-- Logs begin at Tue 2022-09-06 09:50:21 UTC, end at Tue 2022-09-06 12:36:22 UTC. -- Sep 06 10:39:07.334152 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 10:39:07.342716 ncdv-master-1 devstack@n-api.service[124449]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 10:39:07.344924 ncdv-master-1 devstack@n-api.service[124449]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 10:39:07 2022] *** Sep 06 10:39:07.344924 ncdv-master-1 devstack@n-api.service[124449]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 10:39:07.344924 ncdv-master-1 devstack@n-api.service[124449]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 10:39:07.344924 ncdv-master-1 devstack@n-api.service[124449]: nodename: ncdv-master-1 Sep 06 10:39:07.344924 ncdv-master-1 devstack@n-api.service[124449]: machine: x86_64 Sep 06 10:39:07.344924 ncdv-master-1 devstack@n-api.service[124449]: clock source: unix Sep 06 10:39:07.344924 ncdv-master-1 devstack@n-api.service[124449]: pcre jit disabled Sep 06 10:39:07.344924 ncdv-master-1 devstack@n-api.service[124449]: detected number of CPU cores: 4 Sep 06 10:39:07.344924 ncdv-master-1 devstack@n-api.service[124449]: current working directory: / Sep 06 10:39:07.344924 ncdv-master-1 devstack@n-api.service[124449]: detected binary path: /usr/bin/uwsgi-core Sep 06 10:39:07.345616 ncdv-master-1 devstack@n-api.service[124449]: your processes number limit is 47680 Sep 06 10:39:07.345616 ncdv-master-1 devstack@n-api.service[124449]: your memory page size is 4096 bytes Sep 06 10:39:07.345616 ncdv-master-1 devstack@n-api.service[124449]: detected max file descriptor number: 2048 Sep 06 10:39:07.345616 ncdv-master-1 devstack@n-api.service[124449]: lock engine: pthread robust mutexes Sep 06 10:39:07.345616 ncdv-master-1 devstack@n-api.service[124449]: thunder lock: enabled Sep 06 10:39:07.345616 ncdv-master-1 devstack@n-api.service[124449]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 10:39:07.345616 ncdv-master-1 devstack@n-api.service[124449]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 10:39:07.389865 ncdv-master-1 devstack@n-api.service[124449]: Python main interpreter initialized at 0x5571a64329c0 Sep 06 10:39:07.389865 ncdv-master-1 devstack@n-api.service[124449]: python threads support enabled Sep 06 10:39:07.389865 ncdv-master-1 devstack@n-api.service[124449]: your server socket listen backlog is limited to 100 connections Sep 06 10:39:07.389865 ncdv-master-1 devstack@n-api.service[124449]: your mercy for graceful operations on workers is 90 seconds Sep 06 10:39:07.390187 ncdv-master-1 devstack@n-api.service[124449]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 10:39:07.390267 ncdv-master-1 devstack@n-api.service[124449]: *** Operational MODE: preforking *** Sep 06 10:39:07.390502 ncdv-master-1 devstack@n-api.service[124449]: *** uWSGI is running in multiple interpreter mode *** Sep 06 10:39:07.390502 ncdv-master-1 devstack@n-api.service[124449]: spawned uWSGI master process (pid: 124449) Sep 06 10:39:07.390685 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 06 10:39:07.391366 ncdv-master-1 devstack@n-api.service[124449]: spawned uWSGI worker 1 (pid: 124450, cores: 1) Sep 06 10:39:07.392193 ncdv-master-1 devstack@n-api.service[124449]: spawned uWSGI worker 2 (pid: 124451, cores: 1) Sep 06 10:39:07.392193 ncdv-master-1 devstack@n-api.service[124449]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 10:39:08.684175 ncdv-master-1 devstack@n-api.service[124451]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 10:39:08.685911 ncdv-master-1 devstack@n-api.service[124450]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 10:39:09.363929 ncdv-master-1 devstack@n-api.service[124451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 10:39:09.363929 ncdv-master-1 devstack@n-api.service[124451]: from cryptography.utils import int_from_bytes Sep 06 10:39:09.364202 ncdv-master-1 devstack@n-api.service[124450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 10:39:09.364202 ncdv-master-1 devstack@n-api.service[124450]: from cryptography.utils import int_from_bytes Sep 06 10:39:09.364446 ncdv-master-1 devstack@n-api.service[124451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 10:39:09.364446 ncdv-master-1 devstack@n-api.service[124451]: from cryptography.utils import int_from_bytes Sep 06 10:39:09.364591 ncdv-master-1 devstack@n-api.service[124450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 10:39:09.364591 ncdv-master-1 devstack@n-api.service[124450]: from cryptography.utils import int_from_bytes Sep 06 10:39:11.948744 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 10:39:11.949237 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 10:39:11.949340 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 10:39:11.949684 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 10:39:11.949766 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 10:39:11.949862 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 10:39:11.949944 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 10:39:11.950120 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 10:39:11.950247 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 10:39:11.950503 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.950591 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 10:39:11.950836 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.950932 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.951181 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.951272 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.951501 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.951597 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.951829 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.951926 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.952138 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.952232 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.952452 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.952543 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.952770 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.952857 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.953090 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.953187 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.953347 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.953444 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.953660 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.953753 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.953974 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.954059 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.954288 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.954373 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.954592 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.954679 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.954900 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.954993 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.955236 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.955336 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.955539 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.955637 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.955879 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.955990 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.956188 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.956286 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.956500 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.956678 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.957010 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.957162 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.957323 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.957447 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.957634 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.957748 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.957952 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.958072 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.958290 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.958381 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.958595 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.958681 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.958904 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.958999 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.959234 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.959319 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.959551 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.959682 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.959854 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.959950 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.960173 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.960267 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.960544 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.960638 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.960853 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.960946 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.961165 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.961263 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.961481 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.961626 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.961871 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.961989 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.962181 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.962290 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.962488 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.962582 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.962804 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.962899 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.963130 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.963241 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.963445 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.963531 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.963760 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.963853 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.964075 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.964163 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.964390 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.964484 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.964691 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.964789 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.964994 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.965080 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.965298 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.965391 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.965608 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.965706 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.965922 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.966016 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.966219 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.966315 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.966470 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.966557 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.966759 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.966858 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.967095 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.967212 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.967410 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.967497 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.967727 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.967816 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.967977 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.968075 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.968225 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.968314 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.968540 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.968628 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.968856 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.968955 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.969159 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.969245 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.969462 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.969557 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.969762 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.969848 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.970065 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.970151 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.970367 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.970466 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.970669 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.970755 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.970972 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.971097 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.971836 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.971949 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.972148 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.972242 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.972468 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.972562 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.972787 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.972888 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.973099 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.973233 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.973407 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.973501 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.973729 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.973897 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.974033 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.974119 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.974336 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.974423 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.974661 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.974748 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.974974 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.975100 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.975308 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.975405 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.975625 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.975779 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.975942 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.976037 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.976251 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.976350 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.976557 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.976656 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.976861 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.976956 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.977171 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.977283 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.977489 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.977597 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.977791 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.977886 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.978039 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.978140 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.978335 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.978427 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.978633 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.978732 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.978935 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.979084 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.979263 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.979362 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.979566 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.979658 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.979869 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.979973 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.980166 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.980280 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.980464 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.980554 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.980763 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.980863 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.981064 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.981163 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.981365 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.981454 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.981665 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.981770 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.981967 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.982059 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.982268 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.982359 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.982570 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.982661 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.982866 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.982956 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.983208 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.983302 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.983499 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.983590 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.983812 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.983904 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.984114 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.984206 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.984414 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.984507 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.984716 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.984808 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.985017 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.985118 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.985354 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.985463 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.985621 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.985719 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.985922 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.986019 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.986228 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.986316 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.986530 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.986680 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.986891 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.987552 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.987733 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.987839 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.988057 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.988410 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.988622 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.988716 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.988931 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.989019 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.989229 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.989380 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.989531 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.989617 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.989835 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.989921 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.990136 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.990221 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.990439 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.990534 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.990740 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.990828 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.991059 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.991150 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.991362 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.991462 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.991664 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.991750 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.991961 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.992046 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.992260 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.992354 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.992553 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.992646 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.992852 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.992944 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.993168 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.993288 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.993473 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.993561 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.993775 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.993862 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.994077 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.994164 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.994377 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.994462 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.994694 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:39:11.994781 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.995040 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.995130 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.995378 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.995464 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.995690 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.995778 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.996022 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.996110 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.996356 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.996442 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.996673 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.996818 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.996984 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.997078 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.997298 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.997385 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.997613 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.997709 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.997922 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.998030 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.998231 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.998318 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.998540 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.998640 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.998853 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.998945 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.999195 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.999299 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.999517 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.999612 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.999829 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:11.999924 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.000145 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.000241 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.000461 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.000557 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.000771 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.000866 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.001082 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.001169 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.001404 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.001501 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.001724 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.001813 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.002037 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.002124 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.002352 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.002447 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.002772 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.002867 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.003132 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.003221 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.003451 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.003539 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.003771 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.003856 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.004084 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.004172 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.004395 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.004492 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.004706 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.004795 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.005019 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.005105 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.005340 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.005435 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.005650 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.005738 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.005965 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.006052 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.006281 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.006370 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.006595 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.006681 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.006904 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.006998 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.007238 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.007326 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.007547 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.007643 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.007857 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.007970 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.008169 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.008278 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.008478 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.008581 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.008800 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.008895 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.009121 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.009210 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.009436 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.009524 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.009745 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.009842 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.010058 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.010151 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.010366 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.010453 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.010674 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.010763 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.010983 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.011144 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.011310 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.011400 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.011614 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.011757 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.011915 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.012003 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.012220 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.012306 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.012522 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.012609 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.012829 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.012915 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.013151 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.013236 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.013457 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.013545 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.013774 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.013859 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.014079 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.014174 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.014390 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.014479 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.014701 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.014795 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.015033 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.015136 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.015335 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.015422 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.015644 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.015738 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.015954 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.016053 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.016263 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.016350 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.016571 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.016666 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.016883 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.017026 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.017190 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.017278 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.017497 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.017594 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.017804 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.017891 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.018136 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.018275 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.018451 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.018539 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.018764 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.018853 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.019103 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.019195 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.019415 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.019504 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.019725 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.019814 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.020039 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.020125 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.020347 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.020433 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.020657 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.020746 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.020969 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.021056 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.021305 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.021404 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.021612 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.021699 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.021934 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.022020 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.022253 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.022349 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.022566 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.022653 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.022869 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.022964 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.023204 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.023301 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.023509 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.023634 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.023815 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.023914 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.024124 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.024286 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.024429 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.024522 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.024731 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.024826 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.025036 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.025123 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.025338 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.025425 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.025642 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.025730 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.025944 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.026084 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.026250 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.026382 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.026564 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.026650 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.026865 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.027064 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.027220 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.027317 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.027486 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.027574 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.027794 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.027882 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.028115 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.028204 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.028440 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.028536 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.028768 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.028854 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.029083 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.029171 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.029401 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.029498 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.029710 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.029797 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.030023 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.030108 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.030327 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.030426 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.030635 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.030730 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.030943 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.031052 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.031277 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.031383 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.031587 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.031674 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.031894 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.031987 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.032211 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.032316 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.032519 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.032607 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.032833 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.032946 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.033141 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.033239 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.035105 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.035226 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.035318 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.035399 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.035490 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.035571 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.035571 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.035710 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.035710 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.035867 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.035956 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.036036 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.036113 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.036189 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.036347 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.036464 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.036561 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.036650 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.036729 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.036808 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.037041 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.037138 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.037351 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.037441 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.037658 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.037757 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.037976 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.038112 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.038283 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.038372 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.038600 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.038688 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.038906 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.039027 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.039251 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.039339 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.039560 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.039656 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.039873 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.039968 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.040173 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.040259 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.040486 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.040574 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.040802 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.040896 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.041130 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.041217 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.041438 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.041526 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.041749 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.041838 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.042060 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.042145 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.042365 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.042452 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.042673 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.042761 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.042982 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.043189 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.043308 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.043396 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.043613 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.043745 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.043920 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.044006 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.044231 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.044316 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.044539 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.044627 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.044850 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.044936 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.045152 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.045309 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.045460 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.045554 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.045765 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.045852 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.046070 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.046165 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.046373 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.046460 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.046678 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.046766 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.046992 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.047155 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.047325 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.047412 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.047641 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.047728 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.047958 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.048053 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.048260 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.048347 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.048562 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.048658 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.048877 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.048968 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.049181 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.049276 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.050022 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.050121 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.050330 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.050418 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.050633 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.050721 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.050940 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.051060 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.051294 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.051382 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.051597 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.051693 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.051910 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.051997 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.052227 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.052315 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.052534 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.052622 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.052846 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.052941 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.053149 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.053236 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.053456 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.053544 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.053777 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.053940 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.054075 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.054162 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.054381 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.054468 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.054693 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.054820 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.055003 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.055112 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.055332 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.055421 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.055640 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.055737 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.055949 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.056036 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.056258 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.056352 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.056568 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.056696 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.056882 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.056970 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.057185 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.057272 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.057491 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.057568 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.057805 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.057887 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.058125 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.058384 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.058714 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.058814 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.059056 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.059158 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.059373 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.059460 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.059695 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.059783 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.060035 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.060136 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.060358 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.060454 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.060685 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.060772 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.061001 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.061089 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.061309 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.061398 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.061622 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.061708 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.061927 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.062016 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.062233 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.062327 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.062542 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.062628 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.062845 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.062940 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.063175 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.063263 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.063480 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.063577 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.063786 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.063873 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.064085 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.064172 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.064389 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.064485 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.064695 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.064781 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.065024 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.065120 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.065331 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.065427 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.065633 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.065719 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.065943 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.066031 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.066245 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.066340 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.066550 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.066635 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.066877 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.066973 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.067208 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.067297 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.067515 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.067609 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.067817 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.067917 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.068124 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.068211 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.068448 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.068534 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.068775 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.068860 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.069102 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.069189 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.069437 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.069523 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.069741 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.069827 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.070049 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.070137 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.070372 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.070464 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.070675 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.070777 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.070980 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.071089 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.071308 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.071397 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.071618 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.071713 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.071925 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.072012 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.072227 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.072314 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.072533 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.072628 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.072838 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.072924 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.073148 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.073235 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.073453 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.073549 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.073755 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.073848 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.074058 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.074145 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.074358 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.074445 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.074664 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.074760 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.074970 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.075095 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.075329 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.075418 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.075640 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.075727 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.075948 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.076034 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.076253 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.076340 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.076557 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.076644 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.076861 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.076954 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.077161 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.077252 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.077466 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.077558 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.077767 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.077933 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.078071 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.078158 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.078375 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.078471 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.078680 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.078775 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.078987 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.079127 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.079340 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.079465 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.079645 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.079789 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.079958 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.080262 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.080351 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.080586 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.080679 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.080895 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.080992 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.081197 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.081284 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.081499 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.081600 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.081804 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.081891 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.082113 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.082211 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.082425 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.082520 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.082728 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.082815 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.083055 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.083160 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.083360 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.083456 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.083662 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.083759 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.083963 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.084057 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.084271 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.084367 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.084573 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.084661 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.084873 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.084987 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.085175 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.085273 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.085474 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.085569 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.085776 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.085864 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.086081 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.086168 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.086387 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.086480 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.086695 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.086782 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.087000 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.087100 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.087325 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.087414 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.087634 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.087720 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.087944 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.088039 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.088295 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.088382 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.088597 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.088691 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.088913 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.089000 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.089241 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.089327 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.089554 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.089650 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.089865 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.089953 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.090180 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.090266 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.090482 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.090578 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.090796 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.090882 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.091130 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.091220 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.091442 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.091541 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.091744 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.091832 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.092047 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.092141 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.092354 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.092450 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.092661 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.092747 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.092971 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.093057 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.093287 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.093374 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.093603 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.093690 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.093920 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.094005 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.094223 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.094318 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.094528 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.094623 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.094836 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.094923 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.095167 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.095257 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.095477 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.095565 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.095786 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.095885 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.096099 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.096711 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.096941 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.097027 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.097252 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.097353 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.097561 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.097649 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.097872 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.097959 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.098177 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.098273 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.098485 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.098574 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.098794 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.098888 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.099118 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.099220 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.099440 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.099526 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.099745 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.099831 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.100047 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.100148 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.100354 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.100441 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.100656 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.100742 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.100965 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.101053 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.101268 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.101355 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.101579 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.101701 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.101889 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.102015 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.102322 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.102409 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.102626 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.102712 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.102935 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.103044 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.103269 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.103356 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.103583 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.103668 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.103895 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.103982 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.104199 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.104286 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.104518 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.104612 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.104829 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.104916 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.105204 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.105290 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.105513 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.105612 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.105813 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.105900 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.106114 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.106202 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.106422 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.106517 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.106740 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.106833 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.107075 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.107217 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.107404 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.107576 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.107706 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.107795 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.108011 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.108104 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.108317 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.108412 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.108637 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.108724 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.108944 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.109031 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.109270 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.109365 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.109631 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.109718 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.110004 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.110091 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.110313 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.110410 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.110626 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.110713 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.110947 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.111079 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.111293 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.111382 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.111615 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.111704 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.112460 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.112560 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.112836 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.112923 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.113402 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.113497 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.113721 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.113932 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.114028 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.114262 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.114351 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.114576 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.114676 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.114891 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.114979 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.115221 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.115319 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.115546 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.115635 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.115869 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.115956 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.116184 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.116274 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.116506 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.116593 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.116832 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.116926 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.117230 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.117365 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.117541 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.117644 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.117858 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.117954 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.118180 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.118268 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.118485 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.118572 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.118790 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.118950 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.119122 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.119211 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.119439 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.119527 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.119745 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.119842 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.120067 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.120153 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.120372 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.120459 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.120682 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.120779 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.120992 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.121079 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.121299 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.121393 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.121601 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.121697 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.121905 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.122000 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.122216 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.122303 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.122518 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.122606 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.122838 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.122969 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.123172 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.123260 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.123493 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.123583 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.123813 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.123899 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.124117 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.124203 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.124428 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.124515 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.124732 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.124819 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.125034 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.125133 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.125338 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.125425 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.125640 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.125728 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.125944 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.126039 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.126271 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.126357 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.126585 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.126679 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.126909 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.127023 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.127260 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.127381 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.127597 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.127688 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.127928 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.128024 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.128251 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.128345 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.128571 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.128658 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.128881 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.128970 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.129197 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.129285 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.129518 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.129604 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.129823 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.129911 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.130129 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.130216 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.130437 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.130531 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.130739 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.130830 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.131065 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.131161 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.131372 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.131476 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.131680 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.131766 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.131983 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.132076 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.132287 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.132383 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.132590 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.132684 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.132896 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.132983 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.133205 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.133300 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.133517 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.133604 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.133823 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.133917 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.134128 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.134224 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.134432 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.134524 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.134734 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.134822 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.135060 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.135150 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.135402 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.135504 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.135711 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.135798 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.136028 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.136123 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.136347 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.136433 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.136664 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.136749 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.136984 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.137071 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.137299 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.137386 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.137616 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.137702 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.137932 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.138027 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.138249 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.138382 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.138565 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.138653 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.138874 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.138969 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.139212 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.139301 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.139530 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.139629 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.139845 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.139931 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.140165 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.140365 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.140691 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.140793 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.141003 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.141089 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.141317 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.141404 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.141630 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.141726 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.141943 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.142031 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.142256 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.142343 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.142566 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.142655 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.142876 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.143001 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.143252 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.143343 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.143565 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.143655 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.143878 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.143965 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.144198 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.144285 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.144521 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.144610 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.144848 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.144935 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.145164 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.145260 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.145480 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.145568 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.145796 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.145883 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.146111 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.146207 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.146430 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.146518 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.146764 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.146851 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.147116 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.147208 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.147431 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.147529 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.147743 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.147833 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.148059 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.148149 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.148369 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.148457 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.148682 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.148770 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.148994 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.149081 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.149304 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.149390 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.149620 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.149715 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.149928 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.150015 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.150238 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.150334 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.150551 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.150647 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.150867 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.150962 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.151220 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.151310 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.151538 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.151637 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.151853 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.151941 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.152167 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.152254 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.152484 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.152571 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.152804 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.153013 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.153328 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.153418 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.153649 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.153745 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.153971 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.154058 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.154293 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.154380 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.154609 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.154697 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.154929 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.155037 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.155280 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.155377 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.155586 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.155680 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.155890 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.155978 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.156199 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.156299 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.156506 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.156594 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.156809 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.156904 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.157118 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.157214 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.157429 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.157524 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.157779 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.157881 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.158042 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.158138 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.158346 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.158434 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.159185 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.159413 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.159741 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.159831 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.160072 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.160158 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.160400 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.160495 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.160727 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.160816 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.161045 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.161132 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.161355 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.161443 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.161665 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.161760 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.161976 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.162066 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.162286 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.162373 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.162592 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.162680 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.162903 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.162989 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.163234 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.163343 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.163543 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.163631 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.163851 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.163939 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.164164 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.164260 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.164466 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.164553 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.164774 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.164861 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.165078 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.165174 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.165384 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.165471 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.165698 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.165791 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.166005 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.166102 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.166308 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.166403 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.166614 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.166701 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.166917 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.167041 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.167246 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.167335 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.167555 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.167641 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.167858 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.167946 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.168166 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.168252 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.168466 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.168553 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.168774 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.168863 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.169149 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.169240 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.169377 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.169505 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.169688 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.169777 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.170025 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.170112 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.170330 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.170430 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.170636 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.170723 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.170943 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.171051 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.171271 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.171372 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.171578 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.171665 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.171886 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.171979 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.172200 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.172296 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.172511 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.172598 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.172823 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.172920 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.173134 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.173230 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.173468 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.173562 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.173786 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.174001 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.174368 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.174985 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.175229 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.175377 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.175559 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.175715 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.175899 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.176051 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.176238 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.176362 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.176550 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.176670 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.176861 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.176980 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.177173 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.177305 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.177502 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.177627 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.177821 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.177951 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.178138 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.178234 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.178454 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.178616 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.178775 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.178866 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.179114 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.179206 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.179434 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.179571 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.179749 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.179843 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.180057 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.180146 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.180368 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.180464 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.180676 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.180765 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.180987 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.181082 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.181298 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.181387 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.181609 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.181697 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.181919 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.182005 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.182241 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.182341 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.182560 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.182648 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.182877 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.182965 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.183217 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.183308 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.183536 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.183630 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.183843 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.183939 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.184152 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.184242 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.184461 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.184549 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.184769 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.184865 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.185079 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.185173 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.185401 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.185489 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.185712 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.185807 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.186018 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.186106 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.186339 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.186678 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.186996 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.187095 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.187335 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.187434 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.187661 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.187748 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.187970 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.188103 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.188293 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.188381 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.188615 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.188703 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.188928 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.189017 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.189249 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.189337 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.189560 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.189657 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.189875 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.189989 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.190236 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.190324 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.190561 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.190662 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.190885 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.190973 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.191214 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.191305 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.191519 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.191618 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.191823 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.191918 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.192131 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.192217 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.192448 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.192552 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.192759 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.192847 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.193062 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.193188 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.193365 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.193453 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.193671 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.193764 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.193972 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.194067 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.194428 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.194534 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.194630 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.194712 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.194874 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.194963 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.195209 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.195299 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.195511 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.195597 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.195815 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.195903 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.196116 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.196205 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.196418 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.196516 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.196721 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.196823 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.197022 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.197110 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.197325 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.197412 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.197630 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.197729 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.197935 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.198023 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.198234 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.198321 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.198540 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.198640 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.198839 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.198966 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.199173 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.199262 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.199508 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.199610 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.199820 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.199907 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.200141 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.200231 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.200449 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.200546 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.200761 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.200848 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.201068 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.201155 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.201387 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.201475 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.201704 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.201790 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.202020 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.202109 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.202330 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.202419 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.202643 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.202731 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.202956 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.203074 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.203307 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.203395 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.203624 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.203713 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.203932 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.204032 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.204242 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.204331 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.204552 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.204647 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.204865 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.204961 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.205195 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.205282 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.205504 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.205619 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.205852 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.205951 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.206169 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.206311 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.206488 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.206618 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.206806 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.206898 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.207144 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.207238 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.207462 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.207550 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.216362 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.216483 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.216572 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.216652 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.216731 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.216810 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.216899 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.216981 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.217060 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.217138 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.217217 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.217304 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.217384 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.217463 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.217542 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.217620 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.217699 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.217791 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.217873 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.217959 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.218040 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.218119 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.218197 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.218284 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.218354 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.218427 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.218506 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.218592 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.218685 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.218766 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.218844 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.218931 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.219027 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.219099 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.219178 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.219260 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.219340 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.219419 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.219497 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.219575 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.219665 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.219746 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.219825 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.219916 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.219998 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 10:39:12.220086 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:39:12.220086 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 10:39:12.280440 ncdv-master-1 devstack@n-api.service[124450]: INFO dbcounter [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Registered counter for database nova_api Sep 06 10:39:12.280591 ncdv-master-1 devstack@n-api.service[124451]: INFO dbcounter [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] Registered counter for database nova_api Sep 06 10:39:12.302609 ncdv-master-1 devstack@n-api.service[124451]: DEBUG oslo_db.sqlalchemy.engines [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:39:12.304254 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_db.sqlalchemy.engines [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:39:12.309171 ncdv-master-1 devstack@n-api.service[124451]: DEBUG dbcounter [-] [124451] Writer thread running {{(pid=124451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:39:12.310902 ncdv-master-1 devstack@n-api.service[124450]: DEBUG dbcounter [-] [124450] Writer thread running {{(pid=124450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:39:12.364697 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.context [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a5a6b47c-7522-4a84-9be6-8ca7130ab6d7(cell1) {{(pid=124451) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 10:39:12.366182 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.context [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a5a6b47c-7522-4a84-9be6-8ca7130ab6d7(cell1) {{(pid=124450) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 10:39:12.368551 ncdv-master-1 devstack@n-api.service[124451]: DEBUG oslo_concurrency.lockutils [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:39:12.369023 ncdv-master-1 devstack@n-api.service[124451]: DEBUG oslo_concurrency.lockutils [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:39:12.370022 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:39:12.370496 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:39:12.370601 ncdv-master-1 devstack@n-api.service[124451]: DEBUG oslo_concurrency.lockutils [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:39:12.371321 ncdv-master-1 devstack@n-api.service[124451]: DEBUG oslo_concurrency.lockutils [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:39:12.371765 ncdv-master-1 devstack@n-api.service[124451]: DEBUG oslo_concurrency.lockutils [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:39:12.372102 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:39:12.372815 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:39:12.373264 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:39:12.373730 ncdv-master-1 devstack@n-api.service[124451]: DEBUG oslo_concurrency.lockutils [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:39:12.375290 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:39:12.375701 ncdv-master-1 devstack@n-api.service[124451]: INFO dbcounter [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] Registered counter for database nova_cell0 Sep 06 10:39:12.377249 ncdv-master-1 devstack@n-api.service[124450]: INFO dbcounter [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Registered counter for database nova_cell0 Sep 06 10:39:12.380995 ncdv-master-1 devstack@n-api.service[124451]: INFO dbcounter [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] Registered counter for database nova_cell1 Sep 06 10:39:12.382792 ncdv-master-1 devstack@n-api.service[124450]: INFO dbcounter [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Registered counter for database nova_cell1 Sep 06 10:39:12.388069 ncdv-master-1 devstack@n-api.service[124451]: DEBUG oslo_db.sqlalchemy.engines [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:39:12.390550 ncdv-master-1 devstack@n-api.service[124451]: DEBUG oslo_db.sqlalchemy.engines [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:39:12.391581 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_db.sqlalchemy.engines [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:39:12.394644 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_db.sqlalchemy.engines [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:39:12.394763 ncdv-master-1 devstack@n-api.service[124451]: DEBUG dbcounter [-] [124451] Writer thread running {{(pid=124451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:39:12.398776 ncdv-master-1 devstack@n-api.service[124450]: DEBUG dbcounter [-] [124450] Writer thread running {{(pid=124450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:39:12.404437 ncdv-master-1 devstack@n-api.service[124450]: DEBUG dbcounter [-] [124450] Writer thread running {{(pid=124450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:39:12.535706 ncdv-master-1 devstack@n-api.service[124451]: DEBUG dbcounter [-] [124451] Writer thread running {{(pid=124451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:39:12.543870 ncdv-master-1 devstack@n-api.service[124450]: INFO dbcounter [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Registered counter for database nova_cell0 Sep 06 10:39:12.544360 ncdv-master-1 devstack@n-api.service[124451]: INFO dbcounter [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] Registered counter for database nova_cell0 Sep 06 10:39:12.552726 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_db.sqlalchemy.engines [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:39:12.554468 ncdv-master-1 devstack@n-api.service[124451]: DEBUG oslo_db.sqlalchemy.engines [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:39:12.557202 ncdv-master-1 devstack@n-api.service[124450]: DEBUG dbcounter [-] [124450] Writer thread running {{(pid=124450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:39:12.558905 ncdv-master-1 devstack@n-api.service[124451]: DEBUG dbcounter [-] [124451] Writer thread running {{(pid=124451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:39:13.105987 ncdv-master-1 devstack@n-api.service[124450]: WARNING keystonemiddleware.auth_token [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 10:39:13.170623 ncdv-master-1 devstack@n-api.service[124450]: WARNING keystonemiddleware.auth_token [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 10:39:13.214065 ncdv-master-1 devstack@n-api.service[124451]: WARNING keystonemiddleware.auth_token [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 10:39:13.221995 ncdv-master-1 devstack@n-api.service[124451]: WARNING keystonemiddleware.auth_token [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 10:39:13.344296 ncdv-master-1 devstack@n-api.service[124450]: WARNING keystonemiddleware.auth_token [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 10:39:13.350909 ncdv-master-1 devstack@n-api.service[124450]: WARNING keystonemiddleware.auth_token [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 10:39:13.356234 ncdv-master-1 devstack@n-api.service[124450]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5571a64329c0 pid: 124450 (default app) Sep 06 10:39:13.358306 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:39:13.359529 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001770 Sep 06 10:39:13.359953 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Tue Sep 6 10:39:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:39:13.443216 ncdv-master-1 devstack@n-api.service[124451]: WARNING keystonemiddleware.auth_token [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 10:39:13.449141 ncdv-master-1 devstack@n-api.service[124451]: WARNING keystonemiddleware.auth_token [None req-743cb339-42fd-4e9a-b97f-a41d31b0718b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 10:39:13.454180 ncdv-master-1 devstack@n-api.service[124451]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5571a64329c0 pid: 124451 (default app) Sep 06 10:40:40.724600 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:40:40.725611 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 06 10:40:40.726014 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:40:40.738424 ncdv-master-1 devstack@n-api.service[124451]: DEBUG dbcounter [-] [124451] Writing DB stats nova_api:SELECT=3 {{(pid=124451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:40.739512 ncdv-master-1 devstack@n-api.service[124451]: DEBUG dbcounter [-] [124451] Writing DB stats nova_cell1:SELECT=3 {{(pid=124451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:40.740185 ncdv-master-1 devstack@n-api.service[124451]: DEBUG dbcounter [-] [124451] Writing DB stats nova_cell0:SELECT=3 {{(pid=124451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:40.740901 ncdv-master-1 devstack@n-api.service[124451]: DEBUG dbcounter [-] [124451] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:41.623149 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-009c072e-67e4-4dfa-a8ce-7163783d9413 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:40:41.655196 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-009c072e-67e4-4dfa-a8ce-7163783d9413 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.921999 Sep 06 10:40:41.656030 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 6 10:40:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:40:44.339167 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:40:44.340172 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-b1e7c4fb-a387-4706-80ba-4aaf66129750 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 06 10:40:44.340557 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:40:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:40:44.749157 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-670c8d6e-f3b9-48c3-9109-89dcae6e8288 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "name": "cirros256", "vcpus": 1, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:40:44.858860 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-670c8d6e-f3b9-48c3-9109-89dcae6e8288 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.504974 Sep 06 10:40:44.858860 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 10:40:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:40:45.098857 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-55903bd5-f989-4dfe-b242-0121821ddf4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:40:45.105333 ncdv-master-1 devstack@n-api.service[124450]: DEBUG dbcounter [-] [124450] Writing DB stats nova_api:SELECT=3 {{(pid=124450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:45.106227 ncdv-master-1 devstack@n-api.service[124450]: DEBUG dbcounter [-] [124450] Writing DB stats nova_cell1:SELECT=3 {{(pid=124450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:45.107212 ncdv-master-1 devstack@n-api.service[124450]: DEBUG dbcounter [-] [124450] Writing DB stats nova_cell0:SELECT=3 {{(pid=124450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:45.107965 ncdv-master-1 devstack@n-api.service[124450]: DEBUG dbcounter [-] [124450] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:45.204748 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-55903bd5-f989-4dfe-b242-0121821ddf4e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.338528 Sep 06 10:40:45.205326 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 6 10:40:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:40:47.938713 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-670c8d6e-f3b9-48c3-9109-89dcae6e8288 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:40:47.940374 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-670c8d6e-f3b9-48c3-9109-89dcae6e8288 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 Sep 06 10:40:47.940923 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:40:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:40:48.738325 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-6ab85dfb-76de-4fb0-abf2-ae96e57174dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:40:48.858935 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-6ab85dfb-76de-4fb0-abf2-ae96e57174dd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.911362 Sep 06 10:40:48.860201 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 10:40:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:40:48.874677 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-9e14b01c-4d36-4d94-b2da-91ea0ac61831 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:40:49.010457 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-9e14b01c-4d36-4d94-b2da-91ea0ac61831 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141782 Sep 06 10:40:49.011838 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 6 10:40:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:40:52.076216 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-6ab85dfb-76de-4fb0-abf2-ae96e57174dd admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:40:52.088051 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-6ab85dfb-76de-4fb0-abf2-ae96e57174dd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.014094 Sep 06 10:40:52.092476 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:40:52 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:40:52.518835 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-f87c6049-cdb4-4d5b-935f-0f98c7a6fdfe admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "disk": 10, "name": "ds1G"}} {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:40:52.616927 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-f87c6049-cdb4-4d5b-935f-0f98c7a6fdfe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.521266 Sep 06 10:40:52.617855 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 10:40:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:40:52.632540 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-9f9ff061-9ee6-40b6-a504-ac287f897d5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:40:52.730545 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-9f9ff061-9ee6-40b6-a504-ac287f897d5b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103688 Sep 06 10:40:52.747757 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 6 10:40:52 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:40:55.834647 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-f87c6049-cdb4-4d5b-935f-0f98c7a6fdfe admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:40:55.835854 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-f87c6049-cdb4-4d5b-935f-0f98c7a6fdfe admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Sep 06 10:40:55.836362 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:40:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:40:56.245915 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-9171ab58-9888-4efc-abbe-24cd899bc9f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:40:56.307801 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-9171ab58-9888-4efc-abbe-24cd899bc9f3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464955 Sep 06 10:40:56.308362 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 10:40:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 10:40:56.321241 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-3402b105-5b20-4122-953f-3c1ba1488930 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:40:56.391445 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-3402b105-5b20-4122-953f-3c1ba1488930 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074124 Sep 06 10:40:56.392124 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 6 10:40:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:40:59.282333 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-9171ab58-9888-4efc-abbe-24cd899bc9f3 admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:40:59.283422 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-9171ab58-9888-4efc-abbe-24cd899bc9f3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 06 10:40:59.283834 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:40:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:40:59.730793 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-ff141603-36a9-4cad-94b4-a4c91150e0d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "id": "d4"}} {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:40:59.804628 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-ff141603-36a9-4cad-94b4-a4c91150e0d0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514496 Sep 06 10:40:59.805363 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 10:40:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:40:59.818380 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-0d738f09-03ae-4b22-adfc-361c0e64375e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:40:59.894752 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-0d738f09-03ae-4b22-adfc-361c0e64375e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080276 Sep 06 10:40:59.895294 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 6 10:40:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:41:02.638778 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-ff141603-36a9-4cad-94b4-a4c91150e0d0 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:02.640872 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-ff141603-36a9-4cad-94b4-a4c91150e0d0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002444 Sep 06 10:41:02.641550 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:41:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:03.072690 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-196f4e5a-eee9-4278-92e9-ad70977ddd71 admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:03.097170 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-196f4e5a-eee9-4278-92e9-ad70977ddd71 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.448445 Sep 06 10:41:03.099135 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 6 10:41:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:41:06.126224 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-ff141603-36a9-4cad-94b4-a4c91150e0d0 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:06.127306 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-ff141603-36a9-4cad-94b4-a4c91150e0d0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 06 10:41:06.127711 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:41:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:06.561146 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-8720eff2-ba76-48d5-b7c0-2c429cb79d13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "vcpus": 1}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:06.722782 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-8720eff2-ba76-48d5-b7c0-2c429cb79d13 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.588895 Sep 06 10:41:06.794451 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 10:41:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 10:41:06.794621 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-20a3f58a-048a-453d-a061-ad22f2a92f7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:06.980335 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-20a3f58a-048a-453d-a061-ad22f2a92f7c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.247497 Sep 06 10:41:06.980914 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 6 10:41:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:41:09.820329 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-8720eff2-ba76-48d5-b7c0-2c429cb79d13 admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:09.821273 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-8720eff2-ba76-48d5-b7c0-2c429cb79d13 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 06 10:41:09.821673 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:41:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:10.219152 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-91651677-5e70-48bd-84ed-245f9e064506 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0}} {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:10.327357 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-91651677-5e70-48bd-84ed-245f9e064506 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.498951 Sep 06 10:41:10.328617 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 10:41:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 10:41:10.340608 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-347a63c8-9d04-4a78-b6de-012ea15d8ef3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:10.401732 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-347a63c8-9d04-4a78-b6de-012ea15d8ef3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064943 Sep 06 10:41:10.402262 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 6 10:41:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:41:13.100745 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-91651677-5e70-48bd-84ed-245f9e064506 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:13.101762 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-91651677-5e70-48bd-84ed-245f9e064506 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 06 10:41:13.102173 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:41:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:13.537305 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-eb7acb7a-e4e7-4f85-bf93-d2e833cf4a23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "ram": 4096, "swap": 0}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:13.610262 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-eb7acb7a-e4e7-4f85-bf93-d2e833cf4a23 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.501259 Sep 06 10:41:13.610804 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 10:41:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:41:13.623224 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-7fc08f64-1bee-4b94-826d-0c5377ddc743 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:13.628008 ncdv-master-1 devstack@n-api.service[124451]: DEBUG dbcounter [-] [124451] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=124451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:13.739621 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-7fc08f64-1bee-4b94-826d-0c5377ddc743 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120049 Sep 06 10:41:13.740373 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 6 10:41:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:41:16.557541 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-eb7acb7a-e4e7-4f85-bf93-d2e833cf4a23 admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:16.557541 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-eb7acb7a-e4e7-4f85-bf93-d2e833cf4a23 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 06 10:41:16.557541 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:41:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:16.991228 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-5fb784e5-e647-4523-a052-711dc37d28fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:17.121739 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-5fb784e5-e647-4523-a052-711dc37d28fe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.565077 Sep 06 10:41:17.121739 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 10:41:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:41:17.125511 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-f01215bb-7b0a-4f7a-94c5-1bf04427a713 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:17.230843 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-f01215bb-7b0a-4f7a-94c5-1bf04427a713 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109976 Sep 06 10:41:17.231760 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 6 10:41:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:41:19.996078 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-5fb784e5-e647-4523-a052-711dc37d28fe admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:19.997129 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-5fb784e5-e647-4523-a052-711dc37d28fe admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 06 10:41:19.997524 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:41:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:20.438833 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-7dfe02d7-6615-4222-aa24-b3cc69fbfbbd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "rxtx_factor": 1.0}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:20.445559 ncdv-master-1 devstack@n-api.service[124450]: DEBUG dbcounter [-] [124450] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=124450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:20.535275 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-7dfe02d7-6615-4222-aa24-b3cc69fbfbbd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.531591 Sep 06 10:41:20.536329 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 10:41:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:41:20.548705 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-84295832-cc82-4c64-8342-7ad477bad70d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:20.659268 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-84295832-cc82-4c64-8342-7ad477bad70d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114434 Sep 06 10:41:20.660568 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 6 10:41:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:41:41.269750 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-7dfe02d7-6615-4222-aa24-b3cc69fbfbbd admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:41.270774 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-7dfe02d7-6615-4222-aa24-b3cc69fbfbbd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 06 10:41:41.271218 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:41:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:41.282172 ncdv-master-1 devstack@n-api.service[124451]: DEBUG dbcounter [-] [124451] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=124451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:41.660033 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-7b903e9d-429a-4e5e-a7ae-f467b432f822 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:41.677633 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-7b903e9d-429a-4e5e-a7ae-f467b432f822 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399892 Sep 06 10:41:41.678163 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 6 10:41:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:41:42.819873 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-7dfe02d7-6615-4222-aa24-b3cc69fbfbbd admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:42.820876 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-7dfe02d7-6615-4222-aa24-b3cc69fbfbbd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 06 10:41:42.821271 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 10:41:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:43.406203 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-f21594ea-efc9-42c4-9a69-78d2f61c2a8f admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:43.411827 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.wsgi [None req-f21594ea-efc9-42c4-9a69-78d2f61c2a8f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-f21594ea-efc9-42c4-9a69-78d2f61c2a8f admin admin] Request method failure captured: Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: Accept: application/json Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: Accept-Encoding: gzip, deflate Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: Connection: keep-alive Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: Content-Length: 0 Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: Host: 10.222.0.20 Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: Openstack-Api-Version: compute 2.92 Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: Openstack-System-Scope: None Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: User-Agent: python-novaclient Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: X-Auth-Token: gAAAAABjFyPmEiD0aCWg2agDRi3Fd3tZM3z0MZx74ljvLf5cpwI3Ilq6HJte8jVziHY2nJJfCTyv_x7qzZzF2WzNIwKaohc-BwQGH9IdUAqGsM5kOH4LUWHH78ZhGCzOcxHN8kwAoNjmh2fO4dFxIM-XVfU_wlcVq_Y5B-EHJfPpUjV26MNwGRw Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: X-Domain-Id: None Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: X-Domain-Name: None Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: X-Identity-Status: Confirmed Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: X-Is-Admin-Project: True Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: X-Project-Domain-Id: default Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: X-Project-Domain-Name: Default Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: X-Project-Id: bd30074e8f6b499db04c6cc2b896adb1 Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: X-Project-Name: admin Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: X-Role: admin,member,reader Sep 06 10:41:43.418050 ncdv-master-1 devstack@n-api.service[124451]: X-Roles: admin,member,reader Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd30074e8f6b499db04c6cc2b896adb1"}]}] Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: X-Tenant: admin Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: X-Tenant-Id: bd30074e8f6b499db04c6cc2b896adb1 Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: X-Tenant-Name: admin Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: X-User: admin Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: X-User-Domain-Id: default Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: X-User-Domain-Name: Default Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: X-User-Id: a9bd1fec8f644330ae0ff1570223a1be Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: X-User-Name: admin Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: method: > Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: exception: Flavor 42 could not be found. Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: action_args: {'id': '42'} Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:41:43.419777 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:41:43.420766 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:43.421913 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-f21594ea-efc9-42c4-9a69-78d2f61c2a8f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:41:43.422952 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-f21594ea-efc9-42c4-9a69-78d2f61c2a8f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.400610 Sep 06 10:41:43.422952 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 6 10:41:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:43.429747 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-17da14c2-9b71-4e40-b337-5194601817cd admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:43.452029 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-17da14c2-9b71-4e40-b337-5194601817cd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026303 Sep 06 10:41:43.452569 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 6 10:41:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:41:43.476413 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-fc707b86-cb17-4b51-a67e-39213741ba3e admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:43.499418 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-fc707b86-cb17-4b51-a67e-39213741ba3e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026666 Sep 06 10:41:43.499958 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 6 10:41:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:41:43.510126 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-c42a810c-c041-42f2-b51e-6d927dccc757 admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:43.515897 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.wsgi [None req-c42a810c-c041-42f2-b51e-6d927dccc757 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-c42a810c-c041-42f2-b51e-6d927dccc757 admin admin] Request method failure captured: Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: Accept: application/json Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: Accept-Encoding: gzip, deflate Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: Connection: keep-alive Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: Content-Length: 0 Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: Host: 10.222.0.20 Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: Openstack-Api-Version: compute 2.92 Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: Openstack-System-Scope: None Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: User-Agent: python-novaclient Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: X-Auth-Token: gAAAAABjFyPmEiD0aCWg2agDRi3Fd3tZM3z0MZx74ljvLf5cpwI3Ilq6HJte8jVziHY2nJJfCTyv_x7qzZzF2WzNIwKaohc-BwQGH9IdUAqGsM5kOH4LUWHH78ZhGCzOcxHN8kwAoNjmh2fO4dFxIM-XVfU_wlcVq_Y5B-EHJfPpUjV26MNwGRw Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: X-Domain-Id: None Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: X-Domain-Name: None Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: X-Identity-Status: Confirmed Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: X-Is-Admin-Project: True Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: X-Project-Domain-Id: default Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: X-Project-Domain-Name: Default Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: X-Project-Id: bd30074e8f6b499db04c6cc2b896adb1 Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: X-Project-Name: admin Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: X-Role: admin,member,reader Sep 06 10:41:43.519208 ncdv-master-1 devstack@n-api.service[124450]: X-Roles: admin,member,reader Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd30074e8f6b499db04c6cc2b896adb1"}]}] Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: X-Tenant: admin Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: X-Tenant-Id: bd30074e8f6b499db04c6cc2b896adb1 Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: X-Tenant-Name: admin Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: X-User: admin Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: X-User-Domain-Id: default Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: X-User-Domain-Name: Default Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: X-User-Id: a9bd1fec8f644330ae0ff1570223a1be Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: X-User-Name: admin Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: method: > Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: exception: Flavor 42 could not be found. Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: action_args: {'id': '42'} Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:41:43.527800 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:41:43.528805 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:43.530308 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-c42a810c-c041-42f2-b51e-6d927dccc757 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:41:43.531905 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-c42a810c-c041-42f2-b51e-6d927dccc757 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014974 Sep 06 10:41:43.531905 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 6 10:41:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:44.501514 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-fc707b86-cb17-4b51-a67e-39213741ba3e admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:44.502580 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-fc707b86-cb17-4b51-a67e-39213741ba3e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 06 10:41:44.502990 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 10:41:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:45.040972 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-7b5f19a8-fd77-4f11-8455-f63106f270be admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:45.046198 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.wsgi [None req-7b5f19a8-fd77-4f11-8455-f63106f270be admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-7b5f19a8-fd77-4f11-8455-f63106f270be admin admin] Request method failure captured: Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: Accept: application/json Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: Accept-Encoding: gzip, deflate Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: Connection: keep-alive Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: Content-Length: 0 Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: Host: 10.222.0.20 Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: Openstack-Api-Version: compute 2.92 Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: Openstack-System-Scope: None Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: User-Agent: python-novaclient Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: X-Auth-Token: gAAAAABjFyPoaUTkikOcLleIEpzbCBqUTTIJXnUvnROQfyTvQyczC44h80UTHoZKyEe8NQacvDdJn3CHfcGxhQFcciLx_winQc4E84cCxUae_iDWxHVaWic33BEb2n09DM3zOKXZfQyFdfG2j95QgZLvPAuOnjOLtVyD9bcItNLeBY42FFJb-9c Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: X-Domain-Id: None Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: X-Domain-Name: None Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: X-Identity-Status: Confirmed Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: X-Is-Admin-Project: True Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: X-Project-Domain-Id: default Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: X-Project-Domain-Name: Default Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: X-Project-Id: bd30074e8f6b499db04c6cc2b896adb1 Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: X-Project-Name: admin Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: X-Role: admin,member,reader Sep 06 10:41:45.047730 ncdv-master-1 devstack@n-api.service[124450]: X-Roles: admin,member,reader Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd30074e8f6b499db04c6cc2b896adb1"}]}] Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: X-Tenant: admin Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: X-Tenant-Id: bd30074e8f6b499db04c6cc2b896adb1 Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: X-Tenant-Name: admin Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: X-User: admin Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: X-User-Domain-Id: default Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: X-User-Domain-Name: Default Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: X-User-Id: a9bd1fec8f644330ae0ff1570223a1be Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: X-User-Name: admin Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: method: > Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: exception: Flavor 84 could not be found. Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: action_args: {'id': '84'} Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:41:45.049233 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:41:45.050196 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:45.051608 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-7b5f19a8-fd77-4f11-8455-f63106f270be admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:41:45.052815 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-7b5f19a8-fd77-4f11-8455-f63106f270be admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.399824 Sep 06 10:41:45.052815 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 6 10:41:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:45.059279 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-85228dc0-090d-47ae-80de-a3e33cce9450 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:45.074474 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-85228dc0-090d-47ae-80de-a3e33cce9450 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019323 Sep 06 10:41:45.074995 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 6 10:41:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:41:45.084058 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-1e3bbd2a-0df5-4e53-9e44-133e3cd095d3 admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:45.098529 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-1e3bbd2a-0df5-4e53-9e44-133e3cd095d3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017842 Sep 06 10:41:45.099127 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 6 10:41:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:41:45.107811 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-a3b21479-dab5-4427-bcf0-41d749fbd492 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:45.113263 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.wsgi [None req-a3b21479-dab5-4427-bcf0-41d749fbd492 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-a3b21479-dab5-4427-bcf0-41d749fbd492 admin admin] Request method failure captured: Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: Accept: application/json Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: Accept-Encoding: gzip, deflate Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: Connection: keep-alive Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: Content-Length: 0 Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: Host: 10.222.0.20 Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: Openstack-Api-Version: compute 2.92 Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: Openstack-System-Scope: None Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: User-Agent: python-novaclient Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: X-Auth-Token: gAAAAABjFyPoaUTkikOcLleIEpzbCBqUTTIJXnUvnROQfyTvQyczC44h80UTHoZKyEe8NQacvDdJn3CHfcGxhQFcciLx_winQc4E84cCxUae_iDWxHVaWic33BEb2n09DM3zOKXZfQyFdfG2j95QgZLvPAuOnjOLtVyD9bcItNLeBY42FFJb-9c Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: X-Domain-Id: None Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: X-Domain-Name: None Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: X-Identity-Status: Confirmed Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: X-Is-Admin-Project: True Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: X-Project-Domain-Id: default Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: X-Project-Domain-Name: Default Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: X-Project-Id: bd30074e8f6b499db04c6cc2b896adb1 Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: X-Project-Name: admin Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: X-Role: admin,member,reader Sep 06 10:41:45.114760 ncdv-master-1 devstack@n-api.service[124451]: X-Roles: admin,member,reader Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd30074e8f6b499db04c6cc2b896adb1"}]}] Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: X-Tenant: admin Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: X-Tenant-Id: bd30074e8f6b499db04c6cc2b896adb1 Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: X-Tenant-Name: admin Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: X-User: admin Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: X-User-Domain-Id: default Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: X-User-Domain-Name: Default Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: X-User-Id: a9bd1fec8f644330ae0ff1570223a1be Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: X-User-Name: admin Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: method: > Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: exception: Flavor 84 could not be found. Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: action_args: {'id': '84'} Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:41:45.116276 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:41:45.117202 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:45.118823 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-a3b21479-dab5-4427-bcf0-41d749fbd492 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:41:45.119824 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-a3b21479-dab5-4427-bcf0-41d749fbd492 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011767 Sep 06 10:41:45.119824 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 6 10:41:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 10:41:46.091349 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-1e3bbd2a-0df5-4e53-9e44-133e3cd095d3 admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:46.092354 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-1e3bbd2a-0df5-4e53-9e44-133e3cd095d3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Sep 06 10:41:46.092742 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 10:41:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:46.618732 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-1556ccd5-2074-4a31-ae11-021c6b18b8da admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:46.625824 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.wsgi [None req-1556ccd5-2074-4a31-ae11-021c6b18b8da admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-1556ccd5-2074-4a31-ae11-021c6b18b8da admin admin] Request method failure captured: Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: Accept: application/json Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: Accept-Encoding: gzip, deflate Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: Connection: keep-alive Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: Content-Length: 0 Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: Host: 10.222.0.20 Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: Openstack-Api-Version: compute 2.92 Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: Openstack-System-Scope: None Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: User-Agent: python-novaclient Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: X-Auth-Token: gAAAAABjFyPpVCuooOrLdCY3XyhV1vEi4gt1rTi9qRDksPPLNR_oWV3Zd4fQa4wJkX43nRfVDegWfCLK5I_wERPy7VuqqO9AAcIRYLPca0nM1R-A50zx09twvFg-fH449I7bpBbZpWS9sgrHfknxxI3z4rY8aRPaan2RC1nJcFsHAhgv47-zZE4 Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: X-Domain-Id: None Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: X-Domain-Name: None Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: X-Identity-Status: Confirmed Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: X-Is-Admin-Project: True Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: X-Project-Domain-Id: default Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: X-Project-Domain-Name: Default Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: X-Project-Id: bd30074e8f6b499db04c6cc2b896adb1 Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: X-Project-Name: admin Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: X-Role: admin,member,reader Sep 06 10:41:46.627494 ncdv-master-1 devstack@n-api.service[124451]: X-Roles: admin,member,reader Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd30074e8f6b499db04c6cc2b896adb1"}]}] Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: X-Tenant: admin Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: X-Tenant-Id: bd30074e8f6b499db04c6cc2b896adb1 Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: X-Tenant-Name: admin Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: X-User: admin Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: X-User-Domain-Id: default Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: X-User-Domain-Name: Default Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: X-User-Id: a9bd1fec8f644330ae0ff1570223a1be Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: X-User-Name: admin Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: method: > Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: exception: Flavor 451 could not be found. Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: action_args: {'id': '451'} Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:41:46.629007 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:41:46.630069 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: ERROR nova.api.openstack.wsgi Sep 06 10:41:46.631482 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-1556ccd5-2074-4a31-ae11-021c6b18b8da admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:41:46.632742 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-1556ccd5-2074-4a31-ae11-021c6b18b8da admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391103 Sep 06 10:41:46.632742 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 6 10:41:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:46.639261 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-9f44155c-bab0-41ca-a19a-83e4acabd521 admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:46.653797 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-9f44155c-bab0-41ca-a19a-83e4acabd521 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018139 Sep 06 10:41:46.654319 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 6 10:41:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:41:46.663527 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:46.678341 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018269 Sep 06 10:41:46.678875 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 6 10:41:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:41:46.688852 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-8c90bf29-3ba1-499e-bff0-dea76fce44c4 admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:46.694138 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.wsgi [None req-8c90bf29-3ba1-499e-bff0-dea76fce44c4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-8c90bf29-3ba1-499e-bff0-dea76fce44c4 admin admin] Request method failure captured: Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: Accept: application/json Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: Accept-Encoding: gzip, deflate Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: Connection: keep-alive Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: Content-Length: 0 Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: Host: 10.222.0.20 Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: Openstack-Api-Version: compute 2.92 Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: Openstack-System-Scope: None Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: User-Agent: python-novaclient Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: X-Auth-Token: gAAAAABjFyPpVCuooOrLdCY3XyhV1vEi4gt1rTi9qRDksPPLNR_oWV3Zd4fQa4wJkX43nRfVDegWfCLK5I_wERPy7VuqqO9AAcIRYLPca0nM1R-A50zx09twvFg-fH449I7bpBbZpWS9sgrHfknxxI3z4rY8aRPaan2RC1nJcFsHAhgv47-zZE4 Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: X-Domain-Id: None Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: X-Domain-Name: None Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: X-Identity-Status: Confirmed Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: X-Is-Admin-Project: True Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: X-Project-Domain-Id: default Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: X-Project-Domain-Name: Default Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: X-Project-Id: bd30074e8f6b499db04c6cc2b896adb1 Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: X-Project-Name: admin Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: X-Role: admin,member,reader Sep 06 10:41:46.695653 ncdv-master-1 devstack@n-api.service[124450]: X-Roles: admin,member,reader Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd30074e8f6b499db04c6cc2b896adb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd30074e8f6b499db04c6cc2b896adb1"}]}] Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: X-Tenant: admin Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: X-Tenant-Id: bd30074e8f6b499db04c6cc2b896adb1 Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: X-Tenant-Name: admin Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: X-User: admin Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: X-User-Domain-Id: default Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: X-User-Domain-Name: Default Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: X-User-Id: a9bd1fec8f644330ae0ff1570223a1be Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: X-User-Name: admin Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: method: > Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: exception: Flavor 451 could not be found. Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: action_args: {'id': '451'} Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:41:46.697803 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:41:46.698747 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: ERROR nova.api.openstack.wsgi Sep 06 10:41:46.699953 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-8c90bf29-3ba1-499e-bff0-dea76fce44c4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:41:46.700933 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-8c90bf29-3ba1-499e-bff0-dea76fce44c4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012318 Sep 06 10:41:46.700933 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 6 10:41:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:47.668035 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:47.669053 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 06 10:41:47.669448 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 10:41:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:48.205232 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-f70fc323-c6f1-45d6-aea2-7d7eda421d49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:48.287704 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-f70fc323-c6f1-45d6-aea2-7d7eda421d49 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.466556 Sep 06 10:41:48.288238 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Sep 6 10:41:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:41:49.260278 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:49.261289 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 06 10:41:49.261680 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 10:41:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:49.787905 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-2315de9b-4584-4934-b11b-3375b35f8473 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:49.864798 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-2315de9b-4584-4934-b11b-3375b35f8473 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.456026 Sep 06 10:41:49.865332 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Sep 6 10:41:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:41:50.860553 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:50.861823 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 06 10:41:50.862219 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 10:41:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:51.386173 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-bd6b8f3c-f3a7-4000-bec4-7e655ba785e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:51.459448 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-bd6b8f3c-f3a7-4000-bec4-7e655ba785e9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.451916 Sep 06 10:41:51.459984 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Sep 6 10:41:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:41:52.443209 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:52.444220 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 06 10:41:52.444617 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 10:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:52.975856 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-f2de78f6-4f53-4af8-a8d6-939dfe89229f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:41:53.059370 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-f2de78f6-4f53-4af8-a8d6-939dfe89229f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.462875 Sep 06 10:41:53.059944 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Sep 6 10:41:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:41:54.035859 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:54.036868 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 06 10:41:54.037260 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 10:41:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:41:54.564268 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-e26c5f03-dc94-4b35-88ec-d21b39cc521c admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:41:54.584033 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-e26c5f03-dc94-4b35-88ec-d21b39cc521c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401442 Sep 06 10:41:54.584559 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Sep 6 10:41:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:42:57.137536 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:42:57.138578 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-85b009c4-62d9-4047-a5f2-c65d3b0dd3e5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 06 10:42:57.138970 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 10:42:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:42:57.146410 ncdv-master-1 devstack@n-api.service[124450]: DEBUG dbcounter [-] [124450] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=124450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:57.526792 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-a7bdeccc-c3db-485d-963a-de9877720c5a admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:42:57.547088 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-a7bdeccc-c3db-485d-963a-de9877720c5a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402037 Sep 06 10:42:57.547630 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 6 10:42:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:42:57.568781 ncdv-master-1 devstack@n-api.service[124451]: DEBUG dbcounter [-] [124451] Writing DB stats nova_api:SELECT=14 {{(pid=124451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:57.572580 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-ced1ed1e-d42e-40e2-aada-4c781d797ac5 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:42:57.579968 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-ced1ed1e-d42e-40e2-aada-4c781d797ac5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012652 Sep 06 10:42:57.580471 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Tue Sep 6 10:42:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:42:57.591932 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-d2aa0229-104a-42d6-b92a-4a55f7664212 admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:42:57.600147 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-d2aa0229-104a-42d6-b92a-4a55f7664212 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011821 Sep 06 10:42:57.601259 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Tue Sep 6 10:42:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:42:57.612704 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-21614d4d-48cf-4bb6-8b5f-d95c89a56295 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:42:57.621233 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-21614d4d-48cf-4bb6-8b5f-d95c89a56295 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012360 Sep 06 10:42:57.621762 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Tue Sep 6 10:42:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:42:57.633138 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-8b0353cc-2ee1-4904-b368-75215afa1f53 admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:42:57.640561 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-8b0353cc-2ee1-4904-b368-75215afa1f53 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011012 Sep 06 10:42:57.641066 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Tue Sep 6 10:42:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:48:36.741047 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-21614d4d-48cf-4bb6-8b5f-d95c89a56295 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:48:36.741047 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-21614d4d-48cf-4bb6-8b5f-d95c89a56295 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 06 10:48:36.741047 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 10:48:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:48:36.889336 ncdv-master-1 devstack@n-api.service[124450]: DEBUG dbcounter [-] [124450] Writing DB stats nova_api:SELECT=6 {{(pid=124450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:48:37.039133 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-2da6c7ab-df04-42d1-9f9e-5ca4bcccd6f9 admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:48:37.042473 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-2da6c7ab-df04-42d1-9f9e-5ca4bcccd6f9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:48:37.042971 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-2da6c7ab-df04-42d1-9f9e-5ca4bcccd6f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:48:37.044112 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-2da6c7ab-df04-42d1-9f9e-5ca4bcccd6f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:48:37.044816 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-2da6c7ab-df04-42d1-9f9e-5ca4bcccd6f9 admin admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:48:37.045257 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-2da6c7ab-df04-42d1-9f9e-5ca4bcccd6f9 admin admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:48:37.045671 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-2da6c7ab-df04-42d1-9f9e-5ca4bcccd6f9 admin admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:48:37.084304 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-2da6c7ab-df04-42d1-9f9e-5ca4bcccd6f9 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.196414 Sep 06 10:48:37.084853 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 6 10:48:36 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:48:37.926703 ncdv-master-1 devstack@n-api.service[124451]: DEBUG nova.api.openstack.wsgi [None req-21614d4d-48cf-4bb6-8b5f-d95c89a56295 admin admin] Calling method '>' {{(pid=124451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:48:37.927757 ncdv-master-1 devstack@n-api.service[124451]: INFO nova.api.openstack.requestlog [None req-21614d4d-48cf-4bb6-8b5f-d95c89a56295 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 06 10:48:37.928139 ncdv-master-1 devstack@n-api.service[124451]: [pid: 124451|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 10:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:48:38.127878 ncdv-master-1 devstack@n-api.service[124450]: DEBUG nova.api.openstack.wsgi [None req-9ba2e896-85e1-46ab-a309-cf99e72e77a1 admin admin] Calling method '>' {{(pid=124450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:48:38.131261 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-9ba2e896-85e1-46ab-a309-cf99e72e77a1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:48:38.131755 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-9ba2e896-85e1-46ab-a309-cf99e72e77a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:48:38.132174 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-9ba2e896-85e1-46ab-a309-cf99e72e77a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:48:38.132868 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-9ba2e896-85e1-46ab-a309-cf99e72e77a1 admin admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:48:38.133308 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-9ba2e896-85e1-46ab-a309-cf99e72e77a1 admin admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:48:38.133718 ncdv-master-1 devstack@n-api.service[124450]: DEBUG oslo_concurrency.lockutils [None req-9ba2e896-85e1-46ab-a309-cf99e72e77a1 admin admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:48:38.157283 ncdv-master-1 devstack@n-api.service[124450]: INFO nova.api.openstack.requestlog [None req-9ba2e896-85e1-46ab-a309-cf99e72e77a1 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.081298 Sep 06 10:48:38.157819 ncdv-master-1 devstack@n-api.service[124450]: [pid: 124450|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 6 10:48:38 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:49:27.215879 ncdv-master-1 devstack@n-api.service[124449]: Tue Sep 6 10:49:27 2022 - graceful shutdown triggered... Sep 06 10:49:27.216419 ncdv-master-1 devstack@n-api.service[124450]: Gracefully killing worker 1 (pid: 124450)... Sep 06 10:49:27.216854 ncdv-master-1 devstack@n-api.service[124451]: Gracefully killing worker 2 (pid: 124451)... Sep 06 10:49:27.216895 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 06 10:49:28.217083 ncdv-master-1 devstack@n-api.service[124449]: worker 1 buried after 1 seconds Sep 06 10:49:28.217083 ncdv-master-1 devstack@n-api.service[124449]: worker 2 buried after 1 seconds Sep 06 10:49:28.217083 ncdv-master-1 devstack@n-api.service[124449]: goodbye to uWSGI. Sep 06 10:49:28.219171 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Sep 06 10:49:28.219770 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 06 10:49:28.222501 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 10:49:28.273537 ncdv-master-1 devstack@n-api.service[140862]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 10:49:28.276251 ncdv-master-1 devstack@n-api.service[140862]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 10:49:28 2022] *** Sep 06 10:49:28.276251 ncdv-master-1 devstack@n-api.service[140862]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 10:49:28.276251 ncdv-master-1 devstack@n-api.service[140862]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 10:49:28.276251 ncdv-master-1 devstack@n-api.service[140862]: nodename: ncdv-master-1 Sep 06 10:49:28.276251 ncdv-master-1 devstack@n-api.service[140862]: machine: x86_64 Sep 06 10:49:28.276251 ncdv-master-1 devstack@n-api.service[140862]: clock source: unix Sep 06 10:49:28.276251 ncdv-master-1 devstack@n-api.service[140862]: pcre jit disabled Sep 06 10:49:28.276251 ncdv-master-1 devstack@n-api.service[140862]: detected number of CPU cores: 4 Sep 06 10:49:28.276251 ncdv-master-1 devstack@n-api.service[140862]: current working directory: / Sep 06 10:49:28.276251 ncdv-master-1 devstack@n-api.service[140862]: detected binary path: /usr/bin/uwsgi-core Sep 06 10:49:28.277118 ncdv-master-1 devstack@n-api.service[140862]: your processes number limit is 47680 Sep 06 10:49:28.277118 ncdv-master-1 devstack@n-api.service[140862]: your memory page size is 4096 bytes Sep 06 10:49:28.277118 ncdv-master-1 devstack@n-api.service[140862]: detected max file descriptor number: 2048 Sep 06 10:49:28.277118 ncdv-master-1 devstack@n-api.service[140862]: lock engine: pthread robust mutexes Sep 06 10:49:28.277118 ncdv-master-1 devstack@n-api.service[140862]: thunder lock: enabled Sep 06 10:49:28.277118 ncdv-master-1 devstack@n-api.service[140862]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 10:49:28.277118 ncdv-master-1 devstack@n-api.service[140862]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 10:49:28.322456 ncdv-master-1 devstack@n-api.service[140862]: Python main interpreter initialized at 0x56196f1749c0 Sep 06 10:49:28.322456 ncdv-master-1 devstack@n-api.service[140862]: python threads support enabled Sep 06 10:49:28.322456 ncdv-master-1 devstack@n-api.service[140862]: your server socket listen backlog is limited to 100 connections Sep 06 10:49:28.322456 ncdv-master-1 devstack@n-api.service[140862]: your mercy for graceful operations on workers is 90 seconds Sep 06 10:49:28.322914 ncdv-master-1 devstack@n-api.service[140862]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 10:49:28.322914 ncdv-master-1 devstack@n-api.service[140862]: *** Operational MODE: preforking *** Sep 06 10:49:28.323164 ncdv-master-1 devstack@n-api.service[140862]: *** uWSGI is running in multiple interpreter mode *** Sep 06 10:49:28.323164 ncdv-master-1 devstack@n-api.service[140862]: spawned uWSGI master process (pid: 140862) Sep 06 10:49:28.323378 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 06 10:49:28.324111 ncdv-master-1 devstack@n-api.service[140862]: spawned uWSGI worker 1 (pid: 140875, cores: 1) Sep 06 10:49:28.324374 ncdv-master-1 devstack@n-api.service[140862]: spawned uWSGI worker 2 (pid: 140876, cores: 1) Sep 06 10:49:28.324527 ncdv-master-1 devstack@n-api.service[140862]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 10:49:29.649413 ncdv-master-1 devstack@n-api.service[140875]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 10:49:29.661816 ncdv-master-1 devstack@n-api.service[140876]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 10:49:30.418459 ncdv-master-1 devstack@n-api.service[140875]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 10:49:30.418459 ncdv-master-1 devstack@n-api.service[140875]: from cryptography.utils import int_from_bytes Sep 06 10:49:30.418765 ncdv-master-1 devstack@n-api.service[140875]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 10:49:30.418765 ncdv-master-1 devstack@n-api.service[140875]: from cryptography.utils import int_from_bytes Sep 06 10:49:30.427294 ncdv-master-1 devstack@n-api.service[140876]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 10:49:30.427294 ncdv-master-1 devstack@n-api.service[140876]: from cryptography.utils import int_from_bytes Sep 06 10:49:30.427593 ncdv-master-1 devstack@n-api.service[140876]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 10:49:30.427593 ncdv-master-1 devstack@n-api.service[140876]: from cryptography.utils import int_from_bytes Sep 06 10:49:32.870544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 10:49:32.871183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 10:49:32.871354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 10:49:32.871730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 10:49:32.871992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 10:49:32.872388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.872724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.873053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.873379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.873716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.874034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.874952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.875308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.875650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.875922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.876245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.876577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.876677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 10:49:32.877063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 10:49:32.877155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.877229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.877434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 10:49:32.877561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.877759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 10:49:32.877876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.878026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 10:49:32.878123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.878427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.878539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.878739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.878852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.879108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.879287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.879457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.879719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.879891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.880056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.880210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.880382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.880537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.880691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.880852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.880995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.881139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.881288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.881433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.881606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.881776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.881928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.882089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.882242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.882397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.882557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.882764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.882921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.883132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.883283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.883445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.883597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.883748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.883902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.884062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.884205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.884361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.885530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.885701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.885868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.886062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.886220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.886367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.886544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.886704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.886862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.887042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.887208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.887354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.887508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.887660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.887811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.887988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.888157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.888309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.888499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.888654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.888825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.889045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.889214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.890240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.890408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.890562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.890718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.890875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.891050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.891050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.891350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.891499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.891652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.891803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.891968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.892121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.892271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.892422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.892587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.892732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.892732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.893074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.893232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.893452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.893607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.893779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.893930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.894073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.894265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.894424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.894576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.894728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.894871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.895102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.895266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.895437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.895595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.895745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.895906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.896057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.896210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.896364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.896514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.896667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.896818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.896968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.897128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.897281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.897432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.897587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.897741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.897892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.898045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.898198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.898351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.898503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.898647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.898798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.898956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.899127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.899281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.899436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.899624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.900078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.900440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.900604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.900765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.900909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.901068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.901229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.901381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.901532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.901683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.901826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.901976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.902146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.902291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.902441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.902585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.902727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.902879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.903069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.903234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.903428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.903588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.903751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.903904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.904066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.904217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.904370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.904527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.904678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.904829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.904973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.905123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.905281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.905431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.905583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.905738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.905889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.906055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.906223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.906373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.906526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.906669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.906820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.906971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.907154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.907309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.907309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.907607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.907749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.907900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.908062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.908212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.908370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.908526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.908526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.908806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.909112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.909266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.909419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.909562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.909712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.909888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.910515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.910674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.910829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.910974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.911165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.911319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.911464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.911614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.911766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.911930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.912083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.912242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.912403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.912564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.912717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.912869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.913022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.913164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.913325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.913476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.913626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.913792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.913946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.914098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.914251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.914394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.914554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.914706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.914860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.915090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.915261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.915414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.915557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.915718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.915862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.916003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.916163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.916309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.916483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.916634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.916777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.916933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.917084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.917237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.917389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.917532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.917682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.917839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.917991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.918134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.918277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.918484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.918649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.918816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.918969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.919146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.919292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.919451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.919598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.919762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.919762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.919762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.919762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.920801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.920983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.921644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.921789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.921940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.922091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.922242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.922399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.922550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.922702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.922844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.922986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.923188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.923426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.923609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.923814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.923971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.923971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.924265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.924419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.924571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.924714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.924865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.925023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.925185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.925330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.925492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.925637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.925778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.925921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.926076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.926219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.926368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.926518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:49:32.926673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.926673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.926968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.927137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.927295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.927457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.927689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.927843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.928008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.928165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.928309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.928462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.928614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.928765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.928915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.929070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.929223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.929385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.929534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.929678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.929835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.929979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.930122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.930283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.930762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.931033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.931207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.931207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.931207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.931207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.931207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.931207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.931207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.931207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.932298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.932298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.932298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.932298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.932861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.933022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.933166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.933309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.933459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.933623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.933775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.933919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.934062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.934203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.934352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.934509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.934660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.934810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.934960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.935163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.935317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.935484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.935649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.935793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.935935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.936079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.936221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.936376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.936526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.936669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.936864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.937524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.937695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.937847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.937847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.938152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.938307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.938458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.938621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.938772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.938924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.939097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.939256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.939400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.939559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.939703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.939853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.940014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.940157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.940347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.940846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.941030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.941262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.941420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.941565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.941716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.941869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.942014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.942157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.942157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.942440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.942593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.942745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.942889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.943058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.943211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.943365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.943521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.943521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.943521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.943521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.943521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.943521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.943521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.944873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.944873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.945164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.945319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.945464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.945617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.945770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.945922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.946072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.946215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.946372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.946516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.946678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.946830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.946982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.947162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.947318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.947469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.947469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.947469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.947878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.948020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.948020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.948308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.948469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.948621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.948775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.948926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.949082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.949235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.949392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.949544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.949687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.949849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.949993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.950135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.950277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.950430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.950581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.950581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.951436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.951597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.951750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.951895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.952076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.952244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.952429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.952583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.952727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.952878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.953034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.953189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.953333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.953475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.953617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.953760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.953911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.954063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.954214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.954364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.954507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.954656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.954818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.955135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.955298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.955451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.955595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.955737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.955894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.956039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.956182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.956325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.956468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.956617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.956775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.956939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.957093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.957245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.957388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.957546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.957692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.957842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.957986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.958136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.958280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.958435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.958579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.958730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.958890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.959107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.959272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.959426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.959571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.959713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.959864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.960008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.960169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.960323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.960475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.960619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.960761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.961256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.961256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.961256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.961256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.961943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.962088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.962230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.962398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.962542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.962684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.962835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.962978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.963147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.963322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.963476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.963620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.963770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.963920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.964064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.964218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.964362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.964505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.964646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.964788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.964930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.965111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.965258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.965410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.965570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.965721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.965879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.966022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.966164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.966306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.966456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.966608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.966766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.966917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.967102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.967262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.967413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.967557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.967709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.967853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.968031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.968176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.968328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.968484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.968641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.968792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.968943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.969097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.969247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.969398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.969549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.969701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.969843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.969992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.970145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.970296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.970449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.970608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.970752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.970893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.970893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.971611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.971882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.971882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.972180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.972325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.972476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.972629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.972780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.972925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.973075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.973219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.973376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.973538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.973731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.973889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.974033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.974183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.974392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.974552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.974697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.974842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.974998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.975176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.975176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.975470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.975614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.975763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.975906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.976056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.976208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.976360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.976360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.976640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.976791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.976948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.977091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.977241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.977400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.977544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.977775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.977943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.978095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.978245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.978395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.978543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.978543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.978849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.979026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.979187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.979348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.979510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.979681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.979845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.980004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.980155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.980305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.980453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.980609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.980843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.980996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.980996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.981624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.981792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.982063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.982236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.982389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.982545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.982696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.982844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.983036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.983207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.983367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.984041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.984211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.984364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.984530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.984692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.984692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.984986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.985144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.985315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.985542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.985542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.985847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.986005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.986155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.986318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.986482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.986643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.986801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.986951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.987137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.987137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.987448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.987599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.987755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.987913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.988064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.988221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.988379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.988537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.988700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.988858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.989017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.989168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.989378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.989532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.989749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.989749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.990090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.991217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.991417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.991921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.992101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.992379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.992379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.992702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.992865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.992865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.993166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.993316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.993476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.993887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.994044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.994208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.994359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.994527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.994527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.994823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.994975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.995254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.995410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.995570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.995732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.995885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.996043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.996208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.996360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.996509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.996683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.996834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.996993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.997151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.997302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.997459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.997625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.997776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.997934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.998086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.998306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.998462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.998626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.998797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.998949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.999125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:32.999846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.000013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.000165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.000325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.000476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.000626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.000784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.000949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.001101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.001259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.001421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.001421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.002052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.002231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.002411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.002659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.002817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.002977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.002977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.003374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.003667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.003824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.003995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.004147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.004313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.004475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.004627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.004786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.004945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.005103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.005265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.005417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.005587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.005748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.005910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.006080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.006245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.006405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.006565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.006565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.006852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.007002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.007231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.007386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.007537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.007686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.007843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.008009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.008172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.008323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.008626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.008787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.008946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.009107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.009267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.009419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.009569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.009718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.009875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.010035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.010185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.010344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.010503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.010663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.010821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.010988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.011193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.011355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.011512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.011664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.012159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.012325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.012486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.012681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.012936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.169762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.170218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.170311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.170410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.170493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.170582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.170671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.170671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.170817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.170903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.170988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.171646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.171732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.171826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.171914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.171986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.172054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.172146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.172218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.172295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.172295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.172426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.172496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.172657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.172739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.172813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.172911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.172911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.172911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.173128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.173204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.173271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.173340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.173422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.173489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.173555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.173628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.173696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.173937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.174999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.175089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.175156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.175300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.175372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.175440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.175507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.175574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.175641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.175716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.175786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.175853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.175920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.175986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.176953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.177991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.178972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.179066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.179138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.179205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.179271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.179337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.179403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.179485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.179581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.179659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.179729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.179797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.179865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.179940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.180982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.181977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.182938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.183973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.184065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.184132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.184199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.184266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.184334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.184334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.184523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.184596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.184664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.184732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.184799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.184799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.184919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.185925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.186000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.186085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.186085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.186217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.186285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.186352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.186420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.186495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.186560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.186627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.187285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.187380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.187380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.187548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.187620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.187688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.187755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.187823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.187890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.187965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.188989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.189064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.189133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.189200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.189275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.189344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.189431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.189504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.189574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.189642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.189731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.189791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.189847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.189925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.190965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.191039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.191100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.191157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.194854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.194929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.194991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.195072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.195147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.195330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.195468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.195597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.195726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.195852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.195978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.196113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.196416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.196556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.196643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.196704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.196917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.196917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.197199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.197199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.197199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.197547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.197683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.197776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.197838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.197895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.198061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.198221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.198371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.198453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.199436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.199573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.199734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.199856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.199967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.200083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.200158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.200228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.200297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.200421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.200546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.200645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.200722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.200792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.200861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.200930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.201008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.201124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.201197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.201316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.201440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.201527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.201600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.201600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.201725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.201794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.201862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.201928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.201988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.202982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.203057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.203128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.203249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.203249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.203249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.203249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.203688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.203785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.203873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.203961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.203961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.204073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.204198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.204299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.204394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.204394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.204587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.204666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.204666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.204666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.204666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.204666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.205232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.205405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.205534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.205632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.205712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.205772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.205842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.205922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.205994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.206065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.206135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.206205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.206275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.206354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.206463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.206541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.206541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.206541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.206736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.206809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.206809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.206986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.207156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.207230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.207345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.207421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.207491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.207491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.207673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.207746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.207858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.207933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.208050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.208125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.208125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.208262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.208335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.208335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.208510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.208583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.208654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.208770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.208850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.208930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.209228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.209312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.209620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.209711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.210000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.210168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.210502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.210616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.210853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.210956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.211239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.211517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.211712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.211992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.212091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.212374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.212467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.212774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.212918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.213099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.213917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.214072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.214141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.214203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.214314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.214379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.214533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.214902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.214994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.215303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.215631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.215740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.215970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.216155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.216502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.216587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.216820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.217058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.217145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.217424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.217510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.217757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.218600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.218708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.218947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.219194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.219324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.219666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.219759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.219957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.220049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.220279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.220359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.220598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.220703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.220927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.221056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.221251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.221409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.221584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.221785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.221906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.222179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.222263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.222506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.222595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.222826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.222906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.223178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.223370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.223499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.223716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.223841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.224047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.224162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.224427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.224510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.224931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.225057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.225383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.225756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.225942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.226214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.226311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.226566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.226648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.226958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.227070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.233660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.234271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.234342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.234404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.234404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.234510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.234586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.234650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.234710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.234710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.234710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.234710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.234958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.235945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.236871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.237194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.237194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.237356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.237435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.237553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.237659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.237740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.237812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.238067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.238154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.238396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.238700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.238798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.239073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.239398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.239540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.239731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.239812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.240057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.240148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.240382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.240463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.240707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.240854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.241029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.241170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.241353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.241484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.241676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.241806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.241998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.242338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.242419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.242709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.242799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.243070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.243223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.243406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.243971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.244053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.244325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.244440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.244662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.244769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.245093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.245172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.245416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.245497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.245731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.245813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.246050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.246130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.246394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.246477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.246723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.247196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.247311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.247438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.247520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.247856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.247970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.248202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.248552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.248879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.249054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.249742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.250034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.250125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.250424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.250632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.250759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.251001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.251121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.251463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.251716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.251826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.251938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.252168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.252250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.252508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.252588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.252828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.252918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.253148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.253229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.253467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.253793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.254126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.254213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.254451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.254531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.254768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.254848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.255139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.255246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.255461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.255549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.255781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.255926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.256098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.256245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.256418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.256576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.256736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.256898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.257061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.257231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.257383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.257556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.257699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.257953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.258051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.258233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.258366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.258558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.258684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.258924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.259126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.259266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.259468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.259599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.259801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.259894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.260144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.260308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.260482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.260612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.260796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.260923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.261109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.261291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.261459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.261544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.261790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.261915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.262129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.262214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.262454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.262535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.262790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.262867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.267628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.267721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.267793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.267854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.267920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.268156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.268249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.268319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.268392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.268465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.268537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.268617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.268691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.268763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.268834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.268905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.268977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.269057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.269130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.269202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.269273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.269344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.269416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.269496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.269569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.269640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.269715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.269786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.269866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.269957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.270025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.270096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.270168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.270235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.270303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.270376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.270376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.270376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.270376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.270617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.270696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.270696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.270827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.271062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.271149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.271374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.271467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.271700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.271884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.272047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.272218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.272374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.272653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.272724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.273243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.273569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.273833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.273976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.274229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.274313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.274521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.274592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.274851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.274929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.275282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.275802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.276171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.276425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.276804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.277179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.277646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.277882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.278036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.278235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.278432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.278569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.278734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.278900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.279125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.279260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.279479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.279583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 10:49:33.279823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.280147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.280493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.281093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.281459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.281798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.282125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.282444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.282762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.283108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.283427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.283745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.284063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.284379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.284702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.285017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.285349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.285648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.285962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.286274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.286586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.286904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.287250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.287563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.288151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.288478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.288835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.289180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.293551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.293551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.293551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.293551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.293551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.293551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.293551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.293551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.294189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.294189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.294189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.294189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.294189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.294189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.294189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.294614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.294781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.295170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.295509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.295826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.296180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.296507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.296838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.297161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.297481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.297874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.298136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.298458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.298776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.299120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.299441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.299768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.300088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.300408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.300732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.301151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.301657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.302072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.302447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.302836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.303142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.303506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.303876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.304231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.304569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.304891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.305212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.305526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:49:33.305774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 10:49:33.348837 ncdv-master-1 devstack@n-api.service[140876]: INFO dbcounter [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] Registered counter for database nova_api Sep 06 10:49:33.369443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:49:33.375879 ncdv-master-1 devstack@n-api.service[140875]: INFO dbcounter [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] Registered counter for database nova_api Sep 06 10:49:33.376996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writer thread running {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:49:33.398241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_db.sqlalchemy.engines [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:49:33.405673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writer thread running {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:49:33.436225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.context [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a5a6b47c-7522-4a84-9be6-8ca7130ab6d7(cell1) {{(pid=140876) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 10:49:33.440833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:49:33.441331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:49:33.442934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:49:33.443711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:49:33.444171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:49:33.446213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:49:33.448264 ncdv-master-1 devstack@n-api.service[140876]: INFO dbcounter [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] Registered counter for database nova_cell0 Sep 06 10:49:33.453398 ncdv-master-1 devstack@n-api.service[140876]: INFO dbcounter [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] Registered counter for database nova_cell1 Sep 06 10:49:33.462014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:49:33.462976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:49:33.470331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.context [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a5a6b47c-7522-4a84-9be6-8ca7130ab6d7(cell1) {{(pid=140875) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 10:49:33.470778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writer thread running {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:49:33.471160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writer thread running {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:49:33.477001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:49:33.477641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:49:33.479417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:49:33.480302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:49:33.480916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:49:33.483135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:49:33.485320 ncdv-master-1 devstack@n-api.service[140875]: INFO dbcounter [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] Registered counter for database nova_cell0 Sep 06 10:49:33.489602 ncdv-master-1 devstack@n-api.service[140875]: INFO dbcounter [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] Registered counter for database nova_cell1 Sep 06 10:49:33.498215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_db.sqlalchemy.engines [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:49:33.501174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_db.sqlalchemy.engines [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:49:33.510128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writer thread running {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:49:33.510510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writer thread running {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:49:33.620552 ncdv-master-1 devstack@n-api.service[140876]: INFO dbcounter [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] Registered counter for database nova_cell0 Sep 06 10:49:33.627844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:49:33.632626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writer thread running {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:49:33.659223 ncdv-master-1 devstack@n-api.service[140875]: INFO dbcounter [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] Registered counter for database nova_cell0 Sep 06 10:49:33.665850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_db.sqlalchemy.engines [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:49:33.670550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writer thread running {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:49:34.073378 ncdv-master-1 devstack@n-api.service[140876]: WARNING keystonemiddleware.auth_token [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 10:49:34.080985 ncdv-master-1 devstack@n-api.service[140876]: WARNING keystonemiddleware.auth_token [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 10:49:34.123706 ncdv-master-1 devstack@n-api.service[140875]: WARNING keystonemiddleware.auth_token [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 10:49:34.132569 ncdv-master-1 devstack@n-api.service[140875]: WARNING keystonemiddleware.auth_token [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 10:49:34.308784 ncdv-master-1 devstack@n-api.service[140876]: WARNING keystonemiddleware.auth_token [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 10:49:34.315552 ncdv-master-1 devstack@n-api.service[140876]: WARNING keystonemiddleware.auth_token [None req-a6e63153-f763-4ad4-9059-5b8156e9065d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 10:49:34.320690 ncdv-master-1 devstack@n-api.service[140876]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56196f1749c0 pid: 140876 (default app) Sep 06 10:49:34.365730 ncdv-master-1 devstack@n-api.service[140875]: WARNING keystonemiddleware.auth_token [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 10:49:34.370315 ncdv-master-1 devstack@n-api.service[140875]: WARNING keystonemiddleware.auth_token [None req-9d66f6c6-db91-4508-961e-ac5c39b65b7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 10:49:34.376198 ncdv-master-1 devstack@n-api.service[140875]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56196f1749c0 pid: 140875 (default app) Sep 06 10:50:18.598935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:18.600539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:18.602303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:18.603256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:19.031928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:19.044494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:19.044494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:19.044494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:19.905794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d81ab1ad-eb88-4730-8d7e-74d989978b0f tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Calling method '.version_select at 0x7f90fa13a3a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:19.915600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d81ab1ad-eb88-4730-8d7e-74d989978b0f tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a5a6b47c-7522-4a84-9be6-8ca7130ab6d7(cell1) {{(pid=140876) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 06 10:50:19.916347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d81ab1ad-eb88-4730-8d7e-74d989978b0f tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:19.916868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d81ab1ad-eb88-4730-8d7e-74d989978b0f tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:19.917310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d81ab1ad-eb88-4730-8d7e-74d989978b0f tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:19.944111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d81ab1ad-eb88-4730-8d7e-74d989978b0f tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:19.944602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d81ab1ad-eb88-4730-8d7e-74d989978b0f tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:19.945055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d81ab1ad-eb88-4730-8d7e-74d989978b0f tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:19.958408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d81ab1ad-eb88-4730-8d7e-74d989978b0f tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:19.958895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d81ab1ad-eb88-4730-8d7e-74d989978b0f tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:19.959370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d81ab1ad-eb88-4730-8d7e-74d989978b0f tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:19.965487 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d81ab1ad-eb88-4730-8d7e-74d989978b0f tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.373917 Sep 06 10:50:19.966052 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1208 bytes} [Tue Sep 6 10:50:18 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:50:20.089332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9fb2922c-5f36-4006-982e-63b615e313b1 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:20.090935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fb2922c-5f36-4006-982e-63b615e313b1 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:20.091449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fb2922c-5f36-4006-982e-63b615e313b1 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:20.091890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fb2922c-5f36-4006-982e-63b615e313b1 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:20.092674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fb2922c-5f36-4006-982e-63b615e313b1 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:20.093134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fb2922c-5f36-4006-982e-63b615e313b1 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:20.093564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fb2922c-5f36-4006-982e-63b615e313b1 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:20.134921 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9fb2922c-5f36-4006-982e-63b615e313b1 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.167762 Sep 06 10:50:20.135531 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2/2] 10.222.0.20 () {58 vars in 1164 bytes} [Tue Sep 6 10:50:19 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:20.203231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b2f6034a-d2f8-4d5b-9629-906e5d8dd8cf tempest-FlavorsV261TestJSON-1607537094 tempest-FlavorsV261TestJSON-1607537094-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1916218288", "id": 1649877577, "os-flavor-access:is_public": "True"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:20.313626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b2fb3617-f85f-4fe9-8d29-bd398adf0fdb tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '.version_select at 0x7f90f9ffa430>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:20.315514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fb3617-f85f-4fe9-8d29-bd398adf0fdb tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:20.316009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fb3617-f85f-4fe9-8d29-bd398adf0fdb tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:20.316456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fb3617-f85f-4fe9-8d29-bd398adf0fdb tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:20.332539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fb3617-f85f-4fe9-8d29-bd398adf0fdb tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:20.333025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fb3617-f85f-4fe9-8d29-bd398adf0fdb tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:20.333481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fb3617-f85f-4fe9-8d29-bd398adf0fdb tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:20.343922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fb3617-f85f-4fe9-8d29-bd398adf0fdb tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:20.344528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fb3617-f85f-4fe9-8d29-bd398adf0fdb tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:20.345075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fb3617-f85f-4fe9-8d29-bd398adf0fdb tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:20.351717 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b2fb3617-f85f-4fe9-8d29-bd398adf0fdb tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.215042 Sep 06 10:50:20.353768 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3/3] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Sep 6 10:50:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:20.365586 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b2f6034a-d2f8-4d5b-9629-906e5d8dd8cf tempest-FlavorsV261TestJSON-1607537094 tempest-FlavorsV261TestJSON-1607537094-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 1.341589 Sep 06 10:50:20.366372 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1/4] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 10:50:19 2022] POST /compute/v2.1/flavors => generated 468 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:50:20.466907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b5d077d3-8b76-4b65-ae64-42da4adf1a77 tempest-AZAdminNegativeTestJSON-2145586194 tempest-AZAdminNegativeTestJSON-2145586194-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:20.469307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b5d077d3-8b76-4b65-ae64-42da4adf1a77 tempest-AZAdminNegativeTestJSON-2145586194 tempest-AZAdminNegativeTestJSON-2145586194-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '5ebcb796fc134c0cadbce30ce9051ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee1411eee0a4ae88a3530c4cb88dfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b5d077d3-8b76-4b65-ae64-42da4adf1a77 tempest-AZAdminNegativeTestJSON-2145586194 tempest-AZAdminNegativeTestJSON-2145586194-project] Request method failure captured: Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyXoWrtZbt_-fG1mvRLievwztUsB_PcwaZRRRMabijSoTN7tP40jJnN6zHfJqDlzOa2yXyoYOXrTTH56t5FqMu9PpjQw_SXj-IWOM4ESRMf7wEV6wa6cQhyr4Ao0-KKV2dAgdd6xXJBZvR1XlyIqGaec2oDx8r9mT0hAmxiFl25_mts Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2ee1411eee0a4ae88a3530c4cb88dfb5 Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2145586194 Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:50:20.473500 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:50:20.474864 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ee1411eee0a4ae88a3530c4cb88dfb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ee1411eee0a4ae88a3530c4cb88dfb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ee1411eee0a4ae88a3530c4cb88dfb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ee1411eee0a4ae88a3530c4cb88dfb5"}]}] Sep 06 10:50:20.474864 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AZAdminNegativeTestJSON-2145586194 Sep 06 10:50:20.474864 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2ee1411eee0a4ae88a3530c4cb88dfb5 Sep 06 10:50:20.474864 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2145586194 Sep 06 10:50:20.474864 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AZAdminNegativeTestJSON-2145586194-project Sep 06 10:50:20.474864 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:50:20.474864 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:50:20.474864 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5ebcb796fc134c0cadbce30ce9051ec8 Sep 06 10:50:20.474864 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AZAdminNegativeTestJSON-2145586194-project Sep 06 10:50:20.474864 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:50:20.474864 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 06 10:50:20.474864 ncdv-master-1 devstack@n-api.service[140876]: action_args: {} Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:50:20.475755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:20.476942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b5d077d3-8b76-4b65-ae64-42da4adf1a77 tempest-AZAdminNegativeTestJSON-2145586194 tempest-AZAdminNegativeTestJSON-2145586194-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:20.477908 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b5d077d3-8b76-4b65-ae64-42da4adf1a77 tempest-AZAdminNegativeTestJSON-2145586194 tempest-AZAdminNegativeTestJSON-2145586194-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.122911 Sep 06 10:50:20.477908 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 4/5] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Sep 6 10:50:20 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 124 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:50:20.490787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1806376093", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:20.731575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-91ca9d7e-00c9-4e1b-82ea-239662f0931c tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1842881971", "id": 369178866, "os-flavor-access:is_public": "False"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:20.901083 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-91ca9d7e-00c9-4e1b-82ea-239662f0931c tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.418025 Sep 06 10:50:20.901678 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 5/6] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:20 2022] POST /compute/v2.1/flavors => generated 428 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:20.906517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-07ebac8d-8500-4ee6-a837-181a10859672 tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1519378332"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:20.910739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.aggregate [None req-07ebac8d-8500-4ee6-a837-181a10859672 tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Generated uuid 42c57efe-cc91-4ebe-9a3c-1ff28195ce79 for aggregate {{(pid=140876) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:50:21.055521 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-07ebac8d-8500-4ee6-a837-181a10859672 tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.152545 Sep 06 10:50:21.057080 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 6/7] 10.222.0.20 () {62 vars in 1205 bytes} [Tue Sep 6 10:50:20 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:50:21.062182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8f820d52-9c56-4585-8868-3b677e2849e3 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:21.064443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f820d52-9c56-4585-8868-3b677e2849e3 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:21.064997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f820d52-9c56-4585-8868-3b677e2849e3 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:21.065441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f820d52-9c56-4585-8868-3b677e2849e3 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:21.066167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f820d52-9c56-4585-8868-3b677e2849e3 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:21.066621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f820d52-9c56-4585-8868-3b677e2849e3 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:21.067075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f820d52-9c56-4585-8868-3b677e2849e3 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:21.093520 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8f820d52-9c56-4585-8868-3b677e2849e3 tempest-AZAdminV2TestJSON-86818258 tempest-AZAdminV2TestJSON-86818258-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.035336 Sep 06 10:50:21.103832 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 7/8] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Sep 6 10:50:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:21.117937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:50:21.287468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f84aec9e-3159-4f3d-bda3-716e32330409 tempest-FlavorsV261TestJSON-805850785 tempest-FlavorsV261TestJSON-805850785-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:21.309756 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f84aec9e-3159-4f3d-bda3-716e32330409 tempest-FlavorsV261TestJSON-805850785 tempest-FlavorsV261TestJSON-805850785-project] 10.222.0.20 "GET /compute/v2.1/flavors/1649877577" status: 200 len: 468 microversion: 2.61 time: 0.214114 Sep 06 10:50:21.310453 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 8/9] 10.222.0.20 () {60 vars in 1199 bytes} [Tue Sep 6 10:50:21 2022] GET /compute/v2.1/flavors/1649877577 => generated 468 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:50:21.315700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9749def1-fc2f-48c2-adb6-e266c0a29ea8 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3fa3489a9bbe41a29a10cb3da1128ca2"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:21.356427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:50:21.356872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:50:21.357315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:50:21.357723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:50:21.358369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:50:21.372516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:21.377856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:21.377856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:21.377856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:21.377856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:21.378265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:21.418523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Getting quotas for project 8f141429ddf044e1812ea5e3dbecd995. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:50:21.428621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Getting quotas for user 3ff6ad8e78ca4b6dbea50007a5737f5e and project 8f141429ddf044e1812ea5e3dbecd995. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:50:21.445456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:50:21.450472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:50:21.613958 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-64d81146-5e85-4ece-8a4e-70e9a4da83fc tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245952 Sep 06 10:50:21.614959 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2/10] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:50:21.635599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-34079789-a56f-4840-ba3e-d05017b64fda tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1629030910"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:21.859209 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9749def1-fc2f-48c2-adb6-e266c0a29ea8 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/369178866/action" status: 200 len: 96 microversion: 2.1 time: 0.546716 Sep 06 10:50:21.865391 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 9/11] 10.222.0.20 () {60 vars in 1197 bytes} [Tue Sep 6 10:50:21 2022] POST /compute/v2.1/flavors/369178866/action => generated 96 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:21.870298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-22842c1e-fc24-462e-8e31-8fbcf5c7ca7f tempest-FlavorsV261TestJSON-1607537094 tempest-FlavorsV261TestJSON-1607537094-project-admin] Action: 'update', calling method: .version_select at 0x7f90fa4f9790>, body: {"flavor": {"description": "new"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:21.964947 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-34079789-a56f-4840-ba3e-d05017b64fda tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.348232 Sep 06 10:50:21.966257 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3/12] 10.222.0.20 () {62 vars in 1210 bytes} [Tue Sep 6 10:50:21 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:50:21.978443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fb2433ce-1d5a-40b2-8d77-4be00c214579 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:21.979992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb2433ce-1d5a-40b2-8d77-4be00c214579 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:22.011895 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-22842c1e-fc24-462e-8e31-8fbcf5c7ca7f tempest-FlavorsV261TestJSON-1607537094 tempest-FlavorsV261TestJSON-1607537094-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1649877577" status: 200 len: 469 microversion: 2.61 time: 0.135663 Sep 06 10:50:22.011895 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 10/13] 10.222.0.20 () {62 vars in 1219 bytes} [Tue Sep 6 10:50:21 2022] PUT /compute/v2.1/flavors/1649877577 => generated 469 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:50:22.103738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb2433ce-1d5a-40b2-8d77-4be00c214579 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:22.121564 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fb2433ce-1d5a-40b2-8d77-4be00c214579 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1220 microversion: 2.1 time: 0.154015 Sep 06 10:50:22.135210 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 4/14] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:21 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1220 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:22.135210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9b3efb8-00e6-4d01-8fda-fa958bc0bb99 tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:22.137473 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e9b3efb8-00e6-4d01-8fda-fa958bc0bb99 tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.013086 Sep 06 10:50:22.138258 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 5/15] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 6 10:50:22 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:50:22.143888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-06e8d4d4-e1fd-4e74-91ae-31f16409edb0 tempest-FlavorsV261TestJSON-805850785 tempest-FlavorsV261TestJSON-805850785-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:22.182710 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-06e8d4d4-e1fd-4e74-91ae-31f16409edb0 tempest-FlavorsV261TestJSON-805850785 tempest-FlavorsV261TestJSON-805850785-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.043176 Sep 06 10:50:22.184015 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 6/16] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Sep 6 10:50:22 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:50:22.194013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9943a2a7-84e7-44a0-ac30-9cf07c06beba tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:22.214052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9943a2a7-84e7-44a0-ac30-9cf07c06beba tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:22.214812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9943a2a7-84e7-44a0-ac30-9cf07c06beba tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:22.215694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9943a2a7-84e7-44a0-ac30-9cf07c06beba tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:22.284563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8ff57ea5-438e-4fff-9308-2159c1986677 tempest-FlavorsAccessTestJSON-1158176142 tempest-FlavorsAccessTestJSON-1158176142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:22.325303 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8ff57ea5-438e-4fff-9308-2159c1986677 tempest-FlavorsAccessTestJSON-1158176142 tempest-FlavorsAccessTestJSON-1158176142-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5827 microversion: 2.1 time: 0.316422 Sep 06 10:50:22.328149 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 11/17] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:22 2022] GET /compute/v2.1/flavors/detail => generated 5827 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:22.336855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-932a344d-521a-472f-bd73-88aecdcbddca tempest-FlavorsV261TestJSON-805850785 tempest-FlavorsV261TestJSON-805850785-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:22.378761 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-932a344d-521a-472f-bd73-88aecdcbddca tempest-FlavorsV261TestJSON-805850785 tempest-FlavorsV261TestJSON-805850785-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.046363 Sep 06 10:50:22.381309 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 12/18] 10.222.0.20 () {60 vars in 1166 bytes} [Tue Sep 6 10:50:22 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:50:22.397509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bbc8cc0b-b410-406c-8570-914bf908be31 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3fa3489a9bbe41a29a10cb3da1128ca2"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:22.727414 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bbc8cc0b-b410-406c-8570-914bf908be31 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/369178866/action" status: 200 len: 21 microversion: 2.1 time: 0.343872 Sep 06 10:50:22.733870 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 13/19] 10.222.0.20 () {60 vars in 1197 bytes} [Tue Sep 6 10:50:22 2022] POST /compute/v2.1/flavors/369178866/action => generated 21 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:22.739507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3ad4660e-174d-478a-bd55-c25aa5a960d9 tempest-FlavorsV261TestJSON-1607537094 tempest-FlavorsV261TestJSON-1607537094-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:22.864948 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3ad4660e-174d-478a-bd55-c25aa5a960d9 tempest-FlavorsV261TestJSON-1607537094 tempest-FlavorsV261TestJSON-1607537094-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1649877577" status: 202 len: 0 microversion: 2.61 time: 0.129695 Sep 06 10:50:22.865540 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 14/20] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Sep 6 10:50:22 2022] DELETE /compute/v2.1/flavors/1649877577 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:50:22.870063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a7d8c3ff-132c-4566-b71d-08a9cd98d5b9 tempest-FlavorsAccessTestJSON-1158176142 tempest-FlavorsAccessTestJSON-1158176142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:22.894670 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a7d8c3ff-132c-4566-b71d-08a9cd98d5b9 tempest-FlavorsAccessTestJSON-1158176142 tempest-FlavorsAccessTestJSON-1158176142-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027256 Sep 06 10:50:22.896258 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 15/21] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:22.901422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-51f4e037-4443-4c5b-a4bf-b701e2b2244a tempest-FlavorsV261TestJSON-1607537094 tempest-FlavorsV261TestJSON-1607537094-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:22.933666 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-51f4e037-4443-4c5b-a4bf-b701e2b2244a tempest-FlavorsV261TestJSON-1607537094 tempest-FlavorsV261TestJSON-1607537094-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.036432 Sep 06 10:50:22.934434 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 16/22] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Sep 6 10:50:22 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:50:22.939541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cbe9e4ff-dc87-4096-b160-2c41735fba40 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:23.055803 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cbe9e4ff-dc87-4096-b160-2c41735fba40 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/369178866" status: 202 len: 0 microversion: 2.1 time: 0.120039 Sep 06 10:50:23.056647 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 17/23] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:50:22 2022] DELETE /compute/v2.1/flavors/369178866 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:23.066078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e0057e0e-a25c-42eb-9b84-7bfffbe88b9a tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:23.086481 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e0057e0e-a25c-42eb-9b84-7bfffbe88b9a tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025017 Sep 06 10:50:23.087076 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 18/24] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:23.107096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c29d224f-7da3-48d7-b81a-99209555c091 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1044799361", "id": 671734880, "os-flavor-access:is_public": "False"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:23.200201 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c29d224f-7da3-48d7-b81a-99209555c091 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.096214 Sep 06 10:50:23.200752 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 19/25] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:23 2022] POST /compute/v2.1/flavors => generated 428 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:23.214299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5f0cdb7c-7469-4f69-ac36-0d7504c1442b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:23.215077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5f0cdb7c-7469-4f69-ac36-0d7504c1442b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:23.477908 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9943a2a7-84e7-44a0-ac30-9cf07c06beba tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 1.292499 Sep 06 10:50:23.478499 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 7/26] 10.222.0.20 () {62 vars in 1232 bytes} [Tue Sep 6 10:50:22 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:50:23.486160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6ea5fb1a-df21-40be-8124-7ebf734a2301 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:23.513519 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6ea5fb1a-df21-40be-8124-7ebf734a2301 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/671734880/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.033716 Sep 06 10:50:23.514073 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 8/27] 10.222.0.20 () {58 vars in 1206 bytes} [Tue Sep 6 10:50:23 2022] GET /compute/v2.1/flavors/671734880/os-flavor-access => generated 21 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:23.519031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-192e0073-326b-400f-841b-aae7712ff972 tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:23.530095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-192e0073-326b-400f-841b-aae7712ff972 tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:23.530584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-192e0073-326b-400f-841b-aae7712ff972 tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:23.531054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-192e0073-326b-400f-841b-aae7712ff972 tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:23.877734 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-192e0073-326b-400f-841b-aae7712ff972 tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.361983 Sep 06 10:50:23.878652 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 9/28] 10.222.0.20 () {62 vars in 1232 bytes} [Tue Sep 6 10:50:23 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:50:23.883315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fc070c4d-2050-4308-abe9-89d437ddd395 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:24.029743 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fc070c4d-2050-4308-abe9-89d437ddd395 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/671734880" status: 202 len: 0 microversion: 2.1 time: 0.149462 Sep 06 10:50:24.031380 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 10/29] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:50:23 2022] DELETE /compute/v2.1/flavors/671734880 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:24.038338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-03289d25-d69d-4e7e-a6cf-929fb48381e3 tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:24.150543 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-03289d25-d69d-4e7e-a6cf-929fb48381e3 tempest-AggregatesAdminTestV241-2130449715 tempest-AggregatesAdminTestV241-2130449715-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.117655 Sep 06 10:50:24.155712 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 11/30] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 6 10:50:24 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:24.159095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7cdaa17d-60e1-40c8-b35f-3371350bdce2 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:24.202083 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7cdaa17d-60e1-40c8-b35f-3371350bdce2 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049562 Sep 06 10:50:24.203299 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 12/31] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:24.234564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5f0cdb7c-7469-4f69-ac36-0d7504c1442b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:24.239732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84b715d0-4b7d-483f-9ee0-1b5050b73129 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2135203468", "name": "tempest-test_aggregate-165922926"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:24.265262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.aggregate [None req-84b715d0-4b7d-483f-9ee0-1b5050b73129 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Generated uuid 2731a8ef-f716-4ac0-b88b-93cdc2d985ed for aggregate {{(pid=140875) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:50:24.301142 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5f0cdb7c-7469-4f69-ac36-0d7504c1442b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1220 microversion: 2.1 time: 1.097472 Sep 06 10:50:24.304011 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 20/32] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:23 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1220 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:24.406511 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84b715d0-4b7d-483f-9ee0-1b5050b73129 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.173344 Sep 06 10:50:24.417464 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 13/33] 10.222.0.20 () {60 vars in 1165 bytes} [Tue Sep 6 10:50:24 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:24.421657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e352fa8-aafa-4285-865e-aceb4f5d10f2 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:24.436823 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e352fa8-aafa-4285-865e-aceb4f5d10f2 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.019526 Sep 06 10:50:24.437986 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 21/34] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 10:50:24 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:50:24.450193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ba101e84-4ba5-4683-bf9f-9503d65ed332 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:24.463988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba101e84-4ba5-4683-bf9f-9503d65ed332 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:24.464492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba101e84-4ba5-4683-bf9f-9503d65ed332 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:24.465803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba101e84-4ba5-4683-bf9f-9503d65ed332 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:24.895109 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ba101e84-4ba5-4683-bf9f-9503d65ed332 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 0.449441 Sep 06 10:50:24.895742 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 14/35] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Sep 6 10:50:24 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:25.614921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cf29ed23-9b03-4058-8093-aac7935a53eb tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-353263290", "id": 662488291, "os-flavor-access:is_public": "False"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:25.695741 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cf29ed23-9b03-4058-8093-aac7935a53eb tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.458305 Sep 06 10:50:25.696694 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 22/36] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:25 2022] POST /compute/v2.1/flavors => generated 435 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:25.701139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1d4da3a9-7c96-42d8-9633-5ec9128b0e00 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:25.703215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1d4da3a9-7c96-42d8-9633-5ec9128b0e00 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:25.725004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d4da3a9-7c96-42d8-9633-5ec9128b0e00 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:25.725004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d4da3a9-7c96-42d8-9633-5ec9128b0e00 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:25.725004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d4da3a9-7c96-42d8-9633-5ec9128b0e00 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:25.725004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d4da3a9-7c96-42d8-9633-5ec9128b0e00 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:25.725334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d4da3a9-7c96-42d8-9633-5ec9128b0e00 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:25.725334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d4da3a9-7c96-42d8-9633-5ec9128b0e00 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:25.866523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d4da3a9-7c96-42d8-9633-5ec9128b0e00 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:25.886262 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1d4da3a9-7c96-42d8-9633-5ec9128b0e00 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1300 microversion: 2.1 time: 0.187849 Sep 06 10:50:25.899119 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 23/37] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:25 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:25.899119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8e1baad2-8c8b-4532-b3a8-042da9eeba3b tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "eaaf917565724ee4a7c411f950b6aa9a"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:25.910621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-909431807", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "availability_zone": "tempest-test_az-2135203468"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:25.927484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:25.928221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:25.929051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:25.930541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:25.931287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:25.931964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:26.015937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:50:26.599003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:50:26.599501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:50:26.600151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:50:26.600571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:50:26.601015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:50:26.611059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:26.611890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:26.612498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:26.617023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:26.617023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:26.617023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:26.640303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Getting quotas for project 2c708f857b3f445985133945eb88d6d3. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:50:26.645466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Getting quotas for user b4effbac6059440f9105f21183de9b23 and project 2c708f857b3f445985133945eb88d6d3. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:50:26.657246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:26.662051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:50:26.665515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:50:26.836684 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-46797b2b-6cbb-4a21-b65f-09cd6082f259 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.504555 Sep 06 10:50:26.844657 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 15/38] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:50:26.849890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dc110f8b-ae7f-4c22-a323-f73fafb8ba52 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:26.853480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dc110f8b-ae7f-4c22-a323-f73fafb8ba52 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:26.881065 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8e1baad2-8c8b-4532-b3a8-042da9eeba3b tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/662488291/action" status: 200 len: 96 microversion: 2.1 time: 0.991294 Sep 06 10:50:26.882288 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 24/39] 10.222.0.20 () {60 vars in 1197 bytes} [Tue Sep 6 10:50:25 2022] POST /compute/v2.1/flavors/662488291/action => generated 96 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:26.892960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c6d76795-5c5d-47cb-b865-f4f31389bd6d tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "eaaf917565724ee4a7c411f950b6aa9a"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:27.108347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dc110f8b-ae7f-4c22-a323-f73fafb8ba52 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:27.118981 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dc110f8b-ae7f-4c22-a323-f73fafb8ba52 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1242 microversion: 2.1 time: 0.273373 Sep 06 10:50:27.120026 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 16/40] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:26 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1242 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:27.131842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ba86a03b-3de8-4ebf-b100-5fe3fa17704c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:27.134553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ba86a03b-3de8-4ebf-b100-5fe3fa17704c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:27.150547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba86a03b-3de8-4ebf-b100-5fe3fa17704c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:27.157172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba86a03b-3de8-4ebf-b100-5fe3fa17704c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:27.158021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba86a03b-3de8-4ebf-b100-5fe3fa17704c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:27.158919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba86a03b-3de8-4ebf-b100-5fe3fa17704c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:27.159570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba86a03b-3de8-4ebf-b100-5fe3fa17704c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:27.160012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba86a03b-3de8-4ebf-b100-5fe3fa17704c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:27.666874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ba86a03b-3de8-4ebf-b100-5fe3fa17704c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:27.683412 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ba86a03b-3de8-4ebf-b100-5fe3fa17704c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.555235 Sep 06 10:50:27.684758 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 17/41] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:27 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:28.146113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a1a3e22a-2da5-45b2-b6e4-1176b0ac01c3 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:28.146904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a1a3e22a-2da5-45b2-b6e4-1176b0ac01c3 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:28.211843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a1a3e22a-2da5-45b2-b6e4-1176b0ac01c3 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:28.219402 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a1a3e22a-2da5-45b2-b6e4-1176b0ac01c3 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1242 microversion: 2.1 time: 0.079755 Sep 06 10:50:28.220291 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 18/42] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:28 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:50:28.709399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-90d586f9-72d5-442d-b482-4774fc00307d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:28.709916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-90d586f9-72d5-442d-b482-4774fc00307d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:28.718395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90d586f9-72d5-442d-b482-4774fc00307d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:28.719635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90d586f9-72d5-442d-b482-4774fc00307d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:28.720810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90d586f9-72d5-442d-b482-4774fc00307d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:28.722645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90d586f9-72d5-442d-b482-4774fc00307d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:28.723627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90d586f9-72d5-442d-b482-4774fc00307d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:28.724614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90d586f9-72d5-442d-b482-4774fc00307d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:29.038098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-90d586f9-72d5-442d-b482-4774fc00307d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:29.052517 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-90d586f9-72d5-442d-b482-4774fc00307d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.346982 Sep 06 10:50:29.052829 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 19/43] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:28 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:29.110385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:29.159559 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-c6d76795-5c5d-47cb-b865-f4f31389bd6d tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] HTTP exception thrown: Flavor access already exists for flavor 18 and project eaaf917565724ee4a7c411f950b6aa9a combination. Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c6d76795-5c5d-47cb-b865-f4f31389bd6d tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Request method failure captured: Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/flavors/662488291/action HTTP/1.1 Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 67 Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyXuME2B80QZ0-JE1hGJpSxEVi75NPYAVQynW1zueLg-AQFVwG2T-rZplnoiNIrgJOFVrogh9e0RTHOjiKtyp0nbBSLrhGM-yKc3cpgn8MhtwVWRrxOeW7PpbT9GLXXbGatJPB3QuGU9wtkNNeL5xb82vP8W4wlUox_C7lXB0BbVrYQ Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: ceb93b73593f43e78f646cf45490c716 Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-168001775 Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:50:29.191999 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:50:29.193193 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ceb93b73593f43e78f646cf45490c716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb93b73593f43e78f646cf45490c716"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ceb93b73593f43e78f646cf45490c716"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb93b73593f43e78f646cf45490c716"}]}] Sep 06 10:50:29.193193 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-168001775 Sep 06 10:50:29.193193 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: ceb93b73593f43e78f646cf45490c716 Sep 06 10:50:29.193193 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-168001775 Sep 06 10:50:29.193193 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin Sep 06 10:50:29.193193 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:50:29.193193 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:50:29.193193 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d359c31a7b8145ea947a51adda2ef9ce Sep 06 10:50:29.193193 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin Sep 06 10:50:29.193193 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:50:29.193193 ncdv-master-1 devstack@n-api.service[140876]: {"addTenantAccess": {"tenant": "eaaf917565724ee4a7c411f950b6aa9a"}} Sep 06 10:50:29.193193 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: exception: Flavor access already exists for flavor 18 and project eaaf917565724ee4a7c411f950b6aa9a combination. Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '662488291', 'body': {'addTenantAccess': {'tenant': 'eaaf917565724ee4a7c411f950b6aa9a'}}} Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result.read() Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 10:50:29.194021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '18-eaaf917565724ee4a7c411f950b6aa9a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi session.flush() Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 10:50:29.195679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 10:50:29.196800 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 10:50:29.197807 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result.read() Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '18-eaaf917565724ee4a7c411f950b6aa9a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 6, 10, 50, 29, 105592), 'updated_at': None, 'flavor_id': 18, 'project_id': 'eaaf917565724ee4a7c411f950b6aa9a'}] Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:29.199647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 18 and project eaaf917565724ee4a7c411f950b6aa9a combination. Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:29.202316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 18 and project eaaf917565724ee4a7c411f950b6aa9a combination. Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:50:29.206915 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:50:29.209690 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 18 and project eaaf917565724ee4a7c411f950b6aa9a combination. Sep 06 10:50:29.209690 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:29.210172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c6d76795-5c5d-47cb-b865-f4f31389bd6d tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Returning 409 to user: Flavor access already exists for flavor 18 and project eaaf917565724ee4a7c411f950b6aa9a combination. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:29.213854 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c6d76795-5c5d-47cb-b865-f4f31389bd6d tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/662488291/action" status: 409 len: 152 microversion: 2.1 time: 2.325009 Sep 06 10:50:29.221677 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 25/44] 10.222.0.20 () {60 vars in 1197 bytes} [Tue Sep 6 10:50:26 2022] POST /compute/v2.1/flavors/662488291/action => generated 152 bytes in 2332 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:50:29.224654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7008b2f7-b52d-4fc4-9363-fab924071207 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "eaaf917565724ee4a7c411f950b6aa9a"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:29.243080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aac1ccd3-7415-425c-b2cd-24f7a0f2b34b tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:29.243947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aac1ccd3-7415-425c-b2cd-24f7a0f2b34b tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:29.277688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aac1ccd3-7415-425c-b2cd-24f7a0f2b34b tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:29.278253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aac1ccd3-7415-425c-b2cd-24f7a0f2b34b tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:29.278709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aac1ccd3-7415-425c-b2cd-24f7a0f2b34b tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:29.288500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aac1ccd3-7415-425c-b2cd-24f7a0f2b34b tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:29.289956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aac1ccd3-7415-425c-b2cd-24f7a0f2b34b tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:29.290418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aac1ccd3-7415-425c-b2cd-24f7a0f2b34b tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:29.506067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aac1ccd3-7415-425c-b2cd-24f7a0f2b34b tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:29.517507 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aac1ccd3-7415-425c-b2cd-24f7a0f2b34b tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1242 microversion: 2.1 time: 0.278637 Sep 06 10:50:29.537138 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 26/45] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:29 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1242 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:30.052731 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7008b2f7-b52d-4fc4-9363-fab924071207 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/662488291/action" status: 200 len: 21 microversion: 2.1 time: 0.830677 Sep 06 10:50:30.055144 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 20/46] 10.222.0.20 () {60 vars in 1197 bytes} [Tue Sep 6 10:50:29 2022] POST /compute/v2.1/flavors/662488291/action => generated 21 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:30.077837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8b339572-c4f3-4cce-abcf-e44bfacb1665 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:30.114833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24120a03-bc30-438a-9c39-9ea971dd26a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:30.115555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-24120a03-bc30-438a-9c39-9ea971dd26a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:30.127561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24120a03-bc30-438a-9c39-9ea971dd26a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:30.127561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24120a03-bc30-438a-9c39-9ea971dd26a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:30.128001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24120a03-bc30-438a-9c39-9ea971dd26a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:30.134851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24120a03-bc30-438a-9c39-9ea971dd26a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:30.136827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24120a03-bc30-438a-9c39-9ea971dd26a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:30.137323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24120a03-bc30-438a-9c39-9ea971dd26a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:30.199321 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8b339572-c4f3-4cce-abcf-e44bfacb1665 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/662488291" status: 202 len: 0 microversion: 2.1 time: 0.127716 Sep 06 10:50:30.199321 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 27/47] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:50:30 2022] DELETE /compute/v2.1/flavors/662488291 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:30.213448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e1e5aeac-469b-4462-941f-b0cbc7c9576a tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:30.277070 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e1e5aeac-469b-4462-941f-b0cbc7c9576a tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067613 Sep 06 10:50:30.285808 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 28/48] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:30.314183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cd84a04a-2d32-44a2-b976-a9908318a8af tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1682449501", "id": 1109007107, "os-flavor-access:is_public": "True"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:30.405670 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cd84a04a-2d32-44a2-b976-a9908318a8af tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.101776 Sep 06 10:50:30.406564 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 29/49] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:30 2022] POST /compute/v2.1/flavors => generated 438 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:30.421561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-28ddc92c-7706-499d-bbd2-fda7484bcef6 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:30.430756 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-28ddc92c-7706-499d-bbd2-fda7484bcef6 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-28ddc92c-7706-499d-bbd2-fda7484bcef6 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Request method failure captured: Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/flavors/1109007107/os-flavor-access HTTP/1.1 Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyXuME2B80QZ0-JE1hGJpSxEVi75NPYAVQynW1zueLg-AQFVwG2T-rZplnoiNIrgJOFVrogh9e0RTHOjiKtyp0nbBSLrhGM-yKc3cpgn8MhtwVWRrxOeW7PpbT9GLXXbGatJPB3QuGU9wtkNNeL5xb82vP8W4wlUox_C7lXB0BbVrYQ Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: ceb93b73593f43e78f646cf45490c716 Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-168001775 Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:50:30.438800 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:50:30.440414 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ceb93b73593f43e78f646cf45490c716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb93b73593f43e78f646cf45490c716"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ceb93b73593f43e78f646cf45490c716"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb93b73593f43e78f646cf45490c716"}]}] Sep 06 10:50:30.440414 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-168001775 Sep 06 10:50:30.440414 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: ceb93b73593f43e78f646cf45490c716 Sep 06 10:50:30.440414 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-168001775 Sep 06 10:50:30.440414 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin Sep 06 10:50:30.440414 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:50:30.440414 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:50:30.440414 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d359c31a7b8145ea947a51adda2ef9ce Sep 06 10:50:30.440414 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin Sep 06 10:50:30.440414 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:50:30.440414 ncdv-master-1 devstack@n-api.service[140876]: exception: Access list not available for public flavors. Sep 06 10:50:30.440414 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'flavor_id': '1109007107'} Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 06 10:50:30.441094 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:30.442107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-28ddc92c-7706-499d-bbd2-fda7484bcef6 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:30.443290 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-28ddc92c-7706-499d-bbd2-fda7484bcef6 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1109007107/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.026376 Sep 06 10:50:30.446649 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 30/50] 10.222.0.20 () {58 vars in 1209 bytes} [Tue Sep 6 10:50:30 2022] GET /compute/v2.1/flavors/1109007107/os-flavor-access => generated 91 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:50:30.459841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7cd7f4fb-3b43-4944-b245-82288641e077 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:30.590142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-24120a03-bc30-438a-9c39-9ea971dd26a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:30.613990 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-24120a03-bc30-438a-9c39-9ea971dd26a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.526900 Sep 06 10:50:30.616591 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 21/51] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:30 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:30.626802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-58a91bc5-3d57-4a0b-b597-420ca22d341a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:30.630419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-58a91bc5-3d57-4a0b-b597-420ca22d341a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:30.642941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58a91bc5-3d57-4a0b-b597-420ca22d341a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:30.644079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58a91bc5-3d57-4a0b-b597-420ca22d341a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:30.645652 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58a91bc5-3d57-4a0b-b597-420ca22d341a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:30.646877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58a91bc5-3d57-4a0b-b597-420ca22d341a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:30.649150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58a91bc5-3d57-4a0b-b597-420ca22d341a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:30.649842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58a91bc5-3d57-4a0b-b597-420ca22d341a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:30.800846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-58a91bc5-3d57-4a0b-b597-420ca22d341a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:30.809464 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-58a91bc5-3d57-4a0b-b597-420ca22d341a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1290 microversion: 2.1 time: 0.191481 Sep 06 10:50:30.812589 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 22/52] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:30 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1290 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:30.835864 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7cd7f4fb-3b43-4944-b245-82288641e077 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1109007107" status: 202 len: 0 microversion: 2.1 time: 0.382638 Sep 06 10:50:30.835864 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 31/53] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Sep 6 10:50:30 2022] DELETE /compute/v2.1/flavors/1109007107 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 10:50:30.843378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-329e9491-58e2-4066-b34d-587d97c4aac2 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:31.034626 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-329e9491-58e2-4066-b34d-587d97c4aac2 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.195704 Sep 06 10:50:31.047740 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 23/54] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:31.065895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2453e4db-18b4-4078-ab43-df6176b6321b tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-506841811", "id": 547937876, "os-flavor-access:is_public": "False"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:31.075051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:31.188760 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2453e4db-18b4-4078-ab43-df6176b6321b tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.127314 Sep 06 10:50:31.195458 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 32/55] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:31 2022] POST /compute/v2.1/flavors => generated 435 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:50:31.609195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d4a3ecdc-079c-4943-be5a-95421587cd66 tempest-FlavorsAccessNegativeTestJSON-569440268 tempest-FlavorsAccessNegativeTestJSON-569440268-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "eaaf917565724ee4a7c411f950b6aa9a"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:31.616513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d4a3ecdc-079c-4943-be5a-95421587cd66 tempest-FlavorsAccessNegativeTestJSON-569440268 tempest-FlavorsAccessNegativeTestJSON-569440268-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '9771badb71674d49a2bfc93cbfca1b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf917565724ee4a7c411f950b6aa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d4a3ecdc-079c-4943-be5a-95421587cd66 tempest-FlavorsAccessNegativeTestJSON-569440268 tempest-FlavorsAccessNegativeTestJSON-569440268-project] Request method failure captured: Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/flavors/547937876/action HTTP/1.1 Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 67 Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyXsWdof4f5DItTVFGimStMITNUNeGNidq-DLCFMqOjNeKyb9rIWZkqB0Ae85CJ-xhtuP_TkqUocvdJRDV4_fvF7ZuV0Q7PwVNII2Xjrx5CTGFVh_0tDZsIvCUtlMppNJn6AAIMazzLKFfv4X1ag4lrjx5er55f9yTPkQUTIBuU5quE Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: eaaf917565724ee4a7c411f950b6aa9a Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-569440268 Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:50:31.631514 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:50:31.632717 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eaaf917565724ee4a7c411f950b6aa9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eaaf917565724ee4a7c411f950b6aa9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eaaf917565724ee4a7c411f950b6aa9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eaaf917565724ee4a7c411f950b6aa9a"}]}] Sep 06 10:50:31.632717 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-569440268 Sep 06 10:50:31.632717 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: eaaf917565724ee4a7c411f950b6aa9a Sep 06 10:50:31.632717 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-569440268 Sep 06 10:50:31.632717 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FlavorsAccessNegativeTestJSON-569440268-project Sep 06 10:50:31.632717 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:50:31.632717 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:50:31.632717 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 9771badb71674d49a2bfc93cbfca1b79 Sep 06 10:50:31.632717 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-569440268-project Sep 06 10:50:31.632717 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:50:31.632717 ncdv-master-1 devstack@n-api.service[140875]: {"addTenantAccess": {"tenant": "eaaf917565724ee4a7c411f950b6aa9a"}} Sep 06 10:50:31.632717 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '547937876', 'body': {'addTenantAccess': {'tenant': 'eaaf917565724ee4a7c411f950b6aa9a'}}} Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:50:31.633359 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 06 10:50:31.634404 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:31.642435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d4a3ecdc-079c-4943-be5a-95421587cd66 tempest-FlavorsAccessNegativeTestJSON-569440268 tempest-FlavorsAccessNegativeTestJSON-569440268-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:31.643888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8a7b94a9-0497-4614-9d4c-7065b6a25085 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:31.644518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8a7b94a9-0497-4614-9d4c-7065b6a25085 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:31.646203 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d4a3ecdc-079c-4943-be5a-95421587cd66 tempest-FlavorsAccessNegativeTestJSON-569440268 tempest-FlavorsAccessNegativeTestJSON-569440268-project] 10.222.0.20 "POST /compute/v2.1/flavors/547937876/action" status: 403 len: 130 microversion: 2.1 time: 0.447445 Sep 06 10:50:31.649008 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 24/56] 10.222.0.20 () {60 vars in 1197 bytes} [Tue Sep 6 10:50:31 2022] POST /compute/v2.1/flavors/547937876/action => generated 130 bytes in 451 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:50:31.666531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56a8a090-ed4e-443d-baf9-9113374ac67b tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:31.672976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a7b94a9-0497-4614-9d4c-7065b6a25085 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:31.679582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a7b94a9-0497-4614-9d4c-7065b6a25085 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:31.682135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a7b94a9-0497-4614-9d4c-7065b6a25085 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:31.682135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a7b94a9-0497-4614-9d4c-7065b6a25085 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:31.682135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a7b94a9-0497-4614-9d4c-7065b6a25085 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:31.695956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a7b94a9-0497-4614-9d4c-7065b6a25085 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:31.814486 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56a8a090-ed4e-443d-baf9-9113374ac67b tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/547937876" status: 202 len: 0 microversion: 2.1 time: 0.160129 Sep 06 10:50:31.815581 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 25/57] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:50:31 2022] DELETE /compute/v2.1/flavors/547937876 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:31.824780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-403bf444-7b04-4ef9-a2ec-75180e77800e tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:31.855351 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-403bf444-7b04-4ef9-a2ec-75180e77800e tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034707 Sep 06 10:50:31.857699 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 26/58] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:31.864065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9831790-7815-40bf-a917-09a187ddab73 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:31.865125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e9831790-7815-40bf-a917-09a187ddab73 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:31.878249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9831790-7815-40bf-a917-09a187ddab73 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:31.879138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9831790-7815-40bf-a917-09a187ddab73 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:31.879797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9831790-7815-40bf-a917-09a187ddab73 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:31.880858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9831790-7815-40bf-a917-09a187ddab73 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:31.881509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9831790-7815-40bf-a917-09a187ddab73 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:31.885536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9831790-7815-40bf-a917-09a187ddab73 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:32.178971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e9831790-7815-40bf-a917-09a187ddab73 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:32.189482 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e9831790-7815-40bf-a917-09a187ddab73 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1308 microversion: 2.1 time: 0.330335 Sep 06 10:50:32.193526 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 27/59] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:31 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:32.199382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2f6a3c62-84e9-4f8c-a86c-097106fc6951 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-451465363", "id": 241543473, "os-flavor-access:is_public": "False"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:32.366764 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2f6a3c62-84e9-4f8c-a86c-097106fc6951 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.170668 Sep 06 10:50:32.374993 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 28/60] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:32 2022] POST /compute/v2.1/flavors => generated 435 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:32.503567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8a7b94a9-0497-4614-9d4c-7065b6a25085 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:32.513621 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8a7b94a9-0497-4614-9d4c-7065b6a25085 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.873502 Sep 06 10:50:32.527290 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 33/61] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:31 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:50:32.527290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aa271b0c-e882-40ab-bc69-369ba715f266 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "eaaf917565724ee4a7c411f950b6aa9a"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:32.849051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-84e02115-eabd-46d3-8b6f-dcc76ef23ec3 req-6a182c9a-7c59-46ea-839c-7ae1b32532af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae98d37d-ffd5-4db1-87d9-4e70a654845d", "tag": "4f78520d-38fd-45e3-85c0-dec28088ea6c"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:32.890545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-84e02115-eabd-46d3-8b6f-dcc76ef23ec3 req-6a182c9a-7c59-46ea-839c-7ae1b32532af service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:32.891469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-84e02115-eabd-46d3-8b6f-dcc76ef23ec3 req-6a182c9a-7c59-46ea-839c-7ae1b32532af service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:32.891942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-84e02115-eabd-46d3-8b6f-dcc76ef23ec3 req-6a182c9a-7c59-46ea-839c-7ae1b32532af service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:32.937685 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-84e02115-eabd-46d3-8b6f-dcc76ef23ec3 req-6a182c9a-7c59-46ea-839c-7ae1b32532af service nova] Creating event network-changed:4f78520d-38fd-45e3-85c0-dec28088ea6c for instance ae98d37d-ffd5-4db1-87d9-4e70a654845d on nch1-master-1 Sep 06 10:50:32.938249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-84e02115-eabd-46d3-8b6f-dcc76ef23ec3 req-6a182c9a-7c59-46ea-839c-7ae1b32532af service nova] Acquiring lock "compute-rpcapi-router" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 10:50:32.943144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-84e02115-eabd-46d3-8b6f-dcc76ef23ec3 req-6a182c9a-7c59-46ea-839c-7ae1b32532af service nova] Acquired lock "compute-rpcapi-router" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 10:50:32.944610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b2f37f4-add6-40d5-93ba-bdb59c12071d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:32.945270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b2f37f4-add6-40d5-93ba-bdb59c12071d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:32.946778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b2f37f4-add6-40d5-93ba-bdb59c12071d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:32.949659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b2f37f4-add6-40d5-93ba-bdb59c12071d None None] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:32.950346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b2f37f4-add6-40d5-93ba-bdb59c12071d None None] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:32.961256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b2f37f4-add6-40d5-93ba-bdb59c12071d None None] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:32.987464 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.compute.rpcapi [None req-2b2f37f4-add6-40d5-93ba-bdb59c12071d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 10:50:32.988417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b2f37f4-add6-40d5-93ba-bdb59c12071d None None] Releasing lock "compute-rpcapi-router" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 10:50:33.017141 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b2f37f4-add6-40d5-93ba-bdb59c12071d None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.648078 Sep 06 10:50:33.018104 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 29/62] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:33.226021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e51eaf69-e99b-4471-b5a2-3d21e28904d6 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:33.226793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e51eaf69-e99b-4471-b5a2-3d21e28904d6 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:33.253808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e51eaf69-e99b-4471-b5a2-3d21e28904d6 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:33.260374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e51eaf69-e99b-4471-b5a2-3d21e28904d6 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:33.262689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e51eaf69-e99b-4471-b5a2-3d21e28904d6 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:33.269337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e51eaf69-e99b-4471-b5a2-3d21e28904d6 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:33.269863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e51eaf69-e99b-4471-b5a2-3d21e28904d6 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:33.270360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e51eaf69-e99b-4471-b5a2-3d21e28904d6 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:33.472599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e51eaf69-e99b-4471-b5a2-3d21e28904d6 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:33.505446 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e51eaf69-e99b-4471-b5a2-3d21e28904d6 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1296 microversion: 2.1 time: 0.279998 Sep 06 10:50:33.520006 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 30/63] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:33 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1296 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:33.540967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b5b4f35d-d2fc-44b3-953e-b0a91b17f2ea tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:33.542146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b5b4f35d-d2fc-44b3-953e-b0a91b17f2ea tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:33.553798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5b4f35d-d2fc-44b3-953e-b0a91b17f2ea tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:33.559228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5b4f35d-d2fc-44b3-953e-b0a91b17f2ea tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:33.559902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5b4f35d-d2fc-44b3-953e-b0a91b17f2ea tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:33.563582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5b4f35d-d2fc-44b3-953e-b0a91b17f2ea tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:33.566106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5b4f35d-d2fc-44b3-953e-b0a91b17f2ea tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:33.566742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5b4f35d-d2fc-44b3-953e-b0a91b17f2ea tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:33.601535 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aa271b0c-e882-40ab-bc69-369ba715f266 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/241543473/action" status: 200 len: 96 microversion: 2.1 time: 1.086179 Sep 06 10:50:33.602391 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 34/64] 10.222.0.20 () {60 vars in 1197 bytes} [Tue Sep 6 10:50:32 2022] POST /compute/v2.1/flavors/241543473/action => generated 96 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:34.097023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c87b4d34-1a75-4910-b7f9-a392691c4a2d tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-748039078", "id": 673059036, "os-flavor-access:is_public": "True"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:34.166970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b5b4f35d-d2fc-44b3-953e-b0a91b17f2ea tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:34.178855 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b5b4f35d-d2fc-44b3-953e-b0a91b17f2ea tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.640791 Sep 06 10:50:34.179964 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 31/65] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:33 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:50:34.192214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d7c75423-c875-4587-9018-a99add4d0a49 tempest-FlavorsAccessNegativeTestJSON-569440268 tempest-FlavorsAccessNegativeTestJSON-569440268-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "eaaf917565724ee4a7c411f950b6aa9a"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:34.216011 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c87b4d34-1a75-4910-b7f9-a392691c4a2d tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.612335 Sep 06 10:50:34.216621 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 35/66] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:33 2022] POST /compute/v2.1/flavors => generated 426 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:34.232046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ee5938cb-31ef-4f9e-9f07-ab7dc1e9e79d tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:34.235892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d7c75423-c875-4587-9018-a99add4d0a49 tempest-FlavorsAccessNegativeTestJSON-569440268 tempest-FlavorsAccessNegativeTestJSON-569440268-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '9771badb71674d49a2bfc93cbfca1b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf917565724ee4a7c411f950b6aa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d7c75423-c875-4587-9018-a99add4d0a49 tempest-FlavorsAccessNegativeTestJSON-569440268 tempest-FlavorsAccessNegativeTestJSON-569440268-project] Request method failure captured: Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/flavors/241543473/action HTTP/1.1 Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 70 Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyXsWdof4f5DItTVFGimStMITNUNeGNidq-DLCFMqOjNeKyb9rIWZkqB0Ae85CJ-xhtuP_TkqUocvdJRDV4_fvF7ZuV0Q7PwVNII2Xjrx5CTGFVh_0tDZsIvCUtlMppNJn6AAIMazzLKFfv4X1ag4lrjx5er55f9yTPkQUTIBuU5quE Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: eaaf917565724ee4a7c411f950b6aa9a Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-569440268 Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:50:34.237599 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:50:34.243304 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eaaf917565724ee4a7c411f950b6aa9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eaaf917565724ee4a7c411f950b6aa9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eaaf917565724ee4a7c411f950b6aa9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eaaf917565724ee4a7c411f950b6aa9a"}]}] Sep 06 10:50:34.243304 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-569440268 Sep 06 10:50:34.243304 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: eaaf917565724ee4a7c411f950b6aa9a Sep 06 10:50:34.243304 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-569440268 Sep 06 10:50:34.243304 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FlavorsAccessNegativeTestJSON-569440268-project Sep 06 10:50:34.243304 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:50:34.243304 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:50:34.243304 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 9771badb71674d49a2bfc93cbfca1b79 Sep 06 10:50:34.243304 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-569440268-project Sep 06 10:50:34.243304 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:50:34.243304 ncdv-master-1 devstack@n-api.service[140875]: {"removeTenantAccess": {"tenant": "eaaf917565724ee4a7c411f950b6aa9a"}} Sep 06 10:50:34.243304 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '241543473', 'body': {'removeTenantAccess': {'tenant': 'eaaf917565724ee4a7c411f950b6aa9a'}}} Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can( Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:50:34.243994 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 06 10:50:34.244968 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:34.247359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d7c75423-c875-4587-9018-a99add4d0a49 tempest-FlavorsAccessNegativeTestJSON-569440268 tempest-FlavorsAccessNegativeTestJSON-569440268-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:34.247359 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d7c75423-c875-4587-9018-a99add4d0a49 tempest-FlavorsAccessNegativeTestJSON-569440268 tempest-FlavorsAccessNegativeTestJSON-569440268-project] 10.222.0.20 "POST /compute/v2.1/flavors/241543473/action" status: 403 len: 133 microversion: 2.1 time: 0.057889 Sep 06 10:50:34.247359 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 32/67] 10.222.0.20 () {60 vars in 1197 bytes} [Tue Sep 6 10:50:34 2022] POST /compute/v2.1/flavors/241543473/action => generated 133 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:50:34.261977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9e97aa6b-6fde-43b4-9b7e-d55b334ce8d4 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "eaaf917565724ee4a7c411f950b6aa9a"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:34.297136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:34.381975 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ee5938cb-31ef-4f9e-9f07-ab7dc1e9e79d tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/673059036" status: 202 len: 0 microversion: 2.1 time: 0.153593 Sep 06 10:50:34.382887 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 36/68] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:50:34 2022] DELETE /compute/v2.1/flavors/673059036 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 10:50:34.391375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7cf20f87-1f57-4563-b2c6-4515f70dd046 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:34.472136 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7cf20f87-1f57-4563-b2c6-4515f70dd046 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085081 Sep 06 10:50:34.472742 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 37/69] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:50:34.492366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a3b12318-bedc-4f95-90fe-16c87a08082a tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-930470864", "id": 720627759, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:34.640842 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a3b12318-bedc-4f95-90fe-16c87a08082a tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.152127 Sep 06 10:50:34.641756 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 38/70] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:34 2022] POST /compute/v2.1/flavors => generated 413 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:34.646435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a1267313-e574-4f21-ade6-914b4d9eb5e0 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:34.647064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a1267313-e574-4f21-ade6-914b4d9eb5e0 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:34.684956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1267313-e574-4f21-ade6-914b4d9eb5e0 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:34.685714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1267313-e574-4f21-ade6-914b4d9eb5e0 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:34.686946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1267313-e574-4f21-ade6-914b4d9eb5e0 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:34.694613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1267313-e574-4f21-ade6-914b4d9eb5e0 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:34.705019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1267313-e574-4f21-ade6-914b4d9eb5e0 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:34.709590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1267313-e574-4f21-ade6-914b4d9eb5e0 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:35.361290 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9e97aa6b-6fde-43b4-9b7e-d55b334ce8d4 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/241543473/action" status: 200 len: 21 microversion: 2.1 time: 1.102950 Sep 06 10:50:35.371633 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 33/71] 10.222.0.20 () {60 vars in 1197 bytes} [Tue Sep 6 10:50:34 2022] POST /compute/v2.1/flavors/241543473/action => generated 21 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:35.400837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6c67d754-c1a7-45ef-b145-ce06e61f1b60 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:35.554384 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6c67d754-c1a7-45ef-b145-ce06e61f1b60 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.178334 Sep 06 10:50:35.558515 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 34/72] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:35 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:35.575797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f68b2b5f-9ffa-4175-970e-0a3ec031b2b0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:35.587502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f68b2b5f-9ffa-4175-970e-0a3ec031b2b0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:35.630776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f68b2b5f-9ffa-4175-970e-0a3ec031b2b0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:35.631240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f68b2b5f-9ffa-4175-970e-0a3ec031b2b0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:35.636478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f68b2b5f-9ffa-4175-970e-0a3ec031b2b0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:35.637853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f68b2b5f-9ffa-4175-970e-0a3ec031b2b0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:35.645917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f68b2b5f-9ffa-4175-970e-0a3ec031b2b0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:35.657586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f68b2b5f-9ffa-4175-970e-0a3ec031b2b0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:35.864706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a1267313-e574-4f21-ade6-914b4d9eb5e0 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:35.884949 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a1267313-e574-4f21-ade6-914b4d9eb5e0 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1338 microversion: 2.1 time: 1.234946 Sep 06 10:50:35.887049 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 39/73] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:34 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1338 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:35.911866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e9ebf00a-2d34-4f1f-9e30-5246e6e3134f tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:36.028495 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e9ebf00a-2d34-4f1f-9e30-5246e6e3134f tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/241543473" status: 202 len: 0 microversion: 2.1 time: 0.132110 Sep 06 10:50:36.028495 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 40/74] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:50:35 2022] DELETE /compute/v2.1/flavors/241543473 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:36.031766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-640435c6-4a03-4898-9574-bfb68c87f352 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:36.163990 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-640435c6-4a03-4898-9574-bfb68c87f352 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/720627759" status: 202 len: 0 microversion: 2.1 time: 0.140382 Sep 06 10:50:36.165197 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 41/75] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:50:36 2022] DELETE /compute/v2.1/flavors/720627759 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:36.180830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8aa724d1-300a-4272-9afd-fd0f9196cf90 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:36.265330 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8aa724d1-300a-4272-9afd-fd0f9196cf90 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088614 Sep 06 10:50:36.269391 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 42/76] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:36.302398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-17a27830-d3d9-4b32-9072-cbfa57a32ed7 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:36.302514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f68b2b5f-9ffa-4175-970e-0a3ec031b2b0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:36.310661 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f68b2b5f-9ffa-4175-970e-0a3ec031b2b0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.750485 Sep 06 10:50:36.311627 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 35/77] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:35 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:36.312794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f68b2b5f-9ffa-4175-970e-0a3ec031b2b0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:36.328946 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f68b2b5f-9ffa-4175-970e-0a3ec031b2b0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.016216 Sep 06 10:50:36.329815 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 36/78] 10.222.0.20 () {56 vars in 886 bytes} [Tue Sep 6 10:50:36 2022] GET /compute/ => generated 377 bytes in 17 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 06 10:50:36.335968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b60734eb-9ddf-491f-b17b-5852dcf880c7 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-527667292", "id": 544522836, "os-flavor-access:is_public": "False"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:36.354350 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-17a27830-d3d9-4b32-9072-cbfa57a32ed7 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080381 Sep 06 10:50:36.363471 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 43/79] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:36.382812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0196a4b4-ad9a-478e-bc5e-465bb88dc727 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-470126627", "id": 1623835243, "os-flavor-access:is_public": "True"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:36.519685 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b60734eb-9ddf-491f-b17b-5852dcf880c7 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.187744 Sep 06 10:50:36.521503 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 37/80] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:36 2022] POST /compute/v2.1/flavors => generated 435 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:36.538263 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0196a4b4-ad9a-478e-bc5e-465bb88dc727 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.159068 Sep 06 10:50:36.540231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9cef50a0-f297-4a95-8cc2-edcbdab1d301 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "233ccb254c784281864e757a9b9a3a84"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:36.540900 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 44/81] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:36 2022] POST /compute/v2.1/flavors => generated 428 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:36.558241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2b8bad02-37d2-483e-a6c1-e62427f276c5 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:36.693383 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2b8bad02-37d2-483e-a6c1-e62427f276c5 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1623835243" status: 202 len: 0 microversion: 2.1 time: 0.139712 Sep 06 10:50:36.694488 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 45/82] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Sep 6 10:50:36 2022] DELETE /compute/v2.1/flavors/1623835243 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:36.720179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5e43428-3231-4670-999a-0a3f3a3a845a tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:36.747828 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a5e43428-3231-4670-999a-0a3f3a3a845a tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037275 Sep 06 10:50:36.749671 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 46/83] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:36.778565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d6228fdb-573c-4800-84dd-8c6fc407dccc tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-325194329", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:38.094480 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d6228fdb-573c-4800-84dd-8c6fc407dccc tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 1.322705 Sep 06 10:50:38.095313 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 47/84] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:36 2022] POST /compute/v2.1/flavors => generated 506 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:38.221554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=18 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:38.361115 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-9cef50a0-f297-4a95-8cc2-edcbdab1d301 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] HTTP exception thrown: Flavor access not found for 24 / 233ccb254c784281864e757a9b9a3a84 combination. Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9cef50a0-f297-4a95-8cc2-edcbdab1d301 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Request method failure captured: Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/flavors/544522836/action HTTP/1.1 Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 70 Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyXuME2B80QZ0-JE1hGJpSxEVi75NPYAVQynW1zueLg-AQFVwG2T-rZplnoiNIrgJOFVrogh9e0RTHOjiKtyp0nbBSLrhGM-yKc3cpgn8MhtwVWRrxOeW7PpbT9GLXXbGatJPB3QuGU9wtkNNeL5xb82vP8W4wlUox_C7lXB0BbVrYQ Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ceb93b73593f43e78f646cf45490c716 Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-168001775 Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:50:38.364743 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:50:38.366158 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ceb93b73593f43e78f646cf45490c716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb93b73593f43e78f646cf45490c716"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ceb93b73593f43e78f646cf45490c716"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb93b73593f43e78f646cf45490c716"}]}] Sep 06 10:50:38.366158 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-168001775 Sep 06 10:50:38.366158 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ceb93b73593f43e78f646cf45490c716 Sep 06 10:50:38.366158 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-168001775 Sep 06 10:50:38.366158 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin Sep 06 10:50:38.366158 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:50:38.366158 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:50:38.366158 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d359c31a7b8145ea947a51adda2ef9ce Sep 06 10:50:38.366158 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin Sep 06 10:50:38.366158 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:50:38.366158 ncdv-master-1 devstack@n-api.service[140875]: {"removeTenantAccess": {"tenant": "233ccb254c784281864e757a9b9a3a84"}} Sep 06 10:50:38.366158 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: exception: Flavor access not found for 24 / 233ccb254c784281864e757a9b9a3a84 combination. Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '544522836', 'body': {'removeTenantAccess': {'tenant': '233ccb254c784281864e757a9b9a3a84'}}} Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 06 10:50:38.366933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 24 / 233ccb254c784281864e757a9b9a3a84 combination. Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 24 / 233ccb254c784281864e757a9b9a3a84 combination. Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:38.368179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:38.369461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:38.369461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:38.369461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:50:38.369461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:50:38.369461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 24 / 233ccb254c784281864e757a9b9a3a84 combination. Sep 06 10:50:38.369461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:38.369461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9cef50a0-f297-4a95-8cc2-edcbdab1d301 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Returning 404 to user: Flavor access not found for 24 / 233ccb254c784281864e757a9b9a3a84 combination. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:38.369461 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9cef50a0-f297-4a95-8cc2-edcbdab1d301 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/544522836/action" status: 404 len: 124 microversion: 2.1 time: 1.836127 Sep 06 10:50:38.371348 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 38/85] 10.222.0.20 () {60 vars in 1197 bytes} [Tue Sep 6 10:50:36 2022] POST /compute/v2.1/flavors/544522836/action => generated 124 bytes in 1841 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:50:38.378848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-28fdcaa9-ddfc-446d-a962-3359f8f2804e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:38.379616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-28fdcaa9-ddfc-446d-a962-3359f8f2804e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:38.387190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28fdcaa9-ddfc-446d-a962-3359f8f2804e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:38.387190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28fdcaa9-ddfc-446d-a962-3359f8f2804e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:38.387190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28fdcaa9-ddfc-446d-a962-3359f8f2804e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:38.387851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28fdcaa9-ddfc-446d-a962-3359f8f2804e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:38.388404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28fdcaa9-ddfc-446d-a962-3359f8f2804e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:38.388782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28fdcaa9-ddfc-446d-a962-3359f8f2804e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:38.568264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e5e93038-e984-4200-bc12-089c80c366e2 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1680519759", "ram": 512, "vcpus": 1, "disk": 10, "id": 550925658, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:38.660049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-28fdcaa9-ddfc-446d-a962-3359f8f2804e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:38.683294 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-28fdcaa9-ddfc-446d-a962-3359f8f2804e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1338 microversion: 2.1 time: 0.309961 Sep 06 10:50:38.687075 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 39/86] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:38 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1338 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:38.706292 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e5e93038-e984-4200-bc12-089c80c366e2 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.609876 Sep 06 10:50:38.715063 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 48/87] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:38 2022] POST /compute/v2.1/flavors => generated 413 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:38.744002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dbe082d0-c600-41c5-aa97-225b31412749 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:38.744665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dbe082d0-c600-41c5-aa97-225b31412749 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:38.774466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbe082d0-c600-41c5-aa97-225b31412749 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:38.777904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbe082d0-c600-41c5-aa97-225b31412749 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:38.777904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbe082d0-c600-41c5-aa97-225b31412749 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:38.778145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbe082d0-c600-41c5-aa97-225b31412749 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:38.780015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbe082d0-c600-41c5-aa97-225b31412749 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:38.780548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbe082d0-c600-41c5-aa97-225b31412749 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:38.826228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=18,nova_api:INSERT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:38.897240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-332af528-2682-4072-af9a-3049291b8519 req-0e2cdb4d-305a-498a-bac3-f20a68640a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a44496f5-17da-461a-bc43-4ae9d86e49df", "tag": "06887f8c-ef11-4593-892f-246139293ebc"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:38.908447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-332af528-2682-4072-af9a-3049291b8519 req-0e2cdb4d-305a-498a-bac3-f20a68640a08 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:38.911212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-332af528-2682-4072-af9a-3049291b8519 req-0e2cdb4d-305a-498a-bac3-f20a68640a08 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:38.917290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-332af528-2682-4072-af9a-3049291b8519 req-0e2cdb4d-305a-498a-bac3-f20a68640a08 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:38.924837 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-332af528-2682-4072-af9a-3049291b8519 req-0e2cdb4d-305a-498a-bac3-f20a68640a08 service nova] Creating event network-changed:06887f8c-ef11-4593-892f-246139293ebc for instance a44496f5-17da-461a-bc43-4ae9d86e49df on nch1-master-1 Sep 06 10:50:38.930191 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-332af528-2682-4072-af9a-3049291b8519 req-0e2cdb4d-305a-498a-bac3-f20a68640a08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225954 Sep 06 10:50:38.930811 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 40/88] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:38.938185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c6de23aa-cc5b-4d51-bf02-fa14ef7526e1 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:39.005132 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c6de23aa-cc5b-4d51-bf02-fa14ef7526e1 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/244fd8fa-67cc-4fd1-aba9-285b05c8788f" status: 202 len: 0 microversion: 2.1 time: 0.072739 Sep 06 10:50:39.006205 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 41/89] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:50:38 2022] DELETE /compute/v2.1/flavors/244fd8fa-67cc-4fd1-aba9-285b05c8788f => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:39.012536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a58f290-3dd7-4d9b-b9ca-57704f171a89 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:39.098963 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0a58f290-3dd7-4d9b-b9ca-57704f171a89 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/544522836" status: 202 len: 0 microversion: 2.1 time: 0.091289 Sep 06 10:50:39.100406 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 42/90] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:50:39 2022] DELETE /compute/v2.1/flavors/544522836 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:39.105712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ee8a315d-9a77-44cb-9c23-872c17d28467 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:39.119870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:DELETE=12 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:39.194852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dbe082d0-c600-41c5-aa97-225b31412749 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:39.203667 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dbe082d0-c600-41c5-aa97-225b31412749 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.479670 Sep 06 10:50:39.204306 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 49/91] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:38 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:39.241948 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ee8a315d-9a77-44cb-9c23-872c17d28467 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/550925658/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.140250 Sep 06 10:50:39.243644 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 43/92] 10.222.0.20 () {60 vars in 1221 bytes} [Tue Sep 6 10:50:39 2022] POST /compute/v2.1/flavors/550925658/os-extra_specs => generated 66 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:39.251221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-af8c7d8f-96c2-403e-8a5d-8656b6006b1f tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:39.272720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2124be4e-e7d4-41dd-bb5e-8956833a698b tempest-FlavorsV255TestJSON-969564724 tempest-FlavorsV255TestJSON-969564724-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1648500258", "id": 2096116239, "os-flavor-access:is_public": "True"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:39.273187 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-af8c7d8f-96c2-403e-8a5d-8656b6006b1f tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.027512 Sep 06 10:50:39.280913 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 44/93] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:39 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:39.286302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4df8f633-8d57-4284-b112-ec0f36883e5e tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:39.309136 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4df8f633-8d57-4284-b112-ec0f36883e5e tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.026873 Sep 06 10:50:39.319478 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 45/94] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:39 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:39.390448 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2124be4e-e7d4-41dd-bb5e-8956833a698b tempest-FlavorsV255TestJSON-969564724 tempest-FlavorsV255TestJSON-969564724-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.184977 Sep 06 10:50:39.391083 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 50/95] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 10:50:39 2022] POST /compute/v2.1/flavors => generated 449 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:50:39.395868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34ea3a37-82fd-45d8-ae96-74e8ebfa3c54 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1313281110", "id": "bb33b034-c6ef-45a1-907f-95062ddec577", "os-flavor-access:is_public": "True"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:39.434669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a7602283-ea82-48b0-9f20-9ca5533bad8d tempest-FlavorsExtraSpecsTestJSON-1957168118 tempest-FlavorsExtraSpecsTestJSON-1957168118-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:39.444749 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a7602283-ea82-48b0-9f20-9ca5533bad8d tempest-FlavorsExtraSpecsTestJSON-1957168118 tempest-FlavorsExtraSpecsTestJSON-1957168118-project] 10.222.0.20 "GET /compute/v2.1/flavors/550925658/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.133903 Sep 06 10:50:39.445327 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 46/96] 10.222.0.20 () {58 vars in 1200 bytes} [Tue Sep 6 10:50:39 2022] GET /compute/v2.1/flavors/550925658/os-extra_specs => generated 66 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:39.504547 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-34ea3a37-82fd-45d8-ae96-74e8ebfa3c54 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.111993 Sep 06 10:50:39.513603 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 51/97] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:39 2022] POST /compute/v2.1/flavors => generated 507 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:39.521644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a988b180-eac7-4ee0-bbb2-b48cb386c6a3 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:39.552435 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a988b180-eac7-4ee0-bbb2-b48cb386c6a3 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/550925658/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036273 Sep 06 10:50:39.557985 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 52/98] 10.222.0.20 () {60 vars in 1221 bytes} [Tue Sep 6 10:50:39 2022] POST /compute/v2.1/flavors/550925658/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:39.564713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-37659f5d-42bf-44e2-9626-4a1793da9f02 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:39.582538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b03249ba-45d3-425a-a05d-79c05d08387f tempest-FlavorsV255TestJSON-1563941342 tempest-FlavorsV255TestJSON-1563941342-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:39.596864 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b03249ba-45d3-425a-a05d-79c05d08387f tempest-FlavorsV255TestJSON-1563941342 tempest-FlavorsV255TestJSON-1563941342-project] 10.222.0.20 "GET /compute/v2.1/flavors/2096116239" status: 200 len: 449 microversion: 2.55 time: 0.150486 Sep 06 10:50:39.597686 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 47/99] 10.222.0.20 () {60 vars in 1199 bytes} [Tue Sep 6 10:50:39 2022] GET /compute/v2.1/flavors/2096116239 => generated 449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:50:39.613133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-db48971d-0ba0-49e8-b453-ff8168c6c6ec tempest-FlavorsExtraSpecsTestJSON-1957168118 tempest-FlavorsExtraSpecsTestJSON-1957168118-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:39.624415 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-db48971d-0ba0-49e8-b453-ff8168c6c6ec tempest-FlavorsExtraSpecsTestJSON-1957168118 tempest-FlavorsExtraSpecsTestJSON-1957168118-project] 10.222.0.20 "GET /compute/v2.1/flavors/550925658/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.016405 Sep 06 10:50:39.625322 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 48/100] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 10:50:39 2022] GET /compute/v2.1/flavors/550925658/os-extra_specs/hw:numa_nodes => generated 22 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:39.630248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd73245f-59d4-40cd-9ce9-ffff222c73b8 tempest-FlavorsV255TestJSON-969564724 tempest-FlavorsV255TestJSON-969564724-project-admin] Action: 'update', calling method: .version_select at 0x7f90fa4f9790>, body: {"flavor": {"description": "new"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:39.644009 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-37659f5d-42bf-44e2-9626-4a1793da9f02 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/bb33b034-c6ef-45a1-907f-95062ddec577" status: 202 len: 0 microversion: 2.1 time: 0.089070 Sep 06 10:50:39.646489 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 53/101] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:50:39 2022] DELETE /compute/v2.1/flavors/bb33b034-c6ef-45a1-907f-95062ddec577 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:39.653743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8d3a31b6-3322-4c34-b9e7-3c8d5f045384 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:39.679975 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8d3a31b6-3322-4c34-b9e7-3c8d5f045384 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/550925658/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032289 Sep 06 10:50:39.685242 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 54/102] 10.222.0.20 () {60 vars in 1221 bytes} [Tue Sep 6 10:50:39 2022] POST /compute/v2.1/flavors/550925658/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:39.690651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7cdc580-7022-4fba-9c61-a15cf40d261e tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:39.719884 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d7cdc580-7022-4fba-9c61-a15cf40d261e tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.026991 Sep 06 10:50:39.719884 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 55/103] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:39 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:39.719884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cabf2df4-484c-4299-ad27-cb686f0e2e00 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:39.728178 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cabf2df4-484c-4299-ad27-cb686f0e2e00 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/550925658/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012032 Sep 06 10:50:39.734176 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 56/104] 10.222.0.20 () {58 vars in 1200 bytes} [Tue Sep 6 10:50:39 2022] GET /compute/v2.1/flavors/550925658/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:39.741667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8f781335-6365-48de-bc0c-c57eb35ab98d tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:39.742436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8f781335-6365-48de-bc0c-c57eb35ab98d tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:39.753906 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd73245f-59d4-40cd-9ce9-ffff222c73b8 tempest-FlavorsV255TestJSON-969564724 tempest-FlavorsV255TestJSON-969564724-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/2096116239" status: 200 len: 450 microversion: 2.55 time: 0.127291 Sep 06 10:50:39.755455 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 49/105] 10.222.0.20 () {62 vars in 1219 bytes} [Tue Sep 6 10:50:39 2022] PUT /compute/v2.1/flavors/2096116239 => generated 450 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:50:39.765962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ce4ed2d5-15dd-4139-8f7e-685b44321c08 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:39.768700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f781335-6365-48de-bc0c-c57eb35ab98d tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:39.771484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f781335-6365-48de-bc0c-c57eb35ab98d tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:39.772236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f781335-6365-48de-bc0c-c57eb35ab98d tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:39.773215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f781335-6365-48de-bc0c-c57eb35ab98d tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:39.774634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f781335-6365-48de-bc0c-c57eb35ab98d tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:39.776118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f781335-6365-48de-bc0c-c57eb35ab98d tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:39.960495 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ce4ed2d5-15dd-4139-8f7e-685b44321c08 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/550925658/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.202101 Sep 06 10:50:39.962482 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 50/106] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 10:50:39 2022] PUT /compute/v2.1/flavors/550925658/os-extra_specs/hw:numa_nodes => generated 22 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:39.975958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9d6f6408-3e4d-49d9-9ef7-6af5c05b1a9b tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-393013902", "id": 1693736502, "os-flavor-access:is_public": "True"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:40.050816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8f781335-6365-48de-bc0c-c57eb35ab98d tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:40.064005 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8f781335-6365-48de-bc0c-c57eb35ab98d tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1338 microversion: 2.1 time: 0.328486 Sep 06 10:50:40.064603 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 57/107] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:39 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1338 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:40.071159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ec07e016-1405-449b-a34a-a2e6ee8d5021 tempest-FlavorsV255TestJSON-1563941342 tempest-FlavorsV255TestJSON-1563941342-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.082722 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9d6f6408-3e4d-49d9-9ef7-6af5c05b1a9b tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.120358 Sep 06 10:50:40.083376 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 51/108] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:39 2022] POST /compute/v2.1/flavors => generated 413 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:40.099128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84e384c6-1336-4410-93f2-c8eb0442a8d2 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.114705 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84e384c6-1336-4410-93f2-c8eb0442a8d2 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/550925658/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028383 Sep 06 10:50:40.116733 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 52/109] 10.222.0.20 () {58 vars in 1200 bytes} [Tue Sep 6 10:50:40 2022] GET /compute/v2.1/flavors/550925658/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:40.124303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-292e9332-14e4-41d9-a2ec-6fe9d50c562c tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.138064 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-292e9332-14e4-41d9-a2ec-6fe9d50c562c tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1693736502" status: 200 len: 413 microversion: 2.1 time: 0.019081 Sep 06 10:50:40.146333 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ec07e016-1405-449b-a34a-a2e6ee8d5021 tempest-FlavorsV255TestJSON-1563941342 tempest-FlavorsV255TestJSON-1563941342-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6573 microversion: 2.55 time: 0.080548 Sep 06 10:50:40.148595 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 58/110] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Sep 6 10:50:40 2022] GET /compute/v2.1/flavors/detail => generated 6573 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:50:40.157692 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 53/111] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:50:40 2022] GET /compute/v2.1/flavors/1693736502 => generated 413 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:40.157978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9d8fa445-1777-40f7-a449-36b807a08f9f tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.304225 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9d8fa445-1777-40f7-a449-36b807a08f9f tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/550925658/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.153614 Sep 06 10:50:40.308950 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 59/112] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 10:50:40 2022] DELETE /compute/v2.1/flavors/550925658/os-extra_specs/hw:numa_nodes => generated 0 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:50:40.314345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5fff0dd2-5e56-455a-8bbf-3fe7169db7d9 tempest-FlavorsV255TestJSON-1563941342 tempest-FlavorsV255TestJSON-1563941342-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.338906 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5fff0dd2-5e56-455a-8bbf-3fe7169db7d9 tempest-FlavorsV255TestJSON-1563941342 tempest-FlavorsV255TestJSON-1563941342-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3660 microversion: 2.55 time: 0.028584 Sep 06 10:50:40.340158 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 60/113] 10.222.0.20 () {60 vars in 1166 bytes} [Tue Sep 6 10:50:40 2022] GET /compute/v2.1/flavors => generated 3660 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:50:40.346380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2a0de775-4a2d-4ec5-97b5-0badae47da01 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.347071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2a0de775-4a2d-4ec5-97b5-0badae47da01 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:40.359960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a0de775-4a2d-4ec5-97b5-0badae47da01 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:40.360783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a0de775-4a2d-4ec5-97b5-0badae47da01 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:40.365930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a0de775-4a2d-4ec5-97b5-0badae47da01 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:40.365930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a0de775-4a2d-4ec5-97b5-0badae47da01 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:40.365930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a0de775-4a2d-4ec5-97b5-0badae47da01 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:40.365930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a0de775-4a2d-4ec5-97b5-0badae47da01 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:40.390603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-646f2316-ecdb-4fe7-9fd9-0204672b73ef tempest-FlavorsAdminTestJSON-719478982 tempest-FlavorsAdminTestJSON-719478982-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.439811 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-646f2316-ecdb-4fe7-9fd9-0204672b73ef tempest-FlavorsAdminTestJSON-719478982 tempest-FlavorsAdminTestJSON-719478982-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6215 microversion: 2.1 time: 0.287590 Sep 06 10:50:40.451040 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 54/114] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:40 2022] GET /compute/v2.1/flavors/detail => generated 6215 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:40.451040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0c97dbe8-f1f7-48f0-aaa4-faf312cd31b9 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.568556 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0c97dbe8-f1f7-48f0-aaa4-faf312cd31b9 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/550925658/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.126925 Sep 06 10:50:40.569776 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 55/115] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 10:50:40 2022] DELETE /compute/v2.1/flavors/550925658/os-extra_specs/hw:cpu_policy => generated 0 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:50:40.577516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5dd68647-7c0a-407d-8167-2636b9125fd8 tempest-FlavorsV255TestJSON-969564724 tempest-FlavorsV255TestJSON-969564724-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.679531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2a0de775-4a2d-4ec5-97b5-0badae47da01 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:40.690961 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2a0de775-4a2d-4ec5-97b5-0badae47da01 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.349580 Sep 06 10:50:40.691821 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 61/116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:40 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:40.698638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5eb742ad-6ea9-4130-9bd0-4a5a78a45127 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.726432 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5dd68647-7c0a-407d-8167-2636b9125fd8 tempest-FlavorsV255TestJSON-969564724 tempest-FlavorsV255TestJSON-969564724-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2096116239" status: 202 len: 0 microversion: 2.55 time: 0.155401 Sep 06 10:50:40.730373 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 56/117] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Sep 6 10:50:40 2022] DELETE /compute/v2.1/flavors/2096116239 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:50:40.735392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6b5e3454-77bf-40f3-8884-2c1418104abf tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.744552 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6b5e3454-77bf-40f3-8884-2c1418104abf tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/550925658/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016268 Sep 06 10:50:40.751290 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 57/118] 10.222.0.20 () {58 vars in 1200 bytes} [Tue Sep 6 10:50:40 2022] GET /compute/v2.1/flavors/550925658/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:40.751290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-13aa0c2e-58bd-4bf7-beef-98be805197a8 tempest-FlavorsV255TestJSON-969564724 tempest-FlavorsV255TestJSON-969564724-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.774383 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-13aa0c2e-58bd-4bf7-beef-98be805197a8 tempest-FlavorsV255TestJSON-969564724 tempest-FlavorsV255TestJSON-969564724-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6133 microversion: 2.55 time: 0.027890 Sep 06 10:50:40.776431 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 58/119] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Sep 6 10:50:40 2022] GET /compute/v2.1/flavors/detail => generated 6133 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:50:40.781471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-94aeb629-5677-416d-8eef-6b775d0cfd19 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.848227 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5eb742ad-6ea9-4130-9bd0-4a5a78a45127 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1693736502" status: 202 len: 0 microversion: 2.1 time: 0.155316 Sep 06 10:50:40.848821 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 62/120] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Sep 6 10:50:40 2022] DELETE /compute/v2.1/flavors/1693736502 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:40.862559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e063df0-2946-44b9-b5ab-ed1fe3049813 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.882224 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-94aeb629-5677-416d-8eef-6b775d0cfd19 tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/550925658" status: 202 len: 0 microversion: 2.1 time: 0.104583 Sep 06 10:50:40.883380 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 59/121] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:50:40 2022] DELETE /compute/v2.1/flavors/550925658 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:40.884901 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e063df0-2946-44b9-b5ab-ed1fe3049813 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.025956 Sep 06 10:50:40.885493 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 63/122] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:40 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:50:40.922266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-534502bf-177b-43f3-8c1c-7c60bf4c28ea tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:40.934286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8451d2bf-54a3-47b7-aab2-2dcdfd9eb5a9 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-737005177", "id": 1232886429, "os-flavor-access:is_public": "False"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:40.956135 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-534502bf-177b-43f3-8c1c-7c60bf4c28ea tempest-FlavorsExtraSpecsTestJSON-382992151 tempest-FlavorsExtraSpecsTestJSON-382992151-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062317 Sep 06 10:50:40.957075 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 60/123] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:41.050230 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8451d2bf-54a3-47b7-aab2-2dcdfd9eb5a9 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.124377 Sep 06 10:50:41.057605 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 64/124] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:40 2022] POST /compute/v2.1/flavors => generated 429 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:41.062735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6035d7f0-b076-4ed7-a5f3-5bcf33276c7c tempest-FlavorsAdminTestJSON-719478982 tempest-FlavorsAdminTestJSON-719478982-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "1232886429"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:41.088871 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-6035d7f0-b076-4ed7-a5f3-5bcf33276c7c tempest-FlavorsAdminTestJSON-719478982 tempest-FlavorsAdminTestJSON-719478982-project] HTTP exception thrown: Flavor 1232886429 could not be found. Sep 06 10:50:41.088986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-680bd5e0-af86-4cf7-aed7-06e36e22cb40 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:41.089785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-680bd5e0-af86-4cf7-aed7-06e36e22cb40 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6035d7f0-b076-4ed7-a5f3-5bcf33276c7c tempest-FlavorsAdminTestJSON-719478982 tempest-FlavorsAdminTestJSON-719478982-project] Request method failure captured: Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 107 Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyX1A0SpcCXnYYHoBqLuqwUWyNS2_bah8xiYzwVe8KsL677vtYZJqD6IOEF9f7YGTTjh5JfsBiNFjW4d7NTdalopWKOcaSLm8Jv0DrjW-wI1XepHgYTpYjA7QjqFF1ThUa2Hv8ujhDOzEmxxywUzAFscgCx-VTOHcL9T6vExpIgxXMY Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: b5f346ce1f8d43b6bf7796526a1270ae Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FlavorsAdminTestJSON-719478982 Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:50:41.094495 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:50:41.095635 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b5f346ce1f8d43b6bf7796526a1270ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b5f346ce1f8d43b6bf7796526a1270ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b5f346ce1f8d43b6bf7796526a1270ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b5f346ce1f8d43b6bf7796526a1270ae"}]}] Sep 06 10:50:41.095635 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FlavorsAdminTestJSON-719478982 Sep 06 10:50:41.095635 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: b5f346ce1f8d43b6bf7796526a1270ae Sep 06 10:50:41.095635 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-719478982 Sep 06 10:50:41.095635 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FlavorsAdminTestJSON-719478982-project Sep 06 10:50:41.095635 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:50:41.095635 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:50:41.095635 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 1d2b5ed384d548968672226861f1dd32 Sep 06 10:50:41.095635 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FlavorsAdminTestJSON-719478982-project Sep 06 10:50:41.095635 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:50:41.095635 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "test", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "1232886429"}} Sep 06 10:50:41.095635 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:50:41.095635 ncdv-master-1 devstack@n-api.service[140875]: exception: Flavor 1232886429 could not be found. Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '1232886429'}}} Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1232886429 could not be found. Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:41.096357 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1232886429 could not be found. Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:41.097408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:41.098829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:41.098829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:50:41.098829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:50:41.098829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1232886429 could not be found. Sep 06 10:50:41.098829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:41.104538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-680bd5e0-af86-4cf7-aed7-06e36e22cb40 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:41.104538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-680bd5e0-af86-4cf7-aed7-06e36e22cb40 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:41.106182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6035d7f0-b076-4ed7-a5f3-5bcf33276c7c tempest-FlavorsAdminTestJSON-719478982 tempest-FlavorsAdminTestJSON-719478982-project] Returning 400 to user: Flavor 1232886429 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:41.106978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-680bd5e0-af86-4cf7-aed7-06e36e22cb40 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:41.110357 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6035d7f0-b076-4ed7-a5f3-5bcf33276c7c tempest-FlavorsAdminTestJSON-719478982 tempest-FlavorsAdminTestJSON-719478982-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.049090 Sep 06 10:50:41.110357 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 61/125] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:41 2022] POST /compute/v2.1/servers => generated 81 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:41.112649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-680bd5e0-af86-4cf7-aed7-06e36e22cb40 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:41.116292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-680bd5e0-af86-4cf7-aed7-06e36e22cb40 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:41.116858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-680bd5e0-af86-4cf7-aed7-06e36e22cb40 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:41.119843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-db1b567e-4cbc-4c8a-9cfc-e8a944863078 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:41.238301 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-db1b567e-4cbc-4c8a-9cfc-e8a944863078 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1232886429" status: 202 len: 0 microversion: 2.1 time: 0.120457 Sep 06 10:50:41.238301 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 62/126] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Sep 6 10:50:41 2022] DELETE /compute/v2.1/flavors/1232886429 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:41.242497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f4378c53-ddb4-4648-bcb2-eb67c058cf77 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:41.270971 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f4378c53-ddb4-4648-bcb2-eb67c058cf77 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032217 Sep 06 10:50:41.272618 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 63/127] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:50:41.298654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-583758b4-b277-4b3e-99cf-b5ad97d52e83 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-873004297", "id": 400841167, "os-flavor-access:is_public": "False"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:41.424217 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-583758b4-b277-4b3e-99cf-b5ad97d52e83 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.130459 Sep 06 10:50:41.425146 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 64/128] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:41 2022] POST /compute/v2.1/flavors => generated 411 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:41.438374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5d342285-143d-4f8f-b39b-172975e82a76 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-528511827", "id": 2061737583, "os-flavor-access:is_public": "True"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:41.555591 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5d342285-143d-4f8f-b39b-172975e82a76 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.122010 Sep 06 10:50:41.556397 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 65/129] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:41 2022] POST /compute/v2.1/flavors => generated 413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:41.577382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84c0f5b5-d20b-473d-8fca-f1493d2a110c tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:41.641933 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84c0f5b5-d20b-473d-8fca-f1493d2a110c tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.074693 Sep 06 10:50:41.642805 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 66/130] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Sep 6 10:50:41 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:41.662750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ad55641-1b82-4ba8-a7e2-3af053fb5887 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:41.674512 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0ad55641-1b82-4ba8-a7e2-3af053fb5887 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.022099 Sep 06 10:50:41.675516 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 67/131] 10.222.0.20 () {58 vars in 1177 bytes} [Tue Sep 6 10:50:41 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:41.719053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b4da0ff-cb92-4f49-b2c8-b56beea62d37 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:41.737762 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b4da0ff-cb92-4f49-b2c8-b56beea62d37 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.041129 Sep 06 10:50:41.742568 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 68/132] 10.222.0.20 () {58 vars in 1171 bytes} [Tue Sep 6 10:50:41 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:41.752965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-32c12dd8-d05f-44ee-a72f-c82198e0d7d5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:41.754423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-32c12dd8-d05f-44ee-a72f-c82198e0d7d5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:41.763678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32c12dd8-d05f-44ee-a72f-c82198e0d7d5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:41.765394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32c12dd8-d05f-44ee-a72f-c82198e0d7d5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:41.765884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32c12dd8-d05f-44ee-a72f-c82198e0d7d5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:41.767140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32c12dd8-d05f-44ee-a72f-c82198e0d7d5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:41.768062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32c12dd8-d05f-44ee-a72f-c82198e0d7d5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:41.769059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32c12dd8-d05f-44ee-a72f-c82198e0d7d5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:41.861025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-680bd5e0-af86-4cf7-aed7-06e36e22cb40 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:41.869128 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-680bd5e0-af86-4cf7-aed7-06e36e22cb40 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1338 microversion: 2.1 time: 0.784427 Sep 06 10:50:41.869718 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 65/133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:41 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1338 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:41.874924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-875a275a-cd33-4e0e-b3d1-dd43ee1943f1 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:41.908943 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-875a275a-cd33-4e0e-b3d1-dd43ee1943f1 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.038156 Sep 06 10:50:41.909816 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 66/134] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Sep 6 10:50:41 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:41.923178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fee44499-65cc-4104-933d-76780697e3ff tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:41.949054 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fee44499-65cc-4104-933d-76780697e3ff tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.030105 Sep 06 10:50:41.952140 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 67/135] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Sep 6 10:50:41 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:50:41.968117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-47c11097-2eea-4016-b691-542317a4cbaf tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:41.971930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-32c12dd8-d05f-44ee-a72f-c82198e0d7d5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:41.983660 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-32c12dd8-d05f-44ee-a72f-c82198e0d7d5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.237527 Sep 06 10:50:41.983660 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 69/136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:41 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:42.005820 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-47c11097-2eea-4016-b691-542317a4cbaf tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.041680 Sep 06 10:50:42.009566 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 68/137] 10.222.0.20 () {58 vars in 1175 bytes} [Tue Sep 6 10:50:41 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:42.025845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d03b42f9-6235-461e-9d27-bb6ec78da2e4 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:42.048367 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d03b42f9-6235-461e-9d27-bb6ec78da2e4 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.026310 Sep 06 10:50:42.060926 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 70/138] 10.222.0.20 () {58 vars in 1173 bytes} [Tue Sep 6 10:50:42 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:42.072983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-836acac7-d044-4ca3-9660-fde2d7f59882 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:42.120287 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-836acac7-d044-4ca3-9660-fde2d7f59882 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.049473 Sep 06 10:50:42.120287 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 69/139] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Sep 6 10:50:42 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:42.144135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4e378ba0-bd2e-45f3-95e5-226da5b1e1ec tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:42.268834 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4e378ba0-bd2e-45f3-95e5-226da5b1e1ec tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2061737583" status: 202 len: 0 microversion: 2.1 time: 0.128637 Sep 06 10:50:42.269574 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 71/140] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Sep 6 10:50:42 2022] DELETE /compute/v2.1/flavors/2061737583 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:42.278820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bde41fc2-eef2-4adc-8e16-aaf3e2e3b310 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:42.312262 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bde41fc2-eef2-4adc-8e16-aaf3e2e3b310 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037130 Sep 06 10:50:42.333363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6d31ac7c-629f-4b72-8ed6-5c0097bcca31 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:42.336315 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 70/141] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:42.430340 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6d31ac7c-629f-4b72-8ed6-5c0097bcca31 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/400841167" status: 202 len: 0 microversion: 2.1 time: 0.102875 Sep 06 10:50:42.438813 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 72/142] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:50:42 2022] DELETE /compute/v2.1/flavors/400841167 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:42.440164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-631117d0-102e-4f07-a9f7-df5934ecbd59 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:42.461833 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-631117d0-102e-4f07-a9f7-df5934ecbd59 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025949 Sep 06 10:50:42.475642 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 71/143] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:42.489137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-47b7e5dc-0463-4a60-97f9-a55f7db281fc tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1233251553", "id": 451281810, "os-flavor-access:is_public": "False"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:42.521786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SAVEPOINT=4,nova_api:INSERT=5,nova_api:RELEASE=4,nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=10 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:42.569945 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-47b7e5dc-0463-4a60-97f9-a55f7db281fc tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.085559 Sep 06 10:50:42.570906 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 73/144] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:42 2022] POST /compute/v2.1/flavors => generated 412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:42.584920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3bd0d7e9-4051-4858-8eb4-ac0bd30a71da tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:42.619416 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3bd0d7e9-4051-4858-8eb4-ac0bd30a71da tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039796 Sep 06 10:50:42.621478 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 72/145] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:42.640060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e8428567-f8ea-4bca-b3b2-9d04821230ff tempest-FlavorsAdminTestJSON-719478982 tempest-FlavorsAdminTestJSON-719478982-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:42.688134 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e8428567-f8ea-4bca-b3b2-9d04821230ff tempest-FlavorsAdminTestJSON-719478982 tempest-FlavorsAdminTestJSON-719478982-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044748 Sep 06 10:50:42.688134 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 74/146] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:42.705323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2b74eb75-207c-43e7-9249-e5ec0127f868 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:42.805110 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2b74eb75-207c-43e7-9249-e5ec0127f868 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/451281810" status: 202 len: 0 microversion: 2.1 time: 0.103977 Sep 06 10:50:42.806509 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 73/147] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:50:42 2022] DELETE /compute/v2.1/flavors/451281810 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:42.815334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b765e092-0c11-4a50-bce9-cb872e0885e4 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:42.870931 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b765e092-0c11-4a50-bce9-cb872e0885e4 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059869 Sep 06 10:50:42.884281 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 75/148] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:42.895406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c1b49fb-19ed-4a1c-8c58-0bc75db67199 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:42.896235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8c1b49fb-19ed-4a1c-8c58-0bc75db67199 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:42.896371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5dd7576f-8017-444b-b23c-8c0f593ac632 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-742625708", "id": 1701412982, "os-flavor-access:is_public": "True"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:42.918233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c1b49fb-19ed-4a1c-8c58-0bc75db67199 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:42.918233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c1b49fb-19ed-4a1c-8c58-0bc75db67199 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:42.918233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c1b49fb-19ed-4a1c-8c58-0bc75db67199 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:42.918233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c1b49fb-19ed-4a1c-8c58-0bc75db67199 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:42.918747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c1b49fb-19ed-4a1c-8c58-0bc75db67199 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:42.918747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c1b49fb-19ed-4a1c-8c58-0bc75db67199 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:42.976080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:43.036104 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5dd7576f-8017-444b-b23c-8c0f593ac632 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.143474 Sep 06 10:50:43.045371 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 76/149] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:42 2022] POST /compute/v2.1/flavors => generated 413 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:43.050724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2738f670-67c1-4b03-a099-ddf8222396dd tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:43.051583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2738f670-67c1-4b03-a099-ddf8222396dd tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:43.061963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2738f670-67c1-4b03-a099-ddf8222396dd tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:43.062659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2738f670-67c1-4b03-a099-ddf8222396dd tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:43.063348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2738f670-67c1-4b03-a099-ddf8222396dd tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:43.064266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2738f670-67c1-4b03-a099-ddf8222396dd tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:43.068762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2738f670-67c1-4b03-a099-ddf8222396dd tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:43.074477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2738f670-67c1-4b03-a099-ddf8222396dd tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:43.480768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8c1b49fb-19ed-4a1c-8c58-0bc75db67199 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:43.493604 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8c1b49fb-19ed-4a1c-8c58-0bc75db67199 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1338 microversion: 2.1 time: 0.602126 Sep 06 10:50:43.494216 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 74/150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:42 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1338 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:43.513626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-58245a91-7afb-461f-80bf-49adc160aae7 tempest-FlavorsAdminTestJSON-719478982 tempest-FlavorsAdminTestJSON-719478982-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:43.558022 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-58245a91-7afb-461f-80bf-49adc160aae7 tempest-FlavorsAdminTestJSON-719478982 tempest-FlavorsAdminTestJSON-719478982-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.062532 Sep 06 10:50:43.567543 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 75/151] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:43 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:43.578106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2738f670-67c1-4b03-a099-ddf8222396dd tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:43.580061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-87d6a2b8-a42d-4dea-8e48-5221fcac47c1 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:43.584529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:DELETE=10 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:43.592350 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2738f670-67c1-4b03-a099-ddf8222396dd tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.545348 Sep 06 10:50:43.593592 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 77/152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:43 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:43.703871 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-87d6a2b8-a42d-4dea-8e48-5221fcac47c1 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1701412982" status: 202 len: 0 microversion: 2.1 time: 0.127268 Sep 06 10:50:43.704998 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 76/153] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Sep 6 10:50:43 2022] DELETE /compute/v2.1/flavors/1701412982 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 10:50:43.718801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-69b60a46-0a1f-403a-82bc-abaf561cd077 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:43.750151 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-69b60a46-0a1f-403a-82bc-abaf561cd077 tempest-FlavorsAdminTestJSON-45677332 tempest-FlavorsAdminTestJSON-45677332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040388 Sep 06 10:50:43.752141 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 78/154] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:44.518422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6fec98ca-af09-4c15-8f04-634eef43c224 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:44.520585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6fec98ca-af09-4c15-8f04-634eef43c224 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:44.528960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fec98ca-af09-4c15-8f04-634eef43c224 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:44.529748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fec98ca-af09-4c15-8f04-634eef43c224 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:44.530432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fec98ca-af09-4c15-8f04-634eef43c224 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:44.531311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fec98ca-af09-4c15-8f04-634eef43c224 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:44.532009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fec98ca-af09-4c15-8f04-634eef43c224 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:44.533252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fec98ca-af09-4c15-8f04-634eef43c224 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:44.617500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d143f2e5-8130-40fd-b1f4-2867d15de92b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:44.618317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d143f2e5-8130-40fd-b1f4-2867d15de92b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:44.626233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d143f2e5-8130-40fd-b1f4-2867d15de92b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:44.626938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d143f2e5-8130-40fd-b1f4-2867d15de92b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:44.627450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d143f2e5-8130-40fd-b1f4-2867d15de92b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:44.628352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d143f2e5-8130-40fd-b1f4-2867d15de92b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:44.629103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d143f2e5-8130-40fd-b1f4-2867d15de92b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:44.629657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d143f2e5-8130-40fd-b1f4-2867d15de92b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:44.766167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6fec98ca-af09-4c15-8f04-634eef43c224 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:44.775386 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6fec98ca-af09-4c15-8f04-634eef43c224 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1338 microversion: 2.1 time: 0.261796 Sep 06 10:50:44.776299 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 77/155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:44 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1338 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:44.865011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d143f2e5-8130-40fd-b1f4-2867d15de92b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:44.876221 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d143f2e5-8130-40fd-b1f4-2867d15de92b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.262640 Sep 06 10:50:44.876800 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 79/156] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:44 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:45.798651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c6d7272c-6cf8-41de-8164-6c61a34a0f02 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:45.799373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c6d7272c-6cf8-41de-8164-6c61a34a0f02 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:45.816036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6d7272c-6cf8-41de-8164-6c61a34a0f02 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:45.816711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6d7272c-6cf8-41de-8164-6c61a34a0f02 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:45.817155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6d7272c-6cf8-41de-8164-6c61a34a0f02 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:45.817882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6d7272c-6cf8-41de-8164-6c61a34a0f02 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:45.818506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6d7272c-6cf8-41de-8164-6c61a34a0f02 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:45.818936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6d7272c-6cf8-41de-8164-6c61a34a0f02 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:45.903127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-922770e3-9cc2-496d-844e-099b36eef95b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:45.904478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-922770e3-9cc2-496d-844e-099b36eef95b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:45.913218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-922770e3-9cc2-496d-844e-099b36eef95b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:45.914001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-922770e3-9cc2-496d-844e-099b36eef95b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:45.914742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-922770e3-9cc2-496d-844e-099b36eef95b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:45.915837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-922770e3-9cc2-496d-844e-099b36eef95b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:45.916570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-922770e3-9cc2-496d-844e-099b36eef95b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:45.917224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-922770e3-9cc2-496d-844e-099b36eef95b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:45.950480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:46.129057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c6d7272c-6cf8-41de-8164-6c61a34a0f02 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:46.140401 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c6d7272c-6cf8-41de-8164-6c61a34a0f02 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1338 microversion: 2.1 time: 0.346398 Sep 06 10:50:46.144231 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 78/157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:45 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1338 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:46.187602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-922770e3-9cc2-496d-844e-099b36eef95b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:46.199592 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-922770e3-9cc2-496d-844e-099b36eef95b tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.300862 Sep 06 10:50:46.211500 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 80/158] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:45 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:50:46.639934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-456c5483-79c0-4e7f-884c-1278eaafaf9f req-5e33c11e-2e3a-451f-89ce-9019a75e6c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44496f5-17da-461a-bc43-4ae9d86e49df", "name": "network-vif-plugged", "status": "completed", "tag": "06887f8c-ef11-4593-892f-246139293ebc"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:46.661195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-456c5483-79c0-4e7f-884c-1278eaafaf9f req-5e33c11e-2e3a-451f-89ce-9019a75e6c69 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:46.661756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-456c5483-79c0-4e7f-884c-1278eaafaf9f req-5e33c11e-2e3a-451f-89ce-9019a75e6c69 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:46.662183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-456c5483-79c0-4e7f-884c-1278eaafaf9f req-5e33c11e-2e3a-451f-89ce-9019a75e6c69 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:46.699359 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-456c5483-79c0-4e7f-884c-1278eaafaf9f req-5e33c11e-2e3a-451f-89ce-9019a75e6c69 service nova] Creating event network-vif-plugged:06887f8c-ef11-4593-892f-246139293ebc for instance a44496f5-17da-461a-bc43-4ae9d86e49df on nch1-master-1 Sep 06 10:50:46.699993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-456c5483-79c0-4e7f-884c-1278eaafaf9f req-5e33c11e-2e3a-451f-89ce-9019a75e6c69 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=140876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 10:50:46.700669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-456c5483-79c0-4e7f-884c-1278eaafaf9f req-5e33c11e-2e3a-451f-89ce-9019a75e6c69 service nova] Acquired lock "compute-rpcapi-router" {{(pid=140876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 10:50:46.701895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b16ce2fe-3ee7-494e-9b93-a3c2f4a919c7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:46.702421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b16ce2fe-3ee7-494e-9b93-a3c2f4a919c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:46.703382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b16ce2fe-3ee7-494e-9b93-a3c2f4a919c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:46.703624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b16ce2fe-3ee7-494e-9b93-a3c2f4a919c7 None None] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:46.704085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b16ce2fe-3ee7-494e-9b93-a3c2f4a919c7 None None] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:46.704516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b16ce2fe-3ee7-494e-9b93-a3c2f4a919c7 None None] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:46.714899 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.compute.rpcapi [None req-b16ce2fe-3ee7-494e-9b93-a3c2f4a919c7 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 10:50:46.716691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b16ce2fe-3ee7-494e-9b93-a3c2f4a919c7 None None] Releasing lock "compute-rpcapi-router" {{(pid=140876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 10:50:46.736463 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b16ce2fe-3ee7-494e-9b93-a3c2f4a919c7 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.502608 Sep 06 10:50:46.738332 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 79/159] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:47.171379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-55a59400-d3fb-45de-8eed-905e147b23bd tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:47.171379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-55a59400-d3fb-45de-8eed-905e147b23bd tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:47.180033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55a59400-d3fb-45de-8eed-905e147b23bd tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:47.180560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55a59400-d3fb-45de-8eed-905e147b23bd tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:47.181182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55a59400-d3fb-45de-8eed-905e147b23bd tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:47.182071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55a59400-d3fb-45de-8eed-905e147b23bd tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:47.182877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55a59400-d3fb-45de-8eed-905e147b23bd tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:47.183453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55a59400-d3fb-45de-8eed-905e147b23bd tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:47.231047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-261afb62-f0b8-4065-bae6-7878e82f85cb tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:47.232413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-261afb62-f0b8-4065-bae6-7878e82f85cb tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:47.239831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-261afb62-f0b8-4065-bae6-7878e82f85cb tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:47.240611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-261afb62-f0b8-4065-bae6-7878e82f85cb tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:47.241086 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-261afb62-f0b8-4065-bae6-7878e82f85cb tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:47.241802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-261afb62-f0b8-4065-bae6-7878e82f85cb tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:47.242529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-261afb62-f0b8-4065-bae6-7878e82f85cb tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:47.243164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-261afb62-f0b8-4065-bae6-7878e82f85cb tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:47.384366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-55a59400-d3fb-45de-8eed-905e147b23bd tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:47.392713 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-55a59400-d3fb-45de-8eed-905e147b23bd tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1338 microversion: 2.1 time: 0.228809 Sep 06 10:50:47.394865 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 81/160] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:47 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1338 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:47.475846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-261afb62-f0b8-4065-bae6-7878e82f85cb tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:47.485036 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-261afb62-f0b8-4065-bae6-7878e82f85cb tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.259412 Sep 06 10:50:47.486901 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 80/161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:47 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:50:48.417847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-165ce8ed-b1c1-4497-9a48-af5466b0ef49 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:48.419178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-165ce8ed-b1c1-4497-9a48-af5466b0ef49 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:48.429915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-165ce8ed-b1c1-4497-9a48-af5466b0ef49 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:48.431758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-165ce8ed-b1c1-4497-9a48-af5466b0ef49 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:48.432298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-165ce8ed-b1c1-4497-9a48-af5466b0ef49 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:48.433101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-165ce8ed-b1c1-4497-9a48-af5466b0ef49 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:48.433907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-165ce8ed-b1c1-4497-9a48-af5466b0ef49 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:48.434558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-165ce8ed-b1c1-4497-9a48-af5466b0ef49 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:48.659475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-165ce8ed-b1c1-4497-9a48-af5466b0ef49 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:48.668747 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-165ce8ed-b1c1-4497-9a48-af5466b0ef49 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1338 microversion: 2.1 time: 0.255024 Sep 06 10:50:48.669340 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 81/162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:48 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1338 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:50:48.687421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5d7e4f70-9e47-41a7-b43b-1816e2b4af6e tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:48.688047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5d7e4f70-9e47-41a7-b43b-1816e2b4af6e tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:48.695912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d7e4f70-9e47-41a7-b43b-1816e2b4af6e tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:48.701640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d7e4f70-9e47-41a7-b43b-1816e2b4af6e tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:48.702299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d7e4f70-9e47-41a7-b43b-1816e2b4af6e tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:48.703278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d7e4f70-9e47-41a7-b43b-1816e2b4af6e tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:48.703898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d7e4f70-9e47-41a7-b43b-1816e2b4af6e tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:48.704504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d7e4f70-9e47-41a7-b43b-1816e2b4af6e tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:48.710596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:48.744719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e75d432-d08e-4900-acf5-6161f3ea4fe3 tempest-InstanceUsageAuditLogTestJSON-43263307 tempest-InstanceUsageAuditLogTestJSON-43263307-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:48.783045 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3e75d432-d08e-4900-acf5-6161f3ea4fe3 tempest-InstanceUsageAuditLogTestJSON-43263307 tempest-InstanceUsageAuditLogTestJSON-43263307-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-06 10:50:48" status: 200 len: 318 microversion: 2.1 time: 0.609061 Sep 06 10:50:48.784297 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 82/163] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 10:50:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-06%2010%3A50%3A48 => generated 318 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:48.804671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-da1bb341-9514-43f6-b902-529235099256 req-a29039d2-e6f9-4f15-9a11-46fd3a77615d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae98d37d-ffd5-4db1-87d9-4e70a654845d", "name": "network-vif-plugged", "status": "completed", "tag": "4f78520d-38fd-45e3-85c0-dec28088ea6c"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:48.828266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-da1bb341-9514-43f6-b902-529235099256 req-a29039d2-e6f9-4f15-9a11-46fd3a77615d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:48.830546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-da1bb341-9514-43f6-b902-529235099256 req-a29039d2-e6f9-4f15-9a11-46fd3a77615d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:48.831197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-da1bb341-9514-43f6-b902-529235099256 req-a29039d2-e6f9-4f15-9a11-46fd3a77615d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:48.849437 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-da1bb341-9514-43f6-b902-529235099256 req-a29039d2-e6f9-4f15-9a11-46fd3a77615d service nova] Creating event network-vif-plugged:4f78520d-38fd-45e3-85c0-dec28088ea6c for instance ae98d37d-ffd5-4db1-87d9-4e70a654845d on nch1-master-1 Sep 06 10:50:48.855265 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-da1bb341-9514-43f6-b902-529235099256 req-a29039d2-e6f9-4f15-9a11-46fd3a77615d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063470 Sep 06 10:50:48.856579 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 83/164] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:48.863156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7c109089-5778-4877-8e96-383a84e1723d tempest-InstanceUsageAuditLogTestJSON-43263307 tempest-InstanceUsageAuditLogTestJSON-43263307-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:48.888311 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7c109089-5778-4877-8e96-383a84e1723d tempest-InstanceUsageAuditLogTestJSON-43263307 tempest-InstanceUsageAuditLogTestJSON-43263307-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.029740 Sep 06 10:50:48.890002 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 84/165] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Sep 6 10:50:48 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:49.014225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5d7e4f70-9e47-41a7-b43b-1816e2b4af6e tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:49.026262 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5d7e4f70-9e47-41a7-b43b-1816e2b4af6e tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.355852 Sep 06 10:50:49.027210 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 82/166] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:48 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:49.701095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-da232fe2-9b5f-4ec4-963d-bdd4bfe4383c tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:49.701974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-da232fe2-9b5f-4ec4-963d-bdd4bfe4383c tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:49.718684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da232fe2-9b5f-4ec4-963d-bdd4bfe4383c tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:49.719273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da232fe2-9b5f-4ec4-963d-bdd4bfe4383c tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:49.721943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da232fe2-9b5f-4ec4-963d-bdd4bfe4383c tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:49.724183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da232fe2-9b5f-4ec4-963d-bdd4bfe4383c tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:49.729466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da232fe2-9b5f-4ec4-963d-bdd4bfe4383c tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:49.730154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da232fe2-9b5f-4ec4-963d-bdd4bfe4383c tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:50.022721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-da232fe2-9b5f-4ec4-963d-bdd4bfe4383c tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:50.035837 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-da232fe2-9b5f-4ec4-963d-bdd4bfe4383c tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1488 microversion: 2.1 time: 0.346491 Sep 06 10:50:50.037275 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 85/167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:49 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1488 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:50.062969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c205c954-b77e-4342-bb28-c96731f1dc87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:50.064322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c205c954-b77e-4342-bb28-c96731f1dc87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:50.069764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ab14297-7133-4cc3-9366-e4631f329af5 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:50.071805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ab14297-7133-4cc3-9366-e4631f329af5 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:50.078520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c205c954-b77e-4342-bb28-c96731f1dc87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:50.079425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c205c954-b77e-4342-bb28-c96731f1dc87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:50.079558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ab14297-7133-4cc3-9366-e4631f329af5 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:50.079872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c205c954-b77e-4342-bb28-c96731f1dc87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:50.082874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ab14297-7133-4cc3-9366-e4631f329af5 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:50.082874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ab14297-7133-4cc3-9366-e4631f329af5 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:50.083097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c205c954-b77e-4342-bb28-c96731f1dc87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:50.083097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c205c954-b77e-4342-bb28-c96731f1dc87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:50.083294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ab14297-7133-4cc3-9366-e4631f329af5 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:50.083394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c205c954-b77e-4342-bb28-c96731f1dc87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:50.083484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ab14297-7133-4cc3-9366-e4631f329af5 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:50.083484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ab14297-7133-4cc3-9366-e4631f329af5 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:50.648852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c205c954-b77e-4342-bb28-c96731f1dc87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:50.665845 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c205c954-b77e-4342-bb28-c96731f1dc87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1342 microversion: 2.1 time: 0.613400 Sep 06 10:50:50.687812 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 83/168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:50 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1342 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:51.025660 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ab14297-7133-4cc3-9366-e4631f329af5 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1639 microversion: 2.1 time: 0.960256 Sep 06 10:50:51.028359 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 86/169] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:50 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1639 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:51.054906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d016fddd-9b77-4943-8341-565b9edb334a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:51.055464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d016fddd-9b77-4943-8341-565b9edb334a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:51.068517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d016fddd-9b77-4943-8341-565b9edb334a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:51.070144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d016fddd-9b77-4943-8341-565b9edb334a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:51.070621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d016fddd-9b77-4943-8341-565b9edb334a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:51.072950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d016fddd-9b77-4943-8341-565b9edb334a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:51.075203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d016fddd-9b77-4943-8341-565b9edb334a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:51.076007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d016fddd-9b77-4943-8341-565b9edb334a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:51.139488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d016fddd-9b77-4943-8341-565b9edb334a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:50:51.685480 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d016fddd-9b77-4943-8341-565b9edb334a tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 204 len: 0 microversion: 2.1 time: 0.634581 Sep 06 10:50:51.687100 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 84/170] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:50:51 2022] DELETE /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:50:51.700571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ca7a461a-fd74-489a-ab1b-e26cb60a9b87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:51.703805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ca7a461a-fd74-489a-ab1b-e26cb60a9b87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:51.706377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-79786609-b7ea-4188-a98e-d05ce4c6ebcf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:51.707266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-79786609-b7ea-4188-a98e-d05ce4c6ebcf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:51.720921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79786609-b7ea-4188-a98e-d05ce4c6ebcf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:51.721685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79786609-b7ea-4188-a98e-d05ce4c6ebcf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:51.725076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79786609-b7ea-4188-a98e-d05ce4c6ebcf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:51.726034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca7a461a-fd74-489a-ab1b-e26cb60a9b87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:51.726400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79786609-b7ea-4188-a98e-d05ce4c6ebcf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:51.726555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca7a461a-fd74-489a-ab1b-e26cb60a9b87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:51.727277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca7a461a-fd74-489a-ab1b-e26cb60a9b87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:51.728126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79786609-b7ea-4188-a98e-d05ce4c6ebcf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:51.734341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca7a461a-fd74-489a-ab1b-e26cb60a9b87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:51.734929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79786609-b7ea-4188-a98e-d05ce4c6ebcf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:51.735037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca7a461a-fd74-489a-ab1b-e26cb60a9b87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:51.735037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca7a461a-fd74-489a-ab1b-e26cb60a9b87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:52.158938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ca7a461a-fd74-489a-ab1b-e26cb60a9b87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:52.165541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-79786609-b7ea-4188-a98e-d05ce4c6ebcf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:52.167081 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ca7a461a-fd74-489a-ab1b-e26cb60a9b87 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1492 microversion: 2.1 time: 0.473394 Sep 06 10:50:52.175375 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 85/171] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:51 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1492 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:52.178521 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-79786609-b7ea-4188-a98e-d05ce4c6ebcf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1494 microversion: 2.1 time: 0.485815 Sep 06 10:50:52.179310 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 87/172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:51 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1494 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:52.828809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-02a7442f-90f5-4bec-9f1c-7afd927a3775 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:52.829471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-02a7442f-90f5-4bec-9f1c-7afd927a3775 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:52.852587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02a7442f-90f5-4bec-9f1c-7afd927a3775 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:52.855283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02a7442f-90f5-4bec-9f1c-7afd927a3775 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:52.856698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02a7442f-90f5-4bec-9f1c-7afd927a3775 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:52.858805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02a7442f-90f5-4bec-9f1c-7afd927a3775 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:52.859515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02a7442f-90f5-4bec-9f1c-7afd927a3775 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:52.860799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02a7442f-90f5-4bec-9f1c-7afd927a3775 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:53.020897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-02a7442f-90f5-4bec-9f1c-7afd927a3775 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:50:53.438351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b7e5296a-4a54-44a3-a3c6-b4d2e0b3356f tempest-FlavorMetadataValidation-413291589 tempest-FlavorMetadataValidation-413291589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-284192350", "id": 312525086, "os-flavor-access:is_public": "True"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:53.525116 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-02a7442f-90f5-4bec-9f1c-7afd927a3775 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 204 len: 0 microversion: 2.1 time: 1.334583 Sep 06 10:50:53.527540 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 86/173] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:50:52 2022] DELETE /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 0 bytes in 1338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 10:50:53.533813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d1d6ad74-72cf-43b4-979e-496acdac7b10 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:53.537993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d1d6ad74-72cf-43b4-979e-496acdac7b10 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:53.545880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1d6ad74-72cf-43b4-979e-496acdac7b10 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:53.546722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1d6ad74-72cf-43b4-979e-496acdac7b10 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:53.547353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1d6ad74-72cf-43b4-979e-496acdac7b10 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:53.548476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1d6ad74-72cf-43b4-979e-496acdac7b10 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:53.549126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1d6ad74-72cf-43b4-979e-496acdac7b10 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:53.549778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1d6ad74-72cf-43b4-979e-496acdac7b10 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:53.576989 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b7e5296a-4a54-44a3-a3c6-b4d2e0b3356f tempest-FlavorMetadataValidation-413291589 tempest-FlavorMetadataValidation-413291589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 1.176739 Sep 06 10:50:53.579811 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 88/174] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 10:50:52 2022] POST /compute/v2.1/flavors => generated 467 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 10:50:53.586115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6effa04b-2df9-4984-9860-b92cacdd6e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:53.589142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6effa04b-2df9-4984-9860-b92cacdd6e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:53.630489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6effa04b-2df9-4984-9860-b92cacdd6e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:53.631030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6effa04b-2df9-4984-9860-b92cacdd6e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:53.631484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6effa04b-2df9-4984-9860-b92cacdd6e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:53.633532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6effa04b-2df9-4984-9860-b92cacdd6e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:53.637993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6effa04b-2df9-4984-9860-b92cacdd6e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:53.639608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6effa04b-2df9-4984-9860-b92cacdd6e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:53.810187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d1d6ad74-72cf-43b4-979e-496acdac7b10 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:53.821548 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d1d6ad74-72cf-43b4-979e-496acdac7b10 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1494 microversion: 2.1 time: 0.292494 Sep 06 10:50:53.822413 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 87/175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:53 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1494 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:53.827821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6f1db6d0-22aa-4401-85f0-ecd11e4a0e1c tempest-FlavorMetadataValidation-413291589 tempest-FlavorMetadataValidation-413291589-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:53.965500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6effa04b-2df9-4984-9860-b92cacdd6e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:54.004095 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6effa04b-2df9-4984-9860-b92cacdd6e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1498 microversion: 2.1 time: 0.403106 Sep 06 10:50:54.008372 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 89/176] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:53 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1498 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:54.203095 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6f1db6d0-22aa-4401-85f0-ecd11e4a0e1c tempest-FlavorMetadataValidation-413291589 tempest-FlavorMetadataValidation-413291589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/312525086/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.379312 Sep 06 10:50:54.206608 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 88/177] 10.222.0.20 () {62 vars in 1262 bytes} [Tue Sep 6 10:50:53 2022] POST /compute/v2.1/flavors/312525086/os-extra_specs => generated 62 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:54.536194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-13740759-2fc4-4457-b373-c605f514c2bf tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Calling method '.version_select at 0x7f90f94d4c10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:54.541946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13740759-2fc4-4457-b373-c605f514c2bf tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:54.542521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13740759-2fc4-4457-b373-c605f514c2bf tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:54.542977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13740759-2fc4-4457-b373-c605f514c2bf tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:54.543761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13740759-2fc4-4457-b373-c605f514c2bf tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:54.544230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13740759-2fc4-4457-b373-c605f514c2bf tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:54.544716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13740759-2fc4-4457-b373-c605f514c2bf tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:54.618275 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-13740759-2fc4-4457-b373-c605f514c2bf tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.608101 Sep 06 10:50:54.619883 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 90/178] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Sep 6 10:50:54 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:54.626157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1fd7508a-c9a7-4d6d-b77b-c23d14c521ad tempest-FlavorMetadataValidation-413291589 tempest-FlavorMetadataValidation-413291589-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:54.722326 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1fd7508a-c9a7-4d6d-b77b-c23d14c521ad tempest-FlavorMetadataValidation-413291589 tempest-FlavorMetadataValidation-413291589-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/312525086" status: 202 len: 0 microversion: 2.86 time: 0.101034 Sep 06 10:50:54.722953 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 91/179] 10.222.0.20 () {60 vars in 1199 bytes} [Tue Sep 6 10:50:54 2022] DELETE /compute/v2.1/flavors/312525086 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:50:54.727998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8198878f-e032-4337-b996-e1f008d4bdf8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Calling method '.version_select at 0x7f90f942c310>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:54.736257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8198878f-e032-4337-b996-e1f008d4bdf8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:54.736928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8198878f-e032-4337-b996-e1f008d4bdf8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:54.737531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8198878f-e032-4337-b996-e1f008d4bdf8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:54.738708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8198878f-e032-4337-b996-e1f008d4bdf8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:54.739468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8198878f-e032-4337-b996-e1f008d4bdf8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:54.740335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8198878f-e032-4337-b996-e1f008d4bdf8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:54.748274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-04346945-eb59-4c99-a5db-b7ac6f1b773e tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-680120521", "ram": 512, "vcpus": 1, "disk": 10, "id": 1475932106, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:54.777906 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8198878f-e032-4337-b996-e1f008d4bdf8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 401 microversion: 2.1 time: 0.053863 Sep 06 10:50:54.785672 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 92/180] 10.222.0.20 () {58 vars in 1139 bytes} [Tue Sep 6 10:50:54 2022] GET /compute/v2.1/os-hosts?zone= => generated 401 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:54.795713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e53bc362-fe80-4d06-82be-531ea46f0ea7 tempest-FlavorMetadataValidation-413291589 tempest-FlavorMetadataValidation-413291589-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:54.830093 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e53bc362-fe80-4d06-82be-531ea46f0ea7 tempest-FlavorMetadataValidation-413291589 tempest-FlavorMetadataValidation-413291589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.043030 Sep 06 10:50:54.843440 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 93/181] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Sep 6 10:50:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:50:54.855101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9b0759a8-c224-4eaf-9dcc-bf12735d065d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Calling method '.version_select at 0x7f90f93489d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:54.858704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b0759a8-c224-4eaf-9dcc-bf12735d065d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:54.859232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b0759a8-c224-4eaf-9dcc-bf12735d065d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:54.859847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b0759a8-c224-4eaf-9dcc-bf12735d065d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:54.860745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b0759a8-c224-4eaf-9dcc-bf12735d065d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:54.861356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b0759a8-c224-4eaf-9dcc-bf12735d065d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:54.861956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b0759a8-c224-4eaf-9dcc-bf12735d065d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:54.869077 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-04346945-eb59-4c99-a5db-b7ac6f1b773e tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.657746 Sep 06 10:50:54.869841 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 89/182] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:54 2022] POST /compute/v2.1/flavors => generated 415 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:54.894780 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9b0759a8-c224-4eaf-9dcc-bf12735d065d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.050160 Sep 06 10:50:54.894985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-e7ab6db7-2aca-44d8-b8c8-fd7a22099d6c req-a504896f-8961-4766-b94b-390a4b0c058e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44496f5-17da-461a-bc43-4ae9d86e49df", "name": "network-vif-deleted", "tag": "06887f8c-ef11-4593-892f-246139293ebc"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:54.907709 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 94/183] 10.222.0.20 () {58 vars in 1145 bytes} [Tue Sep 6 10:50:54 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:54.920560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e36e9dcd-764a-4f3e-8278-eca0bb57541e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:54.923568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e36e9dcd-764a-4f3e-8278-eca0bb57541e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:54.932499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e7ab6db7-2aca-44d8-b8c8-fd7a22099d6c req-a504896f-8961-4766-b94b-390a4b0c058e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:54.933014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e7ab6db7-2aca-44d8-b8c8-fd7a22099d6c req-a504896f-8961-4766-b94b-390a4b0c058e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:54.933462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e7ab6db7-2aca-44d8-b8c8-fd7a22099d6c req-a504896f-8961-4766-b94b-390a4b0c058e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:54.937637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e36e9dcd-764a-4f3e-8278-eca0bb57541e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:54.938307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e36e9dcd-764a-4f3e-8278-eca0bb57541e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:54.938859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e36e9dcd-764a-4f3e-8278-eca0bb57541e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:54.939970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e36e9dcd-764a-4f3e-8278-eca0bb57541e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:54.942644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e36e9dcd-764a-4f3e-8278-eca0bb57541e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:54.946175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e36e9dcd-764a-4f3e-8278-eca0bb57541e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:54.962916 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-e7ab6db7-2aca-44d8-b8c8-fd7a22099d6c req-a504896f-8961-4766-b94b-390a4b0c058e service nova] Creating event network-vif-deleted:06887f8c-ef11-4593-892f-246139293ebc for instance a44496f5-17da-461a-bc43-4ae9d86e49df on nch1-master-1 Sep 06 10:50:54.969508 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-e7ab6db7-2aca-44d8-b8c8-fd7a22099d6c req-a504896f-8961-4766-b94b-390a4b0c058e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098293 Sep 06 10:50:54.972357 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 90/184] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:55.161850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e36e9dcd-764a-4f3e-8278-eca0bb57541e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4effbac6059440f9105f21183de9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c708f857b3f445985133945eb88d6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:55.177047 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e36e9dcd-764a-4f3e-8278-eca0bb57541e tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 200 len: 1452 microversion: 2.1 time: 0.267860 Sep 06 10:50:55.187409 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 95/185] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:54 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 1452 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:55.196455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-460ee8fb-5a02-4168-bdc7-32e7384ef11c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:55.197695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-460ee8fb-5a02-4168-bdc7-32e7384ef11c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:55.206436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-460ee8fb-5a02-4168-bdc7-32e7384ef11c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:55.207675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-460ee8fb-5a02-4168-bdc7-32e7384ef11c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:55.208332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-460ee8fb-5a02-4168-bdc7-32e7384ef11c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:55.209802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-460ee8fb-5a02-4168-bdc7-32e7384ef11c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:55.210532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-460ee8fb-5a02-4168-bdc7-32e7384ef11c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:55.211223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-460ee8fb-5a02-4168-bdc7-32e7384ef11c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:55.300377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cf3f4d63-7caf-47a7-888d-3afca87aac58 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:55.311889 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-cf3f4d63-7caf-47a7-888d-3afca87aac58 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] HTTP exception thrown: Flavor 1475932106 has no extra specs with key hw:cpu_thread_policy. Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cf3f4d63-7caf-47a7-888d-3afca87aac58 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Request method failure captured: Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/flavors/1475932106/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyYKteaLaQ-BOn8xaTpgdZt75hbu5snuehIiLFJ3Ku5-SSQrSz7Oe4R1IlwL1oqpPref6MjXqHwRD6tNEv72hBSDDoOTWZtVoRknyEGwhQTvCdersxlX7nQCHet8MQitmXn6zY-zz1wCVErnJSXfdVuhDOsVeXQ_rTj8_zj6hHTLVp8 Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: ad1f8fbd81984512a7b38a5a01f21ae6 Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:50:55.313780 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:50:55.315137 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad1f8fbd81984512a7b38a5a01f21ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad1f8fbd81984512a7b38a5a01f21ae6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad1f8fbd81984512a7b38a5a01f21ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad1f8fbd81984512a7b38a5a01f21ae6"}]}] Sep 06 10:50:55.315137 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 Sep 06 10:50:55.315137 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: ad1f8fbd81984512a7b38a5a01f21ae6 Sep 06 10:50:55.315137 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 Sep 06 10:50:55.315137 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project Sep 06 10:50:55.315137 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:50:55.315137 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:50:55.315137 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 04e5b3b3591f4daf974896ad09651fd2 Sep 06 10:50:55.315137 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project Sep 06 10:50:55.315137 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:50:55.315137 ncdv-master-1 devstack@n-api.service[140876]: exception: Flavor 1475932106 has no extra specs with key hw:cpu_thread_policy. Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'flavor_id': '1475932106', 'id': 'hw:cpu_thread_policy'} Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1475932106 has no extra specs with key hw:cpu_thread_policy. Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:55.315843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.317186 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.317186 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.317186 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.317186 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:50:55.317186 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:50:55.317186 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1475932106 has no extra specs with key hw:cpu_thread_policy. Sep 06 10:50:55.317186 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.317186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cf3f4d63-7caf-47a7-888d-3afca87aac58 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Returning 404 to user: Flavor 1475932106 has no extra specs with key hw:cpu_thread_policy. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:55.317186 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cf3f4d63-7caf-47a7-888d-3afca87aac58 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] 10.222.0.20 "GET /compute/v2.1/flavors/1475932106/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.340535 Sep 06 10:50:55.320137 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 91/186] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 10:50:54 2022] GET /compute/v2.1/flavors/1475932106/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 346 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:50:55.325016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-84727f80-5185-4773-a046-0bc7c56861f0 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:55.328915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-84727f80-5185-4773-a046-0bc7c56861f0 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '04e5b3b3591f4daf974896ad09651fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f8fbd81984512a7b38a5a01f21ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-84727f80-5185-4773-a046-0bc7c56861f0 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Request method failure captured: Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/flavors/1475932106/os-extra_specs HTTP/1.1 Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 66 Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyYKteaLaQ-BOn8xaTpgdZt75hbu5snuehIiLFJ3Ku5-SSQrSz7Oe4R1IlwL1oqpPref6MjXqHwRD6tNEv72hBSDDoOTWZtVoRknyEGwhQTvCdersxlX7nQCHet8MQitmXn6zY-zz1wCVErnJSXfdVuhDOsVeXQ_rTj8_zj6hHTLVp8 Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: ad1f8fbd81984512a7b38a5a01f21ae6 Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:50:55.338410 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:50:55.340128 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad1f8fbd81984512a7b38a5a01f21ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad1f8fbd81984512a7b38a5a01f21ae6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad1f8fbd81984512a7b38a5a01f21ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad1f8fbd81984512a7b38a5a01f21ae6"}]}] Sep 06 10:50:55.340128 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 Sep 06 10:50:55.340128 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: ad1f8fbd81984512a7b38a5a01f21ae6 Sep 06 10:50:55.340128 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 Sep 06 10:50:55.340128 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project Sep 06 10:50:55.340128 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:50:55.340128 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:50:55.340128 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 04e5b3b3591f4daf974896ad09651fd2 Sep 06 10:50:55.340128 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project Sep 06 10:50:55.340128 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:50:55.340128 ncdv-master-1 devstack@n-api.service[140876]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 06 10:50:55.340128 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'flavor_id': '1475932106', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:50:55.340900 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 06 10:50:55.342709 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.344981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-84727f80-5185-4773-a046-0bc7c56861f0 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:55.346538 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-84727f80-5185-4773-a046-0bc7c56861f0 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] 10.222.0.20 "POST /compute/v2.1/flavors/1475932106/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.024860 Sep 06 10:50:55.351688 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 92/187] 10.222.0.20 () {60 vars in 1224 bytes} [Tue Sep 6 10:50:55 2022] POST /compute/v2.1/flavors/1475932106/os-extra_specs => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:50:55.357174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb817674-b7be-465d-ac4a-7110469d111b tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:55.491319 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fb817674-b7be-465d-ac4a-7110469d111b tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1475932106/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.137996 Sep 06 10:50:55.492035 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 93/188] 10.222.0.20 () {60 vars in 1224 bytes} [Tue Sep 6 10:50:55 2022] POST /compute/v2.1/flavors/1475932106/os-extra_specs => generated 66 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:55.506607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a2777f8a-73b2-4d1b-ae32-bcce98d7d970 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:55.507640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-460ee8fb-5a02-4168-bdc7-32e7384ef11c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:55.522444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a2777f8a-73b2-4d1b-ae32-bcce98d7d970 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '04e5b3b3591f4daf974896ad09651fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f8fbd81984512a7b38a5a01f21ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a2777f8a-73b2-4d1b-ae32-bcce98d7d970 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Request method failure captured: Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/flavors/1475932106/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyYKteaLaQ-BOn8xaTpgdZt75hbu5snuehIiLFJ3Ku5-SSQrSz7Oe4R1IlwL1oqpPref6MjXqHwRD6tNEv72hBSDDoOTWZtVoRknyEGwhQTvCdersxlX7nQCHet8MQitmXn6zY-zz1wCVErnJSXfdVuhDOsVeXQ_rTj8_zj6hHTLVp8 Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: ad1f8fbd81984512a7b38a5a01f21ae6 Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:50:55.528436 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:50:55.530280 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad1f8fbd81984512a7b38a5a01f21ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad1f8fbd81984512a7b38a5a01f21ae6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad1f8fbd81984512a7b38a5a01f21ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad1f8fbd81984512a7b38a5a01f21ae6"}]}] Sep 06 10:50:55.530280 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 Sep 06 10:50:55.530280 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: ad1f8fbd81984512a7b38a5a01f21ae6 Sep 06 10:50:55.530280 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 Sep 06 10:50:55.530280 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project Sep 06 10:50:55.530280 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:50:55.530280 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:50:55.530280 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 04e5b3b3591f4daf974896ad09651fd2 Sep 06 10:50:55.530280 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project Sep 06 10:50:55.530280 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:50:55.530280 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'flavor_id': '1475932106', 'id': 'hw:numa_nodes'} Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:50:55.530853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.531887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a2777f8a-73b2-4d1b-ae32-bcce98d7d970 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:55.533634 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a2777f8a-73b2-4d1b-ae32-bcce98d7d970 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] 10.222.0.20 "DELETE /compute/v2.1/flavors/1475932106/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.031343 Sep 06 10:50:55.533634 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 94/189] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 10:50:55 2022] DELETE /compute/v2.1/flavors/1475932106/os-extra_specs/hw:numa_nodes => generated 124 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:50:55.537248 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-460ee8fb-5a02-4168-bdc7-32e7384ef11c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1498 microversion: 2.1 time: 0.344280 Sep 06 10:50:55.539793 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 96/190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:55 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1498 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:55.557886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-476483be-e13b-4753-bf26-ce8f8a71be9b tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:55.587475 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-476483be-e13b-4753-bf26-ce8f8a71be9b tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1475932106/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041831 Sep 06 10:50:55.594605 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 95/191] 10.222.0.20 () {60 vars in 1224 bytes} [Tue Sep 6 10:50:55 2022] POST /compute/v2.1/flavors/1475932106/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:55.600428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8062db7a-6531-4cb4-b5e6-a54a59dd611b tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:55.605228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8062db7a-6531-4cb4-b5e6-a54a59dd611b tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '04e5b3b3591f4daf974896ad09651fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f8fbd81984512a7b38a5a01f21ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8062db7a-6531-4cb4-b5e6-a54a59dd611b tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Request method failure captured: Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: request: PUT /compute/v2.1/flavors/1475932106/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 22 Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYKteaLaQ-BOn8xaTpgdZt75hbu5snuehIiLFJ3Ku5-SSQrSz7Oe4R1IlwL1oqpPref6MjXqHwRD6tNEv72hBSDDoOTWZtVoRknyEGwhQTvCdersxlX7nQCHet8MQitmXn6zY-zz1wCVErnJSXfdVuhDOsVeXQ_rTj8_zj6hHTLVp8 Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ad1f8fbd81984512a7b38a5a01f21ae6 Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:50:55.608694 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:50:55.609859 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad1f8fbd81984512a7b38a5a01f21ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad1f8fbd81984512a7b38a5a01f21ae6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad1f8fbd81984512a7b38a5a01f21ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad1f8fbd81984512a7b38a5a01f21ae6"}]}] Sep 06 10:50:55.609859 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 Sep 06 10:50:55.609859 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ad1f8fbd81984512a7b38a5a01f21ae6 Sep 06 10:50:55.609859 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 Sep 06 10:50:55.609859 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project Sep 06 10:50:55.609859 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:50:55.609859 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:50:55.609859 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 04e5b3b3591f4daf974896ad09651fd2 Sep 06 10:50:55.609859 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project Sep 06 10:50:55.609859 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:50:55.609859 ncdv-master-1 devstack@n-api.service[140875]: {"hw:numa_nodes": "1"} Sep 06 10:50:55.609859 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:50:55.609859 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'flavor_id': '1475932106', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:50:55.610536 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 06 10:50:55.612312 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.614657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8062db7a-6531-4cb4-b5e6-a54a59dd611b tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:55.616202 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8062db7a-6531-4cb4-b5e6-a54a59dd611b tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684 tempest-FlavorsExtraSpecsNegativeTestJSON-2063329684-project] 10.222.0.20 "PUT /compute/v2.1/flavors/1475932106/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021366 Sep 06 10:50:55.617222 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 97/192] 10.222.0.20 () {60 vars in 1265 bytes} [Tue Sep 6 10:50:55 2022] PUT /compute/v2.1/flavors/1475932106/os-extra_specs/hw:numa_nodes => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:50:55.638916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93ec7a06-83be-4d53-a564-4774035a8667 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:55.642441 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-93ec7a06-83be-4d53-a564-4774035a8667 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] HTTP exception thrown: Flavor 1475932106 has no extra specs with key hw:cpu_thread_policy. Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93ec7a06-83be-4d53-a564-4774035a8667 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Request method failure captured: Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/flavors/1475932106/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYNGFCq3l2WphoNURzpIJtzNvh6qqiaj8Uzv8FhZYNy3-Fgq51ZwZK0r1289JaaSgWM9r_-48wr2WUmMATDSNNQpfB0gDmPHExrwIRtBaCOG9mopaNpc8Hrx2uGGTVHkGJ8VJuYpNIk8xTyG33guc3Q27ervunj62smE-lQfll_C-c Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 1e1a08ee14ba4961a722997512bb6c06 Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:50:55.643881 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:50:55.645142 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e1a08ee14ba4961a722997512bb6c06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e1a08ee14ba4961a722997512bb6c06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e1a08ee14ba4961a722997512bb6c06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e1a08ee14ba4961a722997512bb6c06"}]}] Sep 06 10:50:55.645142 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 Sep 06 10:50:55.645142 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 1e1a08ee14ba4961a722997512bb6c06 Sep 06 10:50:55.645142 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 Sep 06 10:50:55.645142 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin Sep 06 10:50:55.645142 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:50:55.645142 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:50:55.645142 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: bcd5497a97094ac182916c9a82fe5ccf Sep 06 10:50:55.645142 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin Sep 06 10:50:55.645142 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:50:55.645142 ncdv-master-1 devstack@n-api.service[140875]: exception: Flavor 1475932106 has no extra specs with key hw:cpu_thread_policy. Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'flavor_id': '1475932106', 'id': 'hw:cpu_thread_policy'} Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1475932106 has no extra specs with key hw:cpu_thread_policy. Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:55.645824 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.646950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.646950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.646950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.646950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:50:55.646950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:50:55.646950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1475932106 has no extra specs with key hw:cpu_thread_policy. Sep 06 10:50:55.646950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.646950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93ec7a06-83be-4d53-a564-4774035a8667 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Returning 404 to user: Flavor 1475932106 has no extra specs with key hw:cpu_thread_policy. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:55.646950 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-93ec7a06-83be-4d53-a564-4774035a8667 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1475932106/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.015001 Sep 06 10:50:55.646950 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 98/193] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 10:50:55 2022] DELETE /compute/v2.1/flavors/1475932106/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:50:55.654876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2e51ee35-a2c0-4443-b2a8-841521168884 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:55.658714 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-2e51ee35-a2c0-4443-b2a8-841521168884 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2e51ee35-a2c0-4443-b2a8-841521168884 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Request method failure captured: Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: request: PUT /compute/v2.1/flavors/1475932106/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 27 Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYNGFCq3l2WphoNURzpIJtzNvh6qqiaj8Uzv8FhZYNy3-Fgq51ZwZK0r1289JaaSgWM9r_-48wr2WUmMATDSNNQpfB0gDmPHExrwIRtBaCOG9mopaNpc8Hrx2uGGTVHkGJ8VJuYpNIk8xTyG33guc3Q27ervunj62smE-lQfll_C-c Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 1e1a08ee14ba4961a722997512bb6c06 Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:50:55.660099 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:50:55.661470 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e1a08ee14ba4961a722997512bb6c06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e1a08ee14ba4961a722997512bb6c06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e1a08ee14ba4961a722997512bb6c06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e1a08ee14ba4961a722997512bb6c06"}]}] Sep 06 10:50:55.661470 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 Sep 06 10:50:55.661470 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 1e1a08ee14ba4961a722997512bb6c06 Sep 06 10:50:55.661470 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 Sep 06 10:50:55.661470 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin Sep 06 10:50:55.661470 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:50:55.661470 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:50:55.661470 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: bcd5497a97094ac182916c9a82fe5ccf Sep 06 10:50:55.661470 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin Sep 06 10:50:55.661470 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:50:55.661470 ncdv-master-1 devstack@n-api.service[140875]: {"hw:cpu_policy": "shared"} Sep 06 10:50:55.661470 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:50:55.661470 ncdv-master-1 devstack@n-api.service[140875]: exception: Request body and URI mismatch Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'flavor_id': '1475932106', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.662331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.663612 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:50:55.663612 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:50:55.663612 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 06 10:50:55.663612 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.663612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2e51ee35-a2c0-4443-b2a8-841521168884 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:55.663612 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2e51ee35-a2c0-4443-b2a8-841521168884 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1475932106/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.010453 Sep 06 10:50:55.666491 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 99/194] 10.222.0.20 () {60 vars in 1265 bytes} [Tue Sep 6 10:50:55 2022] PUT /compute/v2.1/flavors/1475932106/os-extra_specs/hw:numa_nodes => generated 73 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:55.679025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5bc339ad-1bfa-4938-92e7-ab476d72cc3b tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5bc339ad-1bfa-4938-92e7-ab476d72cc3b tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Request method failure captured: Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: request: PUT /compute/v2.1/flavors/1475932106/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 49 Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYNGFCq3l2WphoNURzpIJtzNvh6qqiaj8Uzv8FhZYNy3-Fgq51ZwZK0r1289JaaSgWM9r_-48wr2WUmMATDSNNQpfB0gDmPHExrwIRtBaCOG9mopaNpc8Hrx2uGGTVHkGJ8VJuYpNIk8xTyG33guc3Q27ervunj62smE-lQfll_C-c Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 1e1a08ee14ba4961a722997512bb6c06 Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:50:55.689388 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:50:55.691743 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e1a08ee14ba4961a722997512bb6c06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e1a08ee14ba4961a722997512bb6c06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e1a08ee14ba4961a722997512bb6c06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e1a08ee14ba4961a722997512bb6c06"}]}] Sep 06 10:50:55.691743 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 Sep 06 10:50:55.691743 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 1e1a08ee14ba4961a722997512bb6c06 Sep 06 10:50:55.691743 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 Sep 06 10:50:55.691743 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin Sep 06 10:50:55.691743 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:50:55.691743 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:50:55.691743 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: bcd5497a97094ac182916c9a82fe5ccf Sep 06 10:50:55.691743 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin Sep 06 10:50:55.691743 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:50:55.691743 ncdv-master-1 devstack@n-api.service[140875]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 06 10:50:55.691743 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'flavor_id': '1475932106', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance: Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 06 10:50:55.692412 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.693805 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:55.696105 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:55.696105 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:55.696105 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:50:55.696105 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:50:55.696105 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 06 10:50:55.696105 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:55.696105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5bc339ad-1bfa-4938-92e7-ab476d72cc3b tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:55.696105 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5bc339ad-1bfa-4938-92e7-ab476d72cc3b tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1475932106/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.023361 Sep 06 10:50:55.696105 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 100/195] 10.222.0.20 () {60 vars in 1265 bytes} [Tue Sep 6 10:50:55 2022] PUT /compute/v2.1/flavors/1475932106/os-extra_specs/hw:numa_nodes => generated 117 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:50:55.703755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-17753d84-6e29-4b7f-b8ad-7572b3d291fd tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:55.802368 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-17753d84-6e29-4b7f-b8ad-7572b3d291fd tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1475932106" status: 202 len: 0 microversion: 2.1 time: 0.104919 Sep 06 10:50:55.806280 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 101/196] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Sep 6 10:50:55 2022] DELETE /compute/v2.1/flavors/1475932106 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:50:56.195844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2dd1c9be-e92c-4fe5-bd39-f4b2028a75ca tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:56.206605 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2dd1c9be-e92c-4fe5-bd39-f4b2028a75ca tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.582762 Sep 06 10:50:56.207414 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 96/197] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:50:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:56.221927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b39918c1-ae00-4ec7-994c-6d11c1de0aa3 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:56.247393 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b39918c1-ae00-4ec7-994c-6d11c1de0aa3 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676 tempest-FlavorsExtraSpecsNegativeTestJSON-236908676-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028414 Sep 06 10:50:56.249497 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 97/198] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:56.256499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-faf345ab-b77e-4031-bb4f-7c0e22831c08 req-b63895e1-2708-4e22-bd43-01f488cd5380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae98d37d-ffd5-4db1-87d9-4e70a654845d", "name": "network-vif-deleted", "tag": "4f78520d-38fd-45e3-85c0-dec28088ea6c"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:56.281113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-faf345ab-b77e-4031-bb4f-7c0e22831c08 req-b63895e1-2708-4e22-bd43-01f488cd5380 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:56.281702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-faf345ab-b77e-4031-bb4f-7c0e22831c08 req-b63895e1-2708-4e22-bd43-01f488cd5380 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:56.282152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-faf345ab-b77e-4031-bb4f-7c0e22831c08 req-b63895e1-2708-4e22-bd43-01f488cd5380 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:56.294924 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-faf345ab-b77e-4031-bb4f-7c0e22831c08 req-b63895e1-2708-4e22-bd43-01f488cd5380 service nova] Creating event network-vif-deleted:4f78520d-38fd-45e3-85c0-dec28088ea6c for instance ae98d37d-ffd5-4db1-87d9-4e70a654845d on nch1-master-1 Sep 06 10:50:56.303106 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-faf345ab-b77e-4031-bb4f-7c0e22831c08 req-b63895e1-2708-4e22-bd43-01f488cd5380 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048816 Sep 06 10:50:56.304216 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 98/199] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:56.310437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-80561be3-3593-4b69-9a61-ec6550c67fbe tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:56.312596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-80561be3-3593-4b69-9a61-ec6550c67fbe tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:56.319646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80561be3-3593-4b69-9a61-ec6550c67fbe tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:56.320780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80561be3-3593-4b69-9a61-ec6550c67fbe tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:56.321135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80561be3-3593-4b69-9a61-ec6550c67fbe tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:56.322359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80561be3-3593-4b69-9a61-ec6550c67fbe tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:56.323168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80561be3-3593-4b69-9a61-ec6550c67fbe tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:56.324127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80561be3-3593-4b69-9a61-ec6550c67fbe tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:56.333473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-74ac6d37-f74c-471d-be05-b4331e18d76b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Calling method '.version_select at 0x7f90f931c310>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:56.345026 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-80561be3-3593-4b69-9a61-ec6550c67fbe tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] HTTP exception thrown: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:50:56.350294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-74ac6d37-f74c-471d-be05-b4331e18d76b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a5a6b47c-7522-4a84-9be6-8ca7130ab6d7(cell1) {{(pid=140875) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-80561be3-3593-4b69-9a61-ec6550c67fbe tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Request method failure captured: Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df HTTP/1.1 Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyXozGH1mUy3OKWLRa8HbWRfMrTL1BgxLbGnP3TIXoGrkEVw8cZ5wpZK3wAI-tK3yxD0faZ6P-Fm_Nl9ptW8Id7QoyrUu10iww6Mm4K_5U7tTKInRF5hapoPoYo5rTEFbUI4aexJmetnbN8KW2fyMhLNT16T2nZ3wbP7j2vQVGdd9vI Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2c708f857b3f445985133945eb88d6d3 Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AggregatesAdminTestJSON-1582968489 Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:50:56.353161 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:50:56.354357 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c708f857b3f445985133945eb88d6d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c708f857b3f445985133945eb88d6d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c708f857b3f445985133945eb88d6d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c708f857b3f445985133945eb88d6d3"}]}] Sep 06 10:50:56.354357 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AggregatesAdminTestJSON-1582968489 Sep 06 10:50:56.354357 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2c708f857b3f445985133945eb88d6d3 Sep 06 10:50:56.354357 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1582968489 Sep 06 10:50:56.354357 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AggregatesAdminTestJSON-1582968489-project Sep 06 10:50:56.354357 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:50:56.354357 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:50:56.354357 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: b4effbac6059440f9105f21183de9b23 Sep 06 10:50:56.354357 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AggregatesAdminTestJSON-1582968489-project Sep 06 10:50:56.354357 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:50:56.354357 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:50:56.354357 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'a44496f5-17da-461a-bc43-4ae9d86e49df'} Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:56.355000 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:50:56.356299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:50:56.357251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-80561be3-3593-4b69-9a61-ec6550c67fbe tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Returning 404 to user: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:56.357251 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-80561be3-3593-4b69-9a61-ec6550c67fbe tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 404 len: 111 microversion: 2.1 time: 0.051558 Sep 06 10:50:56.362227 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 99/200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:56 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:50:56.368270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ac6d37-f74c-471d-be05-b4331e18d76b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:56.369287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ac6d37-f74c-471d-be05-b4331e18d76b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:56.370432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ac6d37-f74c-471d-be05-b4331e18d76b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:56.394131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=12,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:56.399917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ac6d37-f74c-471d-be05-b4331e18d76b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:56.400895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ac6d37-f74c-471d-be05-b4331e18d76b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:56.402802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ac6d37-f74c-471d-be05-b4331e18d76b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:56.418408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ac6d37-f74c-471d-be05-b4331e18d76b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:56.419527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ac6d37-f74c-471d-be05-b4331e18d76b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:56.420744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ac6d37-f74c-471d-be05-b4331e18d76b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:56.430064 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-74ac6d37-f74c-471d-be05-b4331e18d76b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.625283 Sep 06 10:50:56.439812 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 102/201] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:56.446204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8bc9c9a1-97d9-43e3-87cc-a15b9e1f4cce tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:56.463348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bc9c9a1-97d9-43e3-87cc-a15b9e1f4cce tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:56.464307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bc9c9a1-97d9-43e3-87cc-a15b9e1f4cce tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:56.465229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bc9c9a1-97d9-43e3-87cc-a15b9e1f4cce tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:56.587691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-77900f17-d80d-44ca-9025-5de3531d4467 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1446074023", "id": 998844218, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:56.595210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:SAVEPOINT=6,nova_api:INSERT=6,nova_api:RELEASE=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:56.712201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:56.732209 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-77900f17-d80d-44ca-9025-5de3531d4467 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.373083 Sep 06 10:50:56.740630 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 100/202] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:56 2022] POST /compute/v2.1/flavors => generated 422 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:56.746171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-87c7700d-2d22-4e6c-82c9-f9588628ea4f tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Calling method '.version_select at 0x7f90f8f8ab80>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:56.757350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c7700d-2d22-4e6c-82c9-f9588628ea4f tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:56.762780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c7700d-2d22-4e6c-82c9-f9588628ea4f tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:56.763694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c7700d-2d22-4e6c-82c9-f9588628ea4f tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:56.798939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c7700d-2d22-4e6c-82c9-f9588628ea4f tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:56.800292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c7700d-2d22-4e6c-82c9-f9588628ea4f tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:56.802687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c7700d-2d22-4e6c-82c9-f9588628ea4f tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:56.844456 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8bc9c9a1-97d9-43e3-87cc-a15b9e1f4cce tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.401756 Sep 06 10:50:56.845356 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 103/203] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Sep 6 10:50:56 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:56.851145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:56.851777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c7700d-2d22-4e6c-82c9-f9588628ea4f tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:56.852447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c7700d-2d22-4e6c-82c9-f9588628ea4f tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:56.852735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:56.852872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c7700d-2d22-4e6c-82c9-f9588628ea4f tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:56.862052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:56.870640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:56.870640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:56.870640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:56.870640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:56.870970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:56.871618 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-87c7700d-2d22-4e6c-82c9-f9588628ea4f tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.129804 Sep 06 10:50:56.876792 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 101/204] 10.222.0.20 () {58 vars in 1212 bytes} [Tue Sep 6 10:50:56 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 196 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:56.888771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8d0fd182-60ce-4b0e-9ee5-9a34f50ad616 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:56.904643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:56.905519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:56.906510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:56.906621 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8d0fd182-60ce-4b0e-9ee5-9a34f50ad616 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028566 Sep 06 10:50:56.909545 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 102/205] 10.222.0.20 () {58 vars in 1182 bytes} [Tue Sep 6 10:50:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:56.909667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lazy-loading 'fault' on Instance uuid ae98d37d-ffd5-4db1-87d9-4e70a654845d {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:50:56.918482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5869e47-31f8-469b-946b-7fe26a43f2de tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:57.017928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:57.031822 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6ae188cd-18bd-4c78-92d9-e15712039be2 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 200 len: 1310 microversion: 2.1 time: 0.182138 Sep 06 10:50:57.032992 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 104/206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:56 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 1310 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:57.051579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7da69672-a969-4cde-9a67-0f9fd76b16f0 tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Calling method '.version_select at 0x7f90f92a8e50>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:57.053981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7da69672-a969-4cde-9a67-0f9fd76b16f0 tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:57.055730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7da69672-a969-4cde-9a67-0f9fd76b16f0 tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:57.056480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7da69672-a969-4cde-9a67-0f9fd76b16f0 tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:57.080077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7da69672-a969-4cde-9a67-0f9fd76b16f0 tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:57.080668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7da69672-a969-4cde-9a67-0f9fd76b16f0 tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:57.081189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7da69672-a969-4cde-9a67-0f9fd76b16f0 tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:57.094676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7da69672-a969-4cde-9a67-0f9fd76b16f0 tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:57.095373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7da69672-a969-4cde-9a67-0f9fd76b16f0 tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:57.095995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7da69672-a969-4cde-9a67-0f9fd76b16f0 tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:57.105869 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a5869e47-31f8-469b-946b-7fe26a43f2de tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.197361 Sep 06 10:50:57.110013 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 103/207] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:50:56 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:50:57.115836 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7da69672-a969-4cde-9a67-0f9fd76b16f0 tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.081367 Sep 06 10:50:57.122357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-07e67d5a-6f3a-4bb4-9708-a446d38c50d3 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1029509224", "id": 74225120, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:57.123378 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 105/208] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:50:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:57.128868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9cf1faa8-6d2b-487b-9557-3730635ce1fc tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1846738538"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:57.135534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.aggregate [None req-9cf1faa8-6d2b-487b-9557-3730635ce1fc tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Generated uuid ba878a93-656a-47a0-ab9a-4ccc02ff8cc1 for aggregate {{(pid=140875) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:50:57.219962 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-07e67d5a-6f3a-4bb4-9708-a446d38c50d3 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 419 microversion: 2.1 time: 0.111504 Sep 06 10:50:57.220794 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 104/209] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:57 2022] POST /compute/v2.1/flavors => generated 419 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:57.224822 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9cf1faa8-6d2b-487b-9557-3730635ce1fc tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.100000 Sep 06 10:50:57.226767 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 106/210] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:50:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:57.231055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-19c47f6c-5249-4c3b-85e4-a339dc6fd93b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Calling method '.version_select at 0x7f90f8f458b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:57.233213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19c47f6c-5249-4c3b-85e4-a339dc6fd93b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:57.233867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19c47f6c-5249-4c3b-85e4-a339dc6fd93b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:57.234477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19c47f6c-5249-4c3b-85e4-a339dc6fd93b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:57.237410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-15719211-923d-4f1d-8f67-fd2fb23f5be8 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:57.252232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19c47f6c-5249-4c3b-85e4-a339dc6fd93b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:57.252831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19c47f6c-5249-4c3b-85e4-a339dc6fd93b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:57.253359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19c47f6c-5249-4c3b-85e4-a339dc6fd93b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:57.257149 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-15719211-923d-4f1d-8f67-fd2fb23f5be8 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027149 Sep 06 10:50:57.258071 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 107/211] 10.222.0.20 () {58 vars in 1182 bytes} [Tue Sep 6 10:50:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:50:57.260426 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-19c47f6c-5249-4c3b-85e4-a339dc6fd93b tempest-HypervisorAdminUnderV252Test-841373309 tempest-HypervisorAdminUnderV252Test-841373309-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.038257 Sep 06 10:50:57.265598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-00f53175-1b4d-412c-8c84-48082e17df43 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:57.268452 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 105/212] 10.222.0.20 () {58 vars in 1209 bytes} [Tue Sep 6 10:50:57 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:57.282103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-483d888d-4d04-4f96-94e4-b509bd1e72ed tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Action: 'create', calling method: .version_select at 0x7f90f8f52040>, body: {"keypair": {"name": "tempest-keypair-338547195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8EE0nJOOIqKk9ZQaF/q8ArHj8deWE+qPoVrEkEd6kr6/vtgVWQabqqXlP537t1VXq9ABDLsghhkvJKCOB+3cvZoj8RXIcZ/kxb15+xa2r6SmGYAf58AAFNmlQM54KeQQ=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:57.291117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00f53175-1b4d-412c-8c84-48082e17df43 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:57.292406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00f53175-1b4d-412c-8c84-48082e17df43 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:57.297041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00f53175-1b4d-412c-8c84-48082e17df43 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:57.334569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-483d888d-4d04-4f96-94e4-b509bd1e72ed tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Getting quotas for project c2078a32d1694ba3b1393762add00729. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:50:57.344860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-483d888d-4d04-4f96-94e4-b509bd1e72ed tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Getting quotas for user 6f59260019b34b0b8c4c8792afe8b317 and project c2078a32d1694ba3b1393762add00729. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:50:57.453237 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-483d888d-4d04-4f96-94e4-b509bd1e72ed tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183061 Sep 06 10:50:57.454119 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 106/213] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:50:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:57.613601 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-00f53175-1b4d-412c-8c84-48082e17df43 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.354242 Sep 06 10:50:57.615081 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 108/214] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Sep 6 10:50:57 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:57.628102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5be38e12-bd19-402a-8864-581e1134daaf tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:57.639085 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5be38e12-bd19-402a-8864-581e1134daaf tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.016395 Sep 06 10:50:57.639866 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 107/215] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 10:50:57 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:50:57.651597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff91b640-c5e2-4440-9328-5d82cb8ff971 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:57.664929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff91b640-c5e2-4440-9328-5d82cb8ff971 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:57.666087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff91b640-c5e2-4440-9328-5d82cb8ff971 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:57.666798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff91b640-c5e2-4440-9328-5d82cb8ff971 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:57.982413 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff91b640-c5e2-4440-9328-5d82cb8ff971 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.333760 Sep 06 10:50:57.984734 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 109/216] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Sep 6 10:50:57 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:50:58.001249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e3a05f0-6fef-4bb4-ba8b-799bf993ce9d tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:58.065230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-443c2fb8-f336-461f-9da4-5a173a1748c5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:58.066370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-443c2fb8-f336-461f-9da4-5a173a1748c5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:58.077012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-443c2fb8-f336-461f-9da4-5a173a1748c5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:58.077872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-443c2fb8-f336-461f-9da4-5a173a1748c5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:58.078706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-443c2fb8-f336-461f-9da4-5a173a1748c5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:58.080541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-443c2fb8-f336-461f-9da4-5a173a1748c5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:58.081485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-443c2fb8-f336-461f-9da4-5a173a1748c5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:58.082132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-443c2fb8-f336-461f-9da4-5a173a1748c5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:58.103684 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-443c2fb8-f336-461f-9da4-5a173a1748c5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] HTTP exception thrown: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:50:58.115031 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e3a05f0-6fef-4bb4-ba8b-799bf993ce9d tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.120405 Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-443c2fb8-f336-461f-9da4-5a173a1748c5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Request method failure captured: Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d HTTP/1.1 Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyXoXwgM3ATy6aZm-B9Ip6Ep2zFYB_9cxVRqt_R6hD_nr4VBECswwr9AGIzS2LE0EZe6Zs4UfxuwU9Mi73Azy1qRQIXzXZGgEdNFg963fTKBQ-95DxL0BMkESWANZT-cQcxJHORUcJxKv_Akw6pon_vuRABHM5_T4axhmFeqFevNIsg Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 8f141429ddf044e1812ea5e3dbecd995 Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:50:58.121238 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:50:58.126634 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f141429ddf044e1812ea5e3dbecd995"}]}] Sep 06 10:50:58.126634 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:50:58.126634 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 8f141429ddf044e1812ea5e3dbecd995 Sep 06 10:50:58.126634 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:50:58.126634 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersAdminTestJSON-534077102-project Sep 06 10:50:58.126634 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:50:58.126634 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:50:58.126634 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3ff6ad8e78ca4b6dbea50007a5737f5e Sep 06 10:50:58.126634 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersAdminTestJSON-534077102-project Sep 06 10:50:58.126634 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:50:58.126634 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:50:58.126634 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'ae98d37d-ffd5-4db1-87d9-4e70a654845d'} Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:50:58.127438 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:50:58.128493 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:50:58.129405 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 108/217] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:50:57 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:50:58.130530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8e2c7964-861c-4e80-9e47-4e7cdd0bef75 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-883694659"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:58.130756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-443c2fb8-f336-461f-9da4-5a173a1748c5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Returning 404 to user: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:50:58.131749 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-443c2fb8-f336-461f-9da4-5a173a1748c5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 404 len: 111 microversion: 2.1 time: 0.073930 Sep 06 10:50:58.138600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.aggregate [None req-8e2c7964-861c-4e80-9e47-4e7cdd0bef75 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Generated uuid 2a73805f-815a-42ad-849c-d35afb1d04db for aggregate {{(pid=140876) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:50:58.145510 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 110/218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:58 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:50:58.247887 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8e2c7964-861c-4e80-9e47-4e7cdd0bef75 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.123665 Sep 06 10:50:58.251288 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 109/219] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:50:58 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:58.263374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-263fa5e5-df8b-49be-aa5e-7dc4362d2d70 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:58.282711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-263fa5e5-df8b-49be-aa5e-7dc4362d2d70 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:58.283611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-263fa5e5-df8b-49be-aa5e-7dc4362d2d70 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:58.284110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-263fa5e5-df8b-49be-aa5e-7dc4362d2d70 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:58.538070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1018621594", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:58.572032 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-263fa5e5-df8b-49be-aa5e-7dc4362d2d70 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.313502 Sep 06 10:50:58.572941 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 111/220] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Sep 6 10:50:58 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:58.587874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b8b6e93-e23f-44e5-a7ab-53e60adcb472 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:58.607312 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b8b6e93-e23f-44e5-a7ab-53e60adcb472 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.025349 Sep 06 10:50:58.608697 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 112/221] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 10:50:58 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:58.620825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d9a22f61-7ae5-4a6e-baae-eb589059892c tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:58.633895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9a22f61-7ae5-4a6e-baae-eb589059892c tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:58.634206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:50:58.634756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9a22f61-7ae5-4a6e-baae-eb589059892c tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:58.635392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9a22f61-7ae5-4a6e-baae-eb589059892c tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:58.881086 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:50:58.881557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:50:58.882042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:50:58.882445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:50:58.886801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:58.887727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:50:58.907576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:58.915430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:58.922801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:58.922801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:58.922801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:58.922801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:50:58.945779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Getting quotas for project 8f141429ddf044e1812ea5e3dbecd995. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:50:58.950610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Getting quotas for user 3ff6ad8e78ca4b6dbea50007a5737f5e and project 8f141429ddf044e1812ea5e3dbecd995. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:50:58.964451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:50:58.968728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:50:59.090025 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d9a22f61-7ae5-4a6e-baae-eb589059892c tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.473170 Sep 06 10:50:59.091748 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 113/222] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Sep 6 10:50:58 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:59.103452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eb38c1cc-dcd2-4361-8ac3-537a1140e836 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:59.137177 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-59a0aea2-27d3-4444-8e87-e78400fab1ed tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600928 Sep 06 10:50:59.140336 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 110/223] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:50:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 10:50:59.158289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eef18ab7-eea5-4194-b28e-52e26b33da16 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:50:59.158925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eef18ab7-eea5-4194-b28e-52e26b33da16 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:50:59.207902 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-eb38c1cc-dcd2-4361-8ac3-537a1140e836 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.108192 Sep 06 10:50:59.211565 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 114/224] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:50:59 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 06 10:50:59.222249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7791d623-22b4-4abb-a454-02ca4e2d4e4a tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-588329535"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:59.229752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.aggregate [None req-7791d623-22b4-4abb-a454-02ca4e2d4e4a tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Generated uuid 7938b4dd-d261-4c18-b8cc-edf35d510a6b for aggregate {{(pid=140875) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:50:59.275357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eef18ab7-eea5-4194-b28e-52e26b33da16 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:50:59.283690 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eef18ab7-eea5-4194-b28e-52e26b33da16 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1220 microversion: 2.1 time: 0.130809 Sep 06 10:50:59.288046 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 111/225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:50:59 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:50:59.359545 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7791d623-22b4-4abb-a454-02ca4e2d4e4a tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.141966 Sep 06 10:50:59.368328 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 115/226] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:50:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:50:59.372586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e6c28413-aee6-4351-a1ab-81e9419d0077 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:50:59.401775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6c28413-aee6-4351-a1ab-81e9419d0077 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:50:59.402388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6c28413-aee6-4351-a1ab-81e9419d0077 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:50:59.402887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6c28413-aee6-4351-a1ab-81e9419d0077 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.070989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b44f7e73-2d3f-44b7-bee7-49a67f0dc2e8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:00.075455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b44f7e73-2d3f-44b7-bee7-49a67f0dc2e8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:00.075950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b44f7e73-2d3f-44b7-bee7-49a67f0dc2e8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:00.077265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b44f7e73-2d3f-44b7-bee7-49a67f0dc2e8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.079188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b44f7e73-2d3f-44b7-bee7-49a67f0dc2e8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:00.082552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b44f7e73-2d3f-44b7-bee7-49a67f0dc2e8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:00.084578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b44f7e73-2d3f-44b7-bee7-49a67f0dc2e8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.121335 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b44f7e73-2d3f-44b7-bee7-49a67f0dc2e8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.319919 Sep 06 10:51:00.125502 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 116/227] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:50:59 2022] GET /compute/v2.1/os-services => generated 947 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:00.146640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-20f88e88-93bf-43da-9311-269ca1809bd9 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:00.152577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20f88e88-93bf-43da-9311-269ca1809bd9 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:00.153081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20f88e88-93bf-43da-9311-269ca1809bd9 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:00.153530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20f88e88-93bf-43da-9311-269ca1809bd9 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.154311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20f88e88-93bf-43da-9311-269ca1809bd9 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:00.155380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20f88e88-93bf-43da-9311-269ca1809bd9 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:00.157694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20f88e88-93bf-43da-9311-269ca1809bd9 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.210912 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-20f88e88-93bf-43da-9311-269ca1809bd9 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.062036 Sep 06 10:51:00.212572 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 117/228] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Sep 6 10:51:00 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:00.225187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aad00801-6b8f-4942-93a7-6141abc687a8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:00.229100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aad00801-6b8f-4942-93a7-6141abc687a8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:00.229709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aad00801-6b8f-4942-93a7-6141abc687a8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:00.230023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aad00801-6b8f-4942-93a7-6141abc687a8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.230758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aad00801-6b8f-4942-93a7-6141abc687a8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:00.231265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aad00801-6b8f-4942-93a7-6141abc687a8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:00.231694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aad00801-6b8f-4942-93a7-6141abc687a8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.236643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:00.258924 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aad00801-6b8f-4942-93a7-6141abc687a8 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.037402 Sep 06 10:51:00.259547 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 118/229] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:51:00 2022] GET /compute/v2.1/os-services => generated 947 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:00.271883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dab7de53-d19c-4b94-8052-cdf4176d29c7 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:00.275449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dab7de53-d19c-4b94-8052-cdf4176d29c7 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:00.275945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dab7de53-d19c-4b94-8052-cdf4176d29c7 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:00.280324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dab7de53-d19c-4b94-8052-cdf4176d29c7 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.281179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dab7de53-d19c-4b94-8052-cdf4176d29c7 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:00.281831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dab7de53-d19c-4b94-8052-cdf4176d29c7 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:00.287261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dab7de53-d19c-4b94-8052-cdf4176d29c7 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.309520 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dab7de53-d19c-4b94-8052-cdf4176d29c7 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.040995 Sep 06 10:51:00.310132 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 119/230] 10.222.0.20 () {58 vars in 1196 bytes} [Tue Sep 6 10:51:00 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 10:51:00.322955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9b30ee7d-40e7-406d-b7dd-b192f4df7e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:00.323637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9b30ee7d-40e7-406d-b7dd-b192f4df7e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:00.352481 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e6c28413-aee6-4351-a1ab-81e9419d0077 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.983450 Sep 06 10:51:00.359254 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 112/231] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Sep 6 10:50:59 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:00.375769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7ef5eefd-b946-48a3-a236-617828326783 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:00.388715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ef5eefd-b946-48a3-a236-617828326783 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:00.388715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ef5eefd-b946-48a3-a236-617828326783 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:00.388715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ef5eefd-b946-48a3-a236-617828326783 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.388715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ef5eefd-b946-48a3-a236-617828326783 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:00.389195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ef5eefd-b946-48a3-a236-617828326783 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:00.389195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ef5eefd-b946-48a3-a236-617828326783 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.414021 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7ef5eefd-b946-48a3-a236-617828326783 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.047602 Sep 06 10:51:00.415173 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 113/232] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:51:00 2022] GET /compute/v2.1/os-services => generated 947 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:00.425530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c623dce1-93eb-42ef-9b71-ddfef18e1306 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:00.438029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c623dce1-93eb-42ef-9b71-ddfef18e1306 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:00.438520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c623dce1-93eb-42ef-9b71-ddfef18e1306 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:00.438958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c623dce1-93eb-42ef-9b71-ddfef18e1306 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.599283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9b30ee7d-40e7-406d-b7dd-b192f4df7e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:00.610248 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9b30ee7d-40e7-406d-b7dd-b192f4df7e51 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1220 microversion: 2.1 time: 0.298223 Sep 06 10:51:00.611160 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 120/233] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:00 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1220 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:00.615657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c7368c3b-5724-4426-bc14-5bc2e199e767 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:00.619622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7368c3b-5724-4426-bc14-5bc2e199e767 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:00.620311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7368c3b-5724-4426-bc14-5bc2e199e767 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:00.620781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7368c3b-5724-4426-bc14-5bc2e199e767 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.621507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7368c3b-5724-4426-bc14-5bc2e199e767 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:00.622390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7368c3b-5724-4426-bc14-5bc2e199e767 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:00.622817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7368c3b-5724-4426-bc14-5bc2e199e767 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:00.657699 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c7368c3b-5724-4426-bc14-5bc2e199e767 tempest-ServicesAdminNegativeTestJSON-1037834962 tempest-ServicesAdminNegativeTestJSON-1037834962-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.045490 Sep 06 10:51:00.658507 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 121/234] 10.222.0.20 () {58 vars in 1198 bytes} [Tue Sep 6 10:51:00 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:51:00.762648 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c623dce1-93eb-42ef-9b71-ddfef18e1306 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.344784 Sep 06 10:51:00.763244 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 114/235] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Sep 6 10:51:00 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:00.775267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-47ba8f25-00f9-4997-bd85-eb883e43f0aa tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:00.860776 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-47ba8f25-00f9-4997-bd85-eb883e43f0aa tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.088499 Sep 06 10:51:00.866133 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 115/236] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:51:00 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 06 10:51:00.871801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1a85121c-f415-4c8f-9610-d56b1dc8f28f tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-607423399"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:00.875449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.aggregate [None req-1a85121c-f415-4c8f-9610-d56b1dc8f28f tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Generated uuid 19f005ee-8fe2-4134-b705-5540a1f9e363 for aggregate {{(pid=140876) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:01.028094 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1a85121c-f415-4c8f-9610-d56b1dc8f28f tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.160266 Sep 06 10:51:01.028870 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 116/237] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:00 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:01.038552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-386b2b46-0a1d-48aa-8c74-e789a6b20525 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Calling method '.version_select at 0x7f90f8eb8ca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:01.044883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-386b2b46-0a1d-48aa-8c74-e789a6b20525 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:01.049818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-386b2b46-0a1d-48aa-8c74-e789a6b20525 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:01.050339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-386b2b46-0a1d-48aa-8c74-e789a6b20525 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:01.051231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-386b2b46-0a1d-48aa-8c74-e789a6b20525 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:01.053622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-386b2b46-0a1d-48aa-8c74-e789a6b20525 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:01.054144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-386b2b46-0a1d-48aa-8c74-e789a6b20525 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:01.091463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-94a41996-09f9-48ee-b79b-1f1a32f951e8 tempest-ServicesAdminNegativeTestJSON-2065416922 tempest-ServicesAdminNegativeTestJSON-2065416922-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:01.098770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-94a41996-09f9-48ee-b79b-1f1a32f951e8 tempest-ServicesAdminNegativeTestJSON-2065416922 tempest-ServicesAdminNegativeTestJSON-2065416922-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '784f7c4384c24adf84e35a5e08b737e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f19b2190b36468087146f342878cc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-94a41996-09f9-48ee-b79b-1f1a32f951e8 tempest-ServicesAdminNegativeTestJSON-2065416922 tempest-ServicesAdminNegativeTestJSON-2065416922-project] Request method failure captured: Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYQRBQ850NYw-lROteNuF4r1CSnxK4p_upVcmIusQwylCImgm3dGngyh-FIwVymYexIVvmpdTfSoC5u2HWKq0puQ-w1rc7QHuI-9jyLZwRpL1OOe8j3FjnSqZLfvnvd4brlARr3mWElmrZBGBAERJO3OnapEk4p-v_XwaTC3eTHv1Y Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 1f19b2190b36468087146f342878cc87 Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-2065416922 Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:51:01.107272 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:51:01.108804 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1f19b2190b36468087146f342878cc87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1f19b2190b36468087146f342878cc87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1f19b2190b36468087146f342878cc87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1f19b2190b36468087146f342878cc87"}]}] Sep 06 10:51:01.108804 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-2065416922 Sep 06 10:51:01.108804 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 1f19b2190b36468087146f342878cc87 Sep 06 10:51:01.108804 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-2065416922 Sep 06 10:51:01.108804 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServicesAdminNegativeTestJSON-2065416922-project Sep 06 10:51:01.108804 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:01.108804 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:01.108804 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 784f7c4384c24adf84e35a5e08b737e9 Sep 06 10:51:01.108804 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-2065416922-project Sep 06 10:51:01.108804 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:01.108804 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 06 10:51:01.108804 ncdv-master-1 devstack@n-api.service[140875]: action_args: {} Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:01.109620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 06 10:51:01.111237 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.114299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-94a41996-09f9-48ee-b79b-1f1a32f951e8 tempest-ServicesAdminNegativeTestJSON-2065416922 tempest-ServicesAdminNegativeTestJSON-2065416922-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:01.117310 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-94a41996-09f9-48ee-b79b-1f1a32f951e8 tempest-ServicesAdminNegativeTestJSON-2065416922 tempest-ServicesAdminNegativeTestJSON-2065416922-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.448630 Sep 06 10:51:01.122606 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 122/238] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:51:00 2022] GET /compute/v2.1/os-services => generated 112 bytes in 454 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:51:01.123902 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-386b2b46-0a1d-48aa-8c74-e789a6b20525 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.089267 Sep 06 10:51:01.123902 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 117/239] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Sep 6 10:51:01 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:01.128447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3de65583-1ebf-47af-a05c-c58a0d67e9b1 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:01.134243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f4bc082f-0fe4-4038-9ece-f8b7b2f2d0b8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Calling method '.version_select at 0x7f90f8ee98b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:01.138027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4bc082f-0fe4-4038-9ece-f8b7b2f2d0b8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:01.139987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4bc082f-0fe4-4038-9ece-f8b7b2f2d0b8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:01.140662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4bc082f-0fe4-4038-9ece-f8b7b2f2d0b8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:01.141618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4bc082f-0fe4-4038-9ece-f8b7b2f2d0b8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:01.142280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4bc082f-0fe4-4038-9ece-f8b7b2f2d0b8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:01.142931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4bc082f-0fe4-4038-9ece-f8b7b2f2d0b8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:01.169050 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f4bc082f-0fe4-4038-9ece-f8b7b2f2d0b8 tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.038258 Sep 06 10:51:01.175937 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 118/240] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 10:51:01 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:01.182959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7b3f2ea7-e6b3-4c34-a6ad-dfed282cbc5d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Calling method '.version_select at 0x7f90f8eb81f0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:01.192605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b3f2ea7-e6b3-4c34-a6ad-dfed282cbc5d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:01.192605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b3f2ea7-e6b3-4c34-a6ad-dfed282cbc5d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:01.192605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b3f2ea7-e6b3-4c34-a6ad-dfed282cbc5d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:01.192605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b3f2ea7-e6b3-4c34-a6ad-dfed282cbc5d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:01.192955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b3f2ea7-e6b3-4c34-a6ad-dfed282cbc5d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:01.192955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b3f2ea7-e6b3-4c34-a6ad-dfed282cbc5d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:01.225650 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7b3f2ea7-e6b3-4c34-a6ad-dfed282cbc5d tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.046836 Sep 06 10:51:01.226134 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 119/241] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Sep 6 10:51:01 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:01.236339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cf7d68f5-7c70-4439-9535-e45017b4c59c tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Calling method '.version_select at 0x7f90f8f8a8b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:01.242966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf7d68f5-7c70-4439-9535-e45017b4c59c tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:01.243487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf7d68f5-7c70-4439-9535-e45017b4c59c tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:01.243952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf7d68f5-7c70-4439-9535-e45017b4c59c tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:01.251932 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3de65583-1ebf-47af-a05c-c58a0d67e9b1 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.130371 Sep 06 10:51:01.258625 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 123/242] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:51:01 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:51:01.267521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-895311614", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "74225120", "adminPass": "***", "networks": [{"uuid": "3f066fd1-1af6-498a-be39-83353a05a19a"}], "security_groups": [{"name": "tempest-securitygroup--1540844153"}], "key_name": "tempest-keypair-338547195", "user_data": "}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:01.271300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf7d68f5-7c70-4439-9535-e45017b4c59c tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:01.271793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf7d68f5-7c70-4439-9535-e45017b4c59c tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:01.272239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf7d68f5-7c70-4439-9535-e45017b4c59c tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:01.281890 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cf7d68f5-7c70-4439-9535-e45017b4c59c tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 332 microversion: 2.1 time: 0.049052 Sep 06 10:51:01.282250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=7,nova_api:INSERT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:01.283147 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 120/243] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Sep 6 10:51:01 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 332 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:01.313615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c827b491-3ba0-4167-91c0-917bee32278d tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:01.322496 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-c827b491-3ba0-4167-91c0-917bee32278d tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c827b491-3ba0-4167-91c0-917bee32278d tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Request method failure captured: Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyXrkOSGSyncTjMpOyQuPV7_X8dr916KxA4XRR6p41eeI8vvxHCuAD9bgsTPb3x9HUMyoPGqeueDezDP_RLetfkC9SJ8znkX6zgKKqqx_q_ydCD_QtjsD4XXYATU0fzEFb6Nnn3NDRGfcJinoFXPrjT7F3pBuxpYG91KgJBxUfvgfIM Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: d764a01fa6ba47db9efe3b70401f2089 Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AggregatesAdminTestJSON-1610219099 Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:01.330754 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:01.337617 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d764a01fa6ba47db9efe3b70401f2089"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d764a01fa6ba47db9efe3b70401f2089"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d764a01fa6ba47db9efe3b70401f2089"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d764a01fa6ba47db9efe3b70401f2089"}]}] Sep 06 10:51:01.337617 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AggregatesAdminTestJSON-1610219099 Sep 06 10:51:01.337617 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: d764a01fa6ba47db9efe3b70401f2089 Sep 06 10:51:01.337617 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1610219099 Sep 06 10:51:01.337617 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AggregatesAdminTestJSON-1610219099-project-admin Sep 06 10:51:01.337617 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:01.337617 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:01.337617 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 722e850b74954dbdb49d0feb4e59bdf4 Sep 06 10:51:01.337617 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AggregatesAdminTestJSON-1610219099-project-admin Sep 06 10:51:01.337617 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:01.337617 ncdv-master-1 devstack@n-api.service[140876]: exception: Aggregate 6 could not be found. Sep 06 10:51:01.337617 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '6'} Sep 06 10:51:01.337617 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.338760 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Sep 06 10:51:01.340935 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.343545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c827b491-3ba0-4167-91c0-917bee32278d tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:01.343545 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c827b491-3ba0-4167-91c0-917bee32278d tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.023598 Sep 06 10:51:01.343545 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 121/244] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 10:51:01 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:51:01.351862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1166dc42-7031-4458-9590-8f400c2661de tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Calling method '.version_select at 0x7f90f8ee94c0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:01.361068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1166dc42-7031-4458-9590-8f400c2661de tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:01.361714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1166dc42-7031-4458-9590-8f400c2661de tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:01.362035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1166dc42-7031-4458-9590-8f400c2661de tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:01.376290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1166dc42-7031-4458-9590-8f400c2661de tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:01.376954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1166dc42-7031-4458-9590-8f400c2661de tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:01.377674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1166dc42-7031-4458-9590-8f400c2661de tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:01.392026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:01.400490 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1166dc42-7031-4458-9590-8f400c2661de tempest-HostsAdminTestJSON-1625212824 tempest-HostsAdminTestJSON-1625212824-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 466 microversion: 2.1 time: 0.066730 Sep 06 10:51:01.401399 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 122/245] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Sep 6 10:51:01 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 466 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:01.407055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbbe20b2-8ce7-42a7-9efb-514af1b9cd68 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:01.421632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] validate_networks() for [('3f066fd1-1af6-498a-be39-83353a05a19a', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:51:01.427958 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-fbbe20b2-8ce7-42a7-9efb-514af1b9cd68 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbbe20b2-8ce7-42a7-9efb-514af1b9cd68 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Request method failure captured: Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyXrkOSGSyncTjMpOyQuPV7_X8dr916KxA4XRR6p41eeI8vvxHCuAD9bgsTPb3x9HUMyoPGqeueDezDP_RLetfkC9SJ8znkX6zgKKqqx_q_ydCD_QtjsD4XXYATU0fzEFb6Nnn3NDRGfcJinoFXPrjT7F3pBuxpYG91KgJBxUfvgfIM Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: d764a01fa6ba47db9efe3b70401f2089 Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AggregatesAdminTestJSON-1610219099 Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:01.434739 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:01.436724 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d764a01fa6ba47db9efe3b70401f2089"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d764a01fa6ba47db9efe3b70401f2089"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d764a01fa6ba47db9efe3b70401f2089"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d764a01fa6ba47db9efe3b70401f2089"}]}] Sep 06 10:51:01.436724 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AggregatesAdminTestJSON-1610219099 Sep 06 10:51:01.436724 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: d764a01fa6ba47db9efe3b70401f2089 Sep 06 10:51:01.436724 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1610219099 Sep 06 10:51:01.436724 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AggregatesAdminTestJSON-1610219099-project-admin Sep 06 10:51:01.436724 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:01.436724 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:01.436724 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 722e850b74954dbdb49d0feb4e59bdf4 Sep 06 10:51:01.436724 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AggregatesAdminTestJSON-1610219099-project-admin Sep 06 10:51:01.436724 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:01.436724 ncdv-master-1 devstack@n-api.service[140876]: exception: Aggregate 6 could not be found. Sep 06 10:51:01.436724 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '6'} Sep 06 10:51:01.436724 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:01.437466 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.438441 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:01.455376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:01.455376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:01.455376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:01.455376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Sep 06 10:51:01.455376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.455376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbbe20b2-8ce7-42a7-9efb-514af1b9cd68 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:01.455376 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fbbe20b2-8ce7-42a7-9efb-514af1b9cd68 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.034993 Sep 06 10:51:01.455376 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 123/246] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:51:01 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:51:01.463327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-79be1b83-8f97-42d2-b148-bcc1e2e25715 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1107981454", "name": "tempest-test_aggregate-455793939"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:01.486329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.aggregate [None req-79be1b83-8f97-42d2-b148-bcc1e2e25715 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Generated uuid d2ca0329-5c03-4727-bf86-33a46d157f80 for aggregate {{(pid=140876) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:01.586310 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-79be1b83-8f97-42d2-b148-bcc1e2e25715 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.129545 Sep 06 10:51:01.587508 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 124/247] 10.222.0.20 () {60 vars in 1165 bytes} [Tue Sep 6 10:51:01 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:01.597767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-67cb8051-0421-4682-97a2-234bc5e2dbb0 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:01.693291 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-67cb8051-0421-4682-97a2-234bc5e2dbb0 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.099114 Sep 06 10:51:01.697298 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 125/248] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:51:01 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 06 10:51:01.702525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-280b0399-ea11-48c7-8542-c71519a833ff tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:01.703573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-280b0399-ea11-48c7-8542-c71519a833ff tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:01.711715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-280b0399-ea11-48c7-8542-c71519a833ff tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:01.715288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-280b0399-ea11-48c7-8542-c71519a833ff tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:01.715288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-280b0399-ea11-48c7-8542-c71519a833ff tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:01.715288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-280b0399-ea11-48c7-8542-c71519a833ff tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:01.715288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-280b0399-ea11-48c7-8542-c71519a833ff tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:01.715762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-280b0399-ea11-48c7-8542-c71519a833ff tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:01.739916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=7,nova_api:INSERT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:01.804713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-280b0399-ea11-48c7-8542-c71519a833ff tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:01.818741 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-280b0399-ea11-48c7-8542-c71519a833ff tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1272 microversion: 2.1 time: 0.119989 Sep 06 10:51:01.819651 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 126/249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:01 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1272 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:01.831939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d5ef3044-07d6-4add-9da5-9f15ed356e31 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:01.842488 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-d5ef3044-07d6-4add-9da5-9f15ed356e31 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d5ef3044-07d6-4add-9da5-9f15ed356e31 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Request method failure captured: Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyXrkOSGSyncTjMpOyQuPV7_X8dr916KxA4XRR6p41eeI8vvxHCuAD9bgsTPb3x9HUMyoPGqeueDezDP_RLetfkC9SJ8znkX6zgKKqqx_q_ydCD_QtjsD4XXYATU0fzEFb6Nnn3NDRGfcJinoFXPrjT7F3pBuxpYG91KgJBxUfvgfIM Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: d764a01fa6ba47db9efe3b70401f2089 Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AggregatesAdminTestJSON-1610219099 Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:01.844515 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:01.845716 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d764a01fa6ba47db9efe3b70401f2089"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d764a01fa6ba47db9efe3b70401f2089"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d764a01fa6ba47db9efe3b70401f2089"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d764a01fa6ba47db9efe3b70401f2089"}]}] Sep 06 10:51:01.845716 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AggregatesAdminTestJSON-1610219099 Sep 06 10:51:01.845716 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: d764a01fa6ba47db9efe3b70401f2089 Sep 06 10:51:01.845716 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1610219099 Sep 06 10:51:01.845716 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AggregatesAdminTestJSON-1610219099-project-admin Sep 06 10:51:01.845716 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:01.845716 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:01.845716 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 722e850b74954dbdb49d0feb4e59bdf4 Sep 06 10:51:01.845716 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AggregatesAdminTestJSON-1610219099-project-admin Sep 06 10:51:01.845716 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:01.845716 ncdv-master-1 devstack@n-api.service[140876]: exception: Aggregate 7 could not be found. Sep 06 10:51:01.845716 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '7'} Sep 06 10:51:01.845716 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.846437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 06 10:51:01.847446 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.848896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d5ef3044-07d6-4add-9da5-9f15ed356e31 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:01.849837 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d5ef3044-07d6-4add-9da5-9f15ed356e31 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.029500 Sep 06 10:51:01.854708 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 127/250] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 10:51:01 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:51:01.860520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-132ec587-12a1-40b5-9dc0-bf79ccc42a06 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:01.872505 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-132ec587-12a1-40b5-9dc0-bf79ccc42a06 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-132ec587-12a1-40b5-9dc0-bf79ccc42a06 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Request method failure captured: Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyXrkOSGSyncTjMpOyQuPV7_X8dr916KxA4XRR6p41eeI8vvxHCuAD9bgsTPb3x9HUMyoPGqeueDezDP_RLetfkC9SJ8znkX6zgKKqqx_q_ydCD_QtjsD4XXYATU0fzEFb6Nnn3NDRGfcJinoFXPrjT7F3pBuxpYG91KgJBxUfvgfIM Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: d764a01fa6ba47db9efe3b70401f2089 Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AggregatesAdminTestJSON-1610219099 Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:01.874688 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:01.876082 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d764a01fa6ba47db9efe3b70401f2089"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d764a01fa6ba47db9efe3b70401f2089"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d764a01fa6ba47db9efe3b70401f2089"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d764a01fa6ba47db9efe3b70401f2089"}]}] Sep 06 10:51:01.876082 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AggregatesAdminTestJSON-1610219099 Sep 06 10:51:01.876082 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: d764a01fa6ba47db9efe3b70401f2089 Sep 06 10:51:01.876082 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1610219099 Sep 06 10:51:01.876082 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AggregatesAdminTestJSON-1610219099-project-admin Sep 06 10:51:01.876082 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:01.876082 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:01.876082 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 722e850b74954dbdb49d0feb4e59bdf4 Sep 06 10:51:01.876082 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AggregatesAdminTestJSON-1610219099-project-admin Sep 06 10:51:01.876082 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:01.876082 ncdv-master-1 devstack@n-api.service[140876]: exception: Aggregate 7 could not be found. Sep 06 10:51:01.876082 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '7'} Sep 06 10:51:01.876082 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:01.876913 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:01.878074 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:01.879273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:01.879273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:01.879273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:01.879273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 06 10:51:01.879273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:01.879273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-132ec587-12a1-40b5-9dc0-bf79ccc42a06 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:01.879273 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-132ec587-12a1-40b5-9dc0-bf79ccc42a06 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.020377 Sep 06 10:51:01.879273 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 128/251] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:51:01 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:51:01.885641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c9b12eba-6196-4d6c-a0cc-57c8fd20b727 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1855641497"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:01.889772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.aggregate [None req-c9b12eba-6196-4d6c-a0cc-57c8fd20b727 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Generated uuid d45e9cb5-f1d1-4c63-a458-e613f286eea9 for aggregate {{(pid=140876) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:02.019638 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c9b12eba-6196-4d6c-a0cc-57c8fd20b727 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.137598 Sep 06 10:51:02.026523 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 129/252] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:02.032116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3048e048-565a-49b3-8337-f30c60aeb08a tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:02.040682 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3048e048-565a-49b3-8337-f30c60aeb08a tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.012647 Sep 06 10:51:02.041250 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 130/253] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 10:51:02 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:02.054541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9d1da275-7075-44d2-870c-5e376408848d tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:02.209011 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9d1da275-7075-44d2-870c-5e376408848d tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.159472 Sep 06 10:51:02.210822 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 131/254] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Sep 6 10:51:02 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:02.221407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-89745b2a-1739-42bd-9317-cc0612206791 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:02.231219 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-89745b2a-1739-42bd-9317-cc0612206791 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.013372 Sep 06 10:51:02.231935 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 132/255] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 10:51:02 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:02.246325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a4aea42c-f81f-4b58-90e1-ca33c59571f4 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:02.346041 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a4aea42c-f81f-4b58-90e1-ca33c59571f4 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.105382 Sep 06 10:51:02.346887 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 133/256] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:51:02 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 06 10:51:02.358194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9060b480-51c3-4451-91f0-b6d75b6f010c tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2060508303", "availability_zone": "tempest-test_az-1530378012"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:02.361723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.aggregate [None req-9060b480-51c3-4451-91f0-b6d75b6f010c tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Generated uuid 2c88d8a3-f335-45a1-ac8e-d86831ec679b for aggregate {{(pid=140876) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:02.497612 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9060b480-51c3-4451-91f0-b6d75b6f010c tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.141797 Sep 06 10:51:02.507114 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 134/257] 10.222.0.20 () {60 vars in 1165 bytes} [Tue Sep 6 10:51:02 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:02.513361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6432677d-27fe-4ff0-bcb4-9e42b5e21fe2 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2060508303_new", "availability_zone": "tempest-test_az-1530378012_new"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:02.782019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6432677d-27fe-4ff0-bcb4-9e42b5e21fe2 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:02.783072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6432677d-27fe-4ff0-bcb4-9e42b5e21fe2 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:02.784652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6432677d-27fe-4ff0-bcb4-9e42b5e21fe2 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:02.860311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:51:02.861355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:51:02.862005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:51:02.862584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:51:02.863188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:51:02.876065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:02.877663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:02.878339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:02.880442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:02.880927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:02.881371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:02.918495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Getting quotas for project c2078a32d1694ba3b1393762add00729. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:51:02.930649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Getting quotas for user 6f59260019b34b0b8c4c8792afe8b317 and project c2078a32d1694ba3b1393762add00729. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:51:02.950989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:51:02.954144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:51:03.012083 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6432677d-27fe-4ff0-bcb4-9e42b5e21fe2 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.503092 Sep 06 10:51:03.023372 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 135/258] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Sep 6 10:51:02 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:03.028832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3ca9cd63-36b3-421d-8e67-db543d84827a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:03.030698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3ca9cd63-36b3-421d-8e67-db543d84827a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:03.040071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ca9cd63-36b3-421d-8e67-db543d84827a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:03.042846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ca9cd63-36b3-421d-8e67-db543d84827a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:03.042846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ca9cd63-36b3-421d-8e67-db543d84827a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:03.042846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ca9cd63-36b3-421d-8e67-db543d84827a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:03.042846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ca9cd63-36b3-421d-8e67-db543d84827a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:03.043757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ca9cd63-36b3-421d-8e67-db543d84827a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:03.130270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3ca9cd63-36b3-421d-8e67-db543d84827a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:03.141556 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3ca9cd63-36b3-421d-8e67-db543d84827a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1278 microversion: 2.1 time: 0.116676 Sep 06 10:51:03.142781 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 136/259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:03 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1278 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:03.147589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-192a77dd-76a9-4a20-b09e-5adfcbef1a7a tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:03.156282 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-192a77dd-76a9-4a20-b09e-5adfcbef1a7a tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.012253 Sep 06 10:51:03.158912 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 137/260] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 10:51:03 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:03.190123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ae8574df-8b0d-45d5-a6cd-ec6a158b0811 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:03.206392 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9c27580e-74ec-4095-bd3c-efefd416d270 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.937180 Sep 06 10:51:03.223189 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 124/261] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:51:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:51:03.244952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-18f17b6e-9831-4f25-a62f-0cc8e25cc35d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:03.245739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-18f17b6e-9831-4f25-a62f-0cc8e25cc35d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:03.357372 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ae8574df-8b0d-45d5-a6cd-ec6a158b0811 tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.181522 Sep 06 10:51:03.360112 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 138/262] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:51:03 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:51:03.388352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-18f17b6e-9831-4f25-a62f-0cc8e25cc35d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:03.390419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ab6ce0a9-9dd2-46b5-90c7-b476486d17ca tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1950106319"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:03.399989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.aggregate [None req-ab6ce0a9-9dd2-46b5-90c7-b476486d17ca tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Generated uuid 295530c2-738c-494b-93c0-5b728fa39772 for aggregate {{(pid=140876) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:03.407136 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-18f17b6e-9831-4f25-a62f-0cc8e25cc35d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 200 len: 1259 microversion: 2.1 time: 0.164974 Sep 06 10:51:03.417602 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 125/263] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:03 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:03.610896 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ab6ce0a9-9dd2-46b5-90c7-b476486d17ca tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.244983 Sep 06 10:51:03.618595 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 139/264] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:03 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:03.622985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d5a8971d-2c3f-42b3-b97d-95f202269b9d tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:03.635713 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d5a8971d-2c3f-42b3-b97d-95f202269b9d tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.016592 Sep 06 10:51:03.643994 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 126/265] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 10:51:03 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:03.655648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b445653d-8f4b-46dc-a0af-733954dda3cd tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:03.815911 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b445653d-8f4b-46dc-a0af-733954dda3cd tempest-AggregatesAdminTestJSON-1610219099 tempest-AggregatesAdminTestJSON-1610219099-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.164748 Sep 06 10:51:03.817142 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 140/266] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 10:51:03 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:51:03.828680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d389202c-ad9e-4a7d-b304-93efa766d9cf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:03.829187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d389202c-ad9e-4a7d-b304-93efa766d9cf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:03.836288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d389202c-ad9e-4a7d-b304-93efa766d9cf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:03.836782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d389202c-ad9e-4a7d-b304-93efa766d9cf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:03.837216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d389202c-ad9e-4a7d-b304-93efa766d9cf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:03.838391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d389202c-ad9e-4a7d-b304-93efa766d9cf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:03.839051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d389202c-ad9e-4a7d-b304-93efa766d9cf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:03.839964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d389202c-ad9e-4a7d-b304-93efa766d9cf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:03.861936 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-d389202c-ad9e-4a7d-b304-93efa766d9cf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] HTTP exception thrown: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d389202c-ad9e-4a7d-b304-93efa766d9cf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Request method failure captured: Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df HTTP/1.1 Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyXozGH1mUy3OKWLRa8HbWRfMrTL1BgxLbGnP3TIXoGrkEVw8cZ5wpZK3wAI-tK3yxD0faZ6P-Fm_Nl9ptW8Id7QoyrUu10iww6Mm4K_5U7tTKInRF5hapoPoYo5rTEFbUI4aexJmetnbN8KW2fyMhLNT16T2nZ3wbP7j2vQVGdd9vI Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 2c708f857b3f445985133945eb88d6d3 Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AggregatesAdminTestJSON-1582968489 Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:51:03.865305 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:51:03.866849 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c708f857b3f445985133945eb88d6d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c708f857b3f445985133945eb88d6d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c708f857b3f445985133945eb88d6d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c708f857b3f445985133945eb88d6d3"}]}] Sep 06 10:51:03.866849 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AggregatesAdminTestJSON-1582968489 Sep 06 10:51:03.866849 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 2c708f857b3f445985133945eb88d6d3 Sep 06 10:51:03.866849 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1582968489 Sep 06 10:51:03.866849 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AggregatesAdminTestJSON-1582968489-project Sep 06 10:51:03.866849 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:03.866849 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:03.866849 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: b4effbac6059440f9105f21183de9b23 Sep 06 10:51:03.866849 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AggregatesAdminTestJSON-1582968489-project Sep 06 10:51:03.866849 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:03.866849 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:51:03.866849 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'a44496f5-17da-461a-bc43-4ae9d86e49df'} Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:03.867641 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:51:03.868820 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:03.875235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d389202c-ad9e-4a7d-b304-93efa766d9cf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Returning 404 to user: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:03.883117 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d389202c-ad9e-4a7d-b304-93efa766d9cf tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 404 len: 111 microversion: 2.1 time: 0.052730 Sep 06 10:51:03.883117 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 127/267] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:51:03 2022] DELETE /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:03.891269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4fcb6e39-8e39-4a1d-903d-d59850881f56 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:03.891899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4fcb6e39-8e39-4a1d-903d-d59850881f56 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] [instance: a44496f5-17da-461a-bc43-4ae9d86e49df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:03.898452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fcb6e39-8e39-4a1d-903d-d59850881f56 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:03.898986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fcb6e39-8e39-4a1d-903d-d59850881f56 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:03.899655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fcb6e39-8e39-4a1d-903d-d59850881f56 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:03.900382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fcb6e39-8e39-4a1d-903d-d59850881f56 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:03.900865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fcb6e39-8e39-4a1d-903d-d59850881f56 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:03.901328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fcb6e39-8e39-4a1d-903d-d59850881f56 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:03.932842 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-4fcb6e39-8e39-4a1d-903d-d59850881f56 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] HTTP exception thrown: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4fcb6e39-8e39-4a1d-903d-d59850881f56 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Request method failure captured: Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df HTTP/1.1 Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyXozGH1mUy3OKWLRa8HbWRfMrTL1BgxLbGnP3TIXoGrkEVw8cZ5wpZK3wAI-tK3yxD0faZ6P-Fm_Nl9ptW8Id7QoyrUu10iww6Mm4K_5U7tTKInRF5hapoPoYo5rTEFbUI4aexJmetnbN8KW2fyMhLNT16T2nZ3wbP7j2vQVGdd9vI Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2c708f857b3f445985133945eb88d6d3 Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AggregatesAdminTestJSON-1582968489 Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:03.934780 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:03.936802 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c708f857b3f445985133945eb88d6d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c708f857b3f445985133945eb88d6d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c708f857b3f445985133945eb88d6d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c708f857b3f445985133945eb88d6d3"}]}] Sep 06 10:51:03.936802 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AggregatesAdminTestJSON-1582968489 Sep 06 10:51:03.936802 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2c708f857b3f445985133945eb88d6d3 Sep 06 10:51:03.936802 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1582968489 Sep 06 10:51:03.936802 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AggregatesAdminTestJSON-1582968489-project Sep 06 10:51:03.936802 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:03.936802 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:03.936802 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: b4effbac6059440f9105f21183de9b23 Sep 06 10:51:03.936802 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AggregatesAdminTestJSON-1582968489-project Sep 06 10:51:03.936802 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:03.936802 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:51:03.936802 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'a44496f5-17da-461a-bc43-4ae9d86e49df'} Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:03.937542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. Sep 06 10:51:03.938533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:03.939804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4fcb6e39-8e39-4a1d-903d-d59850881f56 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] Returning 404 to user: Instance a44496f5-17da-461a-bc43-4ae9d86e49df could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:03.939804 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4fcb6e39-8e39-4a1d-903d-d59850881f56 tempest-AggregatesAdminTestJSON-1582968489 tempest-AggregatesAdminTestJSON-1582968489-project] 10.222.0.20 "GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df" status: 404 len: 111 microversion: 2.1 time: 0.050157 Sep 06 10:51:03.939804 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 141/268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:03 2022] GET /compute/v2.1/servers/a44496f5-17da-461a-bc43-4ae9d86e49df => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:04.173650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0045c87d-cf1b-46e0-8c8d-bd067a87062c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:04.175178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0045c87d-cf1b-46e0-8c8d-bd067a87062c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:04.182566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0045c87d-cf1b-46e0-8c8d-bd067a87062c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:04.183383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0045c87d-cf1b-46e0-8c8d-bd067a87062c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:04.183894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0045c87d-cf1b-46e0-8c8d-bd067a87062c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:04.184844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0045c87d-cf1b-46e0-8c8d-bd067a87062c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:04.191196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0045c87d-cf1b-46e0-8c8d-bd067a87062c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:04.191196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0045c87d-cf1b-46e0-8c8d-bd067a87062c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:04.367555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0045c87d-cf1b-46e0-8c8d-bd067a87062c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:04.377031 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0045c87d-cf1b-46e0-8c8d-bd067a87062c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1320 microversion: 2.1 time: 0.208400 Sep 06 10:51:04.377603 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 128/269] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:04 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1320 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:04.433906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f9d0d400-566c-4055-9924-364b2e79bbce tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:04.434540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f9d0d400-566c-4055-9924-364b2e79bbce tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:04.494981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f9d0d400-566c-4055-9924-364b2e79bbce tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:04.502655 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f9d0d400-566c-4055-9924-364b2e79bbce tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 200 len: 1259 microversion: 2.1 time: 0.072716 Sep 06 10:51:04.505371 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 142/270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:04 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:05.404930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-487fa7e8-20f7-4982-b8ea-f57d0ecb903c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:05.405673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-487fa7e8-20f7-4982-b8ea-f57d0ecb903c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:05.419521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-487fa7e8-20f7-4982-b8ea-f57d0ecb903c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:05.421996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-487fa7e8-20f7-4982-b8ea-f57d0ecb903c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:05.423848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-487fa7e8-20f7-4982-b8ea-f57d0ecb903c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:05.424897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-487fa7e8-20f7-4982-b8ea-f57d0ecb903c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:05.429047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-487fa7e8-20f7-4982-b8ea-f57d0ecb903c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:05.429920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-487fa7e8-20f7-4982-b8ea-f57d0ecb903c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:05.531370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ae13758e-0c08-45fe-bba6-e13fb2146513 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:05.532328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ae13758e-0c08-45fe-bba6-e13fb2146513 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:05.559555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae13758e-0c08-45fe-bba6-e13fb2146513 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:05.574298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae13758e-0c08-45fe-bba6-e13fb2146513 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:05.574728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae13758e-0c08-45fe-bba6-e13fb2146513 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:05.580389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae13758e-0c08-45fe-bba6-e13fb2146513 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:05.580962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae13758e-0c08-45fe-bba6-e13fb2146513 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:05.584384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae13758e-0c08-45fe-bba6-e13fb2146513 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:05.649028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-487fa7e8-20f7-4982-b8ea-f57d0ecb903c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:05.660216 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-487fa7e8-20f7-4982-b8ea-f57d0ecb903c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1320 microversion: 2.1 time: 0.262787 Sep 06 10:51:05.660782 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 129/271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:05 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:05.723459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ae13758e-0c08-45fe-bba6-e13fb2146513 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:05.738739 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ae13758e-0c08-45fe-bba6-e13fb2146513 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 200 len: 1311 microversion: 2.1 time: 0.213196 Sep 06 10:51:05.740008 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 143/272] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:05 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 1311 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:06.691883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-382dd7f8-e852-4436-bb47-5e87fd68421a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:06.692505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-382dd7f8-e852-4436-bb47-5e87fd68421a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:06.707977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-382dd7f8-e852-4436-bb47-5e87fd68421a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:06.708502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-382dd7f8-e852-4436-bb47-5e87fd68421a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:06.708956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-382dd7f8-e852-4436-bb47-5e87fd68421a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:06.709695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-382dd7f8-e852-4436-bb47-5e87fd68421a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:06.710160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-382dd7f8-e852-4436-bb47-5e87fd68421a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:06.717431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-382dd7f8-e852-4436-bb47-5e87fd68421a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:06.781854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a33f5ca8-3c9a-4a2a-a12b-e0db28da9740 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:06.782792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a33f5ca8-3c9a-4a2a-a12b-e0db28da9740 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:06.785001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=8,nova_api:UPDATE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:06.795844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a33f5ca8-3c9a-4a2a-a12b-e0db28da9740 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:06.796431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a33f5ca8-3c9a-4a2a-a12b-e0db28da9740 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:06.796933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a33f5ca8-3c9a-4a2a-a12b-e0db28da9740 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:06.797727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a33f5ca8-3c9a-4a2a-a12b-e0db28da9740 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:06.798244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a33f5ca8-3c9a-4a2a-a12b-e0db28da9740 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:06.798902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a33f5ca8-3c9a-4a2a-a12b-e0db28da9740 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:06.900486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a33f5ca8-3c9a-4a2a-a12b-e0db28da9740 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:06.923536 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a33f5ca8-3c9a-4a2a-a12b-e0db28da9740 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 200 len: 1317 microversion: 2.1 time: 0.146030 Sep 06 10:51:06.924799 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 144/273] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:06 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:06.971572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-382dd7f8-e852-4436-bb47-5e87fd68421a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:06.980720 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-382dd7f8-e852-4436-bb47-5e87fd68421a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1320 microversion: 2.1 time: 0.297559 Sep 06 10:51:06.995727 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 130/274] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:06 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1320 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:07.682589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed08d136-24d9-4676-8cec-5d8c623135cf tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Action: 'create', calling method: .version_select at 0x7f90f8eb7a60>, body: {"keypair": {"name": "tempest-keypair-297666026", "type": "ssh", "user_id": "990aa3b96d8e4366bda76ec07f4f7014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgRrlaP5TAJ4Zq+nYScgHkWdCofFkvzwysZImfNY732PoVnQvR+xfEGUkfQNB2zB5lBqr079ha7+EsULcAF9mrMKw8pf4bH07xIljIBoz55vAuUKMDVg+G7FBwq4z+6Qg=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:07.717545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ed08d136-24d9-4676-8cec-5d8c623135cf tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Getting quotas for project 9439f8a11f784c8fb52a3738c3d582c6. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:51:07.731294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ed08d136-24d9-4676-8cec-5d8c623135cf tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Getting quotas for user bb65d76aa0264bd5b1a1de9897a689da and project 9439f8a11f784c8fb52a3738c3d582c6. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:51:07.862968 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ed08d136-24d9-4676-8cec-5d8c623135cf tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.586494 Sep 06 10:51:07.862968 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 145/275] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Sep 6 10:51:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 588 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 10:51:07.875038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0ee2f87f-ffc5-4c5c-8ea7-e609f27dee1c tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Action: 'create', calling method: .version_select at 0x7f90f8ee9b80>, body: {"keypair": {"name": "tempest-keypair-609135288", "type": "ssh", "user_id": "990aa3b96d8e4366bda76ec07f4f7014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmRpN+vdRz2iSgId4a/7s5I4ivK63cMPoaCgSuRQdtQ9820XzhkLlOalr/PmNspWwoLuR3oxsRHEnAvxhstfBGOeeatp1+uKcAdMb+rrgEefukz/1yzvuClYXBjhlsuIQ=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:07.901616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-0ee2f87f-ffc5-4c5c-8ea7-e609f27dee1c tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Getting quotas for project 9439f8a11f784c8fb52a3738c3d582c6. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:51:07.911890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-0ee2f87f-ffc5-4c5c-8ea7-e609f27dee1c tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Getting quotas for user bb65d76aa0264bd5b1a1de9897a689da and project 9439f8a11f784c8fb52a3738c3d582c6. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:51:08.017807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-15c4d899-99fd-4757-9d1f-bd5c67d33b99 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Calling method '.version_select at 0x7f90f9484b80>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:08.020167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c4d899-99fd-4757-9d1f-bd5c67d33b99 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.020951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c4d899-99fd-4757-9d1f-bd5c67d33b99 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.021545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c4d899-99fd-4757-9d1f-bd5c67d33b99 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.032621 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0ee2f87f-ffc5-4c5c-8ea7-e609f27dee1c tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.163831 Sep 06 10:51:08.033359 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 146/276] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Sep 6 10:51:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 06 10:51:08.043318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e6a93ed2-2a28-4009-b1c9-57f085fef4ac tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:08.044100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e6a93ed2-2a28-4009-b1c9-57f085fef4ac tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:08.052069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6a93ed2-2a28-4009-b1c9-57f085fef4ac tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.055846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c4d899-99fd-4757-9d1f-bd5c67d33b99 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.056579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6a93ed2-2a28-4009-b1c9-57f085fef4ac tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.057221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6a93ed2-2a28-4009-b1c9-57f085fef4ac tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.058010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6a93ed2-2a28-4009-b1c9-57f085fef4ac tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.058666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c4d899-99fd-4757-9d1f-bd5c67d33b99 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.059280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c4d899-99fd-4757-9d1f-bd5c67d33b99 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.060062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6a93ed2-2a28-4009-b1c9-57f085fef4ac tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.064443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6a93ed2-2a28-4009-b1c9-57f085fef4ac tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.093265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c4d899-99fd-4757-9d1f-bd5c67d33b99 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.097892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c4d899-99fd-4757-9d1f-bd5c67d33b99 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.098555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c4d899-99fd-4757-9d1f-bd5c67d33b99 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.110507 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-15c4d899-99fd-4757-9d1f-bd5c67d33b99 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.567353 Sep 06 10:51:08.129436 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 131/277] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:51:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:08.135197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a6d282a0-192e-4c92-a4cd-32f3ed1359ad tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:08.135810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a6d282a0-192e-4c92-a4cd-32f3ed1359ad tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:08.143432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6d282a0-192e-4c92-a4cd-32f3ed1359ad tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.144109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6d282a0-192e-4c92-a4cd-32f3ed1359ad tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.144548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6d282a0-192e-4c92-a4cd-32f3ed1359ad tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.145287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6d282a0-192e-4c92-a4cd-32f3ed1359ad tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.145739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6d282a0-192e-4c92-a4cd-32f3ed1359ad tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.146167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6d282a0-192e-4c92-a4cd-32f3ed1359ad tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.397028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e6a93ed2-2a28-4009-b1c9-57f085fef4ac tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:08.400986 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e6a93ed2-2a28-4009-b1c9-57f085fef4ac tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 200 len: 1385 microversion: 2.1 time: 0.366445 Sep 06 10:51:08.403290 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 147/278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:08 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 1385 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:08.408380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1341a113-fa89-4a75-8d32-75fe7afa579e tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Calling method '.version_select at 0x7f90f8eb8a60>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:08.425017 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1341a113-fa89-4a75-8d32-75fe7afa579e tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-297666026?user_id=990aa3b96d8e4366bda76ec07f4f7014" status: 200 len: 511 microversion: 2.10 time: 0.020458 Sep 06 10:51:08.431951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a6d282a0-192e-4c92-a4cd-32f3ed1359ad tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:08.449024 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 148/279] 10.222.0.20 () {60 vars in 1337 bytes} [Tue Sep 6 10:51:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-297666026?user_id=990aa3b96d8e4366bda76ec07f4f7014 => generated 511 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:51:08.449024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7e80289-8b43-4577-be4d-d776c42ff912 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Calling method '.version_select at 0x7f90f8eb83a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:08.449262 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a6d282a0-192e-4c92-a4cd-32f3ed1359ad tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1320 microversion: 2.1 time: 0.311709 Sep 06 10:51:08.449363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7e80289-8b43-4577-be4d-d776c42ff912 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.449363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7e80289-8b43-4577-be4d-d776c42ff912 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.449507 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 132/280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:08 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:08.449578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7e80289-8b43-4577-be4d-d776c42ff912 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.451312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-5d61af36-4750-4ef3-abbc-2362774ca628 req-0f45374e-8878-4464-a63c-a12b578bda04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9007e9-46e7-420d-8c1d-dc40c1c212de", "tag": "36edbd4f-0314-40a6-8427-33258c8c5ddc"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:08.460029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7e80289-8b43-4577-be4d-d776c42ff912 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.460522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7e80289-8b43-4577-be4d-d776c42ff912 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.461164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7e80289-8b43-4577-be4d-d776c42ff912 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.462783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5d61af36-4750-4ef3-abbc-2362774ca628 req-0f45374e-8878-4464-a63c-a12b578bda04 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.463319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5d61af36-4750-4ef3-abbc-2362774ca628 req-0f45374e-8878-4464-a63c-a12b578bda04 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.463911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5d61af36-4750-4ef3-abbc-2362774ca628 req-0f45374e-8878-4464-a63c-a12b578bda04 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.473628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7e80289-8b43-4577-be4d-d776c42ff912 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.474370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7e80289-8b43-4577-be4d-d776c42ff912 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.475172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7e80289-8b43-4577-be4d-d776c42ff912 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.476368 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5d61af36-4750-4ef3-abbc-2362774ca628 req-0f45374e-8878-4464-a63c-a12b578bda04 service nova] Creating event network-changed:36edbd4f-0314-40a6-8427-33258c8c5ddc for instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de on nch1-master-1 Sep 06 10:51:08.481520 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-5d61af36-4750-4ef3-abbc-2362774ca628 req-0f45374e-8878-4464-a63c-a12b578bda04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036219 Sep 06 10:51:08.483169 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d7e80289-8b43-4577-be4d-d776c42ff912 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.045702 Sep 06 10:51:08.483335 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 133/281] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:08.484406 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 149/282] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Sep 6 10:51:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:08.488318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c070d471-968a-4c71-9773-b52c60f84293 tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Action: 'create', calling method: .version_select at 0x7f90f91939d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1480785637", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7Lzg05PvYktA8V5XfiRwVn75ZUKNwDNqI5QPk9IOozcdKe0DNPGotDfgoK0yK3QMz/mf5euSETX43r5Vk82dYDBL3z00wmOt8woy9GOBerGtSaMBA4MPkZ9YIgA4mrQg=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:08.504018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-489762b5-6289-406c-8763-05276c900b35 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Calling method '.version_select at 0x7f90f8f0bf70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:08.506133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-489762b5-6289-406c-8763-05276c900b35 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.506761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-489762b5-6289-406c-8763-05276c900b35 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.507255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-489762b5-6289-406c-8763-05276c900b35 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.512964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-c070d471-968a-4c71-9773-b52c60f84293 tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Getting quotas for project 9439f8a11f784c8fb52a3738c3d582c6. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:51:08.517650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-c070d471-968a-4c71-9773-b52c60f84293 tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Getting quotas for user bb65d76aa0264bd5b1a1de9897a689da and project 9439f8a11f784c8fb52a3738c3d582c6. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:51:08.525483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-489762b5-6289-406c-8763-05276c900b35 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.526049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-489762b5-6289-406c-8763-05276c900b35 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.693403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-489762b5-6289-406c-8763-05276c900b35 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.693403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-489762b5-6289-406c-8763-05276c900b35 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.693403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-489762b5-6289-406c-8763-05276c900b35 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.693403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-489762b5-6289-406c-8763-05276c900b35 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.694072 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-489762b5-6289-406c-8763-05276c900b35 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048329 Sep 06 10:51:08.694072 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 150/283] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:51:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:08.694072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-42b3cf7c-a541-43c2-8a78-50d7734be1be tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Calling method '.version_select at 0x7f90f8eb81f0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:08.694072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42b3cf7c-a541-43c2-8a78-50d7734be1be tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.694072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42b3cf7c-a541-43c2-8a78-50d7734be1be tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.694397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42b3cf7c-a541-43c2-8a78-50d7734be1be tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.705138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42b3cf7c-a541-43c2-8a78-50d7734be1be tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.705633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42b3cf7c-a541-43c2-8a78-50d7734be1be tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.706077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42b3cf7c-a541-43c2-8a78-50d7734be1be tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.712854 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-42b3cf7c-a541-43c2-8a78-50d7734be1be tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.031434 Sep 06 10:51:08.713471 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 151/284] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:51:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:08.729155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7a7756a-abca-4fc7-9c00-d8738dd30538 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Calling method '.version_select at 0x7f90f8f8a4c0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:08.730905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7a7756a-abca-4fc7-9c00-d8738dd30538 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.731423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7a7756a-abca-4fc7-9c00-d8738dd30538 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.731867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7a7756a-abca-4fc7-9c00-d8738dd30538 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.749718 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d7a7756a-abca-4fc7-9c00-d8738dd30538 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.024150 Sep 06 10:51:08.750334 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 152/285] 10.222.0.20 () {58 vars in 1179 bytes} [Tue Sep 6 10:51:08 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:08.766004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b339ead2-9ccb-493e-ba53-4009ad9a06b6 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Calling method '.version_select at 0x7f90f8eb8af0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:08.768203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b339ead2-9ccb-493e-ba53-4009ad9a06b6 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.768749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b339ead2-9ccb-493e-ba53-4009ad9a06b6 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.769516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b339ead2-9ccb-493e-ba53-4009ad9a06b6 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.791345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b339ead2-9ccb-493e-ba53-4009ad9a06b6 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.791345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b339ead2-9ccb-493e-ba53-4009ad9a06b6 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.791345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b339ead2-9ccb-493e-ba53-4009ad9a06b6 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.798108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b339ead2-9ccb-493e-ba53-4009ad9a06b6 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.798697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b339ead2-9ccb-493e-ba53-4009ad9a06b6 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.799260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b339ead2-9ccb-493e-ba53-4009ad9a06b6 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.806465 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b339ead2-9ccb-493e-ba53-4009ad9a06b6 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.045443 Sep 06 10:51:08.807201 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 153/286] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:51:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:08.819213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e44222b1-35db-4deb-a747-8fb16389bb83 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Calling method '.version_select at 0x7f90f8eb8d30>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:08.821304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e44222b1-35db-4deb-a747-8fb16389bb83 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.821798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e44222b1-35db-4deb-a747-8fb16389bb83 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.825868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e44222b1-35db-4deb-a747-8fb16389bb83 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.827636 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c070d471-968a-4c71-9773-b52c60f84293 tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.343200 Sep 06 10:51:08.828251 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 134/287] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Sep 6 10:51:08 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 344 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 10:51:08.938166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e44222b1-35db-4deb-a747-8fb16389bb83 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.938166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e44222b1-35db-4deb-a747-8fb16389bb83 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.938166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e44222b1-35db-4deb-a747-8fb16389bb83 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:08.938166 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e44222b1-35db-4deb-a747-8fb16389bb83 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.035255 Sep 06 10:51:08.940072 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 154/288] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:51:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:08.999441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-840b3c29-f92e-4fec-a3e1-7a8726415148 tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Calling method '.version_select at 0x7f90f93278b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:08.999605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dca02baf-75d3-439b-a1ec-0e3c35c617a7 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Calling method '.version_select at 0x7f90f8eb8280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:08.999778 ncdv-master-1 devstack@n-api.service[140875]: WARNING oslo_db.sqlalchemy.utils [None req-840b3c29-f92e-4fec-a3e1-7a8726415148 tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 06 10:51:08.999940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dca02baf-75d3-439b-a1ec-0e3c35c617a7 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:08.999940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dca02baf-75d3-439b-a1ec-0e3c35c617a7 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:08.999940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dca02baf-75d3-439b-a1ec-0e3c35c617a7 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:09.000328 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-840b3c29-f92e-4fec-a3e1-7a8726415148 tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs?user_id=990aa3b96d8e4366bda76ec07f4f7014" status: 200 len: 724 microversion: 2.10 time: 0.016959 Sep 06 10:51:09.000328 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 135/289] 10.222.0.20 () {60 vars in 1259 bytes} [Tue Sep 6 10:51:08 2022] GET /compute/v2.1/os-keypairs?user_id=990aa3b96d8e4366bda76ec07f4f7014 => generated 724 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:51:09.000548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dca02baf-75d3-439b-a1ec-0e3c35c617a7 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:09.000548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dca02baf-75d3-439b-a1ec-0e3c35c617a7 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:09.000548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dca02baf-75d3-439b-a1ec-0e3c35c617a7 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:09.000548 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dca02baf-75d3-439b-a1ec-0e3c35c617a7 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.030881 Sep 06 10:51:09.001019 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 155/290] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:51:08 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:09.009793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-70cbb126-500c-46ae-9f68-9faf8446fb02 tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Calling method '.version_select at 0x7f90f9150040>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:09.017436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b14e116f-49c9-4f7f-b35a-db885c7996f9 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Calling method '.version_select at 0x7f90f8ee9ca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:09.019640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b14e116f-49c9-4f7f-b35a-db885c7996f9 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:09.020237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b14e116f-49c9-4f7f-b35a-db885c7996f9 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:09.020754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b14e116f-49c9-4f7f-b35a-db885c7996f9 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:09.038063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b14e116f-49c9-4f7f-b35a-db885c7996f9 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:09.038522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b14e116f-49c9-4f7f-b35a-db885c7996f9 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:09.039106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b14e116f-49c9-4f7f-b35a-db885c7996f9 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:09.051141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b14e116f-49c9-4f7f-b35a-db885c7996f9 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:09.051628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b14e116f-49c9-4f7f-b35a-db885c7996f9 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:09.052062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b14e116f-49c9-4f7f-b35a-db885c7996f9 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:09.077735 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b14e116f-49c9-4f7f-b35a-db885c7996f9 tempest-HypervisorAdminTestJSON-1764946861 tempest-HypervisorAdminTestJSON-1764946861-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.064001 Sep 06 10:51:09.078525 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 156/291] 10.222.0.20 () {58 vars in 1173 bytes} [Tue Sep 6 10:51:09 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:09.293391 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-70cbb126-500c-46ae-9f68-9faf8446fb02 tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1480785637" status: 204 len: 0 microversion: 2.10 time: 0.287413 Sep 06 10:51:09.298089 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 136/292] 10.222.0.20 () {60 vars in 1325 bytes} [Tue Sep 6 10:51:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1480785637 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 10:51:09.303314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cb2c8b38-bfe3-47f5-9eaf-1f7a4561924f tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Calling method '.version_select at 0x7f90f8eb79d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:09.378050 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cb2c8b38-bfe3-47f5-9eaf-1f7a4561924f tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-609135288?user_id=990aa3b96d8e4366bda76ec07f4f7014" status: 204 len: 0 microversion: 2.10 time: 0.079107 Sep 06 10:51:09.379239 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 157/293] 10.222.0.20 () {60 vars in 1340 bytes} [Tue Sep 6 10:51:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-609135288?user_id=990aa3b96d8e4366bda76ec07f4f7014 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 10:51:09.388002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4ac9e6ea-f216-4714-863d-c03092166a9d tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] Calling method '.version_select at 0x7f90f94c0700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:09.574280 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4ac9e6ea-f216-4714-863d-c03092166a9d tempest-KeyPairsV210TestJSON-457363564 tempest-KeyPairsV210TestJSON-457363564-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-297666026?user_id=990aa3b96d8e4366bda76ec07f4f7014" status: 204 len: 0 microversion: 2.10 time: 0.190600 Sep 06 10:51:09.574873 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 137/294] 10.222.0.20 () {60 vars in 1340 bytes} [Tue Sep 6 10:51:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-297666026?user_id=990aa3b96d8e4366bda76ec07f4f7014 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 10:51:09.580017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-52c87b96-dab9-44a8-abff-e3843025adbe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:09.581975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-52c87b96-dab9-44a8-abff-e3843025adbe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:09.586876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52c87b96-dab9-44a8-abff-e3843025adbe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:09.587400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52c87b96-dab9-44a8-abff-e3843025adbe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:09.587854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52c87b96-dab9-44a8-abff-e3843025adbe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:09.588581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52c87b96-dab9-44a8-abff-e3843025adbe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:09.589418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52c87b96-dab9-44a8-abff-e3843025adbe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:09.589599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52c87b96-dab9-44a8-abff-e3843025adbe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:09.754188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-52c87b96-dab9-44a8-abff-e3843025adbe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:09.765976 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-52c87b96-dab9-44a8-abff-e3843025adbe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 200 len: 1385 microversion: 2.1 time: 0.190017 Sep 06 10:51:09.767338 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 138/295] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:09 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 1385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:09.773009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e41501eb-675c-4cc8-80c6-314534696de0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:09.774171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e41501eb-675c-4cc8-80c6-314534696de0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:09.785295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e41501eb-675c-4cc8-80c6-314534696de0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:09.785295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e41501eb-675c-4cc8-80c6-314534696de0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:09.785295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e41501eb-675c-4cc8-80c6-314534696de0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:09.785295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e41501eb-675c-4cc8-80c6-314534696de0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:09.785658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e41501eb-675c-4cc8-80c6-314534696de0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:09.785813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e41501eb-675c-4cc8-80c6-314534696de0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:09.928842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e41501eb-675c-4cc8-80c6-314534696de0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:09.938996 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e41501eb-675c-4cc8-80c6-314534696de0 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1320 microversion: 2.1 time: 0.170294 Sep 06 10:51:09.939591 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 139/296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:09 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:10.002527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a2742902-32f2-47af-8f21-49e4e6d933e4 req-af466aa6-416e-410f-9f8f-8160e39d3450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75159ad8-0c49-4c3d-8baf-70ecad89e29c", "tag": "1e855477-40de-441c-9ddb-40fff21e25da"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:10.013625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a2742902-32f2-47af-8f21-49e4e6d933e4 req-af466aa6-416e-410f-9f8f-8160e39d3450 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:10.014811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a2742902-32f2-47af-8f21-49e4e6d933e4 req-af466aa6-416e-410f-9f8f-8160e39d3450 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:10.015445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a2742902-32f2-47af-8f21-49e4e6d933e4 req-af466aa6-416e-410f-9f8f-8160e39d3450 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:10.027998 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a2742902-32f2-47af-8f21-49e4e6d933e4 req-af466aa6-416e-410f-9f8f-8160e39d3450 service nova] Creating event network-changed:1e855477-40de-441c-9ddb-40fff21e25da for instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c on nch2-master-1 Sep 06 10:51:10.034696 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a2742902-32f2-47af-8f21-49e4e6d933e4 req-af466aa6-416e-410f-9f8f-8160e39d3450 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036363 Sep 06 10:51:10.040064 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 140/297] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:10.075240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-581094f3-f42b-447e-84dd-6c671a00ad99 tempest-InstanceUsageAuditLogNegativeTestJSON-530630556 tempest-InstanceUsageAuditLogNegativeTestJSON-530630556-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:10.080794 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-581094f3-f42b-447e-84dd-6c671a00ad99 tempest-InstanceUsageAuditLogNegativeTestJSON-530630556 tempest-InstanceUsageAuditLogNegativeTestJSON-530630556-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-581094f3-f42b-447e-84dd-6c671a00ad99 tempest-InstanceUsageAuditLogNegativeTestJSON-530630556 tempest-InstanceUsageAuditLogNegativeTestJSON-530630556-project-admin] Request method failure captured: Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyYdBEGobT8SmhNUGdExf4DWZ4K4JK69jsg8zJJMn2YoXRjFhAXZ8Rg7Hw2fLclDO358IQEhiEENWc5jUJfuVAz6zn10TAxwsOIjFjQFS_8pjhx-VE31bEEJzXNg-lSyNJm82lNGwK3xnc8Vaj60bV9XARMWtJP5XfmaofdT9PHkdVs Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 7e1511e862b044419f2b43f401856470 Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-530630556 Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:10.094570 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:10.102460 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e1511e862b044419f2b43f401856470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e1511e862b044419f2b43f401856470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e1511e862b044419f2b43f401856470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e1511e862b044419f2b43f401856470"}]}] Sep 06 10:51:10.102460 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-530630556 Sep 06 10:51:10.102460 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 7e1511e862b044419f2b43f401856470 Sep 06 10:51:10.102460 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-530630556 Sep 06 10:51:10.102460 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-530630556-project-admin Sep 06 10:51:10.102460 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:10.102460 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:10.102460 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 41fb2d0cc8654d58b3be7160e8cd1e15 Sep 06 10:51:10.102460 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-530630556-project-admin Sep 06 10:51:10.102460 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:10.102460 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid timestamp for date invalid_time Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'invalid_time'} Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:10.103327 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-581094f3-f42b-447e-84dd-6c671a00ad99 tempest-InstanceUsageAuditLogNegativeTestJSON-530630556 tempest-InstanceUsageAuditLogNegativeTestJSON-530630556-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:10.104675 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-581094f3-f42b-447e-84dd-6c671a00ad99 tempest-InstanceUsageAuditLogNegativeTestJSON-530630556 tempest-InstanceUsageAuditLogNegativeTestJSON-530630556-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.694350 Sep 06 10:51:10.105873 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 158/298] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:09 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 696 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 06 10:51:10.573255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-88cefdac-c3fb-4901-9b6f-f5677445a874 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:10.575047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-88cefdac-c3fb-4901-9b6f-f5677445a874 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '1819c62a28c041608b9e4620b938979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810fe8e68f7d41288fc90e1ed351f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-88cefdac-c3fb-4901-9b6f-f5677445a874 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project] Request method failure captured: Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYZMaLNcpHTY9sQcUh-QJtJtMJXybmFsTsLdD8HML01QBSFL2nc7z1OCCl_PxclIFcboSQOvkzou2LEZ7QiEuU9pWmIP8Wm6llvuO8lL5hRJO1urtDDoBuGs3QvsQB1RpPW6SuvJO9pOfoFrLLs9LgmOkCaxWDJJKtmUwHX0GoVCUk Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 810fe8e68f7d41288fc90e1ed351f81e Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:51:10.577470 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:51:10.578926 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_810fe8e68f7d41288fc90e1ed351f81e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/810fe8e68f7d41288fc90e1ed351f81e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/810fe8e68f7d41288fc90e1ed351f81e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/810fe8e68f7d41288fc90e1ed351f81e"}]}] Sep 06 10:51:10.578926 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 Sep 06 10:51:10.578926 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 810fe8e68f7d41288fc90e1ed351f81e Sep 06 10:51:10.578926 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 Sep 06 10:51:10.578926 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project Sep 06 10:51:10.578926 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:10.578926 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:10.578926 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 1819c62a28c041608b9e4620b938979c Sep 06 10:51:10.578926 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project Sep 06 10:51:10.578926 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: action_args: {} Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:10.579713 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 06 10:51:10.581197 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:10.582648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-88cefdac-c3fb-4901-9b6f-f5677445a874 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:10.582648 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-88cefdac-c3fb-4901-9b6f-f5677445a874 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.473376 Sep 06 10:51:10.591092 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 141/299] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Sep 6 10:51:10 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 486 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:10.610731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8aa962eb-4cda-49c8-afc6-0979d56efbe4 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:10.612537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8aa962eb-4cda-49c8-afc6-0979d56efbe4 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '1819c62a28c041608b9e4620b938979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810fe8e68f7d41288fc90e1ed351f81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8aa962eb-4cda-49c8-afc6-0979d56efbe4 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project] Request method failure captured: Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-06%2010:51:10 HTTP/1.1 Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyYZMaLNcpHTY9sQcUh-QJtJtMJXybmFsTsLdD8HML01QBSFL2nc7z1OCCl_PxclIFcboSQOvkzou2LEZ7QiEuU9pWmIP8Wm6llvuO8lL5hRJO1urtDDoBuGs3QvsQB1RpPW6SuvJO9pOfoFrLLs9LgmOkCaxWDJJKtmUwHX0GoVCUk Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 810fe8e68f7d41288fc90e1ed351f81e Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:10.615375 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:10.616697 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_810fe8e68f7d41288fc90e1ed351f81e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/810fe8e68f7d41288fc90e1ed351f81e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/810fe8e68f7d41288fc90e1ed351f81e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/810fe8e68f7d41288fc90e1ed351f81e"}]}] Sep 06 10:51:10.616697 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 Sep 06 10:51:10.616697 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 810fe8e68f7d41288fc90e1ed351f81e Sep 06 10:51:10.616697 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 Sep 06 10:51:10.616697 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project Sep 06 10:51:10.616697 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:10.616697 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:10.616697 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 1819c62a28c041608b9e4620b938979c Sep 06 10:51:10.616697 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project Sep 06 10:51:10.616697 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '2022-09-06 10:51:10'} Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:10.617376 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 06 10:51:10.618627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:10.620722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8aa962eb-4cda-49c8-afc6-0979d56efbe4 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:10.621772 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8aa962eb-4cda-49c8-afc6-0979d56efbe4 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259 tempest-InstanceUsageAuditLogNegativeTestJSON-707599259-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-06 10:51:10" status: 403 len: 128 microversion: 2.1 time: 0.015600 Sep 06 10:51:10.623974 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 159/300] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 10:51:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-06%2010%3A51%3A10 => generated 128 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:10.792556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fa93d587-ef7f-4caf-8d9d-72df597d689a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:10.793499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fa93d587-ef7f-4caf-8d9d-72df597d689a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:10.801058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa93d587-ef7f-4caf-8d9d-72df597d689a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:10.804939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa93d587-ef7f-4caf-8d9d-72df597d689a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:10.804939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa93d587-ef7f-4caf-8d9d-72df597d689a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:10.804939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa93d587-ef7f-4caf-8d9d-72df597d689a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:10.804939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa93d587-ef7f-4caf-8d9d-72df597d689a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:10.805471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa93d587-ef7f-4caf-8d9d-72df597d689a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:10.950057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fa93d587-ef7f-4caf-8d9d-72df597d689a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:10.959153 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fa93d587-ef7f-4caf-8d9d-72df597d689a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 200 len: 1385 microversion: 2.1 time: 0.170437 Sep 06 10:51:10.959857 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 142/301] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:10 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 1385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:10.962663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-06426a0e-0f6a-4b99-9a5f-b0e95946746f tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:10.963463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-06426a0e-0f6a-4b99-9a5f-b0e95946746f tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:10.971988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06426a0e-0f6a-4b99-9a5f-b0e95946746f tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:10.972476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06426a0e-0f6a-4b99-9a5f-b0e95946746f tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:10.973112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06426a0e-0f6a-4b99-9a5f-b0e95946746f tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:10.974036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06426a0e-0f6a-4b99-9a5f-b0e95946746f tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:10.977790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06426a0e-0f6a-4b99-9a5f-b0e95946746f tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:10.978531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06426a0e-0f6a-4b99-9a5f-b0e95946746f tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:11.169964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-06426a0e-0f6a-4b99-9a5f-b0e95946746f tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:11.178365 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-06426a0e-0f6a-4b99-9a5f-b0e95946746f tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1320 microversion: 2.1 time: 0.220091 Sep 06 10:51:11.179105 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 160/302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:10 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:11.985132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8d5d5101-b376-46b6-9546-1a0decb63aaa tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:11.985947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8d5d5101-b376-46b6-9546-1a0decb63aaa tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:11.993345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d5d5101-b376-46b6-9546-1a0decb63aaa tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:11.993853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d5d5101-b376-46b6-9546-1a0decb63aaa tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:11.994304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d5d5101-b376-46b6-9546-1a0decb63aaa tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:11.995059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d5d5101-b376-46b6-9546-1a0decb63aaa tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:11.995541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d5d5101-b376-46b6-9546-1a0decb63aaa tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:11.995977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d5d5101-b376-46b6-9546-1a0decb63aaa tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:12.204516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76aa503a-418a-47ed-b041-4f83b42ee36a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:12.205913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-76aa503a-418a-47ed-b041-4f83b42ee36a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:12.215539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=10 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:12.222171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8d5d5101-b376-46b6-9546-1a0decb63aaa tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:12.231560 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8d5d5101-b376-46b6-9546-1a0decb63aaa tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 200 len: 1385 microversion: 2.1 time: 0.250587 Sep 06 10:51:12.235517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76aa503a-418a-47ed-b041-4f83b42ee36a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:12.235695 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 143/303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:11 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 1385 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:12.236450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76aa503a-418a-47ed-b041-4f83b42ee36a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:12.237575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76aa503a-418a-47ed-b041-4f83b42ee36a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:12.240982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76aa503a-418a-47ed-b041-4f83b42ee36a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:12.241719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76aa503a-418a-47ed-b041-4f83b42ee36a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:12.242822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76aa503a-418a-47ed-b041-4f83b42ee36a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:12.458304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-76aa503a-418a-47ed-b041-4f83b42ee36a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:12.470182 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-76aa503a-418a-47ed-b041-4f83b42ee36a tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1320 microversion: 2.1 time: 0.270807 Sep 06 10:51:12.470794 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 161/304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:12 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1320 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:51:13.260776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-447592d3-aa6b-45c1-8f6b-43e93e9e3e0b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:13.261578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-447592d3-aa6b-45c1-8f6b-43e93e9e3e0b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:13.264245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=18 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:13.272519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-447592d3-aa6b-45c1-8f6b-43e93e9e3e0b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:13.273015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-447592d3-aa6b-45c1-8f6b-43e93e9e3e0b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:13.273458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-447592d3-aa6b-45c1-8f6b-43e93e9e3e0b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:13.274256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-447592d3-aa6b-45c1-8f6b-43e93e9e3e0b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:13.274787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-447592d3-aa6b-45c1-8f6b-43e93e9e3e0b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:13.275246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-447592d3-aa6b-45c1-8f6b-43e93e9e3e0b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:13.466915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-447592d3-aa6b-45c1-8f6b-43e93e9e3e0b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:13.475990 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-447592d3-aa6b-45c1-8f6b-43e93e9e3e0b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 200 len: 1385 microversion: 2.1 time: 0.220749 Sep 06 10:51:13.476802 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 144/305] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:13 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 1385 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:13.840436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2134286966", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:13.903152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:51:14.080251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-57e4bbb6-fb01-47ce-8c7f-0493235af10d tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Calling method '.version_select at 0x7f90f9150790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:14.082488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57e4bbb6-fb01-47ce-8c7f-0493235af10d tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:14.083558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57e4bbb6-fb01-47ce-8c7f-0493235af10d tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:14.084000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57e4bbb6-fb01-47ce-8c7f-0493235af10d tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:14.108763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57e4bbb6-fb01-47ce-8c7f-0493235af10d tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:14.108763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57e4bbb6-fb01-47ce-8c7f-0493235af10d tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:14.108763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57e4bbb6-fb01-47ce-8c7f-0493235af10d tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:14.119384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57e4bbb6-fb01-47ce-8c7f-0493235af10d tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:14.120087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57e4bbb6-fb01-47ce-8c7f-0493235af10d tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:14.120703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57e4bbb6-fb01-47ce-8c7f-0493235af10d tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:14.129617 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-57e4bbb6-fb01-47ce-8c7f-0493235af10d tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.651252 Sep 06 10:51:14.136404 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 145/306] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Sep 6 10:51:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:51:14.137792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:51:14.138291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:51:14.138942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:51:14.139464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:51:14.140163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:51:14.143076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c6a54b7-c942-4bb8-97e9-b1af14f24d31 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:14.144016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c6a54b7-c942-4bb8-97e9-b1af14f24d31 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:14.152265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:14.152784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c6a54b7-c942-4bb8-97e9-b1af14f24d31 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:14.153066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:14.153582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:14.153898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c6a54b7-c942-4bb8-97e9-b1af14f24d31 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:14.154489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:14.154792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c6a54b7-c942-4bb8-97e9-b1af14f24d31 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:14.155099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:14.155768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:14.156035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c6a54b7-c942-4bb8-97e9-b1af14f24d31 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:14.156603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c6a54b7-c942-4bb8-97e9-b1af14f24d31 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:14.157230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c6a54b7-c942-4bb8-97e9-b1af14f24d31 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:14.177708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Getting quotas for project 752e7bf666fb4d7a8a997af85d508dd6. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:51:14.182793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Getting quotas for user 68b67a91aae74b33959efe4f3e647efb and project 752e7bf666fb4d7a8a997af85d508dd6. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:51:14.197012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:51:14.199749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:51:14.348563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2c6a54b7-c942-4bb8-97e9-b1af14f24d31 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:14.359548 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c6a54b7-c942-4bb8-97e9-b1af14f24d31 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1320 microversion: 2.1 time: 0.221765 Sep 06 10:51:14.360126 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 146/307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:14 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1320 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:14.364445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0d2a4be4-b97d-4f03-b38a-8bb0d16d7df3 tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Calling method '.version_select at 0x7f90f9193c10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:14.366228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d2a4be4-b97d-4f03-b38a-8bb0d16d7df3 tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:14.366715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d2a4be4-b97d-4f03-b38a-8bb0d16d7df3 tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:14.367189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d2a4be4-b97d-4f03-b38a-8bb0d16d7df3 tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:14.384568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d2a4be4-b97d-4f03-b38a-8bb0d16d7df3 tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:14.385116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d2a4be4-b97d-4f03-b38a-8bb0d16d7df3 tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:14.385559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d2a4be4-b97d-4f03-b38a-8bb0d16d7df3 tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:14.394784 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b656f6b3-8ffe-4e05-aaca-27da3874ea53 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106380 Sep 06 10:51:14.396497 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0d2a4be4-b97d-4f03-b38a-8bb0d16d7df3 tempest-HypervisorAdminV228Test-1094805872 tempest-HypervisorAdminV228Test-1094805872-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.035335 Sep 06 10:51:14.397554 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 147/308] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 6 10:51:14 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:51:14.401629 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 162/309] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:51:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:51:14.412115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-32dca439-1fc7-4288-abb0-cad2f624199a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:14.412115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-32dca439-1fc7-4288-abb0-cad2f624199a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:14.485623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-32dca439-1fc7-4288-abb0-cad2f624199a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:14.493096 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-32dca439-1fc7-4288-abb0-cad2f624199a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1214 microversion: 2.1 time: 0.089659 Sep 06 10:51:14.497103 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 148/310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:14 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:14.501583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c5e0042d-8dd9-4de5-bfdf-af8f1522a39b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:14.503772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c5e0042d-8dd9-4de5-bfdf-af8f1522a39b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:14.511500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5e0042d-8dd9-4de5-bfdf-af8f1522a39b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:14.512338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5e0042d-8dd9-4de5-bfdf-af8f1522a39b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:14.512798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5e0042d-8dd9-4de5-bfdf-af8f1522a39b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:14.513535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5e0042d-8dd9-4de5-bfdf-af8f1522a39b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:14.514540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5e0042d-8dd9-4de5-bfdf-af8f1522a39b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:14.514982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5e0042d-8dd9-4de5-bfdf-af8f1522a39b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:14.659563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c5e0042d-8dd9-4de5-bfdf-af8f1522a39b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:14.667147 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c5e0042d-8dd9-4de5-bfdf-af8f1522a39b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 200 len: 1385 microversion: 2.1 time: 0.170401 Sep 06 10:51:14.667770 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 163/311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:14 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 1385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:15.199966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-54ffd56f-d6a8-4561-8089-041097285216 req-3e08532c-ae44-4ee5-964c-f8cd38a37e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9007e9-46e7-420d-8c1d-dc40c1c212de", "name": "network-vif-plugged", "status": "completed", "tag": "36edbd4f-0314-40a6-8427-33258c8c5ddc"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:15.219533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-54ffd56f-d6a8-4561-8089-041097285216 req-3e08532c-ae44-4ee5-964c-f8cd38a37e5a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:15.220343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-54ffd56f-d6a8-4561-8089-041097285216 req-3e08532c-ae44-4ee5-964c-f8cd38a37e5a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:15.220781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-54ffd56f-d6a8-4561-8089-041097285216 req-3e08532c-ae44-4ee5-964c-f8cd38a37e5a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:15.244244 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-54ffd56f-d6a8-4561-8089-041097285216 req-3e08532c-ae44-4ee5-964c-f8cd38a37e5a service nova] Creating event network-vif-plugged:36edbd4f-0314-40a6-8427-33258c8c5ddc for instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de on nch1-master-1 Sep 06 10:51:15.250197 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-54ffd56f-d6a8-4561-8089-041097285216 req-3e08532c-ae44-4ee5-964c-f8cd38a37e5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057235 Sep 06 10:51:15.251443 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 149/312] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:15.386795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26062378-8c45-49ec-880f-5e3f4346999c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:15.390427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-26062378-8c45-49ec-880f-5e3f4346999c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:15.402863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26062378-8c45-49ec-880f-5e3f4346999c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:15.405034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26062378-8c45-49ec-880f-5e3f4346999c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:15.405034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26062378-8c45-49ec-880f-5e3f4346999c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:15.406131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26062378-8c45-49ec-880f-5e3f4346999c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:15.407782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26062378-8c45-49ec-880f-5e3f4346999c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:15.409337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26062378-8c45-49ec-880f-5e3f4346999c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:15.530623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-58fc8361-260d-4d96-9f70-c397513412fa tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:15.532403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-58fc8361-260d-4d96-9f70-c397513412fa tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:15.614921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-58fc8361-260d-4d96-9f70-c397513412fa tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:15.620331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-26062378-8c45-49ec-880f-5e3f4346999c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:15.625074 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-58fc8361-260d-4d96-9f70-c397513412fa tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1214 microversion: 2.1 time: 0.112414 Sep 06 10:51:15.635660 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 150/313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:15 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:15.638646 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-26062378-8c45-49ec-880f-5e3f4346999c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1320 microversion: 2.1 time: 0.260116 Sep 06 10:51:15.640929 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 164/314] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:15 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1320 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:15.699099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1bb1a607-b131-4c35-8aae-c4633bc144c5 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:15.700001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1bb1a607-b131-4c35-8aae-c4633bc144c5 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:15.716676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bb1a607-b131-4c35-8aae-c4633bc144c5 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:15.717198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bb1a607-b131-4c35-8aae-c4633bc144c5 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:15.722942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bb1a607-b131-4c35-8aae-c4633bc144c5 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:15.723923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bb1a607-b131-4c35-8aae-c4633bc144c5 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:15.724603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bb1a607-b131-4c35-8aae-c4633bc144c5 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:15.725289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bb1a607-b131-4c35-8aae-c4633bc144c5 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:15.884315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1bb1a607-b131-4c35-8aae-c4633bc144c5 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:15.893000 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1bb1a607-b131-4c35-8aae-c4633bc144c5 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 200 len: 1385 microversion: 2.1 time: 0.206391 Sep 06 10:51:15.893663 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 151/315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:15 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 1385 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:16.386025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d40cadd9-253e-4b28-8654-5803aa5298f2 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:16.389661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d40cadd9-253e-4b28-8654-5803aa5298f2 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:16.391118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d40cadd9-253e-4b28-8654-5803aa5298f2 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:16.391900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d40cadd9-253e-4b28-8654-5803aa5298f2 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:16.392867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d40cadd9-253e-4b28-8654-5803aa5298f2 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:16.393362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d40cadd9-253e-4b28-8654-5803aa5298f2 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:16.393855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d40cadd9-253e-4b28-8654-5803aa5298f2 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:16.398981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:16.420338 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d40cadd9-253e-4b28-8654-5803aa5298f2 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.330069 Sep 06 10:51:16.421649 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 165/316] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Sep 6 10:51:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:16.442971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8eb32f10-3de3-4cc1-a7ff-a6ce21f88fd6 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2137890068"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:16.449269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.aggregate [None req-8eb32f10-3de3-4cc1-a7ff-a6ce21f88fd6 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Generated uuid f818a31e-b4f9-43a2-a8f8-a9f32d0bbba8 for aggregate {{(pid=140875) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:16.588680 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8eb32f10-3de3-4cc1-a7ff-a6ce21f88fd6 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.155336 Sep 06 10:51:16.596171 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 152/317] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:16.600927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5114240d-ece6-4607-87de-f0bcb8cbef81 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:16.612400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5114240d-ece6-4607-87de-f0bcb8cbef81 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:16.612924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5114240d-ece6-4607-87de-f0bcb8cbef81 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:16.613364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5114240d-ece6-4607-87de-f0bcb8cbef81 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:16.647802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f8219c85-9fad-45ef-933e-fad6b6f7fb43 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:16.648654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f8219c85-9fad-45ef-933e-fad6b6f7fb43 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:16.664909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8219c85-9fad-45ef-933e-fad6b6f7fb43 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:16.665404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8219c85-9fad-45ef-933e-fad6b6f7fb43 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:16.668765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8219c85-9fad-45ef-933e-fad6b6f7fb43 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:16.668765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8219c85-9fad-45ef-933e-fad6b6f7fb43 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:16.668765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8219c85-9fad-45ef-933e-fad6b6f7fb43 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:16.668765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8219c85-9fad-45ef-933e-fad6b6f7fb43 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:16.696704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:16.756039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f8219c85-9fad-45ef-933e-fad6b6f7fb43 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:16.769078 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f8219c85-9fad-45ef-933e-fad6b6f7fb43 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1210 microversion: 2.1 time: 0.124994 Sep 06 10:51:16.779677 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 153/318] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:16 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:51:16.794281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-146c6c31-b3b5-45b7-b458-065676869643 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:16.798157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-146c6c31-b3b5-45b7-b458-065676869643 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:16.800839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:16.810054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-146c6c31-b3b5-45b7-b458-065676869643 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:16.811506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-146c6c31-b3b5-45b7-b458-065676869643 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:16.812262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-146c6c31-b3b5-45b7-b458-065676869643 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:16.813257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-146c6c31-b3b5-45b7-b458-065676869643 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:16.814166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-146c6c31-b3b5-45b7-b458-065676869643 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:16.814826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-146c6c31-b3b5-45b7-b458-065676869643 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:16.930558 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5114240d-ece6-4607-87de-f0bcb8cbef81 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.333562 Sep 06 10:51:16.932458 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 166/319] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Sep 6 10:51:16 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:16.947476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f5df2a80-4d58-4fa4-a8a0-b6bbad930cc0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:16.953622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f5df2a80-4d58-4fa4-a8a0-b6bbad930cc0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:16.963339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5df2a80-4d58-4fa4-a8a0-b6bbad930cc0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:16.963827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5df2a80-4d58-4fa4-a8a0-b6bbad930cc0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:16.964275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5df2a80-4d58-4fa4-a8a0-b6bbad930cc0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:16.967340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5df2a80-4d58-4fa4-a8a0-b6bbad930cc0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:16.968081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5df2a80-4d58-4fa4-a8a0-b6bbad930cc0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:16.969378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5df2a80-4d58-4fa4-a8a0-b6bbad930cc0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:17.016894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-146c6c31-b3b5-45b7-b458-065676869643 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:17.025723 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-146c6c31-b3b5-45b7-b458-065676869643 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1320 microversion: 2.1 time: 0.249241 Sep 06 10:51:17.026391 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 154/320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:16 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:17.031326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-615ae2f9-bc50-4171-9a45-50b64edadd0d tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:17.042986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-615ae2f9-bc50-4171-9a45-50b64edadd0d tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:17.042986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-615ae2f9-bc50-4171-9a45-50b64edadd0d tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:17.043255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-615ae2f9-bc50-4171-9a45-50b64edadd0d tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:17.141169 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-615ae2f9-bc50-4171-9a45-50b64edadd0d tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] HTTP exception thrown: Aggregate 11 already has host nch1-master-1. Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-615ae2f9-bc50-4171-9a45-50b64edadd0d tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Request method failure captured: Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 39 Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYkk8ER6FXQCgi9qs_zWRr-Qgs0GTywS-qTilCLdNSanXp43B_GpqBxkxBllzM-5fg3-aNuc8WvL3Jz63hj_P7noFS3TC7nho6QnyqdxQXiFNbw5GD55EgIj8yHTW4HO7RN3DU4IfMsjkTtrGInbZVi24TwlbQkUi8zgCuNX1d1H1o Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:51:17.154184 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:51:17.156025 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}] Sep 06 10:51:17.156025 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:17.156025 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:17.156025 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:17.156025 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:17.156025 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:17.156025 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:17.156025 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: f219933dab6c4d64ad844f36b545d542 Sep 06 10:51:17.156025 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:17.156025 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:51:17.156025 ncdv-master-1 devstack@n-api.service[140875]: {"add_host": {"host": "nch1-master-1"}} Sep 06 10:51:17.156025 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:17.156025 ncdv-master-1 devstack@n-api.service[140875]: exception: Aggregate 11 already has host nch1-master-1. Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '11', 'body': {'add_host': {'host': 'nch1-master-1'}}} Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result.read() Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 10:51:17.156737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch1-master-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi session.flush() Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 10:51:17.158381 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 10:51:17.161235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 10:51:17.163901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result.read() Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch1-master-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 6, 10, 51, 17, 64529), 'updated_at': None, 'host': 'nch1-master-1', 'aggregate_id': 11}] Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:17.165941 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host nch1-master-1. Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:17.173758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host nch1-master-1. Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:17.174841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:17.176516 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host nch1-master-1. Sep 06 10:51:17.176516 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:17.176516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-615ae2f9-bc50-4171-9a45-50b64edadd0d tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Returning 409 to user: Aggregate 11 already has host nch1-master-1. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:17.176516 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-615ae2f9-bc50-4171-9a45-50b64edadd0d tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.140666 Sep 06 10:51:17.176516 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 155/321] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Sep 6 10:51:17 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 06 10:51:17.180434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-afd02066-06c1-4710-ba07-244e4afc28b4 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:17.181178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f5df2a80-4d58-4fa4-a8a0-b6bbad930cc0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:17.190319 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f5df2a80-4d58-4fa4-a8a0-b6bbad930cc0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 200 len: 1584 microversion: 2.1 time: 0.255038 Sep 06 10:51:17.191348 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 167/322] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:16 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 1584 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:17.194470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afd02066-06c1-4710-ba07-244e4afc28b4 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:17.194969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afd02066-06c1-4710-ba07-244e4afc28b4 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:17.195512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afd02066-06c1-4710-ba07-244e4afc28b4 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:17.216986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1918add6-1336-4c9e-bde9-49be9f6909ce tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:17.217484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1918add6-1336-4c9e-bde9-49be9f6909ce tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:17.224481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1918add6-1336-4c9e-bde9-49be9f6909ce tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:17.225702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1918add6-1336-4c9e-bde9-49be9f6909ce tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:17.226187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1918add6-1336-4c9e-bde9-49be9f6909ce tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:17.227357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1918add6-1336-4c9e-bde9-49be9f6909ce tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:17.227824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1918add6-1336-4c9e-bde9-49be9f6909ce tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:17.228250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1918add6-1336-4c9e-bde9-49be9f6909ce tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:17.334435 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1918add6-1336-4c9e-bde9-49be9f6909ce tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123086 Sep 06 10:51:17.336217 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 168/323] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 10:51:17 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:17.343153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-d5dfa754-1f43-4b0b-b8b2-e91386694c3f req-ab77018c-0307-4979-913b-1ad9f55e8e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75159ad8-0c49-4c3d-8baf-70ecad89e29c", "name": "network-vif-plugged", "status": "completed", "tag": "1e855477-40de-441c-9ddb-40fff21e25da"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:17.366988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d5dfa754-1f43-4b0b-b8b2-e91386694c3f req-ab77018c-0307-4979-913b-1ad9f55e8e75 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:17.369977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d5dfa754-1f43-4b0b-b8b2-e91386694c3f req-ab77018c-0307-4979-913b-1ad9f55e8e75 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:17.371581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d5dfa754-1f43-4b0b-b8b2-e91386694c3f req-ab77018c-0307-4979-913b-1ad9f55e8e75 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:17.399538 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d5dfa754-1f43-4b0b-b8b2-e91386694c3f req-ab77018c-0307-4979-913b-1ad9f55e8e75 service nova] Creating event network-vif-plugged:1e855477-40de-441c-9ddb-40fff21e25da for instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c on nch2-master-1 Sep 06 10:51:17.406902 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-d5dfa754-1f43-4b0b-b8b2-e91386694c3f req-ab77018c-0307-4979-913b-1ad9f55e8e75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069148 Sep 06 10:51:17.410081 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 169/324] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:17.585640 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-afd02066-06c1-4710-ba07-244e4afc28b4 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.411063 Sep 06 10:51:17.587313 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 156/325] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Sep 6 10:51:17 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:17.600762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6fdc9fdd-c661-4391-9f79-fc3c19a3706b tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:17.616364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:17.729903 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6fdc9fdd-c661-4391-9f79-fc3c19a3706b tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.120604 Sep 06 10:51:17.735830 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 170/326] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 10:51:17 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:51:17.746232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b6f30955-e241-4e90-afe8-1969be105a2a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1593829199"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:17.751630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.aggregate [None req-b6f30955-e241-4e90-afe8-1969be105a2a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Generated uuid 26360eec-15a5-46b7-947f-b1fed44166a1 for aggregate {{(pid=140875) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:17.801878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-27b146e0-94af-4d0f-a0e8-894761295d5d tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:17.803307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-27b146e0-94af-4d0f-a0e8-894761295d5d tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:17.814905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27b146e0-94af-4d0f-a0e8-894761295d5d tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:17.817746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27b146e0-94af-4d0f-a0e8-894761295d5d tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:17.818973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27b146e0-94af-4d0f-a0e8-894761295d5d tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:17.820006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27b146e0-94af-4d0f-a0e8-894761295d5d tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:17.823493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27b146e0-94af-4d0f-a0e8-894761295d5d tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:17.823883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27b146e0-94af-4d0f-a0e8-894761295d5d tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:17.964852 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b6f30955-e241-4e90-afe8-1969be105a2a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.222770 Sep 06 10:51:17.965896 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 157/327] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:17.995878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-27b146e0-94af-4d0f-a0e8-894761295d5d tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:18.014433 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-27b146e0-94af-4d0f-a0e8-894761295d5d tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1274 microversion: 2.1 time: 0.224988 Sep 06 10:51:18.028239 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 171/328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:17 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1274 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:18.058267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a54b368e-4120-403d-9fca-8e0d300eec05 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:18.062220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a54b368e-4120-403d-9fca-8e0d300eec05 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:18.097663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a54b368e-4120-403d-9fca-8e0d300eec05 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:18.099261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a54b368e-4120-403d-9fca-8e0d300eec05 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:18.102948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a54b368e-4120-403d-9fca-8e0d300eec05 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:18.104783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a54b368e-4120-403d-9fca-8e0d300eec05 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:18.107947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a54b368e-4120-403d-9fca-8e0d300eec05 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:18.108640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a54b368e-4120-403d-9fca-8e0d300eec05 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:18.299971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-16e0ad1d-0b45-474f-ac99-697da0178a4f tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:18.309773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-16e0ad1d-0b45-474f-ac99-697da0178a4f tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'a642f5be336548aea66f2ca1f7213e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7773842cb74c92878a6e62fb2dab36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-16e0ad1d-0b45-474f-ac99-697da0178a4f tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Request method failure captured: Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 39 Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYhn2ufP1GseH2xpYZUF0DNeO-Zi2836L7xB-JN9NrF4KUrnECAROD7ECIQmkEb1sTPQr9wyfxUX2MU4b1wU_0kTmVqgP64sW8yv6kgqmHoNF4Nq0BZxfBP-SA0PcTyLn_tkFvle2SCTzMcvAKNvD3cYFDe345J0GWhoPvl__p2lIU Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 6a7773842cb74c92878a6e62fb2dab36 Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:51:18.313270 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:51:18.314615 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a7773842cb74c92878a6e62fb2dab36"}]}] Sep 06 10:51:18.314615 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:18.314615 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 6a7773842cb74c92878a6e62fb2dab36 Sep 06 10:51:18.314615 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:18.314615 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AggregatesAdminNegativeTestJSON-824923484-project Sep 06 10:51:18.314615 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:18.314615 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:18.314615 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a642f5be336548aea66f2ca1f7213e21 Sep 06 10:51:18.314615 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-824923484-project Sep 06 10:51:18.314615 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:51:18.314615 ncdv-master-1 devstack@n-api.service[140875]: {"add_host": {"host": "nch1-master-1"}} Sep 06 10:51:18.314615 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:18.314615 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '12', 'body': {'add_host': {'host': 'nch1-master-1'}}} Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:18.315342 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 06 10:51:18.316333 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:18.317316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-16e0ad1d-0b45-474f-ac99-697da0178a4f tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:18.317316 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-16e0ad1d-0b45-474f-ac99-697da0178a4f tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.340245 Sep 06 10:51:18.317789 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 158/329] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Sep 6 10:51:17 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 342 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:18.405443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1e2190a6-7667-4fef-afd7-6f6a2d038a0b tempest-QuotaClassesAdmin257Test-1714563801 tempest-QuotaClassesAdmin257Test-1714563801-project-admin] Calling method '.version_select at 0x7f90f8f0e040>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:18.426881 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1e2190a6-7667-4fef-afd7-6f6a2d038a0b tempest-QuotaClassesAdmin257Test-1714563801 tempest-QuotaClassesAdmin257Test-1714563801-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.105828 Sep 06 10:51:18.433661 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 159/330] 10.222.0.20 () {60 vars in 1226 bytes} [Tue Sep 6 10:51:18 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:51:18.439311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-20d19f2a-5962-4d53-b61c-183b1a5b8826 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:18.446594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a54b368e-4120-403d-9fca-8e0d300eec05 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:18.459600 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a54b368e-4120-403d-9fca-8e0d300eec05 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1320 microversion: 2.1 time: 0.414989 Sep 06 10:51:18.460541 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 172/331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:18 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1320 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:18.470213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-588f6c22-c903-480a-86d4-361b8921043e tempest-QuotaClassesAdmin257Test-1714563801 tempest-QuotaClassesAdmin257Test-1714563801-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8da5040>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:18.571950 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-20d19f2a-5962-4d53-b61c-183b1a5b8826 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.142837 Sep 06 10:51:18.582436 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 160/332] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 10:51:18 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:51:18.583318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dfd29493-7531-43ed-8423-1b67db1b2b19 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-526411269"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:18.587298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.aggregate [None req-dfd29493-7531-43ed-8423-1b67db1b2b19 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Generated uuid 2c591d00-bf17-4e81-b64b-7bb90b3e4657 for aggregate {{(pid=140875) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:18.707855 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dfd29493-7531-43ed-8423-1b67db1b2b19 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.128768 Sep 06 10:51:18.712930 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 161/333] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:18.727517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0c64609c-71a6-418a-9e83-b2aff67ffefd tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-275710895"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:18.755528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c64609c-71a6-418a-9e83-b2aff67ffefd tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:18.760074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c64609c-71a6-418a-9e83-b2aff67ffefd tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:18.760959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c64609c-71a6-418a-9e83-b2aff67ffefd tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:18.778796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c64609c-71a6-418a-9e83-b2aff67ffefd tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:18.779474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c64609c-71a6-418a-9e83-b2aff67ffefd tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:18.780289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c64609c-71a6-418a-9e83-b2aff67ffefd tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:18.792758 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-0c64609c-71a6-418a-9e83-b2aff67ffefd tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-275710895 could not be found. Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0c64609c-71a6-418a-9e83-b2aff67ffefd tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Request method failure captured: Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 57 Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYkk8ER6FXQCgi9qs_zWRr-Qgs0GTywS-qTilCLdNSanXp43B_GpqBxkxBllzM-5fg3-aNuc8WvL3Jz63hj_P7noFS3TC7nho6QnyqdxQXiFNbw5GD55EgIj8yHTW4HO7RN3DU4IfMsjkTtrGInbZVi24TwlbQkUi8zgCuNX1d1H1o Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:51:18.797155 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:51:18.798468 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}] Sep 06 10:51:18.798468 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:18.798468 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:18.798468 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:18.798468 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:18.798468 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:18.798468 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:18.798468 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: f219933dab6c4d64ad844f36b545d542 Sep 06 10:51:18.798468 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:18.798468 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:51:18.798468 ncdv-master-1 devstack@n-api.service[140875]: {"add_host": {"host": "tempest-nonexist_host-275710895"}} Sep 06 10:51:18.798468 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:18.798468 ncdv-master-1 devstack@n-api.service[140875]: exception: Compute host tempest-nonexist_host-275710895 could not be found. Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-275710895'}}} Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-275710895' is not mapped to any cell Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:18.799190 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 06 10:51:18.800245 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-275710895 could not be found. Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-275710895 could not be found. Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:18.801331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:18.802428 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:18.802428 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:18.802428 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:18.802428 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:18.802428 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:18.802428 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-275710895 could not be found. Sep 06 10:51:18.802428 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:18.802428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0c64609c-71a6-418a-9e83-b2aff67ffefd tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-275710895 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:18.802428 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0c64609c-71a6-418a-9e83-b2aff67ffefd tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.078758 Sep 06 10:51:18.802428 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 162/334] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Sep 6 10:51:18 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:51:18.814523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9485ba44-9eb3-4c69-ac67-5ca342c962a2 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:18.988553 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9485ba44-9eb3-4c69-ac67-5ca342c962a2 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.180208 Sep 06 10:51:18.990724 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 163/335] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 10:51:18 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:51:19.004750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6a7573a8-2b4c-4a59-a9b1-adf4b2150f06 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6a7573a8-2b4c-4a59-a9b1-adf4b2150f06 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Request method failure captured: Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 283 Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYkk8ER6FXQCgi9qs_zWRr-Qgs0GTywS-qTilCLdNSanXp43B_GpqBxkxBllzM-5fg3-aNuc8WvL3Jz63hj_P7noFS3TC7nho6QnyqdxQXiFNbw5GD55EgIj8yHTW4HO7RN3DU4IfMsjkTtrGInbZVi24TwlbQkUi8zgCuNX1d1H1o Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:51:19.018131 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:51:19.019376 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}] Sep 06 10:51:19.019376 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:19.019376 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:19.019376 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:19.019376 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:19.019376 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:19.019376 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:19.019376 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: f219933dab6c4d64ad844f36b545d542 Sep 06 10:51:19.019376 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:19.019376 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:51:19.020387 ncdv-master-1 devstack@n-api.service[140875]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 06 10:51:19.020387 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:19.020387 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 10:51:19.020387 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 06 10:51:19.020387 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:19.020387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:19.020387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:51:19.020387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:51:19.020387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:51:19.020387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:19.021031 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:19.021912 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:19.022691 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:51:19.022691 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:51:19.022691 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 10:51:19.022691 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.024121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6a7573a8-2b4c-4a59-a9b1-adf4b2150f06 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:19.026195 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6a7573a8-2b4c-4a59-a9b1-adf4b2150f06 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.026979 Sep 06 10:51:19.028523 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 164/336] 10.222.0.20 () {60 vars in 1165 bytes} [Tue Sep 6 10:51:18 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:51:19.044206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a694c20b-d06a-40d1-b5c8-14042bbe795c tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a694c20b-d06a-40d1-b5c8-14042bbe795c tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Request method failure captured: Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 27 Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYkk8ER6FXQCgi9qs_zWRr-Qgs0GTywS-qTilCLdNSanXp43B_GpqBxkxBllzM-5fg3-aNuc8WvL3Jz63hj_P7noFS3TC7nho6QnyqdxQXiFNbw5GD55EgIj8yHTW4HO7RN3DU4IfMsjkTtrGInbZVi24TwlbQkUi8zgCuNX1d1H1o Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:51:19.054717 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:51:19.056038 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}] Sep 06 10:51:19.056038 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:19.056038 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:19.056038 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:19.056038 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:19.056038 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:19.056038 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:19.056038 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: f219933dab6c4d64ad844f36b545d542 Sep 06 10:51:19.056038 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:19.056038 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:51:19.056038 ncdv-master-1 devstack@n-api.service[140875]: {"aggregate": {"name": ""}} Sep 06 10:51:19.056038 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:19.056038 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi '' Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:19.056721 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 06 10:51:19.057879 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.063329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a694c20b-d06a-40d1-b5c8-14042bbe795c tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:19.066144 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a694c20b-d06a-40d1-b5c8-14042bbe795c tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.030792 Sep 06 10:51:19.066945 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 165/337] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:19 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:51:19.079674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dfb2e3a3-f295-478e-958c-66456b3e5b52 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:19.080425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dfb2e3a3-f295-478e-958c-66456b3e5b52 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:19.087104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfb2e3a3-f295-478e-958c-66456b3e5b52 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:19.087670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfb2e3a3-f295-478e-958c-66456b3e5b52 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:19.088183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfb2e3a3-f295-478e-958c-66456b3e5b52 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:19.089073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfb2e3a3-f295-478e-958c-66456b3e5b52 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:19.090311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfb2e3a3-f295-478e-958c-66456b3e5b52 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:19.091078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfb2e3a3-f295-478e-958c-66456b3e5b52 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:19.198399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dfb2e3a3-f295-478e-958c-66456b3e5b52 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:19.233514 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dfb2e3a3-f295-478e-958c-66456b3e5b52 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1272 microversion: 2.1 time: 0.162017 Sep 06 10:51:19.245783 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 166/338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:19 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:19.268696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b38859e2-3e3b-49e5-9793-87bb36616816 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-47107838"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:19.278316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b38859e2-3e3b-49e5-9793-87bb36616816 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'a642f5be336548aea66f2ca1f7213e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7773842cb74c92878a6e62fb2dab36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b38859e2-3e3b-49e5-9793-87bb36616816 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Request method failure captured: Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 58 Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYhn2ufP1GseH2xpYZUF0DNeO-Zi2836L7xB-JN9NrF4KUrnECAROD7ECIQmkEb1sTPQr9wyfxUX2MU4b1wU_0kTmVqgP64sW8yv6kgqmHoNF4Nq0BZxfBP-SA0PcTyLn_tkFvle2SCTzMcvAKNvD3cYFDe345J0GWhoPvl__p2lIU Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 6a7773842cb74c92878a6e62fb2dab36 Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:51:19.280759 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:51:19.282294 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a7773842cb74c92878a6e62fb2dab36"}]}] Sep 06 10:51:19.282294 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:19.282294 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 6a7773842cb74c92878a6e62fb2dab36 Sep 06 10:51:19.282294 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:19.282294 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AggregatesAdminNegativeTestJSON-824923484-project Sep 06 10:51:19.282294 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:19.282294 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:19.282294 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a642f5be336548aea66f2ca1f7213e21 Sep 06 10:51:19.282294 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-824923484-project Sep 06 10:51:19.282294 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:51:19.282294 ncdv-master-1 devstack@n-api.service[140875]: {"aggregate": {"name": "tempest-test_aggregate-47107838"}} Sep 06 10:51:19.282294 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:19.282294 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-47107838'}}} Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:19.283283 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:19.284534 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 06 10:51:19.285809 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.285809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b38859e2-3e3b-49e5-9793-87bb36616816 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:19.285809 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b38859e2-3e3b-49e5-9793-87bb36616816 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.038233 Sep 06 10:51:19.286029 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 167/339] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:19 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:19.299219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3a1a2106-0fbf-4eca-89a5-d1aa8a002571 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1674965725"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:19.303036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.aggregate [None req-3a1a2106-0fbf-4eca-89a5-d1aa8a002571 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Generated uuid 872c080a-cb8e-489f-b19f-6166023f5dfa for aggregate {{(pid=140875) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:19.432533 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3a1a2106-0fbf-4eca-89a5-d1aa8a002571 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.137724 Sep 06 10:51:19.441851 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 168/340] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:19 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:19.444447 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-588f6c22-c903-480a-86d4-361b8921043e tempest-QuotaClassesAdmin257Test-1714563801 tempest-QuotaClassesAdmin257Test-1714563801-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.981811 Sep 06 10:51:19.447784 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 173/341] 10.222.0.20 () {62 vars in 1247 bytes} [Tue Sep 6 10:51:18 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:51:19.449203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a01bd54e-75fa-48d4-a5a3-b22e43ccf167 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1674965725"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:19.454504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.aggregate [None req-a01bd54e-75fa-48d4-a5a3-b22e43ccf167 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Generated uuid b1b751e6-3d20-4970-b715-2a795ed15f2d for aggregate {{(pid=140875) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:19.468243 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-a01bd54e-75fa-48d4-a5a3-b22e43ccf167 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1674965725 already exists. Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a01bd54e-75fa-48d4-a5a3-b22e43ccf167 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Request method failure captured: Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 60 Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYkk8ER6FXQCgi9qs_zWRr-Qgs0GTywS-qTilCLdNSanXp43B_GpqBxkxBllzM-5fg3-aNuc8WvL3Jz63hj_P7noFS3TC7nho6QnyqdxQXiFNbw5GD55EgIj8yHTW4HO7RN3DU4IfMsjkTtrGInbZVi24TwlbQkUi8zgCuNX1d1H1o Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:51:19.470332 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:51:19.471587 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}] Sep 06 10:51:19.471587 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:19.471587 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:19.471587 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:19.471587 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:19.471587 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:19.471587 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:19.471587 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: f219933dab6c4d64ad844f36b545d542 Sep 06 10:51:19.471587 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:19.471587 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:51:19.471587 ncdv-master-1 devstack@n-api.service[140875]: {"aggregate": {"name": "tempest-test_aggregate-1674965725"}} Sep 06 10:51:19.471587 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:19.471587 ncdv-master-1 devstack@n-api.service[140875]: exception: Aggregate tempest-test_aggregate-1674965725 already exists. Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1674965725'}}} Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 06 10:51:19.472434 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1674965725 already exists. Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:19.473459 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 06 10:51:19.474562 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 06 10:51:19.474562 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1674965725 already exists. Sep 06 10:51:19.474562 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.474562 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:19.474562 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.474562 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:19.474562 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:19.474562 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:19.474562 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:19.474562 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:19.474562 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1674965725 already exists. Sep 06 10:51:19.474562 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:19.475254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1b0dd066-1990-43dc-852d-d29c174f44d9 tempest-QuotaClassesAdmin257Test-1714563801 tempest-QuotaClassesAdmin257Test-1714563801-project-admin] Calling method '.version_select at 0x7f90f8ee9ca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:19.477402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a01bd54e-75fa-48d4-a5a3-b22e43ccf167 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1674965725 already exists. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:19.478497 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a01bd54e-75fa-48d4-a5a3-b22e43ccf167 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.035414 Sep 06 10:51:19.479573 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 169/342] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:19 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 37 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:51:19.490409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-af64fe4c-3629-494b-aeb1-92bdec47fc48 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:19.491435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-af64fe4c-3629-494b-aeb1-92bdec47fc48 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:19.498894 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1b0dd066-1990-43dc-852d-d29c174f44d9 tempest-QuotaClassesAdmin257Test-1714563801 tempest-QuotaClassesAdmin257Test-1714563801-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.042307 Sep 06 10:51:19.502696 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 174/343] 10.222.0.20 () {60 vars in 1226 bytes} [Tue Sep 6 10:51:19 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:51:19.508896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af64fe4c-3629-494b-aeb1-92bdec47fc48 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:19.508896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af64fe4c-3629-494b-aeb1-92bdec47fc48 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:19.508896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af64fe4c-3629-494b-aeb1-92bdec47fc48 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:19.508896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af64fe4c-3629-494b-aeb1-92bdec47fc48 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:19.509383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af64fe4c-3629-494b-aeb1-92bdec47fc48 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:19.509383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af64fe4c-3629-494b-aeb1-92bdec47fc48 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:19.509541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f382a0a9-3b44-4f44-8805-10c09dca5eb8 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:19.630874 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f382a0a9-3b44-4f44-8805-10c09dca5eb8 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.126293 Sep 06 10:51:19.632431 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 175/344] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 10:51:19 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:51:19.641795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3c456a9f-4fd6-4f74-90f2-36367fac451b tempest-QuotaClassesAdmin257Test-1714563801 tempest-QuotaClassesAdmin257Test-1714563801-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8d50940>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:20.072790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af64fe4c-3629-494b-aeb1-92bdec47fc48 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:20.083438 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-af64fe4c-3629-494b-aeb1-92bdec47fc48 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1320 microversion: 2.1 time: 0.601283 Sep 06 10:51:20.101441 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 170/345] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:19 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1320 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:20.114359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-334f144b-8c7b-458f-a1e0-f9b8fd44fc5a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-538009474"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:20.119840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.aggregate [None req-334f144b-8c7b-458f-a1e0-f9b8fd44fc5a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Generated uuid 066edd80-4f3a-40c0-8a33-2f945729d0f1 for aggregate {{(pid=140875) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:20.275147 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-334f144b-8c7b-458f-a1e0-f9b8fd44fc5a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.173927 Sep 06 10:51:20.281686 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 171/346] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:20.293093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fc326d44-b49b-46a7-80ee-85a89c39a0dc tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:20.313250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fc326d44-b49b-46a7-80ee-85a89c39a0dc tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:20.334251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc326d44-b49b-46a7-80ee-85a89c39a0dc tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:20.334768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc326d44-b49b-46a7-80ee-85a89c39a0dc tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:20.335317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc326d44-b49b-46a7-80ee-85a89c39a0dc tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:20.338534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc326d44-b49b-46a7-80ee-85a89c39a0dc tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:20.339070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc326d44-b49b-46a7-80ee-85a89c39a0dc tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:20.339793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc326d44-b49b-46a7-80ee-85a89c39a0dc tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:20.479179 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3c456a9f-4fd6-4f74-90f2-36367fac451b tempest-QuotaClassesAdmin257Test-1714563801 tempest-QuotaClassesAdmin257Test-1714563801-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.843662 Sep 06 10:51:20.484003 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 176/347] 10.222.0.20 () {62 vars in 1247 bytes} [Tue Sep 6 10:51:19 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:51:20.496933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-1abe7e7d-dee6-4791-b901-5af3ef0a806a req-86fe7476-01d9-459a-a029-ac7f47b3a0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9007e9-46e7-420d-8c1d-dc40c1c212de", "tag": "36edbd4f-0314-40a6-8427-33258c8c5ddc"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:20.529654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1abe7e7d-dee6-4791-b901-5af3ef0a806a req-86fe7476-01d9-459a-a029-ac7f47b3a0b3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:20.530704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1abe7e7d-dee6-4791-b901-5af3ef0a806a req-86fe7476-01d9-459a-a029-ac7f47b3a0b3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:20.532482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1abe7e7d-dee6-4791-b901-5af3ef0a806a req-86fe7476-01d9-459a-a029-ac7f47b3a0b3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:20.574506 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-1abe7e7d-dee6-4791-b901-5af3ef0a806a req-86fe7476-01d9-459a-a029-ac7f47b3a0b3 service nova] Creating event network-changed:36edbd4f-0314-40a6-8427-33258c8c5ddc for instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de on nch1-master-1 Sep 06 10:51:20.590273 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-1abe7e7d-dee6-4791-b901-5af3ef0a806a req-86fe7476-01d9-459a-a029-ac7f47b3a0b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104751 Sep 06 10:51:20.595572 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 177/348] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:20.611958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6b354d88-359e-4f5b-b811-76927c536006 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:20.615319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6b354d88-359e-4f5b-b811-76927c536006 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:20.639498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b354d88-359e-4f5b-b811-76927c536006 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:20.642532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b354d88-359e-4f5b-b811-76927c536006 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:20.643135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b354d88-359e-4f5b-b811-76927c536006 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:20.648358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b354d88-359e-4f5b-b811-76927c536006 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:20.648358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b354d88-359e-4f5b-b811-76927c536006 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:20.648358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b354d88-359e-4f5b-b811-76927c536006 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:21.003322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fc326d44-b49b-46a7-80ee-85a89c39a0dc tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:21.012112 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fc326d44-b49b-46a7-80ee-85a89c39a0dc tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 200 len: 1584 microversion: 2.1 time: 0.727753 Sep 06 10:51:21.021492 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 172/349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:20 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 1584 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:21.035602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3f8b26ea-d148-4a1d-8b36-a3e50e036885 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:21.037693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3f8b26ea-d148-4a1d-8b36-a3e50e036885 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'a642f5be336548aea66f2ca1f7213e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7773842cb74c92878a6e62fb2dab36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3f8b26ea-d148-4a1d-8b36-a3e50e036885 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Request method failure captured: Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYhn2ufP1GseH2xpYZUF0DNeO-Zi2836L7xB-JN9NrF4KUrnECAROD7ECIQmkEb1sTPQr9wyfxUX2MU4b1wU_0kTmVqgP64sW8yv6kgqmHoNF4Nq0BZxfBP-SA0PcTyLn_tkFvle2SCTzMcvAKNvD3cYFDe345J0GWhoPvl__p2lIU Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 6a7773842cb74c92878a6e62fb2dab36 Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:51:21.039321 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:51:21.040496 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a7773842cb74c92878a6e62fb2dab36"}]}] Sep 06 10:51:21.040496 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:21.040496 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 6a7773842cb74c92878a6e62fb2dab36 Sep 06 10:51:21.040496 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:21.040496 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AggregatesAdminNegativeTestJSON-824923484-project Sep 06 10:51:21.040496 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:21.040496 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:21.040496 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a642f5be336548aea66f2ca1f7213e21 Sep 06 10:51:21.040496 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-824923484-project Sep 06 10:51:21.040496 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:21.040496 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 06 10:51:21.040496 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '15'} Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:21.041148 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.042320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3f8b26ea-d148-4a1d-8b36-a3e50e036885 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:21.048930 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3f8b26ea-d148-4a1d-8b36-a3e50e036885 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.018282 Sep 06 10:51:21.048930 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 173/350] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 10:51:21 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:21.057802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-debd6885-bf52-4ac6-8805-7e762ffa69fe tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:21.186982 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-debd6885-bf52-4ac6-8805-7e762ffa69fe tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.132777 Sep 06 10:51:21.188387 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 174/351] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 10:51:21 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:51:21.196731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cba8fc0e-aee5-45a9-aa50-6bf9965c025c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:21.201625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cba8fc0e-aee5-45a9-aa50-6bf9965c025c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:21.218598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cba8fc0e-aee5-45a9-aa50-6bf9965c025c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:21.235069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cba8fc0e-aee5-45a9-aa50-6bf9965c025c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:21.240128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cba8fc0e-aee5-45a9-aa50-6bf9965c025c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:21.241114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cba8fc0e-aee5-45a9-aa50-6bf9965c025c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:21.241798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cba8fc0e-aee5-45a9-aa50-6bf9965c025c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:21.242425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cba8fc0e-aee5-45a9-aa50-6bf9965c025c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:21.280055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6b354d88-359e-4f5b-b811-76927c536006 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:21.291775 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6b354d88-359e-4f5b-b811-76927c536006 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1314 microversion: 2.1 time: 0.692618 Sep 06 10:51:21.294110 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 178/352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:20 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:21.305449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e839e25d-f0f5-4da9-896a-8f00a0e52f7a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:21.334757 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-e839e25d-f0f5-4da9-896a-8f00a0e52f7a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e839e25d-f0f5-4da9-896a-8f00a0e52f7a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Request method failure captured: Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyYkk8ER6FXQCgi9qs_zWRr-Qgs0GTywS-qTilCLdNSanXp43B_GpqBxkxBllzM-5fg3-aNuc8WvL3Jz63hj_P7noFS3TC7nho6QnyqdxQXiFNbw5GD55EgIj8yHTW4HO7RN3DU4IfMsjkTtrGInbZVi24TwlbQkUi8zgCuNX1d1H1o Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:21.342951 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:21.346371 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}] Sep 06 10:51:21.346371 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:21.346371 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:21.346371 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:21.346371 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:21.346371 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:21.346371 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:21.346371 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: f219933dab6c4d64ad844f36b545d542 Sep 06 10:51:21.346371 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:21.346371 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:21.346371 ncdv-master-1 devstack@n-api.service[140876]: exception: Aggregate -1 could not be found. Sep 06 10:51:21.346371 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '-1'} Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 06 10:51:21.347236 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.348576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:21.349762 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:21.349762 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:21.349762 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:21.349762 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:21.349762 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 06 10:51:21.349762 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.351470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e839e25d-f0f5-4da9-896a-8f00a0e52f7a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:21.352748 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e839e25d-f0f5-4da9-896a-8f00a0e52f7a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.056856 Sep 06 10:51:21.355743 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 179/353] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 10:51:21 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:51:21.367812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-42787515-4797-4149-a440-9d9a5fa14690 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-319637913"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:21.380289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.aggregate [None req-42787515-4797-4149-a440-9d9a5fa14690 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Generated uuid b5f283af-5b1c-4d7d-99af-56113d982c79 for aggregate {{(pid=140876) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:21.525074 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-42787515-4797-4149-a440-9d9a5fa14690 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.163218 Sep 06 10:51:21.525996 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 180/354] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:51:21.538921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f1133ca0-cae2-4769-aed1-666695b38827 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:21.542216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f1133ca0-cae2-4769-aed1-666695b38827 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'a642f5be336548aea66f2ca1f7213e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7773842cb74c92878a6e62fb2dab36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f1133ca0-cae2-4769-aed1-666695b38827 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Request method failure captured: Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyYhn2ufP1GseH2xpYZUF0DNeO-Zi2836L7xB-JN9NrF4KUrnECAROD7ECIQmkEb1sTPQr9wyfxUX2MU4b1wU_0kTmVqgP64sW8yv6kgqmHoNF4Nq0BZxfBP-SA0PcTyLn_tkFvle2SCTzMcvAKNvD3cYFDe345J0GWhoPvl__p2lIU Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 6a7773842cb74c92878a6e62fb2dab36 Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:21.543967 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:21.545678 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a7773842cb74c92878a6e62fb2dab36"}]}] Sep 06 10:51:21.545678 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:21.545678 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 6a7773842cb74c92878a6e62fb2dab36 Sep 06 10:51:21.545678 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:21.545678 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AggregatesAdminNegativeTestJSON-824923484-project Sep 06 10:51:21.545678 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:21.545678 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:21.545678 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: a642f5be336548aea66f2ca1f7213e21 Sep 06 10:51:21.545678 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-824923484-project Sep 06 10:51:21.545678 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:21.545678 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 06 10:51:21.545678 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '16'} Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:21.546333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.548304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f1133ca0-cae2-4769-aed1-666695b38827 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:21.549236 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f1133ca0-cae2-4769-aed1-666695b38827 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.012033 Sep 06 10:51:21.549236 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 181/355] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:51:21 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:51:21.569551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f2d4c320-1d78-4da1-b744-8dab4175dfe0 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:21.709116 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f2d4c320-1d78-4da1-b744-8dab4175dfe0 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.152334 Sep 06 10:51:21.711461 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 182/356] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 10:51:21 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:51:21.724307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-396af513-b3d0-48dc-bc0a-92a3d43ea993 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:21.734191 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-396af513-b3d0-48dc-bc0a-92a3d43ea993 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-396af513-b3d0-48dc-bc0a-92a3d43ea993 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Request method failure captured: Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyYkk8ER6FXQCgi9qs_zWRr-Qgs0GTywS-qTilCLdNSanXp43B_GpqBxkxBllzM-5fg3-aNuc8WvL3Jz63hj_P7noFS3TC7nho6QnyqdxQXiFNbw5GD55EgIj8yHTW4HO7RN3DU4IfMsjkTtrGInbZVi24TwlbQkUi8zgCuNX1d1H1o Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:21.737534 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:21.738748 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}] Sep 06 10:51:21.738748 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:21.738748 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:21.738748 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:21.738748 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:21.738748 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:21.738748 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:21.738748 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: f219933dab6c4d64ad844f36b545d542 Sep 06 10:51:21.738748 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:21.738748 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:21.738748 ncdv-master-1 devstack@n-api.service[140876]: exception: Aggregate -1 could not be found. Sep 06 10:51:21.738748 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '-1'} Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:21.739430 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 06 10:51:21.740626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.742447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-396af513-b3d0-48dc-bc0a-92a3d43ea993 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:21.742447 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-396af513-b3d0-48dc-bc0a-92a3d43ea993 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.023213 Sep 06 10:51:21.742447 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 183/357] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:51:21 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:51:21.751675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8e2ed239-0d05-4c0a-a347-c72123368983 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8e2ed239-0d05-4c0a-a347-c72123368983 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'a642f5be336548aea66f2ca1f7213e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7773842cb74c92878a6e62fb2dab36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8e2ed239-0d05-4c0a-a347-c72123368983 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Request method failure captured: Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyYhn2ufP1GseH2xpYZUF0DNeO-Zi2836L7xB-JN9NrF4KUrnECAROD7ECIQmkEb1sTPQr9wyfxUX2MU4b1wU_0kTmVqgP64sW8yv6kgqmHoNF4Nq0BZxfBP-SA0PcTyLn_tkFvle2SCTzMcvAKNvD3cYFDe345J0GWhoPvl__p2lIU Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 6a7773842cb74c92878a6e62fb2dab36 Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:21.758175 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:21.761124 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a7773842cb74c92878a6e62fb2dab36"}]}] Sep 06 10:51:21.761124 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:21.761124 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 6a7773842cb74c92878a6e62fb2dab36 Sep 06 10:51:21.761124 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:21.761124 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AggregatesAdminNegativeTestJSON-824923484-project Sep 06 10:51:21.761124 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:21.761124 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:21.761124 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: a642f5be336548aea66f2ca1f7213e21 Sep 06 10:51:21.761124 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-824923484-project Sep 06 10:51:21.761124 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:21.761124 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 06 10:51:21.761124 ncdv-master-1 devstack@n-api.service[140876]: action_args: {} Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:21.761960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:21.763472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8e2ed239-0d05-4c0a-a347-c72123368983 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:21.764523 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8e2ed239-0d05-4c0a-a347-c72123368983 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010660 Sep 06 10:51:21.764523 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 184/358] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 10:51:21 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:51:21.770863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-93a3bc9f-d0c8-4250-bc35-25d0d9705949 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-878916830"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:21.778347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.aggregate [None req-93a3bc9f-d0c8-4250-bc35-25d0d9705949 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Generated uuid 592c95e7-1547-4faa-814f-abd0217d8fe8 for aggregate {{(pid=140876) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:21.840070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cba8fc0e-aee5-45a9-aa50-6bf9965c025c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:21.861969 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cba8fc0e-aee5-45a9-aa50-6bf9965c025c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1470 microversion: 2.1 time: 0.672060 Sep 06 10:51:21.862563 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 175/359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:21 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1470 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:21.885383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-465a215c-58c6-44ac-89a3-0e663dd4c2b8 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:21.887907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-465a215c-58c6-44ac-89a3-0e663dd4c2b8 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:21.900781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-465a215c-58c6-44ac-89a3-0e663dd4c2b8 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:21.903472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-465a215c-58c6-44ac-89a3-0e663dd4c2b8 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:21.904706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-465a215c-58c6-44ac-89a3-0e663dd4c2b8 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:21.905637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-465a215c-58c6-44ac-89a3-0e663dd4c2b8 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:21.908740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-465a215c-58c6-44ac-89a3-0e663dd4c2b8 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:21.916913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-465a215c-58c6-44ac-89a3-0e663dd4c2b8 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:21.919548 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-93a3bc9f-d0c8-4250-bc35-25d0d9705949 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.153295 Sep 06 10:51:21.922253 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 185/360] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:21.934975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-51aefe8d-3784-4e44-ab8d-49bc0a08743b tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:21.960120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51aefe8d-3784-4e44-ab8d-49bc0a08743b tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:21.960652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51aefe8d-3784-4e44-ab8d-49bc0a08743b tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:21.961149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51aefe8d-3784-4e44-ab8d-49bc0a08743b tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:22.300361 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-51aefe8d-3784-4e44-ab8d-49bc0a08743b tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.370123 Sep 06 10:51:22.301427 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 186/361] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Sep 6 10:51:21 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:22.335901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-451411ad-5363-4cdf-a318-74b4d9f0d312 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:22.363450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-451411ad-5363-4cdf-a318-74b4d9f0d312 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'a642f5be336548aea66f2ca1f7213e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7773842cb74c92878a6e62fb2dab36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-451411ad-5363-4cdf-a318-74b4d9f0d312 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Request method failure captured: Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 42 Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyYhn2ufP1GseH2xpYZUF0DNeO-Zi2836L7xB-JN9NrF4KUrnECAROD7ECIQmkEb1sTPQr9wyfxUX2MU4b1wU_0kTmVqgP64sW8yv6kgqmHoNF4Nq0BZxfBP-SA0PcTyLn_tkFvle2SCTzMcvAKNvD3cYFDe345J0GWhoPvl__p2lIU Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 6a7773842cb74c92878a6e62fb2dab36 Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:22.371742 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:22.373278 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a7773842cb74c92878a6e62fb2dab36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a7773842cb74c92878a6e62fb2dab36"}]}] Sep 06 10:51:22.373278 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:22.373278 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 6a7773842cb74c92878a6e62fb2dab36 Sep 06 10:51:22.373278 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-824923484 Sep 06 10:51:22.373278 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AggregatesAdminNegativeTestJSON-824923484-project Sep 06 10:51:22.373278 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:22.373278 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:22.373278 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: a642f5be336548aea66f2ca1f7213e21 Sep 06 10:51:22.373278 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-824923484-project Sep 06 10:51:22.373278 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:51:22.373278 ncdv-master-1 devstack@n-api.service[140876]: {"remove_host": {"host": "nch1-master-1"}} Sep 06 10:51:22.373278 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:22.373278 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nch1-master-1'}}} Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:22.373960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 06 10:51:22.374990 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:22.377048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-451411ad-5363-4cdf-a318-74b4d9f0d312 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:22.377048 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-451411ad-5363-4cdf-a318-74b4d9f0d312 tempest-AggregatesAdminNegativeTestJSON-824923484 tempest-AggregatesAdminNegativeTestJSON-824923484-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.066246 Sep 06 10:51:22.378682 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 187/362] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Sep 6 10:51:22 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 70 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:22.394691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-605829d5-ce0a-4eb8-89b9-e658c1617de5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:22.396038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-605829d5-ce0a-4eb8-89b9-e658c1617de5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:22.408115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-605829d5-ce0a-4eb8-89b9-e658c1617de5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:22.411141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-605829d5-ce0a-4eb8-89b9-e658c1617de5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:22.412064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-605829d5-ce0a-4eb8-89b9-e658c1617de5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:22.413850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-605829d5-ce0a-4eb8-89b9-e658c1617de5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:22.414024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-605829d5-ce0a-4eb8-89b9-e658c1617de5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:22.414705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-605829d5-ce0a-4eb8-89b9-e658c1617de5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:22.476655 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-465a215c-58c6-44ac-89a3-0e663dd4c2b8 tempest-DeleteServersAdminTestJSON-1434605112 tempest-DeleteServersAdminTestJSON-1434605112-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c/action" status: 202 len: 0 microversion: 2.1 time: 0.594616 Sep 06 10:51:22.477756 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 176/363] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:51:21 2022] POST /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:51:22.483437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bf63d1a1-060c-4d49-92d4-542029bfbc0a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:22.499886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf63d1a1-060c-4d49-92d4-542029bfbc0a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:22.500977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf63d1a1-060c-4d49-92d4-542029bfbc0a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:22.501697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf63d1a1-060c-4d49-92d4-542029bfbc0a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:22.942550 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bf63d1a1-060c-4d49-92d4-542029bfbc0a tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.463340 Sep 06 10:51:22.943217 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 177/364] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Sep 6 10:51:22 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:22.951855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:22.952482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:22.962767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:22.963459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:22.964106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:22.964993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:22.965611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:22.966204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:23.017723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:23.019757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:23.020370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:23.021360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lazy-loading 'fault' on Instance uuid 75159ad8-0c49-4c3d-8baf-70ecad89e29c {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:51:23.340314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-605829d5-ce0a-4eb8-89b9-e658c1617de5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:23.381875 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-605829d5-ce0a-4eb8-89b9-e658c1617de5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1314 microversion: 2.1 time: 1.000646 Sep 06 10:51:23.390120 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 188/365] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:22 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1314 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:23.395363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2db97313-0bbd-4b12-b996-3585d65d7cce tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:23.408358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=71,nova_api:UPDATE=14,nova_api:INSERT=10 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:23.456687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:23.480535 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-59c4d014-f8f3-41e5-8279-ca09cde2cd10 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1453 microversion: 2.1 time: 0.532689 Sep 06 10:51:23.485532 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2db97313-0bbd-4b12-b996-3585d65d7cce tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.093729 Sep 06 10:51:23.486469 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 189/366] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 10:51:23 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:51:23.496395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e0b36f4-4a3f-4e96-947b-7f92f647b3b0 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1618056863"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:23.500450 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 178/367] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:22 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1453 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:23.503850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.aggregate [None req-5e0b36f4-4a3f-4e96-947b-7f92f647b3b0 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Generated uuid 7afb22a3-759c-410b-b002-3a2c6425eb99 for aggregate {{(pid=140876) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 10:51:23.520867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7914cb3a-83bb-4334-aae8-be51d0970f21 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:23.523139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7914cb3a-83bb-4334-aae8-be51d0970f21 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:23.538841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7914cb3a-83bb-4334-aae8-be51d0970f21 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:23.539596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7914cb3a-83bb-4334-aae8-be51d0970f21 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:23.541660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7914cb3a-83bb-4334-aae8-be51d0970f21 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:23.542419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7914cb3a-83bb-4334-aae8-be51d0970f21 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:23.542887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7914cb3a-83bb-4334-aae8-be51d0970f21 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:23.543351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7914cb3a-83bb-4334-aae8-be51d0970f21 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:23.583881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7914cb3a-83bb-4334-aae8-be51d0970f21 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:51:23.603962 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5e0b36f4-4a3f-4e96-947b-7f92f647b3b0 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.111323 Sep 06 10:51:23.613630 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 190/368] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 10:51:23 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:23.619325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26a876e0-f8fc-4123-9281-1d4d140f423f tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:23.637181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26a876e0-f8fc-4123-9281-1d4d140f423f tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:23.638047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26a876e0-f8fc-4123-9281-1d4d140f423f tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:23.638776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26a876e0-f8fc-4123-9281-1d4d140f423f tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:23.650878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26a876e0-f8fc-4123-9281-1d4d140f423f tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:23.651987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26a876e0-f8fc-4123-9281-1d4d140f423f tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:23.655237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26a876e0-f8fc-4123-9281-1d4d140f423f tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:23.670507 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.compute.aggregates [None req-26a876e0-f8fc-4123-9281-1d4d140f423f tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 06 10:51:23.671491 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-26a876e0-f8fc-4123-9281-1d4d140f423f tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26a876e0-f8fc-4123-9281-1d4d140f423f tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Request method failure captured: Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 42 Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyYkk8ER6FXQCgi9qs_zWRr-Qgs0GTywS-qTilCLdNSanXp43B_GpqBxkxBllzM-5fg3-aNuc8WvL3Jz63hj_P7noFS3TC7nho6QnyqdxQXiFNbw5GD55EgIj8yHTW4HO7RN3DU4IfMsjkTtrGInbZVi24TwlbQkUi8zgCuNX1d1H1o Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:23.674634 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:23.676159 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac962a502cf849bfb744f9c83be6acb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac962a502cf849bfb744f9c83be6acb6"}]}] Sep 06 10:51:23.676159 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:23.676159 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: ac962a502cf849bfb744f9c83be6acb6 Sep 06 10:51:23.676159 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-622909633 Sep 06 10:51:23.676159 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:23.676159 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:23.676159 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:23.676159 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: f219933dab6c4d64ad844f36b545d542 Sep 06 10:51:23.676159 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin Sep 06 10:51:23.676159 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:51:23.676159 ncdv-master-1 devstack@n-api.service[140876]: {"remove_host": {"host": "nonexist_host"}} Sep 06 10:51:23.676159 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:23.676159 ncdv-master-1 devstack@n-api.service[140876]: exception: Cannot remove host nonexist_host in aggregate 18 Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 06 10:51:23.677080 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 06 10:51:23.678414 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:23.681064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:23.683590 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:23.683590 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:23.683590 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:23.683590 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:23.683590 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Sep 06 10:51:23.683590 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:23.688614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26a876e0-f8fc-4123-9281-1d4d140f423f tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:23.689558 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-26a876e0-f8fc-4123-9281-1d4d140f423f tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.074576 Sep 06 10:51:23.694053 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 191/369] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Sep 6 10:51:23 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:51:23.702373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a56361f7-b71f-470f-9cc6-d49a4035dc28 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:23.858553 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a56361f7-b71f-470f-9cc6-d49a4035dc28 tempest-AggregatesAdminNegativeTestJSON-622909633 tempest-AggregatesAdminNegativeTestJSON-622909633-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.160989 Sep 06 10:51:23.864942 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 192/370] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 10:51:23 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 10:51:24.056621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-489f92b3-310e-47a3-b2cb-9dc9fcee00d6 req-70fc1b96-c198-4eab-b442-b62f2d49904c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bee805b-5243-4d62-a2a7-7fcfe7639100", "tag": "85f90eaf-dda4-4abd-bc73-7ce6606dc418"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:24.074542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-489f92b3-310e-47a3-b2cb-9dc9fcee00d6 req-70fc1b96-c198-4eab-b442-b62f2d49904c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:24.077355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-489f92b3-310e-47a3-b2cb-9dc9fcee00d6 req-70fc1b96-c198-4eab-b442-b62f2d49904c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:24.095400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-489f92b3-310e-47a3-b2cb-9dc9fcee00d6 req-70fc1b96-c198-4eab-b442-b62f2d49904c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:24.127323 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-489f92b3-310e-47a3-b2cb-9dc9fcee00d6 req-70fc1b96-c198-4eab-b442-b62f2d49904c service nova] Creating event network-changed:85f90eaf-dda4-4abd-bc73-7ce6606dc418 for instance 0bee805b-5243-4d62-a2a7-7fcfe7639100 on nch1-master-1 Sep 06 10:51:24.140838 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-489f92b3-310e-47a3-b2cb-9dc9fcee00d6 req-70fc1b96-c198-4eab-b442-b62f2d49904c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089786 Sep 06 10:51:24.140838 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 193/371] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:24.237906 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7914cb3a-83bb-4334-aae8-be51d0970f21 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "DELETE /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 204 len: 0 microversion: 2.1 time: 0.729932 Sep 06 10:51:24.240566 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 179/372] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:51:23 2022] DELETE /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 0 bytes in 735 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:51:24.256857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:24.257906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:24.267889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:24.271643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:24.273114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:24.274553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:24.275824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:24.276999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:24.338778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:24.342762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:24.345015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:24.346441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lazy-loading 'fault' on Instance uuid 75159ad8-0c49-4c3d-8baf-70ecad89e29c {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:51:24.415734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aa82b2bc-b604-4068-9201-34de4ad2b2f9 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:24.417117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aa82b2bc-b604-4068-9201-34de4ad2b2f9 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:24.436157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa82b2bc-b604-4068-9201-34de4ad2b2f9 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:24.436680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa82b2bc-b604-4068-9201-34de4ad2b2f9 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:24.438464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa82b2bc-b604-4068-9201-34de4ad2b2f9 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:24.448858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa82b2bc-b604-4068-9201-34de4ad2b2f9 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:24.448858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa82b2bc-b604-4068-9201-34de4ad2b2f9 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:24.448858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa82b2bc-b604-4068-9201-34de4ad2b2f9 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:24.974350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:24.988612 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9c9c4472-3fba-46fd-a3c8-2605a1fa5ff5 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1459 microversion: 2.1 time: 0.735037 Sep 06 10:51:25.003341 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 194/373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:24 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1459 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:25.009506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aa82b2bc-b604-4068-9201-34de4ad2b2f9 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:25.018030 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aa82b2bc-b604-4068-9201-34de4ad2b2f9 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1314 microversion: 2.1 time: 0.610009 Sep 06 10:51:25.021461 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 180/374] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:24 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:26.017714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:26.018343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:26.036632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:26.037447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:26.039698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:26.042805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:26.043554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:26.044200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:26.048405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1de7ddc7-7a81-4653-a4e4-c05f62066e91 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:26.049556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1de7ddc7-7a81-4653-a4e4-c05f62066e91 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:26.056583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de7ddc7-7a81-4653-a4e4-c05f62066e91 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:26.057265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de7ddc7-7a81-4653-a4e4-c05f62066e91 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:26.057869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de7ddc7-7a81-4653-a4e4-c05f62066e91 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:26.058754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de7ddc7-7a81-4653-a4e4-c05f62066e91 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:26.059416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de7ddc7-7a81-4653-a4e4-c05f62066e91 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:26.060089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de7ddc7-7a81-4653-a4e4-c05f62066e91 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:26.118180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:26.124021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:26.125610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:26.126285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lazy-loading 'fault' on Instance uuid 75159ad8-0c49-4c3d-8baf-70ecad89e29c {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:51:26.822135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:26.843601 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fa5762f7-4054-4492-a6b1-891df385f5a3 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1459 microversion: 2.1 time: 0.831568 Sep 06 10:51:26.847466 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 195/375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:26 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1459 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:26.984701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1de7ddc7-7a81-4653-a4e4-c05f62066e91 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:27.001899 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1de7ddc7-7a81-4653-a4e4-c05f62066e91 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1314 microversion: 2.1 time: 0.952023 Sep 06 10:51:27.015100 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 181/376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:26 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1314 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:51:27.876605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:27.884507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:27.916008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:27.919696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:27.934477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:27.938752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:27.939582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:27.945365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:28.014002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:28.014637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:28.015402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:28.015972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lazy-loading 'fault' on Instance uuid 75159ad8-0c49-4c3d-8baf-70ecad89e29c {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:51:28.028083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6acd3bf9-a62e-4c2b-aafd-f3f08df78122 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:28.029679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6acd3bf9-a62e-4c2b-aafd-f3f08df78122 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:28.048812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6acd3bf9-a62e-4c2b-aafd-f3f08df78122 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:28.049337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6acd3bf9-a62e-4c2b-aafd-f3f08df78122 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:28.049790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6acd3bf9-a62e-4c2b-aafd-f3f08df78122 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:28.050520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6acd3bf9-a62e-4c2b-aafd-f3f08df78122 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:28.063657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6acd3bf9-a62e-4c2b-aafd-f3f08df78122 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:28.064297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6acd3bf9-a62e-4c2b-aafd-f3f08df78122 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:28.423389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=20 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:28.459600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:28.470304 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-19123092-0a2f-477d-a05a-e50861c041ce tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1417 microversion: 2.1 time: 0.598423 Sep 06 10:51:28.480871 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 196/377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:27 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1417 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:28.502087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-cbc830fd-dec7-4cc5-ae9d-a19c8a5ac0ca req-01ca62c2-6ff5-4cdf-a4df-de060e81e3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75159ad8-0c49-4c3d-8baf-70ecad89e29c", "name": "network-vif-deleted", "tag": "1e855477-40de-441c-9ddb-40fff21e25da"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:28.535669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cbc830fd-dec7-4cc5-ae9d-a19c8a5ac0ca req-01ca62c2-6ff5-4cdf-a4df-de060e81e3ea service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:28.536313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cbc830fd-dec7-4cc5-ae9d-a19c8a5ac0ca req-01ca62c2-6ff5-4cdf-a4df-de060e81e3ea service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:28.538090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cbc830fd-dec7-4cc5-ae9d-a19c8a5ac0ca req-01ca62c2-6ff5-4cdf-a4df-de060e81e3ea service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:28.565355 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-cbc830fd-dec7-4cc5-ae9d-a19c8a5ac0ca req-01ca62c2-6ff5-4cdf-a4df-de060e81e3ea service nova] Creating event network-vif-deleted:1e855477-40de-441c-9ddb-40fff21e25da for instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c on nch2-master-1 Sep 06 10:51:28.585822 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-cbc830fd-dec7-4cc5-ae9d-a19c8a5ac0ca req-01ca62c2-6ff5-4cdf-a4df-de060e81e3ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101295 Sep 06 10:51:28.598005 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 197/378] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:28.776676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:28.899230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6acd3bf9-a62e-4c2b-aafd-f3f08df78122 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:28.901831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:28.917794 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6acd3bf9-a62e-4c2b-aafd-f3f08df78122 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1314 microversion: 2.1 time: 0.896231 Sep 06 10:51:28.944613 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 182/379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:28 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1314 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:29.512998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:29.514331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:29.528513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:29.529567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:29.530972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:29.536641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:29.537148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:29.537599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:29.616122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:29.617186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:29.617827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:29.618452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lazy-loading 'fault' on Instance uuid 75159ad8-0c49-4c3d-8baf-70ecad89e29c {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:51:29.801227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff6ad8e78ca4b6dbea50007a5737f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f141429ddf044e1812ea5e3dbecd995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:29.812419 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-59b85407-0214-49ad-84f9-61761ec63e9c tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 200 len: 1310 microversion: 2.1 time: 0.310572 Sep 06 10:51:29.819572 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 198/380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:29 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 1310 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:29.953878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-42087d54-0d45-40ee-a0e1-7ebb7b052af0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:29.955434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-42087d54-0d45-40ee-a0e1-7ebb7b052af0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:29.975171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42087d54-0d45-40ee-a0e1-7ebb7b052af0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:29.982868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42087d54-0d45-40ee-a0e1-7ebb7b052af0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:29.982868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42087d54-0d45-40ee-a0e1-7ebb7b052af0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:29.982868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42087d54-0d45-40ee-a0e1-7ebb7b052af0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:29.985165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42087d54-0d45-40ee-a0e1-7ebb7b052af0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:29.986357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42087d54-0d45-40ee-a0e1-7ebb7b052af0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:30.688360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-42087d54-0d45-40ee-a0e1-7ebb7b052af0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:30.699479 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-42087d54-0d45-40ee-a0e1-7ebb7b052af0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1314 microversion: 2.1 time: 0.753292 Sep 06 10:51:30.703087 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 183/381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:29 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:30.836596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b42ce223-f271-46f2-9457-d5bf20a84391 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:30.837452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b42ce223-f271-46f2-9457-d5bf20a84391 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:30.840070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=55,nova_cell0:UPDATE=7 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:30.852348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b42ce223-f271-46f2-9457-d5bf20a84391 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:30.854466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b42ce223-f271-46f2-9457-d5bf20a84391 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:30.855037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b42ce223-f271-46f2-9457-d5bf20a84391 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:30.857047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b42ce223-f271-46f2-9457-d5bf20a84391 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:30.858991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b42ce223-f271-46f2-9457-d5bf20a84391 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:30.864733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b42ce223-f271-46f2-9457-d5bf20a84391 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:30.900541 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-b42ce223-f271-46f2-9457-d5bf20a84391 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] HTTP exception thrown: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b42ce223-f271-46f2-9457-d5bf20a84391 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Request method failure captured: Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c HTTP/1.1 Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyXoXwgM3ATy6aZm-B9Ip6Ep2zFYB_9cxVRqt_R6hD_nr4VBECswwr9AGIzS2LE0EZe6Zs4UfxuwU9Mi73Azy1qRQIXzXZGgEdNFg963fTKBQ-95DxL0BMkESWANZT-cQcxJHORUcJxKv_Akw6pon_vuRABHM5_T4axhmFeqFevNIsg Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 8f141429ddf044e1812ea5e3dbecd995 Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:30.902398 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:30.904474 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f141429ddf044e1812ea5e3dbecd995"}]}] Sep 06 10:51:30.904474 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:30.904474 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 8f141429ddf044e1812ea5e3dbecd995 Sep 06 10:51:30.904474 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:30.904474 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-DeleteServersAdminTestJSON-534077102-project Sep 06 10:51:30.904474 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:30.904474 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:30.904474 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3ff6ad8e78ca4b6dbea50007a5737f5e Sep 06 10:51:30.904474 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-DeleteServersAdminTestJSON-534077102-project Sep 06 10:51:30.904474 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:30.904474 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:30.904474 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '75159ad8-0c49-4c3d-8baf-70ecad89e29c'} Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:30.905371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:30.920309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:30.921456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b42ce223-f271-46f2-9457-d5bf20a84391 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Returning 404 to user: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:30.921456 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b42ce223-f271-46f2-9457-d5bf20a84391 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 404 len: 111 microversion: 2.1 time: 0.074347 Sep 06 10:51:30.921456 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 199/382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:30 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:30.923264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-384fa315-779c-4d61-a174-50e81f38b4c4 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:30.923264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-384fa315-779c-4d61-a174-50e81f38b4c4 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:30.932505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-384fa315-779c-4d61-a174-50e81f38b4c4 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:30.935644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-384fa315-779c-4d61-a174-50e81f38b4c4 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:30.936377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-384fa315-779c-4d61-a174-50e81f38b4c4 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:30.940393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-384fa315-779c-4d61-a174-50e81f38b4c4 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:30.941374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-384fa315-779c-4d61-a174-50e81f38b4c4 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:30.941942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-384fa315-779c-4d61-a174-50e81f38b4c4 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:30.974648 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-384fa315-779c-4d61-a174-50e81f38b4c4 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] HTTP exception thrown: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-384fa315-779c-4d61-a174-50e81f38b4c4 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Request method failure captured: Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c HTTP/1.1 Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyXoXwgM3ATy6aZm-B9Ip6Ep2zFYB_9cxVRqt_R6hD_nr4VBECswwr9AGIzS2LE0EZe6Zs4UfxuwU9Mi73Azy1qRQIXzXZGgEdNFg963fTKBQ-95DxL0BMkESWANZT-cQcxJHORUcJxKv_Akw6pon_vuRABHM5_T4axhmFeqFevNIsg Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 8f141429ddf044e1812ea5e3dbecd995 Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:51:30.982426 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:51:30.983944 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f141429ddf044e1812ea5e3dbecd995"}]}] Sep 06 10:51:30.983944 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:30.983944 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 8f141429ddf044e1812ea5e3dbecd995 Sep 06 10:51:30.983944 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:30.983944 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersAdminTestJSON-534077102-project Sep 06 10:51:30.983944 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:30.983944 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:30.983944 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3ff6ad8e78ca4b6dbea50007a5737f5e Sep 06 10:51:30.983944 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersAdminTestJSON-534077102-project Sep 06 10:51:30.983944 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:30.983944 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:30.983944 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '75159ad8-0c49-4c3d-8baf-70ecad89e29c'} Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:30.984899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:30.986340 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:30.988044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-384fa315-779c-4d61-a174-50e81f38b4c4 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Returning 404 to user: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:30.992441 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-384fa315-779c-4d61-a174-50e81f38b4c4 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "DELETE /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 404 len: 111 microversion: 2.1 time: 0.071000 Sep 06 10:51:30.993108 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 184/383] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:51:30 2022] DELETE /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:31.001996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0221f246-91fb-49ed-be8b-d7cce4a42eef tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:31.002773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0221f246-91fb-49ed-be8b-d7cce4a42eef tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: 75159ad8-0c49-4c3d-8baf-70ecad89e29c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:31.009018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0221f246-91fb-49ed-be8b-d7cce4a42eef tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:31.009505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0221f246-91fb-49ed-be8b-d7cce4a42eef tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:31.027858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0221f246-91fb-49ed-be8b-d7cce4a42eef tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:31.029049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0221f246-91fb-49ed-be8b-d7cce4a42eef tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:31.030857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0221f246-91fb-49ed-be8b-d7cce4a42eef tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:31.033000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0221f246-91fb-49ed-be8b-d7cce4a42eef tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:31.085708 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-0221f246-91fb-49ed-be8b-d7cce4a42eef tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] HTTP exception thrown: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0221f246-91fb-49ed-be8b-d7cce4a42eef tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Request method failure captured: Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c HTTP/1.1 Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyXoXwgM3ATy6aZm-B9Ip6Ep2zFYB_9cxVRqt_R6hD_nr4VBECswwr9AGIzS2LE0EZe6Zs4UfxuwU9Mi73Azy1qRQIXzXZGgEdNFg963fTKBQ-95DxL0BMkESWANZT-cQcxJHORUcJxKv_Akw6pon_vuRABHM5_T4axhmFeqFevNIsg Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 8f141429ddf044e1812ea5e3dbecd995 Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:31.091964 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:31.093384 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f141429ddf044e1812ea5e3dbecd995"}]}] Sep 06 10:51:31.093384 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:31.093384 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 8f141429ddf044e1812ea5e3dbecd995 Sep 06 10:51:31.093384 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:31.093384 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-DeleteServersAdminTestJSON-534077102-project Sep 06 10:51:31.093384 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:31.093384 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:31.093384 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3ff6ad8e78ca4b6dbea50007a5737f5e Sep 06 10:51:31.093384 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-DeleteServersAdminTestJSON-534077102-project Sep 06 10:51:31.093384 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:31.093384 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:31.093384 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '75159ad8-0c49-4c3d-8baf-70ecad89e29c'} Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:31.094234 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. Sep 06 10:51:31.095343 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.097605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0221f246-91fb-49ed-be8b-d7cce4a42eef tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Returning 404 to user: Instance 75159ad8-0c49-4c3d-8baf-70ecad89e29c could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:31.099510 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0221f246-91fb-49ed-be8b-d7cce4a42eef tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c" status: 404 len: 111 microversion: 2.1 time: 0.094751 Sep 06 10:51:31.103408 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 200/384] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:30 2022] GET /compute/v2.1/servers/75159ad8-0c49-4c3d-8baf-70ecad89e29c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:31.110436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2d6608ba-24a2-446a-b4f8-8ef1f67cdb75 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:31.110939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2d6608ba-24a2-446a-b4f8-8ef1f67cdb75 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:31.125202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d6608ba-24a2-446a-b4f8-8ef1f67cdb75 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:31.125712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d6608ba-24a2-446a-b4f8-8ef1f67cdb75 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:31.126156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d6608ba-24a2-446a-b4f8-8ef1f67cdb75 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:31.126876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d6608ba-24a2-446a-b4f8-8ef1f67cdb75 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:31.127357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d6608ba-24a2-446a-b4f8-8ef1f67cdb75 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:31.128273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d6608ba-24a2-446a-b4f8-8ef1f67cdb75 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:31.163970 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-2d6608ba-24a2-446a-b4f8-8ef1f67cdb75 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] HTTP exception thrown: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2d6608ba-24a2-446a-b4f8-8ef1f67cdb75 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Request method failure captured: Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d HTTP/1.1 Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyXoXwgM3ATy6aZm-B9Ip6Ep2zFYB_9cxVRqt_R6hD_nr4VBECswwr9AGIzS2LE0EZe6Zs4UfxuwU9Mi73Azy1qRQIXzXZGgEdNFg963fTKBQ-95DxL0BMkESWANZT-cQcxJHORUcJxKv_Akw6pon_vuRABHM5_T4axhmFeqFevNIsg Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 8f141429ddf044e1812ea5e3dbecd995 Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:51:31.165709 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:51:31.166914 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f141429ddf044e1812ea5e3dbecd995"}]}] Sep 06 10:51:31.166914 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:31.166914 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 8f141429ddf044e1812ea5e3dbecd995 Sep 06 10:51:31.166914 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:31.166914 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersAdminTestJSON-534077102-project Sep 06 10:51:31.166914 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:31.166914 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:31.166914 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3ff6ad8e78ca4b6dbea50007a5737f5e Sep 06 10:51:31.166914 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersAdminTestJSON-534077102-project Sep 06 10:51:31.166914 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:31.166914 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:51:31.166914 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'ae98d37d-ffd5-4db1-87d9-4e70a654845d'} Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:31.167726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:51:31.168839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.170468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2d6608ba-24a2-446a-b4f8-8ef1f67cdb75 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Returning 404 to user: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:31.170468 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2d6608ba-24a2-446a-b4f8-8ef1f67cdb75 tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 404 len: 111 microversion: 2.1 time: 0.060595 Sep 06 10:51:31.170468 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 185/385] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:51:31 2022] DELETE /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:31.178476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8262df49-bca5-4643-9eb2-317fbc2b525d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:31.179131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8262df49-bca5-4643-9eb2-317fbc2b525d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] [instance: ae98d37d-ffd5-4db1-87d9-4e70a654845d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:31.193737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8262df49-bca5-4643-9eb2-317fbc2b525d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:31.194603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8262df49-bca5-4643-9eb2-317fbc2b525d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:31.195459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8262df49-bca5-4643-9eb2-317fbc2b525d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:31.198070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8262df49-bca5-4643-9eb2-317fbc2b525d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:31.198698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8262df49-bca5-4643-9eb2-317fbc2b525d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:31.201007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8262df49-bca5-4643-9eb2-317fbc2b525d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:31.230464 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-8262df49-bca5-4643-9eb2-317fbc2b525d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] HTTP exception thrown: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8262df49-bca5-4643-9eb2-317fbc2b525d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Request method failure captured: Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d HTTP/1.1 Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyXoXwgM3ATy6aZm-B9Ip6Ep2zFYB_9cxVRqt_R6hD_nr4VBECswwr9AGIzS2LE0EZe6Zs4UfxuwU9Mi73Azy1qRQIXzXZGgEdNFg963fTKBQ-95DxL0BMkESWANZT-cQcxJHORUcJxKv_Akw6pon_vuRABHM5_T4axhmFeqFevNIsg Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 8f141429ddf044e1812ea5e3dbecd995 Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:51:31.233713 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:51:31.235598 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f141429ddf044e1812ea5e3dbecd995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f141429ddf044e1812ea5e3dbecd995"}]}] Sep 06 10:51:31.235598 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:31.235598 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 8f141429ddf044e1812ea5e3dbecd995 Sep 06 10:51:31.235598 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-534077102 Sep 06 10:51:31.235598 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersAdminTestJSON-534077102-project Sep 06 10:51:31.235598 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:31.235598 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:31.235598 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3ff6ad8e78ca4b6dbea50007a5737f5e Sep 06 10:51:31.235598 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersAdminTestJSON-534077102-project Sep 06 10:51:31.235598 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:51:31.235598 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:51:31.235598 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'ae98d37d-ffd5-4db1-87d9-4e70a654845d'} Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:31.236367 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. Sep 06 10:51:31.237441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:31.238379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8262df49-bca5-4643-9eb2-317fbc2b525d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] Returning 404 to user: Instance ae98d37d-ffd5-4db1-87d9-4e70a654845d could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:31.238379 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8262df49-bca5-4643-9eb2-317fbc2b525d tempest-DeleteServersAdminTestJSON-534077102 tempest-DeleteServersAdminTestJSON-534077102-project] 10.222.0.20 "GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d" status: 404 len: 111 microversion: 2.1 time: 0.062892 Sep 06 10:51:31.238379 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 186/386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:31 2022] GET /compute/v2.1/servers/ae98d37d-ffd5-4db1-87d9-4e70a654845d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:51:31.649245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e065a63b-6982-4297-9587-3b3cf148c23e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8d50940>, body: {"quota_set": {"ram": "5120"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:31.722838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8978c469-2049-48eb-b26c-8e6e5771788c tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:31.723493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8978c469-2049-48eb-b26c-8e6e5771788c tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:31.726929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:31.735610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8978c469-2049-48eb-b26c-8e6e5771788c tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:31.736058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8978c469-2049-48eb-b26c-8e6e5771788c tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:31.736516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8978c469-2049-48eb-b26c-8e6e5771788c tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:31.737262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8978c469-2049-48eb-b26c-8e6e5771788c tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:31.737726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8978c469-2049-48eb-b26c-8e6e5771788c tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:31.738160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8978c469-2049-48eb-b26c-8e6e5771788c tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:31.975428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8978c469-2049-48eb-b26c-8e6e5771788c tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:31.985178 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8978c469-2049-48eb-b26c-8e6e5771788c tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1314 microversion: 2.1 time: 0.266660 Sep 06 10:51:31.986004 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 187/387] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:31 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:51:32.834350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e065a63b-6982-4297-9587-3b3cf148c23e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:32.836022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e065a63b-6982-4297-9587-3b3cf148c23e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:32.836680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e065a63b-6982-4297-9587-3b3cf148c23e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:32.837668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e065a63b-6982-4297-9587-3b3cf148c23e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:32.839473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e065a63b-6982-4297-9587-3b3cf148c23e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:32.840593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e065a63b-6982-4297-9587-3b3cf148c23e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:33.010972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-45221074-0b14-4a66-b98c-880b8cc3bcdc tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:33.011611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-45221074-0b14-4a66-b98c-880b8cc3bcdc tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:33.019046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45221074-0b14-4a66-b98c-880b8cc3bcdc tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:33.027771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45221074-0b14-4a66-b98c-880b8cc3bcdc tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:33.028469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45221074-0b14-4a66-b98c-880b8cc3bcdc tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:33.029948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45221074-0b14-4a66-b98c-880b8cc3bcdc tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:33.031582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45221074-0b14-4a66-b98c-880b8cc3bcdc tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:33.033657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45221074-0b14-4a66-b98c-880b8cc3bcdc tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:33.153210 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e065a63b-6982-4297-9587-3b3cf148c23e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/7c0e46bde29145e0849ca2f92c145654" status: 200 len: 240 microversion: 2.36 time: 2.015918 Sep 06 10:51:33.156424 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 201/388] 10.222.0.20 () {62 vars in 1303 bytes} [Tue Sep 6 10:51:31 2022] PUT /compute/v2.1/os-quota-sets/7c0e46bde29145e0849ca2f92c145654 => generated 240 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:51:33.174925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8aadf5f4-271a-475b-9947-b47c8fc7a3a4 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Calling method '.version_select at 0x7f90f8da5b80>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:33.459089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-45221074-0b14-4a66-b98c-880b8cc3bcdc tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:33.471986 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-45221074-0b14-4a66-b98c-880b8cc3bcdc tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1314 microversion: 2.1 time: 0.463850 Sep 06 10:51:33.487073 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 188/389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:33 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:51:33.487073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-968ddee0-31e0-4b69-bc65-c4bb3e792c0f req-5d8bf598-5fa4-430c-957b-5399e84a0243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bee805b-5243-4d62-a2a7-7fcfe7639100", "name": "network-vif-plugged", "status": "completed", "tag": "85f90eaf-dda4-4abd-bc73-7ce6606dc418"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:33.504632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-968ddee0-31e0-4b69-bc65-c4bb3e792c0f req-5d8bf598-5fa4-430c-957b-5399e84a0243 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:33.507058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-968ddee0-31e0-4b69-bc65-c4bb3e792c0f req-5d8bf598-5fa4-430c-957b-5399e84a0243 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:33.507768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-968ddee0-31e0-4b69-bc65-c4bb3e792c0f req-5d8bf598-5fa4-430c-957b-5399e84a0243 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:33.531228 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-968ddee0-31e0-4b69-bc65-c4bb3e792c0f req-5d8bf598-5fa4-430c-957b-5399e84a0243 service nova] Creating event network-vif-plugged:85f90eaf-dda4-4abd-bc73-7ce6606dc418 for instance 0bee805b-5243-4d62-a2a7-7fcfe7639100 on nch1-master-1 Sep 06 10:51:33.549737 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-968ddee0-31e0-4b69-bc65-c4bb3e792c0f req-5d8bf598-5fa4-430c-957b-5399e84a0243 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070701 Sep 06 10:51:33.550991 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 189/390] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:34.280424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aadf5f4-271a-475b-9947-b47c8fc7a3a4 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:34.284387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aadf5f4-271a-475b-9947-b47c8fc7a3a4 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:34.295749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aadf5f4-271a-475b-9947-b47c8fc7a3a4 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:34.300741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aadf5f4-271a-475b-9947-b47c8fc7a3a4 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:34.301310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aadf5f4-271a-475b-9947-b47c8fc7a3a4 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:34.301759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aadf5f4-271a-475b-9947-b47c8fc7a3a4 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:34.359521 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8aadf5f4-271a-475b-9947-b47c8fc7a3a4 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/7c0e46bde29145e0849ca2f92c145654/detail" status: 200 len: 672 microversion: 2.36 time: 1.195731 Sep 06 10:51:34.363366 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 202/391] 10.222.0.20 () {60 vars in 1304 bytes} [Tue Sep 6 10:51:33 2022] GET /compute/v2.1/os-quota-sets/7c0e46bde29145e0849ca2f92c145654/detail => generated 672 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:51:34.503605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-db7e2044-543b-408c-bc6d-ed330227e4ed tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:34.505202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-db7e2044-543b-408c-bc6d-ed330227e4ed tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:34.521269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db7e2044-543b-408c-bc6d-ed330227e4ed tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:34.521819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db7e2044-543b-408c-bc6d-ed330227e4ed tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:34.526746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db7e2044-543b-408c-bc6d-ed330227e4ed tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:34.526746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db7e2044-543b-408c-bc6d-ed330227e4ed tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:34.528233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db7e2044-543b-408c-bc6d-ed330227e4ed tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:34.528707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db7e2044-543b-408c-bc6d-ed330227e4ed tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:34.893203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-db7e2044-543b-408c-bc6d-ed330227e4ed tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:34.910939 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-db7e2044-543b-408c-bc6d-ed330227e4ed tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1314 microversion: 2.1 time: 0.413120 Sep 06 10:51:34.913199 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 190/392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:34 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:35.943461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8fe42af4-bfda-4177-afab-e2251b6b0394 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:35.943461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8fe42af4-bfda-4177-afab-e2251b6b0394 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:35.955200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fe42af4-bfda-4177-afab-e2251b6b0394 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:35.955844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fe42af4-bfda-4177-afab-e2251b6b0394 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:35.956618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fe42af4-bfda-4177-afab-e2251b6b0394 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:35.958878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fe42af4-bfda-4177-afab-e2251b6b0394 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:35.960227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fe42af4-bfda-4177-afab-e2251b6b0394 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:35.962180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fe42af4-bfda-4177-afab-e2251b6b0394 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:36.307465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8e9f940>, body: {"quota_set": {"ram": "2048"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:36.547205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8fe42af4-bfda-4177-afab-e2251b6b0394 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:36.557331 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8fe42af4-bfda-4177-afab-e2251b6b0394 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1463 microversion: 2.1 time: 0.621494 Sep 06 10:51:36.558338 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 203/393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:35 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1463 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:37.033530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:37.034409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:37.035495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:37.039645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:37.054110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:37.064849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:37.065333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-08aba18e-a9f3-4940-99bb-e154d78566bd tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Calling method '.version_select at 0x7f90f8d90790>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:37.100566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08aba18e-a9f3-4940-99bb-e154d78566bd tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:37.108118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08aba18e-a9f3-4940-99bb-e154d78566bd tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:37.108810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08aba18e-a9f3-4940-99bb-e154d78566bd tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:37.183731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08aba18e-a9f3-4940-99bb-e154d78566bd tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:37.184223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08aba18e-a9f3-4940-99bb-e154d78566bd tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:37.184665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08aba18e-a9f3-4940-99bb-e154d78566bd tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:37.200310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:37.220393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:37.229182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:37.229182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:37.229182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:37.229182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:37.229746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:37.236498 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-08aba18e-a9f3-4940-99bb-e154d78566bd tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/752e7bf666fb4d7a8a997af85d508dd6?start=2022-09-05T10%3A51%3A36.576405&end=2022-09-07T10%3A51%3A36.576405" status: 200 len: 691 microversion: 2.1 time: 0.656174 Sep 06 10:51:37.255156 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 204/394] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Sep 6 10:51:36 2022] GET /compute/v2.1/os-simple-tenant-usage/752e7bf666fb4d7a8a997af85d508dd6?start=2022-09-05T10%3A51%3A36.576405&end=2022-09-07T10%3A51%3A36.576405 => generated 691 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:37.440139 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9a4feded-5cc5-4525-a7d6-d5aa3ebe20ac tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/7c0e46bde29145e0849ca2f92c145654?user_id=1679d253bef444b79349f9fb993f6414" status: 200 len: 240 microversion: 2.36 time: 1.136260 Sep 06 10:51:37.447066 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 191/395] 10.222.0.20 () {62 vars in 1384 bytes} [Tue Sep 6 10:51:36 2022] PUT /compute/v2.1/os-quota-sets/7c0e46bde29145e0849ca2f92c145654?user_id=1679d253bef444b79349f9fb993f6414 => generated 240 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:51:37.455049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f68b5871-6ed3-4de0-a362-5fb9cab66156 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '.version_select at 0x7f90f8f1a700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:37.466391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f68b5871-6ed3-4de0-a362-5fb9cab66156 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:37.467419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f68b5871-6ed3-4de0-a362-5fb9cab66156 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:37.467872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f68b5871-6ed3-4de0-a362-5fb9cab66156 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:37.503916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f68b5871-6ed3-4de0-a362-5fb9cab66156 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:37.504740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f68b5871-6ed3-4de0-a362-5fb9cab66156 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:37.505528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f68b5871-6ed3-4de0-a362-5fb9cab66156 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:37.532784 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f68b5871-6ed3-4de0-a362-5fb9cab66156 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/752e7bf666fb4d7a8a997af85d508dd6?start=2022-09-05T10%3A51%3A36.576405&end=2022-09-07T10%3A51%3A36.576405" status: 200 len: 651 microversion: 2.1 time: 0.090223 Sep 06 10:51:37.533822 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 192/396] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Sep 6 10:51:37 2022] GET /compute/v2.1/os-simple-tenant-usage/752e7bf666fb4d7a8a997af85d508dd6?start=2022-09-05T10%3A51%3A36.576405&end=2022-09-07T10%3A51%3A36.576405 => generated 651 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:37.541683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b765189c-30db-4fdf-99e9-f8c10ec12375 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Calling method '.version_select at 0x7f90f8e12dc0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:37.738600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d4b6b8b0-8c4c-486f-9277-8ad47a6ed72e tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Calling method '.version_select at 0x7f90f8d170d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:37.743153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4b6b8b0-8c4c-486f-9277-8ad47a6ed72e tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:37.743660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4b6b8b0-8c4c-486f-9277-8ad47a6ed72e tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:37.744102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4b6b8b0-8c4c-486f-9277-8ad47a6ed72e tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:37.744845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4b6b8b0-8c4c-486f-9277-8ad47a6ed72e tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:37.745301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4b6b8b0-8c4c-486f-9277-8ad47a6ed72e tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:37.745736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4b6b8b0-8c4c-486f-9277-8ad47a6ed72e tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:37.813556 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d4b6b8b0-8c4c-486f-9277-8ad47a6ed72e tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.556945 Sep 06 10:51:37.816575 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 205/397] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Sep 6 10:51:37 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:37.830925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bcd163c7-c5b2-4ace-aa66-bbaff5afb607 tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Calling method '.version_select at 0x7f90f8d50820>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:37.859440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd163c7-c5b2-4ace-aa66-bbaff5afb607 tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:37.874240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd163c7-c5b2-4ace-aa66-bbaff5afb607 tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:37.874827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd163c7-c5b2-4ace-aa66-bbaff5afb607 tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:37.894654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd163c7-c5b2-4ace-aa66-bbaff5afb607 tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:37.895185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd163c7-c5b2-4ace-aa66-bbaff5afb607 tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:37.895651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd163c7-c5b2-4ace-aa66-bbaff5afb607 tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:37.929620 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bcd163c7-c5b2-4ace-aa66-bbaff5afb607 tempest-TenantUsagesTestJSON-430145195 tempest-TenantUsagesTestJSON-430145195-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-05T10%3A51%3A36.576405&end=2022-09-07T10%3A51%3A36.576405&detailed=1" status: 200 len: 3214 microversion: 2.1 time: 0.104996 Sep 06 10:51:37.930228 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 206/398] 10.222.0.20 () {58 vars in 1335 bytes} [Tue Sep 6 10:51:37 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-05T10%3A51%3A36.576405&end=2022-09-07T10%3A51%3A36.576405&detailed=1 => generated 3214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:38.072952 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b765189c-30db-4fdf-99e9-f8c10ec12375 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/7c0e46bde29145e0849ca2f92c145654?user_id=1679d253bef444b79349f9fb993f6414" status: 200 len: 282 microversion: 2.36 time: 0.534882 Sep 06 10:51:38.072952 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 193/399] 10.222.0.20 () {60 vars in 1364 bytes} [Tue Sep 6 10:51:37 2022] GET /compute/v2.1/os-quota-sets/7c0e46bde29145e0849ca2f92c145654?user_id=1679d253bef444b79349f9fb993f6414 => generated 282 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:51:38.079390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-00773e9c-7bee-411f-b1b3-551926bf6b3a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:38.080371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-00773e9c-7bee-411f-b1b3-551926bf6b3a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:38.102531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00773e9c-7bee-411f-b1b3-551926bf6b3a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:38.110451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00773e9c-7bee-411f-b1b3-551926bf6b3a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:38.110990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00773e9c-7bee-411f-b1b3-551926bf6b3a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:38.112462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00773e9c-7bee-411f-b1b3-551926bf6b3a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:38.113247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00773e9c-7bee-411f-b1b3-551926bf6b3a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:38.114023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00773e9c-7bee-411f-b1b3-551926bf6b3a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:38.165549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-00773e9c-7bee-411f-b1b3-551926bf6b3a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:51:38.481802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3cdd2b7a-d27c-425c-a7b3-f261740ee4f6 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Calling method '.version_select at 0x7f90f8d90dc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:38.485887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3cdd2b7a-d27c-425c-a7b3-f261740ee4f6 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'ec72b141a68542a7b7e24b4d0cf8a133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9e608da6374619b6f3df4d214dc065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3cdd2b7a-d27c-425c-a7b3-f261740ee4f6 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Request method failure captured: Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY1CS91lOh05k0PpSSokJzy0Jxd66AqrwYC0WCOi7U6443R3J9heSSFiDk43hpgTzoTvGD0iQCOuupnN0IL2wcShPEaVgqhRzP1_WKlBsGxo7ozLsz4e8Ll28bVaNDw_Dyy2ccGMuEI-DdrIZbiIs4SHwnyzHC1Onbbob_emhVUtnw Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: de9e608da6374619b6f3df4d214dc065 Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:38.490702 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:38.492152 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de9e608da6374619b6f3df4d214dc065"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de9e608da6374619b6f3df4d214dc065"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de9e608da6374619b6f3df4d214dc065"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de9e608da6374619b6f3df4d214dc065"}]}] Sep 06 10:51:38.492152 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.492152 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: de9e608da6374619b6f3df4d214dc065 Sep 06 10:51:38.492152 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.492152 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-2122635854-project Sep 06 10:51:38.492152 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:38.492152 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:38.492152 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: ec72b141a68542a7b7e24b4d0cf8a133 Sep 06 10:51:38.492152 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2122635854-project Sep 06 10:51:38.492152 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:38.492152 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 06 10:51:38.492152 ncdv-master-1 devstack@n-api.service[140876]: action_args: {} Sep 06 10:51:38.492152 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:38.493055 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 06 10:51:38.494053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.500849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3cdd2b7a-d27c-425c-a7b3-f261740ee4f6 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:38.502311 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3cdd2b7a-d27c-425c-a7b3-f261740ee4f6 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.571108 Sep 06 10:51:38.507502 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 207/400] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Sep 6 10:51:37 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 577 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:38.528372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dc98d8f8-3aa8-4f85-baca-dfc79c4eb375 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Calling method '.version_select at 0x7f90f8ce7af0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:38.532941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dc98d8f8-3aa8-4f85-baca-dfc79c4eb375 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'ec72b141a68542a7b7e24b4d0cf8a133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9e608da6374619b6f3df4d214dc065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dc98d8f8-3aa8-4f85-baca-dfc79c4eb375 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Request method failure captured: Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY1CS91lOh05k0PpSSokJzy0Jxd66AqrwYC0WCOi7U6443R3J9heSSFiDk43hpgTzoTvGD0iQCOuupnN0IL2wcShPEaVgqhRzP1_WKlBsGxo7ozLsz4e8Ll28bVaNDw_Dyy2ccGMuEI-DdrIZbiIs4SHwnyzHC1Onbbob_emhVUtnw Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: de9e608da6374619b6f3df4d214dc065 Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:38.538480 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:38.539818 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de9e608da6374619b6f3df4d214dc065"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de9e608da6374619b6f3df4d214dc065"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de9e608da6374619b6f3df4d214dc065"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de9e608da6374619b6f3df4d214dc065"}]}] Sep 06 10:51:38.539818 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.539818 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: de9e608da6374619b6f3df4d214dc065 Sep 06 10:51:38.539818 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.539818 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-2122635854-project Sep 06 10:51:38.539818 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:38.539818 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:38.539818 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: ec72b141a68542a7b7e24b4d0cf8a133 Sep 06 10:51:38.539818 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2122635854-project Sep 06 10:51:38.539818 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:38.539818 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 06 10:51:38.539818 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ncdv-master-1'} Sep 06 10:51:38.539818 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:38.540548 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 06 10:51:38.541569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.542457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dc98d8f8-3aa8-4f85-baca-dfc79c4eb375 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:38.544713 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dc98d8f8-3aa8-4f85-baca-dfc79c4eb375 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.026361 Sep 06 10:51:38.545737 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 208/401] 10.222.0.20 () {58 vars in 1191 bytes} [Tue Sep 6 10:51:38 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:51:38.562708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbecd76d-f80f-4a10-930b-8da1044f0759 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Calling method '.version_select at 0x7f90f8d399d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:38.585496 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-fbecd76d-f80f-4a10-930b-8da1044f0759 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbecd76d-f80f-4a10-930b-8da1044f0759 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Request method failure captured: Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY5IWX27KQfWFuWCvIfre3eZZ51boxp1akXhrt1K-v8ZmtDO8s_ibwpe7oOr2XiRClnqteXLSAxyVYRwHOKOe63Gc5i5BxeeohgVH3OLwb-fGcbwAeeZI1f9ARY2i9aF34HZ1HdFVPdxgA7N91-CTFTUVHROISBpkZtHojbzwckkP0 Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:38.592428 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:38.593712 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3d7353155c8b41bb845c42980a324282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3d7353155c8b41bb845c42980a324282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}] Sep 06 10:51:38.593712 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.593712 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:38.593712 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.593712 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:38.593712 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:38.593712 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:38.593712 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 63de5e1379d14ae7b49beec637fd6352 Sep 06 10:51:38.593712 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:38.593712 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:38.593712 ncdv-master-1 devstack@n-api.service[140876]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.593712 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'nonexistent_hostname'} Sep 06 10:51:38.593712 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:38.594454 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 06 10:51:38.595505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:38.596490 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.596490 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.596490 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.596490 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.596490 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.596490 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.596490 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.596490 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:38.596490 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:38.596490 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.596490 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.599098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbecd76d-f80f-4a10-930b-8da1044f0759 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:38.600366 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fbecd76d-f80f-4a10-930b-8da1044f0759 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.048958 Sep 06 10:51:38.601177 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 209/402] 10.222.0.20 () {58 vars in 1212 bytes} [Tue Sep 6 10:51:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:51:38.611278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-044902a1-930c-4517-bbe1-8fb4d149324c tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Calling method '.version_select at 0x7f90f8d44c10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:38.612095 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-00773e9c-7bee-411f-b1b3-551926bf6b3a tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 204 len: 0 microversion: 2.1 time: 0.538376 Sep 06 10:51:38.613215 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 194/403] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:51:38 2022] DELETE /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:51:38.616775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-044902a1-930c-4517-bbe1-8fb4d149324c tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'ec72b141a68542a7b7e24b4d0cf8a133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9e608da6374619b6f3df4d214dc065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-044902a1-930c-4517-bbe1-8fb4d149324c tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Request method failure captured: Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY1CS91lOh05k0PpSSokJzy0Jxd66AqrwYC0WCOi7U6443R3J9heSSFiDk43hpgTzoTvGD0iQCOuupnN0IL2wcShPEaVgqhRzP1_WKlBsGxo7ozLsz4e8Ll28bVaNDw_Dyy2ccGMuEI-DdrIZbiIs4SHwnyzHC1Onbbob_emhVUtnw Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: de9e608da6374619b6f3df4d214dc065 Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:38.618387 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:38.620810 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de9e608da6374619b6f3df4d214dc065"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de9e608da6374619b6f3df4d214dc065"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de9e608da6374619b6f3df4d214dc065"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de9e608da6374619b6f3df4d214dc065"}]}] Sep 06 10:51:38.620810 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.620810 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: de9e608da6374619b6f3df4d214dc065 Sep 06 10:51:38.620810 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.620810 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-2122635854-project Sep 06 10:51:38.620810 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:38.620810 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:38.620810 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: ec72b141a68542a7b7e24b4d0cf8a133 Sep 06 10:51:38.620810 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2122635854-project Sep 06 10:51:38.620810 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:38.620810 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 06 10:51:38.620810 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ncdv-master-1'} Sep 06 10:51:38.620810 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:38.621665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 06 10:51:38.624412 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.627160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-044902a1-930c-4517-bbe1-8fb4d149324c tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:38.627160 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-044902a1-930c-4517-bbe1-8fb4d149324c tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.013267 Sep 06 10:51:38.627160 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 210/404] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Sep 6 10:51:38 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:51:38.630564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-00f4ba95-a2ed-4635-956c-87a6cd7a9a78 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Calling method '.version_select at 0x7f90f8d39a60>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:38.636599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-30d88e8f-ff2e-4321-bfe6-07a052f7e8d4 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:38.636981 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-00f4ba95-a2ed-4635-956c-87a6cd7a9a78 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.639283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-30d88e8f-ff2e-4321-bfe6-07a052f7e8d4 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-00f4ba95-a2ed-4635-956c-87a6cd7a9a78 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Request method failure captured: Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY5IWX27KQfWFuWCvIfre3eZZ51boxp1akXhrt1K-v8ZmtDO8s_ibwpe7oOr2XiRClnqteXLSAxyVYRwHOKOe63Gc5i5BxeeohgVH3OLwb-fGcbwAeeZI1f9ARY2i9aF34HZ1HdFVPdxgA7N91-CTFTUVHROISBpkZtHojbzwckkP0 Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:38.639624 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:38.641000 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3d7353155c8b41bb845c42980a324282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3d7353155c8b41bb845c42980a324282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}] Sep 06 10:51:38.641000 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.641000 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:38.641000 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.641000 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:38.641000 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:38.641000 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:38.641000 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 63de5e1379d14ae7b49beec637fd6352 Sep 06 10:51:38.641000 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:38.641000 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:38.641000 ncdv-master-1 devstack@n-api.service[140876]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.641000 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'nonexistent_hostname'} Sep 06 10:51:38.641000 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.641810 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.643204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.645920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-00f4ba95-a2ed-4635-956c-87a6cd7a9a78 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:38.647074 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-00f4ba95-a2ed-4635-956c-87a6cd7a9a78 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.020176 Sep 06 10:51:38.651801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30d88e8f-ff2e-4321-bfe6-07a052f7e8d4 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:38.652746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30d88e8f-ff2e-4321-bfe6-07a052f7e8d4 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:38.653459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30d88e8f-ff2e-4321-bfe6-07a052f7e8d4 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:38.653570 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 211/405] 10.222.0.20 () {58 vars in 1191 bytes} [Tue Sep 6 10:51:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:51:38.654688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30d88e8f-ff2e-4321-bfe6-07a052f7e8d4 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:38.655397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30d88e8f-ff2e-4321-bfe6-07a052f7e8d4 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:38.656034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30d88e8f-ff2e-4321-bfe6-07a052f7e8d4 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:38.658620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3bb5d5a8-ee05-4f3e-915c-c3edc092e241 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Calling method '.version_select at 0x7f90f8d90dc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:38.660546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3bb5d5a8-ee05-4f3e-915c-c3edc092e241 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'ec72b141a68542a7b7e24b4d0cf8a133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9e608da6374619b6f3df4d214dc065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3bb5d5a8-ee05-4f3e-915c-c3edc092e241 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Request method failure captured: Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY1CS91lOh05k0PpSSokJzy0Jxd66AqrwYC0WCOi7U6443R3J9heSSFiDk43hpgTzoTvGD0iQCOuupnN0IL2wcShPEaVgqhRzP1_WKlBsGxo7ozLsz4e8Ll28bVaNDw_Dyy2ccGMuEI-DdrIZbiIs4SHwnyzHC1Onbbob_emhVUtnw Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: de9e608da6374619b6f3df4d214dc065 Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:38.662355 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:38.663605 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de9e608da6374619b6f3df4d214dc065"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de9e608da6374619b6f3df4d214dc065"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de9e608da6374619b6f3df4d214dc065"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de9e608da6374619b6f3df4d214dc065"}]}] Sep 06 10:51:38.663605 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.663605 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: de9e608da6374619b6f3df4d214dc065 Sep 06 10:51:38.663605 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.663605 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-2122635854-project Sep 06 10:51:38.663605 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:38.663605 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:38.663605 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: ec72b141a68542a7b7e24b4d0cf8a133 Sep 06 10:51:38.663605 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2122635854-project Sep 06 10:51:38.663605 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:38.663605 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 06 10:51:38.663605 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ncdv-master-1'} Sep 06 10:51:38.663605 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:38.664318 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 06 10:51:38.665315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.667536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3bb5d5a8-ee05-4f3e-915c-c3edc092e241 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:38.667536 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3bb5d5a8-ee05-4f3e-915c-c3edc092e241 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009373 Sep 06 10:51:38.670761 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 212/406] 10.222.0.20 () {58 vars in 1197 bytes} [Tue Sep 6 10:51:38 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:38.693630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5afa8e18-35d7-45bf-b96c-d13bb3d65c60 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Calling method '.version_select at 0x7f90f8eb7dc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:38.722324 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-5afa8e18-35d7-45bf-b96c-d13bb3d65c60 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5afa8e18-35d7-45bf-b96c-d13bb3d65c60 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Request method failure captured: Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY5IWX27KQfWFuWCvIfre3eZZ51boxp1akXhrt1K-v8ZmtDO8s_ibwpe7oOr2XiRClnqteXLSAxyVYRwHOKOe63Gc5i5BxeeohgVH3OLwb-fGcbwAeeZI1f9ARY2i9aF34HZ1HdFVPdxgA7N91-CTFTUVHROISBpkZtHojbzwckkP0 Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:38.725223 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:38.726433 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3d7353155c8b41bb845c42980a324282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3d7353155c8b41bb845c42980a324282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}] Sep 06 10:51:38.726433 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.726433 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:38.726433 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.726433 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:38.726433 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:38.726433 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:38.726433 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 63de5e1379d14ae7b49beec637fd6352 Sep 06 10:51:38.726433 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:38.726433 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:38.726433 ncdv-master-1 devstack@n-api.service[140876]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.726433 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'nonexistent_hostname'} Sep 06 10:51:38.726433 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:38.727153 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 06 10:51:38.728143 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:38.731027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.731027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.731027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.731027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.731027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.731027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.731027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.731027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:38.731027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:38.731027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.731027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.731027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5afa8e18-35d7-45bf-b96c-d13bb3d65c60 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:38.746722 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5afa8e18-35d7-45bf-b96c-d13bb3d65c60 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.054679 Sep 06 10:51:38.766805 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 213/407] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 10:51:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:51:38.792567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-404edc4c-a1d6-4ca3-815f-f1f5f69a6ac1 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Calling method '.version_select at 0x7f90f8d90e50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:38.795134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-404edc4c-a1d6-4ca3-815f-f1f5f69a6ac1 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'ec72b141a68542a7b7e24b4d0cf8a133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9e608da6374619b6f3df4d214dc065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-404edc4c-a1d6-4ca3-815f-f1f5f69a6ac1 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Request method failure captured: Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY1CS91lOh05k0PpSSokJzy0Jxd66AqrwYC0WCOi7U6443R3J9heSSFiDk43hpgTzoTvGD0iQCOuupnN0IL2wcShPEaVgqhRzP1_WKlBsGxo7ozLsz4e8Ll28bVaNDw_Dyy2ccGMuEI-DdrIZbiIs4SHwnyzHC1Onbbob_emhVUtnw Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: de9e608da6374619b6f3df4d214dc065 Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:38.814360 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:38.815909 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de9e608da6374619b6f3df4d214dc065"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de9e608da6374619b6f3df4d214dc065"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de9e608da6374619b6f3df4d214dc065"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de9e608da6374619b6f3df4d214dc065"}]}] Sep 06 10:51:38.815909 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.815909 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: de9e608da6374619b6f3df4d214dc065 Sep 06 10:51:38.815909 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.815909 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-2122635854-project Sep 06 10:51:38.815909 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:38.815909 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:38.815909 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: ec72b141a68542a7b7e24b4d0cf8a133 Sep 06 10:51:38.815909 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2122635854-project Sep 06 10:51:38.815909 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:38.815909 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 06 10:51:38.815909 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ncdv-master-1'} Sep 06 10:51:38.815909 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:38.816632 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 06 10:51:38.817645 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.821528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-404edc4c-a1d6-4ca3-815f-f1f5f69a6ac1 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:38.822650 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-404edc4c-a1d6-4ca3-815f-f1f5f69a6ac1 tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.054748 Sep 06 10:51:38.833594 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 214/408] 10.222.0.20 () {58 vars in 1194 bytes} [Tue Sep 6 10:51:38 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 66 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:38.856189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1b946d56-16a7-4c69-b2b1-8f52dcc04a4e tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Calling method '.version_select at 0x7f90f8e063a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:38.874722 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-1b946d56-16a7-4c69-b2b1-8f52dcc04a4e tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1b946d56-16a7-4c69-b2b1-8f52dcc04a4e tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Request method failure captured: Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY5IWX27KQfWFuWCvIfre3eZZ51boxp1akXhrt1K-v8ZmtDO8s_ibwpe7oOr2XiRClnqteXLSAxyVYRwHOKOe63Gc5i5BxeeohgVH3OLwb-fGcbwAeeZI1f9ARY2i9aF34HZ1HdFVPdxgA7N91-CTFTUVHROISBpkZtHojbzwckkP0 Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:38.882544 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:38.885516 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3d7353155c8b41bb845c42980a324282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3d7353155c8b41bb845c42980a324282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}] Sep 06 10:51:38.885516 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.885516 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:38.885516 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.885516 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:38.885516 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:38.885516 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:38.885516 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 63de5e1379d14ae7b49beec637fd6352 Sep 06 10:51:38.885516 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:38.885516 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:38.885516 ncdv-master-1 devstack@n-api.service[140876]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.885516 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'nonexistent_hostname'} Sep 06 10:51:38.885516 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:38.886213 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 06 10:51:38.887251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1b946d56-16a7-4c69-b2b1-8f52dcc04a4e tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1b946d56-16a7-4c69-b2b1-8f52dcc04a4e tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.032347 Sep 06 10:51:38.888891 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 215/409] 10.222.0.20 () {58 vars in 1215 bytes} [Tue Sep 6 10:51:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 06 10:51:38.897354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e9d049e2-42bf-4dd3-b585-de0a52ffbb42 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8d90670>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e9d049e2-42bf-4dd3-b585-de0a52ffbb42 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Request method failure captured: Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 51 Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY5IWX27KQfWFuWCvIfre3eZZ51boxp1akXhrt1K-v8ZmtDO8s_ibwpe7oOr2XiRClnqteXLSAxyVYRwHOKOe63Gc5i5BxeeohgVH3OLwb-fGcbwAeeZI1f9ARY2i9aF34HZ1HdFVPdxgA7N91-CTFTUVHROISBpkZtHojbzwckkP0 Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:38.913753 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:38.915042 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3d7353155c8b41bb845c42980a324282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3d7353155c8b41bb845c42980a324282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}] Sep 06 10:51:38.915042 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.915042 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:38.915042 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.915042 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:38.915042 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:38.915042 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:38.915042 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 63de5e1379d14ae7b49beec637fd6352 Sep 06 10:51:38.915042 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:38.915042 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:51:38.915042 ncdv-master-1 devstack@n-api.service[140876]: {"status": "enable", "maintenance_mode": "invalid"} Sep 06 10:51:38.915042 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:38.915042 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'disable', Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'Enable', Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'Disable', Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance: Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'invalid' Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.922333 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.923960 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.924939 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.924939 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:51:38.924939 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:51:38.924939 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 06 10:51:38.924939 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.924939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e9d049e2-42bf-4dd3-b585-de0a52ffbb42 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:38.924939 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e9d049e2-42bf-4dd3-b585-de0a52ffbb42 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.022317 Sep 06 10:51:38.924939 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 216/410] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 6 10:51:38 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:51:38.931818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-755cefa5-0b70-4514-bb9c-a8ad86ed74da tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8d505e0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-755cefa5-0b70-4514-bb9c-a8ad86ed74da tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Request method failure captured: Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 51 Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY5IWX27KQfWFuWCvIfre3eZZ51boxp1akXhrt1K-v8ZmtDO8s_ibwpe7oOr2XiRClnqteXLSAxyVYRwHOKOe63Gc5i5BxeeohgVH3OLwb-fGcbwAeeZI1f9ARY2i9aF34HZ1HdFVPdxgA7N91-CTFTUVHROISBpkZtHojbzwckkP0 Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:38.936243 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:38.937472 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3d7353155c8b41bb845c42980a324282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3d7353155c8b41bb845c42980a324282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}] Sep 06 10:51:38.937472 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.937472 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:38.937472 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:38.937472 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:38.937472 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:38.937472 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:38.937472 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 63de5e1379d14ae7b49beec637fd6352 Sep 06 10:51:38.937472 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:38.937472 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:51:38.937472 ncdv-master-1 devstack@n-api.service[140876]: {"status": "invalid", "maintenance_mode": "enable"} Sep 06 10:51:38.937472 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:38.937472 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'disable', Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'Enable', Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'Disable', Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance: Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'invalid' Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.938183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.939682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.940699 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.940699 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:51:38.940699 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:51:38.940699 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 06 10:51:38.940699 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.940699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-755cefa5-0b70-4514-bb9c-a8ad86ed74da tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:38.940699 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-755cefa5-0b70-4514-bb9c-a8ad86ed74da tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.010010 Sep 06 10:51:38.947724 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 217/411] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 6 10:51:38 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 10:51:38.965039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5d9e705e-1a11-4515-8c35-2cf1a2e0795e tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Action: 'update', calling method: .version_select at 0x7f90f8d39430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:38.968686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5d9e705e-1a11-4515-8c35-2cf1a2e0795e tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'ec72b141a68542a7b7e24b4d0cf8a133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9e608da6374619b6f3df4d214dc065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5d9e705e-1a11-4515-8c35-2cf1a2e0795e tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Request method failure captured: Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 50 Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY1CS91lOh05k0PpSSokJzy0Jxd66AqrwYC0WCOi7U6443R3J9heSSFiDk43hpgTzoTvGD0iQCOuupnN0IL2wcShPEaVgqhRzP1_WKlBsGxo7ozLsz4e8Ll28bVaNDw_Dyy2ccGMuEI-DdrIZbiIs4SHwnyzHC1Onbbob_emhVUtnw Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: de9e608da6374619b6f3df4d214dc065 Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:38.970291 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de9e608da6374619b6f3df4d214dc065"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de9e608da6374619b6f3df4d214dc065"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de9e608da6374619b6f3df4d214dc065"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de9e608da6374619b6f3df4d214dc065"}]}] Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: de9e608da6374619b6f3df4d214dc065 Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2122635854 Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-2122635854-project Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: ec72b141a68542a7b7e24b4d0cf8a133 Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2122635854-project Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: {"status": "enable", "maintenance_mode": "enable"} Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 06 10:51:38.971654 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:38.972416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 06 10:51:38.973460 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:38.979339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5d9e705e-1a11-4515-8c35-2cf1a2e0795e tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:38.979961 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5d9e705e-1a11-4515-8c35-2cf1a2e0795e tempest-HostsAdminNegativeTestJSON-2122635854 tempest-HostsAdminNegativeTestJSON-2122635854-project] 10.222.0.20 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.027941 Sep 06 10:51:38.981281 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 218/412] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 6 10:51:38 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:38.992403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb0c6bca-12ab-4379-b76e-b262ac6e2b15 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8d90ca0>, body: {"status": null, "maintenance_mode": null} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb0c6bca-12ab-4379-b76e-b262ac6e2b15 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Request method failure captured: Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 42 Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY5IWX27KQfWFuWCvIfre3eZZ51boxp1akXhrt1K-v8ZmtDO8s_ibwpe7oOr2XiRClnqteXLSAxyVYRwHOKOe63Gc5i5BxeeohgVH3OLwb-fGcbwAeeZI1f9ARY2i9aF34HZ1HdFVPdxgA7N91-CTFTUVHROISBpkZtHojbzwckkP0 Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:39.006115 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3d7353155c8b41bb845c42980a324282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3d7353155c8b41bb845c42980a324282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}] Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 63de5e1379d14ae7b49beec637fd6352 Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: {"status": null, "maintenance_mode": null} Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 06 10:51:39.009010 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'disable', Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'Enable', Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'Disable', Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance: Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi None Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:39.009766 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:39.011102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:39.012124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:51:39.012124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:51:39.012124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 06 10:51:39.012124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:39.012124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb0c6bca-12ab-4379-b76e-b262ac6e2b15 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:39.012124 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fb0c6bca-12ab-4379-b76e-b262ac6e2b15 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.023023 Sep 06 10:51:39.012124 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 219/413] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 6 10:51:38 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 10:51:39.021206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dca1df4b-be0e-4256-8c90-cf3a32802e75 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8d90550>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:39.043795 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.hosts [None req-dca1df4b-be0e-4256-8c90-cf3a32802e75 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Enabling host nonexistent_hostname. Sep 06 10:51:39.063554 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-dca1df4b-be0e-4256-8c90-cf3a32802e75 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dca1df4b-be0e-4256-8c90-cf3a32802e75 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Request method failure captured: Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 50 Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY5IWX27KQfWFuWCvIfre3eZZ51boxp1akXhrt1K-v8ZmtDO8s_ibwpe7oOr2XiRClnqteXLSAxyVYRwHOKOe63Gc5i5BxeeohgVH3OLwb-fGcbwAeeZI1f9ARY2i9aF34HZ1HdFVPdxgA7N91-CTFTUVHROISBpkZtHojbzwckkP0 Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:39.067845 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3d7353155c8b41bb845c42980a324282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3d7353155c8b41bb845c42980a324282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d7353155c8b41bb845c42980a324282"}]}] Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3d7353155c8b41bb845c42980a324282 Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-106587739 Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 63de5e1379d14ae7b49beec637fd6352 Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HostsAdminNegativeTestJSON-106587739-project-admin Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: {"status": "enable", "maintenance_mode": "enable"} Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:39.078747 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 06 10:51:39.079925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:51:39.081256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:39.082320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dca1df4b-be0e-4256-8c90-cf3a32802e75 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:39.083151 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dca1df4b-be0e-4256-8c90-cf3a32802e75 tempest-HostsAdminNegativeTestJSON-106587739 tempest-HostsAdminNegativeTestJSON-106587739-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.052880 Sep 06 10:51:39.083151 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 220/414] 10.222.0.20 () {60 vars in 1211 bytes} [Tue Sep 6 10:51:39 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 06 10:51:39.459640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-30d88e8f-ff2e-4321-bfe6-07a052f7e8d4 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:39.479402 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-30d88e8f-ff2e-4321-bfe6-07a052f7e8d4 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1469 microversion: 2.1 time: 0.859657 Sep 06 10:51:39.482010 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 195/415] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:38 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1469 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:40.516003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2c3ff41f-0a62-4c00-9c1f-ebeb475334a0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:40.517228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2c3ff41f-0a62-4c00-9c1f-ebeb475334a0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:40.528613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c3ff41f-0a62-4c00-9c1f-ebeb475334a0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:40.529159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c3ff41f-0a62-4c00-9c1f-ebeb475334a0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:40.529607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c3ff41f-0a62-4c00-9c1f-ebeb475334a0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:40.530324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c3ff41f-0a62-4c00-9c1f-ebeb475334a0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:40.537625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c3ff41f-0a62-4c00-9c1f-ebeb475334a0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:40.539107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c3ff41f-0a62-4c00-9c1f-ebeb475334a0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:41.126593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2c3ff41f-0a62-4c00-9c1f-ebeb475334a0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:41.139902 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2c3ff41f-0a62-4c00-9c1f-ebeb475334a0 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1469 microversion: 2.1 time: 0.633533 Sep 06 10:51:41.151376 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 221/416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:40 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1469 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:42.167792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-82d5fc94-1197-47d7-b717-44dfbf175be5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:42.173445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-82d5fc94-1197-47d7-b717-44dfbf175be5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:42.178343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82d5fc94-1197-47d7-b717-44dfbf175be5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.178877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82d5fc94-1197-47d7-b717-44dfbf175be5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.180116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82d5fc94-1197-47d7-b717-44dfbf175be5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.183172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82d5fc94-1197-47d7-b717-44dfbf175be5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.183365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82d5fc94-1197-47d7-b717-44dfbf175be5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.184618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82d5fc94-1197-47d7-b717-44dfbf175be5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.494224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Calling method '.version_select at 0x7f90f8d39310>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:42.511964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.513071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.514031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.578446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.579512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.582083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.645358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.650485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.650485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.672989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.675903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.676365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.693801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.694304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.694751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.704984 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5face6e8-59ca-4f22-a27a-354f463d5bbd tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 0.481531 Sep 06 10:51:42.706621 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 222/417] 10.222.0.20 () {60 vars in 1243 bytes} [Tue Sep 6 10:51:42 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:51:42.723378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Calling method '.version_select at 0x7f90f8d17940>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:42.727295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.727987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.728585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.749615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.750582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.751235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.790261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.790773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.791250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.810160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.810656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.811401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.824485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-82d5fc94-1197-47d7-b717-44dfbf175be5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:42.842024 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-82d5fc94-1197-47d7-b717-44dfbf175be5 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1427 microversion: 2.1 time: 0.678243 Sep 06 10:51:42.851997 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 196/418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:42 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1427 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:42.874254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.874254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.874864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.889958 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2c048a21-1543-4868-af5a-337b71cd4f04 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 436 microversion: 2.53 time: 0.170542 Sep 06 10:51:42.890542 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 223/419] 10.222.0.20 () {60 vars in 1222 bytes} [Tue Sep 6 10:51:42 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 436 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 10:51:42.902698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b2aa19aa-3c63-4534-9c2e-00b4c8de7249 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Calling method '.version_select at 0x7f90f8e12ee0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:42.911175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2aa19aa-3c63-4534-9c2e-00b4c8de7249 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.911709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2aa19aa-3c63-4534-9c2e-00b4c8de7249 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.912221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2aa19aa-3c63-4534-9c2e-00b4c8de7249 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.956530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-2abf0453-ae47-49de-8187-f3fd02c11205 req-e97a8707-349f-4128-8697-a93e400b38d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bee805b-5243-4d62-a2a7-7fcfe7639100", "name": "network-vif-deleted", "tag": "85f90eaf-dda4-4abd-bc73-7ce6606dc418"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:42.961843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2aa19aa-3c63-4534-9c2e-00b4c8de7249 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:42.963491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2aa19aa-3c63-4534-9c2e-00b4c8de7249 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:42.964683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2aa19aa-3c63-4534-9c2e-00b4c8de7249 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:42.984869 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b2aa19aa-3c63-4534-9c2e-00b4c8de7249 tempest-HypervisorAdminV253TestBase-828407891 tempest-HypervisorAdminV253TestBase-828407891-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/4d0ba37e-c102-4a14-bfc6-d7e0b4b4ee51" status: 200 len: 792 microversion: 2.53 time: 0.085927 Sep 06 10:51:42.987455 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 197/420] 10.222.0.20 () {60 vars in 1298 bytes} [Tue Sep 6 10:51:42 2022] GET /compute/v2.1/os-hypervisors/4d0ba37e-c102-4a14-bfc6-d7e0b4b4ee51 => generated 792 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:51:43.017608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2abf0453-ae47-49de-8187-f3fd02c11205 req-e97a8707-349f-4128-8697-a93e400b38d7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:43.019106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2abf0453-ae47-49de-8187-f3fd02c11205 req-e97a8707-349f-4128-8697-a93e400b38d7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:43.019106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2abf0453-ae47-49de-8187-f3fd02c11205 req-e97a8707-349f-4128-8697-a93e400b38d7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:43.050168 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-2abf0453-ae47-49de-8187-f3fd02c11205 req-e97a8707-349f-4128-8697-a93e400b38d7 service nova] Creating event network-vif-deleted:85f90eaf-dda4-4abd-bc73-7ce6606dc418 for instance 0bee805b-5243-4d62-a2a7-7fcfe7639100 on nch1-master-1 Sep 06 10:51:43.064034 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-2abf0453-ae47-49de-8187-f3fd02c11205 req-e97a8707-349f-4128-8697-a93e400b38d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111087 Sep 06 10:51:43.066646 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 224/421] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:43.884445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:43.885675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:43.906984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:43.907533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:43.907989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:43.908741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:43.914298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:43.916352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:44.046991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:44.049398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:44.053824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:44.059151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lazy-loading 'fault' on Instance uuid 0bee805b-5243-4d62-a2a7-7fcfe7639100 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:51:44.322277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b67a91aae74b33959efe4f3e647efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752e7bf666fb4d7a8a997af85d508dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:44.333228 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8acd851e-2a75-4145-bf67-b35bae3a57ff tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 200 len: 1304 microversion: 2.1 time: 0.455472 Sep 06 10:51:44.337227 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 198/422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:43 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 1304 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:51:45.358500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=10 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:45.362716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-10c84a49-7ebd-4b10-ae23-da3ac969ceb2 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:45.363448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-10c84a49-7ebd-4b10-ae23-da3ac969ceb2 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] [instance: 0bee805b-5243-4d62-a2a7-7fcfe7639100] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:45.370380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=94,nova_api:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:45.374743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10c84a49-7ebd-4b10-ae23-da3ac969ceb2 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:45.381565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10c84a49-7ebd-4b10-ae23-da3ac969ceb2 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:45.383564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10c84a49-7ebd-4b10-ae23-da3ac969ceb2 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:45.384522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10c84a49-7ebd-4b10-ae23-da3ac969ceb2 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:45.387894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10c84a49-7ebd-4b10-ae23-da3ac969ceb2 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:45.388562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10c84a49-7ebd-4b10-ae23-da3ac969ceb2 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:45.416938 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-10c84a49-7ebd-4b10-ae23-da3ac969ceb2 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] HTTP exception thrown: Instance 0bee805b-5243-4d62-a2a7-7fcfe7639100 could not be found. Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-10c84a49-7ebd-4b10-ae23-da3ac969ceb2 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Request method failure captured: Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 HTTP/1.1 Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyYeG3VH80Et7vZEuamawbLRuYp3C97XNt2QCNt39wRHM-U9xr2LyIi8SP86YB6pixr-K8v3ZuGeTUNcuSi73r_DLOaKa8Q4kDFR8hfndgNqmym8dWEF69Adh7ghQzpxUc87qrsXMakLV_XzDtNQ5JSk-MNJx3JRQ9-ihBYtI8bMD40 Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 752e7bf666fb4d7a8a997af85d508dd6 Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TenantUsagesTestJSON-372635906 Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:45.423985 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:45.425548 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_752e7bf666fb4d7a8a997af85d508dd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/752e7bf666fb4d7a8a997af85d508dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/752e7bf666fb4d7a8a997af85d508dd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/752e7bf666fb4d7a8a997af85d508dd6"}]}] Sep 06 10:51:45.425548 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TenantUsagesTestJSON-372635906 Sep 06 10:51:45.425548 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 752e7bf666fb4d7a8a997af85d508dd6 Sep 06 10:51:45.425548 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TenantUsagesTestJSON-372635906 Sep 06 10:51:45.425548 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TenantUsagesTestJSON-372635906-project Sep 06 10:51:45.425548 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:45.425548 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:45.425548 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 68b67a91aae74b33959efe4f3e647efb Sep 06 10:51:45.425548 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TenantUsagesTestJSON-372635906-project Sep 06 10:51:45.425548 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:51:45.425548 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 0bee805b-5243-4d62-a2a7-7fcfe7639100 could not be found. Sep 06 10:51:45.425548 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '0bee805b-5243-4d62-a2a7-7fcfe7639100'} Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bee805b-5243-4d62-a2a7-7fcfe7639100 could not be found. Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:45.426409 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bee805b-5243-4d62-a2a7-7fcfe7639100 could not be found. Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bee805b-5243-4d62-a2a7-7fcfe7639100 could not be found. Sep 06 10:51:45.427841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:45.429730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-10c84a49-7ebd-4b10-ae23-da3ac969ceb2 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] Returning 404 to user: Instance 0bee805b-5243-4d62-a2a7-7fcfe7639100 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:45.430748 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-10c84a49-7ebd-4b10-ae23-da3ac969ceb2 tempest-TenantUsagesTestJSON-372635906 tempest-TenantUsagesTestJSON-372635906-project] 10.222.0.20 "GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100" status: 404 len: 111 microversion: 2.1 time: 0.074498 Sep 06 10:51:45.435613 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 225/423] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:51:45 2022] GET /compute/v2.1/servers/0bee805b-5243-4d62-a2a7-7fcfe7639100 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:47.487131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=7 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:47.541052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-619871498", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "3d4af992-111f-451f-ba0f-1750f5aa94d6"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:47.658197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] validate_networks() for [('3d4af992-111f-451f-ba0f-1750f5aa94d6', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:51:48.053502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=16 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:48.665547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:51:48.666153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:51:48.666477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:51:48.667086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:51:48.667656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:51:48.685616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:48.688066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:48.688719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:48.691465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:48.693726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:48.694366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:48.752968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Getting quotas for project 437799e22df2433a83eca67987e942c6. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:51:48.764775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Getting quotas for user d9f88a4c72854cff9bba7ed2920f55b0 and project 437799e22df2433a83eca67987e942c6. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:51:48.830045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:51:48.832865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:51:48.988676 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-690b8f60-73c2-491a-b51f-02cf5e3d9996 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.938536 Sep 06 10:51:48.990716 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 199/424] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 10:51:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 10:51:49.006392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-098254c2-1de1-4822-adff-c2aec98d1779 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:49.007204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-098254c2-1de1-4822-adff-c2aec98d1779 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:49.010256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=16 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:49.271520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-098254c2-1de1-4822-adff-c2aec98d1779 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:49.297777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-098254c2-1de1-4822-adff-c2aec98d1779 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:49.297777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-098254c2-1de1-4822-adff-c2aec98d1779 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:49.301700 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-098254c2-1de1-4822-adff-c2aec98d1779 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1261 microversion: 2.25 time: 0.299854 Sep 06 10:51:49.314438 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 226/425] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:51:49 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1261 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:51:50.330171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5d57c800-514c-4985-9c9f-c53a52c90cd5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:50.334270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5d57c800-514c-4985-9c9f-c53a52c90cd5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:50.437343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5d57c800-514c-4985-9c9f-c53a52c90cd5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:50.446863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5d57c800-514c-4985-9c9f-c53a52c90cd5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:50.456984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5d57c800-514c-4985-9c9f-c53a52c90cd5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:50.460231 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5d57c800-514c-4985-9c9f-c53a52c90cd5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1261 microversion: 2.25 time: 0.132524 Sep 06 10:51:50.462410 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 200/426] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:51:50 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1261 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:51:51.498714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e95ba674-7cb9-462b-9a2f-2217906857a5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:51.499378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e95ba674-7cb9-462b-9a2f-2217906857a5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:51.545185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e95ba674-7cb9-462b-9a2f-2217906857a5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:51.547192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e95ba674-7cb9-462b-9a2f-2217906857a5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:51.549307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e95ba674-7cb9-462b-9a2f-2217906857a5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:51.556564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e95ba674-7cb9-462b-9a2f-2217906857a5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:51.561201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e95ba674-7cb9-462b-9a2f-2217906857a5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:51.561969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e95ba674-7cb9-462b-9a2f-2217906857a5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:51.834827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e95ba674-7cb9-462b-9a2f-2217906857a5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:51.888374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e95ba674-7cb9-462b-9a2f-2217906857a5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:51.916206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e95ba674-7cb9-462b-9a2f-2217906857a5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:51.917389 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e95ba674-7cb9-462b-9a2f-2217906857a5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1257 microversion: 2.25 time: 0.425742 Sep 06 10:51:51.919821 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 227/427] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:51:51 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1257 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:51:52.944446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eba3b94d-0478-4d0a-92bb-a24778dc66c8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:52.945049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-eba3b94d-0478-4d0a-92bb-a24778dc66c8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:52.955424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eba3b94d-0478-4d0a-92bb-a24778dc66c8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:52.956281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eba3b94d-0478-4d0a-92bb-a24778dc66c8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:52.956908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eba3b94d-0478-4d0a-92bb-a24778dc66c8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:52.958938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eba3b94d-0478-4d0a-92bb-a24778dc66c8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:52.959677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eba3b94d-0478-4d0a-92bb-a24778dc66c8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:52.960334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eba3b94d-0478-4d0a-92bb-a24778dc66c8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:53.234268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-eba3b94d-0478-4d0a-92bb-a24778dc66c8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:53.252990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-eba3b94d-0478-4d0a-92bb-a24778dc66c8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:53.256606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-eba3b94d-0478-4d0a-92bb-a24778dc66c8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:53.259499 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-eba3b94d-0478-4d0a-92bb-a24778dc66c8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1321 microversion: 2.25 time: 0.318554 Sep 06 10:51:53.274450 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 201/428] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:51:52 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:51:54.225802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7dc75c4a-0b80-4e58-a114-e1c086322032 tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Calling method '.version_select at 0x7f90f8ce7820>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:54.246197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7dc75c4a-0b80-4e58-a114-e1c086322032 tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '483145a466ca47029d351d05525b7e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7dedf5039043e99d49f60d147cfe3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7dc75c4a-0b80-4e58-a114-e1c086322032 tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Request method failure captured: Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZGoPwxjDppL5bYZjXDPe0GIsiRlw7qvtJjR2PDvyR6yVUTRczAw301N5RsiYA5rf4Mz-TmTCU1cZ_DdllcIZRKR_R-IDMMxU9M9H3N7SKykzmEotFYMCcZMsg-LvJXm9MqdcCwWTJchcgd21xNb1dIlAojOVJv9mKwuZL9ZmNxkHs Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 9d7dedf5039043e99d49f60d147cfe3a Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:54.253516 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:54.254783 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7dedf5039043e99d49f60d147cfe3a"}]}] Sep 06 10:51:54.254783 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:54.254783 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 9d7dedf5039043e99d49f60d147cfe3a Sep 06 10:51:54.254783 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:54.254783 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HypervisorAdminNegativeTestJSON-1902737589-project Sep 06 10:51:54.254783 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:54.254783 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:54.254783 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 483145a466ca47029d351d05525b7e05 Sep 06 10:51:54.254783 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589-project Sep 06 10:51:54.254783 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:54.254783 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 06 10:51:54.254783 ncdv-master-1 devstack@n-api.service[140876]: action_args: {} Sep 06 10:51:54.254783 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:54.255921 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 06 10:51:54.257251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:54.259278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7dc75c4a-0b80-4e58-a114-e1c086322032 tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:54.262149 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7dc75c4a-0b80-4e58-a114-e1c086322032 tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.653187 Sep 06 10:51:54.266351 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 228/429] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Sep 6 10:51:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 658 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:51:54.276150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8287358e-8fcb-47cb-8bd7-6ee4867b86bf tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Calling method '.version_select at 0x7f90f8d94a60>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:54.278596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8287358e-8fcb-47cb-8bd7-6ee4867b86bf tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '483145a466ca47029d351d05525b7e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7dedf5039043e99d49f60d147cfe3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8287358e-8fcb-47cb-8bd7-6ee4867b86bf tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Request method failure captured: Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZGoPwxjDppL5bYZjXDPe0GIsiRlw7qvtJjR2PDvyR6yVUTRczAw301N5RsiYA5rf4Mz-TmTCU1cZ_DdllcIZRKR_R-IDMMxU9M9H3N7SKykzmEotFYMCcZMsg-LvJXm9MqdcCwWTJchcgd21xNb1dIlAojOVJv9mKwuZL9ZmNxkHs Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 9d7dedf5039043e99d49f60d147cfe3a Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:51:54.281975 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:51:54.283596 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7dedf5039043e99d49f60d147cfe3a"}]}] Sep 06 10:51:54.283596 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:54.283596 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 9d7dedf5039043e99d49f60d147cfe3a Sep 06 10:51:54.283596 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:54.283596 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-HypervisorAdminNegativeTestJSON-1902737589-project Sep 06 10:51:54.283596 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:54.283596 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:54.283596 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 483145a466ca47029d351d05525b7e05 Sep 06 10:51:54.283596 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589-project Sep 06 10:51:54.283596 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:51:54.283596 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 06 10:51:54.283596 ncdv-master-1 devstack@n-api.service[140875]: action_args: {} Sep 06 10:51:54.283596 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:54.284455 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 06 10:51:54.285519 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:54.286812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8287358e-8fcb-47cb-8bd7-6ee4867b86bf tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:54.286812 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8287358e-8fcb-47cb-8bd7-6ee4867b86bf tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.011074 Sep 06 10:51:54.288994 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 202/430] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:51:54 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:54.306795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-947b13d0-96be-42d9-a22a-d4e72afdeb4e tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Calling method '.version_select at 0x7f90f8d170d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:54.308803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-91c9e711-1c24-4f41-a2d1-f0f2a25512df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:54.310184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-91c9e711-1c24-4f41-a2d1-f0f2a25512df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:54.312640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-947b13d0-96be-42d9-a22a-d4e72afdeb4e tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '483145a466ca47029d351d05525b7e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7dedf5039043e99d49f60d147cfe3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-947b13d0-96be-42d9-a22a-d4e72afdeb4e tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Request method failure captured: Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZGoPwxjDppL5bYZjXDPe0GIsiRlw7qvtJjR2PDvyR6yVUTRczAw301N5RsiYA5rf4Mz-TmTCU1cZ_DdllcIZRKR_R-IDMMxU9M9H3N7SKykzmEotFYMCcZMsg-LvJXm9MqdcCwWTJchcgd21xNb1dIlAojOVJv9mKwuZL9ZmNxkHs Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 9d7dedf5039043e99d49f60d147cfe3a Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:54.316887 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:54.321965 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7dedf5039043e99d49f60d147cfe3a"}]}] Sep 06 10:51:54.321965 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:54.321965 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 9d7dedf5039043e99d49f60d147cfe3a Sep 06 10:51:54.321965 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:54.321965 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HypervisorAdminNegativeTestJSON-1902737589-project Sep 06 10:51:54.321965 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:54.321965 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:54.321965 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 483145a466ca47029d351d05525b7e05 Sep 06 10:51:54.321965 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589-project Sep 06 10:51:54.321965 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:54.321965 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 06 10:51:54.321965 ncdv-master-1 devstack@n-api.service[140876]: action_args: {} Sep 06 10:51:54.321965 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:54.322882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 06 10:51:54.324310 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:54.330162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-947b13d0-96be-42d9-a22a-d4e72afdeb4e tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:54.332373 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-947b13d0-96be-42d9-a22a-d4e72afdeb4e tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.041313 Sep 06 10:51:54.343581 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 229/431] 10.222.0.20 () {58 vars in 1179 bytes} [Tue Sep 6 10:51:54 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:54.344015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91c9e711-1c24-4f41-a2d1-f0f2a25512df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:54.344538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91c9e711-1c24-4f41-a2d1-f0f2a25512df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:54.345151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91c9e711-1c24-4f41-a2d1-f0f2a25512df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:54.345917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91c9e711-1c24-4f41-a2d1-f0f2a25512df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:54.346499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91c9e711-1c24-4f41-a2d1-f0f2a25512df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:54.347065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91c9e711-1c24-4f41-a2d1-f0f2a25512df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:54.493245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-91c9e711-1c24-4f41-a2d1-f0f2a25512df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:54.502657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-91c9e711-1c24-4f41-a2d1-f0f2a25512df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:54.506446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-91c9e711-1c24-4f41-a2d1-f0f2a25512df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:54.513142 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-91c9e711-1c24-4f41-a2d1-f0f2a25512df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1319 microversion: 2.25 time: 0.211080 Sep 06 10:51:54.517923 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 203/432] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:51:54 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:51:54.530127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6c432424-3ea2-41e7-977d-74bc974b8f7f tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:54.530958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6c432424-3ea2-41e7-977d-74bc974b8f7f tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:54.549093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c432424-3ea2-41e7-977d-74bc974b8f7f tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:54.550770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c432424-3ea2-41e7-977d-74bc974b8f7f tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:54.551466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c432424-3ea2-41e7-977d-74bc974b8f7f tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:54.552677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c432424-3ea2-41e7-977d-74bc974b8f7f tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:54.554539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c432424-3ea2-41e7-977d-74bc974b8f7f tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:54.556065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c432424-3ea2-41e7-977d-74bc974b8f7f tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:54.617447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6c432424-3ea2-41e7-977d-74bc974b8f7f tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:51:54.621862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:54.961026 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6c432424-3ea2-41e7-977d-74bc974b8f7f tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 204 len: 0 microversion: 2.1 time: 0.441211 Sep 06 10:51:54.961976 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 204/433] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:51:54 2022] DELETE /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:51:55.068840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-20a3572b-c2e7-4dbd-bf77-644b1ebd1bfe tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Calling method '.version_select at 0x7f90f8d17040>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:55.072477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a3572b-c2e7-4dbd-bf77-644b1ebd1bfe tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:55.073311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a3572b-c2e7-4dbd-bf77-644b1ebd1bfe tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:55.073980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a3572b-c2e7-4dbd-bf77-644b1ebd1bfe tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:55.112883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a3572b-c2e7-4dbd-bf77-644b1ebd1bfe tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:55.114232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a3572b-c2e7-4dbd-bf77-644b1ebd1bfe tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:55.116350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a3572b-c2e7-4dbd-bf77-644b1ebd1bfe tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:55.157557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a3572b-c2e7-4dbd-bf77-644b1ebd1bfe tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:55.159149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a3572b-c2e7-4dbd-bf77-644b1ebd1bfe tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:55.162473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a3572b-c2e7-4dbd-bf77-644b1ebd1bfe tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:55.173929 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-20a3572b-c2e7-4dbd-bf77-644b1ebd1bfe tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.828073 Sep 06 10:51:55.205291 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 230/434] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:51:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:55.221012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2ddb67e6-4abe-4eba-8656-5e054e2d6cad tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Calling method '.version_select at 0x7f90f94c0310>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:55.225028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2ddb67e6-4abe-4eba-8656-5e054e2d6cad tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '483145a466ca47029d351d05525b7e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7dedf5039043e99d49f60d147cfe3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2ddb67e6-4abe-4eba-8656-5e054e2d6cad tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Request method failure captured: Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZGoPwxjDppL5bYZjXDPe0GIsiRlw7qvtJjR2PDvyR6yVUTRczAw301N5RsiYA5rf4Mz-TmTCU1cZ_DdllcIZRKR_R-IDMMxU9M9H3N7SKykzmEotFYMCcZMsg-LvJXm9MqdcCwWTJchcgd21xNb1dIlAojOVJv9mKwuZL9ZmNxkHs Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 9d7dedf5039043e99d49f60d147cfe3a Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:51:55.236128 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:51:55.237485 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7dedf5039043e99d49f60d147cfe3a"}]}] Sep 06 10:51:55.237485 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:55.237485 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 9d7dedf5039043e99d49f60d147cfe3a Sep 06 10:51:55.237485 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:55.237485 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-HypervisorAdminNegativeTestJSON-1902737589-project Sep 06 10:51:55.237485 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:51:55.237485 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:51:55.237485 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 483145a466ca47029d351d05525b7e05 Sep 06 10:51:55.237485 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589-project Sep 06 10:51:55.237485 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:51:55.237485 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 06 10:51:55.237485 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '1'} Sep 06 10:51:55.237485 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:55.238217 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 06 10:51:55.241645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.243571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2ddb67e6-4abe-4eba-8656-5e054e2d6cad tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:55.243571 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2ddb67e6-4abe-4eba-8656-5e054e2d6cad tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.022754 Sep 06 10:51:55.248799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb3256a7-9060-48bf-9c8a-2236420bd34c tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Calling method '.version_select at 0x7f90f8d50280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:55.252816 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 205/435] 10.222.0.20 () {58 vars in 1173 bytes} [Tue Sep 6 10:51:55 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:55.270591 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-fb3256a7-9060-48bf-9c8a-2236420bd34c tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] HTTP exception thrown: Hypervisor with ID '35e6320e-1436-4c14-b747-e9403b43f27b' could not be found. Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb3256a7-9060-48bf-9c8a-2236420bd34c tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Request method failure captured: Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hypervisors/35e6320e-1436-4c14-b747-e9403b43f27b/uptime HTTP/1.1 Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZJJLiKwaM_7_4BCxxlcmOzCAM8H5D6nWT6DDZJgZ1H8v1WPu5SF4va3eZIVK7DLPPndTB3Vq0x_ymHJ9h3JwcT-jLn-XKmEM0HibebMgotcqw83xfGC3C4dWqmGHajeCjoAoZVxZq4fzGteL-NY28K7YZyekc-RIphhM4L3VprMmQ Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 5a7a8a969966467291c440899443b8c5 Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1078413191 Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:55.285726 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:55.287275 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a7a8a969966467291c440899443b8c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a7a8a969966467291c440899443b8c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a7a8a969966467291c440899443b8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a7a8a969966467291c440899443b8c5"}]}] Sep 06 10:51:55.287275 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1078413191 Sep 06 10:51:55.287275 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 5a7a8a969966467291c440899443b8c5 Sep 06 10:51:55.287275 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1078413191 Sep 06 10:51:55.287275 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin Sep 06 10:51:55.287275 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:55.287275 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:55.287275 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d184ba9bb82a4cae820b2270bf1ff561 Sep 06 10:51:55.287275 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin Sep 06 10:51:55.287275 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:55.287275 ncdv-master-1 devstack@n-api.service[140876]: exception: Hypervisor with ID '35e6320e-1436-4c14-b747-e9403b43f27b' could not be found. Sep 06 10:51:55.287275 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '35e6320e-1436-4c14-b747-e9403b43f27b'} Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '35e6320e-1436-4c14-b747-e9403b43f27b' Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 06 10:51:55.288228 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '35e6320e-1436-4c14-b747-e9403b43f27b' could not be found. Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:55.290476 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.291985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.291985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:55.291985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:55.291985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:55.291985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:55.291985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '35e6320e-1436-4c14-b747-e9403b43f27b' could not be found. Sep 06 10:51:55.291985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.301873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb3256a7-9060-48bf-9c8a-2236420bd34c tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Returning 404 to user: Hypervisor with ID '35e6320e-1436-4c14-b747-e9403b43f27b' could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:55.304547 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fb3256a7-9060-48bf-9c8a-2236420bd34c tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/35e6320e-1436-4c14-b747-e9403b43f27b/uptime" status: 404 len: 123 microversion: 2.1 time: 0.060523 Sep 06 10:51:55.306594 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 231/436] 10.222.0.20 () {58 vars in 1278 bytes} [Tue Sep 6 10:51:55 2022] GET /compute/v2.1/os-hypervisors/35e6320e-1436-4c14-b747-e9403b43f27b/uptime => generated 123 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:51:55.320212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7fd360ee-4348-4d8f-b834-700a1de3bcdc tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Calling method '.version_select at 0x7f90f8ce71f0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:55.327468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fd360ee-4348-4d8f-b834-700a1de3bcdc tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:55.328017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fd360ee-4348-4d8f-b834-700a1de3bcdc tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:55.328419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fd360ee-4348-4d8f-b834-700a1de3bcdc tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:55.361640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fd360ee-4348-4d8f-b834-700a1de3bcdc tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:55.362145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fd360ee-4348-4d8f-b834-700a1de3bcdc tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:55.364836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fd360ee-4348-4d8f-b834-700a1de3bcdc tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:55.393449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fd360ee-4348-4d8f-b834-700a1de3bcdc tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:55.395160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fd360ee-4348-4d8f-b834-700a1de3bcdc tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:55.398545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fd360ee-4348-4d8f-b834-700a1de3bcdc tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:55.424129 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7fd360ee-4348-4d8f-b834-700a1de3bcdc tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.110383 Sep 06 10:51:55.426215 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 232/437] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:51:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:55.437997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-56f49b42-714d-4350-9648-34e3aa5f4cd6 tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Calling method '.version_select at 0x7f90f8cbe280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:55.443436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-56f49b42-714d-4350-9648-34e3aa5f4cd6 tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '483145a466ca47029d351d05525b7e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7dedf5039043e99d49f60d147cfe3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-56f49b42-714d-4350-9648-34e3aa5f4cd6 tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Request method failure captured: Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZGoPwxjDppL5bYZjXDPe0GIsiRlw7qvtJjR2PDvyR6yVUTRczAw301N5RsiYA5rf4Mz-TmTCU1cZ_DdllcIZRKR_R-IDMMxU9M9H3N7SKykzmEotFYMCcZMsg-LvJXm9MqdcCwWTJchcgd21xNb1dIlAojOVJv9mKwuZL9ZmNxkHs Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 9d7dedf5039043e99d49f60d147cfe3a Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:51:55.449602 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:51:55.451249 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d7dedf5039043e99d49f60d147cfe3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7dedf5039043e99d49f60d147cfe3a"}]}] Sep 06 10:51:55.451249 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:55.451249 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 9d7dedf5039043e99d49f60d147cfe3a Sep 06 10:51:55.451249 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589 Sep 06 10:51:55.451249 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HypervisorAdminNegativeTestJSON-1902737589-project Sep 06 10:51:55.451249 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:55.451249 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:55.451249 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 483145a466ca47029d351d05525b7e05 Sep 06 10:51:55.451249 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1902737589-project Sep 06 10:51:55.451249 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:55.451249 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 06 10:51:55.451249 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '1'} Sep 06 10:51:55.451249 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:51:55.452158 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 06 10:51:55.453512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.456773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-56f49b42-714d-4350-9648-34e3aa5f4cd6 tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:55.458235 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-56f49b42-714d-4350-9648-34e3aa5f4cd6 tempest-HypervisorAdminNegativeTestJSON-1902737589 tempest-HypervisorAdminNegativeTestJSON-1902737589-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.025534 Sep 06 10:51:55.462125 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 233/438] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:51:55 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:51:55.481404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9eab727e-eea9-4a8b-b4e2-a8d531bbf355 tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Calling method '.version_select at 0x7f90f8ce7d30>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:55.490584 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-9eab727e-eea9-4a8b-b4e2-a8d531bbf355 tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] HTTP exception thrown: Hypervisor with ID 'a56056f2-c5ae-4e19-8ddf-76a1b3fbca0f' could not be found. Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9eab727e-eea9-4a8b-b4e2-a8d531bbf355 tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Request method failure captured: Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hypervisors/a56056f2-c5ae-4e19-8ddf-76a1b3fbca0f HTTP/1.1 Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZJJLiKwaM_7_4BCxxlcmOzCAM8H5D6nWT6DDZJgZ1H8v1WPu5SF4va3eZIVK7DLPPndTB3Vq0x_ymHJ9h3JwcT-jLn-XKmEM0HibebMgotcqw83xfGC3C4dWqmGHajeCjoAoZVxZq4fzGteL-NY28K7YZyekc-RIphhM4L3VprMmQ Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 5a7a8a969966467291c440899443b8c5 Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1078413191 Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:51:55.496443 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:51:55.506774 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a7a8a969966467291c440899443b8c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a7a8a969966467291c440899443b8c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a7a8a969966467291c440899443b8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a7a8a969966467291c440899443b8c5"}]}] Sep 06 10:51:55.506774 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1078413191 Sep 06 10:51:55.506774 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 5a7a8a969966467291c440899443b8c5 Sep 06 10:51:55.506774 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1078413191 Sep 06 10:51:55.506774 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin Sep 06 10:51:55.506774 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:51:55.506774 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:51:55.506774 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d184ba9bb82a4cae820b2270bf1ff561 Sep 06 10:51:55.506774 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin Sep 06 10:51:55.506774 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:51:55.506774 ncdv-master-1 devstack@n-api.service[140876]: exception: Hypervisor with ID 'a56056f2-c5ae-4e19-8ddf-76a1b3fbca0f' could not be found. Sep 06 10:51:55.506774 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'a56056f2-c5ae-4e19-8ddf-76a1b3fbca0f'} Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a56056f2-c5ae-4e19-8ddf-76a1b3fbca0f' Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 06 10:51:55.507609 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 06 10:51:55.509287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a56056f2-c5ae-4e19-8ddf-76a1b3fbca0f' could not be found. Sep 06 10:51:55.510614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.510614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:51:55.510614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.510614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:51:55.510614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:51:55.510614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:51:55.510614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:51:55.510614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:51:55.510614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a56056f2-c5ae-4e19-8ddf-76a1b3fbca0f' could not be found. Sep 06 10:51:55.510614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:51:55.510614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9eab727e-eea9-4a8b-b4e2-a8d531bbf355 tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] Returning 404 to user: Hypervisor with ID 'a56056f2-c5ae-4e19-8ddf-76a1b3fbca0f' could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:51:55.510614 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9eab727e-eea9-4a8b-b4e2-a8d531bbf355 tempest-HypervisorAdminNegativeTestJSON-1078413191 tempest-HypervisorAdminNegativeTestJSON-1078413191-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/a56056f2-c5ae-4e19-8ddf-76a1b3fbca0f" status: 404 len: 123 microversion: 2.1 time: 0.032925 Sep 06 10:51:55.514406 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 234/439] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Sep 6 10:51:55 2022] GET /compute/v2.1/os-hypervisors/a56056f2-c5ae-4e19-8ddf-76a1b3fbca0f => generated 123 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:51:55.547236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9e64c988-7ecb-49f8-a90f-aa7278e3c43f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:55.548579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9e64c988-7ecb-49f8-a90f-aa7278e3c43f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:55.561075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e64c988-7ecb-49f8-a90f-aa7278e3c43f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:55.561799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e64c988-7ecb-49f8-a90f-aa7278e3c43f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:55.561999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e64c988-7ecb-49f8-a90f-aa7278e3c43f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:55.566970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e64c988-7ecb-49f8-a90f-aa7278e3c43f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:55.569357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e64c988-7ecb-49f8-a90f-aa7278e3c43f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:55.570003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e64c988-7ecb-49f8-a90f-aa7278e3c43f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:55.733795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-199623629", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "83241706-ada5-4425-9544-55285e98247c"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:55.859858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] validate_networks() for [('83241706-ada5-4425-9544-55285e98247c', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:51:56.163777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9e64c988-7ecb-49f8-a90f-aa7278e3c43f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:56.178444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9e64c988-7ecb-49f8-a90f-aa7278e3c43f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:56.179899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9e64c988-7ecb-49f8-a90f-aa7278e3c43f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:56.181038 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9e64c988-7ecb-49f8-a90f-aa7278e3c43f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1361 microversion: 2.25 time: 0.639364 Sep 06 10:51:56.181585 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 235/440] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:51:55 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1361 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:51:56.201790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-503160730", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "998844218", "adminPass": "***", "networks": [{"uuid": "3f066fd1-1af6-498a-be39-83353a05a19a"}], "security_groups": [{"name": "tempest-securitygroup--1540844153"}], "key_name": "tempest-keypair-338547195", "user_data": "}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:56.646571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] validate_networks() for [('3f066fd1-1af6-498a-be39-83353a05a19a', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:51:58.155561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:51:58.156935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:51:58.157533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:51:58.158024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:51:58.158517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:51:58.169073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:58.170308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:58.170934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:58.171862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:58.172480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:58.173758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:58.221293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Getting quotas for project fb1af95268504c5bbed702fce756f5f4. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:51:58.236551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Getting quotas for user c4e1ac1b40e94dbc80548a1f45919b6f and project fb1af95268504c5bbed702fce756f5f4. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:51:58.270344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:58.271822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:51:58.274249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:51:58.452250 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-42adebea-2807-4b71-a1d1-8ded95b7484f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.157389 Sep 06 10:51:58.453181 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 206/441] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:51:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:51:58.665787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:51:58.666352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:51:58.667134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:51:58.667689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:51:58.668203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:51:58.708790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:58.711771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:58.714315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:58.716401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:58.720638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:58.727751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:58.790513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Getting quotas for project c2078a32d1694ba3b1393762add00729. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:51:58.803225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Getting quotas for user 6f59260019b34b0b8c4c8792afe8b317 and project c2078a32d1694ba3b1393762add00729. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:51:58.842948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:51:58.847739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:51:59.089822 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0c0d0383-1ba7-4a2a-9cc5-093bd64c5a3a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.900640 Sep 06 10:51:59.110142 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 236/442] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:51:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:51:59.153594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-131715945", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:59.261984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:51:59.376379 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-95f6aa18-bc48-43ce-afea-eb6b445533d9 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] 10.222.0.20 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.264777 Sep 06 10:51:59.382197 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 237/443] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Sep 6 10:51:59 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 10:51:59.382197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-c16721b1-b30a-45e5-ae16-0ada29254659 req-341e0378-bccf-42e0-a1d8-121e82a7a6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2328e1f-4118-416a-94bd-e0e51ab9002c", "tag": "c0304443-2c0c-425a-b04d-74a367a3d905"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:51:59.414144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c16721b1-b30a-45e5-ae16-0ada29254659 req-341e0378-bccf-42e0-a1d8-121e82a7a6b0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:59.414630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c16721b1-b30a-45e5-ae16-0ada29254659 req-341e0378-bccf-42e0-a1d8-121e82a7a6b0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:59.415087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c16721b1-b30a-45e5-ae16-0ada29254659 req-341e0378-bccf-42e0-a1d8-121e82a7a6b0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:59.445024 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-c16721b1-b30a-45e5-ae16-0ada29254659 req-341e0378-bccf-42e0-a1d8-121e82a7a6b0 service nova] Creating event network-changed:c0304443-2c0c-425a-b04d-74a367a3d905 for instance c2328e1f-4118-416a-94bd-e0e51ab9002c on nch2-master-1 Sep 06 10:51:59.459237 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-c16721b1-b30a-45e5-ae16-0ada29254659 req-341e0378-bccf-42e0-a1d8-121e82a7a6b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080794 Sep 06 10:51:59.460366 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 238/444] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:51:59.468333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d6ed4936-eb1d-4330-9b21-337654612fd1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:51:59.469371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d6ed4936-eb1d-4330-9b21-337654612fd1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:51:59.489229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d6ed4936-eb1d-4330-9b21-337654612fd1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:59.489728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d6ed4936-eb1d-4330-9b21-337654612fd1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:59.490176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d6ed4936-eb1d-4330-9b21-337654612fd1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:59.490937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d6ed4936-eb1d-4330-9b21-337654612fd1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:59.491787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d6ed4936-eb1d-4330-9b21-337654612fd1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:59.492677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d6ed4936-eb1d-4330-9b21-337654612fd1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:59.845272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d6ed4936-eb1d-4330-9b21-337654612fd1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:59.864765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d6ed4936-eb1d-4330-9b21-337654612fd1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:59.867297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d6ed4936-eb1d-4330-9b21-337654612fd1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:51:59.874127 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d6ed4936-eb1d-4330-9b21-337654612fd1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1361 microversion: 2.25 time: 0.412001 Sep 06 10:51:59.875244 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 239/445] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:51:59 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1361 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:51:59.936127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:51:59.936551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:51:59.937026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:51:59.937437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:51:59.937850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:51:59.957621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:59.958262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:59.958912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:59.960314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:51:59.960877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:51:59.964706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:51:59.987416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Getting quotas for project 4882f2c8ef9c4f29bf3cbaa93cf9d488. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:51:59.999203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Getting quotas for user e425c7348db042389a189daa866ea06d and project 4882f2c8ef9c4f29bf3cbaa93cf9d488. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:52:00.048940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:52:00.051426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:52:00.237843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-29101016-b67f-4cf8-80a4-19ca10fb5488 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Calling method '.version_select at 0x7f90f8d90820>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:00.240759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29101016-b67f-4cf8-80a4-19ca10fb5488 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:00.243646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29101016-b67f-4cf8-80a4-19ca10fb5488 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:00.244359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29101016-b67f-4cf8-80a4-19ca10fb5488 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:00.284506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29101016-b67f-4cf8-80a4-19ca10fb5488 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:00.294745 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8f03aeb8-dc29-45ed-aff3-6245af4df61d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.839604 Sep 06 10:52:00.312483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29101016-b67f-4cf8-80a4-19ca10fb5488 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:00.316995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29101016-b67f-4cf8-80a4-19ca10fb5488 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:00.326098 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 207/446] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:51:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:52:00.352850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-017176da-5a89-4a6d-84d5-1a757f3b43ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:00.354818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-017176da-5a89-4a6d-84d5-1a757f3b43ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:00.365502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29101016-b67f-4cf8-80a4-19ca10fb5488 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:00.370068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29101016-b67f-4cf8-80a4-19ca10fb5488 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:00.373090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29101016-b67f-4cf8-80a4-19ca10fb5488 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:00.405706 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-29101016-b67f-4cf8-80a4-19ca10fb5488 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.526481 Sep 06 10:52:00.407720 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 240/447] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:51:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:00.422191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ce0f2234-fb18-45b3-abf6-206ab306210a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:00.424402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ce0f2234-fb18-45b3-abf6-206ab306210a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:00.628317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce0f2234-fb18-45b3-abf6-206ab306210a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:00.643401 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ce0f2234-fb18-45b3-abf6-206ab306210a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1261 microversion: 2.1 time: 0.233612 Sep 06 10:52:00.665184 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 241/448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:00 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:00.668105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-017176da-5a89-4a6d-84d5-1a757f3b43ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:00.670928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dd42c4f9-97be-4b03-93a6-6584d5fdefb7 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Calling method '.version_select at 0x7f90f8d90ca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:00.717814 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-017176da-5a89-4a6d-84d5-1a757f3b43ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1210 microversion: 2.1 time: 0.386143 Sep 06 10:52:00.721814 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 208/449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:00 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1210 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:00.729265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a43666c3-7667-4c0c-a27d-489012c13701 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:00.730681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a43666c3-7667-4c0c-a27d-489012c13701 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:00.776639 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-dd42c4f9-97be-4b03-93a6-6584d5fdefb7 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] HTTP exception thrown: Image not found. Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dd42c4f9-97be-4b03-93a6-6584d5fdefb7 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Request method failure captured: Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZMqwHiauxuVNBW15KL44l4TJSPD0ZfBV9RXNrzTr5VFdo4wgeGwD6bv4NWfjruHj7WjkUjCHiXwghOh46EcsruqcMk42R0wQ4yfAwAWNMLV1X49SS2an1N5gLmklFZ0PsG_LVHTw_KBeCTkavAZILlAfIzLwSIh9Aj1rj-VxzrKoY Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 7118c94664984394b216e9f1d77cef7d Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:52:00.784127 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7118c94664984394b216e9f1d77cef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7118c94664984394b216e9f1d77cef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7118c94664984394b216e9f1d77cef7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7118c94664984394b216e9f1d77cef7d"}]}] Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 7118c94664984394b216e9f1d77cef7d Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesDeleteNegativeTestJSON-704836384-project Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: a0ea2319d9794a5a8ce7de8b5df76fec Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-704836384-project Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: exception: Image not found. Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '-1'} Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:00.785866 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:00.786847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:00.788156 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 06 10:52:00.790437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:52:00.790437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:52:00.790437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:00.790437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:00.790437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:00.790437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:00.790437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:00.790437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:00.790437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:00.790437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:00.790437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:52:00.790437 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:00.801311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dd42c4f9-97be-4b03-93a6-6584d5fdefb7 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Returning 404 to user: Image not found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:00.808985 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dd42c4f9-97be-4b03-93a6-6584d5fdefb7 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] 10.222.0.20 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.136141 Sep 06 10:52:00.808985 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 242/450] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Sep 6 10:52:00 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:52:00.820479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-40c3ac68-ef9a-4001-b0bb-caf76dcf63ca req-fa48f1fa-49c4-483f-954b-34e2c1eb0ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9007e9-46e7-420d-8c1d-dc40c1c212de", "name": "network-vif-deleted", "tag": "36edbd4f-0314-40a6-8427-33258c8c5ddc"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:00.849322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a43666c3-7667-4c0c-a27d-489012c13701 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:00.861253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-40c3ac68-ef9a-4001-b0bb-caf76dcf63ca req-fa48f1fa-49c4-483f-954b-34e2c1eb0ac9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:00.874093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-40c3ac68-ef9a-4001-b0bb-caf76dcf63ca req-fa48f1fa-49c4-483f-954b-34e2c1eb0ac9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:00.874678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-40c3ac68-ef9a-4001-b0bb-caf76dcf63ca req-fa48f1fa-49c4-483f-954b-34e2c1eb0ac9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:00.875364 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a43666c3-7667-4c0c-a27d-489012c13701 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1221 microversion: 2.1 time: 0.149775 Sep 06 10:52:00.877939 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 209/451] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:00 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1221 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:00.921058 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-40c3ac68-ef9a-4001-b0bb-caf76dcf63ca req-fa48f1fa-49c4-483f-954b-34e2c1eb0ac9 service nova] Creating event network-vif-deleted:36edbd4f-0314-40a6-8427-33258c8c5ddc for instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de on nch1-master-1 Sep 06 10:52:00.943564 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-40c3ac68-ef9a-4001-b0bb-caf76dcf63ca req-fa48f1fa-49c4-483f-954b-34e2c1eb0ac9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135906 Sep 06 10:52:00.944176 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 243/452] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:00.963920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26fdb0ab-2c52-4a09-ab7c-2860143054e9 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Calling method '.version_select at 0x7f90f8bcd5e0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:01.066406 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-26fdb0ab-2c52-4a09-ab7c-2860143054e9 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] HTTP exception thrown: Image not found. Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26fdb0ab-2c52-4a09-ab7c-2860143054e9 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Request method failure captured: Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/images/31c78dc9-876a-49c1-ad0d-1356b2ebe7dj HTTP/1.1 Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZMqwHiauxuVNBW15KL44l4TJSPD0ZfBV9RXNrzTr5VFdo4wgeGwD6bv4NWfjruHj7WjkUjCHiXwghOh46EcsruqcMk42R0wQ4yfAwAWNMLV1X49SS2an1N5gLmklFZ0PsG_LVHTw_KBeCTkavAZILlAfIzLwSIh9Aj1rj-VxzrKoY Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 7118c94664984394b216e9f1d77cef7d Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:52:01.068533 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:52:01.070111 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7118c94664984394b216e9f1d77cef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7118c94664984394b216e9f1d77cef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7118c94664984394b216e9f1d77cef7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7118c94664984394b216e9f1d77cef7d"}]}] Sep 06 10:52:01.070111 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:01.070111 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 7118c94664984394b216e9f1d77cef7d Sep 06 10:52:01.070111 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:01.070111 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesDeleteNegativeTestJSON-704836384-project Sep 06 10:52:01.070111 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:52:01.070111 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:52:01.070111 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: a0ea2319d9794a5a8ce7de8b5df76fec Sep 06 10:52:01.070111 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-704836384-project Sep 06 10:52:01.070111 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:52:01.070111 ncdv-master-1 devstack@n-api.service[140876]: exception: Image not found. Sep 06 10:52:01.070111 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '31c78dc9-876a-49c1-ad0d-1356b2ebe7dj'} Sep 06 10:52:01.070111 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 31c78dc9-876a-49c1-ad0d-1356b2ebe7dj to delete Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.070962 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 31c78dc9-876a-49c1-ad0d-1356b2ebe7dj could not be found. Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:01.072350 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:01.073790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 06 10:52:01.073790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:52:01.073790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:52:01.073790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.073790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.073790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.073790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.073790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:01.073790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:01.073790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:01.073790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:01.073790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:52:01.073790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.076444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26fdb0ab-2c52-4a09-ab7c-2860143054e9 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Returning 404 to user: Image not found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:01.081397 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-26fdb0ab-2c52-4a09-ab7c-2860143054e9 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] 10.222.0.20 "DELETE /compute/v2.1/images/31c78dc9-876a-49c1-ad0d-1356b2ebe7dj" status: 404 len: 62 microversion: 2.1 time: 0.132194 Sep 06 10:52:01.081397 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 244/453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:00 2022] DELETE /compute/v2.1/images/31c78dc9-876a-49c1-ad0d-1356b2ebe7dj => generated 62 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:52:01.090492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-23b846f7-3643-4151-857c-5604a7d42a37 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:01.094778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-23b846f7-3643-4151-857c-5604a7d42a37 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:01.114089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23b846f7-3643-4151-857c-5604a7d42a37 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:01.118388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23b846f7-3643-4151-857c-5604a7d42a37 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:01.119199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23b846f7-3643-4151-857c-5604a7d42a37 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:01.124243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23b846f7-3643-4151-857c-5604a7d42a37 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:01.124940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23b846f7-3643-4151-857c-5604a7d42a37 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:01.127403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23b846f7-3643-4151-857c-5604a7d42a37 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:01.413999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eee19161-20b7-40a6-bf0f-5e3a28b726a2 tempest-HypervisorAdminNegativeUnderV252Test-601818415 tempest-HypervisorAdminNegativeUnderV252Test-601818415-project] Calling method '.version_select at 0x7f90f9572700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:01.416016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-eee19161-20b7-40a6-bf0f-5e3a28b726a2 tempest-HypervisorAdminNegativeUnderV252Test-601818415 tempest-HypervisorAdminNegativeUnderV252Test-601818415-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '5076cb5048a647f48c286d54fef25506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c44e342ed40efac7984922701f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eee19161-20b7-40a6-bf0f-5e3a28b726a2 tempest-HypervisorAdminNegativeUnderV252Test-601818415 tempest-HypervisorAdminNegativeUnderV252Test-601818415-project] Request method failure captured: Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-hypervisors/nch1-master-1/search HTTP/1.1 Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZLOQcBA6gbCpHjNakZa42K_nqECgvLhVJNwPdz3jnOrfuBZgUPKpjdmLx9r7LdeIkj0w2J7vrVJS1dHGvqqZXEZ9A1ksNztyovjLiFsRHhDW3YVDIHkgQ0VAfpYL9N2LKpLFzTyOtYlcHUVFNUUkH1kVsZRCVnZqhyWyH93W8i_1k Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 485c44e342ed40efac7984922701f623 Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-601818415 Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:52:01.417594 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:52:01.418828 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_485c44e342ed40efac7984922701f623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/485c44e342ed40efac7984922701f623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/485c44e342ed40efac7984922701f623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/485c44e342ed40efac7984922701f623"}]}] Sep 06 10:52:01.418828 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-601818415 Sep 06 10:52:01.418828 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 485c44e342ed40efac7984922701f623 Sep 06 10:52:01.418828 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-601818415 Sep 06 10:52:01.418828 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-601818415-project Sep 06 10:52:01.418828 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:01.418828 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:01.418828 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5076cb5048a647f48c286d54fef25506 Sep 06 10:52:01.418828 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-601818415-project Sep 06 10:52:01.418828 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:52:01.418828 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 06 10:52:01.418828 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'nch1-master-1'} Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:52:01.420208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 06 10:52:01.421270 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.422367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eee19161-20b7-40a6-bf0f-5e3a28b726a2 tempest-HypervisorAdminNegativeUnderV252Test-601818415 tempest-HypervisorAdminNegativeUnderV252Test-601818415-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:01.423358 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-eee19161-20b7-40a6-bf0f-5e3a28b726a2 tempest-HypervisorAdminNegativeUnderV252Test-601818415 tempest-HypervisorAdminNegativeUnderV252Test-601818415-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.541175 Sep 06 10:52:01.432014 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 210/454] 10.222.0.20 () {58 vars in 1209 bytes} [Tue Sep 6 10:52:00 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 553 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:52:01.445274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a80844e0-e59d-477a-9124-ef1a4e12af55 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Calling method '.version_select at 0x7f90f8db1ee0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:01.483362 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-a80844e0-e59d-477a-9124-ef1a4e12af55 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] HTTP exception thrown: Image not found. Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a80844e0-e59d-477a-9124-ef1a4e12af55 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Request method failure captured: Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/images/d00abda9-1813-42cc-bda0-389c6eba8e7b1 HTTP/1.1 Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZMqwHiauxuVNBW15KL44l4TJSPD0ZfBV9RXNrzTr5VFdo4wgeGwD6bv4NWfjruHj7WjkUjCHiXwghOh46EcsruqcMk42R0wQ4yfAwAWNMLV1X49SS2an1N5gLmklFZ0PsG_LVHTw_KBeCTkavAZILlAfIzLwSIh9Aj1rj-VxzrKoY Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 7118c94664984394b216e9f1d77cef7d Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:52:01.495308 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:52:01.512845 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7118c94664984394b216e9f1d77cef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7118c94664984394b216e9f1d77cef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7118c94664984394b216e9f1d77cef7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7118c94664984394b216e9f1d77cef7d"}]}] Sep 06 10:52:01.512845 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:01.512845 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 7118c94664984394b216e9f1d77cef7d Sep 06 10:52:01.512845 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:01.512845 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesDeleteNegativeTestJSON-704836384-project Sep 06 10:52:01.512845 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:01.512845 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:01.512845 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a0ea2319d9794a5a8ce7de8b5df76fec Sep 06 10:52:01.512845 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-704836384-project Sep 06 10:52:01.512845 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:52:01.512845 ncdv-master-1 devstack@n-api.service[140875]: exception: Image not found. Sep 06 10:52:01.512845 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'd00abda9-1813-42cc-bda0-389c6eba8e7b1'} Sep 06 10:52:01.512845 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d00abda9-1813-42cc-bda0-389c6eba8e7b1 to delete Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.514457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d00abda9-1813-42cc-bda0-389c6eba8e7b1 could not be found. Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:01.516421 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a80844e0-e59d-477a-9124-ef1a4e12af55 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Returning 404 to user: Image not found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:01.518614 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a80844e0-e59d-477a-9124-ef1a4e12af55 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] 10.222.0.20 "DELETE /compute/v2.1/images/d00abda9-1813-42cc-bda0-389c6eba8e7b1" status: 404 len: 62 microversion: 2.1 time: 0.067667 Sep 06 10:52:01.520025 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 211/455] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:52:01 2022] DELETE /compute/v2.1/images/d00abda9-1813-42cc-bda0-389c6eba8e7b1 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:52:01.526994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-04bfadae-e946-4013-9b3e-e84ad60fccab tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Calling method '.version_select at 0x7f90f8d94c10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:01.528906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04bfadae-e946-4013-9b3e-e84ad60fccab tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:01.529431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04bfadae-e946-4013-9b3e-e84ad60fccab tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:01.529829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04bfadae-e946-4013-9b3e-e84ad60fccab tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:01.537493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-23b846f7-3643-4151-857c-5604a7d42a37 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:01.566177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-04bfadae-e946-4013-9b3e-e84ad60fccab tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-04bfadae-e946-4013-9b3e-e84ad60fccab tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Request method failure captured: Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZNJKnUq77023QT3RfSe6AGU2cDIjbb4RnUOmMVbBvYz3VJzEMbCmd_lOVLV2yjcFnt1KR-brCOMlSUOZPiiFh-hWAPQIsj0WkryGj3iZd8sffAwrH5ZONNIwLRHQY5mCih_vDJTNsA0gCyQrtmoOoRfAJhc4RaRmo-sio4d34sDi8 Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: db54fd3987e9474ab1d8d095ad58ed27 Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1447622317 Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:52:01.569470 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:52:01.571059 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_db54fd3987e9474ab1d8d095ad58ed27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db54fd3987e9474ab1d8d095ad58ed27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/db54fd3987e9474ab1d8d095ad58ed27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db54fd3987e9474ab1d8d095ad58ed27"}]}] Sep 06 10:52:01.571059 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1447622317 Sep 06 10:52:01.571059 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: db54fd3987e9474ab1d8d095ad58ed27 Sep 06 10:52:01.571059 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1447622317 Sep 06 10:52:01.571059 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin Sep 06 10:52:01.571059 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:01.571059 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:01.571059 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5c9544c4607443cea7e9c5a454619d41 Sep 06 10:52:01.571059 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin Sep 06 10:52:01.571059 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:52:01.571059 ncdv-master-1 devstack@n-api.service[140875]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 06 10:52:01.571059 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.571905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:01.573243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:01.573243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:01.573243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:01.573243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 06 10:52:01.573243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.575057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-04bfadae-e946-4013-9b3e-e84ad60fccab tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:01.576981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-23b846f7-3643-4151-857c-5604a7d42a37 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:01.579434 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-04bfadae-e946-4013-9b3e-e84ad60fccab tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.069298 Sep 06 10:52:01.581088 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 212/456] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 10:52:01 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:52:01.584471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-23b846f7-3643-4151-857c-5604a7d42a37 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:01.600746 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-23b846f7-3643-4151-857c-5604a7d42a37 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1361 microversion: 2.25 time: 0.521547 Sep 06 10:52:01.601451 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 245/457] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:01 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1361 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:01.612896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-47034a12-930f-41ed-b6c7-8ee12ccd09b5 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Calling method '.version_select at 0x7f90f8db14c0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:01.628571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9e47631d-4d87-402d-8ecd-8e6992590173 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Calling method '.version_select at 0x7f90f8bcd430>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:01.630349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e47631d-4d87-402d-8ecd-8e6992590173 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:01.630837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e47631d-4d87-402d-8ecd-8e6992590173 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:01.645922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e47631d-4d87-402d-8ecd-8e6992590173 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:01.653899 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-47034a12-930f-41ed-b6c7-8ee12ccd09b5 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] HTTP exception thrown: Image not found. Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-47034a12-930f-41ed-b6c7-8ee12ccd09b5 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Request method failure captured: Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/images/tempest-invalid-34247185 HTTP/1.1 Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZMqwHiauxuVNBW15KL44l4TJSPD0ZfBV9RXNrzTr5VFdo4wgeGwD6bv4NWfjruHj7WjkUjCHiXwghOh46EcsruqcMk42R0wQ4yfAwAWNMLV1X49SS2an1N5gLmklFZ0PsG_LVHTw_KBeCTkavAZILlAfIzLwSIh9Aj1rj-VxzrKoY Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 7118c94664984394b216e9f1d77cef7d Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:52:01.655697 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:52:01.657227 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7118c94664984394b216e9f1d77cef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7118c94664984394b216e9f1d77cef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7118c94664984394b216e9f1d77cef7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7118c94664984394b216e9f1d77cef7d"}]}] Sep 06 10:52:01.657227 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:01.657227 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 7118c94664984394b216e9f1d77cef7d Sep 06 10:52:01.657227 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:01.657227 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesDeleteNegativeTestJSON-704836384-project Sep 06 10:52:01.657227 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:01.657227 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:01.657227 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a0ea2319d9794a5a8ce7de8b5df76fec Sep 06 10:52:01.657227 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-704836384-project Sep 06 10:52:01.657227 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:52:01.657227 ncdv-master-1 devstack@n-api.service[140875]: exception: Image not found. Sep 06 10:52:01.657227 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'tempest-invalid-34247185'} Sep 06 10:52:01.657227 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-34247185 to delete Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.658149 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-34247185 could not be found. Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:01.659298 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-47034a12-930f-41ed-b6c7-8ee12ccd09b5 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Returning 404 to user: Image not found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:01.668158 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-47034a12-930f-41ed-b6c7-8ee12ccd09b5 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] 10.222.0.20 "DELETE /compute/v2.1/images/tempest-invalid-34247185" status: 404 len: 62 microversion: 2.1 time: 0.064131 Sep 06 10:52:01.673053 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 213/458] 10.222.0.20 () {58 vars in 1200 bytes} [Tue Sep 6 10:52:01 2022] DELETE /compute/v2.1/images/tempest-invalid-34247185 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:52:01.692163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4c28afab-df10-4f32-94d6-6eff39726405 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Calling method '.version_select at 0x7f90f8e0e700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:01.693127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e47631d-4d87-402d-8ecd-8e6992590173 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:01.693682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e47631d-4d87-402d-8ecd-8e6992590173 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:01.694313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e47631d-4d87-402d-8ecd-8e6992590173 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:01.724153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e47631d-4d87-402d-8ecd-8e6992590173 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:01.724899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e47631d-4d87-402d-8ecd-8e6992590173 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:01.725505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e47631d-4d87-402d-8ecd-8e6992590173 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:01.742628 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9e47631d-4d87-402d-8ecd-8e6992590173 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.117653 Sep 06 10:52:01.750291 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-4c28afab-df10-4f32-94d6-6eff39726405 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] HTTP exception thrown: Image not found. Sep 06 10:52:01.750757 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 246/459] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:52:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4c28afab-df10-4f32-94d6-6eff39726405 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Request method failure captured: Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/images/6ee78dae-5cb2-4bd4-b12c-6a905aa55b93 HTTP/1.1 Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZMqwHiauxuVNBW15KL44l4TJSPD0ZfBV9RXNrzTr5VFdo4wgeGwD6bv4NWfjruHj7WjkUjCHiXwghOh46EcsruqcMk42R0wQ4yfAwAWNMLV1X49SS2an1N5gLmklFZ0PsG_LVHTw_KBeCTkavAZILlAfIzLwSIh9Aj1rj-VxzrKoY Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 7118c94664984394b216e9f1d77cef7d Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:52:01.752781 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:52:01.754338 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7118c94664984394b216e9f1d77cef7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7118c94664984394b216e9f1d77cef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7118c94664984394b216e9f1d77cef7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7118c94664984394b216e9f1d77cef7d"}]}] Sep 06 10:52:01.754338 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:01.754338 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 7118c94664984394b216e9f1d77cef7d Sep 06 10:52:01.754338 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-704836384 Sep 06 10:52:01.754338 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesDeleteNegativeTestJSON-704836384-project Sep 06 10:52:01.754338 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:01.754338 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:01.754338 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a0ea2319d9794a5a8ce7de8b5df76fec Sep 06 10:52:01.754338 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-704836384-project Sep 06 10:52:01.754338 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:52:01.754338 ncdv-master-1 devstack@n-api.service[140875]: exception: Image not found. Sep 06 10:52:01.754338 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '6ee78dae-5cb2-4bd4-b12c-6a905aa55b93'} Sep 06 10:52:01.754338 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6ee78dae-5cb2-4bd4-b12c-6a905aa55b93 to delete Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.755265 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6ee78dae-5cb2-4bd4-b12c-6a905aa55b93 could not be found. Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:01.757178 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:01.758844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 06 10:52:01.758844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:52:01.758844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:52:01.758844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.758844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:01.758844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.758844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:01.758844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:01.758844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:01.758844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:01.758844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:01.758844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:52:01.758844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:01.760597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-73767260-8198-4309-a900-fcefbde52a59 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:01.760597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-73767260-8198-4309-a900-fcefbde52a59 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:01.760751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4c28afab-df10-4f32-94d6-6eff39726405 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] Returning 404 to user: Image not found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:01.760751 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4c28afab-df10-4f32-94d6-6eff39726405 tempest-ImagesDeleteNegativeTestJSON-704836384 tempest-ImagesDeleteNegativeTestJSON-704836384-project] 10.222.0.20 "DELETE /compute/v2.1/images/6ee78dae-5cb2-4bd4-b12c-6a905aa55b93" status: 404 len: 62 microversion: 2.1 time: 0.082711 Sep 06 10:52:01.764662 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 214/460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:01 2022] DELETE /compute/v2.1/images/6ee78dae-5cb2-4bd4-b12c-6a905aa55b93 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:52:01.773309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3f532625-c899-4f83-b499-4e40887f415c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:01.774233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3f532625-c899-4f83-b499-4e40887f415c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:01.788551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f532625-c899-4f83-b499-4e40887f415c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:01.789204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f532625-c899-4f83-b499-4e40887f415c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:01.794954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73767260-8198-4309-a900-fcefbde52a59 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:01.795715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f532625-c899-4f83-b499-4e40887f415c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:01.796784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f532625-c899-4f83-b499-4e40887f415c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:01.797601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f532625-c899-4f83-b499-4e40887f415c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:01.798277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f532625-c899-4f83-b499-4e40887f415c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:01.799732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73767260-8198-4309-a900-fcefbde52a59 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:01.801175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73767260-8198-4309-a900-fcefbde52a59 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:01.803340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73767260-8198-4309-a900-fcefbde52a59 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:01.803782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73767260-8198-4309-a900-fcefbde52a59 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:01.807583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73767260-8198-4309-a900-fcefbde52a59 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:01.935473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3f532625-c899-4f83-b499-4e40887f415c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:01.967245 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3f532625-c899-4f83-b499-4e40887f415c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1206 microversion: 2.1 time: 0.195418 Sep 06 10:52:01.969315 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 215/461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:01 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1206 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:01.977984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c0d4d9d4-2726-48b4-81ad-e6eab7f8df53 tempest-HypervisorAdminNegativeUnderV252Test-601818415 tempest-HypervisorAdminNegativeUnderV252Test-601818415-project] Calling method '.version_select at 0x7f90f8e0ec10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:01.988300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c0d4d9d4-2726-48b4-81ad-e6eab7f8df53 tempest-HypervisorAdminNegativeUnderV252Test-601818415 tempest-HypervisorAdminNegativeUnderV252Test-601818415-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '5076cb5048a647f48c286d54fef25506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c44e342ed40efac7984922701f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c0d4d9d4-2726-48b4-81ad-e6eab7f8df53 tempest-HypervisorAdminNegativeUnderV252Test-601818415 tempest-HypervisorAdminNegativeUnderV252Test-601818415-project] Request method failure captured: Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZLOQcBA6gbCpHjNakZa42K_nqECgvLhVJNwPdz3jnOrfuBZgUPKpjdmLx9r7LdeIkj0w2J7vrVJS1dHGvqqZXEZ9A1ksNztyovjLiFsRHhDW3YVDIHkgQ0VAfpYL9N2LKpLFzTyOtYlcHUVFNUUkH1kVsZRCVnZqhyWyH93W8i_1k Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 485c44e342ed40efac7984922701f623 Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-601818415 Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:52:01.998317 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:52:02.002967 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_485c44e342ed40efac7984922701f623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/485c44e342ed40efac7984922701f623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/485c44e342ed40efac7984922701f623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/485c44e342ed40efac7984922701f623"}]}] Sep 06 10:52:02.002967 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-601818415 Sep 06 10:52:02.002967 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 485c44e342ed40efac7984922701f623 Sep 06 10:52:02.002967 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-601818415 Sep 06 10:52:02.002967 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-601818415-project Sep 06 10:52:02.002967 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:02.002967 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:02.002967 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5076cb5048a647f48c286d54fef25506 Sep 06 10:52:02.002967 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-601818415-project Sep 06 10:52:02.002967 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:52:02.002967 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 06 10:52:02.002967 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '1'} Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:52:02.003999 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 06 10:52:02.005546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:02.007543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c0d4d9d4-2726-48b4-81ad-e6eab7f8df53 tempest-HypervisorAdminNegativeUnderV252Test-601818415 tempest-HypervisorAdminNegativeUnderV252Test-601818415-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:02.015483 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c0d4d9d4-2726-48b4-81ad-e6eab7f8df53 tempest-HypervisorAdminNegativeUnderV252Test-601818415 tempest-HypervisorAdminNegativeUnderV252Test-601818415-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.039074 Sep 06 10:52:02.016225 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 216/462] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Sep 6 10:52:01 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:52:02.036216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-88e3125a-8f19-414a-91f1-1f1ec503f47f tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:02.039693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-88e3125a-8f19-414a-91f1-1f1ec503f47f tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:02.072452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-73767260-8198-4309-a900-fcefbde52a59 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:02.085630 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-73767260-8198-4309-a900-fcefbde52a59 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1257 microversion: 2.1 time: 0.330482 Sep 06 10:52:02.085630 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 247/463] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:01 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1257 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:02.116296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-28e9e129-ae61-4ec9-8f5d-482f5fedcb89 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Calling method '.version_select at 0x7f90f8d39c10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:02.125335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28e9e129-ae61-4ec9-8f5d-482f5fedcb89 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:02.126805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28e9e129-ae61-4ec9-8f5d-482f5fedcb89 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:02.127706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28e9e129-ae61-4ec9-8f5d-482f5fedcb89 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:02.144115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:02.151194 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-28e9e129-ae61-4ec9-8f5d-482f5fedcb89 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] HTTP exception thrown: No hypervisor matching 'db98a668-b7c9-46d0-833c-1fd70586e947' could be found. Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-28e9e129-ae61-4ec9-8f5d-482f5fedcb89 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Request method failure captured: Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-hypervisors/db98a668-b7c9-46d0-833c-1fd70586e947/servers HTTP/1.1 Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZNJKnUq77023QT3RfSe6AGU2cDIjbb4RnUOmMVbBvYz3VJzEMbCmd_lOVLV2yjcFnt1KR-brCOMlSUOZPiiFh-hWAPQIsj0WkryGj3iZd8sffAwrH5ZONNIwLRHQY5mCih_vDJTNsA0gCyQrtmoOoRfAJhc4RaRmo-sio4d34sDi8 Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: db54fd3987e9474ab1d8d095ad58ed27 Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1447622317 Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:52:02.155240 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:52:02.156541 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_db54fd3987e9474ab1d8d095ad58ed27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db54fd3987e9474ab1d8d095ad58ed27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/db54fd3987e9474ab1d8d095ad58ed27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db54fd3987e9474ab1d8d095ad58ed27"}]}] Sep 06 10:52:02.156541 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1447622317 Sep 06 10:52:02.156541 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: db54fd3987e9474ab1d8d095ad58ed27 Sep 06 10:52:02.156541 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1447622317 Sep 06 10:52:02.156541 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin Sep 06 10:52:02.156541 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:52:02.156541 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:52:02.156541 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5c9544c4607443cea7e9c5a454619d41 Sep 06 10:52:02.156541 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin Sep 06 10:52:02.156541 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:52:02.156541 ncdv-master-1 devstack@n-api.service[140876]: exception: No hypervisor matching 'db98a668-b7c9-46d0-833c-1fd70586e947' could be found. Sep 06 10:52:02.156541 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'db98a668-b7c9-46d0-833c-1fd70586e947'} Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'db98a668-b7c9-46d0-833c-1fd70586e947' could be found. Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:02.158458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:02.160161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:02.160161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:02.160161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:02.160161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:02.160161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'db98a668-b7c9-46d0-833c-1fd70586e947' could be found. Sep 06 10:52:02.160161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:02.160161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-28e9e129-ae61-4ec9-8f5d-482f5fedcb89 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] Returning 404 to user: No hypervisor matching 'db98a668-b7c9-46d0-833c-1fd70586e947' could be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:02.160161 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-28e9e129-ae61-4ec9-8f5d-482f5fedcb89 tempest-HypervisorAdminNegativeUnderV252Test-1447622317 tempest-HypervisorAdminNegativeUnderV252Test-1447622317-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/db98a668-b7c9-46d0-833c-1fd70586e947/servers" status: 404 len: 123 microversion: 2.1 time: 0.072905 Sep 06 10:52:02.177493 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 248/464] 10.222.0.20 () {58 vars in 1281 bytes} [Tue Sep 6 10:52:02 2022] GET /compute/v2.1/os-hypervisors/db98a668-b7c9-46d0-833c-1fd70586e947/servers => generated 123 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:52:02.204536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-88e3125a-8f19-414a-91f1-1f1ec503f47f tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:02.214712 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-88e3125a-8f19-414a-91f1-1f1ec503f47f tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1221 microversion: 2.1 time: 0.195556 Sep 06 10:52:02.216747 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 217/465] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:02 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1221 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:02.632328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7d05b3f5-e281-475f-a237-7a426acd8bb7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:02.633546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7d05b3f5-e281-475f-a237-7a426acd8bb7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:02.648346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d05b3f5-e281-475f-a237-7a426acd8bb7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:02.648847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d05b3f5-e281-475f-a237-7a426acd8bb7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:02.649294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d05b3f5-e281-475f-a237-7a426acd8bb7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:02.650091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d05b3f5-e281-475f-a237-7a426acd8bb7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:02.650557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d05b3f5-e281-475f-a237-7a426acd8bb7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:02.650992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d05b3f5-e281-475f-a237-7a426acd8bb7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:02.993404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d05b3f5-e281-475f-a237-7a426acd8bb7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:02.999792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5d100a3d-4a2a-4db9-a895-205e5a4e2579 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:03.001224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5d100a3d-4a2a-4db9-a895-205e5a4e2579 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:03.015609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d100a3d-4a2a-4db9-a895-205e5a4e2579 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:03.016910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d100a3d-4a2a-4db9-a895-205e5a4e2579 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:03.018359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d05b3f5-e281-475f-a237-7a426acd8bb7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:03.019286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d100a3d-4a2a-4db9-a895-205e5a4e2579 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:03.020322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d100a3d-4a2a-4db9-a895-205e5a4e2579 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:03.025586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d05b3f5-e281-475f-a237-7a426acd8bb7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:03.028915 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7d05b3f5-e281-475f-a237-7a426acd8bb7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1361 microversion: 2.25 time: 0.401593 Sep 06 10:52:03.037425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d100a3d-4a2a-4db9-a895-205e5a4e2579 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:03.037425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d100a3d-4a2a-4db9-a895-205e5a4e2579 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:03.054067 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 249/466] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:02 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1361 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:03.111446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2388aff3-ed86-4241-9dc7-ea36f996e290 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:03.120007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2388aff3-ed86-4241-9dc7-ea36f996e290 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:03.145203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2388aff3-ed86-4241-9dc7-ea36f996e290 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:03.149120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2388aff3-ed86-4241-9dc7-ea36f996e290 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:03.151075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2388aff3-ed86-4241-9dc7-ea36f996e290 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:03.153522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2388aff3-ed86-4241-9dc7-ea36f996e290 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:03.155808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2388aff3-ed86-4241-9dc7-ea36f996e290 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:03.161867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2388aff3-ed86-4241-9dc7-ea36f996e290 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:03.221909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5d100a3d-4a2a-4db9-a895-205e5a4e2579 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:03.233673 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5d100a3d-4a2a-4db9-a895-205e5a4e2579 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1206 microversion: 2.1 time: 0.240576 Sep 06 10:52:03.255708 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 218/467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:02 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1206 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:03.274446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-633c3aeb-2aff-41a3-b5af-32b46dce568d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:03.276047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-633c3aeb-2aff-41a3-b5af-32b46dce568d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:03.285187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-633c3aeb-2aff-41a3-b5af-32b46dce568d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:03.285890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-633c3aeb-2aff-41a3-b5af-32b46dce568d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:03.287035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-633c3aeb-2aff-41a3-b5af-32b46dce568d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:03.288089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-633c3aeb-2aff-41a3-b5af-32b46dce568d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:03.288759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-633c3aeb-2aff-41a3-b5af-32b46dce568d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:03.289396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-633c3aeb-2aff-41a3-b5af-32b46dce568d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:03.403567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2388aff3-ed86-4241-9dc7-ea36f996e290 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:03.421086 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2388aff3-ed86-4241-9dc7-ea36f996e290 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1313 microversion: 2.1 time: 0.314196 Sep 06 10:52:03.425317 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 250/468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:03 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:03.602210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-633c3aeb-2aff-41a3-b5af-32b46dce568d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:03.625019 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-633c3aeb-2aff-41a3-b5af-32b46dce568d tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1217 microversion: 2.1 time: 0.365494 Sep 06 10:52:03.645100 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 219/469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:03 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1217 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:04.064455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e0c78fff-31cc-4d3f-857b-3a9b439838cb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:04.065075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e0c78fff-31cc-4d3f-857b-3a9b439838cb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:04.079870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0c78fff-31cc-4d3f-857b-3a9b439838cb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:04.080382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0c78fff-31cc-4d3f-857b-3a9b439838cb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:04.080831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0c78fff-31cc-4d3f-857b-3a9b439838cb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:04.084261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0c78fff-31cc-4d3f-857b-3a9b439838cb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:04.084941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0c78fff-31cc-4d3f-857b-3a9b439838cb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:04.089332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0c78fff-31cc-4d3f-857b-3a9b439838cb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:04.275891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-40621c82-5724-49a6-aad7-87d5a3f01018 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:04.280746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-40621c82-5724-49a6-aad7-87d5a3f01018 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:04.313135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40621c82-5724-49a6-aad7-87d5a3f01018 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:04.314136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40621c82-5724-49a6-aad7-87d5a3f01018 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:04.317690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40621c82-5724-49a6-aad7-87d5a3f01018 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:04.319408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40621c82-5724-49a6-aad7-87d5a3f01018 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:04.320305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40621c82-5724-49a6-aad7-87d5a3f01018 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:04.322193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40621c82-5724-49a6-aad7-87d5a3f01018 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:04.718914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-40621c82-5724-49a6-aad7-87d5a3f01018 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:04.737352 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-40621c82-5724-49a6-aad7-87d5a3f01018 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1262 microversion: 2.1 time: 0.472186 Sep 06 10:52:04.738678 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 220/470] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:04 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1262 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:04.755804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a019fdde-60fb-4848-bca9-a9795cd10549 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:04.761730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a019fdde-60fb-4848-bca9-a9795cd10549 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:04.779707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a019fdde-60fb-4848-bca9-a9795cd10549 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:04.782793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a019fdde-60fb-4848-bca9-a9795cd10549 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:04.783627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a019fdde-60fb-4848-bca9-a9795cd10549 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:04.788997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a019fdde-60fb-4848-bca9-a9795cd10549 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:04.793673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a019fdde-60fb-4848-bca9-a9795cd10549 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:04.793673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a019fdde-60fb-4848-bca9-a9795cd10549 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:04.861418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e0c78fff-31cc-4d3f-857b-3a9b439838cb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:04.889568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e0c78fff-31cc-4d3f-857b-3a9b439838cb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:04.891565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e0c78fff-31cc-4d3f-857b-3a9b439838cb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:04.893321 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e0c78fff-31cc-4d3f-857b-3a9b439838cb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1361 microversion: 2.25 time: 0.834008 Sep 06 10:52:04.894100 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 251/471] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:04 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1361 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:52:04.899324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9014b88a-bd56-4f08-8ec4-fd8378f5844a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:04.909203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9014b88a-bd56-4f08-8ec4-fd8378f5844a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:04.914171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9014b88a-bd56-4f08-8ec4-fd8378f5844a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:04.914752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9014b88a-bd56-4f08-8ec4-fd8378f5844a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:04.915288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9014b88a-bd56-4f08-8ec4-fd8378f5844a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:04.916851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9014b88a-bd56-4f08-8ec4-fd8378f5844a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:04.918430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9014b88a-bd56-4f08-8ec4-fd8378f5844a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:04.919370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9014b88a-bd56-4f08-8ec4-fd8378f5844a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:05.642642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9014b88a-bd56-4f08-8ec4-fd8378f5844a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:05.666210 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9014b88a-bd56-4f08-8ec4-fd8378f5844a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1281 microversion: 2.1 time: 0.769832 Sep 06 10:52:05.674166 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 252/472] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:04 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1281 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:05.674462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a019fdde-60fb-4848-bca9-a9795cd10549 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:05.694747 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a019fdde-60fb-4848-bca9-a9795cd10549 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1319 microversion: 2.1 time: 0.953637 Sep 06 10:52:05.695913 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 221/473] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:04 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1319 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:05.719986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e7b0f804-61d5-4031-b055-f5bbcf77cd9c req-0867e36d-c140-438c-b236-858b0a3759d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2328e1f-4118-416a-94bd-e0e51ab9002c", "name": "network-vif-plugged", "status": "completed", "tag": "c0304443-2c0c-425a-b04d-74a367a3d905"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:05.755748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e7b0f804-61d5-4031-b055-f5bbcf77cd9c req-0867e36d-c140-438c-b236-858b0a3759d7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:05.756260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e7b0f804-61d5-4031-b055-f5bbcf77cd9c req-0867e36d-c140-438c-b236-858b0a3759d7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:05.758379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e7b0f804-61d5-4031-b055-f5bbcf77cd9c req-0867e36d-c140-438c-b236-858b0a3759d7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:05.795699 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e7b0f804-61d5-4031-b055-f5bbcf77cd9c req-0867e36d-c140-438c-b236-858b0a3759d7 service nova] Creating event network-vif-plugged:c0304443-2c0c-425a-b04d-74a367a3d905 for instance c2328e1f-4118-416a-94bd-e0e51ab9002c on nch2-master-1 Sep 06 10:52:05.810339 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e7b0f804-61d5-4031-b055-f5bbcf77cd9c req-0867e36d-c140-438c-b236-858b0a3759d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095685 Sep 06 10:52:05.818514 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 222/474] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:52:05.827315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5873183c-e39d-4f98-baf9-bc9bc79b41e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:05.828036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5873183c-e39d-4f98-baf9-bc9bc79b41e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:05.853279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5873183c-e39d-4f98-baf9-bc9bc79b41e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:05.860192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5873183c-e39d-4f98-baf9-bc9bc79b41e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:05.861373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5873183c-e39d-4f98-baf9-bc9bc79b41e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:05.862528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5873183c-e39d-4f98-baf9-bc9bc79b41e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:05.864706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5873183c-e39d-4f98-baf9-bc9bc79b41e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:05.866506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5873183c-e39d-4f98-baf9-bc9bc79b41e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:05.961786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7f8f2fb-e1f5-45a4-83b2-7b1813c8f306 tempest-QuotaClassesAdminTestJSON-531981082 tempest-QuotaClassesAdminTestJSON-531981082-project-admin] Calling method '.version_select at 0x7f90f8be4430>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:05.991598 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d7f8f2fb-e1f5-45a4-83b2-7b1813c8f306 tempest-QuotaClassesAdminTestJSON-531981082 tempest-QuotaClassesAdminTestJSON-531981082-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.316131 Sep 06 10:52:05.992186 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 253/475] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Sep 6 10:52:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:05.999819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-92b046f2-16a2-41ac-b518-6d7a28201438 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:06.000628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-92b046f2-16a2-41ac-b518-6d7a28201438 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:06.008797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92b046f2-16a2-41ac-b518-6d7a28201438 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:06.009518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92b046f2-16a2-41ac-b518-6d7a28201438 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:06.010084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92b046f2-16a2-41ac-b518-6d7a28201438 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:06.010865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92b046f2-16a2-41ac-b518-6d7a28201438 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:06.011441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92b046f2-16a2-41ac-b518-6d7a28201438 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:06.011883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92b046f2-16a2-41ac-b518-6d7a28201438 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:06.161515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5873183c-e39d-4f98-baf9-bc9bc79b41e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:06.183823 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5873183c-e39d-4f98-baf9-bc9bc79b41e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1268 microversion: 2.1 time: 0.362724 Sep 06 10:52:06.185598 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 223/476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:05 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1268 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:06.195740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e480d3d4-d20a-4ad4-a350-99e81ca91a17 tempest-QuotaClassesAdminTestJSON-531981082 tempest-QuotaClassesAdminTestJSON-531981082-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8d94ee0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:06.911306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-92b046f2-16a2-41ac-b518-6d7a28201438 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:06.930035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-92b046f2-16a2-41ac-b518-6d7a28201438 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:06.931989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-92b046f2-16a2-41ac-b518-6d7a28201438 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:06.938571 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-92b046f2-16a2-41ac-b518-6d7a28201438 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1361 microversion: 2.25 time: 0.944174 Sep 06 10:52:06.939354 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 254/477] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:05 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1361 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:06.963389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-54e258f5-9e4b-429d-845b-d317da4cd3f5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:06.964679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-54e258f5-9e4b-429d-845b-d317da4cd3f5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:06.972083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e258f5-9e4b-429d-845b-d317da4cd3f5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:06.972757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e258f5-9e4b-429d-845b-d317da4cd3f5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:06.976394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e258f5-9e4b-429d-845b-d317da4cd3f5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:06.976394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e258f5-9e4b-429d-845b-d317da4cd3f5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:06.976394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e258f5-9e4b-429d-845b-d317da4cd3f5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:06.976394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e258f5-9e4b-429d-845b-d317da4cd3f5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:07.070912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-54e258f5-9e4b-429d-845b-d317da4cd3f5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:07.081982 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-54e258f5-9e4b-429d-845b-d317da4cd3f5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1279 microversion: 2.1 time: 0.129076 Sep 06 10:52:07.098981 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 255/478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:06 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1279 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:07.104527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2db98dd1-f5ff-4bdc-ad42-44c6a11b6dec tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:07.105643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2db98dd1-f5ff-4bdc-ad42-44c6a11b6dec tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:07.115037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2db98dd1-f5ff-4bdc-ad42-44c6a11b6dec tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:07.115763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2db98dd1-f5ff-4bdc-ad42-44c6a11b6dec tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:07.116371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2db98dd1-f5ff-4bdc-ad42-44c6a11b6dec tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:07.117244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2db98dd1-f5ff-4bdc-ad42-44c6a11b6dec tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:07.117968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2db98dd1-f5ff-4bdc-ad42-44c6a11b6dec tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:07.118561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2db98dd1-f5ff-4bdc-ad42-44c6a11b6dec tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:07.516901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2db98dd1-f5ff-4bdc-ad42-44c6a11b6dec tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:07.537110 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2db98dd1-f5ff-4bdc-ad42-44c6a11b6dec tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1387 microversion: 2.1 time: 0.435554 Sep 06 10:52:07.539527 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 256/479] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:07 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1387 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:07.563182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0a1668ae-638c-4b31-939d-a7046937db10 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:07.564494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0a1668ae-638c-4b31-939d-a7046937db10 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:07.574450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a1668ae-638c-4b31-939d-a7046937db10 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:07.575583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a1668ae-638c-4b31-939d-a7046937db10 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:07.576036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a1668ae-638c-4b31-939d-a7046937db10 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:07.576756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a1668ae-638c-4b31-939d-a7046937db10 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:07.577222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a1668ae-638c-4b31-939d-a7046937db10 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:07.577726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a1668ae-638c-4b31-939d-a7046937db10 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:07.606055 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e480d3d4-d20a-4ad4-a350-99e81ca91a17 tempest-QuotaClassesAdminTestJSON-531981082 tempest-QuotaClassesAdminTestJSON-531981082-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.414239 Sep 06 10:52:07.607623 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 224/480] 10.222.0.20 () {60 vars in 1206 bytes} [Tue Sep 6 10:52:06 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:07.620207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4aae35eb-c654-47a0-b460-b4ee81c989bf tempest-QuotaClassesAdminTestJSON-531981082 tempest-QuotaClassesAdminTestJSON-531981082-project-admin] Calling method '.version_select at 0x7f90f8dbf5e0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:07.633912 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4aae35eb-c654-47a0-b460-b4ee81c989bf tempest-QuotaClassesAdminTestJSON-531981082 tempest-QuotaClassesAdminTestJSON-531981082-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.017431 Sep 06 10:52:07.650086 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 225/481] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Sep 6 10:52:07 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:07.657649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-82f66e75-117b-4cff-9628-fd863f5e52a4 tempest-QuotaClassesAdminTestJSON-531981082 tempest-QuotaClassesAdminTestJSON-531981082-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8e0eb80>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:07.815186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=13,nova_api:UPDATE=14 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:08.063296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0a1668ae-638c-4b31-939d-a7046937db10 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:08.081414 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0a1668ae-638c-4b31-939d-a7046937db10 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1310 microversion: 2.1 time: 0.537999 Sep 06 10:52:08.082520 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 257/482] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:07 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1310 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:08.109004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-19fed926-2cb6-450f-982d-876104a25e82 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:08.113410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-19fed926-2cb6-450f-982d-876104a25e82 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:08.122996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19fed926-2cb6-450f-982d-876104a25e82 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:08.126245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19fed926-2cb6-450f-982d-876104a25e82 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:08.127041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19fed926-2cb6-450f-982d-876104a25e82 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:08.135242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19fed926-2cb6-450f-982d-876104a25e82 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:08.135242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19fed926-2cb6-450f-982d-876104a25e82 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:08.135242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19fed926-2cb6-450f-982d-876104a25e82 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:08.495381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19fed926-2cb6-450f-982d-876104a25e82 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:08.507971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19fed926-2cb6-450f-982d-876104a25e82 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:08.510180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19fed926-2cb6-450f-982d-876104a25e82 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:08.511863 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-19fed926-2cb6-450f-982d-876104a25e82 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1557 microversion: 2.25 time: 0.414535 Sep 06 10:52:08.523041 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 258/483] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:08 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1557 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:08.523041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-61bbe675-caad-49a9-872d-e606a95c53aa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:08.523041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-61bbe675-caad-49a9-872d-e606a95c53aa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:08.534866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61bbe675-caad-49a9-872d-e606a95c53aa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:08.534866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61bbe675-caad-49a9-872d-e606a95c53aa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:08.534866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61bbe675-caad-49a9-872d-e606a95c53aa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:08.534866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61bbe675-caad-49a9-872d-e606a95c53aa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:08.535289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61bbe675-caad-49a9-872d-e606a95c53aa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:08.535289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61bbe675-caad-49a9-872d-e606a95c53aa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:08.751881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:08.832768 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-82f66e75-117b-4cff-9628-fd863f5e52a4 tempest-QuotaClassesAdminTestJSON-531981082 tempest-QuotaClassesAdminTestJSON-531981082-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.180433 Sep 06 10:52:08.835525 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 226/484] 10.222.0.20 () {60 vars in 1206 bytes} [Tue Sep 6 10:52:07 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:08.835866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-61bbe675-caad-49a9-872d-e606a95c53aa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:08.845539 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-61bbe675-caad-49a9-872d-e606a95c53aa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1321 microversion: 2.1 time: 0.330471 Sep 06 10:52:08.846402 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 259/485] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:08 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:08.874690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fc7f8bf4-9f39-43fb-a3b8-91ea0c16fe7a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:08.878603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fc7f8bf4-9f39-43fb-a3b8-91ea0c16fe7a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:08.885876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc7f8bf4-9f39-43fb-a3b8-91ea0c16fe7a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:08.886445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc7f8bf4-9f39-43fb-a3b8-91ea0c16fe7a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:08.887040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc7f8bf4-9f39-43fb-a3b8-91ea0c16fe7a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:08.887955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc7f8bf4-9f39-43fb-a3b8-91ea0c16fe7a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:08.888478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc7f8bf4-9f39-43fb-a3b8-91ea0c16fe7a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:08.889028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc7f8bf4-9f39-43fb-a3b8-91ea0c16fe7a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:09.278405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a406b726-d159-4f4f-90bb-88a4972c7551 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:09.280554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a406b726-d159-4f4f-90bb-88a4972c7551 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:09.301784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a406b726-d159-4f4f-90bb-88a4972c7551 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:09.302317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a406b726-d159-4f4f-90bb-88a4972c7551 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:09.302772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a406b726-d159-4f4f-90bb-88a4972c7551 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:09.303538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a406b726-d159-4f4f-90bb-88a4972c7551 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:09.308008 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a406b726-d159-4f4f-90bb-88a4972c7551 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:09.310542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a406b726-d159-4f4f-90bb-88a4972c7551 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:09.577003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fc7f8bf4-9f39-43fb-a3b8-91ea0c16fe7a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:09.595214 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fc7f8bf4-9f39-43fb-a3b8-91ea0c16fe7a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1387 microversion: 2.1 time: 0.734571 Sep 06 10:52:09.603651 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 260/486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:08 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1387 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:09.611221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-81271dd6-402f-4089-9a16-ea9b468249b9 req-da42747e-60df-4b28-9062-c882c5ddad6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb198d5-0fb1-4632-ae1f-dddec53a5ae9", "tag": "1cb8770a-9a75-4ea5-afaa-80e009e0a319"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:09.638895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-81271dd6-402f-4089-9a16-ea9b468249b9 req-da42747e-60df-4b28-9062-c882c5ddad6e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:09.638895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-81271dd6-402f-4089-9a16-ea9b468249b9 req-da42747e-60df-4b28-9062-c882c5ddad6e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:09.638895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-81271dd6-402f-4089-9a16-ea9b468249b9 req-da42747e-60df-4b28-9062-c882c5ddad6e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:09.651409 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-81271dd6-402f-4089-9a16-ea9b468249b9 req-da42747e-60df-4b28-9062-c882c5ddad6e service nova] Creating event network-changed:1cb8770a-9a75-4ea5-afaa-80e009e0a319 for instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 on nch1-master-1 Sep 06 10:52:09.658406 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-81271dd6-402f-4089-9a16-ea9b468249b9 req-da42747e-60df-4b28-9062-c882c5ddad6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055260 Sep 06 10:52:09.662183 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 261/487] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:09.677011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c6cea849-fe2d-44c5-a962-915f4947b134 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:09.679471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c6cea849-fe2d-44c5-a962-915f4947b134 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:09.696519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6cea849-fe2d-44c5-a962-915f4947b134 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:09.697739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6cea849-fe2d-44c5-a962-915f4947b134 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:09.698783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6cea849-fe2d-44c5-a962-915f4947b134 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:09.700173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6cea849-fe2d-44c5-a962-915f4947b134 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:09.701136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6cea849-fe2d-44c5-a962-915f4947b134 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:09.701983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6cea849-fe2d-44c5-a962-915f4947b134 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:09.971747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:10.407502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-a406b726-d159-4f4f-90bb-88a4972c7551 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid c2328e1f-4118-416a-94bd-e0e51ab9002c {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:52:10.466261 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a406b726-d159-4f4f-90bb-88a4972c7551 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 2049 microversion: 2.25 time: 1.629258 Sep 06 10:52:10.470002 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 227/488] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:08 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 2049 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:10.471680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9740ebe9-a7eb-4c67-920d-abb3544f062f req-b1a33810-b56e-4853-af40-e0563935a038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9162565a-4488-4d48-ba04-dfc70918d16d", "tag": "04beff9e-7cb6-41b4-b6e0-56c1debdbfcc"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:10.491588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9740ebe9-a7eb-4c67-920d-abb3544f062f req-b1a33810-b56e-4853-af40-e0563935a038 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:10.492167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9740ebe9-a7eb-4c67-920d-abb3544f062f req-b1a33810-b56e-4853-af40-e0563935a038 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:10.492670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9740ebe9-a7eb-4c67-920d-abb3544f062f req-b1a33810-b56e-4853-af40-e0563935a038 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:10.507335 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9740ebe9-a7eb-4c67-920d-abb3544f062f req-b1a33810-b56e-4853-af40-e0563935a038 service nova] Creating event network-changed:04beff9e-7cb6-41b4-b6e0-56c1debdbfcc for instance 9162565a-4488-4d48-ba04-dfc70918d16d on nch1-master-1 Sep 06 10:52:10.514469 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9740ebe9-a7eb-4c67-920d-abb3544f062f req-b1a33810-b56e-4853-af40-e0563935a038 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046145 Sep 06 10:52:10.518728 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 228/489] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:10.525842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5669cede-f41d-4cdf-a961-88a34cdcd952 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:10.526873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5669cede-f41d-4cdf-a961-88a34cdcd952 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:10.534279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5669cede-f41d-4cdf-a961-88a34cdcd952 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:10.534777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5669cede-f41d-4cdf-a961-88a34cdcd952 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:10.535575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5669cede-f41d-4cdf-a961-88a34cdcd952 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:10.536288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5669cede-f41d-4cdf-a961-88a34cdcd952 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:10.537062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5669cede-f41d-4cdf-a961-88a34cdcd952 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:10.537186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5669cede-f41d-4cdf-a961-88a34cdcd952 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:10.726084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c6cea849-fe2d-44c5-a962-915f4947b134 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:10.734552 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c6cea849-fe2d-44c5-a962-915f4947b134 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1310 microversion: 2.1 time: 1.071253 Sep 06 10:52:10.735159 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 262/490] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:09 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1310 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:10.739601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7d4d84f1-62f4-470d-afb5-dace165947d3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:10.740342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7d4d84f1-62f4-470d-afb5-dace165947d3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:10.747709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d4d84f1-62f4-470d-afb5-dace165947d3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:10.748309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d4d84f1-62f4-470d-afb5-dace165947d3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:10.748816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d4d84f1-62f4-470d-afb5-dace165947d3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:10.750136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d4d84f1-62f4-470d-afb5-dace165947d3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:10.751475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d4d84f1-62f4-470d-afb5-dace165947d3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:10.751934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d4d84f1-62f4-470d-afb5-dace165947d3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:11.056180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5669cede-f41d-4cdf-a961-88a34cdcd952 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:11.066429 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5669cede-f41d-4cdf-a961-88a34cdcd952 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1321 microversion: 2.1 time: 0.545750 Sep 06 10:52:11.067346 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 229/491] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:10 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1321 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:11.082754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e2ab3af9-546c-4bb9-b739-6e62eb7a8a90 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:11.083434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e2ab3af9-546c-4bb9-b739-6e62eb7a8a90 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:11.089445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2ab3af9-546c-4bb9-b739-6e62eb7a8a90 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:11.089934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2ab3af9-546c-4bb9-b739-6e62eb7a8a90 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:11.090374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2ab3af9-546c-4bb9-b739-6e62eb7a8a90 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:11.091122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2ab3af9-546c-4bb9-b739-6e62eb7a8a90 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:11.091584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2ab3af9-546c-4bb9-b739-6e62eb7a8a90 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:11.092018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2ab3af9-546c-4bb9-b739-6e62eb7a8a90 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:11.147401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-7d4d84f1-62f4-470d-afb5-dace165947d3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid c2328e1f-4118-416a-94bd-e0e51ab9002c {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:52:11.205115 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7d4d84f1-62f4-470d-afb5-dace165947d3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 2049 microversion: 2.25 time: 0.468807 Sep 06 10:52:11.205638 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 263/492] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:10 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 2049 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:11.230410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a10b5c2e-1d44-4dd7-97c9-1bb55cf6a783 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:11.234864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a10b5c2e-1d44-4dd7-97c9-1bb55cf6a783 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:11.235383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a10b5c2e-1d44-4dd7-97c9-1bb55cf6a783 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:11.235827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a10b5c2e-1d44-4dd7-97c9-1bb55cf6a783 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:11.236565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a10b5c2e-1d44-4dd7-97c9-1bb55cf6a783 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:11.237027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a10b5c2e-1d44-4dd7-97c9-1bb55cf6a783 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:11.237467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a10b5c2e-1d44-4dd7-97c9-1bb55cf6a783 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:11.275461 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a10b5c2e-1d44-4dd7-97c9-1bb55cf6a783 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.048737 Sep 06 10:52:11.276086 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 264/493] 10.222.0.20 () {60 vars in 1217 bytes} [Tue Sep 6 10:52:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 10:52:11.288807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-668ab697-af63-4b31-90b0-279fc5268856 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:11.291314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-668ab697-af63-4b31-90b0-279fc5268856 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:11.299314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-668ab697-af63-4b31-90b0-279fc5268856 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:11.299810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-668ab697-af63-4b31-90b0-279fc5268856 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:11.300250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-668ab697-af63-4b31-90b0-279fc5268856 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:11.300969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-668ab697-af63-4b31-90b0-279fc5268856 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:11.301420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-668ab697-af63-4b31-90b0-279fc5268856 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:11.302110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-668ab697-af63-4b31-90b0-279fc5268856 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:11.394837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-668ab697-af63-4b31-90b0-279fc5268856 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'flavor' on Instance uuid c2328e1f-4118-416a-94bd-e0e51ab9002c {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:52:11.403354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e2ab3af9-546c-4bb9-b739-6e62eb7a8a90 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:11.412595 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e2ab3af9-546c-4bb9-b739-6e62eb7a8a90 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1387 microversion: 2.1 time: 0.343956 Sep 06 10:52:11.413736 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 230/494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:11 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1387 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:11.445151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-668ab697-af63-4b31-90b0-279fc5268856 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Going to try to live migrate instance to nch1-master-1 {{(pid=140876) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 06 10:52:11.599744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:11.759084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5c75f680-e786-4a01-a928-aec18262f584 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:11.763258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5c75f680-e786-4a01-a928-aec18262f584 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:11.772202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5c75f680-e786-4a01-a928-aec18262f584 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:11.772894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5c75f680-e786-4a01-a928-aec18262f584 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:11.773508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5c75f680-e786-4a01-a928-aec18262f584 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:11.774566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5c75f680-e786-4a01-a928-aec18262f584 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:11.776031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5c75f680-e786-4a01-a928-aec18262f584 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:11.778065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5c75f680-e786-4a01-a928-aec18262f584 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:12.111687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5c75f680-e786-4a01-a928-aec18262f584 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:12.134970 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5c75f680-e786-4a01-a928-aec18262f584 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1310 microversion: 2.1 time: 0.380542 Sep 06 10:52:12.135807 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 231/495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:11 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1310 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:12.146915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2cffbc93-d47b-4b9d-a093-f594fd9d38e2 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:12.147607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2cffbc93-d47b-4b9d-a093-f594fd9d38e2 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:12.163424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cffbc93-d47b-4b9d-a093-f594fd9d38e2 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:12.164238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cffbc93-d47b-4b9d-a093-f594fd9d38e2 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:12.165866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cffbc93-d47b-4b9d-a093-f594fd9d38e2 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:12.166621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cffbc93-d47b-4b9d-a093-f594fd9d38e2 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:12.167543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cffbc93-d47b-4b9d-a093-f594fd9d38e2 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:12.171599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cffbc93-d47b-4b9d-a093-f594fd9d38e2 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:12.770581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2cffbc93-d47b-4b9d-a093-f594fd9d38e2 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:12.787780 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2cffbc93-d47b-4b9d-a093-f594fd9d38e2 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1321 microversion: 2.1 time: 0.651120 Sep 06 10:52:12.797547 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 232/496] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:12 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1321 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:13.055354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9df454fa-d07c-4986-9012-3877f48b8a03 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Calling method '.version_select at 0x7f90f8db1700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:13.143458 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9df454fa-d07c-4986-9012-3877f48b8a03 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96" status: 200 len: 371 microversion: 2.1 time: 0.350801 Sep 06 10:52:13.145623 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 233/497] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 10:52:12 2022] GET /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96 => generated 371 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:13.151574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6a8a6b4c-b1ce-4381-a837-79e32e8b2ef8 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:13.152739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6a8a6b4c-b1ce-4381-a837-79e32e8b2ef8 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:13.163558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8a6b4c-b1ce-4381-a837-79e32e8b2ef8 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:13.173755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8a6b4c-b1ce-4381-a837-79e32e8b2ef8 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:13.173755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8a6b4c-b1ce-4381-a837-79e32e8b2ef8 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:13.173755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8a6b4c-b1ce-4381-a837-79e32e8b2ef8 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:13.173755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8a6b4c-b1ce-4381-a837-79e32e8b2ef8 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:13.174349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8a6b4c-b1ce-4381-a837-79e32e8b2ef8 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:13.844467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6a8a6b4c-b1ce-4381-a837-79e32e8b2ef8 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:13.857302 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6a8a6b4c-b1ce-4381-a837-79e32e8b2ef8 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1387 microversion: 2.1 time: 0.710147 Sep 06 10:52:13.860271 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 234/498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:13 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1387 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:13.878956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6d5d036b-5340-4dfb-8dce-8ffc7672883b req-191df9a4-777b-4b37-b31a-0c981b904b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3679923f-ffbb-4dd3-bc2f-5789e13143eb", "tag": "2bb261a6-9f74-4480-ac5c-2f4c13f925bf"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:13.940735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6d5d036b-5340-4dfb-8dce-8ffc7672883b req-191df9a4-777b-4b37-b31a-0c981b904b31 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:13.941421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6d5d036b-5340-4dfb-8dce-8ffc7672883b req-191df9a4-777b-4b37-b31a-0c981b904b31 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:13.942456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6d5d036b-5340-4dfb-8dce-8ffc7672883b req-191df9a4-777b-4b37-b31a-0c981b904b31 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:13.978603 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6d5d036b-5340-4dfb-8dce-8ffc7672883b req-191df9a4-777b-4b37-b31a-0c981b904b31 service nova] Creating event network-changed:2bb261a6-9f74-4480-ac5c-2f4c13f925bf for instance 3679923f-ffbb-4dd3-bc2f-5789e13143eb on nch1-master-1 Sep 06 10:52:13.993701 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6d5d036b-5340-4dfb-8dce-8ffc7672883b req-191df9a4-777b-4b37-b31a-0c981b904b31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129855 Sep 06 10:52:14.001027 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 235/499] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:14.027419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-79437d3b-696f-440a-8069-8a96088dc589 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8db1a60>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:14.292767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79437d3b-696f-440a-8069-8a96088dc589 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:14.293420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79437d3b-696f-440a-8069-8a96088dc589 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:14.294227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79437d3b-696f-440a-8069-8a96088dc589 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:14.313002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79437d3b-696f-440a-8069-8a96088dc589 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:14.313619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79437d3b-696f-440a-8069-8a96088dc589 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:14.321001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79437d3b-696f-440a-8069-8a96088dc589 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:14.527703 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-79437d3b-696f-440a-8069-8a96088dc589 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96" status: 200 len: 328 microversion: 2.1 time: 0.523124 Sep 06 10:52:14.529594 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 236/500] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 10:52:14 2022] PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96 => generated 328 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:14.535073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-23f852f7-859c-4724-b02d-728d3ba06a11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:14.539533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-23f852f7-859c-4724-b02d-728d3ba06a11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:14.542637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23f852f7-859c-4724-b02d-728d3ba06a11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:14.543405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23f852f7-859c-4724-b02d-728d3ba06a11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:14.544686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23f852f7-859c-4724-b02d-728d3ba06a11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:14.545938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23f852f7-859c-4724-b02d-728d3ba06a11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:14.550616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23f852f7-859c-4724-b02d-728d3ba06a11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:14.551280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23f852f7-859c-4724-b02d-728d3ba06a11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:14.583696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:14.915519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-23f852f7-859c-4724-b02d-728d3ba06a11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:14.925369 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-23f852f7-859c-4724-b02d-728d3ba06a11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1310 microversion: 2.1 time: 0.394307 Sep 06 10:52:14.925937 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 237/501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:14 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1310 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:14.947679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-75b4bbe6-28ae-45a6-9d88-1294f05d451c tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:14.948381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-75b4bbe6-28ae-45a6-9d88-1294f05d451c tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:14.955989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75b4bbe6-28ae-45a6-9d88-1294f05d451c tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:14.960381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75b4bbe6-28ae-45a6-9d88-1294f05d451c tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:14.960381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75b4bbe6-28ae-45a6-9d88-1294f05d451c tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:14.960381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75b4bbe6-28ae-45a6-9d88-1294f05d451c tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:14.960381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75b4bbe6-28ae-45a6-9d88-1294f05d451c tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:14.960770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75b4bbe6-28ae-45a6-9d88-1294f05d451c tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:15.140014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-75b4bbe6-28ae-45a6-9d88-1294f05d451c tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:15.149348 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-75b4bbe6-28ae-45a6-9d88-1294f05d451c tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1321 microversion: 2.1 time: 0.221946 Sep 06 10:52:15.150035 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 238/502] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:14 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:15.714513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-909948625", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:15.824692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:52:15.988931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:16.211100 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-668ab697-af63-4b31-90b0-279fc5268856 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c/action" status: 202 len: 0 microversion: 2.25 time: 4.925923 Sep 06 10:52:16.215322 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 265/503] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 10:52:11 2022] POST /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c/action => generated 0 bytes in 4928 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 06 10:52:16.217828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4238d465-d7e3-45f8-bfa3-f38496d4f92c tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:16.218635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4238d465-d7e3-45f8-bfa3-f38496d4f92c tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:16.228435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4238d465-d7e3-45f8-bfa3-f38496d4f92c tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:16.228799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4238d465-d7e3-45f8-bfa3-f38496d4f92c tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:16.229341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4238d465-d7e3-45f8-bfa3-f38496d4f92c tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:16.230248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4238d465-d7e3-45f8-bfa3-f38496d4f92c tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:16.230939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4238d465-d7e3-45f8-bfa3-f38496d4f92c tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:16.231746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4238d465-d7e3-45f8-bfa3-f38496d4f92c tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:16.655297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:52:16.655949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:52:16.656600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:52:16.657016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:52:16.657461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:52:16.668508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:16.669712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:16.670155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:16.670964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:16.672630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:16.673082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:16.705765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Getting quotas for project 27c94fb551d3488ea0bbf8e8249bff96. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:52:16.714438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Getting quotas for user e12f56e39d3847dc886258de14e533ef and project 27c94fb551d3488ea0bbf8e8249bff96. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:52:16.748317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.utils [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] cores quota exceeded for 27c94fb551d3488ea0bbf8e8249bff96, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140875) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 06 10:52:16.751024 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Request method failure captured: Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 144 Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZaTc9TsUj98vEL0q_NdZ9DrI9pkBq82b9CKB9SegUOM2oUFhCQrfoABNJcGr8B1-4gQuJr04vZ0mZqXz-AMinmqgwiOMgSAtRJrFXEKmxGnO23f5CjSxPlL_hZSobhD4hjAn_-VoGXSvL-Xlw9i5PBDkhRe47aoztiQZ28DPsCq14 Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 27c94fb551d3488ea0bbf8e8249bff96 Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-QuotasAdminNegativeTest-136504040 Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:52:16.756495 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:52:16.758207 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27c94fb551d3488ea0bbf8e8249bff96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27c94fb551d3488ea0bbf8e8249bff96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27c94fb551d3488ea0bbf8e8249bff96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27c94fb551d3488ea0bbf8e8249bff96"}]}] Sep 06 10:52:16.758207 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-QuotasAdminNegativeTest-136504040 Sep 06 10:52:16.758207 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 27c94fb551d3488ea0bbf8e8249bff96 Sep 06 10:52:16.758207 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-136504040 Sep 06 10:52:16.758207 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-QuotasAdminNegativeTest-136504040-project Sep 06 10:52:16.758207 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:16.758207 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:16.758207 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e12f56e39d3847dc886258de14e533ef Sep 06 10:52:16.758207 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-QuotasAdminNegativeTest-136504040-project Sep 06 10:52:16.758207 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:52:16.758207 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-909948625", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} Sep 06 10:52:16.758207 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-909948625', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452'}}} Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 06 10:52:16.759151 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:16.760712 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:16.761990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:16.768865 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:16.768865 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:16.768865 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:16.768865 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:16.768865 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 06 10:52:16.768865 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:16.768865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:16.768865 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9c66ae03-e23c-4a1d-9cdd-43e6a52c276d tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.610097 Sep 06 10:52:16.768865 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 239/504] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:52:15 2022] POST /compute/v2.1/servers => generated 111 bytes in 1615 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:52:16.774849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-450ebf09-869d-458a-9791-748a958c3cfe req-c5c79d03-5a34-4592-9203-8676f8cb1d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9162565a-4488-4d48-ba04-dfc70918d16d", "name": "network-vif-plugged", "status": "completed", "tag": "04beff9e-7cb6-41b4-b6e0-56c1debdbfcc"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:16.788584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-450ebf09-869d-458a-9791-748a958c3cfe req-c5c79d03-5a34-4592-9203-8676f8cb1d96 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:16.789078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-450ebf09-869d-458a-9791-748a958c3cfe req-c5c79d03-5a34-4592-9203-8676f8cb1d96 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:16.789506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-450ebf09-869d-458a-9791-748a958c3cfe req-c5c79d03-5a34-4592-9203-8676f8cb1d96 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:16.802817 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-450ebf09-869d-458a-9791-748a958c3cfe req-c5c79d03-5a34-4592-9203-8676f8cb1d96 service nova] Creating event network-vif-plugged:04beff9e-7cb6-41b4-b6e0-56c1debdbfcc for instance 9162565a-4488-4d48-ba04-dfc70918d16d on nch1-master-1 Sep 06 10:52:16.810447 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-450ebf09-869d-458a-9791-748a958c3cfe req-c5c79d03-5a34-4592-9203-8676f8cb1d96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041617 Sep 06 10:52:16.812159 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 240/505] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:16.819325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fa1be0c2-dd3f-451c-b8c1-087e24cdc286 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:16.820116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fa1be0c2-dd3f-451c-b8c1-087e24cdc286 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:16.827313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa1be0c2-dd3f-451c-b8c1-087e24cdc286 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:16.828154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa1be0c2-dd3f-451c-b8c1-087e24cdc286 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:16.828805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa1be0c2-dd3f-451c-b8c1-087e24cdc286 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:16.829734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa1be0c2-dd3f-451c-b8c1-087e24cdc286 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:16.830402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa1be0c2-dd3f-451c-b8c1-087e24cdc286 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:16.831093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa1be0c2-dd3f-451c-b8c1-087e24cdc286 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:16.858740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4238d465-d7e3-45f8-bfa3-f38496d4f92c tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:16.875258 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4238d465-d7e3-45f8-bfa3-f38496d4f92c tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1387 microversion: 2.1 time: 0.661839 Sep 06 10:52:16.902231 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 266/506] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:16 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1387 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:16.919527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1828ffd1-332c-4cb1-9574-041bd866300e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:16.919527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1828ffd1-332c-4cb1-9574-041bd866300e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:16.928784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1828ffd1-332c-4cb1-9574-041bd866300e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:16.929418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1828ffd1-332c-4cb1-9574-041bd866300e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:16.929943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1828ffd1-332c-4cb1-9574-041bd866300e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:16.930739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1828ffd1-332c-4cb1-9574-041bd866300e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:16.931956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1828ffd1-332c-4cb1-9574-041bd866300e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:16.932668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1828ffd1-332c-4cb1-9574-041bd866300e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:17.279882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fa1be0c2-dd3f-451c-b8c1-087e24cdc286 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:17.286562 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fa1be0c2-dd3f-451c-b8c1-087e24cdc286 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1310 microversion: 2.1 time: 0.472734 Sep 06 10:52:17.288719 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 241/507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:16 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1310 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:17.294475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-85f1d52a-1fc6-4615-99e3-b849ede01fc4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:17.307823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-85f1d52a-1fc6-4615-99e3-b849ede01fc4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:17.316117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f1d52a-1fc6-4615-99e3-b849ede01fc4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:17.316913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f1d52a-1fc6-4615-99e3-b849ede01fc4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:17.318120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f1d52a-1fc6-4615-99e3-b849ede01fc4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:17.318689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f1d52a-1fc6-4615-99e3-b849ede01fc4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:17.319612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f1d52a-1fc6-4615-99e3-b849ede01fc4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:17.320859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f1d52a-1fc6-4615-99e3-b849ede01fc4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:17.419732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1828ffd1-332c-4cb1-9574-041bd866300e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:17.428048 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1828ffd1-332c-4cb1-9574-041bd866300e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1321 microversion: 2.1 time: 0.524352 Sep 06 10:52:17.431369 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 267/508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:16 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:17.451926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1fd37d98-83ba-4c9f-a2b2-b83ef4928f2b tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8bcda60>, body: {"quota_set": {"cores": 20}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:17.554061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-85f1d52a-1fc6-4615-99e3-b849ede01fc4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:17.570630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-85f1d52a-1fc6-4615-99e3-b849ede01fc4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:17.578078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-85f1d52a-1fc6-4615-99e3-b849ede01fc4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:17.579576 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-85f1d52a-1fc6-4615-99e3-b849ede01fc4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1567 microversion: 2.25 time: 0.289397 Sep 06 10:52:17.583819 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 242/509] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:17 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1567 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:18.002968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f5eb12e9-b3f2-484f-b9b7-6b3fe40c3667 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Calling method '.version_select at 0x7f90f8c03670>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:18.023835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:18.033133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fd37d98-83ba-4c9f-a2b2-b83ef4928f2b tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:18.033868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fd37d98-83ba-4c9f-a2b2-b83ef4928f2b tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:18.035570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fd37d98-83ba-4c9f-a2b2-b83ef4928f2b tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:18.036483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fd37d98-83ba-4c9f-a2b2-b83ef4928f2b tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:18.037105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fd37d98-83ba-4c9f-a2b2-b83ef4928f2b tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:18.037691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fd37d98-83ba-4c9f-a2b2-b83ef4928f2b tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:18.132133 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f5eb12e9-b3f2-484f-b9b7-6b3fe40c3667 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/6407ee2c2eaa42119a5e47facb834759" status: 200 len: 371 microversion: 2.1 time: 0.440202 Sep 06 10:52:18.132990 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 243/510] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 10:52:17 2022] GET /compute/v2.1/os-quota-sets/6407ee2c2eaa42119a5e47facb834759 => generated 371 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:52:18.137926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c8d1559a-f7cf-41ad-9e3b-0106ec9de988 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:18.138733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c8d1559a-f7cf-41ad-9e3b-0106ec9de988 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:18.145412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8d1559a-f7cf-41ad-9e3b-0106ec9de988 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:18.146518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8d1559a-f7cf-41ad-9e3b-0106ec9de988 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:18.147205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8d1559a-f7cf-41ad-9e3b-0106ec9de988 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:18.148093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8d1559a-f7cf-41ad-9e3b-0106ec9de988 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:18.148722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8d1559a-f7cf-41ad-9e3b-0106ec9de988 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:18.149321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8d1559a-f7cf-41ad-9e3b-0106ec9de988 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:18.219504 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1fd37d98-83ba-4c9f-a2b2-b83ef4928f2b tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96" status: 200 len: 329 microversion: 2.1 time: 0.781565 Sep 06 10:52:18.234372 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 268/511] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 10:52:17 2022] PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96 => generated 329 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:18.241401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4b29bc0-9fd2-4f60-b28d-be483a870f66 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8afd550>, body: {"quota_set": {"ram": "5120"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:18.327621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b29bc0-9fd2-4f60-b28d-be483a870f66 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:18.329641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b29bc0-9fd2-4f60-b28d-be483a870f66 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:18.329641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b29bc0-9fd2-4f60-b28d-be483a870f66 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:18.329641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b29bc0-9fd2-4f60-b28d-be483a870f66 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:18.330207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b29bc0-9fd2-4f60-b28d-be483a870f66 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:18.330348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b29bc0-9fd2-4f60-b28d-be483a870f66 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:18.440853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c8d1559a-f7cf-41ad-9e3b-0106ec9de988 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:18.451310 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c8d1559a-f7cf-41ad-9e3b-0106ec9de988 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1387 microversion: 2.1 time: 0.316473 Sep 06 10:52:18.452375 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 244/512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:18 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1387 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:18.486010 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b4b29bc0-9fd2-4f60-b28d-be483a870f66 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/6407ee2c2eaa42119a5e47facb834759" status: 200 len: 328 microversion: 2.1 time: 0.249191 Sep 06 10:52:18.488049 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 269/513] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 10:52:18 2022] PUT /compute/v2.1/os-quota-sets/6407ee2c2eaa42119a5e47facb834759 => generated 328 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:18.494338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-10028052-680a-4fd1-971a-bfbeeb47273b tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Calling method '.version_select at 0x7f90f8d901f0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:18.620056 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-10028052-680a-4fd1-971a-bfbeeb47273b tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96" status: 200 len: 371 microversion: 2.1 time: 0.130639 Sep 06 10:52:18.620820 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 270/514] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 10:52:18 2022] GET /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96 => generated 371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:18.633664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1e241086-f5ff-44c3-bb4f-4158f2af6202 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:18.634645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1e241086-f5ff-44c3-bb4f-4158f2af6202 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:18.645169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9f53492-7671-4ee5-bec4-022179088fcd tempest-SecurityGroupsTestAdminJSON-1450650556 tempest-SecurityGroupsTestAdminJSON-1450650556-project] Action: 'create', calling method: .version_select at 0x7f90f8db1ca0>, body: {"security_group": {"name": "tempest-securitygroup-298181588", "description": "tempest-description-656097594"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:18.654733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e241086-f5ff-44c3-bb4f-4158f2af6202 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:18.655256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e241086-f5ff-44c3-bb4f-4158f2af6202 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:18.655840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e241086-f5ff-44c3-bb4f-4158f2af6202 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:18.656558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e241086-f5ff-44c3-bb4f-4158f2af6202 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:18.657223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e241086-f5ff-44c3-bb4f-4158f2af6202 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:18.657652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e241086-f5ff-44c3-bb4f-4158f2af6202 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:19.241501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1e241086-f5ff-44c3-bb4f-4158f2af6202 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:19.250330 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1e241086-f5ff-44c3-bb4f-4158f2af6202 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1493 microversion: 2.1 time: 0.627314 Sep 06 10:52:19.274646 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 271/515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:18 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1493 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:19.274646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cc674399-1180-4df4-9734-239964a1c76a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:19.275641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cc674399-1180-4df4-9734-239964a1c76a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:19.282917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc674399-1180-4df4-9734-239964a1c76a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:19.283678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc674399-1180-4df4-9734-239964a1c76a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:19.284115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc674399-1180-4df4-9734-239964a1c76a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:19.284838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc674399-1180-4df4-9734-239964a1c76a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:19.285297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc674399-1180-4df4-9734-239964a1c76a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:19.285728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc674399-1180-4df4-9734-239964a1c76a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:19.758441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cc674399-1180-4df4-9734-239964a1c76a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:19.767046 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cc674399-1180-4df4-9734-239964a1c76a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1321 microversion: 2.1 time: 0.499145 Sep 06 10:52:19.767814 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 272/516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:19 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:19.772255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-84e68218-b5d9-4bdd-85d0-5edce7ec297a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:19.890944 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-84e68218-b5d9-4bdd-85d0-5edce7ec297a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-quota-sets/6407ee2c2eaa42119a5e47facb834759" status: 202 len: 0 microversion: 2.1 time: 0.122037 Sep 06 10:52:19.892417 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 273/517] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 10:52:19 2022] DELETE /compute/v2.1/os-quota-sets/6407ee2c2eaa42119a5e47facb834759 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:52:19.897621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-821fc4b0-48f0-4ad7-b4fd-a5093cb720c9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:19.898419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-821fc4b0-48f0-4ad7-b4fd-a5093cb720c9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:19.905943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-821fc4b0-48f0-4ad7-b4fd-a5093cb720c9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:19.906220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-821fc4b0-48f0-4ad7-b4fd-a5093cb720c9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:19.906848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-821fc4b0-48f0-4ad7-b4fd-a5093cb720c9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:19.907424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-821fc4b0-48f0-4ad7-b4fd-a5093cb720c9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:19.907839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-821fc4b0-48f0-4ad7-b4fd-a5093cb720c9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:19.908345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-821fc4b0-48f0-4ad7-b4fd-a5093cb720c9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:19.995895 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e9f53492-7671-4ee5-bec4-022179088fcd tempest-SecurityGroupsTestAdminJSON-1450650556 tempest-SecurityGroupsTestAdminJSON-1450650556-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.542132 Sep 06 10:52:19.997301 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 245/518] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:52:18 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:20.002319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-43b5c6c9-fb39-476d-9551-3758fb49b2e7 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8c03ee0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:20.064595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=72,nova_cell0:UPDATE=7 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:20.070375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43b5c6c9-fb39-476d-9551-3758fb49b2e7 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:20.071144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43b5c6c9-fb39-476d-9551-3758fb49b2e7 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:20.071637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43b5c6c9-fb39-476d-9551-3758fb49b2e7 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:20.072321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43b5c6c9-fb39-476d-9551-3758fb49b2e7 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:20.073089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43b5c6c9-fb39-476d-9551-3758fb49b2e7 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:20.073900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43b5c6c9-fb39-476d-9551-3758fb49b2e7 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:20.196167 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-43b5c6c9-fb39-476d-9551-3758fb49b2e7 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96" status: 200 len: 328 microversion: 2.1 time: 0.197750 Sep 06 10:52:20.196921 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 246/519] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 10:52:19 2022] PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96 => generated 328 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:20.230047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-821fc4b0-48f0-4ad7-b4fd-a5093cb720c9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:20.232748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-595f2331-82f8-40b3-8556-3909e622ab01 req-209507b5-1909-4b73-8ba5-628c12f97508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb198d5-0fb1-4632-ae1f-dddec53a5ae9", "name": "network-vif-plugged", "status": "completed", "tag": "1cb8770a-9a75-4ea5-afaa-80e009e0a319"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:20.239539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-821fc4b0-48f0-4ad7-b4fd-a5093cb720c9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:20.246016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-821fc4b0-48f0-4ad7-b4fd-a5093cb720c9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:20.250216 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-821fc4b0-48f0-4ad7-b4fd-a5093cb720c9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1567 microversion: 2.25 time: 0.356330 Sep 06 10:52:20.262977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-595f2331-82f8-40b3-8556-3909e622ab01 req-209507b5-1909-4b73-8ba5-628c12f97508 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:20.265729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-595f2331-82f8-40b3-8556-3909e622ab01 req-209507b5-1909-4b73-8ba5-628c12f97508 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:20.265928 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 274/520] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:19 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1567 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:20.266528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-595f2331-82f8-40b3-8556-3909e622ab01 req-209507b5-1909-4b73-8ba5-628c12f97508 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:20.295962 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-595f2331-82f8-40b3-8556-3909e622ab01 req-209507b5-1909-4b73-8ba5-628c12f97508 service nova] Creating event network-vif-plugged:1cb8770a-9a75-4ea5-afaa-80e009e0a319 for instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 on nch1-master-1 Sep 06 10:52:20.308477 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-595f2331-82f8-40b3-8556-3909e622ab01 req-209507b5-1909-4b73-8ba5-628c12f97508 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084019 Sep 06 10:52:20.309950 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 247/521] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:20.323038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0395ce08-dbdf-4265-a17a-c5fc07792f39 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:20.324445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0395ce08-dbdf-4265-a17a-c5fc07792f39 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:20.327793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:UPDATE=10,nova_api:SELECT=88,nova_api:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:20.332578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0395ce08-dbdf-4265-a17a-c5fc07792f39 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:20.333329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0395ce08-dbdf-4265-a17a-c5fc07792f39 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:20.333949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0395ce08-dbdf-4265-a17a-c5fc07792f39 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:20.334841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0395ce08-dbdf-4265-a17a-c5fc07792f39 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:20.335518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0395ce08-dbdf-4265-a17a-c5fc07792f39 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:20.336117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0395ce08-dbdf-4265-a17a-c5fc07792f39 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:20.591184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c35ebce9-35d7-478d-98cf-11534a45c5ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:20.591811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c35ebce9-35d7-478d-98cf-11534a45c5ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:20.599033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c35ebce9-35d7-478d-98cf-11534a45c5ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:20.599954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c35ebce9-35d7-478d-98cf-11534a45c5ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:20.600746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c35ebce9-35d7-478d-98cf-11534a45c5ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:20.602868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c35ebce9-35d7-478d-98cf-11534a45c5ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:20.604271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c35ebce9-35d7-478d-98cf-11534a45c5ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:20.604993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c35ebce9-35d7-478d-98cf-11534a45c5ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:20.630214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0395ce08-dbdf-4265-a17a-c5fc07792f39 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:20.638927 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0395ce08-dbdf-4265-a17a-c5fc07792f39 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1387 microversion: 2.1 time: 0.323931 Sep 06 10:52:20.639545 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 248/522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:20 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1387 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:20.647887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff23363f-4016-4832-b326-3456c0711085 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Calling method '.version_select at 0x7f90f8c035e0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:20.728480 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff23363f-4016-4832-b326-3456c0711085 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/6407ee2c2eaa42119a5e47facb834759" status: 200 len: 371 microversion: 2.1 time: 0.085464 Sep 06 10:52:20.729069 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 249/523] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 10:52:20 2022] GET /compute/v2.1/os-quota-sets/6407ee2c2eaa42119a5e47facb834759 => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:20.734924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b8da314e-373c-45a1-a278-036934cabe36 req-ca66b990-28b5-4199-9800-85e32bc0c5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2328e1f-4118-416a-94bd-e0e51ab9002c", "name": "network-vif-unplugged", "status": "completed", "tag": "c0304443-2c0c-425a-b04d-74a367a3d905"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:20.748404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b8da314e-373c-45a1-a278-036934cabe36 req-ca66b990-28b5-4199-9800-85e32bc0c5e1 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:20.748909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b8da314e-373c-45a1-a278-036934cabe36 req-ca66b990-28b5-4199-9800-85e32bc0c5e1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:20.749612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b8da314e-373c-45a1-a278-036934cabe36 req-ca66b990-28b5-4199-9800-85e32bc0c5e1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:20.763740 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b8da314e-373c-45a1-a278-036934cabe36 req-ca66b990-28b5-4199-9800-85e32bc0c5e1 service nova] Creating event network-vif-unplugged:c0304443-2c0c-425a-b04d-74a367a3d905 for instance c2328e1f-4118-416a-94bd-e0e51ab9002c on nch2-master-1 Sep 06 10:52:20.773318 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b8da314e-373c-45a1-a278-036934cabe36 req-ca66b990-28b5-4199-9800-85e32bc0c5e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039579 Sep 06 10:52:20.773318 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 250/524] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:20.777646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1ae6cfd8-ab68-4139-882c-75872d6040a7 tempest-SecurityGroupsTestAdminJSON-1450650556 tempest-SecurityGroupsTestAdminJSON-1450650556-project] Action: 'create', calling method: .version_select at 0x7f90f8e0e550>, body: {"security_group": {"name": "tempest-securitygroup-1918076502", "description": "tempest-description-2017698924"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:20.902180 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c35ebce9-35d7-478d-98cf-11534a45c5ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1644 microversion: 2.1 time: 0.635016 Sep 06 10:52:20.926117 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 275/525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:20 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1644 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:20.931059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1538934343", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:20.983461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:52:21.446957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:52:21.447403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:52:21.447934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:52:21.448406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:52:21.448928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:52:21.458888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:21.459410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:21.460309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:21.461092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:21.461598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:21.462034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:21.479885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Getting quotas for project 27c94fb551d3488ea0bbf8e8249bff96. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:52:21.485293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Getting quotas for user e12f56e39d3847dc886258de14e533ef and project 27c94fb551d3488ea0bbf8e8249bff96. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:52:21.500311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.utils [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] instances quota exceeded for 27c94fb551d3488ea0bbf8e8249bff96, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140876) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 06 10:52:21.501143 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Request method failure captured: Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 145 Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZaTc9TsUj98vEL0q_NdZ9DrI9pkBq82b9CKB9SegUOM2oUFhCQrfoABNJcGr8B1-4gQuJr04vZ0mZqXz-AMinmqgwiOMgSAtRJrFXEKmxGnO23f5CjSxPlL_hZSobhD4hjAn_-VoGXSvL-Xlw9i5PBDkhRe47aoztiQZ28DPsCq14 Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 27c94fb551d3488ea0bbf8e8249bff96 Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-QuotasAdminNegativeTest-136504040 Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:52:21.505930 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:52:21.507264 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27c94fb551d3488ea0bbf8e8249bff96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27c94fb551d3488ea0bbf8e8249bff96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27c94fb551d3488ea0bbf8e8249bff96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27c94fb551d3488ea0bbf8e8249bff96"}]}] Sep 06 10:52:21.507264 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-QuotasAdminNegativeTest-136504040 Sep 06 10:52:21.507264 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 27c94fb551d3488ea0bbf8e8249bff96 Sep 06 10:52:21.507264 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-136504040 Sep 06 10:52:21.507264 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-QuotasAdminNegativeTest-136504040-project Sep 06 10:52:21.507264 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:52:21.507264 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:52:21.507264 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e12f56e39d3847dc886258de14e533ef Sep 06 10:52:21.507264 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-QuotasAdminNegativeTest-136504040-project Sep 06 10:52:21.507264 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:52:21.507264 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1538934343", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} Sep 06 10:52:21.507264 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1538934343', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452'}}} Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 06 10:52:21.508712 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:21.510732 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:21.514362 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:21.517269 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:21.517269 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:21.517269 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:21.517269 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:21.517269 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 06 10:52:21.517269 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:21.517269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:21.517269 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0880f140-5f3e-4e5e-819a-c5a093adf0c6 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.580059 Sep 06 10:52:21.517269 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 276/526] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:52:20 2022] POST /compute/v2.1/servers => generated 119 bytes in 581 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:52:21.517269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3037c872-2f7f-4c41-a882-bf561ede446a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:21.517998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3037c872-2f7f-4c41-a882-bf561ede446a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:21.520038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3037c872-2f7f-4c41-a882-bf561ede446a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:21.520530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3037c872-2f7f-4c41-a882-bf561ede446a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:21.520976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3037c872-2f7f-4c41-a882-bf561ede446a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:21.521721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3037c872-2f7f-4c41-a882-bf561ede446a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:21.522181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3037c872-2f7f-4c41-a882-bf561ede446a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:21.522649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3037c872-2f7f-4c41-a882-bf561ede446a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:21.565385 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1ae6cfd8-ab68-4139-882c-75872d6040a7 tempest-SecurityGroupsTestAdminJSON-1450650556 tempest-SecurityGroupsTestAdminJSON-1450650556-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.792173 Sep 06 10:52:21.566352 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 251/527] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:52:20 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:21.571553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-20b12577-07f5-43ea-968c-30f6292b0a84 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:21.573005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-20b12577-07f5-43ea-968c-30f6292b0a84 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:21.580550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20b12577-07f5-43ea-968c-30f6292b0a84 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:21.581173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20b12577-07f5-43ea-968c-30f6292b0a84 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:21.581678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20b12577-07f5-43ea-968c-30f6292b0a84 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:21.589580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20b12577-07f5-43ea-968c-30f6292b0a84 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:21.589580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20b12577-07f5-43ea-968c-30f6292b0a84 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:21.589580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20b12577-07f5-43ea-968c-30f6292b0a84 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:21.777429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3037c872-2f7f-4c41-a882-bf561ede446a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:21.785666 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3037c872-2f7f-4c41-a882-bf561ede446a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1321 microversion: 2.1 time: 0.276703 Sep 06 10:52:21.786236 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 277/528] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:21 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:21.795332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-506294a1-2d78-4833-abae-d212dee7648d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Calling method '.version_select at 0x7f90f8ab60d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:21.855509 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-20b12577-07f5-43ea-968c-30f6292b0a84 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1644 microversion: 2.1 time: 0.288092 Sep 06 10:52:21.856913 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 252/529] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:21 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1644 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:21.866004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1e120ccd-cfcc-4785-af89-ff0aecf63b9f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:21.869035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1e120ccd-cfcc-4785-af89-ff0aecf63b9f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:21.884677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e120ccd-cfcc-4785-af89-ff0aecf63b9f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:21.885157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e120ccd-cfcc-4785-af89-ff0aecf63b9f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:21.885607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e120ccd-cfcc-4785-af89-ff0aecf63b9f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:21.886320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e120ccd-cfcc-4785-af89-ff0aecf63b9f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:21.886776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e120ccd-cfcc-4785-af89-ff0aecf63b9f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:21.887267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e120ccd-cfcc-4785-af89-ff0aecf63b9f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:22.048456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1e120ccd-cfcc-4785-af89-ff0aecf63b9f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:22.061968 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-506294a1-2d78-4833-abae-d212dee7648d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/e285e69559d04059b8f46cb6391cf1c5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.271959 Sep 06 10:52:22.063752 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 278/530] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 10:52:21 2022] GET /compute/v2.1/os-quota-sets/e285e69559d04059b8f46cb6391cf1c5/defaults => generated 371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:22.067835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1e120ccd-cfcc-4785-af89-ff0aecf63b9f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:22.069515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1e120ccd-cfcc-4785-af89-ff0aecf63b9f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:22.070913 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1e120ccd-cfcc-4785-af89-ff0aecf63b9f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1567 microversion: 2.25 time: 0.212913 Sep 06 10:52:22.075885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fffd9b37-3a87-4f97-a77f-c2699f923b29 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8afdaf0>, body: {"quota_set": {"instances": 10}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:22.091274 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 253/531] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:21 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:22.230445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-15305a95-3b63-48d3-a86a-f68e4e8ff2c7 tempest-SecurityGroupsTestAdminJSON-1989210912 tempest-SecurityGroupsTestAdminJSON-1989210912-project-admin] Action: 'create', calling method: .version_select at 0x7f90f8d94ee0>, body: {"security_group": {"name": "tempest-securitygroup-1069294735", "description": "tempest-description-2003273413"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:22.404694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fffd9b37-3a87-4f97-a77f-c2699f923b29 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:22.405264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fffd9b37-3a87-4f97-a77f-c2699f923b29 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:22.405963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fffd9b37-3a87-4f97-a77f-c2699f923b29 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:22.406891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fffd9b37-3a87-4f97-a77f-c2699f923b29 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:22.407480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fffd9b37-3a87-4f97-a77f-c2699f923b29 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:22.407994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fffd9b37-3a87-4f97-a77f-c2699f923b29 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:22.633469 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fffd9b37-3a87-4f97-a77f-c2699f923b29 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96" status: 200 len: 329 microversion: 2.1 time: 0.568235 Sep 06 10:52:22.634393 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 279/532] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 10:52:22 2022] PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96 => generated 329 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:22.642663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7afb5457-1383-445c-869f-820bcb494a17 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:22.643370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7afb5457-1383-445c-869f-820bcb494a17 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:22.651430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7afb5457-1383-445c-869f-820bcb494a17 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:22.651927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7afb5457-1383-445c-869f-820bcb494a17 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:22.652372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7afb5457-1383-445c-869f-820bcb494a17 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:22.653665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7afb5457-1383-445c-869f-820bcb494a17 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:22.654132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7afb5457-1383-445c-869f-820bcb494a17 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:22.654571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7afb5457-1383-445c-869f-820bcb494a17 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:22.813905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7afb5457-1383-445c-869f-820bcb494a17 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:22.822179 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7afb5457-1383-445c-869f-820bcb494a17 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1587 microversion: 2.1 time: 0.186329 Sep 06 10:52:22.828310 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 280/533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:22 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1587 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:22.828310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f53ff9e-cc72-444c-9301-e7fed44cfe02 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:22.831199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f53ff9e-cc72-444c-9301-e7fed44cfe02 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:22.831690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f53ff9e-cc72-444c-9301-e7fed44cfe02 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:22.832135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f53ff9e-cc72-444c-9301-e7fed44cfe02 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:22.832870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f53ff9e-cc72-444c-9301-e7fed44cfe02 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:22.833332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f53ff9e-cc72-444c-9301-e7fed44cfe02 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:22.833809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f53ff9e-cc72-444c-9301-e7fed44cfe02 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:22.856740 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7f53ff9e-cc72-444c-9301-e7fed44cfe02 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033012 Sep 06 10:52:22.857309 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 281/534] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Sep 6 10:52:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:22.880834 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-15305a95-3b63-48d3-a86a-f68e4e8ff2c7 tempest-SecurityGroupsTestAdminJSON-1989210912 tempest-SecurityGroupsTestAdminJSON-1989210912-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.784490 Sep 06 10:52:22.881667 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 254/535] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:52:22 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:22.886239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-02af766a-cdab-43cd-9bc7-2317daf2cad1 req-0b81f123-0262-4ac1-a7f4-098efc93162e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3679923f-ffbb-4dd3-bc2f-5789e13143eb", "name": "network-vif-plugged", "status": "completed", "tag": "2bb261a6-9f74-4480-ac5c-2f4c13f925bf"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:22.896252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-02af766a-cdab-43cd-9bc7-2317daf2cad1 req-0b81f123-0262-4ac1-a7f4-098efc93162e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:22.896732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-02af766a-cdab-43cd-9bc7-2317daf2cad1 req-0b81f123-0262-4ac1-a7f4-098efc93162e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:22.897095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-02af766a-cdab-43cd-9bc7-2317daf2cad1 req-0b81f123-0262-4ac1-a7f4-098efc93162e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:22.908418 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-02af766a-cdab-43cd-9bc7-2317daf2cad1 req-0b81f123-0262-4ac1-a7f4-098efc93162e service nova] Creating event network-vif-plugged:2bb261a6-9f74-4480-ac5c-2f4c13f925bf for instance 3679923f-ffbb-4dd3-bc2f-5789e13143eb on nch1-master-1 Sep 06 10:52:22.920664 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-02af766a-cdab-43cd-9bc7-2317daf2cad1 req-0b81f123-0262-4ac1-a7f4-098efc93162e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037629 Sep 06 10:52:22.921483 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 255/536] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:22.926612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-52840c4d-c17e-4778-bab2-ba6da6eb38fc tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8e0eb80>, body: {"quota_set": {"ram": "5120"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:23.045830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1781288542", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "a12e8367-831f-4a7b-ab55-8a1095444e0d"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:23.047651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52840c4d-c17e-4778-bab2-ba6da6eb38fc tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:23.048317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52840c4d-c17e-4778-bab2-ba6da6eb38fc tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:23.048931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52840c4d-c17e-4778-bab2-ba6da6eb38fc tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:23.049668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52840c4d-c17e-4778-bab2-ba6da6eb38fc tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:23.050307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52840c4d-c17e-4778-bab2-ba6da6eb38fc tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:23.050934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52840c4d-c17e-4778-bab2-ba6da6eb38fc tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:23.120259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] validate_networks() for [('a12e8367-831f-4a7b-ab55-8a1095444e0d', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:52:23.180426 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-52840c4d-c17e-4778-bab2-ba6da6eb38fc tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/beef80c06df043d3851b1c276931e881" status: 200 len: 328 microversion: 2.1 time: 0.257496 Sep 06 10:52:23.181112 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 256/537] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 10:52:22 2022] PUT /compute/v2.1/os-quota-sets/beef80c06df043d3851b1c276931e881 => generated 328 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:23.185915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24129962-53f5-4604-8cb3-8855c8ab457e tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Calling method '.version_select at 0x7f90f8d845e0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:23.257708 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-24129962-53f5-4604-8cb3-8855c8ab457e tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96" status: 200 len: 371 microversion: 2.1 time: 0.075649 Sep 06 10:52:23.265041 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 257/538] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 10:52:23 2022] GET /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96 => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:23.270095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-690182cf-fda6-41ad-801b-86354b5e7034 req-1423f5a8-7720-471c-8b2b-821f0d9210e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2328e1f-4118-416a-94bd-e0e51ab9002c", "tag": "c0304443-2c0c-425a-b04d-74a367a3d905"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:23.280470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-690182cf-fda6-41ad-801b-86354b5e7034 req-1423f5a8-7720-471c-8b2b-821f0d9210e9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:23.280959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-690182cf-fda6-41ad-801b-86354b5e7034 req-1423f5a8-7720-471c-8b2b-821f0d9210e9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:23.281733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-690182cf-fda6-41ad-801b-86354b5e7034 req-1423f5a8-7720-471c-8b2b-821f0d9210e9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:23.294162 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-690182cf-fda6-41ad-801b-86354b5e7034 req-1423f5a8-7720-471c-8b2b-821f0d9210e9 service nova] Creating event network-changed:c0304443-2c0c-425a-b04d-74a367a3d905 for instance c2328e1f-4118-416a-94bd-e0e51ab9002c on nch2-master-1 Sep 06 10:52:23.299367 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-690182cf-fda6-41ad-801b-86354b5e7034 req-1423f5a8-7720-471c-8b2b-821f0d9210e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032999 Sep 06 10:52:23.300399 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 258/539] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:23.305505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-19494255-15bd-42ff-8c2e-7d95ed6fec56 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:23.306198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-19494255-15bd-42ff-8c2e-7d95ed6fec56 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:23.313056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19494255-15bd-42ff-8c2e-7d95ed6fec56 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:23.313744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19494255-15bd-42ff-8c2e-7d95ed6fec56 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:23.314351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19494255-15bd-42ff-8c2e-7d95ed6fec56 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:23.315382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19494255-15bd-42ff-8c2e-7d95ed6fec56 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:23.316111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19494255-15bd-42ff-8c2e-7d95ed6fec56 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:23.316704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19494255-15bd-42ff-8c2e-7d95ed6fec56 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:23.555761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-19494255-15bd-42ff-8c2e-7d95ed6fec56 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:23.566375 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-19494255-15bd-42ff-8c2e-7d95ed6fec56 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1321 microversion: 2.1 time: 0.264743 Sep 06 10:52:23.567845 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 259/540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:23 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:23.574394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4d0eb56a-8de9-4c0b-be7a-0c651f1dfe6a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:23.575265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4d0eb56a-8de9-4c0b-be7a-0c651f1dfe6a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:23.582398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d0eb56a-8de9-4c0b-be7a-0c651f1dfe6a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:23.583234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d0eb56a-8de9-4c0b-be7a-0c651f1dfe6a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:23.584520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d0eb56a-8de9-4c0b-be7a-0c651f1dfe6a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:23.585426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d0eb56a-8de9-4c0b-be7a-0c651f1dfe6a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:23.586049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d0eb56a-8de9-4c0b-be7a-0c651f1dfe6a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:23.586640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d0eb56a-8de9-4c0b-be7a-0c651f1dfe6a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:23.599129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:52:23.599129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:52:23.599129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:52:23.599129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:52:23.599129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:52:23.619447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:23.620463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:23.621358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:23.622845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:23.626032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:23.630048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:23.652148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Getting quotas for project 52177b94887d409f9034b3cee40237dd. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:52:23.662009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Getting quotas for user 117e12084c60416aabce823ebae4f214 and project 52177b94887d409f9034b3cee40237dd. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:52:23.693143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:52:23.693143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:52:23.706327 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4d0eb56a-8de9-4c0b-be7a-0c651f1dfe6a tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137081 Sep 06 10:52:23.707533 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 260/541] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 10:52:23 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:23.716165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-363980ec-c876-418a-93ca-d20bcc5cb779 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:23.724615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-363980ec-c876-418a-93ca-d20bcc5cb779 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:23.738978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-363980ec-c876-418a-93ca-d20bcc5cb779 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:23.741294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-363980ec-c876-418a-93ca-d20bcc5cb779 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:23.745461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-363980ec-c876-418a-93ca-d20bcc5cb779 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:23.746407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-363980ec-c876-418a-93ca-d20bcc5cb779 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:23.747680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-363980ec-c876-418a-93ca-d20bcc5cb779 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:23.748281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-363980ec-c876-418a-93ca-d20bcc5cb779 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:23.862470 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-932449f0-710a-4fd0-a164-080ccf78600e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.004057 Sep 06 10:52:23.863183 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 282/542] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:52:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:52:23.872622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eae4621e-d911-42dc-bc48-c16da57070b6 tempest-SecurityGroupsTestAdminJSON-1989210912 tempest-SecurityGroupsTestAdminJSON-1989210912-project-admin] Action: 'create', calling method: .version_select at 0x7f90f8a2aca0>, body: {"security_group": {"name": "tempest-securitygroup-492359417", "description": "tempest-description-2038852833"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:23.876686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-363980ec-c876-418a-93ca-d20bcc5cb779 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lazy-loading 'flavor' on Instance uuid 9162565a-4488-4d48-ba04-dfc70918d16d {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:52:23.964163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-363980ec-c876-418a-93ca-d20bcc5cb779 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Going to try to live migrate instance to nch2-master-1 {{(pid=140875) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 06 10:52:25.196425 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eae4621e-d911-42dc-bc48-c16da57070b6 tempest-SecurityGroupsTestAdminJSON-1989210912 tempest-SecurityGroupsTestAdminJSON-1989210912-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.332131 Sep 06 10:52:25.197027 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 283/543] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:52:23 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:25.209670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-336a5c62-7bdc-4c4e-840a-ee61f1df093c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:25.210534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-336a5c62-7bdc-4c4e-840a-ee61f1df093c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:25.221943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-336a5c62-7bdc-4c4e-840a-ee61f1df093c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:25.222446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-336a5c62-7bdc-4c4e-840a-ee61f1df093c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:25.222898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-336a5c62-7bdc-4c4e-840a-ee61f1df093c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:25.225465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-336a5c62-7bdc-4c4e-840a-ee61f1df093c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:25.225978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-336a5c62-7bdc-4c4e-840a-ee61f1df093c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:25.226429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-336a5c62-7bdc-4c4e-840a-ee61f1df093c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:25.420173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-336a5c62-7bdc-4c4e-840a-ee61f1df093c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:25.428620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-336a5c62-7bdc-4c4e-840a-ee61f1df093c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:25.430081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-336a5c62-7bdc-4c4e-840a-ee61f1df093c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:25.431275 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-336a5c62-7bdc-4c4e-840a-ee61f1df093c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1567 microversion: 2.25 time: 0.225590 Sep 06 10:52:25.431827 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 284/544] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:25 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:25.436298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2967cb42-855a-406d-ac6f-1ba152cb74ba tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Calling method '.version_select at 0x7f90f8afdaf0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:25.500736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:25.509078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2967cb42-855a-406d-ac6f-1ba152cb74ba tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:25.509692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2967cb42-855a-406d-ac6f-1ba152cb74ba tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:25.510230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2967cb42-855a-406d-ac6f-1ba152cb74ba tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:25.511198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2967cb42-855a-406d-ac6f-1ba152cb74ba tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:25.511739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2967cb42-855a-406d-ac6f-1ba152cb74ba tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:25.512892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2967cb42-855a-406d-ac6f-1ba152cb74ba tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:25.533763 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2967cb42-855a-406d-ac6f-1ba152cb74ba tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/beef80c06df043d3851b1c276931e881/detail" status: 200 len: 916 microversion: 2.1 time: 0.100867 Sep 06 10:52:25.534694 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 285/545] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 10:52:25 2022] GET /compute/v2.1/os-quota-sets/beef80c06df043d3851b1c276931e881/detail => generated 916 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:25.539170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-276e0cb6-bc3a-4b22-8511-5252f86e88fb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8a85430>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:25.636083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-276e0cb6-bc3a-4b22-8511-5252f86e88fb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:25.637792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-276e0cb6-bc3a-4b22-8511-5252f86e88fb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:25.639996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-276e0cb6-bc3a-4b22-8511-5252f86e88fb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:25.642429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-276e0cb6-bc3a-4b22-8511-5252f86e88fb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:25.643496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-276e0cb6-bc3a-4b22-8511-5252f86e88fb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:25.644125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-276e0cb6-bc3a-4b22-8511-5252f86e88fb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:25.835729 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-276e0cb6-bc3a-4b22-8511-5252f86e88fb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96" status: 200 len: 325 microversion: 2.1 time: 0.299665 Sep 06 10:52:25.836567 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 286/546] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 10:52:25 2022] PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96 => generated 325 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:25.843879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34d31f55-0ecc-49d7-b714-69888aaed732 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:25.844816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-34d31f55-0ecc-49d7-b714-69888aaed732 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:25.852264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d31f55-0ecc-49d7-b714-69888aaed732 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:25.852940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d31f55-0ecc-49d7-b714-69888aaed732 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:25.853519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d31f55-0ecc-49d7-b714-69888aaed732 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:25.854720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d31f55-0ecc-49d7-b714-69888aaed732 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:25.855224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d31f55-0ecc-49d7-b714-69888aaed732 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:25.856986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d31f55-0ecc-49d7-b714-69888aaed732 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:25.986359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-34d31f55-0ecc-49d7-b714-69888aaed732 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:25.995134 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-34d31f55-0ecc-49d7-b714-69888aaed732 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1229 microversion: 2.1 time: 0.157370 Sep 06 10:52:25.996001 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 287/547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:25 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1229 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:26.003037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-12cf59b2-97ce-4d4c-add2-f75e84a13d54 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:26.003755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-12cf59b2-97ce-4d4c-add2-f75e84a13d54 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:26.009636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12cf59b2-97ce-4d4c-add2-f75e84a13d54 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:26.010128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12cf59b2-97ce-4d4c-add2-f75e84a13d54 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:26.010575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12cf59b2-97ce-4d4c-add2-f75e84a13d54 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:26.012930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12cf59b2-97ce-4d4c-add2-f75e84a13d54 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:26.012930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12cf59b2-97ce-4d4c-add2-f75e84a13d54 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:26.013124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12cf59b2-97ce-4d4c-add2-f75e84a13d54 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:26.180231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-12cf59b2-97ce-4d4c-add2-f75e84a13d54 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:26.190414 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-12cf59b2-97ce-4d4c-add2-f75e84a13d54 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1471 microversion: 2.1 time: 0.192457 Sep 06 10:52:26.194462 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 288/548] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:25 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1471 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:26.196295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9bfb7d54-3582-480e-aff0-7dea2a3e878c tempest-SecurityGroupsTestAdminJSON-1989210912 tempest-SecurityGroupsTestAdminJSON-1989210912-project-admin] Calling method '.version_select at 0x7f90f8ab6040>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:26.807037 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-363980ec-c876-418a-93ca-d20bcc5cb779 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d/action" status: 202 len: 0 microversion: 2.1 time: 3.098142 Sep 06 10:52:26.812278 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 261/549] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:52:23 2022] POST /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d/action => generated 0 bytes in 3104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:52:26.821703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6024d2a3-a96a-4024-aa02-038cb8e5899e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:26.822754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6024d2a3-a96a-4024-aa02-038cb8e5899e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:26.833609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6024d2a3-a96a-4024-aa02-038cb8e5899e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:26.833609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6024d2a3-a96a-4024-aa02-038cb8e5899e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:26.833609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6024d2a3-a96a-4024-aa02-038cb8e5899e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:26.833609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6024d2a3-a96a-4024-aa02-038cb8e5899e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:26.834058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6024d2a3-a96a-4024-aa02-038cb8e5899e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:26.834715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6024d2a3-a96a-4024-aa02-038cb8e5899e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:27.018805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6024d2a3-a96a-4024-aa02-038cb8e5899e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:27.031341 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6024d2a3-a96a-4024-aa02-038cb8e5899e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1587 microversion: 2.1 time: 0.215340 Sep 06 10:52:27.032066 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 262/550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:26 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1587 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:27.037124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-5d957fbc-122a-4fb9-9d40-75fafda848cf req-619064a4-e3ef-4455-a081-14c43b2c0fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb198d5-0fb1-4632-ae1f-dddec53a5ae9", "tag": "1cb8770a-9a75-4ea5-afaa-80e009e0a319"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:27.056042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5d957fbc-122a-4fb9-9d40-75fafda848cf req-619064a4-e3ef-4455-a081-14c43b2c0fb8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:27.056731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5d957fbc-122a-4fb9-9d40-75fafda848cf req-619064a4-e3ef-4455-a081-14c43b2c0fb8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:27.057512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5d957fbc-122a-4fb9-9d40-75fafda848cf req-619064a4-e3ef-4455-a081-14c43b2c0fb8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:27.070484 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5d957fbc-122a-4fb9-9d40-75fafda848cf req-619064a4-e3ef-4455-a081-14c43b2c0fb8 service nova] Creating event network-changed:1cb8770a-9a75-4ea5-afaa-80e009e0a319 for instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 on nch1-master-1 Sep 06 10:52:27.076383 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-5d957fbc-122a-4fb9-9d40-75fafda848cf req-619064a4-e3ef-4455-a081-14c43b2c0fb8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042971 Sep 06 10:52:27.077508 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 263/551] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:27.102353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8c7e8b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:27.188931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:27.190355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:27.191046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:27.192067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:27.192607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:27.193053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:27.203406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:27.258156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:27.260106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:27.263112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:27.263112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:27.263112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:27.263112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:27.455752 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-adcde961-d531-4ca4-a16c-f168de031f75 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/beef80c06df043d3851b1c276931e881?user_id=07844b4cfcbe459fbfdf3a53b3a508bc" status: 200 len: 328 microversion: 2.1 time: 0.376746 Sep 06 10:52:27.456396 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 264/552] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 6 10:52:27 2022] PUT /compute/v2.1/os-quota-sets/beef80c06df043d3851b1c276931e881?user_id=07844b4cfcbe459fbfdf3a53b3a508bc => generated 328 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:27.461750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1376949948", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:27.533986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:52:28.527689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:52:28.529752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:52:28.530790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:52:28.531298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:52:28.532036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:52:28.546814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:28.547201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:28.547922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:28.551174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:28.551174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:28.551174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:28.573031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Getting quotas for project 27c94fb551d3488ea0bbf8e8249bff96. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:52:28.581287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Getting quotas for user e12f56e39d3847dc886258de14e533ef and project 27c94fb551d3488ea0bbf8e8249bff96. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:52:28.597193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.utils [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] ram quota exceeded for 27c94fb551d3488ea0bbf8e8249bff96, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140875) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 06 10:52:28.598122 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Request method failure captured: Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 145 Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZaTc9TsUj98vEL0q_NdZ9DrI9pkBq82b9CKB9SegUOM2oUFhCQrfoABNJcGr8B1-4gQuJr04vZ0mZqXz-AMinmqgwiOMgSAtRJrFXEKmxGnO23f5CjSxPlL_hZSobhD4hjAn_-VoGXSvL-Xlw9i5PBDkhRe47aoztiQZ28DPsCq14 Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 27c94fb551d3488ea0bbf8e8249bff96 Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-QuotasAdminNegativeTest-136504040 Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:52:28.600592 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:52:28.601932 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27c94fb551d3488ea0bbf8e8249bff96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27c94fb551d3488ea0bbf8e8249bff96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27c94fb551d3488ea0bbf8e8249bff96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27c94fb551d3488ea0bbf8e8249bff96"}]}] Sep 06 10:52:28.601932 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-QuotasAdminNegativeTest-136504040 Sep 06 10:52:28.601932 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 27c94fb551d3488ea0bbf8e8249bff96 Sep 06 10:52:28.601932 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-136504040 Sep 06 10:52:28.601932 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-QuotasAdminNegativeTest-136504040-project Sep 06 10:52:28.601932 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:28.601932 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:28.601932 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e12f56e39d3847dc886258de14e533ef Sep 06 10:52:28.601932 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-QuotasAdminNegativeTest-136504040-project Sep 06 10:52:28.601932 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:52:28.601932 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1376949948", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} Sep 06 10:52:28.601932 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1376949948', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452'}}} Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 06 10:52:28.602701 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:28.603990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:28.605347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:28.610076 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:28.610076 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:28.610076 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:28.610076 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:28.610076 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 06 10:52:28.610076 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:28.610076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:28.610076 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-387a524a-49b9-4a27-a62c-451c8d17b6b5 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.151807 Sep 06 10:52:28.611102 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 265/553] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:52:27 2022] POST /compute/v2.1/servers => generated 110 bytes in 1154 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:52:28.747508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7b5d5af8-8be5-45bc-bffe-339ae3b31477 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:28.748216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7b5d5af8-8be5-45bc-bffe-339ae3b31477 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] [instance: 8f17d4d6-2b4e-41f7-a949-bb83bee5b5e0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:28.756279 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-7b5d5af8-8be5-45bc-bffe-339ae3b31477 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] HTTP exception thrown: Instance 8f17d4d6-2b4e-41f7-a949-bb83bee5b5e0 could not be found. Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7b5d5af8-8be5-45bc-bffe-339ae3b31477 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Request method failure captured: Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/8f17d4d6-2b4e-41f7-a949-bb83bee5b5e0/action HTTP/1.1 Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 15 Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZK9Kj3tVvR1AJQ0f7sx1f4zaU5UoQFSMdqKBQmz3RxE_bWL2LQON8hU-61waimjCVS9KgfD06gnRGBDC6vapz-aYWKf-pNc57TJgqJ4yo5ul-MYIO91akGkS3__Pbih8P6Z0CI4APgx0zuqOf236KXg0D8hrizp6-CxeBwEqGYd8c Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4da8b0a081964e2191d0e5e3e9eac26f Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:52:28.761031 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:52:28.763348 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4da8b0a081964e2191d0e5e3e9eac26f"}]}] Sep 06 10:52:28.763348 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:28.763348 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4da8b0a081964e2191d0e5e3e9eac26f Sep 06 10:52:28.763348 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:28.763348 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersAdminNegativeTestJSON-245965064-project-admin Sep 06 10:52:28.763348 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:28.763348 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:28.763348 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 66e653c2ba034b269a99e7335e810861 Sep 06 10:52:28.763348 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersAdminNegativeTestJSON-245965064-project-admin Sep 06 10:52:28.763348 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:52:28.763348 ncdv-master-1 devstack@n-api.service[140875]: {"migrate": {}} Sep 06 10:52:28.763348 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:52:28.763348 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 8f17d4d6-2b4e-41f7-a949-bb83bee5b5e0 could not be found. Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '8f17d4d6-2b4e-41f7-a949-bb83bee5b5e0', 'body': {'migrate': {}}} Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f17d4d6-2b4e-41f7-a949-bb83bee5b5e0 could not be found. Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:28.764308 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f17d4d6-2b4e-41f7-a949-bb83bee5b5e0 could not be found. Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f17d4d6-2b4e-41f7-a949-bb83bee5b5e0 could not be found. Sep 06 10:52:28.765981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:28.770065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7b5d5af8-8be5-45bc-bffe-339ae3b31477 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Returning 404 to user: Instance 8f17d4d6-2b4e-41f7-a949-bb83bee5b5e0 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:28.770065 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7b5d5af8-8be5-45bc-bffe-339ae3b31477 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8f17d4d6-2b4e-41f7-a949-bb83bee5b5e0/action" status: 404 len: 111 microversion: 2.1 time: 0.150907 Sep 06 10:52:28.770065 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 266/554] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:52:28 2022] POST /compute/v2.1/servers/8f17d4d6-2b4e-41f7-a949-bb83bee5b5e0/action => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:52:28.781394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9f7a8c7-5d1f-4d65-ab30-db5497bc44c6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:28.781394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c9f7a8c7-5d1f-4d65-ab30-db5497bc44c6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:28.785800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9f7a8c7-5d1f-4d65-ab30-db5497bc44c6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:28.786418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9f7a8c7-5d1f-4d65-ab30-db5497bc44c6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:28.786977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9f7a8c7-5d1f-4d65-ab30-db5497bc44c6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:28.787926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9f7a8c7-5d1f-4d65-ab30-db5497bc44c6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:28.788431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9f7a8c7-5d1f-4d65-ab30-db5497bc44c6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:28.788865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9f7a8c7-5d1f-4d65-ab30-db5497bc44c6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:29.111801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c9f7a8c7-5d1f-4d65-ab30-db5497bc44c6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:29.121450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c9f7a8c7-5d1f-4d65-ab30-db5497bc44c6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:29.124014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c9f7a8c7-5d1f-4d65-ab30-db5497bc44c6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:29.126061 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c9f7a8c7-5d1f-4d65-ab30-db5497bc44c6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1567 microversion: 2.25 time: 0.353686 Sep 06 10:52:29.128186 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 267/555] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:28 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1567 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:29.131946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-98a5273a-78d4-4dd6-9130-a1f7eb9055ed tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:29.132735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-98a5273a-78d4-4dd6-9130-a1f7eb9055ed tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:29.146505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98a5273a-78d4-4dd6-9130-a1f7eb9055ed tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:29.147279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98a5273a-78d4-4dd6-9130-a1f7eb9055ed tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:29.147762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98a5273a-78d4-4dd6-9130-a1f7eb9055ed tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:29.148826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98a5273a-78d4-4dd6-9130-a1f7eb9055ed tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:29.149444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98a5273a-78d4-4dd6-9130-a1f7eb9055ed tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:29.150189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98a5273a-78d4-4dd6-9130-a1f7eb9055ed tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:29.443510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-98a5273a-78d4-4dd6-9130-a1f7eb9055ed tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:29.461088 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-98a5273a-78d4-4dd6-9130-a1f7eb9055ed tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1503 microversion: 2.1 time: 0.332804 Sep 06 10:52:29.461885 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 268/556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:29 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1503 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:29.468068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dbeff185-0b87-482f-8a10-0002f9e7ba1e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:29.469148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dbeff185-0b87-482f-8a10-0002f9e7ba1e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:29.476319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbeff185-0b87-482f-8a10-0002f9e7ba1e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:29.477013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbeff185-0b87-482f-8a10-0002f9e7ba1e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:29.477604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbeff185-0b87-482f-8a10-0002f9e7ba1e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:29.478343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbeff185-0b87-482f-8a10-0002f9e7ba1e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:29.478841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbeff185-0b87-482f-8a10-0002f9e7ba1e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:29.479456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbeff185-0b87-482f-8a10-0002f9e7ba1e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:29.772040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dbeff185-0b87-482f-8a10-0002f9e7ba1e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:29.781302 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dbeff185-0b87-482f-8a10-0002f9e7ba1e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1325 microversion: 2.1 time: 0.317993 Sep 06 10:52:29.782121 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 269/557] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:29 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1325 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:29.786592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d63dbbb0-17bd-4423-9dc3-317190c0ea91 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Calling method '.version_select at 0x7f90f8b44f70>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:29.865919 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d63dbbb0-17bd-4423-9dc3-317190c0ea91 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/beef80c06df043d3851b1c276931e881?user_id=07844b4cfcbe459fbfdf3a53b3a508bc" status: 200 len: 370 microversion: 2.1 time: 0.082952 Sep 06 10:52:29.866793 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 270/558] 10.222.0.20 () {58 vars in 1323 bytes} [Tue Sep 6 10:52:29 2022] GET /compute/v2.1/os-quota-sets/beef80c06df043d3851b1c276931e881?user_id=07844b4cfcbe459fbfdf3a53b3a508bc => generated 370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:29.871429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-faae5802-0c02-43da-9cd0-0dc2d2e8dc33 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8b603a0>, body: {"quota_set": {"ram": 51200}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:29.954576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-faae5802-0c02-43da-9cd0-0dc2d2e8dc33 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:29.955525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-faae5802-0c02-43da-9cd0-0dc2d2e8dc33 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:29.960709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-faae5802-0c02-43da-9cd0-0dc2d2e8dc33 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:29.960709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-faae5802-0c02-43da-9cd0-0dc2d2e8dc33 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:29.960709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-faae5802-0c02-43da-9cd0-0dc2d2e8dc33 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:29.960709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-faae5802-0c02-43da-9cd0-0dc2d2e8dc33 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:29.978512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:29.987304 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9bfb7d54-3582-480e-aff0-7dea2a3e878c tempest-SecurityGroupsTestAdminJSON-1989210912 tempest-SecurityGroupsTestAdminJSON-1989210912-project-admin] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10370 microversion: 2.1 time: 3.794821 Sep 06 10:52:30.003303 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 289/559] 10.222.0.20 () {58 vars in 1191 bytes} [Tue Sep 6 10:52:26 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10370 bytes in 3797 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:52:30.003303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-822812594", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:30.054852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:52:30.143753 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-faae5802-0c02-43da-9cd0-0dc2d2e8dc33 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96" status: 200 len: 329 microversion: 2.1 time: 0.275954 Sep 06 10:52:30.145308 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 271/560] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 10:52:29 2022] PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96 => generated 329 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:30.150526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-08990f96-6400-4320-a7c7-bf1889d58620 req-115f23a7-b88c-46e6-b5be-85e70f94bf6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c8cb47-28e9-42c5-97f6-8cefe47b7555", "tag": "473b3240-51be-44f5-9767-a6901b66a6d3"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:30.163447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-08990f96-6400-4320-a7c7-bf1889d58620 req-115f23a7-b88c-46e6-b5be-85e70f94bf6f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:30.163447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-08990f96-6400-4320-a7c7-bf1889d58620 req-115f23a7-b88c-46e6-b5be-85e70f94bf6f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:30.163447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-08990f96-6400-4320-a7c7-bf1889d58620 req-115f23a7-b88c-46e6-b5be-85e70f94bf6f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:30.174600 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-08990f96-6400-4320-a7c7-bf1889d58620 req-115f23a7-b88c-46e6-b5be-85e70f94bf6f service nova] Creating event network-changed:473b3240-51be-44f5-9767-a6901b66a6d3 for instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 on nch2-master-1 Sep 06 10:52:30.180313 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-08990f96-6400-4320-a7c7-bf1889d58620 req-115f23a7-b88c-46e6-b5be-85e70f94bf6f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033169 Sep 06 10:52:30.186250 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 272/561] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:30.193340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3f46b09-5b97-4400-b001-1cec9833285d tempest-SecurityGroupsTestAdminJSON-1450650556 tempest-SecurityGroupsTestAdminJSON-1450650556-project] Calling method '.version_select at 0x7f90f8bd8790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:30.555372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:52:30.555802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:52:30.556284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:52:30.556699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:52:30.557243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:52:30.577692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:30.578199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:30.578846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:30.579623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:30.580377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:30.580982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:30.599758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Getting quotas for project 4882f2c8ef9c4f29bf3cbaa93cf9d488. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:52:30.606129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Getting quotas for user e425c7348db042389a189daa866ea06d and project 4882f2c8ef9c4f29bf3cbaa93cf9d488. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:52:30.619795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:52:30.622314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:52:30.798223 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d154e86e-3274-4d8c-b3ec-01cbff66d476 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.807303 Sep 06 10:52:30.805692 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 290/562] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:52:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:52:30.811455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8dcc6d49-43b0-400b-9ae2-2e20050a3652 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:30.812715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8dcc6d49-43b0-400b-9ae2-2e20050a3652 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:30.821399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8dcc6d49-43b0-400b-9ae2-2e20050a3652 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:30.822516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8dcc6d49-43b0-400b-9ae2-2e20050a3652 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:30.823246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8dcc6d49-43b0-400b-9ae2-2e20050a3652 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:30.824187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8dcc6d49-43b0-400b-9ae2-2e20050a3652 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:30.825377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8dcc6d49-43b0-400b-9ae2-2e20050a3652 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:30.825964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8dcc6d49-43b0-400b-9ae2-2e20050a3652 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:31.094348 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f3f46b09-5b97-4400-b001-1cec9833285d tempest-SecurityGroupsTestAdminJSON-1450650556 tempest-SecurityGroupsTestAdminJSON-1450650556-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.906517 Sep 06 10:52:31.095049 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 273/563] 10.222.0.20 () {58 vars in 1191 bytes} [Tue Sep 6 10:52:30 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:31.103596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4b548ae4-e0fc-40f8-88dd-e92b26e4cc96 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Action: 'update', calling method: .version_select at 0x7f90f8b60dc0>, body: {"quota_set": {"ram": 0}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:31.109361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4b548ae4-e0fc-40f8-88dd-e92b26e4cc96 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'e12f56e39d3847dc886258de14e533ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c94fb551d3488ea0bbf8e8249bff96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4b548ae4-e0fc-40f8-88dd-e92b26e4cc96 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Request method failure captured: Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: request: PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96 HTTP/1.1 Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 25 Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZaTc9TsUj98vEL0q_NdZ9DrI9pkBq82b9CKB9SegUOM2oUFhCQrfoABNJcGr8B1-4gQuJr04vZ0mZqXz-AMinmqgwiOMgSAtRJrFXEKmxGnO23f5CjSxPlL_hZSobhD4hjAn_-VoGXSvL-Xlw9i5PBDkhRe47aoztiQZ28DPsCq14 Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 27c94fb551d3488ea0bbf8e8249bff96 Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-QuotasAdminNegativeTest-136504040 Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:52:31.111512 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27c94fb551d3488ea0bbf8e8249bff96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27c94fb551d3488ea0bbf8e8249bff96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27c94fb551d3488ea0bbf8e8249bff96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27c94fb551d3488ea0bbf8e8249bff96"}]}] Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-QuotasAdminNegativeTest-136504040 Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 27c94fb551d3488ea0bbf8e8249bff96 Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-136504040 Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-QuotasAdminNegativeTest-136504040-project Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e12f56e39d3847dc886258de14e533ef Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-QuotasAdminNegativeTest-136504040-project Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: {"quota_set": {"ram": 0}} Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 06 10:52:31.112945 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '27c94fb551d3488ea0bbf8e8249bff96', 'body': {'quota_set': {'ram': 0}}} Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:31.113918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:31.115226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:31.116420 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:31.116420 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:31.116420 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:52:31.116420 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:52:31.116420 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 06 10:52:31.116420 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:31.116420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4b548ae4-e0fc-40f8-88dd-e92b26e4cc96 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:31.116420 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4b548ae4-e0fc-40f8-88dd-e92b26e4cc96 tempest-QuotasAdminNegativeTest-136504040 tempest-QuotasAdminNegativeTest-136504040-project] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96" status: 403 len: 116 microversion: 2.1 time: 0.013109 Sep 06 10:52:31.116420 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 274/564] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 10:52:31 2022] PUT /compute/v2.1/os-quota-sets/27c94fb551d3488ea0bbf8e8249bff96 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:52:31.120917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ea225706-3d15-485a-9d84-72ae1b941e6b tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Calling method '.version_select at 0x7f90f9193280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:31.168493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8dcc6d49-43b0-400b-9ae2-2e20050a3652 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:31.182180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8dcc6d49-43b0-400b-9ae2-2e20050a3652 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:31.188960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8dcc6d49-43b0-400b-9ae2-2e20050a3652 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:31.191452 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8dcc6d49-43b0-400b-9ae2-2e20050a3652 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1567 microversion: 2.25 time: 0.384346 Sep 06 10:52:31.197096 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 291/565] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:30 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1567 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:31.208652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d3d4e99c-14b1-462a-b37f-87247789634d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:31.211599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3d4e99c-14b1-462a-b37f-87247789634d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:31.220068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d4e99c-14b1-462a-b37f-87247789634d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:31.220783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d4e99c-14b1-462a-b37f-87247789634d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:31.221419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d4e99c-14b1-462a-b37f-87247789634d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:31.222308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d4e99c-14b1-462a-b37f-87247789634d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:31.222926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d4e99c-14b1-462a-b37f-87247789634d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:31.223533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d4e99c-14b1-462a-b37f-87247789634d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:31.474800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d3d4e99c-14b1-462a-b37f-87247789634d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:31.485215 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d3d4e99c-14b1-462a-b37f-87247789634d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1503 microversion: 2.1 time: 0.284085 Sep 06 10:52:31.486150 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 292/566] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:31 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1503 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:31.500974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7acc49b8-cd20-4fb3-b197-c3a762d209b9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:31.501608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7acc49b8-cd20-4fb3-b197-c3a762d209b9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:31.502011 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ea225706-3d15-485a-9d84-72ae1b941e6b tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/e285e69559d04059b8f46cb6391cf1c5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.386962 Sep 06 10:52:31.502853 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 275/567] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 10:52:31 2022] GET /compute/v2.1/os-quota-sets/e285e69559d04059b8f46cb6391cf1c5/defaults => generated 371 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:31.508237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24112fce-6ad4-4f35-aefa-c5bd56e25c32 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:31.509132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-24112fce-6ad4-4f35-aefa-c5bd56e25c32 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:31.517701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7acc49b8-cd20-4fb3-b197-c3a762d209b9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:31.520187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7acc49b8-cd20-4fb3-b197-c3a762d209b9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:31.520187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7acc49b8-cd20-4fb3-b197-c3a762d209b9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:31.521999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7acc49b8-cd20-4fb3-b197-c3a762d209b9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:31.522543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7acc49b8-cd20-4fb3-b197-c3a762d209b9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:31.522999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7acc49b8-cd20-4fb3-b197-c3a762d209b9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:31.529840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:31.608676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-24112fce-6ad4-4f35-aefa-c5bd56e25c32 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:31.615837 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-24112fce-6ad4-4f35-aefa-c5bd56e25c32 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1221 microversion: 2.1 time: 0.111792 Sep 06 10:52:31.616542 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 276/568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:31 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1221 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:31.622426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f9a5c7a6-88d5-4aff-851f-723c7c261b29 tempest-SecurityGroupsTestAdminJSON-1989210912 tempest-SecurityGroupsTestAdminJSON-1989210912-project-admin] Calling method '.version_select at 0x7f90f8b440d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:31.832945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7acc49b8-cd20-4fb3-b197-c3a762d209b9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:31.842214 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7acc49b8-cd20-4fb3-b197-c3a762d209b9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1325 microversion: 2.1 time: 0.354622 Sep 06 10:52:31.842786 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 293/569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:31 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1325 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:31.847736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3c72a8d4-d5ca-4d3a-9143-f5bc9cca34d9 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8ab6a60>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:32.107954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c72a8d4-d5ca-4d3a-9143-f5bc9cca34d9 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:32.109342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c72a8d4-d5ca-4d3a-9143-f5bc9cca34d9 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:32.110117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c72a8d4-d5ca-4d3a-9143-f5bc9cca34d9 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:32.111183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c72a8d4-d5ca-4d3a-9143-f5bc9cca34d9 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:32.111819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c72a8d4-d5ca-4d3a-9143-f5bc9cca34d9 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:32.112289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c72a8d4-d5ca-4d3a-9143-f5bc9cca34d9 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:32.125552 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f9a5c7a6-88d5-4aff-851f-723c7c261b29 tempest-SecurityGroupsTestAdminJSON-1989210912 tempest-SecurityGroupsTestAdminJSON-1989210912-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/4e018abb-271a-4f00-9b75-9343d4a1fc52" status: 202 len: 0 microversion: 2.1 time: 0.507360 Sep 06 10:52:32.129388 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 277/570] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:52:31 2022] DELETE /compute/v2.1/os-security-groups/4e018abb-271a-4f00-9b75-9343d4a1fc52 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:52:32.135386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fadb2cc1-3dbe-4dad-81c9-22ce9aac3cb8 tempest-SecurityGroupsTestAdminJSON-1989210912 tempest-SecurityGroupsTestAdminJSON-1989210912-project-admin] Calling method '.version_select at 0x7f90f8bc09d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:32.451882 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fadb2cc1-3dbe-4dad-81c9-22ce9aac3cb8 tempest-SecurityGroupsTestAdminJSON-1989210912 tempest-SecurityGroupsTestAdminJSON-1989210912-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b2f1d2d7-e716-41f3-898c-7e2e736d0c42" status: 202 len: 0 microversion: 2.1 time: 0.320919 Sep 06 10:52:32.455979 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 278/571] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:52:32 2022] DELETE /compute/v2.1/os-security-groups/b2f1d2d7-e716-41f3-898c-7e2e736d0c42 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:52:32.461605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-205590a4-7bcf-44d1-a8f1-ae20fc197e1b req-30b18c82-3dbc-4e0e-80cd-23e9120e44d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9162565a-4488-4d48-ba04-dfc70918d16d", "name": "network-vif-unplugged", "status": "completed", "tag": "04beff9e-7cb6-41b4-b6e0-56c1debdbfcc"}, {"name": "network-changed", "server_uuid": "9162565a-4488-4d48-ba04-dfc70918d16d", "tag": "04beff9e-7cb6-41b4-b6e0-56c1debdbfcc"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:32.476499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-205590a4-7bcf-44d1-a8f1-ae20fc197e1b req-30b18c82-3dbc-4e0e-80cd-23e9120e44d5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:32.477188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-205590a4-7bcf-44d1-a8f1-ae20fc197e1b req-30b18c82-3dbc-4e0e-80cd-23e9120e44d5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:32.477908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-205590a4-7bcf-44d1-a8f1-ae20fc197e1b req-30b18c82-3dbc-4e0e-80cd-23e9120e44d5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:32.491942 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-205590a4-7bcf-44d1-a8f1-ae20fc197e1b req-30b18c82-3dbc-4e0e-80cd-23e9120e44d5 service nova] Creating event network-vif-unplugged:04beff9e-7cb6-41b4-b6e0-56c1debdbfcc for instance 9162565a-4488-4d48-ba04-dfc70918d16d on nch1-master-1 Sep 06 10:52:32.492463 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-205590a4-7bcf-44d1-a8f1-ae20fc197e1b req-30b18c82-3dbc-4e0e-80cd-23e9120e44d5 service nova] Creating event network-changed:04beff9e-7cb6-41b4-b6e0-56c1debdbfcc for instance 9162565a-4488-4d48-ba04-dfc70918d16d on nch1-master-1 Sep 06 10:52:32.498284 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-205590a4-7bcf-44d1-a8f1-ae20fc197e1b req-30b18c82-3dbc-4e0e-80cd-23e9120e44d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.040941 Sep 06 10:52:32.498876 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 279/572] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:32.506286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c2578f49-ef23-41c0-bd64-283072f71805 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:32.506286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c2578f49-ef23-41c0-bd64-283072f71805 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:32.511412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2578f49-ef23-41c0-bd64-283072f71805 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:32.511896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2578f49-ef23-41c0-bd64-283072f71805 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:32.512909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2578f49-ef23-41c0-bd64-283072f71805 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:32.513742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2578f49-ef23-41c0-bd64-283072f71805 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:32.514191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2578f49-ef23-41c0-bd64-283072f71805 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:32.514617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2578f49-ef23-41c0-bd64-283072f71805 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:32.750834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c2578f49-ef23-41c0-bd64-283072f71805 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:32.760658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c2578f49-ef23-41c0-bd64-283072f71805 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:32.762814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c2578f49-ef23-41c0-bd64-283072f71805 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:32.764427 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c2578f49-ef23-41c0-bd64-283072f71805 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1557 microversion: 2.25 time: 0.264399 Sep 06 10:52:32.766283 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 280/573] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:32 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1557 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:32.771981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-87e2d0be-c53c-4ff5-b89f-8158c68553a5 tempest-SecurityGroupsTestAdminJSON-1450650556 tempest-SecurityGroupsTestAdminJSON-1450650556-project] Calling method '.version_select at 0x7f90f8bc0430>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:33.207749 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-87e2d0be-c53c-4ff5-b89f-8158c68553a5 tempest-SecurityGroupsTestAdminJSON-1450650556 tempest-SecurityGroupsTestAdminJSON-1450650556-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/12b9233b-a192-4ab4-882e-f4c1af648e0f" status: 202 len: 0 microversion: 2.1 time: 0.440616 Sep 06 10:52:33.209611 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 281/574] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:52:32 2022] DELETE /compute/v2.1/os-security-groups/12b9233b-a192-4ab4-882e-f4c1af648e0f => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:52:33.217355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3308a5a8-0873-44d4-9874-cc8b16e9d8ab tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:33.218301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3308a5a8-0873-44d4-9874-cc8b16e9d8ab tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:33.225108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3308a5a8-0873-44d4-9874-cc8b16e9d8ab tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:33.226430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3308a5a8-0873-44d4-9874-cc8b16e9d8ab tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:33.227129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3308a5a8-0873-44d4-9874-cc8b16e9d8ab tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:33.228476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3308a5a8-0873-44d4-9874-cc8b16e9d8ab tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:33.229143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3308a5a8-0873-44d4-9874-cc8b16e9d8ab tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:33.229638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3308a5a8-0873-44d4-9874-cc8b16e9d8ab tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:33.407510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3308a5a8-0873-44d4-9874-cc8b16e9d8ab tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:33.411557 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3308a5a8-0873-44d4-9874-cc8b16e9d8ab tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1503 microversion: 2.1 time: 0.198828 Sep 06 10:52:33.427298 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 282/575] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:33 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:33.435857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3431ff4-5edc-4aab-aaa0-5f1393539ce0 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:33.437177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f3431ff4-5edc-4aab-aaa0-5f1393539ce0 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:33.444051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3431ff4-5edc-4aab-aaa0-5f1393539ce0 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:33.444553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3431ff4-5edc-4aab-aaa0-5f1393539ce0 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:33.445128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3431ff4-5edc-4aab-aaa0-5f1393539ce0 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:33.445905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3431ff4-5edc-4aab-aaa0-5f1393539ce0 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:33.446373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3431ff4-5edc-4aab-aaa0-5f1393539ce0 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:33.451391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3431ff4-5edc-4aab-aaa0-5f1393539ce0 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:33.555830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f3431ff4-5edc-4aab-aaa0-5f1393539ce0 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:33.560225 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3c72a8d4-d5ca-4d3a-9143-f5bc9cca34d9 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e285e69559d04059b8f46cb6391cf1c5" status: 200 len: 329 microversion: 2.1 time: 1.716164 Sep 06 10:52:33.561393 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 294/576] 10.222.0.20 () {60 vars in 1263 bytes} [Tue Sep 6 10:52:31 2022] PUT /compute/v2.1/os-quota-sets/e285e69559d04059b8f46cb6391cf1c5 => generated 329 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:33.567197 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f3431ff4-5edc-4aab-aaa0-5f1393539ce0 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1273 microversion: 2.1 time: 0.135477 Sep 06 10:52:33.571383 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 283/577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:33 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:33.573822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1ec55bf6-2175-4806-9a1b-276e397386e9 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '.version_select at 0x7f90f8ab8280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:33.578418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ec55bf6-2175-4806-9a1b-276e397386e9 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:33.579144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ec55bf6-2175-4806-9a1b-276e397386e9 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:33.579768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ec55bf6-2175-4806-9a1b-276e397386e9 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:33.579888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-498b71f9-7c05-4d17-a87c-26d2404b02fd tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:33.583124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-498b71f9-7c05-4d17-a87c-26d2404b02fd tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:33.586826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-498b71f9-7c05-4d17-a87c-26d2404b02fd tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:33.587398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-498b71f9-7c05-4d17-a87c-26d2404b02fd tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:33.587920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-498b71f9-7c05-4d17-a87c-26d2404b02fd tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:33.588576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-498b71f9-7c05-4d17-a87c-26d2404b02fd tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:33.589039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-498b71f9-7c05-4d17-a87c-26d2404b02fd tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:33.589474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-498b71f9-7c05-4d17-a87c-26d2404b02fd tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:33.598621 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1ec55bf6-2175-4806-9a1b-276e397386e9 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1344 microversion: 2.25 time: 0.029467 Sep 06 10:52:33.599506 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 295/578] 10.222.0.20 () {60 vars in 1184 bytes} [Tue Sep 6 10:52:33 2022] GET /compute/v2.1/os-migrations => generated 1344 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:33.604168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ceef9bdc-adb2-4120-a7a7-2aa7554e09da tempest-SecurityGroupsTestAdminJSON-1450650556 tempest-SecurityGroupsTestAdminJSON-1450650556-project] Calling method '.version_select at 0x7f90f8aaff70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:33.799710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-498b71f9-7c05-4d17-a87c-26d2404b02fd tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:33.807698 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-498b71f9-7c05-4d17-a87c-26d2404b02fd tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1325 microversion: 2.1 time: 0.235236 Sep 06 10:52:33.809647 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 284/579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:33 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1325 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:33.814110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c405d060-eaee-4ed7-bac4-069b2d097f44 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8bc0dc0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:34.080864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c405d060-eaee-4ed7-bac4-069b2d097f44 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:34.081360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c405d060-eaee-4ed7-bac4-069b2d097f44 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:34.081803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c405d060-eaee-4ed7-bac4-069b2d097f44 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:34.082711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c405d060-eaee-4ed7-bac4-069b2d097f44 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:34.083202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c405d060-eaee-4ed7-bac4-069b2d097f44 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:34.084368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c405d060-eaee-4ed7-bac4-069b2d097f44 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:34.105228 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ceef9bdc-adb2-4120-a7a7-2aa7554e09da tempest-SecurityGroupsTestAdminJSON-1450650556 tempest-SecurityGroupsTestAdminJSON-1450650556-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/1907634a-f45d-4af2-8be5-70269d62b5c9" status: 202 len: 0 microversion: 2.1 time: 0.504145 Sep 06 10:52:34.113703 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 296/580] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:52:33 2022] DELETE /compute/v2.1/os-security-groups/1907634a-f45d-4af2-8be5-70269d62b5c9 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:52:34.119458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-af97bb58-296a-4d59-8599-ac5eb56cfae1 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:34.120535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-af97bb58-296a-4d59-8599-ac5eb56cfae1 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:34.130098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af97bb58-296a-4d59-8599-ac5eb56cfae1 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:34.130984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af97bb58-296a-4d59-8599-ac5eb56cfae1 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:34.131674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af97bb58-296a-4d59-8599-ac5eb56cfae1 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:34.132894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af97bb58-296a-4d59-8599-ac5eb56cfae1 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:34.133957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af97bb58-296a-4d59-8599-ac5eb56cfae1 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:34.136234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af97bb58-296a-4d59-8599-ac5eb56cfae1 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:34.307193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-af97bb58-296a-4d59-8599-ac5eb56cfae1 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid c2328e1f-4118-416a-94bd-e0e51ab9002c {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:52:34.321558 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-af97bb58-296a-4d59-8599-ac5eb56cfae1 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 2049 microversion: 2.25 time: 0.206434 Sep 06 10:52:34.322265 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 297/581] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:34 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 2049 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:34.442836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7d8af37b-f6f3-4ee5-9343-d8c57490b4d9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:34.446298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7d8af37b-f6f3-4ee5-9343-d8c57490b4d9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:34.453359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d8af37b-f6f3-4ee5-9343-d8c57490b4d9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:34.453982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d8af37b-f6f3-4ee5-9343-d8c57490b4d9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:34.454520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d8af37b-f6f3-4ee5-9343-d8c57490b4d9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:34.455406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d8af37b-f6f3-4ee5-9343-d8c57490b4d9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:34.456024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d8af37b-f6f3-4ee5-9343-d8c57490b4d9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:34.456557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d8af37b-f6f3-4ee5-9343-d8c57490b4d9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:34.673402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d8af37b-f6f3-4ee5-9343-d8c57490b4d9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:34.685844 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7d8af37b-f6f3-4ee5-9343-d8c57490b4d9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1503 microversion: 2.1 time: 0.250584 Sep 06 10:52:34.688683 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 298/582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:34 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:34.699412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1009454680", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "3d4af992-111f-451f-ba0f-1750f5aa94d6"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:34.767379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] validate_networks() for [('3d4af992-111f-451f-ba0f-1750f5aa94d6', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:52:35.341338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:52:35.341862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:52:35.342573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:52:35.342744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:52:35.343200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:52:35.353433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:35.353926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:35.356799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:35.357703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:35.358167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:35.362464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:35.398648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Getting quotas for project 437799e22df2433a83eca67987e942c6. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:52:35.402107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Getting quotas for user d9f88a4c72854cff9bba7ed2920f55b0 and project 437799e22df2433a83eca67987e942c6. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:52:35.414825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=18 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:35.419731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:52:35.422118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:52:35.579805 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-016914e7-4158-4a6a-9319-e69f822f20d7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.887003 Sep 06 10:52:35.580652 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 299/583] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 10:52:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 10:52:35.586924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7dc49f2f-1469-4ef9-96f0-c8050d8bcb37 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:35.587777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7dc49f2f-1469-4ef9-96f0-c8050d8bcb37 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:35.595956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7dc49f2f-1469-4ef9-96f0-c8050d8bcb37 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:35.601586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7dc49f2f-1469-4ef9-96f0-c8050d8bcb37 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:35.601586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7dc49f2f-1469-4ef9-96f0-c8050d8bcb37 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:35.601586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7dc49f2f-1469-4ef9-96f0-c8050d8bcb37 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:35.601586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7dc49f2f-1469-4ef9-96f0-c8050d8bcb37 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:35.601953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7dc49f2f-1469-4ef9-96f0-c8050d8bcb37 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:36.177870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7dc49f2f-1469-4ef9-96f0-c8050d8bcb37 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:36.189552 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7dc49f2f-1469-4ef9-96f0-c8050d8bcb37 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1321 microversion: 2.1 time: 0.607471 Sep 06 10:52:36.191451 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 300/584] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:35 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1321 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:36.196068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-17f525f2-3a2e-4222-a117-7cdeb99abf58 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:36.199416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-17f525f2-3a2e-4222-a117-7cdeb99abf58 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:36.213263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17f525f2-3a2e-4222-a117-7cdeb99abf58 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:36.214083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17f525f2-3a2e-4222-a117-7cdeb99abf58 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:36.214733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17f525f2-3a2e-4222-a117-7cdeb99abf58 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:36.216161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17f525f2-3a2e-4222-a117-7cdeb99abf58 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:36.216945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17f525f2-3a2e-4222-a117-7cdeb99abf58 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:36.217607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17f525f2-3a2e-4222-a117-7cdeb99abf58 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:36.406759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-17f525f2-3a2e-4222-a117-7cdeb99abf58 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:36.414607 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-17f525f2-3a2e-4222-a117-7cdeb99abf58 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1325 microversion: 2.1 time: 0.222116 Sep 06 10:52:36.415213 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 301/585] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:36 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1325 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:36.421839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-adfcee3a-2f64-45d0-9b45-1634116aca68 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:36.422492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-adfcee3a-2f64-45d0-9b45-1634116aca68 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:36.476370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-adfcee3a-2f64-45d0-9b45-1634116aca68 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:36.485009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-adfcee3a-2f64-45d0-9b45-1634116aca68 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:36.486481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-adfcee3a-2f64-45d0-9b45-1634116aca68 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:36.487766 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-adfcee3a-2f64-45d0-9b45-1634116aca68 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1262 microversion: 2.25 time: 0.071607 Sep 06 10:52:36.488542 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 302/586] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:36 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:36.496976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-43e59acf-0ca9-4ca1-99e2-c4ddf3dd4c83 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:36.499596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-43e59acf-0ca9-4ca1-99e2-c4ddf3dd4c83 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:36.508257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43e59acf-0ca9-4ca1-99e2-c4ddf3dd4c83 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:36.523549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43e59acf-0ca9-4ca1-99e2-c4ddf3dd4c83 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:36.525163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43e59acf-0ca9-4ca1-99e2-c4ddf3dd4c83 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:36.529154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43e59acf-0ca9-4ca1-99e2-c4ddf3dd4c83 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:36.529882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43e59acf-0ca9-4ca1-99e2-c4ddf3dd4c83 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:36.532682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43e59acf-0ca9-4ca1-99e2-c4ddf3dd4c83 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:36.543764 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c405d060-eaee-4ed7-bac4-069b2d097f44 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e285e69559d04059b8f46cb6391cf1c5" status: 200 len: 329 microversion: 2.1 time: 2.730441 Sep 06 10:52:36.545508 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 285/587] 10.222.0.20 () {60 vars in 1263 bytes} [Tue Sep 6 10:52:33 2022] PUT /compute/v2.1/os-quota-sets/e285e69559d04059b8f46cb6391cf1c5 => generated 329 bytes in 2735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:36.559764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b214b0a2-566b-4a17-a37e-d04f74253155 req-e0dbf32a-4389-4fce-9f08-bf5a93afd8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c8cb47-28e9-42c5-97f6-8cefe47b7555", "name": "network-vif-plugged", "status": "completed", "tag": "473b3240-51be-44f5-9767-a6901b66a6d3"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:36.583772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b214b0a2-566b-4a17-a37e-d04f74253155 req-e0dbf32a-4389-4fce-9f08-bf5a93afd8a8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:36.593756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b214b0a2-566b-4a17-a37e-d04f74253155 req-e0dbf32a-4389-4fce-9f08-bf5a93afd8a8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:36.594574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b214b0a2-566b-4a17-a37e-d04f74253155 req-e0dbf32a-4389-4fce-9f08-bf5a93afd8a8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:36.611941 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b214b0a2-566b-4a17-a37e-d04f74253155 req-e0dbf32a-4389-4fce-9f08-bf5a93afd8a8 service nova] Creating event network-vif-plugged:473b3240-51be-44f5-9767-a6901b66a6d3 for instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 on nch2-master-1 Sep 06 10:52:36.617329 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b214b0a2-566b-4a17-a37e-d04f74253155 req-e0dbf32a-4389-4fce-9f08-bf5a93afd8a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068919 Sep 06 10:52:36.618684 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 286/588] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:36.788831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-43e59acf-0ca9-4ca1-99e2-c4ddf3dd4c83 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:36.801228 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-43e59acf-0ca9-4ca1-99e2-c4ddf3dd4c83 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1503 microversion: 2.1 time: 0.310250 Sep 06 10:52:36.801228 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 303/589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:36 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1503 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:37.101063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9dab8e7d-a1df-4f0f-a350-83de6d8cacdc req-05e940cc-f7aa-4ad7-9f22-867dd86d248b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd27770e-769c-4cf0-94af-385f8049f51e", "tag": "a1b2e0a1-7c2d-41d6-9a07-6fdfaca69e81"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:37.110466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9dab8e7d-a1df-4f0f-a350-83de6d8cacdc req-05e940cc-f7aa-4ad7-9f22-867dd86d248b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.110951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9dab8e7d-a1df-4f0f-a350-83de6d8cacdc req-05e940cc-f7aa-4ad7-9f22-867dd86d248b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.111415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9dab8e7d-a1df-4f0f-a350-83de6d8cacdc req-05e940cc-f7aa-4ad7-9f22-867dd86d248b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.122553 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9dab8e7d-a1df-4f0f-a350-83de6d8cacdc req-05e940cc-f7aa-4ad7-9f22-867dd86d248b service nova] Creating event network-changed:a1b2e0a1-7c2d-41d6-9a07-6fdfaca69e81 for instance fd27770e-769c-4cf0-94af-385f8049f51e on nch2-master-1 Sep 06 10:52:37.127802 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9dab8e7d-a1df-4f0f-a350-83de6d8cacdc req-05e940cc-f7aa-4ad7-9f22-867dd86d248b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030560 Sep 06 10:52:37.128451 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 304/590] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:52:37.217114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c10324e-6dfe-4694-8f86-fa9a7b1cb8f4 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:37.217815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4c10324e-6dfe-4694-8f86-fa9a7b1cb8f4 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:37.224437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c10324e-6dfe-4694-8f86-fa9a7b1cb8f4 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.225356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c10324e-6dfe-4694-8f86-fa9a7b1cb8f4 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.225356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c10324e-6dfe-4694-8f86-fa9a7b1cb8f4 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.228948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c10324e-6dfe-4694-8f86-fa9a7b1cb8f4 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.228948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c10324e-6dfe-4694-8f86-fa9a7b1cb8f4 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.228948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c10324e-6dfe-4694-8f86-fa9a7b1cb8f4 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.423022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4c10324e-6dfe-4694-8f86-fa9a7b1cb8f4 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:37.435822 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4c10324e-6dfe-4694-8f86-fa9a7b1cb8f4 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1321 microversion: 2.1 time: 0.223383 Sep 06 10:52:37.437065 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 305/591] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:37 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:37.445304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9d46906e-1296-4087-ac54-4debc80e5faa tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:37.446479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9d46906e-1296-4087-ac54-4debc80e5faa tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:37.454271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d46906e-1296-4087-ac54-4debc80e5faa tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.454796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d46906e-1296-4087-ac54-4debc80e5faa tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.456606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d46906e-1296-4087-ac54-4debc80e5faa tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.456606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d46906e-1296-4087-ac54-4debc80e5faa tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.456606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d46906e-1296-4087-ac54-4debc80e5faa tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.457030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d46906e-1296-4087-ac54-4debc80e5faa tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.521303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-18347fb7-7939-4c6b-91ba-795f64fc6be6 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8bd8550>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:37.524815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18347fb7-7939-4c6b-91ba-795f64fc6be6 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.525367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18347fb7-7939-4c6b-91ba-795f64fc6be6 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.525815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18347fb7-7939-4c6b-91ba-795f64fc6be6 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.534248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18347fb7-7939-4c6b-91ba-795f64fc6be6 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.534971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18347fb7-7939-4c6b-91ba-795f64fc6be6 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.535671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18347fb7-7939-4c6b-91ba-795f64fc6be6 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-18347fb7-7939-4c6b-91ba-795f64fc6be6 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] HTTP exception thrown: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-18347fb7-7939-4c6b-91ba-795f64fc6be6 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Request method failure captured: Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: request: PUT /compute/v2.1/os-services/a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 HTTP/1.1 Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 56 Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZ0OUVxJss1fPzOTb-5o72DDntX5ZmhjWPuN2yVI_BxE4P9Fq8ZJ4cezyOw0qQATwBhhgTXnB_qZ2VIV_3cRg8thEENt0aQge6lPwR47gFC_YhYX1RyG6sTUm1JzV30QVpPdE0slws42w5CLWDZQXBHTwhHfC74MxK6hSjQOSs_7Og Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.53 Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 6636444ced9949b7b97a2f8b8299f719 Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-388427185 Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:52:37.548706 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:52:37.550849 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6636444ced9949b7b97a2f8b8299f719"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6636444ced9949b7b97a2f8b8299f719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6636444ced9949b7b97a2f8b8299f719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6636444ced9949b7b97a2f8b8299f719"}]}] Sep 06 10:52:37.550849 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-388427185 Sep 06 10:52:37.550849 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 6636444ced9949b7b97a2f8b8299f719 Sep 06 10:52:37.550849 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-388427185 Sep 06 10:52:37.550849 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin Sep 06 10:52:37.550849 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:37.550849 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:37.550849 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e044c7cb5f6428ab005191728ae0f74 Sep 06 10:52:37.550849 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin Sep 06 10:52:37.550849 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:52:37.550849 ncdv-master-1 devstack@n-api.service[140875]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 06 10:52:37.550849 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:52:37.550849 ncdv-master-1 devstack@n-api.service[140875]: exception: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'a31cbadd-eb7b-48f7-ada2-3e7b65de7be3', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.551943 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:37.553399 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:37.555983 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:37.555983 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.555983 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.555983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-18347fb7-7939-4c6b-91ba-795f64fc6be6 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Returning 404 to user: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:37.557021 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-18347fb7-7939-4c6b-91ba-795f64fc6be6 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/a31cbadd-eb7b-48f7-ada2-3e7b65de7be3" status: 404 len: 110 microversion: 2.53 time: 0.895052 Sep 06 10:52:37.558134 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 287/592] 10.222.0.20 () {62 vars in 1309 bytes} [Tue Sep 6 10:52:36 2022] PUT /compute/v2.1/os-services/a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 => generated 110 bytes in 905 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:52:37.563918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-37c2748b-52d4-4a52-b617-f3505dacc1a1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:37.565262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-37c2748b-52d4-4a52-b617-f3505dacc1a1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:37.570262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=15,nova_api:UPDATE=15 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:37.574884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-37c2748b-52d4-4a52-b617-f3505dacc1a1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.575508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-37c2748b-52d4-4a52-b617-f3505dacc1a1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.576209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-37c2748b-52d4-4a52-b617-f3505dacc1a1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.577006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-37c2748b-52d4-4a52-b617-f3505dacc1a1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.577699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-37c2748b-52d4-4a52-b617-f3505dacc1a1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.578348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-37c2748b-52d4-4a52-b617-f3505dacc1a1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.702392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-37c2748b-52d4-4a52-b617-f3505dacc1a1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:37.714587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-37c2748b-52d4-4a52-b617-f3505dacc1a1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:37.717338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-37c2748b-52d4-4a52-b617-f3505dacc1a1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:37.718490 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-37c2748b-52d4-4a52-b617-f3505dacc1a1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1266 microversion: 2.25 time: 0.158921 Sep 06 10:52:37.719321 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 288/593] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:37 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:37.725109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e06e73e4-329b-4d0e-abb5-56caa788156b tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8b60ee0>, body: {"status": "disabled"} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:37.729287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e06e73e4-329b-4d0e-abb5-56caa788156b tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.729988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e06e73e4-329b-4d0e-abb5-56caa788156b tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.730438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e06e73e4-329b-4d0e-abb5-56caa788156b tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.737783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e06e73e4-329b-4d0e-abb5-56caa788156b tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.738256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e06e73e4-329b-4d0e-abb5-56caa788156b tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.738701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e06e73e4-329b-4d0e-abb5-56caa788156b tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.743853 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-e06e73e4-329b-4d0e-abb5-56caa788156b tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] HTTP exception thrown: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e06e73e4-329b-4d0e-abb5-56caa788156b tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Request method failure captured: Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: request: PUT /compute/v2.1/os-services/a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 HTTP/1.1 Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 22 Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZ0OUVxJss1fPzOTb-5o72DDntX5ZmhjWPuN2yVI_BxE4P9Fq8ZJ4cezyOw0qQATwBhhgTXnB_qZ2VIV_3cRg8thEENt0aQge6lPwR47gFC_YhYX1RyG6sTUm1JzV30QVpPdE0slws42w5CLWDZQXBHTwhHfC74MxK6hSjQOSs_7Og Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.53 Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 6636444ced9949b7b97a2f8b8299f719 Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-388427185 Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:52:37.745722 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6636444ced9949b7b97a2f8b8299f719"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6636444ced9949b7b97a2f8b8299f719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6636444ced9949b7b97a2f8b8299f719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6636444ced9949b7b97a2f8b8299f719"}]}] Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-388427185 Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 6636444ced9949b7b97a2f8b8299f719 Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-388427185 Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e044c7cb5f6428ab005191728ae0f74 Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: {"status": "disabled"} Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: exception: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.748325 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'a31cbadd-eb7b-48f7-ada2-3e7b65de7be3', 'body': {'status': 'disabled'}} Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:37.749653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:37.752591 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:37.755114 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.755114 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.755790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e06e73e4-329b-4d0e-abb5-56caa788156b tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Returning 404 to user: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:37.756765 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e06e73e4-329b-4d0e-abb5-56caa788156b tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/a31cbadd-eb7b-48f7-ada2-3e7b65de7be3" status: 404 len: 110 microversion: 2.53 time: 0.036172 Sep 06 10:52:37.757839 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 289/594] 10.222.0.20 () {62 vars in 1309 bytes} [Tue Sep 6 10:52:37 2022] PUT /compute/v2.1/os-services/a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:52:37.763813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9d46906e-1296-4087-ac54-4debc80e5faa tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:37.770784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1388dbd1-4805-472b-8fc0-833abb5b6acd tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8b32550>, body: {"status": "enabled"} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:37.775127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1388dbd1-4805-472b-8fc0-833abb5b6acd tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.776009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1388dbd1-4805-472b-8fc0-833abb5b6acd tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.776679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1388dbd1-4805-472b-8fc0-833abb5b6acd tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.786203 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9d46906e-1296-4087-ac54-4debc80e5faa tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1325 microversion: 2.1 time: 0.346932 Sep 06 10:52:37.786888 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 306/595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:37 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1325 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:37.794749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1388dbd1-4805-472b-8fc0-833abb5b6acd tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.795268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1388dbd1-4805-472b-8fc0-833abb5b6acd tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.795959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1388dbd1-4805-472b-8fc0-833abb5b6acd tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.808660 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-1388dbd1-4805-472b-8fc0-833abb5b6acd tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] HTTP exception thrown: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1388dbd1-4805-472b-8fc0-833abb5b6acd tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Request method failure captured: Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: request: PUT /compute/v2.1/os-services/a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 HTTP/1.1 Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 21 Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZ0OUVxJss1fPzOTb-5o72DDntX5ZmhjWPuN2yVI_BxE4P9Fq8ZJ4cezyOw0qQATwBhhgTXnB_qZ2VIV_3cRg8thEENt0aQge6lPwR47gFC_YhYX1RyG6sTUm1JzV30QVpPdE0slws42w5CLWDZQXBHTwhHfC74MxK6hSjQOSs_7Og Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.53 Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 6636444ced9949b7b97a2f8b8299f719 Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-388427185 Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:52:37.810929 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6636444ced9949b7b97a2f8b8299f719"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6636444ced9949b7b97a2f8b8299f719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6636444ced9949b7b97a2f8b8299f719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6636444ced9949b7b97a2f8b8299f719"}]}] Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-388427185 Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 6636444ced9949b7b97a2f8b8299f719 Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-388427185 Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e044c7cb5f6428ab005191728ae0f74 Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: {"status": "enabled"} Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: exception: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.812334 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'a31cbadd-eb7b-48f7-ada2-3e7b65de7be3', 'body': {'status': 'enabled'}} Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:37.813222 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:37.814509 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:37.815672 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. Sep 06 10:52:37.815672 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:37.816625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1388dbd1-4805-472b-8fc0-833abb5b6acd tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Returning 404 to user: Service a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:37.817512 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1388dbd1-4805-472b-8fc0-833abb5b6acd tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/a31cbadd-eb7b-48f7-ada2-3e7b65de7be3" status: 404 len: 110 microversion: 2.53 time: 0.053532 Sep 06 10:52:37.822599 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 290/596] 10.222.0.20 () {62 vars in 1309 bytes} [Tue Sep 6 10:52:37 2022] PUT /compute/v2.1/os-services/a31cbadd-eb7b-48f7-ada2-3e7b65de7be3 => generated 110 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:52:37.831485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bd317cad-b02b-4c3c-84b8-0967e3c839ff tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:37.852603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd317cad-b02b-4c3c-84b8-0967e3c839ff tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.852603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd317cad-b02b-4c3c-84b8-0967e3c839ff tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.852603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd317cad-b02b-4c3c-84b8-0967e3c839ff tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.853663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cb8089b1-a7f4-4831-8359-63227c7e4f4b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:37.854112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd317cad-b02b-4c3c-84b8-0967e3c839ff tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.854112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd317cad-b02b-4c3c-84b8-0967e3c839ff tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.854112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd317cad-b02b-4c3c-84b8-0967e3c839ff tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.854465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cb8089b1-a7f4-4831-8359-63227c7e4f4b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:37.858863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb8089b1-a7f4-4831-8359-63227c7e4f4b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.859405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb8089b1-a7f4-4831-8359-63227c7e4f4b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.861433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb8089b1-a7f4-4831-8359-63227c7e4f4b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.862655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb8089b1-a7f4-4831-8359-63227c7e4f4b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.864320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb8089b1-a7f4-4831-8359-63227c7e4f4b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.866585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb8089b1-a7f4-4831-8359-63227c7e4f4b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.871980 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bd317cad-b02b-4c3c-84b8-0967e3c839ff tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.044302 Sep 06 10:52:37.872672 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 291/597] 10.222.0.20 () {60 vars in 1178 bytes} [Tue Sep 6 10:52:37 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:52:37.887729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0b11230a-adfe-4268-b226-c2e0d0402e20 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:37.891933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b11230a-adfe-4268-b226-c2e0d0402e20 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.892422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b11230a-adfe-4268-b226-c2e0d0402e20 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.892979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b11230a-adfe-4268-b226-c2e0d0402e20 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.897055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b11230a-adfe-4268-b226-c2e0d0402e20 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.897055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b11230a-adfe-4268-b226-c2e0d0402e20 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.897055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b11230a-adfe-4268-b226-c2e0d0402e20 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.922421 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0b11230a-adfe-4268-b226-c2e0d0402e20 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.039412 Sep 06 10:52:37.927180 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 292/598] 10.222.0.20 () {60 vars in 1211 bytes} [Tue Sep 6 10:52:37 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:37.938752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d41e4072-fe2f-41e0-8fd0-96684fc44b01 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:37.943793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d41e4072-fe2f-41e0-8fd0-96684fc44b01 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.945047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d41e4072-fe2f-41e0-8fd0-96684fc44b01 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.945493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d41e4072-fe2f-41e0-8fd0-96684fc44b01 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.946233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d41e4072-fe2f-41e0-8fd0-96684fc44b01 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.946690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d41e4072-fe2f-41e0-8fd0-96684fc44b01 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.947136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d41e4072-fe2f-41e0-8fd0-96684fc44b01 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.971648 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d41e4072-fe2f-41e0-8fd0-96684fc44b01 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.038663 Sep 06 10:52:37.972474 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 293/599] 10.222.0.20 () {60 vars in 1178 bytes} [Tue Sep 6 10:52:37 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:37.985390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7dd905cc-7005-4d7e-8870-3d7b0d295bb5 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:37.989556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dd905cc-7005-4d7e-8870-3d7b0d295bb5 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.990312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dd905cc-7005-4d7e-8870-3d7b0d295bb5 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.990947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dd905cc-7005-4d7e-8870-3d7b0d295bb5 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:37.991899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dd905cc-7005-4d7e-8870-3d7b0d295bb5 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:37.992546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dd905cc-7005-4d7e-8870-3d7b0d295bb5 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:37.993172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dd905cc-7005-4d7e-8870-3d7b0d295bb5 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:38.020616 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7dd905cc-7005-4d7e-8870-3d7b0d295bb5 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.039292 Sep 06 10:52:38.023184 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 294/600] 10.222.0.20 () {60 vars in 1237 bytes} [Tue Sep 6 10:52:37 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:38.037213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0cc647ac-0a17-4471-bc76-de7fc069c6b3 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:38.042558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cc647ac-0a17-4471-bc76-de7fc069c6b3 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:38.043175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cc647ac-0a17-4471-bc76-de7fc069c6b3 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:38.043622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cc647ac-0a17-4471-bc76-de7fc069c6b3 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:38.044359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cc647ac-0a17-4471-bc76-de7fc069c6b3 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:38.044817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cc647ac-0a17-4471-bc76-de7fc069c6b3 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:38.045540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cc647ac-0a17-4471-bc76-de7fc069c6b3 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:38.070260 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0cc647ac-0a17-4471-bc76-de7fc069c6b3 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.037529 Sep 06 10:52:38.071003 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 295/601] 10.222.0.20 () {60 vars in 1178 bytes} [Tue Sep 6 10:52:38 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:52:38.090262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f26aaa59-41cd-4527-9e83-deae9ca3a7c1 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:38.099397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f26aaa59-41cd-4527-9e83-deae9ca3a7c1 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:38.100241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f26aaa59-41cd-4527-9e83-deae9ca3a7c1 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:38.100851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f26aaa59-41cd-4527-9e83-deae9ca3a7c1 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:38.101966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f26aaa59-41cd-4527-9e83-deae9ca3a7c1 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:38.103599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f26aaa59-41cd-4527-9e83-deae9ca3a7c1 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:38.104078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f26aaa59-41cd-4527-9e83-deae9ca3a7c1 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:38.152366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cb8089b1-a7f4-4831-8359-63227c7e4f4b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:38.156479 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f26aaa59-41cd-4527-9e83-deae9ca3a7c1 tempest-ServicesAdminNegativeV253TestJSON-388427185 tempest-ServicesAdminNegativeV253TestJSON-388427185-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.074160 Sep 06 10:52:38.157426 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 296/602] 10.222.0.20 () {60 vars in 1239 bytes} [Tue Sep 6 10:52:38 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:38.163992 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cb8089b1-a7f4-4831-8359-63227c7e4f4b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1503 microversion: 2.1 time: 0.344409 Sep 06 10:52:38.166746 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 307/603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:37 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:38.459063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f752270-d064-4801-bf14-e8f58388b3cf tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:38.459741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7f752270-d064-4801-bf14-e8f58388b3cf tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:38.468797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f752270-d064-4801-bf14-e8f58388b3cf tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:38.469302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f752270-d064-4801-bf14-e8f58388b3cf tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:38.469752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f752270-d064-4801-bf14-e8f58388b3cf tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:38.470468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f752270-d064-4801-bf14-e8f58388b3cf tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:38.470945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f752270-d064-4801-bf14-e8f58388b3cf tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:38.481190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f752270-d064-4801-bf14-e8f58388b3cf tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:38.597561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-db766cf0-17de-49c2-9f3b-409377794d48 tempest-ServicesAdminNegativeV253TestJSON-186373894 tempest-ServicesAdminNegativeV253TestJSON-186373894-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:38.603825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-db766cf0-17de-49c2-9f3b-409377794d48 tempest-ServicesAdminNegativeV253TestJSON-186373894 tempest-ServicesAdminNegativeV253TestJSON-186373894-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'eaab6d1333c647f79400b4a15ab15309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ac22fb18b840e58301a8e6bb1d780d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-db766cf0-17de-49c2-9f3b-409377794d48 tempest-ServicesAdminNegativeV253TestJSON-186373894 tempest-ServicesAdminNegativeV253TestJSON-186373894-project] Request method failure captured: Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZzLhC1HW_fufY-MlaiYS5qzVQlYgjVYYnSs9Cfj08ME0wDxj6iYF4YIFYztq6YDqD-OVmh-KiNSw-5QqtNHXuAWrZJ3mQWUFDhZLxNSpo6MaTit6pHEo2fgfGLGDD30CPk4vgFpuZ9hfZfspaT2QQ1dCfehuJZvZN4EykH__Zk3zQ Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.53 Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: b8ac22fb18b840e58301a8e6bb1d780d Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-186373894 Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:52:38.608173 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:52:38.609827 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b8ac22fb18b840e58301a8e6bb1d780d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b8ac22fb18b840e58301a8e6bb1d780d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b8ac22fb18b840e58301a8e6bb1d780d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b8ac22fb18b840e58301a8e6bb1d780d"}]}] Sep 06 10:52:38.609827 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-186373894 Sep 06 10:52:38.609827 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: b8ac22fb18b840e58301a8e6bb1d780d Sep 06 10:52:38.609827 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-186373894 Sep 06 10:52:38.609827 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServicesAdminNegativeV253TestJSON-186373894-project Sep 06 10:52:38.609827 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:38.609827 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:38.609827 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: eaab6d1333c647f79400b4a15ab15309 Sep 06 10:52:38.609827 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-186373894-project Sep 06 10:52:38.609827 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:52:38.609827 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 06 10:52:38.609827 ncdv-master-1 devstack@n-api.service[140875]: action_args: {} Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:52:38.610686 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 06 10:52:38.612106 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:38.617275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-db766cf0-17de-49c2-9f3b-409377794d48 tempest-ServicesAdminNegativeV253TestJSON-186373894 tempest-ServicesAdminNegativeV253TestJSON-186373894-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:38.621476 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-db766cf0-17de-49c2-9f3b-409377794d48 tempest-ServicesAdminNegativeV253TestJSON-186373894 tempest-ServicesAdminNegativeV253TestJSON-186373894-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.455638 Sep 06 10:52:38.622397 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 297/604] 10.222.0.20 () {60 vars in 1178 bytes} [Tue Sep 6 10:52:38 2022] GET /compute/v2.1/os-services => generated 112 bytes in 457 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Sep 06 10:52:38.744742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cb5dfca6-4461-4a16-9e22-faa178c8e629 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:38.744912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f752270-d064-4801-bf14-e8f58388b3cf tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:38.745686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cb5dfca6-4461-4a16-9e22-faa178c8e629 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:38.754011 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7f752270-d064-4801-bf14-e8f58388b3cf tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1321 microversion: 2.1 time: 0.298768 Sep 06 10:52:38.769840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb5dfca6-4461-4a16-9e22-faa178c8e629 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:38.769840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb5dfca6-4461-4a16-9e22-faa178c8e629 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:38.769840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb5dfca6-4461-4a16-9e22-faa178c8e629 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:38.769840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb5dfca6-4461-4a16-9e22-faa178c8e629 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:38.770463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb5dfca6-4461-4a16-9e22-faa178c8e629 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:38.770463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb5dfca6-4461-4a16-9e22-faa178c8e629 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:38.771482 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 308/605] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:38 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:38.813282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0258c10f-86f7-45c9-b507-84db550d027d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:38.813897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0258c10f-86f7-45c9-b507-84db550d027d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:38.831210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0258c10f-86f7-45c9-b507-84db550d027d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:38.831714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0258c10f-86f7-45c9-b507-84db550d027d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:38.832152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0258c10f-86f7-45c9-b507-84db550d027d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:38.832867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0258c10f-86f7-45c9-b507-84db550d027d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:38.833323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0258c10f-86f7-45c9-b507-84db550d027d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:38.835323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0258c10f-86f7-45c9-b507-84db550d027d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:38.856251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cb5dfca6-4461-4a16-9e22-faa178c8e629 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:38.868336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cb5dfca6-4461-4a16-9e22-faa178c8e629 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:38.870170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cb5dfca6-4461-4a16-9e22-faa178c8e629 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:38.871963 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cb5dfca6-4461-4a16-9e22-faa178c8e629 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1314 microversion: 2.25 time: 0.130664 Sep 06 10:52:38.872525 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 298/606] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:38 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1314 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:52:39.017124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0258c10f-86f7-45c9-b507-84db550d027d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:39.024858 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0258c10f-86f7-45c9-b507-84db550d027d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1520 microversion: 2.1 time: 0.216349 Sep 06 10:52:39.025436 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 309/607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:38 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:39.048038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4012611e-fe08-442a-8664-efb704f4bc2e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:39.049268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4012611e-fe08-442a-8664-efb704f4bc2e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:39.057002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4012611e-fe08-442a-8664-efb704f4bc2e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:39.058026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4012611e-fe08-442a-8664-efb704f4bc2e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:39.058761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4012611e-fe08-442a-8664-efb704f4bc2e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:39.060036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4012611e-fe08-442a-8664-efb704f4bc2e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:39.060502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4012611e-fe08-442a-8664-efb704f4bc2e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:39.061288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4012611e-fe08-442a-8664-efb704f4bc2e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:39.190431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5267d069-3526-424f-b36a-23f6094a1816 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:39.191087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5267d069-3526-424f-b36a-23f6094a1816 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:39.197920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5267d069-3526-424f-b36a-23f6094a1816 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:39.198685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5267d069-3526-424f-b36a-23f6094a1816 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:39.199413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5267d069-3526-424f-b36a-23f6094a1816 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:39.200690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5267d069-3526-424f-b36a-23f6094a1816 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:39.201352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5267d069-3526-424f-b36a-23f6094a1816 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:39.202142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5267d069-3526-424f-b36a-23f6094a1816 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:39.450044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4012611e-fe08-442a-8664-efb704f4bc2e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:39.458936 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4012611e-fe08-442a-8664-efb704f4bc2e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1520 microversion: 2.1 time: 0.415659 Sep 06 10:52:39.459894 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 299/608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:39 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1520 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:39.485249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7d556980-5c8e-4b03-9522-8b499ca84ce4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1092877167", "metadata": {"": ""}}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7d556980-5c8e-4b03-9522-8b499ca84ce4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action HTTP/1.1 Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 107 Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:52:39.497174 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:52:39.499598 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:52:39.499598 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:39.499598 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:52:39.499598 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:39.499598 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:52:39.499598 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:39.499598 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:39.499598 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:52:39.499598 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:52:39.499598 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:52:39.499598 ncdv-master-1 devstack@n-api.service[140875]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1092877167", "metadata": {"": ""}}} Sep 06 10:52:39.499598 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '94c8cb47-28e9-42c5-97f6-8cefe47b7555', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1092877167', 'metadata': {'': ''}}}} Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'': ''} Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:39.500944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:39.502834 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:39.507606 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:39.507606 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:39.507606 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:52:39.507606 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:52:39.507606 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 10:52:39.507606 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:39.507606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7d556980-5c8e-4b03-9522-8b499ca84ce4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:39.509398 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7d556980-5c8e-4b03-9522-8b499ca84ce4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action" status: 400 len: 170 microversion: 2.1 time: 0.030042 Sep 06 10:52:39.510997 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 300/609] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Sep 6 10:52:39 2022] POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action => generated 170 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 10:52:39.521821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e5963e95-86ac-4ae4-803d-f128d392ca26 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:39.523533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e5963e95-86ac-4ae4-803d-f128d392ca26 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:39.535995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5267d069-3526-424f-b36a-23f6094a1816 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:39.544873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5963e95-86ac-4ae4-803d-f128d392ca26 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:39.545957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5963e95-86ac-4ae4-803d-f128d392ca26 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:39.546467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5963e95-86ac-4ae4-803d-f128d392ca26 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:39.548784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5963e95-86ac-4ae4-803d-f128d392ca26 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:39.549598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5963e95-86ac-4ae4-803d-f128d392ca26 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:39.550311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5963e95-86ac-4ae4-803d-f128d392ca26 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:39.552392 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5267d069-3526-424f-b36a-23f6094a1816 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1503 microversion: 2.1 time: 0.365750 Sep 06 10:52:39.553506 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 310/610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:39 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1503 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:39.712369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e5963e95-86ac-4ae4-803d-f128d392ca26 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:39.720730 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e5963e95-86ac-4ae4-803d-f128d392ca26 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1520 microversion: 2.1 time: 0.204738 Sep 06 10:52:39.731608 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 301/611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:39 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:39.747241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a784123f-9e03-46ad-a42c-86c065c2a3a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:39.748233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a784123f-9e03-46ad-a42c-86c065c2a3a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:39.757364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a784123f-9e03-46ad-a42c-86c065c2a3a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:39.757875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a784123f-9e03-46ad-a42c-86c065c2a3a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:39.758320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a784123f-9e03-46ad-a42c-86c065c2a3a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:39.759341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a784123f-9e03-46ad-a42c-86c065c2a3a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:39.759886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a784123f-9e03-46ad-a42c-86c065c2a3a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:39.760420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a784123f-9e03-46ad-a42c-86c065c2a3a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:39.779507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-51b3f5a6-2631-4a34-8153-2dfdcda10174 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:39.779507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-51b3f5a6-2631-4a34-8153-2dfdcda10174 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:39.787516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51b3f5a6-2631-4a34-8153-2dfdcda10174 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:39.788236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51b3f5a6-2631-4a34-8153-2dfdcda10174 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:39.788950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51b3f5a6-2631-4a34-8153-2dfdcda10174 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:39.789824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51b3f5a6-2631-4a34-8153-2dfdcda10174 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:39.790530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51b3f5a6-2631-4a34-8153-2dfdcda10174 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:39.791244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51b3f5a6-2631-4a34-8153-2dfdcda10174 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:39.796762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:40.061414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a784123f-9e03-46ad-a42c-86c065c2a3a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:40.071409 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a784123f-9e03-46ad-a42c-86c065c2a3a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1520 microversion: 2.1 time: 0.330866 Sep 06 10:52:40.080532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-51b3f5a6-2631-4a34-8153-2dfdcda10174 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:40.089449 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 311/612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:39 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1520 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:40.091526 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-51b3f5a6-2631-4a34-8153-2dfdcda10174 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1321 microversion: 2.1 time: 0.316224 Sep 06 10:52:40.094322 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 302/613] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:39 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:40.098642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-37603653-5e00-43f9-8107-8a3a74a1390c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2115143574", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:40.099687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e7f63daa-5833-44a2-b050-0982f2658523 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:40.100529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e7f63daa-5833-44a2-b050-0982f2658523 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:40.107757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7f63daa-5833-44a2-b050-0982f2658523 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-37603653-5e00-43f9-8107-8a3a74a1390c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action HTTP/1.1 Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 619 Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:52:40.107924 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:52:40.109155 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:52:40.109155 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:40.109155 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:52:40.109155 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:40.109155 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:52:40.109155 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:40.109155 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:40.109155 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:52:40.109155 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:52:40.109155 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:52:40.109759 ncdv-master-1 devstack@n-api.service[140875]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2115143574", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 06 10:52:40.109759 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:52:40.109759 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 10:52:40.109974 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '94c8cb47-28e9-42c5-97f6-8cefe47b7555', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2115143574', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 06 10:52:40.109974 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:40.109974 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:40.109974 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:52:40.109974 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:52:40.109974 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:52:40.109974 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:52:40.109974 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 10:52:40.109974 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.109974 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 06 10:52:40.109974 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:40.110957 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:40.116040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:40.116040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:52:40.116040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:52:40.116040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:52:40.116040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:52:40.116040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:52:40.116040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:52:40.116040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 10:52:40.116040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.116040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:40.116040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.116040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:40.117116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:40.117116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:40.117116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:52:40.117116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:52:40.117116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 10:52:40.117116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.117577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-37603653-5e00-43f9-8107-8a3a74a1390c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:40.117577 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-37603653-5e00-43f9-8107-8a3a74a1390c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action" status: 400 len: 938 microversion: 2.1 time: 0.016224 Sep 06 10:52:40.117577 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 303/614] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Sep 6 10:52:40 2022] POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action => generated 938 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:52:40.118721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7f63daa-5833-44a2-b050-0982f2658523 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:40.119231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7f63daa-5833-44a2-b050-0982f2658523 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:40.119953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fad1a1e8-d1c3-4502-ad22-296ea5faa2b0 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:40.120085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7f63daa-5833-44a2-b050-0982f2658523 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:40.120438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7f63daa-5833-44a2-b050-0982f2658523 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:40.120551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fad1a1e8-d1c3-4502-ad22-296ea5faa2b0 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:40.120873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7f63daa-5833-44a2-b050-0982f2658523 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:40.128919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fad1a1e8-d1c3-4502-ad22-296ea5faa2b0 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:40.129398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fad1a1e8-d1c3-4502-ad22-296ea5faa2b0 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:40.129842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fad1a1e8-d1c3-4502-ad22-296ea5faa2b0 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:40.130559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fad1a1e8-d1c3-4502-ad22-296ea5faa2b0 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:40.131051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fad1a1e8-d1c3-4502-ad22-296ea5faa2b0 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:40.131500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fad1a1e8-d1c3-4502-ad22-296ea5faa2b0 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:40.230853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e7f63daa-5833-44a2-b050-0982f2658523 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:40.240859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e7f63daa-5833-44a2-b050-0982f2658523 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:40.242345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e7f63daa-5833-44a2-b050-0982f2658523 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:40.243542 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e7f63daa-5833-44a2-b050-0982f2658523 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1322 microversion: 2.25 time: 0.151613 Sep 06 10:52:40.244139 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 312/615] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:40 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:40.335178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fad1a1e8-d1c3-4502-ad22-296ea5faa2b0 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:40.344109 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fad1a1e8-d1c3-4502-ad22-296ea5faa2b0 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1520 microversion: 2.1 time: 0.228200 Sep 06 10:52:40.347630 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 304/616] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:40 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:40.367546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-89319b6e-4285-47db-a5d7-179fced8cab1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:40.368157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-89319b6e-4285-47db-a5d7-179fced8cab1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:40.374764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89319b6e-4285-47db-a5d7-179fced8cab1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:40.375520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89319b6e-4285-47db-a5d7-179fced8cab1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:40.375960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89319b6e-4285-47db-a5d7-179fced8cab1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:40.376648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89319b6e-4285-47db-a5d7-179fced8cab1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:40.377112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89319b6e-4285-47db-a5d7-179fced8cab1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:40.377542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89319b6e-4285-47db-a5d7-179fced8cab1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:40.580655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a1d7a33d-290a-445c-bc29-e05e208d6953 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:40.581651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a1d7a33d-290a-445c-bc29-e05e208d6953 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:40.589801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d7a33d-290a-445c-bc29-e05e208d6953 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:40.590551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d7a33d-290a-445c-bc29-e05e208d6953 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:40.591356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d7a33d-290a-445c-bc29-e05e208d6953 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:40.592225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d7a33d-290a-445c-bc29-e05e208d6953 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:40.593222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d7a33d-290a-445c-bc29-e05e208d6953 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:40.594172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d7a33d-290a-445c-bc29-e05e208d6953 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:40.602008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-89319b6e-4285-47db-a5d7-179fced8cab1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:40.613513 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-89319b6e-4285-47db-a5d7-179fced8cab1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1520 microversion: 2.1 time: 0.247483 Sep 06 10:52:40.614126 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 313/617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:40 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:40.649953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4de88fab-b827-4053-bdfb-115f13e29285 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4de88fab-b827-4053-bdfb-115f13e29285 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action HTTP/1.1 Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 285 Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:52:40.656734 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:52:40.658982 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:52:40.658982 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:40.658982 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:52:40.658982 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:40.658982 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:52:40.658982 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:52:40.658982 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:52:40.658982 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:52:40.658982 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:52:40.658982 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:52:40.658982 ncdv-master-1 devstack@n-api.service[140876]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 06 10:52:40.660974 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:52:40.660974 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 10:52:40.660974 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '94c8cb47-28e9-42c5-97f6-8cefe47b7555', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 06 10:52:40.660974 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:40.660974 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:40.660974 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:52:40.660974 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:52:40.660974 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:52:40.660974 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:52:40.660974 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:52:40.662063 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:52:40.667192 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:52:40.667192 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:52:40.667192 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:52:40.667192 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:52:40.667192 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 10:52:40.667192 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.667192 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:40.667192 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.667192 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:40.667192 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:40.667192 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:40.667192 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:52:40.667192 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:52:40.669211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 10:52:40.669211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:40.669211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4de88fab-b827-4053-bdfb-115f13e29285 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:40.670352 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4de88fab-b827-4053-bdfb-115f13e29285 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action" status: 400 len: 619 microversion: 2.1 time: 0.024656 Sep 06 10:52:40.672024 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 314/618] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Sep 6 10:52:40 2022] POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 10:52:40.681035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c3ce69e9-a51d-47e4-bcea-f5da136f7595 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:40.681891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c3ce69e9-a51d-47e4-bcea-f5da136f7595 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:40.690609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3ce69e9-a51d-47e4-bcea-f5da136f7595 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:40.691233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3ce69e9-a51d-47e4-bcea-f5da136f7595 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:40.691750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3ce69e9-a51d-47e4-bcea-f5da136f7595 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:40.692538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3ce69e9-a51d-47e4-bcea-f5da136f7595 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:40.693075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3ce69e9-a51d-47e4-bcea-f5da136f7595 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:40.693588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3ce69e9-a51d-47e4-bcea-f5da136f7595 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:40.698508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:40.958499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a1d7a33d-290a-445c-bc29-e05e208d6953 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:40.969785 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a1d7a33d-290a-445c-bc29-e05e208d6953 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1503 microversion: 2.1 time: 0.394152 Sep 06 10:52:40.971837 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 305/619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:40 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1503 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:41.035867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c3ce69e9-a51d-47e4-bcea-f5da136f7595 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:41.047256 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c3ce69e9-a51d-47e4-bcea-f5da136f7595 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1520 microversion: 2.1 time: 0.370705 Sep 06 10:52:41.047829 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 315/620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:40 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1520 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:41.083399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-acbe2ed4-9cb2-45b4-ac71-7a882091f6c5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:41.084067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-acbe2ed4-9cb2-45b4-ac71-7a882091f6c5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:41.103569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acbe2ed4-9cb2-45b4-ac71-7a882091f6c5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:41.106414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acbe2ed4-9cb2-45b4-ac71-7a882091f6c5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:41.106881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acbe2ed4-9cb2-45b4-ac71-7a882091f6c5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:41.107789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acbe2ed4-9cb2-45b4-ac71-7a882091f6c5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:41.111895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acbe2ed4-9cb2-45b4-ac71-7a882091f6c5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:41.114743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acbe2ed4-9cb2-45b4-ac71-7a882091f6c5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:41.119130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-98094059-0aaa-4a7f-abfa-aacd236a3ddc tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:41.119750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-98094059-0aaa-4a7f-abfa-aacd236a3ddc tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:41.128814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98094059-0aaa-4a7f-abfa-aacd236a3ddc tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:41.129351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98094059-0aaa-4a7f-abfa-aacd236a3ddc tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:41.134209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98094059-0aaa-4a7f-abfa-aacd236a3ddc tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:41.135366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98094059-0aaa-4a7f-abfa-aacd236a3ddc tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:41.136006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98094059-0aaa-4a7f-abfa-aacd236a3ddc tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:41.136652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98094059-0aaa-4a7f-abfa-aacd236a3ddc tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:41.511229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-acbe2ed4-9cb2-45b4-ac71-7a882091f6c5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:41.513013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-98094059-0aaa-4a7f-abfa-aacd236a3ddc tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:41.524307 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-98094059-0aaa-4a7f-abfa-aacd236a3ddc tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1321 microversion: 2.1 time: 0.409447 Sep 06 10:52:41.535092 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 316/621] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:41 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1321 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:41.535288 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-acbe2ed4-9cb2-45b4-ac71-7a882091f6c5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1520 microversion: 2.1 time: 0.452967 Sep 06 10:52:41.535377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe4862ac-c605-47a4-a974-5a6c39e7e8aa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:41.535377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe4862ac-c605-47a4-a974-5a6c39e7e8aa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:41.538885 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 306/622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:41 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1520 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:41.551047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe4862ac-c605-47a4-a974-5a6c39e7e8aa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:41.551668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe4862ac-c605-47a4-a974-5a6c39e7e8aa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:41.552266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe4862ac-c605-47a4-a974-5a6c39e7e8aa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:41.554169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe4862ac-c605-47a4-a974-5a6c39e7e8aa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:41.555724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b30e0441-41c5-4cfe-bf5b-8a42bbbcaa77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-133513392"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:41.555856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe4862ac-c605-47a4-a974-5a6c39e7e8aa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:41.556372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe4862ac-c605-47a4-a974-5a6c39e7e8aa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:41.563747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b30e0441-41c5-4cfe-bf5b-8a42bbbcaa77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:41.589726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b30e0441-41c5-4cfe-bf5b-8a42bbbcaa77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:41.592543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b30e0441-41c5-4cfe-bf5b-8a42bbbcaa77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:41.595741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b30e0441-41c5-4cfe-bf5b-8a42bbbcaa77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:41.595741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b30e0441-41c5-4cfe-bf5b-8a42bbbcaa77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:41.596040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b30e0441-41c5-4cfe-bf5b-8a42bbbcaa77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:41.596479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b30e0441-41c5-4cfe-bf5b-8a42bbbcaa77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:41.954373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe4862ac-c605-47a4-a974-5a6c39e7e8aa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:41.968049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe4862ac-c605-47a4-a974-5a6c39e7e8aa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:41.972606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe4862ac-c605-47a4-a974-5a6c39e7e8aa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:41.974367 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe4862ac-c605-47a4-a974-5a6c39e7e8aa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1320 microversion: 2.25 time: 0.448432 Sep 06 10:52:41.974959 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 317/623] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:41 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1320 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:41.997146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-271c5d64-e9d4-4be4-b854-a30cc553b1c5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:41.998302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-271c5d64-e9d4-4be4-b854-a30cc553b1c5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:42.007772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-271c5d64-e9d4-4be4-b854-a30cc553b1c5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:42.008515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-271c5d64-e9d4-4be4-b854-a30cc553b1c5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:42.009314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-271c5d64-e9d4-4be4-b854-a30cc553b1c5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:42.010462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-271c5d64-e9d4-4be4-b854-a30cc553b1c5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:42.011354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-271c5d64-e9d4-4be4-b854-a30cc553b1c5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:42.012535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-271c5d64-e9d4-4be4-b854-a30cc553b1c5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:42.325113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-271c5d64-e9d4-4be4-b854-a30cc553b1c5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:42.336301 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-271c5d64-e9d4-4be4-b854-a30cc553b1c5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1493 microversion: 2.1 time: 0.346119 Sep 06 10:52:42.358087 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 318/624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:41 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1493 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:42.365374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26da6337-2517-41a7-bdd8-69ea2611720b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '.version_select at 0x7f90f8a2a9d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:42.404555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26da6337-2517-41a7-bdd8-69ea2611720b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:42.405110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26da6337-2517-41a7-bdd8-69ea2611720b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:42.405572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26da6337-2517-41a7-bdd8-69ea2611720b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:42.459697 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-26da6337-2517-41a7-bdd8-69ea2611720b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 782 microversion: 2.1 time: 0.099176 Sep 06 10:52:42.461932 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 319/625] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 10:52:42 2022] GET /compute/v2.1/os-migrations => generated 782 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:42.491324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9b63f18d-06ae-4060-88f8-f9e2e0442c88 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:42.493397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9b63f18d-06ae-4060-88f8-f9e2e0442c88 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:42.506674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b63f18d-06ae-4060-88f8-f9e2e0442c88 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:42.507557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b63f18d-06ae-4060-88f8-f9e2e0442c88 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:42.508382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b63f18d-06ae-4060-88f8-f9e2e0442c88 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:42.509512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b63f18d-06ae-4060-88f8-f9e2e0442c88 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:42.510204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b63f18d-06ae-4060-88f8-f9e2e0442c88 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:42.510836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b63f18d-06ae-4060-88f8-f9e2e0442c88 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:42.511121 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b30e0441-41c5-4cfe-bf5b-8a42bbbcaa77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action" status: 202 len: 0 microversion: 2.1 time: 0.949706 Sep 06 10:52:42.514898 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 307/626] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:52:41 2022] POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action => generated 0 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 06 10:52:42.545447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3666d771-273a-415a-9406-10c2e57e72d7 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-252354521"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:42.557379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3666d771-273a-415a-9406-10c2e57e72d7 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:42.607903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3666d771-273a-415a-9406-10c2e57e72d7 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:42.615254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3666d771-273a-415a-9406-10c2e57e72d7 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:42.623407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3666d771-273a-415a-9406-10c2e57e72d7 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:42.633832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3666d771-273a-415a-9406-10c2e57e72d7 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:42.636090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3666d771-273a-415a-9406-10c2e57e72d7 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:42.644472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3666d771-273a-415a-9406-10c2e57e72d7 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:42.719321 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-3666d771-273a-415a-9406-10c2e57e72d7 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] HTTP exception thrown: Cannot 'createImage' instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 while it is in task_state image_snapshot_pending Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3666d771-273a-415a-9406-10c2e57e72d7 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action HTTP/1.1 Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 84 Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:52:42.721176 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:52:42.722601 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:52:42.722601 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:42.722601 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:52:42.722601 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:42.722601 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:52:42.722601 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:42.722601 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:42.722601 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:52:42.722601 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:52:42.722601 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:52:42.722601 ncdv-master-1 devstack@n-api.service[140875]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-252354521"}} Sep 06 10:52:42.722601 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: exception: Cannot 'createImage' instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 while it is in task_state image_snapshot_pending Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '94c8cb47-28e9-42c5-97f6-8cefe47b7555', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-252354521'}}} Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:42.723397 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 while it is in task_state image_snapshot_pending Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 while it is in task_state image_snapshot_pending Sep 06 10:52:42.729787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:42.731575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3666d771-273a-415a-9406-10c2e57e72d7 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 409 to user: Cannot 'createImage' instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 while it is in task_state image_snapshot_pending {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:42.731575 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3666d771-273a-415a-9406-10c2e57e72d7 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action" status: 409 len: 167 microversion: 2.1 time: 0.187889 Sep 06 10:52:42.732151 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 308/627] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:52:42 2022] POST /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555/action => generated 167 bytes in 199 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:52:42.743562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e0bcdcc-e15d-4007-9f0b-c8a7c14512e9 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:42.744519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e0bcdcc-e15d-4007-9f0b-c8a7c14512e9 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:42.764224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e0bcdcc-e15d-4007-9f0b-c8a7c14512e9 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:42.768868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e0bcdcc-e15d-4007-9f0b-c8a7c14512e9 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:42.768868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e0bcdcc-e15d-4007-9f0b-c8a7c14512e9 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:42.768868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e0bcdcc-e15d-4007-9f0b-c8a7c14512e9 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:42.768868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e0bcdcc-e15d-4007-9f0b-c8a7c14512e9 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:42.769395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e0bcdcc-e15d-4007-9f0b-c8a7c14512e9 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:43.008420 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9b63f18d-06ae-4060-88f8-f9e2e0442c88 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1644 microversion: 2.1 time: 0.535258 Sep 06 10:52:43.013117 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 320/628] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:42 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1644 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:43.022885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-266b2e16-2af1-4f42-96f7-192bc3e50168 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '.version_select at 0x7f90f8a2a670>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:43.128597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7e0bcdcc-e15d-4007-9f0b-c8a7c14512e9 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:43.150426 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e0bcdcc-e15d-4007-9f0b-c8a7c14512e9 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1321 microversion: 2.1 time: 0.415088 Sep 06 10:52:43.160648 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 309/629] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:42 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:43.201134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bde07cd5-854f-4f6f-9dc0-6374d7ab4874 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:43.201779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bde07cd5-854f-4f6f-9dc0-6374d7ab4874 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:43.223663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde07cd5-854f-4f6f-9dc0-6374d7ab4874 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:43.224168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde07cd5-854f-4f6f-9dc0-6374d7ab4874 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:43.224613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde07cd5-854f-4f6f-9dc0-6374d7ab4874 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:43.228084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde07cd5-854f-4f6f-9dc0-6374d7ab4874 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:43.228599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde07cd5-854f-4f6f-9dc0-6374d7ab4874 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:43.230060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde07cd5-854f-4f6f-9dc0-6374d7ab4874 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:43.438975 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-266b2e16-2af1-4f42-96f7-192bc3e50168 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "DELETE /compute/v2.1/images/d0634bd2-c679-41d3-a2a7-ec4c8cc8742e" status: 204 len: 0 microversion: 2.1 time: 0.421844 Sep 06 10:52:43.438975 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 321/630] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:43 2022] DELETE /compute/v2.1/images/d0634bd2-c679-41d3-a2a7-ec4c8cc8742e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:52:43.445836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1369444160", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "83241706-ada5-4425-9544-55285e98247c"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:43.583600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] validate_networks() for [('83241706-ada5-4425-9544-55285e98247c', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:52:43.622614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bde07cd5-854f-4f6f-9dc0-6374d7ab4874 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:43.641359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bde07cd5-854f-4f6f-9dc0-6374d7ab4874 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:43.643348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bde07cd5-854f-4f6f-9dc0-6374d7ab4874 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:43.647645 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bde07cd5-854f-4f6f-9dc0-6374d7ab4874 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1362 microversion: 2.25 time: 0.475040 Sep 06 10:52:43.650261 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 310/631] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:43 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1362 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:43.657754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-95e750a0-b0fd-4cd1-9f52-1a1753461fd4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:43.663321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-95e750a0-b0fd-4cd1-9f52-1a1753461fd4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:43.677731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95e750a0-b0fd-4cd1-9f52-1a1753461fd4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:43.682420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95e750a0-b0fd-4cd1-9f52-1a1753461fd4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:43.682420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95e750a0-b0fd-4cd1-9f52-1a1753461fd4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:43.682420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95e750a0-b0fd-4cd1-9f52-1a1753461fd4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:43.682420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95e750a0-b0fd-4cd1-9f52-1a1753461fd4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:43.682847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95e750a0-b0fd-4cd1-9f52-1a1753461fd4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:43.931751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-95e750a0-b0fd-4cd1-9f52-1a1753461fd4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:43.959242 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-95e750a0-b0fd-4cd1-9f52-1a1753461fd4 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1532 microversion: 2.1 time: 0.307613 Sep 06 10:52:43.960549 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 311/632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:43 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1532 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:44.196347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-689af824-1177-4774-ab7f-03fa6e6f2d48 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:44.197261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-689af824-1177-4774-ab7f-03fa6e6f2d48 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:44.206103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-689af824-1177-4774-ab7f-03fa6e6f2d48 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:44.207588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-689af824-1177-4774-ab7f-03fa6e6f2d48 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:44.208039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-689af824-1177-4774-ab7f-03fa6e6f2d48 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:44.209001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-689af824-1177-4774-ab7f-03fa6e6f2d48 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:44.209916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-689af824-1177-4774-ab7f-03fa6e6f2d48 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:44.210797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-689af824-1177-4774-ab7f-03fa6e6f2d48 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:44.743030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-689af824-1177-4774-ab7f-03fa6e6f2d48 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:44.752628 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-689af824-1177-4774-ab7f-03fa6e6f2d48 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1321 microversion: 2.1 time: 0.565925 Sep 06 10:52:44.753239 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 312/633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:44 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1321 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:44.782178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f1d9aee9-69be-43f9-ab34-09726ae137d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:44.783241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f1d9aee9-69be-43f9-ab34-09726ae137d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:44.789532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1d9aee9-69be-43f9-ab34-09726ae137d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:44.790166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1d9aee9-69be-43f9-ab34-09726ae137d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:44.790799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1d9aee9-69be-43f9-ab34-09726ae137d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:44.791727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1d9aee9-69be-43f9-ab34-09726ae137d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:44.792456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1d9aee9-69be-43f9-ab34-09726ae137d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:44.793163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1d9aee9-69be-43f9-ab34-09726ae137d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:45.070061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f1d9aee9-69be-43f9-ab34-09726ae137d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:45.082933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f1d9aee9-69be-43f9-ab34-09726ae137d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:45.082933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f1d9aee9-69be-43f9-ab34-09726ae137d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:45.082933 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f1d9aee9-69be-43f9-ab34-09726ae137d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1362 microversion: 2.25 time: 0.328335 Sep 06 10:52:45.084259 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 313/634] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:44 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:45.086427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:52:45.087189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:52:45.087831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:52:45.088394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:52:45.089286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:52:45.090686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-76f9b309-1130-45b6-91cc-85142dc91683 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:45.091671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-76f9b309-1130-45b6-91cc-85142dc91683 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:45.098850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76f9b309-1130-45b6-91cc-85142dc91683 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:45.099572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76f9b309-1130-45b6-91cc-85142dc91683 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:45.100939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76f9b309-1130-45b6-91cc-85142dc91683 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:45.101848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76f9b309-1130-45b6-91cc-85142dc91683 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:45.102480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76f9b309-1130-45b6-91cc-85142dc91683 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:45.103158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76f9b309-1130-45b6-91cc-85142dc91683 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:45.110852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:45.111678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:45.112292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:45.113415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:45.114054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:45.115204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:45.330987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=25 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:45.342059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:45.344461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Getting quotas for project fb1af95268504c5bbed702fce756f5f4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:52:45.350322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Getting quotas for user c4e1ac1b40e94dbc80548a1f45919b6f and project fb1af95268504c5bbed702fce756f5f4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:52:45.366133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:52:45.369623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:52:45.506989 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8ed51de0-65d0-4d15-8ecb-00a01841976d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.064373 Sep 06 10:52:45.510049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-76f9b309-1130-45b6-91cc-85142dc91683 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:45.510375 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 322/635] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:52:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:52:45.521901 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-76f9b309-1130-45b6-91cc-85142dc91683 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1538 microversion: 2.1 time: 0.436042 Sep 06 10:52:45.542142 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 314/636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:45 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1538 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:45.542674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-84e69db8-6cb2-4edb-8857-6e677232e762 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:45.542674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-84e69db8-6cb2-4edb-8857-6e677232e762 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:45.605464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-84e69db8-6cb2-4edb-8857-6e677232e762 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:45.621804 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-84e69db8-6cb2-4edb-8857-6e677232e762 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1211 microversion: 2.1 time: 0.103671 Sep 06 10:52:45.623117 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 323/637] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:45 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:45.782195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a91c106d-2110-4f9f-ada8-f7d73252c4a5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:45.783367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a91c106d-2110-4f9f-ada8-f7d73252c4a5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:45.793857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a91c106d-2110-4f9f-ada8-f7d73252c4a5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:45.794379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a91c106d-2110-4f9f-ada8-f7d73252c4a5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:45.800204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a91c106d-2110-4f9f-ada8-f7d73252c4a5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:45.801341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a91c106d-2110-4f9f-ada8-f7d73252c4a5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:45.801975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a91c106d-2110-4f9f-ada8-f7d73252c4a5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:45.803837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a91c106d-2110-4f9f-ada8-f7d73252c4a5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:45.822661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-0d459cc3-c1d4-48c0-a4fb-199a2a4bb8c0 req-80661abd-f45d-4384-ad35-05599b704740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239473a8-8554-4c9d-a566-b76c75336087", "tag": "e8f21b28-8b08-44a7-892d-3e672959f381"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:45.844044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0d459cc3-c1d4-48c0-a4fb-199a2a4bb8c0 req-80661abd-f45d-4384-ad35-05599b704740 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:45.844821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0d459cc3-c1d4-48c0-a4fb-199a2a4bb8c0 req-80661abd-f45d-4384-ad35-05599b704740 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:45.845598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0d459cc3-c1d4-48c0-a4fb-199a2a4bb8c0 req-80661abd-f45d-4384-ad35-05599b704740 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:45.884457 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-0d459cc3-c1d4-48c0-a4fb-199a2a4bb8c0 req-80661abd-f45d-4384-ad35-05599b704740 service nova] Creating event network-changed:e8f21b28-8b08-44a7-892d-3e672959f381 for instance 239473a8-8554-4c9d-a566-b76c75336087 on nch2-master-1 Sep 06 10:52:45.892375 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-0d459cc3-c1d4-48c0-a4fb-199a2a4bb8c0 req-80661abd-f45d-4384-ad35-05599b704740 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073394 Sep 06 10:52:45.896512 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 324/638] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:46.114051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f769307e-b4d0-42bb-bf25-2e13d741bb5a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:46.119327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f769307e-b4d0-42bb-bf25-2e13d741bb5a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:46.133430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f769307e-b4d0-42bb-bf25-2e13d741bb5a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:46.133930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f769307e-b4d0-42bb-bf25-2e13d741bb5a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:46.134474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f769307e-b4d0-42bb-bf25-2e13d741bb5a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:46.135229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f769307e-b4d0-42bb-bf25-2e13d741bb5a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:46.144091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f769307e-b4d0-42bb-bf25-2e13d741bb5a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:46.144663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f769307e-b4d0-42bb-bf25-2e13d741bb5a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:46.525277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=85 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:46.577378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a91c106d-2110-4f9f-ada8-f7d73252c4a5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:46.617350 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a91c106d-2110-4f9f-ada8-f7d73252c4a5 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1321 microversion: 2.1 time: 0.839381 Sep 06 10:52:46.640876 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 315/639] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:45 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1321 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:46.654845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aaafdabb-b558-4aa0-b786-3b91bd5be35e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:46.657596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aaafdabb-b558-4aa0-b786-3b91bd5be35e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:46.672906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aaafdabb-b558-4aa0-b786-3b91bd5be35e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:46.673034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aaafdabb-b558-4aa0-b786-3b91bd5be35e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:46.674858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aaafdabb-b558-4aa0-b786-3b91bd5be35e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:46.675661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aaafdabb-b558-4aa0-b786-3b91bd5be35e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:46.676142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aaafdabb-b558-4aa0-b786-3b91bd5be35e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:46.679111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aaafdabb-b558-4aa0-b786-3b91bd5be35e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:46.777384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f769307e-b4d0-42bb-bf25-2e13d741bb5a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:46.792012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f769307e-b4d0-42bb-bf25-2e13d741bb5a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:46.794235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f769307e-b4d0-42bb-bf25-2e13d741bb5a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:46.816891 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f769307e-b4d0-42bb-bf25-2e13d741bb5a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1362 microversion: 2.25 time: 0.707461 Sep 06 10:52:46.818273 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 325/640] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:46 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1362 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:52:46.833495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1caa3d61-b7b2-4b2f-969a-f13e333683d8 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:46.834594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1caa3d61-b7b2-4b2f-969a-f13e333683d8 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:46.845213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1caa3d61-b7b2-4b2f-969a-f13e333683d8 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:46.846044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1caa3d61-b7b2-4b2f-969a-f13e333683d8 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:46.848507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1caa3d61-b7b2-4b2f-969a-f13e333683d8 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:46.851948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1caa3d61-b7b2-4b2f-969a-f13e333683d8 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:46.852629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1caa3d61-b7b2-4b2f-969a-f13e333683d8 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:46.853364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1caa3d61-b7b2-4b2f-969a-f13e333683d8 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:47.072502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aaafdabb-b558-4aa0-b786-3b91bd5be35e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:47.089563 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aaafdabb-b558-4aa0-b786-3b91bd5be35e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1520 microversion: 2.1 time: 0.441391 Sep 06 10:52:47.090863 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 316/641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:46 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1520 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:47.098652 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-21be0754-542f-46ca-9050-5ea3aaa84cf7 req-e5c604eb-59db-45c7-a178-ab5f39276f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd27770e-769c-4cf0-94af-385f8049f51e", "name": "network-vif-plugged", "status": "completed", "tag": "a1b2e0a1-7c2d-41d6-9a07-6fdfaca69e81"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:47.125720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-21be0754-542f-46ca-9050-5ea3aaa84cf7 req-e5c604eb-59db-45c7-a178-ab5f39276f47 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:47.125720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-21be0754-542f-46ca-9050-5ea3aaa84cf7 req-e5c604eb-59db-45c7-a178-ab5f39276f47 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:47.125720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-21be0754-542f-46ca-9050-5ea3aaa84cf7 req-e5c604eb-59db-45c7-a178-ab5f39276f47 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:47.151129 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-21be0754-542f-46ca-9050-5ea3aaa84cf7 req-e5c604eb-59db-45c7-a178-ab5f39276f47 service nova] Creating event network-vif-plugged:a1b2e0a1-7c2d-41d6-9a07-6fdfaca69e81 for instance fd27770e-769c-4cf0-94af-385f8049f51e on nch2-master-1 Sep 06 10:52:47.164984 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-21be0754-542f-46ca-9050-5ea3aaa84cf7 req-e5c604eb-59db-45c7-a178-ab5f39276f47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072519 Sep 06 10:52:47.165686 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 317/642] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:47.166944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1caa3d61-b7b2-4b2f-969a-f13e333683d8 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:47.174987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-975502ac-c4a8-47ff-b5f0-ac056ed4c735 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:47.179933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-975502ac-c4a8-47ff-b5f0-ac056ed4c735 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:47.181867 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1caa3d61-b7b2-4b2f-969a-f13e333683d8 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1215 microversion: 2.1 time: 0.359957 Sep 06 10:52:47.184995 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 326/643] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:46 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1215 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:47.194813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-975502ac-c4a8-47ff-b5f0-ac056ed4c735 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:47.195414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-975502ac-c4a8-47ff-b5f0-ac056ed4c735 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:47.202116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-975502ac-c4a8-47ff-b5f0-ac056ed4c735 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:47.202116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-975502ac-c4a8-47ff-b5f0-ac056ed4c735 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:47.202116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-975502ac-c4a8-47ff-b5f0-ac056ed4c735 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:47.202116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-975502ac-c4a8-47ff-b5f0-ac056ed4c735 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:47.281793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-975502ac-c4a8-47ff-b5f0-ac056ed4c735 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:52:47.301755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:47.631149 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-975502ac-c4a8-47ff-b5f0-ac056ed4c735 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "DELETE /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 204 len: 0 microversion: 2.1 time: 0.460195 Sep 06 10:52:47.632317 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 318/644] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:52:47 2022] DELETE /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:52:47.641732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2e0cadf4-b635-42de-a61c-3b51964f5591 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:47.643723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2e0cadf4-b635-42de-a61c-3b51964f5591 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:47.647887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a4217636-900e-479b-a1ca-88c99cf0d696 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:47.648666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a4217636-900e-479b-a1ca-88c99cf0d696 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:47.651135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e0cadf4-b635-42de-a61c-3b51964f5591 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:47.652095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e0cadf4-b635-42de-a61c-3b51964f5591 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:47.653284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e0cadf4-b635-42de-a61c-3b51964f5591 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:47.654172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e0cadf4-b635-42de-a61c-3b51964f5591 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:47.654803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e0cadf4-b635-42de-a61c-3b51964f5591 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:47.655431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e0cadf4-b635-42de-a61c-3b51964f5591 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:47.656267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4217636-900e-479b-a1ca-88c99cf0d696 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:47.656851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4217636-900e-479b-a1ca-88c99cf0d696 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:47.657360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4217636-900e-479b-a1ca-88c99cf0d696 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:47.658136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4217636-900e-479b-a1ca-88c99cf0d696 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:47.658665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4217636-900e-479b-a1ca-88c99cf0d696 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:47.659198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4217636-900e-479b-a1ca-88c99cf0d696 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:48.125959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=37 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:48.427299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a4217636-900e-479b-a1ca-88c99cf0d696 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:48.439025 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a4217636-900e-479b-a1ca-88c99cf0d696 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1321 microversion: 2.1 time: 0.794945 Sep 06 10:52:48.440416 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 319/645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:47 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1321 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:48.469630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-31bb0e6e-9e64-4765-80fd-5f941153b436 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:48.471079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-31bb0e6e-9e64-4765-80fd-5f941153b436 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:48.473381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2e0cadf4-b635-42de-a61c-3b51964f5591 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:48.483956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bb0e6e-9e64-4765-80fd-5f941153b436 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:48.485372 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2e0cadf4-b635-42de-a61c-3b51964f5591 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1526 microversion: 2.1 time: 0.847626 Sep 06 10:52:48.485937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bb0e6e-9e64-4765-80fd-5f941153b436 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:48.486184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bb0e6e-9e64-4765-80fd-5f941153b436 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:48.487148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bb0e6e-9e64-4765-80fd-5f941153b436 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:48.487713 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 327/646] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:47 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1526 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:48.488214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bb0e6e-9e64-4765-80fd-5f941153b436 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:48.488887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bb0e6e-9e64-4765-80fd-5f941153b436 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:48.505770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-860c1a38-d9df-4955-b306-ee6f1a6e457b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:48.510007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-860c1a38-d9df-4955-b306-ee6f1a6e457b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:48.553297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-860c1a38-d9df-4955-b306-ee6f1a6e457b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:48.554483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-860c1a38-d9df-4955-b306-ee6f1a6e457b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:48.556116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-860c1a38-d9df-4955-b306-ee6f1a6e457b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:48.557998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-860c1a38-d9df-4955-b306-ee6f1a6e457b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:48.561682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-860c1a38-d9df-4955-b306-ee6f1a6e457b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:48.562745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-860c1a38-d9df-4955-b306-ee6f1a6e457b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:48.754558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-860c1a38-d9df-4955-b306-ee6f1a6e457b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:48.769148 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-860c1a38-d9df-4955-b306-ee6f1a6e457b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1271 microversion: 2.1 time: 0.279429 Sep 06 10:52:48.796877 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 328/647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:48 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1271 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:48.950167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-31bb0e6e-9e64-4765-80fd-5f941153b436 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:48.962243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-31bb0e6e-9e64-4765-80fd-5f941153b436 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:48.965483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-31bb0e6e-9e64-4765-80fd-5f941153b436 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:48.967648 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-31bb0e6e-9e64-4765-80fd-5f941153b436 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1362 microversion: 2.25 time: 0.525867 Sep 06 10:52:48.970250 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 320/648] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:48 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1362 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:49.203934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ba949049-199c-4b03-bf26-ad53a3025cc8 req-1d81c041-2365-45ba-9f1f-a6fc6f14bf58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c8cb47-28e9-42c5-97f6-8cefe47b7555", "name": "network-vif-plugged", "status": "completed", "tag": "473b3240-51be-44f5-9767-a6901b66a6d3"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:49.220828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ba949049-199c-4b03-bf26-ad53a3025cc8 req-1d81c041-2365-45ba-9f1f-a6fc6f14bf58 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:49.221485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ba949049-199c-4b03-bf26-ad53a3025cc8 req-1d81c041-2365-45ba-9f1f-a6fc6f14bf58 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:49.222126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ba949049-199c-4b03-bf26-ad53a3025cc8 req-1d81c041-2365-45ba-9f1f-a6fc6f14bf58 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:49.239877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-82100636-8b1a-4675-8e27-e51461064065 tempest-FloatingIPDetailsNegativeTestJSON-2029046176 tempest-FloatingIPDetailsNegativeTestJSON-2029046176-project] Calling method '.version_select at 0x7f90f8ab64c0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:49.241926 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ba949049-199c-4b03-bf26-ad53a3025cc8 req-1d81c041-2365-45ba-9f1f-a6fc6f14bf58 service nova] Creating event network-vif-plugged:473b3240-51be-44f5-9767-a6901b66a6d3 for instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 on nch2-master-1 Sep 06 10:52:49.248840 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ba949049-199c-4b03-bf26-ad53a3025cc8 req-1d81c041-2365-45ba-9f1f-a6fc6f14bf58 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052594 Sep 06 10:52:49.252109 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 321/649] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:49.309631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-82100636-8b1a-4675-8e27-e51461064065 tempest-FloatingIPDetailsNegativeTestJSON-2029046176 tempest-FloatingIPDetailsNegativeTestJSON-2029046176-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3ec26a60-5193-4fac-93f1-4ff2c892c0c3 could not be found", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:52:49.311280 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-82100636-8b1a-4675-8e27-e51461064065 tempest-FloatingIPDetailsNegativeTestJSON-2029046176 tempest-FloatingIPDetailsNegativeTestJSON-2029046176-project] HTTP exception thrown: Floating IP not found for ID 3ec26a60-5193-4fac-93f1-4ff2c892c0c3 Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-82100636-8b1a-4675-8e27-e51461064065 tempest-FloatingIPDetailsNegativeTestJSON-2029046176 tempest-FloatingIPDetailsNegativeTestJSON-2029046176-project] Request method failure captured: Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-floating-ips/3ec26a60-5193-4fac-93f1-4ff2c892c0c3 HTTP/1.1 Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaAZDpcGeC1yanLQSGNAjRiAedUI3rpTuVwMdNTE1cPlO-fym8_DRGIW_AyE8WiXGVg8OtmhszPon8qi8aO1CnBy3Xo0gbskulsvaFo_G6txwk-TuaACQqhzB13k2CkBYp2IDFtxNYa5q9ZmQiM9g0e1j5oJI-WOH__5n8JJxpisAo Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: fb1bb71c2e344a579584add8a97863f1 Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2029046176 Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:52:49.340451 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:52:49.341865 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb1bb71c2e344a579584add8a97863f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb1bb71c2e344a579584add8a97863f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb1bb71c2e344a579584add8a97863f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb1bb71c2e344a579584add8a97863f1"}]}] Sep 06 10:52:49.341865 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2029046176 Sep 06 10:52:49.341865 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: fb1bb71c2e344a579584add8a97863f1 Sep 06 10:52:49.341865 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2029046176 Sep 06 10:52:49.341865 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2029046176-project Sep 06 10:52:49.341865 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:52:49.341865 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:52:49.341865 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 42902f5389b747b18216571f47b9e537 Sep 06 10:52:49.341865 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2029046176-project Sep 06 10:52:49.341865 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:52:49.341865 ncdv-master-1 devstack@n-api.service[140876]: exception: Floating IP not found for ID 3ec26a60-5193-4fac-93f1-4ff2c892c0c3 Sep 06 10:52:49.341865 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '3ec26a60-5193-4fac-93f1-4ff2c892c0c3'} Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:52:49.342789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3ec26a60-5193-4fac-93f1-4ff2c892c0c3 could not be found Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f904043-5f46-4127-a3b5-87219141ebb8'] Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3ec26a60-5193-4fac-93f1-4ff2c892c0c3. Sep 06 10:52:49.344029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3ec26a60-5193-4fac-93f1-4ff2c892c0c3 Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:49.345371 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:49.346693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:49.346693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3ec26a60-5193-4fac-93f1-4ff2c892c0c3 Sep 06 10:52:49.346693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:49.352495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-82100636-8b1a-4675-8e27-e51461064065 tempest-FloatingIPDetailsNegativeTestJSON-2029046176 tempest-FloatingIPDetailsNegativeTestJSON-2029046176-project] Returning 404 to user: Floating IP not found for ID 3ec26a60-5193-4fac-93f1-4ff2c892c0c3 {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:49.354610 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-82100636-8b1a-4675-8e27-e51461064065 tempest-FloatingIPDetailsNegativeTestJSON-2029046176 tempest-FloatingIPDetailsNegativeTestJSON-2029046176-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/3ec26a60-5193-4fac-93f1-4ff2c892c0c3" status: 404 len: 111 microversion: 2.1 time: 0.555838 Sep 06 10:52:49.357103 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 329/650] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 10:52:48 2022] GET /compute/v2.1/os-floating-ips/3ec26a60-5193-4fac-93f1-4ff2c892c0c3 => generated 111 bytes in 560 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:52:49.469621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-17f85f30-c492-4cb2-ad9e-160912c6b44e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:49.470426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-17f85f30-c492-4cb2-ad9e-160912c6b44e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:49.483383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f85f30-c492-4cb2-ad9e-160912c6b44e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:49.488822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f85f30-c492-4cb2-ad9e-160912c6b44e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:49.491045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f85f30-c492-4cb2-ad9e-160912c6b44e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:49.491045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f85f30-c492-4cb2-ad9e-160912c6b44e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:49.491045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f85f30-c492-4cb2-ad9e-160912c6b44e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:49.494209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f85f30-c492-4cb2-ad9e-160912c6b44e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:49.517703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3e6997f4-a72d-40df-bf99-bddae218658d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:49.519678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3e6997f4-a72d-40df-bf99-bddae218658d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:49.539476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e6997f4-a72d-40df-bf99-bddae218658d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:49.540638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e6997f4-a72d-40df-bf99-bddae218658d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:49.542342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e6997f4-a72d-40df-bf99-bddae218658d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:49.544226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e6997f4-a72d-40df-bf99-bddae218658d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:49.544913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e6997f4-a72d-40df-bf99-bddae218658d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:49.546500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e6997f4-a72d-40df-bf99-bddae218658d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:49.961268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-17f85f30-c492-4cb2-ad9e-160912c6b44e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:49.980093 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-17f85f30-c492-4cb2-ad9e-160912c6b44e tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1321 microversion: 2.1 time: 0.513165 Sep 06 10:52:49.981058 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 322/651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:49 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:49.984208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3e6997f4-a72d-40df-bf99-bddae218658d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:49.993321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-83215bc4-7018-4aaf-bbdb-827412c4656b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:49.995673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-83215bc4-7018-4aaf-bbdb-827412c4656b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:50.006410 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3e6997f4-a72d-40df-bf99-bddae218658d tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1526 microversion: 2.1 time: 0.494840 Sep 06 10:52:50.009310 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 330/652] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:49 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1526 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:50.013405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83215bc4-7018-4aaf-bbdb-827412c4656b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:50.013910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83215bc4-7018-4aaf-bbdb-827412c4656b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:50.014356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83215bc4-7018-4aaf-bbdb-827412c4656b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:50.020869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83215bc4-7018-4aaf-bbdb-827412c4656b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:50.021546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83215bc4-7018-4aaf-bbdb-827412c4656b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:50.022155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83215bc4-7018-4aaf-bbdb-827412c4656b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:50.033011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4b321623-cd83-4f19-9d8e-02b687298672 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:50.033724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4b321623-cd83-4f19-9d8e-02b687298672 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:50.049782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b321623-cd83-4f19-9d8e-02b687298672 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:50.052369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b321623-cd83-4f19-9d8e-02b687298672 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:50.054853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b321623-cd83-4f19-9d8e-02b687298672 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:50.060479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b321623-cd83-4f19-9d8e-02b687298672 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:50.060479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b321623-cd83-4f19-9d8e-02b687298672 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:50.060479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b321623-cd83-4f19-9d8e-02b687298672 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:50.143074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-83215bc4-7018-4aaf-bbdb-827412c4656b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:50.155418 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-83215bc4-7018-4aaf-bbdb-827412c4656b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1269 microversion: 2.1 time: 0.173206 Sep 06 10:52:50.160495 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 323/653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:49 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:50.518888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4b321623-cd83-4f19-9d8e-02b687298672 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:50.534675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4b321623-cd83-4f19-9d8e-02b687298672 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:50.537498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4b321623-cd83-4f19-9d8e-02b687298672 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:50.541609 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4b321623-cd83-4f19-9d8e-02b687298672 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1362 microversion: 2.25 time: 0.528590 Sep 06 10:52:50.556822 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 331/654] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:50 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1362 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:51.006345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-362b7aec-b52d-4026-8a42-a4c3b6d07396 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:51.006959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-362b7aec-b52d-4026-8a42-a4c3b6d07396 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:51.013980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-362b7aec-b52d-4026-8a42-a4c3b6d07396 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:51.014474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-362b7aec-b52d-4026-8a42-a4c3b6d07396 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:51.014915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-362b7aec-b52d-4026-8a42-a4c3b6d07396 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:51.023915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-362b7aec-b52d-4026-8a42-a4c3b6d07396 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:51.024399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-362b7aec-b52d-4026-8a42-a4c3b6d07396 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:51.024838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-362b7aec-b52d-4026-8a42-a4c3b6d07396 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:51.032841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8a587da2-727e-4aed-920c-897181b5ca09 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:51.033676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8a587da2-727e-4aed-920c-897181b5ca09 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:51.048142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a587da2-727e-4aed-920c-897181b5ca09 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:51.051751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a587da2-727e-4aed-920c-897181b5ca09 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:51.054289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a587da2-727e-4aed-920c-897181b5ca09 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:51.054289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a587da2-727e-4aed-920c-897181b5ca09 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:51.054289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a587da2-727e-4aed-920c-897181b5ca09 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:51.054289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a587da2-727e-4aed-920c-897181b5ca09 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:51.473085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-362b7aec-b52d-4026-8a42-a4c3b6d07396 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:51.487271 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-362b7aec-b52d-4026-8a42-a4c3b6d07396 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1321 microversion: 2.1 time: 0.484291 Sep 06 10:52:51.489469 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 324/655] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:51 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1321 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:51.502378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e09c959b-9289-4d18-91eb-23e93da4cc70 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:51.504163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e09c959b-9289-4d18-91eb-23e93da4cc70 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:51.519112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e09c959b-9289-4d18-91eb-23e93da4cc70 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:51.519977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e09c959b-9289-4d18-91eb-23e93da4cc70 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:51.521805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e09c959b-9289-4d18-91eb-23e93da4cc70 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:51.523535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e09c959b-9289-4d18-91eb-23e93da4cc70 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:51.524389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e09c959b-9289-4d18-91eb-23e93da4cc70 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:51.528324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e09c959b-9289-4d18-91eb-23e93da4cc70 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:51.637958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8a587da2-727e-4aed-920c-897181b5ca09 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:51.656400 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8a587da2-727e-4aed-920c-897181b5ca09 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1526 microversion: 2.1 time: 0.626784 Sep 06 10:52:51.658600 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 332/656] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:51 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1526 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:51.673848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-80c5bc22-38e8-4c66-9f8e-a9b8dfa33519 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:51.675282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-80c5bc22-38e8-4c66-9f8e-a9b8dfa33519 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:51.686324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80c5bc22-38e8-4c66-9f8e-a9b8dfa33519 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:51.687083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80c5bc22-38e8-4c66-9f8e-a9b8dfa33519 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:51.687833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80c5bc22-38e8-4c66-9f8e-a9b8dfa33519 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:51.688729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80c5bc22-38e8-4c66-9f8e-a9b8dfa33519 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:51.689331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80c5bc22-38e8-4c66-9f8e-a9b8dfa33519 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:51.690246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80c5bc22-38e8-4c66-9f8e-a9b8dfa33519 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:52.061540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e09c959b-9289-4d18-91eb-23e93da4cc70 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:52.087556 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e09c959b-9289-4d18-91eb-23e93da4cc70 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1311 microversion: 2.1 time: 0.594266 Sep 06 10:52:52.090994 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 325/657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:51 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1311 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:52.276507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-80c5bc22-38e8-4c66-9f8e-a9b8dfa33519 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:52.301438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-80c5bc22-38e8-4c66-9f8e-a9b8dfa33519 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:52.315401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-80c5bc22-38e8-4c66-9f8e-a9b8dfa33519 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:52.319741 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-80c5bc22-38e8-4c66-9f8e-a9b8dfa33519 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1362 microversion: 2.25 time: 0.658995 Sep 06 10:52:52.323712 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 333/658] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:51 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1362 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:52.345893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-818816428", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:52.452845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:52:52.518702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76a9f501-2ec4-4e90-a331-3bd3f599db11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:52.520269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-76a9f501-2ec4-4e90-a331-3bd3f599db11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:52.530967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76a9f501-2ec4-4e90-a331-3bd3f599db11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:52.536471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76a9f501-2ec4-4e90-a331-3bd3f599db11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:52.537301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76a9f501-2ec4-4e90-a331-3bd3f599db11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:52.538784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76a9f501-2ec4-4e90-a331-3bd3f599db11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:52.539962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76a9f501-2ec4-4e90-a331-3bd3f599db11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:52.543332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76a9f501-2ec4-4e90-a331-3bd3f599db11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:52.900720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-76a9f501-2ec4-4e90-a331-3bd3f599db11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:52.915496 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-76a9f501-2ec4-4e90-a331-3bd3f599db11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1471 microversion: 2.1 time: 0.402122 Sep 06 10:52:52.925140 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 334/659] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:52 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1471 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:52.949881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c2656f09-1576-4b22-9595-57e8ef93d80a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:52.950445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c2656f09-1576-4b22-9595-57e8ef93d80a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:52.969178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2656f09-1576-4b22-9595-57e8ef93d80a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:52.974583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2656f09-1576-4b22-9595-57e8ef93d80a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:52.975161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2656f09-1576-4b22-9595-57e8ef93d80a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:52.978170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2656f09-1576-4b22-9595-57e8ef93d80a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:52.980090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2656f09-1576-4b22-9595-57e8ef93d80a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:52.981600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2656f09-1576-4b22-9595-57e8ef93d80a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:52.986334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:52:52.987784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:52:52.987784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:52:52.988312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:52:52.988929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:52:53.011126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:53.012632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:53.013252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:53.016810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:53.016810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:53.016810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:53.067106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Getting quotas for project 37509f3214ec4a83a0db84a1c5377690. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:52:53.093536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Getting quotas for user 42a1b77561bd4df3a751dea07b1c6cda and project 37509f3214ec4a83a0db84a1c5377690. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:52:53.139697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c2656f09-1576-4b22-9595-57e8ef93d80a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:53.157878 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c2656f09-1576-4b22-9595-57e8ef93d80a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 200 len: 1484 microversion: 2.1 time: 0.230515 Sep 06 10:52:53.159224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:52:53.166048 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 335/660] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:52 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 1484 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:53.166479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:52:53.175225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-43c581d2-423b-4d93-827b-52867bbfd5c4 req-fb57b4bc-c789-4d17-babe-d8658829c3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c8cb47-28e9-42c5-97f6-8cefe47b7555", "name": "network-vif-deleted", "tag": "473b3240-51be-44f5-9767-a6901b66a6d3"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:53.189606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-43c581d2-423b-4d93-827b-52867bbfd5c4 req-fb57b4bc-c789-4d17-babe-d8658829c3b0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:53.190529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-43c581d2-423b-4d93-827b-52867bbfd5c4 req-fb57b4bc-c789-4d17-babe-d8658829c3b0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:53.191213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-43c581d2-423b-4d93-827b-52867bbfd5c4 req-fb57b4bc-c789-4d17-babe-d8658829c3b0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:53.206580 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-43c581d2-423b-4d93-827b-52867bbfd5c4 req-fb57b4bc-c789-4d17-babe-d8658829c3b0 service nova] Creating event network-vif-deleted:473b3240-51be-44f5-9767-a6901b66a6d3 for instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 on nch2-master-1 Sep 06 10:52:53.216089 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-43c581d2-423b-4d93-827b-52867bbfd5c4 req-fb57b4bc-c789-4d17-babe-d8658829c3b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050312 Sep 06 10:52:53.216971 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 336/661] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:53.224527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eb611109-65a0-4239-a7d2-4202eb66d485 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:53.225941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eb611109-65a0-4239-a7d2-4202eb66d485 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:53.235835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb611109-65a0-4239-a7d2-4202eb66d485 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:53.241704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb611109-65a0-4239-a7d2-4202eb66d485 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:53.241704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb611109-65a0-4239-a7d2-4202eb66d485 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:53.241704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb611109-65a0-4239-a7d2-4202eb66d485 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:53.241704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb611109-65a0-4239-a7d2-4202eb66d485 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:53.242336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb611109-65a0-4239-a7d2-4202eb66d485 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:53.264707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:53.270714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-eb611109-65a0-4239-a7d2-4202eb66d485 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lazy-loading 'flavor' on Instance uuid fd27770e-769c-4cf0-94af-385f8049f51e {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:52:53.374045 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-86eaf35a-c9fa-478c-87e5-ac7bf07fa6ec tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281355 Sep 06 10:52:53.391428 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 326/662] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:52:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:52:53.406473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-10f9372b-84ce-44f5-b3cc-52c8a05de4bd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:53.409058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-10f9372b-84ce-44f5-b3cc-52c8a05de4bd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:53.425900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:53.430743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10f9372b-84ce-44f5-b3cc-52c8a05de4bd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:53.431470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10f9372b-84ce-44f5-b3cc-52c8a05de4bd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:53.432227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10f9372b-84ce-44f5-b3cc-52c8a05de4bd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:53.438849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10f9372b-84ce-44f5-b3cc-52c8a05de4bd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:53.439554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10f9372b-84ce-44f5-b3cc-52c8a05de4bd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:53.441711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10f9372b-84ce-44f5-b3cc-52c8a05de4bd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:53.692703 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eb611109-65a0-4239-a7d2-4202eb66d485 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e/action" status: 202 len: 0 microversion: 2.1 time: 0.472637 Sep 06 10:52:53.693893 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 337/663] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:52:53 2022] POST /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:52:53.701571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e57cb8b0-7e8f-4d97-9dd9-dcb500a48c87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:53.702985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e57cb8b0-7e8f-4d97-9dd9-dcb500a48c87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:53.710798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e57cb8b0-7e8f-4d97-9dd9-dcb500a48c87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:53.711666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e57cb8b0-7e8f-4d97-9dd9-dcb500a48c87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:53.712501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e57cb8b0-7e8f-4d97-9dd9-dcb500a48c87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:53.713461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e57cb8b0-7e8f-4d97-9dd9-dcb500a48c87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:53.714036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e57cb8b0-7e8f-4d97-9dd9-dcb500a48c87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:53.715181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e57cb8b0-7e8f-4d97-9dd9-dcb500a48c87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:54.558807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-10f9372b-84ce-44f5-b3cc-52c8a05de4bd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:54.571917 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-10f9372b-84ce-44f5-b3cc-52c8a05de4bd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1311 microversion: 2.1 time: 1.179006 Sep 06 10:52:54.572876 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 327/664] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:53 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1311 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:54.582236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1831387958", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:54.679406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:52:54.693227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e57cb8b0-7e8f-4d97-9dd9-dcb500a48c87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:54.707391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e57cb8b0-7e8f-4d97-9dd9-dcb500a48c87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:54.709159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e57cb8b0-7e8f-4d97-9dd9-dcb500a48c87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:54.714020 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e57cb8b0-7e8f-4d97-9dd9-dcb500a48c87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1362 microversion: 2.25 time: 1.018606 Sep 06 10:52:54.714789 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 338/665] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:53 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1362 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:54.735623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d0cb4d4a-171f-4396-8dfc-10be23692c15 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:54.737733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d0cb4d4a-171f-4396-8dfc-10be23692c15 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:54.756201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0cb4d4a-171f-4396-8dfc-10be23692c15 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:54.761692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0cb4d4a-171f-4396-8dfc-10be23692c15 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:54.761692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0cb4d4a-171f-4396-8dfc-10be23692c15 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:54.761692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0cb4d4a-171f-4396-8dfc-10be23692c15 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:54.761692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0cb4d4a-171f-4396-8dfc-10be23692c15 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:54.762528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0cb4d4a-171f-4396-8dfc-10be23692c15 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:55.481049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:52:55.487526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:52:55.487526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:52:55.487526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:52:55.487526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:52:55.498674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:55.500676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:55.501512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:55.502527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:55.503432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:55.504263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:55.566435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Getting quotas for project 37509f3214ec4a83a0db84a1c5377690. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:52:55.585777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Getting quotas for user 42a1b77561bd4df3a751dea07b1c6cda and project 37509f3214ec4a83a0db84a1c5377690. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:52:55.607726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:52:55.612263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:52:55.842057 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-52970b08-4d91-4e7b-ba7f-36035c4efc6e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.265524 Sep 06 10:52:55.849590 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 328/666] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:52:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:52:55.859685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b39e4975-478b-49d0-8bd4-b73f380cb77a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:55.859685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b39e4975-478b-49d0-8bd4-b73f380cb77a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:55.866286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b39e4975-478b-49d0-8bd4-b73f380cb77a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:55.867035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b39e4975-478b-49d0-8bd4-b73f380cb77a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:55.867673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b39e4975-478b-49d0-8bd4-b73f380cb77a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:55.868667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b39e4975-478b-49d0-8bd4-b73f380cb77a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:55.869286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b39e4975-478b-49d0-8bd4-b73f380cb77a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:55.870076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b39e4975-478b-49d0-8bd4-b73f380cb77a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:55.901761 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-b39e4975-478b-49d0-8bd4-b73f380cb77a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] HTTP exception thrown: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b39e4975-478b-49d0-8bd4-b73f380cb77a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 HTTP/1.1 Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:52:55.905518 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:52:55.907176 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:52:55.907176 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:55.907176 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:52:55.907176 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:52:55.907176 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:52:55.907176 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:55.907176 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:55.907176 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:52:55.907176 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:52:55.907176 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:52:55.907176 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:52:55.907176 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '94c8cb47-28e9-42c5-97f6-8cefe47b7555'} Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:55.908108 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:52:55.909588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:55.913319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b39e4975-478b-49d0-8bd4-b73f380cb77a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 404 to user: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:55.922912 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b39e4975-478b-49d0-8bd4-b73f380cb77a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 404 len: 111 microversion: 2.1 time: 0.063482 Sep 06 10:52:55.922912 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 329/667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:55 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:52:55.922912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-4ec01b5b-d7d4-43b5-91dc-7292c4355268 req-d8b233ba-9b48-4e35-829a-5998cdf2d434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239473a8-8554-4c9d-a566-b76c75336087", "name": "network-vif-plugged", "status": "completed", "tag": "e8f21b28-8b08-44a7-892d-3e672959f381"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:55.936837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4ec01b5b-d7d4-43b5-91dc-7292c4355268 req-d8b233ba-9b48-4e35-829a-5998cdf2d434 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:55.937314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4ec01b5b-d7d4-43b5-91dc-7292c4355268 req-d8b233ba-9b48-4e35-829a-5998cdf2d434 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:55.937741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4ec01b5b-d7d4-43b5-91dc-7292c4355268 req-d8b233ba-9b48-4e35-829a-5998cdf2d434 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:55.961431 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-4ec01b5b-d7d4-43b5-91dc-7292c4355268 req-d8b233ba-9b48-4e35-829a-5998cdf2d434 service nova] Creating event network-vif-plugged:e8f21b28-8b08-44a7-892d-3e672959f381 for instance 239473a8-8554-4c9d-a566-b76c75336087 on nch2-master-1 Sep 06 10:52:55.975968 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-4ec01b5b-d7d4-43b5-91dc-7292c4355268 req-d8b233ba-9b48-4e35-829a-5998cdf2d434 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059268 Sep 06 10:52:55.976576 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 330/668] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:55.982615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b7c4bbae-3333-43e1-bb69-462b5cae89c7 req-75642286-0895-46e9-a300-bb1001991052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11eb8c12-ec92-4302-a038-5c343138776c", "tag": "943d3511-f984-4e2d-9c92-94ae06bad6c8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:56.001303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b7c4bbae-3333-43e1-bb69-462b5cae89c7 req-75642286-0895-46e9-a300-bb1001991052 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:56.001303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b7c4bbae-3333-43e1-bb69-462b5cae89c7 req-75642286-0895-46e9-a300-bb1001991052 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:56.001303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b7c4bbae-3333-43e1-bb69-462b5cae89c7 req-75642286-0895-46e9-a300-bb1001991052 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:56.024115 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b7c4bbae-3333-43e1-bb69-462b5cae89c7 req-75642286-0895-46e9-a300-bb1001991052 service nova] Creating event network-changed:943d3511-f984-4e2d-9c92-94ae06bad6c8 for instance 11eb8c12-ec92-4302-a038-5c343138776c on nch1-master-1 Sep 06 10:52:56.031995 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b7c4bbae-3333-43e1-bb69-462b5cae89c7 req-75642286-0895-46e9-a300-bb1001991052 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052405 Sep 06 10:52:56.031995 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 331/669] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:56.037755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5a824fc4-a3c1-4226-9aba-23125aee3289 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:56.038386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5a824fc4-a3c1-4226-9aba-23125aee3289 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:56.042279 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d0cb4d4a-171f-4396-8dfc-10be23692c15 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1630 microversion: 2.1 time: 1.326135 Sep 06 10:52:56.046412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a824fc4-a3c1-4226-9aba-23125aee3289 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:56.046913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a824fc4-a3c1-4226-9aba-23125aee3289 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:56.047540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a824fc4-a3c1-4226-9aba-23125aee3289 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:56.048260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a824fc4-a3c1-4226-9aba-23125aee3289 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:56.048717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a824fc4-a3c1-4226-9aba-23125aee3289 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:56.049143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a824fc4-a3c1-4226-9aba-23125aee3289 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:56.050609 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 339/670] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:54 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1630 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:56.062637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f2b172d-dbce-455e-b52a-52b83194ab9d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:56.080877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1f2b172d-dbce-455e-b52a-52b83194ab9d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:56.099575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f2b172d-dbce-455e-b52a-52b83194ab9d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:56.101794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f2b172d-dbce-455e-b52a-52b83194ab9d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:56.102263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f2b172d-dbce-455e-b52a-52b83194ab9d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:56.103022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f2b172d-dbce-455e-b52a-52b83194ab9d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:56.103677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f2b172d-dbce-455e-b52a-52b83194ab9d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:56.115287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f2b172d-dbce-455e-b52a-52b83194ab9d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:56.131372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:56.132583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:56.484047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5a824fc4-a3c1-4226-9aba-23125aee3289 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:56.492079 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5a824fc4-a3c1-4226-9aba-23125aee3289 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1311 microversion: 2.1 time: 0.458565 Sep 06 10:52:56.492711 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 332/671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:56 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1311 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:56.497738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56e317ea-e6d3-4a33-a973-e3ba552ecc19 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:56.498342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56e317ea-e6d3-4a33-a973-e3ba552ecc19 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:56.578919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1f2b172d-dbce-455e-b52a-52b83194ab9d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:56.590537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1f2b172d-dbce-455e-b52a-52b83194ab9d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:56.592761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1f2b172d-dbce-455e-b52a-52b83194ab9d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:56.596216 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1f2b172d-dbce-455e-b52a-52b83194ab9d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1362 microversion: 2.25 time: 0.544314 Sep 06 10:52:56.603144 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 340/672] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:56 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1362 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:56.615528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed03d976-e92e-4011-be67-fedcbb7bf304 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Action: 'create', calling method: .version_select at 0x7f90f8e17310>, body: {"keypair": {"name": "tempest-keypair-400484163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0mozaEkiqV6m6n5CRjVKX0a78schukWeTmgt40MVCEp3gc0wyh6sli15mQ0WXcehInQ/b9ha6Om/xQDmEyR3Wu6ai72S/41aMCXaK4b3lOxyyUYbgdm8jM+TXZ6ak+ww=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:56.631780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:56.639129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ed03d976-e92e-4011-be67-fedcbb7bf304 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Getting quotas for project 52177b94887d409f9034b3cee40237dd. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:52:56.646508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ed03d976-e92e-4011-be67-fedcbb7bf304 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Getting quotas for user 117e12084c60416aabce823ebae4f214 and project 52177b94887d409f9034b3cee40237dd. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:52:56.694862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-56e317ea-e6d3-4a33-a973-e3ba552ecc19 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:56.717664 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56e317ea-e6d3-4a33-a973-e3ba552ecc19 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1214 microversion: 2.1 time: 0.223931 Sep 06 10:52:56.728128 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 333/673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:56 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1214 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:56.737171 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ed03d976-e92e-4011-be67-fedcbb7bf304 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131444 Sep 06 10:52:56.738725 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 341/674] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:52:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:52:57.069225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a7b6d013-823d-46dc-a4c9-870f5448a5ce tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:57.070016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a7b6d013-823d-46dc-a4c9-870f5448a5ce tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:57.077979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7b6d013-823d-46dc-a4c9-870f5448a5ce tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:57.078838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7b6d013-823d-46dc-a4c9-870f5448a5ce tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:57.079426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7b6d013-823d-46dc-a4c9-870f5448a5ce tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:57.080335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7b6d013-823d-46dc-a4c9-870f5448a5ce tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:57.080856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7b6d013-823d-46dc-a4c9-870f5448a5ce tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:57.081402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7b6d013-823d-46dc-a4c9-870f5448a5ce tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:57.517465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-67969028-55d5-459d-970c-d05cc584b921 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:57.518901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-67969028-55d5-459d-970c-d05cc584b921 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:57.528939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67969028-55d5-459d-970c-d05cc584b921 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:57.529439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67969028-55d5-459d-970c-d05cc584b921 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:57.529882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67969028-55d5-459d-970c-d05cc584b921 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:57.530630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67969028-55d5-459d-970c-d05cc584b921 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:57.531369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67969028-55d5-459d-970c-d05cc584b921 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:57.531864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67969028-55d5-459d-970c-d05cc584b921 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:57.594232 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a7b6d013-823d-46dc-a4c9-870f5448a5ce tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1613 microversion: 2.1 time: 0.530512 Sep 06 10:52:57.594814 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 334/675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:57 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1613 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:57.618531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-045e9b61-cddf-41d3-bd6f-4c38fb4f7c13 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:57.621532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-045e9b61-cddf-41d3-bd6f-4c38fb4f7c13 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:57.628177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-045e9b61-cddf-41d3-bd6f-4c38fb4f7c13 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:57.628983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-045e9b61-cddf-41d3-bd6f-4c38fb4f7c13 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:57.629746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-045e9b61-cddf-41d3-bd6f-4c38fb4f7c13 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:57.630886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-045e9b61-cddf-41d3-bd6f-4c38fb4f7c13 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:57.631542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-045e9b61-cddf-41d3-bd6f-4c38fb4f7c13 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:57.632304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-045e9b61-cddf-41d3-bd6f-4c38fb4f7c13 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:57.714081 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-045e9b61-cddf-41d3-bd6f-4c38fb4f7c13 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] HTTP exception thrown: Cannot 'migrate' instance fd27770e-769c-4cf0-94af-385f8049f51e while it is in vm_state suspended Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-045e9b61-cddf-41d3-bd6f-4c38fb4f7c13 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Request method failure captured: Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e/action HTTP/1.1 Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 15 Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZK9Kj3tVvR1AJQ0f7sx1f4zaU5UoQFSMdqKBQmz3RxE_bWL2LQON8hU-61waimjCVS9KgfD06gnRGBDC6vapz-aYWKf-pNc57TJgqJ4yo5ul-MYIO91akGkS3__Pbih8P6Z0CI4APgx0zuqOf236KXg0D8hrizp6-CxeBwEqGYd8c Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4da8b0a081964e2191d0e5e3e9eac26f Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:52:57.716285 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:52:57.717865 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4da8b0a081964e2191d0e5e3e9eac26f"}]}] Sep 06 10:52:57.717865 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:57.717865 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4da8b0a081964e2191d0e5e3e9eac26f Sep 06 10:52:57.717865 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:57.717865 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersAdminNegativeTestJSON-245965064-project-admin Sep 06 10:52:57.717865 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:52:57.717865 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:52:57.717865 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 66e653c2ba034b269a99e7335e810861 Sep 06 10:52:57.717865 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersAdminNegativeTestJSON-245965064-project-admin Sep 06 10:52:57.717865 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:52:57.717865 ncdv-master-1 devstack@n-api.service[140875]: {"migrate": {}} Sep 06 10:52:57.717865 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:52:57.717865 ncdv-master-1 devstack@n-api.service[140875]: exception: Cannot 'migrate' instance fd27770e-769c-4cf0-94af-385f8049f51e while it is in vm_state suspended Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'fd27770e-769c-4cf0-94af-385f8049f51e', 'body': {'migrate': {}}} Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fd27770e-769c-4cf0-94af-385f8049f51e in vm_state suspended. Cannot resize while the instance is in this state. Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:57.718724 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance fd27770e-769c-4cf0-94af-385f8049f51e while it is in vm_state suspended Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:57.720104 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:57.721229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:57.721229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:57.721229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance fd27770e-769c-4cf0-94af-385f8049f51e while it is in vm_state suspended Sep 06 10:52:57.721229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:52:57.721229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-045e9b61-cddf-41d3-bd6f-4c38fb4f7c13 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Returning 409 to user: Cannot 'migrate' instance fd27770e-769c-4cf0-94af-385f8049f51e while it is in vm_state suspended {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:57.721229 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-045e9b61-cddf-41d3-bd6f-4c38fb4f7c13 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e/action" status: 409 len: 148 microversion: 2.1 time: 0.104101 Sep 06 10:52:57.723444 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 335/676] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:52:57 2022] POST /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e/action => generated 148 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:52:57.728907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a5e8a192-ee67-4bb5-8172-b6a3c9606b1c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:57.729528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a5e8a192-ee67-4bb5-8172-b6a3c9606b1c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:57.736993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5e8a192-ee67-4bb5-8172-b6a3c9606b1c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:57.737490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5e8a192-ee67-4bb5-8172-b6a3c9606b1c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:57.737937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5e8a192-ee67-4bb5-8172-b6a3c9606b1c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:57.738648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5e8a192-ee67-4bb5-8172-b6a3c9606b1c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:57.739136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5e8a192-ee67-4bb5-8172-b6a3c9606b1c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:57.739571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5e8a192-ee67-4bb5-8172-b6a3c9606b1c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:57.961444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-67969028-55d5-459d-970c-d05cc584b921 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:57.973045 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-67969028-55d5-459d-970c-d05cc584b921 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1311 microversion: 2.1 time: 0.458699 Sep 06 10:52:57.987979 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 342/677] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:57 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1311 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:57.998551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f843ccb7-e246-46ae-a4fd-2ef5e2da08ea tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f843ccb7-e246-46ae-a4fd-2ef5e2da08ea tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Request method failure captured: Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb/action HTTP/1.1 Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 39 Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZK9Kj3tVvR1AJQ0f7sx1f4zaU5UoQFSMdqKBQmz3RxE_bWL2LQON8hU-61waimjCVS9KgfD06gnRGBDC6vapz-aYWKf-pNc57TJgqJ4yo5ul-MYIO91akGkS3__Pbih8P6Z0CI4APgx0zuqOf236KXg0D8hrizp6-CxeBwEqGYd8c Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 4da8b0a081964e2191d0e5e3e9eac26f Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:52:58.002990 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:52:58.004304 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4da8b0a081964e2191d0e5e3e9eac26f"}]}] Sep 06 10:52:58.004304 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:58.004304 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 4da8b0a081964e2191d0e5e3e9eac26f Sep 06 10:52:58.004304 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:58.004304 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersAdminNegativeTestJSON-245965064-project-admin Sep 06 10:52:58.004304 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:52:58.004304 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:52:58.004304 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 66e653c2ba034b269a99e7335e810861 Sep 06 10:52:58.004304 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersAdminNegativeTestJSON-245965064-project-admin Sep 06 10:52:58.004304 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:52:58.004304 ncdv-master-1 devstack@n-api.service[140876]: {"os-resetState": {"state": "invalid"}} Sep 06 10:52:58.004304 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '3679923f-ffbb-4dd3-bc2f-5789e13143eb', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'invalid' Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:58.005109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:52:58.006442 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 06 10:52:58.009649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.009649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f843ccb7-e246-46ae-a4fd-2ef5e2da08ea tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:58.009649 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f843ccb7-e246-46ae-a4fd-2ef5e2da08ea tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb/action" status: 400 len: 144 microversion: 2.1 time: 0.031519 Sep 06 10:52:58.009649 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 343/678] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:52:57 2022] POST /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb/action => generated 144 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:52:58.019868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f08b6ba8-bb87-488c-85df-d1ea509f3ce9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:58.023024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f08b6ba8-bb87-488c-85df-d1ea509f3ce9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:58.031863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f08b6ba8-bb87-488c-85df-d1ea509f3ce9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:58.032609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f08b6ba8-bb87-488c-85df-d1ea509f3ce9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:58.033319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f08b6ba8-bb87-488c-85df-d1ea509f3ce9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:58.034550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f08b6ba8-bb87-488c-85df-d1ea509f3ce9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:58.035271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f08b6ba8-bb87-488c-85df-d1ea509f3ce9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:58.035965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f08b6ba8-bb87-488c-85df-d1ea509f3ce9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:58.144315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f08b6ba8-bb87-488c-85df-d1ea509f3ce9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:58.155378 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f08b6ba8-bb87-488c-85df-d1ea509f3ce9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1266 microversion: 2.1 time: 0.147398 Sep 06 10:52:58.155992 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 344/679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:58 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:58.163187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-96e39f6c-8e2c-4a36-8b41-0ebdb5783499 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-96e39f6c-8e2c-4a36-8b41-0ebdb5783499 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Request method failure captured: Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb/action HTTP/1.1 Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 31 Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZK9Kj3tVvR1AJQ0f7sx1f4zaU5UoQFSMdqKBQmz3RxE_bWL2LQON8hU-61waimjCVS9KgfD06gnRGBDC6vapz-aYWKf-pNc57TJgqJ4yo5ul-MYIO91akGkS3__Pbih8P6Z0CI4APgx0zuqOf236KXg0D8hrizp6-CxeBwEqGYd8c Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 4da8b0a081964e2191d0e5e3e9eac26f Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:52:58.167252 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:52:58.172575 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4da8b0a081964e2191d0e5e3e9eac26f"}]}] Sep 06 10:52:58.172575 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:58.172575 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 4da8b0a081964e2191d0e5e3e9eac26f Sep 06 10:52:58.172575 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:58.172575 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersAdminNegativeTestJSON-245965064-project-admin Sep 06 10:52:58.172575 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:52:58.172575 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:52:58.172575 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 66e653c2ba034b269a99e7335e810861 Sep 06 10:52:58.172575 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersAdminNegativeTestJSON-245965064-project-admin Sep 06 10:52:58.172575 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:52:58.172575 ncdv-master-1 devstack@n-api.service[140876]: {"os-resetState": {"state": 1}} Sep 06 10:52:58.172575 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:52:58.172575 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '3679923f-ffbb-4dd3-bc2f-5789e13143eb', 'body': {'os-resetState': {'state': 1}}} Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 1 Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:58.173360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 06 10:52:58.174675 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.177599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-96e39f6c-8e2c-4a36-8b41-0ebdb5783499 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:58.177599 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-96e39f6c-8e2c-4a36-8b41-0ebdb5783499 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb/action" status: 400 len: 120 microversion: 2.1 time: 0.011501 Sep 06 10:52:58.177599 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 345/680] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:52:58 2022] POST /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:52:58.180379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ffced7c0-0a80-40af-a780-a33892b2bd86 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:52:58.182554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ffced7c0-0a80-40af-a780-a33892b2bd86 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Failed to fetch instance by id 999 {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 06 10:52:58.183127 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-ffced7c0-0a80-40af-a780-a33892b2bd86 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ffced7c0-0a80-40af-a780-a33892b2bd86 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Request method failure captured: Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 37 Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZK9Kj3tVvR1AJQ0f7sx1f4zaU5UoQFSMdqKBQmz3RxE_bWL2LQON8hU-61waimjCVS9KgfD06gnRGBDC6vapz-aYWKf-pNc57TJgqJ4yo5ul-MYIO91akGkS3__Pbih8P6Z0CI4APgx0zuqOf236KXg0D8hrizp6-CxeBwEqGYd8c Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 4da8b0a081964e2191d0e5e3e9eac26f Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:52:58.185326 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:52:58.187744 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4da8b0a081964e2191d0e5e3e9eac26f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4da8b0a081964e2191d0e5e3e9eac26f"}]}] Sep 06 10:52:58.187744 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:58.187744 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 4da8b0a081964e2191d0e5e3e9eac26f Sep 06 10:52:58.187744 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-245965064 Sep 06 10:52:58.187744 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersAdminNegativeTestJSON-245965064-project-admin Sep 06 10:52:58.187744 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:52:58.187744 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:52:58.187744 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 66e653c2ba034b269a99e7335e810861 Sep 06 10:52:58.187744 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersAdminNegativeTestJSON-245965064-project-admin Sep 06 10:52:58.187744 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:52:58.187744 ncdv-master-1 devstack@n-api.service[140876]: {"os-resetState": {"state": "error"}} Sep 06 10:52:58.187744 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:52:58.187744 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 999 could not be found. Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:52:58.189533 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ffced7c0-0a80-40af-a780-a33892b2bd86 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:52:58.192288 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ffced7c0-0a80-40af-a780-a33892b2bd86 tempest-ServersAdminNegativeTestJSON-245965064 tempest-ServersAdminNegativeTestJSON-245965064-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.010515 Sep 06 10:52:58.200036 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 346/681] 10.222.0.20 () {60 vars in 1179 bytes} [Tue Sep 6 10:52:58 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:52:58.200036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c46293ba-1167-4e9b-ab15-2f4b27caa5f7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:58.200036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c46293ba-1167-4e9b-ab15-2f4b27caa5f7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:58.204257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c46293ba-1167-4e9b-ab15-2f4b27caa5f7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:58.204947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c46293ba-1167-4e9b-ab15-2f4b27caa5f7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:58.205307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c46293ba-1167-4e9b-ab15-2f4b27caa5f7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:58.205956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c46293ba-1167-4e9b-ab15-2f4b27caa5f7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:58.206417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c46293ba-1167-4e9b-ab15-2f4b27caa5f7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:58.206853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c46293ba-1167-4e9b-ab15-2f4b27caa5f7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:58.225208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a5e8a192-ee67-4bb5-8172-b6a3c9606b1c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:58.237825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c46293ba-1167-4e9b-ab15-2f4b27caa5f7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:52:58.239663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a5e8a192-ee67-4bb5-8172-b6a3c9606b1c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:58.241326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a5e8a192-ee67-4bb5-8172-b6a3c9606b1c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:58.242807 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a5e8a192-ee67-4bb5-8172-b6a3c9606b1c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1362 microversion: 2.25 time: 0.518225 Sep 06 10:52:58.243844 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 336/682] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:57 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1362 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:58.626525 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c46293ba-1167-4e9b-ab15-2f4b27caa5f7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 204 len: 0 microversion: 2.1 time: 0.433721 Sep 06 10:52:58.628669 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 347/683] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:52:58 2022] DELETE /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:52:58.639982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0156da49-a627-46f2-86c6-4442fb8ff282 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:58.641103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0156da49-a627-46f2-86c6-4442fb8ff282 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:58.663508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0156da49-a627-46f2-86c6-4442fb8ff282 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:58.669032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0156da49-a627-46f2-86c6-4442fb8ff282 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:58.673577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0156da49-a627-46f2-86c6-4442fb8ff282 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:58.682595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0156da49-a627-46f2-86c6-4442fb8ff282 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:58.683784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0156da49-a627-46f2-86c6-4442fb8ff282 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:58.684565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0156da49-a627-46f2-86c6-4442fb8ff282 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:58.998221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4721aaf1-ef10-45dc-866a-2687d2478269 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:58.998943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4721aaf1-ef10-45dc-866a-2687d2478269 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:59.005874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4721aaf1-ef10-45dc-866a-2687d2478269 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:59.006733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4721aaf1-ef10-45dc-866a-2687d2478269 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:59.007569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4721aaf1-ef10-45dc-866a-2687d2478269 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:59.008659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4721aaf1-ef10-45dc-866a-2687d2478269 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:59.009395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4721aaf1-ef10-45dc-866a-2687d2478269 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:59.010078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4721aaf1-ef10-45dc-866a-2687d2478269 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:59.288366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0156da49-a627-46f2-86c6-4442fb8ff282 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:59.313914 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0156da49-a627-46f2-86c6-4442fb8ff282 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1468 microversion: 2.1 time: 0.678256 Sep 06 10:52:59.315234 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 337/684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:58 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1468 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:59.333392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-88ac697e-9926-4b47-b1c6-f424f6e33a36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:59.334330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-88ac697e-9926-4b47-b1c6-f424f6e33a36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:59.342350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88ac697e-9926-4b47-b1c6-f424f6e33a36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:59.343331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88ac697e-9926-4b47-b1c6-f424f6e33a36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:59.344530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88ac697e-9926-4b47-b1c6-f424f6e33a36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:59.345457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88ac697e-9926-4b47-b1c6-f424f6e33a36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:59.346615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88ac697e-9926-4b47-b1c6-f424f6e33a36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:59.347248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88ac697e-9926-4b47-b1c6-f424f6e33a36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:59.505350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-88ac697e-9926-4b47-b1c6-f424f6e33a36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:59.514458 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-88ac697e-9926-4b47-b1c6-f424f6e33a36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1272 microversion: 2.1 time: 0.198057 Sep 06 10:52:59.515713 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 338/685] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:59 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:52:59.520764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b45989fd-7995-49d3-aae8-fc4cb0852e4d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:59.521568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b45989fd-7995-49d3-aae8-fc4cb0852e4d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:59.531469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b45989fd-7995-49d3-aae8-fc4cb0852e4d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:59.534010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b45989fd-7995-49d3-aae8-fc4cb0852e4d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:59.534684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b45989fd-7995-49d3-aae8-fc4cb0852e4d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:59.535669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b45989fd-7995-49d3-aae8-fc4cb0852e4d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:59.536771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b45989fd-7995-49d3-aae8-fc4cb0852e4d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:59.537429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b45989fd-7995-49d3-aae8-fc4cb0852e4d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:59.559545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:59.591197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4721aaf1-ef10-45dc-866a-2687d2478269 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:59.600598 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4721aaf1-ef10-45dc-866a-2687d2478269 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1311 microversion: 2.1 time: 0.608317 Sep 06 10:52:59.601398 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 348/686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:52:58 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1311 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:52:59.895886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b45989fd-7995-49d3-aae8-fc4cb0852e4d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:59.931515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b45989fd-7995-49d3-aae8-fc4cb0852e4d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:59.941640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b45989fd-7995-49d3-aae8-fc4cb0852e4d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:52:59.949761 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b45989fd-7995-49d3-aae8-fc4cb0852e4d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1559 microversion: 2.25 time: 0.430233 Sep 06 10:52:59.962736 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 339/687] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:59 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1559 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:52:59.980605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3f157e3f-5907-44df-8842-2df9a8ba12d4 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:52:59.982855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3f157e3f-5907-44df-8842-2df9a8ba12d4 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:52:59.991557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f157e3f-5907-44df-8842-2df9a8ba12d4 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:59.992348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f157e3f-5907-44df-8842-2df9a8ba12d4 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:52:59.993323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f157e3f-5907-44df-8842-2df9a8ba12d4 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:52:59.994254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f157e3f-5907-44df-8842-2df9a8ba12d4 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:52:59.995003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f157e3f-5907-44df-8842-2df9a8ba12d4 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:00.003106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f157e3f-5907-44df-8842-2df9a8ba12d4 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:00.346173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7d8edd28-074c-4607-b78b-bcbebc3c63ca tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:00.347612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7d8edd28-074c-4607-b78b-bcbebc3c63ca tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:00.359879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d8edd28-074c-4607-b78b-bcbebc3c63ca tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:00.361484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d8edd28-074c-4607-b78b-bcbebc3c63ca tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:00.363783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d8edd28-074c-4607-b78b-bcbebc3c63ca tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:00.366769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d8edd28-074c-4607-b78b-bcbebc3c63ca tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:00.367466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d8edd28-074c-4607-b78b-bcbebc3c63ca tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:00.373911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d8edd28-074c-4607-b78b-bcbebc3c63ca tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:01.076353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-3f157e3f-5907-44df-8842-2df9a8ba12d4 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid 239473a8-8554-4c9d-a566-b76c75336087 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:53:01.096461 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3f157e3f-5907-44df-8842-2df9a8ba12d4 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 2052 microversion: 2.25 time: 1.119596 Sep 06 10:53:01.114718 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 349/688] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:52:59 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 2052 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:01.119900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7d8edd28-074c-4607-b78b-bcbebc3c63ca tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:01.127167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-16960287-fe73-4fa0-a8ed-e6a6863aa3be tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:01.128391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-16960287-fe73-4fa0-a8ed-e6a6863aa3be tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:01.133262 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7d8edd28-074c-4607-b78b-bcbebc3c63ca tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1468 microversion: 2.1 time: 0.788897 Sep 06 10:53:01.133893 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 340/689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:00 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1468 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:01.138628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16960287-fe73-4fa0-a8ed-e6a6863aa3be tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:01.139873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16960287-fe73-4fa0-a8ed-e6a6863aa3be tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:01.140611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16960287-fe73-4fa0-a8ed-e6a6863aa3be tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:01.141557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16960287-fe73-4fa0-a8ed-e6a6863aa3be tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:01.142243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16960287-fe73-4fa0-a8ed-e6a6863aa3be tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:01.142921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16960287-fe73-4fa0-a8ed-e6a6863aa3be tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:01.153802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f17c369b-d7f0-4e6f-aceb-c5ccafbe46be tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:01.154417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f17c369b-d7f0-4e6f-aceb-c5ccafbe46be tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:01.176362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f17c369b-d7f0-4e6f-aceb-c5ccafbe46be tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:01.179156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f17c369b-d7f0-4e6f-aceb-c5ccafbe46be tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:01.179825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f17c369b-d7f0-4e6f-aceb-c5ccafbe46be tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:01.181274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f17c369b-d7f0-4e6f-aceb-c5ccafbe46be tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:01.183905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f17c369b-d7f0-4e6f-aceb-c5ccafbe46be tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:01.184363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f17c369b-d7f0-4e6f-aceb-c5ccafbe46be tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:01.284707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-16960287-fe73-4fa0-a8ed-e6a6863aa3be tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:01.303376 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-16960287-fe73-4fa0-a8ed-e6a6863aa3be tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1272 microversion: 2.1 time: 0.186350 Sep 06 10:53:01.320886 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 350/690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:01 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1272 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:01.330831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-70601463", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:01.396591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] validate_networks() for [('a12e8367-831f-4a7b-ab55-8a1095444e0d', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:53:01.611227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f17c369b-d7f0-4e6f-aceb-c5ccafbe46be tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:01.618944 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f17c369b-d7f0-4e6f-aceb-c5ccafbe46be tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1311 microversion: 2.1 time: 0.469038 Sep 06 10:53:01.631381 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 341/691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:01 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1311 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:01.637576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-76ba2e9d-4531-4cae-883c-ec72502b6345 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:01.638417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-76ba2e9d-4531-4cae-883c-ec72502b6345 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:01.654631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76ba2e9d-4531-4cae-883c-ec72502b6345 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:01.655110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76ba2e9d-4531-4cae-883c-ec72502b6345 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:01.655748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76ba2e9d-4531-4cae-883c-ec72502b6345 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:01.656631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76ba2e9d-4531-4cae-883c-ec72502b6345 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:01.657442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76ba2e9d-4531-4cae-883c-ec72502b6345 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:01.658032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76ba2e9d-4531-4cae-883c-ec72502b6345 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:02.015858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-76ba2e9d-4531-4cae-883c-ec72502b6345 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid 239473a8-8554-4c9d-a566-b76c75336087 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:53:02.046580 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-76ba2e9d-4531-4cae-883c-ec72502b6345 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 2052 microversion: 2.25 time: 0.412642 Sep 06 10:53:02.056823 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 342/692] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:01 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 2052 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:02.075545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-23c8da41-e31a-41d0-a750-4dd127c58173 req-1edc709a-8894-4d35-ad53-41f461e9d22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11eb8c12-ec92-4302-a038-5c343138776c", "name": "network-vif-plugged", "status": "completed", "tag": "943d3511-f984-4e2d-9c92-94ae06bad6c8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:02.108286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-23c8da41-e31a-41d0-a750-4dd127c58173 req-1edc709a-8894-4d35-ad53-41f461e9d22b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:02.109080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-23c8da41-e31a-41d0-a750-4dd127c58173 req-1edc709a-8894-4d35-ad53-41f461e9d22b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:02.109874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-23c8da41-e31a-41d0-a750-4dd127c58173 req-1edc709a-8894-4d35-ad53-41f461e9d22b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:02.129392 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-23c8da41-e31a-41d0-a750-4dd127c58173 req-1edc709a-8894-4d35-ad53-41f461e9d22b service nova] Creating event network-vif-plugged:943d3511-f984-4e2d-9c92-94ae06bad6c8 for instance 11eb8c12-ec92-4302-a038-5c343138776c on nch1-master-1 Sep 06 10:53:02.136216 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-23c8da41-e31a-41d0-a750-4dd127c58173 req-1edc709a-8894-4d35-ad53-41f461e9d22b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087447 Sep 06 10:53:02.138504 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 343/693] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:02.148904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01ae225f-5f9c-4a57-b737-7b9483c979dc tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:02.156150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01ae225f-5f9c-4a57-b737-7b9483c979dc tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:02.156872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01ae225f-5f9c-4a57-b737-7b9483c979dc tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:02.157479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01ae225f-5f9c-4a57-b737-7b9483c979dc tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:02.160646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01ae225f-5f9c-4a57-b737-7b9483c979dc tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:02.160907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01ae225f-5f9c-4a57-b737-7b9483c979dc tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:02.161570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01ae225f-5f9c-4a57-b737-7b9483c979dc tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:02.221322 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-01ae225f-5f9c-4a57-b737-7b9483c979dc tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.081314 Sep 06 10:53:02.222890 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 344/694] 10.222.0.20 () {60 vars in 1217 bytes} [Tue Sep 6 10:53:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:53:02.236672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-85360583-55fa-4194-aa6c-30b1a911f57a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:02.238424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-85360583-55fa-4194-aa6c-30b1a911f57a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:02.245964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85360583-55fa-4194-aa6c-30b1a911f57a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:02.246734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85360583-55fa-4194-aa6c-30b1a911f57a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:02.247881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85360583-55fa-4194-aa6c-30b1a911f57a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:02.249136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85360583-55fa-4194-aa6c-30b1a911f57a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:02.249846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85360583-55fa-4194-aa6c-30b1a911f57a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:02.250941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85360583-55fa-4194-aa6c-30b1a911f57a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:02.580148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-85360583-55fa-4194-aa6c-30b1a911f57a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:02.588940 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-85360583-55fa-4194-aa6c-30b1a911f57a tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1426 microversion: 2.1 time: 0.364567 Sep 06 10:53:02.594049 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 345/695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:02 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1426 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:02.599064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4beb7625-0ec9-46ce-b5fb-8165833c4a93 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:02.603780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4beb7625-0ec9-46ce-b5fb-8165833c4a93 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:02.616821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4beb7625-0ec9-46ce-b5fb-8165833c4a93 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:02.621222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4beb7625-0ec9-46ce-b5fb-8165833c4a93 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:02.621885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4beb7625-0ec9-46ce-b5fb-8165833c4a93 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:02.622748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4beb7625-0ec9-46ce-b5fb-8165833c4a93 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:02.623371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4beb7625-0ec9-46ce-b5fb-8165833c4a93 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:02.627251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4beb7625-0ec9-46ce-b5fb-8165833c4a93 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:02.739586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:53:02.740106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:53:02.740603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:53:02.741021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:53:02.741586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:53:02.753100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:02.754574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:02.755230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:02.757418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:02.758292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:02.759110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:02.794556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Getting quotas for project 52177b94887d409f9034b3cee40237dd. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:53:02.803117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Getting quotas for user 117e12084c60416aabce823ebae4f214 and project 52177b94887d409f9034b3cee40237dd. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:53:02.822953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:53:02.827102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:53:02.897556 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4beb7625-0ec9-46ce-b5fb-8165833c4a93 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087/action" status: 202 len: 0 microversion: 2.25 time: 0.301961 Sep 06 10:53:02.902425 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 346/696] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 10:53:02 2022] POST /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:53:02.906850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c1e20c09-4aaa-423d-92b1-253109c51a9b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:02.923588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c1e20c09-4aaa-423d-92b1-253109c51a9b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:02.944383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1e20c09-4aaa-423d-92b1-253109c51a9b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:02.944890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1e20c09-4aaa-423d-92b1-253109c51a9b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:02.945342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1e20c09-4aaa-423d-92b1-253109c51a9b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:02.946071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1e20c09-4aaa-423d-92b1-253109c51a9b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:02.946539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1e20c09-4aaa-423d-92b1-253109c51a9b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:02.946981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1e20c09-4aaa-423d-92b1-253109c51a9b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:02.973748 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d64ff510-1677-4ff1-93ce-3e92a3c9ce9b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.651356 Sep 06 10:53:02.976337 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 351/697] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:53:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:53:03.066563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9f5e65d4-6539-4977-aaac-b5cd536ba3be req-757c65f5-54f5-41b8-ab77-426b1dede75f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd27770e-769c-4cf0-94af-385f8049f51e", "name": "network-vif-deleted", "tag": "a1b2e0a1-7c2d-41d6-9a07-6fdfaca69e81"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:03.104616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9f5e65d4-6539-4977-aaac-b5cd536ba3be req-757c65f5-54f5-41b8-ab77-426b1dede75f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:03.108760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9f5e65d4-6539-4977-aaac-b5cd536ba3be req-757c65f5-54f5-41b8-ab77-426b1dede75f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:03.110811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9f5e65d4-6539-4977-aaac-b5cd536ba3be req-757c65f5-54f5-41b8-ab77-426b1dede75f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:03.159364 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9f5e65d4-6539-4977-aaac-b5cd536ba3be req-757c65f5-54f5-41b8-ab77-426b1dede75f service nova] Creating event network-vif-deleted:a1b2e0a1-7c2d-41d6-9a07-6fdfaca69e81 for instance fd27770e-769c-4cf0-94af-385f8049f51e on nch2-master-1 Sep 06 10:53:03.174727 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9f5e65d4-6539-4977-aaac-b5cd536ba3be req-757c65f5-54f5-41b8-ab77-426b1dede75f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195936 Sep 06 10:53:03.175899 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 352/698] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:03.181524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-decabd34-255b-482c-9833-e3c73dfb87a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:03.188599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-decabd34-255b-482c-9833-e3c73dfb87a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:03.204874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-decabd34-255b-482c-9833-e3c73dfb87a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:03.204874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-decabd34-255b-482c-9833-e3c73dfb87a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:03.204874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-decabd34-255b-482c-9833-e3c73dfb87a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:03.204874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-decabd34-255b-482c-9833-e3c73dfb87a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:03.212355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-decabd34-255b-482c-9833-e3c73dfb87a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:03.212970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-decabd34-255b-482c-9833-e3c73dfb87a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:03.725613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c1e20c09-4aaa-423d-92b1-253109c51a9b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:03.741335 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c1e20c09-4aaa-423d-92b1-253109c51a9b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1314 microversion: 2.1 time: 0.841866 Sep 06 10:53:03.743377 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 347/699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:02 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1314 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:03.754554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d3859050-0e6a-4442-a732-585bab1f0b1f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:03.755793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d3859050-0e6a-4442-a732-585bab1f0b1f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:03.764026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3859050-0e6a-4442-a732-585bab1f0b1f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:03.764993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3859050-0e6a-4442-a732-585bab1f0b1f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:03.765867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3859050-0e6a-4442-a732-585bab1f0b1f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:03.769011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3859050-0e6a-4442-a732-585bab1f0b1f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:03.769743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3859050-0e6a-4442-a732-585bab1f0b1f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:03.770504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3859050-0e6a-4442-a732-585bab1f0b1f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:03.923143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-decabd34-255b-482c-9833-e3c73dfb87a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:03.931922 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-decabd34-255b-482c-9833-e3c73dfb87a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1311 microversion: 2.1 time: 0.754617 Sep 06 10:53:03.936054 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 353/700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:03 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1311 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:03.953225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eb5cce0f-8285-45dc-a5d7-335d26767e63 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:03.953947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eb5cce0f-8285-45dc-a5d7-335d26767e63 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:04.031982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eb5cce0f-8285-45dc-a5d7-335d26767e63 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:04.041468 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eb5cce0f-8285-45dc-a5d7-335d26767e63 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1223 microversion: 2.1 time: 0.104014 Sep 06 10:53:04.042410 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 354/701] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:03 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:04.057025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-0e12cb4d-a3ae-4e93-92a1-f8f115edb6bc req-73303d0d-cbb5-4051-b963-1cc0097fbe8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77dd8f1a-f2a3-463e-9129-1060fc467171", "tag": "0722de88-af62-4350-ab9b-6cd8023675fa"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:04.084848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0e12cb4d-a3ae-4e93-92a1-f8f115edb6bc req-73303d0d-cbb5-4051-b963-1cc0097fbe8a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:04.085433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0e12cb4d-a3ae-4e93-92a1-f8f115edb6bc req-73303d0d-cbb5-4051-b963-1cc0097fbe8a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:04.085894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0e12cb4d-a3ae-4e93-92a1-f8f115edb6bc req-73303d0d-cbb5-4051-b963-1cc0097fbe8a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:04.113330 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-0e12cb4d-a3ae-4e93-92a1-f8f115edb6bc req-73303d0d-cbb5-4051-b963-1cc0097fbe8a service nova] Creating event network-changed:0722de88-af62-4350-ab9b-6cd8023675fa for instance 77dd8f1a-f2a3-463e-9129-1060fc467171 on nch1-master-1 Sep 06 10:53:04.126045 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-0e12cb4d-a3ae-4e93-92a1-f8f115edb6bc req-73303d0d-cbb5-4051-b963-1cc0097fbe8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080895 Sep 06 10:53:04.135099 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 355/702] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:04.142049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:04.142768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:04.162611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:04.162611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:04.162611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:04.162611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:04.163000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:04.163000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:04.272822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-d3859050-0e6a-4442-a732-585bab1f0b1f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid 239473a8-8554-4c9d-a566-b76c75336087 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:53:04.280809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:04.282508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:04.292610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:04.292610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lazy-loading 'fault' on Instance uuid fd27770e-769c-4cf0-94af-385f8049f51e {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:53:04.340774 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d3859050-0e6a-4442-a732-585bab1f0b1f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 2037 microversion: 2.25 time: 0.592546 Sep 06 10:53:04.349888 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 348/703] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:03 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 2037 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:04.378030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3543fe70-34cb-4e6a-95bf-4e644036d29b tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:04.382013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3543fe70-34cb-4e6a-95bf-4e644036d29b tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:04.389145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3543fe70-34cb-4e6a-95bf-4e644036d29b tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:04.390040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3543fe70-34cb-4e6a-95bf-4e644036d29b tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:04.390699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3543fe70-34cb-4e6a-95bf-4e644036d29b tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:04.391678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3543fe70-34cb-4e6a-95bf-4e644036d29b tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:04.392659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3543fe70-34cb-4e6a-95bf-4e644036d29b tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:04.393304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3543fe70-34cb-4e6a-95bf-4e644036d29b tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:04.409498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:04.418622 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-15175967-3a6d-4317-b13d-852095c6aaaa tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 200 len: 1311 microversion: 2.1 time: 0.281973 Sep 06 10:53:04.421930 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 356/704] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:04 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 1311 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:04.469274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-3543fe70-34cb-4e6a-95bf-4e644036d29b tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'flavor' on Instance uuid 239473a8-8554-4c9d-a566-b76c75336087 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:53:04.485235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3543fe70-34cb-4e6a-95bf-4e644036d29b tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Going to try to live migrate instance to nch1-master-1 {{(pid=140875) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 06 10:53:04.623545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3fcc193a-8d5a-420d-8e18-31c17132442b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:04.624405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3fcc193a-8d5a-420d-8e18-31c17132442b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:04.632568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fcc193a-8d5a-420d-8e18-31c17132442b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:04.633063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fcc193a-8d5a-420d-8e18-31c17132442b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:04.633602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fcc193a-8d5a-420d-8e18-31c17132442b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:04.634258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fcc193a-8d5a-420d-8e18-31c17132442b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:04.634721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fcc193a-8d5a-420d-8e18-31c17132442b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:04.635180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fcc193a-8d5a-420d-8e18-31c17132442b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:04.650450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:04.696939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3fcc193a-8d5a-420d-8e18-31c17132442b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:53:05.086124 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3fcc193a-8d5a-420d-8e18-31c17132442b tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 204 len: 0 microversion: 2.1 time: 0.466996 Sep 06 10:53:05.087057 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 357/705] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:53:04 2022] DELETE /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:53:05.093565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-570a30ed-6e53-4f83-af34-466155492535 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:05.097227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-570a30ed-6e53-4f83-af34-466155492535 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:05.103617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-570a30ed-6e53-4f83-af34-466155492535 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:05.104486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-570a30ed-6e53-4f83-af34-466155492535 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:05.105540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-570a30ed-6e53-4f83-af34-466155492535 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:05.106540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-570a30ed-6e53-4f83-af34-466155492535 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:05.107155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-570a30ed-6e53-4f83-af34-466155492535 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:05.107789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-570a30ed-6e53-4f83-af34-466155492535 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:05.333772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-570a30ed-6e53-4f83-af34-466155492535 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:05.347950 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-570a30ed-6e53-4f83-af34-466155492535 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1314 microversion: 2.1 time: 0.256726 Sep 06 10:53:05.359803 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 358/706] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:05 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:05.374155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a0915e28-0134-4a8f-9886-5f3818d1450c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:05.374789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a0915e28-0134-4a8f-9886-5f3818d1450c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:05.385406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0915e28-0134-4a8f-9886-5f3818d1450c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:05.385911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0915e28-0134-4a8f-9886-5f3818d1450c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:05.386403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0915e28-0134-4a8f-9886-5f3818d1450c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:05.387841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0915e28-0134-4a8f-9886-5f3818d1450c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:05.388694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0915e28-0134-4a8f-9886-5f3818d1450c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:05.389250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0915e28-0134-4a8f-9886-5f3818d1450c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:05.571606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a0915e28-0134-4a8f-9886-5f3818d1450c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:05.588171 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a0915e28-0134-4a8f-9886-5f3818d1450c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1494 microversion: 2.1 time: 0.227135 Sep 06 10:53:05.604568 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 359/707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:05 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1494 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:05.615729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9ec1b246-710f-460b-afc7-7cafb6161364 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:05.616552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9ec1b246-710f-460b-afc7-7cafb6161364 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:05.624550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec1b246-710f-460b-afc7-7cafb6161364 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:05.629626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec1b246-710f-460b-afc7-7cafb6161364 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:05.629626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec1b246-710f-460b-afc7-7cafb6161364 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:05.629626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec1b246-710f-460b-afc7-7cafb6161364 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:05.629626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec1b246-710f-460b-afc7-7cafb6161364 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:05.630591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec1b246-710f-460b-afc7-7cafb6161364 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:05.713009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9ec1b246-710f-460b-afc7-7cafb6161364 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:05.721507 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9ec1b246-710f-460b-afc7-7cafb6161364 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1275 microversion: 2.1 time: 0.115184 Sep 06 10:53:05.734794 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 360/708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:05 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1275 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:05.743586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b8a86428-9c70-4234-a81c-7e0c23dad9dd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:05.744229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b8a86428-9c70-4234-a81c-7e0c23dad9dd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:05.752423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8a86428-9c70-4234-a81c-7e0c23dad9dd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:05.753056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8a86428-9c70-4234-a81c-7e0c23dad9dd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:05.753482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8a86428-9c70-4234-a81c-7e0c23dad9dd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:05.754265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8a86428-9c70-4234-a81c-7e0c23dad9dd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:05.754734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8a86428-9c70-4234-a81c-7e0c23dad9dd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:05.755201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8a86428-9c70-4234-a81c-7e0c23dad9dd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:06.026806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b8a86428-9c70-4234-a81c-7e0c23dad9dd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:06.034955 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b8a86428-9c70-4234-a81c-7e0c23dad9dd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1711 microversion: 2.1 time: 0.299005 Sep 06 10:53:06.035748 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 361/709] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:05 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1711 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:06.041123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-d607628c-e905-4732-8a37-9bf8c14c6727 req-d9e9624e-d5e6-4805-bdcd-fa004958dac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b77047-0abe-4fe2-8f93-41a27feb4861", "tag": "1e7653a0-3a04-40cd-b60e-9537558010eb"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:06.052721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d607628c-e905-4732-8a37-9bf8c14c6727 req-d9e9624e-d5e6-4805-bdcd-fa004958dac0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:06.053488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d607628c-e905-4732-8a37-9bf8c14c6727 req-d9e9624e-d5e6-4805-bdcd-fa004958dac0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:06.054148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d607628c-e905-4732-8a37-9bf8c14c6727 req-d9e9624e-d5e6-4805-bdcd-fa004958dac0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:06.071146 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d607628c-e905-4732-8a37-9bf8c14c6727 req-d9e9624e-d5e6-4805-bdcd-fa004958dac0 service nova] Creating event network-changed:1e7653a0-3a04-40cd-b60e-9537558010eb for instance 58b77047-0abe-4fe2-8f93-41a27feb4861 on nch1-master-1 Sep 06 10:53:06.077855 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-d607628c-e905-4732-8a37-9bf8c14c6727 req-d9e9624e-d5e6-4805-bdcd-fa004958dac0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040005 Sep 06 10:53:06.079181 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 362/710] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:06.084761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-67765dcf-97b0-4dd3-a89d-326046f7ddf7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:06.085839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-67765dcf-97b0-4dd3-a89d-326046f7ddf7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: fd27770e-769c-4cf0-94af-385f8049f51e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:06.092761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67765dcf-97b0-4dd3-a89d-326046f7ddf7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:06.094088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67765dcf-97b0-4dd3-a89d-326046f7ddf7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:06.094722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67765dcf-97b0-4dd3-a89d-326046f7ddf7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:06.095670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67765dcf-97b0-4dd3-a89d-326046f7ddf7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:06.095978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67765dcf-97b0-4dd3-a89d-326046f7ddf7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:06.096415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67765dcf-97b0-4dd3-a89d-326046f7ddf7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:06.113199 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-67765dcf-97b0-4dd3-a89d-326046f7ddf7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] HTTP exception thrown: Instance fd27770e-769c-4cf0-94af-385f8049f51e could not be found. Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-67765dcf-97b0-4dd3-a89d-326046f7ddf7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Request method failure captured: Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e HTTP/1.1 Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZI00RjWWvpOxH-yxoUo4yd12TQAOe8tiLPAKBUH-_gWj2EnVnUWFlar5YDau03t9SyVxxDzfcp1jGhSSLffwa9lkhwFE2o3DJKHpHl4Yl_sayJ79PfzkRuxcc6FdcQu2LuDOsjX7bG0DMPh5Mkwqrwu7wZpPHSxfx2ZvukX7ARGgY Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 4882f2c8ef9c4f29bf3cbaa93cf9d488 Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1191351515 Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:53:06.118616 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:53:06.120424 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4882f2c8ef9c4f29bf3cbaa93cf9d488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4882f2c8ef9c4f29bf3cbaa93cf9d488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4882f2c8ef9c4f29bf3cbaa93cf9d488"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4882f2c8ef9c4f29bf3cbaa93cf9d488"}]}] Sep 06 10:53:06.120424 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1191351515 Sep 06 10:53:06.120424 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 4882f2c8ef9c4f29bf3cbaa93cf9d488 Sep 06 10:53:06.120424 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1191351515 Sep 06 10:53:06.120424 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersAdminNegativeTestJSON-1191351515-project Sep 06 10:53:06.120424 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:53:06.120424 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:53:06.120424 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e425c7348db042389a189daa866ea06d Sep 06 10:53:06.120424 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1191351515-project Sep 06 10:53:06.120424 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:53:06.120424 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance fd27770e-769c-4cf0-94af-385f8049f51e could not be found. Sep 06 10:53:06.120424 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'fd27770e-769c-4cf0-94af-385f8049f51e'} Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd27770e-769c-4cf0-94af-385f8049f51e could not be found. Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:53:06.122021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd27770e-769c-4cf0-94af-385f8049f51e could not be found. Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd27770e-769c-4cf0-94af-385f8049f51e could not be found. Sep 06 10:53:06.125282 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:06.134747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-67765dcf-97b0-4dd3-a89d-326046f7ddf7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Returning 404 to user: Instance fd27770e-769c-4cf0-94af-385f8049f51e could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:53:06.134747 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-67765dcf-97b0-4dd3-a89d-326046f7ddf7 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e" status: 404 len: 111 microversion: 2.1 time: 0.040223 Sep 06 10:53:06.134747 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 363/711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:06 2022] GET /compute/v2.1/servers/fd27770e-769c-4cf0-94af-385f8049f51e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:53:06.134747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c34252c8-5937-4104-abaf-a793661f52c5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:06.134747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c34252c8-5937-4104-abaf-a793661f52c5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:06.137274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c34252c8-5937-4104-abaf-a793661f52c5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:06.137774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c34252c8-5937-4104-abaf-a793661f52c5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:06.138219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c34252c8-5937-4104-abaf-a793661f52c5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:06.138929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c34252c8-5937-4104-abaf-a793661f52c5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:06.139419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c34252c8-5937-4104-abaf-a793661f52c5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:06.139850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c34252c8-5937-4104-abaf-a793661f52c5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:06.701861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=14 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:06.773526 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c34252c8-5937-4104-abaf-a793661f52c5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1645 microversion: 2.1 time: 0.647953 Sep 06 10:53:06.774107 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 364/712] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:06 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1645 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:06.778713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6cf5329e-702e-4ca5-b97d-70d376cf54b6 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:06.779251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6cf5329e-702e-4ca5-b97d-70d376cf54b6 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:06.785477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cf5329e-702e-4ca5-b97d-70d376cf54b6 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:06.786161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cf5329e-702e-4ca5-b97d-70d376cf54b6 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:06.786809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cf5329e-702e-4ca5-b97d-70d376cf54b6 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:06.787732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cf5329e-702e-4ca5-b97d-70d376cf54b6 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:06.788359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cf5329e-702e-4ca5-b97d-70d376cf54b6 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:06.788960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cf5329e-702e-4ca5-b97d-70d376cf54b6 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:06.821249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6cf5329e-702e-4ca5-b97d-70d376cf54b6 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:53:07.191120 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6cf5329e-702e-4ca5-b97d-70d376cf54b6 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 204 len: 0 microversion: 2.1 time: 0.415703 Sep 06 10:53:07.192958 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 365/713] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:53:06 2022] DELETE /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:53:07.202540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8106406a-41d8-47af-87f7-ee0bc2f055b5 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:07.203890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8106406a-41d8-47af-87f7-ee0bc2f055b5 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:07.210982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8106406a-41d8-47af-87f7-ee0bc2f055b5 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:07.231292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8106406a-41d8-47af-87f7-ee0bc2f055b5 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:07.240082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8106406a-41d8-47af-87f7-ee0bc2f055b5 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:07.240758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8106406a-41d8-47af-87f7-ee0bc2f055b5 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:07.241267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8106406a-41d8-47af-87f7-ee0bc2f055b5 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:07.241784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8106406a-41d8-47af-87f7-ee0bc2f055b5 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:07.701831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8106406a-41d8-47af-87f7-ee0bc2f055b5 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:07.719079 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8106406a-41d8-47af-87f7-ee0bc2f055b5 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1314 microversion: 2.1 time: 0.524205 Sep 06 10:53:07.726805 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 366/714] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:07 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:07.739950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e8a5c153-ecd3-4034-af53-5cfef0f412e8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:07.742461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e8a5c153-ecd3-4034-af53-5cfef0f412e8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:07.750202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8a5c153-ecd3-4034-af53-5cfef0f412e8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:07.751264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8a5c153-ecd3-4034-af53-5cfef0f412e8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:07.751878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8a5c153-ecd3-4034-af53-5cfef0f412e8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:07.752948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8a5c153-ecd3-4034-af53-5cfef0f412e8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:07.753575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8a5c153-ecd3-4034-af53-5cfef0f412e8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:07.754457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8a5c153-ecd3-4034-af53-5cfef0f412e8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:07.919428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e8a5c153-ecd3-4034-af53-5cfef0f412e8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:07.929310 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e8a5c153-ecd3-4034-af53-5cfef0f412e8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1281 microversion: 2.1 time: 0.196691 Sep 06 10:53:07.929912 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 367/715] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:07 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1281 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:07.936847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d1786b8c-ac7a-464d-9c9f-a2a5b59dfcfe tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:07.937656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d1786b8c-ac7a-464d-9c9f-a2a5b59dfcfe tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:07.950242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1786b8c-ac7a-464d-9c9f-a2a5b59dfcfe tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:07.950749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1786b8c-ac7a-464d-9c9f-a2a5b59dfcfe tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:07.951225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1786b8c-ac7a-464d-9c9f-a2a5b59dfcfe tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:07.962385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1786b8c-ac7a-464d-9c9f-a2a5b59dfcfe tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:07.962808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1786b8c-ac7a-464d-9c9f-a2a5b59dfcfe tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:07.963442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1786b8c-ac7a-464d-9c9f-a2a5b59dfcfe tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:08.291911 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d1786b8c-ac7a-464d-9c9f-a2a5b59dfcfe tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1645 microversion: 2.1 time: 0.360686 Sep 06 10:53:08.297418 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 368/716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:07 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1645 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:08.308797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2a9dffdc-bb7e-4880-8eb2-5b812f13202d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:08.309452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2a9dffdc-bb7e-4880-8eb2-5b812f13202d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:08.327637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a9dffdc-bb7e-4880-8eb2-5b812f13202d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:08.328164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a9dffdc-bb7e-4880-8eb2-5b812f13202d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:08.328590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a9dffdc-bb7e-4880-8eb2-5b812f13202d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:08.329320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a9dffdc-bb7e-4880-8eb2-5b812f13202d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:08.329788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a9dffdc-bb7e-4880-8eb2-5b812f13202d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:08.330220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a9dffdc-bb7e-4880-8eb2-5b812f13202d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:09.235628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2a9dffdc-bb7e-4880-8eb2-5b812f13202d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:09.258397 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2a9dffdc-bb7e-4880-8eb2-5b812f13202d tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1711 microversion: 2.1 time: 0.959395 Sep 06 10:53:09.282753 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 369/717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:08 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1711 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:09.297331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-39393221-61e9-45fa-8cfa-ff9e68f43354 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:09.301657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-39393221-61e9-45fa-8cfa-ff9e68f43354 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:09.328897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39393221-61e9-45fa-8cfa-ff9e68f43354 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:09.333691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39393221-61e9-45fa-8cfa-ff9e68f43354 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:09.334348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39393221-61e9-45fa-8cfa-ff9e68f43354 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:09.339547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39393221-61e9-45fa-8cfa-ff9e68f43354 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:09.341138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39393221-61e9-45fa-8cfa-ff9e68f43354 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:09.341773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39393221-61e9-45fa-8cfa-ff9e68f43354 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:10.115731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-39393221-61e9-45fa-8cfa-ff9e68f43354 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:10.132535 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-39393221-61e9-45fa-8cfa-ff9e68f43354 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1477 microversion: 2.1 time: 0.844521 Sep 06 10:53:10.133607 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 370/718] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:09 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1477 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:10.141740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0091827c-e3e4-41a0-890b-ef4e772db24b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:10.148285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0091827c-e3e4-41a0-890b-ef4e772db24b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:10.149151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0091827c-e3e4-41a0-890b-ef4e772db24b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:10.150414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0091827c-e3e4-41a0-890b-ef4e772db24b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:10.152448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0091827c-e3e4-41a0-890b-ef4e772db24b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:10.154113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0091827c-e3e4-41a0-890b-ef4e772db24b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:10.155456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0091827c-e3e4-41a0-890b-ef4e772db24b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:10.203993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:10.213335 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0091827c-e3e4-41a0-890b-ef4e772db24b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.078307 Sep 06 10:53:10.224691 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 371/719] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Sep 6 10:53:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:10.235807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8746d0f1-bc5b-4905-a5a6-210807177b4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:10.237278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8746d0f1-bc5b-4905-a5a6-210807177b4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:10.256234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8746d0f1-bc5b-4905-a5a6-210807177b4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:10.258941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8746d0f1-bc5b-4905-a5a6-210807177b4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:10.259664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8746d0f1-bc5b-4905-a5a6-210807177b4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:10.260601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8746d0f1-bc5b-4905-a5a6-210807177b4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:10.261799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8746d0f1-bc5b-4905-a5a6-210807177b4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:10.262402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8746d0f1-bc5b-4905-a5a6-210807177b4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:10.311121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:10.804546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8746d0f1-bc5b-4905-a5a6-210807177b4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:10.816837 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8746d0f1-bc5b-4905-a5a6-210807177b4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1314 microversion: 2.1 time: 0.589905 Sep 06 10:53:10.834320 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 372/720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:10 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:10.847402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4b8bd1b-c7cb-46d8-a668-8f4bc5f5f8cc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:10.847537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b4b8bd1b-c7cb-46d8-a668-8f4bc5f5f8cc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:10.855566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b8bd1b-c7cb-46d8-a668-8f4bc5f5f8cc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:10.856070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b8bd1b-c7cb-46d8-a668-8f4bc5f5f8cc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:10.856644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b8bd1b-c7cb-46d8-a668-8f4bc5f5f8cc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:10.857375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b8bd1b-c7cb-46d8-a668-8f4bc5f5f8cc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:10.857843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b8bd1b-c7cb-46d8-a668-8f4bc5f5f8cc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:10.858278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b8bd1b-c7cb-46d8-a668-8f4bc5f5f8cc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:11.450229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b4b8bd1b-c7cb-46d8-a668-8f4bc5f5f8cc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:11.466899 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b4b8bd1b-c7cb-46d8-a668-8f4bc5f5f8cc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1323 microversion: 2.1 time: 0.629071 Sep 06 10:53:11.469461 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 373/721] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:10 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1323 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:11.475105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-10753389-3af9-4929-93fd-43b16f05efe3 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:11.475989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-10753389-3af9-4929-93fd-43b16f05efe3 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:11.483720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10753389-3af9-4929-93fd-43b16f05efe3 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:11.484636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10753389-3af9-4929-93fd-43b16f05efe3 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:11.486040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10753389-3af9-4929-93fd-43b16f05efe3 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:11.487048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10753389-3af9-4929-93fd-43b16f05efe3 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:11.487741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10753389-3af9-4929-93fd-43b16f05efe3 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:11.488414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10753389-3af9-4929-93fd-43b16f05efe3 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:11.830116 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-10753389-3af9-4929-93fd-43b16f05efe3 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c/action" status: 202 len: 0 microversion: 2.1 time: 0.358912 Sep 06 10:53:11.831631 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 374/722] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:53:11 2022] POST /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:53:11.845325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-04734f5f-e084-48a2-80d1-45a41ca39a33 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:11.846227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-04734f5f-e084-48a2-80d1-45a41ca39a33 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:11.865158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04734f5f-e084-48a2-80d1-45a41ca39a33 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:11.871376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04734f5f-e084-48a2-80d1-45a41ca39a33 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:11.871376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04734f5f-e084-48a2-80d1-45a41ca39a33 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:11.871376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04734f5f-e084-48a2-80d1-45a41ca39a33 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:11.871376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04734f5f-e084-48a2-80d1-45a41ca39a33 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:11.871729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04734f5f-e084-48a2-80d1-45a41ca39a33 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:12.034272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-04734f5f-e084-48a2-80d1-45a41ca39a33 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f59260019b34b0b8c4c8792afe8b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2078a32d1694ba3b1393762add00729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:12.043156 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-04734f5f-e084-48a2-80d1-45a41ca39a33 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 200 len: 1346 microversion: 2.1 time: 0.206378 Sep 06 10:53:12.046265 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 375/723] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:11 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 1346 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:12.067530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:12.068384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:12.075812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:12.079571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:12.081194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:12.084037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:12.084722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:12.085352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:12.168482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:12.228126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:12.228578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:12.231098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:12.235468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lazy-loading 'fault' on Instance uuid 3679923f-ffbb-4dd3-bc2f-5789e13143eb {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:53:12.834448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e425c7348db042389a189daa866ea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:12.849483 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-061617d1-9d2a-415d-9c7b-07e3efdf08d3 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 200 len: 1311 microversion: 2.1 time: 0.801771 Sep 06 10:53:12.850445 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 376/724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:12 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 1311 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:12.859646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-bbadfe46-8cee-4817-94a8-bb76303c39ab req-5f9fac79-43c3-47af-a1ee-9533f87d7e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb198d5-0fb1-4632-ae1f-dddec53a5ae9", "name": "network-vif-deleted", "tag": "1cb8770a-9a75-4ea5-afaa-80e009e0a319"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:12.886756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-bbadfe46-8cee-4817-94a8-bb76303c39ab req-5f9fac79-43c3-47af-a1ee-9533f87d7e82 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:12.887275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-bbadfe46-8cee-4817-94a8-bb76303c39ab req-5f9fac79-43c3-47af-a1ee-9533f87d7e82 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:12.887714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-bbadfe46-8cee-4817-94a8-bb76303c39ab req-5f9fac79-43c3-47af-a1ee-9533f87d7e82 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:12.922563 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-bbadfe46-8cee-4817-94a8-bb76303c39ab req-5f9fac79-43c3-47af-a1ee-9533f87d7e82 service nova] Creating event network-vif-deleted:1cb8770a-9a75-4ea5-afaa-80e009e0a319 for instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 on nch1-master-1 Sep 06 10:53:12.950052 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-bbadfe46-8cee-4817-94a8-bb76303c39ab req-5f9fac79-43c3-47af-a1ee-9533f87d7e82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084463 Sep 06 10:53:12.952340 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 377/725] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:12.969702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-2f7be228-cbf2-4f5e-b483-740518bf303a req-c027d484-fa6f-45a2-ba06-00082fd43b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3679923f-ffbb-4dd3-bc2f-5789e13143eb", "name": "network-vif-deleted", "tag": "2bb261a6-9f74-4480-ac5c-2f4c13f925bf"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:12.992071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2f7be228-cbf2-4f5e-b483-740518bf303a req-c027d484-fa6f-45a2-ba06-00082fd43b80 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:12.993118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2f7be228-cbf2-4f5e-b483-740518bf303a req-c027d484-fa6f-45a2-ba06-00082fd43b80 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:12.996205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2f7be228-cbf2-4f5e-b483-740518bf303a req-c027d484-fa6f-45a2-ba06-00082fd43b80 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:13.036614 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-2f7be228-cbf2-4f5e-b483-740518bf303a req-c027d484-fa6f-45a2-ba06-00082fd43b80 service nova] Creating event network-vif-deleted:2bb261a6-9f74-4480-ac5c-2f4c13f925bf for instance 3679923f-ffbb-4dd3-bc2f-5789e13143eb on nch1-master-1 Sep 06 10:53:13.048490 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-2f7be228-cbf2-4f5e-b483-740518bf303a req-c027d484-fa6f-45a2-ba06-00082fd43b80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094432 Sep 06 10:53:13.049717 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 378/726] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:13.055920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dcaffcb4-3ca0-4c99-8e98-d6e9d00425da tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:13.056932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dcaffcb4-3ca0-4c99-8e98-d6e9d00425da tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:13.070656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcaffcb4-3ca0-4c99-8e98-d6e9d00425da tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:13.071788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcaffcb4-3ca0-4c99-8e98-d6e9d00425da tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:13.072554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcaffcb4-3ca0-4c99-8e98-d6e9d00425da tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:13.075145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcaffcb4-3ca0-4c99-8e98-d6e9d00425da tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:13.076131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcaffcb4-3ca0-4c99-8e98-d6e9d00425da tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:13.076935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcaffcb4-3ca0-4c99-8e98-d6e9d00425da tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:13.365925 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3543fe70-34cb-4e6a-95bf-4e644036d29b tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087/action" status: 202 len: 0 microversion: 2.25 time: 8.992019 Sep 06 10:53:13.379873 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 349/727] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 10:53:04 2022] POST /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087/action => generated 0 bytes in 9007 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:53:13.395874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4d97c888-5d8e-4a3a-9975-fbebe3931827 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:13.398409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4d97c888-5d8e-4a3a-9975-fbebe3931827 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:13.429316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d97c888-5d8e-4a3a-9975-fbebe3931827 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:13.432405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d97c888-5d8e-4a3a-9975-fbebe3931827 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:13.434298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d97c888-5d8e-4a3a-9975-fbebe3931827 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:13.437774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d97c888-5d8e-4a3a-9975-fbebe3931827 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:13.438683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d97c888-5d8e-4a3a-9975-fbebe3931827 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:13.442896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d97c888-5d8e-4a3a-9975-fbebe3931827 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:14.038234 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dcaffcb4-3ca0-4c99-8e98-d6e9d00425da tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1630 microversion: 2.1 time: 0.986846 Sep 06 10:53:14.052504 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 379/728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:13 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1630 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:14.062468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:14.067192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-fc7550f5-0548-48dd-8807-b6c7f5e9f039 req-fbc76675-6755-4c6a-beea-7343c726ccb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dd8f1a-f2a3-463e-9129-1060fc467171", "name": "network-vif-plugged", "status": "completed", "tag": "0722de88-af62-4350-ab9b-6cd8023675fa"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:14.079776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-fc7550f5-0548-48dd-8807-b6c7f5e9f039 req-fbc76675-6755-4c6a-beea-7343c726ccb8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:14.080522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-fc7550f5-0548-48dd-8807-b6c7f5e9f039 req-fbc76675-6755-4c6a-beea-7343c726ccb8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:14.081117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-fc7550f5-0548-48dd-8807-b6c7f5e9f039 req-fbc76675-6755-4c6a-beea-7343c726ccb8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:14.094638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4d97c888-5d8e-4a3a-9975-fbebe3931827 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:14.096189 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-fc7550f5-0548-48dd-8807-b6c7f5e9f039 req-fbc76675-6755-4c6a-beea-7343c726ccb8 service nova] Creating event network-vif-plugged:0722de88-af62-4350-ab9b-6cd8023675fa for instance 77dd8f1a-f2a3-463e-9129-1060fc467171 on nch1-master-1 Sep 06 10:53:14.100959 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-fc7550f5-0548-48dd-8807-b6c7f5e9f039 req-fbc76675-6755-4c6a-beea-7343c726ccb8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047112 Sep 06 10:53:14.102127 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 380/729] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:14.107327 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4d97c888-5d8e-4a3a-9975-fbebe3931827 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1314 microversion: 2.1 time: 0.724678 Sep 06 10:53:14.108764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7c986eb2-0226-4a11-8f05-034393803945 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:14.109650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7c986eb2-0226-4a11-8f05-034393803945 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:14.118329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c986eb2-0226-4a11-8f05-034393803945 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:14.119894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c986eb2-0226-4a11-8f05-034393803945 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:14.121108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c986eb2-0226-4a11-8f05-034393803945 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:14.125923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c986eb2-0226-4a11-8f05-034393803945 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:14.125923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c986eb2-0226-4a11-8f05-034393803945 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:14.125923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c986eb2-0226-4a11-8f05-034393803945 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:14.139318 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 350/730] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:13 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:14.148133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9435d22e-3ceb-4190-94ba-8aba37efbecd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:14.148772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9435d22e-3ceb-4190-94ba-8aba37efbecd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:14.157404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9435d22e-3ceb-4190-94ba-8aba37efbecd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:14.159987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9435d22e-3ceb-4190-94ba-8aba37efbecd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:14.159987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9435d22e-3ceb-4190-94ba-8aba37efbecd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:14.159987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9435d22e-3ceb-4190-94ba-8aba37efbecd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:14.160419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9435d22e-3ceb-4190-94ba-8aba37efbecd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:14.160914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9435d22e-3ceb-4190-94ba-8aba37efbecd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:14.192751 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-9435d22e-3ceb-4190-94ba-8aba37efbecd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] HTTP exception thrown: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9435d22e-3ceb-4190-94ba-8aba37efbecd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Request method failure captured: Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 HTTP/1.1 Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYEd5ToXN51s16qwaq94urY_pftQ_f5HIu5folisY0SThLaXd46KKdNEGhnIJkwu_Btr9Y3nwsO42Iosincaed8zT2LmZ14btytmLy4d3vdZIUnSMk6ekBhMwZujMjJRxdR6rAjldppJkd9Q71Z6tmqUd0VORRrTW5TpKjn9iCufVs Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:53:14.194437 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:53:14.196049 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2078a32d1694ba3b1393762add00729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2078a32d1694ba3b1393762add00729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}] Sep 06 10:53:14.196049 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:14.196049 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:14.196049 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:14.196049 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:14.196049 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:53:14.196049 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:53:14.196049 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6f59260019b34b0b8c4c8792afe8b317 Sep 06 10:53:14.196049 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:14.196049 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:53:14.196049 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:14.196049 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '9fb198d5-0fb1-4632-ae1f-dddec53a5ae9'} Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:53:14.196829 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:14.198289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:14.204063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9435d22e-3ceb-4190-94ba-8aba37efbecd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Returning 404 to user: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:53:14.205748 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9435d22e-3ceb-4190-94ba-8aba37efbecd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 404 len: 111 microversion: 2.1 time: 0.065264 Sep 06 10:53:14.206565 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 351/731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:14 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:53:14.211500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7259872e-9041-4a38-91b3-30f57d955ec6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:14.212231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7259872e-9041-4a38-91b3-30f57d955ec6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:14.220510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7259872e-9041-4a38-91b3-30f57d955ec6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:14.221116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7259872e-9041-4a38-91b3-30f57d955ec6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:14.221680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7259872e-9041-4a38-91b3-30f57d955ec6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:14.222636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7259872e-9041-4a38-91b3-30f57d955ec6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:14.223227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7259872e-9041-4a38-91b3-30f57d955ec6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:14.223876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7259872e-9041-4a38-91b3-30f57d955ec6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:14.742873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7c986eb2-0226-4a11-8f05-034393803945 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:14.761802 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7c986eb2-0226-4a11-8f05-034393803945 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1323 microversion: 2.1 time: 0.657184 Sep 06 10:53:14.771841 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 381/732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:14 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1323 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:14.778459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0401a6b8-945a-4256-8a48-0ceaf95fed11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:14.784403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0401a6b8-945a-4256-8a48-0ceaf95fed11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] [instance: 3679923f-ffbb-4dd3-bc2f-5789e13143eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:14.807437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0401a6b8-945a-4256-8a48-0ceaf95fed11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:14.809951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0401a6b8-945a-4256-8a48-0ceaf95fed11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:14.810633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0401a6b8-945a-4256-8a48-0ceaf95fed11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:14.814450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0401a6b8-945a-4256-8a48-0ceaf95fed11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:14.817243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0401a6b8-945a-4256-8a48-0ceaf95fed11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:14.818745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0401a6b8-945a-4256-8a48-0ceaf95fed11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:14.866901 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-0401a6b8-945a-4256-8a48-0ceaf95fed11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] HTTP exception thrown: Instance 3679923f-ffbb-4dd3-bc2f-5789e13143eb could not be found. Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0401a6b8-945a-4256-8a48-0ceaf95fed11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Request method failure captured: Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb HTTP/1.1 Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZI00RjWWvpOxH-yxoUo4yd12TQAOe8tiLPAKBUH-_gWj2EnVnUWFlar5YDau03t9SyVxxDzfcp1jGhSSLffwa9lkhwFE2o3DJKHpHl4Yl_sayJ79PfzkRuxcc6FdcQu2LuDOsjX7bG0DMPh5Mkwqrwu7wZpPHSxfx2ZvukX7ARGgY Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 4882f2c8ef9c4f29bf3cbaa93cf9d488 Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1191351515 Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:53:14.873026 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:53:14.874377 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4882f2c8ef9c4f29bf3cbaa93cf9d488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4882f2c8ef9c4f29bf3cbaa93cf9d488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4882f2c8ef9c4f29bf3cbaa93cf9d488"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4882f2c8ef9c4f29bf3cbaa93cf9d488"}]}] Sep 06 10:53:14.874377 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1191351515 Sep 06 10:53:14.874377 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 4882f2c8ef9c4f29bf3cbaa93cf9d488 Sep 06 10:53:14.874377 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1191351515 Sep 06 10:53:14.874377 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersAdminNegativeTestJSON-1191351515-project Sep 06 10:53:14.874377 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:53:14.874377 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:53:14.874377 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e425c7348db042389a189daa866ea06d Sep 06 10:53:14.874377 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1191351515-project Sep 06 10:53:14.874377 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:53:14.874377 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 3679923f-ffbb-4dd3-bc2f-5789e13143eb could not be found. Sep 06 10:53:14.874377 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '3679923f-ffbb-4dd3-bc2f-5789e13143eb'} Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3679923f-ffbb-4dd3-bc2f-5789e13143eb could not be found. Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:53:14.875104 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3679923f-ffbb-4dd3-bc2f-5789e13143eb could not be found. Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3679923f-ffbb-4dd3-bc2f-5789e13143eb could not be found. Sep 06 10:53:14.876637 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:14.879507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0401a6b8-945a-4256-8a48-0ceaf95fed11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] Returning 404 to user: Instance 3679923f-ffbb-4dd3-bc2f-5789e13143eb could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:53:14.886373 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0401a6b8-945a-4256-8a48-0ceaf95fed11 tempest-ServersAdminNegativeTestJSON-1191351515 tempest-ServersAdminNegativeTestJSON-1191351515-project] 10.222.0.20 "GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb" status: 404 len: 111 microversion: 2.1 time: 0.107706 Sep 06 10:53:14.886373 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 382/733] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:14 2022] GET /compute/v2.1/servers/3679923f-ffbb-4dd3-bc2f-5789e13143eb => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:53:14.915090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-15c944c4-8112-4576-aa42-5a7ab29c01b2 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:14.937436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-15c944c4-8112-4576-aa42-5a7ab29c01b2 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:14.957424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15c944c4-8112-4576-aa42-5a7ab29c01b2 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:14.958897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15c944c4-8112-4576-aa42-5a7ab29c01b2 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:14.960071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15c944c4-8112-4576-aa42-5a7ab29c01b2 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:14.962036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15c944c4-8112-4576-aa42-5a7ab29c01b2 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:14.970168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15c944c4-8112-4576-aa42-5a7ab29c01b2 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:14.970168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15c944c4-8112-4576-aa42-5a7ab29c01b2 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:15.016428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7259872e-9041-4a38-91b3-30f57d955ec6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:15.032078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7259872e-9041-4a38-91b3-30f57d955ec6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:15.041889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7259872e-9041-4a38-91b3-30f57d955ec6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:15.043741 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7259872e-9041-4a38-91b3-30f57d955ec6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1569 microversion: 2.25 time: 0.836044 Sep 06 10:53:15.045793 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 352/734] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:14 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1569 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:15.060776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a268fa55-6a00-422d-b156-66381216198e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:15.061537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-15c944c4-8112-4576-aa42-5a7ab29c01b2 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lazy-loading 'flavor' on Instance uuid 11eb8c12-ec92-4302-a038-5c343138776c {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:53:15.062927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a268fa55-6a00-422d-b156-66381216198e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:15.081499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-15c944c4-8112-4576-aa42-5a7ab29c01b2 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Going to try to live migrate instance to nch2-master-1 {{(pid=140876) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 06 10:53:15.094821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a268fa55-6a00-422d-b156-66381216198e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:15.095770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a268fa55-6a00-422d-b156-66381216198e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:15.096440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a268fa55-6a00-422d-b156-66381216198e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:15.097424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a268fa55-6a00-422d-b156-66381216198e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:15.098243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a268fa55-6a00-422d-b156-66381216198e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:15.098970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a268fa55-6a00-422d-b156-66381216198e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:15.126890 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-a268fa55-6a00-422d-b156-66381216198e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] HTTP exception thrown: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a268fa55-6a00-422d-b156-66381216198e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Request method failure captured: Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de HTTP/1.1 Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYEd5ToXN51s16qwaq94urY_pftQ_f5HIu5folisY0SThLaXd46KKdNEGhnIJkwu_Btr9Y3nwsO42Iosincaed8zT2LmZ14btytmLy4d3vdZIUnSMk6ekBhMwZujMjJRxdR6rAjldppJkd9Q71Z6tmqUd0VORRrTW5TpKjn9iCufVs Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:53:15.128873 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:53:15.130279 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2078a32d1694ba3b1393762add00729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2078a32d1694ba3b1393762add00729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}] Sep 06 10:53:15.130279 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:15.130279 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:15.130279 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:15.130279 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:15.130279 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:53:15.130279 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:53:15.130279 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6f59260019b34b0b8c4c8792afe8b317 Sep 06 10:53:15.130279 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:15.130279 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:53:15.130279 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:15.130279 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '8f9007e9-46e7-420d-8c1d-dc40c1c212de'} Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:53:15.132049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:15.133331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:15.137428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a268fa55-6a00-422d-b156-66381216198e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Returning 404 to user: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:53:15.138541 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a268fa55-6a00-422d-b156-66381216198e tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 404 len: 111 microversion: 2.1 time: 0.090821 Sep 06 10:53:15.139768 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 353/735] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:53:15 2022] DELETE /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:53:15.267942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1085212255", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "8c7b67ff-233f-4a9e-acc5-cc1f60baf7c8"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:15.425363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] validate_networks() for [('8c7b67ff-233f-4a9e-acc5-cc1f60baf7c8', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:53:17.254760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:53:17.256503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:53:17.257232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:53:17.257895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:53:17.258477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:53:17.275289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:17.276129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:17.277337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:17.285130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:17.285917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:17.286606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:17.314800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Getting quotas for project e047ab9362dc476c9a4b4aee7223d042. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:53:17.321994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Getting quotas for user d79046739b2d4572b0aedef59e621ab8 and project e047ab9362dc476c9a4b4aee7223d042. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:53:17.339943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:53:17.342634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:53:17.497357 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f394e2c5-2987-4970-874b-dd757dd1d358 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.356001 Sep 06 10:53:17.505254 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 354/736] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:53:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:53:17.517362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ccc0f95-5b47-4a94-acca-d27f883c3833 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:17.518222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0ccc0f95-5b47-4a94-acca-d27f883c3833 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:17.529362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ccc0f95-5b47-4a94-acca-d27f883c3833 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:17.530980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ccc0f95-5b47-4a94-acca-d27f883c3833 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:17.531976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ccc0f95-5b47-4a94-acca-d27f883c3833 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:17.537951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ccc0f95-5b47-4a94-acca-d27f883c3833 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:17.537951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ccc0f95-5b47-4a94-acca-d27f883c3833 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:17.537951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ccc0f95-5b47-4a94-acca-d27f883c3833 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:18.006761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0ccc0f95-5b47-4a94-acca-d27f883c3833 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:18.009097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:18.016152 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0ccc0f95-5b47-4a94-acca-d27f883c3833 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1314 microversion: 2.1 time: 0.508688 Sep 06 10:53:18.016864 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 355/737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:17 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:18.021711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a045156-ab11-4d3b-a50f-471327730efe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:18.022470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0a045156-ab11-4d3b-a50f-471327730efe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:18.033002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a045156-ab11-4d3b-a50f-471327730efe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:18.033501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a045156-ab11-4d3b-a50f-471327730efe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:18.033936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a045156-ab11-4d3b-a50f-471327730efe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:18.034700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a045156-ab11-4d3b-a50f-471327730efe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:18.035232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a045156-ab11-4d3b-a50f-471327730efe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:18.035671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a045156-ab11-4d3b-a50f-471327730efe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:18.067675 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-0a045156-ab11-4d3b-a50f-471327730efe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] HTTP exception thrown: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a045156-ab11-4d3b-a50f-471327730efe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Request method failure captured: Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de HTTP/1.1 Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYEd5ToXN51s16qwaq94urY_pftQ_f5HIu5folisY0SThLaXd46KKdNEGhnIJkwu_Btr9Y3nwsO42Iosincaed8zT2LmZ14btytmLy4d3vdZIUnSMk6ekBhMwZujMjJRxdR6rAjldppJkd9Q71Z6tmqUd0VORRrTW5TpKjn9iCufVs Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:53:18.070180 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:53:18.071674 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2078a32d1694ba3b1393762add00729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2078a32d1694ba3b1393762add00729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}] Sep 06 10:53:18.071674 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:18.071674 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:18.071674 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:18.071674 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:18.071674 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:53:18.071674 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:53:18.071674 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6f59260019b34b0b8c4c8792afe8b317 Sep 06 10:53:18.071674 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:18.071674 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:53:18.071674 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:18.071674 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '8f9007e9-46e7-420d-8c1d-dc40c1c212de'} Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:53:18.072473 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:18.074210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:18.076357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a045156-ab11-4d3b-a50f-471327730efe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Returning 404 to user: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:53:18.077608 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0a045156-ab11-4d3b-a50f-471327730efe tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 404 len: 111 microversion: 2.1 time: 0.059812 Sep 06 10:53:18.081455 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 356/738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:18 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:53:18.086428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-43fea620-f805-4f64-9ccd-6b6a4748200b req-285e4251-efb2-470d-b448-35c7610a34b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3270e900-2c13-43a0-9bb1-2a45ad779f85", "tag": "e70d14e6-709d-4b07-af6d-182402e5390a"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:18.103334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-43fea620-f805-4f64-9ccd-6b6a4748200b req-285e4251-efb2-470d-b448-35c7610a34b3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:18.104140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-43fea620-f805-4f64-9ccd-6b6a4748200b req-285e4251-efb2-470d-b448-35c7610a34b3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:18.104693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-43fea620-f805-4f64-9ccd-6b6a4748200b req-285e4251-efb2-470d-b448-35c7610a34b3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:18.138949 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-43fea620-f805-4f64-9ccd-6b6a4748200b req-285e4251-efb2-470d-b448-35c7610a34b3 service nova] Creating event network-changed:e70d14e6-709d-4b07-af6d-182402e5390a for instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 on nch2-master-1 Sep 06 10:53:18.148126 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-43fea620-f805-4f64-9ccd-6b6a4748200b req-285e4251-efb2-470d-b448-35c7610a34b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065760 Sep 06 10:53:18.148763 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 357/739] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:18.176552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-22e2d9e9-d590-4c08-98d7-653a3b84abba tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:18.179258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-22e2d9e9-d590-4c08-98d7-653a3b84abba tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:18.230106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e2d9e9-d590-4c08-98d7-653a3b84abba tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:18.231692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e2d9e9-d590-4c08-98d7-653a3b84abba tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:18.232877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e2d9e9-d590-4c08-98d7-653a3b84abba tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:18.234256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e2d9e9-d590-4c08-98d7-653a3b84abba tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:18.237304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e2d9e9-d590-4c08-98d7-653a3b84abba tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:18.237627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e2d9e9-d590-4c08-98d7-653a3b84abba tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:18.262817 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-15c944c4-8112-4576-aa42-5a7ab29c01b2 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c/action" status: 202 len: 0 microversion: 2.1 time: 3.376392 Sep 06 10:53:18.264681 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 383/740] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:53:14 2022] POST /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c/action => generated 0 bytes in 3379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:53:18.278357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a90054d6-1798-4ffa-9d51-0bd2a0493764 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:18.279759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a90054d6-1798-4ffa-9d51-0bd2a0493764 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:18.300873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a90054d6-1798-4ffa-9d51-0bd2a0493764 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:18.317184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a90054d6-1798-4ffa-9d51-0bd2a0493764 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:18.317184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a90054d6-1798-4ffa-9d51-0bd2a0493764 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:18.319082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a90054d6-1798-4ffa-9d51-0bd2a0493764 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:18.322717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a90054d6-1798-4ffa-9d51-0bd2a0493764 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:18.323497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a90054d6-1798-4ffa-9d51-0bd2a0493764 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:19.028649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-22e2d9e9-d590-4c08-98d7-653a3b84abba tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:19.039380 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-22e2d9e9-d590-4c08-98d7-653a3b84abba tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1323 microversion: 2.1 time: 0.886671 Sep 06 10:53:19.051434 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 358/741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:18 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1323 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:19.081196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-af23fbfb-9acb-41f2-94f2-6b19fd154952 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:19.081813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-af23fbfb-9acb-41f2-94f2-6b19fd154952 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:19.127619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:19.237742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a90054d6-1798-4ffa-9d51-0bd2a0493764 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:19.247695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a90054d6-1798-4ffa-9d51-0bd2a0493764 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:19.259274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a90054d6-1798-4ffa-9d51-0bd2a0493764 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:19.274355 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a90054d6-1798-4ffa-9d51-0bd2a0493764 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1569 microversion: 2.25 time: 1.003224 Sep 06 10:53:19.290395 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 384/742] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:18 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1569 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:19.308530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-d4a418e0-f56a-4bcb-8636-06a89085a6fc req-e0203dc6-6cda-4695-9280-b475a8d1aa1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b77047-0abe-4fe2-8f93-41a27feb4861", "name": "network-vif-plugged", "status": "completed", "tag": "1e7653a0-3a04-40cd-b60e-9537558010eb"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:19.348277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af23fbfb-9acb-41f2-94f2-6b19fd154952 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:19.360261 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-af23fbfb-9acb-41f2-94f2-6b19fd154952 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1208 microversion: 2.1 time: 0.292421 Sep 06 10:53:19.361910 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 359/743] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:19 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1208 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:19.362680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d4a418e0-f56a-4bcb-8636-06a89085a6fc req-e0203dc6-6cda-4695-9280-b475a8d1aa1e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:19.363204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d4a418e0-f56a-4bcb-8636-06a89085a6fc req-e0203dc6-6cda-4695-9280-b475a8d1aa1e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:19.363667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d4a418e0-f56a-4bcb-8636-06a89085a6fc req-e0203dc6-6cda-4695-9280-b475a8d1aa1e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:19.386195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84ffa6d0-2499-4c5b-b46d-a64bf9520b96 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '.version_select at 0x7f90f8bc0d30>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:19.419885 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d4a418e0-f56a-4bcb-8636-06a89085a6fc req-e0203dc6-6cda-4695-9280-b475a8d1aa1e service nova] Creating event network-vif-plugged:1e7653a0-3a04-40cd-b60e-9537558010eb for instance 58b77047-0abe-4fe2-8f93-41a27feb4861 on nch1-master-1 Sep 06 10:53:19.453454 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-d4a418e0-f56a-4bcb-8636-06a89085a6fc req-e0203dc6-6cda-4695-9280-b475a8d1aa1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167941 Sep 06 10:53:19.461920 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 385/744] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:19.467507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a56ab45c-3c52-477a-883f-846fab3fe17f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:19.468223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a56ab45c-3c52-477a-883f-846fab3fe17f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:19.494336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a56ab45c-3c52-477a-883f-846fab3fe17f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:19.497307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a56ab45c-3c52-477a-883f-846fab3fe17f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:19.498710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a56ab45c-3c52-477a-883f-846fab3fe17f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:19.499889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a56ab45c-3c52-477a-883f-846fab3fe17f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:19.500531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a56ab45c-3c52-477a-883f-846fab3fe17f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:19.501409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a56ab45c-3c52-477a-883f-846fab3fe17f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:19.521974 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84ffa6d0-2499-4c5b-b46d-a64bf9520b96 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-338547195" status: 202 len: 0 microversion: 2.1 time: 0.158775 Sep 06 10:53:19.524878 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 360/745] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 10:53:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-338547195 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:53:19.533248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-52752a9e-e53b-4652-bc39-a523fe60df1a tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:19.533993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-52752a9e-e53b-4652-bc39-a523fe60df1a tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:19.555513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52752a9e-e53b-4652-bc39-a523fe60df1a tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:19.556121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52752a9e-e53b-4652-bc39-a523fe60df1a tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:19.563162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52752a9e-e53b-4652-bc39-a523fe60df1a tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:19.564307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52752a9e-e53b-4652-bc39-a523fe60df1a tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:19.567219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52752a9e-e53b-4652-bc39-a523fe60df1a tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:19.567947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52752a9e-e53b-4652-bc39-a523fe60df1a tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:20.083679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-52752a9e-e53b-4652-bc39-a523fe60df1a tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:20.093314 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-52752a9e-e53b-4652-bc39-a523fe60df1a tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1314 microversion: 2.1 time: 0.564861 Sep 06 10:53:20.097732 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 361/746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:19 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:20.118755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e338118-f467-44e9-b8b6-297174762817 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:20.119841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e338118-f467-44e9-b8b6-297174762817 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:20.144244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e338118-f467-44e9-b8b6-297174762817 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:20.150635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e338118-f467-44e9-b8b6-297174762817 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:20.151315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e338118-f467-44e9-b8b6-297174762817 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:20.152810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e338118-f467-44e9-b8b6-297174762817 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:20.153514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e338118-f467-44e9-b8b6-297174762817 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:20.154330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e338118-f467-44e9-b8b6-297174762817 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:20.172173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:20.610971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a56ab45c-3c52-477a-883f-846fab3fe17f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:20.622458 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a56ab45c-3c52-477a-883f-846fab3fe17f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1504 microversion: 2.1 time: 1.159137 Sep 06 10:53:20.623989 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 386/747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:19 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1504 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:20.639343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-63016be7-4a6d-4401-a04e-3fde43435e30 req-f3bbee78-91ce-4e9d-88e0-1a44f6ccaf78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239473a8-8554-4c9d-a566-b76c75336087", "name": "network-vif-unplugged", "status": "completed", "tag": "e8f21b28-8b08-44a7-892d-3e672959f381"}, {"name": "network-changed", "server_uuid": "239473a8-8554-4c9d-a566-b76c75336087", "tag": "e8f21b28-8b08-44a7-892d-3e672959f381"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:20.677400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-63016be7-4a6d-4401-a04e-3fde43435e30 req-f3bbee78-91ce-4e9d-88e0-1a44f6ccaf78 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:20.680942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-63016be7-4a6d-4401-a04e-3fde43435e30 req-f3bbee78-91ce-4e9d-88e0-1a44f6ccaf78 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:20.681705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-63016be7-4a6d-4401-a04e-3fde43435e30 req-f3bbee78-91ce-4e9d-88e0-1a44f6ccaf78 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:20.712535 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-63016be7-4a6d-4401-a04e-3fde43435e30 req-f3bbee78-91ce-4e9d-88e0-1a44f6ccaf78 service nova] Creating event network-vif-unplugged:e8f21b28-8b08-44a7-892d-3e672959f381 for instance 239473a8-8554-4c9d-a566-b76c75336087 on nch2-master-1 Sep 06 10:53:20.713398 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-63016be7-4a6d-4401-a04e-3fde43435e30 req-f3bbee78-91ce-4e9d-88e0-1a44f6ccaf78 service nova] Creating event network-changed:e8f21b28-8b08-44a7-892d-3e672959f381 for instance 239473a8-8554-4c9d-a566-b76c75336087 on nch2-master-1 Sep 06 10:53:20.725488 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-63016be7-4a6d-4401-a04e-3fde43435e30 req-f3bbee78-91ce-4e9d-88e0-1a44f6ccaf78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.099873 Sep 06 10:53:20.727887 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 387/748] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:20.746907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c5df58bb-2fe8-49cd-a337-8c1245cbd846 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:20.748560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c5df58bb-2fe8-49cd-a337-8c1245cbd846 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:20.760594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5df58bb-2fe8-49cd-a337-8c1245cbd846 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:20.763617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5df58bb-2fe8-49cd-a337-8c1245cbd846 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:20.765570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5df58bb-2fe8-49cd-a337-8c1245cbd846 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:20.767672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5df58bb-2fe8-49cd-a337-8c1245cbd846 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:20.771223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5df58bb-2fe8-49cd-a337-8c1245cbd846 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:20.772007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5df58bb-2fe8-49cd-a337-8c1245cbd846 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:20.914920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7e338118-f467-44e9-b8b6-297174762817 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:20.936676 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e338118-f467-44e9-b8b6-297174762817 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1323 microversion: 2.1 time: 0.835842 Sep 06 10:53:20.960157 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 362/749] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:20 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1323 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:20.965523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6e1ebe2f-8ab2-4d4d-9772-8adb80ff40ec tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:20.971869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6e1ebe2f-8ab2-4d4d-9772-8adb80ff40ec tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:20.985816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e1ebe2f-8ab2-4d4d-9772-8adb80ff40ec tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:20.986625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e1ebe2f-8ab2-4d4d-9772-8adb80ff40ec tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:20.987271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e1ebe2f-8ab2-4d4d-9772-8adb80ff40ec tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:20.990152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e1ebe2f-8ab2-4d4d-9772-8adb80ff40ec tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:20.990940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e1ebe2f-8ab2-4d4d-9772-8adb80ff40ec tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:20.991580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e1ebe2f-8ab2-4d4d-9772-8adb80ff40ec tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:21.919547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6e1ebe2f-8ab2-4d4d-9772-8adb80ff40ec tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:21.934469 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6e1ebe2f-8ab2-4d4d-9772-8adb80ff40ec tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1204 microversion: 2.1 time: 0.971748 Sep 06 10:53:21.935371 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 363/750] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:20 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1204 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:21.949580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6d05e5db-88b6-4476-9dfb-a80784782de0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:21.950456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6d05e5db-88b6-4476-9dfb-a80784782de0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:21.963405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d05e5db-88b6-4476-9dfb-a80784782de0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:21.967749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d05e5db-88b6-4476-9dfb-a80784782de0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:21.967749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d05e5db-88b6-4476-9dfb-a80784782de0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:21.969134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d05e5db-88b6-4476-9dfb-a80784782de0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:21.971272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d05e5db-88b6-4476-9dfb-a80784782de0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:21.973563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d05e5db-88b6-4476-9dfb-a80784782de0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:22.034871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c5df58bb-2fe8-49cd-a337-8c1245cbd846 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:22.185147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c5df58bb-2fe8-49cd-a337-8c1245cbd846 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:22.198946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c5df58bb-2fe8-49cd-a337-8c1245cbd846 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:22.200231 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c5df58bb-2fe8-49cd-a337-8c1245cbd846 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1569 microversion: 2.25 time: 1.470952 Sep 06 10:53:22.200817 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 388/751] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:20 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1569 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:22.214758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4cb29efd-af65-4048-8cf7-0f3d3ab00224 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:22.218199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4cb29efd-af65-4048-8cf7-0f3d3ab00224 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:22.228931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cb29efd-af65-4048-8cf7-0f3d3ab00224 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:22.232840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cb29efd-af65-4048-8cf7-0f3d3ab00224 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:22.233488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cb29efd-af65-4048-8cf7-0f3d3ab00224 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:22.234751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cb29efd-af65-4048-8cf7-0f3d3ab00224 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:22.235462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cb29efd-af65-4048-8cf7-0f3d3ab00224 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:22.238620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cb29efd-af65-4048-8cf7-0f3d3ab00224 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:22.441323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6d05e5db-88b6-4476-9dfb-a80784782de0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:22.461434 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6d05e5db-88b6-4476-9dfb-a80784782de0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1314 microversion: 2.1 time: 0.524812 Sep 06 10:53:22.468444 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 364/752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:21 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:22.689179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4cb29efd-af65-4048-8cf7-0f3d3ab00224 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:22.697023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:22.714388 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4cb29efd-af65-4048-8cf7-0f3d3ab00224 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1504 microversion: 2.1 time: 0.511797 Sep 06 10:53:22.715001 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 389/753] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:22 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1504 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:22.727539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-18e830eb-793e-4f5e-a645-4e4a48fcc238 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:22.727539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-18e830eb-793e-4f5e-a645-4e4a48fcc238 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:22.756435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18e830eb-793e-4f5e-a645-4e4a48fcc238 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:22.759252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18e830eb-793e-4f5e-a645-4e4a48fcc238 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:22.759884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18e830eb-793e-4f5e-a645-4e4a48fcc238 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:22.767034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18e830eb-793e-4f5e-a645-4e4a48fcc238 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:22.767701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18e830eb-793e-4f5e-a645-4e4a48fcc238 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:22.768175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18e830eb-793e-4f5e-a645-4e4a48fcc238 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:22.927287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f6307581-77a6-45c5-9679-e649bfc0b618 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:22.931831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6307581-77a6-45c5-9679-e649bfc0b618 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:22.934528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6307581-77a6-45c5-9679-e649bfc0b618 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:22.935144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6307581-77a6-45c5-9679-e649bfc0b618 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:22.937312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6307581-77a6-45c5-9679-e649bfc0b618 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:22.938856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6307581-77a6-45c5-9679-e649bfc0b618 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:22.939573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6307581-77a6-45c5-9679-e649bfc0b618 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:23.022368 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f6307581-77a6-45c5-9679-e649bfc0b618 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.552224 Sep 06 10:53:23.035474 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 365/754] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:53:22 2022] GET /compute/v2.1/os-services => generated 947 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:23.041170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ea6d03c4-3673-4d3a-9fbe-40af36dff37d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:23.042205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ea6d03c4-3673-4d3a-9fbe-40af36dff37d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:23.058677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea6d03c4-3673-4d3a-9fbe-40af36dff37d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:23.059557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea6d03c4-3673-4d3a-9fbe-40af36dff37d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:23.060441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea6d03c4-3673-4d3a-9fbe-40af36dff37d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:23.061549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea6d03c4-3673-4d3a-9fbe-40af36dff37d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:23.062244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea6d03c4-3673-4d3a-9fbe-40af36dff37d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:23.063050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea6d03c4-3673-4d3a-9fbe-40af36dff37d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:23.168973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-18e830eb-793e-4f5e-a645-4e4a48fcc238 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:23.183616 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-18e830eb-793e-4f5e-a645-4e4a48fcc238 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1323 microversion: 2.1 time: 0.466871 Sep 06 10:53:23.202203 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 390/755] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:22 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1323 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:23.203572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2769768a-94cd-4810-9187-8937c3343014 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:23.209390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2769768a-94cd-4810-9187-8937c3343014 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:23.210582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2769768a-94cd-4810-9187-8937c3343014 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:23.213242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2769768a-94cd-4810-9187-8937c3343014 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:23.214408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2769768a-94cd-4810-9187-8937c3343014 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:23.217353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2769768a-94cd-4810-9187-8937c3343014 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:23.218021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2769768a-94cd-4810-9187-8937c3343014 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:23.305847 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2769768a-94cd-4810-9187-8937c3343014 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.112239 Sep 06 10:53:23.307526 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 391/756] 10.222.0.20 () {58 vars in 1174 bytes} [Tue Sep 6 10:53:23 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:23.324203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ea6d03c4-3673-4d3a-9fbe-40af36dff37d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:23.326534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-fa367301-34c6-463d-bdff-6a2b0dd17de4 req-e6df1c4c-5f78-4a2e-a285-a399e5a17068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11eb8c12-ec92-4302-a038-5c343138776c", "name": "network-vif-unplugged", "status": "completed", "tag": "943d3511-f984-4e2d-9c92-94ae06bad6c8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:23.343160 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ea6d03c4-3673-4d3a-9fbe-40af36dff37d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1268 microversion: 2.1 time: 0.306086 Sep 06 10:53:23.348538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-fa367301-34c6-463d-bdff-6a2b0dd17de4 req-e6df1c4c-5f78-4a2e-a285-a399e5a17068 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:23.349127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-fa367301-34c6-463d-bdff-6a2b0dd17de4 req-e6df1c4c-5f78-4a2e-a285-a399e5a17068 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:23.349569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-fa367301-34c6-463d-bdff-6a2b0dd17de4 req-e6df1c4c-5f78-4a2e-a285-a399e5a17068 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:23.365881 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 366/757] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:23 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1268 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:23.377543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3bc78ec7-b445-4750-963b-e90fe47f98b4 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:23.399480 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-fa367301-34c6-463d-bdff-6a2b0dd17de4 req-e6df1c4c-5f78-4a2e-a285-a399e5a17068 service nova] Creating event network-vif-unplugged:943d3511-f984-4e2d-9c92-94ae06bad6c8 for instance 11eb8c12-ec92-4302-a038-5c343138776c on nch1-master-1 Sep 06 10:53:23.417748 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-fa367301-34c6-463d-bdff-6a2b0dd17de4 req-e6df1c4c-5f78-4a2e-a285-a399e5a17068 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105942 Sep 06 10:53:23.420470 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 392/758] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:23.435304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-47131036-4656-48cd-b807-6a46cc71eb87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:23.445573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-47131036-4656-48cd-b807-6a46cc71eb87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:23.460215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47131036-4656-48cd-b807-6a46cc71eb87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:23.461706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47131036-4656-48cd-b807-6a46cc71eb87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:23.463756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47131036-4656-48cd-b807-6a46cc71eb87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:23.467645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47131036-4656-48cd-b807-6a46cc71eb87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:23.469151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47131036-4656-48cd-b807-6a46cc71eb87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:23.471656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47131036-4656-48cd-b807-6a46cc71eb87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:23.503337 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3bc78ec7-b445-4750-963b-e90fe47f98b4 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/74225120" status: 202 len: 0 microversion: 2.1 time: 0.134173 Sep 06 10:53:23.505510 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 367/759] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 10:53:23 2022] DELETE /compute/v2.1/flavors/74225120 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:53:23.512113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d32f3928-1cd5-424f-8da3-529d6f776c0a tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:23.520465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d32f3928-1cd5-424f-8da3-529d6f776c0a tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:23.521386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d32f3928-1cd5-424f-8da3-529d6f776c0a tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:23.522052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d32f3928-1cd5-424f-8da3-529d6f776c0a tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:23.523244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d32f3928-1cd5-424f-8da3-529d6f776c0a tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:23.523933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d32f3928-1cd5-424f-8da3-529d6f776c0a tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:23.524634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d32f3928-1cd5-424f-8da3-529d6f776c0a tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:23.680586 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d32f3928-1cd5-424f-8da3-529d6f776c0a tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.171405 Sep 06 10:53:23.681685 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 368/760] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Sep 6 10:53:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:23.704169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cd664bd5-78ec-4aaa-b68c-2eee2eef0314 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:23.705311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cd664bd5-78ec-4aaa-b68c-2eee2eef0314 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:23.724044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd664bd5-78ec-4aaa-b68c-2eee2eef0314 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:23.726834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd664bd5-78ec-4aaa-b68c-2eee2eef0314 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:23.729571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd664bd5-78ec-4aaa-b68c-2eee2eef0314 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:23.735674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd664bd5-78ec-4aaa-b68c-2eee2eef0314 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:23.739492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd664bd5-78ec-4aaa-b68c-2eee2eef0314 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:23.742515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd664bd5-78ec-4aaa-b68c-2eee2eef0314 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:23.991722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-47131036-4656-48cd-b807-6a46cc71eb87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:24.000843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-47131036-4656-48cd-b807-6a46cc71eb87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:24.006167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-47131036-4656-48cd-b807-6a46cc71eb87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:24.006167 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-47131036-4656-48cd-b807-6a46cc71eb87 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1569 microversion: 2.25 time: 0.581478 Sep 06 10:53:24.015291 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 393/761] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:23 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1569 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:24.020139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e4bbbf62-2f7b-4f53-aecc-4eb72e892a81 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:24.049477 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e4bbbf62-2f7b-4f53-aecc-4eb72e892a81 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.032789 Sep 06 10:53:24.050172 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 394/762] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:53:24 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:24.060247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3d31ed67-6185-40e4-929f-0507efd31774 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:24.065228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d31ed67-6185-40e4-929f-0507efd31774 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:24.066511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d31ed67-6185-40e4-929f-0507efd31774 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:24.067555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d31ed67-6185-40e4-929f-0507efd31774 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:24.068674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d31ed67-6185-40e4-929f-0507efd31774 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:24.069561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d31ed67-6185-40e4-929f-0507efd31774 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:24.069700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d31ed67-6185-40e4-929f-0507efd31774 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:24.083777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cd664bd5-78ec-4aaa-b68c-2eee2eef0314 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:24.098055 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cd664bd5-78ec-4aaa-b68c-2eee2eef0314 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1463 microversion: 2.1 time: 0.399821 Sep 06 10:53:24.108828 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 369/763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:23 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1463 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:24.120285 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3d31ed67-6185-40e4-929f-0507efd31774 tempest-ServicesAdminTestJSON-1309838509 tempest-ServicesAdminTestJSON-1309838509-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.068783 Sep 06 10:53:24.127041 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 395/764] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:53:24 2022] GET /compute/v2.1/os-services => generated 947 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:24.127201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a1cf453b-6e00-4c91-842c-a967645bd223 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:24.127201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a1cf453b-6e00-4c91-842c-a967645bd223 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:24.135031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7e6dbe9-fb65-4cd9-919b-0199cf982d43 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:24.156129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1cf453b-6e00-4c91-842c-a967645bd223 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:24.156649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1cf453b-6e00-4c91-842c-a967645bd223 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:24.157213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1cf453b-6e00-4c91-842c-a967645bd223 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:24.157953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1cf453b-6e00-4c91-842c-a967645bd223 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:24.158421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1cf453b-6e00-4c91-842c-a967645bd223 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:24.158859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1cf453b-6e00-4c91-842c-a967645bd223 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:24.275071 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d7e6dbe9-fb65-4cd9-919b-0199cf982d43 tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/998844218" status: 202 len: 0 microversion: 2.1 time: 0.153013 Sep 06 10:53:24.275798 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 396/765] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:53:24 2022] DELETE /compute/v2.1/flavors/998844218 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:53:24.281516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1c0c2524-7992-4364-9350-ce980c4ce95b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:24.283409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1c0c2524-7992-4364-9350-ce980c4ce95b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:24.304767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c0c2524-7992-4364-9350-ce980c4ce95b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:24.306547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c0c2524-7992-4364-9350-ce980c4ce95b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:24.309034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c0c2524-7992-4364-9350-ce980c4ce95b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:24.315481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c0c2524-7992-4364-9350-ce980c4ce95b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:24.315481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c0c2524-7992-4364-9350-ce980c4ce95b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:24.315481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c0c2524-7992-4364-9350-ce980c4ce95b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:24.531053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a1cf453b-6e00-4c91-842c-a967645bd223 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:24.562422 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a1cf453b-6e00-4c91-842c-a967645bd223 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1504 microversion: 2.1 time: 0.451700 Sep 06 10:53:24.566432 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 370/766] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:24 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1504 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:24.587882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b956a2f3-b91e-4c3a-8b60-ae974567ebaf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:24.589876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b956a2f3-b91e-4c3a-8b60-ae974567ebaf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:24.620185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b956a2f3-b91e-4c3a-8b60-ae974567ebaf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:24.620185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b956a2f3-b91e-4c3a-8b60-ae974567ebaf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:24.620185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b956a2f3-b91e-4c3a-8b60-ae974567ebaf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:24.620185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b956a2f3-b91e-4c3a-8b60-ae974567ebaf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:24.626906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b956a2f3-b91e-4c3a-8b60-ae974567ebaf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:24.626906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b956a2f3-b91e-4c3a-8b60-ae974567ebaf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:25.294200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1c0c2524-7992-4364-9350-ce980c4ce95b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:25.312563 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1c0c2524-7992-4364-9350-ce980c4ce95b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1463 microversion: 2.1 time: 1.035630 Sep 06 10:53:25.313643 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 397/767] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:24 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1463 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:25.367559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-86643a48-b6b1-4b3a-9873-26eb8f2a6a5c tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:25.421449 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-86643a48-b6b1-4b3a-9873-26eb8f2a6a5c tempest-ServersWithSpecificFlavorTestJSON-1483357638 tempest-ServersWithSpecificFlavorTestJSON-1483357638-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.100016 Sep 06 10:53:25.422066 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 398/768] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:53:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:25.474043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2d26d61b-bfdc-454e-884e-f799435e74d0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:25.476837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2d26d61b-bfdc-454e-884e-f799435e74d0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:25.497323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d26d61b-bfdc-454e-884e-f799435e74d0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:25.499625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d26d61b-bfdc-454e-884e-f799435e74d0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:25.500105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d26d61b-bfdc-454e-884e-f799435e74d0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:25.502056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d26d61b-bfdc-454e-884e-f799435e74d0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:25.504730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d26d61b-bfdc-454e-884e-f799435e74d0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:25.505375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d26d61b-bfdc-454e-884e-f799435e74d0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:25.674702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2d26d61b-bfdc-454e-884e-f799435e74d0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:25.684203 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2d26d61b-bfdc-454e-884e-f799435e74d0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1266 microversion: 2.1 time: 0.247903 Sep 06 10:53:25.703764 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 399/769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:25 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:25.720670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-dced8cce-c365-4a43-8037-7a6a9718e8c8 req-b5e44e38-82c4-4853-901a-fbea994e6ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3270e900-2c13-43a0-9bb1-2a45ad779f85", "name": "network-vif-plugged", "status": "completed", "tag": "e70d14e6-709d-4b07-af6d-182402e5390a"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:25.749404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dced8cce-c365-4a43-8037-7a6a9718e8c8 req-b5e44e38-82c4-4853-901a-fbea994e6ff1 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:25.749907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dced8cce-c365-4a43-8037-7a6a9718e8c8 req-b5e44e38-82c4-4853-901a-fbea994e6ff1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:25.750352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dced8cce-c365-4a43-8037-7a6a9718e8c8 req-b5e44e38-82c4-4853-901a-fbea994e6ff1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:25.813160 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-dced8cce-c365-4a43-8037-7a6a9718e8c8 req-b5e44e38-82c4-4853-901a-fbea994e6ff1 service nova] Creating event network-vif-plugged:e70d14e6-709d-4b07-af6d-182402e5390a for instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 on nch2-master-1 Sep 06 10:53:25.832317 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-dced8cce-c365-4a43-8037-7a6a9718e8c8 req-b5e44e38-82c4-4853-901a-fbea994e6ff1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125768 Sep 06 10:53:25.834335 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 400/770] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:25.864935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3e0fd4e4-f18c-4665-82e0-7c495a21aa00 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:25.871349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3e0fd4e4-f18c-4665-82e0-7c495a21aa00 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:25.877317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b956a2f3-b91e-4c3a-8b60-ae974567ebaf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:25.900301 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b956a2f3-b91e-4c3a-8b60-ae974567ebaf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1323 microversion: 2.1 time: 1.326604 Sep 06 10:53:25.905271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0fd4e4-f18c-4665-82e0-7c495a21aa00 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:25.906137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0fd4e4-f18c-4665-82e0-7c495a21aa00 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:25.907322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0fd4e4-f18c-4665-82e0-7c495a21aa00 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:25.917405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0fd4e4-f18c-4665-82e0-7c495a21aa00 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:25.931455 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 371/771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:24 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1323 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:25.935242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0fd4e4-f18c-4665-82e0-7c495a21aa00 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:25.937851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0fd4e4-f18c-4665-82e0-7c495a21aa00 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:25.943604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-03362d8a-4460-4cc2-9fd4-57a27aaeac92 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:25.949805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-03362d8a-4460-4cc2-9fd4-57a27aaeac92 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:25.969586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03362d8a-4460-4cc2-9fd4-57a27aaeac92 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:25.970499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03362d8a-4460-4cc2-9fd4-57a27aaeac92 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:25.975082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03362d8a-4460-4cc2-9fd4-57a27aaeac92 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:25.976222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03362d8a-4460-4cc2-9fd4-57a27aaeac92 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:25.979801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03362d8a-4460-4cc2-9fd4-57a27aaeac92 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:25.980573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03362d8a-4460-4cc2-9fd4-57a27aaeac92 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:26.030503 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-03362d8a-4460-4cc2-9fd4-57a27aaeac92 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] HTTP exception thrown: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-03362d8a-4460-4cc2-9fd4-57a27aaeac92 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Request method failure captured: Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 HTTP/1.1 Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYEd5ToXN51s16qwaq94urY_pftQ_f5HIu5folisY0SThLaXd46KKdNEGhnIJkwu_Btr9Y3nwsO42Iosincaed8zT2LmZ14btytmLy4d3vdZIUnSMk6ekBhMwZujMjJRxdR6rAjldppJkd9Q71Z6tmqUd0VORRrTW5TpKjn9iCufVs Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:53:26.038947 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:53:26.040719 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2078a32d1694ba3b1393762add00729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2078a32d1694ba3b1393762add00729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}] Sep 06 10:53:26.040719 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:26.040719 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:26.040719 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:26.040719 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:26.040719 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:53:26.040719 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:53:26.040719 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6f59260019b34b0b8c4c8792afe8b317 Sep 06 10:53:26.040719 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:26.040719 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:53:26.040719 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:26.040719 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '9fb198d5-0fb1-4632-ae1f-dddec53a5ae9'} Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:53:26.041639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:26.043187 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:26.046587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-03362d8a-4460-4cc2-9fd4-57a27aaeac92 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Returning 404 to user: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:53:26.052249 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-03362d8a-4460-4cc2-9fd4-57a27aaeac92 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 404 len: 111 microversion: 2.1 time: 0.119261 Sep 06 10:53:26.058477 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 372/772] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:53:25 2022] DELETE /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:53:26.074820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-85ffe6ff-df03-4c71-8a8b-405513270486 req-c476e5c8-21ad-4ac9-97af-8c2339c4b7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11eb8c12-ec92-4302-a038-5c343138776c", "tag": "943d3511-f984-4e2d-9c92-94ae06bad6c8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:26.096065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-85ffe6ff-df03-4c71-8a8b-405513270486 req-c476e5c8-21ad-4ac9-97af-8c2339c4b7e6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:26.096871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-85ffe6ff-df03-4c71-8a8b-405513270486 req-c476e5c8-21ad-4ac9-97af-8c2339c4b7e6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:26.097468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-85ffe6ff-df03-4c71-8a8b-405513270486 req-c476e5c8-21ad-4ac9-97af-8c2339c4b7e6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:26.125181 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-85ffe6ff-df03-4c71-8a8b-405513270486 req-c476e5c8-21ad-4ac9-97af-8c2339c4b7e6 service nova] Creating event network-changed:943d3511-f984-4e2d-9c92-94ae06bad6c8 for instance 11eb8c12-ec92-4302-a038-5c343138776c on nch1-master-1 Sep 06 10:53:26.132349 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-85ffe6ff-df03-4c71-8a8b-405513270486 req-c476e5c8-21ad-4ac9-97af-8c2339c4b7e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074412 Sep 06 10:53:26.133660 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 373/773] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:26.143869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7dbf4396-93a2-413b-9afa-8d872bfc644c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:26.147144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7dbf4396-93a2-413b-9afa-8d872bfc644c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:26.170957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dbf4396-93a2-413b-9afa-8d872bfc644c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:26.171889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dbf4396-93a2-413b-9afa-8d872bfc644c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:26.172672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dbf4396-93a2-413b-9afa-8d872bfc644c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:26.174748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dbf4396-93a2-413b-9afa-8d872bfc644c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:26.175441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dbf4396-93a2-413b-9afa-8d872bfc644c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:26.176049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dbf4396-93a2-413b-9afa-8d872bfc644c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:26.947713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3e0fd4e4-f18c-4665-82e0-7c495a21aa00 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:26.970530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3e0fd4e4-f18c-4665-82e0-7c495a21aa00 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:26.973830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3e0fd4e4-f18c-4665-82e0-7c495a21aa00 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:26.978277 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3e0fd4e4-f18c-4665-82e0-7c495a21aa00 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1569 microversion: 2.25 time: 1.131855 Sep 06 10:53:26.982117 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 401/774] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:25 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1569 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:26.994434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-391819359", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "77dd8f1a-f2a3-463e-9129-1060fc467171"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:27.063716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7dbf4396-93a2-413b-9afa-8d872bfc644c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:27.082514 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7dbf4396-93a2-413b-9afa-8d872bfc644c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1504 microversion: 2.1 time: 0.940535 Sep 06 10:53:27.096303 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 374/775] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:26 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1504 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:27.101479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:53:27.117584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0e5d5a9c-6ed1-4fb3-ab2f-6f8aa7ff79c4 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:27.120968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0e5d5a9c-6ed1-4fb3-ab2f-6f8aa7ff79c4 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:27.132181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e5d5a9c-6ed1-4fb3-ab2f-6f8aa7ff79c4 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:27.135910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e5d5a9c-6ed1-4fb3-ab2f-6f8aa7ff79c4 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:27.137170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e5d5a9c-6ed1-4fb3-ab2f-6f8aa7ff79c4 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:27.139261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e5d5a9c-6ed1-4fb3-ab2f-6f8aa7ff79c4 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:27.140195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e5d5a9c-6ed1-4fb3-ab2f-6f8aa7ff79c4 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:27.142139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e5d5a9c-6ed1-4fb3-ab2f-6f8aa7ff79c4 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:27.179143 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-0e5d5a9c-6ed1-4fb3-ab2f-6f8aa7ff79c4 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] HTTP exception thrown: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0e5d5a9c-6ed1-4fb3-ab2f-6f8aa7ff79c4 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Request method failure captured: Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 HTTP/1.1 Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYEd5ToXN51s16qwaq94urY_pftQ_f5HIu5folisY0SThLaXd46KKdNEGhnIJkwu_Btr9Y3nwsO42Iosincaed8zT2LmZ14btytmLy4d3vdZIUnSMk6ekBhMwZujMjJRxdR6rAjldppJkd9Q71Z6tmqUd0VORRrTW5TpKjn9iCufVs Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:53:27.183332 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:53:27.184871 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2078a32d1694ba3b1393762add00729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2078a32d1694ba3b1393762add00729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}] Sep 06 10:53:27.184871 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:27.184871 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:27.184871 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:27.184871 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:27.184871 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:53:27.184871 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:53:27.184871 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6f59260019b34b0b8c4c8792afe8b317 Sep 06 10:53:27.184871 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:27.184871 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:53:27.184871 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:27.184871 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '9fb198d5-0fb1-4632-ae1f-dddec53a5ae9'} Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:53:27.185661 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. Sep 06 10:53:27.186985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:27.206245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0e5d5a9c-6ed1-4fb3-ab2f-6f8aa7ff79c4 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Returning 404 to user: Instance 9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:53:27.211292 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0e5d5a9c-6ed1-4fb3-ab2f-6f8aa7ff79c4 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9" status: 404 len: 111 microversion: 2.1 time: 0.109671 Sep 06 10:53:27.215664 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 375/776] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:27 2022] GET /compute/v2.1/servers/9fb198d5-0fb1-4632-ae1f-dddec53a5ae9 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:53:27.227897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6af60742-8fda-4f28-8ca3-108c2445c9e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:27.228447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6af60742-8fda-4f28-8ca3-108c2445c9e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:27.245758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6af60742-8fda-4f28-8ca3-108c2445c9e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:27.246261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6af60742-8fda-4f28-8ca3-108c2445c9e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:27.246711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6af60742-8fda-4f28-8ca3-108c2445c9e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:27.247464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6af60742-8fda-4f28-8ca3-108c2445c9e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:27.247928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6af60742-8fda-4f28-8ca3-108c2445c9e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:27.248364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6af60742-8fda-4f28-8ca3-108c2445c9e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:27.702654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6af60742-8fda-4f28-8ca3-108c2445c9e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:27.710714 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6af60742-8fda-4f28-8ca3-108c2445c9e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1308 microversion: 2.1 time: 0.495530 Sep 06 10:53:27.711418 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 376/777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:27 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1308 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:27.734580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2cd9312a-8215-4198-8a07-f05bd9864086 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:27.735618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2cd9312a-8215-4198-8a07-f05bd9864086 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:27.743274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cd9312a-8215-4198-8a07-f05bd9864086 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:27.743783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cd9312a-8215-4198-8a07-f05bd9864086 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:27.744229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cd9312a-8215-4198-8a07-f05bd9864086 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:27.745002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cd9312a-8215-4198-8a07-f05bd9864086 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:27.746082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cd9312a-8215-4198-8a07-f05bd9864086 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:27.746516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cd9312a-8215-4198-8a07-f05bd9864086 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:28.294273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:53:28.294867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:53:28.295748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:53:28.298970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:53:28.298970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:53:28.307245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:28.308356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:28.309043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:28.309861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:28.310432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:28.311060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:28.420373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2cd9312a-8215-4198-8a07-f05bd9864086 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:28.439663 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2cd9312a-8215-4198-8a07-f05bd9864086 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1323 microversion: 2.1 time: 0.717285 Sep 06 10:53:28.479885 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 377/778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:27 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1323 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:28.487425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Getting quotas for project 37509f3214ec4a83a0db84a1c5377690. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:53:28.494005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60b28712-1720-41c9-b29b-50abc392cacd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:28.494559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-60b28712-1720-41c9-b29b-50abc392cacd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:28.513094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b28712-1720-41c9-b29b-50abc392cacd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:28.513679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b28712-1720-41c9-b29b-50abc392cacd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:28.514135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b28712-1720-41c9-b29b-50abc392cacd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:28.517548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b28712-1720-41c9-b29b-50abc392cacd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:28.518437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b28712-1720-41c9-b29b-50abc392cacd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:28.519941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Getting quotas for user 42a1b77561bd4df3a751dea07b1c6cda and project 37509f3214ec4a83a0db84a1c5377690. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:53:28.521734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b28712-1720-41c9-b29b-50abc392cacd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:28.550309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:53:28.552832 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-60b28712-1720-41c9-b29b-50abc392cacd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] HTTP exception thrown: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60b28712-1720-41c9-b29b-50abc392cacd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Request method failure captured: Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de HTTP/1.1 Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYEd5ToXN51s16qwaq94urY_pftQ_f5HIu5folisY0SThLaXd46KKdNEGhnIJkwu_Btr9Y3nwsO42Iosincaed8zT2LmZ14btytmLy4d3vdZIUnSMk6ekBhMwZujMjJRxdR6rAjldppJkd9Q71Z6tmqUd0VORRrTW5TpKjn9iCufVs Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:53:28.554736 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:53:28.556504 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2078a32d1694ba3b1393762add00729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2078a32d1694ba3b1393762add00729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}] Sep 06 10:53:28.556504 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:28.556504 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:28.556504 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:28.556504 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:28.556504 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:53:28.556504 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:53:28.556504 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6f59260019b34b0b8c4c8792afe8b317 Sep 06 10:53:28.556504 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:28.556504 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:53:28.556504 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:28.556504 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '8f9007e9-46e7-420d-8c1d-dc40c1c212de'} Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:53:28.557364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:28.559281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:28.562175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:53:28.563169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60b28712-1720-41c9-b29b-50abc392cacd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Returning 404 to user: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:53:28.564315 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-60b28712-1720-41c9-b29b-50abc392cacd tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 404 len: 111 microversion: 2.1 time: 0.083341 Sep 06 10:53:28.569440 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 378/779] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:53:28 2022] DELETE /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:53:28.577209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-00ecf47b-79dd-46e6-a849-b5b5b83fb8f9 req-ac2edede-64b0-4eee-8ff6-8534257cfba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdba9b97-4ac9-425a-93bf-efc405463026", "tag": "c993e7ce-f4ac-4c50-8fae-67c9b2f4e028"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:28.585569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-00ecf47b-79dd-46e6-a849-b5b5b83fb8f9 req-ac2edede-64b0-4eee-8ff6-8534257cfba2 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:28.586412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-00ecf47b-79dd-46e6-a849-b5b5b83fb8f9 req-ac2edede-64b0-4eee-8ff6-8534257cfba2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:28.597104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-00ecf47b-79dd-46e6-a849-b5b5b83fb8f9 req-ac2edede-64b0-4eee-8ff6-8534257cfba2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:28.630344 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-00ecf47b-79dd-46e6-a849-b5b5b83fb8f9 req-ac2edede-64b0-4eee-8ff6-8534257cfba2 service nova] Creating event network-changed:c993e7ce-f4ac-4c50-8fae-67c9b2f4e028 for instance cdba9b97-4ac9-425a-93bf-efc405463026 on nch2-master-1 Sep 06 10:53:28.638226 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-00ecf47b-79dd-46e6-a849-b5b5b83fb8f9 req-ac2edede-64b0-4eee-8ff6-8534257cfba2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067147 Sep 06 10:53:28.645090 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 379/780] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:28.652023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fa98f7ae-fcb8-4e02-9f41-11340cb575a8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:28.653055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fa98f7ae-fcb8-4e02-9f41-11340cb575a8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:28.661582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa98f7ae-fcb8-4e02-9f41-11340cb575a8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:28.662622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa98f7ae-fcb8-4e02-9f41-11340cb575a8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:28.663308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa98f7ae-fcb8-4e02-9f41-11340cb575a8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:28.669234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa98f7ae-fcb8-4e02-9f41-11340cb575a8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:28.669234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa98f7ae-fcb8-4e02-9f41-11340cb575a8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:28.669234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa98f7ae-fcb8-4e02-9f41-11340cb575a8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:28.804106 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-80446138-9c83-4dd1-b2af-ae7628446be1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.819487 Sep 06 10:53:28.811156 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 402/781] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:53:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:53:28.818739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9cb80b79-0988-42f1-87e4-a45d9adbe6f1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:28.818739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9cb80b79-0988-42f1-87e4-a45d9adbe6f1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:28.836013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cb80b79-0988-42f1-87e4-a45d9adbe6f1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:28.836013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cb80b79-0988-42f1-87e4-a45d9adbe6f1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:28.836421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cb80b79-0988-42f1-87e4-a45d9adbe6f1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:28.837030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cb80b79-0988-42f1-87e4-a45d9adbe6f1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:28.839046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cb80b79-0988-42f1-87e4-a45d9adbe6f1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:28.839490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cb80b79-0988-42f1-87e4-a45d9adbe6f1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:28.931341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fa98f7ae-fcb8-4e02-9f41-11340cb575a8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:28.946179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fa98f7ae-fcb8-4e02-9f41-11340cb575a8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:28.950009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fa98f7ae-fcb8-4e02-9f41-11340cb575a8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:28.951269 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fa98f7ae-fcb8-4e02-9f41-11340cb575a8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1569 microversion: 2.25 time: 0.304686 Sep 06 10:53:28.976746 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 380/782] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:28 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1569 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:28.981710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a8afeff3-0bc1-485d-9169-005a0e4391b0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:28.982337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a8afeff3-0bc1-485d-9169-005a0e4391b0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] [instance: 8f9007e9-46e7-420d-8c1d-dc40c1c212de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:29.000261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8afeff3-0bc1-485d-9169-005a0e4391b0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:29.009085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8afeff3-0bc1-485d-9169-005a0e4391b0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:29.012562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8afeff3-0bc1-485d-9169-005a0e4391b0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:29.012562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8afeff3-0bc1-485d-9169-005a0e4391b0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:29.012562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8afeff3-0bc1-485d-9169-005a0e4391b0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:29.012562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8afeff3-0bc1-485d-9169-005a0e4391b0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:29.246996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9cb80b79-0988-42f1-87e4-a45d9adbe6f1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:29.269641 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9cb80b79-0988-42f1-87e4-a45d9adbe6f1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1504 microversion: 2.1 time: 0.463791 Sep 06 10:53:29.275258 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 403/783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:28 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:29.286321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c39c992f-b68d-4ff7-ae52-bafc3670e2a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:29.296610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c39c992f-b68d-4ff7-ae52-bafc3670e2a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:29.314270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c39c992f-b68d-4ff7-ae52-bafc3670e2a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:29.321064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c39c992f-b68d-4ff7-ae52-bafc3670e2a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:29.321805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c39c992f-b68d-4ff7-ae52-bafc3670e2a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:29.322764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c39c992f-b68d-4ff7-ae52-bafc3670e2a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:29.323453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c39c992f-b68d-4ff7-ae52-bafc3670e2a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:29.324165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c39c992f-b68d-4ff7-ae52-bafc3670e2a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:29.351983 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-a8afeff3-0bc1-485d-9169-005a0e4391b0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] HTTP exception thrown: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a8afeff3-0bc1-485d-9169-005a0e4391b0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Request method failure captured: Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de HTTP/1.1 Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyYEd5ToXN51s16qwaq94urY_pftQ_f5HIu5folisY0SThLaXd46KKdNEGhnIJkwu_Btr9Y3nwsO42Iosincaed8zT2LmZ14btytmLy4d3vdZIUnSMk6ekBhMwZujMjJRxdR6rAjldppJkd9Q71Z6tmqUd0VORRrTW5TpKjn9iCufVs Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:53:29.355232 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:53:29.356596 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2078a32d1694ba3b1393762add00729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2078a32d1694ba3b1393762add00729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2078a32d1694ba3b1393762add00729"}]}] Sep 06 10:53:29.356596 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:29.356596 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: c2078a32d1694ba3b1393762add00729 Sep 06 10:53:29.356596 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718 Sep 06 10:53:29.356596 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:29.356596 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:53:29.356596 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:53:29.356596 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6f59260019b34b0b8c4c8792afe8b317 Sep 06 10:53:29.356596 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-678264718-project Sep 06 10:53:29.356596 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:53:29.356596 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:29.356596 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '8f9007e9-46e7-420d-8c1d-dc40c1c212de'} Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:53:29.357337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. Sep 06 10:53:29.358626 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:53:29.359723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a8afeff3-0bc1-485d-9169-005a0e4391b0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] Returning 404 to user: Instance 8f9007e9-46e7-420d-8c1d-dc40c1c212de could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:53:29.359723 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a8afeff3-0bc1-485d-9169-005a0e4391b0 tempest-ServersWithSpecificFlavorTestJSON-678264718 tempest-ServersWithSpecificFlavorTestJSON-678264718-project] 10.222.0.20 "GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de" status: 404 len: 111 microversion: 2.1 time: 0.378894 Sep 06 10:53:29.361511 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 381/784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:28 2022] GET /compute/v2.1/servers/8f9007e9-46e7-420d-8c1d-dc40c1c212de => generated 111 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:53:29.376544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:29.385221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-12ba843b-acdf-4748-9feb-9668e723e492 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:29.386439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-12ba843b-acdf-4748-9feb-9668e723e492 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:29.560516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-12ba843b-acdf-4748-9feb-9668e723e492 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:29.571720 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-12ba843b-acdf-4748-9feb-9668e723e492 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1213 microversion: 2.1 time: 0.209056 Sep 06 10:53:29.589853 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 382/785] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:29 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1213 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:29.607493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cc3d21c0-622e-4041-861e-2a2c1499c0ff tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:29.608518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cc3d21c0-622e-4041-861e-2a2c1499c0ff tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:29.622207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc3d21c0-622e-4041-861e-2a2c1499c0ff tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:29.622987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc3d21c0-622e-4041-861e-2a2c1499c0ff tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:29.623453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc3d21c0-622e-4041-861e-2a2c1499c0ff tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:29.625443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc3d21c0-622e-4041-861e-2a2c1499c0ff tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:29.627676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc3d21c0-622e-4041-861e-2a2c1499c0ff tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:29.628875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc3d21c0-622e-4041-861e-2a2c1499c0ff tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:29.637585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:29.760430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c39c992f-b68d-4ff7-ae52-bafc3670e2a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:29.773596 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c39c992f-b68d-4ff7-ae52-bafc3670e2a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1308 microversion: 2.1 time: 0.499730 Sep 06 10:53:29.775953 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 404/786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:29 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1308 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:29.874163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cc3d21c0-622e-4041-861e-2a2c1499c0ff tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:29.883362 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cc3d21c0-622e-4041-861e-2a2c1499c0ff tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1518 microversion: 2.1 time: 0.291876 Sep 06 10:53:29.891060 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 383/787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:29 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1518 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:29.927913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7679d5ef-d557-4b2e-86e7-b40a4be63dce tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:29.928747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7679d5ef-d557-4b2e-86e7-b40a4be63dce tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:29.936159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7679d5ef-d557-4b2e-86e7-b40a4be63dce tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:29.937576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7679d5ef-d557-4b2e-86e7-b40a4be63dce tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:29.937576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7679d5ef-d557-4b2e-86e7-b40a4be63dce tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:29.938388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7679d5ef-d557-4b2e-86e7-b40a4be63dce tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:29.939059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7679d5ef-d557-4b2e-86e7-b40a4be63dce tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:29.939705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7679d5ef-d557-4b2e-86e7-b40a4be63dce tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:29.986852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60b2cb4a-2134-436b-86ba-54bd3f07a693 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:29.987989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-60b2cb4a-2134-436b-86ba-54bd3f07a693 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:29.997407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b2cb4a-2134-436b-86ba-54bd3f07a693 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:29.998382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b2cb4a-2134-436b-86ba-54bd3f07a693 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:29.999094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b2cb4a-2134-436b-86ba-54bd3f07a693 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:30.000203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b2cb4a-2134-436b-86ba-54bd3f07a693 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:30.000910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b2cb4a-2134-436b-86ba-54bd3f07a693 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:30.001908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b2cb4a-2134-436b-86ba-54bd3f07a693 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:30.428397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-60b2cb4a-2134-436b-86ba-54bd3f07a693 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:30.439605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-60b2cb4a-2134-436b-86ba-54bd3f07a693 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:30.442113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-60b2cb4a-2134-436b-86ba-54bd3f07a693 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:30.444492 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-60b2cb4a-2134-436b-86ba-54bd3f07a693 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1569 microversion: 2.25 time: 0.464071 Sep 06 10:53:30.450103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7679d5ef-d557-4b2e-86e7-b40a4be63dce tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:30.461961 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7679d5ef-d557-4b2e-86e7-b40a4be63dce tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1518 microversion: 2.1 time: 0.538026 Sep 06 10:53:30.471197 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 384/788] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:29 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1569 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:30.478002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-14be6279-8797-426c-bb48-cb2876b66a66 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:30.481307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-14be6279-8797-426c-bb48-cb2876b66a66 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:30.488181 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 405/789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:29 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1518 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:30.497020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14be6279-8797-426c-bb48-cb2876b66a66 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:30.498074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14be6279-8797-426c-bb48-cb2876b66a66 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:30.498748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14be6279-8797-426c-bb48-cb2876b66a66 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:30.500235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14be6279-8797-426c-bb48-cb2876b66a66 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:30.500913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14be6279-8797-426c-bb48-cb2876b66a66 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:30.501874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14be6279-8797-426c-bb48-cb2876b66a66 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:30.516494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-61676b6c-37d2-4a5c-9816-ad4c02eb430f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1453344163"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:30.519591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-61676b6c-37d2-4a5c-9816-ad4c02eb430f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:30.533176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61676b6c-37d2-4a5c-9816-ad4c02eb430f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:30.533176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61676b6c-37d2-4a5c-9816-ad4c02eb430f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:30.533176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61676b6c-37d2-4a5c-9816-ad4c02eb430f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:30.533176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61676b6c-37d2-4a5c-9816-ad4c02eb430f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:30.533646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61676b6c-37d2-4a5c-9816-ad4c02eb430f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:30.533646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61676b6c-37d2-4a5c-9816-ad4c02eb430f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:30.900577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-14be6279-8797-426c-bb48-cb2876b66a66 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:30.912665 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-14be6279-8797-426c-bb48-cb2876b66a66 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1504 microversion: 2.1 time: 0.439976 Sep 06 10:53:30.914986 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 385/790] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:30 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:30.929243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-86b91b8e-e4a7-4e52-933f-a32364becf41 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:30.931837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-86b91b8e-e4a7-4e52-933f-a32364becf41 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:30.950362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86b91b8e-e4a7-4e52-933f-a32364becf41 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:30.955208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86b91b8e-e4a7-4e52-933f-a32364becf41 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:30.955208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86b91b8e-e4a7-4e52-933f-a32364becf41 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:30.955208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86b91b8e-e4a7-4e52-933f-a32364becf41 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:30.955769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86b91b8e-e4a7-4e52-933f-a32364becf41 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:30.956472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86b91b8e-e4a7-4e52-933f-a32364becf41 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:31.231213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-86b91b8e-e4a7-4e52-933f-a32364becf41 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:31.239815 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-86b91b8e-e4a7-4e52-933f-a32364becf41 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1209 microversion: 2.1 time: 0.323155 Sep 06 10:53:31.241025 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 386/791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:30 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1209 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:31.253468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6ecb4956-9a9a-4cf1-8caa-c57e133d2542 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:31.254349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6ecb4956-9a9a-4cf1-8caa-c57e133d2542 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:31.270168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ecb4956-9a9a-4cf1-8caa-c57e133d2542 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:31.274660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ecb4956-9a9a-4cf1-8caa-c57e133d2542 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:31.280041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ecb4956-9a9a-4cf1-8caa-c57e133d2542 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:31.280476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ecb4956-9a9a-4cf1-8caa-c57e133d2542 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:31.284349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ecb4956-9a9a-4cf1-8caa-c57e133d2542 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:31.285359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ecb4956-9a9a-4cf1-8caa-c57e133d2542 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:31.377925 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-61676b6c-37d2-4a5c-9816-ad4c02eb430f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "POST /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85/action" status: 202 len: 0 microversion: 2.1 time: 0.881900 Sep 06 10:53:31.384476 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 406/792] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:53:30 2022] POST /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85/action => generated 0 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 06 10:53:31.406445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-799f1492-4858-4933-a1b9-a7d8e9f55c11 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '.version_select at 0x7f90f8913a60>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:31.828749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6ecb4956-9a9a-4cf1-8caa-c57e133d2542 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:31.840371 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6ecb4956-9a9a-4cf1-8caa-c57e133d2542 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1308 microversion: 2.1 time: 0.597708 Sep 06 10:53:31.842836 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 387/793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:31 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1308 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:31.852775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bd1fb9c5-e371-4542-80a2-e727a5f7a257 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:31.855824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bd1fb9c5-e371-4542-80a2-e727a5f7a257 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:31.887164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd1fb9c5-e371-4542-80a2-e727a5f7a257 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:31.887806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd1fb9c5-e371-4542-80a2-e727a5f7a257 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:31.887917 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-799f1492-4858-4933-a1b9-a7d8e9f55c11 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "DELETE /compute/v2.1/images/60cd360d-a66d-4b2d-8f8f-3d13a2f293f6" status: 204 len: 0 microversion: 2.1 time: 0.494879 Sep 06 10:53:31.888300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd1fb9c5-e371-4542-80a2-e727a5f7a257 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:31.891060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd1fb9c5-e371-4542-80a2-e727a5f7a257 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:31.891346 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 407/794] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:31 2022] DELETE /compute/v2.1/images/60cd360d-a66d-4b2d-8f8f-3d13a2f293f6 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:53:31.891444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd1fb9c5-e371-4542-80a2-e727a5f7a257 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:31.892360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd1fb9c5-e371-4542-80a2-e727a5f7a257 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:31.898051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dc857cd8-36cc-4b39-9086-d65641d0cfcc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '.version_select at 0x7f90f8921ca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:31.938062 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-dc857cd8-36cc-4b39-9086-d65641d0cfcc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] HTTP exception thrown: Image not found. Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dc857cd8-36cc-4b39-9086-d65641d0cfcc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/images/60cd360d-a66d-4b2d-8f8f-3d13a2f293f6 HTTP/1.1 Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:53:31.942406 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:53:31.943831 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:53:31.943831 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:53:31.943831 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:53:31.943831 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:53:31.943831 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:53:31.943831 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:53:31.943831 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:53:31.943831 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:53:31.943831 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:53:31.943831 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:53:31.943831 ncdv-master-1 devstack@n-api.service[140876]: exception: Image not found. Sep 06 10:53:31.943831 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '60cd360d-a66d-4b2d-8f8f-3d13a2f293f6'} Sep 06 10:53:31.943831 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:53:31.944651 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 60cd360d-a66d-4b2d-8f8f-3d13a2f293f6 Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:53:31.945802 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60cd360d-a66d-4b2d-8f8f-3d13a2f293f6 could not be found. Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:53:31.947112 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:53:31.948843 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:31.952404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dc857cd8-36cc-4b39-9086-d65641d0cfcc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 404 to user: Image not found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:53:31.953341 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dc857cd8-36cc-4b39-9086-d65641d0cfcc tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/images/60cd360d-a66d-4b2d-8f8f-3d13a2f293f6" status: 404 len: 62 microversion: 2.1 time: 0.059279 Sep 06 10:53:31.957019 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 408/795] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:31 2022] GET /compute/v2.1/images/60cd360d-a66d-4b2d-8f8f-3d13a2f293f6 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:53:31.964540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9738d2ac-c56a-45d9-b2e7-6581c22569d0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:31.964540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9738d2ac-c56a-45d9-b2e7-6581c22569d0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:31.977243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:31.979340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9738d2ac-c56a-45d9-b2e7-6581c22569d0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:31.979853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9738d2ac-c56a-45d9-b2e7-6581c22569d0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:31.980306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9738d2ac-c56a-45d9-b2e7-6581c22569d0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:31.981189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9738d2ac-c56a-45d9-b2e7-6581c22569d0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:31.981951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9738d2ac-c56a-45d9-b2e7-6581c22569d0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:31.982394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9738d2ac-c56a-45d9-b2e7-6581c22569d0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:32.413089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9738d2ac-c56a-45d9-b2e7-6581c22569d0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:32.430532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bd1fb9c5-e371-4542-80a2-e727a5f7a257 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:32.431736 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9738d2ac-c56a-45d9-b2e7-6581c22569d0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1504 microversion: 2.1 time: 0.475690 Sep 06 10:53:32.433181 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 409/796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:31 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:32.442969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f1ffc20-cd0c-40df-a00f-259b12e42dd3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:32.443658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bd1fb9c5-e371-4542-80a2-e727a5f7a257 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:32.445651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bd1fb9c5-e371-4542-80a2-e727a5f7a257 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:32.445939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4f1ffc20-cd0c-40df-a00f-259b12e42dd3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:32.449961 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bd1fb9c5-e371-4542-80a2-e727a5f7a257 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1544 microversion: 2.25 time: 0.605680 Sep 06 10:53:32.450543 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 388/797] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:31 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1544 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:32.481688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1774670b-fd30-4ef7-b88d-923ff2056340 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:32.481688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1774670b-fd30-4ef7-b88d-923ff2056340 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:32.496826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1774670b-fd30-4ef7-b88d-923ff2056340 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:32.500949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1774670b-fd30-4ef7-b88d-923ff2056340 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:32.518776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1774670b-fd30-4ef7-b88d-923ff2056340 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:32.518776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1774670b-fd30-4ef7-b88d-923ff2056340 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:32.518776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1774670b-fd30-4ef7-b88d-923ff2056340 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:32.518776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1774670b-fd30-4ef7-b88d-923ff2056340 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:32.526947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f1ffc20-cd0c-40df-a00f-259b12e42dd3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:32.527462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f1ffc20-cd0c-40df-a00f-259b12e42dd3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:32.527925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f1ffc20-cd0c-40df-a00f-259b12e42dd3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:32.537421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f1ffc20-cd0c-40df-a00f-259b12e42dd3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:32.537939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f1ffc20-cd0c-40df-a00f-259b12e42dd3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:32.541311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f1ffc20-cd0c-40df-a00f-259b12e42dd3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:32.707378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1774670b-fd30-4ef7-b88d-923ff2056340 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:32.719813 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1774670b-fd30-4ef7-b88d-923ff2056340 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1273 microversion: 2.1 time: 0.246814 Sep 06 10:53:32.732472 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 389/798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:32 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1273 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:32.754401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cd25ea6f-3290-4a3d-aa77-4ae0ae9a1d6e tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '.version_select at 0x7f90f8c7e430>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:32.759255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd25ea6f-3290-4a3d-aa77-4ae0ae9a1d6e tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:32.760420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd25ea6f-3290-4a3d-aa77-4ae0ae9a1d6e tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:32.762837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd25ea6f-3290-4a3d-aa77-4ae0ae9a1d6e tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:32.788321 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cd25ea6f-3290-4a3d-aa77-4ae0ae9a1d6e tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2184 microversion: 2.25 time: 0.053790 Sep 06 10:53:32.798436 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 390/799] 10.222.0.20 () {60 vars in 1184 bytes} [Tue Sep 6 10:53:32 2022] GET /compute/v2.1/os-migrations => generated 2184 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:32.826397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cf393aad-d00d-4110-be58-7b7dbbaa6ef8 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:32.827849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cf393aad-d00d-4110-be58-7b7dbbaa6ef8 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:32.839692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf393aad-d00d-4110-be58-7b7dbbaa6ef8 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:32.840605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf393aad-d00d-4110-be58-7b7dbbaa6ef8 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:32.841960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf393aad-d00d-4110-be58-7b7dbbaa6ef8 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:32.844751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf393aad-d00d-4110-be58-7b7dbbaa6ef8 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:32.848195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf393aad-d00d-4110-be58-7b7dbbaa6ef8 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:32.849233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf393aad-d00d-4110-be58-7b7dbbaa6ef8 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:33.297084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4f1ffc20-cd0c-40df-a00f-259b12e42dd3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:33.309335 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4f1ffc20-cd0c-40df-a00f-259b12e42dd3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1530 microversion: 2.1 time: 0.874731 Sep 06 10:53:33.315977 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 410/800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:32 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1530 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:33.335092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-90bd926b-4568-4fed-a716-b473f74f2d14 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:33.337045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-90bd926b-4568-4fed-a716-b473f74f2d14 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:33.358657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90bd926b-4568-4fed-a716-b473f74f2d14 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:33.361055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90bd926b-4568-4fed-a716-b473f74f2d14 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:33.362103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90bd926b-4568-4fed-a716-b473f74f2d14 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:33.364484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90bd926b-4568-4fed-a716-b473f74f2d14 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:33.376537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90bd926b-4568-4fed-a716-b473f74f2d14 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:33.376537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90bd926b-4568-4fed-a716-b473f74f2d14 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:33.490582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-cf393aad-d00d-4110-be58-7b7dbbaa6ef8 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid 239473a8-8554-4c9d-a566-b76c75336087 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:53:33.511918 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cf393aad-d00d-4110-be58-7b7dbbaa6ef8 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 2037 microversion: 2.25 time: 0.694166 Sep 06 10:53:33.513663 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 391/801] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:32 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 2037 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:53:33.589466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:33.716898 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-707a9669-60be-41d4-9054-0b0ffe9ee23d tempest-TenantUsagesNegativeTestJSON-1606899669 tempest-TenantUsagesNegativeTestJSON-1606899669-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-05T10%3A53%3A33.368994&end=2022-09-07T10%3A53%3A33.368994" status: 404 len: 112 microversion: - time: 0.189553 Sep 06 10:53:33.717581 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 392/802] 10.222.0.20 () {58 vars in 1316 bytes} [Tue Sep 6 10:53:33 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-05T10%3A53%3A33.368994&end=2022-09-07T10%3A53%3A33.368994 => generated 112 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 10:53:33.722617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bf9fa753-222a-436a-aacc-c8dd550e42b9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:33.723566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bf9fa753-222a-436a-aacc-c8dd550e42b9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:33.732596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf9fa753-222a-436a-aacc-c8dd550e42b9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:33.733387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf9fa753-222a-436a-aacc-c8dd550e42b9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:33.734681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf9fa753-222a-436a-aacc-c8dd550e42b9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:33.735492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf9fa753-222a-436a-aacc-c8dd550e42b9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:33.736437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf9fa753-222a-436a-aacc-c8dd550e42b9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:33.737264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf9fa753-222a-436a-aacc-c8dd550e42b9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:33.953610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-90bd926b-4568-4fed-a716-b473f74f2d14 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:33.970015 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-90bd926b-4568-4fed-a716-b473f74f2d14 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1308 microversion: 2.1 time: 0.639740 Sep 06 10:53:33.982506 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 411/803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:33 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1308 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:34.006408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bc3215c1-1cd2-4714-ab02-ed10e4b8278f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Action: 'create', calling method: .version_select at 0x7f90f8a2adc0>, body: {"keypair": {"name": "tempest-keypair-1470633700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB7+SQsGWzNVKo61O/NCjSj8a1SVU/Sli+qQxP8MjrWw0fAMQeTFq3xr9OH/WXXu82tGYi3oN5RiwhiWl6L8xgD3LDeHcciwokOEh1fDWOj2ow4G8+W/ZN8I6ZnvPkMyw=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:34.068942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-bc3215c1-1cd2-4714-ab02-ed10e4b8278f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Getting quotas for project 437799e22df2433a83eca67987e942c6. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:53:34.092099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-bc3215c1-1cd2-4714-ab02-ed10e4b8278f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Getting quotas for user d9f88a4c72854cff9bba7ed2920f55b0 and project 437799e22df2433a83eca67987e942c6. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:53:34.209509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bf9fa753-222a-436a-aacc-c8dd550e42b9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:34.212185 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bc3215c1-1cd2-4714-ab02-ed10e4b8278f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.227240 Sep 06 10:53:34.215504 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 412/804] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Sep 6 10:53:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 232 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 10:53:34.226910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ddf145bd-fb13-48e9-b289-2324d6b9ad4e tempest-TenantUsagesNegativeTestJSON-1606899669 tempest-TenantUsagesNegativeTestJSON-1606899669-project-admin] Calling method '.version_select at 0x7f90f893d040>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:34.233804 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-ddf145bd-fb13-48e9-b289-2324d6b9ad4e tempest-TenantUsagesNegativeTestJSON-1606899669 tempest-TenantUsagesNegativeTestJSON-1606899669-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 06 10:53:34.235760 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bf9fa753-222a-436a-aacc-c8dd550e42b9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1504 microversion: 2.1 time: 0.517112 Sep 06 10:53:34.236889 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 393/805] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:33 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1504 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ddf145bd-fb13-48e9-b289-2324d6b9ad4e tempest-TenantUsagesNegativeTestJSON-1606899669 tempest-TenantUsagesNegativeTestJSON-1606899669-project-admin] Request method failure captured: Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-simple-tenant-usage/8e366a81621942378f03c2206baa8030?start=2022-09-07T10%3A53%3A33.368994&end=2022-09-05T10%3A53%3A33.368994 HTTP/1.1 Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyattfxN-tKTKlvlrU-ILoAjjY7LclCfh1D1jAQLAOEBygdMRq1y8H3mBMuYZ_wqstmgx0PeTUd0kX2OGQwhttgpGIkgiomIPfu1at98qvZgcN85qhKlPJ79zVdRA5XpN6Cm6gsAPA4dxzRHGi37zzYnV_aMSQERnvlGyM6wPPyc9Mg Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2268f96cc3de417d957e145fc0dfb0fa Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1606899669 Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 10:53:34.245364 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 10:53:34.247773 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2268f96cc3de417d957e145fc0dfb0fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2268f96cc3de417d957e145fc0dfb0fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2268f96cc3de417d957e145fc0dfb0fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2268f96cc3de417d957e145fc0dfb0fa"}]}] Sep 06 10:53:34.247773 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1606899669 Sep 06 10:53:34.247773 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2268f96cc3de417d957e145fc0dfb0fa Sep 06 10:53:34.247773 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1606899669 Sep 06 10:53:34.247773 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TenantUsagesNegativeTestJSON-1606899669-project-admin Sep 06 10:53:34.247773 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:53:34.247773 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:53:34.247773 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: f88a466a769b4c718c6c352b92d116ee Sep 06 10:53:34.247773 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1606899669-project-admin Sep 06 10:53:34.247773 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:53:34.247773 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid start time. The start time cannot occur after the end time. Sep 06 10:53:34.247773 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '8e366a81621942378f03c2206baa8030'} Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 06 10:53:34.248571 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 06 10:53:34.249742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:34.249742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:34.249742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:34.249742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:34.249742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:34.249742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:34.249742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:53:34.249742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:53:34.249742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 06 10:53:34.249742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:34.253512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9129680f-2ee4-425d-b6ec-f419fa6c1e14 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:34.253994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ddf145bd-fb13-48e9-b289-2324d6b9ad4e tempest-TenantUsagesNegativeTestJSON-1606899669 tempest-TenantUsagesNegativeTestJSON-1606899669-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:53:34.255233 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ddf145bd-fb13-48e9-b289-2324d6b9ad4e tempest-TenantUsagesNegativeTestJSON-1606899669 tempest-TenantUsagesNegativeTestJSON-1606899669-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/8e366a81621942378f03c2206baa8030?start=2022-09-07T10%3A53%3A33.368994&end=2022-09-05T10%3A53%3A33.368994" status: 400 len: 111 microversion: 2.1 time: 0.037732 Sep 06 10:53:34.256110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9129680f-2ee4-425d-b6ec-f419fa6c1e14 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:34.259737 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 413/806] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Sep 6 10:53:34 2022] GET /compute/v2.1/os-simple-tenant-usage/8e366a81621942378f03c2206baa8030?start=2022-09-07T10%3A53%3A33.368994&end=2022-09-05T10%3A53%3A33.368994 => generated 111 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:53:34.278200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9129680f-2ee4-425d-b6ec-f419fa6c1e14 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:34.281211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9129680f-2ee4-425d-b6ec-f419fa6c1e14 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:34.283049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9129680f-2ee4-425d-b6ec-f419fa6c1e14 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:34.284595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9129680f-2ee4-425d-b6ec-f419fa6c1e14 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:34.285092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9129680f-2ee4-425d-b6ec-f419fa6c1e14 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:34.285537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9129680f-2ee4-425d-b6ec-f419fa6c1e14 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:34.493822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9129680f-2ee4-425d-b6ec-f419fa6c1e14 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:34.513219 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9129680f-2ee4-425d-b6ec-f419fa6c1e14 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1271 microversion: 2.1 time: 0.275079 Sep 06 10:53:34.517003 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 394/807] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:34 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:34.548644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4ce93079-6197-47a6-a84f-7772b54e2bdf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:34.549397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4ce93079-6197-47a6-a84f-7772b54e2bdf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:34.561483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a51e4926-58c6-41e0-a46b-edd20ce0791c tempest-TenantUsagesNegativeTestJSON-1023263006 tempest-TenantUsagesNegativeTestJSON-1023263006-project] Calling method '.version_select at 0x7f90f88c5670>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:34.564436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ce93079-6197-47a6-a84f-7772b54e2bdf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:34.564942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ce93079-6197-47a6-a84f-7772b54e2bdf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:34.565389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ce93079-6197-47a6-a84f-7772b54e2bdf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:34.566114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ce93079-6197-47a6-a84f-7772b54e2bdf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:34.568649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a51e4926-58c6-41e0-a46b-edd20ce0791c tempest-TenantUsagesNegativeTestJSON-1023263006 tempest-TenantUsagesNegativeTestJSON-1023263006-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '16536d4ce7d249d9867a342d4f5ffd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e366a81621942378f03c2206baa8030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:34.571819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ce93079-6197-47a6-a84f-7772b54e2bdf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:34.572307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ce93079-6197-47a6-a84f-7772b54e2bdf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a51e4926-58c6-41e0-a46b-edd20ce0791c tempest-TenantUsagesNegativeTestJSON-1023263006 tempest-TenantUsagesNegativeTestJSON-1023263006-project] Request method failure captured: Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-05T10%3A53%3A33.368994&end=2022-09-07T10%3A53%3A33.368994&detailed=1 HTTP/1.1 Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyarDBcTXeb2r5eRskt93xvfYgnX5NMz-xVUddXUR267kyY2XButOSfoiCuzNAkFCgFOgoEeozcfD1NOhNX5u5mEOdrHUF4Z1ov6mgRlpm9V4gPFzgQ9RtM1xHzRbuLulGcrfa_Sr884MQYFZ2qll4Pj7-IEOqN4slpaFKttE156hP4 Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 8e366a81621942378f03c2206baa8030 Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1023263006 Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:53:34.574355 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:53:34.575947 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8e366a81621942378f03c2206baa8030"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8e366a81621942378f03c2206baa8030"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8e366a81621942378f03c2206baa8030"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8e366a81621942378f03c2206baa8030"}]}] Sep 06 10:53:34.575947 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1023263006 Sep 06 10:53:34.575947 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 8e366a81621942378f03c2206baa8030 Sep 06 10:53:34.575947 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1023263006 Sep 06 10:53:34.575947 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TenantUsagesNegativeTestJSON-1023263006-project Sep 06 10:53:34.575947 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:53:34.575947 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:53:34.575947 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 16536d4ce7d249d9867a342d4f5ffd59 Sep 06 10:53:34.575947 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1023263006-project Sep 06 10:53:34.575947 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:53:34.575947 ncdv-master-1 devstack@n-api.service[140876]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 06 10:53:34.575947 ncdv-master-1 devstack@n-api.service[140876]: action_args: {} Sep 06 10:53:34.575947 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 10:53:34.576957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 10:53:34.578401 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 10:53:34.579906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 06 10:53:34.579906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:34.583519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a51e4926-58c6-41e0-a46b-edd20ce0791c tempest-TenantUsagesNegativeTestJSON-1023263006 tempest-TenantUsagesNegativeTestJSON-1023263006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:53:34.584766 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a51e4926-58c6-41e0-a46b-edd20ce0791c tempest-TenantUsagesNegativeTestJSON-1023263006 tempest-TenantUsagesNegativeTestJSON-1023263006-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-05T10%3A53%3A33.368994&end=2022-09-07T10%3A53%3A33.368994&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.317659 Sep 06 10:53:34.587320 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 414/808] 10.222.0.20 () {58 vars in 1335 bytes} [Tue Sep 6 10:53:34 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-05T10%3A53%3A33.368994&end=2022-09-07T10%3A53%3A33.368994&detailed=1 => generated 123 bytes in 321 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:53:34.904579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4ce93079-6197-47a6-a84f-7772b54e2bdf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:34.918431 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4ce93079-6197-47a6-a84f-7772b54e2bdf tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1536 microversion: 2.1 time: 0.399460 Sep 06 10:53:34.919042 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 395/809] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:34 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1536 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:35.003260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8a52dee4-3e96-412a-bdb3-74889b8f83e1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:35.004823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8a52dee4-3e96-412a-bdb3-74889b8f83e1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:35.024466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a52dee4-3e96-412a-bdb3-74889b8f83e1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:35.027536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a52dee4-3e96-412a-bdb3-74889b8f83e1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:35.031227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a52dee4-3e96-412a-bdb3-74889b8f83e1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:35.031227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a52dee4-3e96-412a-bdb3-74889b8f83e1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:35.031227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a52dee4-3e96-412a-bdb3-74889b8f83e1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:35.031227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a52dee4-3e96-412a-bdb3-74889b8f83e1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:35.271063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1087a3d5-49d3-41a0-8029-86853fd1a93b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:35.272055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1087a3d5-49d3-41a0-8029-86853fd1a93b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:35.285455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1087a3d5-49d3-41a0-8029-86853fd1a93b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:35.290646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1087a3d5-49d3-41a0-8029-86853fd1a93b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:35.291440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1087a3d5-49d3-41a0-8029-86853fd1a93b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:35.294692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1087a3d5-49d3-41a0-8029-86853fd1a93b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:35.295419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1087a3d5-49d3-41a0-8029-86853fd1a93b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:35.296021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1087a3d5-49d3-41a0-8029-86853fd1a93b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:35.423447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8a52dee4-3e96-412a-bdb3-74889b8f83e1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:35.436806 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8a52dee4-3e96-412a-bdb3-74889b8f83e1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1308 microversion: 2.1 time: 0.438538 Sep 06 10:53:35.451808 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 415/810] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:34 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1308 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:35.542373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-65688f28-160c-46fa-a63f-0c36952b45fa tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:35.543556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-65688f28-160c-46fa-a63f-0c36952b45fa tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:35.555304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65688f28-160c-46fa-a63f-0c36952b45fa tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:35.555805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65688f28-160c-46fa-a63f-0c36952b45fa tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:35.556251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65688f28-160c-46fa-a63f-0c36952b45fa tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:35.557012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65688f28-160c-46fa-a63f-0c36952b45fa tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:35.558023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65688f28-160c-46fa-a63f-0c36952b45fa tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:35.563359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65688f28-160c-46fa-a63f-0c36952b45fa tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:35.610813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:35.788796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1087a3d5-49d3-41a0-8029-86853fd1a93b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:35.797521 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1087a3d5-49d3-41a0-8029-86853fd1a93b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1479 microversion: 2.1 time: 0.532038 Sep 06 10:53:35.800262 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 396/811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:35 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1479 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:53:35.830640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3aa0f58f-4c7a-4fd8-9fc8-7c480f766b24 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '.version_select at 0x7f90f8d943a0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:35.834317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3aa0f58f-4c7a-4fd8-9fc8-7c480f766b24 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:35.834787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3aa0f58f-4c7a-4fd8-9fc8-7c480f766b24 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:35.835261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3aa0f58f-4c7a-4fd8-9fc8-7c480f766b24 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:35.850882 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3aa0f58f-4c7a-4fd8-9fc8-7c480f766b24 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.030397 Sep 06 10:53:35.852129 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 397/812] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 10:53:35 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:35.873960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-46c01dcf-6d41-4015-ab5b-c6bcd59dc9d9 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:35.874848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-46c01dcf-6d41-4015-ab5b-c6bcd59dc9d9 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:35.884958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46c01dcf-6d41-4015-ab5b-c6bcd59dc9d9 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:35.885494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46c01dcf-6d41-4015-ab5b-c6bcd59dc9d9 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:35.885941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46c01dcf-6d41-4015-ab5b-c6bcd59dc9d9 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:35.891374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46c01dcf-6d41-4015-ab5b-c6bcd59dc9d9 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:35.891979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46c01dcf-6d41-4015-ab5b-c6bcd59dc9d9 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:35.892423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46c01dcf-6d41-4015-ab5b-c6bcd59dc9d9 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:36.133123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-65688f28-160c-46fa-a63f-0c36952b45fa tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:36.142008 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-65688f28-160c-46fa-a63f-0c36952b45fa tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1313 microversion: 2.1 time: 0.604817 Sep 06 10:53:36.146643 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 416/813] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:35 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:53:36.165756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f03d8e95-644d-47db-8682-666ef68c43d5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:36.167181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f03d8e95-644d-47db-8682-666ef68c43d5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:36.181149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f03d8e95-644d-47db-8682-666ef68c43d5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:36.181655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f03d8e95-644d-47db-8682-666ef68c43d5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:36.182156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f03d8e95-644d-47db-8682-666ef68c43d5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:36.183585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f03d8e95-644d-47db-8682-666ef68c43d5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:36.184044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f03d8e95-644d-47db-8682-666ef68c43d5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:36.186941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f03d8e95-644d-47db-8682-666ef68c43d5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:37.078223 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-46c01dcf-6d41-4015-ab5b-c6bcd59dc9d9 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1630 microversion: 2.1 time: 1.208607 Sep 06 10:53:37.082709 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 398/814] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:35 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1630 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:53:37.093874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a3d9c6d3-eb0d-459c-83e8-faa0b8db7514 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:37.094658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a3d9c6d3-eb0d-459c-83e8-faa0b8db7514 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:37.112912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3d9c6d3-eb0d-459c-83e8-faa0b8db7514 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:37.113679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3d9c6d3-eb0d-459c-83e8-faa0b8db7514 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:37.114402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3d9c6d3-eb0d-459c-83e8-faa0b8db7514 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:37.115150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3d9c6d3-eb0d-459c-83e8-faa0b8db7514 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:37.115615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3d9c6d3-eb0d-459c-83e8-faa0b8db7514 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:37.116050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3d9c6d3-eb0d-459c-83e8-faa0b8db7514 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:37.236838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f03d8e95-644d-47db-8682-666ef68c43d5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:37.249825 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f03d8e95-644d-47db-8682-666ef68c43d5 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1531 microversion: 2.1 time: 1.101914 Sep 06 10:53:37.257894 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 417/815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:36 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1531 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:37.264507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3ee15d8f-d880-4de4-94bc-d070fca8e0c3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Action: 'create', calling method: .version_select at 0x7f90f893df70>, body: {"keypair": {"name": "tempest-keypair-1619655621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQ2eLpM5Jisn9X8zW2ez5oafFh/Zg5YTkJ1qbK0a96LQjLqwomCZJUQF8bz0tOdERFSubZMBTp9FBez7fBPymyCzHwubbFhVN3mrlMslsu5F9wyJ5el3UzEKbbXohNgQg=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:37.316385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-3ee15d8f-d880-4de4-94bc-d070fca8e0c3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Getting quotas for project fb1af95268504c5bbed702fce756f5f4. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:53:37.328611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-3ee15d8f-d880-4de4-94bc-d070fca8e0c3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Getting quotas for user c4e1ac1b40e94dbc80548a1f45919b6f and project fb1af95268504c5bbed702fce756f5f4. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:53:37.474797 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3ee15d8f-d880-4de4-94bc-d070fca8e0c3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.215760 Sep 06 10:53:37.476025 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 418/816] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:53:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:37.484003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a0eae675-89b3-4275-8aa7-323008c21e87 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:37.490332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a0eae675-89b3-4275-8aa7-323008c21e87 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:37.522131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0eae675-89b3-4275-8aa7-323008c21e87 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:37.522654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0eae675-89b3-4275-8aa7-323008c21e87 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:37.523161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0eae675-89b3-4275-8aa7-323008c21e87 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:37.523864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0eae675-89b3-4275-8aa7-323008c21e87 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:37.524327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0eae675-89b3-4275-8aa7-323008c21e87 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:37.524757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0eae675-89b3-4275-8aa7-323008c21e87 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:38.003177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a3d9c6d3-eb0d-459c-83e8-faa0b8db7514 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:38.020506 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a3d9c6d3-eb0d-459c-83e8-faa0b8db7514 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1308 microversion: 2.1 time: 0.936332 Sep 06 10:53:38.021550 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 399/817] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:37 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1308 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:38.026846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6c1c513a-3b49-4c1e-bceb-f95c792aa147 req-2ba59667-5e72-4b74-ae6a-568807945bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdba9b97-4ac9-425a-93bf-efc405463026", "name": "network-vif-plugged", "status": "completed", "tag": "c993e7ce-f4ac-4c50-8fae-67c9b2f4e028"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:38.050286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6c1c513a-3b49-4c1e-bceb-f95c792aa147 req-2ba59667-5e72-4b74-ae6a-568807945bdc service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:38.051507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6c1c513a-3b49-4c1e-bceb-f95c792aa147 req-2ba59667-5e72-4b74-ae6a-568807945bdc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:38.052308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6c1c513a-3b49-4c1e-bceb-f95c792aa147 req-2ba59667-5e72-4b74-ae6a-568807945bdc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:38.075556 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6c1c513a-3b49-4c1e-bceb-f95c792aa147 req-2ba59667-5e72-4b74-ae6a-568807945bdc service nova] Creating event network-vif-plugged:c993e7ce-f4ac-4c50-8fae-67c9b2f4e028 for instance cdba9b97-4ac9-425a-93bf-efc405463026 on nch2-master-1 Sep 06 10:53:38.092482 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6c1c513a-3b49-4c1e-bceb-f95c792aa147 req-2ba59667-5e72-4b74-ae6a-568807945bdc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069257 Sep 06 10:53:38.094089 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 400/818] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:38.134948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a0eae675-89b3-4275-8aa7-323008c21e87 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:38.144040 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a0eae675-89b3-4275-8aa7-323008c21e87 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1313 microversion: 2.1 time: 0.666320 Sep 06 10:53:38.153161 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 419/819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:37 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1313 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:38.284350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e54ea79b-a604-409d-931e-832c54ea3513 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:38.285549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e54ea79b-a604-409d-931e-832c54ea3513 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:38.299501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e54ea79b-a604-409d-931e-832c54ea3513 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:38.304583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e54ea79b-a604-409d-931e-832c54ea3513 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:38.309193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e54ea79b-a604-409d-931e-832c54ea3513 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:38.310971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e54ea79b-a604-409d-931e-832c54ea3513 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:38.311637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e54ea79b-a604-409d-931e-832c54ea3513 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:38.315301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e54ea79b-a604-409d-931e-832c54ea3513 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:38.867001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e54ea79b-a604-409d-931e-832c54ea3513 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:38.877525 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e54ea79b-a604-409d-931e-832c54ea3513 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1518 microversion: 2.1 time: 0.597365 Sep 06 10:53:38.893547 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 401/820] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:38 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1518 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:38.904390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f5daee58-1ebc-4b05-be4e-13ac0fb1f91b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:38.905606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f5daee58-1ebc-4b05-be4e-13ac0fb1f91b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:38.913448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:38.915655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5daee58-1ebc-4b05-be4e-13ac0fb1f91b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:38.916379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5daee58-1ebc-4b05-be4e-13ac0fb1f91b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:38.917581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5daee58-1ebc-4b05-be4e-13ac0fb1f91b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:38.923252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5daee58-1ebc-4b05-be4e-13ac0fb1f91b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:38.923252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5daee58-1ebc-4b05-be4e-13ac0fb1f91b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:38.923252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5daee58-1ebc-4b05-be4e-13ac0fb1f91b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:38.952481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f5daee58-1ebc-4b05-be4e-13ac0fb1f91b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:53:39.048342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-226f3a5e-e8d3-4a02-b14a-e52fb73693be tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:39.049163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-226f3a5e-e8d3-4a02-b14a-e52fb73693be tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:39.065118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-226f3a5e-e8d3-4a02-b14a-e52fb73693be tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:39.072162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-226f3a5e-e8d3-4a02-b14a-e52fb73693be tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:39.076474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-226f3a5e-e8d3-4a02-b14a-e52fb73693be tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:39.078630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-226f3a5e-e8d3-4a02-b14a-e52fb73693be tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:39.080798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-226f3a5e-e8d3-4a02-b14a-e52fb73693be tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:39.084422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-226f3a5e-e8d3-4a02-b14a-e52fb73693be tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:39.117490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:39.357790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-226f3a5e-e8d3-4a02-b14a-e52fb73693be tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:39.367711 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f5daee58-1ebc-4b05-be4e-13ac0fb1f91b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 204 len: 0 microversion: 2.1 time: 0.467294 Sep 06 10:53:39.368315 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 420/821] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:53:38 2022] DELETE /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:53:39.377072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2038757889", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "3d4af992-111f-451f-ba0f-1750f5aa94d6"}], "security_groups": [{"name": "tempest-securitygroup--240468681"}], "key_name": "tempest-keypair-1470633700", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:39.385033 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-226f3a5e-e8d3-4a02-b14a-e52fb73693be tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1308 microversion: 2.1 time: 0.341190 Sep 06 10:53:39.399896 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 402/822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:39 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:53:39.413331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-97ccc99e-8cf0-44f2-bdbe-a7d9d6444e94 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:39.415064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-97ccc99e-8cf0-44f2-bdbe-a7d9d6444e94 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:39.425018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97ccc99e-8cf0-44f2-bdbe-a7d9d6444e94 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:39.425734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97ccc99e-8cf0-44f2-bdbe-a7d9d6444e94 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:39.426505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97ccc99e-8cf0-44f2-bdbe-a7d9d6444e94 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:39.427475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97ccc99e-8cf0-44f2-bdbe-a7d9d6444e94 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:39.428161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97ccc99e-8cf0-44f2-bdbe-a7d9d6444e94 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:39.428815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97ccc99e-8cf0-44f2-bdbe-a7d9d6444e94 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:39.732213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-97ccc99e-8cf0-44f2-bdbe-a7d9d6444e94 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:39.744335 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-97ccc99e-8cf0-44f2-bdbe-a7d9d6444e94 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1313 microversion: 2.1 time: 0.342939 Sep 06 10:53:39.746978 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 403/823] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:39 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:39.754800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-35915d68-b817-456b-89a8-079718d6ffba req-ce68180c-9646-453b-aeb5-2342b6eeba34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2fe43cc-0af8-4ca0-9083-61b0f76aaa10", "tag": "710dacdc-43a5-4e67-9326-47de62fc72f5"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:39.766781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] validate_networks() for [('3d4af992-111f-451f-ba0f-1750f5aa94d6', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:53:39.785752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-35915d68-b817-456b-89a8-079718d6ffba req-ce68180c-9646-453b-aeb5-2342b6eeba34 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:39.789817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-35915d68-b817-456b-89a8-079718d6ffba req-ce68180c-9646-453b-aeb5-2342b6eeba34 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:39.792224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-35915d68-b817-456b-89a8-079718d6ffba req-ce68180c-9646-453b-aeb5-2342b6eeba34 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:39.843218 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-35915d68-b817-456b-89a8-079718d6ffba req-ce68180c-9646-453b-aeb5-2342b6eeba34 service nova] Creating event network-changed:710dacdc-43a5-4e67-9326-47de62fc72f5 for instance a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 on nch1-master-1 Sep 06 10:53:39.856104 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-35915d68-b817-456b-89a8-079718d6ffba req-ce68180c-9646-453b-aeb5-2342b6eeba34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106780 Sep 06 10:53:39.857729 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 404/824] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:39.871991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-17de6bf3-4db6-4265-a048-95b4cbeca14c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:39.873626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-17de6bf3-4db6-4265-a048-95b4cbeca14c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:39.921642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17de6bf3-4db6-4265-a048-95b4cbeca14c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:39.923363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17de6bf3-4db6-4265-a048-95b4cbeca14c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:39.932013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17de6bf3-4db6-4265-a048-95b4cbeca14c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:39.954030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17de6bf3-4db6-4265-a048-95b4cbeca14c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:39.956133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17de6bf3-4db6-4265-a048-95b4cbeca14c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:39.956756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17de6bf3-4db6-4265-a048-95b4cbeca14c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:40.145527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:40.414984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-17de6bf3-4db6-4265-a048-95b4cbeca14c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:40.430811 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-17de6bf3-4db6-4265-a048-95b4cbeca14c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1524 microversion: 2.1 time: 0.570557 Sep 06 10:53:40.457454 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 405/825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:39 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1524 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:40.478445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-c5888cbb-8caa-426b-9efd-1cb226aa45f9 req-7e8d5950-357d-43a5-801d-50f758ee4b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3270e900-2c13-43a0-9bb1-2a45ad779f85", "name": "network-vif-plugged", "status": "completed", "tag": "e70d14e6-709d-4b07-af6d-182402e5390a"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:40.505090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:40.507315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c5888cbb-8caa-426b-9efd-1cb226aa45f9 req-7e8d5950-357d-43a5-801d-50f758ee4b70 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:40.508039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c5888cbb-8caa-426b-9efd-1cb226aa45f9 req-7e8d5950-357d-43a5-801d-50f758ee4b70 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:40.508661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c5888cbb-8caa-426b-9efd-1cb226aa45f9 req-7e8d5950-357d-43a5-801d-50f758ee4b70 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:40.524825 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-c5888cbb-8caa-426b-9efd-1cb226aa45f9 req-7e8d5950-357d-43a5-801d-50f758ee4b70 service nova] Creating event network-vif-plugged:e70d14e6-709d-4b07-af6d-182402e5390a for instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 on nch2-master-1 Sep 06 10:53:40.534010 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-c5888cbb-8caa-426b-9efd-1cb226aa45f9 req-7e8d5950-357d-43a5-801d-50f758ee4b70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075131 Sep 06 10:53:40.539308 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 406/826] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:40.545538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-df1339ad-918f-4ac2-b193-bdb75fac65fc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:40.546563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-df1339ad-918f-4ac2-b193-bdb75fac65fc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:40.553181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df1339ad-918f-4ac2-b193-bdb75fac65fc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:40.553976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df1339ad-918f-4ac2-b193-bdb75fac65fc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:40.554643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df1339ad-918f-4ac2-b193-bdb75fac65fc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:40.555702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df1339ad-918f-4ac2-b193-bdb75fac65fc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:40.556399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df1339ad-918f-4ac2-b193-bdb75fac65fc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:40.557055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df1339ad-918f-4ac2-b193-bdb75fac65fc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:40.693714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:53:40.695436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:53:40.696211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:53:40.696829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:53:40.698395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:53:40.723569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:40.724498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:40.725350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:40.726445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:40.727146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:40.728103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:40.748962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Getting quotas for project 437799e22df2433a83eca67987e942c6. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:53:40.756290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Getting quotas for user d9f88a4c72854cff9bba7ed2920f55b0 and project 437799e22df2433a83eca67987e942c6. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:53:40.774482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-df1339ad-918f-4ac2-b193-bdb75fac65fc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:40.784430 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-df1339ad-918f-4ac2-b193-bdb75fac65fc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1308 microversion: 2.1 time: 0.243519 Sep 06 10:53:40.785682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:53:40.798082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:53:40.798444 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 407/827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:40 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:40.798444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3bfd72dd-da94-4983-b814-00eed1846fdb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:40.798444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3bfd72dd-da94-4983-b814-00eed1846fdb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:40.806613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bfd72dd-da94-4983-b814-00eed1846fdb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:40.807665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bfd72dd-da94-4983-b814-00eed1846fdb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:40.808144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bfd72dd-da94-4983-b814-00eed1846fdb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:40.808880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bfd72dd-da94-4983-b814-00eed1846fdb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:40.809362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bfd72dd-da94-4983-b814-00eed1846fdb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:40.809810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bfd72dd-da94-4983-b814-00eed1846fdb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:40.985051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3bfd72dd-da94-4983-b814-00eed1846fdb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:41.001152 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3bfd72dd-da94-4983-b814-00eed1846fdb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1313 microversion: 2.1 time: 0.211231 Sep 06 10:53:41.019999 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 408/828] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:40 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:41.459588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c5a47ef4-e2dc-493e-af5d-08b2fb2b6717 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:41.461006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c5a47ef4-e2dc-493e-af5d-08b2fb2b6717 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:41.466475 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-74165049-b0c8-4a69-81ff-57ca36b335f6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.096907 Sep 06 10:53:41.470582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5a47ef4-e2dc-493e-af5d-08b2fb2b6717 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:41.472057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5a47ef4-e2dc-493e-af5d-08b2fb2b6717 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:41.472696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5a47ef4-e2dc-493e-af5d-08b2fb2b6717 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:41.474682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5a47ef4-e2dc-493e-af5d-08b2fb2b6717 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:41.476613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5a47ef4-e2dc-493e-af5d-08b2fb2b6717 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:41.477121 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 421/829] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 10:53:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 2108 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 10:53:41.478931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5a47ef4-e2dc-493e-af5d-08b2fb2b6717 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:41.507779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3fc1e060-7618-49ac-8198-e2fbb8a13090 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:41.508427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3fc1e060-7618-49ac-8198-e2fbb8a13090 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:41.783131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3fc1e060-7618-49ac-8198-e2fbb8a13090 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:41.806572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3fc1e060-7618-49ac-8198-e2fbb8a13090 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:41.815154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3fc1e060-7618-49ac-8198-e2fbb8a13090 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:41.817885 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3fc1e060-7618-49ac-8198-e2fbb8a13090 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1286 microversion: 2.25 time: 0.326156 Sep 06 10:53:41.836086 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 422/830] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:41 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1286 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:41.850551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dfbcfbbe-8eb6-4827-ba31-e7f77b9fd069 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:41.851589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dfbcfbbe-8eb6-4827-ba31-e7f77b9fd069 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:41.874155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dfbcfbbe-8eb6-4827-ba31-e7f77b9fd069 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:41.882795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dfbcfbbe-8eb6-4827-ba31-e7f77b9fd069 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:41.882795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dfbcfbbe-8eb6-4827-ba31-e7f77b9fd069 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:41.882795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dfbcfbbe-8eb6-4827-ba31-e7f77b9fd069 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:41.882795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dfbcfbbe-8eb6-4827-ba31-e7f77b9fd069 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:41.883390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dfbcfbbe-8eb6-4827-ba31-e7f77b9fd069 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:41.950525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c5a47ef4-e2dc-493e-af5d-08b2fb2b6717 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:41.960920 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c5a47ef4-e2dc-493e-af5d-08b2fb2b6717 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1524 microversion: 2.1 time: 0.509870 Sep 06 10:53:41.963771 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 409/831] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:41 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1524 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:53:42.026125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aa921705-e5b3-4f15-91c4-7392e09a51b7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:42.027116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aa921705-e5b3-4f15-91c4-7392e09a51b7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:42.039594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa921705-e5b3-4f15-91c4-7392e09a51b7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:42.040507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa921705-e5b3-4f15-91c4-7392e09a51b7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:42.041152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa921705-e5b3-4f15-91c4-7392e09a51b7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:42.042627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa921705-e5b3-4f15-91c4-7392e09a51b7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:42.043313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa921705-e5b3-4f15-91c4-7392e09a51b7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:42.045495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa921705-e5b3-4f15-91c4-7392e09a51b7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:42.377146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dfbcfbbe-8eb6-4827-ba31-e7f77b9fd069 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:42.394621 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dfbcfbbe-8eb6-4827-ba31-e7f77b9fd069 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1488 microversion: 2.1 time: 0.556564 Sep 06 10:53:42.404878 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 423/832] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:41 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1488 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:42.422889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7621078d-e400-4459-9579-f48fb276c63c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:42.425844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7621078d-e400-4459-9579-f48fb276c63c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:42.440326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aa921705-e5b3-4f15-91c4-7392e09a51b7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:42.457590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7621078d-e400-4459-9579-f48fb276c63c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:42.460017 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aa921705-e5b3-4f15-91c4-7392e09a51b7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1313 microversion: 2.1 time: 0.438265 Sep 06 10:53:42.461016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7621078d-e400-4459-9579-f48fb276c63c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:42.462276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7621078d-e400-4459-9579-f48fb276c63c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:42.465267 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 410/833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:42 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:53:42.466315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7621078d-e400-4459-9579-f48fb276c63c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:42.467103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7621078d-e400-4459-9579-f48fb276c63c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:42.467765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7621078d-e400-4459-9579-f48fb276c63c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:42.845965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-128e043c-431d-484b-bb55-e0375ae1c92d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:42.849774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-128e043c-431d-484b-bb55-e0375ae1c92d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:42.934420 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7621078d-e400-4459-9579-f48fb276c63c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "POST /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026/action" status: 202 len: 0 microversion: 2.1 time: 0.517597 Sep 06 10:53:42.940955 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 424/834] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:53:42 2022] POST /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:53:42.951797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-90d7ca18-d4e9-4a6b-9f77-15a3caba0071 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:42.953547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-90d7ca18-d4e9-4a6b-9f77-15a3caba0071 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:42.962998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90d7ca18-d4e9-4a6b-9f77-15a3caba0071 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:42.963961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90d7ca18-d4e9-4a6b-9f77-15a3caba0071 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:42.965292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90d7ca18-d4e9-4a6b-9f77-15a3caba0071 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:42.967188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90d7ca18-d4e9-4a6b-9f77-15a3caba0071 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:42.968267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90d7ca18-d4e9-4a6b-9f77-15a3caba0071 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:42.968946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90d7ca18-d4e9-4a6b-9f77-15a3caba0071 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:43.075180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-128e043c-431d-484b-bb55-e0375ae1c92d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:43.090995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-128e043c-431d-484b-bb55-e0375ae1c92d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:43.092544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-128e043c-431d-484b-bb55-e0375ae1c92d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:43.093694 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-128e043c-431d-484b-bb55-e0375ae1c92d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1286 microversion: 2.25 time: 0.252701 Sep 06 10:53:43.095569 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 411/835] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:42 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1286 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:43.101422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a3ca44fd-6391-4332-a757-931de16f443f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:43.111909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a3ca44fd-6391-4332-a757-931de16f443f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:43.137510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3ca44fd-6391-4332-a757-931de16f443f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:43.140914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3ca44fd-6391-4332-a757-931de16f443f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:43.140914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3ca44fd-6391-4332-a757-931de16f443f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:43.143544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3ca44fd-6391-4332-a757-931de16f443f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:43.144144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3ca44fd-6391-4332-a757-931de16f443f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:43.147146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3ca44fd-6391-4332-a757-931de16f443f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:43.240478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-90d7ca18-d4e9-4a6b-9f77-15a3caba0071 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:43.250516 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-90d7ca18-d4e9-4a6b-9f77-15a3caba0071 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1493 microversion: 2.1 time: 0.305688 Sep 06 10:53:43.270060 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 425/836] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:42 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1493 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:43.282939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a96cac92-6591-449a-9cd5-c4ccc8a86933 req-24063705-400c-40e9-b26b-bee07878d569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3270e900-2c13-43a0-9bb1-2a45ad779f85", "name": "network-vif-deleted", "tag": "e70d14e6-709d-4b07-af6d-182402e5390a"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:43.317919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a3ca44fd-6391-4332-a757-931de16f443f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:43.331762 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a3ca44fd-6391-4332-a757-931de16f443f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 200 len: 1482 microversion: 2.1 time: 0.234953 Sep 06 10:53:43.332159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a96cac92-6591-449a-9cd5-c4ccc8a86933 req-24063705-400c-40e9-b26b-bee07878d569 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:43.332712 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 412/837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:43 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 1482 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:43.333600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a96cac92-6591-449a-9cd5-c4ccc8a86933 req-24063705-400c-40e9-b26b-bee07878d569 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:43.334182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a96cac92-6591-449a-9cd5-c4ccc8a86933 req-24063705-400c-40e9-b26b-bee07878d569 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:43.338228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1170391294", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "83241706-ada5-4425-9544-55285e98247c"}], "security_groups": [{"name": "tempest-securitygroup--623507759"}], "key_name": "tempest-keypair-1619655621", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:43.365262 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a96cac92-6591-449a-9cd5-c4ccc8a86933 req-24063705-400c-40e9-b26b-bee07878d569 service nova] Creating event network-vif-deleted:e70d14e6-709d-4b07-af6d-182402e5390a for instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 on nch2-master-1 Sep 06 10:53:43.372810 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a96cac92-6591-449a-9cd5-c4ccc8a86933 req-24063705-400c-40e9-b26b-bee07878d569 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101168 Sep 06 10:53:43.373973 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 426/838] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:43.490436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-acba280a-4317-4d88-a365-a94995fa824e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:43.491302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-acba280a-4317-4d88-a365-a94995fa824e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:43.505488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] validate_networks() for [('83241706-ada5-4425-9544-55285e98247c', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:53:43.527593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acba280a-4317-4d88-a365-a94995fa824e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:43.530600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acba280a-4317-4d88-a365-a94995fa824e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:43.531592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acba280a-4317-4d88-a365-a94995fa824e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:43.533930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acba280a-4317-4d88-a365-a94995fa824e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:43.537749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acba280a-4317-4d88-a365-a94995fa824e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:43.539681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acba280a-4317-4d88-a365-a94995fa824e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:43.931803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-acba280a-4317-4d88-a365-a94995fa824e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:43.944956 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-acba280a-4317-4d88-a365-a94995fa824e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1313 microversion: 2.1 time: 0.458723 Sep 06 10:53:43.946540 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 427/839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:43 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:44.124506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f12ab51b-bdbf-4456-96ee-1a3ba8927459 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:44.125401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f12ab51b-bdbf-4456-96ee-1a3ba8927459 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:44.140845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12ab51b-bdbf-4456-96ee-1a3ba8927459 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:44.145651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12ab51b-bdbf-4456-96ee-1a3ba8927459 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:44.149031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12ab51b-bdbf-4456-96ee-1a3ba8927459 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:44.149832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12ab51b-bdbf-4456-96ee-1a3ba8927459 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:44.150331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12ab51b-bdbf-4456-96ee-1a3ba8927459 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:44.150812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12ab51b-bdbf-4456-96ee-1a3ba8927459 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:44.901946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f12ab51b-bdbf-4456-96ee-1a3ba8927459 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:44.913868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f12ab51b-bdbf-4456-96ee-1a3ba8927459 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:44.918513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f12ab51b-bdbf-4456-96ee-1a3ba8927459 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:44.923465 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f12ab51b-bdbf-4456-96ee-1a3ba8927459 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1338 microversion: 2.25 time: 0.804091 Sep 06 10:53:44.926051 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 428/840] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:44 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1338 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:53:44.934940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-25b166d7-23de-4f49-9af6-1dbf1ef7be79 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:44.937909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-25b166d7-23de-4f49-9af6-1dbf1ef7be79 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:44.958329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25b166d7-23de-4f49-9af6-1dbf1ef7be79 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:44.959623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25b166d7-23de-4f49-9af6-1dbf1ef7be79 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:44.960297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25b166d7-23de-4f49-9af6-1dbf1ef7be79 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:44.961254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25b166d7-23de-4f49-9af6-1dbf1ef7be79 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:44.963613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25b166d7-23de-4f49-9af6-1dbf1ef7be79 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:44.964435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25b166d7-23de-4f49-9af6-1dbf1ef7be79 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:45.196051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:53:45.196603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:53:45.196970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:53:45.197390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:53:45.199482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:53:45.218481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:45.220087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:45.220567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:45.223841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:45.224494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:45.225169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:45.261104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Getting quotas for project fb1af95268504c5bbed702fce756f5f4. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:53:45.268108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Getting quotas for user c4e1ac1b40e94dbc80548a1f45919b6f and project fb1af95268504c5bbed702fce756f5f4. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:53:45.294613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:53:45.303426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:53:45.452090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-25b166d7-23de-4f49-9af6-1dbf1ef7be79 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:45.460855 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-25b166d7-23de-4f49-9af6-1dbf1ef7be79 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 200 len: 1473 microversion: 2.1 time: 0.529969 Sep 06 10:53:45.468648 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 429/841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:44 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 1473 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:45.489772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-69d33830-71db-4520-9b96-32687f097b2f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:45.493886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-69d33830-71db-4520-9b96-32687f097b2f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:45.519788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69d33830-71db-4520-9b96-32687f097b2f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:45.520556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69d33830-71db-4520-9b96-32687f097b2f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:45.521214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69d33830-71db-4520-9b96-32687f097b2f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:45.522115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69d33830-71db-4520-9b96-32687f097b2f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:45.527095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69d33830-71db-4520-9b96-32687f097b2f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:45.527792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69d33830-71db-4520-9b96-32687f097b2f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:45.557815 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8ddd41f2-6432-4753-a738-00d174e7313d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.219502 Sep 06 10:53:45.561727 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 413/842] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:53:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:53:45.587902 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-69d33830-71db-4520-9b96-32687f097b2f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] HTTP exception thrown: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-69d33830-71db-4520-9b96-32687f097b2f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 HTTP/1.1 Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:53:45.591758 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:53:45.593256 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:53:45.593256 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:53:45.593256 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:53:45.593256 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:53:45.593256 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:53:45.593256 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:53:45.593256 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:53:45.593256 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:53:45.593256 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:53:45.593256 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:53:45.593256 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:53:45.593256 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '3270e900-2c13-43a0-9bb1-2a45ad779f85'} Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:53:45.594053 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:53:45.595421 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:53:45.600957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-69d33830-71db-4520-9b96-32687f097b2f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 404 to user: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:53:45.602007 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-69d33830-71db-4520-9b96-32687f097b2f tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 404 len: 111 microversion: 2.1 time: 0.132183 Sep 06 10:53:45.617156 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 430/843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:45 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:53:45.633259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f4d5a1d1-39b9-4e9e-b1bb-37fdcae7f975 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:45.639592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb1d3e28-124d-443e-a2c4-df44cc1d6871 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1967847313"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:45.639736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f4d5a1d1-39b9-4e9e-b1bb-37fdcae7f975 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:45.647046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fb1d3e28-124d-443e-a2c4-df44cc1d6871 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:45.668736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4d5a1d1-39b9-4e9e-b1bb-37fdcae7f975 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:45.669208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb1d3e28-124d-443e-a2c4-df44cc1d6871 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:45.669723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb1d3e28-124d-443e-a2c4-df44cc1d6871 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:45.670173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb1d3e28-124d-443e-a2c4-df44cc1d6871 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:45.670753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4d5a1d1-39b9-4e9e-b1bb-37fdcae7f975 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:45.670896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb1d3e28-124d-443e-a2c4-df44cc1d6871 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:45.671395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb1d3e28-124d-443e-a2c4-df44cc1d6871 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:45.671828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb1d3e28-124d-443e-a2c4-df44cc1d6871 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:45.673877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4d5a1d1-39b9-4e9e-b1bb-37fdcae7f975 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:45.683290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4d5a1d1-39b9-4e9e-b1bb-37fdcae7f975 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:45.684483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4d5a1d1-39b9-4e9e-b1bb-37fdcae7f975 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:45.685322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4d5a1d1-39b9-4e9e-b1bb-37fdcae7f975 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:46.291093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f4d5a1d1-39b9-4e9e-b1bb-37fdcae7f975 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:46.301372 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f4d5a1d1-39b9-4e9e-b1bb-37fdcae7f975 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1313 microversion: 2.1 time: 0.737054 Sep 06 10:53:46.315371 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 414/844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:45 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1313 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:46.323457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b0f0ee17-51ae-429c-91b0-935fff9414e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:46.324371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b0f0ee17-51ae-429c-91b0-935fff9414e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:46.469723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b0f0ee17-51ae-429c-91b0-935fff9414e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:46.481032 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b0f0ee17-51ae-429c-91b0-935fff9414e6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1235 microversion: 2.1 time: 0.164410 Sep 06 10:53:46.484565 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 415/845] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:46 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1235 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:46.500515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1135167885", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:46.568358 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fb1d3e28-124d-443e-a2c4-df44cc1d6871 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "POST /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026/action" status: 202 len: 0 microversion: 2.1 time: 0.949689 Sep 06 10:53:46.576794 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 431/846] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:53:45 2022] POST /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026/action => generated 0 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 06 10:53:46.594980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-27757173-8b98-4623-9156-b50e8b9ed16e req-3548a9c2-a824-40e3-a6b8-a166a1e89301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fe43cc-0af8-4ca0-9083-61b0f76aaa10", "name": "network-vif-plugged", "status": "completed", "tag": "710dacdc-43a5-4e67-9326-47de62fc72f5"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:46.628683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] validate_networks() for [('a12e8367-831f-4a7b-ab55-8a1095444e0d', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:53:46.630045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-27757173-8b98-4623-9156-b50e8b9ed16e req-3548a9c2-a824-40e3-a6b8-a166a1e89301 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:46.634214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-27757173-8b98-4623-9156-b50e8b9ed16e req-3548a9c2-a824-40e3-a6b8-a166a1e89301 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:46.640439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-27757173-8b98-4623-9156-b50e8b9ed16e req-3548a9c2-a824-40e3-a6b8-a166a1e89301 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:46.683912 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-27757173-8b98-4623-9156-b50e8b9ed16e req-3548a9c2-a824-40e3-a6b8-a166a1e89301 service nova] Creating event network-vif-plugged:710dacdc-43a5-4e67-9326-47de62fc72f5 for instance a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 on nch1-master-1 Sep 06 10:53:46.714794 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-27757173-8b98-4623-9156-b50e8b9ed16e req-3548a9c2-a824-40e3-a6b8-a166a1e89301 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127636 Sep 06 10:53:46.714794 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 432/847] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:46.731706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bcd16fda-2d15-481d-af41-9f1ad7ab4e43 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:46.735095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bcd16fda-2d15-481d-af41-9f1ad7ab4e43 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:46.756033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd16fda-2d15-481d-af41-9f1ad7ab4e43 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:46.757471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd16fda-2d15-481d-af41-9f1ad7ab4e43 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:46.758146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd16fda-2d15-481d-af41-9f1ad7ab4e43 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:46.761535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd16fda-2d15-481d-af41-9f1ad7ab4e43 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:46.762033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd16fda-2d15-481d-af41-9f1ad7ab4e43 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:46.762474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd16fda-2d15-481d-af41-9f1ad7ab4e43 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:46.882355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bcd16fda-2d15-481d-af41-9f1ad7ab4e43 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:46.888631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:46.897366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bcd16fda-2d15-481d-af41-9f1ad7ab4e43 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:46.899370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bcd16fda-2d15-481d-af41-9f1ad7ab4e43 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:46.901687 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bcd16fda-2d15-481d-af41-9f1ad7ab4e43 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1344 microversion: 2.25 time: 0.186733 Sep 06 10:53:46.903845 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 433/848] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:46 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1344 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:46.908981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-434a6488-c99a-4f67-825e-cb8252d1f802 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f893d310>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:46.990270 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-434a6488-c99a-4f67-825e-cb8252d1f802 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1412 microversion: 2.1 time: 0.085116 Sep 06 10:53:46.991319 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 434/849] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:46 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:47.331043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-625b85da-67ff-45e2-82ca-d76d74e554d2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:47.332931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-625b85da-67ff-45e2-82ca-d76d74e554d2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:47.355371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-625b85da-67ff-45e2-82ca-d76d74e554d2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:47.356623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-625b85da-67ff-45e2-82ca-d76d74e554d2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:47.359117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-625b85da-67ff-45e2-82ca-d76d74e554d2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:47.359647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:53:47.360405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-625b85da-67ff-45e2-82ca-d76d74e554d2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:47.360777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:53:47.360905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-625b85da-67ff-45e2-82ca-d76d74e554d2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:47.361257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:53:47.361677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:53:47.362213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:53:47.362873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-625b85da-67ff-45e2-82ca-d76d74e554d2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:47.381061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:47.381964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:47.382682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:47.383979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:47.386552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:47.387280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:47.447308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Getting quotas for project 52177b94887d409f9034b3cee40237dd. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:53:47.454707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Getting quotas for user 117e12084c60416aabce823ebae4f214 and project 52177b94887d409f9034b3cee40237dd. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:53:47.476577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:53:47.479586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:53:47.645097 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-67ab8597-8345-4430-8e1b-6eecf83b242c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.159140 Sep 06 10:53:47.645750 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 416/850] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:53:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:53:47.653213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ad448431-d76a-400c-a43f-e1d6c61e80ad tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:47.654088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ad448431-d76a-400c-a43f-e1d6c61e80ad tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:47.671718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad448431-d76a-400c-a43f-e1d6c61e80ad tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:47.672561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad448431-d76a-400c-a43f-e1d6c61e80ad tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:47.673171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad448431-d76a-400c-a43f-e1d6c61e80ad tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:47.674074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad448431-d76a-400c-a43f-e1d6c61e80ad tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:47.676931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad448431-d76a-400c-a43f-e1d6c61e80ad tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:47.677715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad448431-d76a-400c-a43f-e1d6c61e80ad tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:47.882039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-625b85da-67ff-45e2-82ca-d76d74e554d2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:47.892093 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-625b85da-67ff-45e2-82ca-d76d74e554d2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1313 microversion: 2.1 time: 0.566532 Sep 06 10:53:47.896902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ad448431-d76a-400c-a43f-e1d6c61e80ad tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:47.908446 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 435/851] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:47 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:47.920522 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ad448431-d76a-400c-a43f-e1d6c61e80ad tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1231 microversion: 2.1 time: 0.259380 Sep 06 10:53:47.934369 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 417/852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:47 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1231 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:47.946985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-45a48009-6d53-4763-8c14-ce48b14ed7f2 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:47.949239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-45a48009-6d53-4763-8c14-ce48b14ed7f2 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:47.953215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-387a75bf-4754-46c7-95cd-cc070abca2a6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:47.953690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-387a75bf-4754-46c7-95cd-cc070abca2a6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:47.974963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-387a75bf-4754-46c7-95cd-cc070abca2a6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:47.978749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-387a75bf-4754-46c7-95cd-cc070abca2a6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:47.979386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-387a75bf-4754-46c7-95cd-cc070abca2a6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:47.980232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-387a75bf-4754-46c7-95cd-cc070abca2a6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:47.982881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-387a75bf-4754-46c7-95cd-cc070abca2a6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:47.983783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-387a75bf-4754-46c7-95cd-cc070abca2a6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:48.230085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-45a48009-6d53-4763-8c14-ce48b14ed7f2 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:48.262946 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-45a48009-6d53-4763-8c14-ce48b14ed7f2 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1225 microversion: 2.1 time: 0.353999 Sep 06 10:53:48.349688 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 436/853] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:47 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1225 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:48.363733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e27893b5-0cbc-4421-b0ba-829acfa76134 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f892cee0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:48.468930 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e27893b5-0cbc-4421-b0ba-829acfa76134 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1412 microversion: 2.1 time: 0.118002 Sep 06 10:53:48.469810 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 437/854] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:48 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:48.639953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-387a75bf-4754-46c7-95cd-cc070abca2a6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:48.660424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-387a75bf-4754-46c7-95cd-cc070abca2a6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:48.662214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-387a75bf-4754-46c7-95cd-cc070abca2a6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:48.663404 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-387a75bf-4754-46c7-95cd-cc070abca2a6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1411 microversion: 2.25 time: 0.728063 Sep 06 10:53:48.663977 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 418/855] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:47 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1411 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:48.917919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6b027e0f-3676-4698-a2b0-7f4c8d2226d4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:48.918493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6b027e0f-3676-4698-a2b0-7f4c8d2226d4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:48.930806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b027e0f-3676-4698-a2b0-7f4c8d2226d4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:48.931353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b027e0f-3676-4698-a2b0-7f4c8d2226d4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:48.931808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b027e0f-3676-4698-a2b0-7f4c8d2226d4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:48.944733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b027e0f-3676-4698-a2b0-7f4c8d2226d4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:48.945299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b027e0f-3676-4698-a2b0-7f4c8d2226d4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:48.945758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b027e0f-3676-4698-a2b0-7f4c8d2226d4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:48.950178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-222a3627-32bf-4fb7-97de-b33d26273fe4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:48.951187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-222a3627-32bf-4fb7-97de-b33d26273fe4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:48.961231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-222a3627-32bf-4fb7-97de-b33d26273fe4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:48.963583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-222a3627-32bf-4fb7-97de-b33d26273fe4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:48.965760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-222a3627-32bf-4fb7-97de-b33d26273fe4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:48.966702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-222a3627-32bf-4fb7-97de-b33d26273fe4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:48.967830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-222a3627-32bf-4fb7-97de-b33d26273fe4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:48.974101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-222a3627-32bf-4fb7-97de-b33d26273fe4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:49.344766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-222a3627-32bf-4fb7-97de-b33d26273fe4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:49.361202 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-222a3627-32bf-4fb7-97de-b33d26273fe4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1287 microversion: 2.1 time: 0.415473 Sep 06 10:53:49.362280 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 419/856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:48 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1287 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:49.369040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b3676dd7-8369-4103-9b73-87008474f291 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:49.370313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b3676dd7-8369-4103-9b73-87008474f291 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:49.658335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b3676dd7-8369-4103-9b73-87008474f291 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:49.669044 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b3676dd7-8369-4103-9b73-87008474f291 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1225 microversion: 2.1 time: 0.304748 Sep 06 10:53:49.670835 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 420/857] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:49 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1225 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:49.681691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6bf2dd19-64ae-4642-8451-58924a9b0477 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8dbfe50>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:49.775780 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6bf2dd19-64ae-4642-8451-58924a9b0477 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1412 microversion: 2.1 time: 0.102668 Sep 06 10:53:49.777585 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 421/858] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:49 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:49.800514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b613195f-5b2a-4275-99b4-5c1016db67d8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:49.801733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b613195f-5b2a-4275-99b4-5c1016db67d8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:49.819433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b613195f-5b2a-4275-99b4-5c1016db67d8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:49.821380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b613195f-5b2a-4275-99b4-5c1016db67d8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:49.823954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b613195f-5b2a-4275-99b4-5c1016db67d8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:49.824977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b613195f-5b2a-4275-99b4-5c1016db67d8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:49.827924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b613195f-5b2a-4275-99b4-5c1016db67d8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:49.828756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b613195f-5b2a-4275-99b4-5c1016db67d8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:49.886997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6b027e0f-3676-4698-a2b0-7f4c8d2226d4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:49.899851 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6b027e0f-3676-4698-a2b0-7f4c8d2226d4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1313 microversion: 2.1 time: 0.985910 Sep 06 10:53:49.905228 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 438/859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:48 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1313 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:50.385606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3c8fc084-f843-46d5-b4d7-de69231da9a2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:50.388282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3c8fc084-f843-46d5-b4d7-de69231da9a2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:50.406827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c8fc084-f843-46d5-b4d7-de69231da9a2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:50.408820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c8fc084-f843-46d5-b4d7-de69231da9a2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:50.411048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c8fc084-f843-46d5-b4d7-de69231da9a2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:50.417212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c8fc084-f843-46d5-b4d7-de69231da9a2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:50.418046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c8fc084-f843-46d5-b4d7-de69231da9a2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:50.419358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c8fc084-f843-46d5-b4d7-de69231da9a2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:50.440275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b613195f-5b2a-4275-99b4-5c1016db67d8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:50.459851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b613195f-5b2a-4275-99b4-5c1016db67d8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:50.461605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b613195f-5b2a-4275-99b4-5c1016db67d8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:50.463954 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b613195f-5b2a-4275-99b4-5c1016db67d8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1411 microversion: 2.25 time: 0.684121 Sep 06 10:53:50.466095 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 422/860] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:49 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1411 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:50.591210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3c8fc084-f843-46d5-b4d7-de69231da9a2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:50.609802 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3c8fc084-f843-46d5-b4d7-de69231da9a2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1293 microversion: 2.1 time: 0.228784 Sep 06 10:53:50.623114 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 439/861] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:50 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1293 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:50.698260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-115901b8-7355-491e-ad30-ccc4e5abd400 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:50.700704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-115901b8-7355-491e-ad30-ccc4e5abd400 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:50.733252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-115901b8-7355-491e-ad30-ccc4e5abd400 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:50.736503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-115901b8-7355-491e-ad30-ccc4e5abd400 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:50.738065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-115901b8-7355-491e-ad30-ccc4e5abd400 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:50.747978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-115901b8-7355-491e-ad30-ccc4e5abd400 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:50.748971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-115901b8-7355-491e-ad30-ccc4e5abd400 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:50.749778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-115901b8-7355-491e-ad30-ccc4e5abd400 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:50.800060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-97210d6f-f1b3-4b4e-85d4-e74ca499ec64 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8a5b550>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:50.830217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:50.949419 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-97210d6f-f1b3-4b4e-85d4-e74ca499ec64 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1412 microversion: 2.1 time: 0.160671 Sep 06 10:53:50.952453 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 440/862] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:50 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1412 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:50.968287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-275d8770-5e3a-4182-81ed-d7c5d8af821a req-d863f98d-f191-4dcb-9394-868a534b1d23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a4ea2a-aa16-4e41-af83-b027dfe81828", "tag": "9fd60b84-0b14-41da-8bad-24a891e8dd1d"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:50.975098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:50.980020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-275d8770-5e3a-4182-81ed-d7c5d8af821a req-d863f98d-f191-4dcb-9394-868a534b1d23 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:50.981084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-275d8770-5e3a-4182-81ed-d7c5d8af821a req-d863f98d-f191-4dcb-9394-868a534b1d23 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:50.981734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-275d8770-5e3a-4182-81ed-d7c5d8af821a req-d863f98d-f191-4dcb-9394-868a534b1d23 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:51.004282 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-275d8770-5e3a-4182-81ed-d7c5d8af821a req-d863f98d-f191-4dcb-9394-868a534b1d23 service nova] Creating event network-changed:9fd60b84-0b14-41da-8bad-24a891e8dd1d for instance 31a4ea2a-aa16-4e41-af83-b027dfe81828 on nch1-master-1 Sep 06 10:53:51.012324 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-275d8770-5e3a-4182-81ed-d7c5d8af821a req-d863f98d-f191-4dcb-9394-868a534b1d23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057967 Sep 06 10:53:51.013266 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 441/863] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:51.019686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8a92f06a-d170-44de-99ce-89a42ecfee93 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:51.020473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8a92f06a-d170-44de-99ce-89a42ecfee93 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:51.027874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a92f06a-d170-44de-99ce-89a42ecfee93 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:51.028510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a92f06a-d170-44de-99ce-89a42ecfee93 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:51.028971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a92f06a-d170-44de-99ce-89a42ecfee93 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:51.029709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a92f06a-d170-44de-99ce-89a42ecfee93 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:51.030198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a92f06a-d170-44de-99ce-89a42ecfee93 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:51.030618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a92f06a-d170-44de-99ce-89a42ecfee93 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:51.481845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-115901b8-7355-491e-ad30-ccc4e5abd400 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:51.490867 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-115901b8-7355-491e-ad30-ccc4e5abd400 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1277 microversion: 2.1 time: 0.797847 Sep 06 10:53:51.504135 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 423/864] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:50 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1277 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:51.509031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7f3edb65-d268-4c8b-8c23-0e2abcc5fd18 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:51.509655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7f3edb65-d268-4c8b-8c23-0e2abcc5fd18 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:51.523929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f3edb65-d268-4c8b-8c23-0e2abcc5fd18 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:51.524496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f3edb65-d268-4c8b-8c23-0e2abcc5fd18 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:51.524962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f3edb65-d268-4c8b-8c23-0e2abcc5fd18 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:51.525756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f3edb65-d268-4c8b-8c23-0e2abcc5fd18 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:51.526248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f3edb65-d268-4c8b-8c23-0e2abcc5fd18 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:51.526692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f3edb65-d268-4c8b-8c23-0e2abcc5fd18 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:52.414457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8a92f06a-d170-44de-99ce-89a42ecfee93 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:52.428853 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8a92f06a-d170-44de-99ce-89a42ecfee93 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1463 microversion: 2.1 time: 1.414303 Sep 06 10:53:52.430213 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 442/865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:51 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1463 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:52.449499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d2e3ac32-0573-4cf6-a5ab-04e75c41ddb3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:52.454105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d2e3ac32-0573-4cf6-a5ab-04e75c41ddb3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:52.457749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2e3ac32-0573-4cf6-a5ab-04e75c41ddb3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:52.461063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2e3ac32-0573-4cf6-a5ab-04e75c41ddb3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:52.464682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2e3ac32-0573-4cf6-a5ab-04e75c41ddb3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:52.465793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2e3ac32-0573-4cf6-a5ab-04e75c41ddb3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:52.466471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2e3ac32-0573-4cf6-a5ab-04e75c41ddb3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:52.467148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2e3ac32-0573-4cf6-a5ab-04e75c41ddb3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:52.749874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7f3edb65-d268-4c8b-8c23-0e2abcc5fd18 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:52.755248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d2e3ac32-0573-4cf6-a5ab-04e75c41ddb3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:52.767222 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d2e3ac32-0573-4cf6-a5ab-04e75c41ddb3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1293 microversion: 2.1 time: 0.334861 Sep 06 10:53:52.772376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7f3edb65-d268-4c8b-8c23-0e2abcc5fd18 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:52.776790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7f3edb65-d268-4c8b-8c23-0e2abcc5fd18 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:52.780066 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7f3edb65-d268-4c8b-8c23-0e2abcc5fd18 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1411 microversion: 2.25 time: 1.274908 Sep 06 10:53:52.783714 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 424/866] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:51 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1411 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:52.793280 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 443/867] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:52 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1293 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:52.808091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-13dafc4b-8f29-4e86-ab63-fad8d114088f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8c7eb80>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:53.591108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76df2b51-8583-4288-b383-b57db8802b59 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:53.597701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-76df2b51-8583-4288-b383-b57db8802b59 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Searching by: {'deleted': False, 'project_id': 'c848bf30ab3948549504d01b5bc5af06'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:53:53.609424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76df2b51-8583-4288-b383-b57db8802b59 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:53.614981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76df2b51-8583-4288-b383-b57db8802b59 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:53.615697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76df2b51-8583-4288-b383-b57db8802b59 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:53.616666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76df2b51-8583-4288-b383-b57db8802b59 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:53.617415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76df2b51-8583-4288-b383-b57db8802b59 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:53.618010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76df2b51-8583-4288-b383-b57db8802b59 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:53.768044 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-76df2b51-8583-4288-b383-b57db8802b59 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.971645 Sep 06 10:53:53.802540 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 444/868] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:53:52 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:53:53.818735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dd3e5c75-f209-41c5-9fa3-25778e5e3fa1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:53.819471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dd3e5c75-f209-41c5-9fa3-25778e5e3fa1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:53.836889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd3e5c75-f209-41c5-9fa3-25778e5e3fa1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:53.837496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd3e5c75-f209-41c5-9fa3-25778e5e3fa1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:53.838047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd3e5c75-f209-41c5-9fa3-25778e5e3fa1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:53.838879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd3e5c75-f209-41c5-9fa3-25778e5e3fa1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:53.843351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd3e5c75-f209-41c5-9fa3-25778e5e3fa1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:53.843891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd3e5c75-f209-41c5-9fa3-25778e5e3fa1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:54.195276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dd3e5c75-f209-41c5-9fa3-25778e5e3fa1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:54.212885 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dd3e5c75-f209-41c5-9fa3-25778e5e3fa1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1325 microversion: 2.1 time: 0.403536 Sep 06 10:53:54.214954 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 445/869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:53 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1325 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:54.232045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-df7c0144-b017-4b75-bdf6-58da4c3942ef req-a870b49f-e08e-46bb-97a5-6c8d47d35aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdba9b97-4ac9-425a-93bf-efc405463026", "name": "network-vif-plugged", "status": "completed", "tag": "c993e7ce-f4ac-4c50-8fae-67c9b2f4e028"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:54.293553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-df7c0144-b017-4b75-bdf6-58da4c3942ef req-a870b49f-e08e-46bb-97a5-6c8d47d35aca service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:54.297080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-df7c0144-b017-4b75-bdf6-58da4c3942ef req-a870b49f-e08e-46bb-97a5-6c8d47d35aca service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:54.297728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-df7c0144-b017-4b75-bdf6-58da4c3942ef req-a870b49f-e08e-46bb-97a5-6c8d47d35aca service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:54.344959 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-df7c0144-b017-4b75-bdf6-58da4c3942ef req-a870b49f-e08e-46bb-97a5-6c8d47d35aca service nova] Creating event network-vif-plugged:c993e7ce-f4ac-4c50-8fae-67c9b2f4e028 for instance cdba9b97-4ac9-425a-93bf-efc405463026 on nch2-master-1 Sep 06 10:53:54.358877 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-df7c0144-b017-4b75-bdf6-58da4c3942ef req-a870b49f-e08e-46bb-97a5-6c8d47d35aca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142118 Sep 06 10:53:54.364110 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 446/870] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:53:54.376174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d639555b-b501-4556-8120-a0d76a92f4ef tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:54.399512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d639555b-b501-4556-8120-a0d76a92f4ef tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Searching by: {'deleted': False} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:53:54.416030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d639555b-b501-4556-8120-a0d76a92f4ef tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:54.417415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d639555b-b501-4556-8120-a0d76a92f4ef tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:54.421022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d639555b-b501-4556-8120-a0d76a92f4ef tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:54.422046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d639555b-b501-4556-8120-a0d76a92f4ef tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:54.422699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d639555b-b501-4556-8120-a0d76a92f4ef tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:54.424499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d639555b-b501-4556-8120-a0d76a92f4ef tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:54.837632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-d639555b-b501-4556-8120-a0d76a92f4ef tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:53:55.167113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=25 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:55.196100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d639555b-b501-4556-8120-a0d76a92f4ef tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:55.203737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d639555b-b501-4556-8120-a0d76a92f4ef tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:55.204569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d639555b-b501-4556-8120-a0d76a92f4ef tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:57.409757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:57.998951 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d639555b-b501-4556-8120-a0d76a92f4ef tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17494 microversion: 2.1 time: 3.633245 Sep 06 10:53:58.013748 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 447/871] 10.222.0.20 () {58 vars in 1171 bytes} [Tue Sep 6 10:53:54 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17494 bytes in 3635 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:53:58.013748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6bbaf488-254d-4d9a-9ab5-4a1a8006093a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:58.013748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6bbaf488-254d-4d9a-9ab5-4a1a8006093a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:58.039157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6bbaf488-254d-4d9a-9ab5-4a1a8006093a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:58.046376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6bbaf488-254d-4d9a-9ab5-4a1a8006093a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:58.056303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6bbaf488-254d-4d9a-9ab5-4a1a8006093a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:58.057141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6bbaf488-254d-4d9a-9ab5-4a1a8006093a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:58.057714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6bbaf488-254d-4d9a-9ab5-4a1a8006093a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:58.058065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6bbaf488-254d-4d9a-9ab5-4a1a8006093a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:58.308332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6bbaf488-254d-4d9a-9ab5-4a1a8006093a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:58.316424 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6bbaf488-254d-4d9a-9ab5-4a1a8006093a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1360 microversion: 2.1 time: 0.315235 Sep 06 10:53:58.317010 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 448/872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:58 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1360 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:58.321563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-136b49a7-591b-42ec-888d-800deba5d21d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:58.322201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-136b49a7-591b-42ec-888d-800deba5d21d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:58.328634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-136b49a7-591b-42ec-888d-800deba5d21d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:58.329118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-136b49a7-591b-42ec-888d-800deba5d21d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:58.329597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-136b49a7-591b-42ec-888d-800deba5d21d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:58.330289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-136b49a7-591b-42ec-888d-800deba5d21d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:58.330753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-136b49a7-591b-42ec-888d-800deba5d21d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:58.331222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-136b49a7-591b-42ec-888d-800deba5d21d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:58.471415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-136b49a7-591b-42ec-888d-800deba5d21d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:58.480276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-136b49a7-591b-42ec-888d-800deba5d21d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:58.482058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-136b49a7-591b-42ec-888d-800deba5d21d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:58.483259 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-136b49a7-591b-42ec-888d-800deba5d21d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1411 microversion: 2.25 time: 0.165232 Sep 06 10:53:58.483820 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 449/873] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:53:58 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1411 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:53:58.488454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f010ef61-5f1a-4618-a471-bc645074d92e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:58.489265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f010ef61-5f1a-4618-a471-bc645074d92e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:53:58.496440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f010ef61-5f1a-4618-a471-bc645074d92e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:58.497139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f010ef61-5f1a-4618-a471-bc645074d92e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:58.497877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f010ef61-5f1a-4618-a471-bc645074d92e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:58.498955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f010ef61-5f1a-4618-a471-bc645074d92e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:58.499534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f010ef61-5f1a-4618-a471-bc645074d92e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:58.500335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f010ef61-5f1a-4618-a471-bc645074d92e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:58.646438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f010ef61-5f1a-4618-a471-bc645074d92e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:53:58.654233 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f010ef61-5f1a-4618-a471-bc645074d92e tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1325 microversion: 2.1 time: 0.169453 Sep 06 10:53:58.656932 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 450/874] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:53:58 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1325 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:58.659169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76091bd5-7f7e-46da-9240-0194a59d4ff0 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:58.664212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-76091bd5-7f7e-46da-9240-0194a59d4ff0 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Searching by: {'deleted': False, 'project_id': 'c848bf30ab3948549504d01b5bc5af06'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:53:58.669184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76091bd5-7f7e-46da-9240-0194a59d4ff0 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:58.669739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76091bd5-7f7e-46da-9240-0194a59d4ff0 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:58.670174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76091bd5-7f7e-46da-9240-0194a59d4ff0 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:58.670894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76091bd5-7f7e-46da-9240-0194a59d4ff0 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:58.671377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76091bd5-7f7e-46da-9240-0194a59d4ff0 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:58.671798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76091bd5-7f7e-46da-9240-0194a59d4ff0 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:58.705236 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-76091bd5-7f7e-46da-9240-0194a59d4ff0 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?tenant_id=37509f3214ec4a83a0db84a1c5377690" status: 200 len: 15 microversion: 2.1 time: 0.049259 Sep 06 10:53:58.705957 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 451/875] 10.222.0.20 () {58 vars in 1231 bytes} [Tue Sep 6 10:53:58 2022] GET /compute/v2.1/servers/detail?tenant_id=37509f3214ec4a83a0db84a1c5377690 => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:53:58.820022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2056520008", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:53:59.516340 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-13dafc4b-8f29-4e86-ab63-fad8d114088f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1412 microversion: 2.1 time: 6.727566 Sep 06 10:53:59.523552 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 425/876] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:52 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1412 bytes in 6734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:53:59.525117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:53:59.532268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9068089-d482-4d7b-ac24-a4b23d7751da tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:53:59.554842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c9068089-d482-4d7b-ac24-a4b23d7751da tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Searching by: {'tenant_id': '37509f3214ec4a83a0db84a1c5377690', 'deleted': False} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:53:59.571003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9068089-d482-4d7b-ac24-a4b23d7751da tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:59.575883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9068089-d482-4d7b-ac24-a4b23d7751da tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:59.577802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9068089-d482-4d7b-ac24-a4b23d7751da tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:59.579643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9068089-d482-4d7b-ac24-a4b23d7751da tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:59.580151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9068089-d482-4d7b-ac24-a4b23d7751da tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:59.580606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9068089-d482-4d7b-ac24-a4b23d7751da tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:59.714886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=18 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:59.813142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-c9068089-d482-4d7b-ac24-a4b23d7751da tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:53:59.852508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:53:59.852939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:53:59.853422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:53:59.854350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:53:59.854775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:53:59.870613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:59.871518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:59.872164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:59.873156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:59.873886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:59.874521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:59.931541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Getting quotas for project 3f02d8ddd39f4d8b93a44ee6295dc7f8. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:53:59.932711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:59.944876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Getting quotas for user 8affa67bb57f451b94d1eded04b1782a and project 3f02d8ddd39f4d8b93a44ee6295dc7f8. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:53:59.960103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9068089-d482-4d7b-ac24-a4b23d7751da tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:53:59.960103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9068089-d482-4d7b-ac24-a4b23d7751da tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:53:59.960103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9068089-d482-4d7b-ac24-a4b23d7751da tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:53:59.981112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:53:59.984126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:54:00.157237 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f3961830-e5c0-436a-8516-15aad32c7f2c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.449795 Sep 06 10:54:00.177713 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 452/877] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:53:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:54:00.192297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-93b37128-1761-4822-8721-e1d74b219c4f req-86ee8d47-74a0-4a08-8930-a9b9f2c2607e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21485351-3c21-4970-9d57-310eff94abb2", "tag": "7ac72bf1-22cc-4a06-8e37-4e7576503af8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:00.219821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-93b37128-1761-4822-8721-e1d74b219c4f req-86ee8d47-74a0-4a08-8930-a9b9f2c2607e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:00.220782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-93b37128-1761-4822-8721-e1d74b219c4f req-86ee8d47-74a0-4a08-8930-a9b9f2c2607e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:00.221394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-93b37128-1761-4822-8721-e1d74b219c4f req-86ee8d47-74a0-4a08-8930-a9b9f2c2607e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:00.222084 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c9068089-d482-4d7b-ac24-a4b23d7751da tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=37509f3214ec4a83a0db84a1c5377690" status: 200 len: 4825 microversion: 2.1 time: 0.701689 Sep 06 10:54:00.226018 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 426/878] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Sep 6 10:53:59 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=37509f3214ec4a83a0db84a1c5377690 => generated 4825 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:00.231507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e62af1a5-fb6f-40e7-8300-45dcd9aff96c req-f4852bf0-693b-4c84-93dc-3837a2811a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb41f601-678e-42fe-822f-ac8f2272bc38", "tag": "5ff2bf28-9bc0-492e-8394-2905d05bc3a7"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:00.251997 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-93b37128-1761-4822-8721-e1d74b219c4f req-86ee8d47-74a0-4a08-8930-a9b9f2c2607e service nova] Creating event network-changed:7ac72bf1-22cc-4a06-8e37-4e7576503af8 for instance 21485351-3c21-4970-9d57-310eff94abb2 on nch2-master-1 Sep 06 10:54:00.258552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e62af1a5-fb6f-40e7-8300-45dcd9aff96c req-f4852bf0-693b-4c84-93dc-3837a2811a4f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:00.258774 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-93b37128-1761-4822-8721-e1d74b219c4f req-86ee8d47-74a0-4a08-8930-a9b9f2c2607e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079037 Sep 06 10:54:00.259453 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 453/879] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:00.259628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e62af1a5-fb6f-40e7-8300-45dcd9aff96c req-f4852bf0-693b-4c84-93dc-3837a2811a4f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:00.260771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e62af1a5-fb6f-40e7-8300-45dcd9aff96c req-f4852bf0-693b-4c84-93dc-3837a2811a4f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:00.270745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-162e22d4-2b58-411e-9eb5-e18781a459ba tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:00.271759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-162e22d4-2b58-411e-9eb5-e18781a459ba tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:00.280597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-162e22d4-2b58-411e-9eb5-e18781a459ba tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:00.281343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-162e22d4-2b58-411e-9eb5-e18781a459ba tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:00.282010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-162e22d4-2b58-411e-9eb5-e18781a459ba tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:00.283170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-162e22d4-2b58-411e-9eb5-e18781a459ba tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:00.283596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-162e22d4-2b58-411e-9eb5-e18781a459ba tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:00.287135 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e62af1a5-fb6f-40e7-8300-45dcd9aff96c req-f4852bf0-693b-4c84-93dc-3837a2811a4f service nova] Creating event network-changed:5ff2bf28-9bc0-492e-8394-2905d05bc3a7 for instance eb41f601-678e-42fe-822f-ac8f2272bc38 on nch2-master-1 Sep 06 10:54:00.289978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-162e22d4-2b58-411e-9eb5-e18781a459ba tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:00.293313 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e62af1a5-fb6f-40e7-8300-45dcd9aff96c req-f4852bf0-693b-4c84-93dc-3837a2811a4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065722 Sep 06 10:54:00.294566 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 427/880] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:00.461160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-162e22d4-2b58-411e-9eb5-e18781a459ba tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:00.471702 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-162e22d4-2b58-411e-9eb5-e18781a459ba tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1360 microversion: 2.1 time: 0.207410 Sep 06 10:54:00.492924 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 454/881] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:00 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1360 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:00.494676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2a3d2570-828b-46fc-b178-1ff4259746fe tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:00.496075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2a3d2570-828b-46fc-b178-1ff4259746fe tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:00.503998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a3d2570-828b-46fc-b178-1ff4259746fe tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:00.504769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a3d2570-828b-46fc-b178-1ff4259746fe tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:00.505392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a3d2570-828b-46fc-b178-1ff4259746fe tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:00.506288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a3d2570-828b-46fc-b178-1ff4259746fe tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:00.506910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a3d2570-828b-46fc-b178-1ff4259746fe tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:00.507524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a3d2570-828b-46fc-b178-1ff4259746fe tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:00.646213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-61436163-ce25-40ba-8de3-28026f1a9bf6 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Action: 'create', calling method: .version_select at 0x7f90f8bc00d0>, body: {"keypair": {"name": "tempest-keypair-1927624671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvfmnlTd84hiaHt/vj2NEK9KktRI2LJwZPMzX3edqCRZ1KK6mELzISrKQy9vVCbyJZNnQJFosKu6BoOzAjMDGfUdoYVZqfbBkFJtsDq8DS+3jhKi4wO51yUNy7LIyRPIg=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:00.665807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-61436163-ce25-40ba-8de3-28026f1a9bf6 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Getting quotas for project c75bc66c9c9b4fc4b76380e47b40b0b5. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:00.696493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-61436163-ce25-40ba-8de3-28026f1a9bf6 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Getting quotas for user 6559ac446c4640218ce700687045bb0d and project c75bc66c9c9b4fc4b76380e47b40b0b5. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:00.725488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2a3d2570-828b-46fc-b178-1ff4259746fe tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:00.741828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2a3d2570-828b-46fc-b178-1ff4259746fe tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:00.748503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2a3d2570-828b-46fc-b178-1ff4259746fe tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:00.752559 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2a3d2570-828b-46fc-b178-1ff4259746fe tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1411 microversion: 2.25 time: 0.263269 Sep 06 10:54:00.756394 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 455/882] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:54:00 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1411 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:54:00.766533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3396eaa0-e9e0-4c3e-a2db-72409e059ac9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:00.768462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3396eaa0-e9e0-4c3e-a2db-72409e059ac9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:00.786417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3396eaa0-e9e0-4c3e-a2db-72409e059ac9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:00.786925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3396eaa0-e9e0-4c3e-a2db-72409e059ac9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:00.787980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3396eaa0-e9e0-4c3e-a2db-72409e059ac9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:00.788723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3396eaa0-e9e0-4c3e-a2db-72409e059ac9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:00.789190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3396eaa0-e9e0-4c3e-a2db-72409e059ac9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:00.789625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3396eaa0-e9e0-4c3e-a2db-72409e059ac9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:00.850527 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-61436163-ce25-40ba-8de3-28026f1a9bf6 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.554507 Sep 06 10:54:00.852326 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 428/883] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:54:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:00.871940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eff256f7-6e86-4dbe-bcef-8d678b6fbe8a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:00.873986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-eff256f7-6e86-4dbe-bcef-8d678b6fbe8a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:01.512932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-eff256f7-6e86-4dbe-bcef-8d678b6fbe8a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:01.540137 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-eff256f7-6e86-4dbe-bcef-8d678b6fbe8a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1219 microversion: 2.1 time: 0.676463 Sep 06 10:54:01.559285 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 429/884] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:00 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1219 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:01.578868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b57b0101-791d-4e8e-a10e-37c192bd0999 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:01.592003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b57b0101-791d-4e8e-a10e-37c192bd0999 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Searching by: {'tenant_id': 'c848bf30ab3948549504d01b5bc5af06', 'deleted': False} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:54:01.626052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b57b0101-791d-4e8e-a10e-37c192bd0999 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:01.626612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b57b0101-791d-4e8e-a10e-37c192bd0999 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:01.627340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b57b0101-791d-4e8e-a10e-37c192bd0999 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:01.628128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b57b0101-791d-4e8e-a10e-37c192bd0999 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:01.628591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b57b0101-791d-4e8e-a10e-37c192bd0999 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:01.629024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b57b0101-791d-4e8e-a10e-37c192bd0999 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:01.732059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3396eaa0-e9e0-4c3e-a2db-72409e059ac9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:01.738788 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b57b0101-791d-4e8e-a10e-37c192bd0999 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c848bf30ab3948549504d01b5bc5af06" status: 200 len: 15 microversion: 2.1 time: 0.176783 Sep 06 10:54:01.738788 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 430/885] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Sep 6 10:54:01 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c848bf30ab3948549504d01b5bc5af06 => generated 15 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:54:01.749939 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3396eaa0-e9e0-4c3e-a2db-72409e059ac9 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1325 microversion: 2.1 time: 0.990432 Sep 06 10:54:01.763673 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 456/886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:00 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1325 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:01.775482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d9ead2b8-c88a-4bed-9497-d6023737186c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8c7e9d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:01.841012 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d9ead2b8-c88a-4bed-9497-d6023737186c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1412 microversion: 2.1 time: 0.080596 Sep 06 10:54:01.842039 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 431/887] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:54:01 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:01.847776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1d345300-3d89-4cbc-b104-88c1902fb7b1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:01.848744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1d345300-3d89-4cbc-b104-88c1902fb7b1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:01.857510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d345300-3d89-4cbc-b104-88c1902fb7b1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:01.858382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d345300-3d89-4cbc-b104-88c1902fb7b1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:01.859264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d345300-3d89-4cbc-b104-88c1902fb7b1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:01.860485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d345300-3d89-4cbc-b104-88c1902fb7b1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:01.861167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d345300-3d89-4cbc-b104-88c1902fb7b1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:01.861808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d345300-3d89-4cbc-b104-88c1902fb7b1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:01.876067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1730807128", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "d007355a-8137-418e-b0f5-eedcd060d4ec"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:02.014273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] validate_networks() for [('d007355a-8137-418e-b0f5-eedcd060d4ec', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:54:02.206204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1d345300-3d89-4cbc-b104-88c1902fb7b1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:02.215856 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1d345300-3d89-4cbc-b104-88c1902fb7b1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1360 microversion: 2.1 time: 0.371994 Sep 06 10:54:02.219873 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 432/888] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:01 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1360 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:02.234635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bbcbdbd6-f878-403f-a5a9-8e39017308b6 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:02.247117 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bbcbdbd6-f878-403f-a5a9-8e39017308b6 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.023947 Sep 06 10:54:02.252764 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 433/889] 10.222.0.20 () {58 vars in 1189 bytes} [Tue Sep 6 10:54:02 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:54:02.265350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-87fb3874-6025-4164-b09f-a385a10c31fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:02.274617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-87fb3874-6025-4164-b09f-a385a10c31fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:02.287832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:02.289422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87fb3874-6025-4164-b09f-a385a10c31fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:02.289924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87fb3874-6025-4164-b09f-a385a10c31fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:02.290372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87fb3874-6025-4164-b09f-a385a10c31fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:02.296009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87fb3874-6025-4164-b09f-a385a10c31fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:02.296703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87fb3874-6025-4164-b09f-a385a10c31fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:02.297183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87fb3874-6025-4164-b09f-a385a10c31fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:02.864262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-87fb3874-6025-4164-b09f-a385a10c31fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:02.874572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-87fb3874-6025-4164-b09f-a385a10c31fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:02.891207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-87fb3874-6025-4164-b09f-a385a10c31fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:02.891207 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-87fb3874-6025-4164-b09f-a385a10c31fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1411 microversion: 2.25 time: 0.624350 Sep 06 10:54:02.900746 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 434/890] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:54:02 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1411 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:54:02.906083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-7a26a5ac-4307-4c1d-82ad-8632de5388c4 req-e21f0daa-7b2b-40e1-8453-28fd1d5ea441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a4ea2a-aa16-4e41-af83-b027dfe81828", "name": "network-vif-plugged", "status": "completed", "tag": "9fd60b84-0b14-41da-8bad-24a891e8dd1d"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:02.917768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7a26a5ac-4307-4c1d-82ad-8632de5388c4 req-e21f0daa-7b2b-40e1-8453-28fd1d5ea441 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:02.918532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7a26a5ac-4307-4c1d-82ad-8632de5388c4 req-e21f0daa-7b2b-40e1-8453-28fd1d5ea441 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:02.919772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7a26a5ac-4307-4c1d-82ad-8632de5388c4 req-e21f0daa-7b2b-40e1-8453-28fd1d5ea441 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:02.934988 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7a26a5ac-4307-4c1d-82ad-8632de5388c4 req-e21f0daa-7b2b-40e1-8453-28fd1d5ea441 service nova] Creating event network-vif-plugged:9fd60b84-0b14-41da-8bad-24a891e8dd1d for instance 31a4ea2a-aa16-4e41-af83-b027dfe81828 on nch1-master-1 Sep 06 10:54:02.943478 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-7a26a5ac-4307-4c1d-82ad-8632de5388c4 req-e21f0daa-7b2b-40e1-8453-28fd1d5ea441 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038315 Sep 06 10:54:02.943478 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 435/891] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:02.948392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ee028a17-c8f2-45bd-8fda-d52010cd7e39 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:02.951361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ee028a17-c8f2-45bd-8fda-d52010cd7e39 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:02.959932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee028a17-c8f2-45bd-8fda-d52010cd7e39 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:02.960845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee028a17-c8f2-45bd-8fda-d52010cd7e39 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:02.961509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee028a17-c8f2-45bd-8fda-d52010cd7e39 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:02.962478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee028a17-c8f2-45bd-8fda-d52010cd7e39 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:02.963241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee028a17-c8f2-45bd-8fda-d52010cd7e39 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:02.963997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee028a17-c8f2-45bd-8fda-d52010cd7e39 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:03.290185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:54:03.290772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:54:03.294673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:54:03.295273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:54:03.297424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:54:03.308401 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ee028a17-c8f2-45bd-8fda-d52010cd7e39 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action" status: 202 len: 0 microversion: 2.1 time: 0.365396 Sep 06 10:54:03.309290 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 436/892] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:54:02 2022] POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:54:03.315027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd066e8a-8f2e-41a2-8009-ac5618066f26 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:03.315027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fd066e8a-8f2e-41a2-8009-ac5618066f26 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:03.321793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:03.325683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:03.326392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:03.327585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd066e8a-8f2e-41a2-8009-ac5618066f26 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:03.328089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd066e8a-8f2e-41a2-8009-ac5618066f26 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:03.328209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:03.328537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd066e8a-8f2e-41a2-8009-ac5618066f26 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:03.328852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:03.329255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd066e8a-8f2e-41a2-8009-ac5618066f26 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:03.329477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:03.329721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd066e8a-8f2e-41a2-8009-ac5618066f26 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:03.330155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd066e8a-8f2e-41a2-8009-ac5618066f26 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:03.376085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Getting quotas for project aa352b4d4810484688d325ca4bb25193. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:03.383471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Getting quotas for user 24d86f8c8ece4257adc548304465f191 and project aa352b4d4810484688d325ca4bb25193. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:03.401565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:54:03.404814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:54:03.444529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fd066e8a-8f2e-41a2-8009-ac5618066f26 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:03.461211 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd066e8a-8f2e-41a2-8009-ac5618066f26 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1215 microversion: 2.1 time: 0.145930 Sep 06 10:54:03.461211 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 437/893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:03 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:03.467264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-03d94f4d-47bf-4f53-851f-4547ba356d6c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:03.468337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-03d94f4d-47bf-4f53-851f-4547ba356d6c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:03.484661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03d94f4d-47bf-4f53-851f-4547ba356d6c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:03.485874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03d94f4d-47bf-4f53-851f-4547ba356d6c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:03.486602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03d94f4d-47bf-4f53-851f-4547ba356d6c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:03.487608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03d94f4d-47bf-4f53-851f-4547ba356d6c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:03.488341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03d94f4d-47bf-4f53-851f-4547ba356d6c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:03.489053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03d94f4d-47bf-4f53-851f-4547ba356d6c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:03.666997 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c70410e2-0bed-4138-a832-2b14b7595bca tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.901853 Sep 06 10:54:03.679694 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 457/894] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:54:03.698309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7006bbc-cd6f-491a-9ff3-36d787e759eb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8796280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:03.809045 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d7006bbc-cd6f-491a-9ff3-36d787e759eb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1412 microversion: 2.1 time: 0.128090 Sep 06 10:54:03.809710 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 458/895] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:54:03 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1412 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:03.814323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-03d94f4d-47bf-4f53-851f-4547ba356d6c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:03.827786 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-03d94f4d-47bf-4f53-851f-4547ba356d6c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1325 microversion: 2.1 time: 0.365151 Sep 06 10:54:03.829766 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 438/896] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:03 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1325 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:03.836416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7db4f1b1-1ef1-4ecd-92b4-90ba2076519e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:03.849274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ceffc4cf-bb1f-4c0c-88fe-919076293cd0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:03.851367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7db4f1b1-1ef1-4ecd-92b4-90ba2076519e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:03.855591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7db4f1b1-1ef1-4ecd-92b4-90ba2076519e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '37509f3214ec4a83a0db84a1c5377690'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:54:03.856491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ceffc4cf-bb1f-4c0c-88fe-919076293cd0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:03.870953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7db4f1b1-1ef1-4ecd-92b4-90ba2076519e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:03.873648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7db4f1b1-1ef1-4ecd-92b4-90ba2076519e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:03.875482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7db4f1b1-1ef1-4ecd-92b4-90ba2076519e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:03.884188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7db4f1b1-1ef1-4ecd-92b4-90ba2076519e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:03.887601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7db4f1b1-1ef1-4ecd-92b4-90ba2076519e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:03.888322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7db4f1b1-1ef1-4ecd-92b4-90ba2076519e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:03.898666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ceffc4cf-bb1f-4c0c-88fe-919076293cd0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:03.901640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ceffc4cf-bb1f-4c0c-88fe-919076293cd0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:03.905260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ceffc4cf-bb1f-4c0c-88fe-919076293cd0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:03.910158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ceffc4cf-bb1f-4c0c-88fe-919076293cd0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:03.912476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ceffc4cf-bb1f-4c0c-88fe-919076293cd0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:03.913031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ceffc4cf-bb1f-4c0c-88fe-919076293cd0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:03.983445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:04.125991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-7db4f1b1-1ef1-4ecd-92b4-90ba2076519e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:54:04.252235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ceffc4cf-bb1f-4c0c-88fe-919076293cd0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:04.263285 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ceffc4cf-bb1f-4c0c-88fe-919076293cd0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1360 microversion: 2.1 time: 0.434227 Sep 06 10:54:04.285331 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 459/897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:03 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1360 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:04.302578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba68c555-0efb-45c4-8e08-687729b8d491 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:04.303387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ba68c555-0efb-45c4-8e08-687729b8d491 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:04.336632 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7db4f1b1-1ef1-4ecd-92b4-90ba2076519e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.506707 Sep 06 10:54:04.337763 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 439/898] 10.222.0.20 () {58 vars in 1150 bytes} [Tue Sep 6 10:54:03 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:04.343740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cc341cf0-906b-45c7-9505-2535b2a3fcad tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:04.345067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cc341cf0-906b-45c7-9505-2535b2a3fcad tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:04.352034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc341cf0-906b-45c7-9505-2535b2a3fcad tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:04.352971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc341cf0-906b-45c7-9505-2535b2a3fcad tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:04.354357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc341cf0-906b-45c7-9505-2535b2a3fcad tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:04.355305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc341cf0-906b-45c7-9505-2535b2a3fcad tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:04.356046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc341cf0-906b-45c7-9505-2535b2a3fcad tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:04.356660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc341cf0-906b-45c7-9505-2535b2a3fcad tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:04.441438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ba68c555-0efb-45c4-8e08-687729b8d491 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:04.451029 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ba68c555-0efb-45c4-8e08-687729b8d491 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1224 microversion: 2.1 time: 0.164345 Sep 06 10:54:04.454082 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 460/899] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:04 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1224 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:04.462286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-506d5784-6d64-436b-9550-ab0772386d61 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:04.478315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-506d5784-6d64-436b-9550-ab0772386d61 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:04.512180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-506d5784-6d64-436b-9550-ab0772386d61 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:04.515070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-506d5784-6d64-436b-9550-ab0772386d61 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:04.517587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-506d5784-6d64-436b-9550-ab0772386d61 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:04.522135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-506d5784-6d64-436b-9550-ab0772386d61 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:04.522765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-506d5784-6d64-436b-9550-ab0772386d61 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:04.523359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-506d5784-6d64-436b-9550-ab0772386d61 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:04.690858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cc341cf0-906b-45c7-9505-2535b2a3fcad tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:04.706066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cc341cf0-906b-45c7-9505-2535b2a3fcad tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:04.711060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cc341cf0-906b-45c7-9505-2535b2a3fcad tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:04.716965 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cc341cf0-906b-45c7-9505-2535b2a3fcad tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1411 microversion: 2.25 time: 0.377933 Sep 06 10:54:04.718260 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 440/900] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:54:04 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1411 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:54:04.730319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-734e88fe-0c34-436d-8952-e70ab7317d41 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:04.732911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-734e88fe-0c34-436d-8952-e70ab7317d41 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:04.772544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-734e88fe-0c34-436d-8952-e70ab7317d41 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:04.775258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-734e88fe-0c34-436d-8952-e70ab7317d41 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:04.776794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-734e88fe-0c34-436d-8952-e70ab7317d41 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:04.780587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-734e88fe-0c34-436d-8952-e70ab7317d41 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:04.783402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-734e88fe-0c34-436d-8952-e70ab7317d41 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:04.785616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-734e88fe-0c34-436d-8952-e70ab7317d41 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:04.896421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-734e88fe-0c34-436d-8952-e70ab7317d41 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:04.909233 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-734e88fe-0c34-436d-8952-e70ab7317d41 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1271 microversion: 2.1 time: 0.188794 Sep 06 10:54:04.911611 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 441/901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:04 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:04.918755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bc8a28d2-5d35-4f7f-9942-038884f3485c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8d94dc0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:05.038753 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bc8a28d2-5d35-4f7f-9942-038884f3485c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1412 microversion: 2.1 time: 0.125593 Sep 06 10:54:05.039372 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 442/902] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:54:04 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:05.047392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca251196-ceb4-4e35-b3fa-0c3d46886b96 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:05.047824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca251196-ceb4-4e35-b3fa-0c3d46886b96 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:05.055257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca251196-ceb4-4e35-b3fa-0c3d46886b96 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:05.055771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca251196-ceb4-4e35-b3fa-0c3d46886b96 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:05.056198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca251196-ceb4-4e35-b3fa-0c3d46886b96 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:05.057451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca251196-ceb4-4e35-b3fa-0c3d46886b96 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:05.057910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca251196-ceb4-4e35-b3fa-0c3d46886b96 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:05.058341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca251196-ceb4-4e35-b3fa-0c3d46886b96 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:05.070758 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-506d5784-6d64-436b-9550-ab0772386d61 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action" status: 202 len: 0 microversion: 2.1 time: 0.614954 Sep 06 10:54:05.074959 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 461/903] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:54:04 2022] POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:54:05.088255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-050c4215-d5a4-4402-87f4-8b2c448d5ba5 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:05.088890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-050c4215-d5a4-4402-87f4-8b2c448d5ba5 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:05.108064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-050c4215-d5a4-4402-87f4-8b2c448d5ba5 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:05.108807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-050c4215-d5a4-4402-87f4-8b2c448d5ba5 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:05.110188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-050c4215-d5a4-4402-87f4-8b2c448d5ba5 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:05.110188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-050c4215-d5a4-4402-87f4-8b2c448d5ba5 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:05.110863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-050c4215-d5a4-4402-87f4-8b2c448d5ba5 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:05.111473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-050c4215-d5a4-4402-87f4-8b2c448d5ba5 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:05.406571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ca251196-ceb4-4e35-b3fa-0c3d46886b96 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:05.414783 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ca251196-ceb4-4e35-b3fa-0c3d46886b96 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1325 microversion: 2.1 time: 0.374367 Sep 06 10:54:05.435043 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 443/904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:05 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:05.444006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-caaf18ce-52cb-41f3-b950-714eed71113f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:05.444789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-caaf18ce-52cb-41f3-b950-714eed71113f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:05.480596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-caaf18ce-52cb-41f3-b950-714eed71113f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:05.483873 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-050c4215-d5a4-4402-87f4-8b2c448d5ba5 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1614 microversion: 2.1 time: 0.403856 Sep 06 10:54:05.484319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-caaf18ce-52cb-41f3-b950-714eed71113f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:05.484319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-caaf18ce-52cb-41f3-b950-714eed71113f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:05.484499 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 462/905] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:05 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1614 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:05.484577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-caaf18ce-52cb-41f3-b950-714eed71113f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:05.484799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-caaf18ce-52cb-41f3-b950-714eed71113f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:05.485487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-caaf18ce-52cb-41f3-b950-714eed71113f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:05.487674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-11e05e08-2cf9-4e7e-a98b-f1acb325623a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:05.488304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-11e05e08-2cf9-4e7e-a98b-f1acb325623a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:05.613855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-11e05e08-2cf9-4e7e-a98b-f1acb325623a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:05.655327 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-11e05e08-2cf9-4e7e-a98b-f1acb325623a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1224 microversion: 2.1 time: 0.171730 Sep 06 10:54:05.672330 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 463/906] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:05 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1224 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:05.682731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2c259adf-cdd4-47f0-9d0a-2d35841d2c87 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:05.683631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2c259adf-cdd4-47f0-9d0a-2d35841d2c87 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:05.690509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c259adf-cdd4-47f0-9d0a-2d35841d2c87 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:05.691641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c259adf-cdd4-47f0-9d0a-2d35841d2c87 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:05.692644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c259adf-cdd4-47f0-9d0a-2d35841d2c87 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:05.693533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c259adf-cdd4-47f0-9d0a-2d35841d2c87 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:05.694183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c259adf-cdd4-47f0-9d0a-2d35841d2c87 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:05.694762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c259adf-cdd4-47f0-9d0a-2d35841d2c87 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:05.867396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-caaf18ce-52cb-41f3-b950-714eed71113f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:05.867396 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-caaf18ce-52cb-41f3-b950-714eed71113f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1360 microversion: 2.1 time: 0.361367 Sep 06 10:54:05.867396 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 444/907] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:05 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1360 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:05.867396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ab3c411c-8fa9-47ea-b123-891eefd7c25b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:05.868307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ab3c411c-8fa9-47ea-b123-891eefd7c25b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:05.868307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab3c411c-8fa9-47ea-b123-891eefd7c25b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:05.868307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab3c411c-8fa9-47ea-b123-891eefd7c25b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:05.868307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab3c411c-8fa9-47ea-b123-891eefd7c25b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:05.868604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab3c411c-8fa9-47ea-b123-891eefd7c25b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:05.868604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab3c411c-8fa9-47ea-b123-891eefd7c25b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:05.868604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab3c411c-8fa9-47ea-b123-891eefd7c25b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:05.953511 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2c259adf-cdd4-47f0-9d0a-2d35841d2c87 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1614 microversion: 2.1 time: 0.279806 Sep 06 10:54:05.954272 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 464/908] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:05 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1614 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:05.960201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dd6f50f5-ad14-495a-a9cc-b225ff726fb6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:05.960951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dd6f50f5-ad14-495a-a9cc-b225ff726fb6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:05.966967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd6f50f5-ad14-495a-a9cc-b225ff726fb6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:05.967615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd6f50f5-ad14-495a-a9cc-b225ff726fb6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:05.968198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd6f50f5-ad14-495a-a9cc-b225ff726fb6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:05.969129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd6f50f5-ad14-495a-a9cc-b225ff726fb6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:05.969734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd6f50f5-ad14-495a-a9cc-b225ff726fb6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:05.970297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd6f50f5-ad14-495a-a9cc-b225ff726fb6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:06.009792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ab3c411c-8fa9-47ea-b123-891eefd7c25b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:06.022210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ab3c411c-8fa9-47ea-b123-891eefd7c25b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:06.024944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ab3c411c-8fa9-47ea-b123-891eefd7c25b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:06.026824 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ab3c411c-8fa9-47ea-b123-891eefd7c25b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1607 microversion: 2.25 time: 0.228762 Sep 06 10:54:06.040062 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 445/909] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:54:05 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1607 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:54:06.040062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ecfa1910-c467-4e65-ad98-f850afa9495d tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:06.045566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ecfa1910-c467-4e65-ad98-f850afa9495d tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:54:06.053470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dd6f50f5-ad14-495a-a9cc-b225ff726fb6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:06.062015 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dd6f50f5-ad14-495a-a9cc-b225ff726fb6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1271 microversion: 2.1 time: 0.106366 Sep 06 10:54:06.062874 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 465/910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:05 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:06.063754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecfa1910-c467-4e65-ad98-f850afa9495d tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:06.064637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecfa1910-c467-4e65-ad98-f850afa9495d tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:06.065319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecfa1910-c467-4e65-ad98-f850afa9495d tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:06.066381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecfa1910-c467-4e65-ad98-f850afa9495d tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:06.067093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecfa1910-c467-4e65-ad98-f850afa9495d tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:06.067464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4bbcc6b5-763f-4a5e-87b6-40ab601419f6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8921160>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:06.068180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecfa1910-c467-4e65-ad98-f850afa9495d tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:06.111695 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4bbcc6b5-763f-4a5e-87b6-40ab601419f6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1412 microversion: 2.1 time: 0.047619 Sep 06 10:54:06.112265 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 466/911] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:54:06 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1412 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:06.116910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a2b502d4-5d05-4a16-9d7d-8fa44c1b4029 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:06.117625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a2b502d4-5d05-4a16-9d7d-8fa44c1b4029 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:06.124204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2b502d4-5d05-4a16-9d7d-8fa44c1b4029 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:06.124695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2b502d4-5d05-4a16-9d7d-8fa44c1b4029 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:06.125138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2b502d4-5d05-4a16-9d7d-8fa44c1b4029 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:06.125830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2b502d4-5d05-4a16-9d7d-8fa44c1b4029 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:06.126288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2b502d4-5d05-4a16-9d7d-8fa44c1b4029 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:06.126714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2b502d4-5d05-4a16-9d7d-8fa44c1b4029 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:06.180286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-ecfa1910-c467-4e65-ad98-f850afa9495d tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:54:06.254238 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a2b502d4-5d05-4a16-9d7d-8fa44c1b4029 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.140844 Sep 06 10:54:06.255609 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 467/912] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Sep 6 10:54:06 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:54:06.275954 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ecfa1910-c467-4e65-ad98-f850afa9495d tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 2327 microversion: 2.1 time: 0.246272 Sep 06 10:54:06.279175 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 446/913] 10.222.0.20 () {58 vars in 1190 bytes} [Tue Sep 6 10:54:06 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 2327 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:06.290751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0adab0c0-60f3-40b0-bb82-5e36fa13cb96 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:06.307405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0adab0c0-60f3-40b0-bb82-5e36fa13cb96 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:54:06.333684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0adab0c0-60f3-40b0-bb82-5e36fa13cb96 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:06.334604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0adab0c0-60f3-40b0-bb82-5e36fa13cb96 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:06.335707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0adab0c0-60f3-40b0-bb82-5e36fa13cb96 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:06.338355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0adab0c0-60f3-40b0-bb82-5e36fa13cb96 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:06.339040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0adab0c0-60f3-40b0-bb82-5e36fa13cb96 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:06.342782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0adab0c0-60f3-40b0-bb82-5e36fa13cb96 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:06.451916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-851eec60-473e-467a-8f0f-e2f27dfe06a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:06.452574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-851eec60-473e-467a-8f0f-e2f27dfe06a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:06.470173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-851eec60-473e-467a-8f0f-e2f27dfe06a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:06.476178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-851eec60-473e-467a-8f0f-e2f27dfe06a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:06.476974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-851eec60-473e-467a-8f0f-e2f27dfe06a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:06.478050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-851eec60-473e-467a-8f0f-e2f27dfe06a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:06.479432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-851eec60-473e-467a-8f0f-e2f27dfe06a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:06.480026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-851eec60-473e-467a-8f0f-e2f27dfe06a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:06.555678 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0adab0c0-60f3-40b0-bb82-5e36fa13cb96 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.268929 Sep 06 10:54:06.559021 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 468/914] 10.222.0.20 () {58 vars in 1196 bytes} [Tue Sep 6 10:54:06 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:54:06.573149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b0d08c42-d61e-4aae-b5fb-255333fc05b2 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:06.578971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b0d08c42-d61e-4aae-b5fb-255333fc05b2 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:06.594554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0d08c42-d61e-4aae-b5fb-255333fc05b2 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:06.598590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0d08c42-d61e-4aae-b5fb-255333fc05b2 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:06.599263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0d08c42-d61e-4aae-b5fb-255333fc05b2 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:06.600318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0d08c42-d61e-4aae-b5fb-255333fc05b2 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:06.600928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0d08c42-d61e-4aae-b5fb-255333fc05b2 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:06.602569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0d08c42-d61e-4aae-b5fb-255333fc05b2 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:06.613575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:07.065705 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b0d08c42-d61e-4aae-b5fb-255333fc05b2 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action" status: 202 len: 0 microversion: 2.1 time: 0.497447 Sep 06 10:54:07.066668 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 469/915] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:54:06 2022] POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 10:54:07.076066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-73909607", "imageRef": "034ec68f-6c77-4077-8823-27517fd027d3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4454c4a5-be77-47a7-b8f9-c00f4a86c855"}], "security_groups": [{"name": "tempest-securitygroup--796280910"}], "key_name": "tempest-keypair-1927624671", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:07.243265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-851eec60-473e-467a-8f0f-e2f27dfe06a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:07.254120 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-851eec60-473e-467a-8f0f-e2f27dfe06a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1325 microversion: 2.1 time: 0.808290 Sep 06 10:54:07.255111 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 447/916] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:06 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1325 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:07.267912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0b271a72-b8d9-4470-a891-8eec41120c8f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:07.267912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0b271a72-b8d9-4470-a891-8eec41120c8f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:07.278624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b271a72-b8d9-4470-a891-8eec41120c8f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:07.279670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b271a72-b8d9-4470-a891-8eec41120c8f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:07.280346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b271a72-b8d9-4470-a891-8eec41120c8f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:07.281302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b271a72-b8d9-4470-a891-8eec41120c8f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:07.281996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b271a72-b8d9-4470-a891-8eec41120c8f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:07.282649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b271a72-b8d9-4470-a891-8eec41120c8f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:07.418114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] validate_networks() for [('4454c4a5-be77-47a7-b8f9-c00f4a86c855', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:54:07.444344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0b271a72-b8d9-4470-a891-8eec41120c8f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:07.460654 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0b271a72-b8d9-4470-a891-8eec41120c8f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1220 microversion: 2.1 time: 0.204223 Sep 06 10:54:07.466165 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 448/917] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:07 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1220 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:07.474495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-056f4b66-9a38-469e-bdad-8dbcd8ad1d2e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:07.475472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-056f4b66-9a38-469e-bdad-8dbcd8ad1d2e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:07.483724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-056f4b66-9a38-469e-bdad-8dbcd8ad1d2e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:07.484752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-056f4b66-9a38-469e-bdad-8dbcd8ad1d2e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:07.485430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-056f4b66-9a38-469e-bdad-8dbcd8ad1d2e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:07.487311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-056f4b66-9a38-469e-bdad-8dbcd8ad1d2e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:07.488117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-056f4b66-9a38-469e-bdad-8dbcd8ad1d2e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:07.493497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-056f4b66-9a38-469e-bdad-8dbcd8ad1d2e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:08.364277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-056f4b66-9a38-469e-bdad-8dbcd8ad1d2e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:08.376325 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-056f4b66-9a38-469e-bdad-8dbcd8ad1d2e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1360 microversion: 2.1 time: 0.908519 Sep 06 10:54:08.378147 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 449/918] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:07 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1360 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:08.387212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:08.391523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:08.415315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:08.416666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:08.417548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:08.418617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:08.419602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:08.420196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:08.596432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:54:08.596868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:54:08.597350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:54:08.597770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:54:08.598192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:54:08.928315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:08.955098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:08.955638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:08.960647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:08.960647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:08.964292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:08.967657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:09.033129 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b59defcb-0191-462c-b6d2-f9ca3beac4ed tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action" status: 202 len: 1067 microversion: 2.1 time: 0.653644 Sep 06 10:54:09.043070 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 450/919] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:54:08 2022] POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action => generated 1067 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 06 10:54:09.043070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9b29963d-a8ac-407b-98a0-d0f244c6f4c8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:09.043070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9b29963d-a8ac-407b-98a0-d0f244c6f4c8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:09.047344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b29963d-a8ac-407b-98a0-d0f244c6f4c8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:09.047857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b29963d-a8ac-407b-98a0-d0f244c6f4c8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:09.048465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b29963d-a8ac-407b-98a0-d0f244c6f4c8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:09.049189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b29963d-a8ac-407b-98a0-d0f244c6f4c8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:09.049959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b29963d-a8ac-407b-98a0-d0f244c6f4c8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:09.050602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b29963d-a8ac-407b-98a0-d0f244c6f4c8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:09.135946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:54:09.136468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:54:09.136852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9b29963d-a8ac-407b-98a0-d0f244c6f4c8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:09.137006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:54:09.137365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:54:09.137877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:54:09.157057 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9b29963d-a8ac-407b-98a0-d0f244c6f4c8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1277 microversion: 2.1 time: 0.121581 Sep 06 10:54:09.158190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:09.162760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:09.163482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:09.164657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:09.167763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:09.168443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:09.183402 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 451/920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:09 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:09.189609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-41c65d87-4bde-48e0-a8e6-6c961992912c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8815700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:09.224063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Getting quotas for project c75bc66c9c9b4fc4b76380e47b40b0b5. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:09.238108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:09.240103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Getting quotas for user 6559ac446c4640218ce700687045bb0d and project c75bc66c9c9b4fc4b76380e47b40b0b5. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:09.258260 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-41c65d87-4bde-48e0-a8e6-6c961992912c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1412 microversion: 2.1 time: 0.073608 Sep 06 10:54:09.268046 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 452/921] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:54:09 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:09.274180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-69dbb0ca-8fcc-420e-ba3e-f9eee3e9bf5b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:09.279300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:54:09.280399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-69dbb0ca-8fcc-420e-ba3e-f9eee3e9bf5b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:09.285161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='034ec68f-6c77-4077-8823-27517fd027d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:54:09.295236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69dbb0ca-8fcc-420e-ba3e-f9eee3e9bf5b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:09.296579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69dbb0ca-8fcc-420e-ba3e-f9eee3e9bf5b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:09.298783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69dbb0ca-8fcc-420e-ba3e-f9eee3e9bf5b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:09.299865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69dbb0ca-8fcc-420e-ba3e-f9eee3e9bf5b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:09.303162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69dbb0ca-8fcc-420e-ba3e-f9eee3e9bf5b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:09.303864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69dbb0ca-8fcc-420e-ba3e-f9eee3e9bf5b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:09.502777 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-957b57d0-ac52-4c19-9326-bfb3da3a9cc3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.434558 Sep 06 10:54:09.503488 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 470/922] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:54:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 2436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:54:09.515102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f5349493-0baf-4791-b265-1442a0d2f93f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:09.518718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f5349493-0baf-4791-b265-1442a0d2f93f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:09.548190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5349493-0baf-4791-b265-1442a0d2f93f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:09.551951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5349493-0baf-4791-b265-1442a0d2f93f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:09.552483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5349493-0baf-4791-b265-1442a0d2f93f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:09.553245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5349493-0baf-4791-b265-1442a0d2f93f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:09.553724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5349493-0baf-4791-b265-1442a0d2f93f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:09.554161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5349493-0baf-4791-b265-1442a0d2f93f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:09.798698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-69dbb0ca-8fcc-420e-ba3e-f9eee3e9bf5b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:09.808221 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-69dbb0ca-8fcc-420e-ba3e-f9eee3e9bf5b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1325 microversion: 2.1 time: 0.538776 Sep 06 10:54:09.824001 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 453/923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:09 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1325 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:09.851569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-58622e66-27b5-467f-b5be-3956fdb584bf req-4dc25ea9-a7f8-4e39-9530-ec0e8c6d85d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb41f601-678e-42fe-822f-ac8f2272bc38", "name": "network-vif-plugged", "status": "completed", "tag": "5ff2bf28-9bc0-492e-8394-2905d05bc3a7"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:09.888755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-58622e66-27b5-467f-b5be-3956fdb584bf req-4dc25ea9-a7f8-4e39-9530-ec0e8c6d85d9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:09.894232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-58622e66-27b5-467f-b5be-3956fdb584bf req-4dc25ea9-a7f8-4e39-9530-ec0e8c6d85d9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:09.898149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-58622e66-27b5-467f-b5be-3956fdb584bf req-4dc25ea9-a7f8-4e39-9530-ec0e8c6d85d9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:09.931896 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-58622e66-27b5-467f-b5be-3956fdb584bf req-4dc25ea9-a7f8-4e39-9530-ec0e8c6d85d9 service nova] Creating event network-vif-plugged:5ff2bf28-9bc0-492e-8394-2905d05bc3a7 for instance eb41f601-678e-42fe-822f-ac8f2272bc38 on nch2-master-1 Sep 06 10:54:09.937276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f5349493-0baf-4791-b265-1442a0d2f93f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:09.948046 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f5349493-0baf-4791-b265-1442a0d2f93f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1282 microversion: 2.1 time: 0.442258 Sep 06 10:54:09.948886 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 471/924] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:09 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1282 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:09.950355 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-58622e66-27b5-467f-b5be-3956fdb584bf req-4dc25ea9-a7f8-4e39-9530-ec0e8c6d85d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124659 Sep 06 10:54:09.952369 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 454/925] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:09.962138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a7713555-58e8-49e2-a26d-d62c0bf6569d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:09.963752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a7713555-58e8-49e2-a26d-d62c0bf6569d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:09.967535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ecfd290-b5be-4838-8725-e2d924fe9cd9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:09.968464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ecfd290-b5be-4838-8725-e2d924fe9cd9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:09.977726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7713555-58e8-49e2-a26d-d62c0bf6569d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:09.980632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ecfd290-b5be-4838-8725-e2d924fe9cd9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:09.981340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7713555-58e8-49e2-a26d-d62c0bf6569d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:09.982163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7713555-58e8-49e2-a26d-d62c0bf6569d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:09.983620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ecfd290-b5be-4838-8725-e2d924fe9cd9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:09.988104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7713555-58e8-49e2-a26d-d62c0bf6569d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:09.988104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7713555-58e8-49e2-a26d-d62c0bf6569d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:09.988104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7713555-58e8-49e2-a26d-d62c0bf6569d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:09.988413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ecfd290-b5be-4838-8725-e2d924fe9cd9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:09.988979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ecfd290-b5be-4838-8725-e2d924fe9cd9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:09.994416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ecfd290-b5be-4838-8725-e2d924fe9cd9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:09.995139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ecfd290-b5be-4838-8725-e2d924fe9cd9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:10.576061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a7713555-58e8-49e2-a26d-d62c0bf6569d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:10.592860 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a7713555-58e8-49e2-a26d-d62c0bf6569d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1471 microversion: 2.1 time: 0.638231 Sep 06 10:54:10.596136 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 472/926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:09 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1471 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:10.598655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ecfd290-b5be-4838-8725-e2d924fe9cd9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:10.605346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2e429e13-87b9-47d7-a709-a82493e846ef tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:10.611476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2e429e13-87b9-47d7-a709-a82493e846ef tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:10.612321 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ecfd290-b5be-4838-8725-e2d924fe9cd9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1360 microversion: 2.1 time: 0.657756 Sep 06 10:54:10.622673 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 455/927] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:09 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1360 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:10.628697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ce0c7c9e-b982-4dfb-a457-e623e646c1a3 req-ab3c7e99-80ba-457b-b83c-2408c887ce63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a4ea2a-aa16-4e41-af83-b027dfe81828", "tag": "9fd60b84-0b14-41da-8bad-24a891e8dd1d"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:10.650134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ce0c7c9e-b982-4dfb-a457-e623e646c1a3 req-ab3c7e99-80ba-457b-b83c-2408c887ce63 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:10.651484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ce0c7c9e-b982-4dfb-a457-e623e646c1a3 req-ab3c7e99-80ba-457b-b83c-2408c887ce63 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:10.652174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ce0c7c9e-b982-4dfb-a457-e623e646c1a3 req-ab3c7e99-80ba-457b-b83c-2408c887ce63 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:10.683878 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ce0c7c9e-b982-4dfb-a457-e623e646c1a3 req-ab3c7e99-80ba-457b-b83c-2408c887ce63 service nova] Creating event network-changed:9fd60b84-0b14-41da-8bad-24a891e8dd1d for instance 31a4ea2a-aa16-4e41-af83-b027dfe81828 on nch1-master-1 Sep 06 10:54:10.698164 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ce0c7c9e-b982-4dfb-a457-e623e646c1a3 req-ab3c7e99-80ba-457b-b83c-2408c887ce63 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081751 Sep 06 10:54:10.700880 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 456/928] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:10.714882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c1d2dbd-6cc9-4cea-ad3d-ac4c8a14e0e8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:10.715917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9c1d2dbd-6cc9-4cea-ad3d-ac4c8a14e0e8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:10.730255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c1d2dbd-6cc9-4cea-ad3d-ac4c8a14e0e8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:10.733831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c1d2dbd-6cc9-4cea-ad3d-ac4c8a14e0e8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:10.735086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c1d2dbd-6cc9-4cea-ad3d-ac4c8a14e0e8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:10.745338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c1d2dbd-6cc9-4cea-ad3d-ac4c8a14e0e8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:10.746054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c1d2dbd-6cc9-4cea-ad3d-ac4c8a14e0e8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:10.746684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c1d2dbd-6cc9-4cea-ad3d-ac4c8a14e0e8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:10.762311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2e429e13-87b9-47d7-a709-a82493e846ef tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:10.776694 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2e429e13-87b9-47d7-a709-a82493e846ef tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1244 microversion: 2.1 time: 0.172829 Sep 06 10:54:10.780983 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 473/929] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:10 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1244 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:10.786092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-954a4d5a-dbda-462a-90c9-6c3705488d2a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8749c10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:10.979667 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-954a4d5a-dbda-462a-90c9-6c3705488d2a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1412 microversion: 2.1 time: 0.197203 Sep 06 10:54:10.980251 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 474/930] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:54:10 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1412 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:11.000897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e206990-6f68-4496-95b0-5f65d6196742 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:11.001820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4e206990-6f68-4496-95b0-5f65d6196742 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:11.018349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e206990-6f68-4496-95b0-5f65d6196742 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:11.018855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e206990-6f68-4496-95b0-5f65d6196742 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:11.019340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e206990-6f68-4496-95b0-5f65d6196742 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:11.020065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e206990-6f68-4496-95b0-5f65d6196742 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:11.020530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e206990-6f68-4496-95b0-5f65d6196742 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:11.020964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e206990-6f68-4496-95b0-5f65d6196742 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:11.531326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:11.600512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c1d2dbd-6cc9-4cea-ad3d-ac4c8a14e0e8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:11.616476 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9c1d2dbd-6cc9-4cea-ad3d-ac4c8a14e0e8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1319 microversion: 2.1 time: 0.913974 Sep 06 10:54:11.618923 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 457/931] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:10 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1319 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:11.623695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e756a7e5-81f1-4a45-872f-41db009988d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:11.630361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e756a7e5-81f1-4a45-872f-41db009988d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:11.644278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e756a7e5-81f1-4a45-872f-41db009988d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:11.645057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e756a7e5-81f1-4a45-872f-41db009988d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:11.645703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e756a7e5-81f1-4a45-872f-41db009988d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:11.646750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e756a7e5-81f1-4a45-872f-41db009988d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:11.647429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e756a7e5-81f1-4a45-872f-41db009988d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:11.650816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e756a7e5-81f1-4a45-872f-41db009988d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:11.954173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4e206990-6f68-4496-95b0-5f65d6196742 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:11.966498 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e206990-6f68-4496-95b0-5f65d6196742 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1325 microversion: 2.1 time: 0.969433 Sep 06 10:54:11.971510 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 475/932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:10 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1325 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:11.985373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-909ba495-44c3-4901-87f7-55f9186d231f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:11.986508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-909ba495-44c3-4901-87f7-55f9186d231f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:11.997369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-909ba495-44c3-4901-87f7-55f9186d231f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:11.997930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-909ba495-44c3-4901-87f7-55f9186d231f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:11.998609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-909ba495-44c3-4901-87f7-55f9186d231f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:11.999717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-909ba495-44c3-4901-87f7-55f9186d231f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:12.002419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-909ba495-44c3-4901-87f7-55f9186d231f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:12.003134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-909ba495-44c3-4901-87f7-55f9186d231f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:12.242705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e756a7e5-81f1-4a45-872f-41db009988d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:12.269951 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e756a7e5-81f1-4a45-872f-41db009988d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1324 microversion: 2.1 time: 0.649232 Sep 06 10:54:12.271524 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 458/933] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:11 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1324 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:12.283365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d6639454-e253-498a-a343-39e79e371ccd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:12.284350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d6639454-e253-498a-a343-39e79e371ccd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:12.308281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6639454-e253-498a-a343-39e79e371ccd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:12.309949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6639454-e253-498a-a343-39e79e371ccd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:12.310683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6639454-e253-498a-a343-39e79e371ccd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:12.311702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6639454-e253-498a-a343-39e79e371ccd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:12.317149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6639454-e253-498a-a343-39e79e371ccd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:12.318095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6639454-e253-498a-a343-39e79e371ccd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:12.587284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-909ba495-44c3-4901-87f7-55f9186d231f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:12.596673 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-909ba495-44c3-4901-87f7-55f9186d231f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1471 microversion: 2.1 time: 0.622214 Sep 06 10:54:12.597265 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 476/934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:11 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1471 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:12.612961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-1cdb347e-13be-4f26-b07e-c2dc51bcfbb5 req-fff71f11-2a74-4f8d-85cf-739b1a60b0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7dd9374-605a-4210-9271-9442a435c17c", "tag": "c3240674-1db4-4057-af2a-0241d0fdc27b"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:12.623926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1cdb347e-13be-4f26-b07e-c2dc51bcfbb5 req-fff71f11-2a74-4f8d-85cf-739b1a60b0e4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:12.624419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1cdb347e-13be-4f26-b07e-c2dc51bcfbb5 req-fff71f11-2a74-4f8d-85cf-739b1a60b0e4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:12.624856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1cdb347e-13be-4f26-b07e-c2dc51bcfbb5 req-fff71f11-2a74-4f8d-85cf-739b1a60b0e4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:12.637714 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-1cdb347e-13be-4f26-b07e-c2dc51bcfbb5 req-fff71f11-2a74-4f8d-85cf-739b1a60b0e4 service nova] Creating event network-changed:c3240674-1db4-4057-af2a-0241d0fdc27b for instance b7dd9374-605a-4210-9271-9442a435c17c on nch1-master-1 Sep 06 10:54:12.642793 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-1cdb347e-13be-4f26-b07e-c2dc51bcfbb5 req-fff71f11-2a74-4f8d-85cf-739b1a60b0e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043850 Sep 06 10:54:12.643907 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 477/935] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:12.649053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c7e5d78d-fdbf-4c9c-907a-fa8c1d644122 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:12.649654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c7e5d78d-fdbf-4c9c-907a-fa8c1d644122 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:12.661731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e5d78d-fdbf-4c9c-907a-fa8c1d644122 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:12.662229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e5d78d-fdbf-4c9c-907a-fa8c1d644122 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:12.662672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e5d78d-fdbf-4c9c-907a-fa8c1d644122 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:12.663415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e5d78d-fdbf-4c9c-907a-fa8c1d644122 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:12.663879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e5d78d-fdbf-4c9c-907a-fa8c1d644122 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:12.664309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e5d78d-fdbf-4c9c-907a-fa8c1d644122 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:12.715931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d6639454-e253-498a-a343-39e79e371ccd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:12.723723 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d6639454-e253-498a-a343-39e79e371ccd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1360 microversion: 2.1 time: 0.444964 Sep 06 10:54:12.724279 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 459/936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:12 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1360 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:12.734273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2894d66b-c9b2-4a53-9429-76afc8b0bbc7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8acdc10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:12.773658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c7e5d78d-fdbf-4c9c-907a-fa8c1d644122 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:12.780078 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2894d66b-c9b2-4a53-9429-76afc8b0bbc7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1412 microversion: 2.1 time: 0.054535 Sep 06 10:54:12.780802 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 460/937] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:54:12 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1412 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:12.782434 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c7e5d78d-fdbf-4c9c-907a-fa8c1d644122 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1296 microversion: 2.1 time: 0.137347 Sep 06 10:54:12.783080 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 478/938] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:12 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1296 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:12.787553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d1fd3ad4-e0b6-4d1d-83e6-6f6aa238dec8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:12.794248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d1fd3ad4-e0b6-4d1d-83e6-6f6aa238dec8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:12.794569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-000bc777-37a0-4f22-8977-fa69461ae70c req-89eef967-9c84-40b1-aa82-eda474a62286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21485351-3c21-4970-9d57-310eff94abb2", "name": "network-vif-plugged", "status": "completed", "tag": "7ac72bf1-22cc-4a06-8e37-4e7576503af8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:12.795176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1fd3ad4-e0b6-4d1d-83e6-6f6aa238dec8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:12.795669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1fd3ad4-e0b6-4d1d-83e6-6f6aa238dec8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:12.796116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1fd3ad4-e0b6-4d1d-83e6-6f6aa238dec8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:12.797257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1fd3ad4-e0b6-4d1d-83e6-6f6aa238dec8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:12.797785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1fd3ad4-e0b6-4d1d-83e6-6f6aa238dec8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:12.798222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1fd3ad4-e0b6-4d1d-83e6-6f6aa238dec8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:12.808811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-000bc777-37a0-4f22-8977-fa69461ae70c req-89eef967-9c84-40b1-aa82-eda474a62286 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:12.809299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-000bc777-37a0-4f22-8977-fa69461ae70c req-89eef967-9c84-40b1-aa82-eda474a62286 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:12.809810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-000bc777-37a0-4f22-8977-fa69461ae70c req-89eef967-9c84-40b1-aa82-eda474a62286 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:12.823603 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-000bc777-37a0-4f22-8977-fa69461ae70c req-89eef967-9c84-40b1-aa82-eda474a62286 service nova] Creating event network-vif-plugged:7ac72bf1-22cc-4a06-8e37-4e7576503af8 for instance 21485351-3c21-4970-9d57-310eff94abb2 on nch2-master-1 Sep 06 10:54:12.829695 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-000bc777-37a0-4f22-8977-fa69461ae70c req-89eef967-9c84-40b1-aa82-eda474a62286 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039994 Sep 06 10:54:12.830488 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 461/939] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:13.002525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c87ebaa8-c9e3-4e67-bb03-8b5ca475581b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:13.003282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c87ebaa8-c9e3-4e67-bb03-8b5ca475581b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:13.014523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c87ebaa8-c9e3-4e67-bb03-8b5ca475581b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:13.015046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c87ebaa8-c9e3-4e67-bb03-8b5ca475581b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:13.015496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c87ebaa8-c9e3-4e67-bb03-8b5ca475581b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:13.016291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c87ebaa8-c9e3-4e67-bb03-8b5ca475581b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:13.016767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c87ebaa8-c9e3-4e67-bb03-8b5ca475581b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:13.017202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c87ebaa8-c9e3-4e67-bb03-8b5ca475581b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:13.484163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d1fd3ad4-e0b6-4d1d-83e6-6f6aa238dec8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:13.496216 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d1fd3ad4-e0b6-4d1d-83e6-6f6aa238dec8 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1319 microversion: 2.1 time: 0.711957 Sep 06 10:54:13.497267 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 479/940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:12 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1319 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:13.503641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c87ebaa8-c9e3-4e67-bb03-8b5ca475581b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:13.518966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-be0277cb-0ac9-4fd3-bf98-9bde62e4b743 req-25eab093-9a1e-48ca-b9ad-3529e5fc2ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40e858a4-422c-4d31-a2b4-e54167933857", "tag": "5f535969-b5ea-4fe2-acc4-37b9c3121df1"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:13.520822 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c87ebaa8-c9e3-4e67-bb03-8b5ca475581b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1519 microversion: 2.1 time: 0.528485 Sep 06 10:54:13.521792 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 462/941] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:12 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1519 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:13.533650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fb7a8297-5347-45a4-928d-5eddc986af3b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:13.534276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb7a8297-5347-45a4-928d-5eddc986af3b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:13.551253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb7a8297-5347-45a4-928d-5eddc986af3b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:13.551253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb7a8297-5347-45a4-928d-5eddc986af3b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:13.551253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb7a8297-5347-45a4-928d-5eddc986af3b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:13.551253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb7a8297-5347-45a4-928d-5eddc986af3b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:13.551607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb7a8297-5347-45a4-928d-5eddc986af3b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:13.551607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb7a8297-5347-45a4-928d-5eddc986af3b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:13.553378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-be0277cb-0ac9-4fd3-bf98-9bde62e4b743 req-25eab093-9a1e-48ca-b9ad-3529e5fc2ea2 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:13.554336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-be0277cb-0ac9-4fd3-bf98-9bde62e4b743 req-25eab093-9a1e-48ca-b9ad-3529e5fc2ea2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:13.554788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-be0277cb-0ac9-4fd3-bf98-9bde62e4b743 req-25eab093-9a1e-48ca-b9ad-3529e5fc2ea2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:13.570462 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-be0277cb-0ac9-4fd3-bf98-9bde62e4b743 req-25eab093-9a1e-48ca-b9ad-3529e5fc2ea2 service nova] Creating event network-changed:5f535969-b5ea-4fe2-acc4-37b9c3121df1 for instance 40e858a4-422c-4d31-a2b4-e54167933857 on nch1-master-1 Sep 06 10:54:13.590717 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-be0277cb-0ac9-4fd3-bf98-9bde62e4b743 req-25eab093-9a1e-48ca-b9ad-3529e5fc2ea2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063411 Sep 06 10:54:13.590717 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 480/942] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:13.590717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-91cebefb-35a4-48a6-8c53-eb958de6a458 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:13.590717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-91cebefb-35a4-48a6-8c53-eb958de6a458 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:13.591866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91cebefb-35a4-48a6-8c53-eb958de6a458 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:13.592452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91cebefb-35a4-48a6-8c53-eb958de6a458 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:13.592893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91cebefb-35a4-48a6-8c53-eb958de6a458 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:13.593622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91cebefb-35a4-48a6-8c53-eb958de6a458 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:13.594137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91cebefb-35a4-48a6-8c53-eb958de6a458 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:13.594592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91cebefb-35a4-48a6-8c53-eb958de6a458 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:13.599103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:13.626435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-91cebefb-35a4-48a6-8c53-eb958de6a458 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:54:13.809234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb7a8297-5347-45a4-928d-5eddc986af3b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:13.809234 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fb7a8297-5347-45a4-928d-5eddc986af3b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1324 microversion: 2.1 time: 0.192073 Sep 06 10:54:13.809234 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 463/943] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:13 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1324 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:13.809234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-042d1403-f58e-4f5a-a9d6-ef251b5897e6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:13.810005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-042d1403-f58e-4f5a-a9d6-ef251b5897e6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:13.810005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-042d1403-f58e-4f5a-a9d6-ef251b5897e6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:13.810005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-042d1403-f58e-4f5a-a9d6-ef251b5897e6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:13.810005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-042d1403-f58e-4f5a-a9d6-ef251b5897e6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:13.810357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-042d1403-f58e-4f5a-a9d6-ef251b5897e6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:13.810357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-042d1403-f58e-4f5a-a9d6-ef251b5897e6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:13.810357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-042d1403-f58e-4f5a-a9d6-ef251b5897e6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:13.863565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-042d1403-f58e-4f5a-a9d6-ef251b5897e6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:13.872769 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-042d1403-f58e-4f5a-a9d6-ef251b5897e6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1471 microversion: 2.1 time: 0.155038 Sep 06 10:54:13.883073 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 464/944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:13 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:13.883073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3719113e-c30e-47aa-8e38-02f172ea9f7c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:13.883073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3719113e-c30e-47aa-8e38-02f172ea9f7c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:13.886382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3719113e-c30e-47aa-8e38-02f172ea9f7c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:13.886883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3719113e-c30e-47aa-8e38-02f172ea9f7c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:13.887360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3719113e-c30e-47aa-8e38-02f172ea9f7c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:13.888059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3719113e-c30e-47aa-8e38-02f172ea9f7c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:13.888519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3719113e-c30e-47aa-8e38-02f172ea9f7c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:13.888969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3719113e-c30e-47aa-8e38-02f172ea9f7c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:14.060001 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-91cebefb-35a4-48a6-8c53-eb958de6a458 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 204 len: 0 microversion: 2.1 time: 0.480935 Sep 06 10:54:14.060963 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 481/945] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:54:13 2022] DELETE /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:54:14.066383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c7997615-3590-4dd2-a353-02a4eb26c770 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8767c10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:14.134893 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c7997615-3590-4dd2-a353-02a4eb26c770 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1412 microversion: 2.1 time: 0.061265 Sep 06 10:54:14.134893 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 482/946] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:54:14 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:14.134893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0d5ddcf8-59f5-4efa-abc0-a4c31391cc26 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:14.134893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0d5ddcf8-59f5-4efa-abc0-a4c31391cc26 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:14.139435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d5ddcf8-59f5-4efa-abc0-a4c31391cc26 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:14.140348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d5ddcf8-59f5-4efa-abc0-a4c31391cc26 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:14.140976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d5ddcf8-59f5-4efa-abc0-a4c31391cc26 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:14.141690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d5ddcf8-59f5-4efa-abc0-a4c31391cc26 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:14.142156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d5ddcf8-59f5-4efa-abc0-a4c31391cc26 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:14.142705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d5ddcf8-59f5-4efa-abc0-a4c31391cc26 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:14.157580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3719113e-c30e-47aa-8e38-02f172ea9f7c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:14.175170 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3719113e-c30e-47aa-8e38-02f172ea9f7c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1360 microversion: 2.1 time: 0.294024 Sep 06 10:54:14.175170 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 465/947] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:13 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1360 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:14.175170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1cf8b182-13a2-407b-99ef-8e6c7e19397c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:14.175425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1cf8b182-13a2-407b-99ef-8e6c7e19397c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:14.185212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cf8b182-13a2-407b-99ef-8e6c7e19397c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:14.185755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cf8b182-13a2-407b-99ef-8e6c7e19397c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:14.186413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cf8b182-13a2-407b-99ef-8e6c7e19397c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:14.187204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cf8b182-13a2-407b-99ef-8e6c7e19397c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:14.187671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cf8b182-13a2-407b-99ef-8e6c7e19397c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:14.188094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cf8b182-13a2-407b-99ef-8e6c7e19397c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:14.192602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:14.262365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0d5ddcf8-59f5-4efa-abc0-a4c31391cc26 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:14.270173 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0d5ddcf8-59f5-4efa-abc0-a4c31391cc26 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1304 microversion: 2.1 time: 0.144491 Sep 06 10:54:14.270740 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 483/948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:14 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:14.525860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1a7c69b0-a121-40ea-ba0b-f650a5faf4df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:14.533987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1a7c69b0-a121-40ea-ba0b-f650a5faf4df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:14.533987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7c69b0-a121-40ea-ba0b-f650a5faf4df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:14.533987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7c69b0-a121-40ea-ba0b-f650a5faf4df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:14.534449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7c69b0-a121-40ea-ba0b-f650a5faf4df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:14.535193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7c69b0-a121-40ea-ba0b-f650a5faf4df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:14.535710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7c69b0-a121-40ea-ba0b-f650a5faf4df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:14.536081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7c69b0-a121-40ea-ba0b-f650a5faf4df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:14.576745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1cf8b182-13a2-407b-99ef-8e6c7e19397c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:14.586354 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1cf8b182-13a2-407b-99ef-8e6c7e19397c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1525 microversion: 2.1 time: 0.415406 Sep 06 10:54:14.587292 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 466/949] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:14 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1525 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:14.740016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d03c1103-7f5e-4fd1-9715-915c239ea8e0 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:14.764585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d03c1103-7f5e-4fd1-9715-915c239ea8e0 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:14.764585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d03c1103-7f5e-4fd1-9715-915c239ea8e0 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:14.764585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d03c1103-7f5e-4fd1-9715-915c239ea8e0 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:14.764585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d03c1103-7f5e-4fd1-9715-915c239ea8e0 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:14.765294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d03c1103-7f5e-4fd1-9715-915c239ea8e0 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:14.765294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d03c1103-7f5e-4fd1-9715-915c239ea8e0 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:14.765294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d03c1103-7f5e-4fd1-9715-915c239ea8e0 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:14.861878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1a7c69b0-a121-40ea-ba0b-f650a5faf4df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:14.870071 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1a7c69b0-a121-40ea-ba0b-f650a5faf4df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1319 microversion: 2.1 time: 0.348662 Sep 06 10:54:14.870644 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 484/950] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:14 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:14.903467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eb431e43-675a-4663-93b5-7e6728f52030 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:14.909622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eb431e43-675a-4663-93b5-7e6728f52030 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:14.916245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb431e43-675a-4663-93b5-7e6728f52030 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:14.916758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb431e43-675a-4663-93b5-7e6728f52030 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:14.917277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb431e43-675a-4663-93b5-7e6728f52030 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:14.917909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb431e43-675a-4663-93b5-7e6728f52030 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:14.918369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb431e43-675a-4663-93b5-7e6728f52030 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:14.918804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb431e43-675a-4663-93b5-7e6728f52030 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:15.105687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d03c1103-7f5e-4fd1-9715-915c239ea8e0 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:15.107028 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d03c1103-7f5e-4fd1-9715-915c239ea8e0 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1324 microversion: 2.1 time: 0.370691 Sep 06 10:54:15.107614 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 467/951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:14 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1324 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:15.139330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6e0fdd67-2870-4b1f-ace3-2558b2a53249 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f88e2d30>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:15.187272 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6e0fdd67-2870-4b1f-ace3-2558b2a53249 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1421 microversion: 2.1 time: 0.051958 Sep 06 10:54:15.191891 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 468/952] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:54:15 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1421 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:15.200967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c5f1d886-16ac-4803-89b6-1575490861cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:15.201574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c5f1d886-16ac-4803-89b6-1575490861cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:15.207611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f1d886-16ac-4803-89b6-1575490861cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:15.208085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f1d886-16ac-4803-89b6-1575490861cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:15.208515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f1d886-16ac-4803-89b6-1575490861cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:15.209222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f1d886-16ac-4803-89b6-1575490861cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:15.209674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f1d886-16ac-4803-89b6-1575490861cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:15.210096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f1d886-16ac-4803-89b6-1575490861cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:15.252962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eb431e43-675a-4663-93b5-7e6728f52030 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:15.259100 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eb431e43-675a-4663-93b5-7e6728f52030 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1471 microversion: 2.1 time: 0.365108 Sep 06 10:54:15.260343 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 485/953] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:14 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1471 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:15.264990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b0ceb692-6257-4420-b367-c2b553617bc3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8647940>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:15.318249 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b0ceb692-6257-4420-b367-c2b553617bc3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 200 len: 1421 microversion: 2.1 time: 0.055526 Sep 06 10:54:15.327944 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 486/954] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:54:15 2022] GET /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 1421 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:15.327944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5144bd5c-ea62-42b5-9d05-5b42735af9c3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:15.327944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5144bd5c-ea62-42b5-9d05-5b42735af9c3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:15.333242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5144bd5c-ea62-42b5-9d05-5b42735af9c3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:15.339065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5144bd5c-ea62-42b5-9d05-5b42735af9c3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:15.339065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5144bd5c-ea62-42b5-9d05-5b42735af9c3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:15.339065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5144bd5c-ea62-42b5-9d05-5b42735af9c3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:15.339065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5144bd5c-ea62-42b5-9d05-5b42735af9c3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:15.339663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5144bd5c-ea62-42b5-9d05-5b42735af9c3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:15.435990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5144bd5c-ea62-42b5-9d05-5b42735af9c3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:15.444105 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5144bd5c-ea62-42b5-9d05-5b42735af9c3 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1314 microversion: 2.1 time: 0.123754 Sep 06 10:54:15.444692 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 487/955] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:15 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1314 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:15.449492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3de34d55-2bf5-4fb7-8dfd-8efd8c476fda tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8647ca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:15.466551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c5f1d886-16ac-4803-89b6-1575490861cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:15.480233 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c5f1d886-16ac-4803-89b6-1575490861cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1360 microversion: 2.1 time: 0.282879 Sep 06 10:54:15.482432 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 469/956] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:15 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1360 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:15.611931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a7449aeb-46e8-44d2-bc54-5fc6b6a53e1c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:15.612558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a7449aeb-46e8-44d2-bc54-5fc6b6a53e1c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:15.621169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7449aeb-46e8-44d2-bc54-5fc6b6a53e1c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:15.621744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7449aeb-46e8-44d2-bc54-5fc6b6a53e1c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:15.622372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7449aeb-46e8-44d2-bc54-5fc6b6a53e1c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:15.623300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7449aeb-46e8-44d2-bc54-5fc6b6a53e1c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:15.623800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7449aeb-46e8-44d2-bc54-5fc6b6a53e1c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:15.624292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7449aeb-46e8-44d2-bc54-5fc6b6a53e1c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:15.785664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a7449aeb-46e8-44d2-bc54-5fc6b6a53e1c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:15.794673 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a7449aeb-46e8-44d2-bc54-5fc6b6a53e1c tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1525 microversion: 2.1 time: 0.187633 Sep 06 10:54:15.795288 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 470/957] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:15 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1525 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:15.893855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-49e5eab7-3a5d-4709-8915-d3f1ec5d00df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:15.894462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-49e5eab7-3a5d-4709-8915-d3f1ec5d00df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:15.901252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e5eab7-3a5d-4709-8915-d3f1ec5d00df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:15.901679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e5eab7-3a5d-4709-8915-d3f1ec5d00df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:15.902121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e5eab7-3a5d-4709-8915-d3f1ec5d00df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:15.902836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e5eab7-3a5d-4709-8915-d3f1ec5d00df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:15.903332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e5eab7-3a5d-4709-8915-d3f1ec5d00df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:15.903768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e5eab7-3a5d-4709-8915-d3f1ec5d00df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:16.047072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-49e5eab7-3a5d-4709-8915-d3f1ec5d00df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:16.054743 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-49e5eab7-3a5d-4709-8915-d3f1ec5d00df tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1319 microversion: 2.1 time: 0.164794 Sep 06 10:54:16.055349 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 471/958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:15 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:16.130774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-949cdcb1-494e-4589-a2b4-082ab04e77fa tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:16.131473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-949cdcb1-494e-4589-a2b4-082ab04e77fa tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:16.133243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:16.138495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-949cdcb1-494e-4589-a2b4-082ab04e77fa tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:16.138989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-949cdcb1-494e-4589-a2b4-082ab04e77fa tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:16.139534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-949cdcb1-494e-4589-a2b4-082ab04e77fa tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:16.140237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-949cdcb1-494e-4589-a2b4-082ab04e77fa tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:16.140698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-949cdcb1-494e-4589-a2b4-082ab04e77fa tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:16.141157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-949cdcb1-494e-4589-a2b4-082ab04e77fa tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:16.323937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-949cdcb1-494e-4589-a2b4-082ab04e77fa tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:16.333060 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-949cdcb1-494e-4589-a2b4-082ab04e77fa tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1324 microversion: 2.1 time: 0.206448 Sep 06 10:54:16.333891 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 472/959] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:16 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1324 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:16.339818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1b519d10-0110-4659-a6f5-3242de44b257 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:16.340431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1b519d10-0110-4659-a6f5-3242de44b257 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:16.347286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b519d10-0110-4659-a6f5-3242de44b257 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:16.347766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b519d10-0110-4659-a6f5-3242de44b257 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:16.348213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b519d10-0110-4659-a6f5-3242de44b257 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:16.348968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b519d10-0110-4659-a6f5-3242de44b257 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:16.349435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b519d10-0110-4659-a6f5-3242de44b257 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:16.349871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b519d10-0110-4659-a6f5-3242de44b257 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:16.544767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1b519d10-0110-4659-a6f5-3242de44b257 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:16.554609 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1b519d10-0110-4659-a6f5-3242de44b257 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1471 microversion: 2.1 time: 0.218451 Sep 06 10:54:16.559462 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 473/960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:16 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:16.572695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d985aced-2720-420e-93aa-f62540010fd7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:16.573610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d985aced-2720-420e-93aa-f62540010fd7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:16.585930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d985aced-2720-420e-93aa-f62540010fd7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:16.589108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d985aced-2720-420e-93aa-f62540010fd7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:16.589108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d985aced-2720-420e-93aa-f62540010fd7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:16.589108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d985aced-2720-420e-93aa-f62540010fd7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:16.589108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d985aced-2720-420e-93aa-f62540010fd7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:16.589465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d985aced-2720-420e-93aa-f62540010fd7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:16.893983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d985aced-2720-420e-93aa-f62540010fd7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:16.911153 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d985aced-2720-420e-93aa-f62540010fd7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.346347 Sep 06 10:54:16.913523 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 474/961] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:16 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:16.925924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a5e7277-93e9-4b0c-8e89-6ce19eef4501 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:16.934916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0a5e7277-93e9-4b0c-8e89-6ce19eef4501 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:16.953233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5e7277-93e9-4b0c-8e89-6ce19eef4501 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:16.959175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5e7277-93e9-4b0c-8e89-6ce19eef4501 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:16.959175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5e7277-93e9-4b0c-8e89-6ce19eef4501 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:16.959175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5e7277-93e9-4b0c-8e89-6ce19eef4501 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:16.959175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5e7277-93e9-4b0c-8e89-6ce19eef4501 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:16.959586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5e7277-93e9-4b0c-8e89-6ce19eef4501 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:16.986489 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3de34d55-2bf5-4fb7-8dfd-8efd8c476fda tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 204 len: 0 microversion: 2.1 time: 1.538652 Sep 06 10:54:16.986489 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 488/962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:15 2022] DELETE /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 0 bytes in 1540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:54:16.992025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4309a960-c768-40d2-87f0-e66510e80aa3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:16.992655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4309a960-c768-40d2-87f0-e66510e80aa3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:17.008102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4309a960-c768-40d2-87f0-e66510e80aa3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:17.011665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4309a960-c768-40d2-87f0-e66510e80aa3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:17.012201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4309a960-c768-40d2-87f0-e66510e80aa3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:17.017281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4309a960-c768-40d2-87f0-e66510e80aa3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:17.017281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4309a960-c768-40d2-87f0-e66510e80aa3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:17.017281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4309a960-c768-40d2-87f0-e66510e80aa3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:17.266208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4309a960-c768-40d2-87f0-e66510e80aa3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:17.280495 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4309a960-c768-40d2-87f0-e66510e80aa3 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1483 microversion: 2.1 time: 0.292504 Sep 06 10:54:17.297652 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 489/963] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:16 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1483 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:17.310635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c59d2755-6da1-4dad-b1c0-f8f7380ccfbf tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:17.315712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c59d2755-6da1-4dad-b1c0-f8f7380ccfbf tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:17.331519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c59d2755-6da1-4dad-b1c0-f8f7380ccfbf tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:17.331519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c59d2755-6da1-4dad-b1c0-f8f7380ccfbf tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:17.331519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c59d2755-6da1-4dad-b1c0-f8f7380ccfbf tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:17.331519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c59d2755-6da1-4dad-b1c0-f8f7380ccfbf tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:17.331929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c59d2755-6da1-4dad-b1c0-f8f7380ccfbf tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:17.331929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c59d2755-6da1-4dad-b1c0-f8f7380ccfbf tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:17.362460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c59d2755-6da1-4dad-b1c0-f8f7380ccfbf tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:54:17.468557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0a5e7277-93e9-4b0c-8e89-6ce19eef4501 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:17.483642 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0a5e7277-93e9-4b0c-8e89-6ce19eef4501 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1544 microversion: 2.1 time: 0.568236 Sep 06 10:54:17.487138 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 475/964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:16 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1544 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:17.511830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-27338ee4-119d-4db3-8db2-63b600c9e1bb tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:17.512821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-27338ee4-119d-4db3-8db2-63b600c9e1bb tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:17.526691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-27338ee4-119d-4db3-8db2-63b600c9e1bb tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:17.527411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-27338ee4-119d-4db3-8db2-63b600c9e1bb tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:17.528435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-27338ee4-119d-4db3-8db2-63b600c9e1bb tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:17.529166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-27338ee4-119d-4db3-8db2-63b600c9e1bb tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:17.529800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-27338ee4-119d-4db3-8db2-63b600c9e1bb tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:17.530237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-27338ee4-119d-4db3-8db2-63b600c9e1bb tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:17.741387 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c59d2755-6da1-4dad-b1c0-f8f7380ccfbf tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 204 len: 0 microversion: 2.1 time: 0.434724 Sep 06 10:54:17.743537 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 490/965] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:54:17 2022] DELETE /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:54:17.757749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-754517cf-01c4-452b-8dcb-e5e336869a16 req-267343ac-dd6e-4d8e-b4ec-aa859e7e58a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb41f601-678e-42fe-822f-ac8f2272bc38", "name": "network-vif-deleted", "tag": "5ff2bf28-9bc0-492e-8394-2905d05bc3a7"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:17.810525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-754517cf-01c4-452b-8dcb-e5e336869a16 req-267343ac-dd6e-4d8e-b4ec-aa859e7e58a9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:17.817339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-754517cf-01c4-452b-8dcb-e5e336869a16 req-267343ac-dd6e-4d8e-b4ec-aa859e7e58a9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:17.818041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-754517cf-01c4-452b-8dcb-e5e336869a16 req-267343ac-dd6e-4d8e-b4ec-aa859e7e58a9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:17.838806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-27338ee4-119d-4db3-8db2-63b600c9e1bb tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:17.845373 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-754517cf-01c4-452b-8dcb-e5e336869a16 req-267343ac-dd6e-4d8e-b4ec-aa859e7e58a9 service nova] Creating event network-vif-deleted:5ff2bf28-9bc0-492e-8394-2905d05bc3a7 for instance eb41f601-678e-42fe-822f-ac8f2272bc38 on nch2-master-1 Sep 06 10:54:17.850813 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-754517cf-01c4-452b-8dcb-e5e336869a16 req-267343ac-dd6e-4d8e-b4ec-aa859e7e58a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104065 Sep 06 10:54:17.852253 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 491/966] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:17.853575 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-27338ee4-119d-4db3-8db2-63b600c9e1bb tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1319 microversion: 2.1 time: 0.352757 Sep 06 10:54:17.854166 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 476/967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:17 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:17.860226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a16ff31b-0cfa-4e0c-9044-0966103dd324 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:17.871455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a16ff31b-0cfa-4e0c-9044-0966103dd324 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:17.871613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b3c0f7c4-63bb-4b3b-8628-11fec708c8fa tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:17.871613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b3c0f7c4-63bb-4b3b-8628-11fec708c8fa tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:17.884197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a16ff31b-0cfa-4e0c-9044-0966103dd324 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:17.890567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3c0f7c4-63bb-4b3b-8628-11fec708c8fa tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:17.891219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a16ff31b-0cfa-4e0c-9044-0966103dd324 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:17.891690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a16ff31b-0cfa-4e0c-9044-0966103dd324 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:17.892455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a16ff31b-0cfa-4e0c-9044-0966103dd324 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:17.892925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a16ff31b-0cfa-4e0c-9044-0966103dd324 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:17.893362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a16ff31b-0cfa-4e0c-9044-0966103dd324 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:17.893784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3c0f7c4-63bb-4b3b-8628-11fec708c8fa tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:17.894388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3c0f7c4-63bb-4b3b-8628-11fec708c8fa tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:17.900559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3c0f7c4-63bb-4b3b-8628-11fec708c8fa tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:17.900559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3c0f7c4-63bb-4b3b-8628-11fec708c8fa tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:17.900559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3c0f7c4-63bb-4b3b-8628-11fec708c8fa tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:18.094235 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b3c0f7c4-63bb-4b3b-8628-11fec708c8fa tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.238857 Sep 06 10:54:18.097281 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 477/968] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 10:54:17 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/os-interface => generated 285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:18.110302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-318fa251-ba88-44e4-a5b5-1f71658cdfc4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:18.110936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-318fa251-ba88-44e4-a5b5-1f71658cdfc4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:18.117340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-318fa251-ba88-44e4-a5b5-1f71658cdfc4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:18.117847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-318fa251-ba88-44e4-a5b5-1f71658cdfc4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:18.118296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-318fa251-ba88-44e4-a5b5-1f71658cdfc4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:18.119073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-318fa251-ba88-44e4-a5b5-1f71658cdfc4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:18.119547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-318fa251-ba88-44e4-a5b5-1f71658cdfc4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:18.119984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-318fa251-ba88-44e4-a5b5-1f71658cdfc4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:18.188609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a16ff31b-0cfa-4e0c-9044-0966103dd324 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:18.204925 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a16ff31b-0cfa-4e0c-9044-0966103dd324 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1324 microversion: 2.1 time: 0.350457 Sep 06 10:54:18.216353 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 492/969] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:17 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1324 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:18.222973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f37a885c-c889-49f7-9915-ef2663f5aa2d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:18.225159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f37a885c-c889-49f7-9915-ef2663f5aa2d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:18.240718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f37a885c-c889-49f7-9915-ef2663f5aa2d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:18.241242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f37a885c-c889-49f7-9915-ef2663f5aa2d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:18.241805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f37a885c-c889-49f7-9915-ef2663f5aa2d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:18.242583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f37a885c-c889-49f7-9915-ef2663f5aa2d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:18.243107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f37a885c-c889-49f7-9915-ef2663f5aa2d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:18.244245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f37a885c-c889-49f7-9915-ef2663f5aa2d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:18.808784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-318fa251-ba88-44e4-a5b5-1f71658cdfc4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:18.820424 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-318fa251-ba88-44e4-a5b5-1f71658cdfc4 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1471 microversion: 2.1 time: 0.721433 Sep 06 10:54:18.821564 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 478/970] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:18 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1471 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:18.828180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-400828463", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "8c7b67ff-233f-4a9e-acc5-cc1f60baf7c8"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:18.891598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] validate_networks() for [('8c7b67ff-233f-4a9e-acc5-cc1f60baf7c8', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:54:18.900159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f37a885c-c889-49f7-9915-ef2663f5aa2d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:18.908371 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f37a885c-c889-49f7-9915-ef2663f5aa2d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.701565 Sep 06 10:54:18.909333 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 493/971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:18 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:18.913923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-c5a1d42e-7050-4a1a-a1d9-096f2fd998c2 req-19dc8fab-313b-48f6-a5e4-3bd39a8b3555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dd9374-605a-4210-9271-9442a435c17c", "name": "network-vif-plugged", "status": "completed", "tag": "c3240674-1db4-4057-af2a-0241d0fdc27b"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:18.927145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c5a1d42e-7050-4a1a-a1d9-096f2fd998c2 req-19dc8fab-313b-48f6-a5e4-3bd39a8b3555 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:18.927715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c5a1d42e-7050-4a1a-a1d9-096f2fd998c2 req-19dc8fab-313b-48f6-a5e4-3bd39a8b3555 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:18.928237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c5a1d42e-7050-4a1a-a1d9-096f2fd998c2 req-19dc8fab-313b-48f6-a5e4-3bd39a8b3555 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:18.940531 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-c5a1d42e-7050-4a1a-a1d9-096f2fd998c2 req-19dc8fab-313b-48f6-a5e4-3bd39a8b3555 service nova] Creating event network-vif-plugged:c3240674-1db4-4057-af2a-0241d0fdc27b for instance b7dd9374-605a-4210-9271-9442a435c17c on nch1-master-1 Sep 06 10:54:18.945489 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-c5a1d42e-7050-4a1a-a1d9-096f2fd998c2 req-19dc8fab-313b-48f6-a5e4-3bd39a8b3555 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034935 Sep 06 10:54:18.946455 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 494/972] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:18.952355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:18.952683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:18.959401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:18.959599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:18.960539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:18.960962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:18.961587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:18.961995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:18.999203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:18.999846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:19.000365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:19.000967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lazy-loading 'fault' on Instance uuid eb41f601-678e-42fe-822f-ac8f2272bc38 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:54:19.073989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:19.084572 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-62230b90-a2bd-4bfb-b55f-28ec08459c36 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1315 microversion: 2.1 time: 0.136826 Sep 06 10:54:19.094198 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 495/973] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:18 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1315 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:19.094198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d3e5692c-402c-4d83-ba0f-7627dcb7570b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:19.094198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3e5692c-402c-4d83-ba0f-7627dcb7570b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:19.106760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e5692c-402c-4d83-ba0f-7627dcb7570b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:19.107222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e5692c-402c-4d83-ba0f-7627dcb7570b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:19.107672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e5692c-402c-4d83-ba0f-7627dcb7570b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:19.108947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e5692c-402c-4d83-ba0f-7627dcb7570b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:19.109420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e5692c-402c-4d83-ba0f-7627dcb7570b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:19.109855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e5692c-402c-4d83-ba0f-7627dcb7570b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:19.195369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=14 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:19.415400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d3e5692c-402c-4d83-ba0f-7627dcb7570b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:19.424899 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d3e5692c-402c-4d83-ba0f-7627dcb7570b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1319 microversion: 2.1 time: 0.338230 Sep 06 10:54:19.425486 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 496/974] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:19 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:19.430046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a666488f-c813-47eb-b84c-f3b95361966f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:19.430650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a666488f-c813-47eb-b84c-f3b95361966f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:19.437972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a666488f-c813-47eb-b84c-f3b95361966f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:19.438776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a666488f-c813-47eb-b84c-f3b95361966f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:19.439758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a666488f-c813-47eb-b84c-f3b95361966f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:19.440485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a666488f-c813-47eb-b84c-f3b95361966f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:19.440932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a666488f-c813-47eb-b84c-f3b95361966f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:19.444027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a666488f-c813-47eb-b84c-f3b95361966f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:19.682082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a666488f-c813-47eb-b84c-f3b95361966f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:19.689364 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a666488f-c813-47eb-b84c-f3b95361966f tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1324 microversion: 2.1 time: 0.262873 Sep 06 10:54:19.693855 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 497/975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:19 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:19.699383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-07296057-174b-49a8-aa90-e46621b2721f req-83faf94a-396e-4b07-b619-2002312ed168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf2c50a-91cd-4042-914e-c85ff9025b00", "tag": "affae396-3552-4226-bc04-afb350e6137f"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:19.711334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-07296057-174b-49a8-aa90-e46621b2721f req-83faf94a-396e-4b07-b619-2002312ed168 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:19.711959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-07296057-174b-49a8-aa90-e46621b2721f req-83faf94a-396e-4b07-b619-2002312ed168 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:19.713043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-07296057-174b-49a8-aa90-e46621b2721f req-83faf94a-396e-4b07-b619-2002312ed168 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:19.714122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:54:19.714548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:54:19.715066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:54:19.715661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:54:19.716079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:54:19.725332 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-07296057-174b-49a8-aa90-e46621b2721f req-83faf94a-396e-4b07-b619-2002312ed168 service nova] Creating event network-changed:affae396-3552-4226-bc04-afb350e6137f for instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 on nch2-master-1 Sep 06 10:54:19.725804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:19.727070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:19.727514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:19.728885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:19.729535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:19.730335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:19.731973 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-07296057-174b-49a8-aa90-e46621b2721f req-83faf94a-396e-4b07-b619-2002312ed168 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036162 Sep 06 10:54:19.733177 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 498/976] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:19.749094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Getting quotas for project e047ab9362dc476c9a4b4aee7223d042. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:19.754650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Getting quotas for user d79046739b2d4572b0aedef59e621ab8 and project e047ab9362dc476c9a4b4aee7223d042. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:19.767435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:54:19.769743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:54:19.789007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:19.849686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cbb0cd09-07b8-486c-882c-3c9bef33da6c tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:19.850386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cbb0cd09-07b8-486c-882c-3c9bef33da6c tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:19.856582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbb0cd09-07b8-486c-882c-3c9bef33da6c tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:19.857063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbb0cd09-07b8-486c-882c-3c9bef33da6c tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:19.857498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbb0cd09-07b8-486c-882c-3c9bef33da6c tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:19.858213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbb0cd09-07b8-486c-882c-3c9bef33da6c tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:19.858652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbb0cd09-07b8-486c-882c-3c9bef33da6c tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:19.859103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbb0cd09-07b8-486c-882c-3c9bef33da6c tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:19.863663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:20.002551 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cbfcd5ad-4dd1-44a1-90e9-6726fa3586cc tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.178628 Sep 06 10:54:20.004266 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 479/977] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:54:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:54:20.010528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-7b723d53-6db7-46a6-9ae0-33872bdd24db req-02b60df7-916f-48a1-bc8e-1fccc95c52bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21485351-3c21-4970-9d57-310eff94abb2", "tag": "7ac72bf1-22cc-4a06-8e37-4e7576503af8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:20.044777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7b723d53-6db7-46a6-9ae0-33872bdd24db req-02b60df7-916f-48a1-bc8e-1fccc95c52bf service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:20.044777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7b723d53-6db7-46a6-9ae0-33872bdd24db req-02b60df7-916f-48a1-bc8e-1fccc95c52bf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:20.044777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7b723d53-6db7-46a6-9ae0-33872bdd24db req-02b60df7-916f-48a1-bc8e-1fccc95c52bf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:20.063648 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7b723d53-6db7-46a6-9ae0-33872bdd24db req-02b60df7-916f-48a1-bc8e-1fccc95c52bf service nova] Creating event network-changed:7ac72bf1-22cc-4a06-8e37-4e7576503af8 for instance 21485351-3c21-4970-9d57-310eff94abb2 on nch2-master-1 Sep 06 10:54:20.074324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cbb0cd09-07b8-486c-882c-3c9bef33da6c tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:20.080928 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-7b723d53-6db7-46a6-9ae0-33872bdd24db req-02b60df7-916f-48a1-bc8e-1fccc95c52bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074558 Sep 06 10:54:20.082111 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 480/978] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:20.089041 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cbb0cd09-07b8-486c-882c-3c9bef33da6c tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1471 microversion: 2.1 time: 0.242007 Sep 06 10:54:20.094264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-de791ad8-951a-464f-8647-559c25c154ee tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:20.102025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-de791ad8-951a-464f-8647-559c25c154ee tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:20.104779 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 499/979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:19 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1471 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:20.112218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de791ad8-951a-464f-8647-559c25c154ee tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:20.112961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de791ad8-951a-464f-8647-559c25c154ee tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:20.113423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de791ad8-951a-464f-8647-559c25c154ee tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:20.114156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de791ad8-951a-464f-8647-559c25c154ee tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:20.114712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de791ad8-951a-464f-8647-559c25c154ee tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:20.115096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de791ad8-951a-464f-8647-559c25c154ee tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:20.126833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b0d3f27f-8234-4988-a9b2-b4d48a83270d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:20.126833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b0d3f27f-8234-4988-a9b2-b4d48a83270d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:20.257373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b0d3f27f-8234-4988-a9b2-b4d48a83270d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:20.274037 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b0d3f27f-8234-4988-a9b2-b4d48a83270d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1207 microversion: 2.1 time: 0.164865 Sep 06 10:54:20.278058 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 500/980] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:20 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1207 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:20.296430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:20.297149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:20.304936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:20.305537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:20.306092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:20.307585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:20.308131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:20.308666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:20.387160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:20.387662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:20.388104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:20.388564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lazy-loading 'fault' on Instance uuid eb41f601-678e-42fe-822f-ac8f2272bc38 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:54:20.454027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-de791ad8-951a-464f-8647-559c25c154ee tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:20.479530 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-de791ad8-951a-464f-8647-559c25c154ee tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.395873 Sep 06 10:54:20.480140 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 481/981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:20 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:20.495667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6b02076b-f5bd-4236-885b-528984ad79f2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:20.496389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6b02076b-f5bd-4236-885b-528984ad79f2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:20.513379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:20.523517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b02076b-f5bd-4236-885b-528984ad79f2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:20.527461 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0ff6e22c-5453-410f-9c84-cdf38509fa17 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1315 microversion: 2.1 time: 0.238477 Sep 06 10:54:20.527605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b02076b-f5bd-4236-885b-528984ad79f2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:20.527605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b02076b-f5bd-4236-885b-528984ad79f2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:20.527605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b02076b-f5bd-4236-885b-528984ad79f2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:20.527605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b02076b-f5bd-4236-885b-528984ad79f2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:20.528100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b02076b-f5bd-4236-885b-528984ad79f2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:20.536218 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 501/982] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:20 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:20.711488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9659dced-94c5-4711-8534-7bcd5032f4ff tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:20.713958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9659dced-94c5-4711-8534-7bcd5032f4ff tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:20.722303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9659dced-94c5-4711-8534-7bcd5032f4ff tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:20.722876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9659dced-94c5-4711-8534-7bcd5032f4ff tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:20.723271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9659dced-94c5-4711-8534-7bcd5032f4ff tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:20.727839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9659dced-94c5-4711-8534-7bcd5032f4ff tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:20.735461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9659dced-94c5-4711-8534-7bcd5032f4ff tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:20.736174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9659dced-94c5-4711-8534-7bcd5032f4ff tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:20.787842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6b02076b-f5bd-4236-885b-528984ad79f2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:20.798818 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6b02076b-f5bd-4236-885b-528984ad79f2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1319 microversion: 2.1 time: 0.317410 Sep 06 10:54:20.799568 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 482/983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:20 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:20.983533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-82679a2e-f9c9-41d0-8e85-83ed51b564bf req-884e7a21-d5f1-4c24-9231-c64738ddfbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdba9b97-4ac9-425a-93bf-efc405463026", "name": "network-vif-unplugged", "status": "completed", "tag": "c993e7ce-f4ac-4c50-8fae-67c9b2f4e028"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:21.025869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-82679a2e-f9c9-41d0-8e85-83ed51b564bf req-884e7a21-d5f1-4c24-9231-c64738ddfbb7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:21.026464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-82679a2e-f9c9-41d0-8e85-83ed51b564bf req-884e7a21-d5f1-4c24-9231-c64738ddfbb7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:21.026830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-82679a2e-f9c9-41d0-8e85-83ed51b564bf req-884e7a21-d5f1-4c24-9231-c64738ddfbb7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:21.054870 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-82679a2e-f9c9-41d0-8e85-83ed51b564bf req-884e7a21-d5f1-4c24-9231-c64738ddfbb7 service nova] Creating event network-vif-unplugged:c993e7ce-f4ac-4c50-8fae-67c9b2f4e028 for instance cdba9b97-4ac9-425a-93bf-efc405463026 on nch2-master-1 Sep 06 10:54:21.062340 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-82679a2e-f9c9-41d0-8e85-83ed51b564bf req-884e7a21-d5f1-4c24-9231-c64738ddfbb7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082446 Sep 06 10:54:21.066915 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 483/984] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:54:21.073106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9659dced-94c5-4711-8534-7bcd5032f4ff tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:21.085200 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9659dced-94c5-4711-8534-7bcd5032f4ff tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1324 microversion: 2.1 time: 0.377539 Sep 06 10:54:21.085797 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 502/985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:20 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:21.119230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-823bde7d-50c2-43a2-b4ad-36091c3c360e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:21.123622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-823bde7d-50c2-43a2-b4ad-36091c3c360e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:21.128368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-823bde7d-50c2-43a2-b4ad-36091c3c360e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:21.129190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-823bde7d-50c2-43a2-b4ad-36091c3c360e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:21.130023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-823bde7d-50c2-43a2-b4ad-36091c3c360e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:21.130920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-823bde7d-50c2-43a2-b4ad-36091c3c360e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:21.131553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-823bde7d-50c2-43a2-b4ad-36091c3c360e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:21.132108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-823bde7d-50c2-43a2-b4ad-36091c3c360e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:21.310652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2509af06-be04-43c3-8f94-d8baaa2dfde5 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:21.312366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2509af06-be04-43c3-8f94-d8baaa2dfde5 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:21.320777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2509af06-be04-43c3-8f94-d8baaa2dfde5 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:21.322114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2509af06-be04-43c3-8f94-d8baaa2dfde5 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:21.322848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2509af06-be04-43c3-8f94-d8baaa2dfde5 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:21.323952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2509af06-be04-43c3-8f94-d8baaa2dfde5 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:21.325647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2509af06-be04-43c3-8f94-d8baaa2dfde5 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:21.326774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-823bde7d-50c2-43a2-b4ad-36091c3c360e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:21.327237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2509af06-be04-43c3-8f94-d8baaa2dfde5 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:21.334845 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-823bde7d-50c2-43a2-b4ad-36091c3c360e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1471 microversion: 2.1 time: 0.222800 Sep 06 10:54:21.345348 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 484/986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:21 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1471 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:21.448445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2509af06-be04-43c3-8f94-d8baaa2dfde5 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:21.470277 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2509af06-be04-43c3-8f94-d8baaa2dfde5 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1211 microversion: 2.1 time: 0.170835 Sep 06 10:54:21.487458 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 503/987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:21 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1211 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:21.515868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-66fede87-49a9-40cf-b702-409991de456d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:21.516778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-66fede87-49a9-40cf-b702-409991de456d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:21.532238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66fede87-49a9-40cf-b702-409991de456d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:21.533357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66fede87-49a9-40cf-b702-409991de456d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:21.533690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66fede87-49a9-40cf-b702-409991de456d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:21.534643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66fede87-49a9-40cf-b702-409991de456d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:21.535282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66fede87-49a9-40cf-b702-409991de456d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:21.535956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66fede87-49a9-40cf-b702-409991de456d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:21.549656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:21.550273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:21.557908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:21.558815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:21.559595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:21.560484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:21.561153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:21.561752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:21.607676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:21.608369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:21.608974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:21.609628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lazy-loading 'fault' on Instance uuid eb41f601-678e-42fe-822f-ac8f2272bc38 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:54:21.688640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:21.698145 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-327195cc-a9d0-4f29-a0d1-cbbe42e89785 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1315 microversion: 2.1 time: 0.152640 Sep 06 10:54:21.698816 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 504/988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:21 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:21.799302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-66fede87-49a9-40cf-b702-409991de456d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:21.808937 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-66fede87-49a9-40cf-b702-409991de456d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.305437 Sep 06 10:54:21.810066 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 485/989] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:21 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:21.824634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26b01265-7cf8-4f08-abda-bc9e17931fc0 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:21.827809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-26b01265-7cf8-4f08-abda-bc9e17931fc0 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:21.833014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26b01265-7cf8-4f08-abda-bc9e17931fc0 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:21.833459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26b01265-7cf8-4f08-abda-bc9e17931fc0 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:21.833907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26b01265-7cf8-4f08-abda-bc9e17931fc0 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:21.834626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26b01265-7cf8-4f08-abda-bc9e17931fc0 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:21.835130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26b01265-7cf8-4f08-abda-bc9e17931fc0 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:21.835571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26b01265-7cf8-4f08-abda-bc9e17931fc0 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:22.006808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-26b01265-7cf8-4f08-abda-bc9e17931fc0 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:22.015612 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-26b01265-7cf8-4f08-abda-bc9e17931fc0 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1319 microversion: 2.1 time: 0.197460 Sep 06 10:54:22.021140 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 505/990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:21 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:22.114968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-46d12ba1-e052-4dd3-b704-0d6a92fa68ea tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:22.116317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-46d12ba1-e052-4dd3-b704-0d6a92fa68ea tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:22.130611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46d12ba1-e052-4dd3-b704-0d6a92fa68ea tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:22.131567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46d12ba1-e052-4dd3-b704-0d6a92fa68ea tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:22.132346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46d12ba1-e052-4dd3-b704-0d6a92fa68ea tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:22.133321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46d12ba1-e052-4dd3-b704-0d6a92fa68ea tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:22.134007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46d12ba1-e052-4dd3-b704-0d6a92fa68ea tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:22.135990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46d12ba1-e052-4dd3-b704-0d6a92fa68ea tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:22.141682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:22.282964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-46d12ba1-e052-4dd3-b704-0d6a92fa68ea tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:22.292052 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-46d12ba1-e052-4dd3-b704-0d6a92fa68ea tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1520 microversion: 2.1 time: 0.181032 Sep 06 10:54:22.292843 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 486/991] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:22 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:22.318916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-89736090-a3e5-4d79-91f6-79d6a28a448c tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Action: 'create', calling method: .version_select at 0x7f90f870d280>, body: {"pool": null} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:22.364514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5220cbf7-b0c5-4966-a795-01a7f4998d36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:22.365306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5220cbf7-b0c5-4966-a795-01a7f4998d36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:22.372275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5220cbf7-b0c5-4966-a795-01a7f4998d36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:22.373184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5220cbf7-b0c5-4966-a795-01a7f4998d36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:22.374315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5220cbf7-b0c5-4966-a795-01a7f4998d36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:22.375410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5220cbf7-b0c5-4966-a795-01a7f4998d36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:22.378297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5220cbf7-b0c5-4966-a795-01a7f4998d36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:22.379148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5220cbf7-b0c5-4966-a795-01a7f4998d36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:22.667105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5220cbf7-b0c5-4966-a795-01a7f4998d36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:22.675997 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5220cbf7-b0c5-4966-a795-01a7f4998d36 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1471 microversion: 2.1 time: 0.315824 Sep 06 10:54:22.676917 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 487/992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:22 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:22.688398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1bcfe623-eb68-44b9-995a-fb6109e58ac0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:22.689297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1bcfe623-eb68-44b9-995a-fb6109e58ac0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:22.695694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bcfe623-eb68-44b9-995a-fb6109e58ac0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:22.696187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bcfe623-eb68-44b9-995a-fb6109e58ac0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:22.696684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bcfe623-eb68-44b9-995a-fb6109e58ac0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:22.697395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bcfe623-eb68-44b9-995a-fb6109e58ac0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:22.697864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bcfe623-eb68-44b9-995a-fb6109e58ac0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:22.698301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bcfe623-eb68-44b9-995a-fb6109e58ac0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:22.785649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1bcfe623-eb68-44b9-995a-fb6109e58ac0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:22.793981 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1bcfe623-eb68-44b9-995a-fb6109e58ac0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1211 microversion: 2.1 time: 0.109418 Sep 06 10:54:22.794910 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 488/993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:22 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1211 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:22.802671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:22.803534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:22.825670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:22.826387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:22.827043 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:22.828082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:22.828652 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:22.829244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:22.871859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:22.872460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:22.878041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:22.878041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lazy-loading 'fault' on Instance uuid eb41f601-678e-42fe-822f-ac8f2272bc38 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:54:22.972289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:22.982927 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fac34a8d-4409-46d5-8eac-34e8527e8e77 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1315 microversion: 2.1 time: 0.186815 Sep 06 10:54:22.983801 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 489/994] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:22 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:22.991363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4fa1eaeb-ccb8-4966-ab27-87989b20b552 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:22.991995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4fa1eaeb-ccb8-4966-ab27-87989b20b552 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:23.014033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fa1eaeb-ccb8-4966-ab27-87989b20b552 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:23.014999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fa1eaeb-ccb8-4966-ab27-87989b20b552 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:23.018761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fa1eaeb-ccb8-4966-ab27-87989b20b552 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:23.018761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fa1eaeb-ccb8-4966-ab27-87989b20b552 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:23.018761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fa1eaeb-ccb8-4966-ab27-87989b20b552 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:23.018761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fa1eaeb-ccb8-4966-ab27-87989b20b552 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:23.248149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4fa1eaeb-ccb8-4966-ab27-87989b20b552 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:23.258011 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4fa1eaeb-ccb8-4966-ab27-87989b20b552 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.273390 Sep 06 10:54:23.258764 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 490/995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:22 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:23.267042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-57777ddd-58c1-4958-bbcd-1d0f0aa5a1b7 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:23.267042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-57777ddd-58c1-4958-bbcd-1d0f0aa5a1b7 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:23.270531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57777ddd-58c1-4958-bbcd-1d0f0aa5a1b7 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:23.271165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57777ddd-58c1-4958-bbcd-1d0f0aa5a1b7 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:23.271718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57777ddd-58c1-4958-bbcd-1d0f0aa5a1b7 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:23.272554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57777ddd-58c1-4958-bbcd-1d0f0aa5a1b7 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:23.273107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57777ddd-58c1-4958-bbcd-1d0f0aa5a1b7 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:23.273644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57777ddd-58c1-4958-bbcd-1d0f0aa5a1b7 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:23.528338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-57777ddd-58c1-4958-bbcd-1d0f0aa5a1b7 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:23.541242 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-57777ddd-58c1-4958-bbcd-1d0f0aa5a1b7 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1319 microversion: 2.1 time: 0.280665 Sep 06 10:54:23.542496 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 491/996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:23 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:23.553007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-69bdacea-db66-4d99-aa0f-5c8df639ccf4 req-a8173d47-0be7-473d-ac12-fe56ffdbaa06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e858a4-422c-4d31-a2b4-e54167933857", "name": "network-vif-plugged", "status": "completed", "tag": "5f535969-b5ea-4fe2-acc4-37b9c3121df1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:23.574350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-69bdacea-db66-4d99-aa0f-5c8df639ccf4 req-a8173d47-0be7-473d-ac12-fe56ffdbaa06 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:23.574871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-69bdacea-db66-4d99-aa0f-5c8df639ccf4 req-a8173d47-0be7-473d-ac12-fe56ffdbaa06 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:23.575359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-69bdacea-db66-4d99-aa0f-5c8df639ccf4 req-a8173d47-0be7-473d-ac12-fe56ffdbaa06 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:23.588014 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-69bdacea-db66-4d99-aa0f-5c8df639ccf4 req-a8173d47-0be7-473d-ac12-fe56ffdbaa06 service nova] Creating event network-vif-plugged:5f535969-b5ea-4fe2-acc4-37b9c3121df1 for instance 40e858a4-422c-4d31-a2b4-e54167933857 on nch1-master-1 Sep 06 10:54:23.597288 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-69bdacea-db66-4d99-aa0f-5c8df639ccf4 req-a8173d47-0be7-473d-ac12-fe56ffdbaa06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053081 Sep 06 10:54:23.597989 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 492/997] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:23.702607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f8b494ff-84c6-48b2-8360-d37379f22a62 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:23.703392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f8b494ff-84c6-48b2-8360-d37379f22a62 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:23.711864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8b494ff-84c6-48b2-8360-d37379f22a62 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:23.713088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8b494ff-84c6-48b2-8360-d37379f22a62 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:23.713640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8b494ff-84c6-48b2-8360-d37379f22a62 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:23.715221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8b494ff-84c6-48b2-8360-d37379f22a62 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:23.715820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8b494ff-84c6-48b2-8360-d37379f22a62 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:23.716364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8b494ff-84c6-48b2-8360-d37379f22a62 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:24.025607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f8b494ff-84c6-48b2-8360-d37379f22a62 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:24.035168 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f8b494ff-84c6-48b2-8360-d37379f22a62 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1471 microversion: 2.1 time: 0.338768 Sep 06 10:54:24.037804 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 493/998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:23 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1471 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:24.044869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-66a739ba-02fd-4883-9f71-fbfb2b305f2c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:24.046083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-66a739ba-02fd-4883-9f71-fbfb2b305f2c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:24.053840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66a739ba-02fd-4883-9f71-fbfb2b305f2c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:24.054738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66a739ba-02fd-4883-9f71-fbfb2b305f2c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:24.055519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66a739ba-02fd-4883-9f71-fbfb2b305f2c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:24.056908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66a739ba-02fd-4883-9f71-fbfb2b305f2c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:24.057707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66a739ba-02fd-4883-9f71-fbfb2b305f2c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:24.058239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66a739ba-02fd-4883-9f71-fbfb2b305f2c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:24.137128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-66a739ba-02fd-4883-9f71-fbfb2b305f2c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:24.146177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-66a739ba-02fd-4883-9f71-fbfb2b305f2c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1211 microversion: 2.1 time: 0.106432 Sep 06 10:54:24.147122 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 494/999] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:24 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:24.155759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:24.156681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:24.176903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:24.178001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:24.178691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:24.179889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:24.180742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:24.182730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:24.228478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:24.228978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:24.229424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:24.229883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lazy-loading 'fault' on Instance uuid eb41f601-678e-42fe-822f-ac8f2272bc38 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:54:24.294194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:24.302322 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-817b9235-a21c-4e21-ae50-a6a263164934 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1315 microversion: 2.1 time: 0.154026 Sep 06 10:54:24.312122 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 495/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:24 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:24.312122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ace460a-c52e-49b3-bf85-d10148b98ceb tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:24.312122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ace460a-c52e-49b3-bf85-d10148b98ceb tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:24.316725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ace460a-c52e-49b3-bf85-d10148b98ceb tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:24.316895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ace460a-c52e-49b3-bf85-d10148b98ceb tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:24.318241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ace460a-c52e-49b3-bf85-d10148b98ceb tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:24.318241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ace460a-c52e-49b3-bf85-d10148b98ceb tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:24.319474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ace460a-c52e-49b3-bf85-d10148b98ceb tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:24.319474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ace460a-c52e-49b3-bf85-d10148b98ceb tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:24.498168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ace460a-c52e-49b3-bf85-d10148b98ceb tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:24.506761 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ace460a-c52e-49b3-bf85-d10148b98ceb tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.202760 Sep 06 10:54:24.507369 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 496/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:24 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:24.565694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0141c243-16cb-4b92-9cc1-c2c49eab538b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:24.566484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0141c243-16cb-4b92-9cc1-c2c49eab538b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:24.573830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0141c243-16cb-4b92-9cc1-c2c49eab538b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:24.574405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0141c243-16cb-4b92-9cc1-c2c49eab538b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:24.574917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0141c243-16cb-4b92-9cc1-c2c49eab538b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:24.575734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0141c243-16cb-4b92-9cc1-c2c49eab538b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:24.576266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0141c243-16cb-4b92-9cc1-c2c49eab538b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:24.576769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0141c243-16cb-4b92-9cc1-c2c49eab538b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:24.825032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0141c243-16cb-4b92-9cc1-c2c49eab538b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:24.834726 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0141c243-16cb-4b92-9cc1-c2c49eab538b tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1319 microversion: 2.1 time: 0.272549 Sep 06 10:54:24.848145 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 497/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:24 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:24.944517 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-89736090-a3e5-4d79-91f6-79d6a28a448c tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.629561 Sep 06 10:54:24.945695 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 506/1003] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Sep 6 10:54:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:25.005012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1023189846", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "d007355a-8137-418e-b0f5-eedcd060d4ec"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:25.064291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c6712e8-5f90-41d8-b0fd-b04784abf478 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:25.064910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8c6712e8-5f90-41d8-b0fd-b04784abf478 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:25.072195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c6712e8-5f90-41d8-b0fd-b04784abf478 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:25.072700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c6712e8-5f90-41d8-b0fd-b04784abf478 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:25.073136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c6712e8-5f90-41d8-b0fd-b04784abf478 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:25.074173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c6712e8-5f90-41d8-b0fd-b04784abf478 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:25.074635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c6712e8-5f90-41d8-b0fd-b04784abf478 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:25.075095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c6712e8-5f90-41d8-b0fd-b04784abf478 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:25.083092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] validate_networks() for [('d007355a-8137-418e-b0f5-eedcd060d4ec', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:54:25.320480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8c6712e8-5f90-41d8-b0fd-b04784abf478 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:25.331329 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8c6712e8-5f90-41d8-b0fd-b04784abf478 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1471 microversion: 2.1 time: 0.271206 Sep 06 10:54:25.332413 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 507/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:25 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:25.359265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c51da2e6-4fab-4408-8390-c3c0c434744e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:25.361346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c51da2e6-4fab-4408-8390-c3c0c434744e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:25.369952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c51da2e6-4fab-4408-8390-c3c0c434744e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:25.370855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c51da2e6-4fab-4408-8390-c3c0c434744e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:25.371695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c51da2e6-4fab-4408-8390-c3c0c434744e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:25.372769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c51da2e6-4fab-4408-8390-c3c0c434744e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:25.373453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c51da2e6-4fab-4408-8390-c3c0c434744e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:25.374076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c51da2e6-4fab-4408-8390-c3c0c434744e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:25.511606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c51da2e6-4fab-4408-8390-c3c0c434744e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:25.521207 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c51da2e6-4fab-4408-8390-c3c0c434744e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1211 microversion: 2.1 time: 0.187409 Sep 06 10:54:25.533806 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 508/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:25 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1211 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:25.547765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:25.548456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:25.555057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:25.555576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:25.556610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:25.558880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:25.559379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:25.561400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:25.619066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:25.624152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:25.624830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:25.625552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:25.626017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lazy-loading 'fault' on Instance uuid eb41f601-678e-42fe-822f-ac8f2272bc38 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:54:25.701320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:25.714161 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0b0cb1e1-e736-4560-a771-d6484e08e240 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1315 microversion: 2.1 time: 0.175099 Sep 06 10:54:25.714989 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 509/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:25 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:25.727159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bf621272-cd91-4ad8-bb87-6cbf8e036fa9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:25.729822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bf621272-cd91-4ad8-bb87-6cbf8e036fa9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:25.740848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf621272-cd91-4ad8-bb87-6cbf8e036fa9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:25.741638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf621272-cd91-4ad8-bb87-6cbf8e036fa9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:25.742251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf621272-cd91-4ad8-bb87-6cbf8e036fa9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:25.743993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:54:25.744473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:54:25.744763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf621272-cd91-4ad8-bb87-6cbf8e036fa9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:25.744883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:54:25.745276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:54:25.745664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf621272-cd91-4ad8-bb87-6cbf8e036fa9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:25.745794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:54:25.746380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf621272-cd91-4ad8-bb87-6cbf8e036fa9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:25.755474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:25.755974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:25.756453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:25.757224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:25.757696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:25.758125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:25.793301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Getting quotas for project aa352b4d4810484688d325ca4bb25193. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:25.804701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Getting quotas for user 24d86f8c8ece4257adc548304465f191 and project aa352b4d4810484688d325ca4bb25193. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:25.823487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:54:25.827877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:54:25.910869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bf621272-cd91-4ad8-bb87-6cbf8e036fa9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:25.922246 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bf621272-cd91-4ad8-bb87-6cbf8e036fa9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.200902 Sep 06 10:54:25.922845 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 510/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:25 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:25.935183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aa2339f6-2194-47c3-b914-912fe6826ef4 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:25.936106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aa2339f6-2194-47c3-b914-912fe6826ef4 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:25.944325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa2339f6-2194-47c3-b914-912fe6826ef4 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:25.944818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa2339f6-2194-47c3-b914-912fe6826ef4 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:25.945402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa2339f6-2194-47c3-b914-912fe6826ef4 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:25.945973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa2339f6-2194-47c3-b914-912fe6826ef4 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:25.951606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa2339f6-2194-47c3-b914-912fe6826ef4 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:25.952170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa2339f6-2194-47c3-b914-912fe6826ef4 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:26.001245 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-88827a46-63e1-43dd-9c57-9c3681b131ac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.000179 Sep 06 10:54:26.002817 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 498/1008] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:54:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 10:54:26.016286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7ed3c4bc-4b32-4b9f-bffe-8e361b00172b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:26.020177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7ed3c4bc-4b32-4b9f-bffe-8e361b00172b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:26.099494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7ed3c4bc-4b32-4b9f-bffe-8e361b00172b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:26.110047 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7ed3c4bc-4b32-4b9f-bffe-8e361b00172b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1224 microversion: 2.1 time: 0.097559 Sep 06 10:54:26.123096 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 499/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:26 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:26.178350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aa2339f6-2194-47c3-b914-912fe6826ef4 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:26.194003 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aa2339f6-2194-47c3-b914-912fe6826ef4 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1469 microversion: 2.1 time: 0.265233 Sep 06 10:54:26.194648 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 511/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:25 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1469 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:26.338975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1449028030", "block_migration": true, "disk_over_commit": false}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:26.342269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:26.355589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:26.356094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:26.356439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0b539603-ed9f-4f19-b775-47fe3e8b2171 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:26.356571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:26.357122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0b539603-ed9f-4f19-b775-47fe3e8b2171 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:26.357725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:26.357725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:26.358630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:26.366033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b539603-ed9f-4f19-b775-47fe3e8b2171 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:26.369319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b539603-ed9f-4f19-b775-47fe3e8b2171 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:26.369319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b539603-ed9f-4f19-b775-47fe3e8b2171 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:26.369319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b539603-ed9f-4f19-b775-47fe3e8b2171 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:26.369319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b539603-ed9f-4f19-b775-47fe3e8b2171 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:26.371547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b539603-ed9f-4f19-b775-47fe3e8b2171 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:26.406351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lazy-loading 'flavor' on Instance uuid 40e858a4-422c-4d31-a2b4-e54167933857 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:54:26.424822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Going to try to live migrate instance to tempest-host-1449028030 {{(pid=140875) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 06 10:54:26.433672 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] HTTP exception thrown: Compute host tempest-host-1449028030 could not be found. Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Request method failure captured: Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857/action HTTP/1.1 Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 107 Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFybF4w5AP-AUxeG0qRbUt6gf22NLBi_Q4yMC2qB81atrH2WUk59oM6QipELW7UBQRYQI38uFdyqMeGmmR63HK6lXjBzYitgmKazFQtjbBV_G7hS9kCtAOhMWDIrCWzQuOz3QrUUs79Q8eYnOHftlaa2Nn6HChwHMG3rgth3FPKYzehM Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 7c467640a0b74919878e4113df83ada7 Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-LiveMigrationNegativeTest-348602465 Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:54:26.438053 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:54:26.439588 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c467640a0b74919878e4113df83ada7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c467640a0b74919878e4113df83ada7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c467640a0b74919878e4113df83ada7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c467640a0b74919878e4113df83ada7"}]}] Sep 06 10:54:26.439588 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-LiveMigrationNegativeTest-348602465 Sep 06 10:54:26.439588 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 7c467640a0b74919878e4113df83ada7 Sep 06 10:54:26.439588 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-348602465 Sep 06 10:54:26.439588 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-LiveMigrationNegativeTest-348602465-project-admin Sep 06 10:54:26.439588 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:54:26.439588 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:54:26.439588 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 99afe908353d421f9a144506425bc1ca Sep 06 10:54:26.439588 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-LiveMigrationNegativeTest-348602465-project-admin Sep 06 10:54:26.439588 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:54:26.439588 ncdv-master-1 devstack@n-api.service[140875]: {"os-migrateLive": {"host": "tempest-host-1449028030", "block_migration": true, "disk_over_commit": false}} Sep 06 10:54:26.439588 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: exception: Compute host tempest-host-1449028030 could not be found. Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '40e858a4-422c-4d31-a2b4-e54167933857', 'body': {'os-migrateLive': {'host': 'tempest-host-1449028030', 'block_migration': True, 'disk_over_commit': False}}} Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 10:54:26.440429 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1449028030 could not be found. Sep 06 10:54:26.442391 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1449028030 could not be found. Sep 06 10:54:26.445134 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:26.447726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:26.447726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:26.447726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:26.447726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:26.447726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:26.447726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:54:26.447726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:54:26.447726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1449028030 could not be found. Sep 06 10:54:26.447726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:26.447726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Returning 400 to user: Compute host tempest-host-1449028030 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:54:26.447726 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1cee3fb1-9216-45f2-8d57-cb9098f1dc4a tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857/action" status: 400 len: 100 microversion: 2.1 time: 0.221911 Sep 06 10:54:26.447726 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 500/1011] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Sep 6 10:54:26 2022] POST /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857/action => generated 100 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:54:26.449629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f0ac3a53-7f35-4c58-94fc-cefa5fec5207 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:26.449629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f0ac3a53-7f35-4c58-94fc-cefa5fec5207 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:26.458544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0ac3a53-7f35-4c58-94fc-cefa5fec5207 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:26.459051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0ac3a53-7f35-4c58-94fc-cefa5fec5207 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:26.459496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0ac3a53-7f35-4c58-94fc-cefa5fec5207 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:26.460207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0ac3a53-7f35-4c58-94fc-cefa5fec5207 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:26.460664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0ac3a53-7f35-4c58-94fc-cefa5fec5207 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:26.461112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0ac3a53-7f35-4c58-94fc-cefa5fec5207 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:26.582043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0b539603-ed9f-4f19-b775-47fe3e8b2171 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:26.592160 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0b539603-ed9f-4f19-b775-47fe3e8b2171 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1471 microversion: 2.1 time: 0.239926 Sep 06 10:54:26.593619 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 512/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:26 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:26.599411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-74ebb301-bda0-4698-915d-1e83ebe8f487 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:26.600026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-74ebb301-bda0-4698-915d-1e83ebe8f487 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:26.607582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74ebb301-bda0-4698-915d-1e83ebe8f487 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:26.608264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74ebb301-bda0-4698-915d-1e83ebe8f487 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:26.608711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74ebb301-bda0-4698-915d-1e83ebe8f487 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:26.610303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74ebb301-bda0-4698-915d-1e83ebe8f487 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:26.610825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74ebb301-bda0-4698-915d-1e83ebe8f487 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:26.611326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74ebb301-bda0-4698-915d-1e83ebe8f487 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:26.676257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f0ac3a53-7f35-4c58-94fc-cefa5fec5207 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:26.684942 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f0ac3a53-7f35-4c58-94fc-cefa5fec5207 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1469 microversion: 2.1 time: 0.239577 Sep 06 10:54:26.685720 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 501/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:26 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1469 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:26.692603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-74ebb301-bda0-4698-915d-1e83ebe8f487 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:26.701180 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-74ebb301-bda0-4698-915d-1e83ebe8f487 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1211 microversion: 2.1 time: 0.106497 Sep 06 10:54:26.701923 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 513/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:26 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:26.741147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:26.741757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:26.748920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:26.749511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:26.749940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:26.750070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1476144806", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:26.750635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:26.751125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:26.751555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:26.785034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:26.785524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:26.785962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:26.786582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lazy-loading 'fault' on Instance uuid eb41f601-678e-42fe-822f-ac8f2272bc38 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:54:26.801557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:54:26.854984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:26.866543 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-66914078-3ca8-4efc-b6b7-f247190cb7c8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1315 microversion: 2.1 time: 0.129102 Sep 06 10:54:26.867807 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 502/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:26 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1315 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:26.945647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-474f77f1-75fb-42f4-a95c-a78abe4ed0f5 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:26.946265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-474f77f1-75fb-42f4-a95c-a78abe4ed0f5 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:26.954907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-474f77f1-75fb-42f4-a95c-a78abe4ed0f5 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:26.955606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-474f77f1-75fb-42f4-a95c-a78abe4ed0f5 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:26.956206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-474f77f1-75fb-42f4-a95c-a78abe4ed0f5 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:26.957005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-474f77f1-75fb-42f4-a95c-a78abe4ed0f5 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:26.957573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-474f77f1-75fb-42f4-a95c-a78abe4ed0f5 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:26.958180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-474f77f1-75fb-42f4-a95c-a78abe4ed0f5 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:27.526954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-474f77f1-75fb-42f4-a95c-a78abe4ed0f5 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:27.538403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:27.541831 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-474f77f1-75fb-42f4-a95c-a78abe4ed0f5 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.600012 Sep 06 10:54:27.542994 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 503/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:26 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:27.548295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c5a59c19-3de2-4c85-8b1d-07689d9e1880 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:27.549203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c5a59c19-3de2-4c85-8b1d-07689d9e1880 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:27.628404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:54:27.628905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:54:27.629457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:54:27.629580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c5a59c19-3de2-4c85-8b1d-07689d9e1880 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:27.629979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:54:27.630509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:54:27.637638 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c5a59c19-3de2-4c85-8b1d-07689d9e1880 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1224 microversion: 2.1 time: 0.093147 Sep 06 10:54:27.638160 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 504/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:27 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:27.640775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=28 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:27.642997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:27.642997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:27.643543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:27.644406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:27.644920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:27.645360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:27.654689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-638669f7-a83f-4426-9623-cc3359861e21 req-6f9fb057-055e-4648-8ee3-8a54b4fc0d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdba9b97-4ac9-425a-93bf-efc405463026", "name": "network-vif-deleted", "tag": "c993e7ce-f4ac-4c50-8fae-67c9b2f4e028"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:27.670980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-638669f7-a83f-4426-9623-cc3359861e21 req-6f9fb057-055e-4648-8ee3-8a54b4fc0d72 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:27.671140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Getting quotas for project 3f02d8ddd39f4d8b93a44ee6295dc7f8. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:27.671840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-638669f7-a83f-4426-9623-cc3359861e21 req-6f9fb057-055e-4648-8ee3-8a54b4fc0d72 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:27.672392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-638669f7-a83f-4426-9623-cc3359861e21 req-6f9fb057-055e-4648-8ee3-8a54b4fc0d72 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:27.676772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Getting quotas for user 8affa67bb57f451b94d1eded04b1782a and project 3f02d8ddd39f4d8b93a44ee6295dc7f8. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:27.688236 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-638669f7-a83f-4426-9623-cc3359861e21 req-6f9fb057-055e-4648-8ee3-8a54b4fc0d72 service nova] Creating event network-vif-deleted:c993e7ce-f4ac-4c50-8fae-67c9b2f4e028 for instance cdba9b97-4ac9-425a-93bf-efc405463026 on nch2-master-1 Sep 06 10:54:27.690127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:54:27.692485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:54:27.693338 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-638669f7-a83f-4426-9623-cc3359861e21 req-6f9fb057-055e-4648-8ee3-8a54b4fc0d72 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042310 Sep 06 10:54:27.693932 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 505/1018] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:27.699632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-185931d1-efe2-4e11-94f2-c6c560ad05a3 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:27.700331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-185931d1-efe2-4e11-94f2-c6c560ad05a3 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:27.707719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-185931d1-efe2-4e11-94f2-c6c560ad05a3 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:27.708233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-185931d1-efe2-4e11-94f2-c6c560ad05a3 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:27.708733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-185931d1-efe2-4e11-94f2-c6c560ad05a3 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:27.709465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-185931d1-efe2-4e11-94f2-c6c560ad05a3 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:27.709928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-185931d1-efe2-4e11-94f2-c6c560ad05a3 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:27.710363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-185931d1-efe2-4e11-94f2-c6c560ad05a3 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:27.964318 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5721ce25-2e48-4c57-85d9-3634679f7ac2 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.218147 Sep 06 10:54:27.971734 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 514/1019] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:54:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 10:54:27.977192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-741b7b12-ca5d-42bc-8919-df9c3f9e1677 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:27.978036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-741b7b12-ca5d-42bc-8919-df9c3f9e1677 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:27.985659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741b7b12-ca5d-42bc-8919-df9c3f9e1677 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:27.986359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741b7b12-ca5d-42bc-8919-df9c3f9e1677 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:27.986995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741b7b12-ca5d-42bc-8919-df9c3f9e1677 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:27.992923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741b7b12-ca5d-42bc-8919-df9c3f9e1677 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:27.992923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741b7b12-ca5d-42bc-8919-df9c3f9e1677 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:27.992923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741b7b12-ca5d-42bc-8919-df9c3f9e1677 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:28.003741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-185931d1-efe2-4e11-94f2-c6c560ad05a3 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:28.013310 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-185931d1-efe2-4e11-94f2-c6c560ad05a3 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1477 microversion: 2.1 time: 0.318178 Sep 06 10:54:28.013874 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 506/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:27 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1477 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:28.035671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:28.036300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:28.045401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:28.050322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:28.050322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:28.050322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:28.050322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:28.050715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:28.105525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-741b7b12-ca5d-42bc-8919-df9c3f9e1677 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:28.108962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:28.113348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:28.114339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:28.117437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lazy-loading 'fault' on Instance uuid eb41f601-678e-42fe-822f-ac8f2272bc38 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:54:28.120629 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-741b7b12-ca5d-42bc-8919-df9c3f9e1677 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1203 microversion: 2.1 time: 0.147434 Sep 06 10:54:28.133412 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 515/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:27 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:28.133412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b61aeb90-1cd9-4391-9c61-e6394c8b9258 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:28.133412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b61aeb90-1cd9-4391-9c61-e6394c8b9258 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:28.202274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117e12084c60416aabce823ebae4f214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52177b94887d409f9034b3cee40237dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:28.213830 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6bb56831-e40c-41f2-92eb-417caf11a562 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 200 len: 1315 microversion: 2.1 time: 0.184896 Sep 06 10:54:28.232383 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 507/1022] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:28 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:28.245688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b61aeb90-1cd9-4391-9c61-e6394c8b9258 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:28.253481 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b61aeb90-1cd9-4391-9c61-e6394c8b9258 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1219 microversion: 2.1 time: 0.128205 Sep 06 10:54:28.255706 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 516/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:28 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:28.565146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5861f4ce-81ad-4438-b3be-efba1e8a4d8d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:28.565877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5861f4ce-81ad-4438-b3be-efba1e8a4d8d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:28.572434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5861f4ce-81ad-4438-b3be-efba1e8a4d8d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:28.572924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5861f4ce-81ad-4438-b3be-efba1e8a4d8d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:28.573372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5861f4ce-81ad-4438-b3be-efba1e8a4d8d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:28.574075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5861f4ce-81ad-4438-b3be-efba1e8a4d8d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:28.574536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5861f4ce-81ad-4438-b3be-efba1e8a4d8d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:28.574971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5861f4ce-81ad-4438-b3be-efba1e8a4d8d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:28.660514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8cbd95e4-6a93-48c6-a202-8064f1ea3a46 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:28.661241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8cbd95e4-6a93-48c6-a202-8064f1ea3a46 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:28.668611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cbd95e4-6a93-48c6-a202-8064f1ea3a46 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:28.669098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cbd95e4-6a93-48c6-a202-8064f1ea3a46 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:28.669538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cbd95e4-6a93-48c6-a202-8064f1ea3a46 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:28.670237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cbd95e4-6a93-48c6-a202-8064f1ea3a46 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:28.670700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cbd95e4-6a93-48c6-a202-8064f1ea3a46 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:28.671147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cbd95e4-6a93-48c6-a202-8064f1ea3a46 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:28.724049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5861f4ce-81ad-4438-b3be-efba1e8a4d8d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:28.733964 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5861f4ce-81ad-4438-b3be-efba1e8a4d8d tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.172555 Sep 06 10:54:28.734887 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 508/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:28 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:28.742348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8cbd95e4-6a93-48c6-a202-8064f1ea3a46 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:28.750773 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8cbd95e4-6a93-48c6-a202-8064f1ea3a46 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1276 microversion: 2.1 time: 0.094289 Sep 06 10:54:28.751383 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 517/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:28 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:29.038854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c97a4c3-1991-4f5f-bf2c-4c9c5db2862b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:29.042491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c97a4c3-1991-4f5f-bf2c-4c9c5db2862b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:29.045806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c97a4c3-1991-4f5f-bf2c-4c9c5db2862b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.046301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c97a4c3-1991-4f5f-bf2c-4c9c5db2862b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.046749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c97a4c3-1991-4f5f-bf2c-4c9c5db2862b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.047514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c97a4c3-1991-4f5f-bf2c-4c9c5db2862b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.047978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c97a4c3-1991-4f5f-bf2c-4c9c5db2862b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.048413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c97a4c3-1991-4f5f-bf2c-4c9c5db2862b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.145866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6569517f-2f23-454b-b6b1-8a48d4c48fe8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:29.146511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6569517f-2f23-454b-b6b1-8a48d4c48fe8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:29.153427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6569517f-2f23-454b-b6b1-8a48d4c48fe8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.154192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6569517f-2f23-454b-b6b1-8a48d4c48fe8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.154710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6569517f-2f23-454b-b6b1-8a48d4c48fe8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.155724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6569517f-2f23-454b-b6b1-8a48d4c48fe8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.156216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6569517f-2f23-454b-b6b1-8a48d4c48fe8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.156872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6569517f-2f23-454b-b6b1-8a48d4c48fe8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.179965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:29.182554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2c97a4c3-1991-4f5f-bf2c-4c9c5db2862b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:29.190947 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c97a4c3-1991-4f5f-bf2c-4c9c5db2862b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1477 microversion: 2.1 time: 0.155847 Sep 06 10:54:29.192219 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 509/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:29 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:29.228621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6569517f-2f23-454b-b6b1-8a48d4c48fe8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:29.236290 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6569517f-2f23-454b-b6b1-8a48d4c48fe8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1267 microversion: 2.1 time: 0.094369 Sep 06 10:54:29.236872 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 518/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:29 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:29.240424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1981b872-ab5e-4fd4-9fdf-8752b73997a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:29.240954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1981b872-ab5e-4fd4-9fdf-8752b73997a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: eb41f601-678e-42fe-822f-ac8f2272bc38] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:29.247940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1981b872-ab5e-4fd4-9fdf-8752b73997a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.248797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1981b872-ab5e-4fd4-9fdf-8752b73997a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.248943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1981b872-ab5e-4fd4-9fdf-8752b73997a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.249707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1981b872-ab5e-4fd4-9fdf-8752b73997a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.250166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1981b872-ab5e-4fd4-9fdf-8752b73997a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.250617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1981b872-ab5e-4fd4-9fdf-8752b73997a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.264301 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-1981b872-ab5e-4fd4-9fdf-8752b73997a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] HTTP exception thrown: Instance eb41f601-678e-42fe-822f-ac8f2272bc38 could not be found. Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1981b872-ab5e-4fd4-9fdf-8752b73997a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 HTTP/1.1 Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:54:29.265939 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:54:29.267669 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:54:29.267669 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:29.267669 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:29.267669 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:29.267669 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:29.267669 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:54:29.267669 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:54:29.267669 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:54:29.267669 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:29.267669 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:54:29.267669 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance eb41f601-678e-42fe-822f-ac8f2272bc38 could not be found. Sep 06 10:54:29.267669 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'eb41f601-678e-42fe-822f-ac8f2272bc38'} Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb41f601-678e-42fe-822f-ac8f2272bc38 could not be found. Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:54:29.268758 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb41f601-678e-42fe-822f-ac8f2272bc38 could not be found. Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb41f601-678e-42fe-822f-ac8f2272bc38 could not be found. Sep 06 10:54:29.270313 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.271735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1981b872-ab5e-4fd4-9fdf-8752b73997a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 404 to user: Instance eb41f601-678e-42fe-822f-ac8f2272bc38 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:54:29.271735 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1981b872-ab5e-4fd4-9fdf-8752b73997a1 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38" status: 404 len: 111 microversion: 2.1 time: 0.032164 Sep 06 10:54:29.271735 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 510/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:29 2022] GET /compute/v2.1/servers/eb41f601-678e-42fe-822f-ac8f2272bc38 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:54:29.276759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8fc95b0c-8688-40ad-a11b-fe1ddc4cab31 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '.version_select at 0x7f90f876dc10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:29.283898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-de020894-20e4-4505-989e-efcaad1e77a3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:29.284529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-de020894-20e4-4505-989e-efcaad1e77a3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:29.291226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de020894-20e4-4505-989e-efcaad1e77a3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.291651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de020894-20e4-4505-989e-efcaad1e77a3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.292091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de020894-20e4-4505-989e-efcaad1e77a3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.292791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de020894-20e4-4505-989e-efcaad1e77a3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.293243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de020894-20e4-4505-989e-efcaad1e77a3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.293670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de020894-20e4-4505-989e-efcaad1e77a3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.300592 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-8fc95b0c-8688-40ad-a11b-fe1ddc4cab31 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] HTTP exception thrown: Image not found. Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8fc95b0c-8688-40ad-a11b-fe1ddc4cab31 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/images/60cd360d-a66d-4b2d-8f8f-3d13a2f293f6 HTTP/1.1 Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:54:29.302548 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:54:29.304260 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:54:29.304260 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:29.304260 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:29.304260 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:29.304260 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:29.304260 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:54:29.304260 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:54:29.304260 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:54:29.304260 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:29.304260 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:54:29.304260 ncdv-master-1 devstack@n-api.service[140876]: exception: Image not found. Sep 06 10:54:29.304260 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '60cd360d-a66d-4b2d-8f8f-3d13a2f293f6'} Sep 06 10:54:29.304260 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 60cd360d-a66d-4b2d-8f8f-3d13a2f293f6 to delete Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:29.305247 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60cd360d-a66d-4b2d-8f8f-3d13a2f293f6 could not be found. Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:54:29.307324 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:54:29.308786 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 06 10:54:29.308786 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:54:29.308786 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:54:29.308786 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.308786 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:29.308786 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.308786 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:29.308786 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:29.308786 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:29.308786 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:54:29.308786 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:54:29.308786 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:54:29.308786 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.310562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8fc95b0c-8688-40ad-a11b-fe1ddc4cab31 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 404 to user: Image not found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:54:29.311448 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8fc95b0c-8688-40ad-a11b-fe1ddc4cab31 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "DELETE /compute/v2.1/images/60cd360d-a66d-4b2d-8f8f-3d13a2f293f6" status: 404 len: 62 microversion: 2.1 time: 0.039412 Sep 06 10:54:29.312016 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 519/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:29 2022] DELETE /compute/v2.1/images/60cd360d-a66d-4b2d-8f8f-3d13a2f293f6 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 06 10:54:29.319961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b7ecb1a9-2f72-40fe-92b8-f104897fc45b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:29.320472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b7ecb1a9-2f72-40fe-92b8-f104897fc45b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:29.327393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7ecb1a9-2f72-40fe-92b8-f104897fc45b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.327896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7ecb1a9-2f72-40fe-92b8-f104897fc45b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.328349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7ecb1a9-2f72-40fe-92b8-f104897fc45b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.329062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7ecb1a9-2f72-40fe-92b8-f104897fc45b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.329531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7ecb1a9-2f72-40fe-92b8-f104897fc45b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.329965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7ecb1a9-2f72-40fe-92b8-f104897fc45b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.346283 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-b7ecb1a9-2f72-40fe-92b8-f104897fc45b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] HTTP exception thrown: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b7ecb1a9-2f72-40fe-92b8-f104897fc45b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 HTTP/1.1 Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:54:29.348149 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:54:29.349758 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:54:29.349758 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:29.349758 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:29.349758 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:29.349758 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:29.349758 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:54:29.349758 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:54:29.349758 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:54:29.349758 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:29.349758 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:54:29.349758 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:54:29.349758 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '3270e900-2c13-43a0-9bb1-2a45ad779f85'} Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:54:29.350605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:54:29.352099 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.354216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b7ecb1a9-2f72-40fe-92b8-f104897fc45b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 404 to user: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:54:29.354216 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b7ecb1a9-2f72-40fe-92b8-f104897fc45b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 404 len: 111 microversion: 2.1 time: 0.033411 Sep 06 10:54:29.354216 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 520/1030] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:54:29 2022] DELETE /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:54:29.355752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-de020894-20e4-4505-989e-efcaad1e77a3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:29.359440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb1659e9-73d5-45cd-8a2f-d3dfa302ec2a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:29.360144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bb1659e9-73d5-45cd-8a2f-d3dfa302ec2a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 3270e900-2c13-43a0-9bb1-2a45ad779f85] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:29.363874 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-de020894-20e4-4505-989e-efcaad1e77a3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1223 microversion: 2.1 time: 0.083686 Sep 06 10:54:29.364469 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 511/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:29 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:29.374253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb1659e9-73d5-45cd-8a2f-d3dfa302ec2a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.374253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb1659e9-73d5-45cd-8a2f-d3dfa302ec2a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.374253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb1659e9-73d5-45cd-8a2f-d3dfa302ec2a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.374253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb1659e9-73d5-45cd-8a2f-d3dfa302ec2a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.379451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb1659e9-73d5-45cd-8a2f-d3dfa302ec2a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.379451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb1659e9-73d5-45cd-8a2f-d3dfa302ec2a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.384155 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-bb1659e9-73d5-45cd-8a2f-d3dfa302ec2a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] HTTP exception thrown: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb1659e9-73d5-45cd-8a2f-d3dfa302ec2a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 HTTP/1.1 Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:54:29.385749 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:54:29.387339 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:54:29.387339 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:29.387339 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:29.387339 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:29.387339 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:29.387339 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:54:29.387339 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:54:29.387339 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:54:29.387339 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:29.387339 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:54:29.387339 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:54:29.387339 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '3270e900-2c13-43a0-9bb1-2a45ad779f85'} Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:54:29.388198 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. Sep 06 10:54:29.389625 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:29.390999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb1659e9-73d5-45cd-8a2f-d3dfa302ec2a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 404 to user: Instance 3270e900-2c13-43a0-9bb1-2a45ad779f85 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:54:29.390999 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bb1659e9-73d5-45cd-8a2f-d3dfa302ec2a tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85" status: 404 len: 111 microversion: 2.1 time: 0.031746 Sep 06 10:54:29.390999 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 521/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:29 2022] GET /compute/v2.1/servers/3270e900-2c13-43a0-9bb1-2a45ad779f85 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:54:29.395821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-854966c8-5c20-4114-a8ed-38ce8bd97d0b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '.version_select at 0x7f90f8767ee0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:29.482006 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-854966c8-5c20-4114-a8ed-38ce8bd97d0b tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-400484163" status: 202 len: 0 microversion: 2.1 time: 0.089864 Sep 06 10:54:29.482598 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 512/1033] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 10:54:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-400484163 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:54:29.758835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8ad2441b-6f30-4150-81d0-a44a8f499a39 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:29.760200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8ad2441b-6f30-4150-81d0-a44a8f499a39 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:29.767083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8ad2441b-6f30-4150-81d0-a44a8f499a39 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.767571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8ad2441b-6f30-4150-81d0-a44a8f499a39 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.768016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8ad2441b-6f30-4150-81d0-a44a8f499a39 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.768738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8ad2441b-6f30-4150-81d0-a44a8f499a39 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.769343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8ad2441b-6f30-4150-81d0-a44a8f499a39 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.769621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8ad2441b-6f30-4150-81d0-a44a8f499a39 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.775910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d9766caa-bf2a-4561-8e93-419cfdd8f4c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:29.776982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d9766caa-bf2a-4561-8e93-419cfdd8f4c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:29.783799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9766caa-bf2a-4561-8e93-419cfdd8f4c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.784664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9766caa-bf2a-4561-8e93-419cfdd8f4c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.785368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9766caa-bf2a-4561-8e93-419cfdd8f4c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.786183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9766caa-bf2a-4561-8e93-419cfdd8f4c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:29.786989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9766caa-bf2a-4561-8e93-419cfdd8f4c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:29.787668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9766caa-bf2a-4561-8e93-419cfdd8f4c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:29.892694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d9766caa-bf2a-4561-8e93-419cfdd8f4c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:29.901165 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d9766caa-bf2a-4561-8e93-419cfdd8f4c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1276 microversion: 2.1 time: 0.130108 Sep 06 10:54:29.901746 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 513/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:29 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:30.016355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8ad2441b-6f30-4150-81d0-a44a8f499a39 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:30.024476 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8ad2441b-6f30-4150-81d0-a44a8f499a39 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.270366 Sep 06 10:54:30.025743 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 522/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:29 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:30.215438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e387825a-2416-40ff-9871-86ea2274aa42 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:30.216904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e387825a-2416-40ff-9871-86ea2274aa42 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:30.223397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e387825a-2416-40ff-9871-86ea2274aa42 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:30.224221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e387825a-2416-40ff-9871-86ea2274aa42 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:30.224670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e387825a-2416-40ff-9871-86ea2274aa42 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:30.225383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e387825a-2416-40ff-9871-86ea2274aa42 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:30.228295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e387825a-2416-40ff-9871-86ea2274aa42 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:30.228904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e387825a-2416-40ff-9871-86ea2274aa42 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:30.266145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fd65759f-f0a1-485f-bce6-c4a5d2fdad62 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:30.266830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fd65759f-f0a1-485f-bce6-c4a5d2fdad62 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:30.274085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd65759f-f0a1-485f-bce6-c4a5d2fdad62 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:30.274844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd65759f-f0a1-485f-bce6-c4a5d2fdad62 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:30.276346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd65759f-f0a1-485f-bce6-c4a5d2fdad62 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:30.277976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd65759f-f0a1-485f-bce6-c4a5d2fdad62 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:30.278806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd65759f-f0a1-485f-bce6-c4a5d2fdad62 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:30.279555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd65759f-f0a1-485f-bce6-c4a5d2fdad62 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:30.403201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fd65759f-f0a1-485f-bce6-c4a5d2fdad62 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:30.411151 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fd65759f-f0a1-485f-bce6-c4a5d2fdad62 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1267 microversion: 2.1 time: 0.154742 Sep 06 10:54:30.411725 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 523/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:30 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:30.416607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-33d53186-5b3b-4994-8a89-7b3c6413535c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:30.417214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-33d53186-5b3b-4994-8a89-7b3c6413535c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:30.423473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33d53186-5b3b-4994-8a89-7b3c6413535c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:30.424120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33d53186-5b3b-4994-8a89-7b3c6413535c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:30.424564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33d53186-5b3b-4994-8a89-7b3c6413535c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:30.425381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33d53186-5b3b-4994-8a89-7b3c6413535c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:30.426013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33d53186-5b3b-4994-8a89-7b3c6413535c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:30.426614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33d53186-5b3b-4994-8a89-7b3c6413535c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:30.567477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-33d53186-5b3b-4994-8a89-7b3c6413535c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:30.591864 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-33d53186-5b3b-4994-8a89-7b3c6413535c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1223 microversion: 2.1 time: 0.178855 Sep 06 10:54:30.592452 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 524/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:30 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1223 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:30.646009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e387825a-2416-40ff-9871-86ea2274aa42 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:30.654575 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e387825a-2416-40ff-9871-86ea2274aa42 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1477 microversion: 2.1 time: 0.442866 Sep 06 10:54:30.674275 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 514/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:30 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1477 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:30.681857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8323204b-9ab6-4dc7-ad3b-b7a8bbbd1220 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '.version_select at 0x7f90f870d3a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:30.704571 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-8323204b-9ab6-4dc7-ad3b-b7a8bbbd1220 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] HTTP exception thrown: Image not found. Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8323204b-9ab6-4dc7-ad3b-b7a8bbbd1220 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/images/d0634bd2-c679-41d3-a2a7-ec4c8cc8742e HTTP/1.1 Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:54:30.706359 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:54:30.708636 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:54:30.708636 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:30.708636 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:30.708636 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:30.708636 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:30.708636 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:54:30.708636 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:54:30.708636 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:54:30.708636 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:30.708636 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:54:30.708636 ncdv-master-1 devstack@n-api.service[140876]: exception: Image not found. Sep 06 10:54:30.708636 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'd0634bd2-c679-41d3-a2a7-ec4c8cc8742e'} Sep 06 10:54:30.708636 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d0634bd2-c679-41d3-a2a7-ec4c8cc8742e to delete Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:30.709627 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d0634bd2-c679-41d3-a2a7-ec4c8cc8742e could not be found. Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:54:30.711027 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8323204b-9ab6-4dc7-ad3b-b7a8bbbd1220 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 404 to user: Image not found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:54:30.712944 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8323204b-9ab6-4dc7-ad3b-b7a8bbbd1220 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "DELETE /compute/v2.1/images/d0634bd2-c679-41d3-a2a7-ec4c8cc8742e" status: 404 len: 62 microversion: 2.1 time: 0.030097 Sep 06 10:54:30.714138 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 525/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:30 2022] DELETE /compute/v2.1/images/d0634bd2-c679-41d3-a2a7-ec4c8cc8742e => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:54:30.717403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a1946855-6314-493b-ac51-777df2bf22d8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:30.718012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a1946855-6314-493b-ac51-777df2bf22d8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:30.724333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:DELETE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:30.725803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1946855-6314-493b-ac51-777df2bf22d8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:30.730577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1946855-6314-493b-ac51-777df2bf22d8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:30.730577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1946855-6314-493b-ac51-777df2bf22d8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:30.730577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1946855-6314-493b-ac51-777df2bf22d8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:30.730577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1946855-6314-493b-ac51-777df2bf22d8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:30.730975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1946855-6314-493b-ac51-777df2bf22d8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:30.744206 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-a1946855-6314-493b-ac51-777df2bf22d8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] HTTP exception thrown: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a1946855-6314-493b-ac51-777df2bf22d8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 HTTP/1.1 Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:54:30.745791 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:54:30.747295 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:54:30.747295 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:30.747295 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:30.747295 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:30.747295 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:30.747295 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:54:30.747295 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:54:30.747295 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:54:30.747295 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:30.747295 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:54:30.747295 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:54:30.747295 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '94c8cb47-28e9-42c5-97f6-8cefe47b7555'} Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:54:30.748181 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:54:30.749624 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.753762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a1946855-6314-493b-ac51-777df2bf22d8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 404 to user: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:54:30.753762 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a1946855-6314-493b-ac51-777df2bf22d8 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "DELETE /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 404 len: 111 microversion: 2.1 time: 0.033929 Sep 06 10:54:30.753762 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 515/1040] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:54:30 2022] DELETE /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:54:30.756769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-848b29cc-a3ca-47e7-862f-b1c9943dd7d6 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:30.757532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-848b29cc-a3ca-47e7-862f-b1c9943dd7d6 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] [instance: 94c8cb47-28e9-42c5-97f6-8cefe47b7555] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:30.765799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-848b29cc-a3ca-47e7-862f-b1c9943dd7d6 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:30.766405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-848b29cc-a3ca-47e7-862f-b1c9943dd7d6 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:30.766720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-848b29cc-a3ca-47e7-862f-b1c9943dd7d6 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:30.767517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-848b29cc-a3ca-47e7-862f-b1c9943dd7d6 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:30.768040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-848b29cc-a3ca-47e7-862f-b1c9943dd7d6 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:30.768482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-848b29cc-a3ca-47e7-862f-b1c9943dd7d6 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:30.784700 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-848b29cc-a3ca-47e7-862f-b1c9943dd7d6 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] HTTP exception thrown: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-848b29cc-a3ca-47e7-862f-b1c9943dd7d6 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Request method failure captured: Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 HTTP/1.1 Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyZl7D-R2bhT_BgUT9mDy5FcqdB5GqPuIEbLbWohv-v84Wm9y8C1fCkpMM-W3uX8Y8H5EQTCxTh7kOkdgtwtfXIvOR9T42gKwTu-inV8OvV4z_y63kMVylv0fQIihvQJq90PY4vFwluk2oY5BzQlcEqljzwnNZyv3plzuc2ZXm3yS4c Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:54:30.786497 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:54:30.788109 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52177b94887d409f9034b3cee40237dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52177b94887d409f9034b3cee40237dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52177b94887d409f9034b3cee40237dd"}]}] Sep 06 10:54:30.788109 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:30.788109 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 52177b94887d409f9034b3cee40237dd Sep 06 10:54:30.788109 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-673729736 Sep 06 10:54:30.788109 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:30.788109 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:54:30.788109 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:54:30.788109 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 117e12084c60416aabce823ebae4f214 Sep 06 10:54:30.788109 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-673729736-project Sep 06 10:54:30.788109 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:54:30.788109 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:54:30.788109 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '94c8cb47-28e9-42c5-97f6-8cefe47b7555'} Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:54:30.788897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. Sep 06 10:54:30.790107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:54:30.791347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-848b29cc-a3ca-47e7-862f-b1c9943dd7d6 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] Returning 404 to user: Instance 94c8cb47-28e9-42c5-97f6-8cefe47b7555 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:54:30.791347 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-848b29cc-a3ca-47e7-862f-b1c9943dd7d6 tempest-ImagesOneServerNegativeTestJSON-673729736 tempest-ImagesOneServerNegativeTestJSON-673729736-project] 10.222.0.20 "GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555" status: 404 len: 111 microversion: 2.1 time: 0.035761 Sep 06 10:54:30.791347 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 526/1041] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:30 2022] GET /compute/v2.1/servers/94c8cb47-28e9-42c5-97f6-8cefe47b7555 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:54:30.924034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ec5656aa-6671-4cf6-aa95-2a0148baccac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:30.924641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ec5656aa-6671-4cf6-aa95-2a0148baccac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:30.931746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec5656aa-6671-4cf6-aa95-2a0148baccac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:30.934232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec5656aa-6671-4cf6-aa95-2a0148baccac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:30.934232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec5656aa-6671-4cf6-aa95-2a0148baccac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:30.934232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec5656aa-6671-4cf6-aa95-2a0148baccac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:30.934232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec5656aa-6671-4cf6-aa95-2a0148baccac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:30.934581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec5656aa-6671-4cf6-aa95-2a0148baccac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:31.050852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-816f6d17-a210-47c9-8a67-939e917cd425 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:31.051633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ec5656aa-6671-4cf6-aa95-2a0148baccac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:31.052197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-816f6d17-a210-47c9-8a67-939e917cd425 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:31.060647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-816f6d17-a210-47c9-8a67-939e917cd425 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:31.061292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-816f6d17-a210-47c9-8a67-939e917cd425 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:31.061840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-816f6d17-a210-47c9-8a67-939e917cd425 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:31.062261 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ec5656aa-6671-4cf6-aa95-2a0148baccac tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1284 microversion: 2.1 time: 0.141860 Sep 06 10:54:31.062757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-816f6d17-a210-47c9-8a67-939e917cd425 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:31.063561 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 516/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:30 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:31.075875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-816f6d17-a210-47c9-8a67-939e917cd425 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:31.076584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-816f6d17-a210-47c9-8a67-939e917cd425 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:31.438533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-81451aa8-d9d7-404c-b6bd-55d99f53b77d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:31.439878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-81451aa8-d9d7-404c-b6bd-55d99f53b77d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:31.448113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81451aa8-d9d7-404c-b6bd-55d99f53b77d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:31.449792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81451aa8-d9d7-404c-b6bd-55d99f53b77d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:31.449792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81451aa8-d9d7-404c-b6bd-55d99f53b77d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:31.451206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81451aa8-d9d7-404c-b6bd-55d99f53b77d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:31.451840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81451aa8-d9d7-404c-b6bd-55d99f53b77d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:31.452409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81451aa8-d9d7-404c-b6bd-55d99f53b77d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:31.578763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-81451aa8-d9d7-404c-b6bd-55d99f53b77d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:31.587272 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-81451aa8-d9d7-404c-b6bd-55d99f53b77d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1265 microversion: 2.1 time: 0.156488 Sep 06 10:54:31.588003 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 517/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:31 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:31.615916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6a8fe652-d58f-41bc-b36e-0e8f805c4ae9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:31.623385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6a8fe652-d58f-41bc-b36e-0e8f805c4ae9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:31.624303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-816f6d17-a210-47c9-8a67-939e917cd425 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:31.624786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8fe652-d58f-41bc-b36e-0e8f805c4ae9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:31.625476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8fe652-d58f-41bc-b36e-0e8f805c4ae9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:31.626225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8fe652-d58f-41bc-b36e-0e8f805c4ae9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:31.627265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8fe652-d58f-41bc-b36e-0e8f805c4ae9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:31.627989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8fe652-d58f-41bc-b36e-0e8f805c4ae9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:31.628588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8fe652-d58f-41bc-b36e-0e8f805c4ae9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:31.651510 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-816f6d17-a210-47c9-8a67-939e917cd425 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.604783 Sep 06 10:54:31.652749 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 527/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:31 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:31.688630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6db6359b-17ab-424f-a9d4-cebcc79e2d0f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:31.689775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6db6359b-17ab-424f-a9d4-cebcc79e2d0f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:31.697948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6db6359b-17ab-424f-a9d4-cebcc79e2d0f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:31.698711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6db6359b-17ab-424f-a9d4-cebcc79e2d0f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:31.699191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6db6359b-17ab-424f-a9d4-cebcc79e2d0f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:31.700081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6db6359b-17ab-424f-a9d4-cebcc79e2d0f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:31.700579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6db6359b-17ab-424f-a9d4-cebcc79e2d0f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:31.701011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6db6359b-17ab-424f-a9d4-cebcc79e2d0f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:31.785964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6a8fe652-d58f-41bc-b36e-0e8f805c4ae9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:31.795482 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6a8fe652-d58f-41bc-b36e-0e8f805c4ae9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1271 microversion: 2.1 time: 0.183515 Sep 06 10:54:31.796236 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 518/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:31 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:31.927533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6db6359b-17ab-424f-a9d4-cebcc79e2d0f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:31.937815 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6db6359b-17ab-424f-a9d4-cebcc79e2d0f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1477 microversion: 2.1 time: 0.253014 Sep 06 10:54:31.938711 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 528/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:31 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1477 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:32.090263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c8f46980-bd16-43d4-8b67-d6952a002426 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:32.091301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c8f46980-bd16-43d4-8b67-d6952a002426 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:32.093848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-32f14e3a-8016-4629-aaf6-6bb45a17013f req-6d9f879d-bdee-4f59-af35-d1c643ee72d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dd8f1a-f2a3-463e-9129-1060fc467171", "name": "network-vif-plugged", "status": "completed", "tag": "0722de88-af62-4350-ab9b-6cd8023675fa"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:32.098166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8f46980-bd16-43d4-8b67-d6952a002426 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:32.098684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8f46980-bd16-43d4-8b67-d6952a002426 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:32.099489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8f46980-bd16-43d4-8b67-d6952a002426 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:32.100216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8f46980-bd16-43d4-8b67-d6952a002426 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:32.100719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8f46980-bd16-43d4-8b67-d6952a002426 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:32.101159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8f46980-bd16-43d4-8b67-d6952a002426 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:32.104947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-32f14e3a-8016-4629-aaf6-6bb45a17013f req-6d9f879d-bdee-4f59-af35-d1c643ee72d3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:32.106946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-32f14e3a-8016-4629-aaf6-6bb45a17013f req-6d9f879d-bdee-4f59-af35-d1c643ee72d3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:32.106946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-32f14e3a-8016-4629-aaf6-6bb45a17013f req-6d9f879d-bdee-4f59-af35-d1c643ee72d3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:32.120222 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-32f14e3a-8016-4629-aaf6-6bb45a17013f req-6d9f879d-bdee-4f59-af35-d1c643ee72d3 service nova] Creating event network-vif-plugged:0722de88-af62-4350-ab9b-6cd8023675fa for instance 77dd8f1a-f2a3-463e-9129-1060fc467171 on nch1-master-1 Sep 06 10:54:32.125323 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-32f14e3a-8016-4629-aaf6-6bb45a17013f req-6d9f879d-bdee-4f59-af35-d1c643ee72d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035100 Sep 06 10:54:32.125929 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 529/1047] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:32.169474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c8f46980-bd16-43d4-8b67-d6952a002426 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:32.178502 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c8f46980-bd16-43d4-8b67-d6952a002426 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1282 microversion: 2.1 time: 0.092401 Sep 06 10:54:32.179177 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 519/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:32 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:32.613346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8b6409b1-f130-4585-859e-ed95c129159c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:32.614063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8b6409b1-f130-4585-859e-ed95c129159c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:32.633895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b6409b1-f130-4585-859e-ed95c129159c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:32.633895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b6409b1-f130-4585-859e-ed95c129159c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:32.633895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b6409b1-f130-4585-859e-ed95c129159c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:32.633895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b6409b1-f130-4585-859e-ed95c129159c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:32.634335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b6409b1-f130-4585-859e-ed95c129159c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:32.634335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b6409b1-f130-4585-859e-ed95c129159c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:32.675125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-719d026e-5d06-4d72-9293-e9c3183a613b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:32.675906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-719d026e-5d06-4d72-9293-e9c3183a613b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:32.686556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-719d026e-5d06-4d72-9293-e9c3183a613b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:32.690234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-719d026e-5d06-4d72-9293-e9c3183a613b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:32.690825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-719d026e-5d06-4d72-9293-e9c3183a613b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:32.694170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-719d026e-5d06-4d72-9293-e9c3183a613b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:32.697525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-719d026e-5d06-4d72-9293-e9c3183a613b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:32.699472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-719d026e-5d06-4d72-9293-e9c3183a613b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:33.077643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8b6409b1-f130-4585-859e-ed95c129159c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:33.087504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-719d026e-5d06-4d72-9293-e9c3183a613b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:33.100580 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-719d026e-5d06-4d72-9293-e9c3183a613b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.429174 Sep 06 10:54:33.109289 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 520/1049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:32 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:33.109650 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8b6409b1-f130-4585-859e-ed95c129159c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1307 microversion: 2.1 time: 0.500435 Sep 06 10:54:33.114288 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 530/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:32 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1307 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:33.116957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-55c3b4b3-eebb-43ed-8a96-c7a36a8e72c9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:33.118127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-55c3b4b3-eebb-43ed-8a96-c7a36a8e72c9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:33.126371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55c3b4b3-eebb-43ed-8a96-c7a36a8e72c9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:33.127782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55c3b4b3-eebb-43ed-8a96-c7a36a8e72c9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:33.128692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55c3b4b3-eebb-43ed-8a96-c7a36a8e72c9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:33.129660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55c3b4b3-eebb-43ed-8a96-c7a36a8e72c9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:33.130430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55c3b4b3-eebb-43ed-8a96-c7a36a8e72c9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:33.131184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55c3b4b3-eebb-43ed-8a96-c7a36a8e72c9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:33.135391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34703c5a-9cd7-4f09-a048-c7407915d196 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:33.141484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-34703c5a-9cd7-4f09-a048-c7407915d196 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:33.166430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34703c5a-9cd7-4f09-a048-c7407915d196 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:33.166969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34703c5a-9cd7-4f09-a048-c7407915d196 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:33.167453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34703c5a-9cd7-4f09-a048-c7407915d196 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:33.168182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34703c5a-9cd7-4f09-a048-c7407915d196 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:33.171592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34703c5a-9cd7-4f09-a048-c7407915d196 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:33.176301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34703c5a-9cd7-4f09-a048-c7407915d196 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:33.322649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-55c3b4b3-eebb-43ed-8a96-c7a36a8e72c9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:33.331255 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-55c3b4b3-eebb-43ed-8a96-c7a36a8e72c9 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1289 microversion: 2.1 time: 0.220384 Sep 06 10:54:33.332170 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 521/1051] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:33 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1289 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:33.338128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2e4fc2b8-b222-42fd-b547-eccebfb319b6 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:33.339040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2e4fc2b8-b222-42fd-b547-eccebfb319b6 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:33.345252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e4fc2b8-b222-42fd-b547-eccebfb319b6 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:33.346296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e4fc2b8-b222-42fd-b547-eccebfb319b6 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:33.346978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e4fc2b8-b222-42fd-b547-eccebfb319b6 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:33.347965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e4fc2b8-b222-42fd-b547-eccebfb319b6 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:33.348596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e4fc2b8-b222-42fd-b547-eccebfb319b6 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:33.349029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e4fc2b8-b222-42fd-b547-eccebfb319b6 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:33.514792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2e4fc2b8-b222-42fd-b547-eccebfb319b6 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:33.526706 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2e4fc2b8-b222-42fd-b547-eccebfb319b6 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1282 microversion: 2.1 time: 0.192415 Sep 06 10:54:33.527697 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 522/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:33 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1282 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:33.632383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-34703c5a-9cd7-4f09-a048-c7407915d196 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:33.655438 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-34703c5a-9cd7-4f09-a048-c7407915d196 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1477 microversion: 2.1 time: 0.544093 Sep 06 10:54:33.659421 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 531/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:33 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1477 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:34.143673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-357f68cc-c31d-4e58-96ee-db2affc55906 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:34.146184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1c90d4f9-9013-4457-b5ab-ec96f10f4efb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:34.148313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1c90d4f9-9013-4457-b5ab-ec96f10f4efb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:34.149078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-357f68cc-c31d-4e58-96ee-db2affc55906 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:34.165136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-357f68cc-c31d-4e58-96ee-db2affc55906 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:34.166022 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-357f68cc-c31d-4e58-96ee-db2affc55906 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:34.166482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c90d4f9-9013-4457-b5ab-ec96f10f4efb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:34.167239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c90d4f9-9013-4457-b5ab-ec96f10f4efb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:34.167945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-357f68cc-c31d-4e58-96ee-db2affc55906 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:34.169617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c90d4f9-9013-4457-b5ab-ec96f10f4efb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:34.170360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-357f68cc-c31d-4e58-96ee-db2affc55906 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:34.171543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-357f68cc-c31d-4e58-96ee-db2affc55906 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:34.172245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c90d4f9-9013-4457-b5ab-ec96f10f4efb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:34.174227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c90d4f9-9013-4457-b5ab-ec96f10f4efb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:34.174477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-357f68cc-c31d-4e58-96ee-db2affc55906 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:34.182040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c90d4f9-9013-4457-b5ab-ec96f10f4efb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:34.550519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-357f68cc-c31d-4e58-96ee-db2affc55906 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:34.565016 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-357f68cc-c31d-4e58-96ee-db2affc55906 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.432336 Sep 06 10:54:34.565638 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 523/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:34 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:34.577048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-076937bd-f758-4d2f-9cd7-de3d188a2118 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:34.583938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-076937bd-f758-4d2f-9cd7-de3d188a2118 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:34.590470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-076937bd-f758-4d2f-9cd7-de3d188a2118 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:34.591248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-076937bd-f758-4d2f-9cd7-de3d188a2118 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:34.591992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-076937bd-f758-4d2f-9cd7-de3d188a2118 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:34.593129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-076937bd-f758-4d2f-9cd7-de3d188a2118 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:34.593752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-076937bd-f758-4d2f-9cd7-de3d188a2118 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:34.594342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-076937bd-f758-4d2f-9cd7-de3d188a2118 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:34.599075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:34.810276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1c90d4f9-9013-4457-b5ab-ec96f10f4efb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:34.820597 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1c90d4f9-9013-4457-b5ab-ec96f10f4efb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1307 microversion: 2.1 time: 0.686487 Sep 06 10:54:34.822124 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 532/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:34 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1307 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:34.832331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b37fd437-ca0b-441b-8b50-9da45c4b57d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:34.834300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b37fd437-ca0b-441b-8b50-9da45c4b57d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:34.844509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b37fd437-ca0b-441b-8b50-9da45c4b57d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:34.845301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b37fd437-ca0b-441b-8b50-9da45c4b57d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:34.845978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b37fd437-ca0b-441b-8b50-9da45c4b57d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:34.846916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b37fd437-ca0b-441b-8b50-9da45c4b57d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:34.847645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b37fd437-ca0b-441b-8b50-9da45c4b57d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:34.848287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b37fd437-ca0b-441b-8b50-9da45c4b57d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:35.183190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-076937bd-f758-4d2f-9cd7-de3d188a2118 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:35.191691 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-076937bd-f758-4d2f-9cd7-de3d188a2118 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1319 microversion: 2.1 time: 0.624024 Sep 06 10:54:35.192911 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 524/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:34 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1319 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:35.201064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4e791e4b-1ac1-4f6d-a958-4a57cbe9d54b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:35.201947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4e791e4b-1ac1-4f6d-a958-4a57cbe9d54b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:35.218083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e791e4b-1ac1-4f6d-a958-4a57cbe9d54b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:35.220447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e791e4b-1ac1-4f6d-a958-4a57cbe9d54b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:35.221313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e791e4b-1ac1-4f6d-a958-4a57cbe9d54b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:35.233593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e791e4b-1ac1-4f6d-a958-4a57cbe9d54b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:35.234772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e791e4b-1ac1-4f6d-a958-4a57cbe9d54b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:35.235602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e791e4b-1ac1-4f6d-a958-4a57cbe9d54b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:35.272652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b37fd437-ca0b-441b-8b50-9da45c4b57d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:35.287463 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b37fd437-ca0b-441b-8b50-9da45c4b57d1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1324 microversion: 2.1 time: 0.458613 Sep 06 10:54:35.288144 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 533/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:34 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:35.294922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-51c690d2-b8c6-45d0-99b7-04cccc3bb76a req-38010c28-f0df-4bbd-b839-5bf7c79f1beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf2c50a-91cd-4042-914e-c85ff9025b00", "name": "network-vif-plugged", "status": "completed", "tag": "affae396-3552-4226-bc04-afb350e6137f"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:35.307934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-51c690d2-b8c6-45d0-99b7-04cccc3bb76a req-38010c28-f0df-4bbd-b839-5bf7c79f1beb service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:35.308727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-51c690d2-b8c6-45d0-99b7-04cccc3bb76a req-38010c28-f0df-4bbd-b839-5bf7c79f1beb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:35.309163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-51c690d2-b8c6-45d0-99b7-04cccc3bb76a req-38010c28-f0df-4bbd-b839-5bf7c79f1beb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:35.323308 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-51c690d2-b8c6-45d0-99b7-04cccc3bb76a req-38010c28-f0df-4bbd-b839-5bf7c79f1beb service nova] Creating event network-vif-plugged:affae396-3552-4226-bc04-afb350e6137f for instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 on nch2-master-1 Sep 06 10:54:35.328827 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-51c690d2-b8c6-45d0-99b7-04cccc3bb76a req-38010c28-f0df-4bbd-b839-5bf7c79f1beb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038617 Sep 06 10:54:35.329754 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 534/1058] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:35.335476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-68d39bf9-becd-4641-8ea9-c0daf871f9d5 req-9af85070-ef31-4fac-bd87-13ac3594786b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d33d19-9934-492e-ab0f-0651fe5c6627", "tag": "b54017fd-be21-45de-8025-0205f20d32de"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:35.345981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-68d39bf9-becd-4641-8ea9-c0daf871f9d5 req-9af85070-ef31-4fac-bd87-13ac3594786b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:35.346469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-68d39bf9-becd-4641-8ea9-c0daf871f9d5 req-9af85070-ef31-4fac-bd87-13ac3594786b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:35.346906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-68d39bf9-becd-4641-8ea9-c0daf871f9d5 req-9af85070-ef31-4fac-bd87-13ac3594786b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:35.360575 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-68d39bf9-becd-4641-8ea9-c0daf871f9d5 req-9af85070-ef31-4fac-bd87-13ac3594786b service nova] Creating event network-changed:b54017fd-be21-45de-8025-0205f20d32de for instance b0d33d19-9934-492e-ab0f-0651fe5c6627 on nch2-master-1 Sep 06 10:54:35.366128 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-68d39bf9-becd-4641-8ea9-c0daf871f9d5 req-9af85070-ef31-4fac-bd87-13ac3594786b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034708 Sep 06 10:54:35.370254 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 535/1059] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:35.543959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4e791e4b-1ac1-4f6d-a958-4a57cbe9d54b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:35.552835 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4e791e4b-1ac1-4f6d-a958-4a57cbe9d54b tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1463 microversion: 2.1 time: 0.358340 Sep 06 10:54:35.553414 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 525/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:35 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1463 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:35.584100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-af1dc84e-95f1-497a-97ff-3d618e37ab49 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:35.584963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-af1dc84e-95f1-497a-97ff-3d618e37ab49 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:35.596457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af1dc84e-95f1-497a-97ff-3d618e37ab49 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:35.598055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b7852b3e-c318-4cc4-a757-82aefb9fd6cd tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:35.598730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af1dc84e-95f1-497a-97ff-3d618e37ab49 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:35.599643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af1dc84e-95f1-497a-97ff-3d618e37ab49 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:35.601842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b7852b3e-c318-4cc4-a757-82aefb9fd6cd tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:35.603865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af1dc84e-95f1-497a-97ff-3d618e37ab49 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:35.605036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af1dc84e-95f1-497a-97ff-3d618e37ab49 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:35.606400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af1dc84e-95f1-497a-97ff-3d618e37ab49 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:35.617314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7852b3e-c318-4cc4-a757-82aefb9fd6cd tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:35.619932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7852b3e-c318-4cc4-a757-82aefb9fd6cd tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:35.620658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7852b3e-c318-4cc4-a757-82aefb9fd6cd tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:35.621662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7852b3e-c318-4cc4-a757-82aefb9fd6cd tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:35.623468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7852b3e-c318-4cc4-a757-82aefb9fd6cd tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:35.625135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7852b3e-c318-4cc4-a757-82aefb9fd6cd tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:35.767430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:36.267964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b7852b3e-c318-4cc4-a757-82aefb9fd6cd tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:36.271131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-af1dc84e-95f1-497a-97ff-3d618e37ab49 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:36.280859 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b7852b3e-c318-4cc4-a757-82aefb9fd6cd tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.690614 Sep 06 10:54:36.281388 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-af1dc84e-95f1-497a-97ff-3d618e37ab49 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1463 microversion: 2.1 time: 0.704359 Sep 06 10:54:36.282324 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 526/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:35 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:36.287866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4aedb63c-0ace-4f1a-8852-0f11c84d73db tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:36.288708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4aedb63c-0ace-4f1a-8852-0f11c84d73db tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:36.295902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aedb63c-0ace-4f1a-8852-0f11c84d73db tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:36.296250 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 536/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:35 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1463 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:36.296938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aedb63c-0ace-4f1a-8852-0f11c84d73db tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:36.297711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aedb63c-0ace-4f1a-8852-0f11c84d73db tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:36.298747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aedb63c-0ace-4f1a-8852-0f11c84d73db tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:36.299453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aedb63c-0ace-4f1a-8852-0f11c84d73db tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:36.300097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aedb63c-0ace-4f1a-8852-0f11c84d73db tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:36.306267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-54ad39ae-8ce7-4dae-bd64-03b6aea4ee8f tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:36.307184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-54ad39ae-8ce7-4dae-bd64-03b6aea4ee8f tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:36.313618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54ad39ae-8ce7-4dae-bd64-03b6aea4ee8f tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:36.314339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54ad39ae-8ce7-4dae-bd64-03b6aea4ee8f tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:36.314777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54ad39ae-8ce7-4dae-bd64-03b6aea4ee8f tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:36.318193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54ad39ae-8ce7-4dae-bd64-03b6aea4ee8f tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:36.318193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54ad39ae-8ce7-4dae-bd64-03b6aea4ee8f tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:36.318193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54ad39ae-8ce7-4dae-bd64-03b6aea4ee8f tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:36.704963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4aedb63c-0ace-4f1a-8852-0f11c84d73db tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:36.713416 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4aedb63c-0ace-4f1a-8852-0f11c84d73db tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1307 microversion: 2.1 time: 0.429832 Sep 06 10:54:36.714007 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 527/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:36 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1307 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:36.718671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:36.721492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:36.727535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:36.728029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:36.728476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:36.729192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:36.729650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:36.730163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:36.735459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-54ad39ae-8ce7-4dae-bd64-03b6aea4ee8f tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:36.745110 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-54ad39ae-8ce7-4dae-bd64-03b6aea4ee8f tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1319 microversion: 2.1 time: 0.447998 Sep 06 10:54:36.745697 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 537/1064] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:36 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:36.750898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5f57111e-3e77-460f-b40e-fa5df2ce5430 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:36.751510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5f57111e-3e77-460f-b40e-fa5df2ce5430 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:36.757925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f57111e-3e77-460f-b40e-fa5df2ce5430 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:36.758570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f57111e-3e77-460f-b40e-fa5df2ce5430 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:36.759625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f57111e-3e77-460f-b40e-fa5df2ce5430 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:36.760815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f57111e-3e77-460f-b40e-fa5df2ce5430 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:36.761788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f57111e-3e77-460f-b40e-fa5df2ce5430 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:36.763275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f57111e-3e77-460f-b40e-fa5df2ce5430 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:36.851882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:54:36.852299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:54:36.853101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:54:36.853671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:54:36.854257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:54:37.138884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:37.157577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:37.160763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:37.163153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:37.164238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:37.166215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5f57111e-3e77-460f-b40e-fa5df2ce5430 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:37.168368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:37.169812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:37.203943 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5f57111e-3e77-460f-b40e-fa5df2ce5430 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1324 microversion: 2.1 time: 0.452247 Sep 06 10:54:37.206284 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 538/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:36 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1324 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:37.222226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-28cf9b47-c8db-4016-a6e1-d31510e5a2dd req-887cbde9-5d6d-4cb7-b317-8cbf7641739f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d17de720-55d8-4b9a-8f16-386ab9e75e14", "tag": "3c0410cd-8d2b-4ec6-9bdc-443bf69e1791"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:37.247237 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-10ace53b-bd5c-4c4e-86e9-2845f94cb373 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action" status: 202 len: 1067 microversion: 2.1 time: 0.532123 Sep 06 10:54:37.248371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-28cf9b47-c8db-4016-a6e1-d31510e5a2dd req-887cbde9-5d6d-4cb7-b317-8cbf7641739f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:37.249021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-28cf9b47-c8db-4016-a6e1-d31510e5a2dd req-887cbde9-5d6d-4cb7-b317-8cbf7641739f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:37.249566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-28cf9b47-c8db-4016-a6e1-d31510e5a2dd req-887cbde9-5d6d-4cb7-b317-8cbf7641739f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:37.259883 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 528/1066] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:54:36 2022] POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action => generated 1067 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 06 10:54:37.264472 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-28cf9b47-c8db-4016-a6e1-d31510e5a2dd req-887cbde9-5d6d-4cb7-b317-8cbf7641739f service nova] Creating event network-changed:3c0410cd-8d2b-4ec6-9bdc-443bf69e1791 for instance d17de720-55d8-4b9a-8f16-386ab9e75e14 on nch2-master-1 Sep 06 10:54:37.267552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5940f3f6-1088-4023-b98b-889ef755b1dc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:37.268168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5940f3f6-1088-4023-b98b-889ef755b1dc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:37.269795 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-28cf9b47-c8db-4016-a6e1-d31510e5a2dd req-887cbde9-5d6d-4cb7-b317-8cbf7641739f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060278 Sep 06 10:54:37.270479 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 539/1067] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:37.276809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5940f3f6-1088-4023-b98b-889ef755b1dc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:37.276809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5940f3f6-1088-4023-b98b-889ef755b1dc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:37.276809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5940f3f6-1088-4023-b98b-889ef755b1dc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:37.277106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5940f3f6-1088-4023-b98b-889ef755b1dc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:37.277329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5940f3f6-1088-4023-b98b-889ef755b1dc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:37.277962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5940f3f6-1088-4023-b98b-889ef755b1dc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:37.308719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6531faba-5bf1-47ea-901c-74d7747cdfc7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:37.309430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6531faba-5bf1-47ea-901c-74d7747cdfc7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:37.316528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6531faba-5bf1-47ea-901c-74d7747cdfc7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:37.317038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6531faba-5bf1-47ea-901c-74d7747cdfc7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:37.317541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6531faba-5bf1-47ea-901c-74d7747cdfc7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:37.318250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6531faba-5bf1-47ea-901c-74d7747cdfc7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:37.318713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6531faba-5bf1-47ea-901c-74d7747cdfc7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:37.319184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6531faba-5bf1-47ea-901c-74d7747cdfc7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:37.496726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5940f3f6-1088-4023-b98b-889ef755b1dc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:37.510979 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5940f3f6-1088-4023-b98b-889ef755b1dc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.247221 Sep 06 10:54:37.511915 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 529/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:37 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:37.516472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-3a96dc31-0be4-42b0-b111-c2a41729da47 req-1be76170-1571-461b-b985-50d0a2994f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f954794-a097-41c8-833d-3ae1320b54d9", "tag": "3a38233d-1716-4cd1-b63c-ed57733b91ed"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:37.538758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3a96dc31-0be4-42b0-b111-c2a41729da47 req-1be76170-1571-461b-b985-50d0a2994f7a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:37.541951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3a96dc31-0be4-42b0-b111-c2a41729da47 req-1be76170-1571-461b-b985-50d0a2994f7a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:37.541951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3a96dc31-0be4-42b0-b111-c2a41729da47 req-1be76170-1571-461b-b985-50d0a2994f7a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:37.545289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6531faba-5bf1-47ea-901c-74d7747cdfc7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:37.560132 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-3a96dc31-0be4-42b0-b111-c2a41729da47 req-1be76170-1571-461b-b985-50d0a2994f7a service nova] Creating event network-changed:3a38233d-1716-4cd1-b63c-ed57733b91ed for instance 0f954794-a097-41c8-833d-3ae1320b54d9 on nch2-master-1 Sep 06 10:54:37.561858 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6531faba-5bf1-47ea-901c-74d7747cdfc7 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1369 microversion: 2.1 time: 0.249947 Sep 06 10:54:37.562487 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 540/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:37 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1369 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:37.565754 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-3a96dc31-0be4-42b0-b111-c2a41729da47 req-1be76170-1571-461b-b985-50d0a2994f7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052603 Sep 06 10:54:37.566583 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 530/1070] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:37.744675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a74455a2-b792-4884-b0a2-6f4806008b46 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:37.745292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a74455a2-b792-4884-b0a2-6f4806008b46 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:37.747789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:37.752727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a74455a2-b792-4884-b0a2-6f4806008b46 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:37.753256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a74455a2-b792-4884-b0a2-6f4806008b46 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:37.758646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a74455a2-b792-4884-b0a2-6f4806008b46 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:37.758646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a74455a2-b792-4884-b0a2-6f4806008b46 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:37.758646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a74455a2-b792-4884-b0a2-6f4806008b46 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:37.758646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a74455a2-b792-4884-b0a2-6f4806008b46 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:37.769649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=16 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:37.774263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bece74b1-8e64-4057-8b29-897ca8142a24 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:37.774971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bece74b1-8e64-4057-8b29-897ca8142a24 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:37.781586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bece74b1-8e64-4057-8b29-897ca8142a24 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:37.786697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bece74b1-8e64-4057-8b29-897ca8142a24 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:37.786697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bece74b1-8e64-4057-8b29-897ca8142a24 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:37.786697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bece74b1-8e64-4057-8b29-897ca8142a24 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:37.786697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bece74b1-8e64-4057-8b29-897ca8142a24 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:37.787124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bece74b1-8e64-4057-8b29-897ca8142a24 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:37.972266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a74455a2-b792-4884-b0a2-6f4806008b46 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:37.975308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bece74b1-8e64-4057-8b29-897ca8142a24 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:37.977808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:37.983381 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a74455a2-b792-4884-b0a2-6f4806008b46 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1307 microversion: 2.1 time: 0.243042 Sep 06 10:54:37.987673 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 541/1071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:37 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1307 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:37.987800 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bece74b1-8e64-4057-8b29-897ca8142a24 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1319 microversion: 2.1 time: 0.218756 Sep 06 10:54:38.004518 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 531/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:37 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:38.228979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-33764022-0100-4e0e-8a6f-b44704384259 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:38.229606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-33764022-0100-4e0e-8a6f-b44704384259 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:38.236186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33764022-0100-4e0e-8a6f-b44704384259 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:38.236749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33764022-0100-4e0e-8a6f-b44704384259 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:38.237275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33764022-0100-4e0e-8a6f-b44704384259 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:38.238047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33764022-0100-4e0e-8a6f-b44704384259 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:38.238599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33764022-0100-4e0e-8a6f-b44704384259 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:38.239110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33764022-0100-4e0e-8a6f-b44704384259 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:38.369692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-33764022-0100-4e0e-8a6f-b44704384259 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:38.377762 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-33764022-0100-4e0e-8a6f-b44704384259 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1324 microversion: 2.1 time: 0.153181 Sep 06 10:54:38.378324 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 542/1073] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:38 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1324 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:38.536531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a540fc34-44a0-4ff0-afa5-59c0b0c32a69 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:38.543093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a540fc34-44a0-4ff0-afa5-59c0b0c32a69 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:38.554835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a540fc34-44a0-4ff0-afa5-59c0b0c32a69 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:38.556539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a540fc34-44a0-4ff0-afa5-59c0b0c32a69 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:38.557088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a540fc34-44a0-4ff0-afa5-59c0b0c32a69 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:38.559331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a540fc34-44a0-4ff0-afa5-59c0b0c32a69 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:38.559917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a540fc34-44a0-4ff0-afa5-59c0b0c32a69 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:38.560419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a540fc34-44a0-4ff0-afa5-59c0b0c32a69 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:38.594557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-28de94cd-8356-4831-97b6-24b8ea97033f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:38.595557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-28de94cd-8356-4831-97b6-24b8ea97033f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:38.604275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28de94cd-8356-4831-97b6-24b8ea97033f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:38.605108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28de94cd-8356-4831-97b6-24b8ea97033f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:38.605764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28de94cd-8356-4831-97b6-24b8ea97033f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:38.606722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28de94cd-8356-4831-97b6-24b8ea97033f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:38.607421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28de94cd-8356-4831-97b6-24b8ea97033f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:38.608100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28de94cd-8356-4831-97b6-24b8ea97033f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:38.666603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=7 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:38.964521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a540fc34-44a0-4ff0-afa5-59c0b0c32a69 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:38.972432 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a540fc34-44a0-4ff0-afa5-59c0b0c32a69 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.440161 Sep 06 10:54:38.973018 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 532/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:38 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:38.977046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-28de94cd-8356-4831-97b6-24b8ea97033f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:38.991354 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-28de94cd-8356-4831-97b6-24b8ea97033f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1554 microversion: 2.1 time: 0.410091 Sep 06 10:54:38.992006 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 543/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:38 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1554 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:39.008298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-54cdd7c5-b1c2-4868-ba10-871248a2183d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:39.009067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-54cdd7c5-b1c2-4868-ba10-871248a2183d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:39.012856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-321e69c7-527b-4595-8bca-849fc78234e6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:39.023795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-321e69c7-527b-4595-8bca-849fc78234e6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:39.024060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54cdd7c5-b1c2-4868-ba10-871248a2183d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:39.024060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54cdd7c5-b1c2-4868-ba10-871248a2183d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:39.024060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54cdd7c5-b1c2-4868-ba10-871248a2183d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:39.024060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54cdd7c5-b1c2-4868-ba10-871248a2183d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:39.024428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54cdd7c5-b1c2-4868-ba10-871248a2183d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:39.024520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-321e69c7-527b-4595-8bca-849fc78234e6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:39.024612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54cdd7c5-b1c2-4868-ba10-871248a2183d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:39.024704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-321e69c7-527b-4595-8bca-849fc78234e6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:39.024704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-321e69c7-527b-4595-8bca-849fc78234e6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:39.024704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-321e69c7-527b-4595-8bca-849fc78234e6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:39.024704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-321e69c7-527b-4595-8bca-849fc78234e6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:39.025048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-321e69c7-527b-4595-8bca-849fc78234e6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:39.223038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-321e69c7-527b-4595-8bca-849fc78234e6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:39.227172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-54cdd7c5-b1c2-4868-ba10-871248a2183d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:39.231639 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-321e69c7-527b-4595-8bca-849fc78234e6 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1319 microversion: 2.1 time: 0.223240 Sep 06 10:54:39.232176 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 544/1076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:39 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:39.236279 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-54cdd7c5-b1c2-4868-ba10-871248a2183d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1307 microversion: 2.1 time: 0.232000 Sep 06 10:54:39.236854 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 533/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:39 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1307 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:39.237399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-25647b59-9f84-4283-b611-0c11ce9cb027 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:39.237964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-25647b59-9f84-4283-b611-0c11ce9cb027 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:39.244482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25647b59-9f84-4283-b611-0c11ce9cb027 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:39.244975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25647b59-9f84-4283-b611-0c11ce9cb027 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:39.245409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25647b59-9f84-4283-b611-0c11ce9cb027 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:39.246106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25647b59-9f84-4283-b611-0c11ce9cb027 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:39.246568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25647b59-9f84-4283-b611-0c11ce9cb027 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:39.246993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25647b59-9f84-4283-b611-0c11ce9cb027 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:39.330001 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-25647b59-9f84-4283-b611-0c11ce9cb027 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095306 Sep 06 10:54:39.335321 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 545/1078] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 10:54:39 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:39.401213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e796bd79-3763-4885-a0f2-cbef69c3506a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:39.402468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e796bd79-3763-4885-a0f2-cbef69c3506a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:39.408580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e796bd79-3763-4885-a0f2-cbef69c3506a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:39.409072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e796bd79-3763-4885-a0f2-cbef69c3506a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:39.409654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e796bd79-3763-4885-a0f2-cbef69c3506a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:39.410649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e796bd79-3763-4885-a0f2-cbef69c3506a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:39.411152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e796bd79-3763-4885-a0f2-cbef69c3506a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:39.411591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e796bd79-3763-4885-a0f2-cbef69c3506a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:39.487709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0f63026c-da41-4c76-b449-d9b225a30023 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Action: 'create', calling method: .version_select at 0x7f90f87088b0>, body: {"keypair": {"name": "tempest-keypair-1525413323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSQIAq87jClBr0pLSycpmvIkajZhEjpTJDVUfdITQa4Hqzcy5i1ikGu0mA/XRyXNsJUeAMsk2M4D8HiSa9eTQj3mbKHEew9UVK7CNGEFFO50bf0IVDymbXRYnVsUlEeWw=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:39.504636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-0f63026c-da41-4c76-b449-d9b225a30023 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Getting quotas for project 68fa0f9865c04cf686e2036dae8c1284. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:39.509778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-0f63026c-da41-4c76-b449-d9b225a30023 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Getting quotas for user c4998ac001564850a12782a5107147da and project 68fa0f9865c04cf686e2036dae8c1284. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:39.596993 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0f63026c-da41-4c76-b449-d9b225a30023 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.227072 Sep 06 10:54:39.597617 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 534/1079] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:54:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:39.609237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5b9c50ab-8c30-4266-aabd-b3332becabcb tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Calling method '.version_select at 0x7f90f8722f70>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:39.618347 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5b9c50ab-8c30-4266-aabd-b3332becabcb tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1525413323" status: 200 len: 497 microversion: 2.1 time: 0.013927 Sep 06 10:54:39.618904 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 535/1080] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 10:54:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1525413323 => generated 497 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:54:39.632338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a94eb8e3-4e95-4429-b537-c5e48c2ede35 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Calling method '.version_select at 0x7f90f873ec10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:39.640092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e796bd79-3763-4885-a0f2-cbef69c3506a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:39.648381 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e796bd79-3763-4885-a0f2-cbef69c3506a tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1324 microversion: 2.1 time: 0.251699 Sep 06 10:54:39.648959 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 546/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:39 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1324 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:39.711536 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a94eb8e3-4e95-4429-b537-c5e48c2ede35 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525413323" status: 202 len: 0 microversion: 2.1 time: 0.083409 Sep 06 10:54:39.712611 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 536/1082] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 10:54:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525413323 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:54:39.724533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed51351e-6e6c-4e36-a3fe-62dc19f7bfbb tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Action: 'create', calling method: .version_select at 0x7f90f85ce5e0>, body: {"keypair": {"name": "tempest-keypair-1732318560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNarFrXJZRohVEJ4Rzg+txDfNYaQt0a95mlouCZwf/wdQHv1Bc/IJe3pcGn6USy+i0EJq4mjDY+iWzaOruz6NTgZbY+L1AI/e/5RqXBd3PshPXf7k2N/OCMjvkmf2joY2Q=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:39.740373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ed51351e-6e6c-4e36-a3fe-62dc19f7bfbb tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Getting quotas for project 68fa0f9865c04cf686e2036dae8c1284. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:39.745682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ed51351e-6e6c-4e36-a3fe-62dc19f7bfbb tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Getting quotas for user c4998ac001564850a12782a5107147da and project 68fa0f9865c04cf686e2036dae8c1284. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:39.825982 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ed51351e-6e6c-4e36-a3fe-62dc19f7bfbb tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105331 Sep 06 10:54:39.826687 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 547/1083] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:54:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:39.838155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9bd2e83-c0db-484b-8ab2-c797eae62ca0 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Calling method '.version_select at 0x7f90f8727a60>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:39.940059 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e9bd2e83-c0db-484b-8ab2-c797eae62ca0 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732318560" status: 202 len: 0 microversion: 2.1 time: 0.106294 Sep 06 10:54:39.940797 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 537/1084] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 10:54:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732318560 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:54:39.951457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e0c319f3-cff5-40ca-8898-3981f55ba26f tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Action: 'create', calling method: .version_select at 0x7f90f870d700>, body: {"keypair": {"name": "tempest-keypair-1228707687", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:39.958159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:39.970515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-e0c319f3-cff5-40ca-8898-3981f55ba26f tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Getting quotas for project 68fa0f9865c04cf686e2036dae8c1284. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:39.975814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-e0c319f3-cff5-40ca-8898-3981f55ba26f tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Getting quotas for user c4998ac001564850a12782a5107147da and project 68fa0f9865c04cf686e2036dae8c1284. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:39.997352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f7d52c48-01a9-4d64-9194-89a4030ebba8 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:39.999679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f7d52c48-01a9-4d64-9194-89a4030ebba8 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:40.004441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7d52c48-01a9-4d64-9194-89a4030ebba8 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:40.004982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7d52c48-01a9-4d64-9194-89a4030ebba8 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:40.005433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7d52c48-01a9-4d64-9194-89a4030ebba8 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:40.006139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7d52c48-01a9-4d64-9194-89a4030ebba8 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:40.006602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7d52c48-01a9-4d64-9194-89a4030ebba8 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:40.007080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7d52c48-01a9-4d64-9194-89a4030ebba8 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:40.072396 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e0c319f3-cff5-40ca-8898-3981f55ba26f tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.124417 Sep 06 10:54:40.073309 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 548/1085] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:54:39 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:40.084634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7eaf7ca6-f2b3-4eab-9862-c8346465ce8b tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Calling method '.version_select at 0x7f90f8705f70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:40.162943 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7eaf7ca6-f2b3-4eab-9862-c8346465ce8b tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228707687" status: 202 len: 0 microversion: 2.1 time: 0.082776 Sep 06 10:54:40.163493 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 549/1086] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 10:54:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228707687 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 10:54:40.175219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed06fa56-a3ca-4e1c-a9f3-4c7b8a875cb8 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Action: 'create', calling method: .version_select at 0x7f90f862d700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-797567498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4XHaweYsDx4yALM+wgvm6kHc3f9xpj7G5jzd+Aqw/kZCQFy/JmAWDMG87UNcCzq+upAt6hZm/Vqcz3/ehJztNgteoSxieXtRy1k5xbaeoDQTuvDYvyDSZr0HS2GbKhnw=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:40.192306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ed06fa56-a3ca-4e1c-a9f3-4c7b8a875cb8 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Getting quotas for project 68fa0f9865c04cf686e2036dae8c1284. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:40.198658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ed06fa56-a3ca-4e1c-a9f3-4c7b8a875cb8 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Getting quotas for user c4998ac001564850a12782a5107147da and project 68fa0f9865c04cf686e2036dae8c1284. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:40.294201 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ed06fa56-a3ca-4e1c-a9f3-4c7b8a875cb8 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.122955 Sep 06 10:54:40.294811 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 550/1087] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:54:40 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:54:40.307735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cc4d089e-601f-4832-b0ac-e82a0939e802 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:40.308355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cc4d089e-601f-4832-b0ac-e82a0939e802 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:40.314343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc4d089e-601f-4832-b0ac-e82a0939e802 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:40.314837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc4d089e-601f-4832-b0ac-e82a0939e802 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:40.315328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc4d089e-601f-4832-b0ac-e82a0939e802 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:40.316031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc4d089e-601f-4832-b0ac-e82a0939e802 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:40.316493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc4d089e-601f-4832-b0ac-e82a0939e802 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:40.316959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc4d089e-601f-4832-b0ac-e82a0939e802 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:40.335683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f7d52c48-01a9-4d64-9194-89a4030ebba8 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:40.346444 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f7d52c48-01a9-4d64-9194-89a4030ebba8 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.353944 Sep 06 10:54:40.347950 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 538/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:39 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:40.354462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-10b20aa2-a580-4baf-8487-b1ed07810946 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:40.355430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-10b20aa2-a580-4baf-8487-b1ed07810946 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:40.368588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10b20aa2-a580-4baf-8487-b1ed07810946 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:40.369422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10b20aa2-a580-4baf-8487-b1ed07810946 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:40.369882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10b20aa2-a580-4baf-8487-b1ed07810946 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:40.370617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10b20aa2-a580-4baf-8487-b1ed07810946 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:40.371168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10b20aa2-a580-4baf-8487-b1ed07810946 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:40.371608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10b20aa2-a580-4baf-8487-b1ed07810946 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:40.903939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-10b20aa2-a580-4baf-8487-b1ed07810946 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:40.915561 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-10b20aa2-a580-4baf-8487-b1ed07810946 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1307 microversion: 2.1 time: 0.562733 Sep 06 10:54:40.915661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cc4d089e-601f-4832-b0ac-e82a0939e802 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:40.916033 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 539/1089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:40 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1307 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:40.918987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f5b131ad-d55c-4d8e-a440-ce8f32727e44 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Action: 'create', calling method: .version_select at 0x7f90f8767ee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-609313590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSGi5Yq9bNp6x73PtJTeDzMBliXynka0zJMbD0KGZkU8GgLhSoufqGBHutwJoHD4HCYlXSQnpSFdytZHGea063TbWuSqQgdEPFdmfLoeN4optuqvwy/YIDVrlYxC3KH9A=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:40.924387 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cc4d089e-601f-4832-b0ac-e82a0939e802 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1319 microversion: 2.1 time: 0.620440 Sep 06 10:54:40.925273 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 551/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:40 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1319 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:40.933793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a12422ce-ccbd-4471-893b-1a9dad5feb56 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:40.934851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a12422ce-ccbd-4471-893b-1a9dad5feb56 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:40.942247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12422ce-ccbd-4471-893b-1a9dad5feb56 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:40.942574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f5b131ad-d55c-4d8e-a440-ce8f32727e44 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Getting quotas for project 68fa0f9865c04cf686e2036dae8c1284. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:40.943327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12422ce-ccbd-4471-893b-1a9dad5feb56 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:40.943889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12422ce-ccbd-4471-893b-1a9dad5feb56 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:40.944856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12422ce-ccbd-4471-893b-1a9dad5feb56 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:40.945227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12422ce-ccbd-4471-893b-1a9dad5feb56 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:40.945716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12422ce-ccbd-4471-893b-1a9dad5feb56 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:40.948842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f5b131ad-d55c-4d8e-a440-ce8f32727e44 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Getting quotas for user c4998ac001564850a12782a5107147da and project 68fa0f9865c04cf686e2036dae8c1284. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:41.077626 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f5b131ad-d55c-4d8e-a440-ce8f32727e44 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.163156 Sep 06 10:54:41.088967 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 540/1091] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:54:40 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:41.097345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56c7fa66-8fb0-4d13-847c-77fb1269ead0 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Action: 'create', calling method: .version_select at 0x7f90f8bd8550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-650524374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbouuHamYUY6+3M5YFAOM6tfVyvA5m5SDIEcUR+gcTwlJFLTONoOjzSlAmI+hIlp/zTpZqbOKE5+WPJ+zA+OieQUfR+rA6N+B5uIefWN20/tGGslkoVT9Wj3PhEDRvNig=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:41.123658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-56c7fa66-8fb0-4d13-847c-77fb1269ead0 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Getting quotas for project 68fa0f9865c04cf686e2036dae8c1284. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:41.130486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-56c7fa66-8fb0-4d13-847c-77fb1269ead0 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Getting quotas for user c4998ac001564850a12782a5107147da and project 68fa0f9865c04cf686e2036dae8c1284. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:41.232593 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56c7fa66-8fb0-4d13-847c-77fb1269ead0 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.141639 Sep 06 10:54:41.234536 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 541/1092] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:54:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:41.246064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3a727e12-e821-4d29-98b9-10e04b81227b tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Calling method '.version_select at 0x7f90f8823670>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:41.250737 ncdv-master-1 devstack@n-api.service[140875]: WARNING oslo_db.sqlalchemy.utils [None req-3a727e12-e821-4d29-98b9-10e04b81227b tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 06 10:54:41.259162 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3a727e12-e821-4d29-98b9-10e04b81227b tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.017522 Sep 06 10:54:41.263989 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 542/1093] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:54:41 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:41.264099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a12422ce-ccbd-4471-893b-1a9dad5feb56 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:41.273513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60fcb442-4ef3-41d9-9368-e538b81d0140 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Calling method '.version_select at 0x7f90f9572700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:41.276105 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a12422ce-ccbd-4471-893b-1a9dad5feb56 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1324 microversion: 2.1 time: 0.348387 Sep 06 10:54:41.277295 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 552/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:40 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1324 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:41.296934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-3b79a1ec-91e6-403f-ade5-bf07fb2319dc req-e1a40bd1-651b-4a67-b99e-0d81ae688eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf2c50a-91cd-4042-914e-c85ff9025b00", "tag": "affae396-3552-4226-bc04-afb350e6137f"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:41.316304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3b79a1ec-91e6-403f-ade5-bf07fb2319dc req-e1a40bd1-651b-4a67-b99e-0d81ae688eee service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:41.316799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3b79a1ec-91e6-403f-ade5-bf07fb2319dc req-e1a40bd1-651b-4a67-b99e-0d81ae688eee service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:41.317245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3b79a1ec-91e6-403f-ade5-bf07fb2319dc req-e1a40bd1-651b-4a67-b99e-0d81ae688eee service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:41.330100 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-3b79a1ec-91e6-403f-ade5-bf07fb2319dc req-e1a40bd1-651b-4a67-b99e-0d81ae688eee service nova] Creating event network-changed:affae396-3552-4226-bc04-afb350e6137f for instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 on nch2-master-1 Sep 06 10:54:41.336153 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-3b79a1ec-91e6-403f-ade5-bf07fb2319dc req-e1a40bd1-651b-4a67-b99e-0d81ae688eee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043096 Sep 06 10:54:41.337541 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 553/1095] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:41.369403 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-60fcb442-4ef3-41d9-9368-e538b81d0140 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-650524374" status: 202 len: 0 microversion: 2.1 time: 0.099629 Sep 06 10:54:41.372994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34d080fb-fb7f-4b43-869a-28150ae5a1b2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:41.378647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-34d080fb-fb7f-4b43-869a-28150ae5a1b2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:41.378937 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 543/1096] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 10:54:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-650524374 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:54:41.384189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d080fb-fb7f-4b43-869a-28150ae5a1b2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:41.385213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d080fb-fb7f-4b43-869a-28150ae5a1b2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:41.386119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d080fb-fb7f-4b43-869a-28150ae5a1b2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:41.387485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d080fb-fb7f-4b43-869a-28150ae5a1b2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:41.387607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56decfb5-4e7c-4726-b7fe-9a005f8bf122 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Calling method '.version_select at 0x7f90f8735310>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:41.388299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d080fb-fb7f-4b43-869a-28150ae5a1b2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:41.389750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d080fb-fb7f-4b43-869a-28150ae5a1b2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:41.409420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:41.547802 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56decfb5-4e7c-4726-b7fe-9a005f8bf122 tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-609313590" status: 202 len: 0 microversion: 2.1 time: 0.165675 Sep 06 10:54:41.553406 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 544/1097] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 10:54:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-609313590 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:54:41.561916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7a7c48e5-84d4-45a9-8536-e7881bcb6bfb tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] Calling method '.version_select at 0x7f90f87351f0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:41.655314 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7a7c48e5-84d4-45a9-8536-e7881bcb6bfb tempest-KeyPairsV2TestJSON-1950726799 tempest-KeyPairsV2TestJSON-1950726799-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-797567498" status: 202 len: 0 microversion: 2.1 time: 0.100696 Sep 06 10:54:41.656322 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 545/1098] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 10:54:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-797567498 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:54:41.809485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-34d080fb-fb7f-4b43-869a-28150ae5a1b2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:41.825874 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-34d080fb-fb7f-4b43-869a-28150ae5a1b2 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.457800 Sep 06 10:54:41.828672 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 554/1099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:41 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:41.946629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-688d5479-f7fa-4d6f-a292-874410fbaf00 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:41.948055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-688d5479-f7fa-4d6f-a292-874410fbaf00 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:41.950343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8e9f7292-5b52-466d-902a-eb48115cf8d3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:41.950983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8e9f7292-5b52-466d-902a-eb48115cf8d3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:41.954887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-688d5479-f7fa-4d6f-a292-874410fbaf00 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:41.955714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-688d5479-f7fa-4d6f-a292-874410fbaf00 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:41.956229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-688d5479-f7fa-4d6f-a292-874410fbaf00 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:41.957156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-688d5479-f7fa-4d6f-a292-874410fbaf00 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:41.957624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-688d5479-f7fa-4d6f-a292-874410fbaf00 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:41.958063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-688d5479-f7fa-4d6f-a292-874410fbaf00 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:41.966540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e9f7292-5b52-466d-902a-eb48115cf8d3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:41.967357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e9f7292-5b52-466d-902a-eb48115cf8d3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:41.969027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e9f7292-5b52-466d-902a-eb48115cf8d3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:41.970631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e9f7292-5b52-466d-902a-eb48115cf8d3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:41.971506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e9f7292-5b52-466d-902a-eb48115cf8d3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:41.972159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e9f7292-5b52-466d-902a-eb48115cf8d3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:42.262534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-688d5479-f7fa-4d6f-a292-874410fbaf00 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:42.272061 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-688d5479-f7fa-4d6f-a292-874410fbaf00 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1307 microversion: 2.1 time: 0.332072 Sep 06 10:54:42.272650 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 546/1100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:41 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1307 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:42.289645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8e9f7292-5b52-466d-902a-eb48115cf8d3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:42.300250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4da2b761-ee63-4490-8d23-fd5955131027 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:42.307238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4da2b761-ee63-4490-8d23-fd5955131027 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:42.307390 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8e9f7292-5b52-466d-902a-eb48115cf8d3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1319 microversion: 2.1 time: 0.355138 Sep 06 10:54:42.307390 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 555/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:41 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:42.313490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4da2b761-ee63-4490-8d23-fd5955131027 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:42.314871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4da2b761-ee63-4490-8d23-fd5955131027 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:42.316765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4da2b761-ee63-4490-8d23-fd5955131027 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:42.319418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4da2b761-ee63-4490-8d23-fd5955131027 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:42.320730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4da2b761-ee63-4490-8d23-fd5955131027 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:42.322625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4da2b761-ee63-4490-8d23-fd5955131027 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:42.536039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4da2b761-ee63-4490-8d23-fd5955131027 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:42.550537 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4da2b761-ee63-4490-8d23-fd5955131027 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1324 microversion: 2.1 time: 0.251713 Sep 06 10:54:42.553098 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 547/1102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:42 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:42.843509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-94a3fa8f-f1ab-4830-89d4-bda7ebb6db84 req-da39792e-c0e7-4a6d-bd41-4341703e7d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d33d19-9934-492e-ab0f-0651fe5c6627", "name": "network-vif-plugged", "status": "completed", "tag": "b54017fd-be21-45de-8025-0205f20d32de"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:42.853138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3cf140bc-a5d4-4e50-8a35-501d84f327d0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:42.853758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3cf140bc-a5d4-4e50-8a35-501d84f327d0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:42.854044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-94a3fa8f-f1ab-4830-89d4-bda7ebb6db84 req-da39792e-c0e7-4a6d-bd41-4341703e7d4f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:42.854531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-94a3fa8f-f1ab-4830-89d4-bda7ebb6db84 req-da39792e-c0e7-4a6d-bd41-4341703e7d4f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:42.854970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-94a3fa8f-f1ab-4830-89d4-bda7ebb6db84 req-da39792e-c0e7-4a6d-bd41-4341703e7d4f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:42.860412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cf140bc-a5d4-4e50-8a35-501d84f327d0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:42.860903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cf140bc-a5d4-4e50-8a35-501d84f327d0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:42.861364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cf140bc-a5d4-4e50-8a35-501d84f327d0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:42.862046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cf140bc-a5d4-4e50-8a35-501d84f327d0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:42.862513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cf140bc-a5d4-4e50-8a35-501d84f327d0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:42.862944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cf140bc-a5d4-4e50-8a35-501d84f327d0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:42.866507 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-94a3fa8f-f1ab-4830-89d4-bda7ebb6db84 req-da39792e-c0e7-4a6d-bd41-4341703e7d4f service nova] Creating event network-vif-plugged:b54017fd-be21-45de-8025-0205f20d32de for instance b0d33d19-9934-492e-ab0f-0651fe5c6627 on nch2-master-1 Sep 06 10:54:42.871484 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-94a3fa8f-f1ab-4830-89d4-bda7ebb6db84 req-da39792e-c0e7-4a6d-bd41-4341703e7d4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031646 Sep 06 10:54:42.872131 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 556/1103] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:43.074615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3cf140bc-a5d4-4e50-8a35-501d84f327d0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:43.082285 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3cf140bc-a5d4-4e50-8a35-501d84f327d0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.233263 Sep 06 10:54:43.082871 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 548/1104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:42 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:54:43.300181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3e0061ae-cf32-415c-81f6-a1fcb3f866f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:43.301575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3e0061ae-cf32-415c-81f6-a1fcb3f866f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:43.309172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0061ae-cf32-415c-81f6-a1fcb3f866f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:43.309663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0061ae-cf32-415c-81f6-a1fcb3f866f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:43.310087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0061ae-cf32-415c-81f6-a1fcb3f866f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:43.310792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0061ae-cf32-415c-81f6-a1fcb3f866f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:43.311271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0061ae-cf32-415c-81f6-a1fcb3f866f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:43.311702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0061ae-cf32-415c-81f6-a1fcb3f866f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:43.326490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-346001ec-12b1-4b2c-a4fd-aabfb2d1e717 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:43.327836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-346001ec-12b1-4b2c-a4fd-aabfb2d1e717 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:43.339210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-346001ec-12b1-4b2c-a4fd-aabfb2d1e717 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:43.339960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-346001ec-12b1-4b2c-a4fd-aabfb2d1e717 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:43.340527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-346001ec-12b1-4b2c-a4fd-aabfb2d1e717 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:43.341277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-346001ec-12b1-4b2c-a4fd-aabfb2d1e717 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:43.341925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-346001ec-12b1-4b2c-a4fd-aabfb2d1e717 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:43.342168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-346001ec-12b1-4b2c-a4fd-aabfb2d1e717 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:43.371595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:43.529420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3e0061ae-cf32-415c-81f6-a1fcb3f866f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:43.537855 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3e0061ae-cf32-415c-81f6-a1fcb3f866f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1307 microversion: 2.1 time: 0.243354 Sep 06 10:54:43.538441 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 557/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:43 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1307 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:43.544349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-346001ec-12b1-4b2c-a4fd-aabfb2d1e717 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:43.553442 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-346001ec-12b1-4b2c-a4fd-aabfb2d1e717 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1319 microversion: 2.1 time: 0.230837 Sep 06 10:54:43.554017 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 549/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:43 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:43.575754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-06b8a9ff-775b-4eb5-9b99-0f50aed25f92 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:43.576470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-06b8a9ff-775b-4eb5-9b99-0f50aed25f92 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:43.582535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06b8a9ff-775b-4eb5-9b99-0f50aed25f92 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:43.583136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06b8a9ff-775b-4eb5-9b99-0f50aed25f92 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:43.583580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06b8a9ff-775b-4eb5-9b99-0f50aed25f92 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:43.584278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06b8a9ff-775b-4eb5-9b99-0f50aed25f92 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:43.584746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06b8a9ff-775b-4eb5-9b99-0f50aed25f92 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:43.585440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06b8a9ff-775b-4eb5-9b99-0f50aed25f92 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:43.715520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-06b8a9ff-775b-4eb5-9b99-0f50aed25f92 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:43.723234 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-06b8a9ff-775b-4eb5-9b99-0f50aed25f92 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1324 microversion: 2.1 time: 0.151329 Sep 06 10:54:43.723823 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 558/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:43 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1324 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:44.111096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-966323de-b93f-49f2-a90e-4fe3c6508e72 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:44.111719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-966323de-b93f-49f2-a90e-4fe3c6508e72 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:44.119639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-966323de-b93f-49f2-a90e-4fe3c6508e72 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:44.120157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-966323de-b93f-49f2-a90e-4fe3c6508e72 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:44.120609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-966323de-b93f-49f2-a90e-4fe3c6508e72 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:44.121319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-966323de-b93f-49f2-a90e-4fe3c6508e72 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:44.121780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-966323de-b93f-49f2-a90e-4fe3c6508e72 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:44.122213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-966323de-b93f-49f2-a90e-4fe3c6508e72 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:44.260638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-966323de-b93f-49f2-a90e-4fe3c6508e72 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:44.269185 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-966323de-b93f-49f2-a90e-4fe3c6508e72 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.162074 Sep 06 10:54:44.274468 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 550/1108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:44 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:44.561575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4ca42f6a-37d4-490f-9df6-52a6fa7504e8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:44.562605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4ca42f6a-37d4-490f-9df6-52a6fa7504e8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:44.576105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ca42f6a-37d4-490f-9df6-52a6fa7504e8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:44.576628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ca42f6a-37d4-490f-9df6-52a6fa7504e8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:44.577624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ca42f6a-37d4-490f-9df6-52a6fa7504e8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:44.578772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ca42f6a-37d4-490f-9df6-52a6fa7504e8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:44.579549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ca42f6a-37d4-490f-9df6-52a6fa7504e8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:44.580140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ca42f6a-37d4-490f-9df6-52a6fa7504e8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:44.586069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-193c2861-aa63-4b01-88a7-6d642a8e7c6a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:44.589061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-193c2861-aa63-4b01-88a7-6d642a8e7c6a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:44.597276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-193c2861-aa63-4b01-88a7-6d642a8e7c6a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:44.597763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-193c2861-aa63-4b01-88a7-6d642a8e7c6a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:44.601248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-193c2861-aa63-4b01-88a7-6d642a8e7c6a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:44.602000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-193c2861-aa63-4b01-88a7-6d642a8e7c6a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:44.609352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-193c2861-aa63-4b01-88a7-6d642a8e7c6a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:44.609853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-193c2861-aa63-4b01-88a7-6d642a8e7c6a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:44.884428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4ca42f6a-37d4-490f-9df6-52a6fa7504e8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:44.886912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-193c2861-aa63-4b01-88a7-6d642a8e7c6a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:44.896615 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4ca42f6a-37d4-490f-9df6-52a6fa7504e8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1307 microversion: 2.1 time: 0.337222 Sep 06 10:54:44.896615 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 559/1109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:44 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:44.900877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1e5ce353-8b5c-45c0-ab72-2053861f92fd tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:44.901736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1e5ce353-8b5c-45c0-ab72-2053861f92fd tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:44.913600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e5ce353-8b5c-45c0-ab72-2053861f92fd tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:44.914218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e5ce353-8b5c-45c0-ab72-2053861f92fd tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:44.932707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e5ce353-8b5c-45c0-ab72-2053861f92fd tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:44.932707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e5ce353-8b5c-45c0-ab72-2053861f92fd tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:44.932707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e5ce353-8b5c-45c0-ab72-2053861f92fd tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:44.932707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e5ce353-8b5c-45c0-ab72-2053861f92fd tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:44.933846 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-193c2861-aa63-4b01-88a7-6d642a8e7c6a tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1319 microversion: 2.1 time: 0.345294 Sep 06 10:54:44.933846 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 551/1110] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:44 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:44.933846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-878c63c9-618e-43bd-b5fb-edfeb36755ae tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:44.933846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-878c63c9-618e-43bd-b5fb-edfeb36755ae tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:44.936147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-878c63c9-618e-43bd-b5fb-edfeb36755ae tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:44.936746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-878c63c9-618e-43bd-b5fb-edfeb36755ae tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:44.937280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-878c63c9-618e-43bd-b5fb-edfeb36755ae tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:44.938078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-878c63c9-618e-43bd-b5fb-edfeb36755ae tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:44.938768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-878c63c9-618e-43bd-b5fb-edfeb36755ae tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:44.939459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-878c63c9-618e-43bd-b5fb-edfeb36755ae tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:45.144493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1e5ce353-8b5c-45c0-ab72-2053861f92fd tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:45.153048 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1e5ce353-8b5c-45c0-ab72-2053861f92fd tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1324 microversion: 2.1 time: 0.256140 Sep 06 10:54:45.153820 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 560/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:44 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:45.158673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-dbf88ce1-a293-4d0f-8a99-4d1fc51eb156 req-fe26ab09-b066-4035-8e3b-586a1fd330b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f954794-a097-41c8-833d-3ae1320b54d9", "name": "network-vif-plugged", "status": "completed", "tag": "3a38233d-1716-4cd1-b63c-ed57733b91ed"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:45.168644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dbf88ce1-a293-4d0f-8a99-4d1fc51eb156 req-fe26ab09-b066-4035-8e3b-586a1fd330b8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:45.169383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dbf88ce1-a293-4d0f-8a99-4d1fc51eb156 req-fe26ab09-b066-4035-8e3b-586a1fd330b8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:45.169824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dbf88ce1-a293-4d0f-8a99-4d1fc51eb156 req-fe26ab09-b066-4035-8e3b-586a1fd330b8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:45.177674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-878c63c9-618e-43bd-b5fb-edfeb36755ae tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid 31a4ea2a-aa16-4e41-af83-b027dfe81828 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:54:45.182541 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-dbf88ce1-a293-4d0f-8a99-4d1fc51eb156 req-fe26ab09-b066-4035-8e3b-586a1fd330b8 service nova] Creating event network-vif-plugged:3a38233d-1716-4cd1-b63c-ed57733b91ed for instance 0f954794-a097-41c8-833d-3ae1320b54d9 on nch2-master-1 Sep 06 10:54:45.187457 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-dbf88ce1-a293-4d0f-8a99-4d1fc51eb156 req-fe26ab09-b066-4035-8e3b-586a1fd330b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032249 Sep 06 10:54:45.188070 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 561/1112] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:45.201424 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-878c63c9-618e-43bd-b5fb-edfeb36755ae tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 2345 microversion: 2.25 time: 0.280961 Sep 06 10:54:45.202227 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 552/1113] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:54:44 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 2345 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:54:45.228810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b2a79f73-66a1-4f1d-876c-83af93b8affd tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:45.232723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2a79f73-66a1-4f1d-876c-83af93b8affd tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:45.233541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2a79f73-66a1-4f1d-876c-83af93b8affd tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:45.234768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2a79f73-66a1-4f1d-876c-83af93b8affd tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:45.235843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2a79f73-66a1-4f1d-876c-83af93b8affd tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:45.236513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2a79f73-66a1-4f1d-876c-83af93b8affd tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:45.237768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2a79f73-66a1-4f1d-876c-83af93b8affd tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:45.268228 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b2a79f73-66a1-4f1d-876c-83af93b8affd tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.045352 Sep 06 10:54:45.276907 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 562/1114] 10.222.0.20 () {60 vars in 1217 bytes} [Tue Sep 6 10:54:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:54:45.293051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5882eaf7-6b65-4a6c-bca2-19aab88da702 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:45.293766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5882eaf7-6b65-4a6c-bca2-19aab88da702 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:45.300606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5882eaf7-6b65-4a6c-bca2-19aab88da702 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:45.301268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5882eaf7-6b65-4a6c-bca2-19aab88da702 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:45.302008 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5882eaf7-6b65-4a6c-bca2-19aab88da702 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:45.302951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5882eaf7-6b65-4a6c-bca2-19aab88da702 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:45.303710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5882eaf7-6b65-4a6c-bca2-19aab88da702 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:45.304355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5882eaf7-6b65-4a6c-bca2-19aab88da702 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:45.480078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5882eaf7-6b65-4a6c-bca2-19aab88da702 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:45.488480 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5882eaf7-6b65-4a6c-bca2-19aab88da702 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.199302 Sep 06 10:54:45.489401 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 553/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:45 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:45.920876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2cc043c8-ff85-4353-a32e-b3bfb3348c74 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:45.922255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2cc043c8-ff85-4353-a32e-b3bfb3348c74 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:45.929793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cc043c8-ff85-4353-a32e-b3bfb3348c74 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:45.930390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cc043c8-ff85-4353-a32e-b3bfb3348c74 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:45.935884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cc043c8-ff85-4353-a32e-b3bfb3348c74 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:45.935884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cc043c8-ff85-4353-a32e-b3bfb3348c74 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:45.935884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cc043c8-ff85-4353-a32e-b3bfb3348c74 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:45.935884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cc043c8-ff85-4353-a32e-b3bfb3348c74 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:45.949928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cab01363-98bd-404e-a092-4195386507e3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:45.950394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cab01363-98bd-404e-a092-4195386507e3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:45.956835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cab01363-98bd-404e-a092-4195386507e3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:45.957543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cab01363-98bd-404e-a092-4195386507e3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:45.960078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cab01363-98bd-404e-a092-4195386507e3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:45.960078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cab01363-98bd-404e-a092-4195386507e3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:45.960078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cab01363-98bd-404e-a092-4195386507e3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:45.960078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cab01363-98bd-404e-a092-4195386507e3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:46.463256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cab01363-98bd-404e-a092-4195386507e3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:46.492428 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cab01363-98bd-404e-a092-4195386507e3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1319 microversion: 2.1 time: 0.525312 Sep 06 10:54:46.492428 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 554/1116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:45 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1319 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:46.492609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2cc043c8-ff85-4353-a32e-b3bfb3348c74 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:46.492609 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2cc043c8-ff85-4353-a32e-b3bfb3348c74 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1487 microversion: 2.1 time: 0.570623 Sep 06 10:54:46.492609 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 563/1117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:45 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1487 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:46.497679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d5ce3670-aa32-4ad9-948f-248c660b0b80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:46.498553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d5ce3670-aa32-4ad9-948f-248c660b0b80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:46.509485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5ce3670-aa32-4ad9-948f-248c660b0b80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:46.509989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5ce3670-aa32-4ad9-948f-248c660b0b80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:46.510438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5ce3670-aa32-4ad9-948f-248c660b0b80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:46.511191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5ce3670-aa32-4ad9-948f-248c660b0b80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:46.511839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5ce3670-aa32-4ad9-948f-248c660b0b80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:46.512274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5ce3670-aa32-4ad9-948f-248c660b0b80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:46.622917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-843517541", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "dffa3805-a31e-49ab-9a87-c94f3f6e088b"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:46.667915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d5ce3670-aa32-4ad9-948f-248c660b0b80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:46.676725 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d5ce3670-aa32-4ad9-948f-248c660b0b80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1324 microversion: 2.1 time: 0.198442 Sep 06 10:54:46.678048 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 555/1118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:46 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1324 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:46.684391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-534cbdfe-63d5-4e68-b74d-396919049b54 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:46.691136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-534cbdfe-63d5-4e68-b74d-396919049b54 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:46.691639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-534cbdfe-63d5-4e68-b74d-396919049b54 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:46.700386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] validate_networks() for [('dffa3805-a31e-49ab-9a87-c94f3f6e088b', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:54:46.703627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-534cbdfe-63d5-4e68-b74d-396919049b54 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:46.782502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-534cbdfe-63d5-4e68-b74d-396919049b54 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Going to try to stop instance {{(pid=140875) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 10:54:47.073272 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-534cbdfe-63d5-4e68-b74d-396919049b54 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "POST /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627/action" status: 202 len: 0 microversion: 2.1 time: 0.393591 Sep 06 10:54:47.078870 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 556/1119] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:54:46 2022] POST /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:54:47.090196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3fb099dc-77b0-49f0-8b63-e8f127ca3d10 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:47.091297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3fb099dc-77b0-49f0-8b63-e8f127ca3d10 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:47.101219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3fb099dc-77b0-49f0-8b63-e8f127ca3d10 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:47.103058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3fb099dc-77b0-49f0-8b63-e8f127ca3d10 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:47.106073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3fb099dc-77b0-49f0-8b63-e8f127ca3d10 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:47.106073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3fb099dc-77b0-49f0-8b63-e8f127ca3d10 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:47.106073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3fb099dc-77b0-49f0-8b63-e8f127ca3d10 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:47.106073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3fb099dc-77b0-49f0-8b63-e8f127ca3d10 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:47.199839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:54:47.200323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:54:47.200731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:54:47.201295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:54:47.201940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:54:47.212001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:47.213083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:47.213672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:47.214459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:47.214925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:47.215410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:47.234201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Getting quotas for project 2ce648f86e3e4a3c9e8712bb087b8769. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:47.245617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Getting quotas for user de579d631e9d4010887077567bbe5fd6 and project 2ce648f86e3e4a3c9e8712bb087b8769. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:47.263721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:54:47.266142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:54:47.268240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3fb099dc-77b0-49f0-8b63-e8f127ca3d10 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:47.277365 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3fb099dc-77b0-49f0-8b63-e8f127ca3d10 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.196657 Sep 06 10:54:47.291376 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 557/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:47 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:47.300171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9186a37a-feb6-4cda-93ac-9f37c702d36a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:47.302649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9186a37a-feb6-4cda-93ac-9f37c702d36a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:47.310928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9186a37a-feb6-4cda-93ac-9f37c702d36a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:47.311733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9186a37a-feb6-4cda-93ac-9f37c702d36a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:47.312607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9186a37a-feb6-4cda-93ac-9f37c702d36a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:47.313517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9186a37a-feb6-4cda-93ac-9f37c702d36a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:47.314044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9186a37a-feb6-4cda-93ac-9f37c702d36a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:47.314477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9186a37a-feb6-4cda-93ac-9f37c702d36a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:47.483496 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2406e4bd-5c11-4d4f-92fa-647335bb0c7d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994122 Sep 06 10:54:47.488329 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 564/1121] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:54:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:54:47.510328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9186a37a-feb6-4cda-93ac-9f37c702d36a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:47.516745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-7ab63fa4-cb2b-4998-b6d7-137fea692f1f req-d0441ef8-6aa4-49e0-b099-6a3c4637ea22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d17de720-55d8-4b9a-8f16-386ab9e75e14", "name": "network-vif-plugged", "status": "completed", "tag": "3c0410cd-8d2b-4ec6-9bdc-443bf69e1791"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:47.539111 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9186a37a-feb6-4cda-93ac-9f37c702d36a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.246549 Sep 06 10:54:47.542660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ab63fa4-cb2b-4998-b6d7-137fea692f1f req-d0441ef8-6aa4-49e0-b099-6a3c4637ea22 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:47.543196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ab63fa4-cb2b-4998-b6d7-137fea692f1f req-d0441ef8-6aa4-49e0-b099-6a3c4637ea22 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:47.543644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ab63fa4-cb2b-4998-b6d7-137fea692f1f req-d0441ef8-6aa4-49e0-b099-6a3c4637ea22 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:47.544151 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 558/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:47 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:47.567079 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-7ab63fa4-cb2b-4998-b6d7-137fea692f1f req-d0441ef8-6aa4-49e0-b099-6a3c4637ea22 service nova] Creating event network-vif-plugged:3c0410cd-8d2b-4ec6-9bdc-443bf69e1791 for instance d17de720-55d8-4b9a-8f16-386ab9e75e14 on nch2-master-1 Sep 06 10:54:47.575148 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-7ab63fa4-cb2b-4998-b6d7-137fea692f1f req-d0441ef8-6aa4-49e0-b099-6a3c4637ea22 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087199 Sep 06 10:54:47.575148 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 565/1123] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:47.583731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-49736742-3236-49dd-904b-aa7f71f86072 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:47.584441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-49736742-3236-49dd-904b-aa7f71f86072 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:47.585408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1767903361", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "dffa3805-a31e-49ab-9a87-c94f3f6e088b"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:47.592879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49736742-3236-49dd-904b-aa7f71f86072 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:47.593377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49736742-3236-49dd-904b-aa7f71f86072 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:47.593824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49736742-3236-49dd-904b-aa7f71f86072 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:47.594547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49736742-3236-49dd-904b-aa7f71f86072 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:47.595042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49736742-3236-49dd-904b-aa7f71f86072 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:47.595694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49736742-3236-49dd-904b-aa7f71f86072 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:47.682539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] validate_networks() for [('dffa3805-a31e-49ab-9a87-c94f3f6e088b', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:54:47.938047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-49736742-3236-49dd-904b-aa7f71f86072 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:47.948602 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-49736742-3236-49dd-904b-aa7f71f86072 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1319 microversion: 2.1 time: 0.390989 Sep 06 10:54:47.949228 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 559/1124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:47 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:47.954384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5bdedd5a-61f6-4d3a-b975-a117b54393c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:47.962863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5bdedd5a-61f6-4d3a-b975-a117b54393c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:47.969732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5bdedd5a-61f6-4d3a-b975-a117b54393c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:47.970437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5bdedd5a-61f6-4d3a-b975-a117b54393c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:47.971276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5bdedd5a-61f6-4d3a-b975-a117b54393c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:47.972001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5bdedd5a-61f6-4d3a-b975-a117b54393c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:47.972637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5bdedd5a-61f6-4d3a-b975-a117b54393c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:47.973078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5bdedd5a-61f6-4d3a-b975-a117b54393c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:48.218231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5bdedd5a-61f6-4d3a-b975-a117b54393c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:48.227518 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5bdedd5a-61f6-4d3a-b975-a117b54393c7 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 200 len: 1520 microversion: 2.1 time: 0.276998 Sep 06 10:54:48.228118 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 560/1125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:47 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:48.255372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Action: 'action', calling method: .version_select at 0x7f90fa2c59d0>, body: {"addFloatingIp": {"address": "172.35.4.89"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:48.258077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:48.267247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:48.267939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:48.268378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:48.269041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:48.269507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:48.269847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:48.347825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:54:48.348308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:54:48.348719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:54:48.349131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:54:48.349920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:54:48.359789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "refresh_cache-b7dd9374-605a-4210-9271-9442a435c17c" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 10:54:48.360395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquired lock "refresh_cache-b7dd9374-605a-4210-9271-9442a435c17c" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 10:54:48.365344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:48.365831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:48.366275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:48.367039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:48.367626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:48.368605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:48.386942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Getting quotas for project 2ce648f86e3e4a3c9e8712bb087b8769. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:48.393198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Getting quotas for user de579d631e9d4010887077567bbe5fd6 and project 2ce648f86e3e4a3c9e8712bb087b8769. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:48.406936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:54:48.409490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:54:48.569491 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-98529898-79e8-444e-8632-e86e77c73678 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989070 Sep 06 10:54:48.586643 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 566/1126] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:54:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:54:48.607481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-31ec16ce-0246-4a74-91e1-18c6c93c3362 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:48.608970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-31ec16ce-0246-4a74-91e1-18c6c93c3362 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:48.628426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31ec16ce-0246-4a74-91e1-18c6c93c3362 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:48.629176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31ec16ce-0246-4a74-91e1-18c6c93c3362 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:48.630500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31ec16ce-0246-4a74-91e1-18c6c93c3362 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:48.631316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31ec16ce-0246-4a74-91e1-18c6c93c3362 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:48.631794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31ec16ce-0246-4a74-91e1-18c6c93c3362 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:48.632238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31ec16ce-0246-4a74-91e1-18c6c93c3362 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:48.661626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:48.884302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-31ec16ce-0246-4a74-91e1-18c6c93c3362 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:48.894540 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-31ec16ce-0246-4a74-91e1-18c6c93c3362 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.306759 Sep 06 10:54:48.895937 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 567/1127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:48 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:48.913955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a09ca45-0cf7-41bb-9c57-37de9f850cf0", "device": "/dev/xvdb"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:48.917832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:48.927349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:48.927859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:48.928361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:48.929117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:48.929586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:48.930114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:49.844782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Building network info cache for instance {{(pid=140875) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 06 10:54:50.097279 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "POST /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.199965 Sep 06 10:54:50.098629 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 568/1128] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Sep 6 10:54:48 2022] POST /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828/os-volume_attachments => generated 194 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:54:50.105932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7d2881fe-d14b-4f28-a2e3-9011f1eea187 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:50.106689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7d2881fe-d14b-4f28-a2e3-9011f1eea187 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:50.112876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d2881fe-d14b-4f28-a2e3-9011f1eea187 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:50.113362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d2881fe-d14b-4f28-a2e3-9011f1eea187 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:50.113823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d2881fe-d14b-4f28-a2e3-9011f1eea187 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:50.114849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d2881fe-d14b-4f28-a2e3-9011f1eea187 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:50.115499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d2881fe-d14b-4f28-a2e3-9011f1eea187 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:50.116183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d2881fe-d14b-4f28-a2e3-9011f1eea187 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:50.349824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d2881fe-d14b-4f28-a2e3-9011f1eea187 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:50.361675 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7d2881fe-d14b-4f28-a2e3-9011f1eea187 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.261510 Sep 06 10:54:50.362522 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 569/1129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:50 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:50.385765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-655169234", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "451", "networks": [{"uuid": "dffa3805-a31e-49ab-9a87-c94f3f6e088b"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:50.451355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] validate_networks() for [('dffa3805-a31e-49ab-9a87-c94f3f6e088b', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:54:50.554200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Updating instance_info_cache with network_info: [{"id": "c3240674-1db4-4057-af2a-0241d0fdc27b", "address": "fa:16:3e:5f:7f:78", "network": {"id": "d007355a-8137-418e-b0f5-eedcd060d4ec", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-192930602-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa352b4d4810484688d325ca4bb25193", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc3240674-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140875) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 06 10:54:50.633679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Releasing lock "refresh_cache-b7dd9374-605a-4210-9271-9442a435c17c" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 10:54:50.634625 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e7d7007-a174-4a81-ab47-8b384f064120 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "POST /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c/action" status: 202 len: 0 microversion: 2.1 time: 2.383724 Sep 06 10:54:50.635564 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 561/1130] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:54:48 2022] POST /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c/action => generated 0 bytes in 2385 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 06 10:54:50.640778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a5f0d514-3c94-4462-a837-4046073f63c5 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:50.641625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a5f0d514-3c94-4462-a837-4046073f63c5 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:50.654566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5f0d514-3c94-4462-a837-4046073f63c5 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:50.655349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5f0d514-3c94-4462-a837-4046073f63c5 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:50.655991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5f0d514-3c94-4462-a837-4046073f63c5 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:50.656715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5f0d514-3c94-4462-a837-4046073f63c5 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:50.657209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5f0d514-3c94-4462-a837-4046073f63c5 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:50.657646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5f0d514-3c94-4462-a837-4046073f63c5 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:51.033754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a5f0d514-3c94-4462-a837-4046073f63c5 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:51.048345 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a5f0d514-3c94-4462-a837-4046073f63c5 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1469 microversion: 2.1 time: 0.411456 Sep 06 10:54:51.063844 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 562/1131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:50 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1469 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:51.075287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f81fb4e6-b79b-4489-8338-47a085f3d359 req-52c4ad76-7af3-4a02-9e11-7e8e28e8fa2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7dd9374-605a-4210-9271-9442a435c17c", "tag": "c3240674-1db4-4057-af2a-0241d0fdc27b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:51.092558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f81fb4e6-b79b-4489-8338-47a085f3d359 req-52c4ad76-7af3-4a02-9e11-7e8e28e8fa2b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:51.103409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f81fb4e6-b79b-4489-8338-47a085f3d359 req-52c4ad76-7af3-4a02-9e11-7e8e28e8fa2b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:51.103409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f81fb4e6-b79b-4489-8338-47a085f3d359 req-52c4ad76-7af3-4a02-9e11-7e8e28e8fa2b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:51.107527 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f81fb4e6-b79b-4489-8338-47a085f3d359 req-52c4ad76-7af3-4a02-9e11-7e8e28e8fa2b service nova] Creating event network-changed:c3240674-1db4-4057-af2a-0241d0fdc27b for instance b7dd9374-605a-4210-9271-9442a435c17c on nch1-master-1 Sep 06 10:54:51.120017 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f81fb4e6-b79b-4489-8338-47a085f3d359 req-52c4ad76-7af3-4a02-9e11-7e8e28e8fa2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054405 Sep 06 10:54:51.121271 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 563/1132] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:51.140678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-efac1fde-bf52-4e04-b72a-1d91aa9592e1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:51.147629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-efac1fde-bf52-4e04-b72a-1d91aa9592e1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:51.151078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=12 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:51.159906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efac1fde-bf52-4e04-b72a-1d91aa9592e1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:51.160419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efac1fde-bf52-4e04-b72a-1d91aa9592e1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:51.160866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efac1fde-bf52-4e04-b72a-1d91aa9592e1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:51.161598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efac1fde-bf52-4e04-b72a-1d91aa9592e1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:51.162061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efac1fde-bf52-4e04-b72a-1d91aa9592e1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:51.162496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efac1fde-bf52-4e04-b72a-1d91aa9592e1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:51.637604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:54:51.638828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:54:51.639362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:54:51.639777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:54:51.640368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:54:51.649592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:51.650150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:51.650531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:51.651933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:51.652399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:51.652837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:51.667446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:51.678517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Getting quotas for project 2ce648f86e3e4a3c9e8712bb087b8769. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:54:51.681330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-efac1fde-bf52-4e04-b72a-1d91aa9592e1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:51.686665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Getting quotas for user de579d631e9d4010887077567bbe5fd6 and project 2ce648f86e3e4a3c9e8712bb087b8769. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:54:51.690099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:51.694169 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-efac1fde-bf52-4e04-b72a-1d91aa9592e1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.569997 Sep 06 10:54:51.694169 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 564/1133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:51 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:51.701052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:54:51.703469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:54:51.713514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.89"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:51.715952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:51.722247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:51.722744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:51.730448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:51.730448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:51.730448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:51.730448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:51.751132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "refresh_cache-0f954794-a097-41c8-833d-3ae1320b54d9" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 10:54:51.753135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquired lock "refresh_cache-0f954794-a097-41c8-833d-3ae1320b54d9" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 10:54:51.858734 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e4ae9a9e-f5c2-40c8-a2ea-05c9f0321110 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.480138 Sep 06 10:54:51.865851 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 570/1134] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:54:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:54:51.867934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-18a46fd3-4804-490b-9fc7-8a6a0e650413 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:51.868778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-18a46fd3-4804-490b-9fc7-8a6a0e650413 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:51.882451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18a46fd3-4804-490b-9fc7-8a6a0e650413 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:51.887935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18a46fd3-4804-490b-9fc7-8a6a0e650413 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:51.888563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18a46fd3-4804-490b-9fc7-8a6a0e650413 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:51.890195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18a46fd3-4804-490b-9fc7-8a6a0e650413 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:51.891504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18a46fd3-4804-490b-9fc7-8a6a0e650413 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:51.892563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18a46fd3-4804-490b-9fc7-8a6a0e650413 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:51.953328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-18a46fd3-4804-490b-9fc7-8a6a0e650413 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lazy-loading 'flavor' on Instance uuid d17de720-55d8-4b9a-8f16-386ab9e75e14 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:54:52.268976 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-18a46fd3-4804-490b-9fc7-8a6a0e650413 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14/action" status: 202 len: 0 microversion: 2.1 time: 0.407051 Sep 06 10:54:52.274954 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 571/1135] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:54:51 2022] POST /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:54:52.285416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e26ab07a-54c4-4fab-b08a-ca93eb2b52ef tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:52.295175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e26ab07a-54c4-4fab-b08a-ca93eb2b52ef tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:52.307767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e26ab07a-54c4-4fab-b08a-ca93eb2b52ef tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:52.309090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e26ab07a-54c4-4fab-b08a-ca93eb2b52ef tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:52.310835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e26ab07a-54c4-4fab-b08a-ca93eb2b52ef tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:52.326258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e26ab07a-54c4-4fab-b08a-ca93eb2b52ef tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:52.328385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e26ab07a-54c4-4fab-b08a-ca93eb2b52ef tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:52.333790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e26ab07a-54c4-4fab-b08a-ca93eb2b52ef tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:52.794949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e26ab07a-54c4-4fab-b08a-ca93eb2b52ef tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:52.802809 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e26ab07a-54c4-4fab-b08a-ca93eb2b52ef tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.524752 Sep 06 10:54:52.803416 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 572/1136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:52 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:52.819407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-47674297-5c0c-4292-b0db-5fdd73c61df6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:52.820076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-47674297-5c0c-4292-b0db-5fdd73c61df6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:52.890760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-47674297-5c0c-4292-b0db-5fdd73c61df6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:52.897851 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-47674297-5c0c-4292-b0db-5fdd73c61df6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1220 microversion: 2.1 time: 0.093423 Sep 06 10:54:52.898423 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 573/1137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:52 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:52.903084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-75228400-25d0-43b5-98c8-aa1e83cb45af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:52.903998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-75228400-25d0-43b5-98c8-aa1e83cb45af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:52.914989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75228400-25d0-43b5-98c8-aa1e83cb45af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:52.915582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75228400-25d0-43b5-98c8-aa1e83cb45af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:52.916096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75228400-25d0-43b5-98c8-aa1e83cb45af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:52.916872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75228400-25d0-43b5-98c8-aa1e83cb45af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:52.917368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75228400-25d0-43b5-98c8-aa1e83cb45af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:52.917799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75228400-25d0-43b5-98c8-aa1e83cb45af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:53.383868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-75228400-25d0-43b5-98c8-aa1e83cb45af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:53.397793 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-75228400-25d0-43b5-98c8-aa1e83cb45af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1477 microversion: 2.1 time: 0.498333 Sep 06 10:54:53.401356 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 574/1138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:52 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1477 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:53.425746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81ab7adf-1088-4215-b965-317731c080cb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:53.426346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-81ab7adf-1088-4215-b965-317731c080cb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:53.436575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81ab7adf-1088-4215-b965-317731c080cb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:53.437231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81ab7adf-1088-4215-b965-317731c080cb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:53.440376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81ab7adf-1088-4215-b965-317731c080cb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:53.440376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81ab7adf-1088-4215-b965-317731c080cb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:53.440376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81ab7adf-1088-4215-b965-317731c080cb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:53.440376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81ab7adf-1088-4215-b965-317731c080cb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:53.736221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-81ab7adf-1088-4215-b965-317731c080cb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:53.757549 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-81ab7adf-1088-4215-b965-317731c080cb tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.344465 Sep 06 10:54:53.760653 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 575/1139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:53 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:53.828517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6d6216f8-e839-4223-ab58-17abed0d2f70 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:53.829256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6d6216f8-e839-4223-ab58-17abed0d2f70 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:53.841432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d6216f8-e839-4223-ab58-17abed0d2f70 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:53.841973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d6216f8-e839-4223-ab58-17abed0d2f70 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:53.842421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d6216f8-e839-4223-ab58-17abed0d2f70 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:53.843199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d6216f8-e839-4223-ab58-17abed0d2f70 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:53.845050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d6216f8-e839-4223-ab58-17abed0d2f70 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:53.845050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d6216f8-e839-4223-ab58-17abed0d2f70 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:54.474588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6d6216f8-e839-4223-ab58-17abed0d2f70 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:54.493741 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6d6216f8-e839-4223-ab58-17abed0d2f70 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.671059 Sep 06 10:54:54.503545 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 576/1140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:53 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:54.511963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34c63c97-1118-4006-adbd-7c77fc6fde5f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:54.515934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-34c63c97-1118-4006-adbd-7c77fc6fde5f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:54.523600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34c63c97-1118-4006-adbd-7c77fc6fde5f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:54.524167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34c63c97-1118-4006-adbd-7c77fc6fde5f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:54.524864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34c63c97-1118-4006-adbd-7c77fc6fde5f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:54.525750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34c63c97-1118-4006-adbd-7c77fc6fde5f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:54.526448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34c63c97-1118-4006-adbd-7c77fc6fde5f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:54.527111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34c63c97-1118-4006-adbd-7c77fc6fde5f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:54.629840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-34c63c97-1118-4006-adbd-7c77fc6fde5f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:54.638981 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-34c63c97-1118-4006-adbd-7c77fc6fde5f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1272 microversion: 2.1 time: 0.143641 Sep 06 10:54:54.642905 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 577/1141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:54 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:54.644105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ad34924c-ae6e-4e46-928b-c4fd6197db6a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:54.645532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ad34924c-ae6e-4e46-928b-c4fd6197db6a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:54.651215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad34924c-ae6e-4e46-928b-c4fd6197db6a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:54.651703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad34924c-ae6e-4e46-928b-c4fd6197db6a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:54.652323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad34924c-ae6e-4e46-928b-c4fd6197db6a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:54.653184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad34924c-ae6e-4e46-928b-c4fd6197db6a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:54.653801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad34924c-ae6e-4e46-928b-c4fd6197db6a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:54.654981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad34924c-ae6e-4e46-928b-c4fd6197db6a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:55.090447 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ad34924c-ae6e-4e46-928b-c4fd6197db6a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1814 microversion: 2.1 time: 0.449633 Sep 06 10:54:55.095811 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 578/1142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:54 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1814 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:55.106269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c34526b0-5f88-458f-bbd0-109810b60902 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:55.106893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c34526b0-5f88-458f-bbd0-109810b60902 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:55.120877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c34526b0-5f88-458f-bbd0-109810b60902 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:55.121395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c34526b0-5f88-458f-bbd0-109810b60902 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:55.121826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c34526b0-5f88-458f-bbd0-109810b60902 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:55.122536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c34526b0-5f88-458f-bbd0-109810b60902 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:55.124399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c34526b0-5f88-458f-bbd0-109810b60902 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:55.125399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c34526b0-5f88-458f-bbd0-109810b60902 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:55.547699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c34526b0-5f88-458f-bbd0-109810b60902 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:55.560936 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c34526b0-5f88-458f-bbd0-109810b60902 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1460 microversion: 2.1 time: 0.457494 Sep 06 10:54:55.570870 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 579/1143] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:55 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1460 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:55.579970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7191f03f-592c-40f2-b84e-fddff609675d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:55.580624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7191f03f-592c-40f2-b84e-fddff609675d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:55.587309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7191f03f-592c-40f2-b84e-fddff609675d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:55.589899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7191f03f-592c-40f2-b84e-fddff609675d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:55.589899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7191f03f-592c-40f2-b84e-fddff609675d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:55.589899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7191f03f-592c-40f2-b84e-fddff609675d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:55.590346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7191f03f-592c-40f2-b84e-fddff609675d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:55.590775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7191f03f-592c-40f2-b84e-fddff609675d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:56.044855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7191f03f-592c-40f2-b84e-fddff609675d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:56.053603 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7191f03f-592c-40f2-b84e-fddff609675d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.483522 Sep 06 10:54:56.054871 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 580/1144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:55 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:56.072012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5ab4f97-88fc-4977-a6df-394558ee782b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:56.075927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5ab4f97-88fc-4977-a6df-394558ee782b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:56.076426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5ab4f97-88fc-4977-a6df-394558ee782b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:56.076871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5ab4f97-88fc-4977-a6df-394558ee782b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:56.077609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5ab4f97-88fc-4977-a6df-394558ee782b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:56.078074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5ab4f97-88fc-4977-a6df-394558ee782b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:56.078810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5ab4f97-88fc-4977-a6df-394558ee782b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:56.105918 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a5ab4f97-88fc-4977-a6df-394558ee782b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.049201 Sep 06 10:54:56.106859 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 581/1145] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Sep 6 10:54:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:56.111617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-2d545700-66c7-4f94-95a4-a94419dad100 req-ca0822c7-f1b4-477d-af5a-f5f46911be4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e56ea2-b73c-4a32-b0aa-1d3d76064bc7", "tag": "6d345f27-53e4-4248-b1d5-8bf046827b4d"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:56.122916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2d545700-66c7-4f94-95a4-a94419dad100 req-ca0822c7-f1b4-477d-af5a-f5f46911be4f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:56.123447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2d545700-66c7-4f94-95a4-a94419dad100 req-ca0822c7-f1b4-477d-af5a-f5f46911be4f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:56.124071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2d545700-66c7-4f94-95a4-a94419dad100 req-ca0822c7-f1b4-477d-af5a-f5f46911be4f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:56.144765 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-2d545700-66c7-4f94-95a4-a94419dad100 req-ca0822c7-f1b4-477d-af5a-f5f46911be4f service nova] Creating event network-changed:6d345f27-53e4-4248-b1d5-8bf046827b4d for instance 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 on nch1-master-1 Sep 06 10:54:56.151195 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-2d545700-66c7-4f94-95a4-a94419dad100 req-ca0822c7-f1b4-477d-af5a-f5f46911be4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042701 Sep 06 10:54:56.152381 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 582/1146] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:56.172161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4902a43b-23b6-43dd-a0e7-33134075d52b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:56.172821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4902a43b-23b6-43dd-a0e7-33134075d52b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:56.180797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4902a43b-23b6-43dd-a0e7-33134075d52b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:56.181739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4902a43b-23b6-43dd-a0e7-33134075d52b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:56.182399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4902a43b-23b6-43dd-a0e7-33134075d52b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:56.183499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4902a43b-23b6-43dd-a0e7-33134075d52b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:56.184866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4902a43b-23b6-43dd-a0e7-33134075d52b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:56.185596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4902a43b-23b6-43dd-a0e7-33134075d52b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:56.681010 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.network.neutron [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] re-assign floating IP 172.35.4.89 from instance b7dd9374-605a-4210-9271-9442a435c17c Sep 06 10:54:56.780004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Building network info cache for instance {{(pid=140875) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 06 10:54:56.893139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4902a43b-23b6-43dd-a0e7-33134075d52b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:56.907410 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4902a43b-23b6-43dd-a0e7-33134075d52b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.753221 Sep 06 10:54:56.913250 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 583/1147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:56 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:56.920985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a740cea-1837-4eb5-b2a5-db9f1877a490 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:56.921593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9a740cea-1837-4eb5-b2a5-db9f1877a490 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:56.937592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a740cea-1837-4eb5-b2a5-db9f1877a490 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:56.940310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a740cea-1837-4eb5-b2a5-db9f1877a490 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:56.940310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a740cea-1837-4eb5-b2a5-db9f1877a490 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:56.940310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a740cea-1837-4eb5-b2a5-db9f1877a490 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:56.940310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a740cea-1837-4eb5-b2a5-db9f1877a490 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:56.940980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a740cea-1837-4eb5-b2a5-db9f1877a490 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:56.946651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:57.876969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Updating instance_info_cache with network_info: [{"id": "c3240674-1db4-4057-af2a-0241d0fdc27b", "address": "fa:16:3e:5f:7f:78", "network": {"id": "d007355a-8137-418e-b0f5-eedcd060d4ec", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-192930602-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa352b4d4810484688d325ca4bb25193", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc3240674-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140875) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 06 10:54:57.953232 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a740cea-1837-4eb5-b2a5-db9f1877a490 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1611 microversion: 2.1 time: 1.037396 Sep 06 10:54:57.960424 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 584/1148] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:56 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1611 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:57.966897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dee65bbd-7ebe-46b0-b2bf-63ed45d0b6dd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:57.967798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dee65bbd-7ebe-46b0-b2bf-63ed45d0b6dd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:57.973920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dee65bbd-7ebe-46b0-b2bf-63ed45d0b6dd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:57.974417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dee65bbd-7ebe-46b0-b2bf-63ed45d0b6dd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:57.974861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dee65bbd-7ebe-46b0-b2bf-63ed45d0b6dd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:57.975609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dee65bbd-7ebe-46b0-b2bf-63ed45d0b6dd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:57.976078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dee65bbd-7ebe-46b0-b2bf-63ed45d0b6dd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:57.976513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dee65bbd-7ebe-46b0-b2bf-63ed45d0b6dd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:58.204423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dee65bbd-7ebe-46b0-b2bf-63ed45d0b6dd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:58.212906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Building network info cache for instance {{(pid=140875) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 06 10:54:58.215376 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dee65bbd-7ebe-46b0-b2bf-63ed45d0b6dd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1320 microversion: 2.1 time: 0.251582 Sep 06 10:54:58.215376 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 585/1149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:57 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1320 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:58.218473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-e19885ba-26e3-4437-8e16-89ca3c609a61 req-ce40b15b-a2e9-46eb-899c-8aa6f2683fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c583ed-d9a7-4efc-aee6-d9aba4141e61", "tag": "bbeeb8f4-352d-4ce1-98d3-a6ec1bdc0267"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:58.229204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e19885ba-26e3-4437-8e16-89ca3c609a61 req-ce40b15b-a2e9-46eb-899c-8aa6f2683fcb service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:58.229691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e19885ba-26e3-4437-8e16-89ca3c609a61 req-ce40b15b-a2e9-46eb-899c-8aa6f2683fcb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:58.230133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e19885ba-26e3-4437-8e16-89ca3c609a61 req-ce40b15b-a2e9-46eb-899c-8aa6f2683fcb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:58.241360 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-e19885ba-26e3-4437-8e16-89ca3c609a61 req-ce40b15b-a2e9-46eb-899c-8aa6f2683fcb service nova] Creating event network-changed:bbeeb8f4-352d-4ce1-98d3-a6ec1bdc0267 for instance 94c583ed-d9a7-4efc-aee6-d9aba4141e61 on nch1-master-1 Sep 06 10:54:58.247828 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-e19885ba-26e3-4437-8e16-89ca3c609a61 req-ce40b15b-a2e9-46eb-899c-8aa6f2683fcb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033074 Sep 06 10:54:58.249991 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 586/1150] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:58.254201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-80d6fde5-a7d8-4e2f-a8fb-ec88550fe21f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:58.254947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-80d6fde5-a7d8-4e2f-a8fb-ec88550fe21f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:58.261914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80d6fde5-a7d8-4e2f-a8fb-ec88550fe21f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:58.262405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80d6fde5-a7d8-4e2f-a8fb-ec88550fe21f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:58.262851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80d6fde5-a7d8-4e2f-a8fb-ec88550fe21f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:58.263592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80d6fde5-a7d8-4e2f-a8fb-ec88550fe21f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:58.264054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80d6fde5-a7d8-4e2f-a8fb-ec88550fe21f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:58.264486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80d6fde5-a7d8-4e2f-a8fb-ec88550fe21f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:58.546058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-80d6fde5-a7d8-4e2f-a8fb-ec88550fe21f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid 31a4ea2a-aa16-4e41-af83-b027dfe81828 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:54:58.560025 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-80d6fde5-a7d8-4e2f-a8fb-ec88550fe21f tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 2423 microversion: 2.25 time: 0.310414 Sep 06 10:54:58.561780 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 587/1151] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:54:58 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 2423 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:54:58.565448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d0500e05-151d-4e55-b1f1-a44f2168b046 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:58.566062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d0500e05-151d-4e55-b1f1-a44f2168b046 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:58.572051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0500e05-151d-4e55-b1f1-a44f2168b046 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:58.572353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0500e05-151d-4e55-b1f1-a44f2168b046 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:58.572790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0500e05-151d-4e55-b1f1-a44f2168b046 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:58.573482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0500e05-151d-4e55-b1f1-a44f2168b046 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:58.573942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0500e05-151d-4e55-b1f1-a44f2168b046 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:58.574368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0500e05-151d-4e55-b1f1-a44f2168b046 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:58.924501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d0500e05-151d-4e55-b1f1-a44f2168b046 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:58.933363 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d0500e05-151d-4e55-b1f1-a44f2168b046 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.371762 Sep 06 10:54:58.934048 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 588/1152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:58 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:58.939284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe5723a1-72d6-41c1-9e62-d24446456d60 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:58.939962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe5723a1-72d6-41c1-9e62-d24446456d60 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:58.946461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5723a1-72d6-41c1-9e62-d24446456d60 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:58.947173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5723a1-72d6-41c1-9e62-d24446456d60 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:58.947621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5723a1-72d6-41c1-9e62-d24446456d60 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:58.948315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5723a1-72d6-41c1-9e62-d24446456d60 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:58.948770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5723a1-72d6-41c1-9e62-d24446456d60 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:58.949197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5723a1-72d6-41c1-9e62-d24446456d60 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:59.203586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe5723a1-72d6-41c1-9e62-d24446456d60 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:59.211632 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe5723a1-72d6-41c1-9e62-d24446456d60 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.276439 Sep 06 10:54:59.212209 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 589/1153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:58 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:59.216514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-753f8db5-8512-404b-bbd3-c4ac826955aa tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:59.220165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-753f8db5-8512-404b-bbd3-c4ac826955aa tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:59.220645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-753f8db5-8512-404b-bbd3-c4ac826955aa tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:59.221084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-753f8db5-8512-404b-bbd3-c4ac826955aa tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:59.222006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-753f8db5-8512-404b-bbd3-c4ac826955aa tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:59.222460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-753f8db5-8512-404b-bbd3-c4ac826955aa tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:59.223090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-753f8db5-8512-404b-bbd3-c4ac826955aa tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:59.254238 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-753f8db5-8512-404b-bbd3-c4ac826955aa tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040858 Sep 06 10:54:59.263212 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 590/1154] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Sep 6 10:54:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:54:59.263212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-41338e4d-2b6a-4120-99db-4e90305130d6 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:59.263212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-41338e4d-2b6a-4120-99db-4e90305130d6 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:59.265534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Updating instance_info_cache with network_info: [{"id": "3a38233d-1716-4cd1-b63c-ed57733b91ed", "address": "fa:16:3e:4e:4a:2b", "network": {"id": "d007355a-8137-418e-b0f5-eedcd060d4ec", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-192930602-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa352b4d4810484688d325ca4bb25193", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3a38233d-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140875) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 06 10:54:59.269763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41338e4d-2b6a-4120-99db-4e90305130d6 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:59.270260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41338e4d-2b6a-4120-99db-4e90305130d6 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:59.270699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41338e4d-2b6a-4120-99db-4e90305130d6 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:59.271439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41338e4d-2b6a-4120-99db-4e90305130d6 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:59.271899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41338e4d-2b6a-4120-99db-4e90305130d6 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:59.273465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41338e4d-2b6a-4120-99db-4e90305130d6 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:59.296574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-41338e4d-2b6a-4120-99db-4e90305130d6 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'flavor' on Instance uuid 31a4ea2a-aa16-4e41-af83-b027dfe81828 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:54:59.308848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-41338e4d-2b6a-4120-99db-4e90305130d6 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Going to try to live migrate instance to nch2-master-1 {{(pid=140876) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 06 10:54:59.397487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Releasing lock "refresh_cache-0f954794-a097-41c8-833d-3ae1320b54d9" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 10:54:59.400075 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c322b3e0-29fc-47f2-a76d-a8a498c45ee1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "POST /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9/action" status: 202 len: 0 microversion: 2.1 time: 7.688849 Sep 06 10:54:59.400075 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 565/1155] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:54:51 2022] POST /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9/action => generated 0 bytes in 7705 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 06 10:54:59.406820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-65403662-89a6-439f-94ae-115ce1f70101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:54:59.410560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-65403662-89a6-439f-94ae-115ce1f70101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:59.417914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65403662-89a6-439f-94ae-115ce1f70101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:59.418041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65403662-89a6-439f-94ae-115ce1f70101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:59.418452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65403662-89a6-439f-94ae-115ce1f70101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:59.419211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65403662-89a6-439f-94ae-115ce1f70101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:59.419680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65403662-89a6-439f-94ae-115ce1f70101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:59.420113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65403662-89a6-439f-94ae-115ce1f70101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:59.584801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-65403662-89a6-439f-94ae-115ce1f70101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:54:59.593567 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-65403662-89a6-439f-94ae-115ce1f70101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1320 microversion: 2.1 time: 0.190571 Sep 06 10:54:59.594221 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 566/1156] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:54:59 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1320 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:54:59.598877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-27155b4f-c497-49c1-8e79-f7e0cf3905cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e67a265-9fec-4ea9-98b6-e577de25d288", "device": "/dev/xvdb"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:54:59.602409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-27155b4f-c497-49c1-8e79-f7e0cf3905cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:54:59.608495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-27155b4f-c497-49c1-8e79-f7e0cf3905cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:59.608981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-27155b4f-c497-49c1-8e79-f7e0cf3905cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:59.609416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-27155b4f-c497-49c1-8e79-f7e0cf3905cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:54:59.610146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-27155b4f-c497-49c1-8e79-f7e0cf3905cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:54:59.610601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-27155b4f-c497-49c1-8e79-f7e0cf3905cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:54:59.611046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-27155b4f-c497-49c1-8e79-f7e0cf3905cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:00.506920 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-27155b4f-c497-49c1-8e79-f7e0cf3905cd tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "POST /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.911468 Sep 06 10:55:00.507883 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 567/1157] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 10:54:59 2022] POST /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/os-volume_attachments => generated 194 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:00.513192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d9d03a2d-b549-4933-9277-f8941db2be20 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:00.519422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d9d03a2d-b549-4933-9277-f8941db2be20 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:00.522087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9d03a2d-b549-4933-9277-f8941db2be20 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:00.522582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9d03a2d-b549-4933-9277-f8941db2be20 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:00.523059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9d03a2d-b549-4933-9277-f8941db2be20 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:00.524352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9d03a2d-b549-4933-9277-f8941db2be20 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:00.524820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9d03a2d-b549-4933-9277-f8941db2be20 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:00.525253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9d03a2d-b549-4933-9277-f8941db2be20 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:00.551513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-d9d03a2d-b549-4933-9277-f8941db2be20 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Lazy-loading 'flavor' on Instance uuid d17de720-55d8-4b9a-8f16-386ab9e75e14 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:00.563946 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-d9d03a2d-b549-4933-9277-f8941db2be20 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance d17de720-55d8-4b9a-8f16-386ab9e75e14 while it is in vm_state suspended Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d9d03a2d-b549-4933-9277-f8941db2be20 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Request method failure captured: Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14/action HTTP/1.1 Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 97 Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFybF4w5AP-AUxeG0qRbUt6gf22NLBi_Q4yMC2qB81atrH2WUk59oM6QipELW7UBQRYQI38uFdyqMeGmmR63HK6lXjBzYitgmKazFQtjbBV_G7hS9kCtAOhMWDIrCWzQuOz3QrUUs79Q8eYnOHftlaa2Nn6HChwHMG3rgth3FPKYzehM Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 7c467640a0b74919878e4113df83ada7 Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-LiveMigrationNegativeTest-348602465 Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:55:00.565796 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:55:00.567517 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c467640a0b74919878e4113df83ada7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c467640a0b74919878e4113df83ada7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c467640a0b74919878e4113df83ada7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c467640a0b74919878e4113df83ada7"}]}] Sep 06 10:55:00.567517 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-LiveMigrationNegativeTest-348602465 Sep 06 10:55:00.567517 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 7c467640a0b74919878e4113df83ada7 Sep 06 10:55:00.567517 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-348602465 Sep 06 10:55:00.567517 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-LiveMigrationNegativeTest-348602465-project-admin Sep 06 10:55:00.567517 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:55:00.567517 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:55:00.567517 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 99afe908353d421f9a144506425bc1ca Sep 06 10:55:00.567517 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-LiveMigrationNegativeTest-348602465-project-admin Sep 06 10:55:00.567517 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:55:00.567517 ncdv-master-1 devstack@n-api.service[140875]: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} Sep 06 10:55:00.567517 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: exception: Cannot 'os-migrateLive' instance d17de720-55d8-4b9a-8f16-386ab9e75e14 while it is in vm_state suspended Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'd17de720-55d8-4b9a-8f16-386ab9e75e14', 'body': {'os-migrateLive': {'host': 'nch1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 06 10:55:00.573963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d17de720-55d8-4b9a-8f16-386ab9e75e14 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:55:00.575145 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance d17de720-55d8-4b9a-8f16-386ab9e75e14 while it is in vm_state suspended Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance d17de720-55d8-4b9a-8f16-386ab9e75e14 while it is in vm_state suspended Sep 06 10:55:00.576678 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:00.578628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d9d03a2d-b549-4933-9277-f8941db2be20 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance d17de720-55d8-4b9a-8f16-386ab9e75e14 while it is in vm_state suspended {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:00.578628 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d9d03a2d-b549-4933-9277-f8941db2be20 tempest-LiveMigrationNegativeTest-348602465 tempest-LiveMigrationNegativeTest-348602465-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14/action" status: 409 len: 155 microversion: 2.1 time: 0.058177 Sep 06 10:55:00.578628 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 568/1158] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:55:00 2022] POST /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14/action => generated 155 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:55:00.578628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-04825a4a-bd81-4bbe-be8f-4e689f1ed036 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Action: 'action', calling method: .version_select at 0x7f90fa2c5700>, body: {"removeFloatingIp": {"address": "172.35.4.89"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:00.759686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-04825a4a-bd81-4bbe-be8f-4e689f1ed036 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:00.767076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04825a4a-bd81-4bbe-be8f-4e689f1ed036 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:00.767658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04825a4a-bd81-4bbe-be8f-4e689f1ed036 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:00.768022 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04825a4a-bd81-4bbe-be8f-4e689f1ed036 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:00.768747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04825a4a-bd81-4bbe-be8f-4e689f1ed036 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:00.769209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04825a4a-bd81-4bbe-be8f-4e689f1ed036 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:00.769777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04825a4a-bd81-4bbe-be8f-4e689f1ed036 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:01.385666 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-04825a4a-bd81-4bbe-be8f-4e689f1ed036 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] HTTP exception thrown: Floating IP 172.35.4.89 is not associated with instance b7dd9374-605a-4210-9271-9442a435c17c. Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-04825a4a-bd81-4bbe-be8f-4e689f1ed036 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Request method failure captured: Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c/action HTTP/1.1 Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 48 Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFybJwBPoDD6TpToX2LfVwlb3pFQBQyhvDfGsXw8HVWS_ENMdZw1fyQvROi67jEDseVD3GqWu4HEzuuaXvWYEn8yK9rBQIBiJZABTIy3OthBEpqf766hp3M1U9juOP2P91wFYQg3yw1TlCQjT0g-MsE0jYMcnyZGv975wsA4RiNJYxjU Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aa352b4d4810484688d325ca4bb25193 Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-324247753 Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:55:01.387757 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:55:01.389678 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa352b4d4810484688d325ca4bb25193"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa352b4d4810484688d325ca4bb25193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa352b4d4810484688d325ca4bb25193"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa352b4d4810484688d325ca4bb25193"}]}] Sep 06 10:55:01.389678 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-324247753 Sep 06 10:55:01.389678 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aa352b4d4810484688d325ca4bb25193 Sep 06 10:55:01.389678 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-324247753 Sep 06 10:55:01.389678 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FloatingIPsAssociationTestJSON-324247753-project Sep 06 10:55:01.389678 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:55:01.389678 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:55:01.389678 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 24d86f8c8ece4257adc548304465f191 Sep 06 10:55:01.389678 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-324247753-project Sep 06 10:55:01.389678 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:55:01.389678 ncdv-master-1 devstack@n-api.service[140875]: {"removeFloatingIp": {"address": "172.35.4.89"}} Sep 06 10:55:01.389678 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:55:01.389678 ncdv-master-1 devstack@n-api.service[140875]: exception: Floating IP 172.35.4.89 is not associated with instance b7dd9374-605a-4210-9271-9442a435c17c. Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'b7dd9374-605a-4210-9271-9442a435c17c', 'body': {'removeFloatingIp': {'address': '172.35.4.89'}}} Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.4.89 is not associated with instance b7dd9374-605a-4210-9271-9442a435c17c. Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:01.390719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:01.396537 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:01.396537 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:01.396537 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:01.396537 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:01.396537 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.4.89 is not associated with instance b7dd9374-605a-4210-9271-9442a435c17c. Sep 06 10:55:01.396537 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:01.396537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-04825a4a-bd81-4bbe-be8f-4e689f1ed036 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Returning 409 to user: Floating IP 172.35.4.89 is not associated with instance b7dd9374-605a-4210-9271-9442a435c17c. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:01.396537 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-04825a4a-bd81-4bbe-be8f-4e689f1ed036 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "POST /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c/action" status: 409 len: 145 microversion: 2.1 time: 0.823941 Sep 06 10:55:01.396537 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 569/1159] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:55:00 2022] POST /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c/action => generated 145 bytes in 825 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:55:01.401216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-45e0390e-cf7e-45a5-a40d-ec9e31320226 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:01.401837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-45e0390e-cf7e-45a5-a40d-ec9e31320226 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:01.408089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45e0390e-cf7e-45a5-a40d-ec9e31320226 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:01.408587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45e0390e-cf7e-45a5-a40d-ec9e31320226 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:01.409036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45e0390e-cf7e-45a5-a40d-ec9e31320226 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:01.409748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45e0390e-cf7e-45a5-a40d-ec9e31320226 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:01.410218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45e0390e-cf7e-45a5-a40d-ec9e31320226 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:01.410645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45e0390e-cf7e-45a5-a40d-ec9e31320226 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:01.617931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-45e0390e-cf7e-45a5-a40d-ec9e31320226 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:01.637645 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-45e0390e-cf7e-45a5-a40d-ec9e31320226 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.232217 Sep 06 10:55:01.637645 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 570/1160] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:01 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:01.637645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1731e04f-0d93-4bb4-a80d-6ac3ad77961f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:01.637645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1731e04f-0d93-4bb4-a80d-6ac3ad77961f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:01.639700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1731e04f-0d93-4bb4-a80d-6ac3ad77961f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:01.640196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1731e04f-0d93-4bb4-a80d-6ac3ad77961f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:01.640643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1731e04f-0d93-4bb4-a80d-6ac3ad77961f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:01.641347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1731e04f-0d93-4bb4-a80d-6ac3ad77961f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:01.641813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1731e04f-0d93-4bb4-a80d-6ac3ad77961f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:01.642342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1731e04f-0d93-4bb4-a80d-6ac3ad77961f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:01.815775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1731e04f-0d93-4bb4-a80d-6ac3ad77961f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:01.825095 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1731e04f-0d93-4bb4-a80d-6ac3ad77961f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.196949 Sep 06 10:55:01.825669 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 571/1161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:01 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:01.830124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-5a5316a1-1810-4dde-a215-7483bd9d74b6 req-2c2f7097-58b4-4954-8117-19c582241056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7dd9374-605a-4210-9271-9442a435c17c", "tag": "c3240674-1db4-4057-af2a-0241d0fdc27b"}, {"name": "network-changed", "server_uuid": "0f954794-a097-41c8-833d-3ae1320b54d9", "tag": "3a38233d-1716-4cd1-b63c-ed57733b91ed"}, {"name": "network-changed", "server_uuid": "2127bce6-afc2-4bc3-87b3-882572de2144", "tag": "23f8c404-c5d8-41db-bbca-1bd890f56145"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:01.841105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5a5316a1-1810-4dde-a215-7483bd9d74b6 req-2c2f7097-58b4-4954-8117-19c582241056 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:01.841569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5a5316a1-1810-4dde-a215-7483bd9d74b6 req-2c2f7097-58b4-4954-8117-19c582241056 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:01.842012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5a5316a1-1810-4dde-a215-7483bd9d74b6 req-2c2f7097-58b4-4954-8117-19c582241056 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:01.855810 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5a5316a1-1810-4dde-a215-7483bd9d74b6 req-2c2f7097-58b4-4954-8117-19c582241056 service nova] Creating event network-changed:c3240674-1db4-4057-af2a-0241d0fdc27b for instance b7dd9374-605a-4210-9271-9442a435c17c on nch1-master-1 Sep 06 10:55:01.856334 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5a5316a1-1810-4dde-a215-7483bd9d74b6 req-2c2f7097-58b4-4954-8117-19c582241056 service nova] Creating event network-changed:3a38233d-1716-4cd1-b63c-ed57733b91ed for instance 0f954794-a097-41c8-833d-3ae1320b54d9 on nch2-master-1 Sep 06 10:55:01.856843 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5a5316a1-1810-4dde-a215-7483bd9d74b6 req-2c2f7097-58b4-4954-8117-19c582241056 service nova] Creating event network-changed:23f8c404-c5d8-41db-bbca-1bd890f56145 for instance 2127bce6-afc2-4bc3-87b3-882572de2144 on nch2-master-1 Sep 06 10:55:01.866677 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-5a5316a1-1810-4dde-a215-7483bd9d74b6 req-2c2f7097-58b4-4954-8117-19c582241056 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.039907 Sep 06 10:55:01.867949 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 572/1162] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:01.873592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e647b8f9-9943-4f7c-ab46-e6f627838b7e tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:01.874179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e647b8f9-9943-4f7c-ab46-e6f627838b7e tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:01.880722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e647b8f9-9943-4f7c-ab46-e6f627838b7e tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:01.881761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e647b8f9-9943-4f7c-ab46-e6f627838b7e tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:01.882267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e647b8f9-9943-4f7c-ab46-e6f627838b7e tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:01.883814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e647b8f9-9943-4f7c-ab46-e6f627838b7e tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:01.884332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e647b8f9-9943-4f7c-ab46-e6f627838b7e tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:01.884767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e647b8f9-9943-4f7c-ab46-e6f627838b7e tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:01.910368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e647b8f9-9943-4f7c-ab46-e6f627838b7e tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:55:02.178680 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e647b8f9-9943-4f7c-ab46-e6f627838b7e tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 204 len: 0 microversion: 2.1 time: 0.308930 Sep 06 10:55:02.183067 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 573/1163] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:55:01 2022] DELETE /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:55:02.187090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7236f5f7-744d-466e-bd3b-7afff071ddcf tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:02.188157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7236f5f7-744d-466e-bd3b-7afff071ddcf tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:02.210554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7236f5f7-744d-466e-bd3b-7afff071ddcf tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:02.214435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7236f5f7-744d-466e-bd3b-7afff071ddcf tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:02.214801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7236f5f7-744d-466e-bd3b-7afff071ddcf tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:02.216255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7236f5f7-744d-466e-bd3b-7afff071ddcf tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:02.216729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7236f5f7-744d-466e-bd3b-7afff071ddcf tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:02.217300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7236f5f7-744d-466e-bd3b-7afff071ddcf tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:02.494658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7236f5f7-744d-466e-bd3b-7afff071ddcf tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:02.503652 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7236f5f7-744d-466e-bd3b-7afff071ddcf tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1320 microversion: 2.1 time: 0.321718 Sep 06 10:55:02.504212 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 574/1164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:02 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1320 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:02.517283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.89"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:02.712990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:02.719236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:02.719819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:02.720513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:02.721532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:02.722012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:02.722446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:02.895743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=32 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:02.945338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "refresh_cache-0f954794-a097-41c8-833d-3ae1320b54d9" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 10:55:02.946345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquired lock "refresh_cache-0f954794-a097-41c8-833d-3ae1320b54d9" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 10:55:03.672376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Building network info cache for instance {{(pid=140875) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 06 10:55:05.199940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Updating instance_info_cache with network_info: [{"id": "3a38233d-1716-4cd1-b63c-ed57733b91ed", "address": "fa:16:3e:4e:4a:2b", "network": {"id": "d007355a-8137-418e-b0f5-eedcd060d4ec", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-192930602-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa352b4d4810484688d325ca4bb25193", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3a38233d-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140875) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 06 10:55:05.263571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Releasing lock "refresh_cache-0f954794-a097-41c8-833d-3ae1320b54d9" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 10:55:05.265237 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2a5548ab-8151-44e1-a471-ecf562b851a1 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "POST /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9/action" status: 202 len: 0 microversion: 2.1 time: 2.759885 Sep 06 10:55:05.269569 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 575/1165] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:55:02 2022] POST /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9/action => generated 0 bytes in 2765 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 06 10:55:05.274904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-31bd1cdc-12a0-4256-84d1-0f4361cb8ccf tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:05.276981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-31bd1cdc-12a0-4256-84d1-0f4361cb8ccf tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:05.283402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bd1cdc-12a0-4256-84d1-0f4361cb8ccf tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:05.283979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bd1cdc-12a0-4256-84d1-0f4361cb8ccf tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:05.284516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bd1cdc-12a0-4256-84d1-0f4361cb8ccf tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:05.285478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bd1cdc-12a0-4256-84d1-0f4361cb8ccf tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:05.285942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bd1cdc-12a0-4256-84d1-0f4361cb8ccf tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:05.286575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bd1cdc-12a0-4256-84d1-0f4361cb8ccf tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:05.293839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=6,nova_cell1:RELEASE=3,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:05.476500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-31bd1cdc-12a0-4256-84d1-0f4361cb8ccf tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:05.490381 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-31bd1cdc-12a0-4256-84d1-0f4361cb8ccf tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1466 microversion: 2.1 time: 0.219344 Sep 06 10:55:05.490983 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 576/1166] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:05 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1466 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:05.498075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-7e27f3d4-f0af-4d8e-8943-d21cca709a87 req-1ac169bb-c14d-4a1b-af60-e78215d77de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e56ea2-b73c-4a32-b0aa-1d3d76064bc7", "name": "network-vif-plugged", "status": "completed", "tag": "6d345f27-53e4-4248-b1d5-8bf046827b4d"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:05.511166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7e27f3d4-f0af-4d8e-8943-d21cca709a87 req-1ac169bb-c14d-4a1b-af60-e78215d77de8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:05.511660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7e27f3d4-f0af-4d8e-8943-d21cca709a87 req-1ac169bb-c14d-4a1b-af60-e78215d77de8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:05.512092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7e27f3d4-f0af-4d8e-8943-d21cca709a87 req-1ac169bb-c14d-4a1b-af60-e78215d77de8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:05.536868 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7e27f3d4-f0af-4d8e-8943-d21cca709a87 req-1ac169bb-c14d-4a1b-af60-e78215d77de8 service nova] Creating event network-vif-plugged:6d345f27-53e4-4248-b1d5-8bf046827b4d for instance 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 on nch1-master-1 Sep 06 10:55:05.544226 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-7e27f3d4-f0af-4d8e-8943-d21cca709a87 req-1ac169bb-c14d-4a1b-af60-e78215d77de8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050170 Sep 06 10:55:05.544999 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 577/1167] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:05.551886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0bc7c345-8b02-41f9-95e8-870c10e1a4a9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:05.552968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0bc7c345-8b02-41f9-95e8-870c10e1a4a9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:05.560700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bc7c345-8b02-41f9-95e8-870c10e1a4a9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:05.561514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bc7c345-8b02-41f9-95e8-870c10e1a4a9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:05.562184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bc7c345-8b02-41f9-95e8-870c10e1a4a9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:05.563186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bc7c345-8b02-41f9-95e8-870c10e1a4a9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:05.563859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bc7c345-8b02-41f9-95e8-870c10e1a4a9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:05.565412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bc7c345-8b02-41f9-95e8-870c10e1a4a9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:05.656473 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-41338e4d-2b6a-4120-99db-4e90305130d6 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828/action" status: 202 len: 0 microversion: 2.25 time: 6.400262 Sep 06 10:55:05.657389 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 591/1168] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 10:54:59 2022] POST /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828/action => generated 0 bytes in 6402 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:55:05.670355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-05db0982-2a7a-4a36-bed8-6acd2bcdeace tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:05.671097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-05db0982-2a7a-4a36-bed8-6acd2bcdeace tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:05.680323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05db0982-2a7a-4a36-bed8-6acd2bcdeace tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:05.682552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05db0982-2a7a-4a36-bed8-6acd2bcdeace tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:05.682552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05db0982-2a7a-4a36-bed8-6acd2bcdeace tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:05.682552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05db0982-2a7a-4a36-bed8-6acd2bcdeace tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:05.682974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05db0982-2a7a-4a36-bed8-6acd2bcdeace tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:05.683879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05db0982-2a7a-4a36-bed8-6acd2bcdeace tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:05.883622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0bc7c345-8b02-41f9-95e8-870c10e1a4a9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:05.894375 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0bc7c345-8b02-41f9-95e8-870c10e1a4a9 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.346685 Sep 06 10:55:05.903351 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 578/1169] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:05 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:05.903351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-872e9eff-f519-457d-92bd-84fb2488b95f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:05.904394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-872e9eff-f519-457d-92bd-84fb2488b95f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:05.913935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-05db0982-2a7a-4a36-bed8-6acd2bcdeace tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:05.923487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-872e9eff-f519-457d-92bd-84fb2488b95f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:05.923487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-872e9eff-f519-457d-92bd-84fb2488b95f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:05.923487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-872e9eff-f519-457d-92bd-84fb2488b95f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:05.923487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-872e9eff-f519-457d-92bd-84fb2488b95f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:05.923853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-872e9eff-f519-457d-92bd-84fb2488b95f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:05.923853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-872e9eff-f519-457d-92bd-84fb2488b95f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:05.931086 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-05db0982-2a7a-4a36-bed8-6acd2bcdeace tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.265543 Sep 06 10:55:05.937152 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 592/1170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:05 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:05.942069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-c315dea4-b062-4b63-9fa2-0faba16acab7 req-aeb3dff3-011c-4e97-989c-2befe23910c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f954794-a097-41c8-833d-3ae1320b54d9", "tag": "3a38233d-1716-4cd1-b63c-ed57733b91ed"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:05.958612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c315dea4-b062-4b63-9fa2-0faba16acab7 req-aeb3dff3-011c-4e97-989c-2befe23910c0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:05.959200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c315dea4-b062-4b63-9fa2-0faba16acab7 req-aeb3dff3-011c-4e97-989c-2befe23910c0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:05.959721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c315dea4-b062-4b63-9fa2-0faba16acab7 req-aeb3dff3-011c-4e97-989c-2befe23910c0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:05.972967 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-c315dea4-b062-4b63-9fa2-0faba16acab7 req-aeb3dff3-011c-4e97-989c-2befe23910c0 service nova] Creating event network-changed:3a38233d-1716-4cd1-b63c-ed57733b91ed for instance 0f954794-a097-41c8-833d-3ae1320b54d9 on nch2-master-1 Sep 06 10:55:05.979841 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-c315dea4-b062-4b63-9fa2-0faba16acab7 req-aeb3dff3-011c-4e97-989c-2befe23910c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041245 Sep 06 10:55:05.980455 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 593/1171] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:05.986446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3c4ae6e7-2f58-477b-8c05-0a2e92e9a8b4 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:05.987281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3c4ae6e7-2f58-477b-8c05-0a2e92e9a8b4 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:05.994184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c4ae6e7-2f58-477b-8c05-0a2e92e9a8b4 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:05.994690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c4ae6e7-2f58-477b-8c05-0a2e92e9a8b4 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:05.995225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c4ae6e7-2f58-477b-8c05-0a2e92e9a8b4 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:06.000821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c4ae6e7-2f58-477b-8c05-0a2e92e9a8b4 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:06.000821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c4ae6e7-2f58-477b-8c05-0a2e92e9a8b4 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:06.000821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c4ae6e7-2f58-477b-8c05-0a2e92e9a8b4 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:06.026645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3c4ae6e7-2f58-477b-8c05-0a2e92e9a8b4 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:55:06.071000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-872e9eff-f519-457d-92bd-84fb2488b95f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:06.080061 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-872e9eff-f519-457d-92bd-84fb2488b95f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1320 microversion: 2.1 time: 0.183926 Sep 06 10:55:06.080631 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 579/1172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:05 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:06.085203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca12b610-496c-4be2-a540-5e0bec084dd3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:06.085810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca12b610-496c-4be2-a540-5e0bec084dd3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:06.093298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca12b610-496c-4be2-a540-5e0bec084dd3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:06.093791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca12b610-496c-4be2-a540-5e0bec084dd3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:06.094238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca12b610-496c-4be2-a540-5e0bec084dd3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:06.094936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca12b610-496c-4be2-a540-5e0bec084dd3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:06.095439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca12b610-496c-4be2-a540-5e0bec084dd3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:06.095959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca12b610-496c-4be2-a540-5e0bec084dd3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:06.228995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ca12b610-496c-4be2-a540-5e0bec084dd3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:06.238126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ca12b610-496c-4be2-a540-5e0bec084dd3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:06.239764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ca12b610-496c-4be2-a540-5e0bec084dd3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:06.240948 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ca12b610-496c-4be2-a540-5e0bec084dd3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.159366 Sep 06 10:55:06.241505 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 580/1173] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:06 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:06.321991 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3c4ae6e7-2f58-477b-8c05-0a2e92e9a8b4 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 204 len: 0 microversion: 2.1 time: 0.339795 Sep 06 10:55:06.322578 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 594/1174] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:55:05 2022] DELETE /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:55:06.332682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.89"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:06.335336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:06.341354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:06.341846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:06.342290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:06.342991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:06.343500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:06.343935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:06.369014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "refresh_cache-b7dd9374-605a-4210-9271-9442a435c17c" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 10:55:06.369425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquired lock "refresh_cache-b7dd9374-605a-4210-9271-9442a435c17c" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 10:55:06.520963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f7e93fe-2efd-4a3f-8ac1-9f3970f6a795 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:06.521621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7f7e93fe-2efd-4a3f-8ac1-9f3970f6a795 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:06.527944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f7e93fe-2efd-4a3f-8ac1-9f3970f6a795 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:06.528460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f7e93fe-2efd-4a3f-8ac1-9f3970f6a795 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:06.528900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f7e93fe-2efd-4a3f-8ac1-9f3970f6a795 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:06.529604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f7e93fe-2efd-4a3f-8ac1-9f3970f6a795 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:06.530061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f7e93fe-2efd-4a3f-8ac1-9f3970f6a795 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:06.530565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f7e93fe-2efd-4a3f-8ac1-9f3970f6a795 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:06.613834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f7e93fe-2efd-4a3f-8ac1-9f3970f6a795 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:06.622783 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7f7e93fe-2efd-4a3f-8ac1-9f3970f6a795 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1424 microversion: 2.1 time: 0.106181 Sep 06 10:55:06.623388 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 595/1175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:06 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:06.918347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5515a358-4782-4642-9753-01b35e7a0126 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:06.918967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5515a358-4782-4642-9753-01b35e7a0126 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:06.925445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5515a358-4782-4642-9753-01b35e7a0126 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:06.925956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5515a358-4782-4642-9753-01b35e7a0126 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:06.926384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5515a358-4782-4642-9753-01b35e7a0126 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:06.927125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5515a358-4782-4642-9753-01b35e7a0126 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:06.927590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5515a358-4782-4642-9753-01b35e7a0126 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:06.928025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5515a358-4782-4642-9753-01b35e7a0126 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:07.092257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5515a358-4782-4642-9753-01b35e7a0126 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:07.100483 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5515a358-4782-4642-9753-01b35e7a0126 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.186453 Sep 06 10:55:07.101075 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 596/1176] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:06 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:07.106438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ff55e504-b846-4484-8134-66d7da52e0c7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:07.107062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ff55e504-b846-4484-8134-66d7da52e0c7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:07.117107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff55e504-b846-4484-8134-66d7da52e0c7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:07.117107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff55e504-b846-4484-8134-66d7da52e0c7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:07.117107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff55e504-b846-4484-8134-66d7da52e0c7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:07.117107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff55e504-b846-4484-8134-66d7da52e0c7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:07.118179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff55e504-b846-4484-8134-66d7da52e0c7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:07.118179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff55e504-b846-4484-8134-66d7da52e0c7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:07.407382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ff55e504-b846-4484-8134-66d7da52e0c7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:07.419535 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ff55e504-b846-4484-8134-66d7da52e0c7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.316531 Sep 06 10:55:07.435151 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 597/1177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:07 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:07.435151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f43c2e54-dca2-4ad2-bb11-6cc836483ddd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:07.435151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f43c2e54-dca2-4ad2-bb11-6cc836483ddd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:07.435151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f43c2e54-dca2-4ad2-bb11-6cc836483ddd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:07.435637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f43c2e54-dca2-4ad2-bb11-6cc836483ddd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:07.435637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f43c2e54-dca2-4ad2-bb11-6cc836483ddd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:07.435637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f43c2e54-dca2-4ad2-bb11-6cc836483ddd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:07.436733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f43c2e54-dca2-4ad2-bb11-6cc836483ddd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:07.436733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f43c2e54-dca2-4ad2-bb11-6cc836483ddd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:07.659371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f43c2e54-dca2-4ad2-bb11-6cc836483ddd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:07.663957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:07.668624 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f43c2e54-dca2-4ad2-bb11-6cc836483ddd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1320 microversion: 2.1 time: 0.246999 Sep 06 10:55:07.669858 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 598/1178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:07 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1320 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:07.683213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aaf331d6-209b-4ba7-aaa5-4d593fe614e3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:07.683941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aaf331d6-209b-4ba7-aaa5-4d593fe614e3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:07.690213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aaf331d6-209b-4ba7-aaa5-4d593fe614e3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:07.692462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aaf331d6-209b-4ba7-aaa5-4d593fe614e3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:07.692462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aaf331d6-209b-4ba7-aaa5-4d593fe614e3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:07.692462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aaf331d6-209b-4ba7-aaa5-4d593fe614e3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:07.692462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aaf331d6-209b-4ba7-aaa5-4d593fe614e3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:07.692996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aaf331d6-209b-4ba7-aaa5-4d593fe614e3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:07.847609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Building network info cache for instance {{(pid=140875) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 06 10:55:07.903546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aaf331d6-209b-4ba7-aaa5-4d593fe614e3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:07.913923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aaf331d6-209b-4ba7-aaa5-4d593fe614e3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:07.916223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aaf331d6-209b-4ba7-aaa5-4d593fe614e3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:07.917408 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aaf331d6-209b-4ba7-aaa5-4d593fe614e3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.245867 Sep 06 10:55:07.921453 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 599/1179] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:07 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:07.922909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1632dfec-abba-4cd7-ac93-ac0d13545b69 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:07.923963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1632dfec-abba-4cd7-ac93-ac0d13545b69 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:07.931488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1632dfec-abba-4cd7-ac93-ac0d13545b69 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:07.932272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1632dfec-abba-4cd7-ac93-ac0d13545b69 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:07.932898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1632dfec-abba-4cd7-ac93-ac0d13545b69 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:07.933946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1632dfec-abba-4cd7-ac93-ac0d13545b69 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:07.934591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1632dfec-abba-4cd7-ac93-ac0d13545b69 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:07.935397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1632dfec-abba-4cd7-ac93-ac0d13545b69 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:08.028040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1632dfec-abba-4cd7-ac93-ac0d13545b69 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:08.036039 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1632dfec-abba-4cd7-ac93-ac0d13545b69 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1295 microversion: 2.1 time: 0.116663 Sep 06 10:55:08.036953 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 600/1180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:07 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1295 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:08.041461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-2f224ead-4ba9-4b86-ace1-b5eba6b888e9 req-506567bf-3371-4f33-bd22-6be02c7616e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c583ed-d9a7-4efc-aee6-d9aba4141e61", "name": "network-vif-plugged", "status": "completed", "tag": "bbeeb8f4-352d-4ce1-98d3-a6ec1bdc0267"}, {"server_uuid": "2127bce6-afc2-4bc3-87b3-882572de2144", "name": "network-vif-plugged", "status": "completed", "tag": "23f8c404-c5d8-41db-bbca-1bd890f56145"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:08.057614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2f224ead-4ba9-4b86-ace1-b5eba6b888e9 req-506567bf-3371-4f33-bd22-6be02c7616e7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:08.058106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2f224ead-4ba9-4b86-ace1-b5eba6b888e9 req-506567bf-3371-4f33-bd22-6be02c7616e7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:08.063945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2f224ead-4ba9-4b86-ace1-b5eba6b888e9 req-506567bf-3371-4f33-bd22-6be02c7616e7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:08.083715 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-2f224ead-4ba9-4b86-ace1-b5eba6b888e9 req-506567bf-3371-4f33-bd22-6be02c7616e7 service nova] Creating event network-vif-plugged:bbeeb8f4-352d-4ce1-98d3-a6ec1bdc0267 for instance 94c583ed-d9a7-4efc-aee6-d9aba4141e61 on nch1-master-1 Sep 06 10:55:08.084288 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-2f224ead-4ba9-4b86-ace1-b5eba6b888e9 req-506567bf-3371-4f33-bd22-6be02c7616e7 service nova] Creating event network-vif-plugged:23f8c404-c5d8-41db-bbca-1bd890f56145 for instance 2127bce6-afc2-4bc3-87b3-882572de2144 on nch2-master-1 Sep 06 10:55:08.095792 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-2f224ead-4ba9-4b86-ace1-b5eba6b888e9 req-506567bf-3371-4f33-bd22-6be02c7616e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057376 Sep 06 10:55:08.098089 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 601/1181] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:08.106435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-14561001-15a4-4f04-af7f-5b91218a2d71 req-9e299543-1b04-41c6-a593-70cd01d11b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d17de720-55d8-4b9a-8f16-386ab9e75e14", "name": "network-vif-deleted", "tag": "3c0410cd-8d2b-4ec6-9bdc-443bf69e1791"}, {"name": "network-changed", "server_uuid": "b7dd9374-605a-4210-9271-9442a435c17c", "tag": "c3240674-1db4-4057-af2a-0241d0fdc27b"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:08.126808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-14561001-15a4-4f04-af7f-5b91218a2d71 req-9e299543-1b04-41c6-a593-70cd01d11b81 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:08.127322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-14561001-15a4-4f04-af7f-5b91218a2d71 req-9e299543-1b04-41c6-a593-70cd01d11b81 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:08.127772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-14561001-15a4-4f04-af7f-5b91218a2d71 req-9e299543-1b04-41c6-a593-70cd01d11b81 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:08.148829 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-14561001-15a4-4f04-af7f-5b91218a2d71 req-9e299543-1b04-41c6-a593-70cd01d11b81 service nova] Creating event network-vif-deleted:3c0410cd-8d2b-4ec6-9bdc-443bf69e1791 for instance d17de720-55d8-4b9a-8f16-386ab9e75e14 on nch2-master-1 Sep 06 10:55:08.149714 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-14561001-15a4-4f04-af7f-5b91218a2d71 req-9e299543-1b04-41c6-a593-70cd01d11b81 service nova] Creating event network-changed:c3240674-1db4-4057-af2a-0241d0fdc27b for instance b7dd9374-605a-4210-9271-9442a435c17c on nch1-master-1 Sep 06 10:55:08.158420 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-14561001-15a4-4f04-af7f-5b91218a2d71 req-9e299543-1b04-41c6-a593-70cd01d11b81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059005 Sep 06 10:55:08.159498 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 602/1182] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:08.165951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4fbe0951-9bb0-4088-b558-7e55019d4032 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:08.166876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4fbe0951-9bb0-4088-b558-7e55019d4032 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:08.173511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fbe0951-9bb0-4088-b558-7e55019d4032 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:08.178398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fbe0951-9bb0-4088-b558-7e55019d4032 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:08.179043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fbe0951-9bb0-4088-b558-7e55019d4032 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:08.180528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fbe0951-9bb0-4088-b558-7e55019d4032 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:08.181111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fbe0951-9bb0-4088-b558-7e55019d4032 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:08.181655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fbe0951-9bb0-4088-b558-7e55019d4032 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:08.456137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4fbe0951-9bb0-4088-b558-7e55019d4032 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:08.467658 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4fbe0951-9bb0-4088-b558-7e55019d4032 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.306439 Sep 06 10:55:08.468617 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 603/1183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:08 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:08.476108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-75c1ac2a-582d-463d-bc33-1c299e1654ea tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:08.482558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-75c1ac2a-582d-463d-bc33-1c299e1654ea tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:08.485541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75c1ac2a-582d-463d-bc33-1c299e1654ea tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:08.486720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75c1ac2a-582d-463d-bc33-1c299e1654ea tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:08.487202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75c1ac2a-582d-463d-bc33-1c299e1654ea tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:08.488555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75c1ac2a-582d-463d-bc33-1c299e1654ea tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:08.488686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75c1ac2a-582d-463d-bc33-1c299e1654ea tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:08.489115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75c1ac2a-582d-463d-bc33-1c299e1654ea tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:08.709247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Updating instance_info_cache with network_info: [{"id": "c3240674-1db4-4057-af2a-0241d0fdc27b", "address": "fa:16:3e:5f:7f:78", "network": {"id": "d007355a-8137-418e-b0f5-eedcd060d4ec", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-192930602-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa352b4d4810484688d325ca4bb25193", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc3240674-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140875) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 06 10:55:08.714838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-75c1ac2a-582d-463d-bc33-1c299e1654ea tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:08.729739 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-75c1ac2a-582d-463d-bc33-1c299e1654ea tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.259966 Sep 06 10:55:08.730319 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 604/1184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:08 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:08.734940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-68aa3dc9-936a-42f7-833b-d1c3df462cff tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:08.735762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-68aa3dc9-936a-42f7-833b-d1c3df462cff tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:08.747786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68aa3dc9-936a-42f7-833b-d1c3df462cff tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:08.747786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68aa3dc9-936a-42f7-833b-d1c3df462cff tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:08.747786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68aa3dc9-936a-42f7-833b-d1c3df462cff tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:08.747786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68aa3dc9-936a-42f7-833b-d1c3df462cff tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:08.748155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68aa3dc9-936a-42f7-833b-d1c3df462cff tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:08.748155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68aa3dc9-936a-42f7-833b-d1c3df462cff tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:08.836866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Releasing lock "refresh_cache-b7dd9374-605a-4210-9271-9442a435c17c" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 10:55:08.838095 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3c95c168-a2bf-4102-b308-a8ecc1804f1b tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "POST /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c/action" status: 202 len: 0 microversion: 2.1 time: 2.509374 Sep 06 10:55:08.838912 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 581/1185] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:55:06 2022] POST /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c/action => generated 0 bytes in 2511 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 06 10:55:08.848875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e48fcafb-1aaa-40bd-bcd2-d8878b31aa19 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '.version_select at 0x7f90f86003a0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:09.229517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:09.527759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-68aa3dc9-936a-42f7-833b-d1c3df462cff tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:09.536513 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-68aa3dc9-936a-42f7-833b-d1c3df462cff tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1320 microversion: 2.1 time: 0.804973 Sep 06 10:55:09.537275 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 605/1186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:08 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1320 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:09.545737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-424fe469-eea6-4d1f-b87d-c2d05a58304a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:09.546603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-424fe469-eea6-4d1f-b87d-c2d05a58304a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:09.554481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-424fe469-eea6-4d1f-b87d-c2d05a58304a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:09.556258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-424fe469-eea6-4d1f-b87d-c2d05a58304a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:09.556258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-424fe469-eea6-4d1f-b87d-c2d05a58304a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:09.556986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-424fe469-eea6-4d1f-b87d-c2d05a58304a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:09.557548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-424fe469-eea6-4d1f-b87d-c2d05a58304a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:09.558080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-424fe469-eea6-4d1f-b87d-c2d05a58304a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:09.649688 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e48fcafb-1aaa-40bd-bcd2-d8878b31aa19 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/87be07b2-af9f-4561-9d80-267814f5bbbc" status: 200 len: 184 microversion: 2.1 time: 0.804785 Sep 06 10:55:09.657529 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 582/1187] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 10:55:08 2022] GET /compute/v2.1/os-floating-ips/87be07b2-af9f-4561-9d80-267814f5bbbc => generated 184 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:09.657529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:09.657529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:09.663186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:09.663700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:09.664664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:09.665638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:09.665869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:09.666298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:09.697800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:09.698279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:09.698721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:09.699202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lazy-loading 'fault' on Instance uuid d17de720-55d8-4b9a-8f16-386ab9e75e14 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:09.728430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-424fe469-eea6-4d1f-b87d-c2d05a58304a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:09.737369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-424fe469-eea6-4d1f-b87d-c2d05a58304a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:09.738822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-424fe469-eea6-4d1f-b87d-c2d05a58304a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:09.740091 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-424fe469-eea6-4d1f-b87d-c2d05a58304a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.201606 Sep 06 10:55:09.740663 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 606/1188] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:09 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:09.752107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eab01a72-7b28-4363-b65b-51ccf242367c tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:09.752107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eab01a72-7b28-4363-b65b-51ccf242367c tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:09.752518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:09.761658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eab01a72-7b28-4363-b65b-51ccf242367c tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:09.761658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eab01a72-7b28-4363-b65b-51ccf242367c tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:09.761658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eab01a72-7b28-4363-b65b-51ccf242367c tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:09.761658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eab01a72-7b28-4363-b65b-51ccf242367c tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:09.763222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eab01a72-7b28-4363-b65b-51ccf242367c tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:09.763222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eab01a72-7b28-4363-b65b-51ccf242367c tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:09.763414 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c3d715c6-1630-4204-99a3-65e0463312af tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 200 len: 1309 microversion: 2.1 time: 0.109060 Sep 06 10:55:09.763414 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 583/1189] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:09 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:09.766764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1b1889d6-348d-47c1-99c9-65e6b385790d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:09.768103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1b1889d6-348d-47c1-99c9-65e6b385790d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:09.774496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b1889d6-348d-47c1-99c9-65e6b385790d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:09.775291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b1889d6-348d-47c1-99c9-65e6b385790d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:09.775825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b1889d6-348d-47c1-99c9-65e6b385790d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:09.776860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b1889d6-348d-47c1-99c9-65e6b385790d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:09.777785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b1889d6-348d-47c1-99c9-65e6b385790d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:09.778471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b1889d6-348d-47c1-99c9-65e6b385790d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:10.019220 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eab01a72-7b28-4363-b65b-51ccf242367c tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1860 microversion: 2.1 time: 0.277231 Sep 06 10:55:10.019816 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 607/1190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:09 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1860 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:10.019965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1b1889d6-348d-47c1-99c9-65e6b385790d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:10.025337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Action: 'action', calling method: .version_select at 0x7f90fa2c5700>, body: {"removeFloatingIp": {"address": "172.35.4.89"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:10.035913 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1b1889d6-348d-47c1-99c9-65e6b385790d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1472 microversion: 2.1 time: 0.273739 Sep 06 10:55:10.039982 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 584/1191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:09 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:10.045931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7f463380-57a4-45be-9359-2a24b1000732 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:10.046541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7f463380-57a4-45be-9359-2a24b1000732 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:10.053005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f463380-57a4-45be-9359-2a24b1000732 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:10.057848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f463380-57a4-45be-9359-2a24b1000732 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:10.057848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f463380-57a4-45be-9359-2a24b1000732 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:10.057848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f463380-57a4-45be-9359-2a24b1000732 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:10.057848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f463380-57a4-45be-9359-2a24b1000732 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:10.058233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f463380-57a4-45be-9359-2a24b1000732 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:10.298245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:10.301448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:10.305494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:10.306057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:10.306508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:10.307249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:10.307710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:10.308335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:10.310974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7f463380-57a4-45be-9359-2a24b1000732 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:10.319242 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7f463380-57a4-45be-9359-2a24b1000732 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.277593 Sep 06 10:55:10.319805 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 585/1192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:10 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:10.324890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6763fb77-dcc4-40cd-a74a-8c4900ec91fb req-8e38d5fb-dc9a-4946-a5c9-f66bab5a57ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f954794-a097-41c8-833d-3ae1320b54d9", "name": "network-vif-deleted", "tag": "3a38233d-1716-4cd1-b63c-ed57733b91ed"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:10.334099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6763fb77-dcc4-40cd-a74a-8c4900ec91fb req-8e38d5fb-dc9a-4946-a5c9-f66bab5a57ef service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:10.334575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6763fb77-dcc4-40cd-a74a-8c4900ec91fb req-8e38d5fb-dc9a-4946-a5c9-f66bab5a57ef service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:10.335210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6763fb77-dcc4-40cd-a74a-8c4900ec91fb req-8e38d5fb-dc9a-4946-a5c9-f66bab5a57ef service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:10.346755 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6763fb77-dcc4-40cd-a74a-8c4900ec91fb req-8e38d5fb-dc9a-4946-a5c9-f66bab5a57ef service nova] Creating event network-vif-deleted:3a38233d-1716-4cd1-b63c-ed57733b91ed for instance 0f954794-a097-41c8-833d-3ae1320b54d9 on nch2-master-1 Sep 06 10:55:10.352339 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6763fb77-dcc4-40cd-a74a-8c4900ec91fb req-8e38d5fb-dc9a-4946-a5c9-f66bab5a57ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030266 Sep 06 10:55:10.352950 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 586/1193] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:10.357822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1ccede63-9076-4733-9a16-60e63c4ba86f tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:10.360341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1ccede63-9076-4733-9a16-60e63c4ba86f tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:10.366249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1ccede63-9076-4733-9a16-60e63c4ba86f tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:10.366729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1ccede63-9076-4733-9a16-60e63c4ba86f tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:10.367785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1ccede63-9076-4733-9a16-60e63c4ba86f tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:10.368487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1ccede63-9076-4733-9a16-60e63c4ba86f tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:10.368940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1ccede63-9076-4733-9a16-60e63c4ba86f tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:10.369367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1ccede63-9076-4733-9a16-60e63c4ba86f tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:10.396049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-1ccede63-9076-4733-9a16-60e63c4ba86f tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lazy-loading 'flavor' on Instance uuid 21485351-3c21-4970-9d57-310eff94abb2 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:10.407887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1ccede63-9076-4733-9a16-60e63c4ba86f tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Going to try to live migrate instance to nch1-master-1 {{(pid=140875) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 06 10:55:10.587053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "refresh_cache-b7dd9374-605a-4210-9271-9442a435c17c" {{(pid=140876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 10:55:10.587693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquired lock "refresh_cache-b7dd9374-605a-4210-9271-9442a435c17c" {{(pid=140876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 10:55:11.765541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Building network info cache for instance {{(pid=140876) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 06 10:55:12.397110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Updating instance_info_cache with network_info: [{"id": "c3240674-1db4-4057-af2a-0241d0fdc27b", "address": "fa:16:3e:5f:7f:78", "network": {"id": "d007355a-8137-418e-b0f5-eedcd060d4ec", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-192930602-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa352b4d4810484688d325ca4bb25193", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc3240674-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140876) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 06 10:55:12.509590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Releasing lock "refresh_cache-b7dd9374-605a-4210-9271-9442a435c17c" {{(pid=140876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 10:55:12.510577 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d09b84cf-fcaa-468a-9414-0a5fef36f6e9 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "POST /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c/action" status: 202 len: 0 microversion: 2.1 time: 2.489090 Sep 06 10:55:12.511431 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 608/1194] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:55:10 2022] POST /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c/action => generated 0 bytes in 2490 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 06 10:55:12.516193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0d9a1fc1-e3af-4405-8220-3c09db5f81cb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:12.516885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0d9a1fc1-e3af-4405-8220-3c09db5f81cb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:12.523003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9a1fc1-e3af-4405-8220-3c09db5f81cb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:12.525896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9a1fc1-e3af-4405-8220-3c09db5f81cb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:12.525896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9a1fc1-e3af-4405-8220-3c09db5f81cb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:12.525896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9a1fc1-e3af-4405-8220-3c09db5f81cb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:12.525896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9a1fc1-e3af-4405-8220-3c09db5f81cb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:12.526280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9a1fc1-e3af-4405-8220-3c09db5f81cb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:12.680166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0d9a1fc1-e3af-4405-8220-3c09db5f81cb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:12.689009 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0d9a1fc1-e3af-4405-8220-3c09db5f81cb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1511 microversion: 2.1 time: 0.176444 Sep 06 10:55:12.691499 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 609/1195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:12 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:12.700626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b48ba1cd-377a-4b12-98b0-89da136df83c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:12.711899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b48ba1cd-377a-4b12-98b0-89da136df83c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:12.719476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b48ba1cd-377a-4b12-98b0-89da136df83c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:12.720270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b48ba1cd-377a-4b12-98b0-89da136df83c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:12.720944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b48ba1cd-377a-4b12-98b0-89da136df83c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:12.721870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b48ba1cd-377a-4b12-98b0-89da136df83c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:12.722497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b48ba1cd-377a-4b12-98b0-89da136df83c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:12.722934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b48ba1cd-377a-4b12-98b0-89da136df83c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:12.882552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b48ba1cd-377a-4b12-98b0-89da136df83c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:12.893619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b48ba1cd-377a-4b12-98b0-89da136df83c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:12.895528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b48ba1cd-377a-4b12-98b0-89da136df83c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:12.901983 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b48ba1cd-377a-4b12-98b0-89da136df83c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.205135 Sep 06 10:55:12.901983 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 610/1196] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:12 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:12.903884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e8e36a51-84d1-4229-b0ff-b54380175021 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:12.904837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e8e36a51-84d1-4229-b0ff-b54380175021 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: d17de720-55d8-4b9a-8f16-386ab9e75e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:12.911040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8e36a51-84d1-4229-b0ff-b54380175021 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:12.911757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8e36a51-84d1-4229-b0ff-b54380175021 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:12.912414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8e36a51-84d1-4229-b0ff-b54380175021 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:12.913325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8e36a51-84d1-4229-b0ff-b54380175021 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:12.914756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8e36a51-84d1-4229-b0ff-b54380175021 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:12.915370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8e36a51-84d1-4229-b0ff-b54380175021 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-e8e36a51-84d1-4229-b0ff-b54380175021 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] HTTP exception thrown: Instance d17de720-55d8-4b9a-8f16-386ab9e75e14 could not be found. Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e8e36a51-84d1-4229-b0ff-b54380175021 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Request method failure captured: Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 HTTP/1.1 Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFybDXL1pY4LpUB4USQKXuKTAGXxUGroyQ9FRc5PfBtcGTN8PX0b2taWdO7cr-L9TWemAXKZZXJxevsfmHMdIP6ZBa3L39WSnbG0BGKkHQuDmq0uNaE0_cFnCoD1igtw6ljmtSGjkIlgMiIa4PCDCDB1BdClyM-0CjHLEqy_Ez4Wwp1g Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3f02d8ddd39f4d8b93a44ee6295dc7f8 Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-LiveMigrationNegativeTest-1852265708 Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:55:12.935664 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:55:12.937598 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f02d8ddd39f4d8b93a44ee6295dc7f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f02d8ddd39f4d8b93a44ee6295dc7f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f02d8ddd39f4d8b93a44ee6295dc7f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f02d8ddd39f4d8b93a44ee6295dc7f8"}]}] Sep 06 10:55:12.937598 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-LiveMigrationNegativeTest-1852265708 Sep 06 10:55:12.937598 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3f02d8ddd39f4d8b93a44ee6295dc7f8 Sep 06 10:55:12.937598 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1852265708 Sep 06 10:55:12.937598 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-LiveMigrationNegativeTest-1852265708-project Sep 06 10:55:12.937598 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:55:12.937598 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:55:12.937598 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 8affa67bb57f451b94d1eded04b1782a Sep 06 10:55:12.937598 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-LiveMigrationNegativeTest-1852265708-project Sep 06 10:55:12.937598 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:55:12.937598 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance d17de720-55d8-4b9a-8f16-386ab9e75e14 could not be found. Sep 06 10:55:12.937598 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'd17de720-55d8-4b9a-8f16-386ab9e75e14'} Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d17de720-55d8-4b9a-8f16-386ab9e75e14 could not be found. Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:12.938551 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d17de720-55d8-4b9a-8f16-386ab9e75e14 could not be found. Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d17de720-55d8-4b9a-8f16-386ab9e75e14 could not be found. Sep 06 10:55:12.940912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:12.943816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e8e36a51-84d1-4229-b0ff-b54380175021 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Returning 404 to user: Instance d17de720-55d8-4b9a-8f16-386ab9e75e14 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:12.943816 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e8e36a51-84d1-4229-b0ff-b54380175021 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14" status: 404 len: 111 microversion: 2.1 time: 0.034279 Sep 06 10:55:12.943816 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 611/1197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:12 2022] GET /compute/v2.1/servers/d17de720-55d8-4b9a-8f16-386ab9e75e14 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:12.943816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f9e100bd-9bd9-4be5-b2fb-32463af6c177 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:12.943816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f9e100bd-9bd9-4be5-b2fb-32463af6c177 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:12.949701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9e100bd-9bd9-4be5-b2fb-32463af6c177 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:12.949866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9e100bd-9bd9-4be5-b2fb-32463af6c177 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:12.950191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9e100bd-9bd9-4be5-b2fb-32463af6c177 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:12.950891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9e100bd-9bd9-4be5-b2fb-32463af6c177 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:12.951391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9e100bd-9bd9-4be5-b2fb-32463af6c177 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:12.951822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9e100bd-9bd9-4be5-b2fb-32463af6c177 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.102916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f9e100bd-9bd9-4be5-b2fb-32463af6c177 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:13.110866 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f9e100bd-9bd9-4be5-b2fb-32463af6c177 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1478 microversion: 2.1 time: 0.171964 Sep 06 10:55:13.111461 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 612/1198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:12 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1478 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:13.116075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-52068a91-4d8b-46d4-9151-0abc13992db8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:13.116714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-52068a91-4d8b-46d4-9151-0abc13992db8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:13.122630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52068a91-4d8b-46d4-9151-0abc13992db8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.123231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52068a91-4d8b-46d4-9151-0abc13992db8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.123602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52068a91-4d8b-46d4-9151-0abc13992db8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.124278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52068a91-4d8b-46d4-9151-0abc13992db8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.124732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52068a91-4d8b-46d4-9151-0abc13992db8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.125446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52068a91-4d8b-46d4-9151-0abc13992db8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.262553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-52068a91-4d8b-46d4-9151-0abc13992db8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:13.270328 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-52068a91-4d8b-46d4-9151-0abc13992db8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.157906 Sep 06 10:55:13.271221 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 613/1199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:13 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:13.275579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-bc8fa4b2-e5c4-4c9d-8199-502efa522172 req-d504a695-aa35-4c5f-96b0-9e6bc8bc61a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7dd9374-605a-4210-9271-9442a435c17c", "tag": "c3240674-1db4-4057-af2a-0241d0fdc27b"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:13.284556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-bc8fa4b2-e5c4-4c9d-8199-502efa522172 req-d504a695-aa35-4c5f-96b0-9e6bc8bc61a7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.285037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-bc8fa4b2-e5c4-4c9d-8199-502efa522172 req-d504a695-aa35-4c5f-96b0-9e6bc8bc61a7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.285473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-bc8fa4b2-e5c4-4c9d-8199-502efa522172 req-d504a695-aa35-4c5f-96b0-9e6bc8bc61a7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.296588 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-bc8fa4b2-e5c4-4c9d-8199-502efa522172 req-d504a695-aa35-4c5f-96b0-9e6bc8bc61a7 service nova] Creating event network-changed:c3240674-1db4-4057-af2a-0241d0fdc27b for instance b7dd9374-605a-4210-9271-9442a435c17c on nch1-master-1 Sep 06 10:55:13.301623 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-bc8fa4b2-e5c4-4c9d-8199-502efa522172 req-d504a695-aa35-4c5f-96b0-9e6bc8bc61a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029196 Sep 06 10:55:13.302225 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 614/1200] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:13.308867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0350afc4-0dfb-40cb-8dcd-5acd3598ef80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:13.309523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0350afc4-0dfb-40cb-8dcd-5acd3598ef80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:13.315943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0350afc4-0dfb-40cb-8dcd-5acd3598ef80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.316422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0350afc4-0dfb-40cb-8dcd-5acd3598ef80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.316862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0350afc4-0dfb-40cb-8dcd-5acd3598ef80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.317569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0350afc4-0dfb-40cb-8dcd-5acd3598ef80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.318027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0350afc4-0dfb-40cb-8dcd-5acd3598ef80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.318649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0350afc4-0dfb-40cb-8dcd-5acd3598ef80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.333066 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-0350afc4-0dfb-40cb-8dcd-5acd3598ef80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] HTTP exception thrown: Instance 0f954794-a097-41c8-833d-3ae1320b54d9 could not be found. Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0350afc4-0dfb-40cb-8dcd-5acd3598ef80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Request method failure captured: Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 HTTP/1.1 Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFybJwBPoDD6TpToX2LfVwlb3pFQBQyhvDfGsXw8HVWS_ENMdZw1fyQvROi67jEDseVD3GqWu4HEzuuaXvWYEn8yK9rBQIBiJZABTIy3OthBEpqf766hp3M1U9juOP2P91wFYQg3yw1TlCQjT0g-MsE0jYMcnyZGv975wsA4RiNJYxjU Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aa352b4d4810484688d325ca4bb25193 Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-324247753 Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:55:13.334916 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:55:13.336612 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa352b4d4810484688d325ca4bb25193"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa352b4d4810484688d325ca4bb25193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa352b4d4810484688d325ca4bb25193"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa352b4d4810484688d325ca4bb25193"}]}] Sep 06 10:55:13.336612 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-324247753 Sep 06 10:55:13.336612 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aa352b4d4810484688d325ca4bb25193 Sep 06 10:55:13.336612 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-324247753 Sep 06 10:55:13.336612 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-FloatingIPsAssociationTestJSON-324247753-project Sep 06 10:55:13.336612 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:55:13.336612 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:55:13.336612 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 24d86f8c8ece4257adc548304465f191 Sep 06 10:55:13.336612 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-324247753-project Sep 06 10:55:13.336612 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:55:13.336612 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 0f954794-a097-41c8-833d-3ae1320b54d9 could not be found. Sep 06 10:55:13.336612 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '0f954794-a097-41c8-833d-3ae1320b54d9'} Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f954794-a097-41c8-833d-3ae1320b54d9 could not be found. Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:13.340896 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f954794-a097-41c8-833d-3ae1320b54d9 could not be found. Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f954794-a097-41c8-833d-3ae1320b54d9 could not be found. Sep 06 10:55:13.342447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:13.346845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0350afc4-0dfb-40cb-8dcd-5acd3598ef80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Returning 404 to user: Instance 0f954794-a097-41c8-833d-3ae1320b54d9 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:13.346845 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0350afc4-0dfb-40cb-8dcd-5acd3598ef80 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 404 len: 111 microversion: 2.1 time: 0.032890 Sep 06 10:55:13.346845 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 615/1201] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:55:13 2022] DELETE /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:13.346845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cef0762b-5bae-4f18-a5ab-9c2b3b102caa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:13.346845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cef0762b-5bae-4f18-a5ab-9c2b3b102caa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:13.349793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cef0762b-5bae-4f18-a5ab-9c2b3b102caa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.350291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cef0762b-5bae-4f18-a5ab-9c2b3b102caa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.350739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cef0762b-5bae-4f18-a5ab-9c2b3b102caa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.352064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cef0762b-5bae-4f18-a5ab-9c2b3b102caa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.352532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cef0762b-5bae-4f18-a5ab-9c2b3b102caa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.352970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cef0762b-5bae-4f18-a5ab-9c2b3b102caa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.402255 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1ccede63-9076-4733-9a16-60e63c4ba86f tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/action" status: 202 len: 0 microversion: 2.1 time: 3.047996 Sep 06 10:55:13.403472 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 587/1202] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:55:10 2022] POST /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/action => generated 0 bytes in 3050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:55:13.408370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b0745a76-7adb-4e5d-b16a-492960540265 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:13.408901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b0745a76-7adb-4e5d-b16a-492960540265 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:13.411295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:13.417030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0745a76-7adb-4e5d-b16a-492960540265 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.417523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0745a76-7adb-4e5d-b16a-492960540265 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.417957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0745a76-7adb-4e5d-b16a-492960540265 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.418832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0745a76-7adb-4e5d-b16a-492960540265 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.419484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0745a76-7adb-4e5d-b16a-492960540265 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.420073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0745a76-7adb-4e5d-b16a-492960540265 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.459331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b0745a76-7adb-4e5d-b16a-492960540265 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:55:13.509482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cef0762b-5bae-4f18-a5ab-9c2b3b102caa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:13.518320 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cef0762b-5bae-4f18-a5ab-9c2b3b102caa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1511 microversion: 2.1 time: 0.180398 Sep 06 10:55:13.519141 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 616/1203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:13 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:13.523936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-93ab74df-2312-4edd-a3cf-b4fc2eb60997 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:13.524825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-93ab74df-2312-4edd-a3cf-b4fc2eb60997 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: 0f954794-a097-41c8-833d-3ae1320b54d9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:13.531357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ab74df-2312-4edd-a3cf-b4fc2eb60997 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.532144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ab74df-2312-4edd-a3cf-b4fc2eb60997 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.532678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ab74df-2312-4edd-a3cf-b4fc2eb60997 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.533442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ab74df-2312-4edd-a3cf-b4fc2eb60997 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.533970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ab74df-2312-4edd-a3cf-b4fc2eb60997 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.534464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ab74df-2312-4edd-a3cf-b4fc2eb60997 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.549316 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-93ab74df-2312-4edd-a3cf-b4fc2eb60997 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] HTTP exception thrown: Instance 0f954794-a097-41c8-833d-3ae1320b54d9 could not be found. Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-93ab74df-2312-4edd-a3cf-b4fc2eb60997 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Request method failure captured: Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 HTTP/1.1 Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFybJwBPoDD6TpToX2LfVwlb3pFQBQyhvDfGsXw8HVWS_ENMdZw1fyQvROi67jEDseVD3GqWu4HEzuuaXvWYEn8yK9rBQIBiJZABTIy3OthBEpqf766hp3M1U9juOP2P91wFYQg3yw1TlCQjT0g-MsE0jYMcnyZGv975wsA4RiNJYxjU Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aa352b4d4810484688d325ca4bb25193 Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-324247753 Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:55:13.550977 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:55:13.554138 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa352b4d4810484688d325ca4bb25193"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa352b4d4810484688d325ca4bb25193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa352b4d4810484688d325ca4bb25193"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa352b4d4810484688d325ca4bb25193"}]}] Sep 06 10:55:13.554138 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-324247753 Sep 06 10:55:13.554138 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aa352b4d4810484688d325ca4bb25193 Sep 06 10:55:13.554138 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-324247753 Sep 06 10:55:13.554138 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-FloatingIPsAssociationTestJSON-324247753-project Sep 06 10:55:13.554138 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:55:13.554138 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:55:13.554138 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 24d86f8c8ece4257adc548304465f191 Sep 06 10:55:13.554138 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-324247753-project Sep 06 10:55:13.554138 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:55:13.554138 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 0f954794-a097-41c8-833d-3ae1320b54d9 could not be found. Sep 06 10:55:13.554138 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '0f954794-a097-41c8-833d-3ae1320b54d9'} Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f954794-a097-41c8-833d-3ae1320b54d9 could not be found. Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:13.555575 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f954794-a097-41c8-833d-3ae1320b54d9 could not be found. Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f954794-a097-41c8-833d-3ae1320b54d9 could not be found. Sep 06 10:55:13.556952 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:13.558209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-93ab74df-2312-4edd-a3cf-b4fc2eb60997 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Returning 404 to user: Instance 0f954794-a097-41c8-833d-3ae1320b54d9 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:13.558209 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-93ab74df-2312-4edd-a3cf-b4fc2eb60997 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9" status: 404 len: 111 microversion: 2.1 time: 0.032078 Sep 06 10:55:13.558209 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 617/1204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:13 2022] GET /compute/v2.1/servers/0f954794-a097-41c8-833d-3ae1320b54d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:13.558544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e68df510-17b3-4682-bf06-5298569acd35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:13.559368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e68df510-17b3-4682-bf06-5298569acd35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:13.566315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e68df510-17b3-4682-bf06-5298569acd35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.566800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e68df510-17b3-4682-bf06-5298569acd35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.567328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e68df510-17b3-4682-bf06-5298569acd35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.568019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e68df510-17b3-4682-bf06-5298569acd35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.568530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e68df510-17b3-4682-bf06-5298569acd35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.569146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e68df510-17b3-4682-bf06-5298569acd35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.711765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e68df510-17b3-4682-bf06-5298569acd35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:13.713928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:13.721133 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e68df510-17b3-4682-bf06-5298569acd35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1719 microversion: 2.1 time: 0.166899 Sep 06 10:55:13.723137 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 618/1205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:13 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:13.728679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ad702b68-4da5-4882-9c41-403f755cb277 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:13.729561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ad702b68-4da5-4882-9c41-403f755cb277 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:13.743230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad702b68-4da5-4882-9c41-403f755cb277 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.746493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad702b68-4da5-4882-9c41-403f755cb277 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.746493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad702b68-4da5-4882-9c41-403f755cb277 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.746756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad702b68-4da5-4882-9c41-403f755cb277 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.747701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad702b68-4da5-4882-9c41-403f755cb277 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.748148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad702b68-4da5-4882-9c41-403f755cb277 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.825046 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b0745a76-7adb-4e5d-b16a-492960540265 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "DELETE /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 204 len: 0 microversion: 2.1 time: 0.419963 Sep 06 10:55:13.825806 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 588/1206] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:55:13 2022] DELETE /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:55:13.834905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cac879be-709f-4087-8841-149938da8efc tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '.version_select at 0x7f90f8544670>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:13.966183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ad702b68-4da5-4882-9c41-403f755cb277 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:13.974064 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ad702b68-4da5-4882-9c41-403f755cb277 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7" status: 200 len: 1512 microversion: 2.1 time: 0.250754 Sep 06 10:55:13.974634 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 619/1207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:13 2022] GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:13.979126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3bbe748a-3e88-489a-b30e-59810d569aea tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:13.981370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3bbe748a-3e88-489a-b30e-59810d569aea tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:13.985709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bbe748a-3e88-489a-b30e-59810d569aea tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.986352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bbe748a-3e88-489a-b30e-59810d569aea tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.986962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bbe748a-3e88-489a-b30e-59810d569aea tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:13.987651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bbe748a-3e88-489a-b30e-59810d569aea tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:13.988110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bbe748a-3e88-489a-b30e-59810d569aea tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:13.988536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bbe748a-3e88-489a-b30e-59810d569aea tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:14.252234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3bbe748a-3e88-489a-b30e-59810d569aea tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:14.260602 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3bbe748a-3e88-489a-b30e-59810d569aea tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1475 microversion: 2.1 time: 0.284798 Sep 06 10:55:14.271088 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 620/1208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:13 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1475 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:14.271088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c5441a37-7937-41da-9bf8-da4fe654722c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:14.271088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c5441a37-7937-41da-9bf8-da4fe654722c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:14.274838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5441a37-7937-41da-9bf8-da4fe654722c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:14.275548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5441a37-7937-41da-9bf8-da4fe654722c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:14.276164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5441a37-7937-41da-9bf8-da4fe654722c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:14.277047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5441a37-7937-41da-9bf8-da4fe654722c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:14.277512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5441a37-7937-41da-9bf8-da4fe654722c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:14.283858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5441a37-7937-41da-9bf8-da4fe654722c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:14.789724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c5441a37-7937-41da-9bf8-da4fe654722c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:14.799852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c5441a37-7937-41da-9bf8-da4fe654722c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:14.801586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c5441a37-7937-41da-9bf8-da4fe654722c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:14.802763 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c5441a37-7937-41da-9bf8-da4fe654722c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.539943 Sep 06 10:55:14.803479 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 621/1209] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:14 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:14.826815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:14.832005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:14.832936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:14.846458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:14.847068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:14.847684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:14.848425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:14.848887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:14.849313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:14.948765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:15.022324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:15.028952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:15.029438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:15.029875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:15.185950 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cac879be-709f-4087-8841-149938da8efc tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/87be07b2-af9f-4561-9d80-267814f5bbbc" status: 202 len: 0 microversion: 2.1 time: 1.358662 Sep 06 10:55:15.187147 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 589/1210] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 10:55:13 2022] DELETE /compute/v2.1/os-floating-ips/87be07b2-af9f-4561-9d80-267814f5bbbc => generated 0 bytes in 1361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:55:15.195973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aa3a5776-19f8-4469-8a38-483b7f496d4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:15.197360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aa3a5776-19f8-4469-8a38-483b7f496d4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:15.220618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa3a5776-19f8-4469-8a38-483b7f496d4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:15.224539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa3a5776-19f8-4469-8a38-483b7f496d4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:15.230392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa3a5776-19f8-4469-8a38-483b7f496d4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:15.237030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa3a5776-19f8-4469-8a38-483b7f496d4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:15.237279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa3a5776-19f8-4469-8a38-483b7f496d4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:15.237848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa3a5776-19f8-4469-8a38-483b7f496d4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:15.253397 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c9d26dcb-46f1-47b0-92b9-3aa4a069501c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.430050 Sep 06 10:55:15.254928 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 622/1211] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Sep 6 10:55:14 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:15.267273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7a4f3363-d293-4722-a6f0-529ca7bb6d96 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:15.267273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7a4f3363-d293-4722-a6f0-529ca7bb6d96 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:15.267610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a4f3363-d293-4722-a6f0-529ca7bb6d96 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:15.268574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a4f3363-d293-4722-a6f0-529ca7bb6d96 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:15.268574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a4f3363-d293-4722-a6f0-529ca7bb6d96 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:15.269490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a4f3363-d293-4722-a6f0-529ca7bb6d96 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:15.269609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a4f3363-d293-4722-a6f0-529ca7bb6d96 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:15.269992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a4f3363-d293-4722-a6f0-529ca7bb6d96 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:15.653221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aa3a5776-19f8-4469-8a38-483b7f496d4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:15.676995 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aa3a5776-19f8-4469-8a38-483b7f496d4e tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1478 microversion: 2.1 time: 0.483259 Sep 06 10:55:15.678590 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 590/1212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:15 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1478 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:15.689802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7a4f3363-d293-4722-a6f0-529ca7bb6d96 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:15.689949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-da9387ed-ccde-4a8b-898b-cec57618266c req-6519853a-228e-4043-9668-27baf2659bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dd8f1a-f2a3-463e-9129-1060fc467171", "name": "network-vif-unplugged", "status": "completed", "tag": "0722de88-af62-4350-ab9b-6cd8023675fa"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:15.708771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-da9387ed-ccde-4a8b-898b-cec57618266c req-6519853a-228e-4043-9668-27baf2659bc5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:15.709254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-da9387ed-ccde-4a8b-898b-cec57618266c req-6519853a-228e-4043-9668-27baf2659bc5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:15.709880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-da9387ed-ccde-4a8b-898b-cec57618266c req-6519853a-228e-4043-9668-27baf2659bc5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:15.722427 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-da9387ed-ccde-4a8b-898b-cec57618266c req-6519853a-228e-4043-9668-27baf2659bc5 service nova] Creating event network-vif-unplugged:0722de88-af62-4350-ab9b-6cd8023675fa for instance 77dd8f1a-f2a3-463e-9129-1060fc467171 on nch1-master-1 Sep 06 10:55:15.728571 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-da9387ed-ccde-4a8b-898b-cec57618266c req-6519853a-228e-4043-9668-27baf2659bc5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047250 Sep 06 10:55:15.729815 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 591/1213] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:15.736487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a4fccd7b-e958-47f1-a2fa-936c19b25c24 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:15.737464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a4fccd7b-e958-47f1-a2fa-936c19b25c24 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:15.742854 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7a4f3363-d293-4722-a6f0-529ca7bb6d96 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.448691 Sep 06 10:55:15.744003 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 623/1214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:15 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:15.745834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4fccd7b-e958-47f1-a2fa-936c19b25c24 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:15.746604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4fccd7b-e958-47f1-a2fa-936c19b25c24 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:15.747389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4fccd7b-e958-47f1-a2fa-936c19b25c24 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:15.748334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4fccd7b-e958-47f1-a2fa-936c19b25c24 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:15.749018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4fccd7b-e958-47f1-a2fa-936c19b25c24 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:15.749726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4fccd7b-e958-47f1-a2fa-936c19b25c24 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:15.751975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2225523f-9909-4334-90d9-cd605b9230ec tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:15.752546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2225523f-9909-4334-90d9-cd605b9230ec tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:15.755278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:15.763115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2225523f-9909-4334-90d9-cd605b9230ec tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:15.763681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2225523f-9909-4334-90d9-cd605b9230ec tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:15.764164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2225523f-9909-4334-90d9-cd605b9230ec tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:15.764917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2225523f-9909-4334-90d9-cd605b9230ec tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:15.765406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2225523f-9909-4334-90d9-cd605b9230ec tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:15.765836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2225523f-9909-4334-90d9-cd605b9230ec tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:16.052326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2225523f-9909-4334-90d9-cd605b9230ec tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:55:16.184754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a4fccd7b-e958-47f1-a2fa-936c19b25c24 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:16.198007 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a4fccd7b-e958-47f1-a2fa-936c19b25c24 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1719 microversion: 2.1 time: 0.466583 Sep 06 10:55:16.198868 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 592/1215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:15 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1719 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:16.203798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:16.210821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:16.212019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-843517541', 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:16.220715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:16.221594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:16.222245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:16.223399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:16.224092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:16.224728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:16.402415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:16.407495 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2225523f-9909-4334-90d9-cd605b9230ec tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 204 len: 0 microversion: 2.1 time: 0.661535 Sep 06 10:55:16.408281 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 624/1216] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:55:15 2022] DELETE /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:55:16.414721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9df3f1d5-f7a0-4565-9cdc-f0e614c36d33 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:16.414721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9df3f1d5-f7a0-4565-9cdc-f0e614c36d33 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:16.426104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9df3f1d5-f7a0-4565-9cdc-f0e614c36d33 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:16.426335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9df3f1d5-f7a0-4565-9cdc-f0e614c36d33 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:16.426623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9df3f1d5-f7a0-4565-9cdc-f0e614c36d33 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:16.435962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9df3f1d5-f7a0-4565-9cdc-f0e614c36d33 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:16.435962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9df3f1d5-f7a0-4565-9cdc-f0e614c36d33 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:16.436654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9df3f1d5-f7a0-4565-9cdc-f0e614c36d33 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:16.506949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:16.514032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:16.514541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:16.514980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:16.927713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9df3f1d5-f7a0-4565-9cdc-f0e614c36d33 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:16.936854 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9df3f1d5-f7a0-4565-9cdc-f0e614c36d33 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1475 microversion: 2.1 time: 0.527572 Sep 06 10:55:16.954677 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 625/1217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:16 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1475 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:16.956101 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-07e3d728-b8e8-4588-89ce-231085e9186b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-843517541" status: 200 len: 1514 microversion: 2.1 time: 0.755875 Sep 06 10:55:16.960385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f1053fe-2e32-4b0f-82b9-676e926ab3e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:16.961335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7f1053fe-2e32-4b0f-82b9-676e926ab3e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:16.971190 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 593/1218] 10.222.0.20 () {58 vars in 1261 bytes} [Tue Sep 6 10:55:16 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-843517541 => generated 1514 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:16.975869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-445133c7-87bb-4bf7-8863-0337e8e86683 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:16.980569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-445133c7-87bb-4bf7-8863-0337e8e86683 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:16.993042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f1053fe-2e32-4b0f-82b9-676e926ab3e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:16.996224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f1053fe-2e32-4b0f-82b9-676e926ab3e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:16.996224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f1053fe-2e32-4b0f-82b9-676e926ab3e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:16.996224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f1053fe-2e32-4b0f-82b9-676e926ab3e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:16.996224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f1053fe-2e32-4b0f-82b9-676e926ab3e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:16.997156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f1053fe-2e32-4b0f-82b9-676e926ab3e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:16.997335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-445133c7-87bb-4bf7-8863-0337e8e86683 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:16.997723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-445133c7-87bb-4bf7-8863-0337e8e86683 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:16.998170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-445133c7-87bb-4bf7-8863-0337e8e86683 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:16.999242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-445133c7-87bb-4bf7-8863-0337e8e86683 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:16.999781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-445133c7-87bb-4bf7-8863-0337e8e86683 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:17.000220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-445133c7-87bb-4bf7-8863-0337e8e86683 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:17.408321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f1053fe-2e32-4b0f-82b9-676e926ab3e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:17.419083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f1053fe-2e32-4b0f-82b9-676e926ab3e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:17.420613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f1053fe-2e32-4b0f-82b9-676e926ab3e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:17.421878 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7f1053fe-2e32-4b0f-82b9-676e926ab3e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.465729 Sep 06 10:55:17.427800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-445133c7-87bb-4bf7-8863-0337e8e86683 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:17.432832 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 626/1219] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:16 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:17.440225 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-445133c7-87bb-4bf7-8863-0337e8e86683 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1526 microversion: 2.1 time: 0.469003 Sep 06 10:55:17.440424 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 594/1220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:16 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1526 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:17.445233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0e4a6d25-5825-4152-a93c-adde9779bf9d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:17.446995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0e4a6d25-5825-4152-a93c-adde9779bf9d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:17.447643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-48e3a6b4-b2f3-4b9a-a9b7-f0b336445225 req-278a08dd-c6be-47e8-988e-b0d2c2f55e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a4ea2a-aa16-4e41-af83-b027dfe81828", "name": "network-vif-unplugged", "status": "completed", "tag": "9fd60b84-0b14-41da-8bad-24a891e8dd1d"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:17.455454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e4a6d25-5825-4152-a93c-adde9779bf9d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:17.459914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-48e3a6b4-b2f3-4b9a-a9b7-f0b336445225 req-278a08dd-c6be-47e8-988e-b0d2c2f55e49 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:17.461436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-48e3a6b4-b2f3-4b9a-a9b7-f0b336445225 req-278a08dd-c6be-47e8-988e-b0d2c2f55e49 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:17.461879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-48e3a6b4-b2f3-4b9a-a9b7-f0b336445225 req-278a08dd-c6be-47e8-988e-b0d2c2f55e49 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:17.462458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e4a6d25-5825-4152-a93c-adde9779bf9d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:17.463048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e4a6d25-5825-4152-a93c-adde9779bf9d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:17.463901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e4a6d25-5825-4152-a93c-adde9779bf9d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:17.464445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e4a6d25-5825-4152-a93c-adde9779bf9d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:17.474711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e4a6d25-5825-4152-a93c-adde9779bf9d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:17.488501 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-48e3a6b4-b2f3-4b9a-a9b7-f0b336445225 req-278a08dd-c6be-47e8-988e-b0d2c2f55e49 service nova] Creating event network-vif-unplugged:9fd60b84-0b14-41da-8bad-24a891e8dd1d for instance 31a4ea2a-aa16-4e41-af83-b027dfe81828 on nch1-master-1 Sep 06 10:55:17.494503 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-48e3a6b4-b2f3-4b9a-a9b7-f0b336445225 req-278a08dd-c6be-47e8-988e-b0d2c2f55e49 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052714 Sep 06 10:55:17.495302 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 595/1221] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:17.501228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6c71d16f-2849-4ebd-b872-fc3aa2fb86da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:17.501958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6c71d16f-2849-4ebd-b872-fc3aa2fb86da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:17.509115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c71d16f-2849-4ebd-b872-fc3aa2fb86da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:17.510294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c71d16f-2849-4ebd-b872-fc3aa2fb86da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:17.510921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c71d16f-2849-4ebd-b872-fc3aa2fb86da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:17.511820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c71d16f-2849-4ebd-b872-fc3aa2fb86da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:17.512706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c71d16f-2849-4ebd-b872-fc3aa2fb86da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:17.513657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c71d16f-2849-4ebd-b872-fc3aa2fb86da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:17.770052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6c71d16f-2849-4ebd-b872-fc3aa2fb86da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:17.781136 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6c71d16f-2849-4ebd-b872-fc3aa2fb86da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1497 microversion: 2.1 time: 0.282982 Sep 06 10:55:17.781807 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 596/1222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:17 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1497 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:17.790435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:17.803712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:17.805790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:17.816407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0e4a6d25-5825-4152-a93c-adde9779bf9d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:17.819532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:17.820992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:17.823094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:17.823999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:17.824477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:17.824904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:17.831918 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0e4a6d25-5825-4152-a93c-adde9779bf9d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1478 microversion: 2.1 time: 0.396747 Sep 06 10:55:17.832512 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 627/1223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:17 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1478 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:17.838881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-823d906f-886f-4448-bf59-b8e6c1e5d98b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:17.839881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-823d906f-886f-4448-bf59-b8e6c1e5d98b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:17.855587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-823d906f-886f-4448-bf59-b8e6c1e5d98b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:17.856818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-823d906f-886f-4448-bf59-b8e6c1e5d98b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:17.857452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-823d906f-886f-4448-bf59-b8e6c1e5d98b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:17.858382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-823d906f-886f-4448-bf59-b8e6c1e5d98b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:17.859029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-823d906f-886f-4448-bf59-b8e6c1e5d98b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:17.859833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-823d906f-886f-4448-bf59-b8e6c1e5d98b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:17.977553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:18.055360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:18.063144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:18.063632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:18.064072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:18.491317 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9be234be-ae6f-4aa6-95c1-f25de63488b4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.706153 Sep 06 10:55:18.500751 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 597/1224] 10.222.0.20 () {58 vars in 1173 bytes} [Tue Sep 6 10:55:17 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:18.511828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-823d906f-886f-4448-bf59-b8e6c1e5d98b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:18.515657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-359d5cfe-ea7b-4582-b635-c81ce890d466 req-ff3d5491-dd29-478a-84e6-9949af7ba783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dd8f1a-f2a3-463e-9129-1060fc467171", "name": "network-vif-plugged", "status": "completed", "tag": "0722de88-af62-4350-ab9b-6cd8023675fa"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:18.528819 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-823d906f-886f-4448-bf59-b8e6c1e5d98b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1719 microversion: 2.1 time: 0.694626 Sep 06 10:55:18.529540 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 628/1225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:17 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1719 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:18.534636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:18.535537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:18.535947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-359d5cfe-ea7b-4582-b635-c81ce890d466 req-ff3d5491-dd29-478a-84e6-9949af7ba783 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:18.536617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-359d5cfe-ea7b-4582-b635-c81ce890d466 req-ff3d5491-dd29-478a-84e6-9949af7ba783 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:18.537139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-359d5cfe-ea7b-4582-b635-c81ce890d466 req-ff3d5491-dd29-478a-84e6-9949af7ba783 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:18.542991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:18.544292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:18.544910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:18.545801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:18.546590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:18.549714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:18.562487 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-359d5cfe-ea7b-4582-b635-c81ce890d466 req-ff3d5491-dd29-478a-84e6-9949af7ba783 service nova] Creating event network-vif-plugged:0722de88-af62-4350-ab9b-6cd8023675fa for instance 77dd8f1a-f2a3-463e-9129-1060fc467171 on nch1-master-1 Sep 06 10:55:18.575910 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-359d5cfe-ea7b-4582-b635-c81ce890d466 req-ff3d5491-dd29-478a-84e6-9949af7ba783 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072962 Sep 06 10:55:18.577160 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 598/1226] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:18.589686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5f827172-69e3-4e11-a832-0dd9239dc215 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:18.595573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5f827172-69e3-4e11-a832-0dd9239dc215 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:18.610257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:18.613547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:18.614364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:18.615300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lazy-loading 'fault' on Instance uuid 40e858a4-422c-4d31-a2b4-e54167933857 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:18.626009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f827172-69e3-4e11-a832-0dd9239dc215 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:18.626674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f827172-69e3-4e11-a832-0dd9239dc215 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:18.636983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f827172-69e3-4e11-a832-0dd9239dc215 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:18.640289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f827172-69e3-4e11-a832-0dd9239dc215 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:18.641258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f827172-69e3-4e11-a832-0dd9239dc215 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:18.647798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f827172-69e3-4e11-a832-0dd9239dc215 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:18.713189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8affa67bb57f451b94d1eded04b1782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:18.721279 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b8179d2e-dc2e-497e-9c13-032df930932c tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 200 len: 1309 microversion: 2.1 time: 0.190412 Sep 06 10:55:18.722121 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 629/1227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:18 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 1309 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:18.727746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-59436835-6805-41f6-bdb6-a6852e3bb219 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:18.728580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-59436835-6805-41f6-bdb6-a6852e3bb219 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:18.735840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59436835-6805-41f6-bdb6-a6852e3bb219 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:18.736614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59436835-6805-41f6-bdb6-a6852e3bb219 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:18.737375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59436835-6805-41f6-bdb6-a6852e3bb219 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:18.738421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59436835-6805-41f6-bdb6-a6852e3bb219 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:18.739115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59436835-6805-41f6-bdb6-a6852e3bb219 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:18.739555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59436835-6805-41f6-bdb6-a6852e3bb219 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.032671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5f827172-69e3-4e11-a832-0dd9239dc215 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:19.042497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5f827172-69e3-4e11-a832-0dd9239dc215 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:19.044380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5f827172-69e3-4e11-a832-0dd9239dc215 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:19.045815 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5f827172-69e3-4e11-a832-0dd9239dc215 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.467388 Sep 06 10:55:19.056802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-59436835-6805-41f6-bdb6-a6852e3bb219 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:19.073277 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 599/1228] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:18 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:19.075187 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-59436835-6805-41f6-bdb6-a6852e3bb219 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1526 microversion: 2.1 time: 0.351905 Sep 06 10:55:19.082054 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 630/1229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:18 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1526 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:19.094091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-698b5880-3cc8-493f-9cbd-ed8b082720a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:19.094747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-698b5880-3cc8-493f-9cbd-ed8b082720a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:19.095473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:19.100970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:19.101484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.compute.servers [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Removing options 'limit' from query {{(pid=140875) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 06 10:55:19.104025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:19.108478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-698b5880-3cc8-493f-9cbd-ed8b082720a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.113614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-698b5880-3cc8-493f-9cbd-ed8b082720a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.113614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-698b5880-3cc8-493f-9cbd-ed8b082720a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.113614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-698b5880-3cc8-493f-9cbd-ed8b082720a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.113614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-698b5880-3cc8-493f-9cbd-ed8b082720a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.113964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-698b5880-3cc8-493f-9cbd-ed8b082720a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.128163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.129844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.134957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.136850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.138525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.140580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.196563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:19.203270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.203833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.204515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.379492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-698b5880-3cc8-493f-9cbd-ed8b082720a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:19.405095 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-698b5880-3cc8-493f-9cbd-ed8b082720a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 200 len: 1474 microversion: 2.1 time: 0.321856 Sep 06 10:55:19.405683 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 631/1230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:19 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 1474 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:19.411750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-52342c25-c558-4b62-976c-53f89f7e7ae7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:19.412368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-52342c25-c558-4b62-976c-53f89f7e7ae7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:19.419161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52342c25-c558-4b62-976c-53f89f7e7ae7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.419879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52342c25-c558-4b62-976c-53f89f7e7ae7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.420323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52342c25-c558-4b62-976c-53f89f7e7ae7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.421211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52342c25-c558-4b62-976c-53f89f7e7ae7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.421846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52342c25-c558-4b62-976c-53f89f7e7ae7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.422281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52342c25-c558-4b62-976c-53f89f7e7ae7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.441649 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-83d214cf-2b9c-4f42-8cfe-510252187477 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.366546 Sep 06 10:55:19.442723 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 600/1231] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Sep 6 10:55:19 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:19.448449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dbd20c5c-1b80-429b-8dc6-a2094d1997e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1645883086"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:19.451231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dbd20c5c-1b80-429b-8dc6-a2094d1997e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:19.458990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbd20c5c-1b80-429b-8dc6-a2094d1997e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.459978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbd20c5c-1b80-429b-8dc6-a2094d1997e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.460756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbd20c5c-1b80-429b-8dc6-a2094d1997e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.462861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbd20c5c-1b80-429b-8dc6-a2094d1997e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.463546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbd20c5c-1b80-429b-8dc6-a2094d1997e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.464161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbd20c5c-1b80-429b-8dc6-a2094d1997e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.608073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-52342c25-c558-4b62-976c-53f89f7e7ae7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:19.610396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:19.616618 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-52342c25-c558-4b62-976c-53f89f7e7ae7 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1478 microversion: 2.1 time: 0.209605 Sep 06 10:55:19.617775 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 632/1232] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:19 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1478 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:19.622290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a27ccd1-7800-4dfe-934c-a6577b0bc8b6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:19.627160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9a27ccd1-7800-4dfe-934c-a6577b0bc8b6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:19.627969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9a27ccd1-7800-4dfe-934c-a6577b0bc8b6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:19.633360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a27ccd1-7800-4dfe-934c-a6577b0bc8b6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.633846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a27ccd1-7800-4dfe-934c-a6577b0bc8b6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.634287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a27ccd1-7800-4dfe-934c-a6577b0bc8b6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.635033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a27ccd1-7800-4dfe-934c-a6577b0bc8b6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.635509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a27ccd1-7800-4dfe-934c-a6577b0bc8b6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.635936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a27ccd1-7800-4dfe-934c-a6577b0bc8b6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.732895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-9a27ccd1-7800-4dfe-934c-a6577b0bc8b6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:19.796581 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a27ccd1-7800-4dfe-934c-a6577b0bc8b6 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.177631 Sep 06 10:55:19.797084 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 633/1233] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:55:19 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:19.801607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-d5066459-3585-41de-858b-05e5b28b2d7d req-42070616-f32a-4993-b4f1-b73b7ef5d23c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e858a4-422c-4d31-a2b4-e54167933857", "name": "network-vif-deleted", "tag": "5f535969-b5ea-4fe2-acc4-37b9c3121df1"}, {"name": "network-changed", "server_uuid": "31a4ea2a-aa16-4e41-af83-b027dfe81828", "tag": "9fd60b84-0b14-41da-8bad-24a891e8dd1d"}, {"server_uuid": "b7dd9374-605a-4210-9271-9442a435c17c", "name": "network-vif-deleted", "tag": "c3240674-1db4-4057-af2a-0241d0fdc27b"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:19.813884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d5066459-3585-41de-858b-05e5b28b2d7d req-42070616-f32a-4993-b4f1-b73b7ef5d23c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.814365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d5066459-3585-41de-858b-05e5b28b2d7d req-42070616-f32a-4993-b4f1-b73b7ef5d23c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.814951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d5066459-3585-41de-858b-05e5b28b2d7d req-42070616-f32a-4993-b4f1-b73b7ef5d23c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.833285 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d5066459-3585-41de-858b-05e5b28b2d7d req-42070616-f32a-4993-b4f1-b73b7ef5d23c service nova] Creating event network-vif-deleted:5f535969-b5ea-4fe2-acc4-37b9c3121df1 for instance 40e858a4-422c-4d31-a2b4-e54167933857 on nch1-master-1 Sep 06 10:55:19.833799 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d5066459-3585-41de-858b-05e5b28b2d7d req-42070616-f32a-4993-b4f1-b73b7ef5d23c service nova] Creating event network-changed:9fd60b84-0b14-41da-8bad-24a891e8dd1d for instance 31a4ea2a-aa16-4e41-af83-b027dfe81828 on nch1-master-1 Sep 06 10:55:19.834303 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d5066459-3585-41de-858b-05e5b28b2d7d req-42070616-f32a-4993-b4f1-b73b7ef5d23c service nova] Creating event network-vif-deleted:c3240674-1db4-4057-af2a-0241d0fdc27b for instance b7dd9374-605a-4210-9271-9442a435c17c on nch1-master-1 Sep 06 10:55:19.842696 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-d5066459-3585-41de-858b-05e5b28b2d7d req-42070616-f32a-4993-b4f1-b73b7ef5d23c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.044133 Sep 06 10:55:19.843596 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 634/1234] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:19.849347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6222937d-c943-4d98-bf2b-ea3b334bc359 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:19.850056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6222937d-c943-4d98-bf2b-ea3b334bc359 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:19.857291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6222937d-c943-4d98-bf2b-ea3b334bc359 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.857783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6222937d-c943-4d98-bf2b-ea3b334bc359 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.858226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6222937d-c943-4d98-bf2b-ea3b334bc359 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.858933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6222937d-c943-4d98-bf2b-ea3b334bc359 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.859512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6222937d-c943-4d98-bf2b-ea3b334bc359 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.859955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6222937d-c943-4d98-bf2b-ea3b334bc359 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.888661 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dbd20c5c-1b80-429b-8dc6-a2094d1997e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "POST /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627/action" status: 202 len: 0 microversion: 2.1 time: 0.444342 Sep 06 10:55:19.889935 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 601/1235] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:55:19 2022] POST /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 06 10:55:19.896384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd9f3315-a042-44ca-ba32-2c00bf8d0dd3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:19.897266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fd9f3315-a042-44ca-ba32-2c00bf8d0dd3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] [instance: 40e858a4-422c-4d31-a2b4-e54167933857] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:19.904707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f3315-a042-44ca-ba32-2c00bf8d0dd3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.904707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f3315-a042-44ca-ba32-2c00bf8d0dd3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.904707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f3315-a042-44ca-ba32-2c00bf8d0dd3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.905314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f3315-a042-44ca-ba32-2c00bf8d0dd3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.905775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f3315-a042-44ca-ba32-2c00bf8d0dd3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.906208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f3315-a042-44ca-ba32-2c00bf8d0dd3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.920480 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-fd9f3315-a042-44ca-ba32-2c00bf8d0dd3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] HTTP exception thrown: Instance 40e858a4-422c-4d31-a2b4-e54167933857 could not be found. Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd9f3315-a042-44ca-ba32-2c00bf8d0dd3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Request method failure captured: Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 HTTP/1.1 Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFybDXL1pY4LpUB4USQKXuKTAGXxUGroyQ9FRc5PfBtcGTN8PX0b2taWdO7cr-L9TWemAXKZZXJxevsfmHMdIP6ZBa3L39WSnbG0BGKkHQuDmq0uNaE0_cFnCoD1igtw6ljmtSGjkIlgMiIa4PCDCDB1BdClyM-0CjHLEqy_Ez4Wwp1g Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 3f02d8ddd39f4d8b93a44ee6295dc7f8 Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-LiveMigrationNegativeTest-1852265708 Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:55:19.922162 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:55:19.923703 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f02d8ddd39f4d8b93a44ee6295dc7f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f02d8ddd39f4d8b93a44ee6295dc7f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f02d8ddd39f4d8b93a44ee6295dc7f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f02d8ddd39f4d8b93a44ee6295dc7f8"}]}] Sep 06 10:55:19.923703 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-LiveMigrationNegativeTest-1852265708 Sep 06 10:55:19.923703 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 3f02d8ddd39f4d8b93a44ee6295dc7f8 Sep 06 10:55:19.923703 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1852265708 Sep 06 10:55:19.923703 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-LiveMigrationNegativeTest-1852265708-project Sep 06 10:55:19.923703 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:55:19.923703 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:55:19.923703 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 8affa67bb57f451b94d1eded04b1782a Sep 06 10:55:19.923703 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-LiveMigrationNegativeTest-1852265708-project Sep 06 10:55:19.923703 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:55:19.923703 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 40e858a4-422c-4d31-a2b4-e54167933857 could not be found. Sep 06 10:55:19.923703 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '40e858a4-422c-4d31-a2b4-e54167933857'} Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e858a4-422c-4d31-a2b4-e54167933857 could not be found. Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:19.924592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e858a4-422c-4d31-a2b4-e54167933857 could not be found. Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e858a4-422c-4d31-a2b4-e54167933857 could not be found. Sep 06 10:55:19.925910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:19.928282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd9f3315-a042-44ca-ba32-2c00bf8d0dd3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] Returning 404 to user: Instance 40e858a4-422c-4d31-a2b4-e54167933857 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:19.929144 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd9f3315-a042-44ca-ba32-2c00bf8d0dd3 tempest-LiveMigrationNegativeTest-1852265708 tempest-LiveMigrationNegativeTest-1852265708-project] 10.222.0.20 "GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857" status: 404 len: 111 microversion: 2.1 time: 0.037864 Sep 06 10:55:19.930233 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 602/1236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:19 2022] GET /compute/v2.1/servers/40e858a4-422c-4d31-a2b4-e54167933857 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:19.949738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-09d0ff03-9eae-4fdf-a104-e145a6f76c9f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:19.959461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-09d0ff03-9eae-4fdf-a104-e145a6f76c9f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:19.959916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.compute.servers [None req-09d0ff03-9eae-4fdf-a104-e145a6f76c9f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Removing options 'limit' from query {{(pid=140875) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 06 10:55:19.960729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-09d0ff03-9eae-4fdf-a104-e145a6f76c9f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:19.970409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09d0ff03-9eae-4fdf-a104-e145a6f76c9f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.970901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09d0ff03-9eae-4fdf-a104-e145a6f76c9f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.971368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09d0ff03-9eae-4fdf-a104-e145a6f76c9f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:19.972100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09d0ff03-9eae-4fdf-a104-e145a6f76c9f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:19.972702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09d0ff03-9eae-4fdf-a104-e145a6f76c9f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:19.973139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09d0ff03-9eae-4fdf-a104-e145a6f76c9f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.031290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6222937d-c943-4d98-bf2b-ea3b334bc359 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:20.042787 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6222937d-c943-4d98-bf2b-ea3b334bc359 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1719 microversion: 2.1 time: 0.196079 Sep 06 10:55:20.043668 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 635/1237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:19 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1719 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:20.051286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a7a1cd3-1e23-473b-a113-80a36c03208b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f848b430>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:20.070664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-09d0ff03-9eae-4fdf-a104-e145a6f76c9f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:20.101560 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a7a1cd3-1e23-473b-a113-80a36c03208b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.056482 Sep 06 10:55:20.102104 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 636/1238] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:20 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:20.106946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e17ca71-291c-4b57-b976-ab5f8a77f855 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:20.107676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4e17ca71-291c-4b57-b976-ab5f8a77f855 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:20.114972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e17ca71-291c-4b57-b976-ab5f8a77f855 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.115502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e17ca71-291c-4b57-b976-ab5f8a77f855 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.115950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e17ca71-291c-4b57-b976-ab5f8a77f855 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.116676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e17ca71-291c-4b57-b976-ab5f8a77f855 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.117177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e17ca71-291c-4b57-b976-ab5f8a77f855 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.117619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e17ca71-291c-4b57-b976-ab5f8a77f855 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.284734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4e17ca71-291c-4b57-b976-ab5f8a77f855 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:20.295330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4e17ca71-291c-4b57-b976-ab5f8a77f855 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:20.296825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4e17ca71-291c-4b57-b976-ab5f8a77f855 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:20.298149 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e17ca71-291c-4b57-b976-ab5f8a77f855 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.195110 Sep 06 10:55:20.298782 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 637/1239] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:20 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:20.318067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1b4eb719-fc10-42b6-acfb-59c0e8c4de17 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:20.318708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1b4eb719-fc10-42b6-acfb-59c0e8c4de17 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:20.325578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b4eb719-fc10-42b6-acfb-59c0e8c4de17 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.328232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b4eb719-fc10-42b6-acfb-59c0e8c4de17 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.328232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b4eb719-fc10-42b6-acfb-59c0e8c4de17 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.328232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b4eb719-fc10-42b6-acfb-59c0e8c4de17 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.328232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b4eb719-fc10-42b6-acfb-59c0e8c4de17 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.328585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b4eb719-fc10-42b6-acfb-59c0e8c4de17 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.344544 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-09d0ff03-9eae-4fdf-a104-e145a6f76c9f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.413244 Sep 06 10:55:20.345145 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 603/1240] 10.222.0.20 () {58 vars in 1150 bytes} [Tue Sep 6 10:55:19 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:20.357064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d0057e1d-3b14-4b41-8250-4706e02ddfb9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:20.362139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d0057e1d-3b14-4b41-8250-4706e02ddfb9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:20.362837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d0057e1d-3b14-4b41-8250-4706e02ddfb9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:20.368349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0057e1d-3b14-4b41-8250-4706e02ddfb9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.369028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0057e1d-3b14-4b41-8250-4706e02ddfb9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.369474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0057e1d-3b14-4b41-8250-4706e02ddfb9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.370244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0057e1d-3b14-4b41-8250-4706e02ddfb9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.370917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0057e1d-3b14-4b41-8250-4706e02ddfb9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.371344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0057e1d-3b14-4b41-8250-4706e02ddfb9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.401342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-d0057e1d-3b14-4b41-8250-4706e02ddfb9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:20.401790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1b4eb719-fc10-42b6-acfb-59c0e8c4de17 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:20.410825 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1b4eb719-fc10-42b6-acfb-59c0e8c4de17 tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1484 microversion: 2.1 time: 0.097651 Sep 06 10:55:20.423815 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 638/1241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:20 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1484 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:20.439799 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d0057e1d-3b14-4b41-8250-4706e02ddfb9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.086342 Sep 06 10:55:20.440493 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 604/1242] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 10:55:20 2022] GET /compute/v2.1/servers => generated 1010 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:20.453679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7da8cac4-c33f-487d-984e-f1c889534f7c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:20.458520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7da8cac4-c33f-487d-984e-f1c889534f7c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:20.459387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7da8cac4-c33f-487d-984e-f1c889534f7c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:20.471554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7da8cac4-c33f-487d-984e-f1c889534f7c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.472032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7da8cac4-c33f-487d-984e-f1c889534f7c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.472471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7da8cac4-c33f-487d-984e-f1c889534f7c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.473208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7da8cac4-c33f-487d-984e-f1c889534f7c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.473668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7da8cac4-c33f-487d-984e-f1c889534f7c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.474096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7da8cac4-c33f-487d-984e-f1c889534f7c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.559440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-7da8cac4-c33f-487d-984e-f1c889534f7c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:20.640944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b02a502c-7393-405d-8cde-bacbc9a44a3f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:20.642053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b02a502c-7393-405d-8cde-bacbc9a44a3f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:20.642833 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7da8cac4-c33f-487d-984e-f1c889534f7c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.192831 Sep 06 10:55:20.643784 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 639/1243] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:55:20 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:20.650839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b02a502c-7393-405d-8cde-bacbc9a44a3f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.651514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b02a502c-7393-405d-8cde-bacbc9a44a3f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.652334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b02a502c-7393-405d-8cde-bacbc9a44a3f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.653125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b02a502c-7393-405d-8cde-bacbc9a44a3f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.653952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b02a502c-7393-405d-8cde-bacbc9a44a3f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.654605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b02a502c-7393-405d-8cde-bacbc9a44a3f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.658078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-11ff0ba3-6593-4baa-970f-02dece83cfde tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:20.664696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-11ff0ba3-6593-4baa-970f-02dece83cfde tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:20.665230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.compute.servers [None req-11ff0ba3-6593-4baa-970f-02dece83cfde tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Removing options 'limit' from query {{(pid=140876) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 06 10:55:20.665911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-11ff0ba3-6593-4baa-970f-02dece83cfde tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:20.672321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11ff0ba3-6593-4baa-970f-02dece83cfde tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.673073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11ff0ba3-6593-4baa-970f-02dece83cfde tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.673535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11ff0ba3-6593-4baa-970f-02dece83cfde tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.674280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11ff0ba3-6593-4baa-970f-02dece83cfde tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.674738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11ff0ba3-6593-4baa-970f-02dece83cfde tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.675412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11ff0ba3-6593-4baa-970f-02dece83cfde tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.772086 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-11ff0ba3-6593-4baa-970f-02dece83cfde tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.118556 Sep 06 10:55:20.775245 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 640/1244] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Sep 6 10:55:20 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:55:20.777875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c25a4fe-ef10-4eb2-9f79-01e2dfac335a"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:20.780324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:20.786769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.787293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.787743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.788487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.788994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.789418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.888036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b02a502c-7393-405d-8cde-bacbc9a44a3f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:20.896527 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b02a502c-7393-405d-8cde-bacbc9a44a3f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1478 microversion: 2.1 time: 0.259274 Sep 06 10:55:20.912361 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 605/1245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:20 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1478 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:20.912361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e059d0cb-d35d-4e3c-84e7-ce4434d1599e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:20.912361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e059d0cb-d35d-4e3c-84e7-ce4434d1599e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:20.912361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e059d0cb-d35d-4e3c-84e7-ce4434d1599e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-843517541', 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:20.918024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e059d0cb-d35d-4e3c-84e7-ce4434d1599e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.918519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e059d0cb-d35d-4e3c-84e7-ce4434d1599e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.918959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e059d0cb-d35d-4e3c-84e7-ce4434d1599e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:20.920111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e059d0cb-d35d-4e3c-84e7-ce4434d1599e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:20.920633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e059d0cb-d35d-4e3c-84e7-ce4434d1599e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:20.921253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e059d0cb-d35d-4e3c-84e7-ce4434d1599e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:21.013648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-e059d0cb-d35d-4e3c-84e7-ce4434d1599e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:21.079581 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e059d0cb-d35d-4e3c-84e7-ce4434d1599e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-843517541" status: 200 len: 345 microversion: 2.1 time: 0.181369 Sep 06 10:55:21.080177 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 606/1246] 10.222.0.20 () {58 vars in 1240 bytes} [Tue Sep 6 10:55:20 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-843517541 => generated 345 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:21.084978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3b4c733a-e6c2-4332-975f-a6ce91910878 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:21.086270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3b4c733a-e6c2-4332-975f-a6ce91910878 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:21.093198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b4c733a-e6c2-4332-975f-a6ce91910878 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:21.093631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b4c733a-e6c2-4332-975f-a6ce91910878 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:21.094083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b4c733a-e6c2-4332-975f-a6ce91910878 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:21.094798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b4c733a-e6c2-4332-975f-a6ce91910878 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:21.095305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b4c733a-e6c2-4332-975f-a6ce91910878 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:21.095784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b4c733a-e6c2-4332-975f-a6ce91910878 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:21.100621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:21.437493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3b4c733a-e6c2-4332-975f-a6ce91910878 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:21.445697 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3b4c733a-e6c2-4332-975f-a6ce91910878 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1719 microversion: 2.1 time: 0.364272 Sep 06 10:55:21.446360 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 607/1247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:21 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1719 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:21.450955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ea5a232e-f383-49c7-ae98-da4cde1c3101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:21.456852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea5a232e-f383-49c7-ae98-da4cde1c3101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:21.457342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea5a232e-f383-49c7-ae98-da4cde1c3101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:21.457800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea5a232e-f383-49c7-ae98-da4cde1c3101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:21.481815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ea5a232e-f383-49c7-ae98-da4cde1c3101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Going to try to stop instance {{(pid=140875) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 10:55:21.629104 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "POST /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.854327 Sep 06 10:55:21.629978 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 641/1248] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 10:55:20 2022] POST /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:21.635869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b5e75e89-bf13-4a84-bd27-eca897ee2f04 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f85c4c10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:21.709438 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ea5a232e-f383-49c7-ae98-da4cde1c3101 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "POST /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61/action" status: 202 len: 0 microversion: 2.1 time: 0.261499 Sep 06 10:55:21.711220 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 608/1249] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:55:21 2022] POST /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:55:21.716890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5ccfeec4-3d02-496c-89bc-ddcba2d0d6d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:21.718901 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b5e75e89-bf13-4a84-bd27-eca897ee2f04 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.087467 Sep 06 10:55:21.720402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5ccfeec4-3d02-496c-89bc-ddcba2d0d6d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:21.723206 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 642/1250] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:21 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:21.729781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ccfeec4-3d02-496c-89bc-ddcba2d0d6d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:21.749576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ccfeec4-3d02-496c-89bc-ddcba2d0d6d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:21.750736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:21.751554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ccfeec4-3d02-496c-89bc-ddcba2d0d6d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:21.752599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:21.753823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ccfeec4-3d02-496c-89bc-ddcba2d0d6d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:21.758084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ccfeec4-3d02-496c-89bc-ddcba2d0d6d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:21.758805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ccfeec4-3d02-496c-89bc-ddcba2d0d6d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:21.771716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:21.774669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:21.775478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:21.776228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:21.777091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:21.777532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:21.836527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:21.837321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:21.838002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:21.838719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lazy-loading 'fault' on Instance uuid b7dd9374-605a-4210-9271-9442a435c17c {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:21.967258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:21.979796 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e27538ff-bf04-44a0-939e-a200d4e006eb tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1314 microversion: 2.1 time: 0.255260 Sep 06 10:55:21.980792 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 643/1251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:21 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:22.000194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-afe98ce8-768f-470d-ab96-afb6429650b8 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:22.001140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-afe98ce8-768f-470d-ab96-afb6429650b8 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:22.010950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-afe98ce8-768f-470d-ab96-afb6429650b8 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:22.012125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-afe98ce8-768f-470d-ab96-afb6429650b8 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:22.014413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-afe98ce8-768f-470d-ab96-afb6429650b8 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:22.015393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-afe98ce8-768f-470d-ab96-afb6429650b8 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:22.016702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-afe98ce8-768f-470d-ab96-afb6429650b8 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:22.017328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-afe98ce8-768f-470d-ab96-afb6429650b8 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:22.138727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5ccfeec4-3d02-496c-89bc-ddcba2d0d6d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:22.151966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5ccfeec4-3d02-496c-89bc-ddcba2d0d6d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:22.153427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5ccfeec4-3d02-496c-89bc-ddcba2d0d6d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:22.154614 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5ccfeec4-3d02-496c-89bc-ddcba2d0d6d5 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.442156 Sep 06 10:55:22.155212 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 609/1252] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:21 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:22.168131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9fe8a8b9-863a-41d1-8c41-1bc1f46ab8e4 req-ddbe57ac-b80d-494e-b870-2b523b654474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21485351-3c21-4970-9d57-310eff94abb2", "name": "network-vif-unplugged", "status": "completed", "tag": "7ac72bf1-22cc-4a06-8e37-4e7576503af8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:22.197728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9fe8a8b9-863a-41d1-8c41-1bc1f46ab8e4 req-ddbe57ac-b80d-494e-b870-2b523b654474 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:22.199411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9fe8a8b9-863a-41d1-8c41-1bc1f46ab8e4 req-ddbe57ac-b80d-494e-b870-2b523b654474 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:22.199870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9fe8a8b9-863a-41d1-8c41-1bc1f46ab8e4 req-ddbe57ac-b80d-494e-b870-2b523b654474 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:22.250286 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9fe8a8b9-863a-41d1-8c41-1bc1f46ab8e4 req-ddbe57ac-b80d-494e-b870-2b523b654474 service nova] Creating event network-vif-unplugged:7ac72bf1-22cc-4a06-8e37-4e7576503af8 for instance 21485351-3c21-4970-9d57-310eff94abb2 on nch2-master-1 Sep 06 10:55:22.275155 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9fe8a8b9-863a-41d1-8c41-1bc1f46ab8e4 req-ddbe57ac-b80d-494e-b870-2b523b654474 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100591 Sep 06 10:55:22.275824 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 610/1253] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:22.288277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8ac04996-3a66-4419-9a9b-fc05c0d50c46 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:22.292814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-afe98ce8-768f-470d-ab96-afb6429650b8 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:22.293788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8ac04996-3a66-4419-9a9b-fc05c0d50c46 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:22.301043 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ac04996-3a66-4419-9a9b-fc05c0d50c46 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:22.301720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ac04996-3a66-4419-9a9b-fc05c0d50c46 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:22.302667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ac04996-3a66-4419-9a9b-fc05c0d50c46 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:22.303560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ac04996-3a66-4419-9a9b-fc05c0d50c46 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:22.306806 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-afe98ce8-768f-470d-ab96-afb6429650b8 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1521 microversion: 2.1 time: 0.321740 Sep 06 10:55:22.306941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ac04996-3a66-4419-9a9b-fc05c0d50c46 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:22.306941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ac04996-3a66-4419-9a9b-fc05c0d50c46 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:22.319639 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 644/1254] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:21 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:22.470660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2dfb5271-65bd-4624-8242-b07724923cd3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:22.471501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2dfb5271-65bd-4624-8242-b07724923cd3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:22.483478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dfb5271-65bd-4624-8242-b07724923cd3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:22.484910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dfb5271-65bd-4624-8242-b07724923cd3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:22.485912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dfb5271-65bd-4624-8242-b07724923cd3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:22.488600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dfb5271-65bd-4624-8242-b07724923cd3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:22.491318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dfb5271-65bd-4624-8242-b07724923cd3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:22.492907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dfb5271-65bd-4624-8242-b07724923cd3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:22.531617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8ac04996-3a66-4419-9a9b-fc05c0d50c46 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:22.541396 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8ac04996-3a66-4419-9a9b-fc05c0d50c46 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1463 microversion: 2.1 time: 0.261665 Sep 06 10:55:22.552544 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 611/1255] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:22 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1463 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:22.596139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9251c9e7-627a-4f6c-9808-0124931a43db tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:22.612893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9251c9e7-627a-4f6c-9808-0124931a43db tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:22.615505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9251c9e7-627a-4f6c-9808-0124931a43db tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:22.616287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9251c9e7-627a-4f6c-9808-0124931a43db tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:22.616970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9251c9e7-627a-4f6c-9808-0124931a43db tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:22.622340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9251c9e7-627a-4f6c-9808-0124931a43db tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:22.622340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9251c9e7-627a-4f6c-9808-0124931a43db tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:22.622340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9251c9e7-627a-4f6c-9808-0124931a43db tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:22.810004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2dfb5271-65bd-4624-8242-b07724923cd3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:22.822033 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2dfb5271-65bd-4624-8242-b07724923cd3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1719 microversion: 2.1 time: 0.356265 Sep 06 10:55:22.827277 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 645/1256] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:22 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1719 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:22.829985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eb9a5bb8-5f74-4ffd-9a20-0a239a7df41c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f85ce8b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:22.918323 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eb9a5bb8-5f74-4ffd-9a20-0a239a7df41c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.093734 Sep 06 10:55:22.919154 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 646/1257] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:22 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:23.006950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:23.008721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:23.015959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.017441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.018087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.020404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.021216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.022076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.081825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.082380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.082835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.083640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lazy-loading 'fault' on Instance uuid b7dd9374-605a-4210-9271-9442a435c17c {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:23.109981 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9251c9e7-627a-4f6c-9808-0124931a43db tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action" status: 202 len: 0 microversion: 2.1 time: 0.527926 Sep 06 10:55:23.116315 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 612/1258] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:55:22 2022] POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:55:23.123050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-570a798d-f6de-417e-a8ad-78a54c291780 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:23.123894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-570a798d-f6de-417e-a8ad-78a54c291780 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:23.136334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d86f8c8ece4257adc548304465f191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa352b4d4810484688d325ca4bb25193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:23.141521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570a798d-f6de-417e-a8ad-78a54c291780 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.141521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570a798d-f6de-417e-a8ad-78a54c291780 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.142516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570a798d-f6de-417e-a8ad-78a54c291780 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.142620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570a798d-f6de-417e-a8ad-78a54c291780 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.143071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570a798d-f6de-417e-a8ad-78a54c291780 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.143567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570a798d-f6de-417e-a8ad-78a54c291780 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.147643 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7ed994b1-e2e6-479c-8f86-a4feb1f0523e tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 200 len: 1314 microversion: 2.1 time: 0.145273 Sep 06 10:55:23.159821 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 647/1259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:23 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:23.201333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3b13c8af-3b75-4d5f-8588-314efceb9e2f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:23.202326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3b13c8af-3b75-4d5f-8588-314efceb9e2f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:23.202446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570a798d-f6de-417e-a8ad-78a54c291780 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.203733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570a798d-f6de-417e-a8ad-78a54c291780 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.204330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570a798d-f6de-417e-a8ad-78a54c291780 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.205197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-570a798d-f6de-417e-a8ad-78a54c291780 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lazy-loading 'fault' on Instance uuid 77dd8f1a-f2a3-463e-9129-1060fc467171 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:23.211582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b13c8af-3b75-4d5f-8588-314efceb9e2f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.212188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b13c8af-3b75-4d5f-8588-314efceb9e2f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.212853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b13c8af-3b75-4d5f-8588-314efceb9e2f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.214311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b13c8af-3b75-4d5f-8588-314efceb9e2f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.215064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b13c8af-3b75-4d5f-8588-314efceb9e2f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.216399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b13c8af-3b75-4d5f-8588-314efceb9e2f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.430354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3b13c8af-3b75-4d5f-8588-314efceb9e2f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:23.432011 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-570a798d-f6de-417e-a8ad-78a54c291780 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1597 microversion: 2.1 time: 0.313344 Sep 06 10:55:23.433232 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 613/1260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:23 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1597 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:23.438590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e627a0c7-81a0-42de-aa84-ba387a1111db tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:23.439251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e627a0c7-81a0-42de-aa84-ba387a1111db tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:23.454087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e627a0c7-81a0-42de-aa84-ba387a1111db tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.454593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e627a0c7-81a0-42de-aa84-ba387a1111db tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.455067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e627a0c7-81a0-42de-aa84-ba387a1111db tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.455954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e627a0c7-81a0-42de-aa84-ba387a1111db tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.456794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e627a0c7-81a0-42de-aa84-ba387a1111db tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.457390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e627a0c7-81a0-42de-aa84-ba387a1111db tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.461163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3b13c8af-3b75-4d5f-8588-314efceb9e2f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:23.462804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3b13c8af-3b75-4d5f-8588-314efceb9e2f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:23.464164 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3b13c8af-3b75-4d5f-8588-314efceb9e2f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.269496 Sep 06 10:55:23.464716 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 648/1261] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:23 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:55:23.469414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-88a34f4d-926d-4d69-8506-564d4f3ef499 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:23.471915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-88a34f4d-926d-4d69-8506-564d4f3ef499 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:23.479142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88a34f4d-926d-4d69-8506-564d4f3ef499 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.480326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88a34f4d-926d-4d69-8506-564d4f3ef499 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.480879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88a34f4d-926d-4d69-8506-564d4f3ef499 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.481797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88a34f4d-926d-4d69-8506-564d4f3ef499 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.482419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88a34f4d-926d-4d69-8506-564d4f3ef499 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.482958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88a34f4d-926d-4d69-8506-564d4f3ef499 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.597803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:23.603158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e627a0c7-81a0-42de-aa84-ba387a1111db tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:23.618578 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e627a0c7-81a0-42de-aa84-ba387a1111db tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1521 microversion: 2.1 time: 0.184118 Sep 06 10:55:23.619244 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 614/1262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:23 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:23.770103 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-88a34f4d-926d-4d69-8506-564d4f3ef499 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action" status: 202 len: 0 microversion: 2.1 time: 0.304138 Sep 06 10:55:23.771472 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 649/1263] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:55:23 2022] POST /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:55:23.779656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-18141538-65d4-4ae0-b200-7fe99f2903b6 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:23.780456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-18141538-65d4-4ae0-b200-7fe99f2903b6 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:23.787250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18141538-65d4-4ae0-b200-7fe99f2903b6 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.787820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18141538-65d4-4ae0-b200-7fe99f2903b6 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.788369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18141538-65d4-4ae0-b200-7fe99f2903b6 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.789197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18141538-65d4-4ae0-b200-7fe99f2903b6 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.789668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18141538-65d4-4ae0-b200-7fe99f2903b6 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.790105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18141538-65d4-4ae0-b200-7fe99f2903b6 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.854201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9b6efeb6-c912-4806-b512-2e21757ab76a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:23.855469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9b6efeb6-c912-4806-b512-2e21757ab76a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:23.863171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b6efeb6-c912-4806-b512-2e21757ab76a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.863670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b6efeb6-c912-4806-b512-2e21757ab76a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.864294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b6efeb6-c912-4806-b512-2e21757ab76a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.865209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b6efeb6-c912-4806-b512-2e21757ab76a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:23.865955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b6efeb6-c912-4806-b512-2e21757ab76a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:23.866587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b6efeb6-c912-4806-b512-2e21757ab76a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:23.987177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-18141538-65d4-4ae0-b200-7fe99f2903b6 tempest-ServersAdminTestJSON-491256503 tempest-ServersAdminTestJSON-491256503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1614 microversion: 2.1 time: 0.211397 Sep 06 10:55:23.988349 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 615/1264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:23 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1614 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:23.993823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d97baafb-481f-4256-98b5-fc890f4d534f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8567790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:24.048938 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d97baafb-481f-4256-98b5-fc890f4d534f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.059017 Sep 06 10:55:24.049925 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 616/1265] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:23 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:24.055049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9e6bf5d2-b368-499b-9aaa-1059ff646ead tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:24.055573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9e6bf5d2-b368-499b-9aaa-1059ff646ead tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:24.062715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e6bf5d2-b368-499b-9aaa-1059ff646ead tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:24.063282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e6bf5d2-b368-499b-9aaa-1059ff646ead tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:24.063931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e6bf5d2-b368-499b-9aaa-1059ff646ead tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:24.064651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e6bf5d2-b368-499b-9aaa-1059ff646ead tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:24.065120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e6bf5d2-b368-499b-9aaa-1059ff646ead tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:24.065562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e6bf5d2-b368-499b-9aaa-1059ff646ead tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:24.067628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9b6efeb6-c912-4806-b512-2e21757ab76a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:24.078400 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9b6efeb6-c912-4806-b512-2e21757ab76a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1719 microversion: 2.1 time: 0.228804 Sep 06 10:55:24.079365 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 650/1266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:23 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1719 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:24.094183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9e6bf5d2-b368-499b-9aaa-1059ff646ead tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:55:24.173949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0388773e-5d90-4d45-ae89-490acadd71ba tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:24.174568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0388773e-5d90-4d45-ae89-490acadd71ba tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] [instance: b7dd9374-605a-4210-9271-9442a435c17c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:24.182492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0388773e-5d90-4d45-ae89-490acadd71ba tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:24.183132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0388773e-5d90-4d45-ae89-490acadd71ba tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:24.183782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0388773e-5d90-4d45-ae89-490acadd71ba tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:24.184567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0388773e-5d90-4d45-ae89-490acadd71ba tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:24.185135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0388773e-5d90-4d45-ae89-490acadd71ba tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:24.185639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0388773e-5d90-4d45-ae89-490acadd71ba tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:24.199997 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-0388773e-5d90-4d45-ae89-490acadd71ba tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] HTTP exception thrown: Instance b7dd9374-605a-4210-9271-9442a435c17c could not be found. Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0388773e-5d90-4d45-ae89-490acadd71ba tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Request method failure captured: Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c HTTP/1.1 Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFybJwBPoDD6TpToX2LfVwlb3pFQBQyhvDfGsXw8HVWS_ENMdZw1fyQvROi67jEDseVD3GqWu4HEzuuaXvWYEn8yK9rBQIBiJZABTIy3OthBEpqf766hp3M1U9juOP2P91wFYQg3yw1TlCQjT0g-MsE0jYMcnyZGv975wsA4RiNJYxjU Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aa352b4d4810484688d325ca4bb25193 Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-324247753 Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:55:24.201666 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:55:24.203334 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa352b4d4810484688d325ca4bb25193"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa352b4d4810484688d325ca4bb25193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa352b4d4810484688d325ca4bb25193"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa352b4d4810484688d325ca4bb25193"}]}] Sep 06 10:55:24.203334 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-324247753 Sep 06 10:55:24.203334 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aa352b4d4810484688d325ca4bb25193 Sep 06 10:55:24.203334 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-324247753 Sep 06 10:55:24.203334 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-FloatingIPsAssociationTestJSON-324247753-project Sep 06 10:55:24.203334 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:55:24.203334 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:55:24.203334 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 24d86f8c8ece4257adc548304465f191 Sep 06 10:55:24.203334 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-324247753-project Sep 06 10:55:24.203334 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:55:24.203334 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance b7dd9374-605a-4210-9271-9442a435c17c could not be found. Sep 06 10:55:24.203334 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'b7dd9374-605a-4210-9271-9442a435c17c'} Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7dd9374-605a-4210-9271-9442a435c17c could not be found. Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:24.204352 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7dd9374-605a-4210-9271-9442a435c17c could not be found. Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7dd9374-605a-4210-9271-9442a435c17c could not be found. Sep 06 10:55:24.205815 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:24.207227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0388773e-5d90-4d45-ae89-490acadd71ba tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] Returning 404 to user: Instance b7dd9374-605a-4210-9271-9442a435c17c could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:24.207227 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0388773e-5d90-4d45-ae89-490acadd71ba tempest-FloatingIPsAssociationTestJSON-324247753 tempest-FloatingIPsAssociationTestJSON-324247753-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c" status: 404 len: 111 microversion: 2.1 time: 0.034917 Sep 06 10:55:24.207227 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 651/1267] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:24 2022] GET /compute/v2.1/servers/b7dd9374-605a-4210-9271-9442a435c17c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:55:24.311277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-8b6c9633-c19e-4760-ba54-4d9222bb8acf req-831c46cc-d557-4221-8309-a94319d8681a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21485351-3c21-4970-9d57-310eff94abb2", "tag": "7ac72bf1-22cc-4a06-8e37-4e7576503af8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:24.317495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:24.321412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8b6c9633-c19e-4760-ba54-4d9222bb8acf req-831c46cc-d557-4221-8309-a94319d8681a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:24.323494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8b6c9633-c19e-4760-ba54-4d9222bb8acf req-831c46cc-d557-4221-8309-a94319d8681a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:24.323494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8b6c9633-c19e-4760-ba54-4d9222bb8acf req-831c46cc-d557-4221-8309-a94319d8681a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:24.336541 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-8b6c9633-c19e-4760-ba54-4d9222bb8acf req-831c46cc-d557-4221-8309-a94319d8681a service nova] Creating event network-changed:7ac72bf1-22cc-4a06-8e37-4e7576503af8 for instance 21485351-3c21-4970-9d57-310eff94abb2 on nch2-master-1 Sep 06 10:55:24.341984 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-8b6c9633-c19e-4760-ba54-4d9222bb8acf req-831c46cc-d557-4221-8309-a94319d8681a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034099 Sep 06 10:55:24.346520 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 652/1268] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:55:24.490661 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9e6bf5d2-b368-499b-9aaa-1059ff646ead tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 204 len: 0 microversion: 2.1 time: 0.439322 Sep 06 10:55:24.491343 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 617/1269] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:55:24 2022] DELETE /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:55:24.496593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5f8179d2-97b4-482f-bec3-ba8d80265285 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:24.498021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5f8179d2-97b4-482f-bec3-ba8d80265285 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:24.500497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-912d9d36-10f8-43ca-b5a6-56e5c1a02f6d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:24.501205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-912d9d36-10f8-43ca-b5a6-56e5c1a02f6d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:24.510847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-912d9d36-10f8-43ca-b5a6-56e5c1a02f6d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:24.517228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-912d9d36-10f8-43ca-b5a6-56e5c1a02f6d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:24.517228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-912d9d36-10f8-43ca-b5a6-56e5c1a02f6d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:24.517228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-912d9d36-10f8-43ca-b5a6-56e5c1a02f6d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:24.517612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f8179d2-97b4-482f-bec3-ba8d80265285 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:24.517733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-912d9d36-10f8-43ca-b5a6-56e5c1a02f6d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:24.517837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f8179d2-97b4-482f-bec3-ba8d80265285 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:24.517939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-912d9d36-10f8-43ca-b5a6-56e5c1a02f6d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:24.518052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f8179d2-97b4-482f-bec3-ba8d80265285 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:24.518052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f8179d2-97b4-482f-bec3-ba8d80265285 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:24.518052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f8179d2-97b4-482f-bec3-ba8d80265285 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:24.518052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f8179d2-97b4-482f-bec3-ba8d80265285 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:24.925811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-912d9d36-10f8-43ca-b5a6-56e5c1a02f6d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:24.941001 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-912d9d36-10f8-43ca-b5a6-56e5c1a02f6d tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1469 microversion: 2.1 time: 0.444743 Sep 06 10:55:24.941590 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 618/1270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:24 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1469 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:24.953084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b18e38c9-d7c4-4aec-94ef-1cdeef5964da tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:24.953714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b18e38c9-d7c4-4aec-94ef-1cdeef5964da tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:24.962959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b18e38c9-d7c4-4aec-94ef-1cdeef5964da tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:24.963517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b18e38c9-d7c4-4aec-94ef-1cdeef5964da tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:24.963955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b18e38c9-d7c4-4aec-94ef-1cdeef5964da tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:24.964973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b18e38c9-d7c4-4aec-94ef-1cdeef5964da tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:24.965592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b18e38c9-d7c4-4aec-94ef-1cdeef5964da tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:24.966337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b18e38c9-d7c4-4aec-94ef-1cdeef5964da tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:25.019804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:25.492011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5f8179d2-97b4-482f-bec3-ba8d80265285 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:25.504943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5f8179d2-97b4-482f-bec3-ba8d80265285 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:25.506561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5f8179d2-97b4-482f-bec3-ba8d80265285 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:25.511923 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5f8179d2-97b4-482f-bec3-ba8d80265285 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 1.020462 Sep 06 10:55:25.511923 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 653/1271] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:24 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:55:25.513370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-33cd218b-49db-4ebf-a996-f6f27cefe7be tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8553310>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:25.595511 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-33cd218b-49db-4ebf-a996-f6f27cefe7be tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.085492 Sep 06 10:55:25.596690 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 654/1272] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:25 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:25.713213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b18e38c9-d7c4-4aec-94ef-1cdeef5964da tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:25.724035 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b18e38c9-d7c4-4aec-94ef-1cdeef5964da tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1521 microversion: 2.1 time: 0.781215 Sep 06 10:55:25.728011 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 619/1273] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:24 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1521 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:25.743892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e5f9a57f-4e08-4b8a-9930-0ac64ed4b0f7 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:25.752164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e5f9a57f-4e08-4b8a-9930-0ac64ed4b0f7 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:25.771197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5f9a57f-4e08-4b8a-9930-0ac64ed4b0f7 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:25.773122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5f9a57f-4e08-4b8a-9930-0ac64ed4b0f7 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:25.773122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5f9a57f-4e08-4b8a-9930-0ac64ed4b0f7 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:25.773673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5f9a57f-4e08-4b8a-9930-0ac64ed4b0f7 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:25.774334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5f9a57f-4e08-4b8a-9930-0ac64ed4b0f7 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:25.774986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5f9a57f-4e08-4b8a-9930-0ac64ed4b0f7 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:25.810111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-87582270", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": "none"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:25.904709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:55:25.905421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:55:25.906128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:55:25.907159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:55:25.907743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:55:25.922798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:25.923751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:25.924427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:25.925566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:25.926243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:25.926943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:25.947958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Getting quotas for project 0c261994fe8c4d0a8b4ff35f26896dcc. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:55:25.957845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Getting quotas for user 3803365807284dee8e89eae93945fc9b and project 0c261994fe8c4d0a8b4ff35f26896dcc. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:55:25.983949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:55:25.986749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:55:26.207633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e5f9a57f-4e08-4b8a-9930-0ac64ed4b0f7 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:26.224359 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e5f9a57f-4e08-4b8a-9930-0ac64ed4b0f7 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1719 microversion: 2.1 time: 0.494798 Sep 06 10:55:26.225437 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3d6b478b-c813-4933-9e81-996a04703f00 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.626839 Sep 06 10:55:26.226476 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 620/1274] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:25 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1719 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:26.227469 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 655/1275] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 10:55:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 10:55:26.232470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8de8f214-3b52-4a72-b351-036f4007c134 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:26.233418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8de8f214-3b52-4a72-b351-036f4007c134 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:26.236006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-81678d87-6c5c-4ab3-be52-8899e5c2a7d9 req-1d37d595-5546-45a2-b05e-da15712b4517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d33d19-9934-492e-ab0f-0651fe5c6627", "name": "network-vif-plugged", "status": "completed", "tag": "b54017fd-be21-45de-8025-0205f20d32de"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:26.241151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8de8f214-3b52-4a72-b351-036f4007c134 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:26.242538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8de8f214-3b52-4a72-b351-036f4007c134 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:26.243179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8de8f214-3b52-4a72-b351-036f4007c134 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:26.244090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8de8f214-3b52-4a72-b351-036f4007c134 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:26.249676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8de8f214-3b52-4a72-b351-036f4007c134 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:26.249676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8de8f214-3b52-4a72-b351-036f4007c134 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:26.250516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-81678d87-6c5c-4ab3-be52-8899e5c2a7d9 req-1d37d595-5546-45a2-b05e-da15712b4517 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:26.251314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-81678d87-6c5c-4ab3-be52-8899e5c2a7d9 req-1d37d595-5546-45a2-b05e-da15712b4517 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:26.252064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-81678d87-6c5c-4ab3-be52-8899e5c2a7d9 req-1d37d595-5546-45a2-b05e-da15712b4517 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:26.258025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:26.267475 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-81678d87-6c5c-4ab3-be52-8899e5c2a7d9 req-1d37d595-5546-45a2-b05e-da15712b4517 service nova] Creating event network-vif-plugged:b54017fd-be21-45de-8025-0205f20d32de for instance b0d33d19-9934-492e-ab0f-0651fe5c6627 on nch2-master-1 Sep 06 10:55:26.274800 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-81678d87-6c5c-4ab3-be52-8899e5c2a7d9 req-1d37d595-5546-45a2-b05e-da15712b4517 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045189 Sep 06 10:55:26.275815 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 621/1276] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:26.284738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a89721fa-5a89-46c5-bb06-8fc4e5ac8263 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:26.287856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a89721fa-5a89-46c5-bb06-8fc4e5ac8263 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:26.296121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a89721fa-5a89-46c5-bb06-8fc4e5ac8263 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:26.297095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a89721fa-5a89-46c5-bb06-8fc4e5ac8263 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:26.297774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a89721fa-5a89-46c5-bb06-8fc4e5ac8263 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:26.298828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a89721fa-5a89-46c5-bb06-8fc4e5ac8263 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:26.300055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a89721fa-5a89-46c5-bb06-8fc4e5ac8263 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:26.300942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a89721fa-5a89-46c5-bb06-8fc4e5ac8263 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:26.369044 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a89721fa-5a89-46c5-bb06-8fc4e5ac8263 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091610 Sep 06 10:55:26.375452 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 622/1277] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 10:55:26 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:26.375452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24fd79d1-460b-4848-848b-409748e18879 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:26.378169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-24fd79d1-460b-4848-848b-409748e18879 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:26.536397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-24fd79d1-460b-4848-848b-409748e18879 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:26.546533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-24fd79d1-460b-4848-848b-409748e18879 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:26.548606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-24fd79d1-460b-4848-848b-409748e18879 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:26.558069 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-24fd79d1-460b-4848-848b-409748e18879 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "PUT /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1357 microversion: 2.75 time: 0.186421 Sep 06 10:55:26.558800 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 623/1278] 10.222.0.20 () {62 vars in 1297 bytes} [Tue Sep 6 10:55:26 2022] PUT /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:26.584999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b0293454-43cc-44a4-a7da-521927eecfac tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:26.585609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b0293454-43cc-44a4-a7da-521927eecfac tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:26.591871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0293454-43cc-44a4-a7da-521927eecfac tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:26.592500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0293454-43cc-44a4-a7da-521927eecfac tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:26.592951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0293454-43cc-44a4-a7da-521927eecfac tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:26.593727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0293454-43cc-44a4-a7da-521927eecfac tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:26.594202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0293454-43cc-44a4-a7da-521927eecfac tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:26.594636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0293454-43cc-44a4-a7da-521927eecfac tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:26.761678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8de8f214-3b52-4a72-b351-036f4007c134 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:26.777480 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8de8f214-3b52-4a72-b351-036f4007c134 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1469 microversion: 2.1 time: 0.548718 Sep 06 10:55:26.778105 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 656/1279] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:26 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1469 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:26.787905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-69d7c5f0-a874-4a39-813a-653dadb0d9fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:26.788890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-69d7c5f0-a874-4a39-813a-653dadb0d9fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:26.795839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-b0293454-43cc-44a4-a7da-521927eecfac tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lazy-loading 'services' on Instance uuid 8bf2c50a-91cd-4042-914e-c85ff9025b00 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:26.819448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69d7c5f0-a874-4a39-813a-653dadb0d9fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:26.827919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69d7c5f0-a874-4a39-813a-653dadb0d9fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:26.828672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69d7c5f0-a874-4a39-813a-653dadb0d9fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:26.829832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69d7c5f0-a874-4a39-813a-653dadb0d9fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:26.830580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69d7c5f0-a874-4a39-813a-653dadb0d9fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:26.832164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69d7c5f0-a874-4a39-813a-653dadb0d9fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:27.145975 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b0293454-43cc-44a4-a7da-521927eecfac tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00/os-volume_attachments/7c25a4fe-ef10-4eb2-9f79-01e2dfac335a" status: 202 len: 0 microversion: 2.1 time: 0.577621 Sep 06 10:55:27.150354 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 624/1280] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 10:55:26 2022] DELETE /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00/os-volume_attachments/7c25a4fe-ef10-4eb2-9f79-01e2dfac335a => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:55:27.179719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ad391450-f776-4aa0-9fbc-33cc62ce5577 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:27.184314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ad391450-f776-4aa0-9fbc-33cc62ce5577 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:27.217127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:27.217596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-69d7c5f0-a874-4a39-813a-653dadb0d9fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:27.244758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-69d7c5f0-a874-4a39-813a-653dadb0d9fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:27.250553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-69d7c5f0-a874-4a39-813a-653dadb0d9fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:27.254551 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-69d7c5f0-a874-4a39-813a-653dadb0d9fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.475234 Sep 06 10:55:27.262204 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 657/1281] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:26 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:27.279630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2761e370-ccbc-40ec-93f3-57908d075158 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f85b8160>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:27.369048 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2761e370-ccbc-40ec-93f3-57908d075158 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.102866 Sep 06 10:55:27.381267 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 658/1282] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:27 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:27.381267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3ad1b246-ca55-4831-b0f5-12f9d74f9c8a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:27.384953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3ad1b246-ca55-4831-b0f5-12f9d74f9c8a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:27.393702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ad1b246-ca55-4831-b0f5-12f9d74f9c8a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:27.394244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ad1b246-ca55-4831-b0f5-12f9d74f9c8a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:27.394820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ad1b246-ca55-4831-b0f5-12f9d74f9c8a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:27.395705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ad1b246-ca55-4831-b0f5-12f9d74f9c8a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:27.396242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ad1b246-ca55-4831-b0f5-12f9d74f9c8a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:27.396745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ad1b246-ca55-4831-b0f5-12f9d74f9c8a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:27.512192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ad391450-f776-4aa0-9fbc-33cc62ce5577 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:27.524089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ad391450-f776-4aa0-9fbc-33cc62ce5577 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:27.525738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ad391450-f776-4aa0-9fbc-33cc62ce5577 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:27.536141 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ad391450-f776-4aa0-9fbc-33cc62ce5577 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1357 microversion: 2.75 time: 0.386416 Sep 06 10:55:27.536964 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 625/1283] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:27 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1357 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:27.543807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-92fb7b7b-d160-46f3-92d2-493f51073b6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:27.544812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-92fb7b7b-d160-46f3-92d2-493f51073b6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:27.559691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92fb7b7b-d160-46f3-92d2-493f51073b6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:27.561512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92fb7b7b-d160-46f3-92d2-493f51073b6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:27.562204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92fb7b7b-d160-46f3-92d2-493f51073b6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:27.563188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92fb7b7b-d160-46f3-92d2-493f51073b6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:27.564455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92fb7b7b-d160-46f3-92d2-493f51073b6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:27.565181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92fb7b7b-d160-46f3-92d2-493f51073b6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:28.028267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3ad1b246-ca55-4831-b0f5-12f9d74f9c8a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:28.048832 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3ad1b246-ca55-4831-b0f5-12f9d74f9c8a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1521 microversion: 2.1 time: 0.677040 Sep 06 10:55:28.059229 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 659/1284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:27 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1521 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:28.065072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-163eaec3-815a-4e09-8e36-7d989b0eea90 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:28.074360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-163eaec3-815a-4e09-8e36-7d989b0eea90 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:28.088664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-163eaec3-815a-4e09-8e36-7d989b0eea90 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:28.089460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-163eaec3-815a-4e09-8e36-7d989b0eea90 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:28.092230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-163eaec3-815a-4e09-8e36-7d989b0eea90 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:28.093175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-163eaec3-815a-4e09-8e36-7d989b0eea90 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:28.093828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-163eaec3-815a-4e09-8e36-7d989b0eea90 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:28.102670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-163eaec3-815a-4e09-8e36-7d989b0eea90 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:28.105374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-92fb7b7b-d160-46f3-92d2-493f51073b6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:28.118662 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-92fb7b7b-d160-46f3-92d2-493f51073b6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1719 microversion: 2.1 time: 0.580276 Sep 06 10:55:28.138239 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 626/1285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:27 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1719 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:28.234203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-391a80f2-b93b-4072-8175-d4469beae8a5 req-acd7bfe0-9b6f-4b7d-a6f9-dd8b137b78d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fe43cc-0af8-4ca0-9083-61b0f76aaa10", "name": "network-vif-deleted", "tag": "710dacdc-43a5-4e67-9326-47de62fc72f5"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:28.260242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-391a80f2-b93b-4072-8175-d4469beae8a5 req-acd7bfe0-9b6f-4b7d-a6f9-dd8b137b78d6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:28.261280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-391a80f2-b93b-4072-8175-d4469beae8a5 req-acd7bfe0-9b6f-4b7d-a6f9-dd8b137b78d6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:28.262574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-391a80f2-b93b-4072-8175-d4469beae8a5 req-acd7bfe0-9b6f-4b7d-a6f9-dd8b137b78d6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:28.268149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-163eaec3-815a-4e09-8e36-7d989b0eea90 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:28.280743 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-163eaec3-815a-4e09-8e36-7d989b0eea90 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1427 microversion: 2.1 time: 0.219443 Sep 06 10:55:28.281669 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 660/1286] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:28 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1427 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:28.288082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-32bd38fe-cad9-4172-8c40-99790a451dc6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:28.291211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-32bd38fe-cad9-4172-8c40-99790a451dc6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:28.294883 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-391a80f2-b93b-4072-8175-d4469beae8a5 req-acd7bfe0-9b6f-4b7d-a6f9-dd8b137b78d6 service nova] Creating event network-vif-deleted:710dacdc-43a5-4e67-9326-47de62fc72f5 for instance a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 on nch1-master-1 Sep 06 10:55:28.306026 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-391a80f2-b93b-4072-8175-d4469beae8a5 req-acd7bfe0-9b6f-4b7d-a6f9-dd8b137b78d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076136 Sep 06 10:55:28.307986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32bd38fe-cad9-4172-8c40-99790a451dc6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:28.308721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32bd38fe-cad9-4172-8c40-99790a451dc6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:28.308851 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 627/1287] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:55:28.310064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32bd38fe-cad9-4172-8c40-99790a451dc6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:28.314652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32bd38fe-cad9-4172-8c40-99790a451dc6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:28.315460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32bd38fe-cad9-4172-8c40-99790a451dc6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:28.316035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32bd38fe-cad9-4172-8c40-99790a451dc6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:28.387977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bb4f1a82-c27f-43cf-8100-2c23a40462b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f87f7310>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:28.520022 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bb4f1a82-c27f-43cf-8100-2c23a40462b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.136980 Sep 06 10:55:28.522746 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 628/1288] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:28 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:28.568932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5c5bfff2-b62e-4e8f-816f-f62ac67afc41 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:28.580287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5c5bfff2-b62e-4e8f-816f-f62ac67afc41 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:28.598060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5c5bfff2-b62e-4e8f-816f-f62ac67afc41 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:28.601802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5c5bfff2-b62e-4e8f-816f-f62ac67afc41 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:28.602557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5c5bfff2-b62e-4e8f-816f-f62ac67afc41 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:28.603529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5c5bfff2-b62e-4e8f-816f-f62ac67afc41 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:28.605324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5c5bfff2-b62e-4e8f-816f-f62ac67afc41 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:28.610417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5c5bfff2-b62e-4e8f-816f-f62ac67afc41 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:28.887524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-32bd38fe-cad9-4172-8c40-99790a451dc6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:28.894261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5c5bfff2-b62e-4e8f-816f-f62ac67afc41 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:28.900815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-32bd38fe-cad9-4172-8c40-99790a451dc6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:28.905622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-32bd38fe-cad9-4172-8c40-99790a451dc6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:28.905777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5c5bfff2-b62e-4e8f-816f-f62ac67afc41 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:28.911447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5c5bfff2-b62e-4e8f-816f-f62ac67afc41 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:28.911642 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-32bd38fe-cad9-4172-8c40-99790a451dc6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.627418 Sep 06 10:55:28.912849 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 661/1289] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:28 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:28.919657 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5c5bfff2-b62e-4e8f-816f-f62ac67afc41 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1361 microversion: 2.75 time: 0.354808 Sep 06 10:55:28.920834 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 629/1290] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:28 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1361 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:29.076868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-67997948-0bc4-4f38-be46-fc09eff96411 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:29.077843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-67997948-0bc4-4f38-be46-fc09eff96411 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:29.089140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67997948-0bc4-4f38-be46-fc09eff96411 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:29.089939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67997948-0bc4-4f38-be46-fc09eff96411 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:29.090558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67997948-0bc4-4f38-be46-fc09eff96411 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:29.091979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67997948-0bc4-4f38-be46-fc09eff96411 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:29.092622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67997948-0bc4-4f38-be46-fc09eff96411 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:29.093215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67997948-0bc4-4f38-be46-fc09eff96411 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:29.145252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-61c6e419-9971-4900-82a4-d3913430ffc1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:29.146240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-61c6e419-9971-4900-82a4-d3913430ffc1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:29.169230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61c6e419-9971-4900-82a4-d3913430ffc1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:29.169230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61c6e419-9971-4900-82a4-d3913430ffc1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:29.169470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61c6e419-9971-4900-82a4-d3913430ffc1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:29.170051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61c6e419-9971-4900-82a4-d3913430ffc1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:29.170538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61c6e419-9971-4900-82a4-d3913430ffc1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:29.170966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61c6e419-9971-4900-82a4-d3913430ffc1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:29.472451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-67997948-0bc4-4f38-be46-fc09eff96411 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:29.489943 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-67997948-0bc4-4f38-be46-fc09eff96411 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1521 microversion: 2.1 time: 0.417142 Sep 06 10:55:29.493102 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 662/1291] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:29 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:29.516440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:29.517285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:29.525995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:29.526524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:29.526971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:29.540331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:29.541162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:29.541535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:29.542764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-61c6e419-9971-4900-82a4-d3913430ffc1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:29.575977 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-61c6e419-9971-4900-82a4-d3913430ffc1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1719 microversion: 2.1 time: 0.434769 Sep 06 10:55:29.605082 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 630/1292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:29 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1719 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:29.616273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bc0ef2d5-cf12-454c-aece-e80336a32214 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f873e430>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:29.630508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:29.631169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:29.631634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:29.632382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lazy-loading 'fault' on Instance uuid a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:29.758299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:29.772395 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-96107152-bd15-4dbf-ae4f-26f922d1aba6 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 200 len: 1303 microversion: 2.1 time: 0.278135 Sep 06 10:55:29.794427 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 663/1293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:29 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 1303 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:29.794631 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bc0ef2d5-cf12-454c-aece-e80336a32214 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.177710 Sep 06 10:55:29.794754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3eb6c501-0b75-4f9d-8cbb-553d5fc5d55b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:29.794754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3eb6c501-0b75-4f9d-8cbb-553d5fc5d55b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:29.796283 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 631/1294] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:29 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:29.810132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3eb6c501-0b75-4f9d-8cbb-553d5fc5d55b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:29.811085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3eb6c501-0b75-4f9d-8cbb-553d5fc5d55b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:29.813214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3eb6c501-0b75-4f9d-8cbb-553d5fc5d55b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:29.814414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3eb6c501-0b75-4f9d-8cbb-553d5fc5d55b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:29.817377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3eb6c501-0b75-4f9d-8cbb-553d5fc5d55b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:29.818060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3eb6c501-0b75-4f9d-8cbb-553d5fc5d55b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:29.877252 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3eb6c501-0b75-4f9d-8cbb-553d5fc5d55b tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095082 Sep 06 10:55:29.878778 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 664/1295] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 10:55:29 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:55:29.958431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d8c08e00-a063-459f-8ec3-cbac1a6f486d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:29.967279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-afd68272-e16e-4cd1-89dc-12e8008f0cfd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:29.967279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-afd68272-e16e-4cd1-89dc-12e8008f0cfd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:29.967980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d8c08e00-a063-459f-8ec3-cbac1a6f486d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:29.977958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8c08e00-a063-459f-8ec3-cbac1a6f486d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:29.980292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8c08e00-a063-459f-8ec3-cbac1a6f486d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:29.981118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8c08e00-a063-459f-8ec3-cbac1a6f486d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:29.983960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8c08e00-a063-459f-8ec3-cbac1a6f486d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:29.984630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8c08e00-a063-459f-8ec3-cbac1a6f486d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:29.986683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afd68272-e16e-4cd1-89dc-12e8008f0cfd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:29.989083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afd68272-e16e-4cd1-89dc-12e8008f0cfd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:29.989410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8c08e00-a063-459f-8ec3-cbac1a6f486d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:29.989686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afd68272-e16e-4cd1-89dc-12e8008f0cfd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:29.989686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afd68272-e16e-4cd1-89dc-12e8008f0cfd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:29.989686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afd68272-e16e-4cd1-89dc-12e8008f0cfd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:29.989686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afd68272-e16e-4cd1-89dc-12e8008f0cfd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:30.274808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d8c08e00-a063-459f-8ec3-cbac1a6f486d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:30.285817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d8c08e00-a063-459f-8ec3-cbac1a6f486d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:30.290441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d8c08e00-a063-459f-8ec3-cbac1a6f486d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:30.308415 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d8c08e00-a063-459f-8ec3-cbac1a6f486d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1409 microversion: 2.75 time: 0.360045 Sep 06 10:55:30.320275 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 665/1296] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:29 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1409 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:30.330376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3521cf7c-492e-4418-b2b7-08f862fd37f8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:30.332883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3521cf7c-492e-4418-b2b7-08f862fd37f8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:30.342378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3521cf7c-492e-4418-b2b7-08f862fd37f8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:30.343187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3521cf7c-492e-4418-b2b7-08f862fd37f8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:30.352962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3521cf7c-492e-4418-b2b7-08f862fd37f8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:30.353929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3521cf7c-492e-4418-b2b7-08f862fd37f8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:30.354745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3521cf7c-492e-4418-b2b7-08f862fd37f8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:30.355380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3521cf7c-492e-4418-b2b7-08f862fd37f8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:30.356235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-afd68272-e16e-4cd1-89dc-12e8008f0cfd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:30.383607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-afd68272-e16e-4cd1-89dc-12e8008f0cfd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:30.385244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-afd68272-e16e-4cd1-89dc-12e8008f0cfd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:30.388133 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-afd68272-e16e-4cd1-89dc-12e8008f0cfd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.441215 Sep 06 10:55:30.403168 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 632/1297] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:29 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:30.429361 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3521cf7c-492e-4418-b2b7-08f862fd37f8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102130 Sep 06 10:55:30.450578 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 666/1298] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 10:55:30 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:55:30.520688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ae57cba3-2f11-49fc-96b0-5e582ebe783e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:30.521242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ae57cba3-2f11-49fc-96b0-5e582ebe783e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:30.536170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae57cba3-2f11-49fc-96b0-5e582ebe783e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:30.536778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae57cba3-2f11-49fc-96b0-5e582ebe783e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:30.538455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae57cba3-2f11-49fc-96b0-5e582ebe783e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:30.547785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae57cba3-2f11-49fc-96b0-5e582ebe783e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:30.547785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae57cba3-2f11-49fc-96b0-5e582ebe783e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:30.550488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae57cba3-2f11-49fc-96b0-5e582ebe783e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:30.573748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ad278ce3-c7e4-4dcc-a279-a9281d739c70 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:30.582417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ad278ce3-c7e4-4dcc-a279-a9281d739c70 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:30.595090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad278ce3-c7e4-4dcc-a279-a9281d739c70 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:30.595600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad278ce3-c7e4-4dcc-a279-a9281d739c70 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:30.596110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad278ce3-c7e4-4dcc-a279-a9281d739c70 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:30.596967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad278ce3-c7e4-4dcc-a279-a9281d739c70 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:30.597446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad278ce3-c7e4-4dcc-a279-a9281d739c70 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:30.597897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad278ce3-c7e4-4dcc-a279-a9281d739c70 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:30.656427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ad278ce3-c7e4-4dcc-a279-a9281d739c70 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:55:30.949623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=12 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:31.208508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ae57cba3-2f11-49fc-96b0-5e582ebe783e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:31.216393 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ae57cba3-2f11-49fc-96b0-5e582ebe783e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1521 microversion: 2.1 time: 0.700349 Sep 06 10:55:31.216972 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 633/1299] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:30 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1521 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:31.230062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ff59e4c-b5ee-4807-a685-c41368e17cb5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:31.231085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0ff59e4c-b5ee-4807-a685-c41368e17cb5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:31.236913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff59e4c-b5ee-4807-a685-c41368e17cb5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:31.237496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff59e4c-b5ee-4807-a685-c41368e17cb5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:31.238011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff59e4c-b5ee-4807-a685-c41368e17cb5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:31.238639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff59e4c-b5ee-4807-a685-c41368e17cb5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:31.239121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff59e4c-b5ee-4807-a685-c41368e17cb5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:31.239551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff59e4c-b5ee-4807-a685-c41368e17cb5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:31.289632 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ad278ce3-c7e4-4dcc-a279-a9281d739c70 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 204 len: 0 microversion: 2.1 time: 0.723444 Sep 06 10:55:31.290242 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 667/1300] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:55:30 2022] DELETE /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:55:31.305487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e84b2a11-85fe-450c-ad55-77cf47cd6e1d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f85cedc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:31.415796 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e84b2a11-85fe-450c-ad55-77cf47cd6e1d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.112243 Sep 06 10:55:31.424768 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 668/1301] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:31 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:31.451028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3075edb6-19ca-4d47-be5f-4c0d0f5476ea tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:31.453535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3075edb6-19ca-4d47-be5f-4c0d0f5476ea tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: a2fe43cc-0af8-4ca0-9083-61b0f76aaa10] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:31.467899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3075edb6-19ca-4d47-be5f-4c0d0f5476ea tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:31.468745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3075edb6-19ca-4d47-be5f-4c0d0f5476ea tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:31.469501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3075edb6-19ca-4d47-be5f-4c0d0f5476ea tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:31.471236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3075edb6-19ca-4d47-be5f-4c0d0f5476ea tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:31.475402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3075edb6-19ca-4d47-be5f-4c0d0f5476ea tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:31.477950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3075edb6-19ca-4d47-be5f-4c0d0f5476ea tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:31.481827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:31.527322 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-3075edb6-19ca-4d47-be5f-4c0d0f5476ea tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] HTTP exception thrown: Instance a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 could not be found. Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3075edb6-19ca-4d47-be5f-4c0d0f5476ea tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Request method failure captured: Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 HTTP/1.1 Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaCvQA1vgxe6NJcVr1HVKu6pZihgUIj4mL8BkOge8zRFI7rwLmBnTsT-B4nNK_35WcVMpQKM_-P6xliIR9y2UGqQoFv3WTKAj8nlYpRtudb5AYIoa2ASGvy9kfOmKLkXaOjIQ5X85RaLmHzjGT33k4TFrlkuSad3tJr2z8mhF1mDC4 Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 37509f3214ec4a83a0db84a1c5377690 Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersAdminTestJSON-282434587 Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:55:31.529208 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:55:31.530903 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37509f3214ec4a83a0db84a1c5377690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37509f3214ec4a83a0db84a1c5377690"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37509f3214ec4a83a0db84a1c5377690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37509f3214ec4a83a0db84a1c5377690"}]}] Sep 06 10:55:31.530903 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersAdminTestJSON-282434587 Sep 06 10:55:31.530903 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 37509f3214ec4a83a0db84a1c5377690 Sep 06 10:55:31.530903 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersAdminTestJSON-282434587 Sep 06 10:55:31.530903 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersAdminTestJSON-282434587-project Sep 06 10:55:31.530903 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:55:31.530903 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:55:31.530903 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 42a1b77561bd4df3a751dea07b1c6cda Sep 06 10:55:31.530903 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersAdminTestJSON-282434587-project Sep 06 10:55:31.530903 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:55:31.530903 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 could not be found. Sep 06 10:55:31.530903 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'a2fe43cc-0af8-4ca0-9083-61b0f76aaa10'} Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 could not be found. Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:31.531905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 could not be found. Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 could not be found. Sep 06 10:55:31.533840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:31.536021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3075edb6-19ca-4d47-be5f-4c0d0f5476ea tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Returning 404 to user: Instance a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:31.536021 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3075edb6-19ca-4d47-be5f-4c0d0f5476ea tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10" status: 404 len: 111 microversion: 2.1 time: 0.109090 Sep 06 10:55:31.536021 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 669/1302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:31 2022] GET /compute/v2.1/servers/a2fe43cc-0af8-4ca0-9083-61b0f76aaa10 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:31.541127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-35c0c03a-e4dd-45db-9a66-eb78dea0365e tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:31.542471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-35c0c03a-e4dd-45db-9a66-eb78dea0365e tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:31.556801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35c0c03a-e4dd-45db-9a66-eb78dea0365e tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:31.557299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35c0c03a-e4dd-45db-9a66-eb78dea0365e tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:31.557741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35c0c03a-e4dd-45db-9a66-eb78dea0365e tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:31.559264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35c0c03a-e4dd-45db-9a66-eb78dea0365e tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:31.559611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35c0c03a-e4dd-45db-9a66-eb78dea0365e tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:31.560327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35c0c03a-e4dd-45db-9a66-eb78dea0365e tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:31.856018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0ff59e4c-b5ee-4807-a685-c41368e17cb5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:31.918584 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0ff59e4c-b5ee-4807-a685-c41368e17cb5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1719 microversion: 2.1 time: 0.676836 Sep 06 10:55:31.918584 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 634/1303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:31 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1719 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:31.923345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-77ea9079-d7d5-47b1-8d20-d8ff110d23e7 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:31.925769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-77ea9079-d7d5-47b1-8d20-d8ff110d23e7 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:31.950458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77ea9079-d7d5-47b1-8d20-d8ff110d23e7 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:31.950458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77ea9079-d7d5-47b1-8d20-d8ff110d23e7 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:31.950458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77ea9079-d7d5-47b1-8d20-d8ff110d23e7 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:31.950458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77ea9079-d7d5-47b1-8d20-d8ff110d23e7 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:31.950906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77ea9079-d7d5-47b1-8d20-d8ff110d23e7 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:31.950906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77ea9079-d7d5-47b1-8d20-d8ff110d23e7 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:31.951126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-35c0c03a-e4dd-45db-9a66-eb78dea0365e tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:31.970794 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-35c0c03a-e4dd-45db-9a66-eb78dea0365e tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1679 microversion: 2.1 time: 0.431171 Sep 06 10:55:31.974005 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 670/1304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:31 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1679 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:32.002348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cf8e6d06-84ee-402c-8feb-c4777818f9ca tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:32.003246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cf8e6d06-84ee-402c-8feb-c4777818f9ca tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:32.015671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf8e6d06-84ee-402c-8feb-c4777818f9ca tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:32.016443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf8e6d06-84ee-402c-8feb-c4777818f9ca tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:32.017233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf8e6d06-84ee-402c-8feb-c4777818f9ca tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:32.018321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf8e6d06-84ee-402c-8feb-c4777818f9ca tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:32.019203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf8e6d06-84ee-402c-8feb-c4777818f9ca tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:32.019863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf8e6d06-84ee-402c-8feb-c4777818f9ca tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:32.051709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-77ea9079-d7d5-47b1-8d20-d8ff110d23e7 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:32.067002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-77ea9079-d7d5-47b1-8d20-d8ff110d23e7 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:32.074016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-77ea9079-d7d5-47b1-8d20-d8ff110d23e7 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:32.083854 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-77ea9079-d7d5-47b1-8d20-d8ff110d23e7 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1427 microversion: 2.75 time: 0.167561 Sep 06 10:55:32.085582 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 635/1305] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:31 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1427 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:32.090312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3b058a0e-30b8-4223-a101-cd889a4e9f34 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:32.091067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3b058a0e-30b8-4223-a101-cd889a4e9f34 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:32.098517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b058a0e-30b8-4223-a101-cd889a4e9f34 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:32.112783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b058a0e-30b8-4223-a101-cd889a4e9f34 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:32.114019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b058a0e-30b8-4223-a101-cd889a4e9f34 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:32.116359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b058a0e-30b8-4223-a101-cd889a4e9f34 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:32.117750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b058a0e-30b8-4223-a101-cd889a4e9f34 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:32.118506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b058a0e-30b8-4223-a101-cd889a4e9f34 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:32.164078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3b058a0e-30b8-4223-a101-cd889a4e9f34 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:55:32.470256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cf8e6d06-84ee-402c-8feb-c4777818f9ca tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:32.482385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cf8e6d06-84ee-402c-8feb-c4777818f9ca tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:32.484160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cf8e6d06-84ee-402c-8feb-c4777818f9ca tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:32.485661 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cf8e6d06-84ee-402c-8feb-c4777818f9ca tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.510350 Sep 06 10:55:32.487089 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 671/1306] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:31 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:32.494807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-44be0c05-e2a8-475e-b578-095fb7638463 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:32.495692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-44be0c05-e2a8-475e-b578-095fb7638463 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:32.504416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44be0c05-e2a8-475e-b578-095fb7638463 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:32.504923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44be0c05-e2a8-475e-b578-095fb7638463 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:32.505516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44be0c05-e2a8-475e-b578-095fb7638463 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:32.506923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44be0c05-e2a8-475e-b578-095fb7638463 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:32.507451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44be0c05-e2a8-475e-b578-095fb7638463 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:32.507890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44be0c05-e2a8-475e-b578-095fb7638463 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:32.522490 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3b058a0e-30b8-4223-a101-cd889a4e9f34 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "DELETE /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 204 len: 0 microversion: 2.1 time: 0.435015 Sep 06 10:55:32.526796 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 636/1307] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:55:32 2022] DELETE /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:55:32.530719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d2b165ed-dc36-4f7e-9cdb-e8d519cb9bce tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8a7cb80>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:32.612268 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d2b165ed-dc36-4f7e-9cdb-e8d519cb9bce tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.086991 Sep 06 10:55:32.613847 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 637/1308] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:32 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:32.619467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-25582011-475e-4983-994f-96901949723f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:32.620536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-25582011-475e-4983-994f-96901949723f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:32.629677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25582011-475e-4983-994f-96901949723f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:32.630489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25582011-475e-4983-994f-96901949723f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:32.631041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25582011-475e-4983-994f-96901949723f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:32.631948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25582011-475e-4983-994f-96901949723f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:32.632423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25582011-475e-4983-994f-96901949723f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:32.632913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25582011-475e-4983-994f-96901949723f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:33.015159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-25582011-475e-4983-994f-96901949723f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:33.033310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-44be0c05-e2a8-475e-b578-095fb7638463 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:33.041383 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-44be0c05-e2a8-475e-b578-095fb7638463 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1521 microversion: 2.1 time: 0.553221 Sep 06 10:55:33.055678 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-25582011-475e-4983-994f-96901949723f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1469 microversion: 2.1 time: 0.414644 Sep 06 10:55:33.057166 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 638/1309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:32 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1469 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:33.059803 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 672/1310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:32 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:33.065312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a2edc0fb-7110-4d23-bece-f40bbe6e90b6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:33.065929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a2edc0fb-7110-4d23-bece-f40bbe6e90b6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:33.071848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-68d80482-9cd2-402f-8a3a-102c3b075023 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:33.072464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-68d80482-9cd2-402f-8a3a-102c3b075023 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:33.082509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2edc0fb-7110-4d23-bece-f40bbe6e90b6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:33.083063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2edc0fb-7110-4d23-bece-f40bbe6e90b6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:33.091701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2edc0fb-7110-4d23-bece-f40bbe6e90b6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:33.091701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2edc0fb-7110-4d23-bece-f40bbe6e90b6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:33.091701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2edc0fb-7110-4d23-bece-f40bbe6e90b6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:33.091701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2edc0fb-7110-4d23-bece-f40bbe6e90b6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:33.092283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68d80482-9cd2-402f-8a3a-102c3b075023 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:33.092283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68d80482-9cd2-402f-8a3a-102c3b075023 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:33.092283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68d80482-9cd2-402f-8a3a-102c3b075023 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:33.092283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68d80482-9cd2-402f-8a3a-102c3b075023 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:33.092651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68d80482-9cd2-402f-8a3a-102c3b075023 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:33.092651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68d80482-9cd2-402f-8a3a-102c3b075023 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:33.526172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a2edc0fb-7110-4d23-bece-f40bbe6e90b6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:33.540969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-68d80482-9cd2-402f-8a3a-102c3b075023 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:33.560467 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a2edc0fb-7110-4d23-bece-f40bbe6e90b6 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1719 microversion: 2.1 time: 0.502119 Sep 06 10:55:33.561263 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 639/1311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:33 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1719 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:33.561577 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-68d80482-9cd2-402f-8a3a-102c3b075023 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1679 microversion: 2.1 time: 0.498166 Sep 06 10:55:33.576688 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 673/1312] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:33 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1679 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:33.598507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-83070f79-ea47-4302-ac18-096af5b1cdfa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:33.599707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-83070f79-ea47-4302-ac18-096af5b1cdfa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:33.601396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-69beeb50-254e-4b4d-a1e4-cf8d005f971f tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:33.608539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-69beeb50-254e-4b4d-a1e4-cf8d005f971f tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:33.625735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83070f79-ea47-4302-ac18-096af5b1cdfa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:33.626415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83070f79-ea47-4302-ac18-096af5b1cdfa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:33.626755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83070f79-ea47-4302-ac18-096af5b1cdfa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:33.631593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83070f79-ea47-4302-ac18-096af5b1cdfa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:33.632101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69beeb50-254e-4b4d-a1e4-cf8d005f971f tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:33.632226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83070f79-ea47-4302-ac18-096af5b1cdfa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:33.632617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83070f79-ea47-4302-ac18-096af5b1cdfa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:33.636466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69beeb50-254e-4b4d-a1e4-cf8d005f971f tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:33.640279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69beeb50-254e-4b4d-a1e4-cf8d005f971f tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:33.641479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69beeb50-254e-4b4d-a1e4-cf8d005f971f tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:33.642189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69beeb50-254e-4b4d-a1e4-cf8d005f971f tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:33.642874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69beeb50-254e-4b4d-a1e4-cf8d005f971f tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:33.890755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-69beeb50-254e-4b4d-a1e4-cf8d005f971f tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:33.906779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-69beeb50-254e-4b4d-a1e4-cf8d005f971f tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:33.911359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-69beeb50-254e-4b4d-a1e4-cf8d005f971f tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:33.921295 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-69beeb50-254e-4b4d-a1e4-cf8d005f971f tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1415 microversion: 2.75 time: 0.336916 Sep 06 10:55:33.935376 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 640/1313] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:33 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1415 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:33.941585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d894930d-6e2a-4f99-bdf2-8a7a7d862f9d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8bc0940>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:34.032362 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d894930d-6e2a-4f99-bdf2-8a7a7d862f9d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.095138 Sep 06 10:55:34.033060 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 641/1314] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:33 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:34.067329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8a49deb6-a9ed-4a0d-983c-bf5c8f140b10 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:34.067852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8a49deb6-a9ed-4a0d-983c-bf5c8f140b10 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:34.075030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a49deb6-a9ed-4a0d-983c-bf5c8f140b10 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:34.075760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a49deb6-a9ed-4a0d-983c-bf5c8f140b10 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:34.091574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a49deb6-a9ed-4a0d-983c-bf5c8f140b10 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:34.093929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a49deb6-a9ed-4a0d-983c-bf5c8f140b10 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:34.094844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a49deb6-a9ed-4a0d-983c-bf5c8f140b10 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:34.095557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a49deb6-a9ed-4a0d-983c-bf5c8f140b10 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:34.304857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-83070f79-ea47-4302-ac18-096af5b1cdfa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:34.317229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-83070f79-ea47-4302-ac18-096af5b1cdfa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:34.326097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-83070f79-ea47-4302-ac18-096af5b1cdfa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:34.326097 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-83070f79-ea47-4302-ac18-096af5b1cdfa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1814 microversion: 2.25 time: 0.738543 Sep 06 10:55:34.326097 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 674/1315] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:33 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1814 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:34.330260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2d567081-95be-4b3f-8f6e-d27227fd892f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:34.331201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2d567081-95be-4b3f-8f6e-d27227fd892f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:34.337704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d567081-95be-4b3f-8f6e-d27227fd892f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:34.338716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d567081-95be-4b3f-8f6e-d27227fd892f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:34.339588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d567081-95be-4b3f-8f6e-d27227fd892f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:34.340597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d567081-95be-4b3f-8f6e-d27227fd892f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:34.341375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d567081-95be-4b3f-8f6e-d27227fd892f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:34.342019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d567081-95be-4b3f-8f6e-d27227fd892f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:34.683747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8a49deb6-a9ed-4a0d-983c-bf5c8f140b10 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:34.686160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:34.695782 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8a49deb6-a9ed-4a0d-983c-bf5c8f140b10 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1521 microversion: 2.1 time: 0.632584 Sep 06 10:55:34.696367 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 642/1316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:34 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1521 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:34.708519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7d563763-26ff-4e06-ba24-76a4670dbc8b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:34.709390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7d563763-26ff-4e06-ba24-76a4670dbc8b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:34.723615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d563763-26ff-4e06-ba24-76a4670dbc8b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:34.725746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d563763-26ff-4e06-ba24-76a4670dbc8b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:34.732343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d563763-26ff-4e06-ba24-76a4670dbc8b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:34.737808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d563763-26ff-4e06-ba24-76a4670dbc8b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:34.737808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d563763-26ff-4e06-ba24-76a4670dbc8b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:34.737808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d563763-26ff-4e06-ba24-76a4670dbc8b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:34.906956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2d567081-95be-4b3f-8f6e-d27227fd892f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:34.933360 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2d567081-95be-4b3f-8f6e-d27227fd892f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1469 microversion: 2.1 time: 0.606334 Sep 06 10:55:34.950709 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 675/1317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:34 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1469 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:34.957256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed2bb835-80d1-49e9-9b4c-98821a2d677f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:34.958235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ed2bb835-80d1-49e9-9b4c-98821a2d677f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:34.979431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed2bb835-80d1-49e9-9b4c-98821a2d677f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:34.980054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed2bb835-80d1-49e9-9b4c-98821a2d677f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:34.980774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed2bb835-80d1-49e9-9b4c-98821a2d677f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:34.981594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed2bb835-80d1-49e9-9b4c-98821a2d677f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:34.982890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed2bb835-80d1-49e9-9b4c-98821a2d677f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:34.983734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed2bb835-80d1-49e9-9b4c-98821a2d677f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:35.669580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7d563763-26ff-4e06-ba24-76a4670dbc8b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:35.700454 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7d563763-26ff-4e06-ba24-76a4670dbc8b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1719 microversion: 2.1 time: 1.001358 Sep 06 10:55:35.701414 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 643/1318] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:34 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1719 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:35.707079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d9cb73fb-e6b1-4045-b043-feb98c31e424 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:35.707702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d9cb73fb-e6b1-4045-b043-feb98c31e424 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:35.716755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9cb73fb-e6b1-4045-b043-feb98c31e424 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:35.717379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9cb73fb-e6b1-4045-b043-feb98c31e424 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:35.717903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9cb73fb-e6b1-4045-b043-feb98c31e424 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:35.718701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9cb73fb-e6b1-4045-b043-feb98c31e424 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:35.719311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9cb73fb-e6b1-4045-b043-feb98c31e424 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:35.719816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9cb73fb-e6b1-4045-b043-feb98c31e424 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:35.874286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ed2bb835-80d1-49e9-9b4c-98821a2d677f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:35.891577 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ed2bb835-80d1-49e9-9b4c-98821a2d677f tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1679 microversion: 2.1 time: 0.945342 Sep 06 10:55:35.892297 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 676/1319] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:34 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1679 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:35.899341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ff238781-b3f3-40cb-aa78-062a70332be4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f853cca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:35.900548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d9cb73fb-e6b1-4045-b043-feb98c31e424 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:35.918342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d9cb73fb-e6b1-4045-b043-feb98c31e424 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:35.920934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d9cb73fb-e6b1-4045-b043-feb98c31e424 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:35.926226 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d9cb73fb-e6b1-4045-b043-feb98c31e424 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1415 microversion: 2.75 time: 0.223524 Sep 06 10:55:35.926934 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 644/1320] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:35 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1415 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:35.935515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2586819d-f0bd-48a3-9520-efaf93a2e68a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:35.935515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2586819d-f0bd-48a3-9520-efaf93a2e68a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:35.940567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2586819d-f0bd-48a3-9520-efaf93a2e68a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:35.941197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=10 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:35.941456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2586819d-f0bd-48a3-9520-efaf93a2e68a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:35.942034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2586819d-f0bd-48a3-9520-efaf93a2e68a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:35.942841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2586819d-f0bd-48a3-9520-efaf93a2e68a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:35.943547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2586819d-f0bd-48a3-9520-efaf93a2e68a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:35.944193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2586819d-f0bd-48a3-9520-efaf93a2e68a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:35.953566 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ff238781-b3f3-40cb-aa78-062a70332be4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.060086 Sep 06 10:55:35.954080 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 677/1321] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:35 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:35.958542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d5a788cb-6cf0-4170-a512-db3937521e5e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:35.959187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d5a788cb-6cf0-4170-a512-db3937521e5e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:35.967313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5a788cb-6cf0-4170-a512-db3937521e5e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:35.967817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5a788cb-6cf0-4170-a512-db3937521e5e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:35.968268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5a788cb-6cf0-4170-a512-db3937521e5e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:35.969594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5a788cb-6cf0-4170-a512-db3937521e5e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:35.970067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5a788cb-6cf0-4170-a512-db3937521e5e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:35.970505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5a788cb-6cf0-4170-a512-db3937521e5e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:35.970964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:36.424738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2586819d-f0bd-48a3-9520-efaf93a2e68a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:36.454590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d5a788cb-6cf0-4170-a512-db3937521e5e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:36.487629 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d5a788cb-6cf0-4170-a512-db3937521e5e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1521 microversion: 2.1 time: 0.517619 Sep 06 10:55:36.488482 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 678/1322] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:35 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:36.517266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7be44122-989d-4a21-a963-7572c74d360f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:36.521299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7be44122-989d-4a21-a963-7572c74d360f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:36.525195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2586819d-f0bd-48a3-9520-efaf93a2e68a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:36.534484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2586819d-f0bd-48a3-9520-efaf93a2e68a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:36.537262 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2586819d-f0bd-48a3-9520-efaf93a2e68a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1804 microversion: 2.25 time: 0.609013 Sep 06 10:55:36.545899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7be44122-989d-4a21-a963-7572c74d360f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:36.546662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7be44122-989d-4a21-a963-7572c74d360f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:36.548937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7be44122-989d-4a21-a963-7572c74d360f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:36.550620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7be44122-989d-4a21-a963-7572c74d360f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:36.558395 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 645/1323] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:35 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1804 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:36.562506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7be44122-989d-4a21-a963-7572c74d360f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:36.564377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7be44122-989d-4a21-a963-7572c74d360f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:36.605299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-04048725-adc1-4e96-a4bf-51e73da6d187 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '.version_select at 0x7f90f87fa9d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:36.616038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04048725-adc1-4e96-a4bf-51e73da6d187 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:36.619845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04048725-adc1-4e96-a4bf-51e73da6d187 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:36.622158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04048725-adc1-4e96-a4bf-51e73da6d187 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:36.667691 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-04048725-adc1-4e96-a4bf-51e73da6d187 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3024 microversion: 2.25 time: 0.091615 Sep 06 10:55:36.671589 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 646/1324] 10.222.0.20 () {60 vars in 1184 bytes} [Tue Sep 6 10:55:36 2022] GET /compute/v2.1/os-migrations => generated 3024 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:36.789548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7be44122-989d-4a21-a963-7572c74d360f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:36.797701 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7be44122-989d-4a21-a963-7572c74d360f tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1427 microversion: 2.1 time: 0.306350 Sep 06 10:55:36.798288 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 679/1325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:36 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1427 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:36.831444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f00fc10a-6ee0-4c21-a312-39671a3524ff tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:36.832585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f00fc10a-6ee0-4c21-a312-39671a3524ff tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:36.845013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f00fc10a-6ee0-4c21-a312-39671a3524ff tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:36.847718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f00fc10a-6ee0-4c21-a312-39671a3524ff tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:36.851744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f00fc10a-6ee0-4c21-a312-39671a3524ff tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:36.852763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f00fc10a-6ee0-4c21-a312-39671a3524ff tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:36.853407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f00fc10a-6ee0-4c21-a312-39671a3524ff tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:36.860686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f00fc10a-6ee0-4c21-a312-39671a3524ff tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:37.292613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-fb7fee43-9c37-418c-99a9-b7d2723c12b9 req-d0c2a29b-f519-4f1f-854b-734a72813776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf2c50a-91cd-4042-914e-c85ff9025b00", "name": "network-vif-deleted", "tag": "affae396-3552-4226-bc04-afb350e6137f"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:37.297147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-f00fc10a-6ee0-4c21-a312-39671a3524ff tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid 31a4ea2a-aa16-4e41-af83-b027dfe81828 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:37.328832 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f00fc10a-6ee0-4c21-a312-39671a3524ff tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 2423 microversion: 2.25 time: 0.510166 Sep 06 10:55:37.331425 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 680/1326] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:36 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 2423 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:37.333592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fb7fee43-9c37-418c-99a9-b7d2723c12b9 req-d0c2a29b-f519-4f1f-854b-734a72813776 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:37.338147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fb7fee43-9c37-418c-99a9-b7d2723c12b9 req-d0c2a29b-f519-4f1f-854b-734a72813776 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:37.340896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb68db14-34c9-492c-b204-f324f62d8423 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:37.341118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fb7fee43-9c37-418c-99a9-b7d2723c12b9 req-d0c2a29b-f519-4f1f-854b-734a72813776 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:37.341477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fb68db14-34c9-492c-b204-f324f62d8423 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:37.350411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb68db14-34c9-492c-b204-f324f62d8423 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:37.351102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb68db14-34c9-492c-b204-f324f62d8423 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:37.354940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb68db14-34c9-492c-b204-f324f62d8423 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:37.354940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb68db14-34c9-492c-b204-f324f62d8423 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:37.354940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb68db14-34c9-492c-b204-f324f62d8423 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:37.354940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb68db14-34c9-492c-b204-f324f62d8423 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:37.381582 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-fb7fee43-9c37-418c-99a9-b7d2723c12b9 req-d0c2a29b-f519-4f1f-854b-734a72813776 service nova] Creating event network-vif-deleted:affae396-3552-4226-bc04-afb350e6137f for instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 on nch2-master-1 Sep 06 10:55:37.401203 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-fb7fee43-9c37-418c-99a9-b7d2723c12b9 req-d0c2a29b-f519-4f1f-854b-734a72813776 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.727532 Sep 06 10:55:37.403907 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 647/1327] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:37.425886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:37.432390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:37.446949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:37.446949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:37.446949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:37.446949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:37.451534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:37.452671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:37.534478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=10 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:37.604691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:37.616058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:37.617185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:37.617652 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lazy-loading 'fault' on Instance uuid 8bf2c50a-91cd-4042-914e-c85ff9025b00 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:37.813153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6559ac446c4640218ce700687045bb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:37.829656 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-59647d1a-03bb-4a22-9a57-a5fc6f43aec9 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 200 len: 1330 microversion: 2.1 time: 0.424335 Sep 06 10:55:37.847958 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 648/1328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:37 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 1330 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:37.866825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f424a759-af90-45c8-b688-e19a92ec1ee8 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:37.867470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f424a759-af90-45c8-b688-e19a92ec1ee8 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:37.881260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f424a759-af90-45c8-b688-e19a92ec1ee8 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:37.885680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f424a759-af90-45c8-b688-e19a92ec1ee8 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:37.886153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f424a759-af90-45c8-b688-e19a92ec1ee8 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:37.886957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f424a759-af90-45c8-b688-e19a92ec1ee8 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:37.887539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f424a759-af90-45c8-b688-e19a92ec1ee8 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:37.887983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f424a759-af90-45c8-b688-e19a92ec1ee8 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:37.889663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fb68db14-34c9-492c-b204-f324f62d8423 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:37.908476 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fb68db14-34c9-492c-b204-f324f62d8423 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1709 microversion: 2.1 time: 0.575792 Sep 06 10:55:37.919052 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 681/1329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:37 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1709 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:37.927995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e56621ca-3e92-4304-8f3b-769b223cd511 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f848bee0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:38.005366 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e56621ca-3e92-4304-8f3b-769b223cd511 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.085026 Sep 06 10:55:38.016770 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 682/1330] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:37 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:38.031245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b26e910e-b3a3-43ea-b6c4-dc726e0657f3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:38.036421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b26e910e-b3a3-43ea-b6c4-dc726e0657f3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:38.046304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b26e910e-b3a3-43ea-b6c4-dc726e0657f3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:38.047083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b26e910e-b3a3-43ea-b6c4-dc726e0657f3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:38.047700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b26e910e-b3a3-43ea-b6c4-dc726e0657f3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:38.056570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b26e910e-b3a3-43ea-b6c4-dc726e0657f3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:38.067901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b26e910e-b3a3-43ea-b6c4-dc726e0657f3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:38.070485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b26e910e-b3a3-43ea-b6c4-dc726e0657f3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:38.080287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f424a759-af90-45c8-b688-e19a92ec1ee8 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:38.093111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f424a759-af90-45c8-b688-e19a92ec1ee8 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:38.096913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f424a759-af90-45c8-b688-e19a92ec1ee8 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:38.108196 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f424a759-af90-45c8-b688-e19a92ec1ee8 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1436 microversion: 2.75 time: 0.258668 Sep 06 10:55:38.114308 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 649/1331] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:37 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1436 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:38.145256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8defabf6-29ed-4f7f-8e8d-8be2b6c7d105 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:38.145256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8defabf6-29ed-4f7f-8e8d-8be2b6c7d105 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:38.153445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8defabf6-29ed-4f7f-8e8d-8be2b6c7d105 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:38.154225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8defabf6-29ed-4f7f-8e8d-8be2b6c7d105 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:38.154971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8defabf6-29ed-4f7f-8e8d-8be2b6c7d105 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:38.155872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8defabf6-29ed-4f7f-8e8d-8be2b6c7d105 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:38.156487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8defabf6-29ed-4f7f-8e8d-8be2b6c7d105 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:38.157066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8defabf6-29ed-4f7f-8e8d-8be2b6c7d105 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:38.412381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8defabf6-29ed-4f7f-8e8d-8be2b6c7d105 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:38.431825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-b26e910e-b3a3-43ea-b6c4-dc726e0657f3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid 31a4ea2a-aa16-4e41-af83-b027dfe81828 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:38.433813 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8defabf6-29ed-4f7f-8e8d-8be2b6c7d105 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1521 microversion: 2.1 time: 0.308710 Sep 06 10:55:38.439096 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 650/1332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:38 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:38.458517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:38.459603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:38.466664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:38.467546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:38.468574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:38.469645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:38.470278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:38.470982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:38.513718 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b26e910e-b3a3-43ea-b6c4-dc726e0657f3 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 2423 microversion: 2.25 time: 0.495492 Sep 06 10:55:38.519826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:38.524599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:38.528021 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 683/1333] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:38 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 2423 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:38.539554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:38.540499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lazy-loading 'fault' on Instance uuid 58b77047-0abe-4fe2-8f93-41a27feb4861 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:38.575321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dbac0616-fb5d-417b-8398-5d42181cade5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '.version_select at 0x7f90f8796700>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:38.587997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbac0616-fb5d-417b-8398-5d42181cade5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:38.588646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbac0616-fb5d-417b-8398-5d42181cade5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:38.589112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbac0616-fb5d-417b-8398-5d42181cade5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:38.625575 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dbac0616-fb5d-417b-8398-5d42181cade5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.092661 Sep 06 10:55:38.639755 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 684/1334] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 10:55:38 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:38.650635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:38.664189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:38.670044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:38.673992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:38.674844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:38.675636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:38.676553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:38.677215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:38.677961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:38.684199 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e07a86b9-6b29-4b63-9d66-e4d328fba019 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 200 len: 1304 microversion: 2.1 time: 0.243781 Sep 06 10:55:38.684802 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 651/1335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:38 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 1304 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:38.724519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3d826f2f-fce3-47ce-9204-59feb19923ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:38.724519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3d826f2f-fce3-47ce-9204-59feb19923ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:38.739566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d826f2f-fce3-47ce-9204-59feb19923ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:38.740088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d826f2f-fce3-47ce-9204-59feb19923ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:38.745267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d826f2f-fce3-47ce-9204-59feb19923ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:38.747991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d826f2f-fce3-47ce-9204-59feb19923ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:38.748493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d826f2f-fce3-47ce-9204-59feb19923ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:38.748942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d826f2f-fce3-47ce-9204-59feb19923ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:38.841515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:55:38.842097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:55:38.845602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:55:38.848894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:55:38.854189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:55:39.080287 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3d826f2f-fce3-47ce-9204-59feb19923ca tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1860 microversion: 2.1 time: 0.388939 Sep 06 10:55:39.081952 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 652/1336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:38 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1860 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:39.098834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f432e34f-d4e5-433b-be4f-f8ea3323b069 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:39.101713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f432e34f-d4e5-433b-be4f-f8ea3323b069 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:39.128070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f432e34f-d4e5-433b-be4f-f8ea3323b069 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:39.131555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f432e34f-d4e5-433b-be4f-f8ea3323b069 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:39.132416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f432e34f-d4e5-433b-be4f-f8ea3323b069 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:39.133574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f432e34f-d4e5-433b-be4f-f8ea3323b069 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:39.134333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f432e34f-d4e5-433b-be4f-f8ea3323b069 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:39.138439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f432e34f-d4e5-433b-be4f-f8ea3323b069 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:39.207225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:39.221912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:39.222732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:39.224168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:39.225138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:39.226353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:39.226955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:39.378404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-f432e34f-d4e5-433b-be4f-f8ea3323b069 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lazy-loading 'services' on Instance uuid 31a4ea2a-aa16-4e41-af83-b027dfe81828 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:39.480488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:39.492616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:39.502370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:39.509814 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f089b860-bf26-4438-87ff-d5edef9865c6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "POST /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db/action" status: 202 len: 1493 microversion: 2.75 time: 0.868624 Sep 06 10:55:39.527372 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 685/1337] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 10:55:38 2022] POST /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db/action => generated 1493 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 06 10:55:39.554479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-948a6195-8315-4333-8c33-72b7d6db3ab8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:39.557109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-948a6195-8315-4333-8c33-72b7d6db3ab8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:39.574247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-948a6195-8315-4333-8c33-72b7d6db3ab8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:39.576853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-948a6195-8315-4333-8c33-72b7d6db3ab8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:39.580178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-948a6195-8315-4333-8c33-72b7d6db3ab8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:39.580955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-948a6195-8315-4333-8c33-72b7d6db3ab8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:39.582670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-948a6195-8315-4333-8c33-72b7d6db3ab8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:39.586962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-948a6195-8315-4333-8c33-72b7d6db3ab8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:39.590768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:39.614027 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-948a6195-8315-4333-8c33-72b7d6db3ab8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] HTTP exception thrown: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-948a6195-8315-4333-8c33-72b7d6db3ab8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Request method failure captured: Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 HTTP/1.1 Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaMHiK0gzmd9scrpv9wlfY2-sOW_gyrGvUI3ISlqv2hlJG66yKdOOci1ZUKGdumB4gAyzdxfdxgOOJePlCTSZzbIPEiUP0hQ9hYelAFQta5paIVQX6qDVwTCVfR6aCcW5RCeSEo0RJaRa8R4gNwnSb5AJk4b9b7htAtE7Gdh5pu8Jo Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: c75bc66c9c9b4fc4b76380e47b40b0b5 Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1362206888 Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:55:39.617503 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:55:39.619676 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c75bc66c9c9b4fc4b76380e47b40b0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c75bc66c9c9b4fc4b76380e47b40b0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c75bc66c9c9b4fc4b76380e47b40b0b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c75bc66c9c9b4fc4b76380e47b40b0b5"}]}] Sep 06 10:55:39.619676 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1362206888 Sep 06 10:55:39.619676 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: c75bc66c9c9b4fc4b76380e47b40b0b5 Sep 06 10:55:39.619676 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1362206888 Sep 06 10:55:39.619676 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachSCSIVolumeTestJSON-1362206888-project Sep 06 10:55:39.619676 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:55:39.619676 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:55:39.619676 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6559ac446c4640218ce700687045bb0d Sep 06 10:55:39.619676 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1362206888-project Sep 06 10:55:39.619676 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:55:39.619676 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:39.619676 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '8bf2c50a-91cd-4042-914e-c85ff9025b00'} Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:39.620640 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:39.622133 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:39.626420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-948a6195-8315-4333-8c33-72b7d6db3ab8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Returning 404 to user: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:39.627670 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-948a6195-8315-4333-8c33-72b7d6db3ab8 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 404 len: 111 microversion: 2.1 time: 0.099083 Sep 06 10:55:39.628438 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 686/1338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:39 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:39.649483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e44b1a5b-2116-406e-ac7b-a45b193b00c1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f870d670>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:39.695913 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f432e34f-d4e5-433b-be4f-f8ea3323b069 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828/os-volume_attachments/9a09ca45-0cf7-41bb-9c57-37de9f850cf0" status: 202 len: 0 microversion: 2.25 time: 0.612263 Sep 06 10:55:39.696945 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 653/1339] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Sep 6 10:55:39 2022] DELETE /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828/os-volume_attachments/9a09ca45-0cf7-41bb-9c57-37de9f850cf0 => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:55:39.702675 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e44b1a5b-2116-406e-ac7b-a45b193b00c1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.072630 Sep 06 10:55:39.703410 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 687/1340] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:39 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:39.710486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0032172b-45e0-410d-bcf7-5a8611c9d0fa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:39.711178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0f4f8b7d-df01-4084-9996-5b53a061825b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:39.711684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0032172b-45e0-410d-bcf7-5a8611c9d0fa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:39.712051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0f4f8b7d-df01-4084-9996-5b53a061825b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:39.721691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0032172b-45e0-410d-bcf7-5a8611c9d0fa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:39.721959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f4f8b7d-df01-4084-9996-5b53a061825b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:39.722612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0032172b-45e0-410d-bcf7-5a8611c9d0fa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:39.722976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f4f8b7d-df01-4084-9996-5b53a061825b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:39.723306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0032172b-45e0-410d-bcf7-5a8611c9d0fa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:39.723947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f4f8b7d-df01-4084-9996-5b53a061825b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:39.724384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0032172b-45e0-410d-bcf7-5a8611c9d0fa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:39.724948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0032172b-45e0-410d-bcf7-5a8611c9d0fa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:39.726035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0032172b-45e0-410d-bcf7-5a8611c9d0fa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:39.726571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f4f8b7d-df01-4084-9996-5b53a061825b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:39.727259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f4f8b7d-df01-4084-9996-5b53a061825b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:39.727859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f4f8b7d-df01-4084-9996-5b53a061825b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:40.052437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0032172b-45e0-410d-bcf7-5a8611c9d0fa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:40.062312 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0032172b-45e0-410d-bcf7-5a8611c9d0fa tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1521 microversion: 2.1 time: 0.357224 Sep 06 10:55:40.076249 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 688/1341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:39 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:40.085770 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0f4f8b7d-df01-4084-9996-5b53a061825b tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1860 microversion: 2.1 time: 0.386997 Sep 06 10:55:40.086483 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 654/1342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:39 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1860 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:40.088731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-c64cd78d-9cf4-47f4-8828-aef233424b92 req-8722198d-15a9-422e-8c84-3a11b07e45a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b77047-0abe-4fe2-8f93-41a27feb4861", "name": "network-vif-deleted", "tag": "1e7653a0-3a04-40cd-b60e-9537558010eb"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:40.103173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c64cd78d-9cf4-47f4-8828-aef233424b92 req-8722198d-15a9-422e-8c84-3a11b07e45a3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:40.103398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-587aa6db-8865-4b7d-98f7-09b62e241a49 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:40.103740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c64cd78d-9cf4-47f4-8828-aef233424b92 req-8722198d-15a9-422e-8c84-3a11b07e45a3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:40.105226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-587aa6db-8865-4b7d-98f7-09b62e241a49 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:40.105508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c64cd78d-9cf4-47f4-8828-aef233424b92 req-8722198d-15a9-422e-8c84-3a11b07e45a3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:40.114393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-587aa6db-8865-4b7d-98f7-09b62e241a49 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:40.114691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-587aa6db-8865-4b7d-98f7-09b62e241a49 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:40.115335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-587aa6db-8865-4b7d-98f7-09b62e241a49 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:40.118463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-587aa6db-8865-4b7d-98f7-09b62e241a49 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:40.119208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-587aa6db-8865-4b7d-98f7-09b62e241a49 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:40.120235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-587aa6db-8865-4b7d-98f7-09b62e241a49 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:40.128153 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-c64cd78d-9cf4-47f4-8828-aef233424b92 req-8722198d-15a9-422e-8c84-3a11b07e45a3 service nova] Creating event network-vif-deleted:1e7653a0-3a04-40cd-b60e-9537558010eb for instance 58b77047-0abe-4fe2-8f93-41a27feb4861 on nch1-master-1 Sep 06 10:55:40.135697 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-c64cd78d-9cf4-47f4-8828-aef233424b92 req-8722198d-15a9-422e-8c84-3a11b07e45a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057433 Sep 06 10:55:40.143477 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 689/1343] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:40.146194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0aa3797f-4490-4fb0-8b84-020c45438bea tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '.version_select at 0x7f90f870db80>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:40.240331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-587aa6db-8865-4b7d-98f7-09b62e241a49 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:40.254066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-587aa6db-8865-4b7d-98f7-09b62e241a49 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:40.255848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-587aa6db-8865-4b7d-98f7-09b62e241a49 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:40.263336 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-587aa6db-8865-4b7d-98f7-09b62e241a49 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.174761 Sep 06 10:55:40.263336 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 655/1344] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:40 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:40.276967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8041d8e8-9bad-40e0-b98d-1a23424922fb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:40.281236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8041d8e8-9bad-40e0-b98d-1a23424922fb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:40.291910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8041d8e8-9bad-40e0-b98d-1a23424922fb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:40.292103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8041d8e8-9bad-40e0-b98d-1a23424922fb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:40.292872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8041d8e8-9bad-40e0-b98d-1a23424922fb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:40.293802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8041d8e8-9bad-40e0-b98d-1a23424922fb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:40.302822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8041d8e8-9bad-40e0-b98d-1a23424922fb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:40.303320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8041d8e8-9bad-40e0-b98d-1a23424922fb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:40.311323 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0aa3797f-4490-4fb0-8b84-020c45438bea tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1927624671" status: 202 len: 0 microversion: 2.1 time: 0.170156 Sep 06 10:55:40.316089 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 690/1345] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 10:55:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1927624671 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:55:40.321118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-57064416-cd7d-47ef-9eb7-fbac9b90d7bf tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:40.322062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-57064416-cd7d-47ef-9eb7-fbac9b90d7bf tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 58b77047-0abe-4fe2-8f93-41a27feb4861] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:40.329701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57064416-cd7d-47ef-9eb7-fbac9b90d7bf tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:40.336111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57064416-cd7d-47ef-9eb7-fbac9b90d7bf tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:40.336111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57064416-cd7d-47ef-9eb7-fbac9b90d7bf tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:40.336111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57064416-cd7d-47ef-9eb7-fbac9b90d7bf tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:40.336111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57064416-cd7d-47ef-9eb7-fbac9b90d7bf tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:40.336472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57064416-cd7d-47ef-9eb7-fbac9b90d7bf tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:40.348402 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-57064416-cd7d-47ef-9eb7-fbac9b90d7bf tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] HTTP exception thrown: Instance 58b77047-0abe-4fe2-8f93-41a27feb4861 could not be found. Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-57064416-cd7d-47ef-9eb7-fbac9b90d7bf tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Request method failure captured: Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 HTTP/1.1 Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaCvQA1vgxe6NJcVr1HVKu6pZihgUIj4mL8BkOge8zRFI7rwLmBnTsT-B4nNK_35WcVMpQKM_-P6xliIR9y2UGqQoFv3WTKAj8nlYpRtudb5AYIoa2ASGvy9kfOmKLkXaOjIQ5X85RaLmHzjGT33k4TFrlkuSad3tJr2z8mhF1mDC4 Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 37509f3214ec4a83a0db84a1c5377690 Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersAdminTestJSON-282434587 Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:55:40.350382 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:55:40.352504 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37509f3214ec4a83a0db84a1c5377690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37509f3214ec4a83a0db84a1c5377690"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37509f3214ec4a83a0db84a1c5377690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37509f3214ec4a83a0db84a1c5377690"}]}] Sep 06 10:55:40.352504 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersAdminTestJSON-282434587 Sep 06 10:55:40.352504 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 37509f3214ec4a83a0db84a1c5377690 Sep 06 10:55:40.352504 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersAdminTestJSON-282434587 Sep 06 10:55:40.352504 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersAdminTestJSON-282434587-project Sep 06 10:55:40.352504 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:55:40.352504 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:55:40.352504 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 42a1b77561bd4df3a751dea07b1c6cda Sep 06 10:55:40.352504 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersAdminTestJSON-282434587-project Sep 06 10:55:40.352504 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:55:40.352504 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 58b77047-0abe-4fe2-8f93-41a27feb4861 could not be found. Sep 06 10:55:40.352504 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '58b77047-0abe-4fe2-8f93-41a27feb4861'} Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b77047-0abe-4fe2-8f93-41a27feb4861 could not be found. Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:40.353299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b77047-0abe-4fe2-8f93-41a27feb4861 could not be found. Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b77047-0abe-4fe2-8f93-41a27feb4861 could not be found. Sep 06 10:55:40.354665 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:40.358571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-57064416-cd7d-47ef-9eb7-fbac9b90d7bf tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Returning 404 to user: Instance 58b77047-0abe-4fe2-8f93-41a27feb4861 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:40.359654 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-57064416-cd7d-47ef-9eb7-fbac9b90d7bf tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861" status: 404 len: 111 microversion: 2.1 time: 0.042947 Sep 06 10:55:40.364785 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 691/1346] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:40 2022] GET /compute/v2.1/servers/58b77047-0abe-4fe2-8f93-41a27feb4861 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:40.369992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d09e3209-dc68-4819-aca4-8348721c87ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:40.370741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d09e3209-dc68-4819-aca4-8348721c87ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:40.377115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09e3209-dc68-4819-aca4-8348721c87ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:40.378073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09e3209-dc68-4819-aca4-8348721c87ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:40.379023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09e3209-dc68-4819-aca4-8348721c87ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:40.379896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09e3209-dc68-4819-aca4-8348721c87ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:40.380518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09e3209-dc68-4819-aca4-8348721c87ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:40.381197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d09e3209-dc68-4819-aca4-8348721c87ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:40.382423 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8041d8e8-9bad-40e0-b98d-1a23424922fb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109472 Sep 06 10:55:40.388911 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 656/1347] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 6 10:55:40 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 10:55:40.397792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9eac64ff-1e70-4a6c-8706-4ec8eca798fc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:40.401355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9eac64ff-1e70-4a6c-8706-4ec8eca798fc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:40.413914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9eac64ff-1e70-4a6c-8706-4ec8eca798fc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:40.414419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9eac64ff-1e70-4a6c-8706-4ec8eca798fc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:40.414870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9eac64ff-1e70-4a6c-8706-4ec8eca798fc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:40.419878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9eac64ff-1e70-4a6c-8706-4ec8eca798fc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:40.420380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9eac64ff-1e70-4a6c-8706-4ec8eca798fc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:40.425558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9eac64ff-1e70-4a6c-8706-4ec8eca798fc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:40.482898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9eac64ff-1e70-4a6c-8706-4ec8eca798fc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:55:40.604307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-d09e3209-dc68-4819-aca4-8348721c87ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lazy-loading 'services' on Instance uuid 21485351-3c21-4970-9d57-310eff94abb2 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:40.761236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:41.004637 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9eac64ff-1e70-4a6c-8706-4ec8eca798fc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 204 len: 0 microversion: 2.1 time: 0.614329 Sep 06 10:55:41.005246 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 657/1348] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:55:40 2022] DELETE /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:55:41.011975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-58749ade-c153-4451-a1a1-0e96fa21e021 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f862c160>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:41.040211 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d09e3209-dc68-4819-aca4-8348721c87ca tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "DELETE /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/os-volume_attachments/5e67a265-9fec-4ea9-98b6-e577de25d288" status: 202 len: 0 microversion: 2.1 time: 0.675086 Sep 06 10:55:41.042089 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 692/1349] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 10:55:40 2022] DELETE /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/os-volume_attachments/5e67a265-9fec-4ea9-98b6-e577de25d288 => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:55:41.050725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9618afff-2705-45dc-ae0a-51abdb86e8b1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:41.056093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9618afff-2705-45dc-ae0a-51abdb86e8b1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:41.074282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:41.078958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9618afff-2705-45dc-ae0a-51abdb86e8b1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:41.081251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9618afff-2705-45dc-ae0a-51abdb86e8b1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:41.082881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9618afff-2705-45dc-ae0a-51abdb86e8b1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:41.096865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9618afff-2705-45dc-ae0a-51abdb86e8b1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:41.097230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9618afff-2705-45dc-ae0a-51abdb86e8b1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:41.097678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9618afff-2705-45dc-ae0a-51abdb86e8b1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:41.098060 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-58749ade-c153-4451-a1a1-0e96fa21e021 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.089478 Sep 06 10:55:41.099551 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 658/1350] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:41 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:41.110015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-793294cb-d713-4f1e-ad71-29e8ebb4ef93 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:41.115760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-793294cb-d713-4f1e-ad71-29e8ebb4ef93 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:41.132489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-793294cb-d713-4f1e-ad71-29e8ebb4ef93 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:41.132988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-793294cb-d713-4f1e-ad71-29e8ebb4ef93 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:41.133426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-793294cb-d713-4f1e-ad71-29e8ebb4ef93 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:41.134141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-793294cb-d713-4f1e-ad71-29e8ebb4ef93 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:41.134598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-793294cb-d713-4f1e-ad71-29e8ebb4ef93 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:41.135035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-793294cb-d713-4f1e-ad71-29e8ebb4ef93 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:41.186472 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-793294cb-d713-4f1e-ad71-29e8ebb4ef93 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085580 Sep 06 10:55:41.187070 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 659/1351] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 10:55:41 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:41.195402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-52c22dc6-346e-4508-87cb-fd36a71f1fe5 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:41.196250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-52c22dc6-346e-4508-87cb-fd36a71f1fe5 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:41.202613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52c22dc6-346e-4508-87cb-fd36a71f1fe5 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:41.203335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52c22dc6-346e-4508-87cb-fd36a71f1fe5 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:41.203945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52c22dc6-346e-4508-87cb-fd36a71f1fe5 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:41.204859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52c22dc6-346e-4508-87cb-fd36a71f1fe5 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:41.205336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52c22dc6-346e-4508-87cb-fd36a71f1fe5 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:41.205929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52c22dc6-346e-4508-87cb-fd36a71f1fe5 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:41.512727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9618afff-2705-45dc-ae0a-51abdb86e8b1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:41.526515 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9618afff-2705-45dc-ae0a-51abdb86e8b1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1469 microversion: 2.1 time: 0.482981 Sep 06 10:55:41.527405 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 693/1352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:41 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1469 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:41.532146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7a84b14e-dea9-4d48-b1f1-bcd3902aced0 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:41.532776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7a84b14e-dea9-4d48-b1f1-bcd3902aced0 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:41.550586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a84b14e-dea9-4d48-b1f1-bcd3902aced0 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:41.551134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a84b14e-dea9-4d48-b1f1-bcd3902aced0 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:41.551595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a84b14e-dea9-4d48-b1f1-bcd3902aced0 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:41.552381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a84b14e-dea9-4d48-b1f1-bcd3902aced0 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:41.552815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a84b14e-dea9-4d48-b1f1-bcd3902aced0 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:41.553254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a84b14e-dea9-4d48-b1f1-bcd3902aced0 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:41.614514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-52c22dc6-346e-4508-87cb-fd36a71f1fe5 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:41.625888 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-52c22dc6-346e-4508-87cb-fd36a71f1fe5 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1521 microversion: 2.1 time: 0.436948 Sep 06 10:55:41.626937 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 660/1353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:41 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:41.644437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-913eca5b-bb15-44ab-a61f-abb0048956fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:41.649547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-913eca5b-bb15-44ab-a61f-abb0048956fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:41.657208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-913eca5b-bb15-44ab-a61f-abb0048956fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:41.657929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-913eca5b-bb15-44ab-a61f-abb0048956fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:41.659439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-913eca5b-bb15-44ab-a61f-abb0048956fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:41.661064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-913eca5b-bb15-44ab-a61f-abb0048956fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:41.661681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-913eca5b-bb15-44ab-a61f-abb0048956fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:41.662196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-913eca5b-bb15-44ab-a61f-abb0048956fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:41.698489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7a84b14e-dea9-4d48-b1f1-bcd3902aced0 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:41.727578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7a84b14e-dea9-4d48-b1f1-bcd3902aced0 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:41.729974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7a84b14e-dea9-4d48-b1f1-bcd3902aced0 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:41.746914 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-913eca5b-bb15-44ab-a61f-abb0048956fc tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.118679 Sep 06 10:55:41.758184 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 661/1354] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 6 10:55:41 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:41.758414 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7a84b14e-dea9-4d48-b1f1-bcd3902aced0 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.222308 Sep 06 10:55:41.758414 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 694/1355] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:41 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:42.115175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c15163e0-2ee0-47b0-8aa2-bfe546ec4012 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f87f71f0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:42.189697 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c15163e0-2ee0-47b0-8aa2-bfe546ec4012 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1412 microversion: 2.1 time: 0.078860 Sep 06 10:55:42.190887 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 662/1356] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:42 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:42.203114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-130bdb80-4176-4c92-a74d-f393026d1395 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:42.205886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-130bdb80-4176-4c92-a74d-f393026d1395 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:42.213167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-130bdb80-4176-4c92-a74d-f393026d1395 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:42.213678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-130bdb80-4176-4c92-a74d-f393026d1395 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:42.214124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-130bdb80-4176-4c92-a74d-f393026d1395 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:42.214840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-130bdb80-4176-4c92-a74d-f393026d1395 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:42.215375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-130bdb80-4176-4c92-a74d-f393026d1395 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:42.215818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-130bdb80-4176-4c92-a74d-f393026d1395 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:42.260287 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-130bdb80-4176-4c92-a74d-f393026d1395 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064575 Sep 06 10:55:42.266015 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 695/1357] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 10:55:42 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:55:42.551421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4753ea3c-9df7-4080-89ce-d34d6176daf1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:42.552250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4753ea3c-9df7-4080-89ce-d34d6176daf1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:42.568557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4753ea3c-9df7-4080-89ce-d34d6176daf1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:42.569937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4753ea3c-9df7-4080-89ce-d34d6176daf1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:42.571242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4753ea3c-9df7-4080-89ce-d34d6176daf1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:42.572578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4753ea3c-9df7-4080-89ce-d34d6176daf1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:42.573242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4753ea3c-9df7-4080-89ce-d34d6176daf1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:42.574080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4753ea3c-9df7-4080-89ce-d34d6176daf1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:42.664704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2517b8ba-15e4-4d4f-8192-cc0f43d6bd2a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:42.664704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2517b8ba-15e4-4d4f-8192-cc0f43d6bd2a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:42.674534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2517b8ba-15e4-4d4f-8192-cc0f43d6bd2a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:42.675059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2517b8ba-15e4-4d4f-8192-cc0f43d6bd2a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:42.675699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2517b8ba-15e4-4d4f-8192-cc0f43d6bd2a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:42.676666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2517b8ba-15e4-4d4f-8192-cc0f43d6bd2a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:42.677299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2517b8ba-15e4-4d4f-8192-cc0f43d6bd2a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:42.693089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2517b8ba-15e4-4d4f-8192-cc0f43d6bd2a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:43.186435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4753ea3c-9df7-4080-89ce-d34d6176daf1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:43.217189 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4753ea3c-9df7-4080-89ce-d34d6176daf1 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1469 microversion: 2.1 time: 0.671150 Sep 06 10:55:43.218818 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 663/1358] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:42 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1469 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:43.224503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5aa55907-0396-43d1-8c14-bc6c222ff2e3 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:43.226627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5aa55907-0396-43d1-8c14-bc6c222ff2e3 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:43.235538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aa55907-0396-43d1-8c14-bc6c222ff2e3 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:43.236784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aa55907-0396-43d1-8c14-bc6c222ff2e3 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:43.238680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aa55907-0396-43d1-8c14-bc6c222ff2e3 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:43.239914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aa55907-0396-43d1-8c14-bc6c222ff2e3 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:43.240602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aa55907-0396-43d1-8c14-bc6c222ff2e3 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:43.248529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aa55907-0396-43d1-8c14-bc6c222ff2e3 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:43.256261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2517b8ba-15e4-4d4f-8192-cc0f43d6bd2a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:43.271288 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2517b8ba-15e4-4d4f-8192-cc0f43d6bd2a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1498 microversion: 2.1 time: 0.621537 Sep 06 10:55:43.283129 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 696/1359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:42 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1498 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:43.287336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-574c8ec1-a50d-4c84-9bc5-628602d6346c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8796e50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:43.379360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5aa55907-0396-43d1-8c14-bc6c222ff2e3 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:43.405488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5aa55907-0396-43d1-8c14-bc6c222ff2e3 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:43.407784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5aa55907-0396-43d1-8c14-bc6c222ff2e3 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:43.420246 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5aa55907-0396-43d1-8c14-bc6c222ff2e3 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.200051 Sep 06 10:55:43.420847 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 664/1360] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:43 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:43.435862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-74ed1b7a-e481-41c1-b49f-66f8366fcb39 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:43.441970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-74ed1b7a-e481-41c1-b49f-66f8366fcb39 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:43.462328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ed1b7a-e481-41c1-b49f-66f8366fcb39 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:43.462857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ed1b7a-e481-41c1-b49f-66f8366fcb39 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:43.463336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ed1b7a-e481-41c1-b49f-66f8366fcb39 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:43.464303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ed1b7a-e481-41c1-b49f-66f8366fcb39 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:43.465137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ed1b7a-e481-41c1-b49f-66f8366fcb39 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:43.465731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ed1b7a-e481-41c1-b49f-66f8366fcb39 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:43.533144 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-74ed1b7a-e481-41c1-b49f-66f8366fcb39 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092009 Sep 06 10:55:43.539823 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 665/1361] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 10:55:43 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:55:43.541049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-20ae0f6d-d5d2-4311-84b0-8a3a759b27a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:43.546568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-20ae0f6d-d5d2-4311-84b0-8a3a759b27a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:43.547618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-20ae0f6d-d5d2-4311-84b0-8a3a759b27a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:43.552826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:43.559198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20ae0f6d-d5d2-4311-84b0-8a3a759b27a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:43.559198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20ae0f6d-d5d2-4311-84b0-8a3a759b27a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:43.559198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20ae0f6d-d5d2-4311-84b0-8a3a759b27a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:43.561724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20ae0f6d-d5d2-4311-84b0-8a3a759b27a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:43.562288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20ae0f6d-d5d2-4311-84b0-8a3a759b27a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:43.562743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20ae0f6d-d5d2-4311-84b0-8a3a759b27a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:43.623776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-20ae0f6d-d5d2-4311-84b0-8a3a759b27a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:43.695787 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-20ae0f6d-d5d2-4311-84b0-8a3a759b27a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.160716 Sep 06 10:55:43.704084 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 666/1362] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Sep 6 10:55:43 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:43.747624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-91881bea-b20a-45b5-832f-7dbc3f4a338b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:43.755896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91881bea-b20a-45b5-832f-7dbc3f4a338b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:43.759917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91881bea-b20a-45b5-832f-7dbc3f4a338b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:43.760661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91881bea-b20a-45b5-832f-7dbc3f4a338b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:43.829176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-91881bea-b20a-45b5-832f-7dbc3f4a338b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Going to try to start instance {{(pid=140875) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 10:55:44.111400 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-91881bea-b20a-45b5-832f-7dbc3f4a338b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "POST /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61/action" status: 202 len: 0 microversion: 2.1 time: 0.404559 Sep 06 10:55:44.112363 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 667/1363] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:55:43 2022] POST /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:55:44.122575 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-574c8ec1-a50d-4c84-9bc5-628602d6346c tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1421 microversion: 2.1 time: 0.844116 Sep 06 10:55:44.123202 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 697/1364] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:43 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1421 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:44.149408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a3a7bec3-b412-4248-9982-220ed0c7c106 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:44.150508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a3a7bec3-b412-4248-9982-220ed0c7c106 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:44.180688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a7bec3-b412-4248-9982-220ed0c7c106 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:44.181199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a7bec3-b412-4248-9982-220ed0c7c106 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:44.183375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a7bec3-b412-4248-9982-220ed0c7c106 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:44.185581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a7bec3-b412-4248-9982-220ed0c7c106 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:44.186687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a7bec3-b412-4248-9982-220ed0c7c106 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:44.187164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a7bec3-b412-4248-9982-220ed0c7c106 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:44.397815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-1760f11c-f4e8-4a8b-a8bc-b38faf2397cf req-565bbb2b-de77-4dc4-a459-6df1af60d7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dd8f1a-f2a3-463e-9129-1060fc467171", "name": "network-vif-deleted", "tag": "0722de88-af62-4350-ab9b-6cd8023675fa"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:44.448268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1760f11c-f4e8-4a8b-a8bc-b38faf2397cf req-565bbb2b-de77-4dc4-a459-6df1af60d7dc service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:44.450250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1760f11c-f4e8-4a8b-a8bc-b38faf2397cf req-565bbb2b-de77-4dc4-a459-6df1af60d7dc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:44.454452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1760f11c-f4e8-4a8b-a8bc-b38faf2397cf req-565bbb2b-de77-4dc4-a459-6df1af60d7dc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:44.469043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a3a7bec3-b412-4248-9982-220ed0c7c106 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:44.481587 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a3a7bec3-b412-4248-9982-220ed0c7c106 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1507 microversion: 2.1 time: 0.345039 Sep 06 10:55:44.498346 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-1760f11c-f4e8-4a8b-a8bc-b38faf2397cf req-565bbb2b-de77-4dc4-a459-6df1af60d7dc service nova] Creating event network-vif-deleted:0722de88-af62-4350-ab9b-6cd8023675fa for instance 77dd8f1a-f2a3-463e-9129-1060fc467171 on nch1-master-1 Sep 06 10:55:44.505843 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 698/1365] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:44 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:44.512494 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-1760f11c-f4e8-4a8b-a8bc-b38faf2397cf req-565bbb2b-de77-4dc4-a459-6df1af60d7dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.398291 Sep 06 10:55:44.518968 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 668/1366] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:44.528970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b35957c4-69cc-4cfc-9e35-85587c7477d2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f870d5e0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:44.533471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:44.534573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:44.547480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:44.547480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:44.548085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:44.548645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:44.549508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:44.550056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:44.599993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:44.600598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:44.602742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:44.603288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lazy-loading 'fault' on Instance uuid 77dd8f1a-f2a3-463e-9129-1060fc467171 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:44.712638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a1b77561bd4df3a751dea07b1c6cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37509f3214ec4a83a0db84a1c5377690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:44.726207 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c7c5742b-93b9-420c-af18-a59e04d44cbc tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 200 len: 1303 microversion: 2.1 time: 0.205189 Sep 06 10:55:44.739629 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 669/1367] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:44 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 1303 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:44.749120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-64be12ed-cb9f-4929-a5a9-a71d74ff26b5 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:44.749896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-64be12ed-cb9f-4929-a5a9-a71d74ff26b5 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:44.764730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64be12ed-cb9f-4929-a5a9-a71d74ff26b5 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:44.765171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64be12ed-cb9f-4929-a5a9-a71d74ff26b5 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:44.765658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64be12ed-cb9f-4929-a5a9-a71d74ff26b5 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:44.766425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64be12ed-cb9f-4929-a5a9-a71d74ff26b5 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:44.766897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64be12ed-cb9f-4929-a5a9-a71d74ff26b5 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:44.772671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64be12ed-cb9f-4929-a5a9-a71d74ff26b5 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:44.870519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-64be12ed-cb9f-4929-a5a9-a71d74ff26b5 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:44.879696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-64be12ed-cb9f-4929-a5a9-a71d74ff26b5 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:44.881175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-64be12ed-cb9f-4929-a5a9-a71d74ff26b5 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:44.887161 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-64be12ed-cb9f-4929-a5a9-a71d74ff26b5 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.145754 Sep 06 10:55:44.902825 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 670/1368] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:44 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:45.047438 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b35957c4-69cc-4cfc-9e35-85587c7477d2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 200 len: 1421 microversion: 2.1 time: 0.534597 Sep 06 10:55:45.058882 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 699/1369] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:44 2022] GET /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 1421 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:45.065016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0756aed9-b7d2-4a91-927e-dee8425d0e40 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8e128b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:45.511124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cc630c36-1af2-4233-98f7-305df35a008f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:45.512406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cc630c36-1af2-4233-98f7-305df35a008f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:45.529500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc630c36-1af2-4233-98f7-305df35a008f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:45.533693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc630c36-1af2-4233-98f7-305df35a008f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:45.540444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc630c36-1af2-4233-98f7-305df35a008f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:45.541336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc630c36-1af2-4233-98f7-305df35a008f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:45.543465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc630c36-1af2-4233-98f7-305df35a008f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:45.544089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc630c36-1af2-4233-98f7-305df35a008f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:45.855774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cc630c36-1af2-4233-98f7-305df35a008f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:45.865536 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cc630c36-1af2-4233-98f7-305df35a008f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1507 microversion: 2.1 time: 0.361096 Sep 06 10:55:45.868670 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 700/1370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:45 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:45.875493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4461edbe-d4e7-487c-986e-09b49b9b5cf0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:45.889555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4461edbe-d4e7-487c-986e-09b49b9b5cf0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] [instance: 77dd8f1a-f2a3-463e-9129-1060fc467171] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:45.915659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4461edbe-d4e7-487c-986e-09b49b9b5cf0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:45.916190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4461edbe-d4e7-487c-986e-09b49b9b5cf0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:45.916645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4461edbe-d4e7-487c-986e-09b49b9b5cf0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:45.920594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4461edbe-d4e7-487c-986e-09b49b9b5cf0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:45.921275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4461edbe-d4e7-487c-986e-09b49b9b5cf0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:45.922267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4461edbe-d4e7-487c-986e-09b49b9b5cf0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:45.940426 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-4461edbe-d4e7-487c-986e-09b49b9b5cf0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] HTTP exception thrown: Instance 77dd8f1a-f2a3-463e-9129-1060fc467171 could not be found. Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4461edbe-d4e7-487c-986e-09b49b9b5cf0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Request method failure captured: Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 HTTP/1.1 Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaCvQA1vgxe6NJcVr1HVKu6pZihgUIj4mL8BkOge8zRFI7rwLmBnTsT-B4nNK_35WcVMpQKM_-P6xliIR9y2UGqQoFv3WTKAj8nlYpRtudb5AYIoa2ASGvy9kfOmKLkXaOjIQ5X85RaLmHzjGT33k4TFrlkuSad3tJr2z8mhF1mDC4 Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 37509f3214ec4a83a0db84a1c5377690 Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersAdminTestJSON-282434587 Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:55:45.942686 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:55:45.945412 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37509f3214ec4a83a0db84a1c5377690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37509f3214ec4a83a0db84a1c5377690"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37509f3214ec4a83a0db84a1c5377690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37509f3214ec4a83a0db84a1c5377690"}]}] Sep 06 10:55:45.945412 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersAdminTestJSON-282434587 Sep 06 10:55:45.945412 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 37509f3214ec4a83a0db84a1c5377690 Sep 06 10:55:45.945412 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersAdminTestJSON-282434587 Sep 06 10:55:45.945412 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersAdminTestJSON-282434587-project Sep 06 10:55:45.945412 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:55:45.945412 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:55:45.945412 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 42a1b77561bd4df3a751dea07b1c6cda Sep 06 10:55:45.945412 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersAdminTestJSON-282434587-project Sep 06 10:55:45.945412 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:55:45.945412 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 77dd8f1a-f2a3-463e-9129-1060fc467171 could not be found. Sep 06 10:55:45.945412 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '77dd8f1a-f2a3-463e-9129-1060fc467171'} Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77dd8f1a-f2a3-463e-9129-1060fc467171 could not be found. Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:45.946433 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77dd8f1a-f2a3-463e-9129-1060fc467171 could not be found. Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77dd8f1a-f2a3-463e-9129-1060fc467171 could not be found. Sep 06 10:55:45.947869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:45.949142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4461edbe-d4e7-487c-986e-09b49b9b5cf0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] Returning 404 to user: Instance 77dd8f1a-f2a3-463e-9129-1060fc467171 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:45.949777 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4461edbe-d4e7-487c-986e-09b49b9b5cf0 tempest-ServersAdminTestJSON-282434587 tempest-ServersAdminTestJSON-282434587-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171" status: 404 len: 111 microversion: 2.1 time: 0.074207 Sep 06 10:55:45.955883 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 701/1371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:45 2022] GET /compute/v2.1/servers/77dd8f1a-f2a3-463e-9129-1060fc467171 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:45.967682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9b2b82c1-7817-4efe-9052-17e9e35db859 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:45.973693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9b2b82c1-7817-4efe-9052-17e9e35db859 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:46.000413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b2b82c1-7817-4efe-9052-17e9e35db859 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:46.000976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b2b82c1-7817-4efe-9052-17e9e35db859 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:46.001599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b2b82c1-7817-4efe-9052-17e9e35db859 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:46.002297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b2b82c1-7817-4efe-9052-17e9e35db859 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:46.003922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b2b82c1-7817-4efe-9052-17e9e35db859 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:46.004383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b2b82c1-7817-4efe-9052-17e9e35db859 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:46.089283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9b2b82c1-7817-4efe-9052-17e9e35db859 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:46.098002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9b2b82c1-7817-4efe-9052-17e9e35db859 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:46.099644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9b2b82c1-7817-4efe-9052-17e9e35db859 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:46.106138 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9b2b82c1-7817-4efe-9052-17e9e35db859 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.142867 Sep 06 10:55:46.107078 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 702/1372] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:45 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:46.543932 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0756aed9-b7d2-4a91-927e-dee8425d0e40 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 204 len: 0 microversion: 2.1 time: 1.483932 Sep 06 10:55:46.545966 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 671/1373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:45 2022] DELETE /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 0 bytes in 1487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:55:46.559081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e790de5c-c210-45e4-97b5-72ff29b5d661 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:46.559081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e790de5c-c210-45e4-97b5-72ff29b5d661 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:46.571443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e790de5c-c210-45e4-97b5-72ff29b5d661 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:46.572037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e790de5c-c210-45e4-97b5-72ff29b5d661 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:46.572500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e790de5c-c210-45e4-97b5-72ff29b5d661 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:46.575468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e790de5c-c210-45e4-97b5-72ff29b5d661 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:46.577219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e790de5c-c210-45e4-97b5-72ff29b5d661 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:46.577524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e790de5c-c210-45e4-97b5-72ff29b5d661 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:46.640384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e790de5c-c210-45e4-97b5-72ff29b5d661 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:55:46.899972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7cf69233-feca-4faa-8b40-4caa44a5c8e0 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:46.901544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7cf69233-feca-4faa-8b40-4caa44a5c8e0 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:46.924515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7cf69233-feca-4faa-8b40-4caa44a5c8e0 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:46.929188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7cf69233-feca-4faa-8b40-4caa44a5c8e0 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:46.929188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7cf69233-feca-4faa-8b40-4caa44a5c8e0 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:46.929188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7cf69233-feca-4faa-8b40-4caa44a5c8e0 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:46.929188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7cf69233-feca-4faa-8b40-4caa44a5c8e0 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:46.929818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7cf69233-feca-4faa-8b40-4caa44a5c8e0 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:47.131978 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e790de5c-c210-45e4-97b5-72ff29b5d661 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 204 len: 0 microversion: 2.1 time: 0.579286 Sep 06 10:55:47.133692 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 703/1374] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:55:46 2022] DELETE /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:55:47.144926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3b7f1369-a035-4f26-b525-06720d564ab1 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:47.149630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3b7f1369-a035-4f26-b525-06720d564ab1 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:47.168130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b7f1369-a035-4f26-b525-06720d564ab1 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:47.173030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b7f1369-a035-4f26-b525-06720d564ab1 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:47.178126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b7f1369-a035-4f26-b525-06720d564ab1 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:47.179678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b7f1369-a035-4f26-b525-06720d564ab1 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:47.180442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b7f1369-a035-4f26-b525-06720d564ab1 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:47.181235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b7f1369-a035-4f26-b525-06720d564ab1 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:47.238912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7cf69233-feca-4faa-8b40-4caa44a5c8e0 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:47.256018 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7cf69233-feca-4faa-8b40-4caa44a5c8e0 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1511 microversion: 2.1 time: 0.357716 Sep 06 10:55:47.260195 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 672/1375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:46 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:47.290154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-195148da-194c-4e4a-b8a2-9e0787992328 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:47.297489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-195148da-194c-4e4a-b8a2-9e0787992328 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:47.303264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.compute.servers [None req-195148da-194c-4e4a-b8a2-9e0787992328 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Removing options 'limit' from query {{(pid=140875) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 06 10:55:47.304542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-195148da-194c-4e4a-b8a2-9e0787992328 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:47.305841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-195148da-194c-4e4a-b8a2-9e0787992328 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:47.306452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-195148da-194c-4e4a-b8a2-9e0787992328 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:47.307673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-195148da-194c-4e4a-b8a2-9e0787992328 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:47.311672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-195148da-194c-4e4a-b8a2-9e0787992328 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:47.312170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-195148da-194c-4e4a-b8a2-9e0787992328 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:47.312622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-195148da-194c-4e4a-b8a2-9e0787992328 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:47.316353 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-195148da-194c-4e4a-b8a2-9e0787992328 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.030789 Sep 06 10:55:47.316942 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 673/1376] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Sep 6 10:55:47 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 10:55:47.332838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8e97e82e-f75a-4f25-9e31-98d995e4e28f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:47.334350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8e97e82e-f75a-4f25-9e31-98d995e4e28f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:47.345133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3b7f1369-a035-4f26-b525-06720d564ab1 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:47.349203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e97e82e-f75a-4f25-9e31-98d995e4e28f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:47.350112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e97e82e-f75a-4f25-9e31-98d995e4e28f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:47.350906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e97e82e-f75a-4f25-9e31-98d995e4e28f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:47.351688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e97e82e-f75a-4f25-9e31-98d995e4e28f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:47.352476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e97e82e-f75a-4f25-9e31-98d995e4e28f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:47.353094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e97e82e-f75a-4f25-9e31-98d995e4e28f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:47.364372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3b7f1369-a035-4f26-b525-06720d564ab1 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:47.371253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3b7f1369-a035-4f26-b525-06720d564ab1 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:47.383177 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3b7f1369-a035-4f26-b525-06720d564ab1 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.245505 Sep 06 10:55:47.396471 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 704/1377] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:47 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:47.412467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-693305040", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "8c7b67ff-233f-4a9e-acc5-cc1f60baf7c8"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:47.508854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] validate_networks() for [('8c7b67ff-233f-4a9e-acc5-cc1f60baf7c8', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:55:47.725029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8e97e82e-f75a-4f25-9e31-98d995e4e28f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:47.745394 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8e97e82e-f75a-4f25-9e31-98d995e4e28f tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1511 microversion: 2.1 time: 0.416522 Sep 06 10:55:47.776239 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 674/1378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:47 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:47.781612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8e34f55a-3c9c-466a-a127-68fdf69290ac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:47.788817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8e34f55a-3c9c-466a-a127-68fdf69290ac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:47.802357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e34f55a-3c9c-466a-a127-68fdf69290ac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:47.803524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e34f55a-3c9c-466a-a127-68fdf69290ac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:47.804466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e34f55a-3c9c-466a-a127-68fdf69290ac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:47.808634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e34f55a-3c9c-466a-a127-68fdf69290ac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:47.809421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e34f55a-3c9c-466a-a127-68fdf69290ac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:47.813383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e34f55a-3c9c-466a-a127-68fdf69290ac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:48.295435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8e34f55a-3c9c-466a-a127-68fdf69290ac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:48.305330 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8e34f55a-3c9c-466a-a127-68fdf69290ac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7" status: 200 len: 1512 microversion: 2.1 time: 0.527482 Sep 06 10:55:48.307045 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 675/1379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:47 2022] GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 => generated 1512 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:48.332629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6e6c5718-7998-49f2-8873-cc272bb67d47 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:48.333593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6e6c5718-7998-49f2-8873-cc272bb67d47 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:48.348790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e6c5718-7998-49f2-8873-cc272bb67d47 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:48.349523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e6c5718-7998-49f2-8873-cc272bb67d47 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:48.350153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e6c5718-7998-49f2-8873-cc272bb67d47 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:48.351063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e6c5718-7998-49f2-8873-cc272bb67d47 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:48.351690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e6c5718-7998-49f2-8873-cc272bb67d47 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:48.352317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e6c5718-7998-49f2-8873-cc272bb67d47 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:48.576617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:55:48.577269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:55:48.578502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:55:48.579059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:55:48.579472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:55:48.614939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:48.616639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:48.617549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:48.618954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:48.619659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:48.620295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:48.647690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6e6c5718-7998-49f2-8873-cc272bb67d47 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:48.663177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6e6c5718-7998-49f2-8873-cc272bb67d47 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1511 microversion: 2.1 time: 0.335419 Sep 06 10:55:48.668140 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 676/1380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:48 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:48.675522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-86bc3d95-6648-4338-8f0c-bd968ad3970c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:48.681281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-86bc3d95-6648-4338-8f0c-bd968ad3970c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:48.692983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86bc3d95-6648-4338-8f0c-bd968ad3970c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:48.696930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86bc3d95-6648-4338-8f0c-bd968ad3970c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:48.700513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86bc3d95-6648-4338-8f0c-bd968ad3970c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:48.701924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86bc3d95-6648-4338-8f0c-bd968ad3970c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:48.702752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86bc3d95-6648-4338-8f0c-bd968ad3970c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:48.703430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86bc3d95-6648-4338-8f0c-bd968ad3970c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:48.706667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Getting quotas for project e047ab9362dc476c9a4b4aee7223d042. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:55:48.720949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Getting quotas for user d79046739b2d4572b0aedef59e621ab8 and project e047ab9362dc476c9a4b4aee7223d042. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:55:48.753653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:48.766595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:55:48.769032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:55:48.934668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-86bc3d95-6648-4338-8f0c-bd968ad3970c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:48.955914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-86bc3d95-6648-4338-8f0c-bd968ad3970c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:48.964454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-86bc3d95-6648-4338-8f0c-bd968ad3970c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:48.970131 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1e3df6f9-95d1-44ca-b4fc-c65f50a26789 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.571757 Sep 06 10:55:48.972680 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 705/1381] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:55:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:55:48.981872 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-86bc3d95-6648-4338-8f0c-bd968ad3970c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.311067 Sep 06 10:55:48.982972 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 677/1382] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:48 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:49.008256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cb92ae53-dd3c-44f5-bcf2-92e473303db4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:49.008893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cb92ae53-dd3c-44f5-bcf2-92e473303db4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:49.012051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-429cdc74-b126-45e5-8a75-41872174e456 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:49.029530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-429cdc74-b126-45e5-8a75-41872174e456 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:49.031483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-429cdc74-b126-45e5-8a75-41872174e456 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'ip': '172.20.0.8', 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:49.205266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cb92ae53-dd3c-44f5-bcf2-92e473303db4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:49.213420 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cb92ae53-dd3c-44f5-bcf2-92e473303db4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1207 microversion: 2.1 time: 0.227470 Sep 06 10:55:49.214269 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 678/1383] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:48 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1207 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:49.282517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-429cdc74-b126-45e5-8a75-41872174e456 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:49.283032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-429cdc74-b126-45e5-8a75-41872174e456 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:49.283602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-429cdc74-b126-45e5-8a75-41872174e456 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:49.285473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-429cdc74-b126-45e5-8a75-41872174e456 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:49.286013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-429cdc74-b126-45e5-8a75-41872174e456 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:49.286449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-429cdc74-b126-45e5-8a75-41872174e456 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:49.480012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-429cdc74-b126-45e5-8a75-41872174e456 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:49.500914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a24f28e5-d95d-4af1-9b3d-2a6358cb932e tempest-FloatingIPsNegativeTestJSON-428181836 tempest-FloatingIPsNegativeTestJSON-428181836-project] Calling method '.version_select at 0x7f90f8b60940>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:49.587433 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a24f28e5-d95d-4af1-9b3d-2a6358cb932e tempest-FloatingIPsNegativeTestJSON-428181836 tempest-FloatingIPsNegativeTestJSON-428181836-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.371989 Sep 06 10:55:49.592768 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 679/1384] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 10:55:49 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:55:49.641580 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-429cdc74-b126-45e5-8a75-41872174e456 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0.8" status: 200 len: 345 microversion: 2.1 time: 0.660657 Sep 06 10:55:49.647985 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 706/1385] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 10:55:48 2022] GET /compute/v2.1/servers?ip=172.20.0.8 => generated 345 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:49.666038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a498097e-3a56-4e75-876d-b2582e8b0026 tempest-FloatingIPsNegativeTestJSON-428181836 tempest-FloatingIPsNegativeTestJSON-428181836-project] Action: 'create', calling method: .version_select at 0x7f90f893dca0>, body: {"pool": "non_exist_pool"} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:49.722573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-cc866de5-28ea-4e24-8f81-870bb1a9930f req-2f4ddc67-f480-43bb-9b4a-9f8e29734e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d33d19-9934-492e-ab0f-0651fe5c6627", "name": "network-vif-unplugged", "status": "completed", "tag": "b54017fd-be21-45de-8025-0205f20d32de"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:49.724142 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-a498097e-3a56-4e75-876d-b2582e8b0026 tempest-FloatingIPsNegativeTestJSON-428181836 tempest-FloatingIPsNegativeTestJSON-428181836-project] HTTP exception thrown: Floating IP pool not found. Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a498097e-3a56-4e75-876d-b2582e8b0026 tempest-FloatingIPsNegativeTestJSON-428181836 tempest-FloatingIPsNegativeTestJSON-428181836-project] Request method failure captured: Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 26 Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyc0u3CNCYcgfEhYC5x7cn12SEBLiBkvilDzoI48uEdYmbYCM6EjCPPMaLTzm4KH1LSWrBYnxv3QVDp_yYvu8p2wrlnvy1sKaHSRGvKOA4UujgLxypHXO1CT_EMdEG8JKqgOgOLXlvaDgBttY08z7fm6h3CRu8OU26Wwht2XYF4y5NM Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 768fb9d0e19e40039f8471dcf9ce1016 Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-428181836 Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:55:49.726383 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_768fb9d0e19e40039f8471dcf9ce1016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/768fb9d0e19e40039f8471dcf9ce1016"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/768fb9d0e19e40039f8471dcf9ce1016"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/768fb9d0e19e40039f8471dcf9ce1016"}]}] Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-428181836 Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 768fb9d0e19e40039f8471dcf9ce1016 Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-428181836 Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-FloatingIPsNegativeTestJSON-428181836-project Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: bbcfd83bc53042f2a6cf7f42e9d6b81e Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-428181836-project Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: {"pool": "non_exist_pool"} Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: exception: Floating IP pool not found. Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 06 10:55:49.729352 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:49.741603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a498097e-3a56-4e75-876d-b2582e8b0026 tempest-FloatingIPsNegativeTestJSON-428181836 tempest-FloatingIPsNegativeTestJSON-428181836-project] Returning 404 to user: Floating IP pool not found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:49.743205 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a498097e-3a56-4e75-876d-b2582e8b0026 tempest-FloatingIPsNegativeTestJSON-428181836 tempest-FloatingIPsNegativeTestJSON-428181836-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.078995 Sep 06 10:55:49.744715 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 707/1386] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Sep 6 10:55:49 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:55:49.744715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1491720c-4019-498b-9712-06b4269fda04 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:49.744715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1491720c-4019-498b-9712-06b4269fda04 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:49.745003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1491720c-4019-498b-9712-06b4269fda04 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:49.745509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1491720c-4019-498b-9712-06b4269fda04 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:49.745954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1491720c-4019-498b-9712-06b4269fda04 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:49.746728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1491720c-4019-498b-9712-06b4269fda04 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:49.753613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-cc866de5-28ea-4e24-8f81-870bb1a9930f req-2f4ddc67-f480-43bb-9b4a-9f8e29734e91 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:49.757154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-cc866de5-28ea-4e24-8f81-870bb1a9930f req-2f4ddc67-f480-43bb-9b4a-9f8e29734e91 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:49.757741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1491720c-4019-498b-9712-06b4269fda04 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:49.757853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-cc866de5-28ea-4e24-8f81-870bb1a9930f req-2f4ddc67-f480-43bb-9b4a-9f8e29734e91 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:49.757947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1491720c-4019-498b-9712-06b4269fda04 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:49.790884 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-cc866de5-28ea-4e24-8f81-870bb1a9930f req-2f4ddc67-f480-43bb-9b4a-9f8e29734e91 service nova] Creating event network-vif-unplugged:b54017fd-be21-45de-8025-0205f20d32de for instance b0d33d19-9934-492e-ab0f-0651fe5c6627 on nch2-master-1 Sep 06 10:55:49.807591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:49.823940 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-cc866de5-28ea-4e24-8f81-870bb1a9930f req-2f4ddc67-f480-43bb-9b4a-9f8e29734e91 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.225650 Sep 06 10:55:49.824831 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 680/1387] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:49.838215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4ee711e4-6ecc-4e26-9e73-15ff51990f78 tempest-FloatingIPsNegativeTestJSON-428181836 tempest-FloatingIPsNegativeTestJSON-428181836-project] Calling method '.version_select at 0x7f90f8708550>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:50.045358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG neutronclient.v2_0.client [None req-4ee711e4-6ecc-4e26-9e73-15ff51990f78 tempest-FloatingIPsNegativeTestJSON-428181836 tempest-FloatingIPsNegativeTestJSON-428181836-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8def6430-4590-4286-a709-3007f391b7b2 could not be found", "detail": ""}} {{(pid=140875) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-4ee711e4-6ecc-4e26-9e73-15ff51990f78 tempest-FloatingIPsNegativeTestJSON-428181836 tempest-FloatingIPsNegativeTestJSON-428181836-project] HTTP exception thrown: Floating IP not found for ID 8def6430-4590-4286-a709-3007f391b7b2 Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4ee711e4-6ecc-4e26-9e73-15ff51990f78 tempest-FloatingIPsNegativeTestJSON-428181836 tempest-FloatingIPsNegativeTestJSON-428181836-project] Request method failure captured: Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/os-floating-ips/8def6430-4590-4286-a709-3007f391b7b2 HTTP/1.1 Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyc0u3CNCYcgfEhYC5x7cn12SEBLiBkvilDzoI48uEdYmbYCM6EjCPPMaLTzm4KH1LSWrBYnxv3QVDp_yYvu8p2wrlnvy1sKaHSRGvKOA4UujgLxypHXO1CT_EMdEG8JKqgOgOLXlvaDgBttY08z7fm6h3CRu8OU26Wwht2XYF4y5NM Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 768fb9d0e19e40039f8471dcf9ce1016 Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-428181836 Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:55:50.051390 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:55:50.052919 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_768fb9d0e19e40039f8471dcf9ce1016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/768fb9d0e19e40039f8471dcf9ce1016"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/768fb9d0e19e40039f8471dcf9ce1016"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/768fb9d0e19e40039f8471dcf9ce1016"}]}] Sep 06 10:55:50.052919 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-428181836 Sep 06 10:55:50.052919 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 768fb9d0e19e40039f8471dcf9ce1016 Sep 06 10:55:50.052919 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-428181836 Sep 06 10:55:50.052919 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FloatingIPsNegativeTestJSON-428181836-project Sep 06 10:55:50.052919 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:55:50.052919 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:55:50.052919 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: bbcfd83bc53042f2a6cf7f42e9d6b81e Sep 06 10:55:50.052919 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-428181836-project Sep 06 10:55:50.052919 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:55:50.052919 ncdv-master-1 devstack@n-api.service[140875]: exception: Floating IP not found for ID 8def6430-4590-4286-a709-3007f391b7b2 Sep 06 10:55:50.052919 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '8def6430-4590-4286-a709-3007f391b7b2'} Sep 06 10:55:50.052919 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:55:50.053841 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8def6430-4590-4286-a709-3007f391b7b2 could not be found Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7770836-7396-427c-a805-e27852eece60'] Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8def6430-4590-4286-a709-3007f391b7b2. Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:50.057810 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8def6430-4590-4286-a709-3007f391b7b2 Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:50.059280 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:50.061045 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8def6430-4590-4286-a709-3007f391b7b2 Sep 06 10:55:50.061045 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:55:50.061045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4ee711e4-6ecc-4e26-9e73-15ff51990f78 tempest-FloatingIPsNegativeTestJSON-428181836 tempest-FloatingIPsNegativeTestJSON-428181836-project] Returning 404 to user: Floating IP not found for ID 8def6430-4590-4286-a709-3007f391b7b2 {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:50.061045 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4ee711e4-6ecc-4e26-9e73-15ff51990f78 tempest-FloatingIPsNegativeTestJSON-428181836 tempest-FloatingIPsNegativeTestJSON-428181836-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/8def6430-4590-4286-a709-3007f391b7b2" status: 404 len: 111 microversion: 2.1 time: 0.223540 Sep 06 10:55:50.061045 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 681/1388] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 10:55:49 2022] DELETE /compute/v2.1/os-floating-ips/8def6430-4590-4286-a709-3007f391b7b2 => generated 111 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:50.061402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c95dd1b9-cd1c-4f9c-beb3-77dc17b6d3bd tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:50.062019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c95dd1b9-cd1c-4f9c-beb3-77dc17b6d3bd tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:50.086406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c95dd1b9-cd1c-4f9c-beb3-77dc17b6d3bd tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:50.088054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c95dd1b9-cd1c-4f9c-beb3-77dc17b6d3bd tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:50.090564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c95dd1b9-cd1c-4f9c-beb3-77dc17b6d3bd tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:50.095160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c95dd1b9-cd1c-4f9c-beb3-77dc17b6d3bd tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:50.096535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c95dd1b9-cd1c-4f9c-beb3-77dc17b6d3bd tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:50.097639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c95dd1b9-cd1c-4f9c-beb3-77dc17b6d3bd tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:50.125007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1491720c-4019-498b-9712-06b4269fda04 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:50.135089 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1491720c-4019-498b-9712-06b4269fda04 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1511 microversion: 2.1 time: 0.404881 Sep 06 10:55:50.136083 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 708/1389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:49 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1511 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:50.159577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1c4c5a63-5dad-407e-b964-f1ac3714192d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:50.160622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1c4c5a63-5dad-407e-b964-f1ac3714192d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:50.194601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c4c5a63-5dad-407e-b964-f1ac3714192d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:50.202823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c4c5a63-5dad-407e-b964-f1ac3714192d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:50.203401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c4c5a63-5dad-407e-b964-f1ac3714192d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:50.208914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c4c5a63-5dad-407e-b964-f1ac3714192d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:50.208914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c4c5a63-5dad-407e-b964-f1ac3714192d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:50.208914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c4c5a63-5dad-407e-b964-f1ac3714192d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:50.512223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c95dd1b9-cd1c-4f9c-beb3-77dc17b6d3bd tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:50.521440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c95dd1b9-cd1c-4f9c-beb3-77dc17b6d3bd tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:50.527804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c95dd1b9-cd1c-4f9c-beb3-77dc17b6d3bd tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:50.546122 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c95dd1b9-cd1c-4f9c-beb3-77dc17b6d3bd tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.492229 Sep 06 10:55:50.561102 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 682/1390] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:50 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:50.570400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f05f8b1c-ad06-4113-b6e6-12c9c333b4a0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:50.570400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f05f8b1c-ad06-4113-b6e6-12c9c333b4a0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:50.585707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f05f8b1c-ad06-4113-b6e6-12c9c333b4a0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:50.586269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f05f8b1c-ad06-4113-b6e6-12c9c333b4a0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:50.586753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f05f8b1c-ad06-4113-b6e6-12c9c333b4a0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:50.587534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f05f8b1c-ad06-4113-b6e6-12c9c333b4a0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:50.588000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f05f8b1c-ad06-4113-b6e6-12c9c333b4a0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:50.588435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f05f8b1c-ad06-4113-b6e6-12c9c333b4a0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:50.748674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f05f8b1c-ad06-4113-b6e6-12c9c333b4a0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:50.779959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1c4c5a63-5dad-407e-b964-f1ac3714192d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:50.793173 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1c4c5a63-5dad-407e-b964-f1ac3714192d tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7" status: 200 len: 1512 microversion: 2.1 time: 0.634474 Sep 06 10:55:50.795442 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 709/1391] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:50 2022] GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 => generated 1512 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:50.806864 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f05f8b1c-ad06-4113-b6e6-12c9c333b4a0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1211 microversion: 2.1 time: 0.249965 Sep 06 10:55:50.807745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-d47164ac-72c4-4bfc-9b83-e83a83e5281c req-f05d6244-66f7-435b-a581-21f0adba4c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d33d19-9934-492e-ab0f-0651fe5c6627", "name": "network-vif-deleted", "tag": "b54017fd-be21-45de-8025-0205f20d32de"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:50.830641 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 683/1392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:50 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1211 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:50.846551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d47164ac-72c4-4bfc-9b83-e83a83e5281c req-f05d6244-66f7-435b-a581-21f0adba4c78 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:50.847412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d47164ac-72c4-4bfc-9b83-e83a83e5281c req-f05d6244-66f7-435b-a581-21f0adba4c78 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:50.849090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d47164ac-72c4-4bfc-9b83-e83a83e5281c req-f05d6244-66f7-435b-a581-21f0adba4c78 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:50.861244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a4122dab-d632-4bf1-9d37-df907004a43e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:50.866885 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d47164ac-72c4-4bfc-9b83-e83a83e5281c req-f05d6244-66f7-435b-a581-21f0adba4c78 service nova] Creating event network-vif-deleted:b54017fd-be21-45de-8025-0205f20d32de for instance b0d33d19-9934-492e-ab0f-0651fe5c6627 on nch2-master-1 Sep 06 10:55:50.872452 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-d47164ac-72c4-4bfc-9b83-e83a83e5281c req-f05d6244-66f7-435b-a581-21f0adba4c78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075766 Sep 06 10:55:50.873303 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 710/1393] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:50.874098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a4122dab-d632-4bf1-9d37-df907004a43e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:50.892396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4122dab-d632-4bf1-9d37-df907004a43e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:50.893113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4122dab-d632-4bf1-9d37-df907004a43e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:50.893754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4122dab-d632-4bf1-9d37-df907004a43e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:50.894926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4122dab-d632-4bf1-9d37-df907004a43e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:50.895646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4122dab-d632-4bf1-9d37-df907004a43e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:50.896302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4122dab-d632-4bf1-9d37-df907004a43e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:51.022522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-03cab3c9-d4ba-46cd-93d1-a7466f116379 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:51.023929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-03cab3c9-d4ba-46cd-93d1-a7466f116379 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:51.047679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03cab3c9-d4ba-46cd-93d1-a7466f116379 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:51.049742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03cab3c9-d4ba-46cd-93d1-a7466f116379 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:51.050920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03cab3c9-d4ba-46cd-93d1-a7466f116379 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:51.052303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03cab3c9-d4ba-46cd-93d1-a7466f116379 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:51.053845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03cab3c9-d4ba-46cd-93d1-a7466f116379 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:51.055633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03cab3c9-d4ba-46cd-93d1-a7466f116379 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:51.085158 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-03cab3c9-d4ba-46cd-93d1-a7466f116379 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] HTTP exception thrown: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-03cab3c9-d4ba-46cd-93d1-a7466f116379 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Request method failure captured: Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 HTTP/1.1 Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaMHiK0gzmd9scrpv9wlfY2-sOW_gyrGvUI3ISlqv2hlJG66yKdOOci1ZUKGdumB4gAyzdxfdxgOOJePlCTSZzbIPEiUP0hQ9hYelAFQta5paIVQX6qDVwTCVfR6aCcW5RCeSEo0RJaRa8R4gNwnSb5AJk4b9b7htAtE7Gdh5pu8Jo Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: c75bc66c9c9b4fc4b76380e47b40b0b5 Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1362206888 Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:55:51.087851 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:55:51.090754 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c75bc66c9c9b4fc4b76380e47b40b0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c75bc66c9c9b4fc4b76380e47b40b0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c75bc66c9c9b4fc4b76380e47b40b0b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c75bc66c9c9b4fc4b76380e47b40b0b5"}]}] Sep 06 10:55:51.090754 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1362206888 Sep 06 10:55:51.090754 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: c75bc66c9c9b4fc4b76380e47b40b0b5 Sep 06 10:55:51.090754 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1362206888 Sep 06 10:55:51.090754 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachSCSIVolumeTestJSON-1362206888-project Sep 06 10:55:51.090754 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:55:51.090754 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:55:51.090754 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6559ac446c4640218ce700687045bb0d Sep 06 10:55:51.090754 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1362206888-project Sep 06 10:55:51.090754 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:55:51.090754 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:51.090754 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '8bf2c50a-91cd-4042-914e-c85ff9025b00'} Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:51.091569 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:51.092850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:51.094114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-03cab3c9-d4ba-46cd-93d1-a7466f116379 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Returning 404 to user: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:51.096078 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-03cab3c9-d4ba-46cd-93d1-a7466f116379 tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 404 len: 111 microversion: 2.1 time: 0.080805 Sep 06 10:55:51.098773 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 711/1394] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:55:51 2022] DELETE /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:51.109186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e0ccbfa-8d13-4685-bf7b-f515cc70d68c tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:51.110415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5e0ccbfa-8d13-4685-bf7b-f515cc70d68c tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] [instance: 8bf2c50a-91cd-4042-914e-c85ff9025b00] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:51.121924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0ccbfa-8d13-4685-bf7b-f515cc70d68c tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:51.122934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0ccbfa-8d13-4685-bf7b-f515cc70d68c tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:51.124314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0ccbfa-8d13-4685-bf7b-f515cc70d68c tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:51.125291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0ccbfa-8d13-4685-bf7b-f515cc70d68c tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:51.126210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0ccbfa-8d13-4685-bf7b-f515cc70d68c tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:51.128579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0ccbfa-8d13-4685-bf7b-f515cc70d68c tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:51.130694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a4122dab-d632-4bf1-9d37-df907004a43e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:51.146656 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a4122dab-d632-4bf1-9d37-df907004a43e tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1511 microversion: 2.1 time: 0.313482 Sep 06 10:55:51.147269 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 684/1395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:50 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:51.174211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:51.182967 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-5e0ccbfa-8d13-4685-bf7b-f515cc70d68c tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] HTTP exception thrown: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e0ccbfa-8d13-4685-bf7b-f515cc70d68c tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Request method failure captured: Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 HTTP/1.1 Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaMHiK0gzmd9scrpv9wlfY2-sOW_gyrGvUI3ISlqv2hlJG66yKdOOci1ZUKGdumB4gAyzdxfdxgOOJePlCTSZzbIPEiUP0hQ9hYelAFQta5paIVQX6qDVwTCVfR6aCcW5RCeSEo0RJaRa8R4gNwnSb5AJk4b9b7htAtE7Gdh5pu8Jo Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: c75bc66c9c9b4fc4b76380e47b40b0b5 Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1362206888 Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:55:51.189898 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:55:51.191354 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c75bc66c9c9b4fc4b76380e47b40b0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c75bc66c9c9b4fc4b76380e47b40b0b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c75bc66c9c9b4fc4b76380e47b40b0b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c75bc66c9c9b4fc4b76380e47b40b0b5"}]}] Sep 06 10:55:51.191354 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1362206888 Sep 06 10:55:51.191354 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: c75bc66c9c9b4fc4b76380e47b40b0b5 Sep 06 10:55:51.191354 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1362206888 Sep 06 10:55:51.191354 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachSCSIVolumeTestJSON-1362206888-project Sep 06 10:55:51.191354 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:55:51.191354 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:55:51.191354 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6559ac446c4640218ce700687045bb0d Sep 06 10:55:51.191354 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1362206888-project Sep 06 10:55:51.191354 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:55:51.191354 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:51.191354 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '8bf2c50a-91cd-4042-914e-c85ff9025b00'} Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:55:51.192124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. Sep 06 10:55:51.193361 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:55:51.194600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e0ccbfa-8d13-4685-bf7b-f515cc70d68c tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] Returning 404 to user: Instance 8bf2c50a-91cd-4042-914e-c85ff9025b00 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:55:51.194600 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5e0ccbfa-8d13-4685-bf7b-f515cc70d68c tempest-AttachSCSIVolumeTestJSON-1362206888 tempest-AttachSCSIVolumeTestJSON-1362206888-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00" status: 404 len: 111 microversion: 2.1 time: 0.083578 Sep 06 10:55:51.194761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:51.194862 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 712/1396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:51 2022] GET /compute/v2.1/servers/8bf2c50a-91cd-4042-914e-c85ff9025b00 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:51.194941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:51.215441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:51.216019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:51.216875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:51.218104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:51.218579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:51.222343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:51.283514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:51.355237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:51.367302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:51.367793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:51.368423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:51.585152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b8204c49-87a1-449c-8f98-9c7bed54811a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:51.585792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b8204c49-87a1-449c-8f98-9c7bed54811a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:51.602145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8204c49-87a1-449c-8f98-9c7bed54811a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:51.605462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8204c49-87a1-449c-8f98-9c7bed54811a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:51.608223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8204c49-87a1-449c-8f98-9c7bed54811a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:51.609650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8204c49-87a1-449c-8f98-9c7bed54811a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:51.610347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8204c49-87a1-449c-8f98-9c7bed54811a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:51.611772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8204c49-87a1-449c-8f98-9c7bed54811a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:51.749542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b8204c49-87a1-449c-8f98-9c7bed54811a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:51.768689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b8204c49-87a1-449c-8f98-9c7bed54811a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:51.775699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b8204c49-87a1-449c-8f98-9c7bed54811a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:51.788864 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b8204c49-87a1-449c-8f98-9c7bed54811a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.214814 Sep 06 10:55:51.791972 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 713/1397] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:51 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:55:51.829179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b9c4b40b-5848-4c59-9de0-e95c4589049b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:51.829813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b9c4b40b-5848-4c59-9de0-e95c4589049b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:51.838359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9c4b40b-5848-4c59-9de0-e95c4589049b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:51.843426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9c4b40b-5848-4c59-9de0-e95c4589049b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:51.844322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9c4b40b-5848-4c59-9de0-e95c4589049b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:51.847165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9c4b40b-5848-4c59-9de0-e95c4589049b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:51.849979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9c4b40b-5848-4c59-9de0-e95c4589049b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:51.851003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9c4b40b-5848-4c59-9de0-e95c4589049b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:51.882110 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7a33e6dc-d714-4908-86eb-2d1392399578 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.711708 Sep 06 10:55:51.883892 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 685/1398] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:55:51 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:51.915793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-30df2394-9970-4317-aa0d-13f56809f783 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:51.923335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-30df2394-9970-4317-aa0d-13f56809f783 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:51.926589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-30df2394-9970-4317-aa0d-13f56809f783 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:52.126027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b9c4b40b-5848-4c59-9de0-e95c4589049b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:52.139430 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b9c4b40b-5848-4c59-9de0-e95c4589049b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1259 microversion: 2.1 time: 0.313850 Sep 06 10:55:52.148314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30df2394-9970-4317-aa0d-13f56809f783 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:52.150157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30df2394-9970-4317-aa0d-13f56809f783 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:52.150157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30df2394-9970-4317-aa0d-13f56809f783 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:52.150510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30df2394-9970-4317-aa0d-13f56809f783 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:52.151785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30df2394-9970-4317-aa0d-13f56809f783 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:52.152419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30df2394-9970-4317-aa0d-13f56809f783 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:52.157953 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 714/1399] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:51 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1259 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:52.274422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-30df2394-9970-4317-aa0d-13f56809f783 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:52.373217 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-30df2394-9970-4317-aa0d-13f56809f783 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.459500 Sep 06 10:55:52.377263 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 686/1400] 10.222.0.20 () {58 vars in 1150 bytes} [Tue Sep 6 10:55:51 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:52.393812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e9ab13eb-558c-4478-a490-a4afdc1cd1b7 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:52.402914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e9ab13eb-558c-4478-a490-a4afdc1cd1b7 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:52.403771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e9ab13eb-558c-4478-a490-a4afdc1cd1b7 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:52.415922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9ab13eb-558c-4478-a490-a4afdc1cd1b7 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:52.417705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9ab13eb-558c-4478-a490-a4afdc1cd1b7 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:52.418324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9ab13eb-558c-4478-a490-a4afdc1cd1b7 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:52.420484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9ab13eb-558c-4478-a490-a4afdc1cd1b7 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:52.421473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9ab13eb-558c-4478-a490-a4afdc1cd1b7 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:52.422335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9ab13eb-558c-4478-a490-a4afdc1cd1b7 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:52.587389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-e9ab13eb-558c-4478-a490-a4afdc1cd1b7 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:52.667913 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e9ab13eb-558c-4478-a490-a4afdc1cd1b7 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.279219 Sep 06 10:55:52.677737 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 715/1401] 10.222.0.20 () {58 vars in 1212 bytes} [Tue Sep 6 10:55:52 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:52.686953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-186c2464-cb75-4c2f-92c6-dfc118c45523 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:52.700387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-186c2464-cb75-4c2f-92c6-dfc118c45523 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:52.701147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-186c2464-cb75-4c2f-92c6-dfc118c45523 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:52.719591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-186c2464-cb75-4c2f-92c6-dfc118c45523 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:52.724153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-186c2464-cb75-4c2f-92c6-dfc118c45523 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:52.724153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-186c2464-cb75-4c2f-92c6-dfc118c45523 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:52.724153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-186c2464-cb75-4c2f-92c6-dfc118c45523 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:52.724740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-186c2464-cb75-4c2f-92c6-dfc118c45523 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:52.725888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-186c2464-cb75-4c2f-92c6-dfc118c45523 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:52.821630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-83fe01b1-0951-45d2-8b5f-d9ccd0b69e8b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:52.822260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-83fe01b1-0951-45d2-8b5f-d9ccd0b69e8b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:52.831992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83fe01b1-0951-45d2-8b5f-d9ccd0b69e8b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:52.833452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83fe01b1-0951-45d2-8b5f-d9ccd0b69e8b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:52.835843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83fe01b1-0951-45d2-8b5f-d9ccd0b69e8b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:52.846093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83fe01b1-0951-45d2-8b5f-d9ccd0b69e8b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:52.847071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83fe01b1-0951-45d2-8b5f-d9ccd0b69e8b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:52.849221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83fe01b1-0951-45d2-8b5f-d9ccd0b69e8b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:52.862183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-186c2464-cb75-4c2f-92c6-dfc118c45523 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:53.007113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-83fe01b1-0951-45d2-8b5f-d9ccd0b69e8b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:53.008209 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-186c2464-cb75-4c2f-92c6-dfc118c45523 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.330155 Sep 06 10:55:53.011057 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 687/1402] 10.222.0.20 () {58 vars in 1196 bytes} [Tue Sep 6 10:55:52 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:53.021116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-83fe01b1-0951-45d2-8b5f-d9ccd0b69e8b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:53.024032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-83fe01b1-0951-45d2-8b5f-d9ccd0b69e8b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:53.024898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fc58e735-14fb-4a82-8cbb-85e33003fcdd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:53.032330 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-83fe01b1-0951-45d2-8b5f-d9ccd0b69e8b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.216366 Sep 06 10:55:53.033941 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 716/1403] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:52 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:55:53.037415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fc58e735-14fb-4a82-8cbb-85e33003fcdd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:53.040775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fc58e735-14fb-4a82-8cbb-85e33003fcdd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'name': '-843517541', 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:53.063767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc58e735-14fb-4a82-8cbb-85e33003fcdd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:53.069447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc58e735-14fb-4a82-8cbb-85e33003fcdd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:53.069447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc58e735-14fb-4a82-8cbb-85e33003fcdd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:53.070831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc58e735-14fb-4a82-8cbb-85e33003fcdd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:53.072948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc58e735-14fb-4a82-8cbb-85e33003fcdd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:53.073650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc58e735-14fb-4a82-8cbb-85e33003fcdd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:53.185246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c5343ea2-2a64-41d2-b788-218ea6030111 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:53.185882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c5343ea2-2a64-41d2-b788-218ea6030111 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:53.195583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5343ea2-2a64-41d2-b788-218ea6030111 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:53.201926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5343ea2-2a64-41d2-b788-218ea6030111 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:53.201926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5343ea2-2a64-41d2-b788-218ea6030111 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:53.201926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5343ea2-2a64-41d2-b788-218ea6030111 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:53.202808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5343ea2-2a64-41d2-b788-218ea6030111 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:53.203325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5343ea2-2a64-41d2-b788-218ea6030111 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:53.264538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-fc58e735-14fb-4a82-8cbb-85e33003fcdd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:53.436622 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fc58e735-14fb-4a82-8cbb-85e33003fcdd tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-843517541" status: 200 len: 345 microversion: 2.1 time: 0.415721 Sep 06 10:55:53.446468 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 688/1404] 10.222.0.20 () {58 vars in 1156 bytes} [Tue Sep 6 10:55:53 2022] GET /compute/v2.1/servers?name=-843517541 => generated 345 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:53.452114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a8b64036-329c-4165-ae69-04661856b094 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:53.457680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a8b64036-329c-4165-ae69-04661856b094 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:53.458304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a8b64036-329c-4165-ae69-04661856b094 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:53.466216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8b64036-329c-4165-ae69-04661856b094 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:53.467163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8b64036-329c-4165-ae69-04661856b094 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:53.467862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8b64036-329c-4165-ae69-04661856b094 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:53.468826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8b64036-329c-4165-ae69-04661856b094 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:53.469553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8b64036-329c-4165-ae69-04661856b094 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:53.470204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8b64036-329c-4165-ae69-04661856b094 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:53.639232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-a8b64036-329c-4165-ae69-04661856b094 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:53.685245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c5343ea2-2a64-41d2-b788-218ea6030111 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:53.697385 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c5343ea2-2a64-41d2-b788-218ea6030111 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1265 microversion: 2.1 time: 0.516228 Sep 06 10:55:53.713010 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 717/1405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:53 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1265 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:53.715730 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a8b64036-329c-4165-ae69-04661856b094 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.267890 Sep 06 10:55:53.716616 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 689/1406] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Sep 6 10:55:53 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:53.738172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fa85154f-8866-4a7d-b9ee-4d89e0c81a69 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:53.754452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fa85154f-8866-4a7d-b9ee-4d89e0c81a69 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:53.755588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fa85154f-8866-4a7d-b9ee-4d89e0c81a69 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-84351754', 'deleted': False, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:55:53.762131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa85154f-8866-4a7d-b9ee-4d89e0c81a69 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:53.763470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa85154f-8866-4a7d-b9ee-4d89e0c81a69 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:53.764041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa85154f-8866-4a7d-b9ee-4d89e0c81a69 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:53.765936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa85154f-8866-4a7d-b9ee-4d89e0c81a69 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:53.766562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa85154f-8866-4a7d-b9ee-4d89e0c81a69 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:53.767471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa85154f-8866-4a7d-b9ee-4d89e0c81a69 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:53.887237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-fa85154f-8866-4a7d-b9ee-4d89e0c81a69 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:55:53.994281 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fa85154f-8866-4a7d-b9ee-4d89e0c81a69 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-84351754" status: 200 len: 345 microversion: 2.1 time: 0.265844 Sep 06 10:55:53.996262 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 718/1407] 10.222.0.20 () {58 vars in 1226 bytes} [Tue Sep 6 10:55:53 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-84351754 => generated 345 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:54.013687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1462465b-33d5-4bae-bc41-d000d0ee1a08 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:54.014957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1462465b-33d5-4bae-bc41-d000d0ee1a08 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:54.031318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1462465b-33d5-4bae-bc41-d000d0ee1a08 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:54.032157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1462465b-33d5-4bae-bc41-d000d0ee1a08 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:54.034539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1462465b-33d5-4bae-bc41-d000d0ee1a08 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:54.035598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1462465b-33d5-4bae-bc41-d000d0ee1a08 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:54.036959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1462465b-33d5-4bae-bc41-d000d0ee1a08 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:54.037640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1462465b-33d5-4bae-bc41-d000d0ee1a08 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:54.067664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b7e93aee-06c8-48d9-9be1-58cf9721607c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:54.070580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b7e93aee-06c8-48d9-9be1-58cf9721607c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:54.092616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7e93aee-06c8-48d9-9be1-58cf9721607c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:54.097410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7e93aee-06c8-48d9-9be1-58cf9721607c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:54.098347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7e93aee-06c8-48d9-9be1-58cf9721607c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:54.101693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7e93aee-06c8-48d9-9be1-58cf9721607c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:54.104208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7e93aee-06c8-48d9-9be1-58cf9721607c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:54.105292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7e93aee-06c8-48d9-9be1-58cf9721607c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:54.112822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1462465b-33d5-4bae-bc41-d000d0ee1a08 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:55:54.488022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b7e93aee-06c8-48d9-9be1-58cf9721607c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:54.517349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b7e93aee-06c8-48d9-9be1-58cf9721607c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:54.521136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b7e93aee-06c8-48d9-9be1-58cf9721607c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:54.532597 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b7e93aee-06c8-48d9-9be1-58cf9721607c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.469906 Sep 06 10:55:54.536249 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 719/1408] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:54 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:55:54.724831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c21b9efe-469e-4534-982d-cc1a64db6b6d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:54.725651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c21b9efe-469e-4534-982d-cc1a64db6b6d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:54.737503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c21b9efe-469e-4534-982d-cc1a64db6b6d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:54.744138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c21b9efe-469e-4534-982d-cc1a64db6b6d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:54.745991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c21b9efe-469e-4534-982d-cc1a64db6b6d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:54.745991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c21b9efe-469e-4534-982d-cc1a64db6b6d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:54.747089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c21b9efe-469e-4534-982d-cc1a64db6b6d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:54.750224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c21b9efe-469e-4534-982d-cc1a64db6b6d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:54.766614 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1462465b-33d5-4bae-bc41-d000d0ee1a08 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 204 len: 0 microversion: 2.1 time: 0.761276 Sep 06 10:55:54.767610 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 690/1409] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:55:54 2022] DELETE /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:55:54.780846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8785893a-1933-4274-b8bd-65b2b55d8f0c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:54.782065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8785893a-1933-4274-b8bd-65b2b55d8f0c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:54.807259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8785893a-1933-4274-b8bd-65b2b55d8f0c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:54.808819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8785893a-1933-4274-b8bd-65b2b55d8f0c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:54.810200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8785893a-1933-4274-b8bd-65b2b55d8f0c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:54.811802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8785893a-1933-4274-b8bd-65b2b55d8f0c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:54.813116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8785893a-1933-4274-b8bd-65b2b55d8f0c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:54.814422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8785893a-1933-4274-b8bd-65b2b55d8f0c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:55.200319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c21b9efe-469e-4534-982d-cc1a64db6b6d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:55.212985 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c21b9efe-469e-4534-982d-cc1a64db6b6d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1307 microversion: 2.1 time: 0.493704 Sep 06 10:55:55.216645 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 720/1410] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:54 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1307 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:55.249638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8785893a-1933-4274-b8bd-65b2b55d8f0c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:55.262783 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8785893a-1933-4274-b8bd-65b2b55d8f0c tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1517 microversion: 2.1 time: 0.489578 Sep 06 10:55:55.263986 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 691/1411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:54 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1517 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:55.565566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-694f3865-3db6-4056-bbcb-9f1216db44c9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:55.567155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-694f3865-3db6-4056-bbcb-9f1216db44c9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:55.586790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-694f3865-3db6-4056-bbcb-9f1216db44c9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:55.588446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-694f3865-3db6-4056-bbcb-9f1216db44c9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:55.588917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-694f3865-3db6-4056-bbcb-9f1216db44c9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:55.591002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-694f3865-3db6-4056-bbcb-9f1216db44c9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:55.593564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-694f3865-3db6-4056-bbcb-9f1216db44c9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:55.594558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-694f3865-3db6-4056-bbcb-9f1216db44c9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:55.771145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-694f3865-3db6-4056-bbcb-9f1216db44c9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:55.797306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-694f3865-3db6-4056-bbcb-9f1216db44c9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:55.798407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-694f3865-3db6-4056-bbcb-9f1216db44c9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:55.804629 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-694f3865-3db6-4056-bbcb-9f1216db44c9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.243454 Sep 06 10:55:55.805807 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 721/1412] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:55 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:56.237872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-44af953b-30b3-44a6-8bc0-5d7e8217e8da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:56.238880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-44af953b-30b3-44a6-8bc0-5d7e8217e8da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:56.256006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44af953b-30b3-44a6-8bc0-5d7e8217e8da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:56.257387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44af953b-30b3-44a6-8bc0-5d7e8217e8da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:56.258003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44af953b-30b3-44a6-8bc0-5d7e8217e8da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:56.259254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44af953b-30b3-44a6-8bc0-5d7e8217e8da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:56.259878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44af953b-30b3-44a6-8bc0-5d7e8217e8da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:56.260532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44af953b-30b3-44a6-8bc0-5d7e8217e8da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:56.288594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-98b7feae-68d2-40b0-9b2b-fc50c6d65166 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:56.289318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-98b7feae-68d2-40b0-9b2b-fc50c6d65166 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:56.308949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98b7feae-68d2-40b0-9b2b-fc50c6d65166 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:56.309612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98b7feae-68d2-40b0-9b2b-fc50c6d65166 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:56.310170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98b7feae-68d2-40b0-9b2b-fc50c6d65166 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:56.311003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98b7feae-68d2-40b0-9b2b-fc50c6d65166 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:56.311601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98b7feae-68d2-40b0-9b2b-fc50c6d65166 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:56.312138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98b7feae-68d2-40b0-9b2b-fc50c6d65166 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:56.579053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-44af953b-30b3-44a6-8bc0-5d7e8217e8da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:56.591341 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-44af953b-30b3-44a6-8bc0-5d7e8217e8da tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1307 microversion: 2.1 time: 0.357234 Sep 06 10:55:56.591947 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 692/1413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:56 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:56.713183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-98b7feae-68d2-40b0-9b2b-fc50c6d65166 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:56.721271 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-98b7feae-68d2-40b0-9b2b-fc50c6d65166 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1517 microversion: 2.1 time: 0.437206 Sep 06 10:55:56.721864 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 722/1414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:56 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1517 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:56.834993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6ca06959-b61f-456e-b437-34f889ac2ef6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:56.835854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6ca06959-b61f-456e-b437-34f889ac2ef6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:56.860287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ca06959-b61f-456e-b437-34f889ac2ef6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:56.860800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ca06959-b61f-456e-b437-34f889ac2ef6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:56.861258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ca06959-b61f-456e-b437-34f889ac2ef6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:56.861989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ca06959-b61f-456e-b437-34f889ac2ef6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:56.862459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ca06959-b61f-456e-b437-34f889ac2ef6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:56.864661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ca06959-b61f-456e-b437-34f889ac2ef6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:57.119627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6ca06959-b61f-456e-b437-34f889ac2ef6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:57.133291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6ca06959-b61f-456e-b437-34f889ac2ef6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:57.139488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6ca06959-b61f-456e-b437-34f889ac2ef6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:57.148679 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6ca06959-b61f-456e-b437-34f889ac2ef6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.318156 Sep 06 10:55:57.151583 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 693/1415] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:56 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:57.509491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-96816f37-375b-4f1c-a9ef-ed33f84116f0 req-657c8d9c-15b4-4ee7-b29b-a67b8c737adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "937289ab-8f49-410a-8477-7f970832616f", "tag": "bbc270c7-beb0-4db6-9d50-0a3fe6996886"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:57.539550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-96816f37-375b-4f1c-a9ef-ed33f84116f0 req-657c8d9c-15b4-4ee7-b29b-a67b8c737adf service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:57.540976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-96816f37-375b-4f1c-a9ef-ed33f84116f0 req-657c8d9c-15b4-4ee7-b29b-a67b8c737adf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:57.540976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-96816f37-375b-4f1c-a9ef-ed33f84116f0 req-657c8d9c-15b4-4ee7-b29b-a67b8c737adf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:57.556464 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-96816f37-375b-4f1c-a9ef-ed33f84116f0 req-657c8d9c-15b4-4ee7-b29b-a67b8c737adf service nova] Creating event network-changed:bbc270c7-beb0-4db6-9d50-0a3fe6996886 for instance 937289ab-8f49-410a-8477-7f970832616f on nch1-master-1 Sep 06 10:55:57.575064 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-96816f37-375b-4f1c-a9ef-ed33f84116f0 req-657c8d9c-15b4-4ee7-b29b-a67b8c737adf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069633 Sep 06 10:55:57.576368 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 723/1416] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:57.618671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dbc572a4-f187-4c76-ad64-9e447bd9cae7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:57.619404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dbc572a4-f187-4c76-ad64-9e447bd9cae7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:57.634789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbc572a4-f187-4c76-ad64-9e447bd9cae7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:57.636255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbc572a4-f187-4c76-ad64-9e447bd9cae7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:57.644903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbc572a4-f187-4c76-ad64-9e447bd9cae7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:57.650414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbc572a4-f187-4c76-ad64-9e447bd9cae7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:57.659228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbc572a4-f187-4c76-ad64-9e447bd9cae7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:57.661526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbc572a4-f187-4c76-ad64-9e447bd9cae7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:57.669406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:57.748882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7c7d1195-6c37-44c8-9aed-efa7b0fe32eb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:57.749683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7c7d1195-6c37-44c8-9aed-efa7b0fe32eb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:57.763321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c7d1195-6c37-44c8-9aed-efa7b0fe32eb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:57.768206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c7d1195-6c37-44c8-9aed-efa7b0fe32eb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:57.775847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c7d1195-6c37-44c8-9aed-efa7b0fe32eb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:57.779601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c7d1195-6c37-44c8-9aed-efa7b0fe32eb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:57.780635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c7d1195-6c37-44c8-9aed-efa7b0fe32eb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:57.781908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c7d1195-6c37-44c8-9aed-efa7b0fe32eb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:58.402188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dbc572a4-f187-4c76-ad64-9e447bd9cae7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:58.422984 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dbc572a4-f187-4c76-ad64-9e447bd9cae7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1307 microversion: 2.1 time: 0.808844 Sep 06 10:55:58.424234 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 694/1417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:57 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1307 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:58.432232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e4ed8f7f-1dad-469d-970a-9cd71d70ca0b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:58.439754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e4ed8f7f-1dad-469d-970a-9cd71d70ca0b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:58.449819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4ed8f7f-1dad-469d-970a-9cd71d70ca0b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:58.450773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4ed8f7f-1dad-469d-970a-9cd71d70ca0b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:58.451425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4ed8f7f-1dad-469d-970a-9cd71d70ca0b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:58.452333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4ed8f7f-1dad-469d-970a-9cd71d70ca0b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:58.453561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4ed8f7f-1dad-469d-970a-9cd71d70ca0b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:58.454186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4ed8f7f-1dad-469d-970a-9cd71d70ca0b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:58.473930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7c7d1195-6c37-44c8-9aed-efa7b0fe32eb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:58.491700 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7c7d1195-6c37-44c8-9aed-efa7b0fe32eb tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1517 microversion: 2.1 time: 0.742419 Sep 06 10:55:58.492370 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 724/1418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:57 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1517 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:55:58.653905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e4ed8f7f-1dad-469d-970a-9cd71d70ca0b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:58.686541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e4ed8f7f-1dad-469d-970a-9cd71d70ca0b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:58.697222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e4ed8f7f-1dad-469d-970a-9cd71d70ca0b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:58.712551 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e4ed8f7f-1dad-469d-970a-9cd71d70ca0b tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.286222 Sep 06 10:55:58.729214 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 695/1419] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:58 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:55:58.819582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-e27ade5c-489d-4313-842f-2af86d2543ff req-1fdf2b89-1849-4670-8be6-f4486ee81b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2127bce6-afc2-4bc3-87b3-882572de2144", "name": "network-vif-deleted", "tag": "23f8c404-c5d8-41db-bbca-1bd890f56145"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:55:58.828861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:58.836014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e27ade5c-489d-4313-842f-2af86d2543ff req-1fdf2b89-1849-4670-8be6-f4486ee81b54 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:58.837099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e27ade5c-489d-4313-842f-2af86d2543ff req-1fdf2b89-1849-4670-8be6-f4486ee81b54 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:58.837712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e27ade5c-489d-4313-842f-2af86d2543ff req-1fdf2b89-1849-4670-8be6-f4486ee81b54 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:58.853544 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-e27ade5c-489d-4313-842f-2af86d2543ff req-1fdf2b89-1849-4670-8be6-f4486ee81b54 service nova] Creating event network-vif-deleted:23f8c404-c5d8-41db-bbca-1bd890f56145 for instance 2127bce6-afc2-4bc3-87b3-882572de2144 on nch2-master-1 Sep 06 10:55:58.860452 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-e27ade5c-489d-4313-842f-2af86d2543ff req-1fdf2b89-1849-4670-8be6-f4486ee81b54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049833 Sep 06 10:55:58.861867 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 725/1420] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:55:59.454133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d80931c0-c907-4eb1-88ad-324c739353e6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:59.455167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d80931c0-c907-4eb1-88ad-324c739353e6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:59.469747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d80931c0-c907-4eb1-88ad-324c739353e6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:59.469747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d80931c0-c907-4eb1-88ad-324c739353e6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:59.469747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d80931c0-c907-4eb1-88ad-324c739353e6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:59.469747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d80931c0-c907-4eb1-88ad-324c739353e6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:59.470146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d80931c0-c907-4eb1-88ad-324c739353e6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:59.470146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d80931c0-c907-4eb1-88ad-324c739353e6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:59.521607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:59.523044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:59.533161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:59.533856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:59.534486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:59.535395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:59.535986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:59.536434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:59.638683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:59.645095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:59.651754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:59.652067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lazy-loading 'fault' on Instance uuid 2127bce6-afc2-4bc3-87b3-882572de2144 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:55:59.765330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:59.809426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d80931c0-c907-4eb1-88ad-324c739353e6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:59.822943 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d80931c0-c907-4eb1-88ad-324c739353e6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1307 microversion: 2.1 time: 0.374250 Sep 06 10:55:59.833819 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 696/1421] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:59 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1307 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:59.840448 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e9312fb8-0fe9-4b6e-8dec-275909081651 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1310 microversion: 2.1 time: 0.322704 Sep 06 10:55:59.843651 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 726/1422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:55:59 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1310 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:55:59.844981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dad51ff8-8cfa-4eac-b5b5-190793b9b3cc tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:55:59.846112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dad51ff8-8cfa-4eac-b5b5-190793b9b3cc tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:55:59.856117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dad51ff8-8cfa-4eac-b5b5-190793b9b3cc tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:59.869012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dad51ff8-8cfa-4eac-b5b5-190793b9b3cc tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:59.869012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dad51ff8-8cfa-4eac-b5b5-190793b9b3cc tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:59.869012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dad51ff8-8cfa-4eac-b5b5-190793b9b3cc tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:55:59.869012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dad51ff8-8cfa-4eac-b5b5-190793b9b3cc tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:55:59.869800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dad51ff8-8cfa-4eac-b5b5-190793b9b3cc tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:55:59.956750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dad51ff8-8cfa-4eac-b5b5-190793b9b3cc tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:59.972846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dad51ff8-8cfa-4eac-b5b5-190793b9b3cc tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:59.977288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dad51ff8-8cfa-4eac-b5b5-190793b9b3cc tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:55:59.985815 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dad51ff8-8cfa-4eac-b5b5-190793b9b3cc tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.150112 Sep 06 10:55:59.987557 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 697/1423] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:55:59 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:00.847099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-93779fa1-2fbf-4e3d-aad7-c78f85419bca tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:00.851582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-93779fa1-2fbf-4e3d-aad7-c78f85419bca tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:00.859359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93779fa1-2fbf-4e3d-aad7-c78f85419bca tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:00.859817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93779fa1-2fbf-4e3d-aad7-c78f85419bca tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:00.860465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93779fa1-2fbf-4e3d-aad7-c78f85419bca tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:00.861186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93779fa1-2fbf-4e3d-aad7-c78f85419bca tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:00.861823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93779fa1-2fbf-4e3d-aad7-c78f85419bca tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:00.862413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93779fa1-2fbf-4e3d-aad7-c78f85419bca tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:00.886714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:00.887427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:00.894465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:00.906533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:00.908616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:00.909399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:00.913109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:00.914644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:00.922370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:00.976218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:00.976218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:00.976629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:00.977354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lazy-loading 'fault' on Instance uuid 2127bce6-afc2-4bc3-87b3-882572de2144 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:01.061497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:01.070742 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-40b84d32-99b6-4809-bf71-eebf94778e63 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 200 len: 1310 microversion: 2.1 time: 0.194931 Sep 06 10:56:01.071624 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 698/1424] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:00 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 1310 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:01.077160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a6d3c9e6-78b7-46e6-b6fb-690196ac6429 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:01.078362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a6d3c9e6-78b7-46e6-b6fb-690196ac6429 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:01.126717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-93779fa1-2fbf-4e3d-aad7-c78f85419bca tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:01.133248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6d3c9e6-78b7-46e6-b6fb-690196ac6429 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:01.133799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6d3c9e6-78b7-46e6-b6fb-690196ac6429 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:01.134569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6d3c9e6-78b7-46e6-b6fb-690196ac6429 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:01.135717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6d3c9e6-78b7-46e6-b6fb-690196ac6429 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:01.136552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6d3c9e6-78b7-46e6-b6fb-690196ac6429 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:01.137254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6d3c9e6-78b7-46e6-b6fb-690196ac6429 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:01.140321 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-93779fa1-2fbf-4e3d-aad7-c78f85419bca tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1307 microversion: 2.1 time: 0.295916 Sep 06 10:56:01.142739 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 727/1425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:00 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1307 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:01.228743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a6d3c9e6-78b7-46e6-b6fb-690196ac6429 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:01.237995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a6d3c9e6-78b7-46e6-b6fb-690196ac6429 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:01.240294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a6d3c9e6-78b7-46e6-b6fb-690196ac6429 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:01.246826 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a6d3c9e6-78b7-46e6-b6fb-690196ac6429 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.173919 Sep 06 10:56:01.259176 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 699/1426] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:01 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:02.099229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ab528024-d26c-4ad3-83cc-877997f48b7b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:02.120946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ab528024-d26c-4ad3-83cc-877997f48b7b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 2127bce6-afc2-4bc3-87b3-882572de2144] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:02.145791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab528024-d26c-4ad3-83cc-877997f48b7b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:02.147059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab528024-d26c-4ad3-83cc-877997f48b7b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:02.149644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab528024-d26c-4ad3-83cc-877997f48b7b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:02.152149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab528024-d26c-4ad3-83cc-877997f48b7b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:02.155269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab528024-d26c-4ad3-83cc-877997f48b7b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:02.157156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab528024-d26c-4ad3-83cc-877997f48b7b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:02.173494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-416a3bbb-cfb5-4207-b770-9e06fdc390c8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:02.174164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-416a3bbb-cfb5-4207-b770-9e06fdc390c8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:02.178709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:02.192843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-416a3bbb-cfb5-4207-b770-9e06fdc390c8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:02.197536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-416a3bbb-cfb5-4207-b770-9e06fdc390c8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:02.197536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-416a3bbb-cfb5-4207-b770-9e06fdc390c8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:02.197536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-416a3bbb-cfb5-4207-b770-9e06fdc390c8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:02.197536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-416a3bbb-cfb5-4207-b770-9e06fdc390c8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:02.198065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-416a3bbb-cfb5-4207-b770-9e06fdc390c8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:02.213409 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-ab528024-d26c-4ad3-83cc-877997f48b7b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] HTTP exception thrown: Instance 2127bce6-afc2-4bc3-87b3-882572de2144 could not be found. Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ab528024-d26c-4ad3-83cc-877997f48b7b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Request method failure captured: Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 HTTP/1.1 Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyb2-UQAYK-7aq-oUAKJdOq0aUvjRC3uyYj_5fffZRRmVHI0mAvck6TZRak_EnOn6T0ra1ZCt8dM90GseWb1krxRJX17XUacFiMjdKFX_4InAvCxudW5cs2W0sOjjPNmZsw_E2f9Fvo82Otmp7uS7gixsM4ROcVwFD2A6Hk-cHg4ARU Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2ce648f86e3e4a3c9e8712bb087b8769 Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ListServerFiltersTestJSON-2142605568 Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:56:02.218662 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:56:02.221321 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ce648f86e3e4a3c9e8712bb087b8769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ce648f86e3e4a3c9e8712bb087b8769"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ce648f86e3e4a3c9e8712bb087b8769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ce648f86e3e4a3c9e8712bb087b8769"}]}] Sep 06 10:56:02.221321 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ListServerFiltersTestJSON-2142605568 Sep 06 10:56:02.221321 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2ce648f86e3e4a3c9e8712bb087b8769 Sep 06 10:56:02.221321 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2142605568 Sep 06 10:56:02.221321 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ListServerFiltersTestJSON-2142605568-project Sep 06 10:56:02.221321 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:56:02.221321 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:56:02.221321 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: de579d631e9d4010887077567bbe5fd6 Sep 06 10:56:02.221321 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ListServerFiltersTestJSON-2142605568-project Sep 06 10:56:02.221321 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:56:02.221321 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 2127bce6-afc2-4bc3-87b3-882572de2144 could not be found. Sep 06 10:56:02.221321 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '2127bce6-afc2-4bc3-87b3-882572de2144'} Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2127bce6-afc2-4bc3-87b3-882572de2144 could not be found. Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:02.222223 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2127bce6-afc2-4bc3-87b3-882572de2144 could not be found. Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2127bce6-afc2-4bc3-87b3-882572de2144 could not be found. Sep 06 10:56:02.224251 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:02.236791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ab528024-d26c-4ad3-83cc-877997f48b7b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Returning 404 to user: Instance 2127bce6-afc2-4bc3-87b3-882572de2144 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:02.240089 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ab528024-d26c-4ad3-83cc-877997f48b7b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144" status: 404 len: 111 microversion: 2.1 time: 0.149946 Sep 06 10:56:02.243211 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 728/1427] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:02 2022] GET /compute/v2.1/servers/2127bce6-afc2-4bc3-87b3-882572de2144 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:56:02.255046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d3412b65-d8fd-4c58-aff4-fe76dc41ad88 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:02.255555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3412b65-d8fd-4c58-aff4-fe76dc41ad88 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:02.263594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:02.269948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3412b65-d8fd-4c58-aff4-fe76dc41ad88 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:02.278980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3412b65-d8fd-4c58-aff4-fe76dc41ad88 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:02.278980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3412b65-d8fd-4c58-aff4-fe76dc41ad88 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:02.278980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3412b65-d8fd-4c58-aff4-fe76dc41ad88 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:02.278980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3412b65-d8fd-4c58-aff4-fe76dc41ad88 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:02.279604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3412b65-d8fd-4c58-aff4-fe76dc41ad88 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:02.316641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3412b65-d8fd-4c58-aff4-fe76dc41ad88 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:56:02.581991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-416a3bbb-cfb5-4207-b770-9e06fdc390c8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:02.598644 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-416a3bbb-cfb5-4207-b770-9e06fdc390c8 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1307 microversion: 2.1 time: 0.428424 Sep 06 10:56:02.600866 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 700/1428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:02 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1307 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:02.608951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4b7ed2ac-1580-4295-b13a-ca8e22d5ec9e tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:02.610356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4b7ed2ac-1580-4295-b13a-ca8e22d5ec9e tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:02.619581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b7ed2ac-1580-4295-b13a-ca8e22d5ec9e tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:02.639511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b7ed2ac-1580-4295-b13a-ca8e22d5ec9e tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:02.643988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b7ed2ac-1580-4295-b13a-ca8e22d5ec9e tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:02.645612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b7ed2ac-1580-4295-b13a-ca8e22d5ec9e tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:02.646303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b7ed2ac-1580-4295-b13a-ca8e22d5ec9e tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:02.648235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b7ed2ac-1580-4295-b13a-ca8e22d5ec9e tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:02.753513 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d3412b65-d8fd-4c58-aff4-fe76dc41ad88 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7" status: 204 len: 0 microversion: 2.1 time: 0.507469 Sep 06 10:56:02.755918 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 729/1429] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:56:02 2022] DELETE /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:56:02.767698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-df2bc4b1-0509-4dad-8b9e-fbc8127703d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:02.768705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-df2bc4b1-0509-4dad-8b9e-fbc8127703d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:02.794779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df2bc4b1-0509-4dad-8b9e-fbc8127703d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:02.799786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df2bc4b1-0509-4dad-8b9e-fbc8127703d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:02.801385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df2bc4b1-0509-4dad-8b9e-fbc8127703d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:02.805047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df2bc4b1-0509-4dad-8b9e-fbc8127703d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:02.806465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df2bc4b1-0509-4dad-8b9e-fbc8127703d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:02.807890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df2bc4b1-0509-4dad-8b9e-fbc8127703d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:02.852385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4b7ed2ac-1580-4295-b13a-ca8e22d5ec9e tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:02.872725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4b7ed2ac-1580-4295-b13a-ca8e22d5ec9e tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:02.886165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4b7ed2ac-1580-4295-b13a-ca8e22d5ec9e tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:02.903346 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4b7ed2ac-1580-4295-b13a-ca8e22d5ec9e tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.296817 Sep 06 10:56:02.910022 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 701/1430] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:02 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:03.088559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-df2bc4b1-0509-4dad-8b9e-fbc8127703d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:03.100577 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-df2bc4b1-0509-4dad-8b9e-fbc8127703d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7" status: 200 len: 1518 microversion: 2.1 time: 0.337799 Sep 06 10:56:03.104367 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 730/1431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:02 2022] GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 => generated 1518 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:03.627680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-023c8a98-8abf-4e3a-bb75-494521558c81 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:03.629290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-023c8a98-8abf-4e3a-bb75-494521558c81 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:03.634251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=12 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:03.651925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-023c8a98-8abf-4e3a-bb75-494521558c81 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:03.651925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-023c8a98-8abf-4e3a-bb75-494521558c81 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:03.651925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-023c8a98-8abf-4e3a-bb75-494521558c81 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:03.661691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-023c8a98-8abf-4e3a-bb75-494521558c81 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:03.665007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-023c8a98-8abf-4e3a-bb75-494521558c81 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:03.667391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-023c8a98-8abf-4e3a-bb75-494521558c81 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:03.919666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-023c8a98-8abf-4e3a-bb75-494521558c81 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:03.930090 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-023c8a98-8abf-4e3a-bb75-494521558c81 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1307 microversion: 2.1 time: 0.306682 Sep 06 10:56:03.946023 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 702/1432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:03 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1307 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:03.946244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-819e102f-ea51-488e-853d-4276c94a6b20 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:03.946244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-819e102f-ea51-488e-853d-4276c94a6b20 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:03.957650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:03.961922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-819e102f-ea51-488e-853d-4276c94a6b20 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:03.964486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-819e102f-ea51-488e-853d-4276c94a6b20 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:03.965012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-819e102f-ea51-488e-853d-4276c94a6b20 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:03.966863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-819e102f-ea51-488e-853d-4276c94a6b20 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:03.967432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-819e102f-ea51-488e-853d-4276c94a6b20 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:03.968644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-819e102f-ea51-488e-853d-4276c94a6b20 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:04.127743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c74b6e33-3b41-4dc8-89e8-9fa31f94a0d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:04.128377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c74b6e33-3b41-4dc8-89e8-9fa31f94a0d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:04.136539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c74b6e33-3b41-4dc8-89e8-9fa31f94a0d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:04.137144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c74b6e33-3b41-4dc8-89e8-9fa31f94a0d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:04.137602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c74b6e33-3b41-4dc8-89e8-9fa31f94a0d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:04.138325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c74b6e33-3b41-4dc8-89e8-9fa31f94a0d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:04.139916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c74b6e33-3b41-4dc8-89e8-9fa31f94a0d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:04.140602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c74b6e33-3b41-4dc8-89e8-9fa31f94a0d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:04.292991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-819e102f-ea51-488e-853d-4276c94a6b20 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:04.334124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-819e102f-ea51-488e-853d-4276c94a6b20 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:04.342765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-819e102f-ea51-488e-853d-4276c94a6b20 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:04.363837 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-819e102f-ea51-488e-853d-4276c94a6b20 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.432943 Sep 06 10:56:04.367282 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 731/1433] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:03 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:04.755643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c74b6e33-3b41-4dc8-89e8-9fa31f94a0d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:04.770343 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c74b6e33-3b41-4dc8-89e8-9fa31f94a0d9 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7" status: 200 len: 1518 microversion: 2.1 time: 0.642473 Sep 06 10:56:04.787423 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 703/1434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:04 2022] GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 => generated 1518 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:04.954441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9e561c77-5942-4b3a-8dda-a7e541d2ac8a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:04.955475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9e561c77-5942-4b3a-8dda-a7e541d2ac8a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:04.965595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e561c77-5942-4b3a-8dda-a7e541d2ac8a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:04.966482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e561c77-5942-4b3a-8dda-a7e541d2ac8a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:04.968718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e561c77-5942-4b3a-8dda-a7e541d2ac8a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:04.969687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e561c77-5942-4b3a-8dda-a7e541d2ac8a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:04.973106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e561c77-5942-4b3a-8dda-a7e541d2ac8a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:04.973809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e561c77-5942-4b3a-8dda-a7e541d2ac8a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:05.397399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ec9abf88-f1dd-4182-b3fe-d615dacb6cae tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:05.398278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ec9abf88-f1dd-4182-b3fe-d615dacb6cae tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:05.416473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec9abf88-f1dd-4182-b3fe-d615dacb6cae tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:05.417002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec9abf88-f1dd-4182-b3fe-d615dacb6cae tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:05.417454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec9abf88-f1dd-4182-b3fe-d615dacb6cae tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:05.418197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec9abf88-f1dd-4182-b3fe-d615dacb6cae tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:05.418663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec9abf88-f1dd-4182-b3fe-d615dacb6cae tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:05.419134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec9abf88-f1dd-4182-b3fe-d615dacb6cae tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:05.502846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9e561c77-5942-4b3a-8dda-a7e541d2ac8a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:05.520891 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9e561c77-5942-4b3a-8dda-a7e541d2ac8a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1307 microversion: 2.1 time: 0.570402 Sep 06 10:56:05.522224 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 732/1435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:04 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1307 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:05.599195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f121f63-80f9-43cd-95e5-ad476ae77271 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Calling method '.version_select at 0x7f90f8e173a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:05.641547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ec9abf88-f1dd-4182-b3fe-d615dacb6cae tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:05.652599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ec9abf88-f1dd-4182-b3fe-d615dacb6cae tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:05.659264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ec9abf88-f1dd-4182-b3fe-d615dacb6cae tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:05.672237 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4f121f63-80f9-43cd-95e5-ad476ae77271 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa" status: 200 len: 637 microversion: 2.1 time: 0.083634 Sep 06 10:56:05.683263 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 733/1436] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:05 2022] GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa => generated 637 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:05.684957 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ec9abf88-f1dd-4182-b3fe-d615dacb6cae tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.279709 Sep 06 10:56:05.687126 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 704/1437] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:05 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:05.692949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d97a75ad-51fb-4d6a-b633-4733cb684bb4 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Action: 'update_all', calling method: .version_select at 0x7f90f8e06700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:05.794620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3b750df5-3e20-49b2-b6e6-2ccf79236eac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:05.795276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3b750df5-3e20-49b2-b6e6-2ccf79236eac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:05.809901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:05.823581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d97a75ad-51fb-4d6a-b633-4733cb684bb4 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:05.823696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b750df5-3e20-49b2-b6e6-2ccf79236eac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:05.823696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b750df5-3e20-49b2-b6e6-2ccf79236eac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:05.823696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b750df5-3e20-49b2-b6e6-2ccf79236eac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:05.823696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b750df5-3e20-49b2-b6e6-2ccf79236eac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:05.824006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b750df5-3e20-49b2-b6e6-2ccf79236eac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:05.824086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b750df5-3e20-49b2-b6e6-2ccf79236eac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:05.837355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d97a75ad-51fb-4d6a-b633-4733cb684bb4 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for user d06b802ec7ca45ba956aeddccfd6ba56 and project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:06.112208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3b750df5-3e20-49b2-b6e6-2ccf79236eac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:06.129552 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3b750df5-3e20-49b2-b6e6-2ccf79236eac tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7" status: 200 len: 1476 microversion: 2.1 time: 0.338970 Sep 06 10:56:06.135163 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 705/1438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:05 2022] GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 => generated 1476 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:06.150062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-fb12dee5-efc3-4153-94e6-07281000d496 req-1b934d6d-7aae-4f9d-84d1-88b7e1c06b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e56ea2-b73c-4a32-b0aa-1d3d76064bc7", "name": "network-vif-deleted", "tag": "6d345f27-53e4-4248-b1d5-8bf046827b4d"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:06.187468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fb12dee5-efc3-4153-94e6-07281000d496 req-1b934d6d-7aae-4f9d-84d1-88b7e1c06b8d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:06.190844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fb12dee5-efc3-4153-94e6-07281000d496 req-1b934d6d-7aae-4f9d-84d1-88b7e1c06b8d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:06.192820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fb12dee5-efc3-4153-94e6-07281000d496 req-1b934d6d-7aae-4f9d-84d1-88b7e1c06b8d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:06.265297 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-fb12dee5-efc3-4153-94e6-07281000d496 req-1b934d6d-7aae-4f9d-84d1-88b7e1c06b8d service nova] Creating event network-vif-deleted:6d345f27-53e4-4248-b1d5-8bf046827b4d for instance 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 on nch1-master-1 Sep 06 10:56:06.286631 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-fb12dee5-efc3-4153-94e6-07281000d496 req-1b934d6d-7aae-4f9d-84d1-88b7e1c06b8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149373 Sep 06 10:56:06.295730 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 706/1439] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:06.560148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-07c3ba46-ee4b-4904-aca9-65686b36f2eb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:06.560148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-07c3ba46-ee4b-4904-aca9-65686b36f2eb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:06.591094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07c3ba46-ee4b-4904-aca9-65686b36f2eb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:06.604341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07c3ba46-ee4b-4904-aca9-65686b36f2eb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:06.611318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07c3ba46-ee4b-4904-aca9-65686b36f2eb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:06.611318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07c3ba46-ee4b-4904-aca9-65686b36f2eb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:06.611318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07c3ba46-ee4b-4904-aca9-65686b36f2eb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:06.611318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07c3ba46-ee4b-4904-aca9-65686b36f2eb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:06.659152 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d97a75ad-51fb-4d6a-b633-4733cb684bb4 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.974469 Sep 06 10:56:06.660535 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 734/1440] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 10:56:05 2022] PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata => generated 61 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:56:06.694186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3e5485ea-ec11-433b-b467-45495e8eafa1 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Calling method '.version_select at 0x7f90f93018b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:06.905100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-07c3ba46-ee4b-4904-aca9-65686b36f2eb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:06.936467 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-07c3ba46-ee4b-4904-aca9-65686b36f2eb tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1307 microversion: 2.1 time: 0.386934 Sep 06 10:56:06.937835 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 707/1441] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:06 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1307 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:06.952722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1835cf8c-9b13-409b-91c4-05829f9f2b7d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:06.953531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1835cf8c-9b13-409b-91c4-05829f9f2b7d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:06.970727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1835cf8c-9b13-409b-91c4-05829f9f2b7d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:06.972553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1835cf8c-9b13-409b-91c4-05829f9f2b7d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:06.973034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1835cf8c-9b13-409b-91c4-05829f9f2b7d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:06.974564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1835cf8c-9b13-409b-91c4-05829f9f2b7d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:06.978699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1835cf8c-9b13-409b-91c4-05829f9f2b7d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:06.979197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1835cf8c-9b13-409b-91c4-05829f9f2b7d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:07.129232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1835cf8c-9b13-409b-91c4-05829f9f2b7d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:07.138563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1835cf8c-9b13-409b-91c4-05829f9f2b7d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:07.140089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1835cf8c-9b13-409b-91c4-05829f9f2b7d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:07.157272 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1835cf8c-9b13-409b-91c4-05829f9f2b7d tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1445 microversion: 2.75 time: 0.215250 Sep 06 10:56:07.175658 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 708/1442] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:06 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1445 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:07.183367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:07.183992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:07.199617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:07.202248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:07.202840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:07.206075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:07.206904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:07.207414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:07.317080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:07.317868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:07.319110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:07.319737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lazy-loading 'fault' on Instance uuid 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:07.398166 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3e5485ea-ec11-433b-b467-45495e8eafa1 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "DELETE /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.729925 Sep 06 10:56:07.399087 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 735/1443] 10.222.0.20 () {58 vars in 1296 bytes} [Tue Sep 6 10:56:06 2022] DELETE /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata/os_version => generated 0 bytes in 732 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:56:07.408493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1a57f59c-b822-4387-a2c6-5eb68f9bc608 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Calling method '.version_select at 0x7f90f8a2ae50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:07.424036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:07.435958 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4fd58f7a-ff55-4aef-8ba6-72b85b349b1a tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7" status: 200 len: 1311 microversion: 2.1 time: 0.263726 Sep 06 10:56:07.436571 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 709/1444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:07 2022] GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 => generated 1311 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:07.485725 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1a57f59c-b822-4387-a2c6-5eb68f9bc608 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata" status: 200 len: 37 microversion: 2.1 time: 0.082060 Sep 06 10:56:07.487889 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 736/1445] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 10:56:07 2022] GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata => generated 37 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 10:56:07.501311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24ad41bc-9296-4e92-a76a-e70d3cafa70b tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Action: 'update_all', calling method: .version_select at 0x7f90f3e3c280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:07.636536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-24ad41bc-9296-4e92-a76a-e70d3cafa70b tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:07.647158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-24ad41bc-9296-4e92-a76a-e70d3cafa70b tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for user d06b802ec7ca45ba956aeddccfd6ba56 and project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:07.967199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76ac20ec-6200-499e-8d97-b0ee67c99189 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:07.968649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-76ac20ec-6200-499e-8d97-b0ee67c99189 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:07.983093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ac20ec-6200-499e-8d97-b0ee67c99189 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:07.985850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ac20ec-6200-499e-8d97-b0ee67c99189 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:07.987225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ac20ec-6200-499e-8d97-b0ee67c99189 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:07.991003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ac20ec-6200-499e-8d97-b0ee67c99189 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:07.991950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ac20ec-6200-499e-8d97-b0ee67c99189 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:07.994971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ac20ec-6200-499e-8d97-b0ee67c99189 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:08.212205 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-24ad41bc-9296-4e92-a76a-e70d3cafa70b tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.714981 Sep 06 10:56:08.217780 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 710/1446] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 10:56:07 2022] PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata => generated 61 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:56:08.222349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-594ad4fa-0e85-4e1f-bc2d-413cc38aaa7c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:08.223202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-594ad4fa-0e85-4e1f-bc2d-413cc38aaa7c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:08.242851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-594ad4fa-0e85-4e1f-bc2d-413cc38aaa7c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:08.246721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-594ad4fa-0e85-4e1f-bc2d-413cc38aaa7c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:08.249042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-594ad4fa-0e85-4e1f-bc2d-413cc38aaa7c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:08.250893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-594ad4fa-0e85-4e1f-bc2d-413cc38aaa7c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:08.252359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-594ad4fa-0e85-4e1f-bc2d-413cc38aaa7c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:08.253563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-594ad4fa-0e85-4e1f-bc2d-413cc38aaa7c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:08.391740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-594ad4fa-0e85-4e1f-bc2d-413cc38aaa7c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:08.396059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:08.410643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-594ad4fa-0e85-4e1f-bc2d-413cc38aaa7c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:08.413604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-594ad4fa-0e85-4e1f-bc2d-413cc38aaa7c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:08.428317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-76ac20ec-6200-499e-8d97-b0ee67c99189 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:08.444094 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-76ac20ec-6200-499e-8d97-b0ee67c99189 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1307 microversion: 2.1 time: 0.481395 Sep 06 10:56:08.444709 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 737/1447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:07 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1307 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:08.445035 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-594ad4fa-0e85-4e1f-bc2d-413cc38aaa7c tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1451 microversion: 2.75 time: 0.229084 Sep 06 10:56:08.446012 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 711/1448] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:08 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1451 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:08.451338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-032497a5-ee0a-45ac-a01c-b1db9f9ead06 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Calling method '.version_select at 0x7f90f3d8e8b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:08.468763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a4a5398-8ca1-4196-bbe6-0b01dbb649a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:08.472669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9a4a5398-8ca1-4196-bbe6-0b01dbb649a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:08.658239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a4a5398-8ca1-4196-bbe6-0b01dbb649a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:08.658239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a4a5398-8ca1-4196-bbe6-0b01dbb649a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:08.658239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a4a5398-8ca1-4196-bbe6-0b01dbb649a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:08.658239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a4a5398-8ca1-4196-bbe6-0b01dbb649a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:08.659279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a4a5398-8ca1-4196-bbe6-0b01dbb649a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:08.659279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a4a5398-8ca1-4196-bbe6-0b01dbb649a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:08.660420 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-032497a5-ee0a-45ac-a01c-b1db9f9ead06 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.068277 Sep 06 10:56:08.660420 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 712/1449] 10.222.0.20 () {58 vars in 1290 bytes} [Tue Sep 6 10:56:08 2022] GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata/os_distro => generated 33 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-9a4a5398-8ca1-4196-bbe6-0b01dbb649a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] HTTP exception thrown: Instance 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 could not be found. Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a4a5398-8ca1-4196-bbe6-0b01dbb649a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Request method failure captured: Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 HTTP/1.1 Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyb2-UQAYK-7aq-oUAKJdOq0aUvjRC3uyYj_5fffZRRmVHI0mAvck6TZRak_EnOn6T0ra1ZCt8dM90GseWb1krxRJX17XUacFiMjdKFX_4InAvCxudW5cs2W0sOjjPNmZsw_E2f9Fvo82Otmp7uS7gixsM4ROcVwFD2A6Hk-cHg4ARU Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2ce648f86e3e4a3c9e8712bb087b8769 Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ListServerFiltersTestJSON-2142605568 Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:56:08.660570 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:56:08.662232 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ce648f86e3e4a3c9e8712bb087b8769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ce648f86e3e4a3c9e8712bb087b8769"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ce648f86e3e4a3c9e8712bb087b8769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ce648f86e3e4a3c9e8712bb087b8769"}]}] Sep 06 10:56:08.662232 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ListServerFiltersTestJSON-2142605568 Sep 06 10:56:08.662232 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2ce648f86e3e4a3c9e8712bb087b8769 Sep 06 10:56:08.662232 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2142605568 Sep 06 10:56:08.662232 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ListServerFiltersTestJSON-2142605568-project Sep 06 10:56:08.662232 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:56:08.662232 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:56:08.662232 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: de579d631e9d4010887077567bbe5fd6 Sep 06 10:56:08.662232 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ListServerFiltersTestJSON-2142605568-project Sep 06 10:56:08.662232 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:56:08.662232 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 could not be found. Sep 06 10:56:08.662232 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '14e56ea2-b73c-4a32-b0aa-1d3d76064bc7'} Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 could not be found. Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:08.663254 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 could not be found. Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 could not be found. Sep 06 10:56:08.664888 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:08.666584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a4a5398-8ca1-4196-bbe6-0b01dbb649a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Returning 404 to user: Instance 14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:08.666584 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a4a5398-8ca1-4196-bbe6-0b01dbb649a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7" status: 404 len: 111 microversion: 2.1 time: 0.075221 Sep 06 10:56:08.666584 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 738/1450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:08 2022] GET /compute/v2.1/servers/14e56ea2-b73c-4a32-b0aa-1d3d76064bc7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:56:08.666838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5a55fd6b-4e73-40a6-b4ee-8f119a31841b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:08.667348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5a55fd6b-4e73-40a6-b4ee-8f119a31841b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:08.670852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0e859333-d608-42f6-94d7-15e8118f0008 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Action: 'update_all', calling method: .version_select at 0x7f90f8a2a790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:08.682174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a55fd6b-4e73-40a6-b4ee-8f119a31841b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:08.682756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a55fd6b-4e73-40a6-b4ee-8f119a31841b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:08.683336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a55fd6b-4e73-40a6-b4ee-8f119a31841b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:08.684171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a55fd6b-4e73-40a6-b4ee-8f119a31841b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:08.684675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a55fd6b-4e73-40a6-b4ee-8f119a31841b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:08.685146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a55fd6b-4e73-40a6-b4ee-8f119a31841b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:08.716289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5a55fd6b-4e73-40a6-b4ee-8f119a31841b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:56:08.731270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-0e859333-d608-42f6-94d7-15e8118f0008 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:08.736707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-0e859333-d608-42f6-94d7-15e8118f0008 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for user d06b802ec7ca45ba956aeddccfd6ba56 and project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:08.923172 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0e859333-d608-42f6-94d7-15e8118f0008 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.261093 Sep 06 10:56:08.925969 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 739/1451] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 10:56:08 2022] PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata => generated 61 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:56:08.936646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2905cd41-fafa-4029-abb0-b332e3299aab tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Calling method '.version_select at 0x7f90f8afd5e0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:09.070974 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2905cd41-fafa-4029-abb0-b332e3299aab tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.140596 Sep 06 10:56:09.084619 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 740/1452] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 10:56:08 2022] GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata => generated 61 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:56:09.098128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-220872a3-9ec4-406f-8369-56912309fca7 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Action: 'update_all', calling method: .version_select at 0x7f90f8be4ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:09.150604 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5a55fd6b-4e73-40a6-b4ee-8f119a31841b tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "DELETE /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 204 len: 0 microversion: 2.1 time: 0.491851 Sep 06 10:56:09.154079 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 713/1453] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:56:08 2022] DELETE /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:56:09.160984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-21525c52-418b-4168-ae92-ebce8fc833a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:09.161706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-21525c52-418b-4168-ae92-ebce8fc833a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:09.170078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21525c52-418b-4168-ae92-ebce8fc833a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:09.170581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21525c52-418b-4168-ae92-ebce8fc833a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:09.171058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21525c52-418b-4168-ae92-ebce8fc833a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:09.171774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21525c52-418b-4168-ae92-ebce8fc833a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:09.176552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21525c52-418b-4168-ae92-ebce8fc833a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:09.183237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-220872a3-9ec4-406f-8369-56912309fca7 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:09.188461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21525c52-418b-4168-ae92-ebce8fc833a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:09.196193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-220872a3-9ec4-406f-8369-56912309fca7 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for user d06b802ec7ca45ba956aeddccfd6ba56 and project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:09.480750 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-220872a3-9ec4-406f-8369-56912309fca7 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.394275 Sep 06 10:56:09.481356 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 741/1454] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 10:56:09 2022] PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata => generated 61 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:56:09.488123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6cb19916-16d4-465b-bf41-37d6b289a933 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:09.488970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6cb19916-16d4-465b-bf41-37d6b289a933 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:09.510107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cb19916-16d4-465b-bf41-37d6b289a933 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:09.510873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cb19916-16d4-465b-bf41-37d6b289a933 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:09.512292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cb19916-16d4-465b-bf41-37d6b289a933 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:09.513218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cb19916-16d4-465b-bf41-37d6b289a933 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:09.514015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cb19916-16d4-465b-bf41-37d6b289a933 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:09.518677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cb19916-16d4-465b-bf41-37d6b289a933 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:09.691405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-21525c52-418b-4168-ae92-ebce8fc833a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:09.696966 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-21525c52-418b-4168-ae92-ebce8fc833a4 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1517 microversion: 2.1 time: 0.541338 Sep 06 10:56:09.698014 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 714/1455] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:09 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1517 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:09.716862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-abf47656-6fc3-4da8-ad52-2744144a375a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:09.717752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-abf47656-6fc3-4da8-ad52-2744144a375a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:09.738066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abf47656-6fc3-4da8-ad52-2744144a375a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:09.738585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abf47656-6fc3-4da8-ad52-2744144a375a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:09.739001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abf47656-6fc3-4da8-ad52-2744144a375a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:09.746963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abf47656-6fc3-4da8-ad52-2744144a375a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:09.747485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abf47656-6fc3-4da8-ad52-2744144a375a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:09.747931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abf47656-6fc3-4da8-ad52-2744144a375a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:09.904534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-abf47656-6fc3-4da8-ad52-2744144a375a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:09.910451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6cb19916-16d4-465b-bf41-37d6b289a933 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:09.920056 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6cb19916-16d4-465b-bf41-37d6b289a933 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1307 microversion: 2.1 time: 0.437422 Sep 06 10:56:09.922682 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 742/1456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:09 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1307 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:09.929749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-78549219-5dbf-47ad-bd29-36f4ecfaffa6 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Action: 'update_all', calling method: .version_select at 0x7f90f8be4940>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:09.961252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-abf47656-6fc3-4da8-ad52-2744144a375a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:09.968296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-abf47656-6fc3-4da8-ad52-2744144a375a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:09.994731 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-abf47656-6fc3-4da8-ad52-2744144a375a tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1451 microversion: 2.75 time: 0.295700 Sep 06 10:56:09.995773 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 715/1457] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:09 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1451 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:10.065373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-78549219-5dbf-47ad-bd29-36f4ecfaffa6 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:10.077227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-78549219-5dbf-47ad-bd29-36f4ecfaffa6 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for user d06b802ec7ca45ba956aeddccfd6ba56 and project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:10.089401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-776efc02-315f-4f66-97e3-b25569097fff req-db7db537-4304-41c7-9cae-52718ae649c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937289ab-8f49-410a-8477-7f970832616f", "name": "network-vif-plugged", "status": "completed", "tag": "bbc270c7-beb0-4db6-9d50-0a3fe6996886"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:10.122911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-776efc02-315f-4f66-97e3-b25569097fff req-db7db537-4304-41c7-9cae-52718ae649c4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:10.126883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-776efc02-315f-4f66-97e3-b25569097fff req-db7db537-4304-41c7-9cae-52718ae649c4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:10.127368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-776efc02-315f-4f66-97e3-b25569097fff req-db7db537-4304-41c7-9cae-52718ae649c4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:10.195559 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-776efc02-315f-4f66-97e3-b25569097fff req-db7db537-4304-41c7-9cae-52718ae649c4 service nova] Creating event network-vif-plugged:bbc270c7-beb0-4db6-9d50-0a3fe6996886 for instance 937289ab-8f49-410a-8477-7f970832616f on nch1-master-1 Sep 06 10:56:10.225676 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-776efc02-315f-4f66-97e3-b25569097fff req-db7db537-4304-41c7-9cae-52718ae649c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130183 Sep 06 10:56:10.225676 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 716/1458] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:56:10.738957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-281cf244-e6f4-48eb-997e-9aad02a7e807 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:10.743159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-281cf244-e6f4-48eb-997e-9aad02a7e807 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:10.752150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-281cf244-e6f4-48eb-997e-9aad02a7e807 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:10.753719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-281cf244-e6f4-48eb-997e-9aad02a7e807 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:10.753845 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-78549219-5dbf-47ad-bd29-36f4ecfaffa6 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata" status: 200 len: 64 microversion: 2.1 time: 0.830001 Sep 06 10:56:10.754822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-281cf244-e6f4-48eb-997e-9aad02a7e807 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:10.754944 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 743/1459] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 10:56:09 2022] PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata => generated 64 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:56:10.757143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-281cf244-e6f4-48eb-997e-9aad02a7e807 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:10.758797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-281cf244-e6f4-48eb-997e-9aad02a7e807 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:10.759994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-281cf244-e6f4-48eb-997e-9aad02a7e807 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:10.764441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dab8f109-85a4-4675-b171-f050d23bb8c5 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Calling method '.version_select at 0x7f90f8654040>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:10.829479 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dab8f109-85a4-4675-b171-f050d23bb8c5 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata" status: 200 len: 64 microversion: 2.1 time: 0.068806 Sep 06 10:56:10.840985 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 744/1460] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 10:56:10 2022] GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata => generated 64 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 10:56:10.857952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-20e44e2e-d338-4179-aceb-6b46d1713b88 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Action: 'update_all', calling method: .version_select at 0x7f90f8be4040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:10.945478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-20e44e2e-d338-4179-aceb-6b46d1713b88 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:10.964202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-20e44e2e-d338-4179-aceb-6b46d1713b88 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for user d06b802ec7ca45ba956aeddccfd6ba56 and project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:11.149530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-281cf244-e6f4-48eb-997e-9aad02a7e807 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:11.158759 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-281cf244-e6f4-48eb-997e-9aad02a7e807 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1517 microversion: 2.1 time: 0.441284 Sep 06 10:56:11.160948 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 717/1461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:10 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1517 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:11.172868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bc149622-e519-4ade-8d42-5ddcc9bc5607 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:11.184169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bc149622-e519-4ade-8d42-5ddcc9bc5607 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:11.191419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc149622-e519-4ade-8d42-5ddcc9bc5607 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:11.192211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc149622-e519-4ade-8d42-5ddcc9bc5607 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:11.192931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc149622-e519-4ade-8d42-5ddcc9bc5607 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:11.194062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc149622-e519-4ade-8d42-5ddcc9bc5607 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:11.194716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc149622-e519-4ade-8d42-5ddcc9bc5607 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:11.195376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc149622-e519-4ade-8d42-5ddcc9bc5607 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:11.468175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bc149622-e519-4ade-8d42-5ddcc9bc5607 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:11.478114 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bc149622-e519-4ade-8d42-5ddcc9bc5607 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1307 microversion: 2.1 time: 0.317154 Sep 06 10:56:11.478700 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 718/1462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:11 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1307 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:11.483532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bc15ce29-0b05-4716-9463-7a83afd2e046 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:11.484823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bc15ce29-0b05-4716-9463-7a83afd2e046 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:11.497148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc15ce29-0b05-4716-9463-7a83afd2e046 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:11.497878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc15ce29-0b05-4716-9463-7a83afd2e046 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:11.498827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc15ce29-0b05-4716-9463-7a83afd2e046 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:11.499767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc15ce29-0b05-4716-9463-7a83afd2e046 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:11.500386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc15ce29-0b05-4716-9463-7a83afd2e046 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:11.500985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc15ce29-0b05-4716-9463-7a83afd2e046 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:11.609316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bc15ce29-0b05-4716-9463-7a83afd2e046 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:11.618113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bc15ce29-0b05-4716-9463-7a83afd2e046 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:11.619772 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-20e44e2e-d338-4179-aceb-6b46d1713b88 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.771757 Sep 06 10:56:11.621255 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 745/1463] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 10:56:10 2022] PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata => generated 61 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:56:11.623885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bc15ce29-0b05-4716-9463-7a83afd2e046 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:11.630746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-381766b0-984c-4e4e-aa12-91b418663d8d tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Action: 'update', calling method: .version_select at 0x7f90f88c5dc0>, body: {"meta": {"os_version": "alt"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:11.632496 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bc15ce29-0b05-4716-9463-7a83afd2e046 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1436 microversion: 2.75 time: 0.152554 Sep 06 10:56:11.633265 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 719/1464] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:11 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1436 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:11.714978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-381766b0-984c-4e4e-aa12-91b418663d8d tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:11.723120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-381766b0-984c-4e4e-aa12-91b418663d8d tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for user d06b802ec7ca45ba956aeddccfd6ba56 and project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:12.218113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:12.220996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:12.228475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:12.229223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:12.229897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:12.230811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:12.231491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:12.232128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:12.360769 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-381766b0-984c-4e4e-aa12-91b418663d8d tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.734273 Sep 06 10:56:12.361385 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 746/1465] 10.222.0.20 () {60 vars in 1313 bytes} [Tue Sep 6 10:56:11 2022] PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata/os_version => generated 31 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 10:56:12.369492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0fa5a7cc-613e-429a-a8ac-dcb11c8aedb1 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:12.378062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0fa5a7cc-613e-429a-a8ac-dcb11c8aedb1 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:12.389449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fa5a7cc-613e-429a-a8ac-dcb11c8aedb1 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:12.390283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fa5a7cc-613e-429a-a8ac-dcb11c8aedb1 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:12.391566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fa5a7cc-613e-429a-a8ac-dcb11c8aedb1 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:12.393130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fa5a7cc-613e-429a-a8ac-dcb11c8aedb1 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:12.394596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:56:12.396738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fa5a7cc-613e-429a-a8ac-dcb11c8aedb1 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:12.397578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:56:12.398517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:56:12.400352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fa5a7cc-613e-429a-a8ac-dcb11c8aedb1 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:12.400969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:56:12.401469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:56:12.563578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0fa5a7cc-613e-429a-a8ac-dcb11c8aedb1 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:12.575378 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0fa5a7cc-613e-429a-a8ac-dcb11c8aedb1 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1475 microversion: 2.1 time: 0.212289 Sep 06 10:56:12.579822 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 747/1466] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:12 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1475 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:12.594716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c005388f-79ca-4e46-b841-ce89fccbb2ce tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Calling method '.version_select at 0x7f90f8a85e50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:12.651829 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c005388f-79ca-4e46-b841-ce89fccbb2ce tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata" status: 200 len: 58 microversion: 2.1 time: 0.070657 Sep 06 10:56:12.652753 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 748/1467] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 10:56:12 2022] GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata => generated 58 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:56:12.657457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c045452c-7966-4ab8-92c8-4079be15103f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:12.658278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c045452c-7966-4ab8-92c8-4079be15103f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:12.665678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c045452c-7966-4ab8-92c8-4079be15103f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:12.666426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c045452c-7966-4ab8-92c8-4079be15103f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:12.667131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c045452c-7966-4ab8-92c8-4079be15103f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:12.668713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c045452c-7966-4ab8-92c8-4079be15103f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:12.669534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c045452c-7966-4ab8-92c8-4079be15103f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:12.670182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c045452c-7966-4ab8-92c8-4079be15103f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:12.783409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:12.825406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:12.830342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:12.832050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:12.837461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:12.838991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:12.839466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:12.998449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c045452c-7966-4ab8-92c8-4079be15103f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:13.010489 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c045452c-7966-4ab8-92c8-4079be15103f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1487 microversion: 2.1 time: 0.353681 Sep 06 10:56:13.011146 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 749/1468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:12 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1487 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:13.088558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-4e76ee18-dbc9-4227-b605-363d345d2a95 req-e006eb9d-7991-4d10-b2fb-2d1c9639f4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c583ed-d9a7-4efc-aee6-d9aba4141e61", "name": "network-vif-deleted", "tag": "bbeeb8f4-352d-4ce1-98d3-a6ec1bdc0267"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:13.144257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4e76ee18-dbc9-4227-b605-363d345d2a95 req-e006eb9d-7991-4d10-b2fb-2d1c9639f4ea service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:13.144975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4e76ee18-dbc9-4227-b605-363d345d2a95 req-e006eb9d-7991-4d10-b2fb-2d1c9639f4ea service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:13.145748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4e76ee18-dbc9-4227-b605-363d345d2a95 req-e006eb9d-7991-4d10-b2fb-2d1c9639f4ea service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:13.174031 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-4e76ee18-dbc9-4227-b605-363d345d2a95 req-e006eb9d-7991-4d10-b2fb-2d1c9639f4ea service nova] Creating event network-vif-deleted:bbeeb8f4-352d-4ce1-98d3-a6ec1bdc0267 for instance 94c583ed-d9a7-4efc-aee6-d9aba4141e61 on nch1-master-1 Sep 06 10:56:13.174327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:13.183111 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-4e76ee18-dbc9-4227-b605-363d345d2a95 req-e006eb9d-7991-4d10-b2fb-2d1c9639f4ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113313 Sep 06 10:56:13.186767 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 750/1469] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:13.204171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-037d0e54-8e85-45f1-b3bd-fe3df3267f6b tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Action: 'update_all', calling method: .version_select at 0x7f90f8a854c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:13.206748 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e0595d5b-64c0-447f-85ec-827c05d162f5 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db/action" status: 202 len: 1938 microversion: 2.75 time: 1.540552 Sep 06 10:56:13.207547 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 720/1470] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 10:56:11 2022] POST /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db/action => generated 1938 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 06 10:56:13.223858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84d34648-027b-4f66-8d56-dd2bd00ad334 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:13.223858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-84d34648-027b-4f66-8d56-dd2bd00ad334 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:13.234178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84d34648-027b-4f66-8d56-dd2bd00ad334 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:13.236881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84d34648-027b-4f66-8d56-dd2bd00ad334 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:13.237694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84d34648-027b-4f66-8d56-dd2bd00ad334 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:13.239489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84d34648-027b-4f66-8d56-dd2bd00ad334 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:13.241209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84d34648-027b-4f66-8d56-dd2bd00ad334 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:13.242190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84d34648-027b-4f66-8d56-dd2bd00ad334 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:13.329163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-84d34648-027b-4f66-8d56-dd2bd00ad334 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lazy-loading 'flavor' on Instance uuid 937289ab-8f49-410a-8477-7f970832616f {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:13.378104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-037d0e54-8e85-45f1-b3bd-fe3df3267f6b tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:13.400695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-037d0e54-8e85-45f1-b3bd-fe3df3267f6b tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for user d06b802ec7ca45ba956aeddccfd6ba56 and project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:13.844976 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84d34648-027b-4f66-8d56-dd2bd00ad334 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "POST /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f/action" status: 202 len: 0 microversion: 2.1 time: 0.636118 Sep 06 10:56:13.845840 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 721/1471] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:56:13 2022] POST /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:56:13.865790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-69e1b184-9753-432a-a4fe-fba2d953bcec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:13.866589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-69e1b184-9753-432a-a4fe-fba2d953bcec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:13.892372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69e1b184-9753-432a-a4fe-fba2d953bcec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:13.893134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69e1b184-9753-432a-a4fe-fba2d953bcec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:13.893818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69e1b184-9753-432a-a4fe-fba2d953bcec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:13.897474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69e1b184-9753-432a-a4fe-fba2d953bcec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:13.898620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69e1b184-9753-432a-a4fe-fba2d953bcec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:13.901688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69e1b184-9753-432a-a4fe-fba2d953bcec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:13.970806 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-037d0e54-8e85-45f1-b3bd-fe3df3267f6b tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.780384 Sep 06 10:56:13.971559 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 751/1472] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 10:56:13 2022] PUT /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata => generated 61 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:56:13.976666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:13.977485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:14.008925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:14.009639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:14.010117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:14.010891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:14.011399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:14.011849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:14.071074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-69e1b184-9753-432a-a4fe-fba2d953bcec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:14.088496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:14.089232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:14.089831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:14.090446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lazy-loading 'fault' on Instance uuid 94c583ed-d9a7-4efc-aee6-d9aba4141e61 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:14.107457 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-69e1b184-9753-432a-a4fe-fba2d953bcec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.259926 Sep 06 10:56:14.123067 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 722/1473] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:13 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:14.123067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2643bfd9-55d4-43b6-bbf5-27ea3406ae3b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:14.123067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2643bfd9-55d4-43b6-bbf5-27ea3406ae3b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:14.123067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2643bfd9-55d4-43b6-bbf5-27ea3406ae3b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:14.123067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2643bfd9-55d4-43b6-bbf5-27ea3406ae3b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:14.124238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2643bfd9-55d4-43b6-bbf5-27ea3406ae3b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:14.124893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2643bfd9-55d4-43b6-bbf5-27ea3406ae3b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:14.127425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2643bfd9-55d4-43b6-bbf5-27ea3406ae3b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:14.127952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2643bfd9-55d4-43b6-bbf5-27ea3406ae3b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:14.203302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de579d631e9d4010887077567bbe5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce648f86e3e4a3c9e8712bb087b8769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:14.214135 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-49c9d42b-a256-4cae-9449-ced1013a9179 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 200 len: 1310 microversion: 2.1 time: 0.241282 Sep 06 10:56:14.214748 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 752/1474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:13 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 1310 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:14.231760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dfe2820b-2afb-48eb-b9df-c755a5345935 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Action: 'create', calling method: .version_select at 0x7f90f8ce7d30>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:14.301413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-dfe2820b-2afb-48eb-b9df-c755a5345935 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:14.307961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-dfe2820b-2afb-48eb-b9df-c755a5345935 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Getting quotas for user d06b802ec7ca45ba956aeddccfd6ba56 and project f1717a28e96f4fbf91edd4d1f622d002. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:14.888478 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dfe2820b-2afb-48eb-b9df-c755a5345935 tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "POST /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata" status: 200 len: 85 microversion: 2.1 time: 0.672158 Sep 06 10:56:14.888600 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 753/1475] 10.222.0.20 () {60 vars in 1281 bytes} [Tue Sep 6 10:56:14 2022] POST /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata => generated 85 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:56:14.898113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f85481ed-85c5-428d-bee8-32fa58c78ebc tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] Calling method '.version_select at 0x7f90f8e17a60>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:14.950563 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f85481ed-85c5-428d-bee8-32fa58c78ebc tempest-ImagesMetadataTestJSON-1646372844 tempest-ImagesMetadataTestJSON-1646372844-project] 10.222.0.20 "GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata" status: 200 len: 85 microversion: 2.1 time: 0.056412 Sep 06 10:56:14.952486 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 754/1476] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 10:56:14 2022] GET /compute/v2.1/images/acff7bf7-5c8e-4738-a44d-d5db848cc1aa/metadata => generated 85 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 10:56:14.991045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2643bfd9-55d4-43b6-bbf5-27ea3406ae3b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:14.993444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:15.003328 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2643bfd9-55d4-43b6-bbf5-27ea3406ae3b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1495 microversion: 2.1 time: 0.889647 Sep 06 10:56:15.003328 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 723/1477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:14 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1495 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:15.143920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8cabdb75-f1ef-41f3-8373-68fd6ceaa091 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:15.144468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8cabdb75-f1ef-41f3-8373-68fd6ceaa091 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:15.152813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cabdb75-f1ef-41f3-8373-68fd6ceaa091 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:15.156847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cabdb75-f1ef-41f3-8373-68fd6ceaa091 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:15.160090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cabdb75-f1ef-41f3-8373-68fd6ceaa091 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:15.160090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cabdb75-f1ef-41f3-8373-68fd6ceaa091 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:15.160428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cabdb75-f1ef-41f3-8373-68fd6ceaa091 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:15.160639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cabdb75-f1ef-41f3-8373-68fd6ceaa091 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:15.252075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d3667315-b1b3-47ab-aa55-42aef77ca7c3 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:15.253120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d3667315-b1b3-47ab-aa55-42aef77ca7c3 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] [instance: 94c583ed-d9a7-4efc-aee6-d9aba4141e61] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:15.269601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3667315-b1b3-47ab-aa55-42aef77ca7c3 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:15.270118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3667315-b1b3-47ab-aa55-42aef77ca7c3 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:15.270572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3667315-b1b3-47ab-aa55-42aef77ca7c3 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:15.275432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3667315-b1b3-47ab-aa55-42aef77ca7c3 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:15.275943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3667315-b1b3-47ab-aa55-42aef77ca7c3 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:15.282503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3667315-b1b3-47ab-aa55-42aef77ca7c3 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:15.309273 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-d3667315-b1b3-47ab-aa55-42aef77ca7c3 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] HTTP exception thrown: Instance 94c583ed-d9a7-4efc-aee6-d9aba4141e61 could not be found. Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d3667315-b1b3-47ab-aa55-42aef77ca7c3 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Request method failure captured: Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 HTTP/1.1 Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyb2-UQAYK-7aq-oUAKJdOq0aUvjRC3uyYj_5fffZRRmVHI0mAvck6TZRak_EnOn6T0ra1ZCt8dM90GseWb1krxRJX17XUacFiMjdKFX_4InAvCxudW5cs2W0sOjjPNmZsw_E2f9Fvo82Otmp7uS7gixsM4ROcVwFD2A6Hk-cHg4ARU Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 2ce648f86e3e4a3c9e8712bb087b8769 Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ListServerFiltersTestJSON-2142605568 Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:56:15.311299 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:56:15.312681 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ce648f86e3e4a3c9e8712bb087b8769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ce648f86e3e4a3c9e8712bb087b8769"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ce648f86e3e4a3c9e8712bb087b8769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ce648f86e3e4a3c9e8712bb087b8769"}]}] Sep 06 10:56:15.312681 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ListServerFiltersTestJSON-2142605568 Sep 06 10:56:15.312681 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 2ce648f86e3e4a3c9e8712bb087b8769 Sep 06 10:56:15.312681 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2142605568 Sep 06 10:56:15.312681 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ListServerFiltersTestJSON-2142605568-project Sep 06 10:56:15.312681 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:56:15.312681 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:56:15.312681 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: de579d631e9d4010887077567bbe5fd6 Sep 06 10:56:15.312681 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ListServerFiltersTestJSON-2142605568-project Sep 06 10:56:15.312681 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:56:15.312681 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 94c583ed-d9a7-4efc-aee6-d9aba4141e61 could not be found. Sep 06 10:56:15.312681 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '94c583ed-d9a7-4efc-aee6-d9aba4141e61'} Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c583ed-d9a7-4efc-aee6-d9aba4141e61 could not be found. Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:15.313468 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c583ed-d9a7-4efc-aee6-d9aba4141e61 could not be found. Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c583ed-d9a7-4efc-aee6-d9aba4141e61 could not be found. Sep 06 10:56:15.315745 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:15.329179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d3667315-b1b3-47ab-aa55-42aef77ca7c3 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] Returning 404 to user: Instance 94c583ed-d9a7-4efc-aee6-d9aba4141e61 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:15.329179 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d3667315-b1b3-47ab-aa55-42aef77ca7c3 tempest-ListServerFiltersTestJSON-2142605568 tempest-ListServerFiltersTestJSON-2142605568-project] 10.222.0.20 "GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61" status: 404 len: 111 microversion: 2.1 time: 0.087808 Sep 06 10:56:15.329179 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 724/1478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:15 2022] GET /compute/v2.1/servers/94c583ed-d9a7-4efc-aee6-d9aba4141e61 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:56:15.507620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-8cabdb75-f1ef-41f3-8373-68fd6ceaa091 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:15.532349 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8cabdb75-f1ef-41f3-8373-68fd6ceaa091 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.393081 Sep 06 10:56:15.533428 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 755/1479] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:15 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:16.025463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-313475e1-5b27-4949-b72a-4d7acd8f50c2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:16.026780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-313475e1-5b27-4949-b72a-4d7acd8f50c2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:16.040066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-313475e1-5b27-4949-b72a-4d7acd8f50c2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:16.040578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-313475e1-5b27-4949-b72a-4d7acd8f50c2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:16.041006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-313475e1-5b27-4949-b72a-4d7acd8f50c2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:16.041714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-313475e1-5b27-4949-b72a-4d7acd8f50c2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:16.049624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-313475e1-5b27-4949-b72a-4d7acd8f50c2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:16.050338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-313475e1-5b27-4949-b72a-4d7acd8f50c2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:16.389352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-313475e1-5b27-4949-b72a-4d7acd8f50c2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:16.409500 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-313475e1-5b27-4949-b72a-4d7acd8f50c2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 200 len: 1478 microversion: 2.1 time: 0.387810 Sep 06 10:56:16.437693 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 725/1480] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:16 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 1478 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:16.448419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d2c4ea10-6142-4439-b30b-450fc740a20a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-879611220"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:16.453420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d2c4ea10-6142-4439-b30b-450fc740a20a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:16.461527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:16.466131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2c4ea10-6142-4439-b30b-450fc740a20a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:16.466131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2c4ea10-6142-4439-b30b-450fc740a20a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:16.466131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2c4ea10-6142-4439-b30b-450fc740a20a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:16.466131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2c4ea10-6142-4439-b30b-450fc740a20a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:16.466581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2c4ea10-6142-4439-b30b-450fc740a20a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:16.467545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2c4ea10-6142-4439-b30b-450fc740a20a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:16.563852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-311e2be5-d5f0-4eb2-b774-ed4ec6bccf2f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:16.563995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-311e2be5-d5f0-4eb2-b774-ed4ec6bccf2f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:16.581767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-311e2be5-d5f0-4eb2-b774-ed4ec6bccf2f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:16.585912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-311e2be5-d5f0-4eb2-b774-ed4ec6bccf2f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:16.588821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-311e2be5-d5f0-4eb2-b774-ed4ec6bccf2f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:16.590384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-311e2be5-d5f0-4eb2-b774-ed4ec6bccf2f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:16.591213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-311e2be5-d5f0-4eb2-b774-ed4ec6bccf2f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:16.593954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-311e2be5-d5f0-4eb2-b774-ed4ec6bccf2f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:16.915268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-311e2be5-d5f0-4eb2-b774-ed4ec6bccf2f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:17.000526 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-311e2be5-d5f0-4eb2-b774-ed4ec6bccf2f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.440999 Sep 06 10:56:17.015048 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 726/1481] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:16 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:17.249203 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d2c4ea10-6142-4439-b30b-450fc740a20a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "POST /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f/action" status: 202 len: 0 microversion: 2.1 time: 0.807129 Sep 06 10:56:17.261771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1e1be88a-a844-4940-84e8-76801c488cfe tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f883b8b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:17.270778 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 756/1482] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:56:16 2022] POST /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f/action => generated 0 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 06 10:56:17.334591 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1e1be88a-a844-4940-84e8-76801c488cfe tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.076106 Sep 06 10:56:17.348892 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 727/1483] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:17 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:17.702737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-363d0b0d-eb31-4f8a-af34-ed3b37376646 tempest-FlavorsV2NegativeTest-292187801 tempest-FlavorsV2NegativeTest-292187801-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:17.730603 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-363d0b0d-eb31-4f8a-af34-ed3b37376646 tempest-FlavorsV2NegativeTest-292187801 tempest-FlavorsV2NegativeTest-292187801-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.272787 Sep 06 10:56:17.732454 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 757/1484] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:56:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:18.039567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-950d353c-a320-4279-8e6f-235823b45a2d tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:18.040190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-950d353c-a320-4279-8e6f-235823b45a2d tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:18.049086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:18.055291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-950d353c-a320-4279-8e6f-235823b45a2d tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:18.056593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-950d353c-a320-4279-8e6f-235823b45a2d tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:18.058595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-950d353c-a320-4279-8e6f-235823b45a2d tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:18.062227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-950d353c-a320-4279-8e6f-235823b45a2d tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:18.064417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-950d353c-a320-4279-8e6f-235823b45a2d tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:18.065190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-950d353c-a320-4279-8e6f-235823b45a2d tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:18.237817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-950d353c-a320-4279-8e6f-235823b45a2d tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:18.279717 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-950d353c-a320-4279-8e6f-235823b45a2d tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.244190 Sep 06 10:56:18.314757 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 728/1485] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:18 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:18.349938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-477a0472-f49b-4686-a906-e5be246520aa tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8da5670>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:18.432211 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-477a0472-f49b-4686-a906-e5be246520aa tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.086213 Sep 06 10:56:18.434949 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 758/1486] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:18 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:19.040697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c2c464d2-c3fe-4d41-ac2f-9a4ec451784a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Action: 'create', calling method: .version_select at 0x7f90f3d8eee0>, body: {"keypair": {"name": "tempest-keypair-16122590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzZh6uMXZqX4daIPjKSutt/N0qX73ODpnbDGh3aOq/Ihl3bIAjXmpHx/HCf6Tb25NqUcubaSi4MvX9gzivBZs5aGnpkCG3Vf5RyF6fA6LV2W+cF45Kq0g0xLC9plPSzdg=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:19.063166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-c2c464d2-c3fe-4d41-ac2f-9a4ec451784a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Getting quotas for project 740286d1464549609e6d4b3280aa50ce. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:19.069905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-c2c464d2-c3fe-4d41-ac2f-9a4ec451784a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Getting quotas for user 6c557446cb39475dba1fc800d061b9e1 and project 740286d1464549609e6d4b3280aa50ce. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:19.178385 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c2c464d2-c3fe-4d41-ac2f-9a4ec451784a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.477747 Sep 06 10:56:19.183152 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 729/1487] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:56:18 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:19.314153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cce5f9b1-aa16-4f4f-9d2a-b2cd49cd2b87 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:19.314894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cce5f9b1-aa16-4f4f-9d2a-b2cd49cd2b87 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:19.330836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cce5f9b1-aa16-4f4f-9d2a-b2cd49cd2b87 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:19.331379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cce5f9b1-aa16-4f4f-9d2a-b2cd49cd2b87 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:19.331833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cce5f9b1-aa16-4f4f-9d2a-b2cd49cd2b87 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:19.332570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cce5f9b1-aa16-4f4f-9d2a-b2cd49cd2b87 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:19.333061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cce5f9b1-aa16-4f4f-9d2a-b2cd49cd2b87 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:19.333509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cce5f9b1-aa16-4f4f-9d2a-b2cd49cd2b87 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:19.389333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:19.450700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84028886-f0fd-4af7-9943-9511302067e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f3cba8b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:19.526884 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84028886-f0fd-4af7-9943-9511302067e4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.080529 Sep 06 10:56:19.540482 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 730/1488] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:19 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:19.544032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-cce5f9b1-aa16-4f4f-9d2a-b2cd49cd2b87 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:19.578188 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cce5f9b1-aa16-4f4f-9d2a-b2cd49cd2b87 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.268615 Sep 06 10:56:19.579248 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 759/1489] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:19 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:56:19.594046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b8784b22-4a38-4980-b98d-7c9bf7e72998 tempest-FlavorsV2NegativeTest-292187801 tempest-FlavorsV2NegativeTest-292187801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1421879566", "imageRef": "0987281c-4562-403e-8d89-bc9fb6cb9fc2", "flavorRef": "452"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:19.665289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-b8784b22-4a38-4980-b98d-7c9bf7e72998 tempest-FlavorsV2NegativeTest-292187801 tempest-FlavorsV2NegativeTest-292187801-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:56:20.098323 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-b8784b22-4a38-4980-b98d-7c9bf7e72998 tempest-FlavorsV2NegativeTest-292187801 tempest-FlavorsV2NegativeTest-292187801-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b8784b22-4a38-4980-b98d-7c9bf7e72998 tempest-FlavorsV2NegativeTest-292187801 tempest-FlavorsV2NegativeTest-292187801-project] Request method failure captured: Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 143 Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFydRWg9PY9IdWKuWZDGlI0HUWNxoIjBhaMrT_SlxGCFaPSYxnJa4fDdz4Kz-FyQ1KA9rcKvOwxG4MQIXkjx1-PqJjSmJGPzf8WLDewjCxPh9NgDHNOnRe95Xs_BkeTlJRArXTqRCw6OfPqtfsAJ3GVS4CPx3IYyriJyCo3sryHGgrww Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 644d0aaa477d4b139d628ca3e419eda4 Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FlavorsV2NegativeTest-292187801 Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:56:20.102391 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:56:20.104702 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_644d0aaa477d4b139d628ca3e419eda4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/644d0aaa477d4b139d628ca3e419eda4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/644d0aaa477d4b139d628ca3e419eda4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/644d0aaa477d4b139d628ca3e419eda4"}]}] Sep 06 10:56:20.104702 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FlavorsV2NegativeTest-292187801 Sep 06 10:56:20.104702 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 644d0aaa477d4b139d628ca3e419eda4 Sep 06 10:56:20.104702 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-292187801 Sep 06 10:56:20.104702 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FlavorsV2NegativeTest-292187801-project Sep 06 10:56:20.104702 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:56:20.104702 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:56:20.104702 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 645bdbe132bf4389ba7b1cffdce9a517 Sep 06 10:56:20.104702 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FlavorsV2NegativeTest-292187801-project Sep 06 10:56:20.104702 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:56:20.104702 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1421879566", "imageRef": "0987281c-4562-403e-8d89-bc9fb6cb9fc2", "flavorRef": "452"}} Sep 06 10:56:20.104702 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: exception: Flavor's memory is too small for requested image. Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1421879566', 'imageRef': '0987281c-4562-403e-8d89-bc9fb6cb9fc2', 'flavorRef': '452'}}} Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:20.105826 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:20.108441 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:20.111718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:20.111718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:20.111718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:56:20.111718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:56:20.111718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 06 10:56:20.111718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:20.114354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b8784b22-4a38-4980-b98d-7c9bf7e72998 tempest-FlavorsV2NegativeTest-292187801 tempest-FlavorsV2NegativeTest-292187801-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:20.117319 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b8784b22-4a38-4980-b98d-7c9bf7e72998 tempest-FlavorsV2NegativeTest-292187801 tempest-FlavorsV2NegativeTest-292187801-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.526413 Sep 06 10:56:20.121982 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 731/1490] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:56:19 2022] POST /compute/v2.1/servers => generated 93 bytes in 533 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:20.547293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4651025c-1065-4b7b-bc63-c8f8efb267f2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f883b3a0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:20.617308 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4651025c-1065-4b7b-bc63-c8f8efb267f2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.075710 Sep 06 10:56:20.618433 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 732/1491] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:20 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:20.634065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7877cc32-26b4-4099-8d51-67b951d3754a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:20.634694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7877cc32-26b4-4099-8d51-67b951d3754a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:20.656785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7877cc32-26b4-4099-8d51-67b951d3754a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:20.657295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7877cc32-26b4-4099-8d51-67b951d3754a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:20.657746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7877cc32-26b4-4099-8d51-67b951d3754a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:20.658470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7877cc32-26b4-4099-8d51-67b951d3754a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:20.658948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7877cc32-26b4-4099-8d51-67b951d3754a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:20.661563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7877cc32-26b4-4099-8d51-67b951d3754a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:20.832263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-7877cc32-26b4-4099-8d51-67b951d3754a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:20.833184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c09b0a6-7b56-4e34-bf55-aa039198b061 tempest-ListImageFiltersNegativeTestJSON-906992657 tempest-ListImageFiltersNegativeTestJSON-906992657-project] Calling method '.version_select at 0x7f90f88c5f70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:20.877595 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-4c09b0a6-7b56-4e34-bf55-aa039198b061 tempest-ListImageFiltersNegativeTestJSON-906992657 tempest-ListImageFiltersNegativeTestJSON-906992657-project] HTTP exception thrown: Image not found. Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c09b0a6-7b56-4e34-bf55-aa039198b061 tempest-ListImageFiltersNegativeTestJSON-906992657 tempest-ListImageFiltersNegativeTestJSON-906992657-project] Request method failure captured: Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/images/6f470f05-4496-4505-8b9a-ebef340ba914 HTTP/1.1 Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFydUXBlfa__E7RJSs9c_OPPtfAB8CH_J-bsZncb3GQTDodVEFsLjfGc4GejjBvsql69FD_XXmhi2pPIKkXlUrlRW0ugKwQJYif6Z6rpXWlf36fwYVXNivHo3ckrKwAvN7-6Pk5nFiwmFyYQYrvMqN7-2XswHki6-j4UnPAQxkLgcMGw Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 9116231b96d24d88b975085b957ba6d8 Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-906992657 Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:56:20.880040 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:56:20.881761 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9116231b96d24d88b975085b957ba6d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9116231b96d24d88b975085b957ba6d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9116231b96d24d88b975085b957ba6d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9116231b96d24d88b975085b957ba6d8"}]}] Sep 06 10:56:20.881761 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-906992657 Sep 06 10:56:20.881761 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 9116231b96d24d88b975085b957ba6d8 Sep 06 10:56:20.881761 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-906992657 Sep 06 10:56:20.881761 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ListImageFiltersNegativeTestJSON-906992657-project Sep 06 10:56:20.881761 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:56:20.881761 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:56:20.881761 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: c8f738c8f855414e8b9d40a8b4c4d19a Sep 06 10:56:20.881761 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-906992657-project Sep 06 10:56:20.881761 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:56:20.881761 ncdv-master-1 devstack@n-api.service[140876]: exception: Image not found. Sep 06 10:56:20.881761 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '6f470f05-4496-4505-8b9a-ebef340ba914'} Sep 06 10:56:20.881761 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:56:20.887172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6f470f05-4496-4505-8b9a-ebef340ba914 Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:56:20.888742 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6f470f05-4496-4505-8b9a-ebef340ba914 could not be found. Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:56:20.890369 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:20.892643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c09b0a6-7b56-4e34-bf55-aa039198b061 tempest-ListImageFiltersNegativeTestJSON-906992657 tempest-ListImageFiltersNegativeTestJSON-906992657-project] Returning 404 to user: Image not found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:20.894641 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4c09b0a6-7b56-4e34-bf55-aa039198b061 tempest-ListImageFiltersNegativeTestJSON-906992657 tempest-ListImageFiltersNegativeTestJSON-906992657-project] 10.222.0.20 "GET /compute/v2.1/images/6f470f05-4496-4505-8b9a-ebef340ba914" status: 404 len: 62 microversion: 2.1 time: 0.606763 Sep 06 10:56:20.894641 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 760/1492] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:20 2022] GET /compute/v2.1/images/6f470f05-4496-4505-8b9a-ebef340ba914 => generated 62 bytes in 608 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:56:20.934490 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7877cc32-26b4-4099-8d51-67b951d3754a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.310042 Sep 06 10:56:20.936818 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 733/1493] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:20 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:21.073787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c2e2145-1f2f-4c92-9590-4eb2936e2f73 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Action: 'create', calling method: .version_select at 0x7f90f8da5040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1459326074", "metadata": {"Type": "work"}}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c2e2145-1f2f-4c92-9590-4eb2936e2f73 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Request method failure captured: Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 122 Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFydUV6orkFkBU21nJZ-rfTDoF_TiN3qe3clOXKsfAa7AZ8pQIS3ynZvtTRn9-OyT5AjdUImaFE3fHJzUzL_vfNGcLhcAML47_Uqm0x8FntQY_uKMaLJDnAv-iteRItxC6UAbLcedmyRv0idfVRU7dwznzn8gxnMoN2oHybypByXj9N4 Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 6426072a16f94ccab950cd671b99d037 Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:56:21.078827 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:56:21.080837 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6426072a16f94ccab950cd671b99d037"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6426072a16f94ccab950cd671b99d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6426072a16f94ccab950cd671b99d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6426072a16f94ccab950cd671b99d037"}]}] Sep 06 10:56:21.080837 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.080837 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 6426072a16f94ccab950cd671b99d037 Sep 06 10:56:21.080837 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.080837 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-VolumesNegativeTest-1837550330-project Sep 06 10:56:21.080837 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:56:21.080837 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:56:21.080837 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 26d3ff201f924305aa89f37bffb5af09 Sep 06 10:56:21.080837 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-VolumesNegativeTest-1837550330-project Sep 06 10:56:21.080837 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:56:21.080837 ncdv-master-1 devstack@n-api.service[140876]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1459326074", "metadata": {"Type": "work"}}} Sep 06 10:56:21.080837 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:56:21.080837 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1459326074', 'metadata': {'Type': 'work'}}}} Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi '#$%' Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:21.081922 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:56:21.085149 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:56:21.087790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 10:56:21.087790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.087790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c2e2145-1f2f-4c92-9590-4eb2936e2f73 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:21.091049 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4c2e2145-1f2f-4c92-9590-4eb2936e2f73 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.096037 Sep 06 10:56:21.096524 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 761/1494] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 10:56:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:56:21.102676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2788740b-34e0-497f-9433-58a200a68461 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Action: 'create', calling method: .version_select at 0x7f90f3ca08b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1401437236", "metadata": {"Type": "work"}}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2788740b-34e0-497f-9433-58a200a68461 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Request method failure captured: Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 120 Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFydUV6orkFkBU21nJZ-rfTDoF_TiN3qe3clOXKsfAa7AZ8pQIS3ynZvtTRn9-OyT5AjdUImaFE3fHJzUzL_vfNGcLhcAML47_Uqm0x8FntQY_uKMaLJDnAv-iteRItxC6UAbLcedmyRv0idfVRU7dwznzn8gxnMoN2oHybypByXj9N4 Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 6426072a16f94ccab950cd671b99d037 Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:56:21.120627 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:56:21.122954 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6426072a16f94ccab950cd671b99d037"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6426072a16f94ccab950cd671b99d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6426072a16f94ccab950cd671b99d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6426072a16f94ccab950cd671b99d037"}]}] Sep 06 10:56:21.122954 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.122954 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 6426072a16f94ccab950cd671b99d037 Sep 06 10:56:21.122954 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.122954 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-VolumesNegativeTest-1837550330-project Sep 06 10:56:21.122954 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:56:21.122954 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:56:21.122954 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 26d3ff201f924305aa89f37bffb5af09 Sep 06 10:56:21.122954 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-VolumesNegativeTest-1837550330-project Sep 06 10:56:21.122954 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:56:21.122954 ncdv-master-1 devstack@n-api.service[140875]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1401437236", "metadata": {"Type": "work"}}} Sep 06 10:56:21.122954 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:56:21.122954 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1401437236', 'metadata': {'Type': 'work'}}}} Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi '0' Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:21.134584 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:56:21.137389 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:56:21.139604 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 10:56:21.139604 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.139604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2788740b-34e0-497f-9433-58a200a68461 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:21.139604 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2788740b-34e0-497f-9433-58a200a68461 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029970 Sep 06 10:56:21.139604 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 734/1495] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 10:56:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 10:56:21.140333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7e92c771-c9e7-4392-9ab5-39cab7cf6296 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Action: 'create', calling method: .version_select at 0x7f90f8a2a280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1306758503", "metadata": {"Type": "work"}}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7e92c771-c9e7-4392-9ab5-39cab7cf6296 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Request method failure captured: Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 119 Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFydUV6orkFkBU21nJZ-rfTDoF_TiN3qe3clOXKsfAa7AZ8pQIS3ynZvtTRn9-OyT5AjdUImaFE3fHJzUzL_vfNGcLhcAML47_Uqm0x8FntQY_uKMaLJDnAv-iteRItxC6UAbLcedmyRv0idfVRU7dwznzn8gxnMoN2oHybypByXj9N4 Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 6426072a16f94ccab950cd671b99d037 Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:56:21.143066 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:56:21.145169 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6426072a16f94ccab950cd671b99d037"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6426072a16f94ccab950cd671b99d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6426072a16f94ccab950cd671b99d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6426072a16f94ccab950cd671b99d037"}]}] Sep 06 10:56:21.145169 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.145169 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 6426072a16f94ccab950cd671b99d037 Sep 06 10:56:21.145169 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.145169 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-VolumesNegativeTest-1837550330-project Sep 06 10:56:21.145169 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:56:21.145169 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:56:21.145169 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 26d3ff201f924305aa89f37bffb5af09 Sep 06 10:56:21.145169 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-VolumesNegativeTest-1837550330-project Sep 06 10:56:21.145169 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:56:21.145169 ncdv-master-1 devstack@n-api.service[140876]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1306758503", "metadata": {"Type": "work"}}} Sep 06 10:56:21.145169 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:56:21.145169 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1306758503', 'metadata': {'Type': 'work'}}}} Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi '' Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:21.146682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:56:21.153557 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:56:21.154969 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 10:56:21.154969 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.154969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7e92c771-c9e7-4392-9ab5-39cab7cf6296 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:21.154969 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7e92c771-c9e7-4392-9ab5-39cab7cf6296 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009562 Sep 06 10:56:21.154969 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 762/1496] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 10:56:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:56:21.159957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9cd9234-e2da-467d-8825-88ebd6a5a464 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Calling method '.version_select at 0x7f90f3cff790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:21.206433 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-c9cd9234-e2da-467d-8825-88ebd6a5a464 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] HTTP exception thrown: Volume tempest-invalid-144306523 could not be found. Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9cd9234-e2da-467d-8825-88ebd6a5a464 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Request method failure captured: Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-144306523 HTTP/1.1 Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFydUV6orkFkBU21nJZ-rfTDoF_TiN3qe3clOXKsfAa7AZ8pQIS3ynZvtTRn9-OyT5AjdUImaFE3fHJzUzL_vfNGcLhcAML47_Uqm0x8FntQY_uKMaLJDnAv-iteRItxC6UAbLcedmyRv0idfVRU7dwznzn8gxnMoN2oHybypByXj9N4 Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 6426072a16f94ccab950cd671b99d037 Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:56:21.233700 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:56:21.240482 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6426072a16f94ccab950cd671b99d037"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6426072a16f94ccab950cd671b99d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6426072a16f94ccab950cd671b99d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6426072a16f94ccab950cd671b99d037"}]}] Sep 06 10:56:21.240482 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.240482 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 6426072a16f94ccab950cd671b99d037 Sep 06 10:56:21.240482 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.240482 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-VolumesNegativeTest-1837550330-project Sep 06 10:56:21.240482 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:56:21.240482 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:56:21.240482 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 26d3ff201f924305aa89f37bffb5af09 Sep 06 10:56:21.240482 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-VolumesNegativeTest-1837550330-project Sep 06 10:56:21.240482 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:56:21.240482 ncdv-master-1 devstack@n-api.service[140875]: exception: Volume tempest-invalid-144306523 could not be found. Sep 06 10:56:21.240482 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'tempest-invalid-144306523'} Sep 06 10:56:21.240482 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-144306523 could not be found. (HTTP 404) (Request-ID: req-25be82e7-e34d-449a-92c9-6467ceba9409) Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.241364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 10:56:21.242621 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-144306523 could not be found. Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:56:21.244259 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-144306523 could not be found. Sep 06 10:56:21.245878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.245878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.245878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.245878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.245878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:21.245878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:21.245878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:56:21.245878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:56:21.245878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-144306523 could not be found. Sep 06 10:56:21.245878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.245878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9cd9234-e2da-467d-8825-88ebd6a5a464 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Returning 404 to user: Volume tempest-invalid-144306523 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:21.245878 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c9cd9234-e2da-467d-8825-88ebd6a5a464 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-144306523" status: 404 len: 98 microversion: 2.1 time: 0.080103 Sep 06 10:56:21.245878 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 735/1497] 10.222.0.20 () {58 vars in 1215 bytes} [Tue Sep 6 10:56:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-144306523 => generated 98 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:56:21.246810 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dc9b8809-ba20-4af2-9e4a-654229e54329 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004190 Sep 06 10:56:21.256330 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 763/1498] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Sep 6 10:56:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 10:56:21.258311 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-283785f0-e969-4736-a582-f50e5f284eca tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005891 Sep 06 10:56:21.258311 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 736/1499] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:56:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 10:56:21.267767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a38bd4d5-c5f3-42ef-8fe9-68ecb850dd68 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Calling method '.version_select at 0x7f90f89d7dc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:21.359958 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-a38bd4d5-c5f3-42ef-8fe9-68ecb850dd68 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] HTTP exception thrown: Volume 796364da-36ae-4cb3-90fb-6c9648bda6f5 could not be found. Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a38bd4d5-c5f3-42ef-8fe9-68ecb850dd68 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Request method failure captured: Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-volumes/796364da-36ae-4cb3-90fb-6c9648bda6f5 HTTP/1.1 Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFydUV6orkFkBU21nJZ-rfTDoF_TiN3qe3clOXKsfAa7AZ8pQIS3ynZvtTRn9-OyT5AjdUImaFE3fHJzUzL_vfNGcLhcAML47_Uqm0x8FntQY_uKMaLJDnAv-iteRItxC6UAbLcedmyRv0idfVRU7dwznzn8gxnMoN2oHybypByXj9N4 Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 6426072a16f94ccab950cd671b99d037 Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:56:21.361339 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:56:21.362844 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6426072a16f94ccab950cd671b99d037"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6426072a16f94ccab950cd671b99d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6426072a16f94ccab950cd671b99d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6426072a16f94ccab950cd671b99d037"}]}] Sep 06 10:56:21.362844 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.362844 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 6426072a16f94ccab950cd671b99d037 Sep 06 10:56:21.362844 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.362844 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-VolumesNegativeTest-1837550330-project Sep 06 10:56:21.362844 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:56:21.362844 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:56:21.362844 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 26d3ff201f924305aa89f37bffb5af09 Sep 06 10:56:21.362844 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-VolumesNegativeTest-1837550330-project Sep 06 10:56:21.362844 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:56:21.362844 ncdv-master-1 devstack@n-api.service[140876]: exception: Volume 796364da-36ae-4cb3-90fb-6c9648bda6f5 could not be found. Sep 06 10:56:21.362844 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '796364da-36ae-4cb3-90fb-6c9648bda6f5'} Sep 06 10:56:21.362844 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 796364da-36ae-4cb3-90fb-6c9648bda6f5 could not be found. (HTTP 404) (Request-ID: req-6d38181b-d700-4769-9499-4abfa0e0eb3e) Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.365270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 10:56:21.368897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 796364da-36ae-4cb3-90fb-6c9648bda6f5 could not be found. Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 10:56:21.371877 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 796364da-36ae-4cb3-90fb-6c9648bda6f5 could not be found. Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 796364da-36ae-4cb3-90fb-6c9648bda6f5 could not be found. Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a38bd4d5-c5f3-42ef-8fe9-68ecb850dd68 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Returning 404 to user: Volume 796364da-36ae-4cb3-90fb-6c9648bda6f5 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a38bd4d5-c5f3-42ef-8fe9-68ecb850dd68 tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/796364da-36ae-4cb3-90fb-6c9648bda6f5" status: 404 len: 109 microversion: 2.1 time: 0.099931 Sep 06 10:56:21.374991 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 764/1500] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 10:56:21 2022] DELETE /compute/v2.1/os-volumes/796364da-36ae-4cb3-90fb-6c9648bda6f5 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:56:21.377597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-681e5200-0ab5-4dc7-a697-87b8e6fc067a tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Calling method '.version_select at 0x7f90f3d8e040>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:21.431538 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-681e5200-0ab5-4dc7-a697-87b8e6fc067a tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] HTTP exception thrown: Volume a05f4f3f-1a34-4f8c-96d0-23fb3db6ba88 could not be found. Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-681e5200-0ab5-4dc7-a697-87b8e6fc067a tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Request method failure captured: Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-volumes/a05f4f3f-1a34-4f8c-96d0-23fb3db6ba88 HTTP/1.1 Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFydUV6orkFkBU21nJZ-rfTDoF_TiN3qe3clOXKsfAa7AZ8pQIS3ynZvtTRn9-OyT5AjdUImaFE3fHJzUzL_vfNGcLhcAML47_Uqm0x8FntQY_uKMaLJDnAv-iteRItxC6UAbLcedmyRv0idfVRU7dwznzn8gxnMoN2oHybypByXj9N4 Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 6426072a16f94ccab950cd671b99d037 Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:56:21.433535 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:56:21.435031 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6426072a16f94ccab950cd671b99d037"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6426072a16f94ccab950cd671b99d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6426072a16f94ccab950cd671b99d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6426072a16f94ccab950cd671b99d037"}]}] Sep 06 10:56:21.435031 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.435031 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 6426072a16f94ccab950cd671b99d037 Sep 06 10:56:21.435031 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-VolumesNegativeTest-1837550330 Sep 06 10:56:21.435031 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-VolumesNegativeTest-1837550330-project Sep 06 10:56:21.435031 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:56:21.435031 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:56:21.435031 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 26d3ff201f924305aa89f37bffb5af09 Sep 06 10:56:21.435031 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-VolumesNegativeTest-1837550330-project Sep 06 10:56:21.435031 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:56:21.435031 ncdv-master-1 devstack@n-api.service[140875]: exception: Volume a05f4f3f-1a34-4f8c-96d0-23fb3db6ba88 could not be found. Sep 06 10:56:21.435031 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'a05f4f3f-1a34-4f8c-96d0-23fb3db6ba88'} Sep 06 10:56:21.435031 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a05f4f3f-1a34-4f8c-96d0-23fb3db6ba88 could not be found. (HTTP 404) (Request-ID: req-b4d36e6c-3b3d-45aa-a224-052ecc18fde9) Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.435931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 10:56:21.437299 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a05f4f3f-1a34-4f8c-96d0-23fb3db6ba88 could not be found. Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 10:56:21.438549 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a05f4f3f-1a34-4f8c-96d0-23fb3db6ba88 could not be found. Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a05f4f3f-1a34-4f8c-96d0-23fb3db6ba88 could not be found. Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-681e5200-0ab5-4dc7-a697-87b8e6fc067a tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] Returning 404 to user: Volume a05f4f3f-1a34-4f8c-96d0-23fb3db6ba88 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-681e5200-0ab5-4dc7-a697-87b8e6fc067a tempest-VolumesNegativeTest-1837550330 tempest-VolumesNegativeTest-1837550330-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a05f4f3f-1a34-4f8c-96d0-23fb3db6ba88" status: 404 len: 109 microversion: 2.1 time: 0.065235 Sep 06 10:56:21.442268 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 737/1501] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 10:56:21 2022] GET /compute/v2.1/os-volumes/a05f4f3f-1a34-4f8c-96d0-23fb3db6ba88 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:56:21.634048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a384ac01-c41a-4af5-a558-3ee0bd7af0c0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8ab6ca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:21.694384 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a384ac01-c41a-4af5-a558-3ee0bd7af0c0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.064790 Sep 06 10:56:21.694956 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 765/1502] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:21 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:21.971839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-586d1ab3-3bb0-4d4d-9376-a70be6992b15 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:21.972386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-586d1ab3-3bb0-4d4d-9376-a70be6992b15 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:21.984743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-586d1ab3-3bb0-4d4d-9376-a70be6992b15 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:21.985255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-586d1ab3-3bb0-4d4d-9376-a70be6992b15 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:21.993454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-586d1ab3-3bb0-4d4d-9376-a70be6992b15 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:21.994974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-586d1ab3-3bb0-4d4d-9376-a70be6992b15 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:21.995911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-586d1ab3-3bb0-4d4d-9376-a70be6992b15 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:21.996529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-586d1ab3-3bb0-4d4d-9376-a70be6992b15 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:22.116451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-586d1ab3-3bb0-4d4d-9376-a70be6992b15 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:22.156067 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-586d1ab3-3bb0-4d4d-9376-a70be6992b15 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.190997 Sep 06 10:56:22.169408 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 738/1503] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:21 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:22.729363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f11bdf33-b892-4509-a3b7-d5e69155d0c7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8ab6a60>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:22.851870 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f11bdf33-b892-4509-a3b7-d5e69155d0c7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.142444 Sep 06 10:56:22.863332 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 766/1504] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:22 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:23.200917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fc3f8610-0ac2-4353-9028-bebbc1b0bf51 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:23.200917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fc3f8610-0ac2-4353-9028-bebbc1b0bf51 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:23.200917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:23.222823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc3f8610-0ac2-4353-9028-bebbc1b0bf51 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:23.225374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc3f8610-0ac2-4353-9028-bebbc1b0bf51 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:23.226990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc3f8610-0ac2-4353-9028-bebbc1b0bf51 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:23.230103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc3f8610-0ac2-4353-9028-bebbc1b0bf51 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:23.247615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc3f8610-0ac2-4353-9028-bebbc1b0bf51 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:23.248086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc3f8610-0ac2-4353-9028-bebbc1b0bf51 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:23.408554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-fc3f8610-0ac2-4353-9028-bebbc1b0bf51 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:23.450081 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fc3f8610-0ac2-4353-9028-bebbc1b0bf51 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.260263 Sep 06 10:56:23.454846 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 739/1505] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:23 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:23.758848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-e326eb36-c01a-46fd-80c2-0cbaaa5a7e1a req-48d61e42-1ffb-4863-8026-268cb6d99cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937289ab-8f49-410a-8477-7f970832616f", "name": "network-vif-plugged", "status": "completed", "tag": "bbc270c7-beb0-4db6-9d50-0a3fe6996886"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:23.781773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e326eb36-c01a-46fd-80c2-0cbaaa5a7e1a req-48d61e42-1ffb-4863-8026-268cb6d99cfa service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:23.787148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e326eb36-c01a-46fd-80c2-0cbaaa5a7e1a req-48d61e42-1ffb-4863-8026-268cb6d99cfa service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:23.787962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e326eb36-c01a-46fd-80c2-0cbaaa5a7e1a req-48d61e42-1ffb-4863-8026-268cb6d99cfa service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:23.807741 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-e326eb36-c01a-46fd-80c2-0cbaaa5a7e1a req-48d61e42-1ffb-4863-8026-268cb6d99cfa service nova] Creating event network-vif-plugged:bbc270c7-beb0-4db6-9d50-0a3fe6996886 for instance 937289ab-8f49-410a-8477-7f970832616f on nch1-master-1 Sep 06 10:56:23.813957 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-e326eb36-c01a-46fd-80c2-0cbaaa5a7e1a req-48d61e42-1ffb-4863-8026-268cb6d99cfa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059232 Sep 06 10:56:23.820848 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 767/1506] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:23.869369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fa1df489-1067-45b6-ad83-a4217aa2dfe3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f3d71550>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:23.940006 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fa1df489-1067-45b6-ad83-a4217aa2dfe3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.075580 Sep 06 10:56:23.940960 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 740/1507] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:23 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:24.380189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=32 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:24.385082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1034667256", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "54983ae4-8ab3-43bc-80e4-fdbaba018ae6"}], "security_groups": [{"name": "tempest-securitygroup--649562837"}], "key_name": "tempest-keypair-16122590", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:24.488160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e0e63e41-3861-42a1-b3ad-b6e8549c011e tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:24.488818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e0e63e41-3861-42a1-b3ad-b6e8549c011e tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:24.519809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0e63e41-3861-42a1-b3ad-b6e8549c011e tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:24.520329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0e63e41-3861-42a1-b3ad-b6e8549c011e tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:24.521314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0e63e41-3861-42a1-b3ad-b6e8549c011e tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:24.522424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0e63e41-3861-42a1-b3ad-b6e8549c011e tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:24.522903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0e63e41-3861-42a1-b3ad-b6e8549c011e tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:24.543455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0e63e41-3861-42a1-b3ad-b6e8549c011e tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:24.721275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] validate_networks() for [('54983ae4-8ab3-43bc-80e4-fdbaba018ae6', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:56:24.798517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-e0e63e41-3861-42a1-b3ad-b6e8549c011e tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:24.854983 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e0e63e41-3861-42a1-b3ad-b6e8549c011e tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.371169 Sep 06 10:56:24.859426 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 741/1508] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:24 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:24.957270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-faa00442-70b0-40e4-876d-477d8b4b3209 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f3d8eaf0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:25.072603 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-faa00442-70b0-40e4-876d-477d8b4b3209 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.114589 Sep 06 10:56:25.074186 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 742/1509] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:24 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:25.522494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:56:25.523728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:56:25.525121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:56:25.525785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:56:25.526450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:56:25.540992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:25.541880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:25.542596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:25.543659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:25.544384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:25.545199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:25.571336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Getting quotas for project 740286d1464549609e6d4b3280aa50ce. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:25.579319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Getting quotas for user 6c557446cb39475dba1fc800d061b9e1 and project 740286d1464549609e6d4b3280aa50ce. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:25.594817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:56:25.597664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:56:25.897881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d069a668-63ed-4bd1-a238-b0cbac033b3c tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:25.899841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d069a668-63ed-4bd1-a238-b0cbac033b3c tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:25.922346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d069a668-63ed-4bd1-a238-b0cbac033b3c tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:25.923439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d069a668-63ed-4bd1-a238-b0cbac033b3c tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:25.929031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d069a668-63ed-4bd1-a238-b0cbac033b3c tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:25.929031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d069a668-63ed-4bd1-a238-b0cbac033b3c tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:25.929031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d069a668-63ed-4bd1-a238-b0cbac033b3c tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:25.929031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d069a668-63ed-4bd1-a238-b0cbac033b3c tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:26.030674 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-929876de-1191-44b5-bc9e-520797a1c103 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.651729 Sep 06 10:56:26.031717 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 768/1510] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:56:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:56:26.049938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-d069a668-63ed-4bd1-a238-b0cbac033b3c tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:26.050537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aea0c4f4-a18b-46b0-823d-3abada2868b0 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:26.052562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aea0c4f4-a18b-46b0-823d-3abada2868b0 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:26.095260 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d069a668-63ed-4bd1-a238-b0cbac033b3c tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.202451 Sep 06 10:56:26.097334 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 743/1511] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:25 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:26.116541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8febbaf6-4621-49c0-9a01-f66566051c04 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f3cbd280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:26.128979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aea0c4f4-a18b-46b0-823d-3abada2868b0 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:26.142205 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aea0c4f4-a18b-46b0-823d-3abada2868b0 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1240 microversion: 2.1 time: 0.102338 Sep 06 10:56:26.143879 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 769/1512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:26 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1240 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:26.209780 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8febbaf6-4621-49c0-9a01-f66566051c04 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.101837 Sep 06 10:56:26.210543 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 744/1513] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:26 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:27.128473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8b2ca3eb-2b08-4bc2-9482-b090948396ae tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:27.129132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8b2ca3eb-2b08-4bc2-9482-b090948396ae tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:27.147110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b2ca3eb-2b08-4bc2-9482-b090948396ae tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:27.148246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b2ca3eb-2b08-4bc2-9482-b090948396ae tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:27.150235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b2ca3eb-2b08-4bc2-9482-b090948396ae tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:27.151829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b2ca3eb-2b08-4bc2-9482-b090948396ae tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:27.153121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b2ca3eb-2b08-4bc2-9482-b090948396ae tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:27.154889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b2ca3eb-2b08-4bc2-9482-b090948396ae tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:27.172701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-99d4b63d-9924-49ad-8698-fee64dc4f6a2 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:27.173474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-99d4b63d-9924-49ad-8698-fee64dc4f6a2 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:27.304767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-8b2ca3eb-2b08-4bc2-9482-b090948396ae tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:27.337845 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8b2ca3eb-2b08-4bc2-9482-b090948396ae tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.213235 Sep 06 10:56:27.351667 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 770/1514] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:27 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:27.359679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-99d4b63d-9924-49ad-8698-fee64dc4f6a2 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:27.368887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6d7e8e70-8e37-456b-9c84-840fe9efa923 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8eb7ca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:27.373286 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-99d4b63d-9924-49ad-8698-fee64dc4f6a2 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1240 microversion: 2.1 time: 0.208485 Sep 06 10:56:27.391217 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 745/1515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:27 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1240 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:27.438399 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6d7e8e70-8e37-456b-9c84-840fe9efa923 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.085249 Sep 06 10:56:27.438974 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 771/1516] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:27 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:27.802900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ef684c99-70b7-45ad-8c3e-5dae2780b3e6 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Action: 'create', calling method: .version_select at 0x7f90f3dbc550>, body: {"keypair": {"name": "tempest-keypair-625486571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmCOEnWy2iB4nxFpczBmGbhEb8rGQwqYi3UIKsAQvYXYG5EwPVijzJuHPvd96KAcwYaGEOILnwWRWqts2+xxtnSFKJ3YNtSBTpHeg7wvhpUc7toVBVrFP8eELkrW9xcQQ=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:27.869013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ef684c99-70b7-45ad-8c3e-5dae2780b3e6 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:27.879109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ef684c99-70b7-45ad-8c3e-5dae2780b3e6 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for user 6eae9e913f944ed4af0e4b95ff7fc8f7 and project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:28.034277 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ef684c99-70b7-45ad-8c3e-5dae2780b3e6 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.428013 Sep 06 10:56:28.039181 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 746/1517] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Sep 6 10:56:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 430 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 06 10:56:28.047778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1dee008d-3354-42e3-b44a-a2ed6798110b tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90f86b5670>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:28.075975 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1dee008d-3354-42e3-b44a-a2ed6798110b tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-625486571" status: 200 len: 512 microversion: 2.2 time: 0.032696 Sep 06 10:56:28.084196 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 772/1518] 10.222.0.20 () {60 vars in 1255 bytes} [Tue Sep 6 10:56:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-625486571 => generated 512 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:28.090653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b72552fa-944b-4d5e-8e41-b7dcab4f723f tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90fd181280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:28.373831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f8eaf727-812c-4914-b1d9-8595d8573d50 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:28.374446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f8eaf727-812c-4914-b1d9-8595d8573d50 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:28.382639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8eaf727-812c-4914-b1d9-8595d8573d50 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:28.383241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8eaf727-812c-4914-b1d9-8595d8573d50 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:28.383738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8eaf727-812c-4914-b1d9-8595d8573d50 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:28.384431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8eaf727-812c-4914-b1d9-8595d8573d50 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:28.384890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8eaf727-812c-4914-b1d9-8595d8573d50 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:28.385318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8eaf727-812c-4914-b1d9-8595d8573d50 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:28.465115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-f8eaf727-812c-4914-b1d9-8595d8573d50 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:28.483657 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f8eaf727-812c-4914-b1d9-8595d8573d50 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.113810 Sep 06 10:56:28.484268 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 773/1519] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:28 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:56:28.488788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-50995a63-9f66-4a1b-825b-cefb5276e630 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:28.489507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-50995a63-9f66-4a1b-825b-cefb5276e630 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:28.496097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50995a63-9f66-4a1b-825b-cefb5276e630 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:28.496813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50995a63-9f66-4a1b-825b-cefb5276e630 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:28.497036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50995a63-9f66-4a1b-825b-cefb5276e630 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:28.497747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50995a63-9f66-4a1b-825b-cefb5276e630 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:28.498214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50995a63-9f66-4a1b-825b-cefb5276e630 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:28.498648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50995a63-9f66-4a1b-825b-cefb5276e630 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:28.538609 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b72552fa-944b-4d5e-8e41-b7dcab4f723f tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-625486571" status: 204 len: 0 microversion: 2.2 time: 0.452955 Sep 06 10:56:28.540485 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 747/1520] 10.222.0.20 () {60 vars in 1258 bytes} [Tue Sep 6 10:56:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-625486571 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 10:56:28.551126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8eeaf8b0-96f4-4191-a186-324940c49ec5 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f3d8e310>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:28.581744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-50995a63-9f66-4a1b-825b-cefb5276e630 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:28.593835 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-50995a63-9f66-4a1b-825b-cefb5276e630 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1244 microversion: 2.1 time: 0.108510 Sep 06 10:56:28.608856 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 774/1521] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:28 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1244 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:28.620977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e00d27a-7201-42d1-8d9b-1553cda25f7a tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Action: 'create', calling method: .version_select at 0x7f90f3f73ee0>, body: {"keypair": {"name": "tempest-keypair-1941832396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYdWhPDVnfhA/f5mQ7I+7H7G/CfTjVLxgrpxmqssAcJw4o0VqkrDsw0UWkzX5GDsDUd1tC/ov0tAK1/FG9hm8E99NxPsMHTEYtPrDhiKzl7Sh8HL5yYkdnztZrWeZKLkQ=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:28.632082 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8eeaf8b0-96f4-4191-a186-324940c49ec5 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.089773 Sep 06 10:56:28.632629 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 748/1522] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:28 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:28.642547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-5e00d27a-7201-42d1-8d9b-1553cda25f7a tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:28.647982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-5e00d27a-7201-42d1-8d9b-1553cda25f7a tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for user 6eae9e913f944ed4af0e4b95ff7fc8f7 and project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:28.742000 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5e00d27a-7201-42d1-8d9b-1553cda25f7a tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.133385 Sep 06 10:56:28.751682 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 775/1523] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Sep 6 10:56:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 06 10:56:28.764676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-90163f83-3d63-4665-9ae2-96e67c1c6308 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90fd159f70>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:28.961491 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-90163f83-3d63-4665-9ae2-96e67c1c6308 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941832396" status: 204 len: 0 microversion: 2.2 time: 0.202507 Sep 06 10:56:28.963778 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 749/1524] 10.222.0.20 () {60 vars in 1261 bytes} [Tue Sep 6 10:56:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941832396 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:56:28.973050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba22ca61-6a59-43d1-9606-fd32d50c1a8b tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Action: 'create', calling method: .version_select at 0x7f90f89fb9d0>, body: {"keypair": {"name": "tempest-keypair-1852625479", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:29.003977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ba22ca61-6a59-43d1-9606-fd32d50c1a8b tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:29.012547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ba22ca61-6a59-43d1-9606-fd32d50c1a8b tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for user 6eae9e913f944ed4af0e4b95ff7fc8f7 and project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:29.127694 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ba22ca61-6a59-43d1-9606-fd32d50c1a8b tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.158723 Sep 06 10:56:29.135340 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 776/1525] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Sep 6 10:56:28 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 160 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 06 10:56:29.142679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c80d8321-3ae0-4be6-9d63-8d4e08bdca4c tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90fd182160>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:29.332144 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c80d8321-3ae0-4be6-9d63-8d4e08bdca4c tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852625479" status: 204 len: 0 microversion: 2.2 time: 0.189881 Sep 06 10:56:29.345946 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 750/1526] 10.222.0.20 () {60 vars in 1261 bytes} [Tue Sep 6 10:56:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852625479 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:56:29.346239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d29c0dde-bd97-475d-bdb6-b90f7fbc801b tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Action: 'create', calling method: .version_select at 0x7f90f8e17670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1474468319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUutPxVmi5mMGd65wTgGD8ooqaaAKos4T4c60CB5PaHK7HcGb1dH/FfdZHcOJ91KxOYeZelhsMSj64DZ7YJDFi2ti/n86cXA0pZeId+aHxrEYNxx6/yLdPMbrnGiaISwg=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:29.379972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d29c0dde-bd97-475d-bdb6-b90f7fbc801b tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:29.401210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d29c0dde-bd97-475d-bdb6-b90f7fbc801b tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for user 6eae9e913f944ed4af0e4b95ff7fc8f7 and project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:29.513941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-555ad2a4-e5a3-46dd-a023-951353bc78ce tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:29.514946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-555ad2a4-e5a3-46dd-a023-951353bc78ce tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:29.520630 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d29c0dde-bd97-475d-bdb6-b90f7fbc801b tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.179627 Sep 06 10:56:29.521726 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 777/1527] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Sep 6 10:56:29 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 06 10:56:29.532375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-555ad2a4-e5a3-46dd-a023-951353bc78ce tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:29.533890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-555ad2a4-e5a3-46dd-a023-951353bc78ce tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:29.535276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-667e676a-5630-453a-b42c-9c56821ca849 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Action: 'create', calling method: .version_select at 0x7f90f89fb4c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-392687465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRkRnyvpL9mai8TtoPC42/buy8aTQDI905idjd8Lc+YrgSqvwENvzIDd0Z2Si14z1AVJ43qKZGylAbGCz5FLLhGuFn7Ne8vrpDvTQPRcOcPZztfIXH5j30WfurNfx9CkA=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:29.535482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-555ad2a4-e5a3-46dd-a023-951353bc78ce tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:29.536858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-555ad2a4-e5a3-46dd-a023-951353bc78ce tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:29.537543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-555ad2a4-e5a3-46dd-a023-951353bc78ce tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:29.538010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-555ad2a4-e5a3-46dd-a023-951353bc78ce tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:29.571041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-667e676a-5630-453a-b42c-9c56821ca849 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:29.594420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-667e676a-5630-453a-b42c-9c56821ca849 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for user 6eae9e913f944ed4af0e4b95ff7fc8f7 and project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:29.636686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-555ad2a4-e5a3-46dd-a023-951353bc78ce tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:29.686018 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-555ad2a4-e5a3-46dd-a023-951353bc78ce tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.175388 Sep 06 10:56:29.688692 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 751/1528] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:29 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:56:29.695905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e8e91b87-c6fc-42b0-9149-990f2537a117 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:29.697656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e8e91b87-c6fc-42b0-9149-990f2537a117 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:29.705456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8e91b87-c6fc-42b0-9149-990f2537a117 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:29.708986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8e91b87-c6fc-42b0-9149-990f2537a117 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:29.709765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8e91b87-c6fc-42b0-9149-990f2537a117 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:29.711236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8e91b87-c6fc-42b0-9149-990f2537a117 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:29.712216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8e91b87-c6fc-42b0-9149-990f2537a117 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:29.717055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8e91b87-c6fc-42b0-9149-990f2537a117 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:29.738973 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-667e676a-5630-453a-b42c-9c56821ca849 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.208352 Sep 06 10:56:29.748095 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 778/1529] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Sep 6 10:56:29 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 210 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 06 10:56:29.753062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-075b82e9-1bf3-4d67-9de9-a3e668ec986b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f86548b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:29.855854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e8e91b87-c6fc-42b0-9149-990f2537a117 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:29.866006 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e8e91b87-c6fc-42b0-9149-990f2537a117 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1292 microversion: 2.1 time: 0.176067 Sep 06 10:56:29.868849 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-075b82e9-1bf3-4d67-9de9-a3e668ec986b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.127571 Sep 06 10:56:29.871111 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 752/1530] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:29 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1292 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:29.877513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-baae0835-17ee-444d-b28b-ffde48f6d903 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Action: 'create', calling method: .version_select at 0x7f90f3d71820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1813482981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN707aRz44LinGcg5sDfy0YP8rxePqIxY6atfclCBgxBJod/wuy/3EU1ouyXnmUWHxHsNsu3gvX1bqHyXFl7AXtlmj0llIXWXAjLabmEO+sZ06BfJo/7P3MM1sttehKZYg=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:29.899685 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 779/1531] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:29 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:29.901752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-baae0835-17ee-444d-b28b-ffde48f6d903 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:29.909461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-baae0835-17ee-444d-b28b-ffde48f6d903 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for user 6eae9e913f944ed4af0e4b95ff7fc8f7 and project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:30.058627 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-baae0835-17ee-444d-b28b-ffde48f6d903 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.185246 Sep 06 10:56:30.062405 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 753/1532] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Sep 6 10:56:29 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 190 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 06 10:56:30.079001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-38d11cc9-7737-4675-aa7f-dd25ad2116ee tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90f89fbca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:30.094462 ncdv-master-1 devstack@n-api.service[140876]: WARNING oslo_db.sqlalchemy.utils [None req-38d11cc9-7737-4675-aa7f-dd25ad2116ee tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 06 10:56:30.110315 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-38d11cc9-7737-4675-aa7f-dd25ad2116ee tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.040059 Sep 06 10:56:30.112036 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 780/1533] 10.222.0.20 () {60 vars in 1177 bytes} [Tue Sep 6 10:56:30 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:30.123160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b020acf6-80fa-4d34-a464-744959e0527f tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90fd181430>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:30.253198 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b020acf6-80fa-4d34-a464-744959e0527f tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1813482981" status: 204 len: 0 microversion: 2.2 time: 0.134051 Sep 06 10:56:30.254556 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 754/1534] 10.222.0.20 () {60 vars in 1321 bytes} [Tue Sep 6 10:56:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1813482981 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:56:30.266419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-259b6710-1ead-4fd5-99d2-322b4e40c51f tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90f8cbe3a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:30.496068 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-259b6710-1ead-4fd5-99d2-322b4e40c51f tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-392687465" status: 204 len: 0 microversion: 2.2 time: 0.235219 Sep 06 10:56:30.506219 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 781/1535] 10.222.0.20 () {60 vars in 1318 bytes} [Tue Sep 6 10:56:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-392687465 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:56:30.511999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-85746c6b-2d04-4f71-a179-7213211bef0f tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90f3cbd040>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:30.719105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b57ce399-c0fe-43ec-a139-87c4176d24ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:30.719737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b57ce399-c0fe-43ec-a139-87c4176d24ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:30.727586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b57ce399-c0fe-43ec-a139-87c4176d24ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:30.728081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b57ce399-c0fe-43ec-a139-87c4176d24ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:30.728533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b57ce399-c0fe-43ec-a139-87c4176d24ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:30.729262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b57ce399-c0fe-43ec-a139-87c4176d24ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:30.729744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b57ce399-c0fe-43ec-a139-87c4176d24ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:30.730166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b57ce399-c0fe-43ec-a139-87c4176d24ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:30.822802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-b57ce399-c0fe-43ec-a139-87c4176d24ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:30.839312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:30.842536 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b57ce399-c0fe-43ec-a139-87c4176d24ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.127315 Sep 06 10:56:30.855803 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 782/1536] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:30 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:56:30.886480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cb6b3c75-b8a2-4a24-b9b9-ad149feaa477 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8aaf280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:30.945314 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cb6b3c75-b8a2-4a24-b9b9-ad149feaa477 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.062870 Sep 06 10:56:30.945901 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 783/1537] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:30 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:30.958638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c1f7e62d-9e7a-4f11-9883-bcb49138285a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:30.959290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c1f7e62d-9e7a-4f11-9883-bcb49138285a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:30.965499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1f7e62d-9e7a-4f11-9883-bcb49138285a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:30.965936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1f7e62d-9e7a-4f11-9883-bcb49138285a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:30.966380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1f7e62d-9e7a-4f11-9883-bcb49138285a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:30.981898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1f7e62d-9e7a-4f11-9883-bcb49138285a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:30.982334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1f7e62d-9e7a-4f11-9883-bcb49138285a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:30.983036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1f7e62d-9e7a-4f11-9883-bcb49138285a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:31.050729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c1f7e62d-9e7a-4f11-9883-bcb49138285a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:31.059918 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c1f7e62d-9e7a-4f11-9883-bcb49138285a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1310 microversion: 2.1 time: 0.105228 Sep 06 10:56:31.060795 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 784/1538] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:30 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1310 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:31.871396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2a1a22f1-2472-4834-89a7-e5ca68f28fb9 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:31.872142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2a1a22f1-2472-4834-89a7-e5ca68f28fb9 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:31.878810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a1a22f1-2472-4834-89a7-e5ca68f28fb9 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:31.879642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a1a22f1-2472-4834-89a7-e5ca68f28fb9 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:31.880643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a1a22f1-2472-4834-89a7-e5ca68f28fb9 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:31.881589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a1a22f1-2472-4834-89a7-e5ca68f28fb9 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:31.882035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a1a22f1-2472-4834-89a7-e5ca68f28fb9 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:31.882471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a1a22f1-2472-4834-89a7-e5ca68f28fb9 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:31.963255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-2a1a22f1-2472-4834-89a7-e5ca68f28fb9 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:31.979651 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2a1a22f1-2472-4834-89a7-e5ca68f28fb9 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.112213 Sep 06 10:56:31.980221 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 785/1539] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:31 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:56:31.986200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6b5a5d9d-cefd-483b-8c96-96884bfa0194 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8d29f70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:32.032343 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6b5a5d9d-cefd-483b-8c96-96884bfa0194 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.051088 Sep 06 10:56:32.032919 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 786/1540] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:31 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:32.088879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3dccce2c-9393-4628-b34f-0b122e62fe8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:32.089545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3dccce2c-9393-4628-b34f-0b122e62fe8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:32.096167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3dccce2c-9393-4628-b34f-0b122e62fe8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:32.096654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3dccce2c-9393-4628-b34f-0b122e62fe8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:32.097144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3dccce2c-9393-4628-b34f-0b122e62fe8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:32.097852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3dccce2c-9393-4628-b34f-0b122e62fe8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:32.098314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3dccce2c-9393-4628-b34f-0b122e62fe8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:32.099316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3dccce2c-9393-4628-b34f-0b122e62fe8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:32.169102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3dccce2c-9393-4628-b34f-0b122e62fe8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:32.177698 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3dccce2c-9393-4628-b34f-0b122e62fe8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1310 microversion: 2.1 time: 0.092443 Sep 06 10:56:32.178269 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 787/1541] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:32 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:32.788499 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-85746c6b-2d04-4f71-a179-7213211bef0f tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1474468319" status: 204 len: 0 microversion: 2.2 time: 2.281037 Sep 06 10:56:32.790703 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 755/1542] 10.222.0.20 () {60 vars in 1321 bytes} [Tue Sep 6 10:56:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1474468319 => generated 0 bytes in 2284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:56:32.815468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-05790d12-87d5-477e-8370-03876cb09d7c tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Action: 'create', calling method: .version_select at 0x7f90f8be43a0>, body: {"keypair": {"name": "tempest-keypair-1642018893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOl6YnogXUQWWWI0TrzRnkgtkmpGgqUg9Mr9hNzqTe26KEfN54XgtChKhu8+X43lQEz621NnK7T7r4RD1vTrkjGNlJlwxpa3CG6rDZPoyu/L0mQofka6G+MsIZKk+0IfA=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:32.836593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-05790d12-87d5-477e-8370-03876cb09d7c tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:32.843299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-05790d12-87d5-477e-8370-03876cb09d7c tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for user 6eae9e913f944ed4af0e4b95ff7fc8f7 and project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:32.969293 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-05790d12-87d5-477e-8370-03876cb09d7c tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.164283 Sep 06 10:56:32.970015 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 788/1543] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Sep 6 10:56:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 06 10:56:32.987545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ab5e7526-c61f-4a13-ad3b-4eb2efe35ebf tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90fd174040>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:33.003370 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ab5e7526-c61f-4a13-ad3b-4eb2efe35ebf tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1642018893" status: 200 len: 513 microversion: 2.2 time: 0.025874 Sep 06 10:56:33.007993 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 756/1544] 10.222.0.20 () {60 vars in 1258 bytes} [Tue Sep 6 10:56:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1642018893 => generated 513 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:33.023925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-579276ab-f9a5-4006-ba0a-4de4772be68f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:33.023925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-579276ab-f9a5-4006-ba0a-4de4772be68f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:33.036504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-579276ab-f9a5-4006-ba0a-4de4772be68f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:33.037267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-12f9e06e-d7c1-4664-9ec1-f5e8e15bce6f tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90f3cff040>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:33.038516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-579276ab-f9a5-4006-ba0a-4de4772be68f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:33.040922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-579276ab-f9a5-4006-ba0a-4de4772be68f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:33.047679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-579276ab-f9a5-4006-ba0a-4de4772be68f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:33.050402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-579276ab-f9a5-4006-ba0a-4de4772be68f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:33.052495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-579276ab-f9a5-4006-ba0a-4de4772be68f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:33.061131 ncdv-master-1 devstack@n-api.service[140875]: WARNING oslo_db.sqlalchemy.utils [None req-12f9e06e-d7c1-4664-9ec1-f5e8e15bce6f tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 06 10:56:33.081817 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-12f9e06e-d7c1-4664-9ec1-f5e8e15bce6f tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.059301 Sep 06 10:56:33.089016 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 757/1545] 10.222.0.20 () {60 vars in 1177 bytes} [Tue Sep 6 10:56:33 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:33.094139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bc695f6b-164c-4c7d-8d3c-77d7cca85c38 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90fd1668b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:33.197782 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bc695f6b-164c-4c7d-8d3c-77d7cca85c38 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.107386 Sep 06 10:56:33.198654 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 758/1546] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:33 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:33.216706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cf5ca3a7-e368-48aa-9189-6d144fcc6f11 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90f3cffdc0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:33.292089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-579276ab-f9a5-4006-ba0a-4de4772be68f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:33.325557 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-579276ab-f9a5-4006-ba0a-4de4772be68f tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.318251 Sep 06 10:56:33.327060 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 789/1547] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:33 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:56:33.338049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0fc22abc-73f4-45a1-a15a-9ca5764b0c53 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:33.339901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0fc22abc-73f4-45a1-a15a-9ca5764b0c53 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:33.357033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fc22abc-73f4-45a1-a15a-9ca5764b0c53 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:33.359406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fc22abc-73f4-45a1-a15a-9ca5764b0c53 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:33.360715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fc22abc-73f4-45a1-a15a-9ca5764b0c53 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:33.363394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fc22abc-73f4-45a1-a15a-9ca5764b0c53 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:33.364394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fc22abc-73f4-45a1-a15a-9ca5764b0c53 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:33.365831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fc22abc-73f4-45a1-a15a-9ca5764b0c53 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:33.378933 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cf5ca3a7-e368-48aa-9189-6d144fcc6f11 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642018893" status: 204 len: 0 microversion: 2.2 time: 0.177236 Sep 06 10:56:33.385203 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 759/1548] 10.222.0.20 () {60 vars in 1261 bytes} [Tue Sep 6 10:56:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642018893 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:56:33.390875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f308da9a-ccf2-4fd3-ad0e-9d5bdaa868da tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Action: 'create', calling method: .version_select at 0x7f90fd174040>, body: {"keypair": {"name": "tempest-keypair-605139939", "type": "x509"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:33.436675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f308da9a-ccf2-4fd3-ad0e-9d5bdaa868da tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:33.450641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f308da9a-ccf2-4fd3-ad0e-9d5bdaa868da tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for user 6eae9e913f944ed4af0e4b95ff7fc8f7 and project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:33.469386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.processutils [None req-f308da9a-ccf2-4fd3-ad0e-9d5bdaa868da tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpbdcz4ogw/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpbdcz4ogw/temp.key -subj /CN=6eae9e913f944ed4af0e4b95ff7fc8f7 -extensions v3_req_client {{(pid=140875) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 06 10:56:33.612024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0fc22abc-73f4-45a1-a15a-9ca5764b0c53 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:33.638733 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0fc22abc-73f4-45a1-a15a-9ca5764b0c53 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1298 microversion: 2.1 time: 0.302129 Sep 06 10:56:33.638733 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 790/1549] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:33 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1298 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:34.115831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.processutils [None req-f308da9a-ccf2-4fd3-ad0e-9d5bdaa868da tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpbdcz4ogw/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpbdcz4ogw/temp.key -subj /CN=6eae9e913f944ed4af0e4b95ff7fc8f7 -extensions v3_req_client" returned: 0 in 0.645s {{(pid=140875) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 06 10:56:34.118219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.processutils [None req-f308da9a-ccf2-4fd3-ad0e-9d5bdaa868da tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpbdcz4ogw/temp.key -password pass: {{(pid=140875) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 06 10:56:34.215964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbfa950d-3182-491a-9c02-94558fb9fe5e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8be48b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:34.221531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.processutils [None req-f308da9a-ccf2-4fd3-ad0e-9d5bdaa868da tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpbdcz4ogw/temp.key -password pass:" returned: 0 in 0.103s {{(pid=140875) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 06 10:56:34.298365 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fbfa950d-3182-491a-9c02-94558fb9fe5e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.087257 Sep 06 10:56:34.310508 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 791/1550] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:34 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:34.357190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-14736cce-38a2-44f7-b6c8-4e4750c684ad tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:34.357844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-14736cce-38a2-44f7-b6c8-4e4750c684ad tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:34.369655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14736cce-38a2-44f7-b6c8-4e4750c684ad tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:34.370168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14736cce-38a2-44f7-b6c8-4e4750c684ad tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:34.370645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14736cce-38a2-44f7-b6c8-4e4750c684ad tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:34.371422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14736cce-38a2-44f7-b6c8-4e4750c684ad tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:34.371897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14736cce-38a2-44f7-b6c8-4e4750c684ad tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:34.372337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14736cce-38a2-44f7-b6c8-4e4750c684ad tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:34.439076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f308da9a-ccf2-4fd3-ad0e-9d5bdaa868da tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:34.459373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f308da9a-ccf2-4fd3-ad0e-9d5bdaa868da tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Getting quotas for user 6eae9e913f944ed4af0e4b95ff7fc8f7 and project 7cac31aec7f344608d2dcb2b9d392a88. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:34.497300 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f308da9a-ccf2-4fd3-ad0e-9d5bdaa868da tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.110799 Sep 06 10:56:34.498546 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 760/1551] 10.222.0.20 () {62 vars in 1198 bytes} [Tue Sep 6 10:56:33 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1113 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:56:34.520324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3cad7aa4-e5d6-4e59-894d-1fde50daf071 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90f3cffa60>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:34.558325 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3cad7aa4-e5d6-4e59-894d-1fde50daf071 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-605139939" status: 200 len: 1533 microversion: 2.2 time: 0.040183 Sep 06 10:56:34.559441 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 761/1552] 10.222.0.20 () {60 vars in 1255 bytes} [Tue Sep 6 10:56:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-605139939 => generated 1533 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:34.571411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a2c4ef3a-80b5-46b5-9156-4f51e941db39 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90fd181dc0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:34.578909 ncdv-master-1 devstack@n-api.service[140875]: WARNING oslo_db.sqlalchemy.utils [None req-a2c4ef3a-80b5-46b5-9156-4f51e941db39 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 06 10:56:34.601159 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a2c4ef3a-80b5-46b5-9156-4f51e941db39 tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.034116 Sep 06 10:56:34.604390 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 762/1553] 10.222.0.20 () {60 vars in 1177 bytes} [Tue Sep 6 10:56:34 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:34.616893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d7879569-cee5-462d-adf1-b2b213a3938f tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] Calling method '.version_select at 0x7f90f3dbc280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:34.631841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:34.699280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-14736cce-38a2-44f7-b6c8-4e4750c684ad tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:34.726543 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-14736cce-38a2-44f7-b6c8-4e4750c684ad tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.373299 Sep 06 10:56:34.727841 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 792/1554] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:34 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:56:34.734439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9fe31e70-fc90-4121-94e3-e68f1fab78dc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:34.736748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9fe31e70-fc90-4121-94e3-e68f1fab78dc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:34.744359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fe31e70-fc90-4121-94e3-e68f1fab78dc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:34.745126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fe31e70-fc90-4121-94e3-e68f1fab78dc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:34.746239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fe31e70-fc90-4121-94e3-e68f1fab78dc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:34.747167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fe31e70-fc90-4121-94e3-e68f1fab78dc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:34.747798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fe31e70-fc90-4121-94e3-e68f1fab78dc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:34.748397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fe31e70-fc90-4121-94e3-e68f1fab78dc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:34.827417 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d7879569-cee5-462d-adf1-b2b213a3938f tempest-KeyPairsV22TestJSON-168571164 tempest-KeyPairsV22TestJSON-168571164-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-605139939" status: 204 len: 0 microversion: 2.2 time: 0.214143 Sep 06 10:56:34.828646 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 763/1555] 10.222.0.20 () {60 vars in 1258 bytes} [Tue Sep 6 10:56:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-605139939 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:56:35.032260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9fe31e70-fc90-4121-94e3-e68f1fab78dc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:35.043275 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9fe31e70-fc90-4121-94e3-e68f1fab78dc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1365 microversion: 2.1 time: 0.314137 Sep 06 10:56:35.044564 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 793/1556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:34 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1365 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:35.330255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dd21268a-d82d-4c82-abf5-a83db9424e1b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f3dbc4c0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:35.423177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dd21268a-d82d-4c82-abf5-a83db9424e1b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.110101 Sep 06 10:56:35.424102 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 764/1557] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:35 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:35.774218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-78371dca-756e-4b07-826e-5a9ce76d257a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:35.775463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-78371dca-756e-4b07-826e-5a9ce76d257a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:35.785461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:35.808935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-78371dca-756e-4b07-826e-5a9ce76d257a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:35.810187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-78371dca-756e-4b07-826e-5a9ce76d257a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:35.812177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-78371dca-756e-4b07-826e-5a9ce76d257a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:35.814043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-78371dca-756e-4b07-826e-5a9ce76d257a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:35.815510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-78371dca-756e-4b07-826e-5a9ce76d257a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:35.816584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-78371dca-756e-4b07-826e-5a9ce76d257a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:35.965939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-78371dca-756e-4b07-826e-5a9ce76d257a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:36.025176 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-78371dca-756e-4b07-826e-5a9ce76d257a tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.255220 Sep 06 10:56:36.025762 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 794/1558] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:35 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:36.068836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e27cd20c-bc8b-401f-88c5-676b957bb262 req-87e9d4b7-a775-40c5-afd2-b080801103f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e343dd1a-4f3b-4da1-9396-5cdc5e1d297a", "tag": "985e3216-597b-4a07-9d39-3796d1f2a0b6"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:36.073710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba7c3116-fc5c-4506-a9af-88d0142c2360 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:36.073710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ba7c3116-fc5c-4506-a9af-88d0142c2360 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:36.079407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba7c3116-fc5c-4506-a9af-88d0142c2360 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:36.079907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba7c3116-fc5c-4506-a9af-88d0142c2360 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:36.080351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba7c3116-fc5c-4506-a9af-88d0142c2360 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:36.081073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba7c3116-fc5c-4506-a9af-88d0142c2360 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:36.081530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba7c3116-fc5c-4506-a9af-88d0142c2360 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:36.081962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba7c3116-fc5c-4506-a9af-88d0142c2360 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:36.091936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e27cd20c-bc8b-401f-88c5-676b957bb262 req-87e9d4b7-a775-40c5-afd2-b080801103f7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:36.095288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e27cd20c-bc8b-401f-88c5-676b957bb262 req-87e9d4b7-a775-40c5-afd2-b080801103f7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:36.100739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e27cd20c-bc8b-401f-88c5-676b957bb262 req-87e9d4b7-a775-40c5-afd2-b080801103f7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:36.138885 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e27cd20c-bc8b-401f-88c5-676b957bb262 req-87e9d4b7-a775-40c5-afd2-b080801103f7 service nova] Creating event network-changed:985e3216-597b-4a07-9d39-3796d1f2a0b6 for instance e343dd1a-4f3b-4da1-9396-5cdc5e1d297a on nch1-master-1 Sep 06 10:56:36.160367 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e27cd20c-bc8b-401f-88c5-676b957bb262 req-87e9d4b7-a775-40c5-afd2-b080801103f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120835 Sep 06 10:56:36.163056 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 765/1559] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:36.440084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bec9ba39-b106-4bc7-8821-5c81f71be3d3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90fd174280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:36.561463 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bec9ba39-b106-4bc7-8821-5c81f71be3d3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.125621 Sep 06 10:56:36.562877 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 766/1560] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:36 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:36.597932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ba7c3116-fc5c-4506-a9af-88d0142c2360 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:36.597932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:36.608987 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ba7c3116-fc5c-4506-a9af-88d0142c2360 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1365 microversion: 2.1 time: 0.542622 Sep 06 10:56:36.609461 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 795/1561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:36 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1365 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:37.080736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b7091ddc-cdf1-4ba0-839e-8a9cf69856ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:37.081589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b7091ddc-cdf1-4ba0-839e-8a9cf69856ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:37.133873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7091ddc-cdf1-4ba0-839e-8a9cf69856ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:37.134392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7091ddc-cdf1-4ba0-839e-8a9cf69856ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:37.134843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7091ddc-cdf1-4ba0-839e-8a9cf69856ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:37.139536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7091ddc-cdf1-4ba0-839e-8a9cf69856ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:37.140291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7091ddc-cdf1-4ba0-839e-8a9cf69856ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:37.140926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7091ddc-cdf1-4ba0-839e-8a9cf69856ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:37.279795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-b7091ddc-cdf1-4ba0-839e-8a9cf69856ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:37.329954 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b7091ddc-cdf1-4ba0-839e-8a9cf69856ec tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.270073 Sep 06 10:56:37.331365 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 767/1562] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:37 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:37.588302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d1dc2407-30b4-4500-b2ff-ebff78ac063f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f87961f0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:37.636776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff861115-44be-4f64-8293-7326f3208fa3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:37.638006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff861115-44be-4f64-8293-7326f3208fa3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:37.652517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff861115-44be-4f64-8293-7326f3208fa3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:37.654101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff861115-44be-4f64-8293-7326f3208fa3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:37.654559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff861115-44be-4f64-8293-7326f3208fa3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:37.655322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff861115-44be-4f64-8293-7326f3208fa3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:37.662014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff861115-44be-4f64-8293-7326f3208fa3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:37.662749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff861115-44be-4f64-8293-7326f3208fa3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:37.681076 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d1dc2407-30b4-4500-b2ff-ebff78ac063f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.099700 Sep 06 10:56:37.699457 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 796/1563] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:37 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:38.120014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff861115-44be-4f64-8293-7326f3208fa3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:38.131796 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff861115-44be-4f64-8293-7326f3208fa3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1365 microversion: 2.1 time: 0.497301 Sep 06 10:56:38.132938 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 768/1564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:37 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1365 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:38.375053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-09e2eea9-254b-4d99-891f-08b16cf960d7 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:38.377341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-09e2eea9-254b-4d99-891f-08b16cf960d7 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:38.391374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09e2eea9-254b-4d99-891f-08b16cf960d7 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:38.391895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09e2eea9-254b-4d99-891f-08b16cf960d7 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:38.394899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09e2eea9-254b-4d99-891f-08b16cf960d7 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:38.407776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09e2eea9-254b-4d99-891f-08b16cf960d7 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:38.409001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09e2eea9-254b-4d99-891f-08b16cf960d7 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:38.410050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09e2eea9-254b-4d99-891f-08b16cf960d7 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:38.716092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-81343121-467d-4d32-8b6d-41ff89ce3af4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90fd1743a0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:38.904813 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-81343121-467d-4d32-8b6d-41ff89ce3af4 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.188242 Sep 06 10:56:38.909402 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 769/1565] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:38 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:39.157321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bbee9eca-d9d8-4cbd-a764-53cb17331991 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:39.158345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bbee9eca-d9d8-4cbd-a764-53cb17331991 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:39.177957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bbee9eca-d9d8-4cbd-a764-53cb17331991 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:39.181275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bbee9eca-d9d8-4cbd-a764-53cb17331991 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:39.182034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bbee9eca-d9d8-4cbd-a764-53cb17331991 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:39.183117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bbee9eca-d9d8-4cbd-a764-53cb17331991 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:39.184584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bbee9eca-d9d8-4cbd-a764-53cb17331991 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:39.185831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bbee9eca-d9d8-4cbd-a764-53cb17331991 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:39.242170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-09e2eea9-254b-4d99-891f-08b16cf960d7 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:39.270512 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-09e2eea9-254b-4d99-891f-08b16cf960d7 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.902654 Sep 06 10:56:39.274714 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 797/1566] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:38 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:39.512988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bbee9eca-d9d8-4cbd-a764-53cb17331991 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:39.512988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:39.522367 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bbee9eca-d9d8-4cbd-a764-53cb17331991 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1365 microversion: 2.1 time: 0.367432 Sep 06 10:56:39.524616 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 770/1567] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:39 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1365 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:39.923506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5b5decce-e0f8-49eb-b4dc-0bbe27378676 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90fd117160>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:40.036217 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5b5decce-e0f8-49eb-b4dc-0bbe27378676 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.109125 Sep 06 10:56:40.036217 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 771/1568] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:39 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:40.316357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3b7ff3a1-530a-434e-834c-719333f4ea24 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:40.317347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3b7ff3a1-530a-434e-834c-719333f4ea24 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:40.372790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-890e782c-cd98-41d2-a0cb-d50a0bfae94d tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] Calling method '.version_select at 0x7f90f8be4670>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:40.373796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b7ff3a1-530a-434e-834c-719333f4ea24 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:40.373796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b7ff3a1-530a-434e-834c-719333f4ea24 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:40.373796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b7ff3a1-530a-434e-834c-719333f4ea24 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:40.373796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b7ff3a1-530a-434e-834c-719333f4ea24 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:40.374252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b7ff3a1-530a-434e-834c-719333f4ea24 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:40.374252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b7ff3a1-530a-434e-834c-719333f4ea24 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:40.374460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-890e782c-cd98-41d2-a0cb-d50a0bfae94d tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:40.374460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-890e782c-cd98-41d2-a0cb-d50a0bfae94d tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:40.374460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-890e782c-cd98-41d2-a0cb-d50a0bfae94d tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:40.374460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-890e782c-cd98-41d2-a0cb-d50a0bfae94d tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:40.374873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-890e782c-cd98-41d2-a0cb-d50a0bfae94d tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:40.374873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-890e782c-cd98-41d2-a0cb-d50a0bfae94d tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:40.395610 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-890e782c-cd98-41d2-a0cb-d50a0bfae94d tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.515972 Sep 06 10:56:40.399381 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 798/1569] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:39 2022] GET /compute/v2.1/limits => generated 511 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:40.478523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-3b7ff3a1-530a-434e-834c-719333f4ea24 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:40.483804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c1796973-f310-4772-ba46-6e961af07031 tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-268599163", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:40.524087 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3b7ff3a1-530a-434e-834c-719333f4ea24 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1925 microversion: 2.75 time: 0.217593 Sep 06 10:56:40.526840 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 772/1570] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:40 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1925 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:40.565078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-65d690ba-c910-4f93-ba2a-d08a13c45e3a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:40.565078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-65d690ba-c910-4f93-ba2a-d08a13c45e3a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:40.571928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65d690ba-c910-4f93-ba2a-d08a13c45e3a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:40.573307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65d690ba-c910-4f93-ba2a-d08a13c45e3a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:40.573831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65d690ba-c910-4f93-ba2a-d08a13c45e3a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:40.574645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65d690ba-c910-4f93-ba2a-d08a13c45e3a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:40.575357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65d690ba-c910-4f93-ba2a-d08a13c45e3a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:40.576000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65d690ba-c910-4f93-ba2a-d08a13c45e3a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:40.606407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-c1796973-f310-4772-ba46-6e961af07031 tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:56:40.869144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-65d690ba-c910-4f93-ba2a-d08a13c45e3a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:40.884800 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-65d690ba-c910-4f93-ba2a-d08a13c45e3a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1365 microversion: 2.1 time: 0.330542 Sep 06 10:56:40.899987 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 773/1571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:40 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:40.986850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-c1796973-f310-4772-ba46-6e961af07031 tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] Getting quotas for project 51221f48f93c438e917c85eeb8b38905. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:40.995439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-c1796973-f310-4772-ba46-6e961af07031 tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] Getting quotas for user f9e3d28d181b4097a4c98ecdeb55dba1 and project 51221f48f93c438e917c85eeb8b38905. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:41.020639 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-c1796973-f310-4772-ba46-6e961af07031 tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c1796973-f310-4772-ba46-6e961af07031 tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] Request method failure captured: Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 1751 Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFydnFGh4nD3TlZyjpnKRG41tKRoKcgkl4uYPtotTkJ0dxK7H_5I0yTOq_JRVazWlz1QCRA7YLcav1xffxZdPdXV35g8XkWLdgGAgptpMz1DtTlZN2g7IWNXazxkCB1w6hKgCThX5lVy7pXIDTYx5dXQsigiKHFkX_SQ0f_aaCgU66D4 Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 51221f48f93c438e917c85eeb8b38905 Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-800058934 Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_51221f48f93c438e917c85eeb8b38905"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/51221f48f93c438e917c85eeb8b38905"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/51221f48f93c438e917c85eeb8b38905"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/51221f48f93c438e917c85eeb8b38905"}]}] Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-800058934 Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 51221f48f93c438e917c85eeb8b38905 Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-800058934 Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-800058934-project Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: f9e3d28d181b4097a4c98ecdeb55dba1 Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-800058934-project Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-268599163", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:56:41.027155 ncdv-master-1 devstack@n-api.service[140876]: exception: Maximum number of metadata items exceeds 128 Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-268599163', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:56:41.033379 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c1796973-f310-4772-ba46-6e961af07031 tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:41.040457 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c1796973-f310-4772-ba46-6e961af07031 tempest-AbsoluteLimitsNegativeTestJSON-800058934 tempest-AbsoluteLimitsNegativeTestJSON-800058934-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.550104 Sep 06 10:56:41.042615 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 799/1572] 10.222.0.20 () {60 vars in 1148 bytes} [Tue Sep 6 10:56:40 2022] POST /compute/v2.1/servers => generated 87 bytes in 562 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:56:41.051101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0f5bec22-1cfd-4495-86aa-5c0e7856e9b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90fd174700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:41.149521 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0f5bec22-1cfd-4495-86aa-5c0e7856e9b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.108941 Sep 06 10:56:41.150291 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 774/1573] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:41 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:41.559516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9eaf1372-fdd2-4155-9dec-702a6f4df5b6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:41.561292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9eaf1372-fdd2-4155-9dec-702a6f4df5b6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:41.587599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eaf1372-fdd2-4155-9dec-702a6f4df5b6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:41.592464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eaf1372-fdd2-4155-9dec-702a6f4df5b6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:41.593922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eaf1372-fdd2-4155-9dec-702a6f4df5b6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:41.596354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eaf1372-fdd2-4155-9dec-702a6f4df5b6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:41.599850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eaf1372-fdd2-4155-9dec-702a6f4df5b6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:41.602589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eaf1372-fdd2-4155-9dec-702a6f4df5b6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:41.769932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-9eaf1372-fdd2-4155-9dec-702a6f4df5b6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:41.807883 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9eaf1372-fdd2-4155-9dec-702a6f4df5b6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1931 microversion: 2.75 time: 0.252534 Sep 06 10:56:41.825776 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 800/1574] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:41 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1931 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:41.915772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-25d93bde-97d5-4a89-8d05-b4e6fcdb6e8a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:41.917875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-25d93bde-97d5-4a89-8d05-b4e6fcdb6e8a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:41.932098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25d93bde-97d5-4a89-8d05-b4e6fcdb6e8a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:41.932696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25d93bde-97d5-4a89-8d05-b4e6fcdb6e8a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:41.933158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25d93bde-97d5-4a89-8d05-b4e6fcdb6e8a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:41.933908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25d93bde-97d5-4a89-8d05-b4e6fcdb6e8a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:41.934382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25d93bde-97d5-4a89-8d05-b4e6fcdb6e8a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:41.934856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25d93bde-97d5-4a89-8d05-b4e6fcdb6e8a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:42.119885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-25d93bde-97d5-4a89-8d05-b4e6fcdb6e8a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:42.142848 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-25d93bde-97d5-4a89-8d05-b4e6fcdb6e8a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1365 microversion: 2.1 time: 0.231575 Sep 06 10:56:42.142848 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 775/1575] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:41 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:42.178675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-30f53838-04b6-40a4-9780-8f02a34f310e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8796c10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:42.237643 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-30f53838-04b6-40a4-9780-8f02a34f310e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1437 microversion: 2.1 time: 0.071489 Sep 06 10:56:42.238218 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 801/1576] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:42 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1437 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:42.685389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2058727693", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "f8b11397-3914-4c86-9b8e-22614951152b"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:42.753462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] validate_networks() for [('f8b11397-3914-4c86-9b8e-22614951152b', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:56:42.842561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1d30f40c-4a02-4bc3-ac67-a82ca6c58ee0 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:42.843864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1d30f40c-4a02-4bc3-ac67-a82ca6c58ee0 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:42.852495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d30f40c-4a02-4bc3-ac67-a82ca6c58ee0 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:42.854148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d30f40c-4a02-4bc3-ac67-a82ca6c58ee0 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:42.856093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d30f40c-4a02-4bc3-ac67-a82ca6c58ee0 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:42.857344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d30f40c-4a02-4bc3-ac67-a82ca6c58ee0 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:42.859377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d30f40c-4a02-4bc3-ac67-a82ca6c58ee0 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:42.861871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d30f40c-4a02-4bc3-ac67-a82ca6c58ee0 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:43.023475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-1d30f40c-4a02-4bc3-ac67-a82ca6c58ee0 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:43.041632 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1d30f40c-4a02-4bc3-ac67-a82ca6c58ee0 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1931 microversion: 2.75 time: 0.205590 Sep 06 10:56:43.042213 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 802/1577] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:42 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1931 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:43.162624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b6217e3d-99f0-4ce2-9a46-06b14928024a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:43.170955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b6217e3d-99f0-4ce2-9a46-06b14928024a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:43.170955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6217e3d-99f0-4ce2-9a46-06b14928024a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:43.171601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6217e3d-99f0-4ce2-9a46-06b14928024a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:43.172045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6217e3d-99f0-4ce2-9a46-06b14928024a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:43.172944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6217e3d-99f0-4ce2-9a46-06b14928024a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:43.173775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6217e3d-99f0-4ce2-9a46-06b14928024a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:43.174352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6217e3d-99f0-4ce2-9a46-06b14928024a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:43.429570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b6217e3d-99f0-4ce2-9a46-06b14928024a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:43.439879 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b6217e3d-99f0-4ce2-9a46-06b14928024a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1365 microversion: 2.1 time: 0.281536 Sep 06 10:56:43.460586 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 803/1578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:43 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1365 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:43.475701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9719fad4-7eda-4b0c-9d5d-e3bda0ccdee0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90fd131820>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:43.539537 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9719fad4-7eda-4b0c-9d5d-e3bda0ccdee0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1446 microversion: 2.1 time: 0.075296 Sep 06 10:56:43.540546 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 804/1579] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:43 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1446 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:43.558986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bf5c66e9-0abd-47d9-bc0a-133a32f8376a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8a2ab80>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:43.562341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:56:43.563243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:56:43.563810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:56:43.564458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:56:43.568544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:56:43.601133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:43.601633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:43.602087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:43.602846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:43.603343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:43.603787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:43.642277 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bf5c66e9-0abd-47d9-bc0a-133a32f8376a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 200 len: 1446 microversion: 2.1 time: 0.090534 Sep 06 10:56:43.643377 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 805/1580] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:43 2022] GET /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:43.665164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-863fe22c-0b58-4582-b913-c5350bb27001 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8d44c10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:43.669016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Getting quotas for project 0bce1bf271594425ad60e24f40b3b60d. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:43.681542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Getting quotas for user 2d0621ebe85c47c383137b4db0814279 and project 0bce1bf271594425ad60e24f40b3b60d. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:43.695588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:56:43.697896 ncdv-master-1 devstack@n-api.service[140875]: WARNING nova.utils [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2058727693 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-205872769 Sep 06 10:56:43.698824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:56:43.860789 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d0bf48d7-6687-4887-af6b-5b8cb45632ba tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.570194 Sep 06 10:56:43.865302 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 776/1581] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:56:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:56:43.871533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-40a37023-03ad-4adb-9834-1c04f95f65f7 req-9328336b-2670-4fc5-b277-264e56951a96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e343dd1a-4f3b-4da1-9396-5cdc5e1d297a", "name": "network-vif-plugged", "status": "completed", "tag": "985e3216-597b-4a07-9d39-3796d1f2a0b6"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:43.897957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-40a37023-03ad-4adb-9834-1c04f95f65f7 req-9328336b-2670-4fc5-b277-264e56951a96 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:43.898750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-40a37023-03ad-4adb-9834-1c04f95f65f7 req-9328336b-2670-4fc5-b277-264e56951a96 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:43.899453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-40a37023-03ad-4adb-9834-1c04f95f65f7 req-9328336b-2670-4fc5-b277-264e56951a96 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:43.918294 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-40a37023-03ad-4adb-9834-1c04f95f65f7 req-9328336b-2670-4fc5-b277-264e56951a96 service nova] Creating event network-vif-plugged:985e3216-597b-4a07-9d39-3796d1f2a0b6 for instance e343dd1a-4f3b-4da1-9396-5cdc5e1d297a on nch1-master-1 Sep 06 10:56:43.945220 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-40a37023-03ad-4adb-9834-1c04f95f65f7 req-9328336b-2670-4fc5-b277-264e56951a96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078494 Sep 06 10:56:43.948773 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 777/1582] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:43.955992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5c3deb52-ee75-4a25-ba7d-e0be9030cd42 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:43.956980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5c3deb52-ee75-4a25-ba7d-e0be9030cd42 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:44.034772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5c3deb52-ee75-4a25-ba7d-e0be9030cd42 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:44.044769 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5c3deb52-ee75-4a25-ba7d-e0be9030cd42 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1232 microversion: 2.1 time: 0.094255 Sep 06 10:56:44.050517 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 778/1583] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:43 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1232 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:44.073210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-06ad2913-f329-4ea7-913a-366e5faab2c6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:44.079248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-06ad2913-f329-4ea7-913a-366e5faab2c6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:44.093215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06ad2913-f329-4ea7-913a-366e5faab2c6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:44.095673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06ad2913-f329-4ea7-913a-366e5faab2c6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:44.096443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06ad2913-f329-4ea7-913a-366e5faab2c6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:44.097408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06ad2913-f329-4ea7-913a-366e5faab2c6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:44.098606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06ad2913-f329-4ea7-913a-366e5faab2c6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:44.100061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06ad2913-f329-4ea7-913a-366e5faab2c6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:44.214933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-06ad2913-f329-4ea7-913a-366e5faab2c6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] Lazy-loading 'services' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:44.230818 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-06ad2913-f329-4ea7-913a-366e5faab2c6 tempest-ServersAdmin275Test-1487139880 tempest-ServersAdmin275Test-1487139880-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1916 microversion: 2.75 time: 0.162521 Sep 06 10:56:44.239970 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 779/1584] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:44 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1916 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:44.274234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bfb24919-841c-40d6-b784-b055afb5b4d9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:44.274625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bfb24919-841c-40d6-b784-b055afb5b4d9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:44.292609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bfb24919-841c-40d6-b784-b055afb5b4d9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:44.295141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bfb24919-841c-40d6-b784-b055afb5b4d9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:44.295141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bfb24919-841c-40d6-b784-b055afb5b4d9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:44.301349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bfb24919-841c-40d6-b784-b055afb5b4d9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:44.301852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bfb24919-841c-40d6-b784-b055afb5b4d9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:44.302350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bfb24919-841c-40d6-b784-b055afb5b4d9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:44.339397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bfb24919-841c-40d6-b784-b055afb5b4d9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:56:44.898360 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bfb24919-841c-40d6-b784-b055afb5b4d9 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "DELETE /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 204 len: 0 microversion: 2.75 time: 0.627213 Sep 06 10:56:44.898360 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 780/1585] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 10:56:44 2022] DELETE /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 10:56:44.901545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-28fb20b7-a15d-44bb-95a0-68c0fe315e31 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:44.902426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-28fb20b7-a15d-44bb-95a0-68c0fe315e31 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:44.909821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28fb20b7-a15d-44bb-95a0-68c0fe315e31 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:44.910458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28fb20b7-a15d-44bb-95a0-68c0fe315e31 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:44.911031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28fb20b7-a15d-44bb-95a0-68c0fe315e31 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:44.911998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28fb20b7-a15d-44bb-95a0-68c0fe315e31 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:44.912571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28fb20b7-a15d-44bb-95a0-68c0fe315e31 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:44.913619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28fb20b7-a15d-44bb-95a0-68c0fe315e31 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:45.260482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-28fb20b7-a15d-44bb-95a0-68c0fe315e31 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:45.267681 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-28fb20b7-a15d-44bb-95a0-68c0fe315e31 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1365 microversion: 2.1 time: 0.371768 Sep 06 10:56:45.268283 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 781/1586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:44 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1365 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:45.282448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e5c38683-7d19-474e-b313-5a20cb57ace6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:45.283097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e5c38683-7d19-474e-b313-5a20cb57ace6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:45.290953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5c38683-7d19-474e-b313-5a20cb57ace6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:45.296187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5c38683-7d19-474e-b313-5a20cb57ace6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:45.296187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5c38683-7d19-474e-b313-5a20cb57ace6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:45.296187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5c38683-7d19-474e-b313-5a20cb57ace6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:45.296187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5c38683-7d19-474e-b313-5a20cb57ace6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:45.296187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5c38683-7d19-474e-b313-5a20cb57ace6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:45.410612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e5c38683-7d19-474e-b313-5a20cb57ace6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:45.420461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e5c38683-7d19-474e-b313-5a20cb57ace6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:45.424200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e5c38683-7d19-474e-b313-5a20cb57ace6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:45.427713 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e5c38683-7d19-474e-b313-5a20cb57ace6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1442 microversion: 2.75 time: 0.158461 Sep 06 10:56:45.428268 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 782/1587] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:45 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:45.432759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-be8d3b1e-cde3-43a6-9879-0105bdb9901a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:45.433436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-be8d3b1e-cde3-43a6-9879-0105bdb9901a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:45.489799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-be8d3b1e-cde3-43a6-9879-0105bdb9901a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:45.496778 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-be8d3b1e-cde3-43a6-9879-0105bdb9901a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1232 microversion: 2.1 time: 0.067543 Sep 06 10:56:45.498806 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 783/1588] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:45 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1232 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:45.964168 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-863fe22c-0b58-4582-b913-c5350bb27001 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 204 len: 0 microversion: 2.1 time: 2.304229 Sep 06 10:56:45.964168 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 806/1589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:43 2022] DELETE /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 0 bytes in 2306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:56:45.971396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff6e5160-c5ee-4357-b817-a93c6c9a1b99 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:45.971990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff6e5160-c5ee-4357-b817-a93c6c9a1b99 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:45.979779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff6e5160-c5ee-4357-b817-a93c6c9a1b99 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:45.980365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff6e5160-c5ee-4357-b817-a93c6c9a1b99 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:45.981009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff6e5160-c5ee-4357-b817-a93c6c9a1b99 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:45.981774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff6e5160-c5ee-4357-b817-a93c6c9a1b99 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:45.982313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff6e5160-c5ee-4357-b817-a93c6c9a1b99 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:45.982821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff6e5160-c5ee-4357-b817-a93c6c9a1b99 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:46.012376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff6e5160-c5ee-4357-b817-a93c6c9a1b99 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:56:46.298220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a365fbbc-ed64-4b63-817c-51d27db8685a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:46.299588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a365fbbc-ed64-4b63-817c-51d27db8685a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:46.308698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a365fbbc-ed64-4b63-817c-51d27db8685a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:46.310261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a365fbbc-ed64-4b63-817c-51d27db8685a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:46.310815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a365fbbc-ed64-4b63-817c-51d27db8685a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:46.313504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a365fbbc-ed64-4b63-817c-51d27db8685a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:46.314288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a365fbbc-ed64-4b63-817c-51d27db8685a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:46.315095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a365fbbc-ed64-4b63-817c-51d27db8685a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:46.514154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a365fbbc-ed64-4b63-817c-51d27db8685a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:46.520733 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff6e5160-c5ee-4357-b817-a93c6c9a1b99 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 204 len: 0 microversion: 2.1 time: 0.554629 Sep 06 10:56:46.523104 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 784/1590] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:56:45 2022] DELETE /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:56:46.535155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1a91b734-bbfe-457e-8174-f83e3987acc6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:46.535155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1a91b734-bbfe-457e-8174-f83e3987acc6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:46.540791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a91b734-bbfe-457e-8174-f83e3987acc6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:46.543564 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a365fbbc-ed64-4b63-817c-51d27db8685a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1555 microversion: 2.1 time: 0.250401 Sep 06 10:56:46.544172 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 807/1591] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:46 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1555 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:46.553995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-00d24017-0bca-40c8-82c9-77d88e7e6583 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:46.559735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-00d24017-0bca-40c8-82c9-77d88e7e6583 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:46.564586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00d24017-0bca-40c8-82c9-77d88e7e6583 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:46.565354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00d24017-0bca-40c8-82c9-77d88e7e6583 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:46.565980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00d24017-0bca-40c8-82c9-77d88e7e6583 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:46.566858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00d24017-0bca-40c8-82c9-77d88e7e6583 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:46.568240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00d24017-0bca-40c8-82c9-77d88e7e6583 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:46.569101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00d24017-0bca-40c8-82c9-77d88e7e6583 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:46.576990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a91b734-bbfe-457e-8174-f83e3987acc6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:46.577897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a91b734-bbfe-457e-8174-f83e3987acc6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:46.579251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a91b734-bbfe-457e-8174-f83e3987acc6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:46.588580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a91b734-bbfe-457e-8174-f83e3987acc6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:46.594442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a91b734-bbfe-457e-8174-f83e3987acc6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:46.740063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-00d24017-0bca-40c8-82c9-77d88e7e6583 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:46.750883 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-00d24017-0bca-40c8-82c9-77d88e7e6583 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1236 microversion: 2.1 time: 0.205471 Sep 06 10:56:46.767089 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 808/1592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:46 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1236 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:46.770236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cdc99e6a-da2b-46d6-9647-213cd6d459ab tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:46.771698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cdc99e6a-da2b-46d6-9647-213cd6d459ab tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:46.780668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cdc99e6a-da2b-46d6-9647-213cd6d459ab tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:46.781174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cdc99e6a-da2b-46d6-9647-213cd6d459ab tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:46.781622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cdc99e6a-da2b-46d6-9647-213cd6d459ab tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:46.782345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cdc99e6a-da2b-46d6-9647-213cd6d459ab tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:46.782807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cdc99e6a-da2b-46d6-9647-213cd6d459ab tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:46.783267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cdc99e6a-da2b-46d6-9647-213cd6d459ab tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:46.832711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1a91b734-bbfe-457e-8174-f83e3987acc6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:46.843090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1a91b734-bbfe-457e-8174-f83e3987acc6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:46.844697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1a91b734-bbfe-457e-8174-f83e3987acc6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:46.851730 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1a91b734-bbfe-457e-8174-f83e3987acc6 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1442 microversion: 2.75 time: 0.324807 Sep 06 10:56:46.866543 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 785/1593] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:46 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1442 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:46.880033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1975956863", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "8c7b67ff-233f-4a9e-acc5-cc1f60baf7c8"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:46.913514 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cdc99e6a-da2b-46d6-9647-213cd6d459ab tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148555 Sep 06 10:56:46.916044 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 809/1594] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 10:56:46 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:46.968343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] validate_networks() for [('8c7b67ff-233f-4a9e-acc5-cc1f60baf7c8', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:56:47.782417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-70d05ad5-e416-4ec7-9ac5-0618ad983ae4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:47.783180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-70d05ad5-e416-4ec7-9ac5-0618ad983ae4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:47.796776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70d05ad5-e416-4ec7-9ac5-0618ad983ae4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:47.797411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70d05ad5-e416-4ec7-9ac5-0618ad983ae4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:47.798479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70d05ad5-e416-4ec7-9ac5-0618ad983ae4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:47.799315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70d05ad5-e416-4ec7-9ac5-0618ad983ae4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:47.799855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70d05ad5-e416-4ec7-9ac5-0618ad983ae4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:47.800528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70d05ad5-e416-4ec7-9ac5-0618ad983ae4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:47.923335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:56:47.923897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:56:47.924314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:56:47.924745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:56:47.925319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:56:47.942034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:47.942587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:47.957217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:47.959728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:47.963334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:47.964018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:48.038514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Getting quotas for project e047ab9362dc476c9a4b4aee7223d042. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:56:48.048466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Getting quotas for user d79046739b2d4572b0aedef59e621ab8 and project e047ab9362dc476c9a4b4aee7223d042. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:56:48.086277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:56:48.088798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:56:48.205797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-70d05ad5-e416-4ec7-9ac5-0618ad983ae4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:48.227917 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-70d05ad5-e416-4ec7-9ac5-0618ad983ae4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1284 microversion: 2.1 time: 0.449053 Sep 06 10:56:48.227917 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 810/1595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:47 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1284 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:48.242797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:48.243721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:48.250755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:48.251648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:48.252325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:48.253319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:48.254013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:48.254944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:48.295300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:48.296126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:48.296572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:48.297206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lazy-loading 'fault' on Instance uuid 45859999-f828-413f-8c7d-440483e0d1db {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:56:48.372218 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-989ad850-dc47-4842-8a5b-4d37221bbc3e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.500283 Sep 06 10:56:48.373803 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 786/1596] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:56:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:56:48.384484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-5d668402-fa20-420e-adeb-686be06a04fd req-d24dacde-b5bc-43fe-9f3c-be6e5d4e0150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937289ab-8f49-410a-8477-7f970832616f", "name": "network-vif-unplugged", "status": "completed", "tag": "bbc270c7-beb0-4db6-9d50-0a3fe6996886"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:48.405815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5d668402-fa20-420e-adeb-686be06a04fd req-d24dacde-b5bc-43fe-9f3c-be6e5d4e0150 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:48.412578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5d668402-fa20-420e-adeb-686be06a04fd req-d24dacde-b5bc-43fe-9f3c-be6e5d4e0150 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:48.413318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5d668402-fa20-420e-adeb-686be06a04fd req-d24dacde-b5bc-43fe-9f3c-be6e5d4e0150 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:48.459831 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5d668402-fa20-420e-adeb-686be06a04fd req-d24dacde-b5bc-43fe-9f3c-be6e5d4e0150 service nova] Creating event network-vif-unplugged:bbc270c7-beb0-4db6-9d50-0a3fe6996886 for instance 937289ab-8f49-410a-8477-7f970832616f on nch1-master-1 Sep 06 10:56:48.472411 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-5d668402-fa20-420e-adeb-686be06a04fd req-d24dacde-b5bc-43fe-9f3c-be6e5d4e0150 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097006 Sep 06 10:56:48.473042 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 787/1597] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:48.490112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-707ebebe-47ff-4b19-8933-cbe32e7da0f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:48.493005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-707ebebe-47ff-4b19-8933-cbe32e7da0f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:48.534285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:48.545707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:48.548847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3803365807284dee8e89eae93945fc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c261994fe8c4d0a8b4ff35f26896dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:48.564031 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c9d9dfad-bd9f-4efb-bb47-66a6ab2a2928 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 200 len: 1447 microversion: 2.75 time: 0.335934 Sep 06 10:56:48.564630 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 811/1598] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:48 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 1447 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:56:48.639674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-707ebebe-47ff-4b19-8933-cbe32e7da0f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:48.649705 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-707ebebe-47ff-4b19-8933-cbe32e7da0f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1208 microversion: 2.1 time: 0.173529 Sep 06 10:56:48.669080 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 788/1599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:48 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1208 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:49.254047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5d22f206-1ec5-470b-a0a7-8beab0faaa14 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:49.255106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5d22f206-1ec5-470b-a0a7-8beab0faaa14 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:49.267526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d22f206-1ec5-470b-a0a7-8beab0faaa14 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:49.268361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d22f206-1ec5-470b-a0a7-8beab0faaa14 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:49.269004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d22f206-1ec5-470b-a0a7-8beab0faaa14 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:49.271493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d22f206-1ec5-470b-a0a7-8beab0faaa14 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:49.271493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d22f206-1ec5-470b-a0a7-8beab0faaa14 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:49.272073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d22f206-1ec5-470b-a0a7-8beab0faaa14 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:49.407686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5d22f206-1ec5-470b-a0a7-8beab0faaa14 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:49.419771 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5d22f206-1ec5-470b-a0a7-8beab0faaa14 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1302 microversion: 2.1 time: 0.170696 Sep 06 10:56:49.434748 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 812/1600] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:49 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1302 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:49.606108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ef7b27a5-d356-4739-b318-b745cd8f9d83 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:49.606822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ef7b27a5-d356-4739-b318-b745cd8f9d83 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] [instance: 45859999-f828-413f-8c7d-440483e0d1db] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:49.610394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:49.620585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef7b27a5-d356-4739-b318-b745cd8f9d83 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:49.621439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef7b27a5-d356-4739-b318-b745cd8f9d83 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:49.622145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef7b27a5-d356-4739-b318-b745cd8f9d83 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:49.623445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef7b27a5-d356-4739-b318-b745cd8f9d83 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:49.624164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef7b27a5-d356-4739-b318-b745cd8f9d83 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:49.624847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef7b27a5-d356-4739-b318-b745cd8f9d83 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:49.640019 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-ef7b27a5-d356-4739-b318-b745cd8f9d83 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] HTTP exception thrown: Instance 45859999-f828-413f-8c7d-440483e0d1db could not be found. Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ef7b27a5-d356-4739-b318-b745cd8f9d83 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Request method failure captured: Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db HTTP/1.1 Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFycbrKLOUCZCkRhmmRp9I-ypWT5jvW_prip1LBPXQ5w__HkurAtWh6pMNZ8s0VCbq6bgFn9skjpwx4EFEWojC3bfik681ndJIDnnBi2FImuAVtgLF5anTjkITd2T_VehynnBBvUKlw6e3UgVGHibKuK6C0fxuBKgXauoLviGFp06v1I Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.75 Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0c261994fe8c4d0a8b4ff35f26896dcc Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersAdmin275Test-932870357 Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0c261994fe8c4d0a8b4ff35f26896dcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0c261994fe8c4d0a8b4ff35f26896dcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0c261994fe8c4d0a8b4ff35f26896dcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0c261994fe8c4d0a8b4ff35f26896dcc"}]}] Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersAdmin275Test-932870357 Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0c261994fe8c4d0a8b4ff35f26896dcc Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersAdmin275Test-932870357 Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersAdmin275Test-932870357-project Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3803365807284dee8e89eae93945fc9b Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersAdmin275Test-932870357-project Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 45859999-f828-413f-8c7d-440483e0d1db could not be found. Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '45859999-f828-413f-8c7d-440483e0d1db'} Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45859999-f828-413f-8c7d-440483e0d1db could not be found. Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45859999-f828-413f-8c7d-440483e0d1db could not be found. Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:49.642198 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:49.647953 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:49.647953 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:49.647953 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:49.647953 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:56:49.647953 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:56:49.647953 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45859999-f828-413f-8c7d-440483e0d1db could not be found. Sep 06 10:56:49.647953 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:49.647953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ef7b27a5-d356-4739-b318-b745cd8f9d83 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] Returning 404 to user: Instance 45859999-f828-413f-8c7d-440483e0d1db could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:49.649175 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ef7b27a5-d356-4739-b318-b745cd8f9d83 tempest-ServersAdmin275Test-932870357 tempest-ServersAdmin275Test-932870357-project] 10.222.0.20 "GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db" status: 404 len: 111 microversion: 2.75 time: 0.046408 Sep 06 10:56:49.652846 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 789/1601] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:56:49 2022] GET /compute/v2.1/servers/45859999-f828-413f-8c7d-440483e0d1db => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:56:49.679597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-61d13c52-124a-4cdf-b0ee-65b24b3a1274 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:49.680279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-61d13c52-124a-4cdf-b0ee-65b24b3a1274 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:49.691343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-feedfe3d-4482-448f-bcbb-a30681b2e0c4 req-9bead2b5-706b-4ec6-a422-94e37ee7f26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e343dd1a-4f3b-4da1-9396-5cdc5e1d297a", "tag": "985e3216-597b-4a07-9d39-3796d1f2a0b6"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:49.712932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-feedfe3d-4482-448f-bcbb-a30681b2e0c4 req-9bead2b5-706b-4ec6-a422-94e37ee7f26a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:49.713727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-feedfe3d-4482-448f-bcbb-a30681b2e0c4 req-9bead2b5-706b-4ec6-a422-94e37ee7f26a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:49.714368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-feedfe3d-4482-448f-bcbb-a30681b2e0c4 req-9bead2b5-706b-4ec6-a422-94e37ee7f26a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:49.729322 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-feedfe3d-4482-448f-bcbb-a30681b2e0c4 req-9bead2b5-706b-4ec6-a422-94e37ee7f26a service nova] Creating event network-changed:985e3216-597b-4a07-9d39-3796d1f2a0b6 for instance e343dd1a-4f3b-4da1-9396-5cdc5e1d297a on nch1-master-1 Sep 06 10:56:49.735795 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-feedfe3d-4482-448f-bcbb-a30681b2e0c4 req-9bead2b5-706b-4ec6-a422-94e37ee7f26a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052557 Sep 06 10:56:49.736968 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 790/1602] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:56:49.836187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-61d13c52-124a-4cdf-b0ee-65b24b3a1274 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:49.855414 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-61d13c52-124a-4cdf-b0ee-65b24b3a1274 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1208 microversion: 2.1 time: 0.179696 Sep 06 10:56:49.855414 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 813/1603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:49 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1208 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:50.480798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-29453127-ef24-4eb2-bea7-9e8397e709d4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:50.482220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-29453127-ef24-4eb2-bea7-9e8397e709d4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:50.498381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29453127-ef24-4eb2-bea7-9e8397e709d4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:50.498381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29453127-ef24-4eb2-bea7-9e8397e709d4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:50.498381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29453127-ef24-4eb2-bea7-9e8397e709d4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:50.498381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29453127-ef24-4eb2-bea7-9e8397e709d4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:50.498381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29453127-ef24-4eb2-bea7-9e8397e709d4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:50.498381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29453127-ef24-4eb2-bea7-9e8397e709d4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:50.873746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d84e4489-4a43-4615-8150-3130ed4a9b90 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:50.874381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d84e4489-4a43-4615-8150-3130ed4a9b90 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:50.882776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:50.886734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d84e4489-4a43-4615-8150-3130ed4a9b90 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:50.887359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d84e4489-4a43-4615-8150-3130ed4a9b90 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:50.887719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d84e4489-4a43-4615-8150-3130ed4a9b90 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:50.893999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d84e4489-4a43-4615-8150-3130ed4a9b90 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:50.894527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d84e4489-4a43-4615-8150-3130ed4a9b90 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:50.894993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d84e4489-4a43-4615-8150-3130ed4a9b90 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:51.049621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-29453127-ef24-4eb2-bea7-9e8397e709d4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:51.054666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d84e4489-4a43-4615-8150-3130ed4a9b90 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:51.060372 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-29453127-ef24-4eb2-bea7-9e8397e709d4 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1290 microversion: 2.1 time: 0.615193 Sep 06 10:56:51.065195 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d84e4489-4a43-4615-8150-3130ed4a9b90 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1204 microversion: 2.1 time: 0.195371 Sep 06 10:56:51.065902 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 791/1604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:50 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1290 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:51.066773 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 814/1605] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:50 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1204 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:51.774616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a0b1bf96-ad89-489c-9db2-2f45b65191f0 req-5a5aab2e-5560-450e-8e92-41153bd92de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937289ab-8f49-410a-8477-7f970832616f", "name": "network-vif-deleted", "tag": "bbc270c7-beb0-4db6-9d50-0a3fe6996886"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:51.800727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a0b1bf96-ad89-489c-9db2-2f45b65191f0 req-5a5aab2e-5560-450e-8e92-41153bd92de3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:51.801479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a0b1bf96-ad89-489c-9db2-2f45b65191f0 req-5a5aab2e-5560-450e-8e92-41153bd92de3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:51.803367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a0b1bf96-ad89-489c-9db2-2f45b65191f0 req-5a5aab2e-5560-450e-8e92-41153bd92de3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:51.838614 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a0b1bf96-ad89-489c-9db2-2f45b65191f0 req-5a5aab2e-5560-450e-8e92-41153bd92de3 service nova] Creating event network-vif-deleted:bbc270c7-beb0-4db6-9d50-0a3fe6996886 for instance 937289ab-8f49-410a-8477-7f970832616f on nch1-master-1 Sep 06 10:56:51.851289 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a0b1bf96-ad89-489c-9db2-2f45b65191f0 req-5a5aab2e-5560-450e-8e92-41153bd92de3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083545 Sep 06 10:56:51.863040 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 792/1606] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:52.102060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cc360854-2516-4311-895f-9cf40603b8ab tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:52.102801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a84de028-431c-4055-aaf6-dff6441bd97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:52.103997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a84de028-431c-4055-aaf6-dff6441bd97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:52.105258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cc360854-2516-4311-895f-9cf40603b8ab tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:52.115471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc360854-2516-4311-895f-9cf40603b8ab tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:52.117002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc360854-2516-4311-895f-9cf40603b8ab tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:52.122319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a84de028-431c-4055-aaf6-dff6441bd97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:52.122319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a84de028-431c-4055-aaf6-dff6441bd97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:52.122319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a84de028-431c-4055-aaf6-dff6441bd97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:52.123142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a84de028-431c-4055-aaf6-dff6441bd97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:52.123778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a84de028-431c-4055-aaf6-dff6441bd97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:52.124313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a84de028-431c-4055-aaf6-dff6441bd97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:52.137460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc360854-2516-4311-895f-9cf40603b8ab tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:52.139434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc360854-2516-4311-895f-9cf40603b8ab tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:52.141646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc360854-2516-4311-895f-9cf40603b8ab tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:52.145378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc360854-2516-4311-895f-9cf40603b8ab tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:52.183570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:52.371370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a84de028-431c-4055-aaf6-dff6441bd97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:52.379975 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a84de028-431c-4055-aaf6-dff6441bd97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1268 microversion: 2.1 time: 0.288272 Sep 06 10:56:52.380771 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 815/1607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:52 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1268 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:52.865939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cc360854-2516-4311-895f-9cf40603b8ab tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:52.877502 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cc360854-2516-4311-895f-9cf40603b8ab tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1332 microversion: 2.1 time: 0.786236 Sep 06 10:56:52.886994 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 793/1608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:52 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1332 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:53.404210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e59591d9-721d-4c44-8d5b-99b0d5a596ad tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:53.405436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e59591d9-721d-4c44-8d5b-99b0d5a596ad tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:53.414113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e59591d9-721d-4c44-8d5b-99b0d5a596ad tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:53.418212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e59591d9-721d-4c44-8d5b-99b0d5a596ad tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:53.418667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e59591d9-721d-4c44-8d5b-99b0d5a596ad tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:53.419761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e59591d9-721d-4c44-8d5b-99b0d5a596ad tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:53.420493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e59591d9-721d-4c44-8d5b-99b0d5a596ad tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:53.425983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e59591d9-721d-4c44-8d5b-99b0d5a596ad tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:53.564778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e59591d9-721d-4c44-8d5b-99b0d5a596ad tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:53.576659 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e59591d9-721d-4c44-8d5b-99b0d5a596ad tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1266 microversion: 2.1 time: 0.176267 Sep 06 10:56:53.578378 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 816/1609] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:53 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:53.913713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8ebc091a-f87b-4c9d-8b82-c4dc39f0d3ae tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:53.913713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8ebc091a-f87b-4c9d-8b82-c4dc39f0d3ae tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:53.931620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ebc091a-f87b-4c9d-8b82-c4dc39f0d3ae tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:53.932141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ebc091a-f87b-4c9d-8b82-c4dc39f0d3ae tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:53.941612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ebc091a-f87b-4c9d-8b82-c4dc39f0d3ae tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:53.941612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ebc091a-f87b-4c9d-8b82-c4dc39f0d3ae tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:53.941612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ebc091a-f87b-4c9d-8b82-c4dc39f0d3ae tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:53.941612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ebc091a-f87b-4c9d-8b82-c4dc39f0d3ae tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:54.212641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8ebc091a-f87b-4c9d-8b82-c4dc39f0d3ae tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:54.221526 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8ebc091a-f87b-4c9d-8b82-c4dc39f0d3ae tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1332 microversion: 2.1 time: 0.321051 Sep 06 10:56:54.222122 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 794/1610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:53 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1332 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:54.359266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-26ee114b-527c-47a2-9196-082d1f78939f req-664a4b03-e8f0-44cf-8cad-41943090b4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a5d8f6-b223-4a68-850d-680fe295ae59", "tag": "cecb333e-7d2a-422c-8560-93edb6898e73"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:54.390729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-26ee114b-527c-47a2-9196-082d1f78939f req-664a4b03-e8f0-44cf-8cad-41943090b4e4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:54.394162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-26ee114b-527c-47a2-9196-082d1f78939f req-664a4b03-e8f0-44cf-8cad-41943090b4e4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:54.394935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-26ee114b-527c-47a2-9196-082d1f78939f req-664a4b03-e8f0-44cf-8cad-41943090b4e4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:54.428066 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-26ee114b-527c-47a2-9196-082d1f78939f req-664a4b03-e8f0-44cf-8cad-41943090b4e4 service nova] Creating event network-changed:cecb333e-7d2a-422c-8560-93edb6898e73 for instance 15a5d8f6-b223-4a68-850d-680fe295ae59 on nch2-master-1 Sep 06 10:56:54.437190 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-26ee114b-527c-47a2-9196-082d1f78939f req-664a4b03-e8f0-44cf-8cad-41943090b4e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085106 Sep 06 10:56:54.438387 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 817/1611] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:56:54.612858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cf434594-7f99-4efe-aff0-5a63f65b73e2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:54.613872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cf434594-7f99-4efe-aff0-5a63f65b73e2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:54.627663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf434594-7f99-4efe-aff0-5a63f65b73e2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:54.629499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf434594-7f99-4efe-aff0-5a63f65b73e2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:54.630820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf434594-7f99-4efe-aff0-5a63f65b73e2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:54.633351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf434594-7f99-4efe-aff0-5a63f65b73e2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:54.634490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf434594-7f99-4efe-aff0-5a63f65b73e2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:54.635243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf434594-7f99-4efe-aff0-5a63f65b73e2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:55.249542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c08b9d3d-46b1-48e3-af3d-78a7ed29b5ce tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:55.250544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c08b9d3d-46b1-48e3-af3d-78a7ed29b5ce tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:55.264667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c08b9d3d-46b1-48e3-af3d-78a7ed29b5ce tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:55.267428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c08b9d3d-46b1-48e3-af3d-78a7ed29b5ce tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:55.269243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c08b9d3d-46b1-48e3-af3d-78a7ed29b5ce tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:55.272611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c08b9d3d-46b1-48e3-af3d-78a7ed29b5ce tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:55.273732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c08b9d3d-46b1-48e3-af3d-78a7ed29b5ce tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:55.275241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c08b9d3d-46b1-48e3-af3d-78a7ed29b5ce tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:55.416509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cf434594-7f99-4efe-aff0-5a63f65b73e2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:55.428218 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cf434594-7f99-4efe-aff0-5a63f65b73e2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1308 microversion: 2.1 time: 0.828280 Sep 06 10:56:55.441265 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 795/1612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:54 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1308 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:55.672779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-354e9f31-3c75-463c-97b5-1eb960988c38 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:55.691466 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-354e9f31-3c75-463c-97b5-1eb960988c38 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.248795 Sep 06 10:56:55.693429 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 796/1613] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:56:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:55.713037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60ca6081-ccf7-4b48-bb40-003abecb27d1 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:55.743940 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-60ca6081-ccf7-4b48-bb40-003abecb27d1 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.039522 Sep 06 10:56:55.745198 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 797/1614] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 10:56:55 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:55.761034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1978fe66-e240-4536-97dd-598387f8513a tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:55.770217 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1978fe66-e240-4536-97dd-598387f8513a tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013186 Sep 06 10:56:55.771422 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 798/1615] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:56:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:55.784655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dc8366d8-acb7-45a5-99b0-f4c30e9f0f42 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:55.794238 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dc8366d8-acb7-45a5-99b0-f4c30e9f0f42 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013344 Sep 06 10:56:55.794837 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 799/1616] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:56:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:56:55.809224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ce7188df-78c2-4032-98e2-bd76da22fdac tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:55.817299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c08b9d3d-46b1-48e3-af3d-78a7ed29b5ce tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:55.839482 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c08b9d3d-46b1-48e3-af3d-78a7ed29b5ce tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1332 microversion: 2.1 time: 0.597237 Sep 06 10:56:55.843406 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 818/1617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:55 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1332 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:55.858045 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ce7188df-78c2-4032-98e2-bd76da22fdac tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.053905 Sep 06 10:56:55.867241 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 800/1618] 10.222.0.20 () {58 vars in 1165 bytes} [Tue Sep 6 10:56:55 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:55.882769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-050c1ed4-9b3a-464d-a3f7-8641013a3575 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:55.891071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:55.913460 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-050c1ed4-9b3a-464d-a3f7-8641013a3575 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026383 Sep 06 10:56:55.924276 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 819/1619] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:56:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:55.929732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2cfd2dda-da6a-4607-aecd-5c96a1286438 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.004953 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2cfd2dda-da6a-4607-aecd-5c96a1286438 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.071276 Sep 06 10:56:56.004953 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 801/1620] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Sep 6 10:56:55 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:56.020896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f3493880-49bf-4d0a-9145-06cbfe47e3c7 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.036981 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f3493880-49bf-4d0a-9145-06cbfe47e3c7 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.020094 Sep 06 10:56:56.038062 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 820/1621] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:56.054858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8b216661-1132-464e-8f26-7b592f4886bb tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.101018 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8b216661-1132-464e-8f26-7b592f4886bb tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.050520 Sep 06 10:56:56.102225 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 802/1622] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:56.115195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-87ca7c33-c771-4c48-beda-121e89adeec0 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.204007 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-87ca7c33-c771-4c48-beda-121e89adeec0 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.093099 Sep 06 10:56:56.204702 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 821/1623] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:56.222735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2a94a3fb-8048-47ad-9976-6c7b0ea111e9 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.238222 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2a94a3fb-8048-47ad-9976-6c7b0ea111e9 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019560 Sep 06 10:56:56.248338 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 803/1624] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:56.253616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e9e6fb0f-2033-4a5d-820c-40930570a959 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.336589 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e9e6fb0f-2033-4a5d-820c-40930570a959 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.087824 Sep 06 10:56:56.338301 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 822/1625] 10.222.0.20 () {58 vars in 1144 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:56.353951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-180e25af-6c59-40e4-9580-808cd619c9a2 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.373364 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-180e25af-6c59-40e4-9580-808cd619c9a2 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023377 Sep 06 10:56:56.375217 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 804/1626] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:56.388683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-288850b0-a738-4b2f-b746-06d50e6c5977 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.452546 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-288850b0-a738-4b2f-b746-06d50e6c5977 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.068912 Sep 06 10:56:56.468932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-557a55ca-5eef-4cb2-83f6-cc355ad48199 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.468932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-557a55ca-5eef-4cb2-83f6-cc355ad48199 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:56.469709 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 823/1627] 10.222.0.20 () {58 vars in 1148 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:56.469799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-557a55ca-5eef-4cb2-83f6-cc355ad48199 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:56.469799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-557a55ca-5eef-4cb2-83f6-cc355ad48199 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:56.469799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-557a55ca-5eef-4cb2-83f6-cc355ad48199 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:56.469799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-557a55ca-5eef-4cb2-83f6-cc355ad48199 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:56.474617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-557a55ca-5eef-4cb2-83f6-cc355ad48199 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:56.475133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-557a55ca-5eef-4cb2-83f6-cc355ad48199 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:56.492917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ab3601a2-6e62-4f6f-9e43-c19ad043c000 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.523886 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ab3601a2-6e62-4f6f-9e43-c19ad043c000 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.037783 Sep 06 10:56:56.540396 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 824/1628] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:56.562375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9d85154a-c6fe-433d-ad8a-7146d98940e2 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.576987 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9d85154a-c6fe-433d-ad8a-7146d98940e2 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026336 Sep 06 10:56:56.577845 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 825/1629] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:56.601465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-75e57ecf-9dc9-4467-bd7d-05c915c11b93 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.640610 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-75e57ecf-9dc9-4467-bd7d-05c915c11b93 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.052050 Sep 06 10:56:56.645444 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 826/1630] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:56.660631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5f3bd300-2a75-47d6-a585-6abbf8114ea7 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.689666 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5f3bd300-2a75-47d6-a585-6abbf8114ea7 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034031 Sep 06 10:56:56.709388 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 827/1631] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:56.714958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d085e668-7c37-423a-b2bd-ddc2825581d8 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.726337 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d085e668-7c37-423a-b2bd-ddc2825581d8 tempest-FlavorsV2TestJSON-400209575 tempest-FlavorsV2TestJSON-400209575-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015446 Sep 06 10:56:56.727339 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 828/1632] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:56:56.868153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2774062a-53ba-4e7a-939a-b5a2072a671a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:56.868892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2774062a-53ba-4e7a-939a-b5a2072a671a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:56.893093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2774062a-53ba-4e7a-939a-b5a2072a671a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:56.893908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2774062a-53ba-4e7a-939a-b5a2072a671a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:56.894455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2774062a-53ba-4e7a-939a-b5a2072a671a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:56.895392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2774062a-53ba-4e7a-939a-b5a2072a671a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:56.895969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2774062a-53ba-4e7a-939a-b5a2072a671a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:56.900694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2774062a-53ba-4e7a-939a-b5a2072a671a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:57.006691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-557a55ca-5eef-4cb2-83f6-cc355ad48199 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:57.021466 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-557a55ca-5eef-4cb2-83f6-cc355ad48199 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1308 microversion: 2.1 time: 0.570662 Sep 06 10:56:57.027693 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 805/1633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1308 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:57.341800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2774062a-53ba-4e7a-939a-b5a2072a671a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:57.347864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:57.354807 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2774062a-53ba-4e7a-939a-b5a2072a671a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1332 microversion: 2.1 time: 0.489577 Sep 06 10:56:57.354807 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 829/1634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:56 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1332 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:57.528081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-dbcca30b-2505-4bc2-9b13-4a80e877f515 req-ea396bab-a9b5-4332-8b7e-74b43e9bb2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d7d4ff-23fc-489c-ac1d-2806d273aaee", "tag": "6897d614-de4c-4743-8ed8-e00cec490776"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:57.553140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dbcca30b-2505-4bc2-9b13-4a80e877f515 req-ea396bab-a9b5-4332-8b7e-74b43e9bb2d6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:57.554628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dbcca30b-2505-4bc2-9b13-4a80e877f515 req-ea396bab-a9b5-4332-8b7e-74b43e9bb2d6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:57.555733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dbcca30b-2505-4bc2-9b13-4a80e877f515 req-ea396bab-a9b5-4332-8b7e-74b43e9bb2d6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:57.577966 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-dbcca30b-2505-4bc2-9b13-4a80e877f515 req-ea396bab-a9b5-4332-8b7e-74b43e9bb2d6 service nova] Creating event network-changed:6897d614-de4c-4743-8ed8-e00cec490776 for instance 93d7d4ff-23fc-489c-ac1d-2806d273aaee on nch2-master-1 Sep 06 10:56:57.583000 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-dbcca30b-2505-4bc2-9b13-4a80e877f515 req-ea396bab-a9b5-4332-8b7e-74b43e9bb2d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059736 Sep 06 10:56:57.583664 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 830/1635] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:56:57.790848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5e436a24-5451-47b5-9a0d-b208e5584d4d tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Action: 'create', calling method: .version_select at 0x7f90f3d8e820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1173332261", "description": "tempest-description-573387909"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:58.004595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:58.054368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3e348575-69d6-4e63-ae4b-478a9d5ba6a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:58.055192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3e348575-69d6-4e63-ae4b-478a9d5ba6a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:58.066002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e348575-69d6-4e63-ae4b-478a9d5ba6a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:58.066826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e348575-69d6-4e63-ae4b-478a9d5ba6a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:58.067419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e348575-69d6-4e63-ae4b-478a9d5ba6a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:58.068258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e348575-69d6-4e63-ae4b-478a9d5ba6a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:58.068809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e348575-69d6-4e63-ae4b-478a9d5ba6a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:58.069328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e348575-69d6-4e63-ae4b-478a9d5ba6a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:58.260421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3e348575-69d6-4e63-ae4b-478a9d5ba6a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:58.273569 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3e348575-69d6-4e63-ae4b-478a9d5ba6a9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1308 microversion: 2.1 time: 0.223393 Sep 06 10:56:58.274366 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 831/1636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:58 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1308 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:56:58.334062 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5e436a24-5451-47b5-9a0d-b208e5584d4d tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.004178 Sep 06 10:56:58.334062 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 806/1637] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:56:57 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:56:58.346840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4729498e-2038-47ec-8a1d-540fcb1860ed tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Action: 'create', calling method: .version_select at 0x7f90f8be4e50>, body: {"security_group_rule": {"parent_group_id": "7fe738fc-fd5c-4cb8-8246-80d27bdfc18d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:58.375842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-47f63fb8-1754-455f-88c5-deba2d536e5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:58.376466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-47f63fb8-1754-455f-88c5-deba2d536e5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:58.387183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47f63fb8-1754-455f-88c5-deba2d536e5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:58.387997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47f63fb8-1754-455f-88c5-deba2d536e5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:58.388607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47f63fb8-1754-455f-88c5-deba2d536e5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:58.389504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47f63fb8-1754-455f-88c5-deba2d536e5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:58.390137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47f63fb8-1754-455f-88c5-deba2d536e5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:58.390727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47f63fb8-1754-455f-88c5-deba2d536e5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:58.646780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=40 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:58.724253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-47f63fb8-1754-455f-88c5-deba2d536e5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:58.736456 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-47f63fb8-1754-455f-88c5-deba2d536e5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1332 microversion: 2.1 time: 0.364455 Sep 06 10:56:58.738872 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 807/1638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:58 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1332 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:59.173927 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4729498e-2038-47ec-8a1d-540fcb1860ed tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.833438 Sep 06 10:56:59.175131 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 832/1639] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 10:56:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:56:59.188428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ccf5e96b-0c70-45b0-ada3-c904a69b4bdc tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Action: 'create', calling method: .version_select at 0x7f90f3cff160>, body: {"security_group_rule": {"parent_group_id": "7fe738fc-fd5c-4cb8-8246-80d27bdfc18d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:59.283486 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-ccf5e96b-0c70-45b0-ada3-c904a69b4bdc tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] HTTP exception thrown: This rule already exists in group 7fe738fc-fd5c-4cb8-8246-80d27bdfc18d Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ccf5e96b-0c70-45b0-ada3-c904a69b4bdc tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Request method failure captured: Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 138 Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyd5p_NaJZCWNDhTvSW_kSQuWk_piKuDcsfE_iK4ZweI5yj4QmRBm_R9jy6GaSjFn529D792IhbkMAgvXht6sEe1FEhRmvuQL_MF69zJeecWHIP8Wv4pfHnZKFmB2gD904m5H0vMKo9QzDzOL59yW4f6fp9yP0W94yS0e5JoWw7m00I Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}] Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d267ab5434dc4119b770fb853f199112 Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: {"security_group_rule": {"parent_group_id": "7fe738fc-fd5c-4cb8-8246-80d27bdfc18d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: exception: This rule already exists in group 7fe738fc-fd5c-4cb8-8246-80d27bdfc18d Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7fe738fc-fd5c-4cb8-8246-80d27bdfc18d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 7fe738fc-fd5c-4cb8-8246-80d27bdfc18d Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 7fe738fc-fd5c-4cb8-8246-80d27bdfc18d Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:56:59.304219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:56:59.314848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:56:59.314848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:56:59.314848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 7fe738fc-fd5c-4cb8-8246-80d27bdfc18d Sep 06 10:56:59.314848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:56:59.314848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ccf5e96b-0c70-45b0-ada3-c904a69b4bdc tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Returning 400 to user: This rule already exists in group 7fe738fc-fd5c-4cb8-8246-80d27bdfc18d {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:56:59.314848 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ccf5e96b-0c70-45b0-ada3-c904a69b4bdc tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.117003 Sep 06 10:56:59.316935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-043807e2-c276-4166-a5ba-025360b4f383 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:59.317051 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 808/1640] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 10:56:59 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:56:59.317729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-043807e2-c276-4166-a5ba-025360b4f383 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:59.320295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1fa08331-24e3-4f50-9fa8-2caba86d9210 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Calling method '.version_select at 0x7f90fd160430>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:59.328063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-043807e2-c276-4166-a5ba-025360b4f383 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:59.329302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-043807e2-c276-4166-a5ba-025360b4f383 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:59.329853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-043807e2-c276-4166-a5ba-025360b4f383 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:59.332712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-043807e2-c276-4166-a5ba-025360b4f383 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:59.335816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-043807e2-c276-4166-a5ba-025360b4f383 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:59.336893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-043807e2-c276-4166-a5ba-025360b4f383 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:59.602505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-043807e2-c276-4166-a5ba-025360b4f383 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:56:59.614184 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-043807e2-c276-4166-a5ba-025360b4f383 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1308 microversion: 2.1 time: 0.320017 Sep 06 10:56:59.614966 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 833/1641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:59 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1308 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:56:59.746813 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1fa08331-24e3-4f50-9fa8-2caba86d9210 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/02228886-c584-4fd0-ba5c-379795f6963a" status: 202 len: 0 microversion: 2.1 time: 0.437950 Sep 06 10:56:59.749873 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 809/1642] 10.222.0.20 () {58 vars in 1287 bytes} [Tue Sep 6 10:56:59 2022] DELETE /compute/v2.1/os-security-group-rules/02228886-c584-4fd0-ba5c-379795f6963a => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:56:59.761518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-af2d55ae-e21f-43d4-b901-b2ee87b02c6c tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:56:59.762319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-af2d55ae-e21f-43d4-b901-b2ee87b02c6c tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:56:59.762489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-682dfbaa-533c-47c4-96fc-c936f66eb4be tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Action: 'create', calling method: .version_select at 0x7f90f8be4dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-736471266", "description": "tempest-description-284425011"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:56:59.787359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af2d55ae-e21f-43d4-b901-b2ee87b02c6c tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:59.788107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af2d55ae-e21f-43d4-b901-b2ee87b02c6c tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:59.792062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af2d55ae-e21f-43d4-b901-b2ee87b02c6c tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:59.793118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af2d55ae-e21f-43d4-b901-b2ee87b02c6c tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:56:59.794120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af2d55ae-e21f-43d4-b901-b2ee87b02c6c tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:56:59.794924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af2d55ae-e21f-43d4-b901-b2ee87b02c6c tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:56:59.846675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=36 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:00.007896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af2d55ae-e21f-43d4-b901-b2ee87b02c6c tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:00.020913 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-af2d55ae-e21f-43d4-b901-b2ee87b02c6c tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1332 microversion: 2.1 time: 0.261015 Sep 06 10:57:00.022402 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 810/1643] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:59 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1332 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:57:00.345960 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-682dfbaa-533c-47c4-96fc-c936f66eb4be tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.588197 Sep 06 10:57:00.346887 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 834/1644] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:56:59 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:00.360984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fbadd2f7-0d37-40e3-950d-27b36284dd41 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Action: 'create', calling method: .version_select at 0x7f90fd160550>, body: {"security_group_rule": {"parent_group_id": "3557d6a4-eabd-438b-bd5e-504dbaea0a21", "ip_protocol": "tcp", "from_port": 9500624, "to_port": 22}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:00.456122 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-fbadd2f7-0d37-40e3-950d-27b36284dd41 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] HTTP exception thrown: Invalid port range 9500624:22. Former value cannot be greater than the later Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fbadd2f7-0d37-40e3-950d-27b36284dd41 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Request method failure captured: Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 143 Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyd5p_NaJZCWNDhTvSW_kSQuWk_piKuDcsfE_iK4ZweI5yj4QmRBm_R9jy6GaSjFn529D792IhbkMAgvXht6sEe1FEhRmvuQL_MF69zJeecWHIP8Wv4pfHnZKFmB2gD904m5H0vMKo9QzDzOL59yW4f6fp9yP0W94yS0e5JoWw7m00I Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}] Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d267ab5434dc4119b770fb853f199112 Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: {"security_group_rule": {"parent_group_id": "3557d6a4-eabd-438b-bd5e-504dbaea0a21", "ip_protocol": "tcp", "from_port": 9500624, "to_port": 22}} Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid port range 9500624:22. Former value cannot be greater than the later Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3557d6a4-eabd-438b-bd5e-504dbaea0a21', 'ip_protocol': 'tcp', 'from_port': 9500624, 'to_port': 22}}} Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 9500624:22. Former value cannot be greater than the later Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 9500624:22. Former value cannot be greater than the later Sep 06 10:57:00.460522 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:00.476960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:00.476960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:00.476960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:00.476960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:00.476960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:00.476960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:00.476960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:00.476960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 9500624:22. Former value cannot be greater than the later Sep 06 10:57:00.476960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:00.476960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fbadd2f7-0d37-40e3-950d-27b36284dd41 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Returning 400 to user: Invalid port range 9500624:22. Former value cannot be greater than the later {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:00.476960 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fbadd2f7-0d37-40e3-950d-27b36284dd41 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 120 microversion: 2.1 time: 0.107125 Sep 06 10:57:00.478892 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 811/1645] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 10:57:00 2022] POST /compute/v2.1/os-security-group-rules => generated 120 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:57:00.482044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d967121d-b9e2-4141-89c5-f7fa41e374c2 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Action: 'create', calling method: .version_select at 0x7f90fd10cdc0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-959322007", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:00.484112 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-d967121d-b9e2-4141-89c5-f7fa41e374c2 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] HTTP exception thrown: Security group id should be uuid Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d967121d-b9e2-4141-89c5-f7fa41e374c2 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Request method failure captured: Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 130 Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyd5p_NaJZCWNDhTvSW_kSQuWk_piKuDcsfE_iK4ZweI5yj4QmRBm_R9jy6GaSjFn529D792IhbkMAgvXht6sEe1FEhRmvuQL_MF69zJeecWHIP8Wv4pfHnZKFmB2gD904m5H0vMKo9QzDzOL59yW4f6fp9yP0W94yS0e5JoWw7m00I Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}] Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d267ab5434dc4119b770fb853f199112 Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-959322007", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: exception: Security group id should be uuid Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-959322007', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:00.486375 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:00.493977 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 06 10:57:00.493977 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:00.493977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d967121d-b9e2-4141-89c5-f7fa41e374c2 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Returning 400 to user: Security group id should be uuid {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:00.494255 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d967121d-b9e2-4141-89c5-f7fa41e374c2 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.016345 Sep 06 10:57:00.494795 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 835/1646] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 10:57:00 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 06 10:57:00.506613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1d4b7f3c-15ae-4a4d-bab1-239da18c75b3 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Action: 'create', calling method: .version_select at 0x7f90fd117280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2004757172", "description": "tempest-description-1815539766"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:00.640630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-96e30acb-0d87-41c1-94e8-6c15cee7f046 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:00.641250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-96e30acb-0d87-41c1-94e8-6c15cee7f046 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:00.649614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96e30acb-0d87-41c1-94e8-6c15cee7f046 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:00.650105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96e30acb-0d87-41c1-94e8-6c15cee7f046 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:00.650545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96e30acb-0d87-41c1-94e8-6c15cee7f046 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:00.651516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96e30acb-0d87-41c1-94e8-6c15cee7f046 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:00.651975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96e30acb-0d87-41c1-94e8-6c15cee7f046 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:00.652838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96e30acb-0d87-41c1-94e8-6c15cee7f046 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:00.851378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-96e30acb-0d87-41c1-94e8-6c15cee7f046 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:00.865737 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-96e30acb-0d87-41c1-94e8-6c15cee7f046 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1308 microversion: 2.1 time: 0.226750 Sep 06 10:57:00.866376 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 836/1647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:00 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1308 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:57:01.050352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9bb3632c-0add-4428-9d83-6a4256561330 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:01.052481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9bb3632c-0add-4428-9d83-6a4256561330 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:01.060542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bb3632c-0add-4428-9d83-6a4256561330 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:01.062476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bb3632c-0add-4428-9d83-6a4256561330 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:01.062476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bb3632c-0add-4428-9d83-6a4256561330 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:01.063587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bb3632c-0add-4428-9d83-6a4256561330 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:01.064245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bb3632c-0add-4428-9d83-6a4256561330 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:01.064859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bb3632c-0add-4428-9d83-6a4256561330 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:01.084433 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1d4b7f3c-15ae-4a4d-bab1-239da18c75b3 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.584205 Sep 06 10:57:01.085284 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 812/1648] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:57:00 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:01.098905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cae2d676-1f19-4ee7-bc6b-aa87154b1fce tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Action: 'create', calling method: .version_select at 0x7f90fd09b0d0>, body: {"security_group_rule": {"parent_group_id": "2c987040-8624-4123-8489-9f427a11f06c", "ip_protocol": "tempest-999-1502006033", "from_port": 22, "to_port": 22}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:01.219931 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-cae2d676-1f19-4ee7-bc6b-aa87154b1fce tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] HTTP exception thrown: Invalid IP protocol tempest-999-1502006033. Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cae2d676-1f19-4ee7-bc6b-aa87154b1fce tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Request method failure captured: Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 157 Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyd5p_NaJZCWNDhTvSW_kSQuWk_piKuDcsfE_iK4ZweI5yj4QmRBm_R9jy6GaSjFn529D792IhbkMAgvXht6sEe1FEhRmvuQL_MF69zJeecWHIP8Wv4pfHnZKFmB2gD904m5H0vMKo9QzDzOL59yW4f6fp9yP0W94yS0e5JoWw7m00I Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}] Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d267ab5434dc4119b770fb853f199112 Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: {"security_group_rule": {"parent_group_id": "2c987040-8624-4123-8489-9f427a11f06c", "ip_protocol": "tempest-999-1502006033", "from_port": 22, "to_port": 22}} Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid IP protocol tempest-999-1502006033. Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2c987040-8624-4123-8489-9f427a11f06c', 'ip_protocol': 'tempest-999-1502006033', 'from_port': 22, 'to_port': 22}}} Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1502006033. Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1502006033. Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:01.223489 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:01.233690 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:01.233690 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:01.233690 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:01.233690 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:01.233690 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:01.233690 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:01.233690 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1502006033. Sep 06 10:57:01.233690 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:01.236084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cae2d676-1f19-4ee7-bc6b-aa87154b1fce tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Returning 400 to user: Invalid IP protocol tempest-999-1502006033. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:01.237082 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cae2d676-1f19-4ee7-bc6b-aa87154b1fce tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.142714 Sep 06 10:57:01.237831 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 813/1649] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 10:57:01 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 06 10:57:01.252309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-05e71664-39fa-4a7f-8e51-189a26afdea3 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Action: 'create', calling method: .version_select at 0x7f90f3cbd0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1685092664", "description": "tempest-description-1324598564"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:01.276892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9bb3632c-0add-4428-9d83-6a4256561330 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:01.285485 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9bb3632c-0add-4428-9d83-6a4256561330 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1332 microversion: 2.1 time: 0.239630 Sep 06 10:57:01.287243 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 837/1650] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:01 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1332 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:01.838690 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-05e71664-39fa-4a7f-8e51-189a26afdea3 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.594423 Sep 06 10:57:01.846876 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 814/1651] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:57:01 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:57:01.852077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ffbfe82c-8b07-4a97-8686-0ae38006bbf1 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Action: 'create', calling method: .version_select at 0x7f90fd0893a0>, body: {"security_group_rule": {"parent_group_id": "92367201-e7db-4c85-9d4c-634bfd0ed1b0", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:01.890486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-83bf8583-8a8b-404b-9b47-50aad8a3c3f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:01.891444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-83bf8583-8a8b-404b-9b47-50aad8a3c3f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:01.902540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83bf8583-8a8b-404b-9b47-50aad8a3c3f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:01.903356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83bf8583-8a8b-404b-9b47-50aad8a3c3f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:01.904001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83bf8583-8a8b-404b-9b47-50aad8a3c3f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:01.908782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83bf8583-8a8b-404b-9b47-50aad8a3c3f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:01.908782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83bf8583-8a8b-404b-9b47-50aad8a3c3f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:01.908782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83bf8583-8a8b-404b-9b47-50aad8a3c3f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:01.960046 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-ffbfe82c-8b07-4a97-8686-0ae38006bbf1 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ffbfe82c-8b07-4a97-8686-0ae38006bbf1 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Request method failure captured: Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 138 Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyd5p_NaJZCWNDhTvSW_kSQuWk_piKuDcsfE_iK4ZweI5yj4QmRBm_R9jy6GaSjFn529D792IhbkMAgvXht6sEe1FEhRmvuQL_MF69zJeecWHIP8Wv4pfHnZKFmB2gD904m5H0vMKo9QzDzOL59yW4f6fp9yP0W94yS0e5JoWw7m00I Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}] Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d267ab5434dc4119b770fb853f199112 Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: {"security_group_rule": {"parent_group_id": "92367201-e7db-4c85-9d4c-634bfd0ed1b0", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'security_group_rule': {'parent_group_id': '92367201-e7db-4c85-9d4c-634bfd0ed1b0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 06 10:57:01.961596 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:01.966647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:01.966647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:01.966647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:01.966647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:01.966647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:01.966647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:01.966647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:01.966647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 06 10:57:01.966647 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:01.969059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ffbfe82c-8b07-4a97-8686-0ae38006bbf1 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:01.970117 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ffbfe82c-8b07-4a97-8686-0ae38006bbf1 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.122049 Sep 06 10:57:01.971265 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 838/1652] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 10:57:01 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 10:57:01.989728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6fa791fb-617b-4c84-826b-cf0417560542 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Action: 'create', calling method: .version_select at 0x7f90f8ab6430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-43807932", "description": "tempest-description-1497660049"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:02.134857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-83bf8583-8a8b-404b-9b47-50aad8a3c3f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:02.142730 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-83bf8583-8a8b-404b-9b47-50aad8a3c3f7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1308 microversion: 2.1 time: 0.256873 Sep 06 10:57:02.143349 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 815/1653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:01 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:57:02.149575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-dc89943f-b53e-48f5-97d6-334d7c220d70 req-35df2ddc-d5c3-42b4-ae94-4e805de95261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a5d8f6-b223-4a68-850d-680fe295ae59", "name": "network-vif-plugged", "status": "completed", "tag": "cecb333e-7d2a-422c-8560-93edb6898e73"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:02.158966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-dc89943f-b53e-48f5-97d6-334d7c220d70 req-35df2ddc-d5c3-42b4-ae94-4e805de95261 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:02.159536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-dc89943f-b53e-48f5-97d6-334d7c220d70 req-35df2ddc-d5c3-42b4-ae94-4e805de95261 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:02.159981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-dc89943f-b53e-48f5-97d6-334d7c220d70 req-35df2ddc-d5c3-42b4-ae94-4e805de95261 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:02.178990 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-dc89943f-b53e-48f5-97d6-334d7c220d70 req-35df2ddc-d5c3-42b4-ae94-4e805de95261 service nova] Creating event network-vif-plugged:cecb333e-7d2a-422c-8560-93edb6898e73 for instance 15a5d8f6-b223-4a68-850d-680fe295ae59 on nch2-master-1 Sep 06 10:57:02.188037 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-dc89943f-b53e-48f5-97d6-334d7c220d70 req-35df2ddc-d5c3-42b4-ae94-4e805de95261 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043107 Sep 06 10:57:02.188754 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 816/1654] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:02.309844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f534bda9-7354-4dff-a1d5-58298cf07cdb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:02.310590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f534bda9-7354-4dff-a1d5-58298cf07cdb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:02.316884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f534bda9-7354-4dff-a1d5-58298cf07cdb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:02.318579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f534bda9-7354-4dff-a1d5-58298cf07cdb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:02.319049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f534bda9-7354-4dff-a1d5-58298cf07cdb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:02.319758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f534bda9-7354-4dff-a1d5-58298cf07cdb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:02.320218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f534bda9-7354-4dff-a1d5-58298cf07cdb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:02.320646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f534bda9-7354-4dff-a1d5-58298cf07cdb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:02.532806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f534bda9-7354-4dff-a1d5-58298cf07cdb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:02.553155 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f534bda9-7354-4dff-a1d5-58298cf07cdb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1332 microversion: 2.1 time: 0.247591 Sep 06 10:57:02.568881 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 817/1655] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:02 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1332 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:57:02.569777 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6fa791fb-617b-4c84-826b-cf0417560542 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.585087 Sep 06 10:57:02.570751 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 839/1656] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:57:01 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:02.584507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9cb75691-d98e-4d4f-8fea-7c7302d9118c tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Action: 'create', calling method: .version_select at 0x7f90f3cbd160>, body: {"security_group_rule": {"parent_group_id": "372f44a4-becb-4aab-b338-5feb97580825", "ip_protocol": "tcp", "from_port": 22, "to_port": 1837422246}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:02.636204 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-9cb75691-d98e-4d4f-8fea-7c7302d9118c tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] HTTP exception thrown: Invalid port range 22:1837422246. Valid TCP ports should be between 1-65535 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9cb75691-d98e-4d4f-8fea-7c7302d9118c tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Request method failure captured: Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 146 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyd5p_NaJZCWNDhTvSW_kSQuWk_piKuDcsfE_iK4ZweI5yj4QmRBm_R9jy6GaSjFn529D792IhbkMAgvXht6sEe1FEhRmvuQL_MF69zJeecWHIP8Wv4pfHnZKFmB2gD904m5H0vMKo9QzDzOL59yW4f6fp9yP0W94yS0e5JoWw7m00I Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}] Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d267ab5434dc4119b770fb853f199112 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: {"security_group_rule": {"parent_group_id": "372f44a4-becb-4aab-b338-5feb97580825", "ip_protocol": "tcp", "from_port": 22, "to_port": 1837422246}} Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid port range 22:1837422246. Valid TCP ports should be between 1-65535 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'security_group_rule': {'parent_group_id': '372f44a4-becb-4aab-b338-5feb97580825', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1837422246}}} Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1837422246. Valid TCP ports should be between 1-65535 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1837422246. Valid TCP ports should be between 1-65535 Sep 06 10:57:02.637893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.642377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:02.642377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.642377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:02.642377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:02.642377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:02.642377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:02.642377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:02.642377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1837422246. Valid TCP ports should be between 1-65535 Sep 06 10:57:02.642377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.642377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9cb75691-d98e-4d4f-8fea-7c7302d9118c tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Returning 400 to user: Invalid port range 22:1837422246. Valid TCP ports should be between 1-65535 {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:02.642377 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9cb75691-d98e-4d4f-8fea-7c7302d9118c tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.059740 Sep 06 10:57:02.642377 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 818/1657] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 10:57:02 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 10:57:02.651267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a8052bdb-815d-4682-a448-64cac917edb9 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Action: 'create', calling method: .version_select at 0x7f90f8a2a700>, body: {"security_group_rule": {"parent_group_id": "7f7d4d7a-063c-49ca-a7bb-05018bf07ca6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:02.675226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-a8052bdb-815d-4682-a448-64cac917edb9 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f7d4d7a-063c-49ca-a7bb-05018bf07ca6 does not exist", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:57:02.675866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.security_group_api [None req-a8052bdb-815d-4682-a448-64cac917edb9 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Neutron security group 7f7d4d7a-063c-49ca-a7bb-05018bf07ca6 not found {{(pid=140876) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 10:57:02.676953 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-a8052bdb-815d-4682-a448-64cac917edb9 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] HTTP exception thrown: Security group 7f7d4d7a-063c-49ca-a7bb-05018bf07ca6 does not exist Sep 06 10:57:02.676953 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-60cf042b-a061-4591-a22a-598ffee9b29d'] Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a8052bdb-815d-4682-a448-64cac917edb9 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Request method failure captured: Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 138 Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyd5p_NaJZCWNDhTvSW_kSQuWk_piKuDcsfE_iK4ZweI5yj4QmRBm_R9jy6GaSjFn529D792IhbkMAgvXht6sEe1FEhRmvuQL_MF69zJeecWHIP8Wv4pfHnZKFmB2gD904m5H0vMKo9QzDzOL59yW4f6fp9yP0W94yS0e5JoWw7m00I Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}] Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d267ab5434dc4119b770fb853f199112 Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: {"security_group_rule": {"parent_group_id": "7f7d4d7a-063c-49ca-a7bb-05018bf07ca6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: exception: Security group 7f7d4d7a-063c-49ca-a7bb-05018bf07ca6 does not exist Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-60cf042b-a061-4591-a22a-598ffee9b29d'] Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7f7d4d7a-063c-49ca-a7bb-05018bf07ca6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:57:02.680316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f7d4d7a-063c-49ca-a7bb-05018bf07ca6 does not exist Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60cf042b-a061-4591-a22a-598ffee9b29d'] Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f7d4d7a-063c-49ca-a7bb-05018bf07ca6 does not exist Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60cf042b-a061-4591-a22a-598ffee9b29d'] Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f7d4d7a-063c-49ca-a7bb-05018bf07ca6 does not exist Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60cf042b-a061-4591-a22a-598ffee9b29d'] Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f7d4d7a-063c-49ca-a7bb-05018bf07ca6 does not exist Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60cf042b-a061-4591-a22a-598ffee9b29d'] Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a8052bdb-815d-4682-a448-64cac917edb9 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Returning 404 to user: Security group 7f7d4d7a-063c-49ca-a7bb-05018bf07ca6 does not exist Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-60cf042b-a061-4591-a22a-598ffee9b29d'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a8052bdb-815d-4682-a448-64cac917edb9 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.041950 Sep 06 10:57:02.692758 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 840/1658] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 10:57:02 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:57:02.701271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-616fcf6b-c700-48c1-8a1a-1c12c36b20d8 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Calling method '.version_select at 0x7f90fd117310>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:02.725723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG neutronclient.v2_0.client [None req-616fcf6b-c700-48c1-8a1a-1c12c36b20d8 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 6da20df9-6d71-4f85-b4d1-3d0398147256 does not exist", "detail": ""}} {{(pid=140875) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:57:02.726365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.security_group_api [None req-616fcf6b-c700-48c1-8a1a-1c12c36b20d8 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Neutron security group rule 6da20df9-6d71-4f85-b4d1-3d0398147256 not found {{(pid=140875) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 06 10:57:02.726917 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-616fcf6b-c700-48c1-8a1a-1c12c36b20d8 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] HTTP exception thrown: Security group rule 6da20df9-6d71-4f85-b4d1-3d0398147256 does not exist Sep 06 10:57:02.726917 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-5eb5cd6d-bb7a-4943-a1fe-ed64d1661cdb'] Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-616fcf6b-c700-48c1-8a1a-1c12c36b20d8 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Request method failure captured: Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/os-security-group-rules/6da20df9-6d71-4f85-b4d1-3d0398147256 HTTP/1.1 Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyd5p_NaJZCWNDhTvSW_kSQuWk_piKuDcsfE_iK4ZweI5yj4QmRBm_R9jy6GaSjFn529D792IhbkMAgvXht6sEe1FEhRmvuQL_MF69zJeecWHIP8Wv4pfHnZKFmB2gD904m5H0vMKo9QzDzOL59yW4f6fp9yP0W94yS0e5JoWw7m00I Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79ebbb3d4ce4d65ae47fb0afb9e7855"}]}] Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: c79ebbb3d4ce4d65ae47fb0afb9e7855 Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876 Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d267ab5434dc4119b770fb853f199112 Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-976987876-project Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: exception: Security group rule 6da20df9-6d71-4f85-b4d1-3d0398147256 does not exist Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-5eb5cd6d-bb7a-4943-a1fe-ed64d1661cdb'] Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '6da20df9-6d71-4f85-b4d1-3d0398147256'} Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:57:02.729147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 6da20df9-6d71-4f85-b4d1-3d0398147256 does not exist Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5eb5cd6d-bb7a-4943-a1fe-ed64d1661cdb'] Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 6da20df9-6d71-4f85-b4d1-3d0398147256 does not exist Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5eb5cd6d-bb7a-4943-a1fe-ed64d1661cdb'] Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 6da20df9-6d71-4f85-b4d1-3d0398147256 does not exist Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5eb5cd6d-bb7a-4943-a1fe-ed64d1661cdb'] Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 6da20df9-6d71-4f85-b4d1-3d0398147256 does not exist Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5eb5cd6d-bb7a-4943-a1fe-ed64d1661cdb'] Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-616fcf6b-c700-48c1-8a1a-1c12c36b20d8 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Returning 404 to user: Security group rule 6da20df9-6d71-4f85-b4d1-3d0398147256 does not exist Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-5eb5cd6d-bb7a-4943-a1fe-ed64d1661cdb'] {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-616fcf6b-c700-48c1-8a1a-1c12c36b20d8 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/6da20df9-6d71-4f85-b4d1-3d0398147256" status: 404 len: 199 microversion: 2.1 time: 0.033274 Sep 06 10:57:02.733808 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 819/1659] 10.222.0.20 () {58 vars in 1287 bytes} [Tue Sep 6 10:57:02 2022] DELETE /compute/v2.1/os-security-group-rules/6da20df9-6d71-4f85-b4d1-3d0398147256 => generated 199 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:57:02.750285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dc0045a3-8259-4645-8c37-70e17fd7c2aa tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Calling method '.version_select at 0x7f90f8ab6e50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:03.092972 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dc0045a3-8259-4645-8c37-70e17fd7c2aa tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/372f44a4-becb-4aab-b338-5feb97580825" status: 202 len: 0 microversion: 2.1 time: 0.356767 Sep 06 10:57:03.094372 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 841/1660] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:57:02 2022] DELETE /compute/v2.1/os-security-groups/372f44a4-becb-4aab-b338-5feb97580825 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:57:03.105854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4a31b72a-c413-49f4-8448-05d287d7c196 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Calling method '.version_select at 0x7f90fd182280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:03.174461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-37797d06-7bee-4656-a4de-8643a51c0708 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:03.175104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-37797d06-7bee-4656-a4de-8643a51c0708 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:03.189002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37797d06-7bee-4656-a4de-8643a51c0708 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:03.189002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37797d06-7bee-4656-a4de-8643a51c0708 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:03.189002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37797d06-7bee-4656-a4de-8643a51c0708 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:03.189002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37797d06-7bee-4656-a4de-8643a51c0708 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:03.189002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37797d06-7bee-4656-a4de-8643a51c0708 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:03.189497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37797d06-7bee-4656-a4de-8643a51c0708 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:03.414200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-37797d06-7bee-4656-a4de-8643a51c0708 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:03.422526 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-37797d06-7bee-4656-a4de-8643a51c0708 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1308 microversion: 2.1 time: 0.259029 Sep 06 10:57:03.423121 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 842/1661] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:03 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1308 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:03.494797 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4a31b72a-c413-49f4-8448-05d287d7c196 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/92367201-e7db-4c85-9d4c-634bfd0ed1b0" status: 202 len: 0 microversion: 2.1 time: 0.395199 Sep 06 10:57:03.496119 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 820/1662] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:57:03 2022] DELETE /compute/v2.1/os-security-groups/92367201-e7db-4c85-9d4c-634bfd0ed1b0 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:57:03.506084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0d4907a2-532a-448d-ae2c-6d52407b0e30 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Calling method '.version_select at 0x7f90fd07f310>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:03.580257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c00a0001-cff7-4216-a0c4-0c34e0fd2cbb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:03.580914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c00a0001-cff7-4216-a0c4-0c34e0fd2cbb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:03.592922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c00a0001-cff7-4216-a0c4-0c34e0fd2cbb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:03.594125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c00a0001-cff7-4216-a0c4-0c34e0fd2cbb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:03.594824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c00a0001-cff7-4216-a0c4-0c34e0fd2cbb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:03.595647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c00a0001-cff7-4216-a0c4-0c34e0fd2cbb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:03.596329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c00a0001-cff7-4216-a0c4-0c34e0fd2cbb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:03.596999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c00a0001-cff7-4216-a0c4-0c34e0fd2cbb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:04.099316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c00a0001-cff7-4216-a0c4-0c34e0fd2cbb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:04.110251 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c00a0001-cff7-4216-a0c4-0c34e0fd2cbb tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1332 microversion: 2.1 time: 0.536374 Sep 06 10:57:04.116695 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 821/1663] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:03 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1332 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:04.240739 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0d4907a2-532a-448d-ae2c-6d52407b0e30 tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2c987040-8624-4123-8489-9f427a11f06c" status: 202 len: 0 microversion: 2.1 time: 0.740325 Sep 06 10:57:04.242469 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 843/1664] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:57:03 2022] DELETE /compute/v2.1/os-security-groups/2c987040-8624-4123-8489-9f427a11f06c => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:57:04.254333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f04154f5-09c7-45e9-995f-19a989003e0c tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Calling method '.version_select at 0x7f90f3cbd040>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:04.445950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c2b6dcc-0d49-47af-bdd8-1c22b45a110b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:04.446574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8c2b6dcc-0d49-47af-bdd8-1c22b45a110b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:04.454359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c2b6dcc-0d49-47af-bdd8-1c22b45a110b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:04.460072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c2b6dcc-0d49-47af-bdd8-1c22b45a110b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:04.460732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c2b6dcc-0d49-47af-bdd8-1c22b45a110b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:04.461516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c2b6dcc-0d49-47af-bdd8-1c22b45a110b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:04.461996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c2b6dcc-0d49-47af-bdd8-1c22b45a110b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:04.462438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c2b6dcc-0d49-47af-bdd8-1c22b45a110b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:04.694786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8c2b6dcc-0d49-47af-bdd8-1c22b45a110b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:04.707427 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8c2b6dcc-0d49-47af-bdd8-1c22b45a110b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1308 microversion: 2.1 time: 0.264683 Sep 06 10:57:04.724743 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 844/1665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:04 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1308 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:04.771040 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f04154f5-09c7-45e9-995f-19a989003e0c tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/3557d6a4-eabd-438b-bd5e-504dbaea0a21" status: 202 len: 0 microversion: 2.1 time: 0.523314 Sep 06 10:57:04.771909 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 822/1666] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:57:04 2022] DELETE /compute/v2.1/os-security-groups/3557d6a4-eabd-438b-bd5e-504dbaea0a21 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:57:04.780102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2783cfd2-8c7d-4ac7-9643-99ccbb0d08bc tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] Calling method '.version_select at 0x7f90f89210d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:05.136278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f0ec1e1b-12ae-457b-82eb-6a1f01aade5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:05.138171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f0ec1e1b-12ae-457b-82eb-6a1f01aade5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:05.173458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0ec1e1b-12ae-457b-82eb-6a1f01aade5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:05.175174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0ec1e1b-12ae-457b-82eb-6a1f01aade5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:05.178084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0ec1e1b-12ae-457b-82eb-6a1f01aade5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:05.181902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0ec1e1b-12ae-457b-82eb-6a1f01aade5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:05.182688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0ec1e1b-12ae-457b-82eb-6a1f01aade5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:05.183408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0ec1e1b-12ae-457b-82eb-6a1f01aade5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:05.276489 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2783cfd2-8c7d-4ac7-9643-99ccbb0d08bc tempest-SecurityGroupRulesNegativeTestJSON-976987876 tempest-SecurityGroupRulesNegativeTestJSON-976987876-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/7fe738fc-fd5c-4cb8-8246-80d27bdfc18d" status: 202 len: 0 microversion: 2.1 time: 0.499888 Sep 06 10:57:05.280810 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 845/1667] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:57:04 2022] DELETE /compute/v2.1/os-security-groups/7fe738fc-fd5c-4cb8-8246-80d27bdfc18d => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 10:57:05.445636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f0ec1e1b-12ae-457b-82eb-6a1f01aade5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:05.460220 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f0ec1e1b-12ae-457b-82eb-6a1f01aade5a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1536 microversion: 2.1 time: 0.329561 Sep 06 10:57:05.461527 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 823/1668] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:05 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1536 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:05.486039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f3eb8229-9e6b-4e3e-a5b2-37ce452bcede tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Action: 'create', calling method: .version_select at 0x7f90f8b901f0>, body: {"pool": "e41669ad-0ff0-4d70-8973-15677f96420c"} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:05.751304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c5c68a76-9550-479c-94e4-28dca391abfa tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:05.753051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c5c68a76-9550-479c-94e4-28dca391abfa tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:05.774224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5c68a76-9550-479c-94e4-28dca391abfa tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:05.774812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5c68a76-9550-479c-94e4-28dca391abfa tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:05.775878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5c68a76-9550-479c-94e4-28dca391abfa tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:05.778108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5c68a76-9550-479c-94e4-28dca391abfa tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:05.778670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5c68a76-9550-479c-94e4-28dca391abfa tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:05.779939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5c68a76-9550-479c-94e4-28dca391abfa tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:06.102315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c5c68a76-9550-479c-94e4-28dca391abfa tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:06.113869 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c5c68a76-9550-479c-94e4-28dca391abfa tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1308 microversion: 2.1 time: 0.384660 Sep 06 10:57:06.114694 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 824/1669] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:05 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1308 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:07.143354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e02bdc78-59df-4df4-8660-838a70f851f2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:07.144216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e02bdc78-59df-4df4-8660-838a70f851f2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:07.159934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e02bdc78-59df-4df4-8660-838a70f851f2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:07.160442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e02bdc78-59df-4df4-8660-838a70f851f2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:07.163799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e02bdc78-59df-4df4-8660-838a70f851f2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:07.164609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e02bdc78-59df-4df4-8660-838a70f851f2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:07.167996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e02bdc78-59df-4df4-8660-838a70f851f2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:07.168527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e02bdc78-59df-4df4-8660-838a70f851f2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:07.604676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e02bdc78-59df-4df4-8660-838a70f851f2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:07.616741 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e02bdc78-59df-4df4-8660-838a70f851f2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1308 microversion: 2.1 time: 0.478640 Sep 06 10:57:07.617235 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 825/1670] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:07 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1308 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:57:08.215968 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f3eb8229-9e6b-4e3e-a5b2-37ce452bcede tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.659257 Sep 06 10:57:08.215968 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 846/1671] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Sep 6 10:57:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:08.217884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.139"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:08.217884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:08.217884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:08.217884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:08.217884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:08.217884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:08.217884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:08.217884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:08.224766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-5c46e44f-6961-4e46-afd3-8d9b7fcb3562 req-4cf7f356-681f-4bd8-b721-2ea42001efa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d7d4ff-23fc-489c-ac1d-2806d273aaee", "name": "network-vif-plugged", "status": "completed", "tag": "6897d614-de4c-4743-8ed8-e00cec490776"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:08.260879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "refresh_cache-15a5d8f6-b223-4a68-850d-680fe295ae59" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 10:57:08.260879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquired lock "refresh_cache-15a5d8f6-b223-4a68-850d-680fe295ae59" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 10:57:08.261938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5c46e44f-6961-4e46-afd3-8d9b7fcb3562 req-4cf7f356-681f-4bd8-b721-2ea42001efa3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:08.261938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5c46e44f-6961-4e46-afd3-8d9b7fcb3562 req-4cf7f356-681f-4bd8-b721-2ea42001efa3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:08.261938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5c46e44f-6961-4e46-afd3-8d9b7fcb3562 req-4cf7f356-681f-4bd8-b721-2ea42001efa3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:08.273657 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-5c46e44f-6961-4e46-afd3-8d9b7fcb3562 req-4cf7f356-681f-4bd8-b721-2ea42001efa3 service nova] Creating event network-vif-plugged:6897d614-de4c-4743-8ed8-e00cec490776 for instance 93d7d4ff-23fc-489c-ac1d-2806d273aaee on nch2-master-1 Sep 06 10:57:08.281738 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-5c46e44f-6961-4e46-afd3-8d9b7fcb3562 req-4cf7f356-681f-4bd8-b721-2ea42001efa3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061033 Sep 06 10:57:08.282363 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 847/1672] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:08.642379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-777192a3-e339-4be7-9ec4-438a72f9dd34 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:08.643379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-777192a3-e339-4be7-9ec4-438a72f9dd34 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:08.657861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-777192a3-e339-4be7-9ec4-438a72f9dd34 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:08.660643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-777192a3-e339-4be7-9ec4-438a72f9dd34 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:08.660643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-777192a3-e339-4be7-9ec4-438a72f9dd34 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:08.664055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-777192a3-e339-4be7-9ec4-438a72f9dd34 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:08.664787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-777192a3-e339-4be7-9ec4-438a72f9dd34 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:08.665426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-777192a3-e339-4be7-9ec4-438a72f9dd34 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:09.256431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-777192a3-e339-4be7-9ec4-438a72f9dd34 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:09.271999 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-777192a3-e339-4be7-9ec4-438a72f9dd34 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1308 microversion: 2.1 time: 0.632938 Sep 06 10:57:09.274112 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 848/1673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:08 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1308 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:10.132261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Building network info cache for instance {{(pid=140875) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 06 10:57:10.166375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-6196cb56-9ab2-40a7-b5a8-fa6abe60b6f9 req-656ded97-abd8-4dbc-9e8f-1c2967231d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a5d8f6-b223-4a68-850d-680fe295ae59", "tag": "cecb333e-7d2a-422c-8560-93edb6898e73"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:10.186432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6196cb56-9ab2-40a7-b5a8-fa6abe60b6f9 req-656ded97-abd8-4dbc-9e8f-1c2967231d75 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:10.189661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6196cb56-9ab2-40a7-b5a8-fa6abe60b6f9 req-656ded97-abd8-4dbc-9e8f-1c2967231d75 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:10.189661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6196cb56-9ab2-40a7-b5a8-fa6abe60b6f9 req-656ded97-abd8-4dbc-9e8f-1c2967231d75 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:10.213918 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-6196cb56-9ab2-40a7-b5a8-fa6abe60b6f9 req-656ded97-abd8-4dbc-9e8f-1c2967231d75 service nova] Creating event network-changed:cecb333e-7d2a-422c-8560-93edb6898e73 for instance 15a5d8f6-b223-4a68-850d-680fe295ae59 on nch2-master-1 Sep 06 10:57:10.220613 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-6196cb56-9ab2-40a7-b5a8-fa6abe60b6f9 req-656ded97-abd8-4dbc-9e8f-1c2967231d75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066266 Sep 06 10:57:10.221886 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 849/1674] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:57:10.297094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c900b7fb-5da2-4235-ae9b-5b245438e2b9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:10.298703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c900b7fb-5da2-4235-ae9b-5b245438e2b9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:10.308653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c900b7fb-5da2-4235-ae9b-5b245438e2b9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:10.309085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c900b7fb-5da2-4235-ae9b-5b245438e2b9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:10.309535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c900b7fb-5da2-4235-ae9b-5b245438e2b9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:10.310264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c900b7fb-5da2-4235-ae9b-5b245438e2b9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:10.310728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c900b7fb-5da2-4235-ae9b-5b245438e2b9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:10.311197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c900b7fb-5da2-4235-ae9b-5b245438e2b9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:10.833538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c900b7fb-5da2-4235-ae9b-5b245438e2b9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:10.842480 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c900b7fb-5da2-4235-ae9b-5b245438e2b9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1488 microversion: 2.1 time: 0.550670 Sep 06 10:57:10.859771 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 850/1675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:10 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1488 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:57:10.888497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1a7b245d-6079-4563-b823-1c5db34c9360 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1650417283"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:10.894334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1a7b245d-6079-4563-b823-1c5db34c9360 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:10.915830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7b245d-6079-4563-b823-1c5db34c9360 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:10.917739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7b245d-6079-4563-b823-1c5db34c9360 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:10.927626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7b245d-6079-4563-b823-1c5db34c9360 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:10.928515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7b245d-6079-4563-b823-1c5db34c9360 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:10.929018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7b245d-6079-4563-b823-1c5db34c9360 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:10.929526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7b245d-6079-4563-b823-1c5db34c9360 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:11.569846 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1a7b245d-6079-4563-b823-1c5db34c9360 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "POST /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee/action" status: 202 len: 0 microversion: 2.1 time: 0.683470 Sep 06 10:57:11.571520 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 851/1676] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:57:10 2022] POST /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 06 10:57:11.916357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-85c32499-8784-4a21-b2af-04697483f70c tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] Action: 'create', calling method: .version_select at 0x7f90fd083c10>, body: {"pool": null} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:12.115725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Updating instance_info_cache with network_info: [{"id": "cecb333e-7d2a-422c-8560-93edb6898e73", "address": "fa:16:3e:9b:ba:9f", "network": {"id": "f8b11397-3914-4c86-9b8e-22614951152b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-476424951-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0bce1bf271594425ad60e24f40b3b60d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcecb333e-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140875) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 06 10:57:12.239408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Releasing lock "refresh_cache-15a5d8f6-b223-4a68-850d-680fe295ae59" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 10:57:12.240571 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f5726dfd-bf6b-4204-8826-26cfa609ed45 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action" status: 202 len: 0 microversion: 2.1 time: 4.090317 Sep 06 10:57:12.241727 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 826/1677] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:57:08 2022] POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action => generated 0 bytes in 4092 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 06 10:57:12.253067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0e183e5b-0a55-4a81-98a0-ebcdb67c1cd7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90fd0b90d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:12.375558 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0e183e5b-0a55-4a81-98a0-ebcdb67c1cd7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/6b6dc568-c462-4fa8-b70d-902df5dbd97d" status: 200 len: 1412 microversion: 2.1 time: 0.132386 Sep 06 10:57:12.386944 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 827/1678] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:12 2022] GET /compute/v2.1/images/6b6dc568-c462-4fa8-b70d-902df5dbd97d => generated 1412 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:12.392901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7d7a43f6-568f-471a-a4ab-9a6cca483ef5 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Action: 'create', calling method: .version_select at 0x7f90f3cbd700>, body: {"pool": "e41669ad-0ff0-4d70-8973-15677f96420c"} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:15.365939 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-85c32499-8784-4a21-b2af-04697483f70c tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.792962 Sep 06 10:57:15.374561 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 852/1679] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Sep 6 10:57:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:15.374561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7c884aa5-c905-46c8-ad3d-c69856cc8694 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90fd083ee0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:15.424566 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7c884aa5-c905-46c8-ad3d-c69856cc8694 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/6b6dc568-c462-4fa8-b70d-902df5dbd97d" status: 200 len: 1412 microversion: 2.1 time: 0.055767 Sep 06 10:57:15.425175 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 853/1680] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:15 2022] GET /compute/v2.1/images/6b6dc568-c462-4fa8-b70d-902df5dbd97d => generated 1412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:15.433066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-18eb1bc8-0189-4393-af11-7d4678668cf9 tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] Action: 'create', calling method: .version_select at 0x7f90fd083430>, body: {"pool": null} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:16.147569 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7d7a43f6-568f-471a-a4ab-9a6cca483ef5 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.756552 Sep 06 10:57:16.147569 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 828/1681] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Sep 6 10:57:12 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:16.152225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cce88b9b-364c-44f9-9af8-89efa36478f1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90fd10e160>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:16.626906 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cce88b9b-364c-44f9-9af8-89efa36478f1 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/images/6b6dc568-c462-4fa8-b70d-902df5dbd97d" status: 204 len: 0 microversion: 2.1 time: 0.481984 Sep 06 10:57:16.627794 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 829/1682] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:16 2022] DELETE /compute/v2.1/images/6b6dc568-c462-4fa8-b70d-902df5dbd97d => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:57:16.636325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.82"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:16.641859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:16.648337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:16.648907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:16.649454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:16.650243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:16.651380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:16.651953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:16.682497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "refresh_cache-15a5d8f6-b223-4a68-850d-680fe295ae59" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 10:57:16.682975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquired lock "refresh_cache-15a5d8f6-b223-4a68-850d-680fe295ae59" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 10:57:17.333110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG neutronclient.v2_0.client [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.4.82 (b726661e-116d-4f55-83c2-9d97b1b2b168) with port cecb333e-7d2a-422c-8560-93edb6898e73 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e41669ad-0ff0-4d70-8973-15677f96420c.", "detail": ""}} {{(pid=140875) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:57:17.333817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Releasing lock "refresh_cache-15a5d8f6-b223-4a68-850d-680fe295ae59" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 10:57:17.335246 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] HTTP exception thrown: Cannot associate floating IP 172.35.4.82 (b726661e-116d-4f55-83c2-9d97b1b2b168) with port cecb333e-7d2a-422c-8560-93edb6898e73 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e41669ad-0ff0-4d70-8973-15677f96420c. Sep 06 10:57:17.335246 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-5a635afe-8181-49a3-9cc0-fead0f903267'] Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Request method failure captured: Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action HTTP/1.1 Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 45 Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFydpSpFvU4p1fU4wY9regjJX9VOmKkhB-dVPB9ay_URmYdPG_zXJ3y9MOzz9CL-lu2nISyRNiXUTBvRoAiTUgEkVSNtZUjAVYT_lJTUhMhFw5l8QqizhiTMEfeNORNuwZIANg3kwazipM0XFBPiqbemt-dJgNHYLfu6ytIBP0b7_-t4 Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0bce1bf271594425ad60e24f40b3b60d Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bce1bf271594425ad60e24f40b3b60d"}]}] Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0bce1bf271594425ad60e24f40b3b60d Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 2d0621ebe85c47c383137b4db0814279 Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: {"addFloatingIp": {"address": "172.35.4.82"}} Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: exception: Cannot associate floating IP 172.35.4.82 (b726661e-116d-4f55-83c2-9d97b1b2b168) with port cecb333e-7d2a-422c-8560-93edb6898e73 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e41669ad-0ff0-4d70-8973-15677f96420c. Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-5a635afe-8181-49a3-9cc0-fead0f903267'] Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '15a5d8f6-b223-4a68-850d-680fe295ae59', 'body': {'addFloatingIp': {'address': '172.35.4.82'}}} Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:57:17.339218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.4.82 (b726661e-116d-4f55-83c2-9d97b1b2b168) with port cecb333e-7d2a-422c-8560-93edb6898e73 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e41669ad-0ff0-4d70-8973-15677f96420c. Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a635afe-8181-49a3-9cc0-fead0f903267'] Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.4.82 (b726661e-116d-4f55-83c2-9d97b1b2b168) with port cecb333e-7d2a-422c-8560-93edb6898e73 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e41669ad-0ff0-4d70-8973-15677f96420c. Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a635afe-8181-49a3-9cc0-fead0f903267'] Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.4.82 (b726661e-116d-4f55-83c2-9d97b1b2b168) with port cecb333e-7d2a-422c-8560-93edb6898e73 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e41669ad-0ff0-4d70-8973-15677f96420c. Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a635afe-8181-49a3-9cc0-fead0f903267'] Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.4.82 (b726661e-116d-4f55-83c2-9d97b1b2b168) with port cecb333e-7d2a-422c-8560-93edb6898e73 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e41669ad-0ff0-4d70-8973-15677f96420c. Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a635afe-8181-49a3-9cc0-fead0f903267'] Sep 06 10:57:17.346290 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.360101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Returning 400 to user: Cannot associate floating IP 172.35.4.82 (b726661e-116d-4f55-83c2-9d97b1b2b168) with port cecb333e-7d2a-422c-8560-93edb6898e73 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e41669ad-0ff0-4d70-8973-15677f96420c. Sep 06 10:57:17.360101 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-5a635afe-8181-49a3-9cc0-fead0f903267'] {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:17.362325 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2a9613c2-5617-4b5f-8944-e50012a033f1 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action" status: 400 len: 381 microversion: 2.1 time: 0.730290 Sep 06 10:57:17.368263 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 830/1683] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:57:16 2022] POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action => generated 381 bytes in 740 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:57:17.373539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f87455c7-d5dd-4bba-8be0-eec6b1bbb5ae tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f3d71c10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:17.412753 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-f87455c7-d5dd-4bba-8be0-eec6b1bbb5ae tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] HTTP exception thrown: Image not found. Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f87455c7-d5dd-4bba-8be0-eec6b1bbb5ae tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Request method failure captured: Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/images/6b6dc568-c462-4fa8-b70d-902df5dbd97d HTTP/1.1 Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyaZA-uiP_RRwyKTpstMq_snN96l4NBAuLpTvUZXZaKkL1nlZPUmB1vY0-_vC4QTS7mBpHk0ByEBb7R-iDxblWfftnB-3EEXfNuNabkEp42rTgFGIHdZFF0Gft6oS7QJVWWEjjoPA1_r2rWah96Ux-IMCZQ9Fe_MDHzU_JnwOMegYHM Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}] Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesTestJSON-232185986 Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d79046739b2d4572b0aedef59e621ab8 Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: exception: Image not found. Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '6b6dc568-c462-4fa8-b70d-902df5dbd97d'} Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6b6dc568-c462-4fa8-b70d-902df5dbd97d Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 06 10:57:17.416988 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6b6dc568-c462-4fa8-b70d-902df5dbd97d could not be found. Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:57:17.422296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:17.432168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f87455c7-d5dd-4bba-8be0-eec6b1bbb5ae tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Returning 404 to user: Image not found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:17.433275 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f87455c7-d5dd-4bba-8be0-eec6b1bbb5ae tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/images/6b6dc568-c462-4fa8-b70d-902df5dbd97d" status: 404 len: 62 microversion: 2.1 time: 0.063719 Sep 06 10:57:17.433834 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 831/1684] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:17 2022] GET /compute/v2.1/images/6b6dc568-c462-4fa8-b70d-902df5dbd97d => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:57:17.445158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56553d7e-1301-4696-adfe-05db47b27079 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '.version_select at 0x7f90f3d71550>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:18.884143 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-18eb1bc8-0189-4393-af11-7d4678668cf9 tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.456939 Sep 06 10:57:18.885411 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 854/1685] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Sep 6 10:57:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:18.890506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9bc914eb-bdf9-4800-87c5-1139a20f955e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:18.892370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9bc914eb-bdf9-4800-87c5-1139a20f955e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:18.912868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bc914eb-bdf9-4800-87c5-1139a20f955e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:18.914725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bc914eb-bdf9-4800-87c5-1139a20f955e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:18.916848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bc914eb-bdf9-4800-87c5-1139a20f955e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:18.920211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bc914eb-bdf9-4800-87c5-1139a20f955e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:18.920907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bc914eb-bdf9-4800-87c5-1139a20f955e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:18.921410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bc914eb-bdf9-4800-87c5-1139a20f955e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:19.177718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9bc914eb-bdf9-4800-87c5-1139a20f955e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:19.197508 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9bc914eb-bdf9-4800-87c5-1139a20f955e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1501 microversion: 2.1 time: 0.310562 Sep 06 10:57:19.198254 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 855/1686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:18 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1501 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:19.203846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-87bb9d28-8b98-4d22-a419-4affc4d22085 req-56367fb3-c708-4466-9859-ab445ca5794f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d7d4ff-23fc-489c-ac1d-2806d273aaee", "name": "network-vif-plugged", "status": "completed", "tag": "6897d614-de4c-4743-8ed8-e00cec490776"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:19.216267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-87bb9d28-8b98-4d22-a419-4affc4d22085 req-56367fb3-c708-4466-9859-ab445ca5794f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:19.217112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-87bb9d28-8b98-4d22-a419-4affc4d22085 req-56367fb3-c708-4466-9859-ab445ca5794f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:19.217791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-87bb9d28-8b98-4d22-a419-4affc4d22085 req-56367fb3-c708-4466-9859-ab445ca5794f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:19.232188 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-87bb9d28-8b98-4d22-a419-4affc4d22085 req-56367fb3-c708-4466-9859-ab445ca5794f service nova] Creating event network-vif-plugged:6897d614-de4c-4743-8ed8-e00cec490776 for instance 93d7d4ff-23fc-489c-ac1d-2806d273aaee on nch2-master-1 Sep 06 10:57:19.237869 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-87bb9d28-8b98-4d22-a419-4affc4d22085 req-56367fb3-c708-4466-9859-ab445ca5794f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038172 Sep 06 10:57:19.239642 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 856/1687] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:19.246272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3b353a80-2a96-45e8-b122-4b23432c094f tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] Action: 'create', calling method: .version_select at 0x7f90fd096790>, body: {"pool": null} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:19.633227 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56553d7e-1301-4696-adfe-05db47b27079 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/b726661e-116d-4f55-83c2-9d97b1b2b168" status: 202 len: 0 microversion: 2.1 time: 2.197127 Sep 06 10:57:19.634426 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 832/1688] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 10:57:17 2022] DELETE /compute/v2.1/os-floating-ips/b726661e-116d-4f55-83c2-9d97b1b2b168 => generated 0 bytes in 2200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:57:19.642423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.139"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:19.939695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:19.948889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:19.951618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:19.953075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:19.956307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:19.963277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:19.967374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:20.534202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "refresh_cache-15a5d8f6-b223-4a68-850d-680fe295ae59" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 10:57:20.534919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquired lock "refresh_cache-15a5d8f6-b223-4a68-850d-680fe295ae59" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 10:57:23.026745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Building network info cache for instance {{(pid=140875) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 06 10:57:24.178256 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3b353a80-2a96-45e8-b122-4b23432c094f tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.936604 Sep 06 10:57:24.185824 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 857/1689] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Sep 6 10:57:19 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:24.192966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c2a87fc3-69e8-4f0a-a09a-99224cfee556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:24.195715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c2a87fc3-69e8-4f0a-a09a-99224cfee556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:24.213019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2a87fc3-69e8-4f0a-a09a-99224cfee556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:24.213527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2a87fc3-69e8-4f0a-a09a-99224cfee556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:24.218131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2a87fc3-69e8-4f0a-a09a-99224cfee556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:24.218893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2a87fc3-69e8-4f0a-a09a-99224cfee556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:24.219603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2a87fc3-69e8-4f0a-a09a-99224cfee556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:24.220229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2a87fc3-69e8-4f0a-a09a-99224cfee556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:24.485416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Updating instance_info_cache with network_info: [{"id": "cecb333e-7d2a-422c-8560-93edb6898e73", "address": "fa:16:3e:9b:ba:9f", "network": {"id": "f8b11397-3914-4c86-9b8e-22614951152b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-476424951-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0bce1bf271594425ad60e24f40b3b60d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcecb333e-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140875) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 06 10:57:24.532423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c2a87fc3-69e8-4f0a-a09a-99224cfee556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:24.542115 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c2a87fc3-69e8-4f0a-a09a-99224cfee556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1501 microversion: 2.1 time: 0.354386 Sep 06 10:57:24.542703 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 858/1690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:24 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1501 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:24.564704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a7bab13b-ecf8-4d91-8165-3dc7661b7acd req-453042ae-80ef-4b9b-971e-8e71b9b19895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a5d8f6-b223-4a68-850d-680fe295ae59", "tag": "cecb333e-7d2a-422c-8560-93edb6898e73"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:24.576916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a7bab13b-ecf8-4d91-8165-3dc7661b7acd req-453042ae-80ef-4b9b-971e-8e71b9b19895 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:24.577699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a7bab13b-ecf8-4d91-8165-3dc7661b7acd req-453042ae-80ef-4b9b-971e-8e71b9b19895 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:24.578316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a7bab13b-ecf8-4d91-8165-3dc7661b7acd req-453042ae-80ef-4b9b-971e-8e71b9b19895 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:24.596353 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a7bab13b-ecf8-4d91-8165-3dc7661b7acd req-453042ae-80ef-4b9b-971e-8e71b9b19895 service nova] Creating event network-changed:cecb333e-7d2a-422c-8560-93edb6898e73 for instance 15a5d8f6-b223-4a68-850d-680fe295ae59 on nch2-master-1 Sep 06 10:57:24.612301 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a7bab13b-ecf8-4d91-8165-3dc7661b7acd req-453042ae-80ef-4b9b-971e-8e71b9b19895 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052514 Sep 06 10:57:24.612301 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 859/1691] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:24.612301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a44f1fda-ab7e-44ce-a281-68d04ad755c4 tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] Action: 'create', calling method: .version_select at 0x7f90fd131820>, body: {"pool": null} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:24.637688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Releasing lock "refresh_cache-15a5d8f6-b223-4a68-850d-680fe295ae59" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 10:57:24.638880 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2254aa16-e6d1-40d7-a7a1-436d927a42a2 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action" status: 202 len: 0 microversion: 2.1 time: 5.000265 Sep 06 10:57:24.642867 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 833/1692] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:57:19 2022] POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action => generated 0 bytes in 5005 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 06 10:57:24.653930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-85a4cfd1-908b-4be0-be5f-7234f4c6d23a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '.version_select at 0x7f90f3cbd0d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:28.094569 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-85a4cfd1-908b-4be0-be5f-7234f4c6d23a tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/13cec661-9329-4f55-91b3-e2364fae5540" status: 202 len: 0 microversion: 2.1 time: 3.450380 Sep 06 10:57:28.095594 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 834/1693] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 10:57:24 2022] DELETE /compute/v2.1/os-floating-ips/13cec661-9329-4f55-91b3-e2364fae5540 => generated 0 bytes in 3452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:57:28.100823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5ebfcc61-eb78-44bf-aca6-8b7c05d19916 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:28.101690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5ebfcc61-eb78-44bf-aca6-8b7c05d19916 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:28.111329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=58 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:28.120349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ebfcc61-eb78-44bf-aca6-8b7c05d19916 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:28.124106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ebfcc61-eb78-44bf-aca6-8b7c05d19916 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:28.124829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ebfcc61-eb78-44bf-aca6-8b7c05d19916 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:28.127800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ebfcc61-eb78-44bf-aca6-8b7c05d19916 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:28.131068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ebfcc61-eb78-44bf-aca6-8b7c05d19916 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:28.131723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ebfcc61-eb78-44bf-aca6-8b7c05d19916 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:28.137356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:28.976299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5ebfcc61-eb78-44bf-aca6-8b7c05d19916 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:28.987555 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5ebfcc61-eb78-44bf-aca6-8b7c05d19916 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1501 microversion: 2.1 time: 0.890780 Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 835/1694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:28 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1501 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3a4faadf-e1ef-4031-af18-c59904712493 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3a4faadf-e1ef-4031-af18-c59904712493 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Request method failure captured: Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action HTTP/1.1 Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 34 Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFydpSpFvU4p1fU4wY9regjJX9VOmKkhB-dVPB9ay_URmYdPG_zXJ3y9MOzz9CL-lu2nISyRNiXUTBvRoAiTUgEkVSNtZUjAVYT_lJTUhMhFw5l8QqizhiTMEfeNORNuwZIANg3kwazipM0XFBPiqbemt-dJgNHYLfu6ytIBP0b7_-t4 Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0bce1bf271594425ad60e24f40b3b60d Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bce1bf271594425ad60e24f40b3b60d"}]}] Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0bce1bf271594425ad60e24f40b3b60d Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 2d0621ebe85c47c383137b4db0814279 Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: {"addFloatingIp": {"address": ""}} Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '15a5d8f6-b223-4a68-850d-680fe295ae59', 'body': {'addFloatingIp': {'address': ''}}} Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi '' Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:29.144746 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3a4faadf-e1ef-4031-af18-c59904712493 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3a4faadf-e1ef-4031-af18-c59904712493 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action" status: 400 len: 142 microversion: 2.1 time: 0.016576 Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 836/1695] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:57:28 2022] POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action => generated 142 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a80d0565-e216-4341-9ed4-9e9c064a1226 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b57edf85-c27b-464d-bc0d-2e4c9a61792a"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a80d0565-e216-4341-9ed4-9e9c064a1226 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a80d0565-e216-4341-9ed4-9e9c064a1226 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a80d0565-e216-4341-9ed4-9e9c064a1226 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a80d0565-e216-4341-9ed4-9e9c064a1226 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:29.151925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a80d0565-e216-4341-9ed4-9e9c064a1226 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:29.154998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a80d0565-e216-4341-9ed4-9e9c064a1226 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:29.154998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a80d0565-e216-4341-9ed4-9e9c064a1226 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:29.819986 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a44f1fda-ab7e-44ce-a281-68d04ad755c4 tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.212268 Sep 06 10:57:29.824705 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 860/1696] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Sep 6 10:57:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:29.834256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Action: 'action', calling method: .version_select at 0x7f90fa2c59d0>, body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:29.839613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:29.841634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=55 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:29.852454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:29.852960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:29.853473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:29.854203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:29.854672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:29.863402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:29.867200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:29.911342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "refresh_cache-15a5d8f6-b223-4a68-850d-680fe295ae59" {{(pid=140876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 10:57:29.911753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquired lock "refresh_cache-15a5d8f6-b223-4a68-850d-680fe295ae59" {{(pid=140876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 10:57:30.036226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Releasing lock "refresh_cache-15a5d8f6-b223-4a68-850d-680fe295ae59" {{(pid=140876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 10:57:30.037079 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] HTTP exception thrown: floating IP not found Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Request method failure captured: Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action HTTP/1.1 Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 41 Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFydpSpFvU4p1fU4wY9regjJX9VOmKkhB-dVPB9ay_URmYdPG_zXJ3y9MOzz9CL-lu2nISyRNiXUTBvRoAiTUgEkVSNtZUjAVYT_lJTUhMhFw5l8QqizhiTMEfeNORNuwZIANg3kwazipM0XFBPiqbemt-dJgNHYLfu6ytIBP0b7_-t4 Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0bce1bf271594425ad60e24f40b3b60d Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bce1bf271594425ad60e24f40b3b60d"}]}] Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0bce1bf271594425ad60e24f40b3b60d Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 2d0621ebe85c47c383137b4db0814279 Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: exception: floating IP not found Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '15a5d8f6-b223-4a68-850d-680fe295ae59', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 06 10:57:30.038959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:30.044363 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:30.044363 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:30.044363 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:30.044363 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:30.044363 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:30.044363 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:30.044363 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:30.044363 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 06 10:57:30.044363 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:30.046317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Returning 404 to user: floating IP not found {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:30.047683 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f5aa5c1c-8da7-4cd1-b1d5-c251f28e6c2d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action" status: 404 len: 67 microversion: 2.1 time: 0.221700 Sep 06 10:57:30.048943 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 861/1697] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:57:29 2022] POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action => generated 67 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:57:30.091367 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a80d0565-e216-4341-9ed4-9e9c064a1226 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "POST /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.081345 Sep 06 10:57:30.100593 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 837/1698] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 10:57:29 2022] POST /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-volume_attachments => generated 194 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:30.116366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d214500b-ad6f-49a1-9bb1-19da44990bc5 tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] Calling method '.version_select at 0x7f90f3da09d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:30.456525 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d214500b-ad6f-49a1-9bb1-19da44990bc5 tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/cc82a164-a661-4ea9-a65f-54d834440155" status: 200 len: 142 microversion: 2.1 time: 0.363003 Sep 06 10:57:30.466488 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 838/1699] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 10:57:30 2022] GET /compute/v2.1/os-floating-ips/cc82a164-a661-4ea9-a65f-54d834440155 => generated 142 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:30.474260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3aeaa4cc-2cc4-4790-aeb3-50e37adb7c01 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:30.478156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3aeaa4cc-2cc4-4790-aeb3-50e37adb7c01 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:30.505839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3aeaa4cc-2cc4-4790-aeb3-50e37adb7c01 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:30.507351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3aeaa4cc-2cc4-4790-aeb3-50e37adb7c01 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:30.508236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3aeaa4cc-2cc4-4790-aeb3-50e37adb7c01 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:30.509338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3aeaa4cc-2cc4-4790-aeb3-50e37adb7c01 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:30.511372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3aeaa4cc-2cc4-4790-aeb3-50e37adb7c01 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:30.512830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3aeaa4cc-2cc4-4790-aeb3-50e37adb7c01 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:30.591669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1107532122", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "9312fcea-ff98-4f9b-847c-17d6e7290268"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:30.750910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] validate_networks() for [('9312fcea-ff98-4f9b-847c-17d6e7290268', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:57:30.958956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3aeaa4cc-2cc4-4790-aeb3-50e37adb7c01 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:30.972324 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3aeaa4cc-2cc4-4790-aeb3-50e37adb7c01 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1501 microversion: 2.1 time: 0.502586 Sep 06 10:57:30.973549 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 839/1700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:30 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1501 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:30.990359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cae1ccf7-b3b1-40fb-923b-75ac9f55f352 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:31.092306 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-cae1ccf7-b3b1-40fb-923b-75ac9f55f352 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cae1ccf7-b3b1-40fb-923b-75ac9f55f352 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Request method failure captured: Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action HTTP/1.1 Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 44 Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFydpSpFvU4p1fU4wY9regjJX9VOmKkhB-dVPB9ay_URmYdPG_zXJ3y9MOzz9CL-lu2nISyRNiXUTBvRoAiTUgEkVSNtZUjAVYT_lJTUhMhFw5l8QqizhiTMEfeNORNuwZIANg3kwazipM0XFBPiqbemt-dJgNHYLfu6ytIBP0b7_-t4 Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0bce1bf271594425ad60e24f40b3b60d Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bce1bf271594425ad60e24f40b3b60d"}]}] Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0bce1bf271594425ad60e24f40b3b60d Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 2d0621ebe85c47c383137b4db0814279 Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: exception: Floating IP not found for address 0.0.0.0. Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '15a5d8f6-b223-4a68-850d-680fe295ae59', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 06 10:57:31.094735 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cae1ccf7-b3b1-40fb-923b-75ac9f55f352 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cae1ccf7-b3b1-40fb-923b-75ac9f55f352 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action" status: 404 len: 88 microversion: 2.1 time: 0.121107 Sep 06 10:57:31.102645 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 840/1701] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:57:30 2022] POST /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59/action => generated 88 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:57:31.111496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-72934d93-15bb-4728-9e6f-941250491764 tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] Calling method '.version_select at 0x7f90fd1173a0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:31.934066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:57:31.934066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:57:31.934066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:57:31.934998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:57:31.935637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:57:31.955143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:31.956015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:31.957838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:31.960664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:31.964209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:31.964948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:32.008257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:57:32.019607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for user e19903666a1243e3a66411e30babe299 and project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:57:32.041960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:57:32.046262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:57:32.240162 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1c62a399-56f5-4252-a5c2-ce2f5c935005 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.189872 Sep 06 10:57:32.245474 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 862/1702] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:57:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:57:32.259540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b2919fae-372c-4477-814d-3da9bf4ed649 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:32.260687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b2919fae-372c-4477-814d-3da9bf4ed649 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:32.275297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2919fae-372c-4477-814d-3da9bf4ed649 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:32.278484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2919fae-372c-4477-814d-3da9bf4ed649 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:32.278959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2919fae-372c-4477-814d-3da9bf4ed649 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:32.279738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2919fae-372c-4477-814d-3da9bf4ed649 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:32.280212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2919fae-372c-4477-814d-3da9bf4ed649 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:32.280655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2919fae-372c-4477-814d-3da9bf4ed649 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:32.316841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b2919fae-372c-4477-814d-3da9bf4ed649 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:57:32.579959 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-72934d93-15bb-4728-9e6f-941250491764 tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/cc82a164-a661-4ea9-a65f-54d834440155" status: 202 len: 0 microversion: 2.1 time: 1.474467 Sep 06 10:57:32.583457 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 841/1703] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 10:57:31 2022] DELETE /compute/v2.1/os-floating-ips/cc82a164-a661-4ea9-a65f-54d834440155 => generated 0 bytes in 1482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:57:32.589674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1e1610ef-b68f-43da-a281-96d8e0ab5267 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:32.590556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1e1610ef-b68f-43da-a281-96d8e0ab5267 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:32.600824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1610ef-b68f-43da-a281-96d8e0ab5267 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:32.601491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1610ef-b68f-43da-a281-96d8e0ab5267 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:32.602162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1610ef-b68f-43da-a281-96d8e0ab5267 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:32.603686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1610ef-b68f-43da-a281-96d8e0ab5267 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:32.604495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1610ef-b68f-43da-a281-96d8e0ab5267 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:32.612534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1610ef-b68f-43da-a281-96d8e0ab5267 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:32.665241 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b2919fae-372c-4477-814d-3da9bf4ed649 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 204 len: 0 microversion: 2.1 time: 0.417778 Sep 06 10:57:32.665969 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 863/1704] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:57:32 2022] DELETE /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:57:32.672087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a834dd6f-3ba6-4c13-9be5-084cc918fad5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:32.672807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a834dd6f-3ba6-4c13-9be5-084cc918fad5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:32.833758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a834dd6f-3ba6-4c13-9be5-084cc918fad5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:32.843944 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a834dd6f-3ba6-4c13-9be5-084cc918fad5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1215 microversion: 2.1 time: 0.176520 Sep 06 10:57:32.850007 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 864/1705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:32 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:32.864370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-09fede52-7977-4d9d-9684-81fdc5e4dcbe tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] Calling method '.version_select at 0x7f90f8be4e50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:33.168737 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-09fede52-7977-4d9d-9684-81fdc5e4dcbe tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.316188 Sep 06 10:57:33.170071 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 865/1706] 10.222.0.20 () {58 vars in 1164 bytes} [Tue Sep 6 10:57:32 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:57:33.181956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ac16c599-f8cf-431e-a579-a8f0c78022fa tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:33.182727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ac16c599-f8cf-431e-a579-a8f0c78022fa tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:33.195297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac16c599-f8cf-431e-a579-a8f0c78022fa tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:33.196664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac16c599-f8cf-431e-a579-a8f0c78022fa tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:33.197364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac16c599-f8cf-431e-a579-a8f0c78022fa tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:33.198157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac16c599-f8cf-431e-a579-a8f0c78022fa tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:33.198634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac16c599-f8cf-431e-a579-a8f0c78022fa tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:33.199143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac16c599-f8cf-431e-a579-a8f0c78022fa tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:33.199951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1e1610ef-b68f-43da-a281-96d8e0ab5267 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:33.213023 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1e1610ef-b68f-43da-a281-96d8e0ab5267 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1501 microversion: 2.1 time: 0.628420 Sep 06 10:57:33.214863 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 842/1707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:32 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1501 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:33.221134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c54e4ec7-4c52-4e82-920d-2ff791eedc4f tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] Calling method '.version_select at 0x7f90fd174790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:33.651654 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c54e4ec7-4c52-4e82-920d-2ff791eedc4f tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.435273 Sep 06 10:57:33.653165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ac16c599-f8cf-431e-a579-a8f0c78022fa tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:33.653487 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 843/1708] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 10:57:33 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:33.678405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5583e0a5-9232-46c8-bac8-5617236ecc69 tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] Calling method '.version_select at 0x7f90fd1170d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:33.686473 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ac16c599-f8cf-431e-a579-a8f0c78022fa tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1542 microversion: 2.1 time: 0.515148 Sep 06 10:57:33.692688 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 866/1709] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:33 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1542 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:33.885425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76661969-3852-49a7-b4d7-7baf278f0c7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:33.898203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-76661969-3852-49a7-b4d7-7baf278f0c7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:33.898203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76661969-3852-49a7-b4d7-7baf278f0c7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:33.898203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76661969-3852-49a7-b4d7-7baf278f0c7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:33.898203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76661969-3852-49a7-b4d7-7baf278f0c7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:33.898203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76661969-3852-49a7-b4d7-7baf278f0c7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:33.898203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76661969-3852-49a7-b4d7-7baf278f0c7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:33.898203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76661969-3852-49a7-b4d7-7baf278f0c7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:34.081670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-76661969-3852-49a7-b4d7-7baf278f0c7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:34.093852 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-76661969-3852-49a7-b4d7-7baf278f0c7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1219 microversion: 2.1 time: 0.217041 Sep 06 10:57:34.111273 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 867/1710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:33 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1219 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:34.242308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a80206d7-ca90-464b-a364-71e9db80914f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:34.243686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a80206d7-ca90-464b-a364-71e9db80914f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:34.253635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80206d7-ca90-464b-a364-71e9db80914f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:34.253635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80206d7-ca90-464b-a364-71e9db80914f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:34.262306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80206d7-ca90-464b-a364-71e9db80914f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:34.263627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80206d7-ca90-464b-a364-71e9db80914f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:34.265130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80206d7-ca90-464b-a364-71e9db80914f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:34.265971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80206d7-ca90-464b-a364-71e9db80914f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:35.116889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a80206d7-ca90-464b-a364-71e9db80914f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:35.136733 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a80206d7-ca90-464b-a364-71e9db80914f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1501 microversion: 2.1 time: 0.898641 Sep 06 10:57:35.177065 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 868/1711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:34 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1501 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:35.198720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0ae44163-e4fc-49ca-92d3-1a7d981c7f08 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:35.202610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0ae44163-e4fc-49ca-92d3-1a7d981c7f08 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:35.213951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ae44163-e4fc-49ca-92d3-1a7d981c7f08 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:35.215761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ae44163-e4fc-49ca-92d3-1a7d981c7f08 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:35.216437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ae44163-e4fc-49ca-92d3-1a7d981c7f08 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:35.223049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ae44163-e4fc-49ca-92d3-1a7d981c7f08 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:35.223978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ae44163-e4fc-49ca-92d3-1a7d981c7f08 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:35.224636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ae44163-e4fc-49ca-92d3-1a7d981c7f08 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:35.949073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0ae44163-e4fc-49ca-92d3-1a7d981c7f08 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:35.960659 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0ae44163-e4fc-49ca-92d3-1a7d981c7f08 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1542 microversion: 2.1 time: 0.779460 Sep 06 10:57:35.971133 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 869/1712] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:35 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1542 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:35.971133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7e7d2353-170a-4fd1-b716-a46543ab2068 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:35.971133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7e7d2353-170a-4fd1-b716-a46543ab2068 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:36.004013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e7d2353-170a-4fd1-b716-a46543ab2068 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:36.004992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e7d2353-170a-4fd1-b716-a46543ab2068 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:36.006252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e7d2353-170a-4fd1-b716-a46543ab2068 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:36.007247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e7d2353-170a-4fd1-b716-a46543ab2068 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:36.008280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e7d2353-170a-4fd1-b716-a46543ab2068 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:36.009082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e7d2353-170a-4fd1-b716-a46543ab2068 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:36.264369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7e7d2353-170a-4fd1-b716-a46543ab2068 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:36.278713 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7e7d2353-170a-4fd1-b716-a46543ab2068 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1275 microversion: 2.1 time: 0.313988 Sep 06 10:57:36.279548 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 870/1713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:35 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1275 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:36.286186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3b4e8828-73c1-46e7-b552-bcfc93b6934e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:36.287140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3b4e8828-73c1-46e7-b552-bcfc93b6934e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:36.293931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b4e8828-73c1-46e7-b552-bcfc93b6934e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:36.294793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b4e8828-73c1-46e7-b552-bcfc93b6934e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:36.295510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b4e8828-73c1-46e7-b552-bcfc93b6934e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:36.296453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b4e8828-73c1-46e7-b552-bcfc93b6934e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:36.297157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b4e8828-73c1-46e7-b552-bcfc93b6934e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:36.297835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3b4e8828-73c1-46e7-b552-bcfc93b6934e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:36.402961 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5583e0a5-9232-46c8-bac8-5617236ecc69 tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/d44511fb-91af-41b5-89c9-da82d2c14093" status: 202 len: 0 microversion: 2.1 time: 2.733599 Sep 06 10:57:36.403757 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 844/1714] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 10:57:33 2022] DELETE /compute/v2.1/os-floating-ips/d44511fb-91af-41b5-89c9-da82d2c14093 => generated 0 bytes in 2735 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:57:36.410180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-29756a7f-ce95-4899-bb73-e46e3fb88342 req-cda4e082-89b2-4289-9693-200c10cb2cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a5d8f6-b223-4a68-850d-680fe295ae59", "name": "network-vif-deleted", "tag": "cecb333e-7d2a-422c-8560-93edb6898e73"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:36.427570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-29756a7f-ce95-4899-bb73-e46e3fb88342 req-cda4e082-89b2-4289-9693-200c10cb2cc8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:36.428028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-29756a7f-ce95-4899-bb73-e46e3fb88342 req-cda4e082-89b2-4289-9693-200c10cb2cc8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:36.428695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-29756a7f-ce95-4899-bb73-e46e3fb88342 req-cda4e082-89b2-4289-9693-200c10cb2cc8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:36.450197 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-29756a7f-ce95-4899-bb73-e46e3fb88342 req-cda4e082-89b2-4289-9693-200c10cb2cc8 service nova] Creating event network-vif-deleted:cecb333e-7d2a-422c-8560-93edb6898e73 for instance 15a5d8f6-b223-4a68-850d-680fe295ae59 on nch2-master-1 Sep 06 10:57:36.456015 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-29756a7f-ce95-4899-bb73-e46e3fb88342 req-cda4e082-89b2-4289-9693-200c10cb2cc8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049838 Sep 06 10:57:36.457221 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 845/1715] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:36.464825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7639ef49-4293-4a57-8286-06c87e36968c tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] Calling method '.version_select at 0x7f90fd0c74c0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:36.542248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3b4e8828-73c1-46e7-b552-bcfc93b6934e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:36.553760 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3b4e8828-73c1-46e7-b552-bcfc93b6934e tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1501 microversion: 2.1 time: 0.272923 Sep 06 10:57:36.560012 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 871/1716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:36 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1501 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:36.995847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:36.997107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:37.027922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:37.028501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:37.037512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:37.043316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:37.043830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:37.044287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:37.105303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:37.117928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:37.118098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:37.119809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lazy-loading 'fault' on Instance uuid 15a5d8f6-b223-4a68-850d-680fe295ae59 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:57:37.246379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0621ebe85c47c383137b4db0814279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce1bf271594425ad60e24f40b3b60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:37.256165 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9160987a-8f62-49a1-bed0-8e1e33e1d7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 200 len: 1322 microversion: 2.1 time: 0.273398 Sep 06 10:57:37.257660 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 872/1717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:36 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:57:37.318013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-17e6d8db-d68f-4bf1-aeb5-4e1606e027bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:37.318674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-17e6d8db-d68f-4bf1-aeb5-4e1606e027bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:37.334391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17e6d8db-d68f-4bf1-aeb5-4e1606e027bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:37.334938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17e6d8db-d68f-4bf1-aeb5-4e1606e027bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:37.335445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17e6d8db-d68f-4bf1-aeb5-4e1606e027bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:37.337109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17e6d8db-d68f-4bf1-aeb5-4e1606e027bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:37.337589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17e6d8db-d68f-4bf1-aeb5-4e1606e027bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:37.338208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17e6d8db-d68f-4bf1-aeb5-4e1606e027bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:37.428557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-17e6d8db-d68f-4bf1-aeb5-4e1606e027bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:37.438868 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-17e6d8db-d68f-4bf1-aeb5-4e1606e027bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1273 microversion: 2.1 time: 0.137286 Sep 06 10:57:37.439858 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 873/1718] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:37 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:37.583525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-72e7db39-6755-4c67-8798-eb3cb55603f3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:37.584363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-72e7db39-6755-4c67-8798-eb3cb55603f3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:37.598619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72e7db39-6755-4c67-8798-eb3cb55603f3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:37.599903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72e7db39-6755-4c67-8798-eb3cb55603f3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:37.600550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72e7db39-6755-4c67-8798-eb3cb55603f3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:37.601450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72e7db39-6755-4c67-8798-eb3cb55603f3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:37.603328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72e7db39-6755-4c67-8798-eb3cb55603f3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:37.604000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72e7db39-6755-4c67-8798-eb3cb55603f3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:37.861034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-72e7db39-6755-4c67-8798-eb3cb55603f3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:37.870093 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-72e7db39-6755-4c67-8798-eb3cb55603f3 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1501 microversion: 2.1 time: 0.292039 Sep 06 10:57:37.871449 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 874/1719] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:37 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1501 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:57:38.011428 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7639ef49-4293-4a57-8286-06c87e36968c tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/4edb9ada-aa75-425b-8b38-9063e93f68e5" status: 202 len: 0 microversion: 2.1 time: 1.552851 Sep 06 10:57:38.012530 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 846/1720] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 10:57:36 2022] DELETE /compute/v2.1/os-floating-ips/4edb9ada-aa75-425b-8b38-9063e93f68e5 => generated 0 bytes in 1555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:57:38.021988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3aeb56b6-2864-47f5-8ddb-18bb04e742a5 tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] Calling method '.version_select at 0x7f90fd131280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:38.347530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1e1f2e69-5013-4308-91b3-fc386d29fed3 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d2b49d6b-8af3-41d2-810f-75dd798e37a5"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:38.348477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1e1f2e69-5013-4308-91b3-fc386d29fed3 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:38.358876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1f2e69-5013-4308-91b3-fc386d29fed3 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:38.361186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1f2e69-5013-4308-91b3-fc386d29fed3 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:38.361852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1f2e69-5013-4308-91b3-fc386d29fed3 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:38.363239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1f2e69-5013-4308-91b3-fc386d29fed3 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:38.363967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1f2e69-5013-4308-91b3-fc386d29fed3 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:38.364634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1f2e69-5013-4308-91b3-fc386d29fed3 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:38.599271 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-1e1f2e69-5013-4308-91b3-fc386d29fed3 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] HTTP exception thrown: Volume d2b49d6b-8af3-41d2-810f-75dd798e37a5 could not be found. Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1e1f2e69-5013-4308-91b3-fc386d29fed3 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Request method failure captured: Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: request: PUT /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-volume_attachments/b57edf85-c27b-464d-bc0d-2e4c9a61792a HTTP/1.1 Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 74 Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFydSmalNBagN2tjar2MI_p4eCTNHfdA5-InOPIrsbBV0DQKnyZxBp4q9SuY9TKb5mCqrn1NMMrdfh8IXhNDvE4G6qn2MbHxbnMFxAliSlZewZuPsdd70WO30FRR1CHGEBeooadIGxig0qpdpKXEoeETuyN7NKWk0-VnTciFCUmwfCzQ Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ff5ee808788043528fdeadc86f89b84d Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-VolumesAdminNegativeTest-536982142 Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff5ee808788043528fdeadc86f89b84d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff5ee808788043528fdeadc86f89b84d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff5ee808788043528fdeadc86f89b84d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff5ee808788043528fdeadc86f89b84d"}]}] Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-VolumesAdminNegativeTest-536982142 Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ff5ee808788043528fdeadc86f89b84d Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-536982142 Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-VolumesAdminNegativeTest-536982142-project-admin Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6a18cb9df0834bf7a271f48f4075ca58 Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-VolumesAdminNegativeTest-536982142-project-admin Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: {"volumeAttachment": {"volumeId": "d2b49d6b-8af3-41d2-810f-75dd798e37a5"}} Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: exception: Volume d2b49d6b-8af3-41d2-810f-75dd798e37a5 could not be found. Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'server_id': 'e343dd1a-4f3b-4da1-9396-5cdc5e1d297a', 'id': 'b57edf85-c27b-464d-bc0d-2e4c9a61792a', 'body': {'volumeAttachment': {'volumeId': 'd2b49d6b-8af3-41d2-810f-75dd798e37a5'}}} Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2b49d6b-8af3-41d2-810f-75dd798e37a5 could not be found. (HTTP 404) (Request-ID: req-18b188a7-068e-402d-9ec9-54c3a18ce3b7) Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 10:57:38.601779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2b49d6b-8af3-41d2-810f-75dd798e37a5 could not be found. Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume d2b49d6b-8af3-41d2-810f-75dd798e37a5 could not be found. Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2b49d6b-8af3-41d2-810f-75dd798e37a5 could not be found. Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1e1f2e69-5013-4308-91b3-fc386d29fed3 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Returning 400 to user: Volume d2b49d6b-8af3-41d2-810f-75dd798e37a5 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1e1f2e69-5013-4308-91b3-fc386d29fed3 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-volume_attachments/b57edf85-c27b-464d-bc0d-2e4c9a61792a" status: 400 len: 107 microversion: 2.1 time: 0.533526 Sep 06 10:57:38.616659 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 847/1721] 10.222.0.20 () {60 vars in 1433 bytes} [Tue Sep 6 10:57:38 2022] PUT /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-volume_attachments/b57edf85-c27b-464d-bc0d-2e4c9a61792a => generated 107 bytes in 535 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:57:38.620721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-31773564-5626-44f2-b2a8-71af2ad6d23d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:38.620721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-31773564-5626-44f2-b2a8-71af2ad6d23d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] [instance: 15a5d8f6-b223-4a68-850d-680fe295ae59] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:38.623526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31773564-5626-44f2-b2a8-71af2ad6d23d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:38.624295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31773564-5626-44f2-b2a8-71af2ad6d23d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:38.624747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31773564-5626-44f2-b2a8-71af2ad6d23d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:38.625929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31773564-5626-44f2-b2a8-71af2ad6d23d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:38.626042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31773564-5626-44f2-b2a8-71af2ad6d23d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:38.626523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31773564-5626-44f2-b2a8-71af2ad6d23d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:38.653203 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-31773564-5626-44f2-b2a8-71af2ad6d23d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] HTTP exception thrown: Instance 15a5d8f6-b223-4a68-850d-680fe295ae59 could not be found. Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-31773564-5626-44f2-b2a8-71af2ad6d23d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Request method failure captured: Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 HTTP/1.1 Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFydpSpFvU4p1fU4wY9regjJX9VOmKkhB-dVPB9ay_URmYdPG_zXJ3y9MOzz9CL-lu2nISyRNiXUTBvRoAiTUgEkVSNtZUjAVYT_lJTUhMhFw5l8QqizhiTMEfeNORNuwZIANg3kwazipM0XFBPiqbemt-dJgNHYLfu6ytIBP0b7_-t4 Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0bce1bf271594425ad60e24f40b3b60d Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0bce1bf271594425ad60e24f40b3b60d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bce1bf271594425ad60e24f40b3b60d"}]}] Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0bce1bf271594425ad60e24f40b3b60d Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 2d0621ebe85c47c383137b4db0814279 Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 15a5d8f6-b223-4a68-850d-680fe295ae59 could not be found. Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '15a5d8f6-b223-4a68-850d-680fe295ae59'} Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a5d8f6-b223-4a68-850d-680fe295ae59 could not be found. Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a5d8f6-b223-4a68-850d-680fe295ae59 could not be found. Sep 06 10:57:38.654888 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:38.661336 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:38.661336 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:38.661336 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:38.661336 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:38.661336 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:38.661336 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:38.661336 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:38.661336 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a5d8f6-b223-4a68-850d-680fe295ae59 could not be found. Sep 06 10:57:38.661336 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:38.661336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-31773564-5626-44f2-b2a8-71af2ad6d23d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] Returning 404 to user: Instance 15a5d8f6-b223-4a68-850d-680fe295ae59 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:38.661336 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-31773564-5626-44f2-b2a8-71af2ad6d23d tempest-FloatingIPsAssociationNegativeTestJSON-1312489389 tempest-FloatingIPsAssociationNegativeTestJSON-1312489389-project] 10.222.0.20 "GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59" status: 404 len: 111 microversion: 2.1 time: 0.051697 Sep 06 10:57:38.661336 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 848/1722] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:38 2022] GET /compute/v2.1/servers/15a5d8f6-b223-4a68-850d-680fe295ae59 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:57:38.684434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d92e9c93-595e-447a-a7be-00cf6fc0a86d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:38.684434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d92e9c93-595e-447a-a7be-00cf6fc0a86d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:38.684434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d92e9c93-595e-447a-a7be-00cf6fc0a86d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:38.684434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d92e9c93-595e-447a-a7be-00cf6fc0a86d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:38.684886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d92e9c93-595e-447a-a7be-00cf6fc0a86d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:38.685431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d92e9c93-595e-447a-a7be-00cf6fc0a86d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:38.686104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d92e9c93-595e-447a-a7be-00cf6fc0a86d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:38.686697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d92e9c93-595e-447a-a7be-00cf6fc0a86d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:39.098633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d92e9c93-595e-447a-a7be-00cf6fc0a86d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:39.108526 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d92e9c93-595e-447a-a7be-00cf6fc0a86d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1315 microversion: 2.1 time: 0.445135 Sep 06 10:57:39.109531 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 849/1723] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:38 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:39.115150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56a18732-702b-4ff0-b864-084d941f5456 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:39.115924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56a18732-702b-4ff0-b864-084d941f5456 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:39.122165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56a18732-702b-4ff0-b864-084d941f5456 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:39.122917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56a18732-702b-4ff0-b864-084d941f5456 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:39.123610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56a18732-702b-4ff0-b864-084d941f5456 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:39.124729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56a18732-702b-4ff0-b864-084d941f5456 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:39.125403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56a18732-702b-4ff0-b864-084d941f5456 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:39.126039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56a18732-702b-4ff0-b864-084d941f5456 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:39.267439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-56a18732-702b-4ff0-b864-084d941f5456 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lazy-loading 'services' on Instance uuid e343dd1a-4f3b-4da1-9396-5cdc5e1d297a {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:57:39.552457 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56a18732-702b-4ff0-b864-084d941f5456 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-volume_attachments/b57edf85-c27b-464d-bc0d-2e4c9a61792a" status: 202 len: 0 microversion: 2.1 time: 0.435245 Sep 06 10:57:39.553367 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 850/1724] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 10:57:39 2022] DELETE /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-volume_attachments/b57edf85-c27b-464d-bc0d-2e4c9a61792a => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:57:39.560643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2e231c1e-b040-4515-acda-48ec8963c97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:39.561962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2e231c1e-b040-4515-acda-48ec8963c97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:39.572053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e231c1e-b040-4515-acda-48ec8963c97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:39.572904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e231c1e-b040-4515-acda-48ec8963c97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:39.573734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e231c1e-b040-4515-acda-48ec8963c97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:39.574817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e231c1e-b040-4515-acda-48ec8963c97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:39.575499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e231c1e-b040-4515-acda-48ec8963c97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:39.576117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e231c1e-b040-4515-acda-48ec8963c97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:39.629358 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3aeb56b6-2864-47f5-8ddb-18bb04e742a5 tempest-FloatingIPDetailsTestJSON-905498391 tempest-FloatingIPDetailsTestJSON-905498391-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/64424ad0-1fe9-45e4-ab3a-42a2833ba18e" status: 202 len: 0 microversion: 2.1 time: 1.612921 Sep 06 10:57:39.630506 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 875/1725] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 10:57:38 2022] DELETE /compute/v2.1/os-floating-ips/64424ad0-1fe9-45e4-ab3a-42a2833ba18e => generated 0 bytes in 1614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:57:39.635244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1520632307", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3d4af992-111f-451f-ba0f-1750f5aa94d6"}], "block_device_mapping_v2": [{"uuid": "459d4725-1cec-496c-b653-8fc2acd7f1d1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:39.722063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] validate_networks() for [('3d4af992-111f-451f-ba0f-1750f5aa94d6', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:57:40.387938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2e231c1e-b040-4515-acda-48ec8963c97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:40.396317 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2e231c1e-b040-4515-acda-48ec8963c97d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1488 microversion: 2.1 time: 0.840509 Sep 06 10:57:40.397233 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 851/1726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:39 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1488 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:40.403247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d172e84b-8244-446f-b166-6c5a10361591 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:40.409089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d172e84b-8244-446f-b166-6c5a10361591 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:40.418036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d172e84b-8244-446f-b166-6c5a10361591 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:40.420377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d172e84b-8244-446f-b166-6c5a10361591 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:40.421079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d172e84b-8244-446f-b166-6c5a10361591 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:40.422645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d172e84b-8244-446f-b166-6c5a10361591 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:40.423359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d172e84b-8244-446f-b166-6c5a10361591 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:40.424034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d172e84b-8244-446f-b166-6c5a10361591 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:40.474941 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d172e84b-8244-446f-b166-6c5a10361591 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076599 Sep 06 10:57:40.475875 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 852/1727] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 10:57:40 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:40.480856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5b2c0a96-801e-4a50-aad3-bca85b204904 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:40.481744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5b2c0a96-801e-4a50-aad3-bca85b204904 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:40.489761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b2c0a96-801e-4a50-aad3-bca85b204904 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:40.490528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b2c0a96-801e-4a50-aad3-bca85b204904 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:40.491222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b2c0a96-801e-4a50-aad3-bca85b204904 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:40.492197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b2c0a96-801e-4a50-aad3-bca85b204904 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:40.492961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b2c0a96-801e-4a50-aad3-bca85b204904 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:40.493618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b2c0a96-801e-4a50-aad3-bca85b204904 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:40.787206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5b2c0a96-801e-4a50-aad3-bca85b204904 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:40.796595 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5b2c0a96-801e-4a50-aad3-bca85b204904 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1315 microversion: 2.1 time: 0.319501 Sep 06 10:57:40.797270 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 853/1728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:40 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:40.802859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7faa6687-0cb2-453b-8dc4-bf45aee5ab7f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:40.803624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7faa6687-0cb2-453b-8dc4-bf45aee5ab7f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:40.810508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7faa6687-0cb2-453b-8dc4-bf45aee5ab7f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:40.811779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7faa6687-0cb2-453b-8dc4-bf45aee5ab7f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:40.812493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7faa6687-0cb2-453b-8dc4-bf45aee5ab7f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:40.814024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7faa6687-0cb2-453b-8dc4-bf45aee5ab7f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:40.814600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7faa6687-0cb2-453b-8dc4-bf45aee5ab7f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:40.815402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7faa6687-0cb2-453b-8dc4-bf45aee5ab7f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:40.844265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7faa6687-0cb2-453b-8dc4-bf45aee5ab7f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:57:40.948842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:57:40.949478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:57:40.950100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:57:40.950586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:57:40.951059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:57:40.966310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:40.966862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:40.967308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:40.968262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:40.968729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:40.969570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:40.995977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Getting quotas for project 437799e22df2433a83eca67987e942c6. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:57:41.004272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Getting quotas for user d9f88a4c72854cff9bba7ed2920f55b0 and project 437799e22df2433a83eca67987e942c6. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:57:41.096675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:57:41.099540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='459d4725-1cec-496c-b653-8fc2acd7f1d1',volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:57:41.252872 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7faa6687-0cb2-453b-8dc4-bf45aee5ab7f tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 204 len: 0 microversion: 2.1 time: 0.453954 Sep 06 10:57:41.254705 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 854/1729] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:57:40 2022] DELETE /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:57:41.261591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ce4c336d-7395-4ca6-a9ae-64d0038b472f req-f38bf760-1984-47ce-8a37-2f9636c88df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26309c50-a09b-444e-ab44-913b9a12e5ec", "tag": "c0533523-b128-42c1-a597-a3347cdaa7a1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:41.280073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ce4c336d-7395-4ca6-a9ae-64d0038b472f req-f38bf760-1984-47ce-8a37-2f9636c88df4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:41.283663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ce4c336d-7395-4ca6-a9ae-64d0038b472f req-f38bf760-1984-47ce-8a37-2f9636c88df4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:41.285449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ce4c336d-7395-4ca6-a9ae-64d0038b472f req-f38bf760-1984-47ce-8a37-2f9636c88df4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:41.306074 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ce4c336d-7395-4ca6-a9ae-64d0038b472f req-f38bf760-1984-47ce-8a37-2f9636c88df4 service nova] Creating event network-changed:c0533523-b128-42c1-a597-a3347cdaa7a1 for instance 26309c50-a09b-444e-ab44-913b9a12e5ec on nch1-master-1 Sep 06 10:57:41.315821 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ce4c336d-7395-4ca6-a9ae-64d0038b472f req-f38bf760-1984-47ce-8a37-2f9636c88df4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055708 Sep 06 10:57:41.319728 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 855/1730] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:41.330891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b5c43b4-37db-4e60-89fc-87eca0c12db0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90fd0c70d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:41.369006 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-2b5c43b4-37db-4e60-89fc-87eca0c12db0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] HTTP exception thrown: Image not found. Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b5c43b4-37db-4e60-89fc-87eca0c12db0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Request method failure captured: Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/images/6b6dc568-c462-4fa8-b70d-902df5dbd97d HTTP/1.1 Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyaZA-uiP_RRwyKTpstMq_snN96l4NBAuLpTvUZXZaKkL1nlZPUmB1vY0-_vC4QTS7mBpHk0ByEBb7R-iDxblWfftnB-3EEXfNuNabkEp42rTgFGIHdZFF0Gft6oS7QJVWWEjjoPA1_r2rWah96Ux-IMCZQ9Fe_MDHzU_JnwOMegYHM Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}] Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesTestJSON-232185986 Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d79046739b2d4572b0aedef59e621ab8 Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: exception: Image not found. Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '6b6dc568-c462-4fa8-b70d-902df5dbd97d'} Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6b6dc568-c462-4fa8-b70d-902df5dbd97d to delete Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6b6dc568-c462-4fa8-b70d-902df5dbd97d could not be found. Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:41.372929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:57:41.378378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:41.380905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b5c43b4-37db-4e60-89fc-87eca0c12db0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Returning 404 to user: Image not found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:41.382072 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b5c43b4-37db-4e60-89fc-87eca0c12db0 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/images/6b6dc568-c462-4fa8-b70d-902df5dbd97d" status: 404 len: 62 microversion: 2.1 time: 0.059863 Sep 06 10:57:41.386037 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 856/1731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:41 2022] DELETE /compute/v2.1/images/6b6dc568-c462-4fa8-b70d-902df5dbd97d => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:57:41.398161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dc7f08ce-e681-4f8f-a24e-f02dbf6905a6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:41.400111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dc7f08ce-e681-4f8f-a24e-f02dbf6905a6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:41.411915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc7f08ce-e681-4f8f-a24e-f02dbf6905a6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:41.412768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc7f08ce-e681-4f8f-a24e-f02dbf6905a6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:41.413360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc7f08ce-e681-4f8f-a24e-f02dbf6905a6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:41.414778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc7f08ce-e681-4f8f-a24e-f02dbf6905a6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:41.415603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc7f08ce-e681-4f8f-a24e-f02dbf6905a6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:41.416335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc7f08ce-e681-4f8f-a24e-f02dbf6905a6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:41.459119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dc7f08ce-e681-4f8f-a24e-f02dbf6905a6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:57:41.513393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:41.675857 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.compute.api [None req-dc7f08ce-e681-4f8f-a24e-f02dbf6905a6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Instance is already in deleting state, ignoring this request Sep 06 10:57:41.675857 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dc7f08ce-e681-4f8f-a24e-f02dbf6905a6 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 204 len: 0 microversion: 2.1 time: 0.283808 Sep 06 10:57:41.679042 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 857/1732] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:57:41 2022] DELETE /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:57:41.685686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3b12c9d8-cc22-41b7-b150-56df1e957e6b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:41.688831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3b12c9d8-cc22-41b7-b150-56df1e957e6b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:41.696034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b12c9d8-cc22-41b7-b150-56df1e957e6b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:41.696626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b12c9d8-cc22-41b7-b150-56df1e957e6b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:41.697534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b12c9d8-cc22-41b7-b150-56df1e957e6b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:41.698738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b12c9d8-cc22-41b7-b150-56df1e957e6b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:41.714479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b12c9d8-cc22-41b7-b150-56df1e957e6b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:41.714479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b12c9d8-cc22-41b7-b150-56df1e957e6b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:41.763387 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3b12c9d8-cc22-41b7-b150-56df1e957e6b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082848 Sep 06 10:57:41.764323 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 858/1733] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 10:57:41 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:41.769478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3dc35ab2-e009-4928-ab71-9092b844133d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:41.770235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3dc35ab2-e009-4928-ab71-9092b844133d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:41.776886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3dc35ab2-e009-4928-ab71-9092b844133d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:41.778013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3dc35ab2-e009-4928-ab71-9092b844133d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:41.778693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3dc35ab2-e009-4928-ab71-9092b844133d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:41.780414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3dc35ab2-e009-4928-ab71-9092b844133d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:41.781210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3dc35ab2-e009-4928-ab71-9092b844133d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:41.782166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3dc35ab2-e009-4928-ab71-9092b844133d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:41.858067 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6467fc7c-fa10-43fa-845d-79a500a19435 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.226150 Sep 06 10:57:41.858767 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 876/1734] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 10:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 10:57:41.865319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-43f9146a-3f46-4b39-aabb-0c159e427e92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:41.866645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-43f9146a-3f46-4b39-aabb-0c159e427e92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:41.903680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43f9146a-3f46-4b39-aabb-0c159e427e92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:41.903680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43f9146a-3f46-4b39-aabb-0c159e427e92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:41.903680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43f9146a-3f46-4b39-aabb-0c159e427e92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:41.915260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43f9146a-3f46-4b39-aabb-0c159e427e92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:41.916036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43f9146a-3f46-4b39-aabb-0c159e427e92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:41.916700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43f9146a-3f46-4b39-aabb-0c159e427e92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:42.154670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3dc35ab2-e009-4928-ab71-9092b844133d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:42.173872 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3dc35ab2-e009-4928-ab71-9092b844133d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1494 microversion: 2.1 time: 0.408136 Sep 06 10:57:42.175597 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 859/1735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:41 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1494 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:42.188575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-82b629ea-8d32-45d5-aab6-dc0e164cde85 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:42.188575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-82b629ea-8d32-45d5-aab6-dc0e164cde85 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:42.339178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-43f9146a-3f46-4b39-aabb-0c159e427e92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:42.351100 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-43f9146a-3f46-4b39-aabb-0c159e427e92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1315 microversion: 2.1 time: 0.490756 Sep 06 10:57:42.368086 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 877/1736] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:41 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:42.368221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-82b629ea-8d32-45d5-aab6-dc0e164cde85 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:42.368357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-6bb6d86d-562d-4130-a0fa-e852417f3bfb req-584e9c68-5438-4c9c-94a0-a6dcce9a49d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d7d4ff-23fc-489c-ac1d-2806d273aaee", "name": "network-vif-unplugged", "status": "completed", "tag": "6897d614-de4c-4743-8ed8-e00cec490776"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:42.374617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-82b629ea-8d32-45d5-aab6-dc0e164cde85 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:42.375114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6bb6d86d-562d-4130-a0fa-e852417f3bfb req-584e9c68-5438-4c9c-94a0-a6dcce9a49d0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:42.375672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6bb6d86d-562d-4130-a0fa-e852417f3bfb req-584e9c68-5438-4c9c-94a0-a6dcce9a49d0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:42.376120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6bb6d86d-562d-4130-a0fa-e852417f3bfb req-584e9c68-5438-4c9c-94a0-a6dcce9a49d0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:42.382864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-82b629ea-8d32-45d5-aab6-dc0e164cde85 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:42.386403 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-82b629ea-8d32-45d5-aab6-dc0e164cde85 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1104 microversion: 2.25 time: 0.209614 Sep 06 10:57:42.387131 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 860/1737] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:57:42 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1104 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:57:42.390062 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-6bb6d86d-562d-4130-a0fa-e852417f3bfb req-584e9c68-5438-4c9c-94a0-a6dcce9a49d0 service nova] Creating event network-vif-unplugged:6897d614-de4c-4743-8ed8-e00cec490776 for instance 93d7d4ff-23fc-489c-ac1d-2806d273aaee on nch2-master-1 Sep 06 10:57:42.402011 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-6bb6d86d-562d-4130-a0fa-e852417f3bfb req-584e9c68-5438-4c9c-94a0-a6dcce9a49d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048616 Sep 06 10:57:42.402851 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 878/1738] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:42.783199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84022ac9-f7a5-45b2-b103-b35990482d32 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:42.785454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-84022ac9-f7a5-45b2-b103-b35990482d32 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:42.795725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84022ac9-f7a5-45b2-b103-b35990482d32 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:42.796732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84022ac9-f7a5-45b2-b103-b35990482d32 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:42.797355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84022ac9-f7a5-45b2-b103-b35990482d32 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:42.798263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84022ac9-f7a5-45b2-b103-b35990482d32 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:42.799107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84022ac9-f7a5-45b2-b103-b35990482d32 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:42.799532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84022ac9-f7a5-45b2-b103-b35990482d32 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:42.846863 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84022ac9-f7a5-45b2-b103-b35990482d32 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071141 Sep 06 10:57:42.857217 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 861/1739] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 10:57:42 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:57:43.201446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-db2d642f-b54a-4c2f-a2d4-0e75f4cf1725 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:43.202176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-db2d642f-b54a-4c2f-a2d4-0e75f4cf1725 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:43.215107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db2d642f-b54a-4c2f-a2d4-0e75f4cf1725 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:43.215617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db2d642f-b54a-4c2f-a2d4-0e75f4cf1725 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:43.216070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db2d642f-b54a-4c2f-a2d4-0e75f4cf1725 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:43.216818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db2d642f-b54a-4c2f-a2d4-0e75f4cf1725 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:43.217282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db2d642f-b54a-4c2f-a2d4-0e75f4cf1725 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:43.217711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db2d642f-b54a-4c2f-a2d4-0e75f4cf1725 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:43.233142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-905693252", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "54983ae4-8ab3-43bc-80e4-fdbaba018ae6"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:43.383955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] validate_networks() for [('54983ae4-8ab3-43bc-80e4-fdbaba018ae6', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:57:43.889557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-db2d642f-b54a-4c2f-a2d4-0e75f4cf1725 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:43.902775 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-db2d642f-b54a-4c2f-a2d4-0e75f4cf1725 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1494 microversion: 2.1 time: 0.702976 Sep 06 10:57:43.908619 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 879/1740] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:43 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1494 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:43.923356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0111fb1b-0ca6-4dd3-9810-3ef67f5b28e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:43.930681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0111fb1b-0ca6-4dd3-9810-3ef67f5b28e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:43.940285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0111fb1b-0ca6-4dd3-9810-3ef67f5b28e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:43.941351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0111fb1b-0ca6-4dd3-9810-3ef67f5b28e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:43.941802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0111fb1b-0ca6-4dd3-9810-3ef67f5b28e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:43.942533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0111fb1b-0ca6-4dd3-9810-3ef67f5b28e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:43.942999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0111fb1b-0ca6-4dd3-9810-3ef67f5b28e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:43.943463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0111fb1b-0ca6-4dd3-9810-3ef67f5b28e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:44.905498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0111fb1b-0ca6-4dd3-9810-3ef67f5b28e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:44.928636 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0111fb1b-0ca6-4dd3-9810-3ef67f5b28e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1315 microversion: 2.1 time: 1.006316 Sep 06 10:57:44.929246 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 880/1741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:43 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1315 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:44.948649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f3b9155f-ae44-4a63-8298-768c2ed01e36 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:44.949823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f3b9155f-ae44-4a63-8298-768c2ed01e36 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:44.983667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3b9155f-ae44-4a63-8298-768c2ed01e36 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:44.988122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3b9155f-ae44-4a63-8298-768c2ed01e36 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:44.989683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3b9155f-ae44-4a63-8298-768c2ed01e36 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:44.993954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3b9155f-ae44-4a63-8298-768c2ed01e36 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:44.994712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3b9155f-ae44-4a63-8298-768c2ed01e36 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:44.995533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3b9155f-ae44-4a63-8298-768c2ed01e36 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:45.009547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:45.355619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:57:45.356261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:57:45.357108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:57:45.357553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:57:45.357956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:57:45.375990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:45.376562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:45.381004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:45.381925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:45.382619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:45.388140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:45.418230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f3b9155f-ae44-4a63-8298-768c2ed01e36 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:45.424235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Getting quotas for project 740286d1464549609e6d4b3280aa50ce. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:57:45.430039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f3b9155f-ae44-4a63-8298-768c2ed01e36 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:45.432262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Getting quotas for user 6c557446cb39475dba1fc800d061b9e1 and project 740286d1464549609e6d4b3280aa50ce. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:57:45.434318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f3b9155f-ae44-4a63-8298-768c2ed01e36 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:45.443940 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f3b9155f-ae44-4a63-8298-768c2ed01e36 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1241 microversion: 2.25 time: 0.504324 Sep 06 10:57:45.450259 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 881/1742] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:57:44 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1241 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:57:45.455545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1794945383", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "83241706-ada5-4425-9544-55285e98247c"}], "block_device_mapping_v2": [{"uuid": "1387fcb2-03ec-4750-9f21-2c9d8cb814a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:45.502284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:57:45.533831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:57:45.625248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] validate_networks() for [('83241706-ada5-4425-9544-55285e98247c', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:57:45.730751 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1b6bb7b9-dd3f-4937-8657-8d0140b14f1b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.501988 Sep 06 10:57:45.731777 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 862/1743] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:57:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:57:45.752129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9aeb7e0-3556-407a-a703-968bc37e91b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:45.754159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e9aeb7e0-3556-407a-a703-968bc37e91b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:45.772389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9aeb7e0-3556-407a-a703-968bc37e91b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:45.772750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9aeb7e0-3556-407a-a703-968bc37e91b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:45.773107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9aeb7e0-3556-407a-a703-968bc37e91b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:45.773709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9aeb7e0-3556-407a-a703-968bc37e91b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:45.774188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9aeb7e0-3556-407a-a703-968bc37e91b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:45.777172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9aeb7e0-3556-407a-a703-968bc37e91b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:46.093126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e9aeb7e0-3556-407a-a703-968bc37e91b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79046739b2d4572b0aedef59e621ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e047ab9362dc476c9a4b4aee7223d042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:46.105460 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e9aeb7e0-3556-407a-a703-968bc37e91b2 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 200 len: 1452 microversion: 2.1 time: 0.372390 Sep 06 10:57:46.107807 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 863/1744] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:45 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 1452 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:46.136774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e3aa2a36-7aa8-48ce-a3c4-fc04d90e055e req-b6b42a0c-05ba-4772-a4c2-99b0502b3773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d7d4ff-23fc-489c-ac1d-2806d273aaee", "name": "network-vif-deleted", "tag": "6897d614-de4c-4743-8ed8-e00cec490776"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:46.168170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e3aa2a36-7aa8-48ce-a3c4-fc04d90e055e req-b6b42a0c-05ba-4772-a4c2-99b0502b3773 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:46.168670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e3aa2a36-7aa8-48ce-a3c4-fc04d90e055e req-b6b42a0c-05ba-4772-a4c2-99b0502b3773 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:46.171133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e3aa2a36-7aa8-48ce-a3c4-fc04d90e055e req-b6b42a0c-05ba-4772-a4c2-99b0502b3773 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:46.209309 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e3aa2a36-7aa8-48ce-a3c4-fc04d90e055e req-b6b42a0c-05ba-4772-a4c2-99b0502b3773 service nova] Creating event network-vif-deleted:6897d614-de4c-4743-8ed8-e00cec490776 for instance 93d7d4ff-23fc-489c-ac1d-2806d273aaee on nch2-master-1 Sep 06 10:57:46.221348 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e3aa2a36-7aa8-48ce-a3c4-fc04d90e055e req-b6b42a0c-05ba-4772-a4c2-99b0502b3773 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110291 Sep 06 10:57:46.222843 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 864/1745] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:46.242295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bb832017-0528-4225-9643-e44d6bdc7ca3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:46.243128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bb832017-0528-4225-9643-e44d6bdc7ca3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:46.676753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bb832017-0528-4225-9643-e44d6bdc7ca3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:46.688315 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bb832017-0528-4225-9643-e44d6bdc7ca3 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1217 microversion: 2.1 time: 0.460775 Sep 06 10:57:46.692288 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 865/1746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:46 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1217 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:46.722810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c5301a4a-b130-4a94-8f36-3e3a3e5e871f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:46.723474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c5301a4a-b130-4a94-8f36-3e3a3e5e871f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:46.732184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5301a4a-b130-4a94-8f36-3e3a3e5e871f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:46.733007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5301a4a-b130-4a94-8f36-3e3a3e5e871f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:46.734486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5301a4a-b130-4a94-8f36-3e3a3e5e871f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:46.735777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5301a4a-b130-4a94-8f36-3e3a3e5e871f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:46.739362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5301a4a-b130-4a94-8f36-3e3a3e5e871f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:46.739362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5301a4a-b130-4a94-8f36-3e3a3e5e871f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:47.360895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c5301a4a-b130-4a94-8f36-3e3a3e5e871f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:47.364709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:57:47.365224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:57:47.365595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:57:47.366010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:57:47.366421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:57:47.385135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:47.387261 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c5301a4a-b130-4a94-8f36-3e3a3e5e871f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1315 microversion: 2.1 time: 0.679260 Sep 06 10:57:47.396001 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 866/1747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:46 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:47.398515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:47.402211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:47.403615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:47.404266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:47.404868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:47.442458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fb088d3a-c40d-4cb5-86b9-a3197bbe4e7f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:47.443310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb088d3a-c40d-4cb5-86b9-a3197bbe4e7f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:47.443760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Getting quotas for project fb1af95268504c5bbed702fce756f5f4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:57:47.461265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Getting quotas for user c4e1ac1b40e94dbc80548a1f45919b6f and project fb1af95268504c5bbed702fce756f5f4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:57:47.470945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb088d3a-c40d-4cb5-86b9-a3197bbe4e7f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:47.476342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb088d3a-c40d-4cb5-86b9-a3197bbe4e7f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:47.477169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb088d3a-c40d-4cb5-86b9-a3197bbe4e7f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:47.478219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb088d3a-c40d-4cb5-86b9-a3197bbe4e7f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:47.478954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb088d3a-c40d-4cb5-86b9-a3197bbe4e7f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:47.479855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb088d3a-c40d-4cb5-86b9-a3197bbe4e7f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:47.572467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:57:47.575151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1387fcb2-03ec-4750-9f21-2c9d8cb814a8',volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:57:47.971523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb088d3a-c40d-4cb5-86b9-a3197bbe4e7f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:48.007238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb088d3a-c40d-4cb5-86b9-a3197bbe4e7f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:48.009482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb088d3a-c40d-4cb5-86b9-a3197bbe4e7f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:48.018281 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fb088d3a-c40d-4cb5-86b9-a3197bbe4e7f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1293 microversion: 2.25 time: 0.608867 Sep 06 10:57:48.019994 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 867/1748] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:57:47 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1293 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:57:48.027880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-be82425a-6486-4d0a-9e55-2805e7c864a7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:48.028831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-be82425a-6486-4d0a-9e55-2805e7c864a7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 93d7d4ff-23fc-489c-ac1d-2806d273aaee] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:48.036439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be82425a-6486-4d0a-9e55-2805e7c864a7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.037261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be82425a-6486-4d0a-9e55-2805e7c864a7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.037913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be82425a-6486-4d0a-9e55-2805e7c864a7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.038822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be82425a-6486-4d0a-9e55-2805e7c864a7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.039469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be82425a-6486-4d0a-9e55-2805e7c864a7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.040378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be82425a-6486-4d0a-9e55-2805e7c864a7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.063926 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-be82425a-6486-4d0a-9e55-2805e7c864a7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] HTTP exception thrown: Instance 93d7d4ff-23fc-489c-ac1d-2806d273aaee could not be found. Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-be82425a-6486-4d0a-9e55-2805e7c864a7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Request method failure captured: Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee HTTP/1.1 Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyaZA-uiP_RRwyKTpstMq_snN96l4NBAuLpTvUZXZaKkL1nlZPUmB1vY0-_vC4QTS7mBpHk0ByEBb7R-iDxblWfftnB-3EEXfNuNabkEp42rTgFGIHdZFF0Gft6oS7QJVWWEjjoPA1_r2rWah96Ux-IMCZQ9Fe_MDHzU_JnwOMegYHM Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}] Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d79046739b2d4572b0aedef59e621ab8 Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 93d7d4ff-23fc-489c-ac1d-2806d273aaee could not be found. Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '93d7d4ff-23fc-489c-ac1d-2806d273aaee'} Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d7d4ff-23fc-489c-ac1d-2806d273aaee could not be found. Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d7d4ff-23fc-489c-ac1d-2806d273aaee could not be found. Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.066120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.080899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.080899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.080899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:48.080899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:48.080899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d7d4ff-23fc-489c-ac1d-2806d273aaee could not be found. Sep 06 10:57:48.080899 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.080899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-be82425a-6486-4d0a-9e55-2805e7c864a7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Returning 404 to user: Instance 93d7d4ff-23fc-489c-ac1d-2806d273aaee could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:48.083369 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-be82425a-6486-4d0a-9e55-2805e7c864a7 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee" status: 404 len: 111 microversion: 2.1 time: 0.062028 Sep 06 10:57:48.084112 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 868/1749] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:48 2022] GET /compute/v2.1/servers/93d7d4ff-23fc-489c-ac1d-2806d273aaee => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:57:48.095690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c6b04194-96e6-4056-a3ff-89586437bd63 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:48.097130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c6b04194-96e6-4056-a3ff-89586437bd63 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:48.122111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6b04194-96e6-4056-a3ff-89586437bd63 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.123354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6b04194-96e6-4056-a3ff-89586437bd63 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.126329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6b04194-96e6-4056-a3ff-89586437bd63 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.126329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6b04194-96e6-4056-a3ff-89586437bd63 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.127697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6b04194-96e6-4056-a3ff-89586437bd63 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.128951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6b04194-96e6-4056-a3ff-89586437bd63 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.247537 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.800581 Sep 06 10:57:48.250239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c6b04194-96e6-4056-a3ff-89586437bd63 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:48.250440 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 882/1750] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:57:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:57:48.270995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4bfea607-5057-4d04-a2cd-cda26b39028a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f89d7a60>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:48.271282 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c6b04194-96e6-4056-a3ff-89586437bd63 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1269 microversion: 2.1 time: 0.179960 Sep 06 10:57:48.290404 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 869/1751] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:48 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:48.290404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f85ded58-db77-4705-a3ac-2711e0344da1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:48.290404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f85ded58-db77-4705-a3ac-2711e0344da1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:48.369720 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-4bfea607-5057-4d04-a2cd-cda26b39028a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] HTTP exception thrown: Image not found. Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4bfea607-5057-4d04-a2cd-cda26b39028a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Request method failure captured: Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 HTTP/1.1 Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaZA-uiP_RRwyKTpstMq_snN96l4NBAuLpTvUZXZaKkL1nlZPUmB1vY0-_vC4QTS7mBpHk0ByEBb7R-iDxblWfftnB-3EEXfNuNabkEp42rTgFGIHdZFF0Gft6oS7QJVWWEjjoPA1_r2rWah96Ux-IMCZQ9Fe_MDHzU_JnwOMegYHM Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}] Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d79046739b2d4572b0aedef59e621ab8 Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: exception: Image not found. Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '62164f9d-fd1e-4b2e-89df-1397c81a2986'} Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 62164f9d-fd1e-4b2e-89df-1397c81a2986 to delete Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62164f9d-fd1e-4b2e-89df-1397c81a2986 could not be found. Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.372140 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4bfea607-5057-4d04-a2cd-cda26b39028a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Returning 404 to user: Image not found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4bfea607-5057-4d04-a2cd-cda26b39028a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986" status: 404 len: 62 microversion: 2.1 time: 0.121911 Sep 06 10:57:48.386067 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 883/1752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:48 2022] DELETE /compute/v2.1/images/62164f9d-fd1e-4b2e-89df-1397c81a2986 => generated 62 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:57:48.388628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5cdaece6-f39c-4c4a-9711-a1d17eea8ae9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:48.389990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5cdaece6-f39c-4c4a-9711-a1d17eea8ae9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:48.409154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5cdaece6-f39c-4c4a-9711-a1d17eea8ae9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.409736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5cdaece6-f39c-4c4a-9711-a1d17eea8ae9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.410451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5cdaece6-f39c-4c4a-9711-a1d17eea8ae9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.411318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5cdaece6-f39c-4c4a-9711-a1d17eea8ae9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.412017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5cdaece6-f39c-4c4a-9711-a1d17eea8ae9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.412536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5cdaece6-f39c-4c4a-9711-a1d17eea8ae9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.421763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f85ded58-db77-4705-a3ac-2711e0344da1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:48.429926 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-5cdaece6-f39c-4c4a-9711-a1d17eea8ae9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] HTTP exception thrown: Instance 937289ab-8f49-410a-8477-7f970832616f could not be found. Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5cdaece6-f39c-4c4a-9711-a1d17eea8ae9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Request method failure captured: Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f HTTP/1.1 Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaZA-uiP_RRwyKTpstMq_snN96l4NBAuLpTvUZXZaKkL1nlZPUmB1vY0-_vC4QTS7mBpHk0ByEBb7R-iDxblWfftnB-3EEXfNuNabkEp42rTgFGIHdZFF0Gft6oS7QJVWWEjjoPA1_r2rWah96Ux-IMCZQ9Fe_MDHzU_JnwOMegYHM Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}] Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d79046739b2d4572b0aedef59e621ab8 Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 937289ab-8f49-410a-8477-7f970832616f could not be found. Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '937289ab-8f49-410a-8477-7f970832616f'} Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937289ab-8f49-410a-8477-7f970832616f could not be found. Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:57:48.431769 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937289ab-8f49-410a-8477-7f970832616f could not be found. Sep 06 10:57:48.436308 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.436308 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.436308 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.436308 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.436308 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.436308 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.436308 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:48.436308 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:48.436308 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937289ab-8f49-410a-8477-7f970832616f could not be found. Sep 06 10:57:48.436308 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.437387 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f85ded58-db77-4705-a3ac-2711e0344da1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1053 microversion: 2.1 time: 0.153948 Sep 06 10:57:48.437481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5cdaece6-f39c-4c4a-9711-a1d17eea8ae9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Returning 404 to user: Instance 937289ab-8f49-410a-8477-7f970832616f could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:48.437481 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5cdaece6-f39c-4c4a-9711-a1d17eea8ae9 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 404 len: 111 microversion: 2.1 time: 0.053357 Sep 06 10:57:48.437657 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 870/1753] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:48 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1053 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:48.438717 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 884/1754] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:57:48 2022] DELETE /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:57:48.444169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c18d7267-5162-4532-9c96-f86610a5a027 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:48.444915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c18d7267-5162-4532-9c96-f86610a5a027 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: 937289ab-8f49-410a-8477-7f970832616f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:48.445392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8b2ce0d7-4240-4acd-9c3b-44f0bb109060 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:48.446010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8b2ce0d7-4240-4acd-9c3b-44f0bb109060 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:48.451824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c18d7267-5162-4532-9c96-f86610a5a027 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.452672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c18d7267-5162-4532-9c96-f86610a5a027 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.454980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c18d7267-5162-4532-9c96-f86610a5a027 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.454980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c18d7267-5162-4532-9c96-f86610a5a027 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.454980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c18d7267-5162-4532-9c96-f86610a5a027 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.455782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c18d7267-5162-4532-9c96-f86610a5a027 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.463543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8b2ce0d7-4240-4acd-9c3b-44f0bb109060 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.464213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8b2ce0d7-4240-4acd-9c3b-44f0bb109060 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.464661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8b2ce0d7-4240-4acd-9c3b-44f0bb109060 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.465379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8b2ce0d7-4240-4acd-9c3b-44f0bb109060 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.465842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8b2ce0d7-4240-4acd-9c3b-44f0bb109060 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.466290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8b2ce0d7-4240-4acd-9c3b-44f0bb109060 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.478797 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-c18d7267-5162-4532-9c96-f86610a5a027 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] HTTP exception thrown: Instance 937289ab-8f49-410a-8477-7f970832616f could not be found. Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c18d7267-5162-4532-9c96-f86610a5a027 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Request method failure captured: Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f HTTP/1.1 Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaZA-uiP_RRwyKTpstMq_snN96l4NBAuLpTvUZXZaKkL1nlZPUmB1vY0-_vC4QTS7mBpHk0ByEBb7R-iDxblWfftnB-3EEXfNuNabkEp42rTgFGIHdZFF0Gft6oS7QJVWWEjjoPA1_r2rWah96Ux-IMCZQ9Fe_MDHzU_JnwOMegYHM Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}] Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d79046739b2d4572b0aedef59e621ab8 Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 937289ab-8f49-410a-8477-7f970832616f could not be found. Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '937289ab-8f49-410a-8477-7f970832616f'} Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937289ab-8f49-410a-8477-7f970832616f could not be found. Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937289ab-8f49-410a-8477-7f970832616f could not be found. Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.481281 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.486558 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.486558 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.486558 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:48.486558 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:48.486558 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937289ab-8f49-410a-8477-7f970832616f could not be found. Sep 06 10:57:48.486558 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.493677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c18d7267-5162-4532-9c96-f86610a5a027 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Returning 404 to user: Instance 937289ab-8f49-410a-8477-7f970832616f could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:48.493677 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c18d7267-5162-4532-9c96-f86610a5a027 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f" status: 404 len: 111 microversion: 2.1 time: 0.050512 Sep 06 10:57:48.494699 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 885/1755] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:48 2022] GET /compute/v2.1/servers/937289ab-8f49-410a-8477-7f970832616f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:57:48.500620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-daf1c9d0-d466-4f40-b2b0-19182f253079 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8a854c0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-daf1c9d0-d466-4f40-b2b0-19182f253079 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] HTTP exception thrown: Image not found. Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-daf1c9d0-d466-4f40-b2b0-19182f253079 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Request method failure captured: Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 HTTP/1.1 Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaZA-uiP_RRwyKTpstMq_snN96l4NBAuLpTvUZXZaKkL1nlZPUmB1vY0-_vC4QTS7mBpHk0ByEBb7R-iDxblWfftnB-3EEXfNuNabkEp42rTgFGIHdZFF0Gft6oS7QJVWWEjjoPA1_r2rWah96Ux-IMCZQ9Fe_MDHzU_JnwOMegYHM Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}] Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d79046739b2d4572b0aedef59e621ab8 Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: exception: Image not found. Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'aac85e8e-b3db-4dcb-918c-d206b6a9f633'} Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aac85e8e-b3db-4dcb-918c-d206b6a9f633 to delete Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aac85e8e-b3db-4dcb-918c-d206b6a9f633 could not be found. Sep 06 10:57:48.541893 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-daf1c9d0-d466-4f40-b2b0-19182f253079 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Returning 404 to user: Image not found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-daf1c9d0-d466-4f40-b2b0-19182f253079 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633" status: 404 len: 62 microversion: 2.1 time: 0.032479 Sep 06 10:57:48.548166 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 886/1756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:48 2022] DELETE /compute/v2.1/images/aac85e8e-b3db-4dcb-918c-d206b6a9f633 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:57:48.569510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-36212b29-6ece-4967-b1b2-8112d441933b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:48.571426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-36212b29-6ece-4967-b1b2-8112d441933b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:48.584254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36212b29-6ece-4967-b1b2-8112d441933b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.584763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36212b29-6ece-4967-b1b2-8112d441933b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.585221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36212b29-6ece-4967-b1b2-8112d441933b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.585966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36212b29-6ece-4967-b1b2-8112d441933b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.586477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36212b29-6ece-4967-b1b2-8112d441933b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.586842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36212b29-6ece-4967-b1b2-8112d441933b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.603360 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-36212b29-6ece-4967-b1b2-8112d441933b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] HTTP exception thrown: Instance b0d33d19-9934-492e-ab0f-0651fe5c6627 could not be found. Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-36212b29-6ece-4967-b1b2-8112d441933b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Request method failure captured: Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 HTTP/1.1 Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaZA-uiP_RRwyKTpstMq_snN96l4NBAuLpTvUZXZaKkL1nlZPUmB1vY0-_vC4QTS7mBpHk0ByEBb7R-iDxblWfftnB-3EEXfNuNabkEp42rTgFGIHdZFF0Gft6oS7QJVWWEjjoPA1_r2rWah96Ux-IMCZQ9Fe_MDHzU_JnwOMegYHM Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}] Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d79046739b2d4572b0aedef59e621ab8 Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance b0d33d19-9934-492e-ab0f-0651fe5c6627 could not be found. Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'b0d33d19-9934-492e-ab0f-0651fe5c6627'} Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d33d19-9934-492e-ab0f-0651fe5c6627 could not be found. Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:57:48.605312 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d33d19-9934-492e-ab0f-0651fe5c6627 could not be found. Sep 06 10:57:48.612589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.612589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.612589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.612589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.612589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.612589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.612589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:48.612589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:48.612589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d33d19-9934-492e-ab0f-0651fe5c6627 could not be found. Sep 06 10:57:48.612589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.612589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-36212b29-6ece-4967-b1b2-8112d441933b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Returning 404 to user: Instance b0d33d19-9934-492e-ab0f-0651fe5c6627 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:48.612589 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-36212b29-6ece-4967-b1b2-8112d441933b tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 404 len: 111 microversion: 2.1 time: 0.049430 Sep 06 10:57:48.612589 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 887/1757] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:57:48 2022] DELETE /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:57:48.617688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6425ab75-3f54-43f1-b8dc-47d28ec2496a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:48.618490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6425ab75-3f54-43f1-b8dc-47d28ec2496a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: b0d33d19-9934-492e-ab0f-0651fe5c6627] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:48.625242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6425ab75-3f54-43f1-b8dc-47d28ec2496a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.626196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6425ab75-3f54-43f1-b8dc-47d28ec2496a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.626389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6425ab75-3f54-43f1-b8dc-47d28ec2496a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.627317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6425ab75-3f54-43f1-b8dc-47d28ec2496a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.628424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6425ab75-3f54-43f1-b8dc-47d28ec2496a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.628977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6425ab75-3f54-43f1-b8dc-47d28ec2496a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.651549 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-6425ab75-3f54-43f1-b8dc-47d28ec2496a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] HTTP exception thrown: Instance b0d33d19-9934-492e-ab0f-0651fe5c6627 could not be found. Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6425ab75-3f54-43f1-b8dc-47d28ec2496a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Request method failure captured: Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 HTTP/1.1 Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaZA-uiP_RRwyKTpstMq_snN96l4NBAuLpTvUZXZaKkL1nlZPUmB1vY0-_vC4QTS7mBpHk0ByEBb7R-iDxblWfftnB-3EEXfNuNabkEp42rTgFGIHdZFF0Gft6oS7QJVWWEjjoPA1_r2rWah96Ux-IMCZQ9Fe_MDHzU_JnwOMegYHM Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}] Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d79046739b2d4572b0aedef59e621ab8 Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance b0d33d19-9934-492e-ab0f-0651fe5c6627 could not be found. Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'b0d33d19-9934-492e-ab0f-0651fe5c6627'} Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d33d19-9934-492e-ab0f-0651fe5c6627 could not be found. Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d33d19-9934-492e-ab0f-0651fe5c6627 could not be found. Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.653348 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.660907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.660907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.660907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:48.660907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:48.660907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d33d19-9934-492e-ab0f-0651fe5c6627 could not be found. Sep 06 10:57:48.660907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.660907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6425ab75-3f54-43f1-b8dc-47d28ec2496a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Returning 404 to user: Instance b0d33d19-9934-492e-ab0f-0651fe5c6627 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:48.660907 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6425ab75-3f54-43f1-b8dc-47d28ec2496a tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627" status: 404 len: 111 microversion: 2.1 time: 0.042723 Sep 06 10:57:48.660907 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 888/1758] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:48 2022] GET /compute/v2.1/servers/b0d33d19-9934-492e-ab0f-0651fe5c6627 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:57:48.663503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-870209ef-2682-4b2d-aef6-4c0550200556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '.version_select at 0x7f90f8e17310>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:48.685996 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-870209ef-2682-4b2d-aef6-4c0550200556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] HTTP exception thrown: Image not found. Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-870209ef-2682-4b2d-aef6-4c0550200556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Request method failure captured: Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce HTTP/1.1 Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaZA-uiP_RRwyKTpstMq_snN96l4NBAuLpTvUZXZaKkL1nlZPUmB1vY0-_vC4QTS7mBpHk0ByEBb7R-iDxblWfftnB-3EEXfNuNabkEp42rTgFGIHdZFF0Gft6oS7QJVWWEjjoPA1_r2rWah96Ux-IMCZQ9Fe_MDHzU_JnwOMegYHM Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}] Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d79046739b2d4572b0aedef59e621ab8 Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: exception: Image not found. Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'b0978031-5f3a-4335-a466-7efe813e40ce'} Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b0978031-5f3a-4335-a466-7efe813e40ce to delete Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b0978031-5f3a-4335-a466-7efe813e40ce could not be found. Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.687833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-870209ef-2682-4b2d-aef6-4c0550200556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Returning 404 to user: Image not found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-870209ef-2682-4b2d-aef6-4c0550200556 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce" status: 404 len: 62 microversion: 2.1 time: 0.029697 Sep 06 10:57:48.697673 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 889/1759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:48 2022] DELETE /compute/v2.1/images/b0978031-5f3a-4335-a466-7efe813e40ce => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:57:48.700325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-54c51211-32ff-40d6-a281-41986c41d71d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:48.700447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-54c51211-32ff-40d6-a281-41986c41d71d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:48.703275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:48.708901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54c51211-32ff-40d6-a281-41986c41d71d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.709301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54c51211-32ff-40d6-a281-41986c41d71d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.709755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54c51211-32ff-40d6-a281-41986c41d71d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.710483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54c51211-32ff-40d6-a281-41986c41d71d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.710955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54c51211-32ff-40d6-a281-41986c41d71d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.711415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54c51211-32ff-40d6-a281-41986c41d71d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.726442 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-54c51211-32ff-40d6-a281-41986c41d71d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] HTTP exception thrown: Instance cdba9b97-4ac9-425a-93bf-efc405463026 could not be found. Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-54c51211-32ff-40d6-a281-41986c41d71d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Request method failure captured: Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 HTTP/1.1 Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaZA-uiP_RRwyKTpstMq_snN96l4NBAuLpTvUZXZaKkL1nlZPUmB1vY0-_vC4QTS7mBpHk0ByEBb7R-iDxblWfftnB-3EEXfNuNabkEp42rTgFGIHdZFF0Gft6oS7QJVWWEjjoPA1_r2rWah96Ux-IMCZQ9Fe_MDHzU_JnwOMegYHM Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}] Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d79046739b2d4572b0aedef59e621ab8 Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance cdba9b97-4ac9-425a-93bf-efc405463026 could not be found. Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'cdba9b97-4ac9-425a-93bf-efc405463026'} Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdba9b97-4ac9-425a-93bf-efc405463026 could not be found. Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:57:48.728062 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdba9b97-4ac9-425a-93bf-efc405463026 could not be found. Sep 06 10:57:48.733330 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.733330 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.733330 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.733330 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.733330 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.733330 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.733330 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:48.733330 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:48.733330 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdba9b97-4ac9-425a-93bf-efc405463026 could not be found. Sep 06 10:57:48.733330 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.733330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-54c51211-32ff-40d6-a281-41986c41d71d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Returning 404 to user: Instance cdba9b97-4ac9-425a-93bf-efc405463026 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:48.733330 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-54c51211-32ff-40d6-a281-41986c41d71d tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 404 len: 111 microversion: 2.1 time: 0.034587 Sep 06 10:57:48.733330 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 890/1760] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:57:48 2022] DELETE /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:57:48.735955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8b2ce0d7-4240-4acd-9c3b-44f0bb109060 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:48.739497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-40681528-bdd6-47cb-bf32-c5e8b8951455 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:48.740556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-40681528-bdd6-47cb-bf32-c5e8b8951455 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] [instance: cdba9b97-4ac9-425a-93bf-efc405463026] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:48.744742 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8b2ce0d7-4240-4acd-9c3b-44f0bb109060 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1315 microversion: 2.1 time: 0.307932 Sep 06 10:57:48.762181 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 871/1761] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:48 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:48.762332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40681528-bdd6-47cb-bf32-c5e8b8951455 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.762332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40681528-bdd6-47cb-bf32-c5e8b8951455 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.762332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40681528-bdd6-47cb-bf32-c5e8b8951455 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.762332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40681528-bdd6-47cb-bf32-c5e8b8951455 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:48.762332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40681528-bdd6-47cb-bf32-c5e8b8951455 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:48.762332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40681528-bdd6-47cb-bf32-c5e8b8951455 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:48.778659 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-40681528-bdd6-47cb-bf32-c5e8b8951455 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] HTTP exception thrown: Instance cdba9b97-4ac9-425a-93bf-efc405463026 could not be found. Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-40681528-bdd6-47cb-bf32-c5e8b8951455 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Request method failure captured: Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 HTTP/1.1 Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyaZA-uiP_RRwyKTpstMq_snN96l4NBAuLpTvUZXZaKkL1nlZPUmB1vY0-_vC4QTS7mBpHk0ByEBb7R-iDxblWfftnB-3EEXfNuNabkEp42rTgFGIHdZFF0Gft6oS7QJVWWEjjoPA1_r2rWah96Ux-IMCZQ9Fe_MDHzU_JnwOMegYHM Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e047ab9362dc476c9a4b4aee7223d042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e047ab9362dc476c9a4b4aee7223d042"}]}] Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e047ab9362dc476c9a4b4aee7223d042 Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesTestJSON-232185986 Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d79046739b2d4572b0aedef59e621ab8 Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesTestJSON-232185986-project Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance cdba9b97-4ac9-425a-93bf-efc405463026 could not be found. Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'cdba9b97-4ac9-425a-93bf-efc405463026'} Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdba9b97-4ac9-425a-93bf-efc405463026 could not be found. Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdba9b97-4ac9-425a-93bf-efc405463026 could not be found. Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.780245 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:48.786855 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:48.786855 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:48.786855 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:48.786855 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:48.786855 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdba9b97-4ac9-425a-93bf-efc405463026 could not be found. Sep 06 10:57:48.786855 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:48.786855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-40681528-bdd6-47cb-bf32-c5e8b8951455 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] Returning 404 to user: Instance cdba9b97-4ac9-425a-93bf-efc405463026 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:48.786855 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-40681528-bdd6-47cb-bf32-c5e8b8951455 tempest-ImagesTestJSON-232185986 tempest-ImagesTestJSON-232185986-project] 10.222.0.20 "GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026" status: 404 len: 111 microversion: 2.1 time: 0.046951 Sep 06 10:57:48.786855 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 891/1762] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:48 2022] GET /compute/v2.1/servers/cdba9b97-4ac9-425a-93bf-efc405463026 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:57:49.045969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a9691d6-cb1f-4262-a447-847eee1ebd50 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:49.046589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0a9691d6-cb1f-4262-a447-847eee1ebd50 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:49.057523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a9691d6-cb1f-4262-a447-847eee1ebd50 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:49.058381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a9691d6-cb1f-4262-a447-847eee1ebd50 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:49.060765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a9691d6-cb1f-4262-a447-847eee1ebd50 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:49.061539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a9691d6-cb1f-4262-a447-847eee1ebd50 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:49.062008 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a9691d6-cb1f-4262-a447-847eee1ebd50 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:49.062456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a9691d6-cb1f-4262-a447-847eee1ebd50 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:49.297958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5829b303-2bcc-4f10-8cb4-304086274909 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:49.298856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5829b303-2bcc-4f10-8cb4-304086274909 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:49.312289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5829b303-2bcc-4f10-8cb4-304086274909 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:49.318688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5829b303-2bcc-4f10-8cb4-304086274909 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:49.318688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5829b303-2bcc-4f10-8cb4-304086274909 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:49.318688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5829b303-2bcc-4f10-8cb4-304086274909 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:49.318688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5829b303-2bcc-4f10-8cb4-304086274909 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:49.321659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5829b303-2bcc-4f10-8cb4-304086274909 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:49.500071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0a9691d6-cb1f-4262-a447-847eee1ebd50 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:49.512200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0a9691d6-cb1f-4262-a447-847eee1ebd50 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:49.514595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0a9691d6-cb1f-4262-a447-847eee1ebd50 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:49.516735 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0a9691d6-cb1f-4262-a447-847eee1ebd50 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1281 microversion: 2.25 time: 0.474380 Sep 06 10:57:49.520036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5829b303-2bcc-4f10-8cb4-304086274909 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:49.528927 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 872/1763] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:57:49 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1281 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:57:49.532890 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5829b303-2bcc-4f10-8cb4-304086274909 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1277 microversion: 2.1 time: 0.239034 Sep 06 10:57:49.536671 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 892/1764] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:49 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:49.542047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b8cf47c5-9198-483d-95ae-0a02bd50aba1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:49.543003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b8cf47c5-9198-483d-95ae-0a02bd50aba1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:49.676996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b8cf47c5-9198-483d-95ae-0a02bd50aba1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:49.684172 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b8cf47c5-9198-483d-95ae-0a02bd50aba1 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1053 microversion: 2.1 time: 0.152641 Sep 06 10:57:49.684891 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 873/1765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:49 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1053 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:49.784601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-706d24e0-93a3-4ff5-9421-833803084e14 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:49.785581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-706d24e0-93a3-4ff5-9421-833803084e14 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:49.793286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-706d24e0-93a3-4ff5-9421-833803084e14 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:49.797480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-706d24e0-93a3-4ff5-9421-833803084e14 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:49.801231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-706d24e0-93a3-4ff5-9421-833803084e14 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:49.801231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-706d24e0-93a3-4ff5-9421-833803084e14 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:49.801231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-706d24e0-93a3-4ff5-9421-833803084e14 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:49.801231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-706d24e0-93a3-4ff5-9421-833803084e14 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:49.912180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-c3ec81fb-9425-46c5-a642-95ecdd788121 req-02b99a26-230b-4e3a-acaa-2c5d265287a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26309c50-a09b-444e-ab44-913b9a12e5ec", "name": "network-vif-plugged", "status": "completed", "tag": "c0533523-b128-42c1-a597-a3347cdaa7a1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:49.923149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c3ec81fb-9425-46c5-a642-95ecdd788121 req-02b99a26-230b-4e3a-acaa-2c5d265287a3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:49.924514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c3ec81fb-9425-46c5-a642-95ecdd788121 req-02b99a26-230b-4e3a-acaa-2c5d265287a3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:49.924514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c3ec81fb-9425-46c5-a642-95ecdd788121 req-02b99a26-230b-4e3a-acaa-2c5d265287a3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:49.936094 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-c3ec81fb-9425-46c5-a642-95ecdd788121 req-02b99a26-230b-4e3a-acaa-2c5d265287a3 service nova] Creating event network-vif-plugged:c0533523-b128-42c1-a597-a3347cdaa7a1 for instance 26309c50-a09b-444e-ab44-913b9a12e5ec on nch1-master-1 Sep 06 10:57:49.941661 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-c3ec81fb-9425-46c5-a642-95ecdd788121 req-02b99a26-230b-4e3a-acaa-2c5d265287a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036583 Sep 06 10:57:49.942733 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 874/1766] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:57:50.150149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-706d24e0-93a3-4ff5-9421-833803084e14 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:50.161934 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-706d24e0-93a3-4ff5-9421-833803084e14 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1315 microversion: 2.1 time: 0.381751 Sep 06 10:57:50.162628 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 893/1767] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:49 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:50.223820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-fc25eda4-e5d8-4deb-91cf-ec896b1b08ee req-21d5013f-8537-4b26-8a23-5ca072f90b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13346df-1ae9-49f9-8768-e174464a198a", "tag": "4ca62dc1-98f7-4849-a1cb-92d224f8d239"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:50.234549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fc25eda4-e5d8-4deb-91cf-ec896b1b08ee req-21d5013f-8537-4b26-8a23-5ca072f90b63 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:50.235057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fc25eda4-e5d8-4deb-91cf-ec896b1b08ee req-21d5013f-8537-4b26-8a23-5ca072f90b63 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:50.235491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fc25eda4-e5d8-4deb-91cf-ec896b1b08ee req-21d5013f-8537-4b26-8a23-5ca072f90b63 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:50.249612 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-fc25eda4-e5d8-4deb-91cf-ec896b1b08ee req-21d5013f-8537-4b26-8a23-5ca072f90b63 service nova] Creating event network-changed:4ca62dc1-98f7-4849-a1cb-92d224f8d239 for instance c13346df-1ae9-49f9-8768-e174464a198a on nch2-master-1 Sep 06 10:57:50.256474 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-fc25eda4-e5d8-4deb-91cf-ec896b1b08ee req-21d5013f-8537-4b26-8a23-5ca072f90b63 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036882 Sep 06 10:57:50.257386 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 875/1768] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:50.548714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f5aff835-9a41-4e49-b3ca-1d367ea035fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:50.549393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f5aff835-9a41-4e49-b3ca-1d367ea035fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:50.568374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ba9ee6fd-15f9-4f87-8501-263c4d93c6ae tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:50.569637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ba9ee6fd-15f9-4f87-8501-263c4d93c6ae tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:50.570440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aff835-9a41-4e49-b3ca-1d367ea035fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:50.571639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aff835-9a41-4e49-b3ca-1d367ea035fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:50.573134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aff835-9a41-4e49-b3ca-1d367ea035fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:50.576010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aff835-9a41-4e49-b3ca-1d367ea035fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:50.576813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aff835-9a41-4e49-b3ca-1d367ea035fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:50.577450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f5aff835-9a41-4e49-b3ca-1d367ea035fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:50.591302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba9ee6fd-15f9-4f87-8501-263c4d93c6ae tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:50.591302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba9ee6fd-15f9-4f87-8501-263c4d93c6ae tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:50.591302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba9ee6fd-15f9-4f87-8501-263c4d93c6ae tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:50.591302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba9ee6fd-15f9-4f87-8501-263c4d93c6ae tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:50.591302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba9ee6fd-15f9-4f87-8501-263c4d93c6ae tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:50.591302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba9ee6fd-15f9-4f87-8501-263c4d93c6ae tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:50.834674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ba9ee6fd-15f9-4f87-8501-263c4d93c6ae tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:50.842832 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ba9ee6fd-15f9-4f87-8501-263c4d93c6ae tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1275 microversion: 2.1 time: 0.281676 Sep 06 10:57:50.843502 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 876/1769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:50 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1275 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:50.848216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3f8e4dd9-95bf-49c7-bd8b-7409269de9d4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:50.848816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3f8e4dd9-95bf-49c7-bd8b-7409269de9d4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:50.854866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f8e4dd9-95bf-49c7-bd8b-7409269de9d4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:50.855593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f8e4dd9-95bf-49c7-bd8b-7409269de9d4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:50.857145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f8e4dd9-95bf-49c7-bd8b-7409269de9d4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:50.858187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f8e4dd9-95bf-49c7-bd8b-7409269de9d4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:50.859659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f8e4dd9-95bf-49c7-bd8b-7409269de9d4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:50.860310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f8e4dd9-95bf-49c7-bd8b-7409269de9d4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:51.017191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3f8e4dd9-95bf-49c7-bd8b-7409269de9d4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:51.027609 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3f8e4dd9-95bf-49c7-bd8b-7409269de9d4 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1151 microversion: 2.1 time: 0.182992 Sep 06 10:57:51.028205 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 877/1770] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:50 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1151 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:51.164332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f5aff835-9a41-4e49-b3ca-1d367ea035fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:51.179409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f5aff835-9a41-4e49-b3ca-1d367ea035fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:51.181814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f5aff835-9a41-4e49-b3ca-1d367ea035fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:51.184200 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f5aff835-9a41-4e49-b3ca-1d367ea035fa tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1281 microversion: 2.25 time: 0.639822 Sep 06 10:57:51.184585 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 894/1771] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:57:50 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1281 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:57:51.186901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a8f8240f-90ed-4f08-a5a3-b10363094103 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:51.188082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a8f8240f-90ed-4f08-a5a3-b10363094103 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:51.198129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8f8240f-90ed-4f08-a5a3-b10363094103 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:51.198650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8f8240f-90ed-4f08-a5a3-b10363094103 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:51.199133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8f8240f-90ed-4f08-a5a3-b10363094103 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:51.203447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8f8240f-90ed-4f08-a5a3-b10363094103 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:51.203952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8f8240f-90ed-4f08-a5a3-b10363094103 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:51.207231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8f8240f-90ed-4f08-a5a3-b10363094103 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:51.586603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a8f8240f-90ed-4f08-a5a3-b10363094103 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:51.594938 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a8f8240f-90ed-4f08-a5a3-b10363094103 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1315 microversion: 2.1 time: 0.413524 Sep 06 10:57:51.595570 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 878/1772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:51 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:51.933842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9578222d-8a3e-4068-9ad4-5a67b4d32945 tempest-ListImagesTestJSON-1225207311 tempest-ListImagesTestJSON-1225207311-project] Calling method '.version_select at 0x7f90f89d73a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:51.940438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fddbe404-65a9-427b-87aa-af107c7a5b9c tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Action: 'create', calling method: .version_select at 0x7f90fd09b4c0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6fePr0KdP0ceYpNRpSvaePZYVtGsaBS3+85Kec/6NPF63pU4w+cVa1DQ34xvJLkOPM5t4za90PoXyeywKubYvPahUfx+Lr8sPaCYJHRrFSprvso7c71WCXwOG8JgI8fw=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fddbe404-65a9-427b-87aa-af107c7a5b9c tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Request method failure captured: Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 257 Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyevjV2OnT8DG7ZE-XGG-XmHo51ur28_bEaBs_w4SIG5K3rquB8NC4k4Mf7E1Ny2MXoL4wBpy7SdQBKqsTHRlVk6S3w8YZXb4n63PGPHP0qTHBJaHkqQ8Af8jt26FRNhNJpWuHPc-gB8PG1MBePW-s6XHzSpEyLZqGLw6n5pYxwYOxo Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}] Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 1aabaadd397349bdb8b02ca1821c55c4 Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6fePr0KdP0ceYpNRpSvaePZYVtGsaBS3+85Kec/6NPF63pU4w+cVa1DQ34xvJLkOPM5t4za90PoXyeywKubYvPahUfx+Lr8sPaCYJHRrFSprvso7c71WCXwOG8JgI8fw=="}} Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6fePr0KdP0ceYpNRpSvaePZYVtGsaBS3+85Kec/6NPF63pU4w+cVa1DQ34xvJLkOPM5t4za90PoXyeywKubYvPahUfx+Lr8sPaCYJHRrFSprvso7c71WCXwOG8JgI8fw=='}}} Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 06 10:57:51.948378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:57:51.953170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fddbe404-65a9-427b-87aa-af107c7a5b9c tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:51.961412 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fddbe404-65a9-427b-87aa-af107c7a5b9c tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.194853 Sep 06 10:57:51.963639 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 879/1773] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:57:51 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:57:51.979708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b5f11988-cbea-45ff-b05d-5a315b0cb071 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:51.981616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b5f11988-cbea-45ff-b05d-5a315b0cb071 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:51.986262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:52.001862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5f11988-cbea-45ff-b05d-5a315b0cb071 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:52.003364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5f11988-cbea-45ff-b05d-5a315b0cb071 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:52.004028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5f11988-cbea-45ff-b05d-5a315b0cb071 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:52.008264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5f11988-cbea-45ff-b05d-5a315b0cb071 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:52.009142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5f11988-cbea-45ff-b05d-5a315b0cb071 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:52.009653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5f11988-cbea-45ff-b05d-5a315b0cb071 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:52.017085 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9578222d-8a3e-4068-9ad4-5a67b4d32945 tempest-ListImagesTestJSON-1225207311 tempest-ListImagesTestJSON-1225207311-project] 10.222.0.20 "GET /compute/v2.1/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f" status: 200 len: 784 microversion: 2.1 time: 0.533414 Sep 06 10:57:52.017085 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 895/1774] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:51 2022] GET /compute/v2.1/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f => generated 784 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:52.021541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-db21c0bc-4fdb-4968-b2f8-f5bea44653a0 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Action: 'create', calling method: .version_select at 0x7f90f8aaf3a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2135559258", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:52.040009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-db21c0bc-4fdb-4968-b2f8-f5bea44653a0 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Getting quotas for project d437a54271e54aa69c5a6fb256f0cdd1. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:57:52.047410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-db21c0bc-4fdb-4968-b2f8-f5bea44653a0 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Getting quotas for user 1aabaadd397349bdb8b02ca1821c55c4 and project d437a54271e54aa69c5a6fb256f0cdd1. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:57:52.065707 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-db21c0bc-4fdb-4968-b2f8-f5bea44653a0 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-db21c0bc-4fdb-4968-b2f8-f5bea44653a0 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Request method failure captured: Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 2167 Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyevjV2OnT8DG7ZE-XGG-XmHo51ur28_bEaBs_w4SIG5K3rquB8NC4k4Mf7E1Ny2MXoL4wBpy7SdQBKqsTHRlVk6S3w8YZXb4n63PGPHP0qTHBJaHkqQ8Af8jt26FRNhNJpWuHPc-gB8PG1MBePW-s6XHzSpEyLZqGLw6n5pYxwYOxo Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}] Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 1aabaadd397349bdb8b02ca1821c55c4 Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2135559258", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:52.086025 ncdv-master-1 devstack@n-api.service[140876]: exception: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2135559258', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:52.089009 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-db21c0bc-4fdb-4968-b2f8-f5bea44653a0 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-db21c0bc-4fdb-4968-b2f8-f5bea44653a0 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.070749 Sep 06 10:57:52.096290 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 896/1775] 10.222.0.20 () {60 vars in 1160 bytes} [Tue Sep 6 10:57:52 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:52.100844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5c541c11-2525-4346-86f4-cfa9bc11139b tempest-ListImagesTestJSON-1225207311 tempest-ListImagesTestJSON-1225207311-project] Calling method '.version_select at 0x7f90f8e17a60>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:52.195611 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5c541c11-2525-4346-86f4-cfa9bc11139b tempest-ListImagesTestJSON-1225207311 tempest-ListImagesTestJSON-1225207311-project] 10.222.0.20 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.099363 Sep 06 10:57:52.204620 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 897/1776] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:52 2022] GET /compute/v2.1/images => generated 445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:52.204620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-30f45d93-fd4b-46af-b18e-f9a73be68f02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:52.206255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-30f45d93-fd4b-46af-b18e-f9a73be68f02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:52.213872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30f45d93-fd4b-46af-b18e-f9a73be68f02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:52.214225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30f45d93-fd4b-46af-b18e-f9a73be68f02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:52.214674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30f45d93-fd4b-46af-b18e-f9a73be68f02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:52.215444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30f45d93-fd4b-46af-b18e-f9a73be68f02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:52.215909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30f45d93-fd4b-46af-b18e-f9a73be68f02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:52.216403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30f45d93-fd4b-46af-b18e-f9a73be68f02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:52.434608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-30f45d93-fd4b-46af-b18e-f9a73be68f02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:52.444981 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-30f45d93-fd4b-46af-b18e-f9a73be68f02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1169 microversion: 2.1 time: 0.246264 Sep 06 10:57:52.447727 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 898/1777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:52 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1169 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:52.459878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8839ad26-8609-4e54-b91d-80d25d1fd599 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Action: 'create', calling method: .version_select at 0x7f90f8a2a310>, body: {"keypair": {"name": "tempest-keypair-97924957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFI4tN3CGQuNGEF3WAA5/F2RQFbA1gIy/wD8W1fP4RO0B0ovYq3Z+1fi0y91LK3m928bwBKzEzXarV7MAkagpzM2Ov6jAyoE/jrigVqRgPxb2w/Z916wQcfq76I4GzjIIQ=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:52.480351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8839ad26-8609-4e54-b91d-80d25d1fd599 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Getting quotas for project d437a54271e54aa69c5a6fb256f0cdd1. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:57:52.486938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8839ad26-8609-4e54-b91d-80d25d1fd599 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Getting quotas for user 1aabaadd397349bdb8b02ca1821c55c4 and project d437a54271e54aa69c5a6fb256f0cdd1. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:57:52.613342 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8839ad26-8609-4e54-b91d-80d25d1fd599 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.162493 Sep 06 10:57:52.624181 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 899/1778] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:57:52 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:52.630944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-38448e4e-8773-4d0f-a064-f570c5a15662 tempest-ListImagesTestJSON-1225207311 tempest-ListImagesTestJSON-1225207311-project] Calling method '.version_select at 0x7f90fd037af0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:52.641620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b5f11988-cbea-45ff-b05d-5a315b0cb071 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:52.654608 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b5f11988-cbea-45ff-b05d-5a315b0cb071 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1317 microversion: 2.1 time: 0.687971 Sep 06 10:57:52.662791 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 880/1779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:51 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1317 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:52.673849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2977d7a4-3c2b-4d32-9a58-38d744fbf3df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:52.674470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2977d7a4-3c2b-4d32-9a58-38d744fbf3df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:52.683153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2977d7a4-3c2b-4d32-9a58-38d744fbf3df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:52.683658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2977d7a4-3c2b-4d32-9a58-38d744fbf3df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:52.684106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2977d7a4-3c2b-4d32-9a58-38d744fbf3df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:52.684976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2977d7a4-3c2b-4d32-9a58-38d744fbf3df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:52.685533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2977d7a4-3c2b-4d32-9a58-38d744fbf3df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:52.686764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2977d7a4-3c2b-4d32-9a58-38d744fbf3df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:52.701243 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-38448e4e-8773-4d0f-a064-f570c5a15662 tempest-ListImagesTestJSON-1225207311 tempest-ListImagesTestJSON-1225207311-project] 10.222.0.20 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.074951 Sep 06 10:57:52.702913 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 900/1780] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 10:57:52 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:52.710851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-018ef3a4-7586-4f90-aad6-14a9e970dbef tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:52.711721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-018ef3a4-7586-4f90-aad6-14a9e970dbef tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:52.733421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-018ef3a4-7586-4f90-aad6-14a9e970dbef tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:52.734426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-018ef3a4-7586-4f90-aad6-14a9e970dbef tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:52.735215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-018ef3a4-7586-4f90-aad6-14a9e970dbef tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:52.736181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-018ef3a4-7586-4f90-aad6-14a9e970dbef tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:52.736816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-018ef3a4-7586-4f90-aad6-14a9e970dbef tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:52.737957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-018ef3a4-7586-4f90-aad6-14a9e970dbef tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:53.769768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-018ef3a4-7586-4f90-aad6-14a9e970dbef tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:53.771492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2977d7a4-3c2b-4d32-9a58-38d744fbf3df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:53.785875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2977d7a4-3c2b-4d32-9a58-38d744fbf3df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:53.789706 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-018ef3a4-7586-4f90-aad6-14a9e970dbef tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1501 microversion: 2.1 time: 1.085535 Sep 06 10:57:53.793315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2977d7a4-3c2b-4d32-9a58-38d744fbf3df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:53.793482 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 901/1781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:52 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1501 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:53.793614 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2977d7a4-3c2b-4d32-9a58-38d744fbf3df tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1281 microversion: 2.25 time: 1.128202 Sep 06 10:57:53.793614 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 881/1782] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:57:52 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1281 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:57:53.798046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a89d616d-bd4d-4210-9b9e-314402d15841 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:53.798664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a89d616d-bd4d-4210-9b9e-314402d15841 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:53.799312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d94d51e9-4e63-4c1f-8483-9eb182ca2294 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Action: 'create', calling method: .version_select at 0x7f90fd083430>, body: {"keypair": {"name": "tempest-keypair-97924957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAopgWuxW+LIVMx32EeHjgW/I2QEwde0kpvn8+3qhmBoHF0Oj/iaQV4gU6BePGcYtYhV02eutJe45EED5b8IHywMG6uqWKTLPsT7Ehm/RBP5QwczBbyh2t3CJ91cDS9PMQ=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:53.806617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a89d616d-bd4d-4210-9b9e-314402d15841 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:53.807139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a89d616d-bd4d-4210-9b9e-314402d15841 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:53.807739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a89d616d-bd4d-4210-9b9e-314402d15841 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:53.808456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a89d616d-bd4d-4210-9b9e-314402d15841 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:53.809096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a89d616d-bd4d-4210-9b9e-314402d15841 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:53.809753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a89d616d-bd4d-4210-9b9e-314402d15841 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:53.824642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d94d51e9-4e63-4c1f-8483-9eb182ca2294 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Getting quotas for project d437a54271e54aa69c5a6fb256f0cdd1. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:57:53.832517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d94d51e9-4e63-4c1f-8483-9eb182ca2294 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Getting quotas for user 1aabaadd397349bdb8b02ca1821c55c4 and project d437a54271e54aa69c5a6fb256f0cdd1. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:57:53.835361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:53.927765 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-d94d51e9-4e63-4c1f-8483-9eb182ca2294 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] HTTP exception thrown: Key pair 'tempest-keypair-97924957' already exists. Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d94d51e9-4e63-4c1f-8483-9eb182ca2294 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Request method failure captured: Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 271 Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyevjV2OnT8DG7ZE-XGG-XmHo51ur28_bEaBs_w4SIG5K3rquB8NC4k4Mf7E1Ny2MXoL4wBpy7SdQBKqsTHRlVk6S3w8YZXb4n63PGPHP0qTHBJaHkqQ8Af8jt26FRNhNJpWuHPc-gB8PG1MBePW-s6XHzSpEyLZqGLw6n5pYxwYOxo Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}] Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 1aabaadd397349bdb8b02ca1821c55c4 Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: {"keypair": {"name": "tempest-keypair-97924957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAopgWuxW+LIVMx32EeHjgW/I2QEwde0kpvn8+3qhmBoHF0Oj/iaQV4gU6BePGcYtYhV02eutJe45EED5b8IHywMG6uqWKTLPsT7Ehm/RBP5QwczBbyh2t3CJ91cDS9PMQ=="}} Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: exception: Key pair 'tempest-keypair-97924957' already exists. Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-97924957', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAopgWuxW+LIVMx32EeHjgW/I2QEwde0kpvn8+3qhmBoHF0Oj/iaQV4gU6BePGcYtYhV02eutJe45EED5b8IHywMG6uqWKTLPsT7Ehm/RBP5QwczBbyh2t3CJ91cDS9PMQ=='}}} Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result.read() Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '1aabaadd397349bdb8b02ca1821c55c4-tempest-keypair-97924957' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 06 10:57:53.938912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi session.flush() Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result.read() Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 06 10:57:53.946522 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '1aabaadd397349bdb8b02ca1821c55c4-tempest-keypair-97924957' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 6, 10, 57, 53, 858812), 'updated_at': None, 'name': 'tempest-keypair-97924957', 'user_id': '1aabaadd397349bdb8b02ca1821c55c4', 'fingerprint': 'f9:be:a3:56:b9:d7:f1:7c:a9:a1:e3:3d:39:70:0a:bb', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAopgWuxW+LIVMx32EeHjgW/I2QEwde0kpvn8+3qhmBoHF0Oj/iaQV4gU6BePGcYtYhV02eutJe45EED5b8IHywMG6uqWKTLPsT7Ehm/RBP5QwczBbyh2t3CJ91cDS9PMQ==', 'type': 'ssh'}] Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi keypair.create() Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._create() Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-97924957' already exists. Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 06 10:57:53.960439 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-97924957' already exists. Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-97924957' already exists. Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d94d51e9-4e63-4c1f-8483-9eb182ca2294 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Returning 409 to user: Key pair 'tempest-keypair-97924957' already exists. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d94d51e9-4e63-4c1f-8483-9eb182ca2294 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 409 len: 103 microversion: 2.1 time: 0.161258 Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 902/1783] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:57:53 2022] POST /compute/v2.1/os-keypairs => generated 103 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0097f114-1389-4687-8906-ebe63c939d64 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:53.966945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0097f114-1389-4687-8906-ebe63c939d64 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:53.986732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0097f114-1389-4687-8906-ebe63c939d64 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:53.986732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0097f114-1389-4687-8906-ebe63c939d64 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:53.986732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0097f114-1389-4687-8906-ebe63c939d64 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:53.986732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0097f114-1389-4687-8906-ebe63c939d64 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:53.986732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0097f114-1389-4687-8906-ebe63c939d64 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:53.986732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0097f114-1389-4687-8906-ebe63c939d64 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:53.997847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a89d616d-bd4d-4210-9b9e-314402d15841 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:54.012080 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a89d616d-bd4d-4210-9b9e-314402d15841 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1169 microversion: 2.1 time: 0.217791 Sep 06 10:57:54.014102 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 882/1784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:53 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1169 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:54.037481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8cde8ebf-ca81-40f6-8967-f964769affa2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:54.037481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8cde8ebf-ca81-40f6-8967-f964769affa2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:54.044354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cde8ebf-ca81-40f6-8967-f964769affa2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:54.044978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cde8ebf-ca81-40f6-8967-f964769affa2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:54.046188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cde8ebf-ca81-40f6-8967-f964769affa2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:54.047258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cde8ebf-ca81-40f6-8967-f964769affa2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:54.047964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cde8ebf-ca81-40f6-8967-f964769affa2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:54.049098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cde8ebf-ca81-40f6-8967-f964769affa2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:54.078582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8cde8ebf-ca81-40f6-8967-f964769affa2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:57:54.303765 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8cde8ebf-ca81-40f6-8967-f964769affa2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 204 len: 0 microversion: 2.1 time: 0.287089 Sep 06 10:57:54.304359 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 883/1785] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:57:54 2022] DELETE /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:57:54.310112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01b764cf-0e3e-4600-ba0a-3d5e70347b52 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Calling method '.version_select at 0x7f90fd10eb80>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:54.394411 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-01b764cf-0e3e-4600-ba0a-3d5e70347b52 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-97924957" status: 202 len: 0 microversion: 2.1 time: 0.088708 Sep 06 10:57:54.395166 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 884/1786] 10.222.0.20 () {58 vars in 1215 bytes} [Tue Sep 6 10:57:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-97924957 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:57:54.401219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8f453671-dad2-43fb-8183-6f955dd74e44 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:54.402422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8f453671-dad2-43fb-8183-6f955dd74e44 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:54.410001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f453671-dad2-43fb-8183-6f955dd74e44 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:54.410506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f453671-dad2-43fb-8183-6f955dd74e44 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:54.411082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f453671-dad2-43fb-8183-6f955dd74e44 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:54.411692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f453671-dad2-43fb-8183-6f955dd74e44 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:54.412157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f453671-dad2-43fb-8183-6f955dd74e44 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:54.412590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f453671-dad2-43fb-8183-6f955dd74e44 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:54.566950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0097f114-1389-4687-8906-ebe63c939d64 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:54.575418 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0097f114-1389-4687-8906-ebe63c939d64 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1317 microversion: 2.1 time: 0.619742 Sep 06 10:57:54.576252 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 903/1787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:53 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:54.582837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4ae102b-76f0-4a40-8918-bb082500911c tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Action: 'create', calling method: .version_select at 0x7f90fd0833a0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoIIr7QlkZ+Y3LkRiQn9dPYjKakTqlEe+0UHd/31r7PZBnycbJ1oHcN3KK88EVg/NjI6gvNRQ6SuQuwItVc1yMIVsOPlos+en7IIuj2xktLrtI8LehT2BZWVcPxDk1KSA=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4ae102b-76f0-4a40-8918-bb082500911c tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Request method failure captured: Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 247 Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyevjV2OnT8DG7ZE-XGG-XmHo51ur28_bEaBs_w4SIG5K3rquB8NC4k4Mf7E1Ny2MXoL4wBpy7SdQBKqsTHRlVk6S3w8YZXb4n63PGPHP0qTHBJaHkqQ8Af8jt26FRNhNJpWuHPc-gB8PG1MBePW-s6XHzSpEyLZqGLw6n5pYxwYOxo Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}] Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 1aabaadd397349bdb8b02ca1821c55c4 Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoIIr7QlkZ+Y3LkRiQn9dPYjKakTqlEe+0UHd/31r7PZBnycbJ1oHcN3KK88EVg/NjI6gvNRQ6SuQuwItVc1yMIVsOPlos+en7IIuj2xktLrtI8LehT2BZWVcPxDk1KSA=="}} Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoIIr7QlkZ+Y3LkRiQn9dPYjKakTqlEe+0UHd/31r7PZBnycbJ1oHcN3KK88EVg/NjI6gvNRQ6SuQuwItVc1yMIVsOPlos+en7IIuj2xktLrtI8LehT2BZWVcPxDk1KSA=='}}} Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi '' Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:57:54.593338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4ae102b-76f0-4a40-8918-bb082500911c tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b4ae102b-76f0-4a40-8918-bb082500911c tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010616 Sep 06 10:57:54.599212 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 904/1788] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:57:54 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:57:54.606720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4c3902c-cd6f-488b-ad2e-0422463885e1 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Action: 'create', calling method: .version_select at 0x7f90fd1318b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2063675355", "public_key": " "}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:54.627680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-b4c3902c-cd6f-488b-ad2e-0422463885e1 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Getting quotas for project d437a54271e54aa69c5a6fb256f0cdd1. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:57:54.642746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-b4c3902c-cd6f-488b-ad2e-0422463885e1 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Getting quotas for user 1aabaadd397349bdb8b02ca1821c55c4 and project d437a54271e54aa69c5a6fb256f0cdd1. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:57:54.659611 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-b4c3902c-cd6f-488b-ad2e-0422463885e1 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4c3902c-cd6f-488b-ad2e-0422463885e1 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Request method failure captured: Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 95 Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyevjV2OnT8DG7ZE-XGG-XmHo51ur28_bEaBs_w4SIG5K3rquB8NC4k4Mf7E1Ny2MXoL4wBpy7SdQBKqsTHRlVk6S3w8YZXb4n63PGPHP0qTHBJaHkqQ8Af8jt26FRNhNJpWuHPc-gB8PG1MBePW-s6XHzSpEyLZqGLw6n5pYxwYOxo Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}] Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 1aabaadd397349bdb8b02ca1821c55c4 Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2063675355", "public_key": " "}} Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: exception: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2063675355', 'public_key': ' '}}} Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:54.662025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4c3902c-cd6f-488b-ad2e-0422463885e1 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b4c3902c-cd6f-488b-ad2e-0422463885e1 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.062044 Sep 06 10:57:54.678273 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 905/1789] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Sep 6 10:57:54 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:54.682017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c2e3cbdf-6cbe-498b-84e3-7ddb4529dbcf tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Action: 'create', calling method: .version_select at 0x7f90fd1310d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbo43xswcRICRRe/N2b1u8kaTD4zemfB6H1UtVcnvrXxKtHfIBXL4hG9RDzMzxyRrKet653iM5lbyH8HIrNi3o4bsNf99Uc8RBu634PgV+S8o1m8e5rjGOXZkl7wwizeA=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c2e3cbdf-6cbe-498b-84e3-7ddb4529dbcf tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Request method failure captured: Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 507 Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyevjV2OnT8DG7ZE-XGG-XmHo51ur28_bEaBs_w4SIG5K3rquB8NC4k4Mf7E1Ny2MXoL4wBpy7SdQBKqsTHRlVk6S3w8YZXb4n63PGPHP0qTHBJaHkqQ8Af8jt26FRNhNJpWuHPc-gB8PG1MBePW-s6XHzSpEyLZqGLw6n5pYxwYOxo Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}] Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 1aabaadd397349bdb8b02ca1821c55c4 Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbo43xswcRICRRe/N2b1u8kaTD4zemfB6H1UtVcnvrXxKtHfIBXL4hG9RDzMzxyRrKet653iM5lbyH8HIrNi3o4bsNf99Uc8RBu634PgV+S8o1m8e5rjGOXZkl7wwizeA=="}} Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbo43xswcRICRRe/N2b1u8kaTD4zemfB6H1UtVcnvrXxKtHfIBXL4hG9RDzMzxyRrKet653iM5lbyH8HIrNi3o4bsNf99Uc8RBu634PgV+S8o1m8e5rjGOXZkl7wwizeA=='}}} Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 06 10:57:54.684718 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c2e3cbdf-6cbe-498b-84e3-7ddb4529dbcf tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c2e3cbdf-6cbe-498b-84e3-7ddb4529dbcf tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012378 Sep 06 10:57:54.692892 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 906/1790] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:57:54 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:57:54.708315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f7161a3-2340-466e-b2d6-78cbbfafa161 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Action: 'create', calling method: .version_select at 0x7f90fd083a60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-845923667", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:54.731573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1f7161a3-2340-466e-b2d6-78cbbfafa161 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Getting quotas for project d437a54271e54aa69c5a6fb256f0cdd1. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:57:54.744122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1f7161a3-2340-466e-b2d6-78cbbfafa161 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Getting quotas for user 1aabaadd397349bdb8b02ca1821c55c4 and project d437a54271e54aa69c5a6fb256f0cdd1. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:57:54.774977 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-1f7161a3-2340-466e-b2d6-78cbbfafa161 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f7161a3-2340-466e-b2d6-78cbbfafa161 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Request method failure captured: Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 117 Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyevjV2OnT8DG7ZE-XGG-XmHo51ur28_bEaBs_w4SIG5K3rquB8NC4k4Mf7E1Ny2MXoL4wBpy7SdQBKqsTHRlVk6S3w8YZXb4n63PGPHP0qTHBJaHkqQ8Af8jt26FRNhNJpWuHPc-gB8PG1MBePW-s6XHzSpEyLZqGLw6n5pYxwYOxo Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}] Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 1aabaadd397349bdb8b02ca1821c55c4 Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-845923667", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: exception: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-845923667', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 06 10:57:54.776940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f7161a3-2340-466e-b2d6-78cbbfafa161 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:54.783194 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1f7161a3-2340-466e-b2d6-78cbbfafa161 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.077167 Sep 06 10:57:54.788633 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 907/1791] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:57:54 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:54.792581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8a5a52f6-e2c1-47e2-aef0-8a056ec04b21 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Calling method '.version_select at 0x7f90fd0374c0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:54.825529 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-8a5a52f6-e2c1-47e2-aef0-8a056ec04b21 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1325118256 not found for user 1aabaadd397349bdb8b02ca1821c55c4 Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8a5a52f6-e2c1-47e2-aef0-8a056ec04b21 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Request method failure captured: Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1325118256 HTTP/1.1 Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyevjV2OnT8DG7ZE-XGG-XmHo51ur28_bEaBs_w4SIG5K3rquB8NC4k4Mf7E1Ny2MXoL4wBpy7SdQBKqsTHRlVk6S3w8YZXb4n63PGPHP0qTHBJaHkqQ8Af8jt26FRNhNJpWuHPc-gB8PG1MBePW-s6XHzSpEyLZqGLw6n5pYxwYOxo Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d437a54271e54aa69c5a6fb256f0cdd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d437a54271e54aa69c5a6fb256f0cdd1"}]}] Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: d437a54271e54aa69c5a6fb256f0cdd1 Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1499781233 Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 1aabaadd397349bdb8b02ca1821c55c4 Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1499781233-project Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: exception: Keypair tempest-keypair-non-existent-1325118256 not found for user 1aabaadd397349bdb8b02ca1821c55c4 Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'tempest-keypair-non-existent-1325118256'} Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1325118256 not found for user 1aabaadd397349bdb8b02ca1821c55c4 Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.827942 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1325118256 not found for user 1aabaadd397349bdb8b02ca1821c55c4 Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1325118256 not found for user 1aabaadd397349bdb8b02ca1821c55c4 Sep 06 10:57:54.833870 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:57:54.837472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8a5a52f6-e2c1-47e2-aef0-8a056ec04b21 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1325118256 not found for user 1aabaadd397349bdb8b02ca1821c55c4 {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:57:54.839055 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8a5a52f6-e2c1-47e2-aef0-8a056ec04b21 tempest-KeyPairsNegativeTestJSON-1499781233 tempest-KeyPairsNegativeTestJSON-1499781233-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1325118256" status: 404 len: 145 microversion: 2.1 time: 0.049914 Sep 06 10:57:54.839236 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 908/1792] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 10:57:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1325118256 => generated 145 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:57:54.868002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9b015a2e-692e-4ad3-907f-ff3a6e3cdab2 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:54.870687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9b015a2e-692e-4ad3-907f-ff3a6e3cdab2 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:54.885352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8f453671-dad2-43fb-8183-6f955dd74e44 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:54.889869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b015a2e-692e-4ad3-907f-ff3a6e3cdab2 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:54.890393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b015a2e-692e-4ad3-907f-ff3a6e3cdab2 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:54.890849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b015a2e-692e-4ad3-907f-ff3a6e3cdab2 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:54.891620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b015a2e-692e-4ad3-907f-ff3a6e3cdab2 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:54.897247 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8f453671-dad2-43fb-8183-6f955dd74e44 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1507 microversion: 2.1 time: 0.500786 Sep 06 10:57:54.899505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b015a2e-692e-4ad3-907f-ff3a6e3cdab2 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:54.900265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b015a2e-692e-4ad3-907f-ff3a6e3cdab2 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:54.914411 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 885/1793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:54 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:55.038617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-674a0b05-af8d-46ba-9d02-9f6fb93aa55a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:55.039403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-674a0b05-af8d-46ba-9d02-9f6fb93aa55a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:55.048941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-674a0b05-af8d-46ba-9d02-9f6fb93aa55a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:55.049983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-674a0b05-af8d-46ba-9d02-9f6fb93aa55a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:55.050446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-674a0b05-af8d-46ba-9d02-9f6fb93aa55a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:55.055320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-674a0b05-af8d-46ba-9d02-9f6fb93aa55a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:55.055888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-674a0b05-af8d-46ba-9d02-9f6fb93aa55a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:55.056363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-674a0b05-af8d-46ba-9d02-9f6fb93aa55a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:55.415051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:55.501782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9b015a2e-692e-4ad3-907f-ff3a6e3cdab2 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:55.515853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9b015a2e-692e-4ad3-907f-ff3a6e3cdab2 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:55.519631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9b015a2e-692e-4ad3-907f-ff3a6e3cdab2 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:55.521297 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9b015a2e-692e-4ad3-907f-ff3a6e3cdab2 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1281 microversion: 2.25 time: 0.681082 Sep 06 10:57:55.522551 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 909/1794] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:57:54 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1281 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:57:55.591732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-674a0b05-af8d-46ba-9d02-9f6fb93aa55a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:55.606323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3fee8be5-9e6c-4ff5-a0b4-96957a35e28a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:55.606323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3fee8be5-9e6c-4ff5-a0b4-96957a35e28a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:55.619036 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-674a0b05-af8d-46ba-9d02-9f6fb93aa55a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1199 microversion: 2.1 time: 0.583329 Sep 06 10:57:55.619839 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 886/1795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:55 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1199 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:57:55.637697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fee8be5-9e6c-4ff5-a0b4-96957a35e28a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:55.638614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fee8be5-9e6c-4ff5-a0b4-96957a35e28a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:55.639478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fee8be5-9e6c-4ff5-a0b4-96957a35e28a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:55.641730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fee8be5-9e6c-4ff5-a0b4-96957a35e28a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:55.642650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fee8be5-9e6c-4ff5-a0b4-96957a35e28a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:55.643657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fee8be5-9e6c-4ff5-a0b4-96957a35e28a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:55.929471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84fc0542-4841-4617-8d9e-d0e8d177cddb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:55.930156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-84fc0542-4841-4617-8d9e-d0e8d177cddb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:55.950424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84fc0542-4841-4617-8d9e-d0e8d177cddb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:55.958357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84fc0542-4841-4617-8d9e-d0e8d177cddb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:55.962433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84fc0542-4841-4617-8d9e-d0e8d177cddb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:55.976490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84fc0542-4841-4617-8d9e-d0e8d177cddb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:55.980077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84fc0542-4841-4617-8d9e-d0e8d177cddb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:55.983122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84fc0542-4841-4617-8d9e-d0e8d177cddb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:56.057555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3fee8be5-9e6c-4ff5-a0b4-96957a35e28a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:56.069454 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3fee8be5-9e6c-4ff5-a0b4-96957a35e28a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1317 microversion: 2.1 time: 0.470078 Sep 06 10:57:56.077527 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 910/1796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:55 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:57:56.096099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-7509e053-2713-4ab1-b26d-0dfbfac15eab req-253694b2-1c4c-4b87-b976-31b636dd523e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "306337d6-b772-41a6-8d68-2e34a9c0aa66", "tag": "accaabe8-5bea-4860-8126-43d747eb00c3"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:56.125235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7509e053-2713-4ab1-b26d-0dfbfac15eab req-253694b2-1c4c-4b87-b976-31b636dd523e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:56.125846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7509e053-2713-4ab1-b26d-0dfbfac15eab req-253694b2-1c4c-4b87-b976-31b636dd523e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:56.128284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7509e053-2713-4ab1-b26d-0dfbfac15eab req-253694b2-1c4c-4b87-b976-31b636dd523e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:56.165215 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-7509e053-2713-4ab1-b26d-0dfbfac15eab req-253694b2-1c4c-4b87-b976-31b636dd523e service nova] Creating event network-changed:accaabe8-5bea-4860-8126-43d747eb00c3 for instance 306337d6-b772-41a6-8d68-2e34a9c0aa66 on nch1-master-1 Sep 06 10:57:56.178176 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-7509e053-2713-4ab1-b26d-0dfbfac15eab req-253694b2-1c4c-4b87-b976-31b636dd523e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101184 Sep 06 10:57:56.179060 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 911/1797] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:56.508718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-84fc0542-4841-4617-8d9e-d0e8d177cddb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:56.517276 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84fc0542-4841-4617-8d9e-d0e8d177cddb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1507 microversion: 2.1 time: 0.593889 Sep 06 10:57:56.520831 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 887/1798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:55 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1507 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:56.548127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9017b4b2-f646-42a9-bfd8-dbac1498f0bb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:56.549761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9017b4b2-f646-42a9-bfd8-dbac1498f0bb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:56.559719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9017b4b2-f646-42a9-bfd8-dbac1498f0bb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:56.560554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9017b4b2-f646-42a9-bfd8-dbac1498f0bb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:56.561193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9017b4b2-f646-42a9-bfd8-dbac1498f0bb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:56.562116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9017b4b2-f646-42a9-bfd8-dbac1498f0bb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:56.562756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9017b4b2-f646-42a9-bfd8-dbac1498f0bb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:56.563383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9017b4b2-f646-42a9-bfd8-dbac1498f0bb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:56.652367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ce4b20a5-0dde-40b3-8c4b-025b5420e88a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:56.654029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ce4b20a5-0dde-40b3-8c4b-025b5420e88a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:56.663059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce4b20a5-0dde-40b3-8c4b-025b5420e88a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:56.664236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce4b20a5-0dde-40b3-8c4b-025b5420e88a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:56.667847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce4b20a5-0dde-40b3-8c4b-025b5420e88a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:56.668883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce4b20a5-0dde-40b3-8c4b-025b5420e88a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:56.669746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce4b20a5-0dde-40b3-8c4b-025b5420e88a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:56.670752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce4b20a5-0dde-40b3-8c4b-025b5420e88a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:57.350470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9017b4b2-f646-42a9-bfd8-dbac1498f0bb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:57.361038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9017b4b2-f646-42a9-bfd8-dbac1498f0bb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:57.363464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9017b4b2-f646-42a9-bfd8-dbac1498f0bb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:57.364838 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9017b4b2-f646-42a9-bfd8-dbac1498f0bb tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1281 microversion: 2.25 time: 0.821227 Sep 06 10:57:57.365947 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 912/1799] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:57:56 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1281 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:57:57.372717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-bfb56cac-ac64-4652-be94-d3dee4fef0d6 req-44173fd6-02e0-4398-a2ba-a6f0c4c30cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26309c50-a09b-444e-ab44-913b9a12e5ec", "name": "network-vif-deleted", "tag": "c0533523-b128-42c1-a597-a3347cdaa7a1"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:57.385578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-bfb56cac-ac64-4652-be94-d3dee4fef0d6 req-44173fd6-02e0-4398-a2ba-a6f0c4c30cbe service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:57.386519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-bfb56cac-ac64-4652-be94-d3dee4fef0d6 req-44173fd6-02e0-4398-a2ba-a6f0c4c30cbe service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:57.388298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-bfb56cac-ac64-4652-be94-d3dee4fef0d6 req-44173fd6-02e0-4398-a2ba-a6f0c4c30cbe service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:57.406281 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-bfb56cac-ac64-4652-be94-d3dee4fef0d6 req-44173fd6-02e0-4398-a2ba-a6f0c4c30cbe service nova] Creating event network-vif-deleted:c0533523-b128-42c1-a597-a3347cdaa7a1 for instance 26309c50-a09b-444e-ab44-913b9a12e5ec on nch1-master-1 Sep 06 10:57:57.413524 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-bfb56cac-ac64-4652-be94-d3dee4fef0d6 req-44173fd6-02e0-4398-a2ba-a6f0c4c30cbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045743 Sep 06 10:57:57.415291 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 913/1800] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:57.421595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-79473c62-19e1-43d0-b920-a0f6fec247d1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:57.422989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-79473c62-19e1-43d0-b920-a0f6fec247d1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:57.430235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79473c62-19e1-43d0-b920-a0f6fec247d1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:57.431465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79473c62-19e1-43d0-b920-a0f6fec247d1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:57.432275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79473c62-19e1-43d0-b920-a0f6fec247d1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:57.433343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79473c62-19e1-43d0-b920-a0f6fec247d1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:57.434029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79473c62-19e1-43d0-b920-a0f6fec247d1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:57.434826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79473c62-19e1-43d0-b920-a0f6fec247d1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:57.435625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:57.574496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ce4b20a5-0dde-40b3-8c4b-025b5420e88a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:57.589045 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ce4b20a5-0dde-40b3-8c4b-025b5420e88a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1199 microversion: 2.1 time: 0.949833 Sep 06 10:57:57.590928 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 888/1801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:56 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1199 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:57.836859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-79473c62-19e1-43d0-b920-a0f6fec247d1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:57.858612 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-79473c62-19e1-43d0-b920-a0f6fec247d1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1317 microversion: 2.1 time: 0.441617 Sep 06 10:57:57.859985 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 914/1802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:57 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:57.867379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:57.868253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:57.895213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:57.904862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:57.905453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:57.906328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:57.906912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:57.907909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:57.971027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:57.971797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:57.972316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:57.972889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lazy-loading 'fault' on Instance uuid 26309c50-a09b-444e-ab44-913b9a12e5ec {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:57:57.989575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ec329b10-cc39-4228-ad3a-1a7928612693 tempest-AZV2TestJSON-254376380 tempest-AZV2TestJSON-254376380-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:57.996813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec329b10-cc39-4228-ad3a-1a7928612693 tempest-AZV2TestJSON-254376380 tempest-AZV2TestJSON-254376380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:57.998758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec329b10-cc39-4228-ad3a-1a7928612693 tempest-AZV2TestJSON-254376380 tempest-AZV2TestJSON-254376380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:58.000293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec329b10-cc39-4228-ad3a-1a7928612693 tempest-AZV2TestJSON-254376380 tempest-AZV2TestJSON-254376380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:58.003842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec329b10-cc39-4228-ad3a-1a7928612693 tempest-AZV2TestJSON-254376380 tempest-AZV2TestJSON-254376380-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:58.004578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec329b10-cc39-4228-ad3a-1a7928612693 tempest-AZV2TestJSON-254376380 tempest-AZV2TestJSON-254376380-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:58.005259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec329b10-cc39-4228-ad3a-1a7928612693 tempest-AZV2TestJSON-254376380 tempest-AZV2TestJSON-254376380-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:58.024369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:58.037481 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8915b5ad-7ed5-4f47-a631-b4217eeb7681 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1305 microversion: 2.1 time: 0.174979 Sep 06 10:57:58.038329 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ec329b10-cc39-4228-ad3a-1a7928612693 tempest-AZV2TestJSON-254376380 tempest-AZV2TestJSON-254376380-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.432883 Sep 06 10:57:58.039270 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 889/1803] 10.222.0.20 () {58 vars in 1164 bytes} [Tue Sep 6 10:57:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 10:57:58.057144 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 915/1804] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:57 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1305 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:58.275664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-4754ce58-8ddd-4e53-b549-f11bb13d3c79 req-e0bc54be-befa-48f4-982e-7c3d0f91f751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4e34be-e53e-434b-a851-3c78589a82c3", "tag": "c5e685a6-87c9-4534-a2e6-8b53a3ce0b8b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:57:58.305465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4754ce58-8ddd-4e53-b549-f11bb13d3c79 req-e0bc54be-befa-48f4-982e-7c3d0f91f751 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:58.307459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4754ce58-8ddd-4e53-b549-f11bb13d3c79 req-e0bc54be-befa-48f4-982e-7c3d0f91f751 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:58.307988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4754ce58-8ddd-4e53-b549-f11bb13d3c79 req-e0bc54be-befa-48f4-982e-7c3d0f91f751 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:58.338490 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-4754ce58-8ddd-4e53-b549-f11bb13d3c79 req-e0bc54be-befa-48f4-982e-7c3d0f91f751 service nova] Creating event network-changed:c5e685a6-87c9-4534-a2e6-8b53a3ce0b8b for instance ca4e34be-e53e-434b-a851-3c78589a82c3 on nch2-master-1 Sep 06 10:57:58.344458 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-4754ce58-8ddd-4e53-b549-f11bb13d3c79 req-e0bc54be-befa-48f4-982e-7c3d0f91f751 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074473 Sep 06 10:57:58.345719 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 890/1805] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:57:58.402766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f9ec59ad-d97b-4178-94c8-987ac2de2aee tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:58.403514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f9ec59ad-d97b-4178-94c8-987ac2de2aee tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:58.411398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9ec59ad-d97b-4178-94c8-987ac2de2aee tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:58.411731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9ec59ad-d97b-4178-94c8-987ac2de2aee tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:58.412188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9ec59ad-d97b-4178-94c8-987ac2de2aee tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:58.412918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9ec59ad-d97b-4178-94c8-987ac2de2aee tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:58.413393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9ec59ad-d97b-4178-94c8-987ac2de2aee tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:58.413832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9ec59ad-d97b-4178-94c8-987ac2de2aee tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:58.620307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9f261844-16fc-4dc4-b9f6-40d172a2383e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:58.621020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9f261844-16fc-4dc4-b9f6-40d172a2383e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:58.628912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f261844-16fc-4dc4-b9f6-40d172a2383e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:58.629799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f261844-16fc-4dc4-b9f6-40d172a2383e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:58.630675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f261844-16fc-4dc4-b9f6-40d172a2383e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:58.631421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f261844-16fc-4dc4-b9f6-40d172a2383e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:58.632486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f261844-16fc-4dc4-b9f6-40d172a2383e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:58.632932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f261844-16fc-4dc4-b9f6-40d172a2383e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:58.646679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f9ec59ad-d97b-4178-94c8-987ac2de2aee tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:58.663551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f9ec59ad-d97b-4178-94c8-987ac2de2aee tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:58.665582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f9ec59ad-d97b-4178-94c8-987ac2de2aee tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:58.667366 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f9ec59ad-d97b-4178-94c8-987ac2de2aee tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1281 microversion: 2.25 time: 0.269411 Sep 06 10:57:58.668494 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 916/1806] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:57:58 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1281 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:57:58.886560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1d09f560-742c-4d94-818a-0d8caecf9b0f tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:58.887449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1d09f560-742c-4d94-818a-0d8caecf9b0f tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:58.898013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d09f560-742c-4d94-818a-0d8caecf9b0f tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:58.898844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d09f560-742c-4d94-818a-0d8caecf9b0f tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:58.901165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d09f560-742c-4d94-818a-0d8caecf9b0f tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:58.902137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d09f560-742c-4d94-818a-0d8caecf9b0f tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:58.906463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d09f560-742c-4d94-818a-0d8caecf9b0f tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:58.907615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d09f560-742c-4d94-818a-0d8caecf9b0f tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:58.916838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9f261844-16fc-4dc4-b9f6-40d172a2383e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:58.934707 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9f261844-16fc-4dc4-b9f6-40d172a2383e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1199 microversion: 2.1 time: 0.319619 Sep 06 10:57:58.943373 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 891/1807] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:58 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1199 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:58.945932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:59.079320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:59.081560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:59.093659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:59.094984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:59.095772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:59.097634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:59.098385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:59.100627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:59.141151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:59.141656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:59.142101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:59.142566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lazy-loading 'fault' on Instance uuid 26309c50-a09b-444e-ab44-913b9a12e5ec {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:57:59.469624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:59.479718 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2ae42b1e-20a9-41d2-9bf1-f4f9fcbc4d6e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 200 len: 1305 microversion: 2.1 time: 0.411538 Sep 06 10:57:59.481003 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 892/1808] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:59 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 1305 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:59.646168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d09f560-742c-4d94-818a-0d8caecf9b0f tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:57:59.678438 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1d09f560-742c-4d94-818a-0d8caecf9b0f tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1317 microversion: 2.1 time: 0.797314 Sep 06 10:57:59.696407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-20fa35bb-09e7-4a87-83ee-bade25812f0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:59.696407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-20fa35bb-09e7-4a87-83ee-bade25812f0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:59.696407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=14 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:59.698738 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 917/1809] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:58 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1317 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:57:59.703365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20fa35bb-09e7-4a87-83ee-bade25812f0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:59.703365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20fa35bb-09e7-4a87-83ee-bade25812f0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:59.703365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20fa35bb-09e7-4a87-83ee-bade25812f0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:59.703695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20fa35bb-09e7-4a87-83ee-bade25812f0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:59.703992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20fa35bb-09e7-4a87-83ee-bade25812f0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:59.704422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20fa35bb-09e7-4a87-83ee-bade25812f0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:59.964706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e092df8-41c6-4fc7-9549-af4d0a8a43cb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:57:59.964706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4e092df8-41c6-4fc7-9549-af4d0a8a43cb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:57:59.971385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e092df8-41c6-4fc7-9549-af4d0a8a43cb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:59.971882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e092df8-41c6-4fc7-9549-af4d0a8a43cb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:59.972356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e092df8-41c6-4fc7-9549-af4d0a8a43cb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:57:59.973123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e092df8-41c6-4fc7-9549-af4d0a8a43cb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:57:59.973591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e092df8-41c6-4fc7-9549-af4d0a8a43cb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:57:59.974031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e092df8-41c6-4fc7-9549-af4d0a8a43cb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:00.103249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-20fa35bb-09e7-4a87-83ee-bade25812f0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:00.112529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-20fa35bb-09e7-4a87-83ee-bade25812f0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:00.114247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-20fa35bb-09e7-4a87-83ee-bade25812f0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:00.115515 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-20fa35bb-09e7-4a87-83ee-bade25812f0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1281 microversion: 2.25 time: 0.426345 Sep 06 10:58:00.127129 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 893/1810] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:57:59 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1281 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:00.307674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ec123275-c2a3-48d9-b81c-ec808d336a8b req-c2e8a9ef-56eb-4eed-a051-dc7b81397134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13346df-1ae9-49f9-8768-e174464a198a", "name": "network-vif-plugged", "status": "completed", "tag": "4ca62dc1-98f7-4849-a1cb-92d224f8d239"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:00.320590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ec123275-c2a3-48d9-b81c-ec808d336a8b req-c2e8a9ef-56eb-4eed-a051-dc7b81397134 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:00.321645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ec123275-c2a3-48d9-b81c-ec808d336a8b req-c2e8a9ef-56eb-4eed-a051-dc7b81397134 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:00.322613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ec123275-c2a3-48d9-b81c-ec808d336a8b req-c2e8a9ef-56eb-4eed-a051-dc7b81397134 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:00.334207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4e092df8-41c6-4fc7-9549-af4d0a8a43cb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:00.338005 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ec123275-c2a3-48d9-b81c-ec808d336a8b req-c2e8a9ef-56eb-4eed-a051-dc7b81397134 service nova] Creating event network-vif-plugged:4ca62dc1-98f7-4849-a1cb-92d224f8d239 for instance c13346df-1ae9-49f9-8768-e174464a198a on nch2-master-1 Sep 06 10:58:00.342293 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e092df8-41c6-4fc7-9549-af4d0a8a43cb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1199 microversion: 2.1 time: 0.383199 Sep 06 10:58:00.342866 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 918/1811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:57:59 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1199 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:00.345038 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ec123275-c2a3-48d9-b81c-ec808d336a8b req-c2e8a9ef-56eb-4eed-a051-dc7b81397134 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042447 Sep 06 10:58:00.345639 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 894/1812] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:58:00.510406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-001763ae-8a8e-4f66-a712-4d37f954b040 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:00.511873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-001763ae-8a8e-4f66-a712-4d37f954b040 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:00.528000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-001763ae-8a8e-4f66-a712-4d37f954b040 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:00.528000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-001763ae-8a8e-4f66-a712-4d37f954b040 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:00.528000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-001763ae-8a8e-4f66-a712-4d37f954b040 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:00.528000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-001763ae-8a8e-4f66-a712-4d37f954b040 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:00.528000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-001763ae-8a8e-4f66-a712-4d37f954b040 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:00.528000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-001763ae-8a8e-4f66-a712-4d37f954b040 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:00.540945 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-001763ae-8a8e-4f66-a712-4d37f954b040 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-001763ae-8a8e-4f66-a712-4d37f954b040 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec HTTP/1.1 Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '26309c50-a09b-444e-ab44-913b9a12e5ec'} Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:00.542735 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:00.548680 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:00.548680 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:00.548680 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:00.548680 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:58:00.548680 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:58:00.548680 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 10:58:00.548680 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:00.548680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-001763ae-8a8e-4f66-a712-4d37f954b040 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:58:00.548680 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-001763ae-8a8e-4f66-a712-4d37f954b040 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 404 len: 111 microversion: 2.1 time: 0.045710 Sep 06 10:58:00.557774 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 919/1813] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:00 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:00.708573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c1dd05d-1a4a-41a0-a74d-78ebe3ca0a2a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:00.709441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9c1dd05d-1a4a-41a0-a74d-78ebe3ca0a2a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:00.719570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c1dd05d-1a4a-41a0-a74d-78ebe3ca0a2a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:00.720585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1241252787", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "9312fcea-ff98-4f9b-847c-17d6e7290268"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:00.721545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c1dd05d-1a4a-41a0-a74d-78ebe3ca0a2a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:00.722505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c1dd05d-1a4a-41a0-a74d-78ebe3ca0a2a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:00.723589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c1dd05d-1a4a-41a0-a74d-78ebe3ca0a2a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:00.724464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c1dd05d-1a4a-41a0-a74d-78ebe3ca0a2a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:00.725247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c1dd05d-1a4a-41a0-a74d-78ebe3ca0a2a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:00.780337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] validate_networks() for [('9312fcea-ff98-4f9b-847c-17d6e7290268', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:58:01.092299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c1dd05d-1a4a-41a0-a74d-78ebe3ca0a2a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:01.107996 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9c1dd05d-1a4a-41a0-a74d-78ebe3ca0a2a tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1317 microversion: 2.1 time: 0.407401 Sep 06 10:58:01.128308 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 895/1814] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:00 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:01.144608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1acb6322-83b2-4efa-92e1-1e65dae92f1d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:01.145582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1acb6322-83b2-4efa-92e1-1e65dae92f1d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:01.165154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1acb6322-83b2-4efa-92e1-1e65dae92f1d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:01.165922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1acb6322-83b2-4efa-92e1-1e65dae92f1d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:01.166835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1acb6322-83b2-4efa-92e1-1e65dae92f1d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:01.168094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1acb6322-83b2-4efa-92e1-1e65dae92f1d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:01.169037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1acb6322-83b2-4efa-92e1-1e65dae92f1d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:01.169953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1acb6322-83b2-4efa-92e1-1e65dae92f1d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:01.409478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1acb6322-83b2-4efa-92e1-1e65dae92f1d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:01.421190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1acb6322-83b2-4efa-92e1-1e65dae92f1d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:01.421190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1acb6322-83b2-4efa-92e1-1e65dae92f1d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:01.421849 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1acb6322-83b2-4efa-92e1-1e65dae92f1d tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1281 microversion: 2.25 time: 0.282872 Sep 06 10:58:01.422408 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 896/1815] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:01 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1281 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:01.427800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c0eb1680-01d6-48e7-af77-1fc768e97be0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:01.428628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c0eb1680-01d6-48e7-af77-1fc768e97be0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:01.443083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0eb1680-01d6-48e7-af77-1fc768e97be0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:01.444831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0eb1680-01d6-48e7-af77-1fc768e97be0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:01.446235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0eb1680-01d6-48e7-af77-1fc768e97be0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:01.447280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0eb1680-01d6-48e7-af77-1fc768e97be0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:01.447972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0eb1680-01d6-48e7-af77-1fc768e97be0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:01.448580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0eb1680-01d6-48e7-af77-1fc768e97be0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:01.488173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:58:01.488969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:58:01.489618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:58:01.490207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:58:01.490631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:58:01.506542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:01.507045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:01.507495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:01.514580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:01.519197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:01.519197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:01.535211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:01.540888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:58:01.547933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for user e19903666a1243e3a66411e30babe299 and project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:58:01.562057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:58:01.564873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:58:01.647262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c0eb1680-01d6-48e7-af77-1fc768e97be0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:01.655647 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c0eb1680-01d6-48e7-af77-1fc768e97be0 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1199 microversion: 2.1 time: 0.232005 Sep 06 10:58:01.656685 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 897/1816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:01 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1199 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:01.738723 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-73bb1854-feba-4ac6-80dd-e8035946c9a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.020175 Sep 06 10:58:01.744759 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 920/1817] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:58:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 10:58:01.750757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4eb91a94-ed83-4ac8-8032-2248c27d728a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:01.752139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4eb91a94-ed83-4ac8-8032-2248c27d728a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:01.827418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4eb91a94-ed83-4ac8-8032-2248c27d728a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:01.836746 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4eb91a94-ed83-4ac8-8032-2248c27d728a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1215 microversion: 2.1 time: 0.090048 Sep 06 10:58:01.848293 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 898/1818] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:01 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:58:02.135036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cf61d083-e939-4d8e-bd12-baf994122c4e tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:02.135769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cf61d083-e939-4d8e-bd12-baf994122c4e tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:02.146171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf61d083-e939-4d8e-bd12-baf994122c4e tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:02.149846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf61d083-e939-4d8e-bd12-baf994122c4e tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:02.149846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf61d083-e939-4d8e-bd12-baf994122c4e tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:02.149846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf61d083-e939-4d8e-bd12-baf994122c4e tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:02.149846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf61d083-e939-4d8e-bd12-baf994122c4e tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:02.149846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cf61d083-e939-4d8e-bd12-baf994122c4e tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:02.364492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cf61d083-e939-4d8e-bd12-baf994122c4e tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:02.374390 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cf61d083-e939-4d8e-bd12-baf994122c4e tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1317 microversion: 2.1 time: 0.244872 Sep 06 10:58:02.392294 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 921/1819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:02 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:02.450235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d6b8c2c0-1e61-4b6a-9330-83db034495e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:02.455094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d6b8c2c0-1e61-4b6a-9330-83db034495e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:02.474679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6b8c2c0-1e61-4b6a-9330-83db034495e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:02.475906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6b8c2c0-1e61-4b6a-9330-83db034495e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:02.477114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6b8c2c0-1e61-4b6a-9330-83db034495e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:02.489827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6b8c2c0-1e61-4b6a-9330-83db034495e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:02.489827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6b8c2c0-1e61-4b6a-9330-83db034495e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:02.491374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6b8c2c0-1e61-4b6a-9330-83db034495e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:02.679984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e2e8e9f6-2dff-46b1-932b-62778a4d834b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:02.681171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e2e8e9f6-2dff-46b1-932b-62778a4d834b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:02.682534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d6b8c2c0-1e61-4b6a-9330-83db034495e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:02.696236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2e8e9f6-2dff-46b1-932b-62778a4d834b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:02.697044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2e8e9f6-2dff-46b1-932b-62778a4d834b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:02.698425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2e8e9f6-2dff-46b1-932b-62778a4d834b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:02.701141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2e8e9f6-2dff-46b1-932b-62778a4d834b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:02.702233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2e8e9f6-2dff-46b1-932b-62778a4d834b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:02.703610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d6b8c2c0-1e61-4b6a-9330-83db034495e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:02.705854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2e8e9f6-2dff-46b1-932b-62778a4d834b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:02.710408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d6b8c2c0-1e61-4b6a-9330-83db034495e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:02.711669 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d6b8c2c0-1e61-4b6a-9330-83db034495e4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1281 microversion: 2.25 time: 0.267146 Sep 06 10:58:02.712578 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 899/1820] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:02 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1281 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:02.863095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-43033d0a-5060-438b-88c4-6a5084357508 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:02.864478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-43033d0a-5060-438b-88c4-6a5084357508 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:02.931707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e2e8e9f6-2dff-46b1-932b-62778a4d834b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:02.968233 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e2e8e9f6-2dff-46b1-932b-62778a4d834b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1199 microversion: 2.1 time: 0.293033 Sep 06 10:58:02.972750 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 922/1821] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:02 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1199 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:03.007054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-43033d0a-5060-438b-88c4-6a5084357508 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:03.016096 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-43033d0a-5060-438b-88c4-6a5084357508 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1215 microversion: 2.1 time: 0.157665 Sep 06 10:58:03.017291 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 900/1822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:02 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:03.400927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d90de338-f44d-4b23-b4f0-0f84d89d246d tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:03.401673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d90de338-f44d-4b23-b4f0-0f84d89d246d tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:03.412103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d90de338-f44d-4b23-b4f0-0f84d89d246d tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:03.412601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d90de338-f44d-4b23-b4f0-0f84d89d246d tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:03.415881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d90de338-f44d-4b23-b4f0-0f84d89d246d tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:03.417324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d90de338-f44d-4b23-b4f0-0f84d89d246d tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:03.419206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d90de338-f44d-4b23-b4f0-0f84d89d246d tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:03.419831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d90de338-f44d-4b23-b4f0-0f84d89d246d tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:03.702252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d90de338-f44d-4b23-b4f0-0f84d89d246d tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:03.710898 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d90de338-f44d-4b23-b4f0-0f84d89d246d tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1317 microversion: 2.1 time: 0.314652 Sep 06 10:58:03.711890 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 923/1823] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:03 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:03.747905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3896850c-66d7-4ce5-a79a-0eb2bc35e4b6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:03.748550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3896850c-66d7-4ce5-a79a-0eb2bc35e4b6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:03.766553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3896850c-66d7-4ce5-a79a-0eb2bc35e4b6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:03.768899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3896850c-66d7-4ce5-a79a-0eb2bc35e4b6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:03.769358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3896850c-66d7-4ce5-a79a-0eb2bc35e4b6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:03.771782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3896850c-66d7-4ce5-a79a-0eb2bc35e4b6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:03.774412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3896850c-66d7-4ce5-a79a-0eb2bc35e4b6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:03.776219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3896850c-66d7-4ce5-a79a-0eb2bc35e4b6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:03.999484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d566702f-ac52-473e-94ab-63817210192d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:04.001334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d566702f-ac52-473e-94ab-63817210192d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:04.025574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d566702f-ac52-473e-94ab-63817210192d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:04.028550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d566702f-ac52-473e-94ab-63817210192d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:04.030878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d566702f-ac52-473e-94ab-63817210192d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:04.033878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d566702f-ac52-473e-94ab-63817210192d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:04.035397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d566702f-ac52-473e-94ab-63817210192d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:04.036928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d566702f-ac52-473e-94ab-63817210192d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:04.197922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3896850c-66d7-4ce5-a79a-0eb2bc35e4b6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:04.203055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:04.213822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3896850c-66d7-4ce5-a79a-0eb2bc35e4b6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:04.216942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3896850c-66d7-4ce5-a79a-0eb2bc35e4b6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:04.219758 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3896850c-66d7-4ce5-a79a-0eb2bc35e4b6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1478 microversion: 2.25 time: 0.478708 Sep 06 10:58:04.221153 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 901/1824] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:03 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1478 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:04.226779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-11eaab0c-c9c8-44aa-8276-84b60b16d1fd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:04.227687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-11eaab0c-c9c8-44aa-8276-84b60b16d1fd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:04.237467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11eaab0c-c9c8-44aa-8276-84b60b16d1fd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:04.243309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11eaab0c-c9c8-44aa-8276-84b60b16d1fd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:04.243309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11eaab0c-c9c8-44aa-8276-84b60b16d1fd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:04.243309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11eaab0c-c9c8-44aa-8276-84b60b16d1fd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:04.243309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11eaab0c-c9c8-44aa-8276-84b60b16d1fd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:04.243309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11eaab0c-c9c8-44aa-8276-84b60b16d1fd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:04.366690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-11eaab0c-c9c8-44aa-8276-84b60b16d1fd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:04.384859 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-11eaab0c-c9c8-44aa-8276-84b60b16d1fd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1211 microversion: 2.1 time: 0.159690 Sep 06 10:58:04.398572 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 902/1825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:04 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1211 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:04.418794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d566702f-ac52-473e-94ab-63817210192d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:04.434752 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d566702f-ac52-473e-94ab-63817210192d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1199 microversion: 2.1 time: 0.443560 Sep 06 10:58:04.449007 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 924/1826] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:03 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1199 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:04.724438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-f5220b62-a1b8-472d-a0fd-92f24dddf0f6 req-72952a6e-1940-431e-ad94-d407448d50cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "306337d6-b772-41a6-8d68-2e34a9c0aa66", "name": "network-vif-plugged", "status": "completed", "tag": "accaabe8-5bea-4860-8126-43d747eb00c3"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:04.762379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f5220b62-a1b8-472d-a0fd-92f24dddf0f6 req-72952a6e-1940-431e-ad94-d407448d50cc service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:04.763174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f5220b62-a1b8-472d-a0fd-92f24dddf0f6 req-72952a6e-1940-431e-ad94-d407448d50cc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:04.763786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f5220b62-a1b8-472d-a0fd-92f24dddf0f6 req-72952a6e-1940-431e-ad94-d407448d50cc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:04.780515 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f5220b62-a1b8-472d-a0fd-92f24dddf0f6 req-72952a6e-1940-431e-ad94-d407448d50cc service nova] Creating event network-vif-plugged:accaabe8-5bea-4860-8126-43d747eb00c3 for instance 306337d6-b772-41a6-8d68-2e34a9c0aa66 on nch1-master-1 Sep 06 10:58:04.786472 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-f5220b62-a1b8-472d-a0fd-92f24dddf0f6 req-72952a6e-1940-431e-ad94-d407448d50cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070543 Sep 06 10:58:04.792221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d1e29c2b-3eaf-4d93-bcfb-fe7d737056db tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:04.792933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d1e29c2b-3eaf-4d93-bcfb-fe7d737056db tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:04.795225 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 925/1827] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:04.804318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1e29c2b-3eaf-4d93-bcfb-fe7d737056db tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:04.804887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1e29c2b-3eaf-4d93-bcfb-fe7d737056db tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:04.805392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1e29c2b-3eaf-4d93-bcfb-fe7d737056db tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:04.806231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1e29c2b-3eaf-4d93-bcfb-fe7d737056db tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:04.806755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1e29c2b-3eaf-4d93-bcfb-fe7d737056db tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:04.807560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1e29c2b-3eaf-4d93-bcfb-fe7d737056db tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:04.818542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-52619ecf-bdaa-48b0-82dc-4745e9a13a3b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:04.821283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-52619ecf-bdaa-48b0-82dc-4745e9a13a3b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:04.850499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52619ecf-bdaa-48b0-82dc-4745e9a13a3b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:04.850499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52619ecf-bdaa-48b0-82dc-4745e9a13a3b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:04.850499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52619ecf-bdaa-48b0-82dc-4745e9a13a3b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:04.850802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52619ecf-bdaa-48b0-82dc-4745e9a13a3b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:04.851434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52619ecf-bdaa-48b0-82dc-4745e9a13a3b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:04.851940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52619ecf-bdaa-48b0-82dc-4745e9a13a3b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:05.241781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-d1e29c2b-3eaf-4d93-bcfb-fe7d737056db tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid c13346df-1ae9-49f9-8768-e174464a198a {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:58:05.262567 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d1e29c2b-3eaf-4d93-bcfb-fe7d737056db tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1971 microversion: 2.25 time: 0.859718 Sep 06 10:58:05.263575 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 903/1828] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:04 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1971 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:05.294441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-25c80358-04dd-4509-bc55-22618ce79946 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:05.295252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-25c80358-04dd-4509-bc55-22618ce79946 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:05.301385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-52619ecf-bdaa-48b0-82dc-4745e9a13a3b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:05.319313 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-52619ecf-bdaa-48b0-82dc-4745e9a13a3b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1317 microversion: 2.1 time: 0.519514 Sep 06 10:58:05.320458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25c80358-04dd-4509-bc55-22618ce79946 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:05.321139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25c80358-04dd-4509-bc55-22618ce79946 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:05.321557 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 926/1829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:04 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:05.322212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25c80358-04dd-4509-bc55-22618ce79946 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:05.324765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25c80358-04dd-4509-bc55-22618ce79946 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:05.325450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25c80358-04dd-4509-bc55-22618ce79946 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:05.326110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25c80358-04dd-4509-bc55-22618ce79946 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:05.410821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d666e0d2-33af-4355-b92f-55e6fb6e778b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:05.411864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d666e0d2-33af-4355-b92f-55e6fb6e778b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:05.420004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d666e0d2-33af-4355-b92f-55e6fb6e778b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:05.420881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d666e0d2-33af-4355-b92f-55e6fb6e778b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:05.425630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d666e0d2-33af-4355-b92f-55e6fb6e778b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:05.426636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d666e0d2-33af-4355-b92f-55e6fb6e778b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:05.427385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d666e0d2-33af-4355-b92f-55e6fb6e778b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:05.428068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d666e0d2-33af-4355-b92f-55e6fb6e778b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:05.550047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d666e0d2-33af-4355-b92f-55e6fb6e778b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:05.558877 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d666e0d2-33af-4355-b92f-55e6fb6e778b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1267 microversion: 2.1 time: 0.152832 Sep 06 10:58:05.563899 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 927/1830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:05 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:58:05.569553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-737a88b8-4b1b-4f45-be30-0510caf8b24e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:05.575353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-737a88b8-4b1b-4f45-be30-0510caf8b24e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:05.583700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-737a88b8-4b1b-4f45-be30-0510caf8b24e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:05.584626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-737a88b8-4b1b-4f45-be30-0510caf8b24e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:05.585294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-737a88b8-4b1b-4f45-be30-0510caf8b24e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:05.586352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-737a88b8-4b1b-4f45-be30-0510caf8b24e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:05.587181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-737a88b8-4b1b-4f45-be30-0510caf8b24e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:05.587868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-737a88b8-4b1b-4f45-be30-0510caf8b24e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:05.615927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-25c80358-04dd-4509-bc55-22618ce79946 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid c13346df-1ae9-49f9-8768-e174464a198a {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:58:05.655753 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-25c80358-04dd-4509-bc55-22618ce79946 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1971 microversion: 2.25 time: 0.366991 Sep 06 10:58:05.666441 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 904/1831] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:05 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1971 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:58:05.693954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c3bb423f-4d8a-47cf-be01-671450b83935 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:05.698254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3bb423f-4d8a-47cf-be01-671450b83935 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:05.698755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3bb423f-4d8a-47cf-be01-671450b83935 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:05.699828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3bb423f-4d8a-47cf-be01-671450b83935 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:05.699953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3bb423f-4d8a-47cf-be01-671450b83935 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:05.700400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3bb423f-4d8a-47cf-be01-671450b83935 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:05.700828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3bb423f-4d8a-47cf-be01-671450b83935 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:05.833264 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c3bb423f-4d8a-47cf-be01-671450b83935 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.142528 Sep 06 10:58:05.834642 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 905/1832] 10.222.0.20 () {60 vars in 1217 bytes} [Tue Sep 6 10:58:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 10:58:05.840780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-737a88b8-4b1b-4f45-be30-0510caf8b24e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:05.850346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:05.856146 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-737a88b8-4b1b-4f45-be30-0510caf8b24e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1199 microversion: 2.1 time: 0.290720 Sep 06 10:58:05.857609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:05.874475 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 928/1833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:05 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1199 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:05.876146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:05.880180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:05.881274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:05.882262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:05.883074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:05.883774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:05.962178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'flavor' on Instance uuid c13346df-1ae9-49f9-8768-e174464a198a {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:58:05.986039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Going to try to live migrate instance to nch1-master-1 {{(pid=140875) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 06 10:58:06.348030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d2b98581-1cb2-4faf-a095-72312c71c1f4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:06.358292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d2b98581-1cb2-4faf-a095-72312c71c1f4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:06.367321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2b98581-1cb2-4faf-a095-72312c71c1f4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:06.367810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2b98581-1cb2-4faf-a095-72312c71c1f4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:06.368497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2b98581-1cb2-4faf-a095-72312c71c1f4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:06.369270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2b98581-1cb2-4faf-a095-72312c71c1f4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:06.369746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2b98581-1cb2-4faf-a095-72312c71c1f4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:06.370338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2b98581-1cb2-4faf-a095-72312c71c1f4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:06.863581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d2b98581-1cb2-4faf-a095-72312c71c1f4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:06.902794 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d2b98581-1cb2-4faf-a095-72312c71c1f4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1317 microversion: 2.1 time: 0.558720 Sep 06 10:58:06.905153 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 929/1834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:06 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1317 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:06.919362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b6024e0e-315e-4b3c-acbf-2d7e74e32400 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:06.920121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b6024e0e-315e-4b3c-acbf-2d7e74e32400 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:06.932788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6024e0e-315e-4b3c-acbf-2d7e74e32400 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:06.933291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6024e0e-315e-4b3c-acbf-2d7e74e32400 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:06.933740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6024e0e-315e-4b3c-acbf-2d7e74e32400 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:06.936262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6024e0e-315e-4b3c-acbf-2d7e74e32400 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:06.936747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6024e0e-315e-4b3c-acbf-2d7e74e32400 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:06.937202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6024e0e-315e-4b3c-acbf-2d7e74e32400 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:07.094289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b6024e0e-315e-4b3c-acbf-2d7e74e32400 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:07.103691 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b6024e0e-315e-4b3c-acbf-2d7e74e32400 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1273 microversion: 2.1 time: 0.196240 Sep 06 10:58:07.117068 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 930/1835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:06 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:07.128538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-246aa4a7-9e43-4bbd-9177-65fbbac29ca9 req-4d2ba2b6-83f4-4ae5-9a88-06aa83c6543c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4e34be-e53e-434b-a851-3c78589a82c3", "name": "network-vif-plugged", "status": "completed", "tag": "c5e685a6-87c9-4534-a2e6-8b53a3ce0b8b"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:07.139296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-246aa4a7-9e43-4bbd-9177-65fbbac29ca9 req-4d2ba2b6-83f4-4ae5-9a88-06aa83c6543c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:07.140132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-246aa4a7-9e43-4bbd-9177-65fbbac29ca9 req-4d2ba2b6-83f4-4ae5-9a88-06aa83c6543c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:07.140747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-246aa4a7-9e43-4bbd-9177-65fbbac29ca9 req-4d2ba2b6-83f4-4ae5-9a88-06aa83c6543c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:07.167105 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-246aa4a7-9e43-4bbd-9177-65fbbac29ca9 req-4d2ba2b6-83f4-4ae5-9a88-06aa83c6543c service nova] Creating event network-vif-plugged:c5e685a6-87c9-4534-a2e6-8b53a3ce0b8b for instance ca4e34be-e53e-434b-a851-3c78589a82c3 on nch2-master-1 Sep 06 10:58:07.180786 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-246aa4a7-9e43-4bbd-9177-65fbbac29ca9 req-4d2ba2b6-83f4-4ae5-9a88-06aa83c6543c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061180 Sep 06 10:58:07.181960 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 931/1836] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:07.189741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1d19c2b1-4089-47d3-8afd-34c87347db7d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:07.190781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1d19c2b1-4089-47d3-8afd-34c87347db7d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:07.197607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d19c2b1-4089-47d3-8afd-34c87347db7d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:07.198767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d19c2b1-4089-47d3-8afd-34c87347db7d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:07.199468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d19c2b1-4089-47d3-8afd-34c87347db7d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:07.200482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d19c2b1-4089-47d3-8afd-34c87347db7d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:07.201209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d19c2b1-4089-47d3-8afd-34c87347db7d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:07.201879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d19c2b1-4089-47d3-8afd-34c87347db7d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:07.577568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d19c2b1-4089-47d3-8afd-34c87347db7d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:07.587275 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1d19c2b1-4089-47d3-8afd-34c87347db7d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1199 microversion: 2.1 time: 0.403140 Sep 06 10:58:07.593158 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 932/1837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:07 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1199 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:07.927644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c04741c-1315-4b5d-aa28-09f41e6469e1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:07.928265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8c04741c-1315-4b5d-aa28-09f41e6469e1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:07.946759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c04741c-1315-4b5d-aa28-09f41e6469e1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:07.947289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c04741c-1315-4b5d-aa28-09f41e6469e1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:07.947732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c04741c-1315-4b5d-aa28-09f41e6469e1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:07.948668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c04741c-1315-4b5d-aa28-09f41e6469e1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:07.949302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c04741c-1315-4b5d-aa28-09f41e6469e1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:07.949905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c04741c-1315-4b5d-aa28-09f41e6469e1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:08.597596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8c04741c-1315-4b5d-aa28-09f41e6469e1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:08.624271 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8c04741c-1315-4b5d-aa28-09f41e6469e1 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1506 microversion: 2.1 time: 0.698153 Sep 06 10:58:08.652755 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 933/1838] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:07 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1506 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:08.665911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-060042a0-82aa-4c30-a974-5d0101859d7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:08.665911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-060042a0-82aa-4c30-a974-5d0101859d7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:08.681149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-060042a0-82aa-4c30-a974-5d0101859d7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:08.682203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-060042a0-82aa-4c30-a974-5d0101859d7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:08.683500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-060042a0-82aa-4c30-a974-5d0101859d7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:08.684632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-060042a0-82aa-4c30-a974-5d0101859d7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:08.686329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-060042a0-82aa-4c30-a974-5d0101859d7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:08.687559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-060042a0-82aa-4c30-a974-5d0101859d7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:09.354742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-060042a0-82aa-4c30-a974-5d0101859d7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:09.373295 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-060042a0-82aa-4c30-a974-5d0101859d7b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1315 microversion: 2.1 time: 0.718544 Sep 06 10:58:09.375819 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 934/1839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:08 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1315 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:09.384768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3cd46546-f7ef-4860-ac6e-1cf9ada73c35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:09.385965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3cd46546-f7ef-4860-ac6e-1cf9ada73c35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:09.398350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cd46546-f7ef-4860-ac6e-1cf9ada73c35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:09.400231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cd46546-f7ef-4860-ac6e-1cf9ada73c35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:09.403431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cd46546-f7ef-4860-ac6e-1cf9ada73c35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:09.403431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cd46546-f7ef-4860-ac6e-1cf9ada73c35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:09.404191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cd46546-f7ef-4860-ac6e-1cf9ada73c35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:09.405005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cd46546-f7ef-4860-ac6e-1cf9ada73c35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:10.203366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3cd46546-f7ef-4860-ac6e-1cf9ada73c35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:10.215292 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3cd46546-f7ef-4860-ac6e-1cf9ada73c35 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1383 microversion: 2.1 time: 0.837649 Sep 06 10:58:10.219402 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 935/1840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:09 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1383 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:10.762051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c52caa3e-ec7a-4d38-a325-95f35ce9e48a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:10.763688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c52caa3e-ec7a-4d38-a325-95f35ce9e48a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:10.785645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c52caa3e-ec7a-4d38-a325-95f35ce9e48a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:10.786307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c52caa3e-ec7a-4d38-a325-95f35ce9e48a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:10.788218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c52caa3e-ec7a-4d38-a325-95f35ce9e48a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:10.789854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c52caa3e-ec7a-4d38-a325-95f35ce9e48a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:10.791966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c52caa3e-ec7a-4d38-a325-95f35ce9e48a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:10.793721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c52caa3e-ec7a-4d38-a325-95f35ce9e48a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:11.216987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:11.225428 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c52caa3e-ec7a-4d38-a325-95f35ce9e48a tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1534 microversion: 2.1 time: 0.986496 Sep 06 10:58:11.226599 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 936/1841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:10 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1534 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:11.233067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9eeccad1-498e-4eb4-bbb4-02e5d9c9dfce tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:11.233932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9eeccad1-498e-4eb4-bbb4-02e5d9c9dfce tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:11.242697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eeccad1-498e-4eb4-bbb4-02e5d9c9dfce tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:11.243487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eeccad1-498e-4eb4-bbb4-02e5d9c9dfce tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:11.244805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eeccad1-498e-4eb4-bbb4-02e5d9c9dfce tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:11.245965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eeccad1-498e-4eb4-bbb4-02e5d9c9dfce tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:11.246663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eeccad1-498e-4eb4-bbb4-02e5d9c9dfce tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:11.247878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eeccad1-498e-4eb4-bbb4-02e5d9c9dfce tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:11.395673 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a/action" status: 202 len: 0 microversion: 2.25 time: 5.551079 Sep 06 10:58:11.397067 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 906/1842] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 10:58:05 2022] POST /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a/action => generated 0 bytes in 5554 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:58:11.405981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-782aae4f-9df7-4da9-be5d-4a8b01711bd5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:11.412679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-782aae4f-9df7-4da9-be5d-4a8b01711bd5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:11.474879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-782aae4f-9df7-4da9-be5d-4a8b01711bd5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:11.475547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-782aae4f-9df7-4da9-be5d-4a8b01711bd5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:11.477978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-782aae4f-9df7-4da9-be5d-4a8b01711bd5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:11.480762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-782aae4f-9df7-4da9-be5d-4a8b01711bd5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:11.481353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-782aae4f-9df7-4da9-be5d-4a8b01711bd5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:11.482366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-782aae4f-9df7-4da9-be5d-4a8b01711bd5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:11.530698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:11.556460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=46 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:12.286412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9eeccad1-498e-4eb4-bbb4-02e5d9c9dfce tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:12.298401 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9eeccad1-498e-4eb4-bbb4-02e5d9c9dfce tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1315 microversion: 2.1 time: 1.070231 Sep 06 10:58:12.299562 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 937/1843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:11 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1315 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:12.320753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-880eb409-796e-4a4f-9534-532b829a8b20 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:12.321435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-880eb409-796e-4a4f-9534-532b829a8b20 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:12.346602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-880eb409-796e-4a4f-9534-532b829a8b20 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:12.346602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-880eb409-796e-4a4f-9534-532b829a8b20 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:12.346602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-880eb409-796e-4a4f-9534-532b829a8b20 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:12.346602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-880eb409-796e-4a4f-9534-532b829a8b20 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:12.346602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-880eb409-796e-4a4f-9534-532b829a8b20 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:12.346602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-880eb409-796e-4a4f-9534-532b829a8b20 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:12.550245 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-782aae4f-9df7-4da9-be5d-4a8b01711bd5 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1534 microversion: 2.1 time: 1.151618 Sep 06 10:58:12.553448 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 907/1844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:11 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1534 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:12.568523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ea885c54-b99d-41de-a0e6-9203e37ced68 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4290afdd-d450-406f-9a50-3848de9ff313"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:12.570881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ea885c54-b99d-41de-a0e6-9203e37ced68 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:12.582745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea885c54-b99d-41de-a0e6-9203e37ced68 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:12.584419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea885c54-b99d-41de-a0e6-9203e37ced68 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:12.584419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea885c54-b99d-41de-a0e6-9203e37ced68 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:12.590923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea885c54-b99d-41de-a0e6-9203e37ced68 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:12.591552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea885c54-b99d-41de-a0e6-9203e37ced68 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:12.592954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea885c54-b99d-41de-a0e6-9203e37ced68 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:12.731622 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-ea885c54-b99d-41de-a0e6-9203e37ced68 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] HTTP exception thrown: Volume c387d5e8-a149-4041-a6c5-e8a994f43df2 could not be found. Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ea885c54-b99d-41de-a0e6-9203e37ced68 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Request method failure captured: Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: request: PUT /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66/os-volume_attachments/c387d5e8-a149-4041-a6c5-e8a994f43df2 HTTP/1.1 Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 74 Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFydSmalNBagN2tjar2MI_p4eCTNHfdA5-InOPIrsbBV0DQKnyZxBp4q9SuY9TKb5mCqrn1NMMrdfh8IXhNDvE4G6qn2MbHxbnMFxAliSlZewZuPsdd70WO30FRR1CHGEBeooadIGxig0qpdpKXEoeETuyN7NKWk0-VnTciFCUmwfCzQ Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ff5ee808788043528fdeadc86f89b84d Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-VolumesAdminNegativeTest-536982142 Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff5ee808788043528fdeadc86f89b84d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff5ee808788043528fdeadc86f89b84d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff5ee808788043528fdeadc86f89b84d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff5ee808788043528fdeadc86f89b84d"}]}] Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-VolumesAdminNegativeTest-536982142 Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ff5ee808788043528fdeadc86f89b84d Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-536982142 Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-VolumesAdminNegativeTest-536982142-project-admin Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6a18cb9df0834bf7a271f48f4075ca58 Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-VolumesAdminNegativeTest-536982142-project-admin Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: {"volumeAttachment": {"volumeId": "4290afdd-d450-406f-9a50-3848de9ff313"}} Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: exception: Volume c387d5e8-a149-4041-a6c5-e8a994f43df2 could not be found. Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'server_id': '306337d6-b772-41a6-8d68-2e34a9c0aa66', 'id': 'c387d5e8-a149-4041-a6c5-e8a994f43df2', 'body': {'volumeAttachment': {'volumeId': '4290afdd-d450-406f-9a50-3848de9ff313'}}} Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c387d5e8-a149-4041-a6c5-e8a994f43df2 could not be found. (HTTP 404) (Request-ID: req-0ed36a49-658d-448d-bde8-4f12a50beda6) Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 10:58:12.734243 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c387d5e8-a149-4041-a6c5-e8a994f43df2 could not be found. Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c387d5e8-a149-4041-a6c5-e8a994f43df2 could not be found. Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c387d5e8-a149-4041-a6c5-e8a994f43df2 could not be found. Sep 06 10:58:12.740107 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:12.746396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ea885c54-b99d-41de-a0e6-9203e37ced68 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] Returning 404 to user: Volume c387d5e8-a149-4041-a6c5-e8a994f43df2 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:58:12.746396 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ea885c54-b99d-41de-a0e6-9203e37ced68 tempest-VolumesAdminNegativeTest-536982142 tempest-VolumesAdminNegativeTest-536982142-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66/os-volume_attachments/c387d5e8-a149-4041-a6c5-e8a994f43df2" status: 404 len: 109 microversion: 2.1 time: 0.191329 Sep 06 10:58:12.746891 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 908/1845] 10.222.0.20 () {60 vars in 1433 bytes} [Tue Sep 6 10:58:12 2022] PUT /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66/os-volume_attachments/c387d5e8-a149-4041-a6c5-e8a994f43df2 => generated 109 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:12.755169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-4e25c611-d155-49ad-9c70-5843a0c67295 req-3770ee97-0efc-4ef5-a111-4c0b8eb68d57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19d97c3-c476-487e-9dca-8b524376c2e6", "tag": "6b4ea1d2-d432-4b81-ae6b-7cc89648aca3"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:12.769264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-880eb409-796e-4a4f-9534-532b829a8b20 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:12.777764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4e25c611-d155-49ad-9c70-5843a0c67295 req-3770ee97-0efc-4ef5-a111-4c0b8eb68d57 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:12.780965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4e25c611-d155-49ad-9c70-5843a0c67295 req-3770ee97-0efc-4ef5-a111-4c0b8eb68d57 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:12.781633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4e25c611-d155-49ad-9c70-5843a0c67295 req-3770ee97-0efc-4ef5-a111-4c0b8eb68d57 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:12.786418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-880eb409-796e-4a4f-9534-532b829a8b20 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:12.796166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-880eb409-796e-4a4f-9534-532b829a8b20 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:12.800724 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-880eb409-796e-4a4f-9534-532b829a8b20 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 0.483782 Sep 06 10:58:12.803958 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 938/1846] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:12 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:12.820878 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-4e25c611-d155-49ad-9c70-5843a0c67295 req-3770ee97-0efc-4ef5-a111-4c0b8eb68d57 service nova] Creating event network-changed:6b4ea1d2-d432-4b81-ae6b-7cc89648aca3 for instance b19d97c3-c476-487e-9dca-8b524376c2e6 on nch1-master-1 Sep 06 10:58:12.823966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8d50cb81-cf40-43ed-b4fc-a2d08c068f25 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:12.832571 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-4e25c611-d155-49ad-9c70-5843a0c67295 req-3770ee97-0efc-4ef5-a111-4c0b8eb68d57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084234 Sep 06 10:58:12.837686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d50cb81-cf40-43ed-b4fc-a2d08c068f25 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:12.838414 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 909/1847] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:12.844242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d50cb81-cf40-43ed-b4fc-a2d08c068f25 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:12.844242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d50cb81-cf40-43ed-b4fc-a2d08c068f25 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:12.844963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d50cb81-cf40-43ed-b4fc-a2d08c068f25 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:12.849904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d50cb81-cf40-43ed-b4fc-a2d08c068f25 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:12.850500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d50cb81-cf40-43ed-b4fc-a2d08c068f25 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:12.945573 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8d50cb81-cf40-43ed-b4fc-a2d08c068f25 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.135726 Sep 06 10:58:12.946163 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 939/1848] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Sep 6 10:58:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:12.960515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ee4168d-aff3-41b5-87f0-12f014b8f229 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:12.963090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0ee4168d-aff3-41b5-87f0-12f014b8f229 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:12.985974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ee4168d-aff3-41b5-87f0-12f014b8f229 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:12.987792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ee4168d-aff3-41b5-87f0-12f014b8f229 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:12.990410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ee4168d-aff3-41b5-87f0-12f014b8f229 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:12.991396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ee4168d-aff3-41b5-87f0-12f014b8f229 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:12.998544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ee4168d-aff3-41b5-87f0-12f014b8f229 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:12.998544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ee4168d-aff3-41b5-87f0-12f014b8f229 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:13.015752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:13.087900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-0ee4168d-aff3-41b5-87f0-12f014b8f229 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lazy-loading 'flavor' on Instance uuid ca4e34be-e53e-434b-a851-3c78589a82c3 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:58:13.120269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0ee4168d-aff3-41b5-87f0-12f014b8f229 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Going to try to live migrate instance to nch1-master-1 {{(pid=140875) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 06 10:58:13.329270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d594750d-506b-4846-95e0-09a5534f8894 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:13.331332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d594750d-506b-4846-95e0-09a5534f8894 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:13.361921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d594750d-506b-4846-95e0-09a5534f8894 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:13.362447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d594750d-506b-4846-95e0-09a5534f8894 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:13.362910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d594750d-506b-4846-95e0-09a5534f8894 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:13.363692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d594750d-506b-4846-95e0-09a5534f8894 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:13.364175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d594750d-506b-4846-95e0-09a5534f8894 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:13.364621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d594750d-506b-4846-95e0-09a5534f8894 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:13.857850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d594750d-506b-4846-95e0-09a5534f8894 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:13.871118 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d594750d-506b-4846-95e0-09a5534f8894 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1315 microversion: 2.1 time: 0.543527 Sep 06 10:58:13.873514 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 940/1849] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:13 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:13.886723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f266a3dc-857d-4fed-b009-75c01b02b4f3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:13.887791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f266a3dc-857d-4fed-b009-75c01b02b4f3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:13.910935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f266a3dc-857d-4fed-b009-75c01b02b4f3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:13.910935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f266a3dc-857d-4fed-b009-75c01b02b4f3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:13.910935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f266a3dc-857d-4fed-b009-75c01b02b4f3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:13.910935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f266a3dc-857d-4fed-b009-75c01b02b4f3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:13.910935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f266a3dc-857d-4fed-b009-75c01b02b4f3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:13.911626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f266a3dc-857d-4fed-b009-75c01b02b4f3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:14.212882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f266a3dc-857d-4fed-b009-75c01b02b4f3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:14.228054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f266a3dc-857d-4fed-b009-75c01b02b4f3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:14.229819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f266a3dc-857d-4fed-b009-75c01b02b4f3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:14.236064 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f266a3dc-857d-4fed-b009-75c01b02b4f3 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 0.356361 Sep 06 10:58:14.238607 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 941/1850] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:13 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:14.900349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3f8fc1f5-8948-4c10-9a6c-db1ff85124a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:14.901879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3f8fc1f5-8948-4c10-9a6c-db1ff85124a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:14.922728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f8fc1f5-8948-4c10-9a6c-db1ff85124a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:14.932747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f8fc1f5-8948-4c10-9a6c-db1ff85124a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:14.933807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f8fc1f5-8948-4c10-9a6c-db1ff85124a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:14.935534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f8fc1f5-8948-4c10-9a6c-db1ff85124a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:14.948946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f8fc1f5-8948-4c10-9a6c-db1ff85124a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:14.949528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f8fc1f5-8948-4c10-9a6c-db1ff85124a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:15.403542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3f8fc1f5-8948-4c10-9a6c-db1ff85124a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:15.414032 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3f8fc1f5-8948-4c10-9a6c-db1ff85124a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1315 microversion: 2.1 time: 0.518543 Sep 06 10:58:15.416630 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 942/1851] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:14 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:58:15.422859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c8338e7c-32f5-4c06-a44d-ac31fca79937 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:15.424905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c8338e7c-32f5-4c06-a44d-ac31fca79937 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:15.433609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8338e7c-32f5-4c06-a44d-ac31fca79937 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:15.434960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8338e7c-32f5-4c06-a44d-ac31fca79937 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:15.435670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8338e7c-32f5-4c06-a44d-ac31fca79937 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:15.436599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8338e7c-32f5-4c06-a44d-ac31fca79937 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:15.437248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8338e7c-32f5-4c06-a44d-ac31fca79937 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:15.437901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8338e7c-32f5-4c06-a44d-ac31fca79937 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:15.764611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:15.792272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c8338e7c-32f5-4c06-a44d-ac31fca79937 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:15.817415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c8338e7c-32f5-4c06-a44d-ac31fca79937 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:15.820838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c8338e7c-32f5-4c06-a44d-ac31fca79937 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:15.824886 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c8338e7c-32f5-4c06-a44d-ac31fca79937 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 0.404736 Sep 06 10:58:15.825750 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 943/1852] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:15 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:16.270989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2e92f77d-77d9-41e1-ad51-bfb1304d5b46 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'create', calling method: .version_select at 0x7f90f8927dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-801382678", "description": "tempest-description-1341284949"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:16.855097 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2e92f77d-77d9-41e1-ad51-bfb1304d5b46 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.723496 Sep 06 10:58:16.857634 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 944/1853] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:58:16 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:16.863189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f969dc33-fd70-4f2b-a139-8a73d2ace4d9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:16.866393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f969dc33-fd70-4f2b-a139-8a73d2ace4d9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:16.891687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f969dc33-fd70-4f2b-a139-8a73d2ace4d9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:16.892907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f969dc33-fd70-4f2b-a139-8a73d2ace4d9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:16.896450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f969dc33-fd70-4f2b-a139-8a73d2ace4d9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:16.898632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f969dc33-fd70-4f2b-a139-8a73d2ace4d9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:16.898632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f969dc33-fd70-4f2b-a139-8a73d2ace4d9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:16.901165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f969dc33-fd70-4f2b-a139-8a73d2ace4d9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:17.184065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f969dc33-fd70-4f2b-a139-8a73d2ace4d9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:17.193573 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f969dc33-fd70-4f2b-a139-8a73d2ace4d9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1315 microversion: 2.1 time: 0.334526 Sep 06 10:58:17.194790 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 945/1854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:16 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:17.206967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-28676274-90fc-4d79-b770-45f766412ce6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:17.207774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-28676274-90fc-4d79-b770-45f766412ce6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:17.217625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28676274-90fc-4d79-b770-45f766412ce6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:17.218431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28676274-90fc-4d79-b770-45f766412ce6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:17.219108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28676274-90fc-4d79-b770-45f766412ce6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:17.220194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28676274-90fc-4d79-b770-45f766412ce6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:17.222903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28676274-90fc-4d79-b770-45f766412ce6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:17.223680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28676274-90fc-4d79-b770-45f766412ce6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:17.534068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-28676274-90fc-4d79-b770-45f766412ce6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:17.550308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-28676274-90fc-4d79-b770-45f766412ce6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:17.555954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-28676274-90fc-4d79-b770-45f766412ce6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:17.561568 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-28676274-90fc-4d79-b770-45f766412ce6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 0.359296 Sep 06 10:58:17.563897 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 946/1855] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:17 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:17.578503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81012cfe-1bce-429e-b15d-2849d37774c3 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'create', calling method: .version_select at 0x7f90fd121040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-227144173", "description": "tempest-description-1524409285"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:19.472638 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-81012cfe-1bce-429e-b15d-2849d37774c3 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.906851 Sep 06 10:58:19.474073 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 947/1856] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:58:17 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:19.480341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-587c8772-f869-48d6-852f-01fdeb5da7b3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:19.480982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-587c8772-f869-48d6-852f-01fdeb5da7b3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:19.509574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-587c8772-f869-48d6-852f-01fdeb5da7b3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:19.510103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-587c8772-f869-48d6-852f-01fdeb5da7b3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:19.513143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-587c8772-f869-48d6-852f-01fdeb5da7b3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:19.517129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-587c8772-f869-48d6-852f-01fdeb5da7b3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:19.518724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-587c8772-f869-48d6-852f-01fdeb5da7b3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:19.518724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-587c8772-f869-48d6-852f-01fdeb5da7b3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:19.719156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-587c8772-f869-48d6-852f-01fdeb5da7b3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:19.729853 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-587c8772-f869-48d6-852f-01fdeb5da7b3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1315 microversion: 2.1 time: 0.254563 Sep 06 10:58:19.731811 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 948/1857] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:19 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:19.738836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-50ecd98a-3f95-41f9-bcc5-caa8ceeec93f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:19.738836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-50ecd98a-3f95-41f9-bcc5-caa8ceeec93f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:19.746442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50ecd98a-3f95-41f9-bcc5-caa8ceeec93f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:19.746950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50ecd98a-3f95-41f9-bcc5-caa8ceeec93f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:19.747491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50ecd98a-3f95-41f9-bcc5-caa8ceeec93f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:19.748214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50ecd98a-3f95-41f9-bcc5-caa8ceeec93f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:19.748685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50ecd98a-3f95-41f9-bcc5-caa8ceeec93f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:19.749126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50ecd98a-3f95-41f9-bcc5-caa8ceeec93f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:19.991319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-50ecd98a-3f95-41f9-bcc5-caa8ceeec93f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:20.013087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-50ecd98a-3f95-41f9-bcc5-caa8ceeec93f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:20.017152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-50ecd98a-3f95-41f9-bcc5-caa8ceeec93f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:20.020399 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0ee4168d-aff3-41b5-87f0-12f014b8f229 tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3/action" status: 202 len: 0 microversion: 2.1 time: 7.065207 Sep 06 10:58:20.022526 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 910/1858] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:58:12 2022] POST /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3/action => generated 0 bytes in 7068 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:58:20.024087 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-50ecd98a-3f95-41f9-bcc5-caa8ceeec93f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 0.289896 Sep 06 10:58:20.026705 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 949/1859] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:19 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:20.035195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-78732ba3-223a-41d6-8007-675bb4c240f6 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:20.036014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-78732ba3-223a-41d6-8007-675bb4c240f6 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:20.041619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1502059599", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "74fd748a-e59f-44c8-8ccf-f684be8cc472"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:20.050013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78732ba3-223a-41d6-8007-675bb4c240f6 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:20.051052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78732ba3-223a-41d6-8007-675bb4c240f6 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:20.051758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78732ba3-223a-41d6-8007-675bb4c240f6 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:20.053856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78732ba3-223a-41d6-8007-675bb4c240f6 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:20.054925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78732ba3-223a-41d6-8007-675bb4c240f6 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:20.055902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78732ba3-223a-41d6-8007-675bb4c240f6 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:20.129390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-78732ba3-223a-41d6-8007-675bb4c240f6 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:58:20.232498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] validate_networks() for [('74fd748a-e59f-44c8-8ccf-f684be8cc472', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:58:20.539863 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-78732ba3-223a-41d6-8007-675bb4c240f6 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "DELETE /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 204 len: 0 microversion: 2.1 time: 0.506263 Sep 06 10:58:20.539863 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 911/1860] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:58:20 2022] DELETE /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:58:20.539863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff68a4a1-01f4-4ec5-ac49-7c91f92ea127 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:20.541752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff68a4a1-01f4-4ec5-ac49-7c91f92ea127 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:20.572862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff68a4a1-01f4-4ec5-ac49-7c91f92ea127 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:20.576495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff68a4a1-01f4-4ec5-ac49-7c91f92ea127 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:20.578309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff68a4a1-01f4-4ec5-ac49-7c91f92ea127 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:20.583432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff68a4a1-01f4-4ec5-ac49-7c91f92ea127 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:20.584066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff68a4a1-01f4-4ec5-ac49-7c91f92ea127 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:20.588025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff68a4a1-01f4-4ec5-ac49-7c91f92ea127 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:21.066540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff68a4a1-01f4-4ec5-ac49-7c91f92ea127 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:21.087038 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff68a4a1-01f4-4ec5-ac49-7c91f92ea127 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.548806 Sep 06 10:58:21.087038 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 912/1861] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:20 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:21.108596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-eb74afe9-21a5-4d75-9cc4-693a5afa2450 req-4059bb28-5b93-4762-b373-b3658e0e7c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19d97c3-c476-487e-9dca-8b524376c2e6", "name": "network-vif-plugged", "status": "completed", "tag": "6b4ea1d2-d432-4b81-ae6b-7cc89648aca3"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:21.136336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-eb74afe9-21a5-4d75-9cc4-693a5afa2450 req-4059bb28-5b93-4762-b373-b3658e0e7c82 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:21.136990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-eb74afe9-21a5-4d75-9cc4-693a5afa2450 req-4059bb28-5b93-4762-b373-b3658e0e7c82 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:21.143431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-eb74afe9-21a5-4d75-9cc4-693a5afa2450 req-4059bb28-5b93-4762-b373-b3658e0e7c82 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:21.151631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:58:21.153980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:58:21.154743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:58:21.155495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:58:21.156330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:58:21.164789 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-eb74afe9-21a5-4d75-9cc4-693a5afa2450 req-4059bb28-5b93-4762-b373-b3658e0e7c82 service nova] Creating event network-vif-plugged:6b4ea1d2-d432-4b81-ae6b-7cc89648aca3 for instance b19d97c3-c476-487e-9dca-8b524376c2e6 on nch1-master-1 Sep 06 10:58:21.170141 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-eb74afe9-21a5-4d75-9cc4-693a5afa2450 req-4059bb28-5b93-4762-b373-b3658e0e7c82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084744 Sep 06 10:58:21.171163 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 913/1862] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:21.177247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f59bdbae-7013-4097-92ed-becb910e0885 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:21.177963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f59bdbae-7013-4097-92ed-becb910e0885 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:21.180511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:21.181636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:21.183662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:21.190051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:21.190202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f59bdbae-7013-4097-92ed-becb910e0885 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:21.190316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:21.190416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f59bdbae-7013-4097-92ed-becb910e0885 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:21.190513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:21.190621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f59bdbae-7013-4097-92ed-becb910e0885 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:21.190621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f59bdbae-7013-4097-92ed-becb910e0885 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:21.190621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f59bdbae-7013-4097-92ed-becb910e0885 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:21.190621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f59bdbae-7013-4097-92ed-becb910e0885 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:21.206463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:21.225655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Getting quotas for project 0df100d31d294ce6858d12ea23adb2b4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:58:21.233621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Getting quotas for user 5689d1981ee04c7b8dbcb4e9e1afd6cd and project 0df100d31d294ce6858d12ea23adb2b4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:58:21.257207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:58:21.265502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:58:21.454573 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d69090e4-ca62-4107-981f-eb6c63cf8927 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.425678 Sep 06 10:58:21.461924 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 950/1863] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:58:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:58:21.484337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f59bdbae-7013-4097-92ed-becb910e0885 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:21.487150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6f81aa4d-cd4e-41aa-8deb-45cd8c00ffff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:21.488072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6f81aa4d-cd4e-41aa-8deb-45cd8c00ffff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:21.499236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f81aa4d-cd4e-41aa-8deb-45cd8c00ffff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:21.500148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f81aa4d-cd4e-41aa-8deb-45cd8c00ffff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:21.504341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f81aa4d-cd4e-41aa-8deb-45cd8c00ffff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:21.504341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f81aa4d-cd4e-41aa-8deb-45cd8c00ffff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:21.504341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f81aa4d-cd4e-41aa-8deb-45cd8c00ffff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:21.505093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f81aa4d-cd4e-41aa-8deb-45cd8c00ffff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:21.510552 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f59bdbae-7013-4097-92ed-becb910e0885 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1512 microversion: 2.1 time: 0.335585 Sep 06 10:58:21.517090 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 914/1864] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:21 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1512 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:21.541802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f0d467ae-aaca-4279-823a-c6a0f35a2a0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:21.543348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f0d467ae-aaca-4279-823a-c6a0f35a2a0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:21.557957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0d467ae-aaca-4279-823a-c6a0f35a2a0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:21.558509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0d467ae-aaca-4279-823a-c6a0f35a2a0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:21.558968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0d467ae-aaca-4279-823a-c6a0f35a2a0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:21.565325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0d467ae-aaca-4279-823a-c6a0f35a2a0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:21.565893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0d467ae-aaca-4279-823a-c6a0f35a2a0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:21.567216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0d467ae-aaca-4279-823a-c6a0f35a2a0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:21.874389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6f81aa4d-cd4e-41aa-8deb-45cd8c00ffff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:21.880313 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6f81aa4d-cd4e-41aa-8deb-45cd8c00ffff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1315 microversion: 2.1 time: 0.408312 Sep 06 10:58:21.883404 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 951/1865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:21 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:21.932659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e285902e-b85b-47b0-a842-966adf66cc6b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:21.935398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e285902e-b85b-47b0-a842-966adf66cc6b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:22.063264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f0d467ae-aaca-4279-823a-c6a0f35a2a0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:22.103469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e285902e-b85b-47b0-a842-966adf66cc6b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:22.125425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f0d467ae-aaca-4279-823a-c6a0f35a2a0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:22.126298 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e285902e-b85b-47b0-a842-966adf66cc6b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1216 microversion: 2.1 time: 0.219226 Sep 06 10:58:22.129260 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 952/1866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:21 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1216 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:22.133605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f0d467ae-aaca-4279-823a-c6a0f35a2a0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:22.138188 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f0d467ae-aaca-4279-823a-c6a0f35a2a0b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 0.616976 Sep 06 10:58:22.139539 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 915/1867] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:21 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:22.143273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ef8461e6-46f9-431b-848d-a4988b65cc22 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:22.144327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ef8461e6-46f9-431b-848d-a4988b65cc22 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:22.156932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef8461e6-46f9-431b-848d-a4988b65cc22 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:22.156932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef8461e6-46f9-431b-848d-a4988b65cc22 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:22.156932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef8461e6-46f9-431b-848d-a4988b65cc22 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:22.158699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef8461e6-46f9-431b-848d-a4988b65cc22 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:22.159885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef8461e6-46f9-431b-848d-a4988b65cc22 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:22.160745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef8461e6-46f9-431b-848d-a4988b65cc22 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:22.381819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ef8461e6-46f9-431b-848d-a4988b65cc22 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:22.400877 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ef8461e6-46f9-431b-848d-a4988b65cc22 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.268847 Sep 06 10:58:22.402333 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 953/1868] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:22 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:22.541908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c362be57-0283-42ee-a762-9d4e9218e140 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:22.542530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c362be57-0283-42ee-a762-9d4e9218e140 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:22.548666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:22.570574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c362be57-0283-42ee-a762-9d4e9218e140 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:22.573031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c362be57-0283-42ee-a762-9d4e9218e140 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:22.576026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c362be57-0283-42ee-a762-9d4e9218e140 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:22.579700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c362be57-0283-42ee-a762-9d4e9218e140 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:22.581025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c362be57-0283-42ee-a762-9d4e9218e140 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:22.584355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c362be57-0283-42ee-a762-9d4e9218e140 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:23.224266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-03e44c4a-4132-4f99-8a7e-ff7e9957d39e tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Action: 'create', calling method: .version_select at 0x7f90fd037ee0>, body: {"keypair": {"name": "tempest-keypair-1149263650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkrV4veEUPAMgw6Dps7e1qT5j5v/SkhOhx3W6Zh7adwFh3uvHUu0D004EmbwS9UHw0CpJIBlE+IqX6nBHYp67M2ijXJYYDGFNr8NnRQ119d5UMzNx1u5IQM8RCjWeHXmg=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:23.253768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-03e44c4a-4132-4f99-8a7e-ff7e9957d39e tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Getting quotas for project d5e0ac401b45419795e5127ed1f667b9. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:58:23.268580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-03e44c4a-4132-4f99-8a7e-ff7e9957d39e tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Getting quotas for user 5c02f8592a8842b8baf95d76c55a4d6e and project d5e0ac401b45419795e5127ed1f667b9. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:58:23.302963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:23.398649 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-03e44c4a-4132-4f99-8a7e-ff7e9957d39e tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.690346 Sep 06 10:58:23.400024 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 954/1869] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:58:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:23.424935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-57cbfe00-3c69-4a17-85af-da48a8dcf301 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:23.427172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-57cbfe00-3c69-4a17-85af-da48a8dcf301 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:23.442467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57cbfe00-3c69-4a17-85af-da48a8dcf301 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:23.445585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57cbfe00-3c69-4a17-85af-da48a8dcf301 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:23.446864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57cbfe00-3c69-4a17-85af-da48a8dcf301 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:23.454327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57cbfe00-3c69-4a17-85af-da48a8dcf301 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:23.460018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57cbfe00-3c69-4a17-85af-da48a8dcf301 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:23.461249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57cbfe00-3c69-4a17-85af-da48a8dcf301 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:23.713850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c362be57-0283-42ee-a762-9d4e9218e140 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:23.722568 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c362be57-0283-42ee-a762-9d4e9218e140 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1512 microversion: 2.1 time: 1.184540 Sep 06 10:58:23.725852 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 916/1870] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:22 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1512 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:23.738617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4820b5b6-c8e8-4bfa-ba69-fe0b0e2e615f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:23.739376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4820b5b6-c8e8-4bfa-ba69-fe0b0e2e615f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:23.755599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4820b5b6-c8e8-4bfa-ba69-fe0b0e2e615f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:23.756926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4820b5b6-c8e8-4bfa-ba69-fe0b0e2e615f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:23.758881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4820b5b6-c8e8-4bfa-ba69-fe0b0e2e615f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:23.760020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4820b5b6-c8e8-4bfa-ba69-fe0b0e2e615f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:23.762099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4820b5b6-c8e8-4bfa-ba69-fe0b0e2e615f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:23.762940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4820b5b6-c8e8-4bfa-ba69-fe0b0e2e615f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:24.024477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4820b5b6-c8e8-4bfa-ba69-fe0b0e2e615f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:24.034601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-57cbfe00-3c69-4a17-85af-da48a8dcf301 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:24.047154 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4820b5b6-c8e8-4bfa-ba69-fe0b0e2e615f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1212 microversion: 2.1 time: 0.319788 Sep 06 10:58:24.047791 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-57cbfe00-3c69-4a17-85af-da48a8dcf301 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1315 microversion: 2.1 time: 0.646123 Sep 06 10:58:24.050319 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 917/1871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:23 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1212 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:24.056830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b6a50002-8fbe-4061-af58-e17baace214e tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:24.058271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b6a50002-8fbe-4061-af58-e17baace214e tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:24.059541 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 955/1872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:23 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:24.074378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-812aa591-b863-4ba9-8d62-3b0ea6ae92ec tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:24.075001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-812aa591-b863-4ba9-8d62-3b0ea6ae92ec tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:24.083968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6a50002-8fbe-4061-af58-e17baace214e tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:24.084778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6a50002-8fbe-4061-af58-e17baace214e tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:24.086849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6a50002-8fbe-4061-af58-e17baace214e tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:24.090126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6a50002-8fbe-4061-af58-e17baace214e tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:24.090865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6a50002-8fbe-4061-af58-e17baace214e tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:24.091697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6a50002-8fbe-4061-af58-e17baace214e tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:24.092601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-812aa591-b863-4ba9-8d62-3b0ea6ae92ec tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:24.093307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-812aa591-b863-4ba9-8d62-3b0ea6ae92ec tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:24.093922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-812aa591-b863-4ba9-8d62-3b0ea6ae92ec tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:24.095759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-812aa591-b863-4ba9-8d62-3b0ea6ae92ec tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:24.097767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-812aa591-b863-4ba9-8d62-3b0ea6ae92ec tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:24.100197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-812aa591-b863-4ba9-8d62-3b0ea6ae92ec tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:24.653941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-812aa591-b863-4ba9-8d62-3b0ea6ae92ec tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:24.663550 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-812aa591-b863-4ba9-8d62-3b0ea6ae92ec tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.602659 Sep 06 10:58:24.670424 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 956/1873] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:24 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:24.812011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b6a50002-8fbe-4061-af58-e17baace214e tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:24.861739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b6a50002-8fbe-4061-af58-e17baace214e tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:24.871214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b6a50002-8fbe-4061-af58-e17baace214e tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b6a50002-8fbe-4061-af58-e17baace214e tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 0.832194 Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 918/1874] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:24 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-83486c50-fd09-4781-b258-8cbe2d38d763 req-daa8d92b-4983-48e8-8626-5cbe8cf5bbf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13346df-1ae9-49f9-8768-e174464a198a", "name": "network-vif-unplugged", "status": "completed", "tag": "4ca62dc1-98f7-4849-a1cb-92d224f8d239"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-83486c50-fd09-4781-b258-8cbe2d38d763 req-daa8d92b-4983-48e8-8626-5cbe8cf5bbf5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-83486c50-fd09-4781-b258-8cbe2d38d763 req-daa8d92b-4983-48e8-8626-5cbe8cf5bbf5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-83486c50-fd09-4781-b258-8cbe2d38d763 req-daa8d92b-4983-48e8-8626-5cbe8cf5bbf5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-83486c50-fd09-4781-b258-8cbe2d38d763 req-daa8d92b-4983-48e8-8626-5cbe8cf5bbf5 service nova] Creating event network-vif-unplugged:4ca62dc1-98f7-4849-a1cb-92d224f8d239 for instance c13346df-1ae9-49f9-8768-e174464a198a on nch2-master-1 Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-83486c50-fd09-4781-b258-8cbe2d38d763 req-daa8d92b-4983-48e8-8626-5cbe8cf5bbf5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054904 Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 919/1875] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-73160814-d285-4e01-a0a7-7d95ebc350c4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-73160814-d285-4e01-a0a7-7d95ebc350c4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73160814-d285-4e01-a0a7-7d95ebc350c4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73160814-d285-4e01-a0a7-7d95ebc350c4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:25.223114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73160814-d285-4e01-a0a7-7d95ebc350c4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:25.225205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73160814-d285-4e01-a0a7-7d95ebc350c4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:25.225205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73160814-d285-4e01-a0a7-7d95ebc350c4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:25.225205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73160814-d285-4e01-a0a7-7d95ebc350c4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:25.225205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-73160814-d285-4e01-a0a7-7d95ebc350c4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:25.225205 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-73160814-d285-4e01-a0a7-7d95ebc350c4 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1470 microversion: 2.1 time: 0.233254 Sep 06 10:58:25.225944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-918cced7-8c4a-4e9b-b8a5-63f54aa48ab1 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Action: 'create', calling method: .version_select at 0x7f90f870d280>, body: {"keypair": {"name": "tempest-keypair-395680744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/nrnsvR3xiWQmKjWjVvkTKoGIvNO2Li8HwZ8t2aenK1r50Yeam+VW1Trt7+8p3hvQiW9hf+0oCUSb2TKaXqa+aBnLM8Za5noa85G2d7+yRKJc8Ac0W/Q2EyC8fU5tWzQ=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:25.226488 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 920/1876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:24 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1470 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:25.234709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e2c6ef4b-f7ce-4c72-a6d7-017950ab3d5b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:25.235556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e2c6ef4b-f7ce-4c72-a6d7-017950ab3d5b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:25.246871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2c6ef4b-f7ce-4c72-a6d7-017950ab3d5b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:25.249491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-918cced7-8c4a-4e9b-b8a5-63f54aa48ab1 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Getting quotas for project aa2ed3ceca87459d8b6db473a08b3464. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:58:25.252664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2c6ef4b-f7ce-4c72-a6d7-017950ab3d5b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:25.253324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2c6ef4b-f7ce-4c72-a6d7-017950ab3d5b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:25.254284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2c6ef4b-f7ce-4c72-a6d7-017950ab3d5b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:25.254908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2c6ef4b-f7ce-4c72-a6d7-017950ab3d5b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:25.255542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2c6ef4b-f7ce-4c72-a6d7-017950ab3d5b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:25.260474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-918cced7-8c4a-4e9b-b8a5-63f54aa48ab1 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Getting quotas for user a880494fb3144a58afd1fbfa8eff6cb4 and project aa2ed3ceca87459d8b6db473a08b3464. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:58:25.521929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e2c6ef4b-f7ce-4c72-a6d7-017950ab3d5b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:25.523296 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-918cced7-8c4a-4e9b-b8a5-63f54aa48ab1 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.851446 Sep 06 10:58:25.526626 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 957/1877] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 10:58:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:25.536772 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e2c6ef4b-f7ce-4c72-a6d7-017950ab3d5b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1501 microversion: 2.1 time: 0.319241 Sep 06 10:58:25.538546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-62e9db4e-1d5e-48ce-b084-1f499d95a0d4 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:25.540016 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 921/1878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:25 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1501 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:25.546859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-62e9db4e-1d5e-48ce-b084-1f499d95a0d4 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:25.613684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62e9db4e-1d5e-48ce-b084-1f499d95a0d4 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:25.615216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62e9db4e-1d5e-48ce-b084-1f499d95a0d4 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:25.624238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62e9db4e-1d5e-48ce-b084-1f499d95a0d4 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:25.625169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62e9db4e-1d5e-48ce-b084-1f499d95a0d4 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:25.625871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62e9db4e-1d5e-48ce-b084-1f499d95a0d4 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:25.626559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62e9db4e-1d5e-48ce-b084-1f499d95a0d4 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:25.694586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d27b48fd-dc46-4e23-8bc5-5cd19ac5529a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:25.695249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d27b48fd-dc46-4e23-8bc5-5cd19ac5529a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:25.717827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d27b48fd-dc46-4e23-8bc5-5cd19ac5529a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:25.718334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d27b48fd-dc46-4e23-8bc5-5cd19ac5529a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:25.718784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d27b48fd-dc46-4e23-8bc5-5cd19ac5529a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:25.739085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d27b48fd-dc46-4e23-8bc5-5cd19ac5529a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:25.739688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d27b48fd-dc46-4e23-8bc5-5cd19ac5529a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:25.740157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d27b48fd-dc46-4e23-8bc5-5cd19ac5529a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:25.865937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-62e9db4e-1d5e-48ce-b084-1f499d95a0d4 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:25.890115 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-62e9db4e-1d5e-48ce-b084-1f499d95a0d4 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1268 microversion: 2.1 time: 0.360007 Sep 06 10:58:25.893876 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 958/1879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:25 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1268 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:25.944842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bef277eb-1405-4278-909a-d68ba7ad8fe6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:25.945524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bef277eb-1405-4278-909a-d68ba7ad8fe6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:25.961078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bef277eb-1405-4278-909a-d68ba7ad8fe6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:25.961767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bef277eb-1405-4278-909a-d68ba7ad8fe6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:25.962432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bef277eb-1405-4278-909a-d68ba7ad8fe6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:25.963139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bef277eb-1405-4278-909a-d68ba7ad8fe6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:25.963603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bef277eb-1405-4278-909a-d68ba7ad8fe6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:25.964037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bef277eb-1405-4278-909a-d68ba7ad8fe6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:26.715959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d27b48fd-dc46-4e23-8bc5-5cd19ac5529a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:26.728612 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d27b48fd-dc46-4e23-8bc5-5cd19ac5529a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 1.037852 Sep 06 10:58:26.729227 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 922/1880] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:25 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:26.754672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:26.758176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:26.781488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:26.782033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:26.783930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:26.784709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:26.785190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:26.785636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:26.858533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:26.859190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:26.859805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:26.860629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lazy-loading 'fault' on Instance uuid 306337d6-b772-41a6-8d68-2e34a9c0aa66 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:58:27.144444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:27.154954 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-741eee20-476a-4713-8d8e-39ed926d9e8b tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 200 len: 1307 microversion: 2.1 time: 0.420511 Sep 06 10:58:27.159621 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 923/1881] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:26 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 1307 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:27.174489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9afe8b1e-2653-454c-bbc1-a876ddf12dd7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:27.177222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9afe8b1e-2653-454c-bbc1-a876ddf12dd7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:27.195595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9afe8b1e-2653-454c-bbc1-a876ddf12dd7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:27.196482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9afe8b1e-2653-454c-bbc1-a876ddf12dd7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:27.197014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9afe8b1e-2653-454c-bbc1-a876ddf12dd7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:27.198006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9afe8b1e-2653-454c-bbc1-a876ddf12dd7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:27.198729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9afe8b1e-2653-454c-bbc1-a876ddf12dd7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:27.200042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9afe8b1e-2653-454c-bbc1-a876ddf12dd7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:27.235651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bef277eb-1405-4278-909a-d68ba7ad8fe6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:27.239615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:27.255224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bef277eb-1405-4278-909a-d68ba7ad8fe6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:27.260798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bef277eb-1405-4278-909a-d68ba7ad8fe6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:27.262129 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bef277eb-1405-4278-909a-d68ba7ad8fe6 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 1.344149 Sep 06 10:58:27.265506 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 959/1882] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:25 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:27.281587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-27d154a8-22a1-4b2f-bf1d-4079a9f1be8a req-754920a2-ebfd-4a16-a25f-318ead97966b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "306337d6-b772-41a6-8d68-2e34a9c0aa66", "name": "network-vif-deleted", "tag": "accaabe8-5bea-4860-8126-43d747eb00c3"}, {"name": "network-changed", "server_uuid": "c13346df-1ae9-49f9-8768-e174464a198a", "tag": "4ca62dc1-98f7-4849-a1cb-92d224f8d239"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:27.318598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-27d154a8-22a1-4b2f-bf1d-4079a9f1be8a req-754920a2-ebfd-4a16-a25f-318ead97966b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:27.328226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-27d154a8-22a1-4b2f-bf1d-4079a9f1be8a req-754920a2-ebfd-4a16-a25f-318ead97966b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:27.328226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-27d154a8-22a1-4b2f-bf1d-4079a9f1be8a req-754920a2-ebfd-4a16-a25f-318ead97966b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:27.330812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9afe8b1e-2653-454c-bbc1-a876ddf12dd7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:27.342125 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9afe8b1e-2653-454c-bbc1-a876ddf12dd7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1274 microversion: 2.1 time: 0.179968 Sep 06 10:58:27.342938 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 924/1883] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:27 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:27.364694 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-27d154a8-22a1-4b2f-bf1d-4079a9f1be8a req-754920a2-ebfd-4a16-a25f-318ead97966b service nova] Creating event network-vif-deleted:accaabe8-5bea-4860-8126-43d747eb00c3 for instance 306337d6-b772-41a6-8d68-2e34a9c0aa66 on nch1-master-1 Sep 06 10:58:27.367379 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-27d154a8-22a1-4b2f-bf1d-4079a9f1be8a req-754920a2-ebfd-4a16-a25f-318ead97966b service nova] Creating event network-changed:4ca62dc1-98f7-4849-a1cb-92d224f8d239 for instance c13346df-1ae9-49f9-8768-e174464a198a on nch2-master-1 Sep 06 10:58:27.391272 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-27d154a8-22a1-4b2f-bf1d-4079a9f1be8a req-754920a2-ebfd-4a16-a25f-318ead97966b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.123576 Sep 06 10:58:27.392454 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 960/1884] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:27.751857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d938eebd-5c9a-4e09-b85c-65d631a48405 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:27.752544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d938eebd-5c9a-4e09-b85c-65d631a48405 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:27.760362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d938eebd-5c9a-4e09-b85c-65d631a48405 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:27.760934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d938eebd-5c9a-4e09-b85c-65d631a48405 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:27.761472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d938eebd-5c9a-4e09-b85c-65d631a48405 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:27.762311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d938eebd-5c9a-4e09-b85c-65d631a48405 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:27.762809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d938eebd-5c9a-4e09-b85c-65d631a48405 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:27.763335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d938eebd-5c9a-4e09-b85c-65d631a48405 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:28.189197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-da5ca853-8a92-4d95-bef4-487ea011c0cf tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:28.189976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-da5ca853-8a92-4d95-bef4-487ea011c0cf tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: 306337d6-b772-41a6-8d68-2e34a9c0aa66] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:28.201591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da5ca853-8a92-4d95-bef4-487ea011c0cf tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:28.202103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da5ca853-8a92-4d95-bef4-487ea011c0cf tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:28.202560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da5ca853-8a92-4d95-bef4-487ea011c0cf tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:28.205177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da5ca853-8a92-4d95-bef4-487ea011c0cf tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:28.205679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da5ca853-8a92-4d95-bef4-487ea011c0cf tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:28.206189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da5ca853-8a92-4d95-bef4-487ea011c0cf tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:28.226394 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-da5ca853-8a92-4d95-bef4-487ea011c0cf tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] HTTP exception thrown: Instance 306337d6-b772-41a6-8d68-2e34a9c0aa66 could not be found. Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-da5ca853-8a92-4d95-bef4-487ea011c0cf tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Request method failure captured: Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 HTTP/1.1 Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFydFo16EeQ86qJjgP_G-3GFfdxDVSgbNV2UAGwmECR-TyeS1d8VoXm9_B8Jb5eMNXX95K1zYuJ5ZAWWZYvhakutBRAW4UeU1wvjh423gINYXRnt1MLrStLsokC7QSgGkaje27gCE80N7XtQFsZZI4rTUPhaMFwoxNnswlds2u4lKWyE Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 740286d1464549609e6d4b3280aa50ce Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-VolumesAdminNegativeTest-204909859 Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_740286d1464549609e6d4b3280aa50ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/740286d1464549609e6d4b3280aa50ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/740286d1464549609e6d4b3280aa50ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/740286d1464549609e6d4b3280aa50ce"}]}] Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-VolumesAdminNegativeTest-204909859 Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 740286d1464549609e6d4b3280aa50ce Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-204909859 Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-VolumesAdminNegativeTest-204909859-project Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6c557446cb39475dba1fc800d061b9e1 Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-VolumesAdminNegativeTest-204909859-project Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 306337d6-b772-41a6-8d68-2e34a9c0aa66 could not be found. Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '306337d6-b772-41a6-8d68-2e34a9c0aa66'} Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 306337d6-b772-41a6-8d68-2e34a9c0aa66 could not be found. Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 306337d6-b772-41a6-8d68-2e34a9c0aa66 could not be found. Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:28.228878 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:28.234577 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:28.234577 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:28.234577 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:28.234577 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:58:28.234577 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:58:28.234577 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 306337d6-b772-41a6-8d68-2e34a9c0aa66 could not be found. Sep 06 10:58:28.234577 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:28.234577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-da5ca853-8a92-4d95-bef4-487ea011c0cf tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Returning 404 to user: Instance 306337d6-b772-41a6-8d68-2e34a9c0aa66 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:58:28.234577 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-da5ca853-8a92-4d95-bef4-487ea011c0cf tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66" status: 404 len: 111 microversion: 2.1 time: 0.049177 Sep 06 10:58:28.239879 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 961/1885] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:28 2022] GET /compute/v2.1/servers/306337d6-b772-41a6-8d68-2e34a9c0aa66 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:58:28.293336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d55a51cb-d446-4dc6-a43b-6831c6cd7a54 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:28.294405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d55a51cb-d446-4dc6-a43b-6831c6cd7a54 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:28.302642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d55a51cb-d446-4dc6-a43b-6831c6cd7a54 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:28.307189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d55a51cb-d446-4dc6-a43b-6831c6cd7a54 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:28.307189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d55a51cb-d446-4dc6-a43b-6831c6cd7a54 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:28.307189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d55a51cb-d446-4dc6-a43b-6831c6cd7a54 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:28.307189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d55a51cb-d446-4dc6-a43b-6831c6cd7a54 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:28.307189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d55a51cb-d446-4dc6-a43b-6831c6cd7a54 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:28.310714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d938eebd-5c9a-4e09-b85c-65d631a48405 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:28.321424 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d938eebd-5c9a-4e09-b85c-65d631a48405 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.573285 Sep 06 10:58:28.331828 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 925/1886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:27 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:28.371541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-14e3ab5a-22d3-4622-96c3-d938647ae2c8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:28.372420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-14e3ab5a-22d3-4622-96c3-d938647ae2c8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:28.378827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14e3ab5a-22d3-4622-96c3-d938647ae2c8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:28.379554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14e3ab5a-22d3-4622-96c3-d938647ae2c8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:28.380179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14e3ab5a-22d3-4622-96c3-d938647ae2c8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:28.381328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14e3ab5a-22d3-4622-96c3-d938647ae2c8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:28.381947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14e3ab5a-22d3-4622-96c3-d938647ae2c8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:28.382521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14e3ab5a-22d3-4622-96c3-d938647ae2c8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:28.852547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-14e3ab5a-22d3-4622-96c3-d938647ae2c8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:28.863813 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-14e3ab5a-22d3-4622-96c3-d938647ae2c8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1274 microversion: 2.1 time: 0.498000 Sep 06 10:58:28.864863 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 926/1887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:28 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1274 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:58:28.870173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1509451377", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "088d56de-c467-49bc-b3d0-90236666a68c"}], "security_groups": [{"name": "tempest-securitygroup--1890576230"}], "key_name": "tempest-keypair-1149263650", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:29.180212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] validate_networks() for [('088d56de-c467-49bc-b3d0-90236666a68c', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:58:29.192887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d55a51cb-d446-4dc6-a43b-6831c6cd7a54 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:29.203919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d55a51cb-d446-4dc6-a43b-6831c6cd7a54 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:29.208120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d55a51cb-d446-4dc6-a43b-6831c6cd7a54 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:29.213920 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d55a51cb-d446-4dc6-a43b-6831c6cd7a54 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 0.924882 Sep 06 10:58:29.214865 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 962/1888] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:28 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:58:29.346483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e7d387e-4c50-43b6-acd2-1efa62340942 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:29.348233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5e7d387e-4c50-43b6-acd2-1efa62340942 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:29.362118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e7d387e-4c50-43b6-acd2-1efa62340942 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:29.362642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e7d387e-4c50-43b6-acd2-1efa62340942 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:29.369530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e7d387e-4c50-43b6-acd2-1efa62340942 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:29.373627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e7d387e-4c50-43b6-acd2-1efa62340942 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:29.374216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e7d387e-4c50-43b6-acd2-1efa62340942 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:29.380163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e7d387e-4c50-43b6-acd2-1efa62340942 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:29.789158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5e7d387e-4c50-43b6-acd2-1efa62340942 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:29.798215 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5e7d387e-4c50-43b6-acd2-1efa62340942 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.456173 Sep 06 10:58:29.809191 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 963/1889] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:29 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:29.893652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8005eba9-913d-4f78-b874-4189ccc38aea tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:29.894271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8005eba9-913d-4f78-b874-4189ccc38aea tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:29.901097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8005eba9-913d-4f78-b874-4189ccc38aea tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:29.901585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8005eba9-913d-4f78-b874-4189ccc38aea tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:29.902028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8005eba9-913d-4f78-b874-4189ccc38aea tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:29.902766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8005eba9-913d-4f78-b874-4189ccc38aea tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:29.903400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8005eba9-913d-4f78-b874-4189ccc38aea tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:29.904408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8005eba9-913d-4f78-b874-4189ccc38aea tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:30.019841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Getting quotas for project d5e0ac401b45419795e5127ed1f667b9. Resources: dict_keys(['metadata_items']) {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:58:30.039211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Getting quotas for user 5c02f8592a8842b8baf95d76c55a4d6e and project d5e0ac401b45419795e5127ed1f667b9. Resources: dict_keys(['metadata_items']) {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:58:30.084781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:58:30.085582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:58:30.086231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:58:30.086971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:58:30.087560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:58:30.106539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:30.107050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:30.107731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:30.108613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:30.109404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:30.110752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:30.133198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Getting quotas for project d5e0ac401b45419795e5127ed1f667b9. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:58:30.139161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Getting quotas for user 5c02f8592a8842b8baf95d76c55a4d6e and project d5e0ac401b45419795e5127ed1f667b9. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:58:30.153967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8005eba9-913d-4f78-b874-4189ccc38aea tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:30.154111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:58:30.162632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:58:30.163860 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8005eba9-913d-4f78-b874-4189ccc38aea tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1316 microversion: 2.1 time: 0.275961 Sep 06 10:58:30.181152 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 964/1890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:29 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:58:30.188096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-25281bcf-ef45-44a8-8248-59b78356fb37 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ed38796-f0d5-4d0a-adc7-38b9e57d52d0"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:30.199501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-25281bcf-ef45-44a8-8248-59b78356fb37 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:30.216197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25281bcf-ef45-44a8-8248-59b78356fb37 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:30.217364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25281bcf-ef45-44a8-8248-59b78356fb37 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:30.219175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25281bcf-ef45-44a8-8248-59b78356fb37 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:30.221594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25281bcf-ef45-44a8-8248-59b78356fb37 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:30.222211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25281bcf-ef45-44a8-8248-59b78356fb37 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:30.222736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25281bcf-ef45-44a8-8248-59b78356fb37 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:30.306621 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-274f36e6-9362-4012-b035-45cab547ce7f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.440165 Sep 06 10:58:30.311700 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 927/1891] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:58:28 2022] POST /compute/v2.1/servers => generated 407 bytes in 1446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:58:30.344320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ee5626ab-738a-412d-9fc3-93f862b32542 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:30.348173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ee5626ab-738a-412d-9fc3-93f862b32542 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:30.360950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee5626ab-738a-412d-9fc3-93f862b32542 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:30.361978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee5626ab-738a-412d-9fc3-93f862b32542 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:30.362939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee5626ab-738a-412d-9fc3-93f862b32542 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:30.364392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee5626ab-738a-412d-9fc3-93f862b32542 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:30.365313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee5626ab-738a-412d-9fc3-93f862b32542 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:30.366496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee5626ab-738a-412d-9fc3-93f862b32542 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:30.713020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ee5626ab-738a-412d-9fc3-93f862b32542 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:30.729682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ee5626ab-738a-412d-9fc3-93f862b32542 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:30.733239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ee5626ab-738a-412d-9fc3-93f862b32542 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:30.741181 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ee5626ab-738a-412d-9fc3-93f862b32542 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 0.424789 Sep 06 10:58:30.744238 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 928/1892] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:30 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:30.757901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0462d212-c41b-4ab5-8015-68901dbc51d4 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:30.761310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0462d212-c41b-4ab5-8015-68901dbc51d4 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:30.913989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0462d212-c41b-4ab5-8015-68901dbc51d4 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:30.941701 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0462d212-c41b-4ab5-8015-68901dbc51d4 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1270 microversion: 2.1 time: 0.194876 Sep 06 10:58:30.941701 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 929/1893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:30 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:30.951175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd6ad1eb-84ec-4058-8b76-06f35bb3555e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:30.952192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fd6ad1eb-84ec-4058-8b76-06f35bb3555e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:30.993931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd6ad1eb-84ec-4058-8b76-06f35bb3555e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:30.994530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd6ad1eb-84ec-4058-8b76-06f35bb3555e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:30.995031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd6ad1eb-84ec-4058-8b76-06f35bb3555e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:30.999370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd6ad1eb-84ec-4058-8b76-06f35bb3555e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:31.008118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd6ad1eb-84ec-4058-8b76-06f35bb3555e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:31.008118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd6ad1eb-84ec-4058-8b76-06f35bb3555e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:31.210971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:31.213816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fd6ad1eb-84ec-4058-8b76-06f35bb3555e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:31.223264 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd6ad1eb-84ec-4058-8b76-06f35bb3555e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.280366 Sep 06 10:58:31.223921 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 930/1894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:30 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:31.228690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-801f5b26-9168-40cc-9cb2-8b0722cb2cf9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:31.229310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-801f5b26-9168-40cc-9cb2-8b0722cb2cf9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:31.235223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-801f5b26-9168-40cc-9cb2-8b0722cb2cf9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:31.236265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-801f5b26-9168-40cc-9cb2-8b0722cb2cf9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:31.236713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-801f5b26-9168-40cc-9cb2-8b0722cb2cf9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:31.237501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-801f5b26-9168-40cc-9cb2-8b0722cb2cf9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:31.237972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-801f5b26-9168-40cc-9cb2-8b0722cb2cf9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:31.238410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-801f5b26-9168-40cc-9cb2-8b0722cb2cf9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:31.442084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-801f5b26-9168-40cc-9cb2-8b0722cb2cf9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:31.443275 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-25281bcf-ef45-44a8-8248-59b78356fb37 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "POST /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.259536 Sep 06 10:58:31.444426 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 965/1895] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 10:58:30 2022] POST /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6/os-volume_attachments => generated 194 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:31.450430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9e3aeda2-1a4a-49c6-8cf1-38e31bf01ef4 req-0357501b-3d12-405f-b3ff-9d0da140ee39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109feea8-7249-41b8-a662-673aebba1930", "tag": "824afb7c-dc73-4081-b4ca-c33182803e3d"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:31.460988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9e3aeda2-1a4a-49c6-8cf1-38e31bf01ef4 req-0357501b-3d12-405f-b3ff-9d0da140ee39 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:31.461555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9e3aeda2-1a4a-49c6-8cf1-38e31bf01ef4 req-0357501b-3d12-405f-b3ff-9d0da140ee39 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:31.462304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9e3aeda2-1a4a-49c6-8cf1-38e31bf01ef4 req-0357501b-3d12-405f-b3ff-9d0da140ee39 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:31.463967 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-801f5b26-9168-40cc-9cb2-8b0722cb2cf9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1316 microversion: 2.1 time: 0.238659 Sep 06 10:58:31.464717 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 931/1896] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:31 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:31.476615 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9e3aeda2-1a4a-49c6-8cf1-38e31bf01ef4 req-0357501b-3d12-405f-b3ff-9d0da140ee39 service nova] Creating event network-changed:824afb7c-dc73-4081-b4ca-c33182803e3d for instance 109feea8-7249-41b8-a662-673aebba1930 on nch2-master-1 Sep 06 10:58:31.482170 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9e3aeda2-1a4a-49c6-8cf1-38e31bf01ef4 req-0357501b-3d12-405f-b3ff-9d0da140ee39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035961 Sep 06 10:58:31.482783 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 966/1897] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:31.768252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7ecf1ef1-8737-419c-82dd-a68e98bae3a4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:31.768977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7ecf1ef1-8737-419c-82dd-a68e98bae3a4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:31.776373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ecf1ef1-8737-419c-82dd-a68e98bae3a4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:31.776865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ecf1ef1-8737-419c-82dd-a68e98bae3a4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:31.777306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ecf1ef1-8737-419c-82dd-a68e98bae3a4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:31.778014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ecf1ef1-8737-419c-82dd-a68e98bae3a4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:31.778499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ecf1ef1-8737-419c-82dd-a68e98bae3a4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:31.778950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ecf1ef1-8737-419c-82dd-a68e98bae3a4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:31.966391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8ce3c3ed-0476-4410-88a7-5f59bffc462e tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:31.967566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8ce3c3ed-0476-4410-88a7-5f59bffc462e tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:32.105599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8ce3c3ed-0476-4410-88a7-5f59bffc462e tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:32.108773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7ecf1ef1-8737-419c-82dd-a68e98bae3a4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:32.117197 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8ce3c3ed-0476-4410-88a7-5f59bffc462e tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1270 microversion: 2.1 time: 0.156690 Sep 06 10:58:32.117815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7ecf1ef1-8737-419c-82dd-a68e98bae3a4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:32.117933 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 967/1898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:31 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:58:32.134660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7ecf1ef1-8737-419c-82dd-a68e98bae3a4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:32.136265 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7ecf1ef1-8737-419c-82dd-a68e98bae3a4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 0.372248 Sep 06 10:58:32.138383 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 932/1899] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:31 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:58:32.254263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-85bc3a8b-ab84-493b-9829-e3d85c896a67 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:32.255491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-85bc3a8b-ab84-493b-9829-e3d85c896a67 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:32.295976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85bc3a8b-ab84-493b-9829-e3d85c896a67 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:32.296494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85bc3a8b-ab84-493b-9829-e3d85c896a67 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:32.296951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85bc3a8b-ab84-493b-9829-e3d85c896a67 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:32.300339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85bc3a8b-ab84-493b-9829-e3d85c896a67 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:32.301588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85bc3a8b-ab84-493b-9829-e3d85c896a67 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:32.302875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85bc3a8b-ab84-493b-9829-e3d85c896a67 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:32.487588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f61309fe-542a-422e-93ca-779f0db2e1de tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:32.490237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f61309fe-542a-422e-93ca-779f0db2e1de tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:32.499195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f61309fe-542a-422e-93ca-779f0db2e1de tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:32.506940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f61309fe-542a-422e-93ca-779f0db2e1de tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:32.507595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f61309fe-542a-422e-93ca-779f0db2e1de tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:32.509182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f61309fe-542a-422e-93ca-779f0db2e1de tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:32.510092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f61309fe-542a-422e-93ca-779f0db2e1de tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:32.510658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f61309fe-542a-422e-93ca-779f0db2e1de tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:32.522111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:32.802722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-85bc3a8b-ab84-493b-9829-e3d85c896a67 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:32.813267 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-85bc3a8b-ab84-493b-9829-e3d85c896a67 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.563104 Sep 06 10:58:32.814934 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 968/1900] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:32 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:32.890267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f61309fe-542a-422e-93ca-779f0db2e1de tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:32.915462 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f61309fe-542a-422e-93ca-779f0db2e1de tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1316 microversion: 2.1 time: 0.432433 Sep 06 10:58:32.916525 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 933/1901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:32 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:58:33.144523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c95e7559-ca23-4efb-841f-f66081cb0ad0 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:33.145709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c95e7559-ca23-4efb-841f-f66081cb0ad0 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:33.155671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c95e7559-ca23-4efb-841f-f66081cb0ad0 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:33.156428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c95e7559-ca23-4efb-841f-f66081cb0ad0 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:33.157135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c95e7559-ca23-4efb-841f-f66081cb0ad0 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:33.158295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c95e7559-ca23-4efb-841f-f66081cb0ad0 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:33.158915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c95e7559-ca23-4efb-841f-f66081cb0ad0 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:33.159419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c95e7559-ca23-4efb-841f-f66081cb0ad0 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:33.167411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60df4f51-dcf3-4514-a4a8-15552f165cf7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:33.168025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-60df4f51-dcf3-4514-a4a8-15552f165cf7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:33.177087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60df4f51-dcf3-4514-a4a8-15552f165cf7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:33.177698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60df4f51-dcf3-4514-a4a8-15552f165cf7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:33.178210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60df4f51-dcf3-4514-a4a8-15552f165cf7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:33.179214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60df4f51-dcf3-4514-a4a8-15552f165cf7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:33.179790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60df4f51-dcf3-4514-a4a8-15552f165cf7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:33.180330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60df4f51-dcf3-4514-a4a8-15552f165cf7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:33.234384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c95e7559-ca23-4efb-841f-f66081cb0ad0 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:33.246747 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c95e7559-ca23-4efb-841f-f66081cb0ad0 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1322 microversion: 2.1 time: 0.105387 Sep 06 10:58:33.246747 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 969/1902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:33 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1322 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:33.378040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-60df4f51-dcf3-4514-a4a8-15552f165cf7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:33.387657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-60df4f51-dcf3-4514-a4a8-15552f165cf7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:33.389126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-60df4f51-dcf3-4514-a4a8-15552f165cf7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:33.390287 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-60df4f51-dcf3-4514-a4a8-15552f165cf7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 0.226863 Sep 06 10:58:33.390853 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 934/1903] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:33 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:58:33.838138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9e3e565e-9c15-49e5-be68-59a4ac364f8d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:33.838960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9e3e565e-9c15-49e5-be68-59a4ac364f8d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:33.847507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e3e565e-9c15-49e5-be68-59a4ac364f8d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:33.848117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e3e565e-9c15-49e5-be68-59a4ac364f8d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:33.848671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e3e565e-9c15-49e5-be68-59a4ac364f8d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:33.850479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e3e565e-9c15-49e5-be68-59a4ac364f8d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:33.850479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e3e565e-9c15-49e5-be68-59a4ac364f8d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:33.850479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e3e565e-9c15-49e5-be68-59a4ac364f8d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:33.940835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1f9d78fc-26a7-4db0-94ab-7a58f0fd88d2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:33.941469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1f9d78fc-26a7-4db0-94ab-7a58f0fd88d2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:33.948516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f9d78fc-26a7-4db0-94ab-7a58f0fd88d2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:33.949008 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f9d78fc-26a7-4db0-94ab-7a58f0fd88d2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:33.949451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f9d78fc-26a7-4db0-94ab-7a58f0fd88d2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:33.957076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f9d78fc-26a7-4db0-94ab-7a58f0fd88d2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:33.957076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f9d78fc-26a7-4db0-94ab-7a58f0fd88d2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:33.957076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f9d78fc-26a7-4db0-94ab-7a58f0fd88d2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:34.100834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9e3e565e-9c15-49e5-be68-59a4ac364f8d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:34.112852 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9e3e565e-9c15-49e5-be68-59a4ac364f8d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.279357 Sep 06 10:58:34.113853 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 970/1904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:33 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:34.172881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1f9d78fc-26a7-4db0-94ab-7a58f0fd88d2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:34.181640 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1f9d78fc-26a7-4db0-94ab-7a58f0fd88d2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1316 microversion: 2.1 time: 0.245944 Sep 06 10:58:34.182324 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 935/1905] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:33 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:58:34.268732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d0ea2fc4-d455-4ace-94a1-c8b62de5b206 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:34.269508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d0ea2fc4-d455-4ace-94a1-c8b62de5b206 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:34.277170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0ea2fc4-d455-4ace-94a1-c8b62de5b206 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:34.277797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0ea2fc4-d455-4ace-94a1-c8b62de5b206 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:34.278317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0ea2fc4-d455-4ace-94a1-c8b62de5b206 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:34.279139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0ea2fc4-d455-4ace-94a1-c8b62de5b206 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:34.279684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0ea2fc4-d455-4ace-94a1-c8b62de5b206 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:34.280193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0ea2fc4-d455-4ace-94a1-c8b62de5b206 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:34.366334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d0ea2fc4-d455-4ace-94a1-c8b62de5b206 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:34.374668 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d0ea2fc4-d455-4ace-94a1-c8b62de5b206 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1328 microversion: 2.1 time: 0.110695 Sep 06 10:58:34.375291 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 971/1906] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:34 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:34.416371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-309e3790-f2a1-4ebc-ac7e-7e50f10857d4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:34.417024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-309e3790-f2a1-4ebc-ac7e-7e50f10857d4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:34.424217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-309e3790-f2a1-4ebc-ac7e-7e50f10857d4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:34.424723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-309e3790-f2a1-4ebc-ac7e-7e50f10857d4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:34.425176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-309e3790-f2a1-4ebc-ac7e-7e50f10857d4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:34.425893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-309e3790-f2a1-4ebc-ac7e-7e50f10857d4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:34.426356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-309e3790-f2a1-4ebc-ac7e-7e50f10857d4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:34.426802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-309e3790-f2a1-4ebc-ac7e-7e50f10857d4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:34.711553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-309e3790-f2a1-4ebc-ac7e-7e50f10857d4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:34.734079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-309e3790-f2a1-4ebc-ac7e-7e50f10857d4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:34.737544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-309e3790-f2a1-4ebc-ac7e-7e50f10857d4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:34.739454 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-309e3790-f2a1-4ebc-ac7e-7e50f10857d4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 0.327073 Sep 06 10:58:34.755623 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 936/1907] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:34 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:35.138549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8e9674e3-2144-4caf-a976-910e03241b17 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:35.139510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8e9674e3-2144-4caf-a976-910e03241b17 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:35.149293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e9674e3-2144-4caf-a976-910e03241b17 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:35.149804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e9674e3-2144-4caf-a976-910e03241b17 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:35.154283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e9674e3-2144-4caf-a976-910e03241b17 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:35.154283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e9674e3-2144-4caf-a976-910e03241b17 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:35.154283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e9674e3-2144-4caf-a976-910e03241b17 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:35.154283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e9674e3-2144-4caf-a976-910e03241b17 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:35.211219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7fdcfc95-d042-48bc-8af8-4bd0124a8063 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:35.212030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7fdcfc95-d042-48bc-8af8-4bd0124a8063 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:35.219679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7fdcfc95-d042-48bc-8af8-4bd0124a8063 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:35.221981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7fdcfc95-d042-48bc-8af8-4bd0124a8063 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:35.221981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7fdcfc95-d042-48bc-8af8-4bd0124a8063 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:35.222662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7fdcfc95-d042-48bc-8af8-4bd0124a8063 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:35.223273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7fdcfc95-d042-48bc-8af8-4bd0124a8063 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:35.223784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7fdcfc95-d042-48bc-8af8-4bd0124a8063 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:35.515724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8e9674e3-2144-4caf-a976-910e03241b17 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:35.527246 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8e9674e3-2144-4caf-a976-910e03241b17 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.393619 Sep 06 10:58:35.530742 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 972/1908] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:35 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:35.534559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-86dfcb53-b40c-4722-b84a-48b060721638 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:35.535374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-86dfcb53-b40c-4722-b84a-48b060721638 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:35.545697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86dfcb53-b40c-4722-b84a-48b060721638 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:35.546200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86dfcb53-b40c-4722-b84a-48b060721638 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:35.546905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86dfcb53-b40c-4722-b84a-48b060721638 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:35.552208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86dfcb53-b40c-4722-b84a-48b060721638 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:35.553663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86dfcb53-b40c-4722-b84a-48b060721638 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:35.553951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86dfcb53-b40c-4722-b84a-48b060721638 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:35.618346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7fdcfc95-d042-48bc-8af8-4bd0124a8063 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:35.627690 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7fdcfc95-d042-48bc-8af8-4bd0124a8063 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1316 microversion: 2.1 time: 0.420528 Sep 06 10:58:35.628783 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 937/1909] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:35 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:35.767721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-80bde143-53c3-41aa-b699-2a7539c2453f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:35.768365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-80bde143-53c3-41aa-b699-2a7539c2453f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:35.781790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80bde143-53c3-41aa-b699-2a7539c2453f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:35.781790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80bde143-53c3-41aa-b699-2a7539c2453f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:35.781790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80bde143-53c3-41aa-b699-2a7539c2453f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:35.782875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80bde143-53c3-41aa-b699-2a7539c2453f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:35.783381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80bde143-53c3-41aa-b699-2a7539c2453f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:35.788015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80bde143-53c3-41aa-b699-2a7539c2453f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:35.913458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-86dfcb53-b40c-4722-b84a-48b060721638 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:35.924580 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-86dfcb53-b40c-4722-b84a-48b060721638 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1396 microversion: 2.1 time: 0.395287 Sep 06 10:58:35.925407 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 973/1910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:35 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1396 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:36.131728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-80bde143-53c3-41aa-b699-2a7539c2453f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:36.146619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-80bde143-53c3-41aa-b699-2a7539c2453f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:36.148669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-80bde143-53c3-41aa-b699-2a7539c2453f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:36.150327 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-80bde143-53c3-41aa-b699-2a7539c2453f tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1488 microversion: 2.25 time: 0.387038 Sep 06 10:58:36.151073 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 938/1911] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:35 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1488 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:58:36.550492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e4060405-ebc6-4d96-bdf5-b163ee1c51b5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:36.551139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e4060405-ebc6-4d96-bdf5-b163ee1c51b5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:36.558156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4060405-ebc6-4d96-bdf5-b163ee1c51b5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:36.558871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4060405-ebc6-4d96-bdf5-b163ee1c51b5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:36.559332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4060405-ebc6-4d96-bdf5-b163ee1c51b5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:36.560089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4060405-ebc6-4d96-bdf5-b163ee1c51b5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:36.560550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4060405-ebc6-4d96-bdf5-b163ee1c51b5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:36.560978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4060405-ebc6-4d96-bdf5-b163ee1c51b5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:36.652562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-95af03b5-cdad-4a1c-9248-1fd7b6e6b092 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:36.653206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-95af03b5-cdad-4a1c-9248-1fd7b6e6b092 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:36.662783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95af03b5-cdad-4a1c-9248-1fd7b6e6b092 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:36.663312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95af03b5-cdad-4a1c-9248-1fd7b6e6b092 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:36.664281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95af03b5-cdad-4a1c-9248-1fd7b6e6b092 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:36.665124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95af03b5-cdad-4a1c-9248-1fd7b6e6b092 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:36.665747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95af03b5-cdad-4a1c-9248-1fd7b6e6b092 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:36.666517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95af03b5-cdad-4a1c-9248-1fd7b6e6b092 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:36.791934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e4060405-ebc6-4d96-bdf5-b163ee1c51b5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:36.801420 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e4060405-ebc6-4d96-bdf5-b163ee1c51b5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.255303 Sep 06 10:58:36.802078 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 974/1912] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:36 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:36.917411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-95af03b5-cdad-4a1c-9248-1fd7b6e6b092 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:36.928874 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-95af03b5-cdad-4a1c-9248-1fd7b6e6b092 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1316 microversion: 2.1 time: 0.280310 Sep 06 10:58:36.930402 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 939/1913] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:36 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:58:36.956847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fac257d9-b165-4d1c-8f76-6d2d1d2626df tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:36.957492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fac257d9-b165-4d1c-8f76-6d2d1d2626df tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:36.968597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fac257d9-b165-4d1c-8f76-6d2d1d2626df tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:36.969111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fac257d9-b165-4d1c-8f76-6d2d1d2626df tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:36.969561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fac257d9-b165-4d1c-8f76-6d2d1d2626df tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:36.970317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fac257d9-b165-4d1c-8f76-6d2d1d2626df tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:36.970785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fac257d9-b165-4d1c-8f76-6d2d1d2626df tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:36.977056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fac257d9-b165-4d1c-8f76-6d2d1d2626df tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:37.162628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fac257d9-b165-4d1c-8f76-6d2d1d2626df tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:37.170821 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fac257d9-b165-4d1c-8f76-6d2d1d2626df tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1396 microversion: 2.1 time: 0.218389 Sep 06 10:58:37.171459 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 975/1914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:36 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1396 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:37.178578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-322e2dce-bbd6-4f54-97e3-549d3bf7cdd7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:37.179222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-322e2dce-bbd6-4f54-97e3-549d3bf7cdd7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:37.189680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-322e2dce-bbd6-4f54-97e3-549d3bf7cdd7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:37.190534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-322e2dce-bbd6-4f54-97e3-549d3bf7cdd7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:37.191192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-322e2dce-bbd6-4f54-97e3-549d3bf7cdd7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:37.192001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-322e2dce-bbd6-4f54-97e3-549d3bf7cdd7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:37.192777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-322e2dce-bbd6-4f54-97e3-549d3bf7cdd7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:37.193468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-322e2dce-bbd6-4f54-97e3-549d3bf7cdd7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:37.246229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-83ea54b8-9ded-47c9-bcff-1ce8d292b2c7 req-3c4b1162-2bdd-41d1-b2e5-04c24e5b806a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58328e0b-391a-4721-b3e4-2b5c2bbaeead", "tag": "3603966b-8262-417f-b816-460a496f2d31"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:37.257070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-83ea54b8-9ded-47c9-bcff-1ce8d292b2c7 req-3c4b1162-2bdd-41d1-b2e5-04c24e5b806a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:37.257636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-83ea54b8-9ded-47c9-bcff-1ce8d292b2c7 req-3c4b1162-2bdd-41d1-b2e5-04c24e5b806a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:37.258246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-83ea54b8-9ded-47c9-bcff-1ce8d292b2c7 req-3c4b1162-2bdd-41d1-b2e5-04c24e5b806a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:37.270132 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-83ea54b8-9ded-47c9-bcff-1ce8d292b2c7 req-3c4b1162-2bdd-41d1-b2e5-04c24e5b806a service nova] Creating event network-changed:3603966b-8262-417f-b816-460a496f2d31 for instance 58328e0b-391a-4721-b3e4-2b5c2bbaeead on nch1-master-1 Sep 06 10:58:37.275538 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-83ea54b8-9ded-47c9-bcff-1ce8d292b2c7 req-3c4b1162-2bdd-41d1-b2e5-04c24e5b806a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042831 Sep 06 10:58:37.276088 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 976/1915] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:37.374231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-322e2dce-bbd6-4f54-97e3-549d3bf7cdd7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:37.383653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-322e2dce-bbd6-4f54-97e3-549d3bf7cdd7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:37.385208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-322e2dce-bbd6-4f54-97e3-549d3bf7cdd7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:37.386399 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-322e2dce-bbd6-4f54-97e3-549d3bf7cdd7 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1478 microversion: 2.25 time: 0.212170 Sep 06 10:58:37.399180 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 940/1916] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:37 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1478 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:37.416113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f21faa71-7443-4a19-b66a-909182c36536 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '.version_select at 0x7f90f8942820>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:37.421572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f21faa71-7443-4a19-b66a-909182c36536 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:37.422169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f21faa71-7443-4a19-b66a-909182c36536 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:37.422918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f21faa71-7443-4a19-b66a-909182c36536 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:37.445740 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f21faa71-7443-4a19-b66a-909182c36536 tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3863 microversion: 2.25 time: 0.035194 Sep 06 10:58:37.446838 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 977/1917] 10.222.0.20 () {60 vars in 1184 bytes} [Tue Sep 6 10:58:37 2022] GET /compute/v2.1/os-migrations => generated 3863 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:37.469552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fc70d9d7-e9a3-4b9b-9f03-6ca93727bc1d tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:37.470557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fc70d9d7-e9a3-4b9b-9f03-6ca93727bc1d tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:37.477447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc70d9d7-e9a3-4b9b-9f03-6ca93727bc1d tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:37.477949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc70d9d7-e9a3-4b9b-9f03-6ca93727bc1d tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:37.478396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc70d9d7-e9a3-4b9b-9f03-6ca93727bc1d tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:37.479569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc70d9d7-e9a3-4b9b-9f03-6ca93727bc1d tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:37.480321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc70d9d7-e9a3-4b9b-9f03-6ca93727bc1d tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:37.480768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc70d9d7-e9a3-4b9b-9f03-6ca93727bc1d tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:37.706001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-fc70d9d7-e9a3-4b9b-9f03-6ca93727bc1d tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] Lazy-loading 'services' on Instance uuid c13346df-1ae9-49f9-8768-e174464a198a {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:58:37.720371 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fc70d9d7-e9a3-4b9b-9f03-6ca93727bc1d tempest-LiveAutoBlockMigrationV225Test-880435670 tempest-LiveAutoBlockMigrationV225Test-880435670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1971 microversion: 2.25 time: 0.254102 Sep 06 10:58:37.721186 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 941/1918] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:37 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1971 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:37.776834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e58acf14-3605-4a32-b822-f00d5ec7c488 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:37.783985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e58acf14-3605-4a32-b822-f00d5ec7c488 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:37.791693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e58acf14-3605-4a32-b822-f00d5ec7c488 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:37.792124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e58acf14-3605-4a32-b822-f00d5ec7c488 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:37.792567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e58acf14-3605-4a32-b822-f00d5ec7c488 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:37.793284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e58acf14-3605-4a32-b822-f00d5ec7c488 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:37.793753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e58acf14-3605-4a32-b822-f00d5ec7c488 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:37.794194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e58acf14-3605-4a32-b822-f00d5ec7c488 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:37.834369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5a830996-c89e-4db6-8262-ba6a16ed3213 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:37.835041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5a830996-c89e-4db6-8262-ba6a16ed3213 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:37.836005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e58acf14-3605-4a32-b822-f00d5ec7c488 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:58:37.844109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a830996-c89e-4db6-8262-ba6a16ed3213 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:37.846476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a830996-c89e-4db6-8262-ba6a16ed3213 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:37.846476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a830996-c89e-4db6-8262-ba6a16ed3213 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:37.846952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a830996-c89e-4db6-8262-ba6a16ed3213 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:37.847569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a830996-c89e-4db6-8262-ba6a16ed3213 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:37.848179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a830996-c89e-4db6-8262-ba6a16ed3213 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:37.865342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:38.074877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5a830996-c89e-4db6-8262-ba6a16ed3213 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:38.085408 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5a830996-c89e-4db6-8262-ba6a16ed3213 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.262403 Sep 06 10:58:38.086874 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 942/1919] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:37 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:38.091523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cd582454-395f-4460-ab46-dd1bd61f4420 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:38.092920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cd582454-395f-4460-ab46-dd1bd61f4420 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:38.099170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd582454-395f-4460-ab46-dd1bd61f4420 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:38.099870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd582454-395f-4460-ab46-dd1bd61f4420 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:38.100851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd582454-395f-4460-ab46-dd1bd61f4420 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:38.105488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd582454-395f-4460-ab46-dd1bd61f4420 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:38.105488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd582454-395f-4460-ab46-dd1bd61f4420 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:38.105488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd582454-395f-4460-ab46-dd1bd61f4420 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:38.295478 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e58acf14-3605-4a32-b822-f00d5ec7c488 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 204 len: 0 microversion: 2.25 time: 0.525593 Sep 06 10:58:38.296438 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 978/1920] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 10:58:37 2022] DELETE /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 10:58:38.298862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cd582454-395f-4460-ab46-dd1bd61f4420 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:38.304671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e8b3a78c-03e2-4de1-b804-f558d6eff9d1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:38.305638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e8b3a78c-03e2-4de1-b804-f558d6eff9d1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:38.308941 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cd582454-395f-4460-ab46-dd1bd61f4420 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1316 microversion: 2.1 time: 0.221226 Sep 06 10:58:38.309629 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 943/1921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:38 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:38.312596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8b3a78c-03e2-4de1-b804-f558d6eff9d1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:38.313259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8b3a78c-03e2-4de1-b804-f558d6eff9d1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:38.314449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8b3a78c-03e2-4de1-b804-f558d6eff9d1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:38.315101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2349bceb-4208-4164-9ae7-8b2f00e8c4f4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:38.315855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2349bceb-4208-4164-9ae7-8b2f00e8c4f4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:38.316077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8b3a78c-03e2-4de1-b804-f558d6eff9d1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:38.317369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8b3a78c-03e2-4de1-b804-f558d6eff9d1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:38.317955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8b3a78c-03e2-4de1-b804-f558d6eff9d1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:38.322459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2349bceb-4208-4164-9ae7-8b2f00e8c4f4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:38.323184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2349bceb-4208-4164-9ae7-8b2f00e8c4f4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:38.323774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2349bceb-4208-4164-9ae7-8b2f00e8c4f4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:38.325218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2349bceb-4208-4164-9ae7-8b2f00e8c4f4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:38.325827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2349bceb-4208-4164-9ae7-8b2f00e8c4f4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:38.326990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2349bceb-4208-4164-9ae7-8b2f00e8c4f4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:38.600905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2349bceb-4208-4164-9ae7-8b2f00e8c4f4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:38.610130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2349bceb-4208-4164-9ae7-8b2f00e8c4f4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:38.612254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2349bceb-4208-4164-9ae7-8b2f00e8c4f4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:38.613514 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2349bceb-4208-4164-9ae7-8b2f00e8c4f4 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1484 microversion: 2.25 time: 0.302897 Sep 06 10:58:38.614156 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 944/1922] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:38 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1484 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:38.621795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e8b3a78c-03e2-4de1-b804-f558d6eff9d1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:38.629405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-92d0c456-302c-48fb-b5da-6a9a8225994b req-fd1614ed-1f9c-4095-bc35-9d2c419c4fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109feea8-7249-41b8-a662-673aebba1930", "name": "network-vif-plugged", "status": "completed", "tag": "824afb7c-dc73-4081-b4ca-c33182803e3d"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:38.635845 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e8b3a78c-03e2-4de1-b804-f558d6eff9d1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1396 microversion: 2.1 time: 0.330616 Sep 06 10:58:38.637844 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 979/1923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:38 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1396 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:38.649174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-92d0c456-302c-48fb-b5da-6a9a8225994b req-fd1614ed-1f9c-4095-bc35-9d2c419c4fc7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:38.649668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-92d0c456-302c-48fb-b5da-6a9a8225994b req-fd1614ed-1f9c-4095-bc35-9d2c419c4fc7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:38.650103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-92d0c456-302c-48fb-b5da-6a9a8225994b req-fd1614ed-1f9c-4095-bc35-9d2c419c4fc7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:38.667162 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-92d0c456-302c-48fb-b5da-6a9a8225994b req-fd1614ed-1f9c-4095-bc35-9d2c419c4fc7 service nova] Creating event network-vif-plugged:824afb7c-dc73-4081-b4ca-c33182803e3d for instance 109feea8-7249-41b8-a662-673aebba1930 on nch2-master-1 Sep 06 10:58:38.673618 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-92d0c456-302c-48fb-b5da-6a9a8225994b req-fd1614ed-1f9c-4095-bc35-9d2c419c4fc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056730 Sep 06 10:58:38.674214 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 945/1924] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:39.110306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f73d94df-19c9-4c04-80cc-982f778e5789 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:39.111439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f73d94df-19c9-4c04-80cc-982f778e5789 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:39.120299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f73d94df-19c9-4c04-80cc-982f778e5789 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:39.120933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f73d94df-19c9-4c04-80cc-982f778e5789 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:39.121444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f73d94df-19c9-4c04-80cc-982f778e5789 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:39.122232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f73d94df-19c9-4c04-80cc-982f778e5789 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:39.122829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f73d94df-19c9-4c04-80cc-982f778e5789 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:39.135143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f73d94df-19c9-4c04-80cc-982f778e5789 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:39.291227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f73d94df-19c9-4c04-80cc-982f778e5789 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:39.299518 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f73d94df-19c9-4c04-80cc-982f778e5789 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.194380 Sep 06 10:58:39.300112 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 980/1925] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:39 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:39.336938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1f3ff7b1-8a3a-4cce-89cc-e85b0e8783f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:39.337737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1f3ff7b1-8a3a-4cce-89cc-e85b0e8783f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:39.344359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f3ff7b1-8a3a-4cce-89cc-e85b0e8783f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:39.345615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f3ff7b1-8a3a-4cce-89cc-e85b0e8783f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:39.346088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f3ff7b1-8a3a-4cce-89cc-e85b0e8783f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:39.346961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f3ff7b1-8a3a-4cce-89cc-e85b0e8783f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:39.347441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f3ff7b1-8a3a-4cce-89cc-e85b0e8783f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:39.347883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f3ff7b1-8a3a-4cce-89cc-e85b0e8783f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:39.493066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1f3ff7b1-8a3a-4cce-89cc-e85b0e8783f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:39.500967 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1f3ff7b1-8a3a-4cce-89cc-e85b0e8783f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1316 microversion: 2.1 time: 0.168727 Sep 06 10:58:39.501543 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 946/1926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:39 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:39.645507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3569eb09-94f7-413f-b054-31b54d973e34 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:39.646467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3569eb09-94f7-413f-b054-31b54d973e34 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:39.652921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3569eb09-94f7-413f-b054-31b54d973e34 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:39.653681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3569eb09-94f7-413f-b054-31b54d973e34 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:39.654307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3569eb09-94f7-413f-b054-31b54d973e34 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:39.655035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3569eb09-94f7-413f-b054-31b54d973e34 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:39.655649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3569eb09-94f7-413f-b054-31b54d973e34 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:39.656086 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3569eb09-94f7-413f-b054-31b54d973e34 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:39.663384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca4a771b-b9cc-40fd-b78a-431cbe748057 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:39.669062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca4a771b-b9cc-40fd-b78a-431cbe748057 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:39.677098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca4a771b-b9cc-40fd-b78a-431cbe748057 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:39.677604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca4a771b-b9cc-40fd-b78a-431cbe748057 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:39.678075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca4a771b-b9cc-40fd-b78a-431cbe748057 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:39.681001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca4a771b-b9cc-40fd-b78a-431cbe748057 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:39.681001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca4a771b-b9cc-40fd-b78a-431cbe748057 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:39.681001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca4a771b-b9cc-40fd-b78a-431cbe748057 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:39.865336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3569eb09-94f7-413f-b054-31b54d973e34 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:39.877844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3569eb09-94f7-413f-b054-31b54d973e34 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:39.880047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3569eb09-94f7-413f-b054-31b54d973e34 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:39.881699 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3569eb09-94f7-413f-b054-31b54d973e34 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1484 microversion: 2.25 time: 0.243960 Sep 06 10:58:39.882756 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 981/1927] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:39 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1484 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:39.891352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ca4a771b-b9cc-40fd-b78a-431cbe748057 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:39.900000 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ca4a771b-b9cc-40fd-b78a-431cbe748057 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1396 microversion: 2.1 time: 0.240605 Sep 06 10:58:39.900612 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 947/1928] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:39 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1396 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:39.954881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8f004138-61b9-49da-988f-de8a7d8a3113 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:39.955417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8f004138-61b9-49da-988f-de8a7d8a3113 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:39.962483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f004138-61b9-49da-988f-de8a7d8a3113 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:39.963160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f004138-61b9-49da-988f-de8a7d8a3113 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:39.963708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f004138-61b9-49da-988f-de8a7d8a3113 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:39.964596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f004138-61b9-49da-988f-de8a7d8a3113 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:39.965179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f004138-61b9-49da-988f-de8a7d8a3113 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:39.965704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f004138-61b9-49da-988f-de8a7d8a3113 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:39.997389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8f004138-61b9-49da-988f-de8a7d8a3113 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:58:40.322637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01998318-bd7a-44e6-a154-d2499a4e30da tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:40.323627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-01998318-bd7a-44e6-a154-d2499a4e30da tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:40.330383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:40.332887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01998318-bd7a-44e6-a154-d2499a4e30da tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:40.333418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01998318-bd7a-44e6-a154-d2499a4e30da tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:40.333869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01998318-bd7a-44e6-a154-d2499a4e30da tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:40.334796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01998318-bd7a-44e6-a154-d2499a4e30da tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:40.335303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01998318-bd7a-44e6-a154-d2499a4e30da tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:40.335899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01998318-bd7a-44e6-a154-d2499a4e30da tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:40.489858 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8f004138-61b9-49da-988f-de8a7d8a3113 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 204 len: 0 microversion: 2.1 time: 0.538657 Sep 06 10:58:40.490400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-01998318-bd7a-44e6-a154-d2499a4e30da tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:40.490769 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 982/1929] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:58:39 2022] DELETE /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:58:40.503978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ac7fcb1d-041c-43cf-a0e6-9fa54ee1adc8 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:40.504156 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-01998318-bd7a-44e6-a154-d2499a4e30da tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.186049 Sep 06 10:58:40.505033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ac7fcb1d-041c-43cf-a0e6-9fa54ee1adc8 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:40.514784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac7fcb1d-041c-43cf-a0e6-9fa54ee1adc8 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:40.515383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac7fcb1d-041c-43cf-a0e6-9fa54ee1adc8 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:40.515863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac7fcb1d-041c-43cf-a0e6-9fa54ee1adc8 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:40.518365 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 948/1930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:40 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:58:40.522842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac7fcb1d-041c-43cf-a0e6-9fa54ee1adc8 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:40.524505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac7fcb1d-041c-43cf-a0e6-9fa54ee1adc8 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:40.525151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac7fcb1d-041c-43cf-a0e6-9fa54ee1adc8 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:40.536268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-33d15eff-3fa5-4cfd-8c2a-489ad112f031 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:40.537221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-33d15eff-3fa5-4cfd-8c2a-489ad112f031 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:40.546951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33d15eff-3fa5-4cfd-8c2a-489ad112f031 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:40.547771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33d15eff-3fa5-4cfd-8c2a-489ad112f031 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:40.549086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33d15eff-3fa5-4cfd-8c2a-489ad112f031 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:40.549840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33d15eff-3fa5-4cfd-8c2a-489ad112f031 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:40.550317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33d15eff-3fa5-4cfd-8c2a-489ad112f031 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:40.550985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33d15eff-3fa5-4cfd-8c2a-489ad112f031 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:40.732663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ac7fcb1d-041c-43cf-a0e6-9fa54ee1adc8 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:40.741892 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ac7fcb1d-041c-43cf-a0e6-9fa54ee1adc8 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1679 microversion: 2.1 time: 0.242566 Sep 06 10:58:40.742552 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 983/1931] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:40 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1679 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:40.761178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-33d15eff-3fa5-4cfd-8c2a-489ad112f031 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:40.770509 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-33d15eff-3fa5-4cfd-8c2a-489ad112f031 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1505 microversion: 2.1 time: 0.247954 Sep 06 10:58:40.771309 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 949/1932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:40 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:40.799476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f7e1376a-bfad-48f2-be12-1afe8e74cebc tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-801382678"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:40.800030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f7e1376a-bfad-48f2-be12-1afe8e74cebc tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:40.806499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7e1376a-bfad-48f2-be12-1afe8e74cebc tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:40.807221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7e1376a-bfad-48f2-be12-1afe8e74cebc tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:40.807671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7e1376a-bfad-48f2-be12-1afe8e74cebc tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:40.808548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7e1376a-bfad-48f2-be12-1afe8e74cebc tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:40.809020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7e1376a-bfad-48f2-be12-1afe8e74cebc tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:40.809484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7e1376a-bfad-48f2-be12-1afe8e74cebc tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:40.907840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d6a2a215-4f09-4a42-a9c9-221c5b1513ef tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:40.908525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d6a2a215-4f09-4a42-a9c9-221c5b1513ef tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:40.914914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6a2a215-4f09-4a42-a9c9-221c5b1513ef tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:40.915441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6a2a215-4f09-4a42-a9c9-221c5b1513ef tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:40.915887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6a2a215-4f09-4a42-a9c9-221c5b1513ef tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:40.916599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6a2a215-4f09-4a42-a9c9-221c5b1513ef tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:40.917386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6a2a215-4f09-4a42-a9c9-221c5b1513ef tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:40.917825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6a2a215-4f09-4a42-a9c9-221c5b1513ef tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:40.920738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:40.935335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=12 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:40.949153 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.network.security_group_api [None req-f7e1376a-bfad-48f2-be12-1afe8e74cebc tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Adding security group a11416d8-c7f5-4c30-945f-506e524c554b to port 824afb7c-dc73-4081-b4ca-c33182803e3d Sep 06 10:58:41.120049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d6a2a215-4f09-4a42-a9c9-221c5b1513ef tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:41.128651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d6a2a215-4f09-4a42-a9c9-221c5b1513ef tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:41.130135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d6a2a215-4f09-4a42-a9c9-221c5b1513ef tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:41.131602 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d6a2a215-4f09-4a42-a9c9-221c5b1513ef tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1484 microversion: 2.25 time: 0.228192 Sep 06 10:58:41.132247 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 950/1933] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:40 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1484 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:58:41.136630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-572fef62-df9b-4fd2-a958-a0d163c6774a tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:41.137239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-572fef62-df9b-4fd2-a958-a0d163c6774a tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:41.143161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-572fef62-df9b-4fd2-a958-a0d163c6774a tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:41.143640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-572fef62-df9b-4fd2-a958-a0d163c6774a tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:41.145265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-572fef62-df9b-4fd2-a958-a0d163c6774a tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:41.145998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-572fef62-df9b-4fd2-a958-a0d163c6774a tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:41.145998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-572fef62-df9b-4fd2-a958-a0d163c6774a tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:41.146345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-572fef62-df9b-4fd2-a958-a0d163c6774a tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:41.362255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-572fef62-df9b-4fd2-a958-a0d163c6774a tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:41.370957 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-572fef62-df9b-4fd2-a958-a0d163c6774a tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1396 microversion: 2.1 time: 0.237587 Sep 06 10:58:41.387811 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 951/1934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:41 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1396 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:41.387811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8770ebfa-f172-49ec-8f03-6db950be9354 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:41.387811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8770ebfa-f172-49ec-8f03-6db950be9354 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:41.397868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:41.400501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8770ebfa-f172-49ec-8f03-6db950be9354 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:41.401405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8770ebfa-f172-49ec-8f03-6db950be9354 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:41.401872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8770ebfa-f172-49ec-8f03-6db950be9354 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:41.402592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8770ebfa-f172-49ec-8f03-6db950be9354 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:41.403093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8770ebfa-f172-49ec-8f03-6db950be9354 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:41.403586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8770ebfa-f172-49ec-8f03-6db950be9354 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:41.432303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8770ebfa-f172-49ec-8f03-6db950be9354 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:58:41.514430 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f7e1376a-bfad-48f2-be12-1afe8e74cebc tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930/action" status: 202 len: 0 microversion: 2.1 time: 0.719153 Sep 06 10:58:41.515383 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 984/1935] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:58:40 2022] POST /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930/action => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:58:41.522330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-683330659", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "5b6705a8-18ba-4c7b-8746-2de97532a645"}], "security_groups": [{"name": "tempest-securitygroup--1571939348"}], "key_name": "tempest-keypair-395680744", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "99977593-ec2b-460c-ac61-5a8c1aad3dad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:41.678065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] validate_networks() for [('5b6705a8-18ba-4c7b-8746-2de97532a645', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:58:41.792743 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8770ebfa-f172-49ec-8f03-6db950be9354 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 204 len: 0 microversion: 2.1 time: 0.415246 Sep 06 10:58:41.794732 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 952/1936] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:58:41 2022] DELETE /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:58:41.802093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0129863d-5d45-44e4-81c4-d4706b2b2cbd tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-227144173"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:41.802938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0129863d-5d45-44e4-81c4-d4706b2b2cbd tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:41.809661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0129863d-5d45-44e4-81c4-d4706b2b2cbd tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:41.810163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0129863d-5d45-44e4-81c4-d4706b2b2cbd tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:41.810792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0129863d-5d45-44e4-81c4-d4706b2b2cbd tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:41.811553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0129863d-5d45-44e4-81c4-d4706b2b2cbd tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:41.812171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0129863d-5d45-44e4-81c4-d4706b2b2cbd tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:41.812767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0129863d-5d45-44e4-81c4-d4706b2b2cbd tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:42.116207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=18 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:42.254713 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.network.security_group_api [None req-0129863d-5d45-44e4-81c4-d4706b2b2cbd tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Adding security group f970c6af-b418-4eb5-ace1-eb1358e1ed9e to port 824afb7c-dc73-4081-b4ca-c33182803e3d Sep 06 10:58:43.021477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Getting quotas for project aa2ed3ceca87459d8b6db473a08b3464. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:58:43.027773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Getting quotas for user a880494fb3144a58afd1fbfa8eff6cb4 and project aa2ed3ceca87459d8b6db473a08b3464. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:58:43.043086 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:58:43.043757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:58:43.044245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:58:43.044654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:58:43.045067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:58:43.053668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:43.054159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:43.054629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:43.055388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:43.055873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:43.056306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:43.071860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:43.074716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Getting quotas for project aa2ed3ceca87459d8b6db473a08b3464. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:58:43.080758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Getting quotas for user a880494fb3144a58afd1fbfa8eff6cb4 and project aa2ed3ceca87459d8b6db473a08b3464. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:58:43.147788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:58:43.150385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99977593-ec2b-460c-ac61-5a8c1aad3dad',volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:58:43.451694 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0129863d-5d45-44e4-81c4-d4706b2b2cbd tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930/action" status: 202 len: 0 microversion: 2.1 time: 1.655322 Sep 06 10:58:43.453032 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 953/1937] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:58:41 2022] POST /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930/action => generated 0 bytes in 1658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:58:43.460044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-933aeb5c-afad-4554-92db-6976e7330286 req-01ec60a1-79bc-4c2b-b385-f8a89939c998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109feea8-7249-41b8-a662-673aebba1930", "tag": "824afb7c-dc73-4081-b4ca-c33182803e3d"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:43.475369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-933aeb5c-afad-4554-92db-6976e7330286 req-01ec60a1-79bc-4c2b-b385-f8a89939c998 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:43.476833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-933aeb5c-afad-4554-92db-6976e7330286 req-01ec60a1-79bc-4c2b-b385-f8a89939c998 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:43.477565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-933aeb5c-afad-4554-92db-6976e7330286 req-01ec60a1-79bc-4c2b-b385-f8a89939c998 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:43.505608 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-933aeb5c-afad-4554-92db-6976e7330286 req-01ec60a1-79bc-4c2b-b385-f8a89939c998 service nova] Creating event network-changed:824afb7c-dc73-4081-b4ca-c33182803e3d for instance 109feea8-7249-41b8-a662-673aebba1930 on nch2-master-1 Sep 06 10:58:43.516328 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-933aeb5c-afad-4554-92db-6976e7330286 req-01ec60a1-79bc-4c2b-b385-f8a89939c998 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061259 Sep 06 10:58:43.519796 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 954/1938] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:43.530547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7441bd94-1378-4811-b812-0665983563e2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:43.531792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7441bd94-1378-4811-b812-0665983563e2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:43.542894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7441bd94-1378-4811-b812-0665983563e2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:43.542894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7441bd94-1378-4811-b812-0665983563e2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:43.542894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7441bd94-1378-4811-b812-0665983563e2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:43.542894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7441bd94-1378-4811-b812-0665983563e2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:43.542894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7441bd94-1378-4811-b812-0665983563e2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:43.544107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7441bd94-1378-4811-b812-0665983563e2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:43.770749 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.253994 Sep 06 10:58:43.772052 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 985/1939] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:58:41 2022] POST /compute/v2.1/servers => generated 407 bytes in 2256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:58:43.779697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba9d5671-3887-45d2-9fe3-b8d1ce8548bc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:43.780819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ba9d5671-3887-45d2-9fe3-b8d1ce8548bc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:43.793783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba9d5671-3887-45d2-9fe3-b8d1ce8548bc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:43.794264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba9d5671-3887-45d2-9fe3-b8d1ce8548bc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:43.801945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba9d5671-3887-45d2-9fe3-b8d1ce8548bc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:43.802966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba9d5671-3887-45d2-9fe3-b8d1ce8548bc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:43.804036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba9d5671-3887-45d2-9fe3-b8d1ce8548bc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:43.804625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba9d5671-3887-45d2-9fe3-b8d1ce8548bc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:44.402077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7441bd94-1378-4811-b812-0665983563e2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:44.410886 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7441bd94-1378-4811-b812-0665983563e2 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.889471 Sep 06 10:58:44.411760 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 955/1940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:43 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:44.416679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c8f0eaf7-2c2c-437e-b157-1e968fb87f8f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:44.417558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c8f0eaf7-2c2c-437e-b157-1e968fb87f8f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:44.424858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8f0eaf7-2c2c-437e-b157-1e968fb87f8f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:44.428846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8f0eaf7-2c2c-437e-b157-1e968fb87f8f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:44.428846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8f0eaf7-2c2c-437e-b157-1e968fb87f8f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:44.428846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8f0eaf7-2c2c-437e-b157-1e968fb87f8f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:44.428846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8f0eaf7-2c2c-437e-b157-1e968fb87f8f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:44.428846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8f0eaf7-2c2c-437e-b157-1e968fb87f8f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:44.493983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ba9d5671-3887-45d2-9fe3-b8d1ce8548bc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:44.504781 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ba9d5671-3887-45d2-9fe3-b8d1ce8548bc tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1679 microversion: 2.1 time: 0.731002 Sep 06 10:58:44.506347 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 986/1941] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:43 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1679 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:44.525843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:44.526876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:44.536196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:44.536948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:44.537876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:44.538949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:44.539745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:44.540424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:44.638489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:44.639613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:44.641759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:44.642420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lazy-loading 'fault' on Instance uuid c13346df-1ae9-49f9-8768-e174464a198a {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:58:44.901135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:44.914024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:44.915571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:44.923266 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-85d026c4-8738-40da-aaea-d2bddb598fde tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 200 len: 1271 microversion: 2.25 time: 0.413250 Sep 06 10:58:44.925483 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 987/1942] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:44 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 1271 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:44.937840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-98e401dd-12bb-47e4-9de9-297318ca3110 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:44.947973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-98e401dd-12bb-47e4-9de9-297318ca3110 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:44.955150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98e401dd-12bb-47e4-9de9-297318ca3110 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:44.955839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98e401dd-12bb-47e4-9de9-297318ca3110 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:44.956291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98e401dd-12bb-47e4-9de9-297318ca3110 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:44.957016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98e401dd-12bb-47e4-9de9-297318ca3110 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:44.957479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98e401dd-12bb-47e4-9de9-297318ca3110 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:44.958067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98e401dd-12bb-47e4-9de9-297318ca3110 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:45.150731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c8f0eaf7-2c2c-437e-b157-1e968fb87f8f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:45.169673 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c8f0eaf7-2c2c-437e-b157-1e968fb87f8f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1553 microversion: 2.1 time: 0.756119 Sep 06 10:58:45.172128 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 956/1943] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:44 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1553 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:45.182012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c6b321b4-b200-4ede-a357-9930580a6ae2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:45.182521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c6b321b4-b200-4ede-a357-9930580a6ae2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:45.196489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6b321b4-b200-4ede-a357-9930580a6ae2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:45.197002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6b321b4-b200-4ede-a357-9930580a6ae2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:45.197459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6b321b4-b200-4ede-a357-9930580a6ae2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:45.198189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6b321b4-b200-4ede-a357-9930580a6ae2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:45.198660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6b321b4-b200-4ede-a357-9930580a6ae2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:45.199127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6b321b4-b200-4ede-a357-9930580a6ae2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:45.305468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-98e401dd-12bb-47e4-9de9-297318ca3110 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:45.316506 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-98e401dd-12bb-47e4-9de9-297318ca3110 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1396 microversion: 2.1 time: 0.389718 Sep 06 10:58:45.323517 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 988/1944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:44 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1396 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:45.338069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ee8a09b5-1d7e-42e1-b274-a14c62faed4f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:45.338968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ee8a09b5-1d7e-42e1-b274-a14c62faed4f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:45.522595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ee8a09b5-1d7e-42e1-b274-a14c62faed4f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:45.545481 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ee8a09b5-1d7e-42e1-b274-a14c62faed4f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1120 microversion: 2.1 time: 0.219325 Sep 06 10:58:45.559279 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 989/1945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:45 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1120 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:45.563488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-df658868-8468-43d9-8680-752eeb7ad3f9 req-ee3903c9-27b8-4e8b-b9b0-657fb78fa8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e343dd1a-4f3b-4da1-9396-5cdc5e1d297a", "name": "network-vif-deleted", "tag": "985e3216-597b-4a07-9d39-3796d1f2a0b6"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:45.600067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-df658868-8468-43d9-8680-752eeb7ad3f9 req-ee3903c9-27b8-4e8b-b9b0-657fb78fa8c5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:45.601191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-df658868-8468-43d9-8680-752eeb7ad3f9 req-ee3903c9-27b8-4e8b-b9b0-657fb78fa8c5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:45.602681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-df658868-8468-43d9-8680-752eeb7ad3f9 req-ee3903c9-27b8-4e8b-b9b0-657fb78fa8c5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:45.625761 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-df658868-8468-43d9-8680-752eeb7ad3f9 req-ee3903c9-27b8-4e8b-b9b0-657fb78fa8c5 service nova] Creating event network-vif-deleted:985e3216-597b-4a07-9d39-3796d1f2a0b6 for instance e343dd1a-4f3b-4da1-9396-5cdc5e1d297a on nch1-master-1 Sep 06 10:58:45.636517 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-df658868-8468-43d9-8680-752eeb7ad3f9 req-ee3903c9-27b8-4e8b-b9b0-657fb78fa8c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080016 Sep 06 10:58:45.637572 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 990/1946] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:45.645136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-aa5f7c95-f26c-4959-bba8-161f40b782e1 req-77cecbc5-fbef-4953-a221-814ec6f95824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58328e0b-391a-4721-b3e4-2b5c2bbaeead", "name": "network-vif-plugged", "status": "completed", "tag": "3603966b-8262-417f-b816-460a496f2d31"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:45.669327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-aa5f7c95-f26c-4959-bba8-161f40b782e1 req-77cecbc5-fbef-4953-a221-814ec6f95824 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:45.670236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-aa5f7c95-f26c-4959-bba8-161f40b782e1 req-77cecbc5-fbef-4953-a221-814ec6f95824 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:45.670818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-aa5f7c95-f26c-4959-bba8-161f40b782e1 req-77cecbc5-fbef-4953-a221-814ec6f95824 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:45.698103 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c6b321b4-b200-4ede-a357-9930580a6ae2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.521790 Sep 06 10:58:45.698958 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 957/1947] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Sep 6 10:58:45 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930/os-security-groups => generated 1157 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:45.700207 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-aa5f7c95-f26c-4959-bba8-161f40b782e1 req-77cecbc5-fbef-4953-a221-814ec6f95824 service nova] Creating event network-vif-plugged:3603966b-8262-417f-b816-460a496f2d31 for instance 58328e0b-391a-4721-b3e4-2b5c2bbaeead on nch1-master-1 Sep 06 10:58:45.705769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ae12af1b-ea42-4701-8e43-905a5fa91a3f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:45.708324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ae12af1b-ea42-4701-8e43-905a5fa91a3f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:45.710070 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-aa5f7c95-f26c-4959-bba8-161f40b782e1 req-77cecbc5-fbef-4953-a221-814ec6f95824 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070829 Sep 06 10:58:45.715537 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 991/1948] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:45.730366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:45.733619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:45.748319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:45.754532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae12af1b-ea42-4701-8e43-905a5fa91a3f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:45.755117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae12af1b-ea42-4701-8e43-905a5fa91a3f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:45.755286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:45.756252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:45.757767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:45.758395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:45.758984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:45.762262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae12af1b-ea42-4701-8e43-905a5fa91a3f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:45.763321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae12af1b-ea42-4701-8e43-905a5fa91a3f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:45.774246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae12af1b-ea42-4701-8e43-905a5fa91a3f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:45.776299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae12af1b-ea42-4701-8e43-905a5fa91a3f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:45.817458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:45.818055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:45.818566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:45.819094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lazy-loading 'fault' on Instance uuid e343dd1a-4f3b-4da1-9396-5cdc5e1d297a {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:58:46.128098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c557446cb39475dba1fc800d061b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740286d1464549609e6d4b3280aa50ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:46.142095 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a0735766-3f23-4e4a-9ec2-40ecc8b49f45 tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 200 len: 1330 microversion: 2.1 time: 0.423486 Sep 06 10:58:46.147094 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 992/1949] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:45 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 1330 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:46.159485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-f8fa9d8b-5be1-442f-aba8-5a2ef8af5edc req-c7068264-550e-4676-946a-bc293fe4537e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13346df-1ae9-49f9-8768-e174464a198a", "name": "network-vif-deleted", "tag": "4ca62dc1-98f7-4849-a1cb-92d224f8d239"}, {"name": "network-changed", "server_uuid": "109feea8-7249-41b8-a662-673aebba1930", "tag": "824afb7c-dc73-4081-b4ca-c33182803e3d"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:46.181809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f8fa9d8b-5be1-442f-aba8-5a2ef8af5edc req-c7068264-550e-4676-946a-bc293fe4537e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:46.187859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f8fa9d8b-5be1-442f-aba8-5a2ef8af5edc req-c7068264-550e-4676-946a-bc293fe4537e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:46.187859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f8fa9d8b-5be1-442f-aba8-5a2ef8af5edc req-c7068264-550e-4676-946a-bc293fe4537e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:46.204082 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f8fa9d8b-5be1-442f-aba8-5a2ef8af5edc req-c7068264-550e-4676-946a-bc293fe4537e service nova] Creating event network-vif-deleted:4ca62dc1-98f7-4849-a1cb-92d224f8d239 for instance c13346df-1ae9-49f9-8768-e174464a198a on nch1-master-1 Sep 06 10:58:46.204596 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f8fa9d8b-5be1-442f-aba8-5a2ef8af5edc req-c7068264-550e-4676-946a-bc293fe4537e service nova] Creating event network-changed:824afb7c-dc73-4081-b4ca-c33182803e3d for instance 109feea8-7249-41b8-a662-673aebba1930 on nch2-master-1 Sep 06 10:58:46.229428 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-f8fa9d8b-5be1-442f-aba8-5a2ef8af5edc req-c7068264-550e-4676-946a-bc293fe4537e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.080980 Sep 06 10:58:46.233867 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 993/1950] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:46.256829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-92189a83-2a91-4faf-a998-0fe8e76a2191 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'create', calling method: .version_select at 0x7f90f86411f0>, body: {"security_group": {"name": " tempest-securitygroup -1838688904 ", "description": "tempest-description-1759643353"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:46.321353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ae12af1b-ea42-4701-8e43-905a5fa91a3f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:46.332616 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ae12af1b-ea42-4701-8e43-905a5fa91a3f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.631666 Sep 06 10:58:46.333924 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 958/1951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:45 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:46.339412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bd51fca9-492d-44c7-bb77-3b6c6879c83a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:46.340189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bd51fca9-492d-44c7-bb77-3b6c6879c83a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c13346df-1ae9-49f9-8768-e174464a198a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:46.363865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd51fca9-492d-44c7-bb77-3b6c6879c83a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:46.365735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd51fca9-492d-44c7-bb77-3b6c6879c83a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:46.366403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd51fca9-492d-44c7-bb77-3b6c6879c83a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:46.368509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd51fca9-492d-44c7-bb77-3b6c6879c83a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:46.369581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd51fca9-492d-44c7-bb77-3b6c6879c83a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:46.371690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd51fca9-492d-44c7-bb77-3b6c6879c83a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:46.409240 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-bd51fca9-492d-44c7-bb77-3b6c6879c83a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] HTTP exception thrown: Instance c13346df-1ae9-49f9-8768-e174464a198a could not be found. Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bd51fca9-492d-44c7-bb77-3b6c6879c83a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Request method failure captured: Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a HTTP/1.1 Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyY0XM8QMXsO-ZWeLvp9H3JP18koy_zrLLTsVcziqdA8AUhtRN2Nos8FUZnlA70cyyHoMhNRX0TLQgSONOWujMjpWXPVbcPTmCUURRh1f4AqUqjN2SB2hJ-XhwH2MKhkrUnx3BjFxywrtAfM4EYJd-Kplg-hPOnvY26JjHh1VMyYKT8 Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.25 Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 437799e22df2433a83eca67987e942c6 Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1816350742 Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_437799e22df2433a83eca67987e942c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/437799e22df2433a83eca67987e942c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/437799e22df2433a83eca67987e942c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/437799e22df2433a83eca67987e942c6"}]}] Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1816350742 Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 437799e22df2433a83eca67987e942c6 Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1816350742 Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-LiveAutoBlockMigrationV225Test-1816350742-project Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d9f88a4c72854cff9bba7ed2920f55b0 Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1816350742-project Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance c13346df-1ae9-49f9-8768-e174464a198a could not be found. Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'c13346df-1ae9-49f9-8768-e174464a198a'} Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13346df-1ae9-49f9-8768-e174464a198a could not be found. Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13346df-1ae9-49f9-8768-e174464a198a could not be found. Sep 06 10:58:46.421160 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:46.425527 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:46.425527 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:46.425527 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:46.425527 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:46.425527 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:46.425527 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:58:46.425527 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:58:46.425527 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13346df-1ae9-49f9-8768-e174464a198a could not be found. Sep 06 10:58:46.425527 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:46.425527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bd51fca9-492d-44c7-bb77-3b6c6879c83a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Returning 404 to user: Instance c13346df-1ae9-49f9-8768-e174464a198a could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:58:46.425527 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bd51fca9-492d-44c7-bb77-3b6c6879c83a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a" status: 404 len: 111 microversion: 2.25 time: 0.087792 Sep 06 10:58:46.425527 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 959/1952] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:46 2022] GET /compute/v2.1/servers/c13346df-1ae9-49f9-8768-e174464a198a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:58:46.436750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-400a92fb-e2b7-49df-b37d-e7cc5c3347ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:46.438976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-400a92fb-e2b7-49df-b37d-e7cc5c3347ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:46.449669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-400a92fb-e2b7-49df-b37d-e7cc5c3347ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:46.450182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-400a92fb-e2b7-49df-b37d-e7cc5c3347ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:46.450636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-400a92fb-e2b7-49df-b37d-e7cc5c3347ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:46.451395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-400a92fb-e2b7-49df-b37d-e7cc5c3347ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:46.451866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-400a92fb-e2b7-49df-b37d-e7cc5c3347ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:46.452446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-400a92fb-e2b7-49df-b37d-e7cc5c3347ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:46.609203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-400a92fb-e2b7-49df-b37d-e7cc5c3347ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:46.627317 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-400a92fb-e2b7-49df-b37d-e7cc5c3347ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1346 microversion: 2.1 time: 0.198772 Sep 06 10:58:46.638060 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 960/1953] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:46 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1346 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:46.649120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c8089f9f-2d46-44b2-b201-7b2acfd01baa tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:46.649728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c8089f9f-2d46-44b2-b201-7b2acfd01baa tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:46.663603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8089f9f-2d46-44b2-b201-7b2acfd01baa tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:46.664155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8089f9f-2d46-44b2-b201-7b2acfd01baa tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:46.664577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8089f9f-2d46-44b2-b201-7b2acfd01baa tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:46.665286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8089f9f-2d46-44b2-b201-7b2acfd01baa tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:46.665751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8089f9f-2d46-44b2-b201-7b2acfd01baa tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:46.666184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8089f9f-2d46-44b2-b201-7b2acfd01baa tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:46.997363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c8089f9f-2d46-44b2-b201-7b2acfd01baa tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:47.015203 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-92189a83-2a91-4faf-a998-0fe8e76a2191 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.779797 Sep 06 10:58:47.016508 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 994/1954] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:58:46 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:47.022769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d99e2c7b-6a3f-4fb6-bde2-cedb782b5271 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:47.023656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d99e2c7b-6a3f-4fb6-bde2-cedb782b5271 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:47.025662 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c8089f9f-2d46-44b2-b201-7b2acfd01baa tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1396 microversion: 2.1 time: 0.386397 Sep 06 10:58:47.026261 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 961/1955] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:46 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1396 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:47.039416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5678e3f8-2be3-4bd9-a0a4-c53aade03d77 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90fd181280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:47.040047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d99e2c7b-6a3f-4fb6-bde2-cedb782b5271 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:47.040754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d99e2c7b-6a3f-4fb6-bde2-cedb782b5271 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:47.041451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d99e2c7b-6a3f-4fb6-bde2-cedb782b5271 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:47.042378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d99e2c7b-6a3f-4fb6-bde2-cedb782b5271 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:47.043123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d99e2c7b-6a3f-4fb6-bde2-cedb782b5271 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:47.043894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d99e2c7b-6a3f-4fb6-bde2-cedb782b5271 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:47.179682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d99e2c7b-6a3f-4fb6-bde2-cedb782b5271 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:47.180192 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5678e3f8-2be3-4bd9-a0a4-c53aade03d77 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/5904aa0b-88c1-4fc7-8de4-0a6dee265c57" status: 200 len: 224 microversion: 2.1 time: 0.152864 Sep 06 10:58:47.180952 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 962/1956] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 10:58:47 2022] GET /compute/v2.1/os-security-groups/5904aa0b-88c1-4fc7-8de4-0a6dee265c57 => generated 224 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:47.191060 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d99e2c7b-6a3f-4fb6-bde2-cedb782b5271 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1218 microversion: 2.1 time: 0.173419 Sep 06 10:58:47.191812 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 995/1957] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:47 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1218 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:47.200378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8a99b7d9-5408-4332-b6f5-9362bbda18ce tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:47.200378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8a99b7d9-5408-4332-b6f5-9362bbda18ce tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] [instance: e343dd1a-4f3b-4da1-9396-5cdc5e1d297a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:47.209185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a99b7d9-5408-4332-b6f5-9362bbda18ce tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:47.209185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a99b7d9-5408-4332-b6f5-9362bbda18ce tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:47.209185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a99b7d9-5408-4332-b6f5-9362bbda18ce tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:47.209185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a99b7d9-5408-4332-b6f5-9362bbda18ce tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:47.209185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a99b7d9-5408-4332-b6f5-9362bbda18ce tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:47.209581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5711dd71-0809-4a57-a758-5b427b2182ab tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f8adea60>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:47.209654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a99b7d9-5408-4332-b6f5-9362bbda18ce tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:47.232636 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-8a99b7d9-5408-4332-b6f5-9362bbda18ce tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] HTTP exception thrown: Instance e343dd1a-4f3b-4da1-9396-5cdc5e1d297a could not be found. Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8a99b7d9-5408-4332-b6f5-9362bbda18ce tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Request method failure captured: Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a HTTP/1.1 Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFydFo16EeQ86qJjgP_G-3GFfdxDVSgbNV2UAGwmECR-TyeS1d8VoXm9_B8Jb5eMNXX95K1zYuJ5ZAWWZYvhakutBRAW4UeU1wvjh423gINYXRnt1MLrStLsokC7QSgGkaje27gCE80N7XtQFsZZI4rTUPhaMFwoxNnswlds2u4lKWyE Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 740286d1464549609e6d4b3280aa50ce Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-VolumesAdminNegativeTest-204909859 Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_740286d1464549609e6d4b3280aa50ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/740286d1464549609e6d4b3280aa50ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/740286d1464549609e6d4b3280aa50ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/740286d1464549609e6d4b3280aa50ce"}]}] Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-VolumesAdminNegativeTest-204909859 Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 740286d1464549609e6d4b3280aa50ce Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-204909859 Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-VolumesAdminNegativeTest-204909859-project Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6c557446cb39475dba1fc800d061b9e1 Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-VolumesAdminNegativeTest-204909859-project Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance e343dd1a-4f3b-4da1-9396-5cdc5e1d297a could not be found. Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'e343dd1a-4f3b-4da1-9396-5cdc5e1d297a'} Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e343dd1a-4f3b-4da1-9396-5cdc5e1d297a could not be found. Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e343dd1a-4f3b-4da1-9396-5cdc5e1d297a could not be found. Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:47.234771 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:47.239729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:47.239729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:47.239729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:47.239729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:58:47.239729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:58:47.239729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e343dd1a-4f3b-4da1-9396-5cdc5e1d297a could not be found. Sep 06 10:58:47.239729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:47.239729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8a99b7d9-5408-4332-b6f5-9362bbda18ce tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Returning 404 to user: Instance e343dd1a-4f3b-4da1-9396-5cdc5e1d297a could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:58:47.239729 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8a99b7d9-5408-4332-b6f5-9362bbda18ce tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a" status: 404 len: 111 microversion: 2.1 time: 0.055852 Sep 06 10:58:47.240355 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 963/1958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:47 2022] GET /compute/v2.1/servers/e343dd1a-4f3b-4da1-9396-5cdc5e1d297a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:47.254527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4fe34cff-3ea0-4bbd-84c9-236ee9cd92fe tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] Calling method '.version_select at 0x7f90fd1963a0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:47.438928 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4fe34cff-3ea0-4bbd-84c9-236ee9cd92fe tempest-VolumesAdminNegativeTest-204909859 tempest-VolumesAdminNegativeTest-204909859-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-16122590" status: 202 len: 0 microversion: 2.1 time: 0.189678 Sep 06 10:58:47.440018 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 964/1959] 10.222.0.20 () {58 vars in 1215 bytes} [Tue Sep 6 10:58:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-16122590 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 10:58:47.444928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c344cf0f-641e-4b70-9071-bbbbb123cc02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:47.445718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c344cf0f-641e-4b70-9071-bbbbb123cc02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:47.452858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c344cf0f-641e-4b70-9071-bbbbb123cc02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:47.454185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c344cf0f-641e-4b70-9071-bbbbb123cc02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:47.454844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c344cf0f-641e-4b70-9071-bbbbb123cc02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:47.455816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c344cf0f-641e-4b70-9071-bbbbb123cc02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:47.456493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c344cf0f-641e-4b70-9071-bbbbb123cc02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:47.457161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c344cf0f-641e-4b70-9071-bbbbb123cc02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:47.586036 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5711dd71-0809-4a57-a758-5b427b2182ab tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5904aa0b-88c1-4fc7-8de4-0a6dee265c57" status: 202 len: 0 microversion: 2.1 time: 0.393158 Sep 06 10:58:47.587291 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 996/1960] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:58:47 2022] DELETE /compute/v2.1/os-security-groups/5904aa0b-88c1-4fc7-8de4-0a6dee265c57 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:58:47.596286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4aa2e3a-9c9d-4a92-b2ad-3bd5b64337f3 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f88c5160>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:47.655401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-b4aa2e3a-9c9d-4a92-b2ad-3bd5b64337f3 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:58:47.656319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.security_group_api [None req-b4aa2e3a-9c9d-4a92-b2ad-3bd5b64337f3 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Neutron security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 not found {{(pid=140876) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 10:58:47.657551 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-b4aa2e3a-9c9d-4a92-b2ad-3bd5b64337f3 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:58:47.657551 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-1d9b9118-435d-4d5a-87f7-56a497c4850e'] Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4aa2e3a-9c9d-4a92-b2ad-3bd5b64337f3 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-security-groups/5904aa0b-88c1-4fc7-8de4-0a6dee265c57 HTTP/1.1 Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: exception: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-1d9b9118-435d-4d5a-87f7-56a497c4850e'] Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '5904aa0b-88c1-4fc7-8de4-0a6dee265c57'} Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:58:47.661001 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d9b9118-435d-4d5a-87f7-56a497c4850e'] Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d9b9118-435d-4d5a-87f7-56a497c4850e'] Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d9b9118-435d-4d5a-87f7-56a497c4850e'] Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d9b9118-435d-4d5a-87f7-56a497c4850e'] Sep 06 10:58:47.665360 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:47.669183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4aa2e3a-9c9d-4a92-b2ad-3bd5b64337f3 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:58:47.669183 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-1d9b9118-435d-4d5a-87f7-56a497c4850e'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:58:47.670465 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b4aa2e3a-9c9d-4a92-b2ad-3bd5b64337f3 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/5904aa0b-88c1-4fc7-8de4-0a6dee265c57" status: 404 len: 194 microversion: 2.1 time: 0.078609 Sep 06 10:58:47.671262 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 997/1961] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 10:58:47 2022] GET /compute/v2.1/os-security-groups/5904aa0b-88c1-4fc7-8de4-0a6dee265c57 => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:58:47.676188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:47.677279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:47.684748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:47.685248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:47.687596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:47.687596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:47.687596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:47.687596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:47.724513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:47.724915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:47.725356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:47.725820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lazy-loading 'fault' on Instance uuid b19d97c3-c476-487e-9dca-8b524376c2e6 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:58:48.231128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:48.234496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:48.253958 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0b4d61f7-6d56-489d-8b11-a82a6ed8a3bf tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 200 len: 1351 microversion: 2.1 time: 0.581134 Sep 06 10:58:48.256144 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 998/1962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:47 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 1351 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:48.262599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a29918ba-0e92-4a5a-91f7-c3f3cd766e06 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'create', calling method: .version_select at 0x7f90f89131f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1730985707", "description": "tempest-description-404055335"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:48.330501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c344cf0f-641e-4b70-9071-bbbbb123cc02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:48.349663 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c344cf0f-641e-4b70-9071-bbbbb123cc02 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.908271 Sep 06 10:58:48.350261 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 965/1963] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:47 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:48.369716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-277efd8c-33d4-43d8-8fc1-47de4074717f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:48.371417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-277efd8c-33d4-43d8-8fc1-47de4074717f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:48.384865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-277efd8c-33d4-43d8-8fc1-47de4074717f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:48.385457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-277efd8c-33d4-43d8-8fc1-47de4074717f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:48.386108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-277efd8c-33d4-43d8-8fc1-47de4074717f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:48.387048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-277efd8c-33d4-43d8-8fc1-47de4074717f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:48.387724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-277efd8c-33d4-43d8-8fc1-47de4074717f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:48.388511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-277efd8c-33d4-43d8-8fc1-47de4074717f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:48.691215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-277efd8c-33d4-43d8-8fc1-47de4074717f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:48.705129 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-277efd8c-33d4-43d8-8fc1-47de4074717f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1576 microversion: 2.1 time: 0.348314 Sep 06 10:58:48.709290 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 966/1964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:48 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1576 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:48.732943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b03fbce6-cbf6-42c8-b5a8-a8960ccb9127 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:48.735761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b03fbce6-cbf6-42c8-b5a8-a8960ccb9127 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:48.750848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b03fbce6-cbf6-42c8-b5a8-a8960ccb9127 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:48.751696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b03fbce6-cbf6-42c8-b5a8-a8960ccb9127 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:48.752469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b03fbce6-cbf6-42c8-b5a8-a8960ccb9127 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:48.754797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b03fbce6-cbf6-42c8-b5a8-a8960ccb9127 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:48.755578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b03fbce6-cbf6-42c8-b5a8-a8960ccb9127 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:48.757058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b03fbce6-cbf6-42c8-b5a8-a8960ccb9127 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:48.861305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b03fbce6-cbf6-42c8-b5a8-a8960ccb9127 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:48.870481 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b03fbce6-cbf6-42c8-b5a8-a8960ccb9127 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1236 microversion: 2.1 time: 0.152303 Sep 06 10:58:48.871397 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 967/1965] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:48 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1236 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:48.876452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-0cd36a90-027e-4838-bfe9-019dcfcc5b13 req-1425d315-a1b8-4fc5-bf94-4548f01f71af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19d97c3-c476-487e-9dca-8b524376c2e6", "name": "network-vif-deleted", "tag": "6b4ea1d2-d432-4b81-ae6b-7cc89648aca3"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:48.890585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0cd36a90-027e-4838-bfe9-019dcfcc5b13 req-1425d315-a1b8-4fc5-bf94-4548f01f71af service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:48.891147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0cd36a90-027e-4838-bfe9-019dcfcc5b13 req-1425d315-a1b8-4fc5-bf94-4548f01f71af service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:48.891588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0cd36a90-027e-4838-bfe9-019dcfcc5b13 req-1425d315-a1b8-4fc5-bf94-4548f01f71af service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:48.913939 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-0cd36a90-027e-4838-bfe9-019dcfcc5b13 req-1425d315-a1b8-4fc5-bf94-4548f01f71af service nova] Creating event network-vif-deleted:6b4ea1d2-d432-4b81-ae6b-7cc89648aca3 for instance b19d97c3-c476-487e-9dca-8b524376c2e6 on nch1-master-1 Sep 06 10:58:48.919399 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-0cd36a90-027e-4838-bfe9-019dcfcc5b13 req-1425d315-a1b8-4fc5-bf94-4548f01f71af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046421 Sep 06 10:58:48.920080 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 968/1966] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:48.932834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dacdcf14-6566-4499-963c-8278a2189ad1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:48.933597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dacdcf14-6566-4499-963c-8278a2189ad1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:48.941158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dacdcf14-6566-4499-963c-8278a2189ad1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:48.941684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dacdcf14-6566-4499-963c-8278a2189ad1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:48.942192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dacdcf14-6566-4499-963c-8278a2189ad1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:48.942991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dacdcf14-6566-4499-963c-8278a2189ad1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:48.943551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dacdcf14-6566-4499-963c-8278a2189ad1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:48.944129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dacdcf14-6566-4499-963c-8278a2189ad1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:49.126783 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a29918ba-0e92-4a5a-91f7-c3f3cd766e06 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.869184 Sep 06 10:58:49.127862 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 999/1967] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:58:48 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:49.142710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-78697068-6ed0-40d1-8205-7e74e1beae29 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'create', calling method: .version_select at 0x7f90f87bfca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1258369424", "description": "tempest-description-1518262185"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:49.148909 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dacdcf14-6566-4499-963c-8278a2189ad1 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227084 Sep 06 10:58:49.150473 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 969/1968] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 10:58:48 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead/os-interface => generated 284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:49.279618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9fd536cc-95c1-482c-86c4-ff569478aaee tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:49.280287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9fd536cc-95c1-482c-86c4-ff569478aaee tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:49.291256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fd536cc-95c1-482c-86c4-ff569478aaee tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:49.291771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fd536cc-95c1-482c-86c4-ff569478aaee tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:49.292239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fd536cc-95c1-482c-86c4-ff569478aaee tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:49.295572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fd536cc-95c1-482c-86c4-ff569478aaee tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:49.296064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fd536cc-95c1-482c-86c4-ff569478aaee tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:49.296511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fd536cc-95c1-482c-86c4-ff569478aaee tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:49.337388 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-9fd536cc-95c1-482c-86c4-ff569478aaee tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9fd536cc-95c1-482c-86c4-ff569478aaee tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 HTTP/1.1 Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'b19d97c3-c476-487e-9dca-8b524376c2e6'} Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:49.343086 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:49.348050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:49.348050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:49.348050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:49.348050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:58:49.348050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:58:49.348050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 10:58:49.348050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:49.348050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9fd536cc-95c1-482c-86c4-ff569478aaee tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:58:49.348050 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9fd536cc-95c1-482c-86c4-ff569478aaee tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 404 len: 111 microversion: 2.1 time: 0.069291 Sep 06 10:58:49.352507 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 970/1969] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:49 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:58:49.374439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b0498431-4781-43ab-808f-e8270703a157 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:49.376275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b0498431-4781-43ab-808f-e8270703a157 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:49.386367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0498431-4781-43ab-808f-e8270703a157 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:49.386905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0498431-4781-43ab-808f-e8270703a157 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:49.389540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0498431-4781-43ab-808f-e8270703a157 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:49.392381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0498431-4781-43ab-808f-e8270703a157 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:49.392890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0498431-4781-43ab-808f-e8270703a157 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:49.393346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0498431-4781-43ab-808f-e8270703a157 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:49.456313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:49.968836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b0498431-4781-43ab-808f-e8270703a157 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:49.981574 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b0498431-4781-43ab-808f-e8270703a157 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.609549 Sep 06 10:58:49.981574 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 971/1970] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:49 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:49.992651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6f9fc6d7-ad63-43ce-9610-7ea1b90550d4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:49.997152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6f9fc6d7-ad63-43ce-9610-7ea1b90550d4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:50.009137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f9fc6d7-ad63-43ce-9610-7ea1b90550d4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:50.009858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f9fc6d7-ad63-43ce-9610-7ea1b90550d4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:50.011416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f9fc6d7-ad63-43ce-9610-7ea1b90550d4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:50.011534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f9fc6d7-ad63-43ce-9610-7ea1b90550d4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:50.012042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f9fc6d7-ad63-43ce-9610-7ea1b90550d4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:50.013279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f9fc6d7-ad63-43ce-9610-7ea1b90550d4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:50.028529 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-6f9fc6d7-ad63-43ce-9610-7ea1b90550d4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6f9fc6d7-ad63-43ce-9610-7ea1b90550d4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6/os-volume_attachments HTTP/1.1 Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'server_id': 'b19d97c3-c476-487e-9dca-8b524376c2e6'} Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:58:50.030848 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6f9fc6d7-ad63-43ce-9610-7ea1b90550d4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6f9fc6d7-ad63-43ce-9610-7ea1b90550d4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047874 Sep 06 10:58:50.043147 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 972/1971] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 10:58:49 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:50.048403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ce10742e-6dd1-4381-91b7-447a0fb80eff tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:50.049051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ce10742e-6dd1-4381-91b7-447a0fb80eff tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:50.070064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce10742e-6dd1-4381-91b7-447a0fb80eff tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:50.070064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce10742e-6dd1-4381-91b7-447a0fb80eff tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:50.070064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce10742e-6dd1-4381-91b7-447a0fb80eff tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:50.070064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce10742e-6dd1-4381-91b7-447a0fb80eff tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:50.070064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce10742e-6dd1-4381-91b7-447a0fb80eff tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:50.070064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce10742e-6dd1-4381-91b7-447a0fb80eff tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:50.239253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ce10742e-6dd1-4381-91b7-447a0fb80eff tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:50.249443 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ce10742e-6dd1-4381-91b7-447a0fb80eff tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1236 microversion: 2.1 time: 0.213436 Sep 06 10:58:50.251917 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 973/1972] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:50 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1236 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:50.292744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-586559848", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "9312fcea-ff98-4f9b-847c-17d6e7290268"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:50.367959 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-78697068-6ed0-40d1-8205-7e74e1beae29 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.231007 Sep 06 10:58:50.369653 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1000/1973] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:58:49 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:58:50.383252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d8c0f4c4-308c-49ee-a43d-49ea5a2b1f1d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'create', calling method: .version_select at 0x7f90f8641e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-145540614", "description": "tempest-description-1987489046"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:50.389732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] validate_networks() for [('9312fcea-ff98-4f9b-847c-17d6e7290268', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:58:51.717672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:58:51.721515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:58:51.730661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:58:51.731557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:58:51.734138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:58:51.763189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:51.764130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:51.764821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:51.765819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:51.766829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:51.767950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:51.782203 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d8c0f4c4-308c-49ee-a43d-49ea5a2b1f1d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.402982 Sep 06 10:58:51.783856 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1001/1974] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:58:50 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:51.789743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-30aba40f-af37-4e04-9a68-1233e8525954 req-1b2082bc-fdde-42f5-831c-0f981e85e2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4e34be-e53e-434b-a851-3c78589a82c3", "name": "network-vif-unplugged", "status": "completed", "tag": "c5e685a6-87c9-4534-a2e6-8b53a3ce0b8b"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:51.805606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:58:51.809247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-30aba40f-af37-4e04-9a68-1233e8525954 req-1b2082bc-fdde-42f5-831c-0f981e85e2b7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:51.809807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-30aba40f-af37-4e04-9a68-1233e8525954 req-1b2082bc-fdde-42f5-831c-0f981e85e2b7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:51.810254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-30aba40f-af37-4e04-9a68-1233e8525954 req-1b2082bc-fdde-42f5-831c-0f981e85e2b7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:51.817606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for user e19903666a1243e3a66411e30babe299 and project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:58:51.843497 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-30aba40f-af37-4e04-9a68-1233e8525954 req-1b2082bc-fdde-42f5-831c-0f981e85e2b7 service nova] Creating event network-vif-unplugged:c5e685a6-87c9-4534-a2e6-8b53a3ce0b8b for instance ca4e34be-e53e-434b-a851-3c78589a82c3 on nch2-master-1 Sep 06 10:58:51.845172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:58:51.850637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: a1fd2e45-af36-4f43-be98-83ef902b0372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:58:51.860689 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-30aba40f-af37-4e04-9a68-1233e8525954 req-1b2082bc-fdde-42f5-831c-0f981e85e2b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075236 Sep 06 10:58:51.861317 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1002/1975] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:51.878427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-051f6d58-f77f-4498-b51c-1b6975bbd49a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:51.881947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-051f6d58-f77f-4498-b51c-1b6975bbd49a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:51.902003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-051f6d58-f77f-4498-b51c-1b6975bbd49a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:51.902505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-051f6d58-f77f-4498-b51c-1b6975bbd49a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:51.903535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-051f6d58-f77f-4498-b51c-1b6975bbd49a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:51.907277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-051f6d58-f77f-4498-b51c-1b6975bbd49a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:51.907988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-051f6d58-f77f-4498-b51c-1b6975bbd49a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:51.909084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-051f6d58-f77f-4498-b51c-1b6975bbd49a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:52.074766 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c094944-873c-4c10-a09e-d3ea342dcb97 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.786423 Sep 06 10:58:52.076875 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 974/1976] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:58:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 10:58:52.097721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9e81f65a-2ee1-4773-a6ae-a52ba886cb31 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:52.098902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9e81f65a-2ee1-4773-a6ae-a52ba886cb31 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:52.121931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e81f65a-2ee1-4773-a6ae-a52ba886cb31 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:52.122686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e81f65a-2ee1-4773-a6ae-a52ba886cb31 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:52.123465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e81f65a-2ee1-4773-a6ae-a52ba886cb31 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:52.124659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e81f65a-2ee1-4773-a6ae-a52ba886cb31 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:52.125368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e81f65a-2ee1-4773-a6ae-a52ba886cb31 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:52.127245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e81f65a-2ee1-4773-a6ae-a52ba886cb31 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:52.842840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-051f6d58-f77f-4498-b51c-1b6975bbd49a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:52.857132 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-051f6d58-f77f-4498-b51c-1b6975bbd49a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.994579 Sep 06 10:58:52.858075 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1003/1977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:51 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:52.877325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-078b7d85-7430-4798-9164-0effcf92fcdb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f8913dc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:52.879737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9e81f65a-2ee1-4773-a6ae-a52ba886cb31 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:52.889839 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9e81f65a-2ee1-4773-a6ae-a52ba886cb31 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1292 microversion: 2.1 time: 0.811551 Sep 06 10:58:52.897034 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 975/1978] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:52 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1292 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:52.902739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7ba77828-b1dc-4dd2-80ce-1941f72d6c0d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:52.907900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7ba77828-b1dc-4dd2-80ce-1941f72d6c0d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: a1fd2e45-af36-4f43-be98-83ef902b0372] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:53.066804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:53.093710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7ba77828-b1dc-4dd2-80ce-1941f72d6c0d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:53.102036 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7ba77828-b1dc-4dd2-80ce-1941f72d6c0d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/a1fd2e45-af36-4f43-be98-83ef902b0372" status: 200 len: 1214 microversion: 2.1 time: 0.203438 Sep 06 10:58:53.111144 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 976/1979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:52 2022] GET /compute/v2.1/servers/a1fd2e45-af36-4f43-be98-83ef902b0372 => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:53.116335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d5d953a3-5480-472f-b6ac-400bae6d2159 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:53.116971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d5d953a3-5480-472f-b6ac-400bae6d2159 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:53.126739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5d953a3-5480-472f-b6ac-400bae6d2159 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:53.127302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5d953a3-5480-472f-b6ac-400bae6d2159 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:53.127717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5d953a3-5480-472f-b6ac-400bae6d2159 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:53.140142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5d953a3-5480-472f-b6ac-400bae6d2159 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:53.140839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5d953a3-5480-472f-b6ac-400bae6d2159 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:53.141359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5d953a3-5480-472f-b6ac-400bae6d2159 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:53.652056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d5d953a3-5480-472f-b6ac-400bae6d2159 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:53.659192 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d5d953a3-5480-472f-b6ac-400bae6d2159 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1576 microversion: 2.1 time: 0.546730 Sep 06 10:58:53.660756 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 977/1980] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:53 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1576 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:53.670517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:53.673772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: a1fd2e45-af36-4f43-be98-83ef902b0372] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:53.690280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:53.691132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:53.691774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:53.692695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:53.693322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:53.693919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:53.745739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: a1fd2e45-af36-4f43-be98-83ef902b0372] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:58:53.764565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:53.776690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:53.779367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:53.807269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lazy-loading 'flavor' on Instance uuid a1fd2e45-af36-4f43-be98-83ef902b0372 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:58:53.827305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lazy-loading 'system_metadata' on Instance uuid a1fd2e45-af36-4f43-be98-83ef902b0372 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:58:53.965219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lazy-loading 'metadata' on Instance uuid a1fd2e45-af36-4f43-be98-83ef902b0372 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:58:54.048656 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-078b7d85-7430-4798-9164-0effcf92fcdb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 1.189286 Sep 06 10:58:54.060164 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1004/1981] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:58:52 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:54.069543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f3aaef7-8a2d-4679-9d0e-98440927fc65 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:54.071071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1f3aaef7-8a2d-4679-9d0e-98440927fc65 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:54.082117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f3aaef7-8a2d-4679-9d0e-98440927fc65 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:54.083109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f3aaef7-8a2d-4679-9d0e-98440927fc65 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:54.100094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f3aaef7-8a2d-4679-9d0e-98440927fc65 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:54.104802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f3aaef7-8a2d-4679-9d0e-98440927fc65 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:54.105474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f3aaef7-8a2d-4679-9d0e-98440927fc65 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:54.107932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f3aaef7-8a2d-4679-9d0e-98440927fc65 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:54.153849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1f3aaef7-8a2d-4679-9d0e-98440927fc65 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:58:54.701812 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1f3aaef7-8a2d-4679-9d0e-98440927fc65 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 204 len: 0 microversion: 2.25 time: 0.640020 Sep 06 10:58:54.704531 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1005/1982] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 10:58:54 2022] DELETE /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 10:58:54.709721 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.scheduler.client.report [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Deleted allocations for instance a1fd2e45-af36-4f43-be98-83ef902b0372 Sep 06 10:58:54.711917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b0bc4f3b-2f4b-4418-b37b-10cdfee019ee tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:54.712647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b0bc4f3b-2f4b-4418-b37b-10cdfee019ee tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:54.727735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0bc4f3b-2f4b-4418-b37b-10cdfee019ee tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:54.728255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0bc4f3b-2f4b-4418-b37b-10cdfee019ee tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:54.728708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0bc4f3b-2f4b-4418-b37b-10cdfee019ee tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:54.732703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0bc4f3b-2f4b-4418-b37b-10cdfee019ee tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:54.733439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0bc4f3b-2f4b-4418-b37b-10cdfee019ee tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:54.734190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0bc4f3b-2f4b-4418-b37b-10cdfee019ee tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:54.837902 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a569bfb0-e690-40cc-ad38-75fe5a23a2ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1fd2e45-af36-4f43-be98-83ef902b0372" status: 204 len: 0 microversion: 2.1 time: 1.175922 Sep 06 10:58:54.838712 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 978/1983] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:58:53 2022] DELETE /compute/v2.1/servers/a1fd2e45-af36-4f43-be98-83ef902b0372 => generated 0 bytes in 1177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:58:54.848193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-07a7c416-a06b-4e70-a0e2-fe0c430689a5 req-782f92c9-892b-4ada-a0eb-61a5c3e20ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58328e0b-391a-4721-b3e4-2b5c2bbaeead", "tag": "3603966b-8262-417f-b816-460a496f2d31"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:54.876226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-07a7c416-a06b-4e70-a0e2-fe0c430689a5 req-782f92c9-892b-4ada-a0eb-61a5c3e20ef7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:54.877322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-07a7c416-a06b-4e70-a0e2-fe0c430689a5 req-782f92c9-892b-4ada-a0eb-61a5c3e20ef7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:54.884647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-07a7c416-a06b-4e70-a0e2-fe0c430689a5 req-782f92c9-892b-4ada-a0eb-61a5c3e20ef7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:54.925494 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-07a7c416-a06b-4e70-a0e2-fe0c430689a5 req-782f92c9-892b-4ada-a0eb-61a5c3e20ef7 service nova] Creating event network-changed:3603966b-8262-417f-b816-460a496f2d31 for instance 58328e0b-391a-4721-b3e4-2b5c2bbaeead on nch1-master-1 Sep 06 10:58:54.940277 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-07a7c416-a06b-4e70-a0e2-fe0c430689a5 req-782f92c9-892b-4ada-a0eb-61a5c3e20ef7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091091 Sep 06 10:58:54.941511 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 979/1984] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:54.946968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cc6b12ba-c82a-43c0-9bfc-ca66e254e206 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:54.952739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cc6b12ba-c82a-43c0-9bfc-ca66e254e206 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:54.972710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc6b12ba-c82a-43c0-9bfc-ca66e254e206 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:54.972710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc6b12ba-c82a-43c0-9bfc-ca66e254e206 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:54.972710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc6b12ba-c82a-43c0-9bfc-ca66e254e206 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:54.972710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc6b12ba-c82a-43c0-9bfc-ca66e254e206 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:54.972710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc6b12ba-c82a-43c0-9bfc-ca66e254e206 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:54.975083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc6b12ba-c82a-43c0-9bfc-ca66e254e206 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:55.402623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b0bc4f3b-2f4b-4418-b37b-10cdfee019ee tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:55.412505 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b0bc4f3b-2f4b-4418-b37b-10cdfee019ee tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.706721 Sep 06 10:58:55.413103 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1006/1985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:54 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:55.418051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5fc31f70-b680-47c8-ac20-cb4340dae5fb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f848bdc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:55.510741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cc6b12ba-c82a-43c0-9bfc-ca66e254e206 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:55.519851 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cc6b12ba-c82a-43c0-9bfc-ca66e254e206 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1292 microversion: 2.1 time: 0.576891 Sep 06 10:58:55.520783 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 980/1986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:54 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1292 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:55.540242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:55.544395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0dd08e2b-b4c3-425e-a320-083a30ae8a06 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:55.545168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0dd08e2b-b4c3-425e-a320-083a30ae8a06 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:55.552624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dd08e2b-b4c3-425e-a320-083a30ae8a06 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:55.553229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dd08e2b-b4c3-425e-a320-083a30ae8a06 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:55.554547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dd08e2b-b4c3-425e-a320-083a30ae8a06 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:55.555992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dd08e2b-b4c3-425e-a320-083a30ae8a06 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:55.555992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dd08e2b-b4c3-425e-a320-083a30ae8a06 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:55.556692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dd08e2b-b4c3-425e-a320-083a30ae8a06 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:55.969352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0dd08e2b-b4c3-425e-a320-083a30ae8a06 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:55.980643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0dd08e2b-b4c3-425e-a320-083a30ae8a06 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:55.983260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0dd08e2b-b4c3-425e-a320-083a30ae8a06 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:55.985665 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0dd08e2b-b4c3-425e-a320-083a30ae8a06 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1732 microversion: 2.25 time: 0.450658 Sep 06 10:58:55.986723 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 981/1987] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:55 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1732 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:55.992428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60b8dc66-d79f-435b-80a5-57dd3ea59104 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:55.993444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-60b8dc66-d79f-435b-80a5-57dd3ea59104 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: a1fd2e45-af36-4f43-be98-83ef902b0372] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:56.001578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b8dc66-d79f-435b-80a5-57dd3ea59104 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:56.002336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b8dc66-d79f-435b-80a5-57dd3ea59104 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:56.004182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b8dc66-d79f-435b-80a5-57dd3ea59104 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:56.005204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b8dc66-d79f-435b-80a5-57dd3ea59104 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:56.005859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b8dc66-d79f-435b-80a5-57dd3ea59104 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:56.006784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60b8dc66-d79f-435b-80a5-57dd3ea59104 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:56.022321 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-60b8dc66-d79f-435b-80a5-57dd3ea59104 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60b8dc66-d79f-435b-80a5-57dd3ea59104 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/a1fd2e45-af36-4f43-be98-83ef902b0372 HTTP/1.1 Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'a1fd2e45-af36-4f43-be98-83ef902b0372'} Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:56.024177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:56.027786 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:56.027786 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:56.027786 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:56.027786 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:58:56.027786 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:58:56.027786 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 10:58:56.027786 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:56.029773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60b8dc66-d79f-435b-80a5-57dd3ea59104 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:58:56.031947 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-60b8dc66-d79f-435b-80a5-57dd3ea59104 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/a1fd2e45-af36-4f43-be98-83ef902b0372" status: 404 len: 111 microversion: 2.1 time: 0.042927 Sep 06 10:58:56.034048 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 982/1988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:55 2022] GET /compute/v2.1/servers/a1fd2e45-af36-4f43-be98-83ef902b0372 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:56.145317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1603828350", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "9312fcea-ff98-4f9b-847c-17d6e7290268"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:56.234203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] validate_networks() for [('9312fcea-ff98-4f9b-847c-17d6e7290268', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:58:56.310474 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5fc31f70-b680-47c8-ac20-cb4340dae5fb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f08b8b12-68d1-4f06-9c9a-3ec51c4f2161" status: 202 len: 0 microversion: 2.1 time: 0.896037 Sep 06 10:58:56.311101 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1007/1989] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:58:55 2022] DELETE /compute/v2.1/os-security-groups/f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 => generated 0 bytes in 897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:58:56.323299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3b1afb57-261e-45d1-9621-cf0d707aa080 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f89fb940>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:56.508738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-3b1afb57-261e-45d1-9621-cf0d707aa080 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:58:56.510400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.security_group_api [None req-3b1afb57-261e-45d1-9621-cf0d707aa080 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Neutron security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 not found {{(pid=140876) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 10:58:56.512697 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-3b1afb57-261e-45d1-9621-cf0d707aa080 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:58:56.512697 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-89e85369-e111-44fe-b209-fa34d5abaa95'] Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3b1afb57-261e-45d1-9621-cf0d707aa080 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-security-groups/f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 HTTP/1.1 Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: exception: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-89e85369-e111-44fe-b209-fa34d5abaa95'] Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'f08b8b12-68d1-4f06-9c9a-3ec51c4f2161'} Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:58:56.515966 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89e85369-e111-44fe-b209-fa34d5abaa95'] Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89e85369-e111-44fe-b209-fa34d5abaa95'] Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89e85369-e111-44fe-b209-fa34d5abaa95'] Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89e85369-e111-44fe-b209-fa34d5abaa95'] Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3b1afb57-261e-45d1-9621-cf0d707aa080 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-89e85369-e111-44fe-b209-fa34d5abaa95'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3b1afb57-261e-45d1-9621-cf0d707aa080 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/f08b8b12-68d1-4f06-9c9a-3ec51c4f2161" status: 404 len: 194 microversion: 2.1 time: 0.200408 Sep 06 10:58:56.524683 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1008/1990] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 10:58:56 2022] GET /compute/v2.1/os-security-groups/f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 => generated 194 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:56.534671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-47793660-3a23-4202-b7b2-c45144c3bd05 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:56.535692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-47793660-3a23-4202-b7b2-c45144c3bd05 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:56.544587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47793660-3a23-4202-b7b2-c45144c3bd05 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:56.546148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47793660-3a23-4202-b7b2-c45144c3bd05 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:56.547769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47793660-3a23-4202-b7b2-c45144c3bd05 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:56.548695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47793660-3a23-4202-b7b2-c45144c3bd05 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:56.550509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47793660-3a23-4202-b7b2-c45144c3bd05 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:56.551331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47793660-3a23-4202-b7b2-c45144c3bd05 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:57.439046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-47793660-3a23-4202-b7b2-c45144c3bd05 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:57.467793 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-47793660-3a23-4202-b7b2-c45144c3bd05 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.948485 Sep 06 10:58:57.482263 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1009/1991] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:56 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:57.488710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-af59a0ff-85ad-4b9f-8e0b-7cc9ab5a9b07 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f8afd310>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:57.838317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:58:57.838787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:58:57.839332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:58:57.839760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:58:57.840485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:58:57.861303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:57.861812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:57.862257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:57.863099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:57.863606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:57.864152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:57.891927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:58:57.899342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:57.900560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for user e19903666a1243e3a66411e30babe299 and project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:58:57.922655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:58:57.925182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:58:58.052225 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-af59a0ff-85ad-4b9f-8e0b-7cc9ab5a9b07 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f4416d2a-d4a3-4497-9758-4e00d1d73573" status: 202 len: 0 microversion: 2.1 time: 0.567640 Sep 06 10:58:58.056306 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1010/1992] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:58:57 2022] DELETE /compute/v2.1/os-security-groups/f4416d2a-d4a3-4497-9758-4e00d1d73573 => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:58:58.062451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a61f6156-5ab5-442d-bf98-350c24c8cfd6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:58.063741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a61f6156-5ab5-442d-bf98-350c24c8cfd6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:58.074051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a61f6156-5ab5-442d-bf98-350c24c8cfd6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:58.074975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a61f6156-5ab5-442d-bf98-350c24c8cfd6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:58.075521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a61f6156-5ab5-442d-bf98-350c24c8cfd6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:58.076322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a61f6156-5ab5-442d-bf98-350c24c8cfd6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:58.076846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a61f6156-5ab5-442d-bf98-350c24c8cfd6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:58.077349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a61f6156-5ab5-442d-bf98-350c24c8cfd6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:58.092605 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8200d833-2e63-4b34-a9ad-1c1794d58609 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.952849 Sep 06 10:58:58.099578 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 983/1993] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:58:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:58:58.109008 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d8ae681c-4e5e-4d81-9239-e5ffe975878c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:58.110746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d8ae681c-4e5e-4d81-9239-e5ffe975878c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:58.124262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8ae681c-4e5e-4d81-9239-e5ffe975878c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:58.126529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8ae681c-4e5e-4d81-9239-e5ffe975878c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:58.127096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8ae681c-4e5e-4d81-9239-e5ffe975878c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:58.127900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8ae681c-4e5e-4d81-9239-e5ffe975878c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:58.128941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8ae681c-4e5e-4d81-9239-e5ffe975878c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:58.129116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8ae681c-4e5e-4d81-9239-e5ffe975878c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:58.258798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d8ae681c-4e5e-4d81-9239-e5ffe975878c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:58.274524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d8ae681c-4e5e-4d81-9239-e5ffe975878c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:58.276251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d8ae681c-4e5e-4d81-9239-e5ffe975878c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:58.280072 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d8ae681c-4e5e-4d81-9239-e5ffe975878c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1665 microversion: 2.25 time: 0.179006 Sep 06 10:58:58.282066 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 984/1994] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:58 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1665 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:58:58.298613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a776fac3-7f3b-4a9e-ae75-d58f1f6c8811 req-e1f4dbb0-8da6-43b9-a836-0263214a8923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4e34be-e53e-434b-a851-3c78589a82c3", "tag": "c5e685a6-87c9-4534-a2e6-8b53a3ce0b8b"}, {"name": "network-changed", "server_uuid": "98c16b23-fea9-48c2-a5e0-ad2f3af9f743", "tag": "d6f21549-bb52-41f9-ba87-a7a0452169a3"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:58:58.333741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a776fac3-7f3b-4a9e-ae75-d58f1f6c8811 req-e1f4dbb0-8da6-43b9-a836-0263214a8923 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:58.334740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a776fac3-7f3b-4a9e-ae75-d58f1f6c8811 req-e1f4dbb0-8da6-43b9-a836-0263214a8923 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:58.339275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a776fac3-7f3b-4a9e-ae75-d58f1f6c8811 req-e1f4dbb0-8da6-43b9-a836-0263214a8923 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:58.367040 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a776fac3-7f3b-4a9e-ae75-d58f1f6c8811 req-e1f4dbb0-8da6-43b9-a836-0263214a8923 service nova] Creating event network-changed:c5e685a6-87c9-4534-a2e6-8b53a3ce0b8b for instance ca4e34be-e53e-434b-a851-3c78589a82c3 on nch2-master-1 Sep 06 10:58:58.368231 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a776fac3-7f3b-4a9e-ae75-d58f1f6c8811 req-e1f4dbb0-8da6-43b9-a836-0263214a8923 service nova] Creating event network-changed:d6f21549-bb52-41f9-ba87-a7a0452169a3 for instance 98c16b23-fea9-48c2-a5e0-ad2f3af9f743 on nch2-master-1 Sep 06 10:58:58.376921 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a776fac3-7f3b-4a9e-ae75-d58f1f6c8811 req-e1f4dbb0-8da6-43b9-a836-0263214a8923 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.092014 Sep 06 10:58:58.379634 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 985/1995] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:58:58.396711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c6e0e64-8bba-49cc-bba6-44578d299101 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f3e3c790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:58.452938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG neutronclient.v2_0.client [None req-1c6e0e64-8bba-49cc-bba6-44578d299101 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist", "detail": ""}} {{(pid=140875) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:58:58.454190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.security_group_api [None req-1c6e0e64-8bba-49cc-bba6-44578d299101 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Neutron security group f4416d2a-d4a3-4497-9758-4e00d1d73573 not found {{(pid=140875) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 10:58:58.454891 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-1c6e0e64-8bba-49cc-bba6-44578d299101 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:58:58.454891 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-ffc78088-82d9-4676-810a-a1536a545ef4'] Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c6e0e64-8bba-49cc-bba6-44578d299101 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-security-groups/f4416d2a-d4a3-4497-9758-4e00d1d73573 HTTP/1.1 Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: exception: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-ffc78088-82d9-4676-810a-a1536a545ef4'] Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'f4416d2a-d4a3-4497-9758-4e00d1d73573'} Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:58:58.471683 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ffc78088-82d9-4676-810a-a1536a545ef4'] Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ffc78088-82d9-4676-810a-a1536a545ef4'] Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ffc78088-82d9-4676-810a-a1536a545ef4'] Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ffc78088-82d9-4676-810a-a1536a545ef4'] Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c6e0e64-8bba-49cc-bba6-44578d299101 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:58:58.476069 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-ffc78088-82d9-4676-810a-a1536a545ef4'] {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:58:58.496032 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1c6e0e64-8bba-49cc-bba6-44578d299101 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/f4416d2a-d4a3-4497-9758-4e00d1d73573" status: 404 len: 194 microversion: 2.1 time: 0.108929 Sep 06 10:58:58.502278 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 986/1996] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 10:58:58 2022] GET /compute/v2.1/os-security-groups/f4416d2a-d4a3-4497-9758-4e00d1d73573 => generated 194 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:58.520181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a61f6156-5ab5-442d-bf98-350c24c8cfd6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:58.528468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-09169c02-47c9-4551-b09d-1cff28674a60 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:58.530621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-09169c02-47c9-4551-b09d-1cff28674a60 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:58.561922 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a61f6156-5ab5-442d-bf98-350c24c8cfd6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1292 microversion: 2.1 time: 0.507140 Sep 06 10:58:58.565231 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1011/1997] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:58 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1292 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:58.583666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-48b32a9f-9431-44d0-8b07-96fd7a4d784d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:58.584381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-48b32a9f-9431-44d0-8b07-96fd7a4d784d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:58.606040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48b32a9f-9431-44d0-8b07-96fd7a4d784d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:58.606575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48b32a9f-9431-44d0-8b07-96fd7a4d784d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:58.610948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48b32a9f-9431-44d0-8b07-96fd7a4d784d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:58.612041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48b32a9f-9431-44d0-8b07-96fd7a4d784d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:58.613499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48b32a9f-9431-44d0-8b07-96fd7a4d784d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:58.614154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48b32a9f-9431-44d0-8b07-96fd7a4d784d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:58.804049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-09169c02-47c9-4551-b09d-1cff28674a60 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:58.815434 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-09169c02-47c9-4551-b09d-1cff28674a60 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1215 microversion: 2.1 time: 0.306624 Sep 06 10:58:58.817060 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 987/1998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:58 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1215 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:58.824096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0acc0e90-8ad3-4076-9ba1-04f89b179448 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f3e3c1f0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:59.137281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-48b32a9f-9431-44d0-8b07-96fd7a4d784d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:59.156194 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-48b32a9f-9431-44d0-8b07-96fd7a4d784d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.587292 Sep 06 10:58:59.161257 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1012/1999] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:58 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:58:59.310404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e0494f14-d8fc-4be5-be54-170b786f32af tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:59.311156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e0494f14-d8fc-4be5-be54-170b786f32af tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:59.317968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0494f14-d8fc-4be5-be54-170b786f32af tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:59.318468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0494f14-d8fc-4be5-be54-170b786f32af tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:59.318915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0494f14-d8fc-4be5-be54-170b786f32af tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:59.319796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0494f14-d8fc-4be5-be54-170b786f32af tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:59.320261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0494f14-d8fc-4be5-be54-170b786f32af tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:59.320998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0494f14-d8fc-4be5-be54-170b786f32af tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:59.393527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e0494f14-d8fc-4be5-be54-170b786f32af tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:59.403288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e0494f14-d8fc-4be5-be54-170b786f32af tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:59.404781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e0494f14-d8fc-4be5-be54-170b786f32af tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:58:59.406039 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e0494f14-d8fc-4be5-be54-170b786f32af tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1665 microversion: 2.25 time: 0.100161 Sep 06 10:58:59.407879 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1013/2000] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:58:59 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1665 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 10:58:59.444199 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0acc0e90-8ad3-4076-9ba1-04f89b179448 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/17c010fb-53b6-4081-a08d-73cfdbc27249" status: 202 len: 0 microversion: 2.1 time: 0.625630 Sep 06 10:58:59.447129 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 988/2001] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:58:58 2022] DELETE /compute/v2.1/os-security-groups/17c010fb-53b6-4081-a08d-73cfdbc27249 => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:58:59.456229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-14237e23-ae17-4e43-b83f-8f1546bebda7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f8593790>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:59.514147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-14237e23-ae17-4e43-b83f-8f1546bebda7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:58:59.514765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.security_group_api [None req-14237e23-ae17-4e43-b83f-8f1546bebda7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Neutron security group 17c010fb-53b6-4081-a08d-73cfdbc27249 not found {{(pid=140876) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 10:58:59.515373 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-14237e23-ae17-4e43-b83f-8f1546bebda7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:58:59.515373 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-35e261cf-93e6-4c62-9ed3-355fe4ff0939'] Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-14237e23-ae17-4e43-b83f-8f1546bebda7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-security-groups/17c010fb-53b6-4081-a08d-73cfdbc27249 HTTP/1.1 Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: exception: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-35e261cf-93e6-4c62-9ed3-355fe4ff0939'] Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '17c010fb-53b6-4081-a08d-73cfdbc27249'} Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:58:59.517824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35e261cf-93e6-4c62-9ed3-355fe4ff0939'] Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35e261cf-93e6-4c62-9ed3-355fe4ff0939'] Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35e261cf-93e6-4c62-9ed3-355fe4ff0939'] Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35e261cf-93e6-4c62-9ed3-355fe4ff0939'] Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-14237e23-ae17-4e43-b83f-8f1546bebda7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-35e261cf-93e6-4c62-9ed3-355fe4ff0939'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-14237e23-ae17-4e43-b83f-8f1546bebda7 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/17c010fb-53b6-4081-a08d-73cfdbc27249" status: 404 len: 194 microversion: 2.1 time: 0.067995 Sep 06 10:58:59.521854 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1014/2002] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 10:58:59 2022] GET /compute/v2.1/os-security-groups/17c010fb-53b6-4081-a08d-73cfdbc27249 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:59.532580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3570256c-6bca-457e-9056-a595159c3bf8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f3e3c8b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:59.591779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7ffc7847-978a-4666-8c32-7ff85fff5daf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:58:59.592714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7ffc7847-978a-4666-8c32-7ff85fff5daf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:58:59.608020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ffc7847-978a-4666-8c32-7ff85fff5daf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:59.610732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ffc7847-978a-4666-8c32-7ff85fff5daf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:59.612608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ffc7847-978a-4666-8c32-7ff85fff5daf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:58:59.618414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ffc7847-978a-4666-8c32-7ff85fff5daf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:58:59.618414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ffc7847-978a-4666-8c32-7ff85fff5daf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:58:59.618414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ffc7847-978a-4666-8c32-7ff85fff5daf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:00.279968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7ffc7847-978a-4666-8c32-7ff85fff5daf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:00.280683 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3570256c-6bca-457e-9056-a595159c3bf8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.742605 Sep 06 10:59:00.280683 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 989/2003] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:58:59 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:00.280683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-121b3209-b4cf-4946-869c-4e1355e0cb55 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:00.280683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-121b3209-b4cf-4946-869c-4e1355e0cb55 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:00.291473 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7ffc7847-978a-4666-8c32-7ff85fff5daf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1292 microversion: 2.1 time: 0.706023 Sep 06 10:59:00.292011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-121b3209-b4cf-4946-869c-4e1355e0cb55 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:00.292537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-121b3209-b4cf-4946-869c-4e1355e0cb55 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:00.292975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-121b3209-b4cf-4946-869c-4e1355e0cb55 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:00.293704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-121b3209-b4cf-4946-869c-4e1355e0cb55 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:00.294389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-121b3209-b4cf-4946-869c-4e1355e0cb55 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:00.295068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-121b3209-b4cf-4946-869c-4e1355e0cb55 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:00.300237 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1015/2004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:58:59 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1292 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:00.316552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3d9b6b4b-c59a-4625-b54c-af8cd02b4d6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:00.317612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3d9b6b4b-c59a-4625-b54c-af8cd02b4d6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:00.326963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d9b6b4b-c59a-4625-b54c-af8cd02b4d6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:00.328765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d9b6b4b-c59a-4625-b54c-af8cd02b4d6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:00.328765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d9b6b4b-c59a-4625-b54c-af8cd02b4d6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:00.329487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d9b6b4b-c59a-4625-b54c-af8cd02b4d6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:00.329964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d9b6b4b-c59a-4625-b54c-af8cd02b4d6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:00.331374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d9b6b4b-c59a-4625-b54c-af8cd02b4d6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:00.492288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-121b3209-b4cf-4946-869c-4e1355e0cb55 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:00.502662 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-121b3209-b4cf-4946-869c-4e1355e0cb55 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1211 microversion: 2.1 time: 0.231448 Sep 06 10:59:00.503940 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 990/2005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:00 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1211 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:00.509425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a5daf95a-4ff2-481a-a6b6-f19486c0f875 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'create', calling method: .version_select at 0x7f90f3dbcdc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1940714931", "description": "tempest-description-530758585"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:00.849475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3d9b6b4b-c59a-4625-b54c-af8cd02b4d6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:00.858552 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3d9b6b4b-c59a-4625-b54c-af8cd02b4d6f tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.557213 Sep 06 10:59:00.859178 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1016/2006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:00 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:00.900255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:00.902068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:00.916674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:00.922498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:00.929197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:00.929197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:00.929197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:00.929197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:01.021867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:01.022418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:01.022782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:01.027202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lazy-loading 'fault' on Instance uuid 31a4ea2a-aa16-4e41-af83-b027dfe81828 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:59:01.122039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:01.131495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:01.134270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:01.135629 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-29a6969a-db39-495f-9536-e42d68ac178a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 200 len: 1376 microversion: 2.25 time: 0.256097 Sep 06 10:59:01.151517 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1017/2007] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:59:00 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 1376 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:59:01.157781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-031242f1-85a1-4d10-9200-4378878dd9b5 req-8db21a11-b791-4061-b9cb-ec28d5b201cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a4ea2a-aa16-4e41-af83-b027dfe81828", "name": "network-vif-deleted", "tag": "9fd60b84-0b14-41da-8bad-24a891e8dd1d"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:01.173691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-031242f1-85a1-4d10-9200-4378878dd9b5 req-8db21a11-b791-4061-b9cb-ec28d5b201cd service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:01.173691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-031242f1-85a1-4d10-9200-4378878dd9b5 req-8db21a11-b791-4061-b9cb-ec28d5b201cd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:01.173691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-031242f1-85a1-4d10-9200-4378878dd9b5 req-8db21a11-b791-4061-b9cb-ec28d5b201cd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:01.185854 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-031242f1-85a1-4d10-9200-4378878dd9b5 req-8db21a11-b791-4061-b9cb-ec28d5b201cd service nova] Creating event network-vif-deleted:9fd60b84-0b14-41da-8bad-24a891e8dd1d for instance 31a4ea2a-aa16-4e41-af83-b027dfe81828 on nch2-master-1 Sep 06 10:59:01.191653 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-031242f1-85a1-4d10-9200-4378878dd9b5 req-8db21a11-b791-4061-b9cb-ec28d5b201cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038940 Sep 06 10:59:01.192264 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1018/2008] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:01.325400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0dbdc134-b767-499b-9af5-026e92f58093 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:01.326987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0dbdc134-b767-499b-9af5-026e92f58093 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:01.333803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dbdc134-b767-499b-9af5-026e92f58093 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:01.334618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dbdc134-b767-499b-9af5-026e92f58093 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:01.335197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dbdc134-b767-499b-9af5-026e92f58093 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:01.335989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dbdc134-b767-499b-9af5-026e92f58093 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:01.336524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dbdc134-b767-499b-9af5-026e92f58093 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:01.337048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dbdc134-b767-499b-9af5-026e92f58093 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:01.403217 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a5daf95a-4ff2-481a-a6b6-f19486c0f875 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.897720 Sep 06 10:59:01.412424 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 991/2009] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:59:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:01.420089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-19c7be15-e8e8-4030-ae8d-6dcd9e056340 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'create', calling method: .version_select at 0x7f90f3e3c280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2145435158", "description": "tempest-description-711539087"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:01.788928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0dbdc134-b767-499b-9af5-026e92f58093 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:01.802908 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0dbdc134-b767-499b-9af5-026e92f58093 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1292 microversion: 2.1 time: 0.482514 Sep 06 10:59:01.803804 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1019/2010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:01 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1292 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:01.815181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c66a3c81-432c-418f-8a53-6ce1f3d67e0b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:01.816196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c66a3c81-432c-418f-8a53-6ce1f3d67e0b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:01.825301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c66a3c81-432c-418f-8a53-6ce1f3d67e0b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:01.825829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c66a3c81-432c-418f-8a53-6ce1f3d67e0b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:01.826354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c66a3c81-432c-418f-8a53-6ce1f3d67e0b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:01.827324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c66a3c81-432c-418f-8a53-6ce1f3d67e0b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:01.827827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c66a3c81-432c-418f-8a53-6ce1f3d67e0b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:01.828874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c66a3c81-432c-418f-8a53-6ce1f3d67e0b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:02.300582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c66a3c81-432c-418f-8a53-6ce1f3d67e0b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:02.309272 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c66a3c81-432c-418f-8a53-6ce1f3d67e0b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1273 microversion: 2.1 time: 0.504131 Sep 06 10:59:02.313431 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1020/2011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:01 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1273 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:02.318333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-347b2c7e-8d84-432d-80c1-7fcfe896d7a3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:02.319387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-347b2c7e-8d84-432d-80c1-7fcfe896d7a3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:02.332104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-347b2c7e-8d84-432d-80c1-7fcfe896d7a3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:02.333356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-347b2c7e-8d84-432d-80c1-7fcfe896d7a3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:02.334192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-347b2c7e-8d84-432d-80c1-7fcfe896d7a3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:02.335388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-347b2c7e-8d84-432d-80c1-7fcfe896d7a3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:02.336076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-347b2c7e-8d84-432d-80c1-7fcfe896d7a3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:02.336740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-347b2c7e-8d84-432d-80c1-7fcfe896d7a3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:02.660621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-347b2c7e-8d84-432d-80c1-7fcfe896d7a3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:02.669179 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-347b2c7e-8d84-432d-80c1-7fcfe896d7a3 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.354493 Sep 06 10:59:02.671176 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1021/2012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:02 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:02.675289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dec0a6d9-876f-4246-9bd3-99df7aa24858 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:02.675922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dec0a6d9-876f-4246-9bd3-99df7aa24858 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 31a4ea2a-aa16-4e41-af83-b027dfe81828] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:02.682702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dec0a6d9-876f-4246-9bd3-99df7aa24858 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:02.683382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dec0a6d9-876f-4246-9bd3-99df7aa24858 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:02.684102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dec0a6d9-876f-4246-9bd3-99df7aa24858 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:02.685397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dec0a6d9-876f-4246-9bd3-99df7aa24858 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:02.686311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dec0a6d9-876f-4246-9bd3-99df7aa24858 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:02.687033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dec0a6d9-876f-4246-9bd3-99df7aa24858 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:02.718698 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-dec0a6d9-876f-4246-9bd3-99df7aa24858 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] HTTP exception thrown: Instance 31a4ea2a-aa16-4e41-af83-b027dfe81828 could not be found. Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dec0a6d9-876f-4246-9bd3-99df7aa24858 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Request method failure captured: Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 HTTP/1.1 Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY0XM8QMXsO-ZWeLvp9H3JP18koy_zrLLTsVcziqdA8AUhtRN2Nos8FUZnlA70cyyHoMhNRX0TLQgSONOWujMjpWXPVbcPTmCUURRh1f4AqUqjN2SB2hJ-XhwH2MKhkrUnx3BjFxywrtAfM4EYJd-Kplg-hPOnvY26JjHh1VMyYKT8 Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Openstack-Nova-Api-Version: 2.25 Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 437799e22df2433a83eca67987e942c6 Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1816350742 Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_437799e22df2433a83eca67987e942c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/437799e22df2433a83eca67987e942c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/437799e22df2433a83eca67987e942c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/437799e22df2433a83eca67987e942c6"}]}] Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1816350742 Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 437799e22df2433a83eca67987e942c6 Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1816350742 Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-LiveAutoBlockMigrationV225Test-1816350742-project Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d9f88a4c72854cff9bba7ed2920f55b0 Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1816350742-project Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 31a4ea2a-aa16-4e41-af83-b027dfe81828 could not be found. Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '31a4ea2a-aa16-4e41-af83-b027dfe81828'} Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a4ea2a-aa16-4e41-af83-b027dfe81828 could not be found. Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a4ea2a-aa16-4e41-af83-b027dfe81828 could not be found. Sep 06 10:59:02.721537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:02.725183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:02.725183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:02.725183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:02.725183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:02.725183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:02.725183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:02.725183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:02.725183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a4ea2a-aa16-4e41-af83-b027dfe81828 could not be found. Sep 06 10:59:02.725183 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:02.725183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dec0a6d9-876f-4246-9bd3-99df7aa24858 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Returning 404 to user: Instance 31a4ea2a-aa16-4e41-af83-b027dfe81828 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:02.725183 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dec0a6d9-876f-4246-9bd3-99df7aa24858 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828" status: 404 len: 111 microversion: 2.25 time: 0.051913 Sep 06 10:59:02.728732 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1022/2013] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:59:02 2022] GET /compute/v2.1/servers/31a4ea2a-aa16-4e41-af83-b027dfe81828 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:59:02.737473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a3be3a65-c0d3-486b-8d8e-7451feec3ef9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '.version_select at 0x7f90f848b3a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:02.827057 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a3be3a65-c0d3-486b-8d8e-7451feec3ef9 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470633700" status: 204 len: 0 microversion: 2.25 time: 0.090864 Sep 06 10:59:02.827057 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1023/2014] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 10:59:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470633700 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 10:59:02.834062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba088a30-3492-41aa-a8f5-fbec376fecf3 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:02.834785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ba088a30-3492-41aa-a8f5-fbec376fecf3 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:02.842845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba088a30-3492-41aa-a8f5-fbec376fecf3 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:02.844541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba088a30-3492-41aa-a8f5-fbec376fecf3 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:02.845280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba088a30-3492-41aa-a8f5-fbec376fecf3 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:02.860254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba088a30-3492-41aa-a8f5-fbec376fecf3 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:02.861911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba088a30-3492-41aa-a8f5-fbec376fecf3 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:02.863548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba088a30-3492-41aa-a8f5-fbec376fecf3 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:02.878035 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-19c7be15-e8e8-4030-ae8d-6dcd9e056340 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.463791 Sep 06 10:59:02.878971 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 992/2015] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:59:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:59:02.897886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:03.107375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1900145663", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "74fd748a-e59f-44c8-8ccf-f684be8cc472"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:03.193905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] validate_networks() for [('74fd748a-e59f-44c8-8ccf-f684be8cc472', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:59:03.373696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ba088a30-3492-41aa-a8f5-fbec376fecf3 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:03.386141 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ba088a30-3492-41aa-a8f5-fbec376fecf3 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1292 microversion: 2.1 time: 0.557693 Sep 06 10:59:03.388994 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1024/2016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:02 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1292 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:03.418735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7ec9297a-7aaa-49fd-a7b1-8fdac12a1628 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:03.419626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7ec9297a-7aaa-49fd-a7b1-8fdac12a1628 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:03.427491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ec9297a-7aaa-49fd-a7b1-8fdac12a1628 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:03.428203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ec9297a-7aaa-49fd-a7b1-8fdac12a1628 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:03.428841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ec9297a-7aaa-49fd-a7b1-8fdac12a1628 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:03.429753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ec9297a-7aaa-49fd-a7b1-8fdac12a1628 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:03.430405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ec9297a-7aaa-49fd-a7b1-8fdac12a1628 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:03.431072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ec9297a-7aaa-49fd-a7b1-8fdac12a1628 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:03.558693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7ec9297a-7aaa-49fd-a7b1-8fdac12a1628 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:03.569870 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7ec9297a-7aaa-49fd-a7b1-8fdac12a1628 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1273 microversion: 2.1 time: 0.160856 Sep 06 10:59:03.570755 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1025/2017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:03 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:03.695248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9530cc14-a544-430d-a3da-80c114db932d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:03.695884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9530cc14-a544-430d-a3da-80c114db932d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:03.705344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9530cc14-a544-430d-a3da-80c114db932d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:03.706111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9530cc14-a544-430d-a3da-80c114db932d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:03.706727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9530cc14-a544-430d-a3da-80c114db932d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:03.707745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9530cc14-a544-430d-a3da-80c114db932d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:03.708549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9530cc14-a544-430d-a3da-80c114db932d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:03.709199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9530cc14-a544-430d-a3da-80c114db932d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:04.175673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9530cc14-a544-430d-a3da-80c114db932d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:04.189289 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9530cc14-a544-430d-a3da-80c114db932d tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1393 microversion: 2.1 time: 0.497158 Sep 06 10:59:04.190514 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1026/2018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:03 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1393 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:04.403084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:59:04.403561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:59:04.404356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:59:04.404535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:59:04.405155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:59:04.411897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4fea2b18-f6fb-48fb-a0c0-e35e73e686fc tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:04.413078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4fea2b18-f6fb-48fb-a0c0-e35e73e686fc tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:04.420624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:04.421186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:04.421576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:04.422456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fea2b18-f6fb-48fb-a0c0-e35e73e686fc tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:04.422967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fea2b18-f6fb-48fb-a0c0-e35e73e686fc tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:04.423449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fea2b18-f6fb-48fb-a0c0-e35e73e686fc tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:04.424177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fea2b18-f6fb-48fb-a0c0-e35e73e686fc tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:04.426245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:04.427519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:04.427644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fea2b18-f6fb-48fb-a0c0-e35e73e686fc tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:04.428082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fea2b18-f6fb-48fb-a0c0-e35e73e686fc tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:04.429885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:04.465553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Getting quotas for project 0df100d31d294ce6858d12ea23adb2b4. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:59:04.476208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Getting quotas for user 5689d1981ee04c7b8dbcb4e9e1afd6cd and project 0df100d31d294ce6858d12ea23adb2b4. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:59:04.491847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:59:04.494803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:59:04.690718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4fea2b18-f6fb-48fb-a0c0-e35e73e686fc tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:04.704821 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4fea2b18-f6fb-48fb-a0c0-e35e73e686fc tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1292 microversion: 2.1 time: 0.296235 Sep 06 10:59:04.704986 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1240d920-aebb-4a0e-91cc-577c5d8bd2f9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.609717 Sep 06 10:59:04.706500 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1027/2019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:04 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1292 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:04.712576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-996d3008-4c73-4b78-8c1d-dbac23893ece tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:04.713338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-996d3008-4c73-4b78-8c1d-dbac23893ece tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:04.715361 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 993/2020] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:59:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:59:04.725061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-996d3008-4c73-4b78-8c1d-dbac23893ece tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:04.726439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-996d3008-4c73-4b78-8c1d-dbac23893ece tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:04.727487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-996d3008-4c73-4b78-8c1d-dbac23893ece tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:04.728991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-996d3008-4c73-4b78-8c1d-dbac23893ece tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:04.729508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-996d3008-4c73-4b78-8c1d-dbac23893ece tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:04.730148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-996d3008-4c73-4b78-8c1d-dbac23893ece tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:04.742073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-89bb6f90-7748-4b1c-9ec6-453e18ca9318 req-5b629d88-fe7c-471f-964c-13567f77dd5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c16b23-fea9-48c2-a5e0-ad2f3af9f743", "name": "network-vif-plugged", "status": "completed", "tag": "d6f21549-bb52-41f9-ba87-a7a0452169a3"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:04.762424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-89bb6f90-7748-4b1c-9ec6-453e18ca9318 req-5b629d88-fe7c-471f-964c-13567f77dd5a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:04.763221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-89bb6f90-7748-4b1c-9ec6-453e18ca9318 req-5b629d88-fe7c-471f-964c-13567f77dd5a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:04.763824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-89bb6f90-7748-4b1c-9ec6-453e18ca9318 req-5b629d88-fe7c-471f-964c-13567f77dd5a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:04.790063 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-89bb6f90-7748-4b1c-9ec6-453e18ca9318 req-5b629d88-fe7c-471f-964c-13567f77dd5a service nova] Creating event network-vif-plugged:d6f21549-bb52-41f9-ba87-a7a0452169a3 for instance 98c16b23-fea9-48c2-a5e0-ad2f3af9f743 on nch2-master-1 Sep 06 10:59:04.800826 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-89bb6f90-7748-4b1c-9ec6-453e18ca9318 req-5b629d88-fe7c-471f-964c-13567f77dd5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083858 Sep 06 10:59:04.804908 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 994/2021] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:04.814269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c3427a7-18bc-4f79-a3e0-d7f00d57987d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:04.818048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1c3427a7-18bc-4f79-a3e0-d7f00d57987d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:04.818583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-996d3008-4c73-4b78-8c1d-dbac23893ece tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:59:04.833822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c3427a7-18bc-4f79-a3e0-d7f00d57987d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:04.835724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c3427a7-18bc-4f79-a3e0-d7f00d57987d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:04.839556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c3427a7-18bc-4f79-a3e0-d7f00d57987d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:04.846997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c3427a7-18bc-4f79-a3e0-d7f00d57987d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:04.846997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c3427a7-18bc-4f79-a3e0-d7f00d57987d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:04.846997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c3427a7-18bc-4f79-a3e0-d7f00d57987d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:05.232104 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-996d3008-4c73-4b78-8c1d-dbac23893ece tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "DELETE /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 204 len: 0 microversion: 2.25 time: 0.523783 Sep 06 10:59:05.233012 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1028/2022] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 10:59:04 2022] DELETE /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 10:59:05.239322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d31aabc2-206e-4aef-87c7-38d7b7840e34 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:05.241075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d31aabc2-206e-4aef-87c7-38d7b7840e34 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:05.243051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:05.303932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1c3427a7-18bc-4f79-a3e0-d7f00d57987d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:05.313211 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1c3427a7-18bc-4f79-a3e0-d7f00d57987d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1315 microversion: 2.1 time: 0.505359 Sep 06 10:59:05.314457 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 995/2023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:04 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:05.321795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3bef2080-d65d-470c-a0c1-f99fd63598a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:05.324595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3bef2080-d65d-470c-a0c1-f99fd63598a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:05.325947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d31aabc2-206e-4aef-87c7-38d7b7840e34 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:05.338680 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d31aabc2-206e-4aef-87c7-38d7b7840e34 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1216 microversion: 2.1 time: 0.104369 Sep 06 10:59:05.340355 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1029/2024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:05 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1216 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:05.340524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bef2080-d65d-470c-a0c1-f99fd63598a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:05.341225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bef2080-d65d-470c-a0c1-f99fd63598a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:05.341843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bef2080-d65d-470c-a0c1-f99fd63598a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:05.342713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bef2080-d65d-470c-a0c1-f99fd63598a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:05.346599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-80134e71-2100-48ef-a949-72508540e833 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:05.347645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bef2080-d65d-470c-a0c1-f99fd63598a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:05.350764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bef2080-d65d-470c-a0c1-f99fd63598a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:05.350884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-80134e71-2100-48ef-a949-72508540e833 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:05.360985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80134e71-2100-48ef-a949-72508540e833 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:05.362091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80134e71-2100-48ef-a949-72508540e833 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:05.362770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80134e71-2100-48ef-a949-72508540e833 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:05.363622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80134e71-2100-48ef-a949-72508540e833 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:05.364159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80134e71-2100-48ef-a949-72508540e833 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:05.364731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80134e71-2100-48ef-a949-72508540e833 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:05.401534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:06.072036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-80134e71-2100-48ef-a949-72508540e833 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:06.086872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-80134e71-2100-48ef-a949-72508540e833 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:06.091179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-80134e71-2100-48ef-a949-72508540e833 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:06.094995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3bef2080-d65d-470c-a0c1-f99fd63598a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:06.099533 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-80134e71-2100-48ef-a949-72508540e833 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1550 microversion: 2.25 time: 0.757702 Sep 06 10:59:06.112421 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3bef2080-d65d-470c-a0c1-f99fd63598a5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1383 microversion: 2.1 time: 0.796327 Sep 06 10:59:06.113047 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 996/2025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:05 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1383 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:06.122649 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1030/2026] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:59:05 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1550 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:59:06.126276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-abbdc426-7c81-4389-9c7c-8ba7fffb1faf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:06.126860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-abbdc426-7c81-4389-9c7c-8ba7fffb1faf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:06.139329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7e89bd9a-eedf-42f1-85df-1098a21663ee tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '.version_select at 0x7f90f859ed30>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:06.145166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e89bd9a-eedf-42f1-85df-1098a21663ee tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:06.145715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e89bd9a-eedf-42f1-85df-1098a21663ee tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:06.146167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e89bd9a-eedf-42f1-85df-1098a21663ee tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:06.159820 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7e89bd9a-eedf-42f1-85df-1098a21663ee tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.023927 Sep 06 10:59:06.159820 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1031/2027] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 10:59:06 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:06.164842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abbdc426-7c81-4389-9c7c-8ba7fffb1faf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:06.165368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abbdc426-7c81-4389-9c7c-8ba7fffb1faf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:06.165814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abbdc426-7c81-4389-9c7c-8ba7fffb1faf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:06.166637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abbdc426-7c81-4389-9c7c-8ba7fffb1faf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:06.167744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abbdc426-7c81-4389-9c7c-8ba7fffb1faf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:06.168322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abbdc426-7c81-4389-9c7c-8ba7fffb1faf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:06.177224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-31c4c20b-13e3-4e39-85bf-a31f635f650d tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:06.178685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-31c4c20b-13e3-4e39-85bf-a31f635f650d tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:06.189563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31c4c20b-13e3-4e39-85bf-a31f635f650d tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:06.191472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31c4c20b-13e3-4e39-85bf-a31f635f650d tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:06.192102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31c4c20b-13e3-4e39-85bf-a31f635f650d tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:06.193062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31c4c20b-13e3-4e39-85bf-a31f635f650d tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:06.193818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31c4c20b-13e3-4e39-85bf-a31f635f650d tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:06.194474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31c4c20b-13e3-4e39-85bf-a31f635f650d tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:06.472527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-abbdc426-7c81-4389-9c7c-8ba7fffb1faf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:06.490765 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-abbdc426-7c81-4389-9c7c-8ba7fffb1faf tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1292 microversion: 2.1 time: 0.376624 Sep 06 10:59:06.491747 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 997/2028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:06 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1292 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:06.496946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5aab4692-b824-4b69-8828-cf958e3c46d0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:06.497822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5aab4692-b824-4b69-8828-cf958e3c46d0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:06.519301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aab4692-b824-4b69-8828-cf958e3c46d0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:06.519619 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-31c4c20b-13e3-4e39-85bf-a31f635f650d tempest-LiveMigrationTest-945793070 tempest-LiveMigrationTest-945793070-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1534 microversion: 2.1 time: 0.346648 Sep 06 10:59:06.520218 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1032/2029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:06 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1534 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:06.521184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aab4692-b824-4b69-8828-cf958e3c46d0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:06.522118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aab4692-b824-4b69-8828-cf958e3c46d0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:06.523337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aab4692-b824-4b69-8828-cf958e3c46d0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:06.524196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aab4692-b824-4b69-8828-cf958e3c46d0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:06.524994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aab4692-b824-4b69-8828-cf958e3c46d0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:06.560044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1e0af678-2a8e-40d7-9b36-fdc28a4b6c36 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:06.561205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1e0af678-2a8e-40d7-9b36-fdc28a4b6c36 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:06.577485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e0af678-2a8e-40d7-9b36-fdc28a4b6c36 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:06.578029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e0af678-2a8e-40d7-9b36-fdc28a4b6c36 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:06.578478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e0af678-2a8e-40d7-9b36-fdc28a4b6c36 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:06.579255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e0af678-2a8e-40d7-9b36-fdc28a4b6c36 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:06.579727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e0af678-2a8e-40d7-9b36-fdc28a4b6c36 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:06.580184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e0af678-2a8e-40d7-9b36-fdc28a4b6c36 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:06.750115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1e0af678-2a8e-40d7-9b36-fdc28a4b6c36 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:06.772617 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1e0af678-2a8e-40d7-9b36-fdc28a4b6c36 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1212 microversion: 2.1 time: 0.234295 Sep 06 10:59:06.776242 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1033/2030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:06 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1212 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:06.787720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1e852421-f76f-4597-b028-11ae1f8aa75e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:06.810106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1e852421-f76f-4597-b028-11ae1f8aa75e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:06.824932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e852421-f76f-4597-b028-11ae1f8aa75e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:06.825415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e852421-f76f-4597-b028-11ae1f8aa75e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:06.826036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e852421-f76f-4597-b028-11ae1f8aa75e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:06.828979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e852421-f76f-4597-b028-11ae1f8aa75e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:06.828979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e852421-f76f-4597-b028-11ae1f8aa75e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:06.828979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e852421-f76f-4597-b028-11ae1f8aa75e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:06.862441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5aab4692-b824-4b69-8828-cf958e3c46d0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:06.878420 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5aab4692-b824-4b69-8828-cf958e3c46d0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1315 microversion: 2.1 time: 0.382623 Sep 06 10:59:06.880131 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 998/2031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:06 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:06.901514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-251a5f21-81a3-4242-8300-0678e23016be req-c6faabee-c1d7-48aa-a0ae-80c25c4b220d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239473a8-8554-4c9d-a566-b76c75336087", "name": "network-vif-deleted", "tag": "e8f21b28-8b08-44a7-892d-3e672959f381"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:06.915329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1e852421-f76f-4597-b028-11ae1f8aa75e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:59:06.923963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-251a5f21-81a3-4242-8300-0678e23016be req-c6faabee-c1d7-48aa-a0ae-80c25c4b220d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:06.924786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-251a5f21-81a3-4242-8300-0678e23016be req-c6faabee-c1d7-48aa-a0ae-80c25c4b220d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:06.928782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-251a5f21-81a3-4242-8300-0678e23016be req-c6faabee-c1d7-48aa-a0ae-80c25c4b220d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:06.952263 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-251a5f21-81a3-4242-8300-0678e23016be req-c6faabee-c1d7-48aa-a0ae-80c25c4b220d service nova] Creating event network-vif-deleted:e8f21b28-8b08-44a7-892d-3e672959f381 for instance 239473a8-8554-4c9d-a566-b76c75336087 on nch1-master-1 Sep 06 10:59:06.989161 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-251a5f21-81a3-4242-8300-0678e23016be req-c6faabee-c1d7-48aa-a0ae-80c25c4b220d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104866 Sep 06 10:59:06.999590 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 999/2032] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:07.005706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-df74bf6b-6a52-422c-9ee7-539be6053131 req-826481ae-af60-4e44-9494-b6bbfd2360af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ecf20d-9dff-4421-be11-23b2fb67c1c3", "tag": "6ce7224e-a97f-4beb-bfad-419526ca6c7f"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:07.026366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-df74bf6b-6a52-422c-9ee7-539be6053131 req-826481ae-af60-4e44-9494-b6bbfd2360af service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:07.030883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-df74bf6b-6a52-422c-9ee7-539be6053131 req-826481ae-af60-4e44-9494-b6bbfd2360af service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:07.032419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-df74bf6b-6a52-422c-9ee7-539be6053131 req-826481ae-af60-4e44-9494-b6bbfd2360af service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:07.054445 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-df74bf6b-6a52-422c-9ee7-539be6053131 req-826481ae-af60-4e44-9494-b6bbfd2360af service nova] Creating event network-changed:6ce7224e-a97f-4beb-bfad-419526ca6c7f for instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 on nch1-master-1 Sep 06 10:59:07.068802 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-df74bf6b-6a52-422c-9ee7-539be6053131 req-826481ae-af60-4e44-9494-b6bbfd2360af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067484 Sep 06 10:59:07.069891 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1000/2033] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:07.135217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:07.151975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:07.160164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:07.160942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:07.161397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:07.162136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:07.162597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:07.163083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:07.263697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:07.264752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:07.265211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:07.266278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lazy-loading 'fault' on Instance uuid 239473a8-8554-4c9d-a566-b76c75336087 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:59:07.307285 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1e852421-f76f-4597-b028-11ae1f8aa75e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 204 len: 0 microversion: 2.1 time: 0.529504 Sep 06 10:59:07.319061 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1034/2034] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:59:06 2022] DELETE /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:59:07.327188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4510cfe0-054a-4f91-85e8-5449387b2a20 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:07.328521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4510cfe0-054a-4f91-85e8-5449387b2a20 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:07.335858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4510cfe0-054a-4f91-85e8-5449387b2a20 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:07.336547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4510cfe0-054a-4f91-85e8-5449387b2a20 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:07.337276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4510cfe0-054a-4f91-85e8-5449387b2a20 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:07.341979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4510cfe0-054a-4f91-85e8-5449387b2a20 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:07.342702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4510cfe0-054a-4f91-85e8-5449387b2a20 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:07.348479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4510cfe0-054a-4f91-85e8-5449387b2a20 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:07.352183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:07.360931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:07.362801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:07.364200 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bde12f4c-34f0-42d1-b777-9f19f992911b tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1352 microversion: 2.25 time: 0.236577 Sep 06 10:59:07.365222 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1001/2035] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:59:07 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1352 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:59:07.520358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0eac3994-d3c5-4fa0-af40-043ba10328b6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:07.521302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0eac3994-d3c5-4fa0-af40-043ba10328b6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:07.548202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0eac3994-d3c5-4fa0-af40-043ba10328b6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:07.548801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0eac3994-d3c5-4fa0-af40-043ba10328b6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:07.549262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0eac3994-d3c5-4fa0-af40-043ba10328b6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:07.556696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0eac3994-d3c5-4fa0-af40-043ba10328b6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:07.557387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0eac3994-d3c5-4fa0-af40-043ba10328b6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:07.560591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0eac3994-d3c5-4fa0-af40-043ba10328b6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:07.781741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4510cfe0-054a-4f91-85e8-5449387b2a20 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:07.808553 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4510cfe0-054a-4f91-85e8-5449387b2a20 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1389 microversion: 2.1 time: 0.487582 Sep 06 10:59:07.825801 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1035/2036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:07 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1389 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:07.850880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f84ee04e-7eea-4bda-a179-d3fb085644e9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:07.852471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f84ee04e-7eea-4bda-a179-d3fb085644e9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:07.863882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f84ee04e-7eea-4bda-a179-d3fb085644e9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:07.864384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f84ee04e-7eea-4bda-a179-d3fb085644e9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:07.864851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f84ee04e-7eea-4bda-a179-d3fb085644e9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:07.865618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f84ee04e-7eea-4bda-a179-d3fb085644e9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:07.866130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f84ee04e-7eea-4bda-a179-d3fb085644e9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:07.866566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f84ee04e-7eea-4bda-a179-d3fb085644e9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:08.022007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0eac3994-d3c5-4fa0-af40-043ba10328b6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:08.030439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f84ee04e-7eea-4bda-a179-d3fb085644e9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:08.035933 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0eac3994-d3c5-4fa0-af40-043ba10328b6 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1482 microversion: 2.1 time: 0.524240 Sep 06 10:59:08.037961 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1002/2037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:07 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1482 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:08.040917 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f84ee04e-7eea-4bda-a179-d3fb085644e9 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1268 microversion: 2.1 time: 0.221782 Sep 06 10:59:08.041504 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1036/2038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:07 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1268 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:08.063465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aba07727-78e9-466e-92bc-276ae5b56f92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:08.064534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aba07727-78e9-466e-92bc-276ae5b56f92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:08.076564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e80903aa-953f-427d-a732-6a77643b27e7 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:08.077295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e80903aa-953f-427d-a732-6a77643b27e7 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:08.082962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aba07727-78e9-466e-92bc-276ae5b56f92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:08.083752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aba07727-78e9-466e-92bc-276ae5b56f92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:08.084430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aba07727-78e9-466e-92bc-276ae5b56f92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:08.085440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aba07727-78e9-466e-92bc-276ae5b56f92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:08.086066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aba07727-78e9-466e-92bc-276ae5b56f92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:08.086507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aba07727-78e9-466e-92bc-276ae5b56f92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:08.092963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e80903aa-953f-427d-a732-6a77643b27e7 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:08.094783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e80903aa-953f-427d-a732-6a77643b27e7 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:08.095518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e80903aa-953f-427d-a732-6a77643b27e7 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:08.096520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e80903aa-953f-427d-a732-6a77643b27e7 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:08.097217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e80903aa-953f-427d-a732-6a77643b27e7 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:08.098078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e80903aa-953f-427d-a732-6a77643b27e7 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:08.384799 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e80903aa-953f-427d-a732-6a77643b27e7 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.317777 Sep 06 10:59:08.395834 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1037/2039] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 10:59:08 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743/os-interface => generated 284 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:59:08.402746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:08.403407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:08.415336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:08.416494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:08.420338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:08.421192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:08.422644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:08.426644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:08.484588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:08.485612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:08.486375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:08.487532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lazy-loading 'fault' on Instance uuid 239473a8-8554-4c9d-a566-b76c75336087 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:59:08.724694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:08.741875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:08.743418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aba07727-78e9-466e-92bc-276ae5b56f92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:08.748659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:08.752105 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f02a6d4b-1522-4fdf-8a06-18feecf62212 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 200 len: 1352 microversion: 2.25 time: 0.354489 Sep 06 10:59:08.753928 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1038/2040] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:59:08 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 1352 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:59:08.771300 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aba07727-78e9-466e-92bc-276ae5b56f92 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1315 microversion: 2.1 time: 0.716346 Sep 06 10:59:08.775888 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1003/2041] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:08 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:08.835457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fc3fcaad-ca9e-4a42-8c92-cd9145373d44 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:08.836140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fc3fcaad-ca9e-4a42-8c92-cd9145373d44 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:08.843444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc3fcaad-ca9e-4a42-8c92-cd9145373d44 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:08.851279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc3fcaad-ca9e-4a42-8c92-cd9145373d44 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:08.851279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc3fcaad-ca9e-4a42-8c92-cd9145373d44 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:08.851279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc3fcaad-ca9e-4a42-8c92-cd9145373d44 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:08.851279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc3fcaad-ca9e-4a42-8c92-cd9145373d44 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:08.851279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc3fcaad-ca9e-4a42-8c92-cd9145373d44 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:08.866091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:09.066840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5f68d10b-5f0d-4f8e-a289-e46f749c78a5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:09.067525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5f68d10b-5f0d-4f8e-a289-e46f749c78a5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:09.080446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f68d10b-5f0d-4f8e-a289-e46f749c78a5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:09.082133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f68d10b-5f0d-4f8e-a289-e46f749c78a5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:09.082632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f68d10b-5f0d-4f8e-a289-e46f749c78a5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:09.083440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f68d10b-5f0d-4f8e-a289-e46f749c78a5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:09.087347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f68d10b-5f0d-4f8e-a289-e46f749c78a5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:09.088255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f68d10b-5f0d-4f8e-a289-e46f749c78a5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:09.291217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5f68d10b-5f0d-4f8e-a289-e46f749c78a5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:09.302588 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5f68d10b-5f0d-4f8e-a289-e46f749c78a5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1274 microversion: 2.1 time: 0.239835 Sep 06 10:59:09.303463 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1004/2042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:09 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1274 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:09.340821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fc3fcaad-ca9e-4a42-8c92-cd9145373d44 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:09.354538 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fc3fcaad-ca9e-4a42-8c92-cd9145373d44 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1389 microversion: 2.1 time: 0.524390 Sep 06 10:59:09.357047 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1039/2043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:08 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1389 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:09.805485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1b69857a-aeb8-4551-925c-72a3c3202840 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:09.808265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ac2df2e5-ff9d-4200-a5b3-05e93c0b83fd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:09.810246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1b69857a-aeb8-4551-925c-72a3c3202840 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:09.812957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ac2df2e5-ff9d-4200-a5b3-05e93c0b83fd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: 239473a8-8554-4c9d-a566-b76c75336087] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:09.832105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac2df2e5-ff9d-4200-a5b3-05e93c0b83fd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:09.832627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac2df2e5-ff9d-4200-a5b3-05e93c0b83fd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:09.834726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac2df2e5-ff9d-4200-a5b3-05e93c0b83fd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:09.834833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b69857a-aeb8-4551-925c-72a3c3202840 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:09.834833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b69857a-aeb8-4551-925c-72a3c3202840 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:09.834833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b69857a-aeb8-4551-925c-72a3c3202840 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:09.835616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac2df2e5-ff9d-4200-a5b3-05e93c0b83fd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:09.836281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac2df2e5-ff9d-4200-a5b3-05e93c0b83fd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:09.836887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac2df2e5-ff9d-4200-a5b3-05e93c0b83fd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:09.837659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b69857a-aeb8-4551-925c-72a3c3202840 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:09.838447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b69857a-aeb8-4551-925c-72a3c3202840 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:09.839853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b69857a-aeb8-4551-925c-72a3c3202840 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:09.911799 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-ac2df2e5-ff9d-4200-a5b3-05e93c0b83fd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] HTTP exception thrown: Instance 239473a8-8554-4c9d-a566-b76c75336087 could not be found. Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ac2df2e5-ff9d-4200-a5b3-05e93c0b83fd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Request method failure captured: Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 HTTP/1.1 Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyY0XM8QMXsO-ZWeLvp9H3JP18koy_zrLLTsVcziqdA8AUhtRN2Nos8FUZnlA70cyyHoMhNRX0TLQgSONOWujMjpWXPVbcPTmCUURRh1f4AqUqjN2SB2hJ-XhwH2MKhkrUnx3BjFxywrtAfM4EYJd-Kplg-hPOnvY26JjHh1VMyYKT8 Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.25 Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 437799e22df2433a83eca67987e942c6 Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1816350742 Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_437799e22df2433a83eca67987e942c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/437799e22df2433a83eca67987e942c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/437799e22df2433a83eca67987e942c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/437799e22df2433a83eca67987e942c6"}]}] Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1816350742 Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 437799e22df2433a83eca67987e942c6 Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1816350742 Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-LiveAutoBlockMigrationV225Test-1816350742-project Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d9f88a4c72854cff9bba7ed2920f55b0 Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1816350742-project Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 239473a8-8554-4c9d-a566-b76c75336087 could not be found. Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '239473a8-8554-4c9d-a566-b76c75336087'} Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239473a8-8554-4c9d-a566-b76c75336087 could not be found. Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239473a8-8554-4c9d-a566-b76c75336087 could not be found. Sep 06 10:59:09.914024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:09.920638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:09.920638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:09.920638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:09.920638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:09.920638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:09.920638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:09.920638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:09.920638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239473a8-8554-4c9d-a566-b76c75336087 could not be found. Sep 06 10:59:09.920638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:09.924245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ac2df2e5-ff9d-4200-a5b3-05e93c0b83fd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Returning 404 to user: Instance 239473a8-8554-4c9d-a566-b76c75336087 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:09.926952 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ac2df2e5-ff9d-4200-a5b3-05e93c0b83fd tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087" status: 404 len: 111 microversion: 2.25 time: 0.145475 Sep 06 10:59:09.931301 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1005/2044] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:59:09 2022] GET /compute/v2.1/servers/239473a8-8554-4c9d-a566-b76c75336087 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:59:09.942849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-5233e417-3506-4005-b9c7-38658bc20566 req-eaac3cd4-380a-4e3c-9dc0-4c47c3d5dad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4e34be-e53e-434b-a851-3c78589a82c3", "name": "network-vif-deleted", "tag": "c5e685a6-87c9-4534-a2e6-8b53a3ce0b8b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:09.977795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5233e417-3506-4005-b9c7-38658bc20566 req-eaac3cd4-380a-4e3c-9dc0-4c47c3d5dad6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:09.978375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5233e417-3506-4005-b9c7-38658bc20566 req-eaac3cd4-380a-4e3c-9dc0-4c47c3d5dad6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:09.978810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5233e417-3506-4005-b9c7-38658bc20566 req-eaac3cd4-380a-4e3c-9dc0-4c47c3d5dad6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:10.001766 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5233e417-3506-4005-b9c7-38658bc20566 req-eaac3cd4-380a-4e3c-9dc0-4c47c3d5dad6 service nova] Creating event network-vif-deleted:c5e685a6-87c9-4534-a2e6-8b53a3ce0b8b for instance ca4e34be-e53e-434b-a851-3c78589a82c3 on nch1-master-1 Sep 06 10:59:10.007738 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-5233e417-3506-4005-b9c7-38658bc20566 req-eaac3cd4-380a-4e3c-9dc0-4c47c3d5dad6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074791 Sep 06 10:59:10.008677 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1006/2045] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:10.017373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8aa2dcef-0131-4694-9072-33b1bbb1feb1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:10.018322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8aa2dcef-0131-4694-9072-33b1bbb1feb1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:10.027569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aa2dcef-0131-4694-9072-33b1bbb1feb1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:10.029561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aa2dcef-0131-4694-9072-33b1bbb1feb1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:10.031823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aa2dcef-0131-4694-9072-33b1bbb1feb1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:10.034336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aa2dcef-0131-4694-9072-33b1bbb1feb1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:10.034987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aa2dcef-0131-4694-9072-33b1bbb1feb1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:10.039328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aa2dcef-0131-4694-9072-33b1bbb1feb1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:10.092303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8aa2dcef-0131-4694-9072-33b1bbb1feb1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:59:10.483395 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8aa2dcef-0131-4694-9072-33b1bbb1feb1 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 204 len: 0 microversion: 2.25 time: 0.472820 Sep 06 10:59:10.484425 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1007/2046] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 10:59:10 2022] DELETE /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 10:59:10.490047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0c65c1f8-36dd-4578-915e-831649dace7d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:10.490958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0c65c1f8-36dd-4578-915e-831649dace7d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:10.497695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c65c1f8-36dd-4578-915e-831649dace7d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:10.498402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c65c1f8-36dd-4578-915e-831649dace7d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:10.498748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c65c1f8-36dd-4578-915e-831649dace7d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:10.504241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c65c1f8-36dd-4578-915e-831649dace7d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:10.504241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c65c1f8-36dd-4578-915e-831649dace7d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:10.504241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c65c1f8-36dd-4578-915e-831649dace7d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:10.697048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1b69857a-aeb8-4551-925c-72a3c3202840 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:10.707052 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1b69857a-aeb8-4551-925c-72a3c3202840 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1315 microversion: 2.1 time: 0.928025 Sep 06 10:59:10.708200 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1040/2047] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:09 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1315 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:10.717234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1eed67fa-fdc6-40cc-8750-73a9b02a827b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:10.718116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1eed67fa-fdc6-40cc-8750-73a9b02a827b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:10.725929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1eed67fa-fdc6-40cc-8750-73a9b02a827b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:10.726439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1eed67fa-fdc6-40cc-8750-73a9b02a827b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:10.726864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1eed67fa-fdc6-40cc-8750-73a9b02a827b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:10.727645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1eed67fa-fdc6-40cc-8750-73a9b02a827b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:10.728333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1eed67fa-fdc6-40cc-8750-73a9b02a827b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:10.728903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1eed67fa-fdc6-40cc-8750-73a9b02a827b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:10.834744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0c65c1f8-36dd-4578-915e-831649dace7d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:10.846985 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0c65c1f8-36dd-4578-915e-831649dace7d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1274 microversion: 2.1 time: 0.361247 Sep 06 10:59:10.848173 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1008/2048] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:10 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1274 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:10.853372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6fee5311-2da5-4ad6-9efa-4013433da64c tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:10.854164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6fee5311-2da5-4ad6-9efa-4013433da64c tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:10.862141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6fee5311-2da5-4ad6-9efa-4013433da64c tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:10.863060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6fee5311-2da5-4ad6-9efa-4013433da64c tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:10.863711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6fee5311-2da5-4ad6-9efa-4013433da64c tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:10.864629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6fee5311-2da5-4ad6-9efa-4013433da64c tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:10.865354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6fee5311-2da5-4ad6-9efa-4013433da64c tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:10.865858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6fee5311-2da5-4ad6-9efa-4013433da64c tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:10.886856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1eed67fa-fdc6-40cc-8750-73a9b02a827b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:10.902589 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1eed67fa-fdc6-40cc-8750-73a9b02a827b tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1184 microversion: 2.1 time: 0.191274 Sep 06 10:59:10.903719 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1041/2049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:10 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1184 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:10.929665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cbd3e0dc-b675-4515-afc1-55a27f814847 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:10.931612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cbd3e0dc-b675-4515-afc1-55a27f814847 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:10.942217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbd3e0dc-b675-4515-afc1-55a27f814847 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:10.942718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbd3e0dc-b675-4515-afc1-55a27f814847 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:10.943212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbd3e0dc-b675-4515-afc1-55a27f814847 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:10.943937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbd3e0dc-b675-4515-afc1-55a27f814847 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:10.944391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbd3e0dc-b675-4515-afc1-55a27f814847 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:10.945043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbd3e0dc-b675-4515-afc1-55a27f814847 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:11.294545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6fee5311-2da5-4ad6-9efa-4013433da64c tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:11.305293 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6fee5311-2da5-4ad6-9efa-4013433da64c tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1482 microversion: 2.1 time: 0.455675 Sep 06 10:59:11.306353 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1009/2050] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:10 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1482 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:11.364777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cbd3e0dc-b675-4515-afc1-55a27f814847 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:11.379359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cbd3e0dc-b675-4515-afc1-55a27f814847 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:11.380902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cbd3e0dc-b675-4515-afc1-55a27f814847 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:11.382340 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cbd3e0dc-b675-4515-afc1-55a27f814847 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1563 microversion: 2.25 time: 0.477443 Sep 06 10:59:11.385395 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1042/2051] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:59:10 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1563 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:59:11.731787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8c2bcec4-e4ac-442b-b9a8-693b09896fdc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:11.732839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8c2bcec4-e4ac-442b-b9a8-693b09896fdc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:11.763542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c2bcec4-e4ac-442b-b9a8-693b09896fdc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:11.764312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c2bcec4-e4ac-442b-b9a8-693b09896fdc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:11.764924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c2bcec4-e4ac-442b-b9a8-693b09896fdc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:11.766187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c2bcec4-e4ac-442b-b9a8-693b09896fdc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:11.768561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c2bcec4-e4ac-442b-b9a8-693b09896fdc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:11.769364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c2bcec4-e4ac-442b-b9a8-693b09896fdc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:11.872297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-59c4673b-0514-4655-9877-b0aae1bcb905 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:11.872986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-59c4673b-0514-4655-9877-b0aae1bcb905 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:11.884900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59c4673b-0514-4655-9877-b0aae1bcb905 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:11.885943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59c4673b-0514-4655-9877-b0aae1bcb905 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:11.887757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59c4673b-0514-4655-9877-b0aae1bcb905 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:11.889106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59c4673b-0514-4655-9877-b0aae1bcb905 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:11.891446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59c4673b-0514-4655-9877-b0aae1bcb905 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:11.892195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59c4673b-0514-4655-9877-b0aae1bcb905 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:12.394454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8c2bcec4-e4ac-442b-b9a8-693b09896fdc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:12.402692 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8c2bcec4-e4ac-442b-b9a8-693b09896fdc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1315 microversion: 2.1 time: 0.675249 Sep 06 10:59:12.403491 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1010/2052] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:11 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:12.418901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:12.419653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:12.425750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:12.426242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:12.426691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:12.427432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:12.428070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:12.428573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:12.468349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:12.469427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:12.469816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:12.470277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lazy-loading 'fault' on Instance uuid ca4e34be-e53e-434b-a851-3c78589a82c3 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:59:12.473243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-59c4673b-0514-4655-9877-b0aae1bcb905 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:12.488603 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-59c4673b-0514-4655-9877-b0aae1bcb905 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1316 microversion: 2.1 time: 0.619672 Sep 06 10:59:12.490017 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1043/2053] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:11 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:12.495915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-5cf38abb-7ebf-4773-a531-c6c870b09e49 req-7faa8df3-b7dd-43db-8c4e-9f076607e571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c16b23-fea9-48c2-a5e0-ad2f3af9f743", "tag": "d6f21549-bb52-41f9-ba87-a7a0452169a3"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:12.507950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5cf38abb-7ebf-4773-a531-c6c870b09e49 req-7faa8df3-b7dd-43db-8c4e-9f076607e571 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:12.508661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5cf38abb-7ebf-4773-a531-c6c870b09e49 req-7faa8df3-b7dd-43db-8c4e-9f076607e571 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:12.509337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5cf38abb-7ebf-4773-a531-c6c870b09e49 req-7faa8df3-b7dd-43db-8c4e-9f076607e571 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:12.522253 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-5cf38abb-7ebf-4773-a531-c6c870b09e49 req-7faa8df3-b7dd-43db-8c4e-9f076607e571 service nova] Creating event network-changed:d6f21549-bb52-41f9-ba87-a7a0452169a3 for instance 98c16b23-fea9-48c2-a5e0-ad2f3af9f743 on nch2-master-1 Sep 06 10:59:12.527595 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-5cf38abb-7ebf-4773-a531-c6c870b09e49 req-7faa8df3-b7dd-43db-8c4e-9f076607e571 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036146 Sep 06 10:59:12.528604 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1044/2054] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:12.534864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-42d61583-45d9-4f5e-8b0e-d49d3777540c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:12.535627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-42d61583-45d9-4f5e-8b0e-d49d3777540c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:12.542231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42d61583-45d9-4f5e-8b0e-d49d3777540c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:12.542721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42d61583-45d9-4f5e-8b0e-d49d3777540c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:12.543247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42d61583-45d9-4f5e-8b0e-d49d3777540c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:12.553973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42d61583-45d9-4f5e-8b0e-d49d3777540c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:12.553973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42d61583-45d9-4f5e-8b0e-d49d3777540c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:12.553973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42d61583-45d9-4f5e-8b0e-d49d3777540c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:12.554686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:12.563383 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e17fa1c5-22e4-4061-9630-9e3991ab5bf9 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 200 len: 1189 microversion: 2.1 time: 0.157795 Sep 06 10:59:12.564365 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1011/2055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:12 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 1189 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:13.088777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-42d61583-45d9-4f5e-8b0e-d49d3777540c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:13.099878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-42d61583-45d9-4f5e-8b0e-d49d3777540c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:13.103561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-42d61583-45d9-4f5e-8b0e-d49d3777540c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:13.105133 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-42d61583-45d9-4f5e-8b0e-d49d3777540c tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1563 microversion: 2.25 time: 0.575482 Sep 06 10:59:13.119440 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1045/2056] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:59:12 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1563 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:59:13.427767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8d0feac9-d879-40a8-8936-fce6b93cfeb6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:13.429203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8d0feac9-d879-40a8-8936-fce6b93cfeb6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:13.442381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d0feac9-d879-40a8-8936-fce6b93cfeb6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:13.450034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d0feac9-d879-40a8-8936-fce6b93cfeb6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:13.450034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d0feac9-d879-40a8-8936-fce6b93cfeb6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:13.450034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d0feac9-d879-40a8-8936-fce6b93cfeb6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:13.450034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d0feac9-d879-40a8-8936-fce6b93cfeb6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:13.450034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d0feac9-d879-40a8-8936-fce6b93cfeb6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:13.516323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d0057b17-524d-43ed-8bd9-42150bb3d045 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:13.520413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d0057b17-524d-43ed-8bd9-42150bb3d045 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:13.523604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0057b17-524d-43ed-8bd9-42150bb3d045 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:13.524581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0057b17-524d-43ed-8bd9-42150bb3d045 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:13.525241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0057b17-524d-43ed-8bd9-42150bb3d045 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:13.526286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0057b17-524d-43ed-8bd9-42150bb3d045 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:13.526988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0057b17-524d-43ed-8bd9-42150bb3d045 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:13.527677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0057b17-524d-43ed-8bd9-42150bb3d045 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:14.378321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d0057b17-524d-43ed-8bd9-42150bb3d045 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:14.388802 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d0057b17-524d-43ed-8bd9-42150bb3d045 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1316 microversion: 2.1 time: 0.877290 Sep 06 10:59:14.389506 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1046/2057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:13 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1316 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:14.394270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-76e20eb5-7c1a-43f0-b32a-19ad963e3117 req-5f4e08f6-1a8f-4556-8937-5e13590bd1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2328e1f-4118-416a-94bd-e0e51ab9002c", "name": "network-vif-deleted", "tag": "c0304443-2c0c-425a-b04d-74a367a3d905"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:14.405234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-76e20eb5-7c1a-43f0-b32a-19ad963e3117 req-5f4e08f6-1a8f-4556-8937-5e13590bd1e5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:14.406639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-76e20eb5-7c1a-43f0-b32a-19ad963e3117 req-5f4e08f6-1a8f-4556-8937-5e13590bd1e5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:14.407351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-76e20eb5-7c1a-43f0-b32a-19ad963e3117 req-5f4e08f6-1a8f-4556-8937-5e13590bd1e5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:14.424911 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-76e20eb5-7c1a-43f0-b32a-19ad963e3117 req-5f4e08f6-1a8f-4556-8937-5e13590bd1e5 service nova] Creating event network-vif-deleted:c0304443-2c0c-425a-b04d-74a367a3d905 for instance c2328e1f-4118-416a-94bd-e0e51ab9002c on nch1-master-1 Sep 06 10:59:14.427780 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-76e20eb5-7c1a-43f0-b32a-19ad963e3117 req-5f4e08f6-1a8f-4556-8937-5e13590bd1e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036428 Sep 06 10:59:14.429329 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1047/2058] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:14.434247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1dd1bf7d-ce7a-441d-860a-653382d1f39c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:14.434966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1dd1bf7d-ce7a-441d-860a-653382d1f39c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: ca4e34be-e53e-434b-a851-3c78589a82c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:14.437761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8d0feac9-d879-40a8-8936-fce6b93cfeb6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:14.442367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dd1bf7d-ce7a-441d-860a-653382d1f39c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:14.442964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dd1bf7d-ce7a-441d-860a-653382d1f39c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:14.443728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dd1bf7d-ce7a-441d-860a-653382d1f39c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:14.444597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dd1bf7d-ce7a-441d-860a-653382d1f39c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:14.445211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dd1bf7d-ce7a-441d-860a-653382d1f39c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:14.445785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dd1bf7d-ce7a-441d-860a-653382d1f39c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:14.453858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:14.459716 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8d0feac9-d879-40a8-8936-fce6b93cfeb6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1315 microversion: 2.1 time: 1.035097 Sep 06 10:59:14.461125 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1012/2059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:13 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1315 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:14.469973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:14.472580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:14.484480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=22 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:14.484785 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-1dd1bf7d-ce7a-441d-860a-653382d1f39c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] HTTP exception thrown: Instance ca4e34be-e53e-434b-a851-3c78589a82c3 could not be found. Sep 06 10:59:14.487263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:14.488032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:14.489587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:14.490919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:14.492125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:14.493707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1dd1bf7d-ce7a-441d-860a-653382d1f39c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Request method failure captured: Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 HTTP/1.1 Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY4vX_-GQFSvlCFpCM_88XOXPnenmn0IC5GvqKRyIJOSaj8HG5Q0AH3SmJN09UhNSHS4fTGKIVCxon8ypZc0I1z3-YkDZjIVpQyOp7ONgTOGirC-U7-JdcbqucQimeJhIZoUZlsDUBna-Zj5FutqaCYPx3uWvNkNtCNBA0PqAWK-SE Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: fb1af95268504c5bbed702fce756f5f4 Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-LiveMigrationTest-1600938040 Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb1af95268504c5bbed702fce756f5f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb1af95268504c5bbed702fce756f5f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb1af95268504c5bbed702fce756f5f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb1af95268504c5bbed702fce756f5f4"}]}] Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-LiveMigrationTest-1600938040 Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: fb1af95268504c5bbed702fce756f5f4 Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-LiveMigrationTest-1600938040 Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-LiveMigrationTest-1600938040-project Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: c4e1ac1b40e94dbc80548a1f45919b6f Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-LiveMigrationTest-1600938040-project Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance ca4e34be-e53e-434b-a851-3c78589a82c3 could not be found. Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ca4e34be-e53e-434b-a851-3c78589a82c3'} Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca4e34be-e53e-434b-a851-3c78589a82c3 could not be found. Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca4e34be-e53e-434b-a851-3c78589a82c3 could not be found. Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:14.494534 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:14.502426 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:14.502426 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:14.502426 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:14.502426 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:14.502426 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:14.502426 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca4e34be-e53e-434b-a851-3c78589a82c3 could not be found. Sep 06 10:59:14.502426 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:14.502426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1dd1bf7d-ce7a-441d-860a-653382d1f39c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Returning 404 to user: Instance ca4e34be-e53e-434b-a851-3c78589a82c3 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:14.502426 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1dd1bf7d-ce7a-441d-860a-653382d1f39c tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3" status: 404 len: 111 microversion: 2.1 time: 0.066079 Sep 06 10:59:14.502426 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1048/2060] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:14 2022] GET /compute/v2.1/servers/ca4e34be-e53e-434b-a851-3c78589a82c3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:14.537828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:14.552682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:14.553506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:14.554193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:14.555082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lazy-loading 'fault' on Instance uuid c2328e1f-4118-416a-94bd-e0e51ab9002c {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:59:14.654619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:14.669422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:14.673694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437799e22df2433a83eca67987e942c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:14.675595 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-af4eaa60-3018-49e7-b0c6-05b047f2463a tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 200 len: 1351 microversion: 2.25 time: 0.212928 Sep 06 10:59:14.676366 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1013/2061] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:59:14 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 1351 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 10:59:15.414890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a16b0378-8500-4402-83dc-6582bd0e3a99 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:15.441081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a16b0378-8500-4402-83dc-6582bd0e3a99 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:15.441081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:15.441081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a16b0378-8500-4402-83dc-6582bd0e3a99 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:15.441081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a16b0378-8500-4402-83dc-6582bd0e3a99 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:15.441081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a16b0378-8500-4402-83dc-6582bd0e3a99 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:15.441081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a16b0378-8500-4402-83dc-6582bd0e3a99 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:15.441081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a16b0378-8500-4402-83dc-6582bd0e3a99 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:15.441081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a16b0378-8500-4402-83dc-6582bd0e3a99 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:15.489160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-543f6d82-0e61-492f-a6c3-0e97a0173182 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:15.490180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-543f6d82-0e61-492f-a6c3-0e97a0173182 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:15.500343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-543f6d82-0e61-492f-a6c3-0e97a0173182 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:15.501164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-543f6d82-0e61-492f-a6c3-0e97a0173182 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:15.501849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-543f6d82-0e61-492f-a6c3-0e97a0173182 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:15.502802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-543f6d82-0e61-492f-a6c3-0e97a0173182 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:15.503695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-543f6d82-0e61-492f-a6c3-0e97a0173182 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:15.504355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-543f6d82-0e61-492f-a6c3-0e97a0173182 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:15.809273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a16b0378-8500-4402-83dc-6582bd0e3a99 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:15.819280 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a16b0378-8500-4402-83dc-6582bd0e3a99 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1316 microversion: 2.1 time: 0.408421 Sep 06 10:59:15.819888 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1049/2062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:15 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:15.828914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eb4e7d97-7b80-4d97-af42-725e0e82b7f8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:15.829785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eb4e7d97-7b80-4d97-af42-725e0e82b7f8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] [instance: c2328e1f-4118-416a-94bd-e0e51ab9002c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:15.841862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb4e7d97-7b80-4d97-af42-725e0e82b7f8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:15.842536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb4e7d97-7b80-4d97-af42-725e0e82b7f8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:15.843088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb4e7d97-7b80-4d97-af42-725e0e82b7f8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:15.843991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb4e7d97-7b80-4d97-af42-725e0e82b7f8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:15.844657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb4e7d97-7b80-4d97-af42-725e0e82b7f8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:15.845256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb4e7d97-7b80-4d97-af42-725e0e82b7f8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:15.860586 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-eb4e7d97-7b80-4d97-af42-725e0e82b7f8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] HTTP exception thrown: Instance c2328e1f-4118-416a-94bd-e0e51ab9002c could not be found. Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eb4e7d97-7b80-4d97-af42-725e0e82b7f8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Request method failure captured: Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c HTTP/1.1 Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY0XM8QMXsO-ZWeLvp9H3JP18koy_zrLLTsVcziqdA8AUhtRN2Nos8FUZnlA70cyyHoMhNRX0TLQgSONOWujMjpWXPVbcPTmCUURRh1f4AqUqjN2SB2hJ-XhwH2MKhkrUnx3BjFxywrtAfM4EYJd-Kplg-hPOnvY26JjHh1VMyYKT8 Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Openstack-Nova-Api-Version: 2.25 Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 437799e22df2433a83eca67987e942c6 Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1816350742 Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_437799e22df2433a83eca67987e942c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/437799e22df2433a83eca67987e942c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/437799e22df2433a83eca67987e942c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/437799e22df2433a83eca67987e942c6"}]}] Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1816350742 Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 437799e22df2433a83eca67987e942c6 Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1816350742 Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-LiveAutoBlockMigrationV225Test-1816350742-project Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d9f88a4c72854cff9bba7ed2920f55b0 Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1816350742-project Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance c2328e1f-4118-416a-94bd-e0e51ab9002c could not be found. Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'c2328e1f-4118-416a-94bd-e0e51ab9002c'} Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2328e1f-4118-416a-94bd-e0e51ab9002c could not be found. Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2328e1f-4118-416a-94bd-e0e51ab9002c could not be found. Sep 06 10:59:15.862568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:15.866705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:15.866705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:15.866705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:15.866705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:15.866705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:15.866705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:15.866705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:15.866705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2328e1f-4118-416a-94bd-e0e51ab9002c could not be found. Sep 06 10:59:15.866705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:15.868061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eb4e7d97-7b80-4d97-af42-725e0e82b7f8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] Returning 404 to user: Instance c2328e1f-4118-416a-94bd-e0e51ab9002c could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:15.869236 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eb4e7d97-7b80-4d97-af42-725e0e82b7f8 tempest-LiveAutoBlockMigrationV225Test-1816350742 tempest-LiveAutoBlockMigrationV225Test-1816350742-project] 10.222.0.20 "GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c" status: 404 len: 111 microversion: 2.25 time: 0.048411 Sep 06 10:59:15.870282 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1050/2063] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 10:59:15 2022] GET /compute/v2.1/servers/c2328e1f-4118-416a-94bd-e0e51ab9002c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:59:15.871894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-543f6d82-0e61-492f-a6c3-0e97a0173182 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:15.886964 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-543f6d82-0e61-492f-a6c3-0e97a0173182 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1315 microversion: 2.1 time: 0.403038 Sep 06 10:59:15.893630 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1014/2064] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:15 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:16.454954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9324eca3-668a-4b5c-a144-6b439d24a65a req-d7b24b9a-9e23-40fa-ae3d-e09d8d09585d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d094fe4-bcd7-4063-8266-a53ee8289624", "tag": "dcb59403-7cd4-4bf4-8790-d4e4297b0e12"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:16.473093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9324eca3-668a-4b5c-a144-6b439d24a65a req-d7b24b9a-9e23-40fa-ae3d-e09d8d09585d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:16.473820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9324eca3-668a-4b5c-a144-6b439d24a65a req-d7b24b9a-9e23-40fa-ae3d-e09d8d09585d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:16.474436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9324eca3-668a-4b5c-a144-6b439d24a65a req-d7b24b9a-9e23-40fa-ae3d-e09d8d09585d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:16.492207 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9324eca3-668a-4b5c-a144-6b439d24a65a req-d7b24b9a-9e23-40fa-ae3d-e09d8d09585d service nova] Creating event network-changed:dcb59403-7cd4-4bf4-8790-d4e4297b0e12 for instance 5d094fe4-bcd7-4063-8266-a53ee8289624 on nch2-master-1 Sep 06 10:59:16.499898 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9324eca3-668a-4b5c-a144-6b439d24a65a req-d7b24b9a-9e23-40fa-ae3d-e09d8d09585d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051356 Sep 06 10:59:16.501856 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1051/2065] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:16.699415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9eac9989-6631-488a-8b9a-4986cff8b4e5 req-2feb87f3-0fbd-4cfa-a264-c07f46fb6d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ecf20d-9dff-4421-be11-23b2fb67c1c3", "name": "network-vif-plugged", "status": "completed", "tag": "6ce7224e-a97f-4beb-bfad-419526ca6c7f"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:16.726944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9eac9989-6631-488a-8b9a-4986cff8b4e5 req-2feb87f3-0fbd-4cfa-a264-c07f46fb6d43 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:16.728995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9eac9989-6631-488a-8b9a-4986cff8b4e5 req-2feb87f3-0fbd-4cfa-a264-c07f46fb6d43 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:16.729697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9eac9989-6631-488a-8b9a-4986cff8b4e5 req-2feb87f3-0fbd-4cfa-a264-c07f46fb6d43 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:16.745550 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9eac9989-6631-488a-8b9a-4986cff8b4e5 req-2feb87f3-0fbd-4cfa-a264-c07f46fb6d43 service nova] Creating event network-vif-plugged:6ce7224e-a97f-4beb-bfad-419526ca6c7f for instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 on nch1-master-1 Sep 06 10:59:16.774752 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9eac9989-6631-488a-8b9a-4986cff8b4e5 req-2feb87f3-0fbd-4cfa-a264-c07f46fb6d43 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087247 Sep 06 10:59:16.778723 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1015/2066] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:16.849334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-305ec4b0-db4f-4a69-ab05-50ea42bb6b1c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:16.850178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-305ec4b0-db4f-4a69-ab05-50ea42bb6b1c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:16.861279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-305ec4b0-db4f-4a69-ab05-50ea42bb6b1c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:16.862243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-305ec4b0-db4f-4a69-ab05-50ea42bb6b1c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:16.862840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-305ec4b0-db4f-4a69-ab05-50ea42bb6b1c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:16.864146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-305ec4b0-db4f-4a69-ab05-50ea42bb6b1c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:16.864615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-305ec4b0-db4f-4a69-ab05-50ea42bb6b1c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:16.865235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-305ec4b0-db4f-4a69-ab05-50ea42bb6b1c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:16.920421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8fb45821-9b3f-4c7b-8f0b-d1fa672a3b4d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:16.920951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8fb45821-9b3f-4c7b-8f0b-d1fa672a3b4d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:16.932600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8fb45821-9b3f-4c7b-8f0b-d1fa672a3b4d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:16.933033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8fb45821-9b3f-4c7b-8f0b-d1fa672a3b4d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:16.933530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8fb45821-9b3f-4c7b-8f0b-d1fa672a3b4d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:16.934277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8fb45821-9b3f-4c7b-8f0b-d1fa672a3b4d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:16.934746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8fb45821-9b3f-4c7b-8f0b-d1fa672a3b4d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:16.935207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8fb45821-9b3f-4c7b-8f0b-d1fa672a3b4d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:17.785572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-305ec4b0-db4f-4a69-ab05-50ea42bb6b1c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:17.792101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8fb45821-9b3f-4c7b-8f0b-d1fa672a3b4d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:17.798201 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-305ec4b0-db4f-4a69-ab05-50ea42bb6b1c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1316 microversion: 2.1 time: 0.958727 Sep 06 10:59:17.800981 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1052/2067] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:16 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1316 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:17.814818 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8fb45821-9b3f-4c7b-8f0b-d1fa672a3b4d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1315 microversion: 2.1 time: 0.901099 Sep 06 10:59:17.817472 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1016/2068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:16 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:18.823150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a46a0d8d-7777-45d0-af98-f0ec817f3d15 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:18.823915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a46a0d8d-7777-45d0-af98-f0ec817f3d15 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:18.848230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a46a0d8d-7777-45d0-af98-f0ec817f3d15 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:18.849104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a46a0d8d-7777-45d0-af98-f0ec817f3d15 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:18.849763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a46a0d8d-7777-45d0-af98-f0ec817f3d15 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:18.852391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a46a0d8d-7777-45d0-af98-f0ec817f3d15 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:18.855071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a46a0d8d-7777-45d0-af98-f0ec817f3d15 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:18.855943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a46a0d8d-7777-45d0-af98-f0ec817f3d15 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:19.082498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-92bb1c8a-1d1a-474b-a2e9-6bb5de89e91f tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Action: 'create', calling method: .version_select at 0x7f90f856b700>, body: {"pool": null} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:19.491919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a46a0d8d-7777-45d0-af98-f0ec817f3d15 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:19.503299 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a46a0d8d-7777-45d0-af98-f0ec817f3d15 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1316 microversion: 2.1 time: 0.683512 Sep 06 10:59:19.530316 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1017/2069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:18 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1316 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:19.534723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e6545324-d784-450a-bcae-fc977693f8bd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:19.535669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e6545324-d784-450a-bcae-fc977693f8bd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:19.542459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6545324-d784-450a-bcae-fc977693f8bd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:19.544817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6545324-d784-450a-bcae-fc977693f8bd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:19.545473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6545324-d784-450a-bcae-fc977693f8bd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:19.547044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6545324-d784-450a-bcae-fc977693f8bd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:19.547824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6545324-d784-450a-bcae-fc977693f8bd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:19.548600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6545324-d784-450a-bcae-fc977693f8bd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:19.904931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e6545324-d784-450a-bcae-fc977693f8bd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:19.920909 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e6545324-d784-450a-bcae-fc977693f8bd tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1501 microversion: 2.1 time: 0.392101 Sep 06 10:59:19.922600 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1018/2070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:19 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1501 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:19.949755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c4acf360-1b65-401c-b71c-755f5fb1f5e6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:19.951507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c4acf360-1b65-401c-b71c-755f5fb1f5e6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:19.971797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4acf360-1b65-401c-b71c-755f5fb1f5e6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:19.973298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4acf360-1b65-401c-b71c-755f5fb1f5e6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:19.981355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4acf360-1b65-401c-b71c-755f5fb1f5e6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:19.981355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4acf360-1b65-401c-b71c-755f5fb1f5e6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:19.981355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4acf360-1b65-401c-b71c-755f5fb1f5e6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:19.981355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4acf360-1b65-401c-b71c-755f5fb1f5e6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:20.280618 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c4acf360-1b65-401c-b71c-755f5fb1f5e6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "POST /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3/action" status: 202 len: 0 microversion: 2.1 time: 0.338438 Sep 06 10:59:20.281872 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1019/2071] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:59:19 2022] POST /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:59:20.290295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c6dd7b85-5fb4-4572-89d3-6d62b7bc3db2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:20.300277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c6dd7b85-5fb4-4572-89d3-6d62b7bc3db2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:20.309399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:20.311515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6dd7b85-5fb4-4572-89d3-6d62b7bc3db2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:20.312722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6dd7b85-5fb4-4572-89d3-6d62b7bc3db2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:20.313389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6dd7b85-5fb4-4572-89d3-6d62b7bc3db2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:20.314269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6dd7b85-5fb4-4572-89d3-6d62b7bc3db2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:20.314875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6dd7b85-5fb4-4572-89d3-6d62b7bc3db2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:20.315479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6dd7b85-5fb4-4572-89d3-6d62b7bc3db2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:20.715418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c6dd7b85-5fb4-4572-89d3-6d62b7bc3db2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:20.725794 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c6dd7b85-5fb4-4572-89d3-6d62b7bc3db2 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1506 microversion: 2.1 time: 0.439790 Sep 06 10:59:20.730955 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1020/2072] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:20 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:20.745671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f4426b1e-cae7-4172-a56b-cfab63d72033 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:20.765599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f4426b1e-cae7-4172-a56b-cfab63d72033 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:20.773816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4426b1e-cae7-4172-a56b-cfab63d72033 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:20.774357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4426b1e-cae7-4172-a56b-cfab63d72033 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:20.776082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4426b1e-cae7-4172-a56b-cfab63d72033 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:20.777574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4426b1e-cae7-4172-a56b-cfab63d72033 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:20.778282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4426b1e-cae7-4172-a56b-cfab63d72033 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:20.778954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4426b1e-cae7-4172-a56b-cfab63d72033 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:21.697115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f4426b1e-cae7-4172-a56b-cfab63d72033 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:21.709947 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f4426b1e-cae7-4172-a56b-cfab63d72033 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1316 microversion: 2.1 time: 0.979289 Sep 06 10:59:21.711170 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1021/2073] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:20 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1316 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:21.752358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-66bff5f5-6c49-408e-9655-9c1f98b2245d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:21.754501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-66bff5f5-6c49-408e-9655-9c1f98b2245d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:21.760183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66bff5f5-6c49-408e-9655-9c1f98b2245d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:21.760878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66bff5f5-6c49-408e-9655-9c1f98b2245d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:21.761484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66bff5f5-6c49-408e-9655-9c1f98b2245d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:21.762525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66bff5f5-6c49-408e-9655-9c1f98b2245d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:21.763264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66bff5f5-6c49-408e-9655-9c1f98b2245d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:21.763862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66bff5f5-6c49-408e-9655-9c1f98b2245d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:22.375484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-66bff5f5-6c49-408e-9655-9c1f98b2245d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:22.389986 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-66bff5f5-6c49-408e-9655-9c1f98b2245d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1486 microversion: 2.1 time: 0.642096 Sep 06 10:59:22.394566 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1022/2074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:21 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1486 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:22.419499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-508096b9-0931-4a40-a6e6-552a85ff83bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:22.421980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-508096b9-0931-4a40-a6e6-552a85ff83bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:22.442731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-508096b9-0931-4a40-a6e6-552a85ff83bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:22.443501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-508096b9-0931-4a40-a6e6-552a85ff83bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:22.444064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-508096b9-0931-4a40-a6e6-552a85ff83bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:22.444920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-508096b9-0931-4a40-a6e6-552a85ff83bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:22.445616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-508096b9-0931-4a40-a6e6-552a85ff83bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:22.446160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-508096b9-0931-4a40-a6e6-552a85ff83bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:22.501362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-508096b9-0931-4a40-a6e6-552a85ff83bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:59:22.904571 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-508096b9-0931-4a40-a6e6-552a85ff83bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 204 len: 0 microversion: 2.1 time: 0.489751 Sep 06 10:59:22.906223 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1023/2075] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:59:22 2022] DELETE /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:59:22.922554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d66fcbb2-ff34-47cc-91f6-5faeb82956da tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:22.924970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d66fcbb2-ff34-47cc-91f6-5faeb82956da tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:22.964128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d66fcbb2-ff34-47cc-91f6-5faeb82956da tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:22.966851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d66fcbb2-ff34-47cc-91f6-5faeb82956da tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:22.968907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d66fcbb2-ff34-47cc-91f6-5faeb82956da tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:22.969915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d66fcbb2-ff34-47cc-91f6-5faeb82956da tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:22.973519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d66fcbb2-ff34-47cc-91f6-5faeb82956da tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:22.974305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d66fcbb2-ff34-47cc-91f6-5faeb82956da tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:23.439078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d66fcbb2-ff34-47cc-91f6-5faeb82956da tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:23.447727 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d66fcbb2-ff34-47cc-91f6-5faeb82956da tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1316 microversion: 2.1 time: 0.536404 Sep 06 10:59:23.448828 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1024/2076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:22 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1316 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:23.454642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a7f71055-2ef9-43b9-bddb-c718b0c8aa79 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:23.455687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a7f71055-2ef9-43b9-bddb-c718b0c8aa79 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:23.462776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7f71055-2ef9-43b9-bddb-c718b0c8aa79 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:23.463534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7f71055-2ef9-43b9-bddb-c718b0c8aa79 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:23.464176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7f71055-2ef9-43b9-bddb-c718b0c8aa79 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:23.465068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7f71055-2ef9-43b9-bddb-c718b0c8aa79 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:23.465831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7f71055-2ef9-43b9-bddb-c718b0c8aa79 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:23.466422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7f71055-2ef9-43b9-bddb-c718b0c8aa79 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:23.703985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a7f71055-2ef9-43b9-bddb-c718b0c8aa79 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:23.719101 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a7f71055-2ef9-43b9-bddb-c718b0c8aa79 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1492 microversion: 2.1 time: 0.268951 Sep 06 10:59:23.723487 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1025/2077] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:23 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1492 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:23.728580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-7ab0aa17-890d-4018-be13-770d4ed25842 req-f6292cf3-8a53-478d-87e3-f1b8a9b1e62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d094fe4-bcd7-4063-8266-a53ee8289624", "name": "network-vif-plugged", "status": "completed", "tag": "dcb59403-7cd4-4bf4-8790-d4e4297b0e12"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:23.743439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7ab0aa17-890d-4018-be13-770d4ed25842 req-f6292cf3-8a53-478d-87e3-f1b8a9b1e62b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:23.743917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7ab0aa17-890d-4018-be13-770d4ed25842 req-f6292cf3-8a53-478d-87e3-f1b8a9b1e62b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:23.748602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7ab0aa17-890d-4018-be13-770d4ed25842 req-f6292cf3-8a53-478d-87e3-f1b8a9b1e62b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:23.765258 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7ab0aa17-890d-4018-be13-770d4ed25842 req-f6292cf3-8a53-478d-87e3-f1b8a9b1e62b service nova] Creating event network-vif-plugged:dcb59403-7cd4-4bf4-8790-d4e4297b0e12 for instance 5d094fe4-bcd7-4063-8266-a53ee8289624 on nch2-master-1 Sep 06 10:59:23.770597 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-7ab0aa17-890d-4018-be13-770d4ed25842 req-f6292cf3-8a53-478d-87e3-f1b8a9b1e62b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049532 Sep 06 10:59:23.771489 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1026/2078] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:23.778547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-769359cc-c3f3-48d6-ad39-059ac40f085e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:23.778547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-769359cc-c3f3-48d6-ad39-059ac40f085e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:23.784278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-769359cc-c3f3-48d6-ad39-059ac40f085e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:23.784775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-769359cc-c3f3-48d6-ad39-059ac40f085e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:23.785251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-769359cc-c3f3-48d6-ad39-059ac40f085e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:23.785968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-769359cc-c3f3-48d6-ad39-059ac40f085e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:23.786432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-769359cc-c3f3-48d6-ad39-059ac40f085e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:23.786872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-769359cc-c3f3-48d6-ad39-059ac40f085e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:23.818637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-769359cc-c3f3-48d6-ad39-059ac40f085e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:59:23.837015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:24.139292 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-92bb1c8a-1d1a-474b-a2e9-6bb5de89e91f tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.414222 Sep 06 10:59:24.140298 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1053/2079] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Sep 6 10:59:18 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:24.143163 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-769359cc-c3f3-48d6-ad39-059ac40f085e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "DELETE /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 204 len: 0 microversion: 2.1 time: 0.370124 Sep 06 10:59:24.146062 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1027/2080] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:59:23 2022] DELETE /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:59:24.152624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a4340d3b-f66c-407a-9550-6cc6f30e3b21 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:24.153085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-953e7429-5b03-4c8b-982a-075f10a9a8c5 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Calling method '.version_select at 0x7f90f857e8b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:24.153247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a4340d3b-f66c-407a-9550-6cc6f30e3b21 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:24.161289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4340d3b-f66c-407a-9550-6cc6f30e3b21 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:24.163472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4340d3b-f66c-407a-9550-6cc6f30e3b21 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:24.163472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4340d3b-f66c-407a-9550-6cc6f30e3b21 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:24.163472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4340d3b-f66c-407a-9550-6cc6f30e3b21 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:24.164210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4340d3b-f66c-407a-9550-6cc6f30e3b21 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:24.164719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4340d3b-f66c-407a-9550-6cc6f30e3b21 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:24.404023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a4340d3b-f66c-407a-9550-6cc6f30e3b21 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:24.411064 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-953e7429-5b03-4c8b-982a-075f10a9a8c5 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/278cd159-ef97-4bfe-84c3-2d55717f5880" status: 200 len: 141 microversion: 2.1 time: 0.261843 Sep 06 10:59:24.413139 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1028/2081] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 10:59:24 2022] GET /compute/v2.1/os-floating-ips/278cd159-ef97-4bfe-84c3-2d55717f5880 => generated 141 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:24.420027 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a4340d3b-f66c-407a-9550-6cc6f30e3b21 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1669 microversion: 2.1 time: 0.271039 Sep 06 10:59:24.420570 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1054/2082] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:24 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1669 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:24.437299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4d8e8296-f451-4e3f-b4ab-611697dcb456 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Calling method '.version_select at 0x7f90f8b7d3a0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:24.473064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-535ab5e5-eb80-4538-b39d-7f706631833b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:24.474184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-535ab5e5-eb80-4538-b39d-7f706631833b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:24.485803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-535ab5e5-eb80-4538-b39d-7f706631833b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:24.487376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-535ab5e5-eb80-4538-b39d-7f706631833b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:24.488116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-535ab5e5-eb80-4538-b39d-7f706631833b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:24.489743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-535ab5e5-eb80-4538-b39d-7f706631833b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:24.491924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-535ab5e5-eb80-4538-b39d-7f706631833b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:24.492494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-535ab5e5-eb80-4538-b39d-7f706631833b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:24.706182 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4d8e8296-f451-4e3f-b4ab-611697dcb456 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.282429 Sep 06 10:59:24.706998 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1029/2083] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 10:59:24 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:24.720579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-94808a59-432a-4ddb-bfe6-6eccd891a693 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Calling method '.version_select at 0x7f90fd188dc0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:25.027825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-535ab5e5-eb80-4538-b39d-7f706631833b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:25.043333 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-535ab5e5-eb80-4538-b39d-7f706631833b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1316 microversion: 2.1 time: 0.575674 Sep 06 10:59:25.044611 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1055/2084] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:24 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1316 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:25.056127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1be48871-1b30-44e0-942c-a5effcffeac5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:25.057521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1be48871-1b30-44e0-942c-a5effcffeac5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:25.067208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1be48871-1b30-44e0-942c-a5effcffeac5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:25.067745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1be48871-1b30-44e0-942c-a5effcffeac5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:25.069327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1be48871-1b30-44e0-942c-a5effcffeac5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:25.069939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1be48871-1b30-44e0-942c-a5effcffeac5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:25.070409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1be48871-1b30-44e0-942c-a5effcffeac5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:25.071114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1be48871-1b30-44e0-942c-a5effcffeac5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:25.895766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1be48871-1b30-44e0-942c-a5effcffeac5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:25.906191 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1be48871-1b30-44e0-942c-a5effcffeac5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1492 microversion: 2.1 time: 0.859781 Sep 06 10:59:25.922122 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1056/2085] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:25 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1492 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:25.934810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8b71fdb4-eaee-4391-9f16-ea309eb1b781 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:25.935665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8b71fdb4-eaee-4391-9f16-ea309eb1b781 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:25.944598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b71fdb4-eaee-4391-9f16-ea309eb1b781 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:25.945183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b71fdb4-eaee-4391-9f16-ea309eb1b781 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:25.945678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b71fdb4-eaee-4391-9f16-ea309eb1b781 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:25.946401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b71fdb4-eaee-4391-9f16-ea309eb1b781 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:25.947056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b71fdb4-eaee-4391-9f16-ea309eb1b781 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:25.947867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b71fdb4-eaee-4391-9f16-ea309eb1b781 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:26.144947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8b71fdb4-eaee-4391-9f16-ea309eb1b781 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:26.157300 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8b71fdb4-eaee-4391-9f16-ea309eb1b781 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 200 len: 1602 microversion: 2.1 time: 0.233740 Sep 06 10:59:26.158036 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1057/2086] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:25 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 1602 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:26.165974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-675bf411-982d-4043-9955-4f9b60d79970 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:26.172577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-675bf411-982d-4043-9955-4f9b60d79970 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:26.173816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-675bf411-982d-4043-9955-4f9b60d79970 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:26.174323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-675bf411-982d-4043-9955-4f9b60d79970 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:26.174811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-675bf411-982d-4043-9955-4f9b60d79970 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:26.175616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-675bf411-982d-4043-9955-4f9b60d79970 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:26.176324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-675bf411-982d-4043-9955-4f9b60d79970 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:26.176783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-675bf411-982d-4043-9955-4f9b60d79970 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:26.660096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-675bf411-982d-4043-9955-4f9b60d79970 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:26.668956 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-675bf411-982d-4043-9955-4f9b60d79970 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1504 microversion: 2.1 time: 0.509215 Sep 06 10:59:26.669666 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1058/2087] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:26 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1504 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:26.693521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-89e6d3e0-c58e-4969-845c-f7d4ce6d6e50 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1940714931"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:26.694295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-89e6d3e0-c58e-4969-845c-f7d4ce6d6e50 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:26.703521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89e6d3e0-c58e-4969-845c-f7d4ce6d6e50 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:26.704541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89e6d3e0-c58e-4969-845c-f7d4ce6d6e50 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:26.705083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89e6d3e0-c58e-4969-845c-f7d4ce6d6e50 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:26.706538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89e6d3e0-c58e-4969-845c-f7d4ce6d6e50 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:26.707303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89e6d3e0-c58e-4969-845c-f7d4ce6d6e50 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:26.711241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89e6d3e0-c58e-4969-845c-f7d4ce6d6e50 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:27.451096 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.network.security_group_api [None req-89e6d3e0-c58e-4969-845c-f7d4ce6d6e50 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Adding security group f91a18be-db27-4c9f-99a7-12542d081b4a to port dcb59403-7cd4-4bf4-8790-d4e4297b0e12 Sep 06 10:59:28.142957 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-94808a59-432a-4ddb-bfe6-6eccd891a693 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/278cd159-ef97-4bfe-84c3-2d55717f5880" status: 202 len: 0 microversion: 2.1 time: 3.426654 Sep 06 10:59:28.150998 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1030/2088] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 10:59:24 2022] DELETE /compute/v2.1/os-floating-ips/278cd159-ef97-4bfe-84c3-2d55717f5880 => generated 0 bytes in 3429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 10:59:28.150998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f030ae41-6d1c-4058-a85e-f5d12dd8fbff tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:28.162599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f030ae41-6d1c-4058-a85e-f5d12dd8fbff tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:28.165625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f030ae41-6d1c-4058-a85e-f5d12dd8fbff tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Searching by: {'deleted': False, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:59:28.182914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f030ae41-6d1c-4058-a85e-f5d12dd8fbff tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:28.183740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f030ae41-6d1c-4058-a85e-f5d12dd8fbff tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:28.184266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f030ae41-6d1c-4058-a85e-f5d12dd8fbff tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:28.185099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f030ae41-6d1c-4058-a85e-f5d12dd8fbff tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:28.185792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f030ae41-6d1c-4058-a85e-f5d12dd8fbff tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:28.186331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f030ae41-6d1c-4058-a85e-f5d12dd8fbff tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:28.230528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-f030ae41-6d1c-4058-a85e-f5d12dd8fbff tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:59:28.284303 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f030ae41-6d1c-4058-a85e-f5d12dd8fbff tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.139155 Sep 06 10:59:28.285696 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1031/2089] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 10:59:28 2022] GET /compute/v2.1/servers => generated 334 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:28.344308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f026860f-621d-4ead-9d48-4475637c0699 req-b8aa901e-f1c6-4791-9425-289d326010a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21485351-3c21-4970-9d57-310eff94abb2", "name": "network-vif-deleted", "tag": "7ac72bf1-22cc-4a06-8e37-4e7576503af8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:28.387235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f026860f-621d-4ead-9d48-4475637c0699 req-b8aa901e-f1c6-4791-9425-289d326010a7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:28.387235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f026860f-621d-4ead-9d48-4475637c0699 req-b8aa901e-f1c6-4791-9425-289d326010a7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:28.387235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f026860f-621d-4ead-9d48-4475637c0699 req-b8aa901e-f1c6-4791-9425-289d326010a7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:28.421649 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f026860f-621d-4ead-9d48-4475637c0699 req-b8aa901e-f1c6-4791-9425-289d326010a7 service nova] Creating event network-vif-deleted:7ac72bf1-22cc-4a06-8e37-4e7576503af8 for instance 21485351-3c21-4970-9d57-310eff94abb2 on nch1-master-1 Sep 06 10:59:28.432481 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f026860f-621d-4ead-9d48-4475637c0699 req-b8aa901e-f1c6-4791-9425-289d326010a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144378 Sep 06 10:59:28.433547 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1032/2090] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:28.444422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:28.446350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:28.466895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:28.467917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:28.468716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:28.470952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:28.471727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:28.475337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:28.549391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:28.549994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:28.550570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:28.551146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lazy-loading 'fault' on Instance uuid 21ecf20d-9dff-4421-be11-23b2fb67c1c3 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:59:28.623484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:28.630275 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d16f8ccf-8721-4daf-9b97-ea91d727afb8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 200 len: 1305 microversion: 2.1 time: 0.194585 Sep 06 10:59:28.646810 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1033/2091] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:28 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 1305 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:28.657404 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-89e6d3e0-c58e-4969-845c-f7d4ce6d6e50 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624/action" status: 202 len: 0 microversion: 2.1 time: 1.968203 Sep 06 10:59:28.658728 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1059/2092] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:59:26 2022] POST /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624/action => generated 0 bytes in 1971 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 10:59:28.665056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-75b785bd-35d4-4a21-a2b2-1f25047494fb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:28.669504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-75b785bd-35d4-4a21-a2b2-1f25047494fb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 21485351-3c21-4970-9d57-310eff94abb2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:28.671843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-3c8c392c-7d93-41ca-8350-b9f3e92cb276 req-5f3b8475-92b6-4055-83e0-b50d2be62a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ecf20d-9dff-4421-be11-23b2fb67c1c3", "name": "network-vif-deleted", "tag": "6ce7224e-a97f-4beb-bfad-419526ca6c7f"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:28.683845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75b785bd-35d4-4a21-a2b2-1f25047494fb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:28.689610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75b785bd-35d4-4a21-a2b2-1f25047494fb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:28.690373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75b785bd-35d4-4a21-a2b2-1f25047494fb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:28.690782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3c8c392c-7d93-41ca-8350-b9f3e92cb276 req-5f3b8475-92b6-4055-83e0-b50d2be62a52 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:28.691301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3c8c392c-7d93-41ca-8350-b9f3e92cb276 req-5f3b8475-92b6-4055-83e0-b50d2be62a52 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:28.691738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3c8c392c-7d93-41ca-8350-b9f3e92cb276 req-5f3b8475-92b6-4055-83e0-b50d2be62a52 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:28.692672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75b785bd-35d4-4a21-a2b2-1f25047494fb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:28.693362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75b785bd-35d4-4a21-a2b2-1f25047494fb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:28.694018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75b785bd-35d4-4a21-a2b2-1f25047494fb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:28.719216 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-3c8c392c-7d93-41ca-8350-b9f3e92cb276 req-5f3b8475-92b6-4055-83e0-b50d2be62a52 service nova] Creating event network-vif-deleted:6ce7224e-a97f-4beb-bfad-419526ca6c7f for instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 on nch1-master-1 Sep 06 10:59:28.723490 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-75b785bd-35d4-4a21-a2b2-1f25047494fb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] HTTP exception thrown: Instance 21485351-3c21-4970-9d57-310eff94abb2 could not be found. Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-75b785bd-35d4-4a21-a2b2-1f25047494fb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Request method failure captured: Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 HTTP/1.1 Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY4vX_-GQFSvlCFpCM_88XOXPnenmn0IC5GvqKRyIJOSaj8HG5Q0AH3SmJN09UhNSHS4fTGKIVCxon8ypZc0I1z3-YkDZjIVpQyOp7ONgTOGirC-U7-JdcbqucQimeJhIZoUZlsDUBna-Zj5FutqaCYPx3uWvNkNtCNBA0PqAWK-SE Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: fb1af95268504c5bbed702fce756f5f4 Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-LiveMigrationTest-1600938040 Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb1af95268504c5bbed702fce756f5f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb1af95268504c5bbed702fce756f5f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb1af95268504c5bbed702fce756f5f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb1af95268504c5bbed702fce756f5f4"}]}] Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-LiveMigrationTest-1600938040 Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: fb1af95268504c5bbed702fce756f5f4 Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-LiveMigrationTest-1600938040 Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-LiveMigrationTest-1600938040-project Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: c4e1ac1b40e94dbc80548a1f45919b6f Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-LiveMigrationTest-1600938040-project Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 21485351-3c21-4970-9d57-310eff94abb2 could not be found. Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '21485351-3c21-4970-9d57-310eff94abb2'} Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21485351-3c21-4970-9d57-310eff94abb2 could not be found. Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21485351-3c21-4970-9d57-310eff94abb2 could not be found. Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:28.726172 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:28.735417 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:28.735417 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:28.735417 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:28.735417 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:28.735417 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:28.735417 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21485351-3c21-4970-9d57-310eff94abb2 could not be found. Sep 06 10:59:28.735417 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:28.735417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-75b785bd-35d4-4a21-a2b2-1f25047494fb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Returning 404 to user: Instance 21485351-3c21-4970-9d57-310eff94abb2 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:28.735417 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-75b785bd-35d4-4a21-a2b2-1f25047494fb tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2" status: 404 len: 111 microversion: 2.1 time: 0.069385 Sep 06 10:59:28.735417 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1060/2093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:28 2022] GET /compute/v2.1/servers/21485351-3c21-4970-9d57-310eff94abb2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:28.736004 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-3c8c392c-7d93-41ca-8350-b9f3e92cb276 req-5f3b8475-92b6-4055-83e0-b50d2be62a52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082366 Sep 06 10:59:28.736004 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1034/2094] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:28.742310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9e9c62a6-a356-4ecb-a94d-47cf234b6be1 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Action: 'create', calling method: .version_select at 0x7f90f85b8af0>, body: {"pool": null} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:28.746375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:28.759436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:28.760341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Searching by: {'deleted': False, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 10:59:28.773801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:28.775447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:28.777351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:28.777351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:28.778121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:28.778945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:28.823557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 10:59:28.943726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:28.966221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:28.966818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:28.967297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:29.390230 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d16d774e-b30e-4010-9107-32467393219d tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.651540 Sep 06 10:59:29.391704 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1035/2095] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 10:59:28 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:29.400409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a0ecda84-5133-4fb7-9731-801e96f9ea49 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f8767e50>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:29.817245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG neutronclient.v2_0.client [None req-a0ecda84-5133-4fb7-9731-801e96f9ea49 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f91a18be-db27-4c9f-99a7-12542d081b4a in use.", "detail": ""}} {{(pid=140875) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:59:29.818140 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-a0ecda84-5133-4fb7-9731-801e96f9ea49 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Security Group f91a18be-db27-4c9f-99a7-12542d081b4a in use. Sep 06 10:59:29.818140 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-bd34cc89-5e9b-49e6-9eaf-36e823b748fa'] Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a0ecda84-5133-4fb7-9731-801e96f9ea49 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/os-security-groups/f91a18be-db27-4c9f-99a7-12542d081b4a HTTP/1.1 Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: exception: Security Group f91a18be-db27-4c9f-99a7-12542d081b4a in use. Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-bd34cc89-5e9b-49e6-9eaf-36e823b748fa'] Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'f91a18be-db27-4c9f-99a7-12542d081b4a'} Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:59:29.820528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f91a18be-db27-4c9f-99a7-12542d081b4a in use. Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd34cc89-5e9b-49e6-9eaf-36e823b748fa'] Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f91a18be-db27-4c9f-99a7-12542d081b4a in use. Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd34cc89-5e9b-49e6-9eaf-36e823b748fa'] Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f91a18be-db27-4c9f-99a7-12542d081b4a in use. Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd34cc89-5e9b-49e6-9eaf-36e823b748fa'] Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f91a18be-db27-4c9f-99a7-12542d081b4a in use. Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd34cc89-5e9b-49e6-9eaf-36e823b748fa'] Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a0ecda84-5133-4fb7-9731-801e96f9ea49 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 400 to user: Security Group f91a18be-db27-4c9f-99a7-12542d081b4a in use. Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-bd34cc89-5e9b-49e6-9eaf-36e823b748fa'] {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a0ecda84-5133-4fb7-9731-801e96f9ea49 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f91a18be-db27-4c9f-99a7-12542d081b4a" status: 400 len: 185 microversion: 2.1 time: 0.429846 Sep 06 10:59:29.829269 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1036/2096] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:59:29 2022] DELETE /compute/v2.1/os-security-groups/f91a18be-db27-4c9f-99a7-12542d081b4a => generated 185 bytes in 431 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 10:59:29.832086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e3e98c1f-44a1-45aa-a088-92fdd8b4689a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '.version_select at 0x7f90f8058a60>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:29.930005 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e3e98c1f-44a1-45aa-a088-92fdd8b4689a tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619655621" status: 202 len: 0 microversion: 2.1 time: 0.105465 Sep 06 10:59:29.931616 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1037/2097] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 10:59:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619655621 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:59:29.937071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b7430545-c9a1-4fd9-8fe4-2731d7dcc08f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:29.947589 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b7430545-c9a1-4fd9-8fe4-2731d7dcc08f tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014712 Sep 06 10:59:29.948891 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1038/2098] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 10:59:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:29.954754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7c3b4a2e-0119-439b-b91e-98dc179abaa3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:29.955532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7c3b4a2e-0119-439b-b91e-98dc179abaa3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:29.961898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c3b4a2e-0119-439b-b91e-98dc179abaa3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:29.965283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c3b4a2e-0119-439b-b91e-98dc179abaa3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:29.965283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c3b4a2e-0119-439b-b91e-98dc179abaa3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:29.965283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c3b4a2e-0119-439b-b91e-98dc179abaa3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:29.965283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c3b4a2e-0119-439b-b91e-98dc179abaa3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:29.965283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c3b4a2e-0119-439b-b91e-98dc179abaa3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-7c3b4a2e-0119-439b-b91e-98dc179abaa3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7c3b4a2e-0119-439b-b91e-98dc179abaa3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 HTTP/1.1 Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '21ecf20d-9dff-4421-be11-23b2fb67c1c3'} Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:59:29.986437 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7c3b4a2e-0119-439b-b91e-98dc179abaa3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7c3b4a2e-0119-439b-b91e-98dc179abaa3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 404 len: 111 microversion: 2.1 time: 0.037735 Sep 06 10:59:29.991251 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1039/2099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:29 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:29.998230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c867489-1005-4589-9d5c-03d74cc87868 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:30.001090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c867489-1005-4589-9d5c-03d74cc87868 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:30.008583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c867489-1005-4589-9d5c-03d74cc87868 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:30.016274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c867489-1005-4589-9d5c-03d74cc87868 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:30.016274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c867489-1005-4589-9d5c-03d74cc87868 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:30.016274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c867489-1005-4589-9d5c-03d74cc87868 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:30.016274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c867489-1005-4589-9d5c-03d74cc87868 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:30.016274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c867489-1005-4589-9d5c-03d74cc87868 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:30.304075 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c867489-1005-4589-9d5c-03d74cc87868 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624/action" status: 202 len: 0 microversion: 2.1 time: 0.314475 Sep 06 10:59:30.305861 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1040/2100] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:59:29 2022] POST /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:59:30.314111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1406198615", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "9312fcea-ff98-4f9b-847c-17d6e7290268"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:30.377963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] validate_networks() for [('9312fcea-ff98-4f9b-847c-17d6e7290268', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:59:31.742632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:59:31.743163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:59:31.743746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:59:31.744069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:59:31.744483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:59:31.757114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:31.758099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:31.759427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:31.760245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:31.760711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:31.761148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:31.781511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:59:31.787279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for user e19903666a1243e3a66411e30babe299 and project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:59:31.800883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:59:31.803490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:59:31.999549 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3122fe42-db4c-4676-b850-c136a9591754 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.690391 Sep 06 10:59:32.002022 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1041/2101] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:59:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 10:59:32.029400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-74fde505-191c-4696-989b-14a6cf258802 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:32.032169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-74fde505-191c-4696-989b-14a6cf258802 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:32.049018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74fde505-191c-4696-989b-14a6cf258802 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:32.051329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74fde505-191c-4696-989b-14a6cf258802 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:32.051329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74fde505-191c-4696-989b-14a6cf258802 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:32.057717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74fde505-191c-4696-989b-14a6cf258802 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:32.058331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74fde505-191c-4696-989b-14a6cf258802 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:32.058859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74fde505-191c-4696-989b-14a6cf258802 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:32.105617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-74fde505-191c-4696-989b-14a6cf258802 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:59:32.653226 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-74fde505-191c-4696-989b-14a6cf258802 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "DELETE /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 204 len: 0 microversion: 2.1 time: 0.648777 Sep 06 10:59:32.654139 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1042/2102] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:59:32 2022] DELETE /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:59:32.663342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b6f4e8d7-7f05-411f-ab45-d402835aff10 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:32.664278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b6f4e8d7-7f05-411f-ab45-d402835aff10 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:32.672648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6f4e8d7-7f05-411f-ab45-d402835aff10 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:32.673067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6f4e8d7-7f05-411f-ab45-d402835aff10 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:32.673670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6f4e8d7-7f05-411f-ab45-d402835aff10 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:32.675082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6f4e8d7-7f05-411f-ab45-d402835aff10 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:32.675699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6f4e8d7-7f05-411f-ab45-d402835aff10 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:32.676285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6f4e8d7-7f05-411f-ab45-d402835aff10 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:33.346296 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9e9c62a6-a356-4ecb-a94d-47cf234b6be1 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.614841 Sep 06 10:59:33.347339 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1061/2103] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Sep 6 10:59:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:33.352372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-6515bc45-fdc6-4b4e-b7eb-5ad6b5233621 req-7013f6e9-f040-44ee-9c5d-386b5a32b677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d094fe4-bcd7-4063-8266-a53ee8289624", "tag": "dcb59403-7cd4-4bf4-8790-d4e4297b0e12"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:33.371538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6515bc45-fdc6-4b4e-b7eb-5ad6b5233621 req-7013f6e9-f040-44ee-9c5d-386b5a32b677 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:33.372502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6515bc45-fdc6-4b4e-b7eb-5ad6b5233621 req-7013f6e9-f040-44ee-9c5d-386b5a32b677 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:33.373161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6515bc45-fdc6-4b4e-b7eb-5ad6b5233621 req-7013f6e9-f040-44ee-9c5d-386b5a32b677 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:33.376687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b6f4e8d7-7f05-411f-ab45-d402835aff10 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:33.387391 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b6f4e8d7-7f05-411f-ab45-d402835aff10 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1580 microversion: 2.1 time: 0.731788 Sep 06 10:59:33.387987 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1043/2104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:32 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1580 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:33.399290 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-6515bc45-fdc6-4b4e-b7eb-5ad6b5233621 req-7013f6e9-f040-44ee-9c5d-386b5a32b677 service nova] Creating event network-changed:dcb59403-7cd4-4bf4-8790-d4e4297b0e12 for instance 5d094fe4-bcd7-4063-8266-a53ee8289624 on nch2-master-1 Sep 06 10:59:33.411350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cadb4db2-fe41-403c-b50a-f566a1a04f89 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:33.411350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cadb4db2-fe41-403c-b50a-f566a1a04f89 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:33.415492 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-6515bc45-fdc6-4b4e-b7eb-5ad6b5233621 req-7013f6e9-f040-44ee-9c5d-386b5a32b677 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066814 Sep 06 10:59:33.416123 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1062/2105] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:33.418109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cadb4db2-fe41-403c-b50a-f566a1a04f89 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:33.418637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cadb4db2-fe41-403c-b50a-f566a1a04f89 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:33.419436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cadb4db2-fe41-403c-b50a-f566a1a04f89 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:33.420159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cadb4db2-fe41-403c-b50a-f566a1a04f89 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:33.421172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cadb4db2-fe41-403c-b50a-f566a1a04f89 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:33.421614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cadb4db2-fe41-403c-b50a-f566a1a04f89 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:33.423112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ef37bded-3b18-49ab-8294-90cb542bd078 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:33.423830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ef37bded-3b18-49ab-8294-90cb542bd078 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:33.430759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef37bded-3b18-49ab-8294-90cb542bd078 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:33.431247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef37bded-3b18-49ab-8294-90cb542bd078 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:33.431698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef37bded-3b18-49ab-8294-90cb542bd078 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:33.432415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef37bded-3b18-49ab-8294-90cb542bd078 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:33.432883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef37bded-3b18-49ab-8294-90cb542bd078 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:33.433333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef37bded-3b18-49ab-8294-90cb542bd078 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:33.438477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:33.454266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cadb4db2-fe41-403c-b50a-f566a1a04f89 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:59:33.534249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ef37bded-3b18-49ab-8294-90cb542bd078 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:33.542953 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ef37bded-3b18-49ab-8294-90cb542bd078 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1219 microversion: 2.1 time: 0.125391 Sep 06 10:59:33.544218 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1063/2106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:33 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:33.549243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba78e779-6055-4172-8372-e8e5899850e3 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:33.550336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ba78e779-6055-4172-8372-e8e5899850e3 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:33.556904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba78e779-6055-4172-8372-e8e5899850e3 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:33.557571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba78e779-6055-4172-8372-e8e5899850e3 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:33.558195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba78e779-6055-4172-8372-e8e5899850e3 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:33.559103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba78e779-6055-4172-8372-e8e5899850e3 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:33.559737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba78e779-6055-4172-8372-e8e5899850e3 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:33.560204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba78e779-6055-4172-8372-e8e5899850e3 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:33.820340 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cadb4db2-fe41-403c-b50a-f566a1a04f89 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "DELETE /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 204 len: 0 microversion: 2.1 time: 0.419186 Sep 06 10:59:33.820472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ba78e779-6055-4172-8372-e8e5899850e3 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:33.820598 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1044/2107] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:59:33 2022] DELETE /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:59:33.820598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24d59668-1f41-4da1-acf4-a30e011b35ad tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Calling method '.version_select at 0x7f90f8a6aa60>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:33.823107 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ba78e779-6055-4172-8372-e8e5899850e3 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1701 microversion: 2.1 time: 0.278049 Sep 06 10:59:33.824262 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1064/2108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:33 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1701 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:33.829191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3255e795-b3dd-4f83-aa26-2b9c2cec1866 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:33.830092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3255e795-b3dd-4f83-aa26-2b9c2cec1866 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:33.836810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3255e795-b3dd-4f83-aa26-2b9c2cec1866 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:33.837577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3255e795-b3dd-4f83-aa26-2b9c2cec1866 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:33.838082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3255e795-b3dd-4f83-aa26-2b9c2cec1866 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:33.838792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3255e795-b3dd-4f83-aa26-2b9c2cec1866 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:33.839560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3255e795-b3dd-4f83-aa26-2b9c2cec1866 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:33.840002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3255e795-b3dd-4f83-aa26-2b9c2cec1866 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:34.392610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3255e795-b3dd-4f83-aa26-2b9c2cec1866 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:34.409593 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3255e795-b3dd-4f83-aa26-2b9c2cec1866 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1485 microversion: 2.1 time: 0.584168 Sep 06 10:59:34.410958 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1065/2109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:33 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1485 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:34.417336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ef8ee096-f6a3-4954-ad6b-5bed8217baeb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:34.418298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ef8ee096-f6a3-4954-ad6b-5bed8217baeb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:34.426151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef8ee096-f6a3-4954-ad6b-5bed8217baeb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:34.427172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef8ee096-f6a3-4954-ad6b-5bed8217baeb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:34.429824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef8ee096-f6a3-4954-ad6b-5bed8217baeb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:34.429824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef8ee096-f6a3-4954-ad6b-5bed8217baeb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:34.429824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef8ee096-f6a3-4954-ad6b-5bed8217baeb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:34.429824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef8ee096-f6a3-4954-ad6b-5bed8217baeb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:35.297716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ef8ee096-f6a3-4954-ad6b-5bed8217baeb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:35.305864 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ef8ee096-f6a3-4954-ad6b-5bed8217baeb tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1573 microversion: 2.1 time: 0.893646 Sep 06 10:59:35.306437 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1066/2110] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:34 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1573 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:35.311167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-48e97b6f-9f17-4c09-9f0c-1a041b4ecc99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:35.312007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-48e97b6f-9f17-4c09-9f0c-1a041b4ecc99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:35.317943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48e97b6f-9f17-4c09-9f0c-1a041b4ecc99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:35.318430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48e97b6f-9f17-4c09-9f0c-1a041b4ecc99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:35.318870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48e97b6f-9f17-4c09-9f0c-1a041b4ecc99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:35.319596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48e97b6f-9f17-4c09-9f0c-1a041b4ecc99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:35.320056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48e97b6f-9f17-4c09-9f0c-1a041b4ecc99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:35.320482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48e97b6f-9f17-4c09-9f0c-1a041b4ecc99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:35.490413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-48e97b6f-9f17-4c09-9f0c-1a041b4ecc99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:35.512525 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-48e97b6f-9f17-4c09-9f0c-1a041b4ecc99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1285 microversion: 2.1 time: 0.204092 Sep 06 10:59:35.513639 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1067/2111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:35 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:35.518739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b5482c39-4cbf-425c-a746-3529dfc477db tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:35.519597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b5482c39-4cbf-425c-a746-3529dfc477db tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:35.527142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5482c39-4cbf-425c-a746-3529dfc477db tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:35.527953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5482c39-4cbf-425c-a746-3529dfc477db tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:35.528639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5482c39-4cbf-425c-a746-3529dfc477db tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:35.529581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5482c39-4cbf-425c-a746-3529dfc477db tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:35.530276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5482c39-4cbf-425c-a746-3529dfc477db tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:35.530930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5482c39-4cbf-425c-a746-3529dfc477db tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:36.341010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b5482c39-4cbf-425c-a746-3529dfc477db tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:36.349446 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b5482c39-4cbf-425c-a746-3529dfc477db tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1701 microversion: 2.1 time: 0.834321 Sep 06 10:59:36.351599 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1068/2112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:35 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1701 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:36.364752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-37398e74-d9da-4f14-8b77-4369aab2c1d5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2145435158"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:36.365598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-37398e74-d9da-4f14-8b77-4369aab2c1d5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:36.372251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37398e74-d9da-4f14-8b77-4369aab2c1d5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:36.373046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37398e74-d9da-4f14-8b77-4369aab2c1d5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:36.374304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37398e74-d9da-4f14-8b77-4369aab2c1d5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:36.375226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37398e74-d9da-4f14-8b77-4369aab2c1d5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:36.375839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37398e74-d9da-4f14-8b77-4369aab2c1d5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:36.376432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37398e74-d9da-4f14-8b77-4369aab2c1d5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:36.767192 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.network.security_group_api [None req-37398e74-d9da-4f14-8b77-4369aab2c1d5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Adding security group c46c3c77-f63e-4882-8825-712b7fa7201c to port dcb59403-7cd4-4bf4-8790-d4e4297b0e12 Sep 06 10:59:37.112386 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-24d59668-1f41-4da1-acf4-a30e011b35ad tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/0e52c50d-72b9-4b92-93ea-42a264e0a728" status: 202 len: 0 microversion: 2.1 time: 3.299948 Sep 06 10:59:37.113654 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1045/2113] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 10:59:33 2022] DELETE /compute/v2.1/os-floating-ips/0e52c50d-72b9-4b92-93ea-42a264e0a728 => generated 0 bytes in 3302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:59:37.121201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-00234aec-32c3-4d0c-9f2e-4a093599ae7e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:37.122239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-00234aec-32c3-4d0c-9f2e-4a093599ae7e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:37.142559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00234aec-32c3-4d0c-9f2e-4a093599ae7e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:37.143569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00234aec-32c3-4d0c-9f2e-4a093599ae7e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:37.145125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00234aec-32c3-4d0c-9f2e-4a093599ae7e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:37.147146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00234aec-32c3-4d0c-9f2e-4a093599ae7e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:37.149761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00234aec-32c3-4d0c-9f2e-4a093599ae7e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:37.152634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00234aec-32c3-4d0c-9f2e-4a093599ae7e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:37.291697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-00234aec-32c3-4d0c-9f2e-4a093599ae7e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:37.302309 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-00234aec-32c3-4d0c-9f2e-4a093599ae7e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1443 microversion: 2.1 time: 0.186637 Sep 06 10:59:37.308334 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1046/2114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:37 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1443 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:37.315897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c61159ed-3bbe-4cf9-b0f3-f101c96af1dc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:37.317018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c61159ed-3bbe-4cf9-b0f3-f101c96af1dc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:37.326151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c61159ed-3bbe-4cf9-b0f3-f101c96af1dc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:37.332672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c61159ed-3bbe-4cf9-b0f3-f101c96af1dc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:37.332672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c61159ed-3bbe-4cf9-b0f3-f101c96af1dc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:37.332672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c61159ed-3bbe-4cf9-b0f3-f101c96af1dc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:37.332672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c61159ed-3bbe-4cf9-b0f3-f101c96af1dc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:37.332672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c61159ed-3bbe-4cf9-b0f3-f101c96af1dc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:37.361710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:37.763198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c61159ed-3bbe-4cf9-b0f3-f101c96af1dc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:37.783924 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c61159ed-3bbe-4cf9-b0f3-f101c96af1dc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1315 microversion: 2.1 time: 0.474208 Sep 06 10:59:37.786205 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1047/2115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:37 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:37.794018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cc0a7a87-34d8-4c0d-9f66-2bf3a157b636 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Calling method '.version_select at 0x7f90f89bd310>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:37.952389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG neutronclient.v2_0.client [None req-cc0a7a87-34d8-4c0d-9f66-2bf3a157b636 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0e52c50d-72b9-4b92-93ea-42a264e0a728 could not be found", "detail": ""}} {{(pid=140875) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:59:37.953788 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-cc0a7a87-34d8-4c0d-9f66-2bf3a157b636 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] HTTP exception thrown: Floating IP not found for ID 0e52c50d-72b9-4b92-93ea-42a264e0a728 Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cc0a7a87-34d8-4c0d-9f66-2bf3a157b636 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Request method failure captured: Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-floating-ips/0e52c50d-72b9-4b92-93ea-42a264e0a728 HTTP/1.1 Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFygGrjdLQRJNKmEAhfQtCP2TVLBmaJ7xhGZXKCzvDUtggzaOS_l6dtaqpQCw7pKzxvHrKUkvFOn-50xgNPd9D0ujZ_C_xNa2Vg-6G2SXf_cJWcwcGdHB7w3wnwRqffE4A2YeMtMPkwf3pMaXf9QzYx0d-lHV0S3AYrqx-t8fgddQGio Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 8931ef8e49e64ed482c8c01bbdb4fed6 Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FloatingIPsTestJSON-2021521725 Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8931ef8e49e64ed482c8c01bbdb4fed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8931ef8e49e64ed482c8c01bbdb4fed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8931ef8e49e64ed482c8c01bbdb4fed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8931ef8e49e64ed482c8c01bbdb4fed6"}]}] Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FloatingIPsTestJSON-2021521725 Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 8931ef8e49e64ed482c8c01bbdb4fed6 Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2021521725 Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FloatingIPsTestJSON-2021521725-project Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6726546cf675485391ccd6a72735d3cb Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FloatingIPsTestJSON-2021521725-project Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: exception: Floating IP not found for ID 0e52c50d-72b9-4b92-93ea-42a264e0a728 Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '0e52c50d-72b9-4b92-93ea-42a264e0a728'} Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0e52c50d-72b9-4b92-93ea-42a264e0a728 could not be found Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-199023d5-0c71-4bce-8175-3c07fd63ddec'] Sep 06 10:59:37.956385 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0e52c50d-72b9-4b92-93ea-42a264e0a728. Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0e52c50d-72b9-4b92-93ea-42a264e0a728 Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0e52c50d-72b9-4b92-93ea-42a264e0a728 Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:37.961228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cc0a7a87-34d8-4c0d-9f66-2bf3a157b636 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Returning 404 to user: Floating IP not found for ID 0e52c50d-72b9-4b92-93ea-42a264e0a728 {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:37.964076 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cc0a7a87-34d8-4c0d-9f66-2bf3a157b636 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/0e52c50d-72b9-4b92-93ea-42a264e0a728" status: 404 len: 111 microversion: 2.1 time: 0.174598 Sep 06 10:59:37.964947 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1048/2116] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 10:59:37 2022] GET /compute/v2.1/os-floating-ips/0e52c50d-72b9-4b92-93ea-42a264e0a728 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:37.970085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-8f088efd-feb3-467f-b459-6face5f8fbd6 req-23ac969e-9201-457b-9113-7710441fc6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11eb8c12-ec92-4302-a038-5c343138776c", "name": "network-vif-deleted", "tag": "943d3511-f984-4e2d-9c92-94ae06bad6c8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:37.981977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8f088efd-feb3-467f-b459-6face5f8fbd6 req-23ac969e-9201-457b-9113-7710441fc6f8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:37.982613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8f088efd-feb3-467f-b459-6face5f8fbd6 req-23ac969e-9201-457b-9113-7710441fc6f8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:37.983810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8f088efd-feb3-467f-b459-6face5f8fbd6 req-23ac969e-9201-457b-9113-7710441fc6f8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:37.995766 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-8f088efd-feb3-467f-b459-6face5f8fbd6 req-23ac969e-9201-457b-9113-7710441fc6f8 service nova] Creating event network-vif-deleted:943d3511-f984-4e2d-9c92-94ae06bad6c8 for instance 11eb8c12-ec92-4302-a038-5c343138776c on nch2-master-1 Sep 06 10:59:38.002254 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-8f088efd-feb3-467f-b459-6face5f8fbd6 req-23ac969e-9201-457b-9113-7710441fc6f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035488 Sep 06 10:59:38.002956 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1049/2117] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:38.008604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-597d8856-4adc-4be4-b4c4-f3dff25dd588 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:38.009586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-597d8856-4adc-4be4-b4c4-f3dff25dd588 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:38.020775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-597d8856-4adc-4be4-b4c4-f3dff25dd588 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:38.023668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-597d8856-4adc-4be4-b4c4-f3dff25dd588 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:38.024146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-597d8856-4adc-4be4-b4c4-f3dff25dd588 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:38.030812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-597d8856-4adc-4be4-b4c4-f3dff25dd588 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:38.030812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-597d8856-4adc-4be4-b4c4-f3dff25dd588 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:38.031257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-597d8856-4adc-4be4-b4c4-f3dff25dd588 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:38.144169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-597d8856-4adc-4be4-b4c4-f3dff25dd588 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:38.157166 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-597d8856-4adc-4be4-b4c4-f3dff25dd588 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1633 microversion: 2.1 time: 0.152658 Sep 06 10:59:38.160602 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1050/2118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:38 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1633 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:38.171522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b96bb790-1538-4de0-8ffe-9bb3dec41113 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Calling method '.version_select at 0x7f90f3dbc550>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:38.330230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG neutronclient.v2_0.client [None req-b96bb790-1538-4de0-8ffe-9bb3dec41113 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0e52c50d-72b9-4b92-93ea-42a264e0a728 could not be found", "detail": ""}} {{(pid=140875) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:59:38.331056 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-b96bb790-1538-4de0-8ffe-9bb3dec41113 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] HTTP exception thrown: Floating IP not found for ID 0e52c50d-72b9-4b92-93ea-42a264e0a728 Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b96bb790-1538-4de0-8ffe-9bb3dec41113 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Request method failure captured: Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/os-floating-ips/0e52c50d-72b9-4b92-93ea-42a264e0a728 HTTP/1.1 Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFygGrjdLQRJNKmEAhfQtCP2TVLBmaJ7xhGZXKCzvDUtggzaOS_l6dtaqpQCw7pKzxvHrKUkvFOn-50xgNPd9D0ujZ_C_xNa2Vg-6G2SXf_cJWcwcGdHB7w3wnwRqffE4A2YeMtMPkwf3pMaXf9QzYx0d-lHV0S3AYrqx-t8fgddQGio Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 8931ef8e49e64ed482c8c01bbdb4fed6 Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-FloatingIPsTestJSON-2021521725 Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8931ef8e49e64ed482c8c01bbdb4fed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8931ef8e49e64ed482c8c01bbdb4fed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8931ef8e49e64ed482c8c01bbdb4fed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8931ef8e49e64ed482c8c01bbdb4fed6"}]}] Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-FloatingIPsTestJSON-2021521725 Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 8931ef8e49e64ed482c8c01bbdb4fed6 Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2021521725 Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-FloatingIPsTestJSON-2021521725-project Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6726546cf675485391ccd6a72735d3cb Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-FloatingIPsTestJSON-2021521725-project Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: exception: Floating IP not found for ID 0e52c50d-72b9-4b92-93ea-42a264e0a728 Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '0e52c50d-72b9-4b92-93ea-42a264e0a728'} Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0e52c50d-72b9-4b92-93ea-42a264e0a728 could not be found Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-854c93de-8d49-4132-9bce-0ec6774fff5a'] Sep 06 10:59:38.334219 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0e52c50d-72b9-4b92-93ea-42a264e0a728. Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0e52c50d-72b9-4b92-93ea-42a264e0a728 Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0e52c50d-72b9-4b92-93ea-42a264e0a728 Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b96bb790-1538-4de0-8ffe-9bb3dec41113 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] Returning 404 to user: Floating IP not found for ID 0e52c50d-72b9-4b92-93ea-42a264e0a728 {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b96bb790-1538-4de0-8ffe-9bb3dec41113 tempest-FloatingIPsTestJSON-2021521725 tempest-FloatingIPsTestJSON-2021521725-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/0e52c50d-72b9-4b92-93ea-42a264e0a728" status: 404 len: 111 microversion: 2.1 time: 0.174181 Sep 06 10:59:38.338883 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1051/2119] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 10:59:38 2022] DELETE /compute/v2.1/os-floating-ips/0e52c50d-72b9-4b92-93ea-42a264e0a728 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:38.342721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-34cde179-64cd-4475-9a4f-418ef7664e03 req-7bd2ffc5-ea07-4de7-be3d-f9dba9d7f883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267d4dad-b118-4f44-993b-81fd05e550df", "tag": "ef011f91-2d4e-406a-bce9-9afb09103a90"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:38.384371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-34cde179-64cd-4475-9a4f-418ef7664e03 req-7bd2ffc5-ea07-4de7-be3d-f9dba9d7f883 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:38.392914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-34cde179-64cd-4475-9a4f-418ef7664e03 req-7bd2ffc5-ea07-4de7-be3d-f9dba9d7f883 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:38.393437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-34cde179-64cd-4475-9a4f-418ef7664e03 req-7bd2ffc5-ea07-4de7-be3d-f9dba9d7f883 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:38.429431 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-34cde179-64cd-4475-9a4f-418ef7664e03 req-7bd2ffc5-ea07-4de7-be3d-f9dba9d7f883 service nova] Creating event network-changed:ef011f91-2d4e-406a-bce9-9afb09103a90 for instance 267d4dad-b118-4f44-993b-81fd05e550df on nch1-master-1 Sep 06 10:59:38.437398 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-34cde179-64cd-4475-9a4f-418ef7664e03 req-7bd2ffc5-ea07-4de7-be3d-f9dba9d7f883 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098815 Sep 06 10:59:38.438834 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1052/2120] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:38.452748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:38.453835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:38.461432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:38.462219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:38.462917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:38.463917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:38.464556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:38.465152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:38.513817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:38.515615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:38.516423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:38.517148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lazy-loading 'fault' on Instance uuid 11eb8c12-ec92-4302-a038-5c343138776c {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:59:38.660543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:38.673381 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e4819b6e-f59b-46f2-82a6-9c16c3925e11 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 200 len: 1301 microversion: 2.1 time: 0.232820 Sep 06 10:59:38.674014 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1053/2121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:38 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 1301 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:38.808128 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-37398e74-d9da-4f14-8b77-4369aab2c1d5 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624/action" status: 202 len: 0 microversion: 2.1 time: 2.455079 Sep 06 10:59:38.809054 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1069/2122] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:59:36 2022] POST /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624/action => generated 0 bytes in 2457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:59:38.818003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6e95c10c-8b18-4a9a-a8d9-12bb6524d90b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f88c50d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:38.825346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b379c7fa-41a6-41a4-b4e9-a9587dfe9ca3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:38.829100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b379c7fa-41a6-41a4-b4e9-a9587dfe9ca3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:38.840530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:38.853617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b379c7fa-41a6-41a4-b4e9-a9587dfe9ca3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:38.855833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b379c7fa-41a6-41a4-b4e9-a9587dfe9ca3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:38.856625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b379c7fa-41a6-41a4-b4e9-a9587dfe9ca3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:38.858379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b379c7fa-41a6-41a4-b4e9-a9587dfe9ca3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:38.860326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b379c7fa-41a6-41a4-b4e9-a9587dfe9ca3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:38.864075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b379c7fa-41a6-41a4-b4e9-a9587dfe9ca3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:39.319726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-6e95c10c-8b18-4a9a-a8d9-12bb6524d90b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group c46c3c77-f63e-4882-8825-712b7fa7201c in use.", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:59:39.321226 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-6e95c10c-8b18-4a9a-a8d9-12bb6524d90b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Security Group c46c3c77-f63e-4882-8825-712b7fa7201c in use. Sep 06 10:59:39.321226 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-185b5e75-01b9-4a91-b098-83a7ef11680a'] Sep 06 10:59:39.339982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b379c7fa-41a6-41a4-b4e9-a9587dfe9ca3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6e95c10c-8b18-4a9a-a8d9-12bb6524d90b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-security-groups/c46c3c77-f63e-4882-8825-712b7fa7201c HTTP/1.1 Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: exception: Security Group c46c3c77-f63e-4882-8825-712b7fa7201c in use. Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-185b5e75-01b9-4a91-b098-83a7ef11680a'] Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'c46c3c77-f63e-4882-8825-712b7fa7201c'} Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:59:39.340682 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group c46c3c77-f63e-4882-8825-712b7fa7201c in use. Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-185b5e75-01b9-4a91-b098-83a7ef11680a'] Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group c46c3c77-f63e-4882-8825-712b7fa7201c in use. Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-185b5e75-01b9-4a91-b098-83a7ef11680a'] Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group c46c3c77-f63e-4882-8825-712b7fa7201c in use. Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-185b5e75-01b9-4a91-b098-83a7ef11680a'] Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group c46c3c77-f63e-4882-8825-712b7fa7201c in use. Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-185b5e75-01b9-4a91-b098-83a7ef11680a'] Sep 06 10:59:39.345918 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:39.352625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6e95c10c-8b18-4a9a-a8d9-12bb6524d90b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 400 to user: Security Group c46c3c77-f63e-4882-8825-712b7fa7201c in use. Sep 06 10:59:39.352625 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-185b5e75-01b9-4a91-b098-83a7ef11680a'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:39.354185 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6e95c10c-8b18-4a9a-a8d9-12bb6524d90b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c46c3c77-f63e-4882-8825-712b7fa7201c" status: 400 len: 185 microversion: 2.1 time: 0.540638 Sep 06 10:59:39.355355 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1070/2123] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:59:38 2022] DELETE /compute/v2.1/os-security-groups/c46c3c77-f63e-4882-8825-712b7fa7201c => generated 185 bytes in 542 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 10:59:39.368133 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b379c7fa-41a6-41a4-b4e9-a9587dfe9ca3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1315 microversion: 2.1 time: 0.560211 Sep 06 10:59:39.373480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:39.375837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:39.385089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:39.393574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:39.393941 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1054/2124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:38 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:39.394916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:39.395576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:39.396497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:39.397134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:39.399558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:39.420375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-058a2f5b-4fd1-4efc-b6aa-1a15d3f3a670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:39.423743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-058a2f5b-4fd1-4efc-b6aa-1a15d3f3a670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:39.434429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-058a2f5b-4fd1-4efc-b6aa-1a15d3f3a670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:39.435650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-058a2f5b-4fd1-4efc-b6aa-1a15d3f3a670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:39.437027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-058a2f5b-4fd1-4efc-b6aa-1a15d3f3a670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:39.438073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-058a2f5b-4fd1-4efc-b6aa-1a15d3f3a670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:39.438696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-058a2f5b-4fd1-4efc-b6aa-1a15d3f3a670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:39.439344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-058a2f5b-4fd1-4efc-b6aa-1a15d3f3a670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:39.445538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:39.447697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:39.448377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:39.449074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lazy-loading 'fault' on Instance uuid 58328e0b-391a-4721-b3e4-2b5c2bbaeead {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:59:39.502403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-058a2f5b-4fd1-4efc-b6aa-1a15d3f3a670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:59:39.599179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c02f8592a8842b8baf95d76c55a4d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e0ac401b45419795e5127ed1f667b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:39.625998 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-31e4efe4-29e9-4371-bb3e-c5aae9a01908 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 200 len: 1360 microversion: 2.1 time: 0.266863 Sep 06 10:59:39.627036 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1071/2125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:39 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 1360 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:39.703211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-86d001c3-30d7-4074-b58b-c3af836d07f5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:39.711686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-86d001c3-30d7-4074-b58b-c3af836d07f5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 11eb8c12-ec92-4302-a038-5c343138776c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:39.729529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86d001c3-30d7-4074-b58b-c3af836d07f5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:39.730347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86d001c3-30d7-4074-b58b-c3af836d07f5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:39.731268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86d001c3-30d7-4074-b58b-c3af836d07f5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:39.732158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86d001c3-30d7-4074-b58b-c3af836d07f5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:39.733526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86d001c3-30d7-4074-b58b-c3af836d07f5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:39.734205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86d001c3-30d7-4074-b58b-c3af836d07f5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:39.755837 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-86d001c3-30d7-4074-b58b-c3af836d07f5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] HTTP exception thrown: Instance 11eb8c12-ec92-4302-a038-5c343138776c could not be found. Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-86d001c3-30d7-4074-b58b-c3af836d07f5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Request method failure captured: Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c HTTP/1.1 Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY4vX_-GQFSvlCFpCM_88XOXPnenmn0IC5GvqKRyIJOSaj8HG5Q0AH3SmJN09UhNSHS4fTGKIVCxon8ypZc0I1z3-YkDZjIVpQyOp7ONgTOGirC-U7-JdcbqucQimeJhIZoUZlsDUBna-Zj5FutqaCYPx3uWvNkNtCNBA0PqAWK-SE Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: fb1af95268504c5bbed702fce756f5f4 Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-LiveMigrationTest-1600938040 Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb1af95268504c5bbed702fce756f5f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb1af95268504c5bbed702fce756f5f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb1af95268504c5bbed702fce756f5f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb1af95268504c5bbed702fce756f5f4"}]}] Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-LiveMigrationTest-1600938040 Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: fb1af95268504c5bbed702fce756f5f4 Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-LiveMigrationTest-1600938040 Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-LiveMigrationTest-1600938040-project Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: c4e1ac1b40e94dbc80548a1f45919b6f Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-LiveMigrationTest-1600938040-project Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 11eb8c12-ec92-4302-a038-5c343138776c could not be found. Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '11eb8c12-ec92-4302-a038-5c343138776c'} Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11eb8c12-ec92-4302-a038-5c343138776c could not be found. Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11eb8c12-ec92-4302-a038-5c343138776c could not be found. Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:39.757944 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:39.764620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:39.764620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:39.764620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:39.764620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:39.764620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:39.764620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11eb8c12-ec92-4302-a038-5c343138776c could not be found. Sep 06 10:59:39.764620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:39.764620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-86d001c3-30d7-4074-b58b-c3af836d07f5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Returning 404 to user: Instance 11eb8c12-ec92-4302-a038-5c343138776c could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:39.765872 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-86d001c3-30d7-4074-b58b-c3af836d07f5 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c" status: 404 len: 111 microversion: 2.1 time: 0.068949 Sep 06 10:59:39.769902 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1072/2126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:39 2022] GET /compute/v2.1/servers/11eb8c12-ec92-4302-a038-5c343138776c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:39.775507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-98fc8b6e-e6a0-4c0c-887d-7b9645d4bd5e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:39.776205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-98fc8b6e-e6a0-4c0c-887d-7b9645d4bd5e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:39.784307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98fc8b6e-e6a0-4c0c-887d-7b9645d4bd5e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:39.791415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98fc8b6e-e6a0-4c0c-887d-7b9645d4bd5e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:39.791415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98fc8b6e-e6a0-4c0c-887d-7b9645d4bd5e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:39.791415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98fc8b6e-e6a0-4c0c-887d-7b9645d4bd5e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:39.791415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98fc8b6e-e6a0-4c0c-887d-7b9645d4bd5e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:39.791415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98fc8b6e-e6a0-4c0c-887d-7b9645d4bd5e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:39.819636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-98fc8b6e-e6a0-4c0c-887d-7b9645d4bd5e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:59:40.090350 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-058a2f5b-4fd1-4efc-b6aa-1a15d3f3a670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 204 len: 0 microversion: 2.1 time: 0.692798 Sep 06 10:59:40.091207 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1055/2127] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:59:39 2022] DELETE /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:59:40.112909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-7475af9f-0614-46df-97d1-d5cd22b58c91 req-cec0bd3e-ee5b-4e1e-a8eb-6743630ec7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58328e0b-391a-4721-b3e4-2b5c2bbaeead", "name": "network-vif-deleted", "tag": "3603966b-8262-417f-b816-460a496f2d31"}, {"name": "network-changed", "server_uuid": "5d094fe4-bcd7-4063-8266-a53ee8289624", "tag": "dcb59403-7cd4-4bf4-8790-d4e4297b0e12"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:40.129545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7475af9f-0614-46df-97d1-d5cd22b58c91 req-cec0bd3e-ee5b-4e1e-a8eb-6743630ec7f1 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:40.130137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7475af9f-0614-46df-97d1-d5cd22b58c91 req-cec0bd3e-ee5b-4e1e-a8eb-6743630ec7f1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:40.130648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7475af9f-0614-46df-97d1-d5cd22b58c91 req-cec0bd3e-ee5b-4e1e-a8eb-6743630ec7f1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:40.146645 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7475af9f-0614-46df-97d1-d5cd22b58c91 req-cec0bd3e-ee5b-4e1e-a8eb-6743630ec7f1 service nova] Creating event network-vif-deleted:3603966b-8262-417f-b816-460a496f2d31 for instance 58328e0b-391a-4721-b3e4-2b5c2bbaeead on nch1-master-1 Sep 06 10:59:40.147506 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7475af9f-0614-46df-97d1-d5cd22b58c91 req-cec0bd3e-ee5b-4e1e-a8eb-6743630ec7f1 service nova] Creating event network-changed:dcb59403-7cd4-4bf4-8790-d4e4297b0e12 for instance 5d094fe4-bcd7-4063-8266-a53ee8289624 on nch2-master-1 Sep 06 10:59:40.157969 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-7475af9f-0614-46df-97d1-d5cd22b58c91 req-cec0bd3e-ee5b-4e1e-a8eb-6743630ec7f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.060667 Sep 06 10:59:40.163284 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1056/2128] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:40.169661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-559c5996-689b-40fa-b45a-5745e5d6fc08 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:40.171280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-559c5996-689b-40fa-b45a-5745e5d6fc08 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:40.182302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-559c5996-689b-40fa-b45a-5745e5d6fc08 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:40.182761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-559c5996-689b-40fa-b45a-5745e5d6fc08 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:40.183868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-559c5996-689b-40fa-b45a-5745e5d6fc08 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:40.184634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-559c5996-689b-40fa-b45a-5745e5d6fc08 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:40.185466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-559c5996-689b-40fa-b45a-5745e5d6fc08 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:40.186518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-559c5996-689b-40fa-b45a-5745e5d6fc08 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:40.399514 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-98fc8b6e-e6a0-4c0c-887d-7b9645d4bd5e tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 204 len: 0 microversion: 2.1 time: 0.627779 Sep 06 10:59:40.404001 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1073/2129] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:59:39 2022] DELETE /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:59:40.417346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bd1ab0ba-f795-4721-9af7-87a5e294a2cc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:40.419913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bd1ab0ba-f795-4721-9af7-87a5e294a2cc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:40.440992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd1ab0ba-f795-4721-9af7-87a5e294a2cc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:40.443309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd1ab0ba-f795-4721-9af7-87a5e294a2cc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:40.443796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd1ab0ba-f795-4721-9af7-87a5e294a2cc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:40.445984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd1ab0ba-f795-4721-9af7-87a5e294a2cc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:40.446491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd1ab0ba-f795-4721-9af7-87a5e294a2cc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:40.453645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd1ab0ba-f795-4721-9af7-87a5e294a2cc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:40.734669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-559c5996-689b-40fa-b45a-5745e5d6fc08 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:40.749650 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-559c5996-689b-40fa-b45a-5745e5d6fc08 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1648 microversion: 2.1 time: 0.584794 Sep 06 10:59:40.750307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bd1ab0ba-f795-4721-9af7-87a5e294a2cc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:40.750660 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1057/2130] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:40 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1648 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:40.756078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01c3cb14-ecc1-4a67-8391-1cd3ce23b7ea tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:40.757289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-01c3cb14-ecc1-4a67-8391-1cd3ce23b7ea tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:40.758977 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bd1ab0ba-f795-4721-9af7-87a5e294a2cc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1315 microversion: 2.1 time: 0.352041 Sep 06 10:59:40.763057 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1074/2131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:40 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:40.773841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6b789055-057f-4288-864f-519fdda70292 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:40.774791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6b789055-057f-4288-864f-519fdda70292 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] [instance: 58328e0b-391a-4721-b3e4-2b5c2bbaeead] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:40.779939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01c3cb14-ecc1-4a67-8391-1cd3ce23b7ea tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:40.780795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01c3cb14-ecc1-4a67-8391-1cd3ce23b7ea tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:40.781529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01c3cb14-ecc1-4a67-8391-1cd3ce23b7ea tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:40.782517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01c3cb14-ecc1-4a67-8391-1cd3ce23b7ea tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:40.783275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01c3cb14-ecc1-4a67-8391-1cd3ce23b7ea tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:40.793450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b789055-057f-4288-864f-519fdda70292 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:40.796765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b789055-057f-4288-864f-519fdda70292 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:40.797228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b789055-057f-4288-864f-519fdda70292 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:40.798398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b789055-057f-4288-864f-519fdda70292 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:40.801179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b789055-057f-4288-864f-519fdda70292 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:40.801670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b789055-057f-4288-864f-519fdda70292 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:40.809369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01c3cb14-ecc1-4a67-8391-1cd3ce23b7ea tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:40.827318 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-6b789055-057f-4288-864f-519fdda70292 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] HTTP exception thrown: Instance 58328e0b-391a-4721-b3e4-2b5c2bbaeead could not be found. Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6b789055-057f-4288-864f-519fdda70292 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Request method failure captured: Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead HTTP/1.1 Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyfOIm1KukA8xaFGc1M8FcxuukH9driRKlVgQ11WLE5FLFKj9h9HMsyuXgs-bRHrNWoSSArR1fSplP_e2rDPv7Kcth1KgathPJaqpD0WfjMznhrk51dgLWbgOgcy7H1FOfPO1enHJBx19eK2CusgRtPbmJkZ19-RQAhIIZATToBpYr4 Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: d5e0ac401b45419795e5127ed1f667b9 Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-61570311 Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5e0ac401b45419795e5127ed1f667b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5e0ac401b45419795e5127ed1f667b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5e0ac401b45419795e5127ed1f667b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5e0ac401b45419795e5127ed1f667b9"}]}] Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-61570311 Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: d5e0ac401b45419795e5127ed1f667b9 Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-61570311 Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-61570311-project Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5c02f8592a8842b8baf95d76c55a4d6e Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-61570311-project Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 58328e0b-391a-4721-b3e4-2b5c2bbaeead could not be found. Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '58328e0b-391a-4721-b3e4-2b5c2bbaeead'} Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58328e0b-391a-4721-b3e4-2b5c2bbaeead could not be found. Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58328e0b-391a-4721-b3e4-2b5c2bbaeead could not be found. Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:40.828755 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:40.833785 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:40.833785 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:40.833785 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:40.833785 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:40.833785 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58328e0b-391a-4721-b3e4-2b5c2bbaeead could not be found. Sep 06 10:59:40.833785 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:40.840877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6b789055-057f-4288-864f-519fdda70292 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Returning 404 to user: Instance 58328e0b-391a-4721-b3e4-2b5c2bbaeead could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:40.843244 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6b789055-057f-4288-864f-519fdda70292 tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead" status: 404 len: 111 microversion: 2.1 time: 0.075165 Sep 06 10:59:40.844548 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1075/2132] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:40 2022] GET /compute/v2.1/servers/58328e0b-391a-4721-b3e4-2b5c2bbaeead => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:40.857468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-12f31b17-7df6-4e60-b3cb-22ea0100430c tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] Calling method '.version_select at 0x7f90f8678ca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:41.009856 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-12f31b17-7df6-4e60-b3cb-22ea0100430c tempest-ServersTestJSON-61570311 tempest-ServersTestJSON-61570311-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149263650" status: 202 len: 0 microversion: 2.1 time: 0.160025 Sep 06 10:59:41.010457 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1076/2133] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 10:59:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149263650 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:59:41.224279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-01c3cb14-ecc1-4a67-8391-1cd3ce23b7ea tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:41.237806 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-01c3cb14-ecc1-4a67-8391-1cd3ce23b7ea tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1499 microversion: 2.1 time: 0.483602 Sep 06 10:59:41.253758 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1058/2134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:40 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1499 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:41.778426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-04385998-1f81-4025-8687-5ed518a351fa tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:41.778640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-04385998-1f81-4025-8687-5ed518a351fa tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:41.791849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-825f09ed-eb5e-401e-943e-cde516d8ea08 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:41.793508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04385998-1f81-4025-8687-5ed518a351fa tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:41.794219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04385998-1f81-4025-8687-5ed518a351fa tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:41.795926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04385998-1f81-4025-8687-5ed518a351fa tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:41.796590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04385998-1f81-4025-8687-5ed518a351fa tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:41.796889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-825f09ed-eb5e-401e-943e-cde516d8ea08 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:41.797520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04385998-1f81-4025-8687-5ed518a351fa tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:41.798170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04385998-1f81-4025-8687-5ed518a351fa tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:41.803775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:41.806251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:41.810341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-825f09ed-eb5e-401e-943e-cde516d8ea08 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:41.810931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-825f09ed-eb5e-401e-943e-cde516d8ea08 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:41.812374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-825f09ed-eb5e-401e-943e-cde516d8ea08 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:41.813489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-825f09ed-eb5e-401e-943e-cde516d8ea08 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:41.813973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-825f09ed-eb5e-401e-943e-cde516d8ea08 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:41.814409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-825f09ed-eb5e-401e-943e-cde516d8ea08 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:42.884328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-825f09ed-eb5e-401e-943e-cde516d8ea08 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:42.896948 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-825f09ed-eb5e-401e-943e-cde516d8ea08 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1315 microversion: 2.1 time: 1.111658 Sep 06 10:59:42.911035 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1059/2135] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:41 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1315 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:42.920986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cdd68fcf-4790-4279-a143-2c5a4b458a81 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:42.920986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cdd68fcf-4790-4279-a143-2c5a4b458a81 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:42.936948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cdd68fcf-4790-4279-a143-2c5a4b458a81 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:42.937595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cdd68fcf-4790-4279-a143-2c5a4b458a81 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:42.944904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cdd68fcf-4790-4279-a143-2c5a4b458a81 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:42.944904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cdd68fcf-4790-4279-a143-2c5a4b458a81 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:42.944904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cdd68fcf-4790-4279-a143-2c5a4b458a81 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:42.944904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cdd68fcf-4790-4279-a143-2c5a4b458a81 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:43.091540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-04385998-1f81-4025-8687-5ed518a351fa tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:43.103290 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-04385998-1f81-4025-8687-5ed518a351fa tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1648 microversion: 2.1 time: 1.328033 Sep 06 10:59:43.104510 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1077/2136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:41 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1648 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:43.446108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-882ab5f8-0d08-4632-838d-6780f5b3ba02 req-63d97e51-0f53-47d3-8333-cbea157e994b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9162565a-4488-4d48-ba04-dfc70918d16d", "name": "network-vif-deleted", "tag": "04beff9e-7cb6-41b4-b6e0-56c1debdbfcc"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:43.458841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-882ab5f8-0d08-4632-838d-6780f5b3ba02 req-63d97e51-0f53-47d3-8333-cbea157e994b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:43.459702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-882ab5f8-0d08-4632-838d-6780f5b3ba02 req-63d97e51-0f53-47d3-8333-cbea157e994b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:43.460344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-882ab5f8-0d08-4632-838d-6780f5b3ba02 req-63d97e51-0f53-47d3-8333-cbea157e994b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:43.475277 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-882ab5f8-0d08-4632-838d-6780f5b3ba02 req-63d97e51-0f53-47d3-8333-cbea157e994b service nova] Creating event network-vif-deleted:04beff9e-7cb6-41b4-b6e0-56c1debdbfcc for instance 9162565a-4488-4d48-ba04-dfc70918d16d on nch2-master-1 Sep 06 10:59:43.481156 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-882ab5f8-0d08-4632-838d-6780f5b3ba02 req-63d97e51-0f53-47d3-8333-cbea157e994b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042237 Sep 06 10:59:43.482290 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1078/2137] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:59:43.571530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cdd68fcf-4790-4279-a143-2c5a4b458a81 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:43.589827 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cdd68fcf-4790-4279-a143-2c5a4b458a81 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1499 microversion: 2.1 time: 0.690317 Sep 06 10:59:43.596662 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1060/2138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:42 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1499 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:43.926615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-adc6a9ff-b66a-4277-a519-16110a35dae7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:43.927571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-adc6a9ff-b66a-4277-a519-16110a35dae7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:43.940141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adc6a9ff-b66a-4277-a519-16110a35dae7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:43.941774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adc6a9ff-b66a-4277-a519-16110a35dae7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:43.942729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adc6a9ff-b66a-4277-a519-16110a35dae7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:43.944082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adc6a9ff-b66a-4277-a519-16110a35dae7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:43.945268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adc6a9ff-b66a-4277-a519-16110a35dae7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:43.946158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adc6a9ff-b66a-4277-a519-16110a35dae7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:44.127124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1bc02f5b-a64b-460b-a371-795b5ebdd207 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:44.127762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1bc02f5b-a64b-460b-a371-795b5ebdd207 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:44.136976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bc02f5b-a64b-460b-a371-795b5ebdd207 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:44.137517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bc02f5b-a64b-460b-a371-795b5ebdd207 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:44.137966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bc02f5b-a64b-460b-a371-795b5ebdd207 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:44.138791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bc02f5b-a64b-460b-a371-795b5ebdd207 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:44.139329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bc02f5b-a64b-460b-a371-795b5ebdd207 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:44.140153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bc02f5b-a64b-460b-a371-795b5ebdd207 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:44.404983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1bc02f5b-a64b-460b-a371-795b5ebdd207 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:44.421409 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1bc02f5b-a64b-460b-a371-795b5ebdd207 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1468 microversion: 2.1 time: 0.294671 Sep 06 10:59:44.421409 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1061/2139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:44 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1468 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:44.617274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:44.618886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:44.641500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:44.644442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:44.645786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:44.648125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:44.649226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:44.650212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:44.747252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:44.751147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:44.751607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:44.752088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lazy-loading 'fault' on Instance uuid 9162565a-4488-4d48-ba04-dfc70918d16d {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:59:44.923051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e1ac1b40e94dbc80548a1f45919b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1af95268504c5bbed702fce756f5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:44.934665 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-467b9498-3acc-42f1-8f9e-ad7aae871a86 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 200 len: 1300 microversion: 2.1 time: 0.322023 Sep 06 10:59:44.935524 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1062/2140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:44 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 1300 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:44.953898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-470c7f7a-92f3-4a61-9a8a-e76e3a3ba69a req-fca1e741-3d9e-46c9-9330-72e670d85789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267d4dad-b118-4f44-993b-81fd05e550df", "name": "network-vif-plugged", "status": "completed", "tag": "ef011f91-2d4e-406a-bce9-9afb09103a90"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:44.975209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-470c7f7a-92f3-4a61-9a8a-e76e3a3ba69a req-fca1e741-3d9e-46c9-9330-72e670d85789 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:44.975954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-470c7f7a-92f3-4a61-9a8a-e76e3a3ba69a req-fca1e741-3d9e-46c9-9330-72e670d85789 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:44.976576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-470c7f7a-92f3-4a61-9a8a-e76e3a3ba69a req-fca1e741-3d9e-46c9-9330-72e670d85789 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:44.997426 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-470c7f7a-92f3-4a61-9a8a-e76e3a3ba69a req-fca1e741-3d9e-46c9-9330-72e670d85789 service nova] Creating event network-vif-plugged:ef011f91-2d4e-406a-bce9-9afb09103a90 for instance 267d4dad-b118-4f44-993b-81fd05e550df on nch1-master-1 Sep 06 10:59:45.009528 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-470c7f7a-92f3-4a61-9a8a-e76e3a3ba69a req-fca1e741-3d9e-46c9-9330-72e670d85789 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072455 Sep 06 10:59:45.012559 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1063/2141] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:45.157191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-765b7f54-f3a4-43fd-8ba4-26cab3530af9 req-9862bc23-1be8-467a-96f9-00426ea44e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d094fe4-bcd7-4063-8266-a53ee8289624", "name": "network-vif-deleted", "tag": "dcb59403-7cd4-4bf4-8790-d4e4297b0e12"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:45.172330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-765b7f54-f3a4-43fd-8ba4-26cab3530af9 req-9862bc23-1be8-467a-96f9-00426ea44e22 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:45.173071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-765b7f54-f3a4-43fd-8ba4-26cab3530af9 req-9862bc23-1be8-467a-96f9-00426ea44e22 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:45.173662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-765b7f54-f3a4-43fd-8ba4-26cab3530af9 req-9862bc23-1be8-467a-96f9-00426ea44e22 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:45.215429 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-765b7f54-f3a4-43fd-8ba4-26cab3530af9 req-9862bc23-1be8-467a-96f9-00426ea44e22 service nova] Creating event network-vif-deleted:dcb59403-7cd4-4bf4-8790-d4e4297b0e12 for instance 5d094fe4-bcd7-4063-8266-a53ee8289624 on nch2-master-1 Sep 06 10:59:45.226890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-adc6a9ff-b66a-4277-a519-16110a35dae7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:45.232224 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-765b7f54-f3a4-43fd-8ba4-26cab3530af9 req-9862bc23-1be8-467a-96f9-00426ea44e22 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080284 Sep 06 10:59:45.235620 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1064/2142] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:59:45.246502 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-adc6a9ff-b66a-4277-a519-16110a35dae7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1315 microversion: 2.1 time: 1.321849 Sep 06 10:59:45.275077 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1079/2143] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:43 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1315 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:45.447193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-011399b5-ab68-410b-8f26-64a7855da04c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:45.447913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-011399b5-ab68-410b-8f26-64a7855da04c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:45.464581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-011399b5-ab68-410b-8f26-64a7855da04c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:45.465302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-011399b5-ab68-410b-8f26-64a7855da04c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:45.469492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-011399b5-ab68-410b-8f26-64a7855da04c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:45.474309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-011399b5-ab68-410b-8f26-64a7855da04c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:45.474309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-011399b5-ab68-410b-8f26-64a7855da04c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:45.474309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-011399b5-ab68-410b-8f26-64a7855da04c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:45.712590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-011399b5-ab68-410b-8f26-64a7855da04c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:45.724054 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-011399b5-ab68-410b-8f26-64a7855da04c tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 200 len: 1301 microversion: 2.1 time: 0.281874 Sep 06 10:59:45.725134 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1065/2144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:45 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 1301 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:45.964483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4bc608de-41f8-4509-8698-3e4c36d29f55 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:45.965390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4bc608de-41f8-4509-8698-3e4c36d29f55 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] [instance: 9162565a-4488-4d48-ba04-dfc70918d16d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:45.977234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bc608de-41f8-4509-8698-3e4c36d29f55 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:45.977674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bc608de-41f8-4509-8698-3e4c36d29f55 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:45.978462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bc608de-41f8-4509-8698-3e4c36d29f55 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:45.980574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bc608de-41f8-4509-8698-3e4c36d29f55 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:45.981213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bc608de-41f8-4509-8698-3e4c36d29f55 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:45.981808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bc608de-41f8-4509-8698-3e4c36d29f55 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:46.012588 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-4bc608de-41f8-4509-8698-3e4c36d29f55 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] HTTP exception thrown: Instance 9162565a-4488-4d48-ba04-dfc70918d16d could not be found. Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4bc608de-41f8-4509-8698-3e4c36d29f55 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Request method failure captured: Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d HTTP/1.1 Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyY4vX_-GQFSvlCFpCM_88XOXPnenmn0IC5GvqKRyIJOSaj8HG5Q0AH3SmJN09UhNSHS4fTGKIVCxon8ypZc0I1z3-YkDZjIVpQyOp7ONgTOGirC-U7-JdcbqucQimeJhIZoUZlsDUBna-Zj5FutqaCYPx3uWvNkNtCNBA0PqAWK-SE Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: fb1af95268504c5bbed702fce756f5f4 Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-LiveMigrationTest-1600938040 Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb1af95268504c5bbed702fce756f5f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb1af95268504c5bbed702fce756f5f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb1af95268504c5bbed702fce756f5f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb1af95268504c5bbed702fce756f5f4"}]}] Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-LiveMigrationTest-1600938040 Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: fb1af95268504c5bbed702fce756f5f4 Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-LiveMigrationTest-1600938040 Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-LiveMigrationTest-1600938040-project Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: c4e1ac1b40e94dbc80548a1f45919b6f Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-LiveMigrationTest-1600938040-project Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 9162565a-4488-4d48-ba04-dfc70918d16d could not be found. Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '9162565a-4488-4d48-ba04-dfc70918d16d'} Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9162565a-4488-4d48-ba04-dfc70918d16d could not be found. Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9162565a-4488-4d48-ba04-dfc70918d16d could not be found. Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:46.015445 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:46.019287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:46.019287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:46.019287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:46.019287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:46.019287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:46.019287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9162565a-4488-4d48-ba04-dfc70918d16d could not be found. Sep 06 10:59:46.019287 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:46.030896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4bc608de-41f8-4509-8698-3e4c36d29f55 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] Returning 404 to user: Instance 9162565a-4488-4d48-ba04-dfc70918d16d could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:46.031837 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4bc608de-41f8-4509-8698-3e4c36d29f55 tempest-LiveMigrationTest-1600938040 tempest-LiveMigrationTest-1600938040-project] 10.222.0.20 "GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d" status: 404 len: 111 microversion: 2.1 time: 0.072867 Sep 06 10:59:46.033236 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1080/2145] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:45 2022] GET /compute/v2.1/servers/9162565a-4488-4d48-ba04-dfc70918d16d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:46.286476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0f3be808-28b0-4db5-a848-f01f8826ba34 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:46.287472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0f3be808-28b0-4db5-a848-f01f8826ba34 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:46.308424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f3be808-28b0-4db5-a848-f01f8826ba34 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:46.310239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f3be808-28b0-4db5-a848-f01f8826ba34 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:46.312139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f3be808-28b0-4db5-a848-f01f8826ba34 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:46.315720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f3be808-28b0-4db5-a848-f01f8826ba34 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:46.317874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f3be808-28b0-4db5-a848-f01f8826ba34 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:46.318823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f3be808-28b0-4db5-a848-f01f8826ba34 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:46.967315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1825013800", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:46.998146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0f3be808-28b0-4db5-a848-f01f8826ba34 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:47.004744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:47.012035 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0f3be808-28b0-4db5-a848-f01f8826ba34 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1315 microversion: 2.1 time: 0.730343 Sep 06 10:59:47.013143 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1066/2146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:46 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:47.019816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eabac675-a331-4321-9b3c-f1eb389acdf6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:47.020464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-eabac675-a331-4321-9b3c-f1eb389acdf6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:47.031958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eabac675-a331-4321-9b3c-f1eb389acdf6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:47.033081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eabac675-a331-4321-9b3c-f1eb389acdf6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:47.033776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eabac675-a331-4321-9b3c-f1eb389acdf6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:47.035619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eabac675-a331-4321-9b3c-f1eb389acdf6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:47.036309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eabac675-a331-4321-9b3c-f1eb389acdf6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:47.037567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eabac675-a331-4321-9b3c-f1eb389acdf6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:47.061585 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-eabac675-a331-4321-9b3c-f1eb389acdf6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eabac675-a331-4321-9b3c-f1eb389acdf6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 HTTP/1.1 Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '5d094fe4-bcd7-4063-8266-a53ee8289624'} Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:47.063440 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:47.067851 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:47.067851 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:47.067851 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:47.067851 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:47.067851 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:47.067851 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:47.067851 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:47.068587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 10:59:47.071504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eabac675-a331-4321-9b3c-f1eb389acdf6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:47.072634 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-eabac675-a331-4321-9b3c-f1eb389acdf6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 404 len: 111 microversion: 2.1 time: 0.057410 Sep 06 10:59:47.073774 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1067/2147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:47 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:47.083407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e3bf5110-6d6a-4cac-aa48-2eefb18fdc16 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90fd08a040>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:47.664254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 10:59:47.664807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 10:59:47.665420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 10:59:47.665962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 10:59:47.666572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 10:59:47.676637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:47.677238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:47.677760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:47.678595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:47.679206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:47.679769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:47.704077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Getting quotas for project 2a1f6f54c8d24eaa9eae09e8f30c56f1. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 10:59:47.707195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Getting quotas for user 3b6e2046e3bd40b3b46802dfa796260b and project 2a1f6f54c8d24eaa9eae09e8f30c56f1. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 10:59:47.723471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 10:59:47.725955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 10:59:47.888078 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e3bf5110-6d6a-4cac-aa48-2eefb18fdc16 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f91a18be-db27-4c9f-99a7-12542d081b4a" status: 202 len: 0 microversion: 2.1 time: 0.809658 Sep 06 10:59:47.896938 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1068/2148] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:59:47 2022] DELETE /compute/v2.1/os-security-groups/f91a18be-db27-4c9f-99a7-12542d081b4a => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:59:47.904147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e50f7898-e132-4ad8-ba3e-17aba1a877ad tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f87089d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:47.923966 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1bcbda65-fbfe-48d5-a30d-a39fb8fb4c37 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183228 Sep 06 10:59:47.924988 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1081/2149] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:59:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 10:59:47.947885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4d38ddf4-6453-4e51-b7a3-a009e8097554 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:47.948522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4d38ddf4-6453-4e51-b7a3-a009e8097554 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:48.344255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4d38ddf4-6453-4e51-b7a3-a009e8097554 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:48.373833 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4d38ddf4-6453-4e51-b7a3-a009e8097554 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1213 microversion: 2.1 time: 0.430865 Sep 06 10:59:48.384258 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1082/2150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:47 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1213 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:48.394630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-951358e0-90d7-47fb-9a3b-3f2424537285 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:48.395358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-951358e0-90d7-47fb-9a3b-3f2424537285 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:48.410897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-951358e0-90d7-47fb-9a3b-3f2424537285 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:48.411985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-951358e0-90d7-47fb-9a3b-3f2424537285 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:48.412449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-951358e0-90d7-47fb-9a3b-3f2424537285 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:48.413186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-951358e0-90d7-47fb-9a3b-3f2424537285 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:48.413808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-951358e0-90d7-47fb-9a3b-3f2424537285 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:48.414763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-951358e0-90d7-47fb-9a3b-3f2424537285 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:49.039004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-951358e0-90d7-47fb-9a3b-3f2424537285 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:49.049229 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-951358e0-90d7-47fb-9a3b-3f2424537285 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1501 microversion: 2.1 time: 0.662272 Sep 06 10:59:49.050929 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1083/2151] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:48 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1501 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:49.081089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-787c7eed-262b-466f-9b7a-a242113a4340 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:49.081674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-787c7eed-262b-466f-9b7a-a242113a4340 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:49.088145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-787c7eed-262b-466f-9b7a-a242113a4340 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:49.088641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-787c7eed-262b-466f-9b7a-a242113a4340 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:49.089085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-787c7eed-262b-466f-9b7a-a242113a4340 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:49.089821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-787c7eed-262b-466f-9b7a-a242113a4340 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:49.090263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-787c7eed-262b-466f-9b7a-a242113a4340 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:49.091632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-787c7eed-262b-466f-9b7a-a242113a4340 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:49.112946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:49.130240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-787c7eed-262b-466f-9b7a-a242113a4340 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lazy-loading 'flavor' on Instance uuid 267d4dad-b118-4f44-993b-81fd05e550df {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:59:49.223775 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e50f7898-e132-4ad8-ba3e-17aba1a877ad tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c46c3c77-f63e-4882-8825-712b7fa7201c" status: 202 len: 0 microversion: 2.1 time: 1.325277 Sep 06 10:59:49.225258 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1069/2152] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:59:47 2022] DELETE /compute/v2.1/os-security-groups/c46c3c77-f63e-4882-8825-712b7fa7201c => generated 0 bytes in 1327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 10:59:49.236690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-90a105e9-ad52-494f-a6fa-5486e5069540 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'create', calling method: .version_select at 0x7f90f3dbcb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-868920194", "description": "tempest-description-1895555861"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:49.971559 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-787c7eed-262b-466f-9b7a-a242113a4340 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "POST /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df/action" status: 202 len: 0 microversion: 2.1 time: 0.895013 Sep 06 10:59:49.972320 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1084/2153] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 10:59:49 2022] POST /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df/action => generated 0 bytes in 897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 10:59:49.998888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f102fd4c-89c7-400d-9c34-58322e701ead tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:50.001980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f102fd4c-89c7-400d-9c34-58322e701ead tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:50.020895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f102fd4c-89c7-400d-9c34-58322e701ead tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:50.021406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f102fd4c-89c7-400d-9c34-58322e701ead tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:50.021848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f102fd4c-89c7-400d-9c34-58322e701ead tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:50.022582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f102fd4c-89c7-400d-9c34-58322e701ead tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:50.030313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f102fd4c-89c7-400d-9c34-58322e701ead tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:50.030825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f102fd4c-89c7-400d-9c34-58322e701ead tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:50.196849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f102fd4c-89c7-400d-9c34-58322e701ead tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:50.209540 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f102fd4c-89c7-400d-9c34-58322e701ead tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1209 microversion: 2.1 time: 0.235138 Sep 06 10:59:50.211261 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1085/2154] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:49 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1209 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:50.218451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-71557639-4617-4155-bd99-99b19694791e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:50.219216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-71557639-4617-4155-bd99-99b19694791e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:50.229243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71557639-4617-4155-bd99-99b19694791e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:50.230248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71557639-4617-4155-bd99-99b19694791e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:50.231111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71557639-4617-4155-bd99-99b19694791e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:50.231909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71557639-4617-4155-bd99-99b19694791e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:50.233414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71557639-4617-4155-bd99-99b19694791e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:50.234176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71557639-4617-4155-bd99-99b19694791e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:50.403722 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-90a105e9-ad52-494f-a6fa-5486e5069540 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.171876 Sep 06 10:59:50.429697 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1070/2155] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 10:59:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 10:59:50.460581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4372118d-0da0-49bb-9833-2fecfd4f14a2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Action: 'update', calling method: .version_select at 0x7f90f85fcb80>, body: {"security_group": {"name": "tempest-sg-hth-414589022", "description": "tempest-description-hth-510220095"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:50.677436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-71557639-4617-4155-bd99-99b19694791e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:50.688381 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-71557639-4617-4155-bd99-99b19694791e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.475726 Sep 06 10:59:50.689229 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1086/2156] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:50 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:51.238850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8525a58c-7fe3-434b-bc8a-cd49d20e1f42 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:51.239648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8525a58c-7fe3-434b-bc8a-cd49d20e1f42 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:51.248935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8525a58c-7fe3-434b-bc8a-cd49d20e1f42 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:51.249555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8525a58c-7fe3-434b-bc8a-cd49d20e1f42 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:51.250278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8525a58c-7fe3-434b-bc8a-cd49d20e1f42 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:51.251279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8525a58c-7fe3-434b-bc8a-cd49d20e1f42 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:51.251827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8525a58c-7fe3-434b-bc8a-cd49d20e1f42 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:51.252473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8525a58c-7fe3-434b-bc8a-cd49d20e1f42 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:51.287533 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4372118d-0da0-49bb-9833-2fecfd4f14a2 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/624d22b1-8c02-4f34-8556-61c129db9388" status: 200 len: 216 microversion: 2.1 time: 0.856797 Sep 06 10:59:51.288152 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1071/2157] 10.222.0.20 () {60 vars in 1290 bytes} [Tue Sep 6 10:59:50 2022] PUT /compute/v2.1/os-security-groups/624d22b1-8c02-4f34-8556-61c129db9388 => generated 216 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:51.302315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ab28b84e-b29e-4c87-bee8-adf80fb3e35a tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f8520040>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:51.705816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8525a58c-7fe3-434b-bc8a-cd49d20e1f42 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:51.742229 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8525a58c-7fe3-434b-bc8a-cd49d20e1f42 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1273 microversion: 2.1 time: 0.507606 Sep 06 10:59:51.745160 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1087/2158] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:51 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1273 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:51.753533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-404ba19f-72eb-452d-a425-4a88bdcbc8a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:51.756749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-404ba19f-72eb-452d-a425-4a88bdcbc8a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:51.776758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-404ba19f-72eb-452d-a425-4a88bdcbc8a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:51.777543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-404ba19f-72eb-452d-a425-4a88bdcbc8a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:51.780557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-404ba19f-72eb-452d-a425-4a88bdcbc8a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:51.781704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-404ba19f-72eb-452d-a425-4a88bdcbc8a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:51.783585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-404ba19f-72eb-452d-a425-4a88bdcbc8a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:51.784826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-404ba19f-72eb-452d-a425-4a88bdcbc8a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:51.789343 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ab28b84e-b29e-4c87-bee8-adf80fb3e35a tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/624d22b1-8c02-4f34-8556-61c129db9388" status: 200 len: 216 microversion: 2.1 time: 0.491855 Sep 06 10:59:51.790205 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1072/2159] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 10:59:51 2022] GET /compute/v2.1/os-security-groups/624d22b1-8c02-4f34-8556-61c129db9388 => generated 216 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:51.809650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d19471e0-d23f-4ddf-998c-476d1273b76b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f8bd85e0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:52.233184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-404ba19f-72eb-452d-a425-4a88bdcbc8a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:52.243661 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-404ba19f-72eb-452d-a425-4a88bdcbc8a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.496974 Sep 06 10:59:52.244339 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1088/2160] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:51 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:52.566238 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d19471e0-d23f-4ddf-998c-476d1273b76b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/624d22b1-8c02-4f34-8556-61c129db9388" status: 202 len: 0 microversion: 2.1 time: 0.761546 Sep 06 10:59:52.567432 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1073/2161] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:59:51 2022] DELETE /compute/v2.1/os-security-groups/624d22b1-8c02-4f34-8556-61c129db9388 => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 10:59:52.576015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3592b63d-ce57-416e-83d1-06e56715d34f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:52.577701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3592b63d-ce57-416e-83d1-06e56715d34f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:52.590791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3592b63d-ce57-416e-83d1-06e56715d34f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:52.593597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3592b63d-ce57-416e-83d1-06e56715d34f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:52.594154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3592b63d-ce57-416e-83d1-06e56715d34f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:52.599921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3592b63d-ce57-416e-83d1-06e56715d34f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:52.599921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3592b63d-ce57-416e-83d1-06e56715d34f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:52.599921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3592b63d-ce57-416e-83d1-06e56715d34f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:52.631808 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-3592b63d-ce57-416e-83d1-06e56715d34f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3592b63d-ce57-416e-83d1-06e56715d34f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 HTTP/1.1 Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '5d094fe4-bcd7-4063-8266-a53ee8289624'} Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:59:52.633521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:59:52.637526 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:52.637526 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.637526 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:52.637526 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.637526 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:52.637526 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:52.637526 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:52.637526 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:52.637526 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:52.637526 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:52.637526 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.637526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3592b63d-ce57-416e-83d1-06e56715d34f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:52.637526 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3592b63d-ce57-416e-83d1-06e56715d34f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 404 len: 111 microversion: 2.1 time: 0.063989 Sep 06 10:59:52.644232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-729082dc-0cf0-4ccc-b95d-1eb1993513b0 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:52.644853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-729082dc-0cf0-4ccc-b95d-1eb1993513b0 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 5d094fe4-bcd7-4063-8266-a53ee8289624] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:52.654330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-729082dc-0cf0-4ccc-b95d-1eb1993513b0 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:52.654869 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1089/2162] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:59:52 2022] DELETE /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:52.659777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-729082dc-0cf0-4ccc-b95d-1eb1993513b0 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:52.660551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-729082dc-0cf0-4ccc-b95d-1eb1993513b0 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:52.661525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-729082dc-0cf0-4ccc-b95d-1eb1993513b0 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:52.662340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-729082dc-0cf0-4ccc-b95d-1eb1993513b0 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:52.668538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-729082dc-0cf0-4ccc-b95d-1eb1993513b0 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:52.689164 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-729082dc-0cf0-4ccc-b95d-1eb1993513b0 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-729082dc-0cf0-4ccc-b95d-1eb1993513b0 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 HTTP/1.1 Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '5d094fe4-bcd7-4063-8266-a53ee8289624'} Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:52.692378 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.695991 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:52.695991 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:52.695991 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:52.695991 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:52.695991 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:52.695991 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. Sep 06 10:59:52.695991 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.697846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-729082dc-0cf0-4ccc-b95d-1eb1993513b0 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Instance 5d094fe4-bcd7-4063-8266-a53ee8289624 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:52.698832 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-729082dc-0cf0-4ccc-b95d-1eb1993513b0 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624" status: 404 len: 111 microversion: 2.1 time: 0.058438 Sep 06 10:59:52.704445 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1074/2163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:52 2022] GET /compute/v2.1/servers/5d094fe4-bcd7-4063-8266-a53ee8289624 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:52.712561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4270770f-1a54-49b7-828f-3e0efee6ec7f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90fd10c040>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:52.774867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2e65ad6f-8331-4872-b6e9-f93c0b17b21f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:52.774867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2e65ad6f-8331-4872-b6e9-f93c0b17b21f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:52.778463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e65ad6f-8331-4872-b6e9-f93c0b17b21f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:52.778966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e65ad6f-8331-4872-b6e9-f93c0b17b21f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:52.779459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e65ad6f-8331-4872-b6e9-f93c0b17b21f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:52.782630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e65ad6f-8331-4872-b6e9-f93c0b17b21f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:52.785053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e65ad6f-8331-4872-b6e9-f93c0b17b21f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:52.785707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e65ad6f-8331-4872-b6e9-f93c0b17b21f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:52.911816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-4270770f-1a54-49b7-828f-3e0efee6ec7f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c46c3c77-f63e-4882-8825-712b7fa7201c does not exist", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:59:52.912377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.security_group_api [None req-4270770f-1a54-49b7-828f-3e0efee6ec7f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Neutron security group c46c3c77-f63e-4882-8825-712b7fa7201c not found {{(pid=140876) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 10:59:52.912901 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-4270770f-1a54-49b7-828f-3e0efee6ec7f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Security group c46c3c77-f63e-4882-8825-712b7fa7201c does not exist Sep 06 10:59:52.912901 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-8fd67aa4-cca3-46a9-a4a1-8ab3748c553c'] Sep 06 10:59:52.919598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2e65ad6f-8331-4872-b6e9-f93c0b17b21f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4270770f-1a54-49b7-828f-3e0efee6ec7f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-security-groups/c46c3c77-f63e-4882-8825-712b7fa7201c HTTP/1.1 Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: exception: Security group c46c3c77-f63e-4882-8825-712b7fa7201c does not exist Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-8fd67aa4-cca3-46a9-a4a1-8ab3748c553c'] Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'c46c3c77-f63e-4882-8825-712b7fa7201c'} Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:59:52.927097 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c46c3c77-f63e-4882-8825-712b7fa7201c does not exist Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8fd67aa4-cca3-46a9-a4a1-8ab3748c553c'] Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c46c3c77-f63e-4882-8825-712b7fa7201c does not exist Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8fd67aa4-cca3-46a9-a4a1-8ab3748c553c'] Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c46c3c77-f63e-4882-8825-712b7fa7201c does not exist Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8fd67aa4-cca3-46a9-a4a1-8ab3748c553c'] Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c46c3c77-f63e-4882-8825-712b7fa7201c does not exist Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8fd67aa4-cca3-46a9-a4a1-8ab3748c553c'] Sep 06 10:59:52.930504 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:52.933991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4270770f-1a54-49b7-828f-3e0efee6ec7f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Security group c46c3c77-f63e-4882-8825-712b7fa7201c does not exist Sep 06 10:59:52.933991 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-8fd67aa4-cca3-46a9-a4a1-8ab3748c553c'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:52.934216 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4270770f-1a54-49b7-828f-3e0efee6ec7f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c46c3c77-f63e-4882-8825-712b7fa7201c" status: 404 len: 194 microversion: 2.1 time: 0.225413 Sep 06 10:59:52.937318 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1090/2164] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:59:52 2022] DELETE /compute/v2.1/os-security-groups/c46c3c77-f63e-4882-8825-712b7fa7201c => generated 194 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:52.944404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-be7a990d-f587-40f0-83a4-9467d9553eb6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f8597f70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:52.945070 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2e65ad6f-8331-4872-b6e9-f93c0b17b21f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1271 microversion: 2.1 time: 0.180597 Sep 06 10:59:52.945670 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1075/2165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:52 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:53.103665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-be7a990d-f587-40f0-83a4-9467d9553eb6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f91a18be-db27-4c9f-99a7-12542d081b4a does not exist", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:59:53.104276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.security_group_api [None req-be7a990d-f587-40f0-83a4-9467d9553eb6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Neutron security group f91a18be-db27-4c9f-99a7-12542d081b4a not found {{(pid=140876) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 10:59:53.104811 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-be7a990d-f587-40f0-83a4-9467d9553eb6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Security group f91a18be-db27-4c9f-99a7-12542d081b4a does not exist Sep 06 10:59:53.104811 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-476834d1-8639-4e56-b5f1-0fb8ec2e153e'] Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-be7a990d-f587-40f0-83a4-9467d9553eb6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-security-groups/f91a18be-db27-4c9f-99a7-12542d081b4a HTTP/1.1 Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: exception: Security group f91a18be-db27-4c9f-99a7-12542d081b4a does not exist Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-476834d1-8639-4e56-b5f1-0fb8ec2e153e'] Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'f91a18be-db27-4c9f-99a7-12542d081b4a'} Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:59:53.106659 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f91a18be-db27-4c9f-99a7-12542d081b4a does not exist Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-476834d1-8639-4e56-b5f1-0fb8ec2e153e'] Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f91a18be-db27-4c9f-99a7-12542d081b4a does not exist Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-476834d1-8639-4e56-b5f1-0fb8ec2e153e'] Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f91a18be-db27-4c9f-99a7-12542d081b4a does not exist Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-476834d1-8639-4e56-b5f1-0fb8ec2e153e'] Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f91a18be-db27-4c9f-99a7-12542d081b4a does not exist Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-476834d1-8639-4e56-b5f1-0fb8ec2e153e'] Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-be7a990d-f587-40f0-83a4-9467d9553eb6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Security group f91a18be-db27-4c9f-99a7-12542d081b4a does not exist Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-476834d1-8639-4e56-b5f1-0fb8ec2e153e'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-be7a990d-f587-40f0-83a4-9467d9553eb6 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f91a18be-db27-4c9f-99a7-12542d081b4a" status: 404 len: 194 microversion: 2.1 time: 0.168876 Sep 06 10:59:53.113764 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1091/2166] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:59:52 2022] DELETE /compute/v2.1/os-security-groups/f91a18be-db27-4c9f-99a7-12542d081b4a => generated 194 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:53.122712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0049367f-d6d7-4b67-ac97-88852229b99d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f8520ca0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:53.261442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG neutronclient.v2_0.client [None req-0049367f-d6d7-4b67-ac97-88852229b99d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist", "detail": ""}} {{(pid=140875) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:59:53.262057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.security_group_api [None req-0049367f-d6d7-4b67-ac97-88852229b99d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Neutron security group 17c010fb-53b6-4081-a08d-73cfdbc27249 not found {{(pid=140875) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 10:59:53.262593 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-0049367f-d6d7-4b67-ac97-88852229b99d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:59:53.262593 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-8b2e2e75-5b26-4d38-9fc5-57371123822e'] Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0049367f-d6d7-4b67-ac97-88852229b99d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/os-security-groups/17c010fb-53b6-4081-a08d-73cfdbc27249 HTTP/1.1 Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: exception: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-8b2e2e75-5b26-4d38-9fc5-57371123822e'] Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '17c010fb-53b6-4081-a08d-73cfdbc27249'} Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:59:53.264595 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b2e2e75-5b26-4d38-9fc5-57371123822e'] Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b2e2e75-5b26-4d38-9fc5-57371123822e'] Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b2e2e75-5b26-4d38-9fc5-57371123822e'] Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b2e2e75-5b26-4d38-9fc5-57371123822e'] Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0049367f-d6d7-4b67-ac97-88852229b99d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Security group 17c010fb-53b6-4081-a08d-73cfdbc27249 does not exist Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-8b2e2e75-5b26-4d38-9fc5-57371123822e'] {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0049367f-d6d7-4b67-ac97-88852229b99d tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/17c010fb-53b6-4081-a08d-73cfdbc27249" status: 404 len: 194 microversion: 2.1 time: 0.152222 Sep 06 10:59:53.269183 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1076/2167] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:59:53 2022] DELETE /compute/v2.1/os-security-groups/17c010fb-53b6-4081-a08d-73cfdbc27249 => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:53.274623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a595c27d-022e-4c18-8278-9d394d66634f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90fd1210d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:53.283467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8c75dff0-8d32-48bc-937f-24c8a33f1ba9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:53.289466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8c75dff0-8d32-48bc-937f-24c8a33f1ba9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:53.301548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c75dff0-8d32-48bc-937f-24c8a33f1ba9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:53.303115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c75dff0-8d32-48bc-937f-24c8a33f1ba9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:53.304613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c75dff0-8d32-48bc-937f-24c8a33f1ba9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:53.305525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c75dff0-8d32-48bc-937f-24c8a33f1ba9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:53.306196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c75dff0-8d32-48bc-937f-24c8a33f1ba9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:53.306983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c75dff0-8d32-48bc-937f-24c8a33f1ba9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-a595c27d-022e-4c18-8278-9d394d66634f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.security_group_api [None req-a595c27d-022e-4c18-8278-9d394d66634f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Neutron security group f4416d2a-d4a3-4497-9758-4e00d1d73573 not found {{(pid=140876) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-a595c27d-022e-4c18-8278-9d394d66634f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-62453387-15dc-4ea3-a9ea-a9f31a13ba34'] Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a595c27d-022e-4c18-8278-9d394d66634f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-security-groups/f4416d2a-d4a3-4497-9758-4e00d1d73573 HTTP/1.1 Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: exception: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-62453387-15dc-4ea3-a9ea-a9f31a13ba34'] Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'f4416d2a-d4a3-4497-9758-4e00d1d73573'} Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:59:53.366386 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62453387-15dc-4ea3-a9ea-a9f31a13ba34'] Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62453387-15dc-4ea3-a9ea-a9f31a13ba34'] Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62453387-15dc-4ea3-a9ea-a9f31a13ba34'] Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62453387-15dc-4ea3-a9ea-a9f31a13ba34'] Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a595c27d-022e-4c18-8278-9d394d66634f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Security group f4416d2a-d4a3-4497-9758-4e00d1d73573 does not exist Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-62453387-15dc-4ea3-a9ea-a9f31a13ba34'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a595c27d-022e-4c18-8278-9d394d66634f tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f4416d2a-d4a3-4497-9758-4e00d1d73573" status: 404 len: 194 microversion: 2.1 time: 0.095837 Sep 06 10:59:53.370593 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1092/2168] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:59:53 2022] DELETE /compute/v2.1/os-security-groups/f4416d2a-d4a3-4497-9758-4e00d1d73573 => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:53.381959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c356771f-95da-4110-a082-9e6b4eb6666e tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f870d700>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:53.470799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-c356771f-95da-4110-a082-9e6b4eb6666e tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:59:53.471647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.security_group_api [None req-c356771f-95da-4110-a082-9e6b4eb6666e tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Neutron security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 not found {{(pid=140876) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 10:59:53.472336 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-c356771f-95da-4110-a082-9e6b4eb6666e tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:59:53.472336 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-bd973a3c-a7cf-45ee-87e1-1f13590d0ae2'] Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c356771f-95da-4110-a082-9e6b4eb6666e tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-security-groups/f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 HTTP/1.1 Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: exception: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-bd973a3c-a7cf-45ee-87e1-1f13590d0ae2'] Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'f08b8b12-68d1-4f06-9c9a-3ec51c4f2161'} Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:59:53.474537 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd973a3c-a7cf-45ee-87e1-1f13590d0ae2'] Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd973a3c-a7cf-45ee-87e1-1f13590d0ae2'] Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd973a3c-a7cf-45ee-87e1-1f13590d0ae2'] Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd973a3c-a7cf-45ee-87e1-1f13590d0ae2'] Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c356771f-95da-4110-a082-9e6b4eb6666e tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Security group f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 does not exist Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-bd973a3c-a7cf-45ee-87e1-1f13590d0ae2'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c356771f-95da-4110-a082-9e6b4eb6666e tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f08b8b12-68d1-4f06-9c9a-3ec51c4f2161" status: 404 len: 194 microversion: 2.1 time: 0.103451 Sep 06 10:59:53.482339 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1093/2169] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:59:53 2022] DELETE /compute/v2.1/os-security-groups/f08b8b12-68d1-4f06-9c9a-3ec51c4f2161 => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 10:59:53.486467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-47647ef2-d857-4d7f-b3fc-fb414f03385b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90fd10cca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:53.540545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-47647ef2-d857-4d7f-b3fc-fb414f03385b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 10:59:53.541214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.security_group_api [None req-47647ef2-d857-4d7f-b3fc-fb414f03385b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Neutron security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 not found {{(pid=140876) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 10:59:53.541752 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-47647ef2-d857-4d7f-b3fc-fb414f03385b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:59:53.541752 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-c0df23b0-027a-4261-8fa6-e0b1c7124e1c'] Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-47647ef2-d857-4d7f-b3fc-fb414f03385b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-security-groups/5904aa0b-88c1-4fc7-8de4-0a6dee265c57 HTTP/1.1 Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: exception: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-c0df23b0-027a-4261-8fa6-e0b1c7124e1c'] Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '5904aa0b-88c1-4fc7-8de4-0a6dee265c57'} Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 10:59:53.546693 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0df23b0-027a-4261-8fa6-e0b1c7124e1c'] Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0df23b0-027a-4261-8fa6-e0b1c7124e1c'] Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0df23b0-027a-4261-8fa6-e0b1c7124e1c'] Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0df23b0-027a-4261-8fa6-e0b1c7124e1c'] Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-47647ef2-d857-4d7f-b3fc-fb414f03385b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Security group 5904aa0b-88c1-4fc7-8de4-0a6dee265c57 does not exist Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-c0df23b0-027a-4261-8fa6-e0b1c7124e1c'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 10:59:53.550731 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-47647ef2-d857-4d7f-b3fc-fb414f03385b tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5904aa0b-88c1-4fc7-8de4-0a6dee265c57" status: 404 len: 194 microversion: 2.1 time: 0.068263 Sep 06 10:59:53.555224 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1094/2170] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 10:59:53 2022] DELETE /compute/v2.1/os-security-groups/5904aa0b-88c1-4fc7-8de4-0a6dee265c57 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 10:59:53.567153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-929de328-75a2-435f-8398-e9e899b92f76 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:53.570437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-929de328-75a2-435f-8398-e9e899b92f76 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:53.580173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-929de328-75a2-435f-8398-e9e899b92f76 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:53.581185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-929de328-75a2-435f-8398-e9e899b92f76 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:53.581923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-929de328-75a2-435f-8398-e9e899b92f76 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:53.582827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-929de328-75a2-435f-8398-e9e899b92f76 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:53.583502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-929de328-75a2-435f-8398-e9e899b92f76 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:53.584097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-929de328-75a2-435f-8398-e9e899b92f76 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:53.667227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-929de328-75a2-435f-8398-e9e899b92f76 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 10:59:53.667360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8c75dff0-8d32-48bc-937f-24c8a33f1ba9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:53.675080 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8c75dff0-8d32-48bc-937f-24c8a33f1ba9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.395823 Sep 06 10:59:53.685433 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1077/2171] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:53 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:53.980140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-25340ab2-249d-4efc-8c74-10d824b1cc76 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:53.980772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-25340ab2-249d-4efc-8c74-10d824b1cc76 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:53.992823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25340ab2-249d-4efc-8c74-10d824b1cc76 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:53.992823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25340ab2-249d-4efc-8c74-10d824b1cc76 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:53.999621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25340ab2-249d-4efc-8c74-10d824b1cc76 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:54.000446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25340ab2-249d-4efc-8c74-10d824b1cc76 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:54.000945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25340ab2-249d-4efc-8c74-10d824b1cc76 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:54.001401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25340ab2-249d-4efc-8c74-10d824b1cc76 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:54.043359 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-929de328-75a2-435f-8398-e9e899b92f76 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 204 len: 0 microversion: 2.1 time: 0.481057 Sep 06 10:59:54.044006 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1095/2172] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 10:59:53 2022] DELETE /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 10:59:54.059160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c73702cd-6660-4f28-86bd-eacf8d5a568a tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:54.060098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c73702cd-6660-4f28-86bd-eacf8d5a568a tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:54.067853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c73702cd-6660-4f28-86bd-eacf8d5a568a tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:54.068736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c73702cd-6660-4f28-86bd-eacf8d5a568a tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:54.069201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c73702cd-6660-4f28-86bd-eacf8d5a568a tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:54.070107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c73702cd-6660-4f28-86bd-eacf8d5a568a tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:54.070643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c73702cd-6660-4f28-86bd-eacf8d5a568a tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:54.071145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c73702cd-6660-4f28-86bd-eacf8d5a568a tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:54.125177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-25340ab2-249d-4efc-8c74-10d824b1cc76 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:54.135805 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-25340ab2-249d-4efc-8c74-10d824b1cc76 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1271 microversion: 2.1 time: 0.161395 Sep 06 10:59:54.143831 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1078/2173] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:53 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:54.484171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c73702cd-6660-4f28-86bd-eacf8d5a568a tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:54.500260 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c73702cd-6660-4f28-86bd-eacf8d5a568a tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1647 microversion: 2.1 time: 0.444301 Sep 06 10:59:54.500953 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1096/2174] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:54 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1647 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:54.703102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ccd228d5-8dec-4607-b80e-4431f36583c9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:54.703102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ccd228d5-8dec-4607-b80e-4431f36583c9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:54.711478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccd228d5-8dec-4607-b80e-4431f36583c9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:54.712464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccd228d5-8dec-4607-b80e-4431f36583c9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:54.713306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccd228d5-8dec-4607-b80e-4431f36583c9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:54.714784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccd228d5-8dec-4607-b80e-4431f36583c9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:54.715503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccd228d5-8dec-4607-b80e-4431f36583c9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:54.717157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccd228d5-8dec-4607-b80e-4431f36583c9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:55.036688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ccd228d5-8dec-4607-b80e-4431f36583c9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:55.053158 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ccd228d5-8dec-4607-b80e-4431f36583c9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.357991 Sep 06 10:59:55.054808 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1079/2175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:54 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:55.165338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1d528d80-ddc1-4acb-bf47-798d76e2de93 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:55.165921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1d528d80-ddc1-4acb-bf47-798d76e2de93 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:55.179790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d528d80-ddc1-4acb-bf47-798d76e2de93 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:55.183450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d528d80-ddc1-4acb-bf47-798d76e2de93 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:55.184108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d528d80-ddc1-4acb-bf47-798d76e2de93 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:55.189173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d528d80-ddc1-4acb-bf47-798d76e2de93 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:55.189923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d528d80-ddc1-4acb-bf47-798d76e2de93 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:55.190646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d528d80-ddc1-4acb-bf47-798d76e2de93 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:55.526765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2f405a62-f5f2-43b1-a429-f5d30d159a05 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:55.527598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2f405a62-f5f2-43b1-a429-f5d30d159a05 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:55.543835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f405a62-f5f2-43b1-a429-f5d30d159a05 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:55.544416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f405a62-f5f2-43b1-a429-f5d30d159a05 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:55.545025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f405a62-f5f2-43b1-a429-f5d30d159a05 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:55.545881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f405a62-f5f2-43b1-a429-f5d30d159a05 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:55.546461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f405a62-f5f2-43b1-a429-f5d30d159a05 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:55.547192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f405a62-f5f2-43b1-a429-f5d30d159a05 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:56.270972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d528d80-ddc1-4acb-bf47-798d76e2de93 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:56.284004 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1d528d80-ddc1-4acb-bf47-798d76e2de93 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1313 microversion: 2.1 time: 1.126881 Sep 06 10:59:56.285894 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1097/2176] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:55 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1313 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:56.293447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a46a96f6-1861-4fd6-bc84-4f127fd0740c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:56.294367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a46a96f6-1861-4fd6-bc84-4f127fd0740c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:56.305911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a46a96f6-1861-4fd6-bc84-4f127fd0740c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:56.307513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a46a96f6-1861-4fd6-bc84-4f127fd0740c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:56.308242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a46a96f6-1861-4fd6-bc84-4f127fd0740c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:56.314414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a46a96f6-1861-4fd6-bc84-4f127fd0740c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:56.315396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a46a96f6-1861-4fd6-bc84-4f127fd0740c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:56.316298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a46a96f6-1861-4fd6-bc84-4f127fd0740c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:56.533422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2f405a62-f5f2-43b1-a429-f5d30d159a05 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:56.548915 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2f405a62-f5f2-43b1-a429-f5d30d159a05 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1647 microversion: 2.1 time: 1.021719 Sep 06 10:59:56.548915 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1080/2177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:55 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1647 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:56.855733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a46a96f6-1861-4fd6-bc84-4f127fd0740c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:56.863787 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a46a96f6-1861-4fd6-bc84-4f127fd0740c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.575155 Sep 06 10:59:56.875523 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1098/2178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:56 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:57.323925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-793b5509-8077-49e2-adeb-c20a04df1002 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:57.323925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-793b5509-8077-49e2-adeb-c20a04df1002 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:57.326776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-793b5509-8077-49e2-adeb-c20a04df1002 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:57.327308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-793b5509-8077-49e2-adeb-c20a04df1002 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:57.327928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-793b5509-8077-49e2-adeb-c20a04df1002 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:57.328793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-793b5509-8077-49e2-adeb-c20a04df1002 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:57.329882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-793b5509-8077-49e2-adeb-c20a04df1002 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:57.332740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-793b5509-8077-49e2-adeb-c20a04df1002 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:57.568492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d3527571-d267-4ee1-b6dd-61ca25ee8733 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:57.569121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3527571-d267-4ee1-b6dd-61ca25ee8733 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:57.593351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3527571-d267-4ee1-b6dd-61ca25ee8733 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:57.593968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3527571-d267-4ee1-b6dd-61ca25ee8733 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:57.594302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3527571-d267-4ee1-b6dd-61ca25ee8733 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:57.595048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3527571-d267-4ee1-b6dd-61ca25ee8733 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:57.595516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3527571-d267-4ee1-b6dd-61ca25ee8733 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:57.595957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3527571-d267-4ee1-b6dd-61ca25ee8733 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:57.712492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:57.798937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d3527571-d267-4ee1-b6dd-61ca25ee8733 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:57.817733 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d3527571-d267-4ee1-b6dd-61ca25ee8733 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1469 microversion: 2.1 time: 0.249284 Sep 06 10:59:57.822576 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1099/2179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:57 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1469 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:57.894908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1addefb5-ece2-4e37-9d40-178f73eac913 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:57.896608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1addefb5-ece2-4e37-9d40-178f73eac913 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:57.905988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1addefb5-ece2-4e37-9d40-178f73eac913 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:57.908910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1addefb5-ece2-4e37-9d40-178f73eac913 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:57.915200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1addefb5-ece2-4e37-9d40-178f73eac913 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:57.915200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1addefb5-ece2-4e37-9d40-178f73eac913 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:57.915200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1addefb5-ece2-4e37-9d40-178f73eac913 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:57.915200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1addefb5-ece2-4e37-9d40-178f73eac913 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:58.197615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-793b5509-8077-49e2-adeb-c20a04df1002 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:58.211324 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-793b5509-8077-49e2-adeb-c20a04df1002 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1313 microversion: 2.1 time: 0.902406 Sep 06 10:59:58.238034 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1081/2180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:57 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1313 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:58.254514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-8cfd58c3-2b88-4154-b457-5f62c09bf044 req-0e1e8368-3108-459f-8338-22192c939eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109feea8-7249-41b8-a662-673aebba1930", "name": "network-vif-deleted", "tag": "824afb7c-dc73-4081-b4ca-c33182803e3d"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 10:59:58.268277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8cfd58c3-2b88-4154-b457-5f62c09bf044 req-0e1e8368-3108-459f-8338-22192c939eab service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:58.269188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8cfd58c3-2b88-4154-b457-5f62c09bf044 req-0e1e8368-3108-459f-8338-22192c939eab service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:58.275535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8cfd58c3-2b88-4154-b457-5f62c09bf044 req-0e1e8368-3108-459f-8338-22192c939eab service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:58.292765 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-8cfd58c3-2b88-4154-b457-5f62c09bf044 req-0e1e8368-3108-459f-8338-22192c939eab service nova] Creating event network-vif-deleted:824afb7c-dc73-4081-b4ca-c33182803e3d for instance 109feea8-7249-41b8-a662-673aebba1930 on nch2-master-1 Sep 06 10:59:58.315532 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-8cfd58c3-2b88-4154-b457-5f62c09bf044 req-0e1e8368-3108-459f-8338-22192c939eab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075515 Sep 06 10:59:58.321527 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1082/2181] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 10:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 10:59:58.373910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:58.742394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1addefb5-ece2-4e37-9d40-178f73eac913 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:58.754821 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1addefb5-ece2-4e37-9d40-178f73eac913 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.864464 Sep 06 10:59:58.767550 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1100/2182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:57 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 10:59:58.847389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:58.847389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:58.865501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:58.865712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:58.866499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:58.867290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:58.867881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:58.868326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:58.986533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:58.987133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:58.987593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:58.988060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lazy-loading 'fault' on Instance uuid 109feea8-7249-41b8-a662-673aebba1930 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 10:59:59.243051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3c097371-30f8-4232-8e83-9920f3eaa7e6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:59.243780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3c097371-30f8-4232-8e83-9920f3eaa7e6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:59.255983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c097371-30f8-4232-8e83-9920f3eaa7e6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:59.256791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c097371-30f8-4232-8e83-9920f3eaa7e6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:59.258661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c097371-30f8-4232-8e83-9920f3eaa7e6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:59.263769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c097371-30f8-4232-8e83-9920f3eaa7e6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:59.264933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c097371-30f8-4232-8e83-9920f3eaa7e6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:59.265740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c097371-30f8-4232-8e83-9920f3eaa7e6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:59.597575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5689d1981ee04c7b8dbcb4e9e1afd6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df100d31d294ce6858d12ea23adb2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 10:59:59.606023 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f02e0616-dcb0-47ca-9423-1172038357f8 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 200 len: 1306 microversion: 2.1 time: 0.767435 Sep 06 10:59:59.607032 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1083/2183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:58 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 1306 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 10:59:59.782316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-baba4ea2-c05a-40bb-a003-e1b4088c3f63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 10:59:59.783236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-baba4ea2-c05a-40bb-a003-e1b4088c3f63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 10:59:59.804543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-baba4ea2-c05a-40bb-a003-e1b4088c3f63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:59.805839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-baba4ea2-c05a-40bb-a003-e1b4088c3f63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:59.809431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-baba4ea2-c05a-40bb-a003-e1b4088c3f63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 10:59:59.812151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-baba4ea2-c05a-40bb-a003-e1b4088c3f63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 10:59:59.814715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-baba4ea2-c05a-40bb-a003-e1b4088c3f63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 10:59:59.816336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-baba4ea2-c05a-40bb-a003-e1b4088c3f63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:00.130243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3c097371-30f8-4232-8e83-9920f3eaa7e6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:00.141273 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3c097371-30f8-4232-8e83-9920f3eaa7e6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1313 microversion: 2.1 time: 0.903860 Sep 06 11:00:00.158717 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1101/2184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:59 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1313 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:00:00.445467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-1cd19eeb-fcea-443f-9832-db69496e9c7a req-61a20d59-53e4-4a84-8123-c8b0e14f1f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6acc0bc9-8746-46d4-b4bb-54029da58446", "tag": "75a4b9ec-0116-4843-8da2-96eb38ec81a3"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:00.462155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-baba4ea2-c05a-40bb-a003-e1b4088c3f63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:00.467765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1cd19eeb-fcea-443f-9832-db69496e9c7a req-61a20d59-53e4-4a84-8123-c8b0e14f1f12 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:00.468479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1cd19eeb-fcea-443f-9832-db69496e9c7a req-61a20d59-53e4-4a84-8123-c8b0e14f1f12 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:00.469110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1cd19eeb-fcea-443f-9832-db69496e9c7a req-61a20d59-53e4-4a84-8123-c8b0e14f1f12 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:00.473664 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-baba4ea2-c05a-40bb-a003-e1b4088c3f63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.699177 Sep 06 11:00:00.477228 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1084/2185] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:59:59 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:00:00.485980 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-1cd19eeb-fcea-443f-9832-db69496e9c7a req-61a20d59-53e4-4a84-8123-c8b0e14f1f12 service nova] Creating event network-changed:75a4b9ec-0116-4843-8da2-96eb38ec81a3 for instance 6acc0bc9-8746-46d4-b4bb-54029da58446 on nch2-master-1 Sep 06 11:00:00.503926 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-1cd19eeb-fcea-443f-9832-db69496e9c7a req-61a20d59-53e4-4a84-8123-c8b0e14f1f12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062557 Sep 06 11:00:00.504861 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1102/2186] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:00:00.649908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6702f168-fca5-496d-8f37-3b8a163e3670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:00.651269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6702f168-fca5-496d-8f37-3b8a163e3670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] [instance: 109feea8-7249-41b8-a662-673aebba1930] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:00.658562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6702f168-fca5-496d-8f37-3b8a163e3670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:00.659717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6702f168-fca5-496d-8f37-3b8a163e3670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:00.660389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6702f168-fca5-496d-8f37-3b8a163e3670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:00.661357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6702f168-fca5-496d-8f37-3b8a163e3670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:00.662040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6702f168-fca5-496d-8f37-3b8a163e3670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:00.662681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6702f168-fca5-496d-8f37-3b8a163e3670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:00.680003 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-6702f168-fca5-496d-8f37-3b8a163e3670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] HTTP exception thrown: Instance 109feea8-7249-41b8-a662-673aebba1930 could not be found. Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6702f168-fca5-496d-8f37-3b8a163e3670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Request method failure captured: Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 HTTP/1.1 Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyfIwudNUDHeNPFxrXp-juTkcAYVcXKIcV0vkeqmoeLM8VOlu4q7lt75KvO9JUjbaZ5osZbQXsUFcl8_rvyWQ-gI7kjHnYDfhzWMsuILBCgBqY21lbSYQoSO--1ovm41gNG-t57Xsej6MH9haGKtSH36iGnGyBG5OKkLekBa9ImwMl0 Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0df100d31d294ce6858d12ea23adb2b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0df100d31d294ce6858d12ea23adb2b4"}]}] Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0df100d31d294ce6858d12ea23adb2b4 Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1987257183 Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5689d1981ee04c7b8dbcb4e9e1afd6cd Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-SecurityGroupsTestJSON-1987257183-project Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 109feea8-7249-41b8-a662-673aebba1930 could not be found. Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '109feea8-7249-41b8-a662-673aebba1930'} Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109feea8-7249-41b8-a662-673aebba1930 could not be found. Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109feea8-7249-41b8-a662-673aebba1930 could not be found. Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:00.682095 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:00.688089 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:00.688089 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:00.688089 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:00.688089 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:00:00.688089 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:00:00.688089 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109feea8-7249-41b8-a662-673aebba1930 could not be found. Sep 06 11:00:00.688089 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:00.689843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6702f168-fca5-496d-8f37-3b8a163e3670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Returning 404 to user: Instance 109feea8-7249-41b8-a662-673aebba1930 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:00:00.690975 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6702f168-fca5-496d-8f37-3b8a163e3670 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930" status: 404 len: 111 microversion: 2.1 time: 0.044996 Sep 06 11:00:00.692177 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1085/2187] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:00 2022] GET /compute/v2.1/servers/109feea8-7249-41b8-a662-673aebba1930 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:00:00.702933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-937e78d4-9bcd-4c58-8396-80b330f8b938 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f8b90b80>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:01.168915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-38c54eff-09a4-411c-94dc-f7581797b78f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:01.169817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-38c54eff-09a4-411c-94dc-f7581797b78f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:01.180776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38c54eff-09a4-411c-94dc-f7581797b78f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:01.181574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38c54eff-09a4-411c-94dc-f7581797b78f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:01.182667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38c54eff-09a4-411c-94dc-f7581797b78f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:01.183711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38c54eff-09a4-411c-94dc-f7581797b78f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:01.187486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38c54eff-09a4-411c-94dc-f7581797b78f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:01.188607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38c54eff-09a4-411c-94dc-f7581797b78f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:01.391546 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-937e78d4-9bcd-4c58-8396-80b330f8b938 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f970c6af-b418-4eb5-ace1-eb1358e1ed9e" status: 202 len: 0 microversion: 2.1 time: 0.694778 Sep 06 11:00:01.392685 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1103/2188] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:00:00 2022] DELETE /compute/v2.1/os-security-groups/f970c6af-b418-4eb5-ace1-eb1358e1ed9e => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:00:01.405554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-027b81b9-1413-4d85-890f-b823c558c663 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] Calling method '.version_select at 0x7f90f8647ca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:01.609316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-38c54eff-09a4-411c-94dc-f7581797b78f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:01.617978 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-38c54eff-09a4-411c-94dc-f7581797b78f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1313 microversion: 2.1 time: 0.453123 Sep 06 11:00:01.632380 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1086/2189] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:01 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:00:01.639512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ba5996f5-4a59-46d1-a891-af4aee0bbeff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:01.640144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ba5996f5-4a59-46d1-a891-af4aee0bbeff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:01.646324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba5996f5-4a59-46d1-a891-af4aee0bbeff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:01.651085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba5996f5-4a59-46d1-a891-af4aee0bbeff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:01.651085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba5996f5-4a59-46d1-a891-af4aee0bbeff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:01.651085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba5996f5-4a59-46d1-a891-af4aee0bbeff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:01.651085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba5996f5-4a59-46d1-a891-af4aee0bbeff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:01.651085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba5996f5-4a59-46d1-a891-af4aee0bbeff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:02.134120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ba5996f5-4a59-46d1-a891-af4aee0bbeff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:02.145455 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ba5996f5-4a59-46d1-a891-af4aee0bbeff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.511896 Sep 06 11:00:02.161267 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1087/2190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:01 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:02.616723 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-027b81b9-1413-4d85-890f-b823c558c663 tempest-SecurityGroupsTestJSON-1987257183 tempest-SecurityGroupsTestJSON-1987257183-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a11416d8-c7f5-4c30-945f-506e524c554b" status: 202 len: 0 microversion: 2.1 time: 1.214855 Sep 06 11:00:02.616723 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1104/2191] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:00:01 2022] DELETE /compute/v2.1/os-security-groups/a11416d8-c7f5-4c30-945f-506e524c554b => generated 0 bytes in 1216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:00:02.645266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-880e89fa-eb55-42db-adeb-ecc04db9dcc7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:02.646048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-880e89fa-eb55-42db-adeb-ecc04db9dcc7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:02.658573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-880e89fa-eb55-42db-adeb-ecc04db9dcc7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:02.661226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-880e89fa-eb55-42db-adeb-ecc04db9dcc7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:02.662805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-880e89fa-eb55-42db-adeb-ecc04db9dcc7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:02.664068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-880e89fa-eb55-42db-adeb-ecc04db9dcc7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:02.666816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-880e89fa-eb55-42db-adeb-ecc04db9dcc7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:02.667636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-880e89fa-eb55-42db-adeb-ecc04db9dcc7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:03.173197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6c0f028e-575e-4770-90b7-cc1c966fd36f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:03.174078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6c0f028e-575e-4770-90b7-cc1c966fd36f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:03.187522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c0f028e-575e-4770-90b7-cc1c966fd36f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:03.187522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c0f028e-575e-4770-90b7-cc1c966fd36f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:03.187522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c0f028e-575e-4770-90b7-cc1c966fd36f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:03.192000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c0f028e-575e-4770-90b7-cc1c966fd36f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:03.195171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c0f028e-575e-4770-90b7-cc1c966fd36f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:03.195833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c0f028e-575e-4770-90b7-cc1c966fd36f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:03.389053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-880e89fa-eb55-42db-adeb-ecc04db9dcc7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:03.398709 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-880e89fa-eb55-42db-adeb-ecc04db9dcc7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1313 microversion: 2.1 time: 0.757579 Sep 06 11:00:03.404753 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1088/2192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:02 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1313 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:04.049632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6c0f028e-575e-4770-90b7-cc1c966fd36f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:04.052426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:04.078488 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6c0f028e-575e-4770-90b7-cc1c966fd36f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.909263 Sep 06 11:00:04.095718 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1105/2193] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:03 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:04.428532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2eb44874-fa8d-451d-b612-5f587f521142 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:04.429157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2eb44874-fa8d-451d-b612-5f587f521142 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:04.443101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb44874-fa8d-451d-b612-5f587f521142 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:04.445618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb44874-fa8d-451d-b612-5f587f521142 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:04.446284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb44874-fa8d-451d-b612-5f587f521142 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:04.447866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb44874-fa8d-451d-b612-5f587f521142 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:04.451832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb44874-fa8d-451d-b612-5f587f521142 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:04.452519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb44874-fa8d-451d-b612-5f587f521142 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:05.111581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-be5817c1-4947-4a1d-9750-c631aecbd108 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:05.113430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-be5817c1-4947-4a1d-9750-c631aecbd108 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:05.137173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be5817c1-4947-4a1d-9750-c631aecbd108 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:05.138984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be5817c1-4947-4a1d-9750-c631aecbd108 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:05.145292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be5817c1-4947-4a1d-9750-c631aecbd108 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:05.149879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be5817c1-4947-4a1d-9750-c631aecbd108 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:05.149879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be5817c1-4947-4a1d-9750-c631aecbd108 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:05.149879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be5817c1-4947-4a1d-9750-c631aecbd108 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:05.526894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2eb44874-fa8d-451d-b612-5f587f521142 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:05.597869 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2eb44874-fa8d-451d-b612-5f587f521142 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1313 microversion: 2.1 time: 1.146392 Sep 06 11:00:05.612773 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1089/2194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:04 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1313 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:05.713963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-be5817c1-4947-4a1d-9750-c631aecbd108 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:05.729679 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-be5817c1-4947-4a1d-9750-c631aecbd108 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.619703 Sep 06 11:00:05.730686 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1106/2195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:05 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:06.629279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fa497298-455d-4cfb-9163-0a884969c8a5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:06.631147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fa497298-455d-4cfb-9163-0a884969c8a5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:06.660104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa497298-455d-4cfb-9163-0a884969c8a5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:06.661920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa497298-455d-4cfb-9163-0a884969c8a5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:06.662406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa497298-455d-4cfb-9163-0a884969c8a5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:06.664679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa497298-455d-4cfb-9163-0a884969c8a5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:06.671935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa497298-455d-4cfb-9163-0a884969c8a5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:06.671935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa497298-455d-4cfb-9163-0a884969c8a5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:06.758127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a4a1a837-11b9-4b8b-a7b1-2e7f1c18a2fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:06.765381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a4a1a837-11b9-4b8b-a7b1-2e7f1c18a2fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:06.782058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4a1a837-11b9-4b8b-a7b1-2e7f1c18a2fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:06.782721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4a1a837-11b9-4b8b-a7b1-2e7f1c18a2fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:06.783314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4a1a837-11b9-4b8b-a7b1-2e7f1c18a2fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:06.785015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4a1a837-11b9-4b8b-a7b1-2e7f1c18a2fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:06.788516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4a1a837-11b9-4b8b-a7b1-2e7f1c18a2fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:06.789093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4a1a837-11b9-4b8b-a7b1-2e7f1c18a2fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:07.232905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fa497298-455d-4cfb-9163-0a884969c8a5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:07.244420 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fa497298-455d-4cfb-9163-0a884969c8a5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1313 microversion: 2.1 time: 0.619134 Sep 06 11:00:07.245620 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1090/2196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:06 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:07.400726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a4a1a837-11b9-4b8b-a7b1-2e7f1c18a2fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:07.409571 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a4a1a837-11b9-4b8b-a7b1-2e7f1c18a2fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.655926 Sep 06 11:00:07.413133 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1107/2197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:06 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:00:07.527969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6d706c03-5a25-47ec-b355-45074bad7915 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'create', calling method: .version_select at 0x7f90f8b60550>, body: {"keypair": {"name": "tempest-keypair-137077139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjBlJcmRqq8frtyZK2IdjLMxjQ3MdHLJnMSSm6xNTBY4DDx2gzmyE5QC/dm7rr4bcsJjsliJjJdYrGF8cDAXtPor62UMYmEXTjvyiY9lR0wd1wjx8UITTzdzkbVPQs1Ug=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:07.550822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1790672685", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "2f5e43ef-d547-4f26-9d98-251e3891cc15"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:07.561435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6d706c03-5a25-47ec-b355-45074bad7915 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Getting quotas for project dcd5ffec2c6246fb89ba181542692585. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:00:07.574630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6d706c03-5a25-47ec-b355-45074bad7915 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Getting quotas for user f16abbf8a68344b68444ff8fc2795c67 and project dcd5ffec2c6246fb89ba181542692585. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:00:07.637027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] validate_networks() for [('2f5e43ef-d547-4f26-9d98-251e3891cc15', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:00:07.695146 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6d706c03-5a25-47ec-b355-45074bad7915 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.448206 Sep 06 11:00:07.697326 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1091/2198] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:00:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:07.701247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-829056bd-da05-4c67-9c33-2849e821aecb req-f75c47ff-4afa-4723-bcef-f89c065384f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6acc0bc9-8746-46d4-b4bb-54029da58446", "name": "network-vif-plugged", "status": "completed", "tag": "75a4b9ec-0116-4843-8da2-96eb38ec81a3"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:07.725961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-829056bd-da05-4c67-9c33-2849e821aecb req-f75c47ff-4afa-4723-bcef-f89c065384f6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:07.726352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-829056bd-da05-4c67-9c33-2849e821aecb req-f75c47ff-4afa-4723-bcef-f89c065384f6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:07.726808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-829056bd-da05-4c67-9c33-2849e821aecb req-f75c47ff-4afa-4723-bcef-f89c065384f6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:07.748642 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-829056bd-da05-4c67-9c33-2849e821aecb req-f75c47ff-4afa-4723-bcef-f89c065384f6 service nova] Creating event network-vif-plugged:75a4b9ec-0116-4843-8da2-96eb38ec81a3 for instance 6acc0bc9-8746-46d4-b4bb-54029da58446 on nch2-master-1 Sep 06 11:00:07.768882 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-829056bd-da05-4c67-9c33-2849e821aecb req-f75c47ff-4afa-4723-bcef-f89c065384f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071857 Sep 06 11:00:07.769797 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1092/2199] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:08.273649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-639f5df1-03ce-4f21-a3b3-04976412b66e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:08.274375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-639f5df1-03ce-4f21-a3b3-04976412b66e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:08.311222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-639f5df1-03ce-4f21-a3b3-04976412b66e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:08.312657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-639f5df1-03ce-4f21-a3b3-04976412b66e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:08.313814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-639f5df1-03ce-4f21-a3b3-04976412b66e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:08.317130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-639f5df1-03ce-4f21-a3b3-04976412b66e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:08.317851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-639f5df1-03ce-4f21-a3b3-04976412b66e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:08.318487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-639f5df1-03ce-4f21-a3b3-04976412b66e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:08.866518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-639f5df1-03ce-4f21-a3b3-04976412b66e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:08.892054 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-639f5df1-03ce-4f21-a3b3-04976412b66e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1313 microversion: 2.1 time: 0.622558 Sep 06 11:00:08.921022 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1093/2200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:08 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:08.934061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a5b15cf3-9f80-4351-bfd4-001296364afe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:08.940022 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a5b15cf3-9f80-4351-bfd4-001296364afe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:08.960931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5b15cf3-9f80-4351-bfd4-001296364afe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:08.960931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5b15cf3-9f80-4351-bfd4-001296364afe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:08.962547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5b15cf3-9f80-4351-bfd4-001296364afe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:08.964914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5b15cf3-9f80-4351-bfd4-001296364afe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:08.966869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5b15cf3-9f80-4351-bfd4-001296364afe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:08.967510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5b15cf3-9f80-4351-bfd4-001296364afe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:09.020376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:09.502533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a5b15cf3-9f80-4351-bfd4-001296364afe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:09.514788 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a5b15cf3-9f80-4351-bfd4-001296364afe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.592275 Sep 06 11:00:09.520866 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1094/2201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:08 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:09.651554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:00:09.659439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:00:09.659439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:00:09.659439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:00:09.659439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:00:09.677410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:09.677936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:09.678455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:09.688780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:09.689682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:09.690322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:09.722551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Getting quotas for project a63d14f0f3fd42a486fc2b395cb87709. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:00:09.733417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Getting quotas for user 41ebe48dba334e2fb49aafcc72aa8e79 and project a63d14f0f3fd42a486fc2b395cb87709. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:00:09.739127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:09.754633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:00:09.757655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:00:09.881346 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a71392a3-c32d-4c18-b9a1-8bc9eb62c280 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.434325 Sep 06 11:00:09.895437 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1108/2202] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:00:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:00:09.898595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7ea11fcc-01e1-4585-a00d-d7d2678d4926 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:09.900097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7ea11fcc-01e1-4585-a00d-d7d2678d4926 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:09.919608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2dcb8571-fa6d-475e-b7bc-b09c33fc8833 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:09.920470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2dcb8571-fa6d-475e-b7bc-b09c33fc8833 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:09.929133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dcb8571-fa6d-475e-b7bc-b09c33fc8833 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:09.934483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dcb8571-fa6d-475e-b7bc-b09c33fc8833 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:09.936258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dcb8571-fa6d-475e-b7bc-b09c33fc8833 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:09.937244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dcb8571-fa6d-475e-b7bc-b09c33fc8833 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:09.937930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dcb8571-fa6d-475e-b7bc-b09c33fc8833 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:09.940120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dcb8571-fa6d-475e-b7bc-b09c33fc8833 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:09.995832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7ea11fcc-01e1-4585-a00d-d7d2678d4926 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:10.009422 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7ea11fcc-01e1-4585-a00d-d7d2678d4926 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1216 microversion: 2.1 time: 0.114678 Sep 06 11:00:10.010354 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1095/2203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:09 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1216 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:10.486015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2dcb8571-fa6d-475e-b7bc-b09c33fc8833 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:10.498127 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2dcb8571-fa6d-475e-b7bc-b09c33fc8833 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1463 microversion: 2.1 time: 0.583827 Sep 06 11:00:10.499462 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1109/2204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:09 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1463 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:10.545738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-09eecd5d-896a-475e-a7eb-70573f6de253 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:10.546516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-09eecd5d-896a-475e-a7eb-70573f6de253 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:10.557948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09eecd5d-896a-475e-a7eb-70573f6de253 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:10.558603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09eecd5d-896a-475e-a7eb-70573f6de253 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:10.559190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09eecd5d-896a-475e-a7eb-70573f6de253 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:10.562269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09eecd5d-896a-475e-a7eb-70573f6de253 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:10.570357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09eecd5d-896a-475e-a7eb-70573f6de253 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:10.570357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09eecd5d-896a-475e-a7eb-70573f6de253 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:10.774301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-04144390-0a1d-4e8a-b5d2-6712a738cf17 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:10.775129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-04144390-0a1d-4e8a-b5d2-6712a738cf17 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:10.783691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04144390-0a1d-4e8a-b5d2-6712a738cf17 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:10.784206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04144390-0a1d-4e8a-b5d2-6712a738cf17 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:10.784668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04144390-0a1d-4e8a-b5d2-6712a738cf17 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:10.785560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04144390-0a1d-4e8a-b5d2-6712a738cf17 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:10.786093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04144390-0a1d-4e8a-b5d2-6712a738cf17 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:10.786585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04144390-0a1d-4e8a-b5d2-6712a738cf17 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:11.429557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-09eecd5d-896a-475e-a7eb-70573f6de253 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:11.439956 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-09eecd5d-896a-475e-a7eb-70573f6de253 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.898952 Sep 06 11:00:11.444871 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1110/2205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:10 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:11.459322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-68badb7e-3598-4844-8a0d-ee9d6a27f6be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:11.460143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-68badb7e-3598-4844-8a0d-ee9d6a27f6be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:11.552679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-68badb7e-3598-4844-8a0d-ee9d6a27f6be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:11.561866 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-68badb7e-3598-4844-8a0d-ee9d6a27f6be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1216 microversion: 2.1 time: 0.115635 Sep 06 11:00:11.567319 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1111/2206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:11 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1216 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:12.146084 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-04144390-0a1d-4e8a-b5d2-6712a738cf17 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1614 microversion: 2.1 time: 1.626489 Sep 06 11:00:12.147937 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1096/2207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:10 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1614 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:12.184045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-38ce6348-7c37-4142-9f25-fb5a7464bd06 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:12.185546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-38ce6348-7c37-4142-9f25-fb5a7464bd06 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:12.207367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38ce6348-7c37-4142-9f25-fb5a7464bd06 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:12.207926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38ce6348-7c37-4142-9f25-fb5a7464bd06 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:12.208397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38ce6348-7c37-4142-9f25-fb5a7464bd06 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:12.209161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38ce6348-7c37-4142-9f25-fb5a7464bd06 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:12.210600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38ce6348-7c37-4142-9f25-fb5a7464bd06 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:12.211249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38ce6348-7c37-4142-9f25-fb5a7464bd06 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:12.359615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-38ce6348-7c37-4142-9f25-fb5a7464bd06 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3320982894964d85bef7eaa13a2f72ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d99cfecc7d499ea8a478b100e9b061', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:12.360604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-38ce6348-7c37-4142-9f25-fb5a7464bd06 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] flavor_id is None. Assuming migration. {{(pid=140876) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 06 11:00:12.361352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-38ce6348-7c37-4142-9f25-fb5a7464bd06 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140876) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:00:12.465989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-57f5d11b-2f1e-413a-aad6-bf6dc835f6a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:12.467267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-57f5d11b-2f1e-413a-aad6-bf6dc835f6a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:12.479248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:12.482411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57f5d11b-2f1e-413a-aad6-bf6dc835f6a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:12.484578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57f5d11b-2f1e-413a-aad6-bf6dc835f6a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:12.486472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57f5d11b-2f1e-413a-aad6-bf6dc835f6a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:12.488548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57f5d11b-2f1e-413a-aad6-bf6dc835f6a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:12.489895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57f5d11b-2f1e-413a-aad6-bf6dc835f6a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:12.490735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57f5d11b-2f1e-413a-aad6-bf6dc835f6a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:13.044804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-57f5d11b-2f1e-413a-aad6-bf6dc835f6a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:13.052209 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-57f5d11b-2f1e-413a-aad6-bf6dc835f6a7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 0.591162 Sep 06 11:00:13.055195 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1097/2208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:12 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:13.078817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-025934e6-0222-4da7-93bf-1f1f34c60c69 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:13.078817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-025934e6-0222-4da7-93bf-1f1f34c60c69 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:13.083398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-025934e6-0222-4da7-93bf-1f1f34c60c69 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:13.087259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-025934e6-0222-4da7-93bf-1f1f34c60c69 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:13.087969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-025934e6-0222-4da7-93bf-1f1f34c60c69 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:13.092207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-025934e6-0222-4da7-93bf-1f1f34c60c69 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:13.092890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-025934e6-0222-4da7-93bf-1f1f34c60c69 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:13.093948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-025934e6-0222-4da7-93bf-1f1f34c60c69 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:13.277367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-025934e6-0222-4da7-93bf-1f1f34c60c69 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:13.287702 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-025934e6-0222-4da7-93bf-1f1f34c60c69 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1268 microversion: 2.1 time: 0.231223 Sep 06 11:00:13.310196 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1098/2209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:13 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1268 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:13.414330 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-38ce6348-7c37-4142-9f25-fb5a7464bd06 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446/action" status: 202 len: 0 microversion: 2.1 time: 1.243669 Sep 06 11:00:13.422164 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1112/2210] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:00:12 2022] POST /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446/action => generated 0 bytes in 1255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:00:13.426280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5b7db4b1-fef4-47a3-bbbe-c379c79cab75 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:13.426898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5b7db4b1-fef4-47a3-bbbe-c379c79cab75 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:13.442253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b7db4b1-fef4-47a3-bbbe-c379c79cab75 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:13.447108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b7db4b1-fef4-47a3-bbbe-c379c79cab75 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:13.447924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b7db4b1-fef4-47a3-bbbe-c379c79cab75 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:13.449065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b7db4b1-fef4-47a3-bbbe-c379c79cab75 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:13.449924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b7db4b1-fef4-47a3-bbbe-c379c79cab75 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:13.450718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b7db4b1-fef4-47a3-bbbe-c379c79cab75 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:14.091704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c9106a53-42f3-437a-b17e-da27ec31b4f0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:14.092922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c9106a53-42f3-437a-b17e-da27ec31b4f0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:14.101948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5b7db4b1-fef4-47a3-bbbe-c379c79cab75 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:14.121688 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5b7db4b1-fef4-47a3-bbbe-c379c79cab75 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1472 microversion: 2.1 time: 0.697308 Sep 06 11:00:14.137642 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1099/2211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:13 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1472 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:00:14.144154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9106a53-42f3-437a-b17e-da27ec31b4f0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:14.144700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9106a53-42f3-437a-b17e-da27ec31b4f0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:14.146845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9106a53-42f3-437a-b17e-da27ec31b4f0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:14.163211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9106a53-42f3-437a-b17e-da27ec31b4f0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:14.163773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9106a53-42f3-437a-b17e-da27ec31b4f0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:14.164401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9106a53-42f3-437a-b17e-da27ec31b4f0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:14.318243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7bbd6726-6477-450b-92cd-779e3b8f484f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:14.318997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7bbd6726-6477-450b-92cd-779e3b8f484f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:14.329006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bbd6726-6477-450b-92cd-779e3b8f484f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:14.332281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bbd6726-6477-450b-92cd-779e3b8f484f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:14.332910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bbd6726-6477-450b-92cd-779e3b8f484f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:14.337690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bbd6726-6477-450b-92cd-779e3b8f484f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:14.338415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bbd6726-6477-450b-92cd-779e3b8f484f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:14.341317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bbd6726-6477-450b-92cd-779e3b8f484f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:14.524302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7bbd6726-6477-450b-92cd-779e3b8f484f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:14.549626 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7bbd6726-6477-450b-92cd-779e3b8f484f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1274 microversion: 2.1 time: 0.233686 Sep 06 11:00:14.551799 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1100/2212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:14 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1274 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:00:14.697396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-849789104", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "350b7fa2-cbf1-4a97-afcf-fd60d6924de1"}], "security_groups": [{"name": "tempest-securitygroup--467571421"}], "key_name": "tempest-keypair-137077139", "user_data": "}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:15.141618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c9106a53-42f3-437a-b17e-da27ec31b4f0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:15.151656 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c9106a53-42f3-437a-b17e-da27ec31b4f0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1507 microversion: 2.1 time: 1.072574 Sep 06 11:00:15.165031 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1113/2213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:14 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1507 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:15.173806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] validate_networks() for [('350b7fa2-cbf1-4a97-afcf-fd60d6924de1', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:00:15.177434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5c5ee0af-cd65-4656-a205-a6ddd42be658 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:15.182166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5c5ee0af-cd65-4656-a205-a6ddd42be658 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:15.196795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c5ee0af-cd65-4656-a205-a6ddd42be658 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:15.197528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c5ee0af-cd65-4656-a205-a6ddd42be658 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:15.197987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c5ee0af-cd65-4656-a205-a6ddd42be658 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:15.198727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c5ee0af-cd65-4656-a205-a6ddd42be658 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:15.204741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c5ee0af-cd65-4656-a205-a6ddd42be658 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:15.205266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c5ee0af-cd65-4656-a205-a6ddd42be658 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:15.853657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5c5ee0af-cd65-4656-a205-a6ddd42be658 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:15.869835 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5c5ee0af-cd65-4656-a205-a6ddd42be658 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1472 microversion: 2.1 time: 0.698894 Sep 06 11:00:15.895442 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1114/2214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:15 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1472 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:15.910585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b98e29a8-438b-414b-924e-b18410019fb9 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:15.911790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b98e29a8-438b-414b-924e-b18410019fb9 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:15.921561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b98e29a8-438b-414b-924e-b18410019fb9 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:15.922083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b98e29a8-438b-414b-924e-b18410019fb9 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:15.922538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b98e29a8-438b-414b-924e-b18410019fb9 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:15.923305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b98e29a8-438b-414b-924e-b18410019fb9 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:15.923992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b98e29a8-438b-414b-924e-b18410019fb9 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:15.924431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b98e29a8-438b-414b-924e-b18410019fb9 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:16.766583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b98e29a8-438b-414b-924e-b18410019fb9 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:16.775096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:00:16.776038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:00:16.776864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:00:16.777481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:00:16.777916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:00:16.779461 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b98e29a8-438b-414b-924e-b18410019fb9 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1316 microversion: 2.1 time: 0.886632 Sep 06 11:00:16.780629 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1115/2215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:15 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1316 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:16.788228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4ec73910-b3a2-4db0-8449-9e4eec481e12 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:16.791065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4ec73910-b3a2-4db0-8449-9e4eec481e12 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:16.792934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:16.794173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:16.794639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:16.796622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:16.800248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:16.800623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ec73910-b3a2-4db0-8449-9e4eec481e12 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:16.801042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:16.801167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ec73910-b3a2-4db0-8449-9e4eec481e12 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:16.801565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ec73910-b3a2-4db0-8449-9e4eec481e12 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:16.802291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ec73910-b3a2-4db0-8449-9e4eec481e12 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:16.802894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ec73910-b3a2-4db0-8449-9e4eec481e12 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:16.803829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ec73910-b3a2-4db0-8449-9e4eec481e12 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:16.894335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Getting quotas for project dcd5ffec2c6246fb89ba181542692585. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:00:16.927486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Getting quotas for user f16abbf8a68344b68444ff8fc2795c67 and project dcd5ffec2c6246fb89ba181542692585. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:00:16.964100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:00:16.972812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:00:17.100570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4ec73910-b3a2-4db0-8449-9e4eec481e12 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:17.111103 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4ec73910-b3a2-4db0-8449-9e4eec481e12 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1528 microversion: 2.1 time: 0.328496 Sep 06 11:00:17.136265 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1116/2216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:16 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1528 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:17.152068 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-013ad55e-51f4-4c4d-9680-0635e942c4fb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.460316 Sep 06 11:00:17.153903 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1101/2217] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:00:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 2463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:00:17.159663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7b01d3ac-c408-4218-9565-5bbc14746931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:17.165902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7b01d3ac-c408-4218-9565-5bbc14746931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:17.167790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b01d3ac-c408-4218-9565-5bbc14746931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:17.168569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b01d3ac-c408-4218-9565-5bbc14746931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:17.169844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b01d3ac-c408-4218-9565-5bbc14746931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:17.171211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b01d3ac-c408-4218-9565-5bbc14746931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:17.172053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b01d3ac-c408-4218-9565-5bbc14746931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:17.172726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b01d3ac-c408-4218-9565-5bbc14746931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:17.450875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7b01d3ac-c408-4218-9565-5bbc14746931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:17.466513 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7b01d3ac-c408-4218-9565-5bbc14746931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1472 microversion: 2.1 time: 0.309914 Sep 06 11:00:17.477458 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1102/2218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:17 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:17.498115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3ef7b8aa-520a-43c2-8c69-d885e03195ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:17.500162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3ef7b8aa-520a-43c2-8c69-d885e03195ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:17.574577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3ef7b8aa-520a-43c2-8c69-d885e03195ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:17.584636 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3ef7b8aa-520a-43c2-8c69-d885e03195ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1237 microversion: 2.1 time: 0.105877 Sep 06 11:00:17.594414 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1103/2219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:17 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1237 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:17.709552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-87c76077-33a3-4e57-926d-7d77ba6640ca tempest-NetworksTest-1464279552 tempest-NetworksTest-1464279552-project-admin] Calling method '.version_select at 0x7f90fcffb670>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:17.834583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8089ce75-1970-4a10-99ef-619ff088732d tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:17.836089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8089ce75-1970-4a10-99ef-619ff088732d tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:17.871226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8089ce75-1970-4a10-99ef-619ff088732d tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:17.872387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8089ce75-1970-4a10-99ef-619ff088732d tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:17.872858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8089ce75-1970-4a10-99ef-619ff088732d tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:17.874870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8089ce75-1970-4a10-99ef-619ff088732d tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:17.876706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8089ce75-1970-4a10-99ef-619ff088732d tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:17.877181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8089ce75-1970-4a10-99ef-619ff088732d tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:18.022222 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-87c76077-33a3-4e57-926d-7d77ba6640ca tempest-NetworksTest-1464279552 tempest-NetworksTest-1464279552-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 6027 microversion: 2.1 time: 0.892426 Sep 06 11:00:18.024138 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1117/2220] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 11:00:17 2022] GET /compute/v2.1/os-networks => generated 6027 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:18.037871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d6b99f90-0712-4908-b07b-a161a907c711 tempest-NetworksTest-1464279552 tempest-NetworksTest-1464279552-project-admin] Calling method '.version_select at 0x7f90f853cdc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:18.250071 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d6b99f90-0712-4908-b07b-a161a907c711 tempest-NetworksTest-1464279552 tempest-NetworksTest-1464279552-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks/e41669ad-0ff0-4d70-8973-15677f96420c" status: 200 len: 652 microversion: 2.1 time: 0.217747 Sep 06 11:00:18.250756 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1118/2221] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:00:18 2022] GET /compute/v2.1/os-networks/e41669ad-0ff0-4d70-8973-15677f96420c => generated 652 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:18.258461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8610762e-6f5c-4cab-849e-1cb320663ce8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:18.258461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8610762e-6f5c-4cab-849e-1cb320663ce8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:18.276398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8610762e-6f5c-4cab-849e-1cb320663ce8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:18.283131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8610762e-6f5c-4cab-849e-1cb320663ce8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:18.283613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8610762e-6f5c-4cab-849e-1cb320663ce8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:18.284584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8610762e-6f5c-4cab-849e-1cb320663ce8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:18.285066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8610762e-6f5c-4cab-849e-1cb320663ce8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:18.285500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8610762e-6f5c-4cab-849e-1cb320663ce8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:18.303306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8089ce75-1970-4a10-99ef-619ff088732d tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:18.311557 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8089ce75-1970-4a10-99ef-619ff088732d tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1316 microversion: 2.1 time: 0.505569 Sep 06 11:00:18.312293 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1104/2222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:17 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:00:18.317477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-96d5580e-9292-4db6-a590-9ba3de4562ea tempest-NetworksTest-1464279552 tempest-NetworksTest-1464279552-project-admin] Calling method '.version_select at 0x7f90f8544280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:18.812881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8610762e-6f5c-4cab-849e-1cb320663ce8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:18.822407 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8610762e-6f5c-4cab-849e-1cb320663ce8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 0.570420 Sep 06 11:00:18.827202 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1119/2223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:18 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:18.862100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-3b1225c3-7c43-4b20-b9ca-2bcc6513cb96 req-6a526c1c-d694-49cd-b08d-2adc586d12bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cb25f53-85d7-4bdf-9154-e23f28c1f2a4", "tag": "e5408e80-6cd2-43fe-82fa-49e7c062fe4c"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:18.892476 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-96d5580e-9292-4db6-a590-9ba3de4562ea tempest-NetworksTest-1464279552 tempest-NetworksTest-1464279552-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 6027 microversion: 2.1 time: 0.578835 Sep 06 11:00:18.894010 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1105/2224] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 11:00:18 2022] GET /compute/v2.1/os-networks => generated 6027 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:18.896305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3b1225c3-7c43-4b20-b9ca-2bcc6513cb96 req-6a526c1c-d694-49cd-b08d-2adc586d12bc service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:18.896741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3b1225c3-7c43-4b20-b9ca-2bcc6513cb96 req-6a526c1c-d694-49cd-b08d-2adc586d12bc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:18.897271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3b1225c3-7c43-4b20-b9ca-2bcc6513cb96 req-6a526c1c-d694-49cd-b08d-2adc586d12bc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:18.904484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c4951f40-ad8d-4d32-8a8b-935bcf20b0f1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:18.905117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c4951f40-ad8d-4d32-8a8b-935bcf20b0f1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:18.920336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4951f40-ad8d-4d32-8a8b-935bcf20b0f1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:18.921826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4951f40-ad8d-4d32-8a8b-935bcf20b0f1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:18.923600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4951f40-ad8d-4d32-8a8b-935bcf20b0f1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:18.924742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4951f40-ad8d-4d32-8a8b-935bcf20b0f1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:18.928658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4951f40-ad8d-4d32-8a8b-935bcf20b0f1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:18.929532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4951f40-ad8d-4d32-8a8b-935bcf20b0f1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:18.948818 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-3b1225c3-7c43-4b20-b9ca-2bcc6513cb96 req-6a526c1c-d694-49cd-b08d-2adc586d12bc service nova] Creating event network-changed:e5408e80-6cd2-43fe-82fa-49e7c062fe4c for instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 on nch1-master-1 Sep 06 11:00:18.956893 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-3b1225c3-7c43-4b20-b9ca-2bcc6513cb96 req-6a526c1c-d694-49cd-b08d-2adc586d12bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116434 Sep 06 11:00:18.964972 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1120/2225] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:18.978626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e7234ae-0af5-4348-97fa-9535f7521870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:18.983771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4e7234ae-0af5-4348-97fa-9535f7521870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:18.995721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e7234ae-0af5-4348-97fa-9535f7521870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:19.000292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e7234ae-0af5-4348-97fa-9535f7521870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:19.000292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e7234ae-0af5-4348-97fa-9535f7521870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:19.000292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e7234ae-0af5-4348-97fa-9535f7521870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:19.000844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e7234ae-0af5-4348-97fa-9535f7521870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:19.001770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e7234ae-0af5-4348-97fa-9535f7521870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:19.171421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4e7234ae-0af5-4348-97fa-9535f7521870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:19.188758 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e7234ae-0af5-4348-97fa-9535f7521870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1241 microversion: 2.1 time: 0.220840 Sep 06 11:00:19.190461 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1121/2226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:18 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1241 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:19.234429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c4951f40-ad8d-4d32-8a8b-935bcf20b0f1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:19.243587 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c4951f40-ad8d-4d32-8a8b-935bcf20b0f1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1472 microversion: 2.1 time: 0.348152 Sep 06 11:00:19.244476 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1106/2227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:18 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:19.336029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cb0a211e-bf88-466c-a19f-21e9fc4e3fe1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:19.336816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cb0a211e-bf88-466c-a19f-21e9fc4e3fe1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:19.350980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb0a211e-bf88-466c-a19f-21e9fc4e3fe1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:19.359763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb0a211e-bf88-466c-a19f-21e9fc4e3fe1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:19.362499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb0a211e-bf88-466c-a19f-21e9fc4e3fe1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:19.365079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb0a211e-bf88-466c-a19f-21e9fc4e3fe1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:19.371420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb0a211e-bf88-466c-a19f-21e9fc4e3fe1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:19.372565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb0a211e-bf88-466c-a19f-21e9fc4e3fe1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:19.711513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:19.858070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f1fdbde3-9b47-4ab8-869e-6e73923ccaa5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:19.862423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f1fdbde3-9b47-4ab8-869e-6e73923ccaa5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:19.870311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1fdbde3-9b47-4ab8-869e-6e73923ccaa5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:19.875723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1fdbde3-9b47-4ab8-869e-6e73923ccaa5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:19.877040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1fdbde3-9b47-4ab8-869e-6e73923ccaa5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:19.883132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1fdbde3-9b47-4ab8-869e-6e73923ccaa5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:19.883923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1fdbde3-9b47-4ab8-869e-6e73923ccaa5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:19.884553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1fdbde3-9b47-4ab8-869e-6e73923ccaa5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:19.999953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cb0a211e-bf88-466c-a19f-21e9fc4e3fe1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:20.012653 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cb0a211e-bf88-466c-a19f-21e9fc4e3fe1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1316 microversion: 2.1 time: 0.681053 Sep 06 11:00:20.014030 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1122/2228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:19 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1316 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:20.212936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4971590d-fb7c-44e4-92b9-11416f9c4f67 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:20.215062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4971590d-fb7c-44e4-92b9-11416f9c4f67 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:20.241277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4971590d-fb7c-44e4-92b9-11416f9c4f67 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:20.244137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4971590d-fb7c-44e4-92b9-11416f9c4f67 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:20.244886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4971590d-fb7c-44e4-92b9-11416f9c4f67 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:20.250020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4971590d-fb7c-44e4-92b9-11416f9c4f67 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:20.250954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4971590d-fb7c-44e4-92b9-11416f9c4f67 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:20.253475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4971590d-fb7c-44e4-92b9-11416f9c4f67 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:20.265844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f1fdbde3-9b47-4ab8-869e-6e73923ccaa5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:20.274285 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f1fdbde3-9b47-4ab8-869e-6e73923ccaa5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 0.424967 Sep 06 11:00:20.284145 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1107/2229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:19 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:00:20.294475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-57106793-cf99-442d-b5d3-2f3ad828e561 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:20.295302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-57106793-cf99-442d-b5d3-2f3ad828e561 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:20.304033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57106793-cf99-442d-b5d3-2f3ad828e561 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:20.312248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57106793-cf99-442d-b5d3-2f3ad828e561 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:20.312971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57106793-cf99-442d-b5d3-2f3ad828e561 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:20.314015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57106793-cf99-442d-b5d3-2f3ad828e561 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:20.314659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57106793-cf99-442d-b5d3-2f3ad828e561 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:20.319320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57106793-cf99-442d-b5d3-2f3ad828e561 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:20.392887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4971590d-fb7c-44e4-92b9-11416f9c4f67 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:20.430396 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4971590d-fb7c-44e4-92b9-11416f9c4f67 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1233 microversion: 2.1 time: 0.216726 Sep 06 11:00:20.432882 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1123/2230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:20 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1233 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:00:20.884555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-96bcbc65-ebda-4817-bc67-e45cafe3285c req-78dccb66-e52b-4b5d-95b8-bc7834945d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267d4dad-b118-4f44-993b-81fd05e550df", "name": "network-vif-plugged", "status": "completed", "tag": "ef011f91-2d4e-406a-bce9-9afb09103a90"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:20.908083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-96bcbc65-ebda-4817-bc67-e45cafe3285c req-78dccb66-e52b-4b5d-95b8-bc7834945d83 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:20.908798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-96bcbc65-ebda-4817-bc67-e45cafe3285c req-78dccb66-e52b-4b5d-95b8-bc7834945d83 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:20.909439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-96bcbc65-ebda-4817-bc67-e45cafe3285c req-78dccb66-e52b-4b5d-95b8-bc7834945d83 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:20.932136 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-96bcbc65-ebda-4817-bc67-e45cafe3285c req-78dccb66-e52b-4b5d-95b8-bc7834945d83 service nova] Creating event network-vif-plugged:ef011f91-2d4e-406a-bce9-9afb09103a90 for instance 267d4dad-b118-4f44-993b-81fd05e550df on nch1-master-1 Sep 06 11:00:20.958532 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-96bcbc65-ebda-4817-bc67-e45cafe3285c req-78dccb66-e52b-4b5d-95b8-bc7834945d83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078662 Sep 06 11:00:20.962225 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1124/2231] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:00:21.039752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-01c0c0cd-6e27-4c00-9d4d-052edfcc0478 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:21.045981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-01c0c0cd-6e27-4c00-9d4d-052edfcc0478 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:21.053836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01c0c0cd-6e27-4c00-9d4d-052edfcc0478 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:21.056447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01c0c0cd-6e27-4c00-9d4d-052edfcc0478 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:21.058918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01c0c0cd-6e27-4c00-9d4d-052edfcc0478 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:21.064048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01c0c0cd-6e27-4c00-9d4d-052edfcc0478 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:21.065394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01c0c0cd-6e27-4c00-9d4d-052edfcc0478 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:21.066059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01c0c0cd-6e27-4c00-9d4d-052edfcc0478 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:21.176504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-57106793-cf99-442d-b5d3-2f3ad828e561 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:21.192490 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-57106793-cf99-442d-b5d3-2f3ad828e561 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1472 microversion: 2.1 time: 0.906485 Sep 06 11:00:21.195737 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1108/2232] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:20 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1472 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:21.303479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-49e4aba8-00fa-4744-85dc-dd3c93c3d3ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:21.304121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-49e4aba8-00fa-4744-85dc-dd3c93c3d3ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:21.332334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e4aba8-00fa-4744-85dc-dd3c93c3d3ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:21.338909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e4aba8-00fa-4744-85dc-dd3c93c3d3ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:21.340565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e4aba8-00fa-4744-85dc-dd3c93c3d3ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:21.342114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e4aba8-00fa-4744-85dc-dd3c93c3d3ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:21.348236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e4aba8-00fa-4744-85dc-dd3c93c3d3ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:21.349107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e4aba8-00fa-4744-85dc-dd3c93c3d3ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:21.368722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-01c0c0cd-6e27-4c00-9d4d-052edfcc0478 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:21.372532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:21.384319 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-01c0c0cd-6e27-4c00-9d4d-052edfcc0478 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1316 microversion: 2.1 time: 0.350320 Sep 06 11:00:21.388553 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1125/2233] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:21 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:21.456090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5c1b784a-6606-4b95-bd3d-496e99186909 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:21.456958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5c1b784a-6606-4b95-bd3d-496e99186909 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:21.466835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c1b784a-6606-4b95-bd3d-496e99186909 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:21.469962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c1b784a-6606-4b95-bd3d-496e99186909 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:21.479297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c1b784a-6606-4b95-bd3d-496e99186909 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:21.479297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c1b784a-6606-4b95-bd3d-496e99186909 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:21.479297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c1b784a-6606-4b95-bd3d-496e99186909 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:21.479297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c1b784a-6606-4b95-bd3d-496e99186909 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:21.558517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:21.586903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5c1b784a-6606-4b95-bd3d-496e99186909 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:21.602327 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5c1b784a-6606-4b95-bd3d-496e99186909 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1289 microversion: 2.1 time: 0.150649 Sep 06 11:00:21.602925 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1126/2234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:21 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1289 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:21.642471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-49e4aba8-00fa-4744-85dc-dd3c93c3d3ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:21.654121 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-49e4aba8-00fa-4744-85dc-dd3c93c3d3ca tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 0.355803 Sep 06 11:00:21.655061 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1109/2235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:21 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:22.219697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5baf00b4-a617-408d-a81d-911b79a00b73 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:22.220319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5baf00b4-a617-408d-a81d-911b79a00b73 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:22.232187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5baf00b4-a617-408d-a81d-911b79a00b73 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:22.232680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5baf00b4-a617-408d-a81d-911b79a00b73 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:22.243735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5baf00b4-a617-408d-a81d-911b79a00b73 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:22.244842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5baf00b4-a617-408d-a81d-911b79a00b73 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:22.245485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5baf00b4-a617-408d-a81d-911b79a00b73 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:22.246109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5baf00b4-a617-408d-a81d-911b79a00b73 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:22.410915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d4132be8-d5ed-4973-aa0f-cdf8caf03520 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:22.412077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d4132be8-d5ed-4973-aa0f-cdf8caf03520 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:22.426801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d4132be8-d5ed-4973-aa0f-cdf8caf03520 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:22.427422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d4132be8-d5ed-4973-aa0f-cdf8caf03520 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:22.428597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d4132be8-d5ed-4973-aa0f-cdf8caf03520 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:22.429477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d4132be8-d5ed-4973-aa0f-cdf8caf03520 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:22.430511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d4132be8-d5ed-4973-aa0f-cdf8caf03520 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:22.431186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d4132be8-d5ed-4973-aa0f-cdf8caf03520 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:22.515396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5baf00b4-a617-408d-a81d-911b79a00b73 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:22.524185 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5baf00b4-a617-408d-a81d-911b79a00b73 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1477 microversion: 2.1 time: 0.309305 Sep 06 11:00:22.542795 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1127/2236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:22 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1477 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:22.627108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5b3392e4-8cf5-41fd-ad14-80cf404e5a39 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:22.628258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5b3392e4-8cf5-41fd-ad14-80cf404e5a39 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:22.638562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b3392e4-8cf5-41fd-ad14-80cf404e5a39 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:22.640592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b3392e4-8cf5-41fd-ad14-80cf404e5a39 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:22.641229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b3392e4-8cf5-41fd-ad14-80cf404e5a39 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:22.642751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b3392e4-8cf5-41fd-ad14-80cf404e5a39 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:22.648746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b3392e4-8cf5-41fd-ad14-80cf404e5a39 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:22.649248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b3392e4-8cf5-41fd-ad14-80cf404e5a39 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:22.977889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5b3392e4-8cf5-41fd-ad14-80cf404e5a39 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:22.992501 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5b3392e4-8cf5-41fd-ad14-80cf404e5a39 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1295 microversion: 2.1 time: 0.366720 Sep 06 11:00:22.993455 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1128/2237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:22 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1295 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:23.003709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0eb2a804-312a-4763-a63d-9084fdcdb9b5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:23.006333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0eb2a804-312a-4763-a63d-9084fdcdb9b5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:23.020654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0eb2a804-312a-4763-a63d-9084fdcdb9b5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:23.022232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0eb2a804-312a-4763-a63d-9084fdcdb9b5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:23.024846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0eb2a804-312a-4763-a63d-9084fdcdb9b5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:23.025801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0eb2a804-312a-4763-a63d-9084fdcdb9b5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:23.028396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0eb2a804-312a-4763-a63d-9084fdcdb9b5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:23.034537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0eb2a804-312a-4763-a63d-9084fdcdb9b5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:23.164605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d4132be8-d5ed-4973-aa0f-cdf8caf03520 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:23.167844 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d4132be8-d5ed-4973-aa0f-cdf8caf03520 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1316 microversion: 2.1 time: 0.760989 Sep 06 11:00:23.183169 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1110/2238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:22 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1316 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:23.280569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0eb2a804-312a-4763-a63d-9084fdcdb9b5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:23.289992 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0eb2a804-312a-4763-a63d-9084fdcdb9b5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 0.294791 Sep 06 11:00:23.293788 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1129/2239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:22 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:23.553831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c508884b-3dda-4489-9933-9f94a06d643c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:23.554434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c508884b-3dda-4489-9933-9f94a06d643c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:23.568487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c508884b-3dda-4489-9933-9f94a06d643c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:23.569414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c508884b-3dda-4489-9933-9f94a06d643c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:23.570089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c508884b-3dda-4489-9933-9f94a06d643c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:23.571391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c508884b-3dda-4489-9933-9f94a06d643c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:23.572085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c508884b-3dda-4489-9933-9f94a06d643c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:23.572761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c508884b-3dda-4489-9933-9f94a06d643c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:23.814910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c508884b-3dda-4489-9933-9f94a06d643c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:23.825345 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c508884b-3dda-4489-9933-9f94a06d643c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1477 microversion: 2.1 time: 0.275340 Sep 06 11:00:23.862449 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1111/2240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:23 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1477 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:24.019591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3d476a1d-359a-4104-896f-c49b89b44654 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:24.020447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3d476a1d-359a-4104-896f-c49b89b44654 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:24.043299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d476a1d-359a-4104-896f-c49b89b44654 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:24.044267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d476a1d-359a-4104-896f-c49b89b44654 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:24.044961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d476a1d-359a-4104-896f-c49b89b44654 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:24.045986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d476a1d-359a-4104-896f-c49b89b44654 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:24.046679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d476a1d-359a-4104-896f-c49b89b44654 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:24.047501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d476a1d-359a-4104-896f-c49b89b44654 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:24.200532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b1f9e58d-f6c6-4a2c-96da-3326791789a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:24.202003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b1f9e58d-f6c6-4a2c-96da-3326791789a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:24.222104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b1f9e58d-f6c6-4a2c-96da-3326791789a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:24.222722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b1f9e58d-f6c6-4a2c-96da-3326791789a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:24.223350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b1f9e58d-f6c6-4a2c-96da-3326791789a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:24.228268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b1f9e58d-f6c6-4a2c-96da-3326791789a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:24.233270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b1f9e58d-f6c6-4a2c-96da-3326791789a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:24.237277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b1f9e58d-f6c6-4a2c-96da-3326791789a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:25.022997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3d476a1d-359a-4104-896f-c49b89b44654 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:25.037126 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3d476a1d-359a-4104-896f-c49b89b44654 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1362 microversion: 2.1 time: 1.022235 Sep 06 11:00:25.041938 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1130/2241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:24 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1362 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:25.060722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0d7db87f-d488-433d-837f-4f36a27a364a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:25.073272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0d7db87f-d488-433d-837f-4f36a27a364a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:25.112444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d7db87f-d488-433d-837f-4f36a27a364a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:25.113079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d7db87f-d488-433d-837f-4f36a27a364a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:25.115152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d7db87f-d488-433d-837f-4f36a27a364a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:25.115977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d7db87f-d488-433d-837f-4f36a27a364a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:25.116518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d7db87f-d488-433d-837f-4f36a27a364a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:25.117955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d7db87f-d488-433d-837f-4f36a27a364a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:25.228274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b1f9e58d-f6c6-4a2c-96da-3326791789a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:25.241741 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b1f9e58d-f6c6-4a2c-96da-3326791789a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1316 microversion: 2.1 time: 1.052008 Sep 06 11:00:25.245795 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1112/2242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:24 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1316 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:00:25.259330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b690a0c9-4501-479b-8b3e-ed0258af2ad0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:25.260070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b690a0c9-4501-479b-8b3e-ed0258af2ad0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:25.287819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b690a0c9-4501-479b-8b3e-ed0258af2ad0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:25.293871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b690a0c9-4501-479b-8b3e-ed0258af2ad0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:25.294634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b690a0c9-4501-479b-8b3e-ed0258af2ad0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:25.315502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b690a0c9-4501-479b-8b3e-ed0258af2ad0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:25.321807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b690a0c9-4501-479b-8b3e-ed0258af2ad0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:25.322275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b690a0c9-4501-479b-8b3e-ed0258af2ad0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:25.909801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0d7db87f-d488-433d-837f-4f36a27a364a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:25.909801 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0d7db87f-d488-433d-837f-4f36a27a364a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 0.843722 Sep 06 11:00:25.909801 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1131/2243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:25 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:25.909801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-8d10d6c2-0e46-4ee8-b600-24d6a44fe8a3 req-5aad2215-f9cb-47b9-b0af-88e5e51a29e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb25f53-85d7-4bdf-9154-e23f28c1f2a4", "name": "network-vif-plugged", "status": "completed", "tag": "e5408e80-6cd2-43fe-82fa-49e7c062fe4c"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:25.917022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8d10d6c2-0e46-4ee8-b600-24d6a44fe8a3 req-5aad2215-f9cb-47b9-b0af-88e5e51a29e4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:25.918847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8d10d6c2-0e46-4ee8-b600-24d6a44fe8a3 req-5aad2215-f9cb-47b9-b0af-88e5e51a29e4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:25.919703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8d10d6c2-0e46-4ee8-b600-24d6a44fe8a3 req-5aad2215-f9cb-47b9-b0af-88e5e51a29e4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:25.920404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b690a0c9-4501-479b-8b3e-ed0258af2ad0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:25.929492 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b690a0c9-4501-479b-8b3e-ed0258af2ad0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1477 microversion: 2.1 time: 0.680268 Sep 06 11:00:25.930468 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1113/2244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:25 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1477 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:25.937518 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-8d10d6c2-0e46-4ee8-b600-24d6a44fe8a3 req-5aad2215-f9cb-47b9-b0af-88e5e51a29e4 service nova] Creating event network-vif-plugged:e5408e80-6cd2-43fe-82fa-49e7c062fe4c for instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 on nch1-master-1 Sep 06 11:00:25.943001 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-8d10d6c2-0e46-4ee8-b600-24d6a44fe8a3 req-5aad2215-f9cb-47b9-b0af-88e5e51a29e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050117 Sep 06 11:00:25.944136 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1132/2245] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:26.070483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7d95fe2b-5dcc-46d2-8e91-3c35a723f9ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:26.071378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7d95fe2b-5dcc-46d2-8e91-3c35a723f9ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:26.079632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d95fe2b-5dcc-46d2-8e91-3c35a723f9ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:26.080572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d95fe2b-5dcc-46d2-8e91-3c35a723f9ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:26.081169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d95fe2b-5dcc-46d2-8e91-3c35a723f9ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:26.082050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d95fe2b-5dcc-46d2-8e91-3c35a723f9ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:26.082960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d95fe2b-5dcc-46d2-8e91-3c35a723f9ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:26.083619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d95fe2b-5dcc-46d2-8e91-3c35a723f9ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:26.272133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-08b61585-2c6a-4a45-83d9-3a5b3eea4286 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:26.273621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-08b61585-2c6a-4a45-83d9-3a5b3eea4286 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:26.301599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08b61585-2c6a-4a45-83d9-3a5b3eea4286 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:26.303848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08b61585-2c6a-4a45-83d9-3a5b3eea4286 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:26.306351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08b61585-2c6a-4a45-83d9-3a5b3eea4286 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:26.308874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08b61585-2c6a-4a45-83d9-3a5b3eea4286 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:26.309384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08b61585-2c6a-4a45-83d9-3a5b3eea4286 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:26.309845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08b61585-2c6a-4a45-83d9-3a5b3eea4286 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:26.765793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7d95fe2b-5dcc-46d2-8e91-3c35a723f9ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:26.771372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:26.776550 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7d95fe2b-5dcc-46d2-8e91-3c35a723f9ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1362 microversion: 2.1 time: 0.710442 Sep 06 11:00:26.780051 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1114/2246] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:26 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1362 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:26.790763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-c3e46618-5231-4e78-93d1-ea78977ec9ec req-8eb69add-1588-4122-8a5f-42f04365dc23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9db1902-3f12-48b6-a27f-425e4843424b", "tag": "1fa7746e-916f-47fe-a1b6-1454c7592311"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:26.818215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c3e46618-5231-4e78-93d1-ea78977ec9ec req-8eb69add-1588-4122-8a5f-42f04365dc23 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:26.839283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c3e46618-5231-4e78-93d1-ea78977ec9ec req-8eb69add-1588-4122-8a5f-42f04365dc23 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:26.839283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c3e46618-5231-4e78-93d1-ea78977ec9ec req-8eb69add-1588-4122-8a5f-42f04365dc23 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:26.854664 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-c3e46618-5231-4e78-93d1-ea78977ec9ec req-8eb69add-1588-4122-8a5f-42f04365dc23 service nova] Creating event network-changed:1fa7746e-916f-47fe-a1b6-1454c7592311 for instance d9db1902-3f12-48b6-a27f-425e4843424b on nch2-master-1 Sep 06 11:00:26.889806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:26.909913 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-c3e46618-5231-4e78-93d1-ea78977ec9ec req-8eb69add-1588-4122-8a5f-42f04365dc23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110446 Sep 06 11:00:26.912060 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1115/2247] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:26.933418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd70f1c3-abc0-4138-b7d1-85107e10dc2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:26.939238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fd70f1c3-abc0-4138-b7d1-85107e10dc2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:26.962185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd70f1c3-abc0-4138-b7d1-85107e10dc2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:26.962789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd70f1c3-abc0-4138-b7d1-85107e10dc2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:26.963287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd70f1c3-abc0-4138-b7d1-85107e10dc2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:26.964019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd70f1c3-abc0-4138-b7d1-85107e10dc2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:26.983339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd70f1c3-abc0-4138-b7d1-85107e10dc2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:26.983339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd70f1c3-abc0-4138-b7d1-85107e10dc2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:27.272436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-08b61585-2c6a-4a45-83d9-3a5b3eea4286 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:27.289787 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-08b61585-2c6a-4a45-83d9-3a5b3eea4286 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1316 microversion: 2.1 time: 1.021762 Sep 06 11:00:27.291089 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1133/2248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:26 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1316 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:27.300099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6a6ad12d-c096-495f-8b37-9d57673abcb0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:27.303824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6a6ad12d-c096-495f-8b37-9d57673abcb0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:27.322444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a6ad12d-c096-495f-8b37-9d57673abcb0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:27.322444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a6ad12d-c096-495f-8b37-9d57673abcb0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:27.322444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a6ad12d-c096-495f-8b37-9d57673abcb0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:27.322444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a6ad12d-c096-495f-8b37-9d57673abcb0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:27.322444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a6ad12d-c096-495f-8b37-9d57673abcb0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:27.330410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a6ad12d-c096-495f-8b37-9d57673abcb0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:27.406568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fd70f1c3-abc0-4138-b7d1-85107e10dc2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:27.424749 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd70f1c3-abc0-4138-b7d1-85107e10dc2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 0.503786 Sep 06 11:00:27.446346 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1116/2249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:26 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:00:27.782976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6a6ad12d-c096-495f-8b37-9d57673abcb0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:27.819491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-72c7e19e-449c-487a-9349-80225561a559 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:27.825291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-72c7e19e-449c-487a-9349-80225561a559 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:27.849544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=14 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:27.849982 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6a6ad12d-c096-495f-8b37-9d57673abcb0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1477 microversion: 2.1 time: 0.547726 Sep 06 11:00:27.861549 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1134/2250] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:27 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1477 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:27.887602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72c7e19e-449c-487a-9349-80225561a559 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:27.888515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72c7e19e-449c-487a-9349-80225561a559 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:27.890628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72c7e19e-449c-487a-9349-80225561a559 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:27.894328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72c7e19e-449c-487a-9349-80225561a559 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:27.901941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72c7e19e-449c-487a-9349-80225561a559 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:27.901941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72c7e19e-449c-487a-9349-80225561a559 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:28.234467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-72c7e19e-449c-487a-9349-80225561a559 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:28.247064 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-72c7e19e-449c-487a-9349-80225561a559 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1362 microversion: 2.1 time: 0.443074 Sep 06 11:00:28.248673 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1117/2251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:27 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1362 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:28.320597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-197e541b-5efa-4efa-88b1-89c0f0600ff3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:28.332300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-197e541b-5efa-4efa-88b1-89c0f0600ff3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:28.336636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-197e541b-5efa-4efa-88b1-89c0f0600ff3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:28.338591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-197e541b-5efa-4efa-88b1-89c0f0600ff3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:28.339253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-197e541b-5efa-4efa-88b1-89c0f0600ff3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:28.341233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-197e541b-5efa-4efa-88b1-89c0f0600ff3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:28.342195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-197e541b-5efa-4efa-88b1-89c0f0600ff3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:28.344262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-197e541b-5efa-4efa-88b1-89c0f0600ff3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:28.517408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1560900067", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:28.620636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:00:28.670099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-197e541b-5efa-4efa-88b1-89c0f0600ff3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:28.682167 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-197e541b-5efa-4efa-88b1-89c0f0600ff3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1503 microversion: 2.1 time: 0.369016 Sep 06 11:00:28.695180 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1118/2252] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:28 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1503 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:28.705482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f0970a35-36e4-45e2-8fdd-0c548b23204f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:28.706122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f0970a35-36e4-45e2-8fdd-0c548b23204f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:28.716473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0970a35-36e4-45e2-8fdd-0c548b23204f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:28.717307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0970a35-36e4-45e2-8fdd-0c548b23204f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:28.717928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0970a35-36e4-45e2-8fdd-0c548b23204f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:28.718846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0970a35-36e4-45e2-8fdd-0c548b23204f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:28.719504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0970a35-36e4-45e2-8fdd-0c548b23204f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:28.720102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0970a35-36e4-45e2-8fdd-0c548b23204f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:29.078884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:00:29.080106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:00:29.080992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:00:29.081636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:00:29.082891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:00:29.098559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f0970a35-36e4-45e2-8fdd-0c548b23204f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:29.108160 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f0970a35-36e4-45e2-8fdd-0c548b23204f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 0.411697 Sep 06 11:00:29.116622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:29.120362 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1119/2253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:28 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:29.124693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:29.125632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:29.128672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5cfeec60-ca1f-4ccd-8ccf-778af50f23be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:29.129766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:29.130890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:29.132135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:29.141794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5cfeec60-ca1f-4ccd-8ccf-778af50f23be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:29.156060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5cfeec60-ca1f-4ccd-8ccf-778af50f23be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:29.165505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5cfeec60-ca1f-4ccd-8ccf-778af50f23be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:29.165505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5cfeec60-ca1f-4ccd-8ccf-778af50f23be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:29.171628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5cfeec60-ca1f-4ccd-8ccf-778af50f23be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:29.172342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5cfeec60-ca1f-4ccd-8ccf-778af50f23be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:29.173497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5cfeec60-ca1f-4ccd-8ccf-778af50f23be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:29.194044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:00:29.201737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:00:29.218886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:00:29.221783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:00:29.230404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5cfeec60-ca1f-4ccd-8ccf-778af50f23be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:00:29.410488 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c882bbae-a548-4d2b-a6ac-b95a2cfbe93c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.127530 Sep 06 11:00:29.419421 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1135/2254] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:00:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:00:29.431463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a1121da8-b6f4-4935-b2a6-305dba04a4c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:29.431463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a1121da8-b6f4-4935-b2a6-305dba04a4c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:29.470655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1121da8-b6f4-4935-b2a6-305dba04a4c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:29.475555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1121da8-b6f4-4935-b2a6-305dba04a4c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:29.476070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1121da8-b6f4-4935-b2a6-305dba04a4c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:29.488477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1121da8-b6f4-4935-b2a6-305dba04a4c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:29.490456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1121da8-b6f4-4935-b2a6-305dba04a4c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:29.491545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1121da8-b6f4-4935-b2a6-305dba04a4c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:29.767101 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5cfeec60-ca1f-4ccd-8ccf-778af50f23be tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 204 len: 0 microversion: 2.1 time: 0.645027 Sep 06 11:00:29.767707 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1120/2255] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:00:29 2022] DELETE /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:00:29.778427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-78e9661c-4b4a-41f9-b380-5447230863bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:29.779846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-78e9661c-4b4a-41f9-b380-5447230863bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:29.798749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78e9661c-4b4a-41f9-b380-5447230863bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:29.799579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78e9661c-4b4a-41f9-b380-5447230863bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:29.800322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78e9661c-4b4a-41f9-b380-5447230863bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:29.801235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78e9661c-4b4a-41f9-b380-5447230863bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:29.801892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78e9661c-4b4a-41f9-b380-5447230863bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:29.802598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78e9661c-4b4a-41f9-b380-5447230863bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:30.304648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a1121da8-b6f4-4935-b2a6-305dba04a4c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:30.317383 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a1121da8-b6f4-4935-b2a6-305dba04a4c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1477 microversion: 2.1 time: 0.896733 Sep 06 11:00:30.319861 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1136/2256] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:29 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1477 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:30.332613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6678a5f6-6ded-4786-8b44-4e90a1c294bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:30.334873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6678a5f6-6ded-4786-8b44-4e90a1c294bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:30.350463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-78e9661c-4b4a-41f9-b380-5447230863bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:30.364506 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-78e9661c-4b4a-41f9-b380-5447230863bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1362 microversion: 2.1 time: 0.591230 Sep 06 11:00:30.381316 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1121/2257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:29 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1362 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:30.394173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1758f7a7-5e3d-4ad1-b190-e5def08b6f64 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:30.402212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1758f7a7-5e3d-4ad1-b190-e5def08b6f64 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:30.412004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1758f7a7-5e3d-4ad1-b190-e5def08b6f64 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:30.412538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1758f7a7-5e3d-4ad1-b190-e5def08b6f64 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:30.413001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1758f7a7-5e3d-4ad1-b190-e5def08b6f64 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:30.413762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1758f7a7-5e3d-4ad1-b190-e5def08b6f64 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:30.414260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1758f7a7-5e3d-4ad1-b190-e5def08b6f64 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:30.419099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1758f7a7-5e3d-4ad1-b190-e5def08b6f64 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:30.528929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6678a5f6-6ded-4786-8b44-4e90a1c294bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:30.540665 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6678a5f6-6ded-4786-8b44-4e90a1c294bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1217 microversion: 2.1 time: 0.216022 Sep 06 11:00:30.541479 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1137/2258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:30 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:30.564506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-535ccdd0-1965-4600-ae80-826e05ccf799 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:30.565291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-535ccdd0-1965-4600-ae80-826e05ccf799 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:30.577794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-535ccdd0-1965-4600-ae80-826e05ccf799 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:30.581321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-535ccdd0-1965-4600-ae80-826e05ccf799 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:30.581935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-535ccdd0-1965-4600-ae80-826e05ccf799 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:30.583913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-535ccdd0-1965-4600-ae80-826e05ccf799 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:30.598853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-535ccdd0-1965-4600-ae80-826e05ccf799 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:30.599502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-535ccdd0-1965-4600-ae80-826e05ccf799 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:31.050930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-535ccdd0-1965-4600-ae80-826e05ccf799 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:31.063619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1758f7a7-5e3d-4ad1-b190-e5def08b6f64 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:31.072605 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-535ccdd0-1965-4600-ae80-826e05ccf799 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 0.520283 Sep 06 11:00:31.074170 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1758f7a7-5e3d-4ad1-b190-e5def08b6f64 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1509 microversion: 2.1 time: 0.691406 Sep 06 11:00:31.090333 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1138/2259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:30 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:31.092420 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1122/2260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:30 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1509 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:31.347152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-089cc3cf-9bce-431d-aaec-d4486e606e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:31.347842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-089cc3cf-9bce-431d-aaec-d4486e606e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:31.378718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-089cc3cf-9bce-431d-aaec-d4486e606e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:31.382115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-089cc3cf-9bce-431d-aaec-d4486e606e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:31.384774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-089cc3cf-9bce-431d-aaec-d4486e606e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:31.388728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-089cc3cf-9bce-431d-aaec-d4486e606e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:31.396805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e26a685b-23c4-46b8-a3e1-032f0ea24b48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:31.398393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e26a685b-23c4-46b8-a3e1-032f0ea24b48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:31.408769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-089cc3cf-9bce-431d-aaec-d4486e606e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:31.412198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-089cc3cf-9bce-431d-aaec-d4486e606e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:31.423539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e26a685b-23c4-46b8-a3e1-032f0ea24b48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:31.424059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e26a685b-23c4-46b8-a3e1-032f0ea24b48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:31.424509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e26a685b-23c4-46b8-a3e1-032f0ea24b48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:31.426536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e26a685b-23c4-46b8-a3e1-032f0ea24b48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:31.427055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e26a685b-23c4-46b8-a3e1-032f0ea24b48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:31.427706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e26a685b-23c4-46b8-a3e1-032f0ea24b48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:31.879962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-089cc3cf-9bce-431d-aaec-d4486e606e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:31.897721 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-089cc3cf-9bce-431d-aaec-d4486e606e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1477 microversion: 2.1 time: 0.555133 Sep 06 11:00:31.898936 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1139/2261] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:31 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1477 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:31.908295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8fbb27d0-eef0-489b-a819-7d2750b04848 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:31.920953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8fbb27d0-eef0-489b-a819-7d2750b04848 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:31.928074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fbb27d0-eef0-489b-a819-7d2750b04848 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:31.930603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fbb27d0-eef0-489b-a819-7d2750b04848 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:31.931588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fbb27d0-eef0-489b-a819-7d2750b04848 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:31.937199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fbb27d0-eef0-489b-a819-7d2750b04848 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:31.938673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fbb27d0-eef0-489b-a819-7d2750b04848 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:31.942390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fbb27d0-eef0-489b-a819-7d2750b04848 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:31.965455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e26a685b-23c4-46b8-a3e1-032f0ea24b48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:31.974243 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e26a685b-23c4-46b8-a3e1-032f0ea24b48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1362 microversion: 2.1 time: 0.582437 Sep 06 11:00:31.979296 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1123/2262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:31 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1362 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:32.061866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8fbb27d0-eef0-489b-a819-7d2750b04848 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:32.083682 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8fbb27d0-eef0-489b-a819-7d2750b04848 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1221 microversion: 2.1 time: 0.178648 Sep 06 11:00:32.085153 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1140/2263] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:31 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1221 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:32.105414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ba347d4c-4fab-46ce-9137-5491deab70f1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:32.107645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ba347d4c-4fab-46ce-9137-5491deab70f1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:32.120389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5060a061-b462-4a26-ab26-ece8f462dc2c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:32.120524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5060a061-b462-4a26-ab26-ece8f462dc2c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:32.126555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba347d4c-4fab-46ce-9137-5491deab70f1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:32.127095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba347d4c-4fab-46ce-9137-5491deab70f1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:32.133231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba347d4c-4fab-46ce-9137-5491deab70f1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:32.138860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba347d4c-4fab-46ce-9137-5491deab70f1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:32.139486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba347d4c-4fab-46ce-9137-5491deab70f1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:32.141797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba347d4c-4fab-46ce-9137-5491deab70f1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:32.148305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5060a061-b462-4a26-ab26-ece8f462dc2c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:32.149161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5060a061-b462-4a26-ab26-ece8f462dc2c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:32.149847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5060a061-b462-4a26-ab26-ece8f462dc2c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:32.150740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5060a061-b462-4a26-ab26-ece8f462dc2c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:32.151522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5060a061-b462-4a26-ab26-ece8f462dc2c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:32.152152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5060a061-b462-4a26-ab26-ece8f462dc2c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:32.457738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ba347d4c-4fab-46ce-9137-5491deab70f1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:32.469817 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ba347d4c-4fab-46ce-9137-5491deab70f1 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1509 microversion: 2.1 time: 0.372559 Sep 06 11:00:32.478706 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1124/2264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:32 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:32.509362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5060a061-b462-4a26-ab26-ece8f462dc2c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:32.520655 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5060a061-b462-4a26-ab26-ece8f462dc2c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 0.413723 Sep 06 11:00:32.521277 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1141/2265] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:32 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:32.938028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-da760fb9-31de-432c-9c11-08655f75dac8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:32.940819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-da760fb9-31de-432c-9c11-08655f75dac8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:32.954064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da760fb9-31de-432c-9c11-08655f75dac8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:32.955094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da760fb9-31de-432c-9c11-08655f75dac8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:32.955728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da760fb9-31de-432c-9c11-08655f75dac8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:32.956986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da760fb9-31de-432c-9c11-08655f75dac8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:32.957806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da760fb9-31de-432c-9c11-08655f75dac8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:32.958599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da760fb9-31de-432c-9c11-08655f75dac8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:33.005235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-99f6921c-0edf-4fbf-9082-bf997732fd53 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:33.006575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-99f6921c-0edf-4fbf-9082-bf997732fd53 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:33.025557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99f6921c-0edf-4fbf-9082-bf997732fd53 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:33.028024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99f6921c-0edf-4fbf-9082-bf997732fd53 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:33.028487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99f6921c-0edf-4fbf-9082-bf997732fd53 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:33.032469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99f6921c-0edf-4fbf-9082-bf997732fd53 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:33.035326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99f6921c-0edf-4fbf-9082-bf997732fd53 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:33.036770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99f6921c-0edf-4fbf-9082-bf997732fd53 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:33.470521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-da760fb9-31de-432c-9c11-08655f75dac8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:33.484471 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-da760fb9-31de-432c-9c11-08655f75dac8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1477 microversion: 2.1 time: 0.566352 Sep 06 11:00:33.488323 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1125/2266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:32 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1477 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:33.498507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9dbdb278-d2bb-4f3c-bee4-1ca47a0a6a03 req-2af5238e-b854-4efc-8fc9-010f95d6ed39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb25f53-85d7-4bdf-9154-e23f28c1f2a4", "name": "network-vif-deleted", "tag": "e5408e80-6cd2-43fe-82fa-49e7c062fe4c"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:33.523321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9dbdb278-d2bb-4f3c-bee4-1ca47a0a6a03 req-2af5238e-b854-4efc-8fc9-010f95d6ed39 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:33.524180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9dbdb278-d2bb-4f3c-bee4-1ca47a0a6a03 req-2af5238e-b854-4efc-8fc9-010f95d6ed39 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:33.524848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9dbdb278-d2bb-4f3c-bee4-1ca47a0a6a03 req-2af5238e-b854-4efc-8fc9-010f95d6ed39 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:33.552600 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9dbdb278-d2bb-4f3c-bee4-1ca47a0a6a03 req-2af5238e-b854-4efc-8fc9-010f95d6ed39 service nova] Creating event network-vif-deleted:e5408e80-6cd2-43fe-82fa-49e7c062fe4c for instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 on nch1-master-1 Sep 06 11:00:33.562647 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9dbdb278-d2bb-4f3c-bee4-1ca47a0a6a03 req-2af5238e-b854-4efc-8fc9-010f95d6ed39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072860 Sep 06 11:00:33.568310 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1126/2267] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:33.579779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5ac5aa5a-b46b-4f7a-b0d1-527655159804 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:33.583004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5ac5aa5a-b46b-4f7a-b0d1-527655159804 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:33.598425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ac5aa5a-b46b-4f7a-b0d1-527655159804 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:33.602318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ac5aa5a-b46b-4f7a-b0d1-527655159804 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:33.603825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ac5aa5a-b46b-4f7a-b0d1-527655159804 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:33.606720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ac5aa5a-b46b-4f7a-b0d1-527655159804 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:33.608217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ac5aa5a-b46b-4f7a-b0d1-527655159804 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:33.608770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ac5aa5a-b46b-4f7a-b0d1-527655159804 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:34.223206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-99f6921c-0edf-4fbf-9082-bf997732fd53 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:34.236913 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-99f6921c-0edf-4fbf-9082-bf997732fd53 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1362 microversion: 2.1 time: 1.240479 Sep 06 11:00:34.252013 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1142/2268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:32 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1362 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:00:34.259340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:34.260250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:34.268248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:34.268832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:34.269480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:34.273490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5ac5aa5a-b46b-4f7a-b0d1-527655159804 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:34.282357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:34.283183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:34.283808 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5ac5aa5a-b46b-4f7a-b0d1-527655159804 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1277 microversion: 2.1 time: 0.712294 Sep 06 11:00:34.285158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:34.301246 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1127/2269] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:33 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1277 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:34.312446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-228a24c2-7b5f-4c8c-92c8-0f5fd7b7e92f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:34.313195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-228a24c2-7b5f-4c8c-92c8-0f5fd7b7e92f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:34.320469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-228a24c2-7b5f-4c8c-92c8-0f5fd7b7e92f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:34.321471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-228a24c2-7b5f-4c8c-92c8-0f5fd7b7e92f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:34.322144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-228a24c2-7b5f-4c8c-92c8-0f5fd7b7e92f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:34.323144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-228a24c2-7b5f-4c8c-92c8-0f5fd7b7e92f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:34.323692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-228a24c2-7b5f-4c8c-92c8-0f5fd7b7e92f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:34.324912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-228a24c2-7b5f-4c8c-92c8-0f5fd7b7e92f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:34.378178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:34.379546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:34.381572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:34.382833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lazy-loading 'fault' on Instance uuid 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:00:34.529846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ebe48dba334e2fb49aafcc72aa8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d14f0f3fd42a486fc2b395cb87709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:34.553140 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-38e4443c-0131-4cc6-99ab-69c1f65c371f tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 200 len: 1306 microversion: 2.1 time: 0.299909 Sep 06 11:00:34.567045 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1143/2270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:34 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 1306 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:34.567045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-cce9ea54-1c82-411b-952d-dd2f1ffc09ea req-69f91f53-bafb-492e-8265-da5806c04951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9db1902-3f12-48b6-a27f-425e4843424b", "name": "network-vif-plugged", "status": "completed", "tag": "1fa7746e-916f-47fe-a1b6-1454c7592311"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:34.595620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-228a24c2-7b5f-4c8c-92c8-0f5fd7b7e92f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:34.606314 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-228a24c2-7b5f-4c8c-92c8-0f5fd7b7e92f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 0.299186 Sep 06 11:00:34.606772 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1128/2271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:34 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:34.624019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ffa57dcf-5a40-432a-9916-77411c86fc1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:34.624019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ffa57dcf-5a40-432a-9916-77411c86fc1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:34.629173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cce9ea54-1c82-411b-952d-dd2f1ffc09ea req-69f91f53-bafb-492e-8265-da5806c04951 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:34.629997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ffa57dcf-5a40-432a-9916-77411c86fc1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:34.630216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cce9ea54-1c82-411b-952d-dd2f1ffc09ea req-69f91f53-bafb-492e-8265-da5806c04951 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:34.630513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ffa57dcf-5a40-432a-9916-77411c86fc1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:34.630973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ffa57dcf-5a40-432a-9916-77411c86fc1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:34.631314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cce9ea54-1c82-411b-952d-dd2f1ffc09ea req-69f91f53-bafb-492e-8265-da5806c04951 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:34.632001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ffa57dcf-5a40-432a-9916-77411c86fc1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:34.646544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ffa57dcf-5a40-432a-9916-77411c86fc1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:34.647116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ffa57dcf-5a40-432a-9916-77411c86fc1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:34.661481 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-cce9ea54-1c82-411b-952d-dd2f1ffc09ea req-69f91f53-bafb-492e-8265-da5806c04951 service nova] Creating event network-vif-plugged:1fa7746e-916f-47fe-a1b6-1454c7592311 for instance d9db1902-3f12-48b6-a27f-425e4843424b on nch2-master-1 Sep 06 11:00:34.681164 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-cce9ea54-1c82-411b-952d-dd2f1ffc09ea req-69f91f53-bafb-492e-8265-da5806c04951 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115869 Sep 06 11:00:34.681164 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1144/2272] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:35.266148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ff5822f0-7843-4bab-ac5a-92ca1cddb91a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:35.267964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ff5822f0-7843-4bab-ac5a-92ca1cddb91a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:35.285716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff5822f0-7843-4bab-ac5a-92ca1cddb91a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:35.289812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff5822f0-7843-4bab-ac5a-92ca1cddb91a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:35.289812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff5822f0-7843-4bab-ac5a-92ca1cddb91a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:35.289812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff5822f0-7843-4bab-ac5a-92ca1cddb91a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:35.293697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff5822f0-7843-4bab-ac5a-92ca1cddb91a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:35.294377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff5822f0-7843-4bab-ac5a-92ca1cddb91a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:35.350592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:35.677457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ffa57dcf-5a40-432a-9916-77411c86fc1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:35.690449 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ffa57dcf-5a40-432a-9916-77411c86fc1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1477 microversion: 2.1 time: 1.082558 Sep 06 11:00:35.701439 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1129/2273] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:34 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1477 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:35.701439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f1a58855-d8de-4b3e-bdb5-2790a46bc09e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:35.701439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f1a58855-d8de-4b3e-bdb5-2790a46bc09e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:35.744557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1a58855-d8de-4b3e-bdb5-2790a46bc09e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:35.756025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1a58855-d8de-4b3e-bdb5-2790a46bc09e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:35.757044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1a58855-d8de-4b3e-bdb5-2790a46bc09e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:35.757978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1a58855-d8de-4b3e-bdb5-2790a46bc09e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:35.758618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1a58855-d8de-4b3e-bdb5-2790a46bc09e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:35.759092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1a58855-d8de-4b3e-bdb5-2790a46bc09e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:35.854204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ff5822f0-7843-4bab-ac5a-92ca1cddb91a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:35.863555 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ff5822f0-7843-4bab-ac5a-92ca1cddb91a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1362 microversion: 2.1 time: 0.603414 Sep 06 11:00:35.873178 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1145/2274] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:35 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1362 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:00:35.879438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb76c82c-7aa1-423e-b2eb-ebc027ee28bb tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:35.880359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bb76c82c-7aa1-423e-b2eb-ebc027ee28bb tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:35.883561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:35.900467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb76c82c-7aa1-423e-b2eb-ebc027ee28bb tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:35.900984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb76c82c-7aa1-423e-b2eb-ebc027ee28bb tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:35.915138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb76c82c-7aa1-423e-b2eb-ebc027ee28bb tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:35.915864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb76c82c-7aa1-423e-b2eb-ebc027ee28bb tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:35.916382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb76c82c-7aa1-423e-b2eb-ebc027ee28bb tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:35.916840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb76c82c-7aa1-423e-b2eb-ebc027ee28bb tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:35.938695 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-bb76c82c-7aa1-423e-b2eb-ebc027ee28bb tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] HTTP exception thrown: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb76c82c-7aa1-423e-b2eb-ebc027ee28bb tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Request method failure captured: Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 HTTP/1.1 Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyg3zwCMmocb2DnLBfdRK52xxpFXEe3KqN765hOIMc62A3oj7okpmtyj8RhmUqj7Ik-W3iKL8Npisd3Y-eMcII800jLDCSCyCLktB6CqVLjtzCJMWDrAgS3T-IPfakjO5GgzSc5qb1AY_r-n9smlYXWGBSHf8M0Tana6Kis2_33MYUc Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}] Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 41ebe48dba334e2fb49aafcc72aa8e79 Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '0cb25f53-85d7-4bdf-9154-e23f28c1f2a4'} Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:35.939669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:35.950016 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:35.950016 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:35.950016 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:35.950016 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:00:35.950016 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:00:35.950016 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:35.950016 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:35.950016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb76c82c-7aa1-423e-b2eb-ebc027ee28bb tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Returning 404 to user: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:00:35.950016 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bb76c82c-7aa1-423e-b2eb-ebc027ee28bb tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 404 len: 111 microversion: 2.1 time: 0.066895 Sep 06 11:00:35.950016 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1146/2275] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:35 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:00:35.950016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fcea6e78-5f2d-493f-b0ef-6f57f5ee1d64 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:35.950016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fcea6e78-5f2d-493f-b0ef-6f57f5ee1d64 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:35.954583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcea6e78-5f2d-493f-b0ef-6f57f5ee1d64 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:35.955108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcea6e78-5f2d-493f-b0ef-6f57f5ee1d64 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:35.955563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcea6e78-5f2d-493f-b0ef-6f57f5ee1d64 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:35.956895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcea6e78-5f2d-493f-b0ef-6f57f5ee1d64 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:35.957043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcea6e78-5f2d-493f-b0ef-6f57f5ee1d64 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:35.957472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcea6e78-5f2d-493f-b0ef-6f57f5ee1d64 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:36.717970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f1a58855-d8de-4b3e-bdb5-2790a46bc09e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:36.737722 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f1a58855-d8de-4b3e-bdb5-2790a46bc09e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1317 microversion: 2.1 time: 1.045432 Sep 06 11:00:36.740210 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1130/2276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:35 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1317 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:36.748586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-68e6b74e-8789-4042-a02c-faa1614d8788 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-797899377", "metadata": {"image_type": "test"}}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:36.767797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-68e6b74e-8789-4042-a02c-faa1614d8788 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:36.779339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fcea6e78-5f2d-493f-b0ef-6f57f5ee1d64 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:36.797351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e6b74e-8789-4042-a02c-faa1614d8788 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:36.797713 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fcea6e78-5f2d-493f-b0ef-6f57f5ee1d64 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 0.852139 Sep 06 11:00:36.800428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e6b74e-8789-4042-a02c-faa1614d8788 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:36.801631 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1147/2277] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:35 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:36.803560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e6b74e-8789-4042-a02c-faa1614d8788 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:36.807002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e6b74e-8789-4042-a02c-faa1614d8788 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:36.808102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e6b74e-8789-4042-a02c-faa1614d8788 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:36.812755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e6b74e-8789-4042-a02c-faa1614d8788 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:36.820566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0c47cf0a-2d9a-4752-8770-cf6f48855a45 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:36.823415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0c47cf0a-2d9a-4752-8770-cf6f48855a45 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:36.853890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c47cf0a-2d9a-4752-8770-cf6f48855a45 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:36.853890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c47cf0a-2d9a-4752-8770-cf6f48855a45 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:36.853890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c47cf0a-2d9a-4752-8770-cf6f48855a45 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:36.853890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c47cf0a-2d9a-4752-8770-cf6f48855a45 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:36.859861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c47cf0a-2d9a-4752-8770-cf6f48855a45 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:36.862290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c47cf0a-2d9a-4752-8770-cf6f48855a45 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:36.873844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:36.878285 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-68e6b74e-8789-4042-a02c-faa1614d8788 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] HTTP exception thrown: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-68e6b74e-8789-4042-a02c-faa1614d8788 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Request method failure captured: Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4/action HTTP/1.1 Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 111 Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyg3zwCMmocb2DnLBfdRK52xxpFXEe3KqN765hOIMc62A3oj7okpmtyj8RhmUqj7Ik-W3iKL8Npisd3Y-eMcII800jLDCSCyCLktB6CqVLjtzCJMWDrAgS3T-IPfakjO5GgzSc5qb1AY_r-n9smlYXWGBSHf8M0Tana6Kis2_33MYUc Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}] Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 41ebe48dba334e2fb49aafcc72aa8e79 Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-797899377", "metadata": {"image_type": "test"}}} Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '0cb25f53-85d7-4bdf-9154-e23f28c1f2a4', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-797899377', 'metadata': {'image_type': 'test'}}}} Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 06 11:00:36.883985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:36.888445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:36.894149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-68e6b74e-8789-4042-a02c-faa1614d8788 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Returning 404 to user: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:00:36.901259 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-68e6b74e-8789-4042-a02c-faa1614d8788 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "POST /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4/action" status: 404 len: 111 microversion: 2.1 time: 0.157259 Sep 06 11:00:36.902452 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1131/2278] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Sep 6 11:00:36 2022] POST /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4/action => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:00:36.915764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a5bdce97-a75a-4cf1-91d0-8a42e84d38e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:36.920792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a5bdce97-a75a-4cf1-91d0-8a42e84d38e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:36.936852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5bdce97-a75a-4cf1-91d0-8a42e84d38e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:36.941321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5bdce97-a75a-4cf1-91d0-8a42e84d38e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:36.946161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5bdce97-a75a-4cf1-91d0-8a42e84d38e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:36.946161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5bdce97-a75a-4cf1-91d0-8a42e84d38e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:36.946161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5bdce97-a75a-4cf1-91d0-8a42e84d38e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:36.946161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5bdce97-a75a-4cf1-91d0-8a42e84d38e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:37.259771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a5bdce97-a75a-4cf1-91d0-8a42e84d38e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:37.271631 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a5bdce97-a75a-4cf1-91d0-8a42e84d38e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1362 microversion: 2.1 time: 0.365729 Sep 06 11:00:37.278036 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1132/2279] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:36 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:37.280593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0c47cf0a-2d9a-4752-8770-cf6f48855a45 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:37.283615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d4c9ac57-910f-42b6-afcb-6c3c66b825cf tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-856315747", "metadata": {"image_type": "test"}}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:37.288920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d4c9ac57-910f-42b6-afcb-6c3c66b825cf tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Failed to fetch instance by id tempest-invalid-309728382 {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 06 11:00:37.294209 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-d4c9ac57-910f-42b6-afcb-6c3c66b825cf tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] HTTP exception thrown: Instance tempest-invalid-309728382 could not be found. Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d4c9ac57-910f-42b6-afcb-6c3c66b825cf tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Request method failure captured: Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/tempest-invalid-309728382/action HTTP/1.1 Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 111 Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyg3zwCMmocb2DnLBfdRK52xxpFXEe3KqN765hOIMc62A3oj7okpmtyj8RhmUqj7Ik-W3iKL8Npisd3Y-eMcII800jLDCSCyCLktB6CqVLjtzCJMWDrAgS3T-IPfakjO5GgzSc5qb1AY_r-n9smlYXWGBSHf8M0Tana6Kis2_33MYUc Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}] Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 41ebe48dba334e2fb49aafcc72aa8e79 Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-856315747", "metadata": {"image_type": "test"}}} Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance tempest-invalid-309728382 could not be found. Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'tempest-invalid-309728382', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-856315747', 'metadata': {'image_type': 'test'}}}} Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-309728382 could not be found. Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:00:37.296208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-309728382 could not be found. Sep 06 11:00:37.299875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.299875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:37.299875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.299875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.299875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:37.299875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:37.299875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:00:37.299875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:00:37.299875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-309728382 could not be found. Sep 06 11:00:37.299875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.300452 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0c47cf0a-2d9a-4752-8770-cf6f48855a45 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1477 microversion: 2.1 time: 0.495072 Sep 06 11:00:37.303405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d4c9ac57-910f-42b6-afcb-6c3c66b825cf tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Returning 404 to user: Instance tempest-invalid-309728382 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:00:37.304532 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d4c9ac57-910f-42b6-afcb-6c3c66b825cf tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "POST /compute/v2.1/servers/tempest-invalid-309728382/action" status: 404 len: 100 microversion: 2.1 time: 0.025345 Sep 06 11:00:37.305282 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1148/2280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:36 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1477 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:37.312168 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1133/2281] 10.222.0.20 () {60 vars in 1246 bytes} [Tue Sep 6 11:00:37 2022] POST /compute/v2.1/servers/tempest-invalid-309728382/action => generated 100 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:00:37.327860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c52e4c4e-3b2b-4d3f-acfb-effea22acfa3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-574025624"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:37.330709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c52e4c4e-3b2b-4d3f-acfb-effea22acfa3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 06 11:00:37.331268 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-c52e4c4e-3b2b-4d3f-acfb-effea22acfa3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c52e4c4e-3b2b-4d3f-acfb-effea22acfa3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Request method failure captured: Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 56 Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyg3zwCMmocb2DnLBfdRK52xxpFXEe3KqN765hOIMc62A3oj7okpmtyj8RhmUqj7Ik-W3iKL8Npisd3Y-eMcII800jLDCSCyCLktB6CqVLjtzCJMWDrAgS3T-IPfakjO5GgzSc5qb1AY_r-n9smlYXWGBSHf8M0Tana6Kis2_33MYUc Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}] Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 41ebe48dba334e2fb49aafcc72aa8e79 Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: {"createImage": {"name": "tempest-test-snap-574025624"}} Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-574025624'}}} Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 06 11:00:37.340778 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.345897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:37.345897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.345897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.345897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:37.345897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:37.345897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:00:37.345897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:00:37.345897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 06 11:00:37.345897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.352612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c52e4c4e-3b2b-4d3f-acfb-effea22acfa3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:00:37.353507 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c52e4c4e-3b2b-4d3f-acfb-effea22acfa3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.039638 Sep 06 11:00:37.354099 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1149/2282] 10.222.0.20 () {60 vars in 1275 bytes} [Tue Sep 6 11:00:37 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:00:37.365039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8efdefe5-81b9-40e4-b0f9-62e2ba58985a tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1923155382"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:37.368494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8efdefe5-81b9-40e4-b0f9-62e2ba58985a tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 06 11:00:37.369047 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-8efdefe5-81b9-40e4-b0f9-62e2ba58985a tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8efdefe5-81b9-40e4-b0f9-62e2ba58985a tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Request method failure captured: Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 57 Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyg3zwCMmocb2DnLBfdRK52xxpFXEe3KqN765hOIMc62A3oj7okpmtyj8RhmUqj7Ik-W3iKL8Npisd3Y-eMcII800jLDCSCyCLktB6CqVLjtzCJMWDrAgS3T-IPfakjO5GgzSc5qb1AY_r-n9smlYXWGBSHf8M0Tana6Kis2_33MYUc Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}] Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 41ebe48dba334e2fb49aafcc72aa8e79 Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: {"createImage": {"name": "tempest-test-snap-1923155382"}} Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1923155382'}}} Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 06 11:00:37.370668 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.377443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:37.377443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.377443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.377443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:37.377443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:37.377443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:00:37.377443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:00:37.377443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 06 11:00:37.377443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.377443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8efdefe5-81b9-40e4-b0f9-62e2ba58985a tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:00:37.377443 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8efdefe5-81b9-40e4-b0f9-62e2ba58985a tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011591 Sep 06 11:00:37.377443 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1134/2283] 10.222.0.20 () {60 vars in 1281 bytes} [Tue Sep 6 11:00:37 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:00:37.382921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-39ea0aee-1140-4e44-9744-f5926b86c9a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:37.383479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-39ea0aee-1140-4e44-9744-f5926b86c9a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:37.398466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39ea0aee-1140-4e44-9744-f5926b86c9a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:37.404686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39ea0aee-1140-4e44-9744-f5926b86c9a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:37.405263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39ea0aee-1140-4e44-9744-f5926b86c9a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:37.406055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39ea0aee-1140-4e44-9744-f5926b86c9a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:37.406546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39ea0aee-1140-4e44-9744-f5926b86c9a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:37.406992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39ea0aee-1140-4e44-9744-f5926b86c9a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:37.451797 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-39ea0aee-1140-4e44-9744-f5926b86c9a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] HTTP exception thrown: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-39ea0aee-1140-4e44-9744-f5926b86c9a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Request method failure captured: Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 HTTP/1.1 Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyg3zwCMmocb2DnLBfdRK52xxpFXEe3KqN765hOIMc62A3oj7okpmtyj8RhmUqj7Ik-W3iKL8Npisd3Y-eMcII800jLDCSCyCLktB6CqVLjtzCJMWDrAgS3T-IPfakjO5GgzSc5qb1AY_r-n9smlYXWGBSHf8M0Tana6Kis2_33MYUc Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}] Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 41ebe48dba334e2fb49aafcc72aa8e79 Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '0cb25f53-85d7-4bdf-9154-e23f28c1f2a4'} Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:00:37.453381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:00:37.457517 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:37.457517 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.457517 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:37.457517 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.457517 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.457517 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:37.457517 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:37.457517 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:00:37.457517 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:00:37.457517 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:37.457517 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.457517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-39ea0aee-1140-4e44-9744-f5926b86c9a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Returning 404 to user: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:00:37.457517 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-39ea0aee-1140-4e44-9744-f5926b86c9a3 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 404 len: 111 microversion: 2.1 time: 0.076550 Sep 06 11:00:37.466915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-46969b55-cec7-4616-a3a9-9234facb5290 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:37.467569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-46969b55-cec7-4616-a3a9-9234facb5290 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] [instance: 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:37.470613 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1150/2284] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:00:37 2022] DELETE /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:00:37.479726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46969b55-cec7-4616-a3a9-9234facb5290 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:37.480281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46969b55-cec7-4616-a3a9-9234facb5290 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:37.482356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46969b55-cec7-4616-a3a9-9234facb5290 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:37.483204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46969b55-cec7-4616-a3a9-9234facb5290 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:37.492197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46969b55-cec7-4616-a3a9-9234facb5290 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:37.492954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46969b55-cec7-4616-a3a9-9234facb5290 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:37.520430 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-46969b55-cec7-4616-a3a9-9234facb5290 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] HTTP exception thrown: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-46969b55-cec7-4616-a3a9-9234facb5290 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Request method failure captured: Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 HTTP/1.1 Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyg3zwCMmocb2DnLBfdRK52xxpFXEe3KqN765hOIMc62A3oj7okpmtyj8RhmUqj7Ik-W3iKL8Npisd3Y-eMcII800jLDCSCyCLktB6CqVLjtzCJMWDrAgS3T-IPfakjO5GgzSc5qb1AY_r-n9smlYXWGBSHf8M0Tana6Kis2_33MYUc Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a63d14f0f3fd42a486fc2b395cb87709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a63d14f0f3fd42a486fc2b395cb87709"}]}] Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: a63d14f0f3fd42a486fc2b395cb87709 Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-917183092 Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 41ebe48dba334e2fb49aafcc72aa8e79 Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesNegativeTestJSON-917183092-project Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '0cb25f53-85d7-4bdf-9154-e23f28c1f2a4'} Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:37.525976 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.530480 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:37.530480 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:37.530480 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:37.530480 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:00:37.530480 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:00:37.530480 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. Sep 06 11:00:37.530480 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:37.535362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-46969b55-cec7-4616-a3a9-9234facb5290 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] Returning 404 to user: Instance 0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:00:37.536332 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-46969b55-cec7-4616-a3a9-9234facb5290 tempest-ImagesNegativeTestJSON-917183092 tempest-ImagesNegativeTestJSON-917183092-project] 10.222.0.20 "GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4" status: 404 len: 111 microversion: 2.1 time: 0.076798 Sep 06 11:00:37.540446 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1135/2285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:37 2022] GET /compute/v2.1/servers/0cb25f53-85d7-4bdf-9154-e23f28c1f2a4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:00:37.764937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-41c4e443-97b2-4c0d-b6ed-bdc6172b873e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:37.765863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-41c4e443-97b2-4c0d-b6ed-bdc6172b873e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:37.782600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41c4e443-97b2-4c0d-b6ed-bdc6172b873e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:37.783847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41c4e443-97b2-4c0d-b6ed-bdc6172b873e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:37.784469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41c4e443-97b2-4c0d-b6ed-bdc6172b873e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:37.785377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41c4e443-97b2-4c0d-b6ed-bdc6172b873e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:37.786018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41c4e443-97b2-4c0d-b6ed-bdc6172b873e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:37.786637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41c4e443-97b2-4c0d-b6ed-bdc6172b873e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:37.828439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2e852a68-4b2e-46da-9a29-f26d195457d8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:37.829073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2e852a68-4b2e-46da-9a29-f26d195457d8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:37.840976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e852a68-4b2e-46da-9a29-f26d195457d8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:37.851786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e852a68-4b2e-46da-9a29-f26d195457d8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:37.852506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e852a68-4b2e-46da-9a29-f26d195457d8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:37.853460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e852a68-4b2e-46da-9a29-f26d195457d8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:37.854091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e852a68-4b2e-46da-9a29-f26d195457d8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:37.854695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e852a68-4b2e-46da-9a29-f26d195457d8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:38.870618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2e852a68-4b2e-46da-9a29-f26d195457d8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:38.874298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-41c4e443-97b2-4c0d-b6ed-bdc6172b873e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:38.895388 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2e852a68-4b2e-46da-9a29-f26d195457d8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 1.065099 Sep 06 11:00:38.897931 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1136/2286] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:37 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:38.899944 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-41c4e443-97b2-4c0d-b6ed-bdc6172b873e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1317 microversion: 2.1 time: 1.134487 Sep 06 11:00:38.899944 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1151/2287] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:37 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1317 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:38.910069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9794bfb6-0735-4af5-bb7a-0533e6de7132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:38.913473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-06752126-1dc0-4de3-ad2d-240c82f67748 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:38.914307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-06752126-1dc0-4de3-ad2d-240c82f67748 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:38.916783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9794bfb6-0735-4af5-bb7a-0533e6de7132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:38.936228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06752126-1dc0-4de3-ad2d-240c82f67748 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:38.938344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06752126-1dc0-4de3-ad2d-240c82f67748 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:38.939047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06752126-1dc0-4de3-ad2d-240c82f67748 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:38.940027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9794bfb6-0735-4af5-bb7a-0533e6de7132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:38.940442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06752126-1dc0-4de3-ad2d-240c82f67748 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:38.941141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06752126-1dc0-4de3-ad2d-240c82f67748 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:38.942348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06752126-1dc0-4de3-ad2d-240c82f67748 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:38.942608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9794bfb6-0735-4af5-bb7a-0533e6de7132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:38.943512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9794bfb6-0735-4af5-bb7a-0533e6de7132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:38.945056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9794bfb6-0735-4af5-bb7a-0533e6de7132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:38.947779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9794bfb6-0735-4af5-bb7a-0533e6de7132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:38.951060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9794bfb6-0735-4af5-bb7a-0533e6de7132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:39.159221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:39.539812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9794bfb6-0735-4af5-bb7a-0533e6de7132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:39.557699 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9794bfb6-0735-4af5-bb7a-0533e6de7132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1477 microversion: 2.1 time: 0.654860 Sep 06 11:00:39.560124 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1152/2288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:38 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1477 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:39.571996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-5f96e219-4ffe-40ae-8540-9a589c083fd1 req-2f54a4f8-db3d-4700-8a82-d37c839bee80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d07bf04-ec2e-40a3-8916-aade0c51060b", "tag": "09304fad-16f8-45c6-b370-7090613127a7"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:39.602530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5f96e219-4ffe-40ae-8540-9a589c083fd1 req-2f54a4f8-db3d-4700-8a82-d37c839bee80 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:39.607872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5f96e219-4ffe-40ae-8540-9a589c083fd1 req-2f54a4f8-db3d-4700-8a82-d37c839bee80 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:39.611098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5f96e219-4ffe-40ae-8540-9a589c083fd1 req-2f54a4f8-db3d-4700-8a82-d37c839bee80 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:39.639087 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-5f96e219-4ffe-40ae-8540-9a589c083fd1 req-2f54a4f8-db3d-4700-8a82-d37c839bee80 service nova] Creating event network-changed:09304fad-16f8-45c6-b370-7090613127a7 for instance 0d07bf04-ec2e-40a3-8916-aade0c51060b on nch1-master-1 Sep 06 11:00:39.649660 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-5f96e219-4ffe-40ae-8540-9a589c083fd1 req-2f54a4f8-db3d-4700-8a82-d37c839bee80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087442 Sep 06 11:00:39.651170 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1153/2289] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:39.817407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-06752126-1dc0-4de3-ad2d-240c82f67748 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:39.834275 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-06752126-1dc0-4de3-ad2d-240c82f67748 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1550 microversion: 2.1 time: 0.932545 Sep 06 11:00:39.836983 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1137/2290] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:38 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1550 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:39.875728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2630d87f-7355-4bc6-9cbb-0c2d0cd6abb1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:39.880987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2630d87f-7355-4bc6-9cbb-0c2d0cd6abb1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:39.934830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c394cd74-5d64-4123-a7ac-600d58d9e006 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:39.935647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c394cd74-5d64-4123-a7ac-600d58d9e006 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:39.968749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:39.970307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c394cd74-5d64-4123-a7ac-600d58d9e006 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:39.970811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c394cd74-5d64-4123-a7ac-600d58d9e006 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:39.981929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2630d87f-7355-4bc6-9cbb-0c2d0cd6abb1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:39.982577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2630d87f-7355-4bc6-9cbb-0c2d0cd6abb1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:39.983063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2630d87f-7355-4bc6-9cbb-0c2d0cd6abb1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:39.983836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2630d87f-7355-4bc6-9cbb-0c2d0cd6abb1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:39.984302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2630d87f-7355-4bc6-9cbb-0c2d0cd6abb1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:39.984739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2630d87f-7355-4bc6-9cbb-0c2d0cd6abb1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:39.999333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c394cd74-5d64-4123-a7ac-600d58d9e006 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:40.000261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c394cd74-5d64-4123-a7ac-600d58d9e006 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:40.000770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c394cd74-5d64-4123-a7ac-600d58d9e006 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:40.001277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c394cd74-5d64-4123-a7ac-600d58d9e006 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:40.397107 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2630d87f-7355-4bc6-9cbb-0c2d0cd6abb1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.537351 Sep 06 11:00:40.397887 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1154/2291] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:00:39 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/os-interface => generated 285 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:00:40.403720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-570105d5-75f3-48dc-9163-89efaff46009 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:40.404569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-570105d5-75f3-48dc-9163-89efaff46009 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:40.423666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-570105d5-75f3-48dc-9163-89efaff46009 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:40.424174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-570105d5-75f3-48dc-9163-89efaff46009 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:40.424615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-570105d5-75f3-48dc-9163-89efaff46009 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:40.431604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-570105d5-75f3-48dc-9163-89efaff46009 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:40.432198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-570105d5-75f3-48dc-9163-89efaff46009 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:40.432878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-570105d5-75f3-48dc-9163-89efaff46009 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:40.542137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:41.031721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c394cd74-5d64-4123-a7ac-600d58d9e006 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:41.047205 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c394cd74-5d64-4123-a7ac-600d58d9e006 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 1.122449 Sep 06 11:00:41.049522 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1138/2292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:39 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:41.088455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b10f133b-88bb-43fa-a4b5-235a24a10b39 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:41.094730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b10f133b-88bb-43fa-a4b5-235a24a10b39 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:41.116191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b10f133b-88bb-43fa-a4b5-235a24a10b39 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:41.125109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b10f133b-88bb-43fa-a4b5-235a24a10b39 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:41.125809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b10f133b-88bb-43fa-a4b5-235a24a10b39 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:41.127282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b10f133b-88bb-43fa-a4b5-235a24a10b39 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:41.133887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b10f133b-88bb-43fa-a4b5-235a24a10b39 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:41.134362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b10f133b-88bb-43fa-a4b5-235a24a10b39 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:42.188947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-570105d5-75f3-48dc-9163-89efaff46009 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:42.216621 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-570105d5-75f3-48dc-9163-89efaff46009 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1317 microversion: 2.1 time: 1.816063 Sep 06 11:00:42.218491 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1155/2293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:40 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1317 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:42.249956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b10f133b-88bb-43fa-a4b5-235a24a10b39 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:42.255798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-39159a5b-bba7-4c6c-ab2e-74599eb806c3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:42.269490 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b10f133b-88bb-43fa-a4b5-235a24a10b39 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1476 microversion: 2.1 time: 1.218036 Sep 06 11:00:42.269742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-39159a5b-bba7-4c6c-ab2e-74599eb806c3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:42.270533 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1139/2294] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:41 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1476 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:42.289029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39159a5b-bba7-4c6c-ab2e-74599eb806c3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:42.289966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39159a5b-bba7-4c6c-ab2e-74599eb806c3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:42.293926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39159a5b-bba7-4c6c-ab2e-74599eb806c3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:42.294827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39159a5b-bba7-4c6c-ab2e-74599eb806c3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:42.295458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39159a5b-bba7-4c6c-ab2e-74599eb806c3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:42.296239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39159a5b-bba7-4c6c-ab2e-74599eb806c3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:43.245381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1f5c6458-2a36-432f-8cd0-f3ef81b42a11 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:43.247054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1f5c6458-2a36-432f-8cd0-f3ef81b42a11 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:43.276690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f5c6458-2a36-432f-8cd0-f3ef81b42a11 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:43.277986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f5c6458-2a36-432f-8cd0-f3ef81b42a11 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:43.280539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f5c6458-2a36-432f-8cd0-f3ef81b42a11 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:43.281689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f5c6458-2a36-432f-8cd0-f3ef81b42a11 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:43.285487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f5c6458-2a36-432f-8cd0-f3ef81b42a11 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:43.285487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f5c6458-2a36-432f-8cd0-f3ef81b42a11 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:43.333403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-39159a5b-bba7-4c6c-ab2e-74599eb806c3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:43.349973 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-39159a5b-bba7-4c6c-ab2e-74599eb806c3 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1523 microversion: 2.1 time: 1.125427 Sep 06 11:00:43.349973 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1156/2295] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:42 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1523 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:43.446300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-b62f1b8b-fdb1-441d-8e10-d592a650fc89 req-735cfbb8-f52c-4457-b983-2413c8814809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6acc0bc9-8746-46d4-b4bb-54029da58446", "name": "network-vif-unplugged", "status": "completed", "tag": "75a4b9ec-0116-4843-8da2-96eb38ec81a3"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:43.458832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b62f1b8b-fdb1-441d-8e10-d592a650fc89 req-735cfbb8-f52c-4457-b983-2413c8814809 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:43.459749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b62f1b8b-fdb1-441d-8e10-d592a650fc89 req-735cfbb8-f52c-4457-b983-2413c8814809 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:43.460190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b62f1b8b-fdb1-441d-8e10-d592a650fc89 req-735cfbb8-f52c-4457-b983-2413c8814809 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:43.475124 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-b62f1b8b-fdb1-441d-8e10-d592a650fc89 req-735cfbb8-f52c-4457-b983-2413c8814809 service nova] Creating event network-vif-unplugged:75a4b9ec-0116-4843-8da2-96eb38ec81a3 for instance 6acc0bc9-8746-46d4-b4bb-54029da58446 on nch1-master-1 Sep 06 11:00:43.485840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-b62f1b8b-fdb1-441d-8e10-d592a650fc89 req-735cfbb8-f52c-4457-b983-2413c8814809 service nova] Instance 6acc0bc9-8746-46d4-b4bb-54029da58446 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:00:43.498918 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-b62f1b8b-fdb1-441d-8e10-d592a650fc89 req-735cfbb8-f52c-4457-b983-2413c8814809 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144109 Sep 06 11:00:43.504822 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1157/2296] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:43.511228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f0ed903d-7e97-4bb1-a6ff-904c7408814c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:43.512902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f0ed903d-7e97-4bb1-a6ff-904c7408814c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:43.521851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0ed903d-7e97-4bb1-a6ff-904c7408814c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:43.522754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0ed903d-7e97-4bb1-a6ff-904c7408814c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:43.524043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0ed903d-7e97-4bb1-a6ff-904c7408814c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:43.524996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0ed903d-7e97-4bb1-a6ff-904c7408814c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:43.525635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0ed903d-7e97-4bb1-a6ff-904c7408814c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:43.526232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0ed903d-7e97-4bb1-a6ff-904c7408814c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:44.524846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1f5c6458-2a36-432f-8cd0-f3ef81b42a11 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:44.538159 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1f5c6458-2a36-432f-8cd0-f3ef81b42a11 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1317 microversion: 2.1 time: 1.300456 Sep 06 11:00:44.553920 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1140/2297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:43 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1317 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:44.553920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6a3db0c6-e8dc-4505-8465-6045585f8cec tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:44.553920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6a3db0c6-e8dc-4505-8465-6045585f8cec tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:44.565282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a3db0c6-e8dc-4505-8465-6045585f8cec tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:44.566071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f0ed903d-7e97-4bb1-a6ff-904c7408814c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:44.566612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a3db0c6-e8dc-4505-8465-6045585f8cec tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:44.567106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a3db0c6-e8dc-4505-8465-6045585f8cec tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:44.567830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a3db0c6-e8dc-4505-8465-6045585f8cec tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:44.568452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a3db0c6-e8dc-4505-8465-6045585f8cec tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:44.569040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a3db0c6-e8dc-4505-8465-6045585f8cec tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:44.587370 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f0ed903d-7e97-4bb1-a6ff-904c7408814c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1476 microversion: 2.1 time: 1.080859 Sep 06 11:00:44.589460 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1158/2298] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:43 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1476 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:45.077329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-65f39030-2c3f-442c-95ad-c8a864f44933 req-286daaa5-1b53-42a5-a77b-074558ec2eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d07bf04-ec2e-40a3-8916-aade0c51060b", "name": "network-vif-plugged", "status": "completed", "tag": "09304fad-16f8-45c6-b370-7090613127a7"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:45.088834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-65f39030-2c3f-442c-95ad-c8a864f44933 req-286daaa5-1b53-42a5-a77b-074558ec2eb7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:45.091410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-65f39030-2c3f-442c-95ad-c8a864f44933 req-286daaa5-1b53-42a5-a77b-074558ec2eb7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:45.092176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-65f39030-2c3f-442c-95ad-c8a864f44933 req-286daaa5-1b53-42a5-a77b-074558ec2eb7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:45.107769 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-65f39030-2c3f-442c-95ad-c8a864f44933 req-286daaa5-1b53-42a5-a77b-074558ec2eb7 service nova] Creating event network-vif-plugged:09304fad-16f8-45c6-b370-7090613127a7 for instance 0d07bf04-ec2e-40a3-8916-aade0c51060b on nch1-master-1 Sep 06 11:00:45.125999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6a3db0c6-e8dc-4505-8465-6045585f8cec tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:45.129824 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-65f39030-2c3f-442c-95ad-c8a864f44933 req-286daaa5-1b53-42a5-a77b-074558ec2eb7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057379 Sep 06 11:00:45.130640 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1159/2299] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:00:45.145404 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6a3db0c6-e8dc-4505-8465-6045585f8cec tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1505 microversion: 2.1 time: 0.605379 Sep 06 11:00:45.146770 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1141/2300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:44 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1505 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:45.562400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b444ed66-1dc6-4aae-b838-c52c16ed121b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:45.563816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b444ed66-1dc6-4aae-b838-c52c16ed121b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:45.587533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b444ed66-1dc6-4aae-b838-c52c16ed121b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:45.589827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b444ed66-1dc6-4aae-b838-c52c16ed121b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:45.590838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b444ed66-1dc6-4aae-b838-c52c16ed121b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:45.592117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b444ed66-1dc6-4aae-b838-c52c16ed121b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:45.593162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b444ed66-1dc6-4aae-b838-c52c16ed121b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:45.593931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b444ed66-1dc6-4aae-b838-c52c16ed121b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:45.617691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-402ab90c-4197-403d-bf1a-e8bc91585752 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:45.619511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-402ab90c-4197-403d-bf1a-e8bc91585752 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:45.635170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-402ab90c-4197-403d-bf1a-e8bc91585752 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:45.636614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-402ab90c-4197-403d-bf1a-e8bc91585752 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:45.637558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-402ab90c-4197-403d-bf1a-e8bc91585752 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:45.641082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-402ab90c-4197-403d-bf1a-e8bc91585752 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:45.647034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-402ab90c-4197-403d-bf1a-e8bc91585752 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:45.647034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-402ab90c-4197-403d-bf1a-e8bc91585752 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:46.059121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b444ed66-1dc6-4aae-b838-c52c16ed121b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:46.070818 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b444ed66-1dc6-4aae-b838-c52c16ed121b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1317 microversion: 2.1 time: 0.512975 Sep 06 11:00:46.078783 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1160/2301] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:45 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:46.088536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a4ba75e2-0352-483a-aed0-ed4883a03d81 req-4b2f8b30-bb59-40c7-9d86-36459bb3223d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6acc0bc9-8746-46d4-b4bb-54029da58446", "tag": "75a4b9ec-0116-4843-8da2-96eb38ec81a3"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:46.114901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a4ba75e2-0352-483a-aed0-ed4883a03d81 req-4b2f8b30-bb59-40c7-9d86-36459bb3223d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:46.117279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a4ba75e2-0352-483a-aed0-ed4883a03d81 req-4b2f8b30-bb59-40c7-9d86-36459bb3223d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:46.117949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a4ba75e2-0352-483a-aed0-ed4883a03d81 req-4b2f8b30-bb59-40c7-9d86-36459bb3223d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:46.148709 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a4ba75e2-0352-483a-aed0-ed4883a03d81 req-4b2f8b30-bb59-40c7-9d86-36459bb3223d service nova] Creating event network-changed:75a4b9ec-0116-4843-8da2-96eb38ec81a3 for instance 6acc0bc9-8746-46d4-b4bb-54029da58446 on nch1-master-1 Sep 06 11:00:46.149866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-402ab90c-4197-403d-bf1a-e8bc91585752 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:46.166273 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-402ab90c-4197-403d-bf1a-e8bc91585752 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1476 microversion: 2.1 time: 0.555637 Sep 06 11:00:46.169332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-a4ba75e2-0352-483a-aed0-ed4883a03d81 req-4b2f8b30-bb59-40c7-9d86-36459bb3223d service nova] Instance 6acc0bc9-8746-46d4-b4bb-54029da58446 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:00:46.174287 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1142/2302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:45 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1476 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:46.185710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-da98d239-65c1-44a4-b642-fe2ecfb2da3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:46.186542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-da98d239-65c1-44a4-b642-fe2ecfb2da3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:46.197728 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a4ba75e2-0352-483a-aed0-ed4883a03d81 req-4b2f8b30-bb59-40c7-9d86-36459bb3223d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117425 Sep 06 11:00:46.199585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da98d239-65c1-44a4-b642-fe2ecfb2da3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:46.199863 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1161/2303] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:46.205740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da98d239-65c1-44a4-b642-fe2ecfb2da3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:46.206407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da98d239-65c1-44a4-b642-fe2ecfb2da3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:46.208615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da98d239-65c1-44a4-b642-fe2ecfb2da3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:46.209310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da98d239-65c1-44a4-b642-fe2ecfb2da3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:46.209928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da98d239-65c1-44a4-b642-fe2ecfb2da3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:46.352112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1110717431", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "9298dce1-2384-4a71-89e1-8a9723555a78"}, {"uuid": "b45bcaa4-f874-4a0b-a39e-943a79bf454b"}, {"uuid": "9298dce1-2384-4a71-89e1-8a9723555a78"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:46.425810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] validate_networks() for [('9298dce1-2384-4a71-89e1-8a9723555a78', None, None, None, None, None), ('b45bcaa4-f874-4a0b-a39e-943a79bf454b', None, None, None, None, None), ('9298dce1-2384-4a71-89e1-8a9723555a78', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:00:46.975472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-da98d239-65c1-44a4-b642-fe2ecfb2da3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:46.989964 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-da98d239-65c1-44a4-b642-fe2ecfb2da3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 200 len: 1508 microversion: 2.1 time: 0.813077 Sep 06 11:00:46.991190 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1143/2304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:46 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 1508 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:47.025254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:47.026086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:47.035260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:47.035963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:47.036656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:47.037492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:47.038231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:47.038794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:47.084021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:00:47.092974 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.compute.api [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Working on deleting snapshot 24243d31-e247-4cf8-9078-901c0b76cafd from shelved instance... Sep 06 11:00:49.045709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:00:49.046266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:00:49.046601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:00:49.047024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:00:49.047456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:00:49.058996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:49.059642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:49.060287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:49.061028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:49.061487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:49.062017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:49.080675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Getting quotas for project 91b83e289c414e499c91fc7f711774b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:00:49.086077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Getting quotas for user 99ebe881ffd44893879bb9e7ab63c9fd and project 91b83e289c414e499c91fc7f711774b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:00:49.102612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:00:49.106093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:00:49.278517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Doing local delete in cell a5a6b47c-7522-4a84-9be6-8ca7130ab6d7(cell1) {{(pid=140875) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 06 11:00:49.280146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:49.281099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:49.281812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:49.282488 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.compute.api [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 06 11:00:49.286865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] deallocate_for_instance() {{(pid=140875) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 06 11:00:49.324286 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1de4d002-591d-4334-b868-785c749aef07 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.977379 Sep 06 11:00:49.339981 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1162/2305] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:00:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:00:49.359667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-48f09ce3-32b1-4f84-97db-9177fcfe79e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:49.360499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-48f09ce3-32b1-4f84-97db-9177fcfe79e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:49.368988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48f09ce3-32b1-4f84-97db-9177fcfe79e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:49.369761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48f09ce3-32b1-4f84-97db-9177fcfe79e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:49.371990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48f09ce3-32b1-4f84-97db-9177fcfe79e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:49.372911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48f09ce3-32b1-4f84-97db-9177fcfe79e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:49.373530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48f09ce3-32b1-4f84-97db-9177fcfe79e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:49.374717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48f09ce3-32b1-4f84-97db-9177fcfe79e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:50.075845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-48f09ce3-32b1-4f84-97db-9177fcfe79e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:50.124980 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-48f09ce3-32b1-4f84-97db-9177fcfe79e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1466 microversion: 2.1 time: 0.780279 Sep 06 11:00:50.124980 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1163/2306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:49 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1466 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:50.134328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0d036ec3-5d1f-4ff5-a270-c83ac5486236 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:50.134957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0d036ec3-5d1f-4ff5-a270-c83ac5486236 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:50.155721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d036ec3-5d1f-4ff5-a270-c83ac5486236 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:50.156228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d036ec3-5d1f-4ff5-a270-c83ac5486236 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:50.156697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d036ec3-5d1f-4ff5-a270-c83ac5486236 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:50.157409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d036ec3-5d1f-4ff5-a270-c83ac5486236 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:50.157879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d036ec3-5d1f-4ff5-a270-c83ac5486236 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:50.158429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d036ec3-5d1f-4ff5-a270-c83ac5486236 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:50.645365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Updating instance_info_cache with network_info: [] {{(pid=140875) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 06 11:00:50.667719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0d036ec3-5d1f-4ff5-a270-c83ac5486236 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:50.684334 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0d036ec3-5d1f-4ff5-a270-c83ac5486236 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1474 microversion: 2.1 time: 0.551723 Sep 06 11:00:50.685038 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1164/2307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:50 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1474 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:50.865987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-4b785778-f319-4fe3-8d0d-0be03c19eda6 req-a6472d56-553f-4d20-a6a8-74075be85494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267d4dad-b118-4f44-993b-81fd05e550df", "name": "network-vif-unplugged", "status": "completed", "tag": "ef011f91-2d4e-406a-bce9-9afb09103a90"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:50.886579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4b785778-f319-4fe3-8d0d-0be03c19eda6 req-a6472d56-553f-4d20-a6a8-74075be85494 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:50.887662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4b785778-f319-4fe3-8d0d-0be03c19eda6 req-a6472d56-553f-4d20-a6a8-74075be85494 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:50.888270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4b785778-f319-4fe3-8d0d-0be03c19eda6 req-a6472d56-553f-4d20-a6a8-74075be85494 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:50.913628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.compute.server_external_events [req-4b785778-f319-4fe3-8d0d-0be03c19eda6 req-a6472d56-553f-4d20-a6a8-74075be85494 service nova] Unable to find a host for instance 267d4dad-b118-4f44-993b-81fd05e550df. Dropping event network-vif-unplugged {{(pid=140876) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 06 11:00:50.914761 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-4b785778-f319-4fe3-8d0d-0be03c19eda6 req-a6472d56-553f-4d20-a6a8-74075be85494 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.228555 Sep 06 11:00:50.916095 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1165/2308] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 230 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 06 11:00:50.949620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-aaf05dd9-dcde-4d00-8087-d4b25c0cb347 req-fd871df5-e451-4832-bea3-048519b7bb74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9db1902-3f12-48b6-a27f-425e4843424b", "tag": "1fa7746e-916f-47fe-a1b6-1454c7592311"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:50.965913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-aaf05dd9-dcde-4d00-8087-d4b25c0cb347 req-fd871df5-e451-4832-bea3-048519b7bb74 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:50.966689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-aaf05dd9-dcde-4d00-8087-d4b25c0cb347 req-fd871df5-e451-4832-bea3-048519b7bb74 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:50.967492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-aaf05dd9-dcde-4d00-8087-d4b25c0cb347 req-fd871df5-e451-4832-bea3-048519b7bb74 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:50.988902 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-aaf05dd9-dcde-4d00-8087-d4b25c0cb347 req-fd871df5-e451-4832-bea3-048519b7bb74 service nova] Creating event network-changed:1fa7746e-916f-47fe-a1b6-1454c7592311 for instance d9db1902-3f12-48b6-a27f-425e4843424b on nch2-master-1 Sep 06 11:00:50.996425 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-aaf05dd9-dcde-4d00-8087-d4b25c0cb347 req-fd871df5-e451-4832-bea3-048519b7bb74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078379 Sep 06 11:00:50.997048 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1166/2309] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:51.009165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-80bf21cb-7ce1-467a-9c83-dde2196394e1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:51.009165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-80bf21cb-7ce1-467a-9c83-dde2196394e1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:51.135529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-80bf21cb-7ce1-467a-9c83-dde2196394e1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:51.157448 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-80bf21cb-7ce1-467a-9c83-dde2196394e1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1213 microversion: 2.1 time: 0.158454 Sep 06 11:00:51.169742 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1167/2310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:50 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:51.253851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dc2c872c-74e6-4e8f-887e-35af26eb1a9f tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:51.254483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dc2c872c-74e6-4e8f-887e-35af26eb1a9f tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:51.264010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc2c872c-74e6-4e8f-887e-35af26eb1a9f tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:51.264508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc2c872c-74e6-4e8f-887e-35af26eb1a9f tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:51.266197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc2c872c-74e6-4e8f-887e-35af26eb1a9f tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:51.267140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc2c872c-74e6-4e8f-887e-35af26eb1a9f tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:51.267771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc2c872c-74e6-4e8f-887e-35af26eb1a9f tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:51.268602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc2c872c-74e6-4e8f-887e-35af26eb1a9f tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:51.445851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:51.528998 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e86273ad-f4cf-4964-bca1-ac7e69a3b5bc tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 204 len: 0 microversion: 2.1 time: 4.510510 Sep 06 11:00:51.529753 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1144/2311] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:00:47 2022] DELETE /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 0 bytes in 4512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:00:51.538149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9eb8e438-9f24-4fc9-b9ce-d0170a70f74f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:51.539173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9eb8e438-9f24-4fc9-b9ce-d0170a70f74f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:51.555314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9eb8e438-9f24-4fc9-b9ce-d0170a70f74f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:51.556152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9eb8e438-9f24-4fc9-b9ce-d0170a70f74f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:51.556752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9eb8e438-9f24-4fc9-b9ce-d0170a70f74f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:51.559635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9eb8e438-9f24-4fc9-b9ce-d0170a70f74f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:51.560934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9eb8e438-9f24-4fc9-b9ce-d0170a70f74f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:51.564028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9eb8e438-9f24-4fc9-b9ce-d0170a70f74f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:51.596879 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-9eb8e438-9f24-4fc9-b9ce-d0170a70f74f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9eb8e438-9f24-4fc9-b9ce-d0170a70f74f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df HTTP/1.1 Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '267d4dad-b118-4f44-993b-81fd05e550df'} Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:00:51.603279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:51.608685 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:00:51.608685 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:00:51.608685 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:00:51.608685 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:00:51.608685 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:00:51.608685 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:00:51.608685 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:00:51.612122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9eb8e438-9f24-4fc9-b9ce-d0170a70f74f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:00:51.615324 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9eb8e438-9f24-4fc9-b9ce-d0170a70f74f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 404 len: 111 microversion: 2.1 time: 0.081161 Sep 06 11:00:51.616121 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1145/2312] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:51 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:00:51.715400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4273b22f-b1c4-4dab-a6e3-632ac7d77df4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:51.720137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4273b22f-b1c4-4dab-a6e3-632ac7d77df4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:51.739511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4273b22f-b1c4-4dab-a6e3-632ac7d77df4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:51.742111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4273b22f-b1c4-4dab-a6e3-632ac7d77df4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:51.742807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4273b22f-b1c4-4dab-a6e3-632ac7d77df4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:51.746571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4273b22f-b1c4-4dab-a6e3-632ac7d77df4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:51.748367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4273b22f-b1c4-4dab-a6e3-632ac7d77df4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:51.750343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4273b22f-b1c4-4dab-a6e3-632ac7d77df4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:52.107822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4273b22f-b1c4-4dab-a6e3-632ac7d77df4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:52.119685 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4273b22f-b1c4-4dab-a6e3-632ac7d77df4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1471 microversion: 2.1 time: 0.412505 Sep 06 11:00:52.122148 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1146/2313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:51 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1471 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:52.127777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2138810498", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "9312fcea-ff98-4f9b-847c-17d6e7290268"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:52.228842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] validate_networks() for [('9312fcea-ff98-4f9b-847c-17d6e7290268', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:00:52.687429 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dc2c872c-74e6-4e8f-887e-35af26eb1a9f tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1617 microversion: 2.1 time: 1.515997 Sep 06 11:00:52.687842 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1168/2314] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:51 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1617 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:52.711554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-94c2da09-546a-4ce9-a119-701b6d791b52 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:52.712243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-94c2da09-546a-4ce9-a119-701b6d791b52 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:52.743216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94c2da09-546a-4ce9-a119-701b6d791b52 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:52.743643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94c2da09-546a-4ce9-a119-701b6d791b52 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:52.744386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94c2da09-546a-4ce9-a119-701b6d791b52 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:52.745121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94c2da09-546a-4ce9-a119-701b6d791b52 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:52.746350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94c2da09-546a-4ce9-a119-701b6d791b52 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:52.747692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94c2da09-546a-4ce9-a119-701b6d791b52 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:52.776100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:53.021709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:00:53.022186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:00:53.022607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:00:53.023053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:00:53.023462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:00:53.041811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:53.042336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:53.042780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:53.043546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:53.044361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:53.045045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:53.068462 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-94c2da09-546a-4ce9-a119-701b6d791b52 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "POST /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446/action" status: 204 len: 0 microversion: 2.1 time: 0.374259 Sep 06 11:00:53.070239 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1169/2315] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:00:52 2022] POST /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446/action => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:00:53.092823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:00:53.098069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a1e32865-d9a2-49c0-baca-8590bf93cc05 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:53.102528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a1e32865-d9a2-49c0-baca-8590bf93cc05 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:53.108370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for user e19903666a1243e3a66411e30babe299 and project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:00:53.123138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1e32865-d9a2-49c0-baca-8590bf93cc05 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:53.125019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1e32865-d9a2-49c0-baca-8590bf93cc05 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:53.126091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1e32865-d9a2-49c0-baca-8590bf93cc05 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:53.128052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:00:53.130612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1e32865-d9a2-49c0-baca-8590bf93cc05 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:53.132545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1e32865-d9a2-49c0-baca-8590bf93cc05 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:53.133658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1e32865-d9a2-49c0-baca-8590bf93cc05 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:53.134560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:00:53.327071 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bb216e4a-261b-4a37-a3a7-cac6138838c6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.203420 Sep 06 11:00:53.328096 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1147/2316] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:00:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:00:53.333900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bf819ca8-2df2-45b9-9b92-539defb5582a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Action: 'create', calling method: .version_select at 0x7f90fcf99310>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-968171799", "policies": ["affinity"]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:53.357555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-bf819ca8-2df2-45b9-9b92-539defb5582a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:00:53.364053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-bf819ca8-2df2-45b9-9b92-539defb5582a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:00:53.380916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a1e32865-d9a2-49c0-baca-8590bf93cc05 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:53.395275 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a1e32865-d9a2-49c0-baca-8590bf93cc05 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1273 microversion: 2.1 time: 0.323443 Sep 06 11:00:53.396352 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1170/2317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:53 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1273 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:53.408227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-46b26699-fb41-4cc4-886b-51e6c6d529e5 req-f40d933c-2ee0-4e26-884d-ba513cdcc6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267d4dad-b118-4f44-993b-81fd05e550df", "name": "network-vif-deleted", "tag": "ef011f91-2d4e-406a-bce9-9afb09103a90"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:53.432426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-46b26699-fb41-4cc4-886b-51e6c6d529e5 req-f40d933c-2ee0-4e26-884d-ba513cdcc6a7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:53.434196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-46b26699-fb41-4cc4-886b-51e6c6d529e5 req-f40d933c-2ee0-4e26-884d-ba513cdcc6a7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:53.434637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-46b26699-fb41-4cc4-886b-51e6c6d529e5 req-f40d933c-2ee0-4e26-884d-ba513cdcc6a7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:53.463172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.compute.server_external_events [req-46b26699-fb41-4cc4-886b-51e6c6d529e5 req-f40d933c-2ee0-4e26-884d-ba513cdcc6a7 service nova] Unable to find a host for instance 267d4dad-b118-4f44-993b-81fd05e550df. Dropping event network-vif-deleted {{(pid=140876) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 06 11:00:53.464688 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-46b26699-fb41-4cc4-886b-51e6c6d529e5 req-f40d933c-2ee0-4e26-884d-ba513cdcc6a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.065555 Sep 06 11:00:53.471464 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1171/2318] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 06 11:00:53.476450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eec1fab1-8621-4be3-8946-2bedffe5d4ed tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:53.482066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eec1fab1-8621-4be3-8946-2bedffe5d4ed tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:53.490894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eec1fab1-8621-4be3-8946-2bedffe5d4ed tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:53.490894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eec1fab1-8621-4be3-8946-2bedffe5d4ed tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:53.490894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eec1fab1-8621-4be3-8946-2bedffe5d4ed tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:53.490894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eec1fab1-8621-4be3-8946-2bedffe5d4ed tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:53.490894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eec1fab1-8621-4be3-8946-2bedffe5d4ed tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:53.491484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eec1fab1-8621-4be3-8946-2bedffe5d4ed tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:53.582116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-bf819ca8-2df2-45b9-9b92-539defb5582a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:00:53.602066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-bf819ca8-2df2-45b9-9b92-539defb5582a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:00:53.631536 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bf819ca8-2df2-45b9-9b92-539defb5582a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.302042 Sep 06 11:00:53.632962 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1148/2319] 10.222.0.20 () {60 vars in 1174 bytes} [Tue Sep 6 11:00:53 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:53.640250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8d88f22c-0e2d-4317-b1d2-0fa57ce63c85 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:53.640941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8d88f22c-0e2d-4317-b1d2-0fa57ce63c85 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:53.796311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8d88f22c-0e2d-4317-b1d2-0fa57ce63c85 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:53.805001 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8d88f22c-0e2d-4317-b1d2-0fa57ce63c85 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1215 microversion: 2.1 time: 0.169854 Sep 06 11:00:53.809095 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1149/2320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:53 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:53.859621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-703948513", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "877e8d5e-c9af-4b48-ae33-9f3498aa3a4f"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:53.962468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:00:54.445721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eec1fab1-8621-4be3-8946-2bedffe5d4ed tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:54.458468 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eec1fab1-8621-4be3-8946-2bedffe5d4ed tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1471 microversion: 2.1 time: 0.984777 Sep 06 11:00:54.469213 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1172/2321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:53 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1471 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:54.767171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a136caa6-7e86-4161-93da-ef94ca480415 tempest-AbsoluteLimitsTestJSON-1652639554 tempest-AbsoluteLimitsTestJSON-1652639554-project] Calling method '.version_select at 0x7f90f84308b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:54.782297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a136caa6-7e86-4161-93da-ef94ca480415 tempest-AbsoluteLimitsTestJSON-1652639554 tempest-AbsoluteLimitsTestJSON-1652639554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:54.783033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a136caa6-7e86-4161-93da-ef94ca480415 tempest-AbsoluteLimitsTestJSON-1652639554 tempest-AbsoluteLimitsTestJSON-1652639554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:54.783850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a136caa6-7e86-4161-93da-ef94ca480415 tempest-AbsoluteLimitsTestJSON-1652639554 tempest-AbsoluteLimitsTestJSON-1652639554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:54.784821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a136caa6-7e86-4161-93da-ef94ca480415 tempest-AbsoluteLimitsTestJSON-1652639554 tempest-AbsoluteLimitsTestJSON-1652639554-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:54.786361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a136caa6-7e86-4161-93da-ef94ca480415 tempest-AbsoluteLimitsTestJSON-1652639554 tempest-AbsoluteLimitsTestJSON-1652639554-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:54.787173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a136caa6-7e86-4161-93da-ef94ca480415 tempest-AbsoluteLimitsTestJSON-1652639554 tempest-AbsoluteLimitsTestJSON-1652639554-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:54.836351 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a136caa6-7e86-4161-93da-ef94ca480415 tempest-AbsoluteLimitsTestJSON-1652639554 tempest-AbsoluteLimitsTestJSON-1652639554-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.363735 Sep 06 11:00:54.837153 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1173/2322] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:54 2022] GET /compute/v2.1/limits => generated 511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:54.841836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-264619ed-aebd-4986-98f5-009965c0f231 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:54.842453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-264619ed-aebd-4986-98f5-009965c0f231 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:54.849383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-264619ed-aebd-4986-98f5-009965c0f231 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:54.860228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-264619ed-aebd-4986-98f5-009965c0f231 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:54.860228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-264619ed-aebd-4986-98f5-009965c0f231 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:54.860228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-264619ed-aebd-4986-98f5-009965c0f231 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:54.860228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-264619ed-aebd-4986-98f5-009965c0f231 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:54.860228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-264619ed-aebd-4986-98f5-009965c0f231 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:55.014721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-264619ed-aebd-4986-98f5-009965c0f231 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:55.022540 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-264619ed-aebd-4986-98f5-009965c0f231 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1271 microversion: 2.1 time: 0.184377 Sep 06 11:00:55.023148 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1174/2323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:54 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:55.041123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7ad6534d-b75c-4e76-9cbe-0ba52d0abdfa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:55.041261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:00:55.041711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:00:55.042669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:00:55.043090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7ad6534d-b75c-4e76-9cbe-0ba52d0abdfa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:55.043297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:00:55.043766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:00:55.053391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ad6534d-b75c-4e76-9cbe-0ba52d0abdfa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:55.053391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ad6534d-b75c-4e76-9cbe-0ba52d0abdfa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:55.053391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ad6534d-b75c-4e76-9cbe-0ba52d0abdfa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:55.053391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ad6534d-b75c-4e76-9cbe-0ba52d0abdfa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:55.053920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ad6534d-b75c-4e76-9cbe-0ba52d0abdfa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:55.054746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ad6534d-b75c-4e76-9cbe-0ba52d0abdfa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:55.074483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:55.074985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:55.075569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:55.076216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:55.076859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:55.077459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:55.097364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:00:55.102727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:00:55.119489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Going to run 2 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:00:55.122351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: a3173985-c4ff-4e48-887a-baf5a5da0a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:00:55.227221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7ad6534d-b75c-4e76-9cbe-0ba52d0abdfa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:55.235691 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7ad6534d-b75c-4e76-9cbe-0ba52d0abdfa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1211 microversion: 2.1 time: 0.210688 Sep 06 11:00:55.236274 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1175/2324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:55 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1211 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:55.240896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-dd5e2fa5-3e7d-45d6-852e-b3d8ccfe2ccd req-785e5277-1133-4958-98ad-71a9d6d514ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6acc0bc9-8746-46d4-b4bb-54029da58446", "name": "network-vif-plugged", "status": "completed", "tag": "75a4b9ec-0116-4843-8da2-96eb38ec81a3"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:55.257642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dd5e2fa5-3e7d-45d6-852e-b3d8ccfe2ccd req-785e5277-1133-4958-98ad-71a9d6d514ec service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:55.258142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dd5e2fa5-3e7d-45d6-852e-b3d8ccfe2ccd req-785e5277-1133-4958-98ad-71a9d6d514ec service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:55.258588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dd5e2fa5-3e7d-45d6-852e-b3d8ccfe2ccd req-785e5277-1133-4958-98ad-71a9d6d514ec service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:55.271819 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-dd5e2fa5-3e7d-45d6-852e-b3d8ccfe2ccd req-785e5277-1133-4958-98ad-71a9d6d514ec service nova] Creating event network-vif-plugged:75a4b9ec-0116-4843-8da2-96eb38ec81a3 for instance 6acc0bc9-8746-46d4-b4bb-54029da58446 on nch1-master-1 Sep 06 11:00:55.278335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-dd5e2fa5-3e7d-45d6-852e-b3d8ccfe2ccd req-785e5277-1133-4958-98ad-71a9d6d514ec service nova] Instance 6acc0bc9-8746-46d4-b4bb-54029da58446 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:00:55.289993 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-dd5e2fa5-3e7d-45d6-852e-b3d8ccfe2ccd req-785e5277-1133-4958-98ad-71a9d6d514ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052273 Sep 06 11:00:55.297675 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1176/2325] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:00:55.315139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140875) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 06 11:00:55.342310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:00:55.348259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:00:55.350610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:55.445820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:00:55.452741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:00:55.471394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=a3173985-c4ff-4e48-887a-baf5a5da0a9b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:00:55.484120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fcca5b89-330c-4448-a9bb-97caf87e0f44 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:55.485683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fcca5b89-330c-4448-a9bb-97caf87e0f44 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:55.494720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcca5b89-330c-4448-a9bb-97caf87e0f44 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:55.496923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcca5b89-330c-4448-a9bb-97caf87e0f44 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:55.503567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcca5b89-330c-4448-a9bb-97caf87e0f44 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:55.503567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcca5b89-330c-4448-a9bb-97caf87e0f44 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:55.503567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcca5b89-330c-4448-a9bb-97caf87e0f44 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:55.503567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcca5b89-330c-4448-a9bb-97caf87e0f44 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:55.633954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:00:55.639519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:00:55.781659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:00:55.792888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:00:55.889872 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ca66e3fd-cc6d-4a4c-b540-f846d12112f4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.035166 Sep 06 11:00:55.893078 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1150/2326] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:00:53 2022] POST /compute/v2.1/servers => generated 32 bytes in 2038 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 06 11:00:55.914220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-61cc4d3e-c2b9-467d-b6eb-65f12143a671 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:55.924641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-61cc4d3e-c2b9-467d-b6eb-65f12143a671 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:55.931427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fcca5b89-330c-4448-a9bb-97caf87e0f44 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:55.942848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-61cc4d3e-c2b9-467d-b6eb-65f12143a671 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Searching by: {'deleted': False, 'project_id': '0a7af966e1b740a59920ff9370b5dade'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:00:55.953405 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fcca5b89-330c-4448-a9bb-97caf87e0f44 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1471 microversion: 2.1 time: 0.473865 Sep 06 11:00:55.954811 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1177/2327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:55 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1471 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:55.985655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61cc4d3e-c2b9-467d-b6eb-65f12143a671 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:55.986579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61cc4d3e-c2b9-467d-b6eb-65f12143a671 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:55.987318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61cc4d3e-c2b9-467d-b6eb-65f12143a671 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:55.988348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61cc4d3e-c2b9-467d-b6eb-65f12143a671 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:55.989058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61cc4d3e-c2b9-467d-b6eb-65f12143a671 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:55.989850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61cc4d3e-c2b9-467d-b6eb-65f12143a671 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:56.050376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe89effb-0a94-44ea-bb5a-105ed910d152 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:56.050960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe89effb-0a94-44ea-bb5a-105ed910d152 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:56.068071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe89effb-0a94-44ea-bb5a-105ed910d152 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:56.068291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-61cc4d3e-c2b9-467d-b6eb-65f12143a671 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:00:56.069442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe89effb-0a94-44ea-bb5a-105ed910d152 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:56.070503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe89effb-0a94-44ea-bb5a-105ed910d152 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:56.073778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe89effb-0a94-44ea-bb5a-105ed910d152 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:56.074671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe89effb-0a94-44ea-bb5a-105ed910d152 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:56.075343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe89effb-0a94-44ea-bb5a-105ed910d152 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:56.142319 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-61cc4d3e-c2b9-467d-b6eb-65f12143a671 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.233445 Sep 06 11:00:56.153808 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1151/2328] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 11:00:55 2022] GET /compute/v2.1/servers => generated 1002 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:56.162222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0adb9fe0-f86c-41e4-a16d-e10e4c992042 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:56.163134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0adb9fe0-f86c-41e4-a16d-e10e4c992042 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:56.336049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0adb9fe0-f86c-41e4-a16d-e10e4c992042 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:56.347211 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0adb9fe0-f86c-41e4-a16d-e10e4c992042 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1218 microversion: 2.1 time: 0.189960 Sep 06 11:00:56.347842 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1152/2329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:56 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1218 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:56.368785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c54c839b-d07a-4a69-a41a-ba5d7de70b13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:56.369516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c54c839b-d07a-4a69-a41a-ba5d7de70b13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:56.386826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54c839b-d07a-4a69-a41a-ba5d7de70b13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:56.391279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54c839b-d07a-4a69-a41a-ba5d7de70b13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:56.391859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54c839b-d07a-4a69-a41a-ba5d7de70b13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:56.393588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54c839b-d07a-4a69-a41a-ba5d7de70b13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:56.395286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54c839b-d07a-4a69-a41a-ba5d7de70b13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:56.398987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54c839b-d07a-4a69-a41a-ba5d7de70b13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:56.472017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe89effb-0a94-44ea-bb5a-105ed910d152 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:56.483701 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe89effb-0a94-44ea-bb5a-105ed910d152 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1313 microversion: 2.1 time: 0.441504 Sep 06 11:00:56.496430 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1178/2330] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:56 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:56.535446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c54c839b-d07a-4a69-a41a-ba5d7de70b13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:56.548416 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c54c839b-d07a-4a69-a41a-ba5d7de70b13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1285 microversion: 2.1 time: 0.192550 Sep 06 11:00:56.572184 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1153/2331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:56 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:56.980700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ccf55a53-b42b-4fcb-b385-5bac48ef337e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:56.981492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ccf55a53-b42b-4fcb-b385-5bac48ef337e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:56.990485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf55a53-b42b-4fcb-b385-5bac48ef337e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:56.990983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf55a53-b42b-4fcb-b385-5bac48ef337e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:56.991691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf55a53-b42b-4fcb-b385-5bac48ef337e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:56.996996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf55a53-b42b-4fcb-b385-5bac48ef337e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:56.997496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf55a53-b42b-4fcb-b385-5bac48ef337e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:56.997973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf55a53-b42b-4fcb-b385-5bac48ef337e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:57.227051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ccf55a53-b42b-4fcb-b385-5bac48ef337e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:57.237390 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ccf55a53-b42b-4fcb-b385-5bac48ef337e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1471 microversion: 2.1 time: 0.260499 Sep 06 11:00:57.248699 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1179/2332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:56 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:57.370798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e910771-77bf-49c6-b447-7e190da4bfaa tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:57.373025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e910771-77bf-49c6-b447-7e190da4bfaa tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:57.516468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ff4dccfb-3030-4901-9419-601df0a06ce3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:57.517217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ff4dccfb-3030-4901-9419-601df0a06ce3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:57.543149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff4dccfb-3030-4901-9419-601df0a06ce3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:57.545086 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff4dccfb-3030-4901-9419-601df0a06ce3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:57.546203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff4dccfb-3030-4901-9419-601df0a06ce3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:57.547841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff4dccfb-3030-4901-9419-601df0a06ce3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:57.548474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff4dccfb-3030-4901-9419-601df0a06ce3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:57.549424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff4dccfb-3030-4901-9419-601df0a06ce3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:57.704333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7e910771-77bf-49c6-b447-7e190da4bfaa tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:57.725759 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e910771-77bf-49c6-b447-7e190da4bfaa tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1218 microversion: 2.1 time: 0.359667 Sep 06 11:00:57.730344 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1154/2333] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:57 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1218 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:57.752179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2cadfc19-5f49-4954-bd3e-0268165a5351 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:57.752179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2cadfc19-5f49-4954-bd3e-0268165a5351 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:57.758202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cadfc19-5f49-4954-bd3e-0268165a5351 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:57.759564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cadfc19-5f49-4954-bd3e-0268165a5351 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:57.759564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cadfc19-5f49-4954-bd3e-0268165a5351 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:57.759907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cadfc19-5f49-4954-bd3e-0268165a5351 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:57.760370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cadfc19-5f49-4954-bd3e-0268165a5351 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:57.760795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cadfc19-5f49-4954-bd3e-0268165a5351 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:58.099725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ff4dccfb-3030-4901-9419-601df0a06ce3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:58.114311 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ff4dccfb-3030-4901-9419-601df0a06ce3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1334 microversion: 2.1 time: 0.601997 Sep 06 11:00:58.115151 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1180/2334] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:57 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1334 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:58.194727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2cadfc19-5f49-4954-bd3e-0268165a5351 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:58.204159 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2cadfc19-5f49-4954-bd3e-0268165a5351 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1315 microversion: 2.1 time: 0.462214 Sep 06 11:00:58.205266 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1155/2335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:57 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:58.261434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-569be744-ded4-4989-b967-eb172753cdf5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:58.262213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-569be744-ded4-4989-b967-eb172753cdf5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:58.278520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569be744-ded4-4989-b967-eb172753cdf5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:58.278520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569be744-ded4-4989-b967-eb172753cdf5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:58.279045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569be744-ded4-4989-b967-eb172753cdf5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:58.280012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569be744-ded4-4989-b967-eb172753cdf5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:58.282308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569be744-ded4-4989-b967-eb172753cdf5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:58.282954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569be744-ded4-4989-b967-eb172753cdf5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:58.565005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-569be744-ded4-4989-b967-eb172753cdf5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:58.582860 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-569be744-ded4-4989-b967-eb172753cdf5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1463 microversion: 2.1 time: 0.319627 Sep 06 11:00:58.583636 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1181/2336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:58 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1463 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:58.611576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dd89c36a-ef18-4e99-8ed9-c2577594a78e tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:58.612328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dd89c36a-ef18-4e99-8ed9-c2577594a78e tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:58.630915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd89c36a-ef18-4e99-8ed9-c2577594a78e tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:58.632246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd89c36a-ef18-4e99-8ed9-c2577594a78e tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:58.634391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd89c36a-ef18-4e99-8ed9-c2577594a78e tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:58.635318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd89c36a-ef18-4e99-8ed9-c2577594a78e tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:58.637187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd89c36a-ef18-4e99-8ed9-c2577594a78e tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:58.639388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd89c36a-ef18-4e99-8ed9-c2577594a78e tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:58.753953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0c0610bc-7e93-43f4-b30b-bf033cec2b66 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:58.754769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0c0610bc-7e93-43f4-b30b-bf033cec2b66 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:58.764379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c0610bc-7e93-43f4-b30b-bf033cec2b66 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:58.767062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c0610bc-7e93-43f4-b30b-bf033cec2b66 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:58.767628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c0610bc-7e93-43f4-b30b-bf033cec2b66 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:58.770604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c0610bc-7e93-43f4-b30b-bf033cec2b66 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:58.771379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c0610bc-7e93-43f4-b30b-bf033cec2b66 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:58.773824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c0610bc-7e93-43f4-b30b-bf033cec2b66 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:58.923187 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dd89c36a-ef18-4e99-8ed9-c2577594a78e tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1614 microversion: 2.1 time: 0.316843 Sep 06 11:00:58.924719 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1156/2337] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:58 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1614 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:58.959824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f37816d6-ade9-4328-bb4e-5d7ff9d7a8e4 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Calling method '.version_select at 0x7f90f8520280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:58.964968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f37816d6-ade9-4328-bb4e-5d7ff9d7a8e4 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:58.965771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f37816d6-ade9-4328-bb4e-5d7ff9d7a8e4 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:58.966553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f37816d6-ade9-4328-bb4e-5d7ff9d7a8e4 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:58.975761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0c0610bc-7e93-43f4-b30b-bf033cec2b66 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:00:58.987691 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f37816d6-ade9-4328-bb4e-5d7ff9d7a8e4 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.034892 Sep 06 11:00:58.989058 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0c0610bc-7e93-43f4-b30b-bf033cec2b66 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1222 microversion: 2.1 time: 0.239000 Sep 06 11:00:58.989806 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1182/2338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:58 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1222 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:00:58.994668 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1157/2339] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 11:00:58 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:00:59.128466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-450656203", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:00:59.147130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56980623-3518-4297-814b-4fb473eb8ef0 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:00:59.148590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56980623-3518-4297-814b-4fb473eb8ef0 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:00:59.169023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56980623-3518-4297-814b-4fb473eb8ef0 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:59.170078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56980623-3518-4297-814b-4fb473eb8ef0 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:59.170709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56980623-3518-4297-814b-4fb473eb8ef0 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:59.171648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56980623-3518-4297-814b-4fb473eb8ef0 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:00:59.172434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56980623-3518-4297-814b-4fb473eb8ef0 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:00:59.173888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56980623-3518-4297-814b-4fb473eb8ef0 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:00:59.210959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:01:00.072933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-56980623-3518-4297-814b-4fb473eb8ef0 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:00.081567 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56980623-3518-4297-814b-4fb473eb8ef0 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.946491 Sep 06 11:01:00.082131 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1158/2340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:00:59 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:00.103158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b31ff63a-7232-476c-bc25-b3ace94a890e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:00.103158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b31ff63a-7232-476c-bc25-b3ace94a890e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:00.107989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b31ff63a-7232-476c-bc25-b3ace94a890e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:00.108478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b31ff63a-7232-476c-bc25-b3ace94a890e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:00.108917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b31ff63a-7232-476c-bc25-b3ace94a890e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:00.109617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b31ff63a-7232-476c-bc25-b3ace94a890e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:00.110075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b31ff63a-7232-476c-bc25-b3ace94a890e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:00.110502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b31ff63a-7232-476c-bc25-b3ace94a890e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:00.223995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:01:00.224521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:01:00.224932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:01:00.225347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:01:00.226325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:01:00.239849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:00.241455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:00.241455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:00.241675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:00.242027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:00.242508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:00.269760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Getting quotas for project 2a1f6f54c8d24eaa9eae09e8f30c56f1. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:01:00.273680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Getting quotas for user 3b6e2046e3bd40b3b46802dfa796260b and project 2a1f6f54c8d24eaa9eae09e8f30c56f1. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:01:00.275408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:00.290217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:01:00.293279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:01:00.430528 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1fbeadbf-5e50-4fd6-84b7-5aa966dd56df tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.305800 Sep 06 11:01:00.441878 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1183/2341] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:01:00.716230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-73d806e8-a44c-4cf0-8a8c-1592f9b870da req-a7e9f651-57bf-47d2-b1cf-0b4455e91019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98250008-de3d-4d5c-8b09-152eadba1601", "tag": "f3e0bff0-ed11-4125-8356-50bdbb50710e"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:00.728245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-73d806e8-a44c-4cf0-8a8c-1592f9b870da req-a7e9f651-57bf-47d2-b1cf-0b4455e91019 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:00.728939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-73d806e8-a44c-4cf0-8a8c-1592f9b870da req-a7e9f651-57bf-47d2-b1cf-0b4455e91019 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:00.730210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-73d806e8-a44c-4cf0-8a8c-1592f9b870da req-a7e9f651-57bf-47d2-b1cf-0b4455e91019 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:00.744692 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-73d806e8-a44c-4cf0-8a8c-1592f9b870da req-a7e9f651-57bf-47d2-b1cf-0b4455e91019 service nova] Creating event network-changed:f3e0bff0-ed11-4125-8356-50bdbb50710e for instance 98250008-de3d-4d5c-8b09-152eadba1601 on nch1-master-1 Sep 06 11:01:00.753267 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-73d806e8-a44c-4cf0-8a8c-1592f9b870da req-a7e9f651-57bf-47d2-b1cf-0b4455e91019 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.309598 Sep 06 11:01:00.754943 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1184/2342] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:00.764396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5b836412-131c-4213-8ea4-a8fdf84998dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:00.765762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5b836412-131c-4213-8ea4-a8fdf84998dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:00.773574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b836412-131c-4213-8ea4-a8fdf84998dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:00.774315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b836412-131c-4213-8ea4-a8fdf84998dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:00.775358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b836412-131c-4213-8ea4-a8fdf84998dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:00.777161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b836412-131c-4213-8ea4-a8fdf84998dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:00.778530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b836412-131c-4213-8ea4-a8fdf84998dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:00.779213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b836412-131c-4213-8ea4-a8fdf84998dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:00.936561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b31ff63a-7232-476c-bc25-b3ace94a890e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:00.936773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5b836412-131c-4213-8ea4-a8fdf84998dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:00.947228 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b31ff63a-7232-476c-bc25-b3ace94a890e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1315 microversion: 2.1 time: 0.849229 Sep 06 11:01:00.952709 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1159/2343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:00 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1315 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:00.952859 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5b836412-131c-4213-8ea4-a8fdf84998dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1278 microversion: 2.1 time: 0.195376 Sep 06 11:01:00.953658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c8b26bba-0870-402c-9c38-f076f1cd9d8b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:00.954429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c8b26bba-0870-402c-9c38-f076f1cd9d8b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:00.958291 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1185/2344] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:00 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:01.111712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5a3bb903-d8b2-4e82-b284-884751740f34 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:01.114199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5a3bb903-d8b2-4e82-b284-884751740f34 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:01.124296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a3bb903-d8b2-4e82-b284-884751740f34 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:01.125004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a3bb903-d8b2-4e82-b284-884751740f34 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:01.125609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a3bb903-d8b2-4e82-b284-884751740f34 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:01.126671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a3bb903-d8b2-4e82-b284-884751740f34 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:01.127254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a3bb903-d8b2-4e82-b284-884751740f34 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:01.127931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a3bb903-d8b2-4e82-b284-884751740f34 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:01.227943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c8b26bba-0870-402c-9c38-f076f1cd9d8b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:01.238415 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c8b26bba-0870-402c-9c38-f076f1cd9d8b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1212 microversion: 2.1 time: 0.288875 Sep 06 11:01:01.249419 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1160/2345] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:00 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1212 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:01.687880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5a3bb903-d8b2-4e82-b284-884751740f34 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:01.697439 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5a3bb903-d8b2-4e82-b284-884751740f34 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.597022 Sep 06 11:01:01.698818 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1186/2346] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:01 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:01.976631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b2657da5-39b4-4fcc-9f4c-6a418ea68479 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:01.979128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b2657da5-39b4-4fcc-9f4c-6a418ea68479 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:01.981109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3d3b9880-5382-4b3f-a457-a14316fd1b62 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:01.982073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3d3b9880-5382-4b3f-a457-a14316fd1b62 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:01.989855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d3b9880-5382-4b3f-a457-a14316fd1b62 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:01.990629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d3b9880-5382-4b3f-a457-a14316fd1b62 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:01.991256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d3b9880-5382-4b3f-a457-a14316fd1b62 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:01.991953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2657da5-39b4-4fcc-9f4c-6a418ea68479 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:01.992602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d3b9880-5382-4b3f-a457-a14316fd1b62 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:01.993227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d3b9880-5382-4b3f-a457-a14316fd1b62 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:01.994153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d3b9880-5382-4b3f-a457-a14316fd1b62 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:02.008010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2657da5-39b4-4fcc-9f4c-6a418ea68479 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:02.008724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2657da5-39b4-4fcc-9f4c-6a418ea68479 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:02.009617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2657da5-39b4-4fcc-9f4c-6a418ea68479 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:02.013627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2657da5-39b4-4fcc-9f4c-6a418ea68479 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:02.014223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2657da5-39b4-4fcc-9f4c-6a418ea68479 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:02.180354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3d3b9880-5382-4b3f-a457-a14316fd1b62 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:02.185080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:02.192875 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3d3b9880-5382-4b3f-a457-a14316fd1b62 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1276 microversion: 2.1 time: 0.218739 Sep 06 11:01:02.193499 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1187/2347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:01 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1276 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:02.269568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0915a294-fd41-4f1e-b98b-9887cbf7a538 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:02.270803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0915a294-fd41-4f1e-b98b-9887cbf7a538 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:02.282343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0915a294-fd41-4f1e-b98b-9887cbf7a538 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:02.283189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0915a294-fd41-4f1e-b98b-9887cbf7a538 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:02.283824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0915a294-fd41-4f1e-b98b-9887cbf7a538 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:02.285608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0915a294-fd41-4f1e-b98b-9887cbf7a538 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:02.286119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0915a294-fd41-4f1e-b98b-9887cbf7a538 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:02.286619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0915a294-fd41-4f1e-b98b-9887cbf7a538 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:02.455540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0915a294-fd41-4f1e-b98b-9887cbf7a538 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:02.464448 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0915a294-fd41-4f1e-b98b-9887cbf7a538 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1208 microversion: 2.1 time: 0.201172 Sep 06 11:01:02.465555 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1188/2348] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:02 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1208 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:02.553969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b2657da5-39b4-4fcc-9f4c-6a418ea68479 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:02.563875 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b2657da5-39b4-4fcc-9f4c-6a418ea68479 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1315 microversion: 2.1 time: 0.596145 Sep 06 11:01:02.565054 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1161/2349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:01 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:02.728380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0e843d5f-39ca-4c05-9c95-8a68fa931c3e tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:02.731125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0e843d5f-39ca-4c05-9c95-8a68fa931c3e tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:02.740201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e843d5f-39ca-4c05-9c95-8a68fa931c3e tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:02.741942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e843d5f-39ca-4c05-9c95-8a68fa931c3e tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:02.743254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e843d5f-39ca-4c05-9c95-8a68fa931c3e tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:02.744381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e843d5f-39ca-4c05-9c95-8a68fa931c3e tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:02.749557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e843d5f-39ca-4c05-9c95-8a68fa931c3e tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:02.751793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e843d5f-39ca-4c05-9c95-8a68fa931c3e tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:03.075405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9f806417-f00a-45bc-9fc9-6b4af2e26516 req-d2a2c37c-b30c-4c03-b490-957f9c0bd911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81", "tag": "d3917aae-e850-4b70-a2b1-89144d1d1fa7"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:03.096765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9f806417-f00a-45bc-9fc9-6b4af2e26516 req-d2a2c37c-b30c-4c03-b490-957f9c0bd911 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:03.102165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9f806417-f00a-45bc-9fc9-6b4af2e26516 req-d2a2c37c-b30c-4c03-b490-957f9c0bd911 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:03.102747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9f806417-f00a-45bc-9fc9-6b4af2e26516 req-d2a2c37c-b30c-4c03-b490-957f9c0bd911 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:03.139897 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9f806417-f00a-45bc-9fc9-6b4af2e26516 req-d2a2c37c-b30c-4c03-b490-957f9c0bd911 service nova] Creating event network-changed:d3917aae-e850-4b70-a2b1-89144d1d1fa7 for instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 on nch1-master-1 Sep 06 11:01:03.148389 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9f806417-f00a-45bc-9fc9-6b4af2e26516 req-d2a2c37c-b30c-4c03-b490-957f9c0bd911 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078269 Sep 06 11:01:03.149619 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1162/2350] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:01:03.222593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0111d872-4676-4aec-9f9f-f3a8e747945f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:03.224124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0111d872-4676-4aec-9f9f-f3a8e747945f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:03.236308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0111d872-4676-4aec-9f9f-f3a8e747945f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:03.239815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0111d872-4676-4aec-9f9f-f3a8e747945f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:03.239815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0111d872-4676-4aec-9f9f-f3a8e747945f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:03.239815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0111d872-4676-4aec-9f9f-f3a8e747945f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:03.239815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0111d872-4676-4aec-9f9f-f3a8e747945f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:03.241174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0111d872-4676-4aec-9f9f-f3a8e747945f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:03.612890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0e843d5f-39ca-4c05-9c95-8a68fa931c3e tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:03.647423 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0e843d5f-39ca-4c05-9c95-8a68fa931c3e tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.929459 Sep 06 11:01:03.648411 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1189/2351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:02 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:03.662048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-79ee029d-a618-4515-9761-3cec9ae1715f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:03.665420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-79ee029d-a618-4515-9761-3cec9ae1715f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:03.673984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ee029d-a618-4515-9761-3cec9ae1715f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:03.675219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ee029d-a618-4515-9761-3cec9ae1715f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:03.675870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ee029d-a618-4515-9761-3cec9ae1715f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:03.677522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ee029d-a618-4515-9761-3cec9ae1715f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:03.678148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ee029d-a618-4515-9761-3cec9ae1715f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:03.679635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ee029d-a618-4515-9761-3cec9ae1715f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:03.774481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0111d872-4676-4aec-9f9f-f3a8e747945f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:03.783977 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0111d872-4676-4aec-9f9f-f3a8e747945f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1276 microversion: 2.1 time: 0.571398 Sep 06 11:01:03.796161 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1163/2352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:03 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1276 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:03.806505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-45306523-d8db-46c6-ba9e-65edd6d3d215 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:03.815253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-45306523-d8db-46c6-ba9e-65edd6d3d215 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:03.815253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45306523-d8db-46c6-ba9e-65edd6d3d215 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:03.815253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45306523-d8db-46c6-ba9e-65edd6d3d215 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:03.816126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45306523-d8db-46c6-ba9e-65edd6d3d215 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:03.816917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45306523-d8db-46c6-ba9e-65edd6d3d215 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:03.817521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45306523-d8db-46c6-ba9e-65edd6d3d215 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:03.818028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45306523-d8db-46c6-ba9e-65edd6d3d215 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:03.872226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-79ee029d-a618-4515-9761-3cec9ae1715f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:03.884844 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-79ee029d-a618-4515-9761-3cec9ae1715f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1282 microversion: 2.1 time: 0.232285 Sep 06 11:01:03.886388 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1190/2353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:03 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1282 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:04.378693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-45306523-d8db-46c6-ba9e-65edd6d3d215 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:04.400028 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-45306523-d8db-46c6-ba9e-65edd6d3d215 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1315 microversion: 2.1 time: 0.602487 Sep 06 11:01:04.419559 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1164/2354] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:03 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:04.682783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c9ea8edb-9ea7-4d07-84ed-aa735676b065 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:04.683575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c9ea8edb-9ea7-4d07-84ed-aa735676b065 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:04.700992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9ea8edb-9ea7-4d07-84ed-aa735676b065 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:04.701791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9ea8edb-9ea7-4d07-84ed-aa735676b065 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:04.702436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9ea8edb-9ea7-4d07-84ed-aa735676b065 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:04.703374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9ea8edb-9ea7-4d07-84ed-aa735676b065 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:04.704001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9ea8edb-9ea7-4d07-84ed-aa735676b065 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:04.704599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9ea8edb-9ea7-4d07-84ed-aa735676b065 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:04.817812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7085195a-2d78-4df8-a656-b3eb0ce27850 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:04.817812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7085195a-2d78-4df8-a656-b3eb0ce27850 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:04.840568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7085195a-2d78-4df8-a656-b3eb0ce27850 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:04.841894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7085195a-2d78-4df8-a656-b3eb0ce27850 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:04.842615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7085195a-2d78-4df8-a656-b3eb0ce27850 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:04.844063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7085195a-2d78-4df8-a656-b3eb0ce27850 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:04.847089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7085195a-2d78-4df8-a656-b3eb0ce27850 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:04.847883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7085195a-2d78-4df8-a656-b3eb0ce27850 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:05.407583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c9ea8edb-9ea7-4d07-84ed-aa735676b065 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:05.418169 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c9ea8edb-9ea7-4d07-84ed-aa735676b065 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.741412 Sep 06 11:01:05.432435 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1191/2355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:04 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:05.441958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9ba7e606-d229-4ea2-9405-e956387b0424 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:05.442852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9ba7e606-d229-4ea2-9405-e956387b0424 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:05.451696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ba7e606-d229-4ea2-9405-e956387b0424 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:05.452318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ba7e606-d229-4ea2-9405-e956387b0424 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:05.453091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ba7e606-d229-4ea2-9405-e956387b0424 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:05.453929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ba7e606-d229-4ea2-9405-e956387b0424 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:05.454533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ba7e606-d229-4ea2-9405-e956387b0424 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:05.455080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ba7e606-d229-4ea2-9405-e956387b0424 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:05.472398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7085195a-2d78-4df8-a656-b3eb0ce27850 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:05.484285 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7085195a-2d78-4df8-a656-b3eb0ce27850 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.676834 Sep 06 11:01:05.485270 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1165/2356] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:04 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:05.504405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a3c1f7fc-b9de-4a68-8c2f-beaef09167b9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:05.504405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a3c1f7fc-b9de-4a68-8c2f-beaef09167b9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:05.508117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3c1f7fc-b9de-4a68-8c2f-beaef09167b9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:05.508609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3c1f7fc-b9de-4a68-8c2f-beaef09167b9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:05.509049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3c1f7fc-b9de-4a68-8c2f-beaef09167b9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:05.509758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3c1f7fc-b9de-4a68-8c2f-beaef09167b9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:05.515735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3c1f7fc-b9de-4a68-8c2f-beaef09167b9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:05.516576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3c1f7fc-b9de-4a68-8c2f-beaef09167b9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:05.777919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9ba7e606-d229-4ea2-9405-e956387b0424 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:05.788643 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9ba7e606-d229-4ea2-9405-e956387b0424 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1270 microversion: 2.1 time: 0.354614 Sep 06 11:01:05.789585 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1192/2357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:05 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1270 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:05.796429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-5c8b4665-c09b-4733-a875-7bbc045d0aef req-76d6d29e-2f96-45a0-b6d7-cc39b235213d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98250008-de3d-4d5c-8b09-152eadba1601", "name": "network-vif-plugged", "status": "completed", "tag": "f3e0bff0-ed11-4125-8356-50bdbb50710e"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:05.821966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5c8b4665-c09b-4733-a875-7bbc045d0aef req-76d6d29e-2f96-45a0-b6d7-cc39b235213d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:05.825228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5c8b4665-c09b-4733-a875-7bbc045d0aef req-76d6d29e-2f96-45a0-b6d7-cc39b235213d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:05.825789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5c8b4665-c09b-4733-a875-7bbc045d0aef req-76d6d29e-2f96-45a0-b6d7-cc39b235213d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:05.842436 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-5c8b4665-c09b-4733-a875-7bbc045d0aef req-76d6d29e-2f96-45a0-b6d7-cc39b235213d service nova] Creating event network-vif-plugged:f3e0bff0-ed11-4125-8356-50bdbb50710e for instance 98250008-de3d-4d5c-8b09-152eadba1601 on nch1-master-1 Sep 06 11:01:05.849753 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-5c8b4665-c09b-4733-a875-7bbc045d0aef req-76d6d29e-2f96-45a0-b6d7-cc39b235213d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058533 Sep 06 11:01:05.851572 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1193/2358] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:06.005167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:06.219832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a3c1f7fc-b9de-4a68-8c2f-beaef09167b9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:06.230703 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a3c1f7fc-b9de-4a68-8c2f-beaef09167b9 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1315 microversion: 2.1 time: 0.744201 Sep 06 11:01:06.231778 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1166/2359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:05 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:06.445896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-debd0af4-54b5-4c4e-beaf-ce3ac0e23f3a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:06.447362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-debd0af4-54b5-4c4e-beaf-ce3ac0e23f3a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:06.454969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-debd0af4-54b5-4c4e-beaf-ce3ac0e23f3a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:06.455862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-debd0af4-54b5-4c4e-beaf-ce3ac0e23f3a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:06.456552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-debd0af4-54b5-4c4e-beaf-ce3ac0e23f3a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:06.457506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-debd0af4-54b5-4c4e-beaf-ce3ac0e23f3a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:06.458193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-debd0af4-54b5-4c4e-beaf-ce3ac0e23f3a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:06.458861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-debd0af4-54b5-4c4e-beaf-ce3ac0e23f3a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:06.515234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8ac08100-91f2-4ce8-9d6b-2289c491ad40 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:06.516130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8ac08100-91f2-4ce8-9d6b-2289c491ad40 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:06.536674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ac08100-91f2-4ce8-9d6b-2289c491ad40 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:06.537322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ac08100-91f2-4ce8-9d6b-2289c491ad40 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:06.537953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ac08100-91f2-4ce8-9d6b-2289c491ad40 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:06.538871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ac08100-91f2-4ce8-9d6b-2289c491ad40 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:06.546223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ac08100-91f2-4ce8-9d6b-2289c491ad40 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:06.547114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ac08100-91f2-4ce8-9d6b-2289c491ad40 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:07.280439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-debd0af4-54b5-4c4e-beaf-ce3ac0e23f3a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:07.288603 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-debd0af4-54b5-4c4e-beaf-ce3ac0e23f3a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.847091 Sep 06 11:01:07.289763 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1194/2360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:06 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:07.295269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c7d12925-c7a1-44e8-91c9-587f113a1ae0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:07.303042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c7d12925-c7a1-44e8-91c9-587f113a1ae0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:07.315994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7d12925-c7a1-44e8-91c9-587f113a1ae0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:07.316728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7d12925-c7a1-44e8-91c9-587f113a1ae0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:07.317339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7d12925-c7a1-44e8-91c9-587f113a1ae0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:07.321214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7d12925-c7a1-44e8-91c9-587f113a1ae0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:07.321890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7d12925-c7a1-44e8-91c9-587f113a1ae0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:07.322700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7d12925-c7a1-44e8-91c9-587f113a1ae0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:07.371640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8ac08100-91f2-4ce8-9d6b-2289c491ad40 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:07.387064 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8ac08100-91f2-4ce8-9d6b-2289c491ad40 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.877299 Sep 06 11:01:07.388143 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1167/2361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:06 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:07.394156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-65db4743-53c6-4f4f-8b6f-bbd2f35dec3b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:07.395257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-65db4743-53c6-4f4f-8b6f-bbd2f35dec3b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:07.409578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65db4743-53c6-4f4f-8b6f-bbd2f35dec3b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:07.411394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65db4743-53c6-4f4f-8b6f-bbd2f35dec3b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:07.426397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65db4743-53c6-4f4f-8b6f-bbd2f35dec3b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:07.429479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65db4743-53c6-4f4f-8b6f-bbd2f35dec3b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:07.431151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65db4743-53c6-4f4f-8b6f-bbd2f35dec3b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:07.433744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65db4743-53c6-4f4f-8b6f-bbd2f35dec3b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:07.435779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c7d12925-c7a1-44e8-91c9-587f113a1ae0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:07.448191 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c7d12925-c7a1-44e8-91c9-587f113a1ae0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1270 microversion: 2.1 time: 0.156824 Sep 06 11:01:07.451059 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1195/2362] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:07 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:07.525064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-8e24671e-ea89-4c1d-bc17-3c5da73d755d req-f6e777a1-a65e-44bb-8be3-998ec5f003d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81", "tag": "87158f46-00b8-4a2f-8c07-c467157d9ae5"}, {"name": "network-changed", "server_uuid": "a3173985-c4ff-4e48-887a-baf5a5da0a9b", "tag": "e0d3bb72-f8aa-40dd-b454-b77384449641"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:07.547338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8e24671e-ea89-4c1d-bc17-3c5da73d755d req-f6e777a1-a65e-44bb-8be3-998ec5f003d8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:07.548145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8e24671e-ea89-4c1d-bc17-3c5da73d755d req-f6e777a1-a65e-44bb-8be3-998ec5f003d8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:07.549455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8e24671e-ea89-4c1d-bc17-3c5da73d755d req-f6e777a1-a65e-44bb-8be3-998ec5f003d8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:07.566100 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-8e24671e-ea89-4c1d-bc17-3c5da73d755d req-f6e777a1-a65e-44bb-8be3-998ec5f003d8 service nova] Creating event network-changed:87158f46-00b8-4a2f-8c07-c467157d9ae5 for instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 on nch1-master-1 Sep 06 11:01:07.567242 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-8e24671e-ea89-4c1d-bc17-3c5da73d755d req-f6e777a1-a65e-44bb-8be3-998ec5f003d8 service nova] Creating event network-changed:e0d3bb72-f8aa-40dd-b454-b77384449641 for instance a3173985-c4ff-4e48-887a-baf5a5da0a9b on nch2-master-1 Sep 06 11:01:07.589443 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-8e24671e-ea89-4c1d-bc17-3c5da73d755d req-f6e777a1-a65e-44bb-8be3-998ec5f003d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075768 Sep 06 11:01:07.593322 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1196/2363] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:08.068021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-65db4743-53c6-4f4f-8b6f-bbd2f35dec3b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:08.080060 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-65db4743-53c6-4f4f-8b6f-bbd2f35dec3b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1315 microversion: 2.1 time: 0.690372 Sep 06 11:01:08.084153 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1168/2364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:07 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:08.314976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3999762b-58ab-4bfd-a9d6-83213d291d92 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:08.315749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3999762b-58ab-4bfd-a9d6-83213d291d92 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:08.333768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3999762b-58ab-4bfd-a9d6-83213d291d92 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:08.333768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3999762b-58ab-4bfd-a9d6-83213d291d92 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:08.333768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3999762b-58ab-4bfd-a9d6-83213d291d92 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:08.333768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3999762b-58ab-4bfd-a9d6-83213d291d92 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:08.333768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3999762b-58ab-4bfd-a9d6-83213d291d92 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:08.333768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3999762b-58ab-4bfd-a9d6-83213d291d92 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:08.424298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d7410be1-a76c-4d69-a351-1152abd0e69d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:08.425917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d7410be1-a76c-4d69-a351-1152abd0e69d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:08.457037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7410be1-a76c-4d69-a351-1152abd0e69d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:08.462385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7410be1-a76c-4d69-a351-1152abd0e69d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:08.463028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7410be1-a76c-4d69-a351-1152abd0e69d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:08.464576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7410be1-a76c-4d69-a351-1152abd0e69d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:08.465170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7410be1-a76c-4d69-a351-1152abd0e69d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:08.468217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7410be1-a76c-4d69-a351-1152abd0e69d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:08.513216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:09.061827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d7410be1-a76c-4d69-a351-1152abd0e69d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:09.070832 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d7410be1-a76c-4d69-a351-1152abd0e69d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.661042 Sep 06 11:01:09.087665 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1169/2365] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:08 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:09.093539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d55988c1-3cad-455e-8a9a-a23c71a88bcb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:09.094457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d55988c1-3cad-455e-8a9a-a23c71a88bcb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:09.109992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d55988c1-3cad-455e-8a9a-a23c71a88bcb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:09.117525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d55988c1-3cad-455e-8a9a-a23c71a88bcb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:09.117525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d55988c1-3cad-455e-8a9a-a23c71a88bcb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:09.117525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d55988c1-3cad-455e-8a9a-a23c71a88bcb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:09.117525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d55988c1-3cad-455e-8a9a-a23c71a88bcb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:09.117525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d55988c1-3cad-455e-8a9a-a23c71a88bcb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:09.247895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3999762b-58ab-4bfd-a9d6-83213d291d92 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:09.262020 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3999762b-58ab-4bfd-a9d6-83213d291d92 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.951066 Sep 06 11:01:09.285366 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1197/2366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:08 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:09.294931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3472f609-a519-4e2c-831d-8e5dc4963efe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:09.295807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3472f609-a519-4e2c-831d-8e5dc4963efe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:09.305045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472f609-a519-4e2c-831d-8e5dc4963efe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:09.305829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472f609-a519-4e2c-831d-8e5dc4963efe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:09.307877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472f609-a519-4e2c-831d-8e5dc4963efe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:09.312303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472f609-a519-4e2c-831d-8e5dc4963efe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:09.312303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472f609-a519-4e2c-831d-8e5dc4963efe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:09.319237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472f609-a519-4e2c-831d-8e5dc4963efe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:10.101284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d55988c1-3cad-455e-8a9a-a23c71a88bcb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:10.113761 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d55988c1-3cad-455e-8a9a-a23c71a88bcb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1312 microversion: 2.1 time: 1.024493 Sep 06 11:01:10.115114 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1170/2367] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:09 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1312 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:10.123796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ad69f8b4-bdaa-4719-8dcc-bfed67c610cb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:10.124841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ad69f8b4-bdaa-4719-8dcc-bfed67c610cb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:10.137643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad69f8b4-bdaa-4719-8dcc-bfed67c610cb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:10.138173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad69f8b4-bdaa-4719-8dcc-bfed67c610cb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:10.138616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad69f8b4-bdaa-4719-8dcc-bfed67c610cb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:10.139704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad69f8b4-bdaa-4719-8dcc-bfed67c610cb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:10.140339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad69f8b4-bdaa-4719-8dcc-bfed67c610cb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:10.140776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad69f8b4-bdaa-4719-8dcc-bfed67c610cb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:10.237022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3472f609-a519-4e2c-831d-8e5dc4963efe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:10.245909 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3472f609-a519-4e2c-831d-8e5dc4963efe tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1502 microversion: 2.1 time: 0.958705 Sep 06 11:01:10.247080 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1198/2368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:09 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1502 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:10.252108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-72e7c83d-a65a-42c7-ab55-adb216358dc8 req-39630c2d-4c98-462a-9043-55bcc2f8989d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81", "tag": "0a3bdacc-8012-4dfe-a06a-cff2d912b42a"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:10.261691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:10.263995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-72e7c83d-a65a-42c7-ab55-adb216358dc8 req-39630c2d-4c98-462a-9043-55bcc2f8989d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:10.264619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-72e7c83d-a65a-42c7-ab55-adb216358dc8 req-39630c2d-4c98-462a-9043-55bcc2f8989d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:10.265187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-72e7c83d-a65a-42c7-ab55-adb216358dc8 req-39630c2d-4c98-462a-9043-55bcc2f8989d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:10.280964 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-72e7c83d-a65a-42c7-ab55-adb216358dc8 req-39630c2d-4c98-462a-9043-55bcc2f8989d service nova] Creating event network-changed:0a3bdacc-8012-4dfe-a06a-cff2d912b42a for instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 on nch1-master-1 Sep 06 11:01:10.295933 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-72e7c83d-a65a-42c7-ab55-adb216358dc8 req-39630c2d-4c98-462a-9043-55bcc2f8989d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047385 Sep 06 11:01:10.300572 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1199/2369] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:10.304458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e8e9801f-7a9b-493f-b7b0-039447d47057 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:10.309029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=16 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:10.313961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8e9801f-7a9b-493f-b7b0-039447d47057 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:10.314686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8e9801f-7a9b-493f-b7b0-039447d47057 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:10.315335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8e9801f-7a9b-493f-b7b0-039447d47057 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:10.387461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e8e9801f-7a9b-493f-b7b0-039447d47057 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Going to try to stop instance {{(pid=140876) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 11:01:10.581100 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e8e9801f-7a9b-493f-b7b0-039447d47057 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "POST /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601/action" status: 202 len: 0 microversion: 2.1 time: 0.282748 Sep 06 11:01:10.581963 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1200/2370] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:01:10 2022] POST /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:01:10.589787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-df4f6db7-311e-4ff2-857b-b6ca43f7e985 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:10.590973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-df4f6db7-311e-4ff2-857b-b6ca43f7e985 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:10.605942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df4f6db7-311e-4ff2-857b-b6ca43f7e985 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:10.609188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df4f6db7-311e-4ff2-857b-b6ca43f7e985 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:10.609925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df4f6db7-311e-4ff2-857b-b6ca43f7e985 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:10.611832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df4f6db7-311e-4ff2-857b-b6ca43f7e985 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:10.612985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df4f6db7-311e-4ff2-857b-b6ca43f7e985 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:10.613691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df4f6db7-311e-4ff2-857b-b6ca43f7e985 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:10.787216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ad69f8b4-bdaa-4719-8dcc-bfed67c610cb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:10.805729 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ad69f8b4-bdaa-4719-8dcc-bfed67c610cb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.688408 Sep 06 11:01:10.808066 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1171/2371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:10 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:10.834217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f9c84165-40db-40d3-9138-2dbe3f8e1d73 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:10.835572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f9c84165-40db-40d3-9138-2dbe3f8e1d73 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:10.849938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9c84165-40db-40d3-9138-2dbe3f8e1d73 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:10.854991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9c84165-40db-40d3-9138-2dbe3f8e1d73 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:10.855516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9c84165-40db-40d3-9138-2dbe3f8e1d73 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:10.856285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9c84165-40db-40d3-9138-2dbe3f8e1d73 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:10.858994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9c84165-40db-40d3-9138-2dbe3f8e1d73 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:10.859530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9c84165-40db-40d3-9138-2dbe3f8e1d73 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:11.236995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=44 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:11.412529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-df4f6db7-311e-4ff2-857b-b6ca43f7e985 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:11.422379 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-df4f6db7-311e-4ff2-857b-b6ca43f7e985 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.838806 Sep 06 11:01:11.428232 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1201/2372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:10 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:11.434702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fa3f92d9-850a-4ce3-b354-311f924f5316 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:11.435642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fa3f92d9-850a-4ce3-b354-311f924f5316 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:11.442396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa3f92d9-850a-4ce3-b354-311f924f5316 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:11.442891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa3f92d9-850a-4ce3-b354-311f924f5316 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:11.443615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa3f92d9-850a-4ce3-b354-311f924f5316 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:11.444516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa3f92d9-850a-4ce3-b354-311f924f5316 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:11.444978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa3f92d9-850a-4ce3-b354-311f924f5316 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:11.445572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa3f92d9-850a-4ce3-b354-311f924f5316 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:11.471850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f9c84165-40db-40d3-9138-2dbe3f8e1d73 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:11.486862 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f9c84165-40db-40d3-9138-2dbe3f8e1d73 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.676730 Sep 06 11:01:11.492932 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1172/2373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:10 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:11.507602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d0d11fb7-a53c-40c7-a4d8-02d2d6684744 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:11.508273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d0d11fb7-a53c-40c7-a4d8-02d2d6684744 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:11.518535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0d11fb7-a53c-40c7-a4d8-02d2d6684744 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:11.519463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0d11fb7-a53c-40c7-a4d8-02d2d6684744 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:11.520284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0d11fb7-a53c-40c7-a4d8-02d2d6684744 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:11.521265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0d11fb7-a53c-40c7-a4d8-02d2d6684744 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:11.521977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0d11fb7-a53c-40c7-a4d8-02d2d6684744 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:11.522634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0d11fb7-a53c-40c7-a4d8-02d2d6684744 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:11.793541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d0d11fb7-a53c-40c7-a4d8-02d2d6684744 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:11.799610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fa3f92d9-850a-4ce3-b354-311f924f5316 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:11.808348 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fa3f92d9-850a-4ce3-b354-311f924f5316 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.377929 Sep 06 11:01:11.810102 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1202/2374] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:11 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:11.817485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-0f2f79ea-1503-4e1a-bc75-3b2fec388b3e req-07c9cf52-64e1-412a-881c-0d9d2d3b1817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccb6a214-824a-420b-8d7b-710ec9f8c9e4", "tag": "6e6a9c93-a942-41c8-95ff-9810c16226ef"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:11.825480 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d0d11fb7-a53c-40c7-a4d8-02d2d6684744 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1312 microversion: 2.1 time: 0.330349 Sep 06 11:01:11.839454 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1173/2375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:11 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1312 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:11.841326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0f2f79ea-1503-4e1a-bc75-3b2fec388b3e req-07c9cf52-64e1-412a-881c-0d9d2d3b1817 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:11.841829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0f2f79ea-1503-4e1a-bc75-3b2fec388b3e req-07c9cf52-64e1-412a-881c-0d9d2d3b1817 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:11.842283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0f2f79ea-1503-4e1a-bc75-3b2fec388b3e req-07c9cf52-64e1-412a-881c-0d9d2d3b1817 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:11.847932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60bae588-5c28-42b1-a77e-51367b3650c2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:11.848660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-60bae588-5c28-42b1-a77e-51367b3650c2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:11.860140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60bae588-5c28-42b1-a77e-51367b3650c2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:11.860407 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-0f2f79ea-1503-4e1a-bc75-3b2fec388b3e req-07c9cf52-64e1-412a-881c-0d9d2d3b1817 service nova] Creating event network-changed:6e6a9c93-a942-41c8-95ff-9810c16226ef for instance ccb6a214-824a-420b-8d7b-710ec9f8c9e4 on nch2-master-1 Sep 06 11:01:11.860510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60bae588-5c28-42b1-a77e-51367b3650c2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:11.860510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60bae588-5c28-42b1-a77e-51367b3650c2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:11.860510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60bae588-5c28-42b1-a77e-51367b3650c2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:11.860510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60bae588-5c28-42b1-a77e-51367b3650c2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:11.860510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60bae588-5c28-42b1-a77e-51367b3650c2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:11.861386 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-0f2f79ea-1503-4e1a-bc75-3b2fec388b3e req-07c9cf52-64e1-412a-881c-0d9d2d3b1817 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047565 Sep 06 11:01:11.862314 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1203/2376] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:11.868995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c20be6e6-5205-42c4-8804-6a9c4ff8d54f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:11.869945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c20be6e6-5205-42c4-8804-6a9c4ff8d54f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:11.879857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c20be6e6-5205-42c4-8804-6a9c4ff8d54f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:11.880361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c20be6e6-5205-42c4-8804-6a9c4ff8d54f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:11.880922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c20be6e6-5205-42c4-8804-6a9c4ff8d54f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:11.885043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c20be6e6-5205-42c4-8804-6a9c4ff8d54f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:11.885043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c20be6e6-5205-42c4-8804-6a9c4ff8d54f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:11.885043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c20be6e6-5205-42c4-8804-6a9c4ff8d54f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:12.204762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-60bae588-5c28-42b1-a77e-51367b3650c2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:12.218207 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-60bae588-5c28-42b1-a77e-51367b3650c2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.377388 Sep 06 11:01:12.219003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c20be6e6-5205-42c4-8804-6a9c4ff8d54f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:12.220095 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1174/2377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:11 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:12.237576 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c20be6e6-5205-42c4-8804-6a9c4ff8d54f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.373557 Sep 06 11:01:12.254013 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1204/2378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:11 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:12.276110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fda8e987-03cf-4f89-b950-c21f9a912a8c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:12.276727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fda8e987-03cf-4f89-b950-c21f9a912a8c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:12.284212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fda8e987-03cf-4f89-b950-c21f9a912a8c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:12.285982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fda8e987-03cf-4f89-b950-c21f9a912a8c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:12.285982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fda8e987-03cf-4f89-b950-c21f9a912a8c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:12.286703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fda8e987-03cf-4f89-b950-c21f9a912a8c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:12.287486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fda8e987-03cf-4f89-b950-c21f9a912a8c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:12.288715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fda8e987-03cf-4f89-b950-c21f9a912a8c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:12.446645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c95bd98d-c2b8-472c-953c-f836ea44c8da tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:12.448169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c95bd98d-c2b8-472c-953c-f836ea44c8da tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:12.458542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c95bd98d-c2b8-472c-953c-f836ea44c8da tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:12.459790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c95bd98d-c2b8-472c-953c-f836ea44c8da tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:12.461832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c95bd98d-c2b8-472c-953c-f836ea44c8da tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:12.462829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c95bd98d-c2b8-472c-953c-f836ea44c8da tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:12.463368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c95bd98d-c2b8-472c-953c-f836ea44c8da tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:12.463804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c95bd98d-c2b8-472c-953c-f836ea44c8da tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:12.691721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fda8e987-03cf-4f89-b950-c21f9a912a8c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:12.700613 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fda8e987-03cf-4f89-b950-c21f9a912a8c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.428763 Sep 06 11:01:12.703243 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1175/2379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:12 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:12.718913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ae20065b-e350-4643-8357-c8f28a5d6e63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:12.719898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ae20065b-e350-4643-8357-c8f28a5d6e63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:12.740244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:12.742867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae20065b-e350-4643-8357-c8f28a5d6e63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:12.743654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae20065b-e350-4643-8357-c8f28a5d6e63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:12.744106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae20065b-e350-4643-8357-c8f28a5d6e63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:12.744912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae20065b-e350-4643-8357-c8f28a5d6e63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:12.745381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae20065b-e350-4643-8357-c8f28a5d6e63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:12.745813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae20065b-e350-4643-8357-c8f28a5d6e63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:12.915231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c95bd98d-c2b8-472c-953c-f836ea44c8da tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:12.932722 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c95bd98d-c2b8-472c-953c-f836ea44c8da tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.489201 Sep 06 11:01:12.932722 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1205/2380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:12 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:12.944865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-797a1f97-a406-4f5f-9211-e6d449390026 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1443937749"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:12.947363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-797a1f97-a406-4f5f-9211-e6d449390026 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:12.967528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-797a1f97-a406-4f5f-9211-e6d449390026 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:12.968121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-797a1f97-a406-4f5f-9211-e6d449390026 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:12.968572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-797a1f97-a406-4f5f-9211-e6d449390026 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:12.969419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-797a1f97-a406-4f5f-9211-e6d449390026 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:12.970258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-797a1f97-a406-4f5f-9211-e6d449390026 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:12.971459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-797a1f97-a406-4f5f-9211-e6d449390026 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:12.991806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:13.233570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ae20065b-e350-4643-8357-c8f28a5d6e63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:13.247477 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ae20065b-e350-4643-8357-c8f28a5d6e63 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.540353 Sep 06 11:01:13.248670 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1176/2381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:12 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:13.256517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9fb3546d-62c8-4e68-9de1-d7a17e1321dc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:13.257983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9fb3546d-62c8-4e68-9de1-d7a17e1321dc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:13.269372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fb3546d-62c8-4e68-9de1-d7a17e1321dc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:13.272311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fb3546d-62c8-4e68-9de1-d7a17e1321dc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:13.272985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fb3546d-62c8-4e68-9de1-d7a17e1321dc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:13.273951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fb3546d-62c8-4e68-9de1-d7a17e1321dc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:13.275075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fb3546d-62c8-4e68-9de1-d7a17e1321dc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:13.276438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fb3546d-62c8-4e68-9de1-d7a17e1321dc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:13.490806 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-797a1f97-a406-4f5f-9211-e6d449390026 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.557381 Sep 06 11:01:13.493066 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1206/2382] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:01:12 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 06 11:01:13.502103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9fb3546d-62c8-4e68-9de1-d7a17e1321dc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:13.515405 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9fb3546d-62c8-4e68-9de1-d7a17e1321dc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1312 microversion: 2.1 time: 0.264299 Sep 06 11:01:13.518640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6394fb88-bfff-4538-9339-dac836ed5cad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:13.523079 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1177/2383] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:13 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:13.524528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6394fb88-bfff-4538-9339-dac836ed5cad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:13.542053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6394fb88-bfff-4538-9339-dac836ed5cad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:13.542741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6394fb88-bfff-4538-9339-dac836ed5cad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:13.543377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6394fb88-bfff-4538-9339-dac836ed5cad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:13.544556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6394fb88-bfff-4538-9339-dac836ed5cad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:13.545218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6394fb88-bfff-4538-9339-dac836ed5cad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:13.545817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6394fb88-bfff-4538-9339-dac836ed5cad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:13.769683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6394fb88-bfff-4538-9339-dac836ed5cad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:13.785297 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6394fb88-bfff-4538-9339-dac836ed5cad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.290758 Sep 06 11:01:13.790974 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1207/2384] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:13 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:13.852356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1cb21297-767d-4837-96e0-a9ba3112c691 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Action: 'create', calling method: .version_select at 0x7f90f3766b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1241833223", "description": "tempest-description-703657817"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:13.881582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-1140d910-248d-4908-88e5-8cfbd67adb75 req-5067db8e-6e70-4e4b-b38d-4376cd5018bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc46dc01-cd54-44a1-a379-0b0f8ff43991", "tag": "17d26200-b9e0-4b27-90ee-4779abc2a65e"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:13.894736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1140d910-248d-4908-88e5-8cfbd67adb75 req-5067db8e-6e70-4e4b-b38d-4376cd5018bf service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:13.901436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1140d910-248d-4908-88e5-8cfbd67adb75 req-5067db8e-6e70-4e4b-b38d-4376cd5018bf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:13.901436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1140d910-248d-4908-88e5-8cfbd67adb75 req-5067db8e-6e70-4e4b-b38d-4376cd5018bf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:13.911487 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-1140d910-248d-4908-88e5-8cfbd67adb75 req-5067db8e-6e70-4e4b-b38d-4376cd5018bf service nova] Creating event network-changed:17d26200-b9e0-4b27-90ee-4779abc2a65e for instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 on nch1-master-1 Sep 06 11:01:13.917812 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-1140d910-248d-4908-88e5-8cfbd67adb75 req-5067db8e-6e70-4e4b-b38d-4376cd5018bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040140 Sep 06 11:01:13.919135 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1208/2385] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:13.960294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f345354-1a60-4c2d-b69a-b976814bc5fa tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:13.960294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4f345354-1a60-4c2d-b69a-b976814bc5fa tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:13.970744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f345354-1a60-4c2d-b69a-b976814bc5fa tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:13.971295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f345354-1a60-4c2d-b69a-b976814bc5fa tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:13.971912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f345354-1a60-4c2d-b69a-b976814bc5fa tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:13.972846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f345354-1a60-4c2d-b69a-b976814bc5fa tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:13.974416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f345354-1a60-4c2d-b69a-b976814bc5fa tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:13.974890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f345354-1a60-4c2d-b69a-b976814bc5fa tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:14.253660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4f345354-1a60-4c2d-b69a-b976814bc5fa tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:14.267248 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4f345354-1a60-4c2d-b69a-b976814bc5fa tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.313339 Sep 06 11:01:14.281621 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1209/2386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:13 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:14.295739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e3d32e0e-0bfb-478a-8af9-2f94fa88c026 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:14.298558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e3d32e0e-0bfb-478a-8af9-2f94fa88c026 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:14.312256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3d32e0e-0bfb-478a-8af9-2f94fa88c026 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:14.315520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3d32e0e-0bfb-478a-8af9-2f94fa88c026 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:14.316791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3d32e0e-0bfb-478a-8af9-2f94fa88c026 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:14.317722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3d32e0e-0bfb-478a-8af9-2f94fa88c026 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:14.319437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3d32e0e-0bfb-478a-8af9-2f94fa88c026 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:14.320827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3d32e0e-0bfb-478a-8af9-2f94fa88c026 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:14.724178 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1cb21297-767d-4837-96e0-a9ba3112c691 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.974693 Sep 06 11:01:14.725470 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1178/2387] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 11:01:13 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:14.731413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-553d57f5-9662-401b-8494-e8e5c0e041e7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:14.733296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-553d57f5-9662-401b-8494-e8e5c0e041e7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:14.751824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-553d57f5-9662-401b-8494-e8e5c0e041e7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:14.754490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-553d57f5-9662-401b-8494-e8e5c0e041e7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:14.757368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-553d57f5-9662-401b-8494-e8e5c0e041e7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:14.759909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-553d57f5-9662-401b-8494-e8e5c0e041e7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:14.762131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-553d57f5-9662-401b-8494-e8e5c0e041e7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:14.763030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-553d57f5-9662-401b-8494-e8e5c0e041e7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:14.849552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e3d32e0e-0bfb-478a-8af9-2f94fa88c026 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:14.861318 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e3d32e0e-0bfb-478a-8af9-2f94fa88c026 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.578057 Sep 06 11:01:14.883506 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1210/2388] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:14 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:14.890597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b181156c-8872-411b-9313-c78a9991785c tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Action: 'create', calling method: .version_select at 0x7f90f39f1310>, body: {"security_group_rule": {"parent_group_id": "7d87ad0e-fd5b-4e6c-98ff-83ca4444dcc2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:15.537635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-553d57f5-9662-401b-8494-e8e5c0e041e7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:15.545968 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-553d57f5-9662-401b-8494-e8e5c0e041e7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1312 microversion: 2.1 time: 0.819319 Sep 06 11:01:15.547128 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1179/2389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:14 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1312 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:15.558745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b91f9411-99e7-427a-8181-199449d9f17c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:15.559690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b91f9411-99e7-427a-8181-199449d9f17c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:15.570958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b91f9411-99e7-427a-8181-199449d9f17c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:15.570958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b91f9411-99e7-427a-8181-199449d9f17c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:15.570958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b91f9411-99e7-427a-8181-199449d9f17c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:15.599903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b91f9411-99e7-427a-8181-199449d9f17c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:15.600446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b91f9411-99e7-427a-8181-199449d9f17c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:15.600896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b91f9411-99e7-427a-8181-199449d9f17c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:15.949950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b91f9411-99e7-427a-8181-199449d9f17c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:15.958044 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b91f9411-99e7-427a-8181-199449d9f17c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.409666 Sep 06 11:01:15.958770 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1180/2390] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:15 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:15.963504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6c753554-3b53-4767-876f-bb4b57963331 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:15.966098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6c753554-3b53-4767-876f-bb4b57963331 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:15.977155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c753554-3b53-4767-876f-bb4b57963331 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:15.983572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c753554-3b53-4767-876f-bb4b57963331 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:15.983572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c753554-3b53-4767-876f-bb4b57963331 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:15.983572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c753554-3b53-4767-876f-bb4b57963331 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:15.983572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c753554-3b53-4767-876f-bb4b57963331 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:15.983572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c753554-3b53-4767-876f-bb4b57963331 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:16.300907 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b181156c-8872-411b-9313-c78a9991785c tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.415518 Sep 06 11:01:16.302492 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1211/2391] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 11:01:14 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:16.311059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-781a678d-7191-430e-a349-1621136b77d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:16.311772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-781a678d-7191-430e-a349-1621136b77d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:16.341943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-781a678d-7191-430e-a349-1621136b77d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:16.342562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-781a678d-7191-430e-a349-1621136b77d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:16.342915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-781a678d-7191-430e-a349-1621136b77d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:16.343683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-781a678d-7191-430e-a349-1621136b77d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:16.345886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-781a678d-7191-430e-a349-1621136b77d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:16.346324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-781a678d-7191-430e-a349-1621136b77d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:16.531185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6c753554-3b53-4767-876f-bb4b57963331 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:16.542248 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6c753554-3b53-4767-876f-bb4b57963331 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.582167 Sep 06 11:01:16.555113 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1181/2392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:15 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:16.555113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f908ba32-3ce3-4953-99bd-f9148a850989 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Action: 'create', calling method: .version_select at 0x7f90fcf99700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-530969749", "description": "tempest-description-1622108235"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:16.760104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-781a678d-7191-430e-a349-1621136b77d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:16.773905 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-781a678d-7191-430e-a349-1621136b77d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.469764 Sep 06 11:01:16.779513 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1212/2393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:16 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:16.786834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-44318ef8-9602-4a96-9a22-3b992826ed0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:16.787511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-44318ef8-9602-4a96-9a22-3b992826ed0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:16.808384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44318ef8-9602-4a96-9a22-3b992826ed0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:16.809203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44318ef8-9602-4a96-9a22-3b992826ed0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:16.809695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44318ef8-9602-4a96-9a22-3b992826ed0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:16.810518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44318ef8-9602-4a96-9a22-3b992826ed0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:16.811222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44318ef8-9602-4a96-9a22-3b992826ed0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:16.811825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44318ef8-9602-4a96-9a22-3b992826ed0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:17.143205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-44318ef8-9602-4a96-9a22-3b992826ed0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:17.165905 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-44318ef8-9602-4a96-9a22-3b992826ed0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1312 microversion: 2.1 time: 0.385104 Sep 06 11:01:17.168681 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1213/2394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:16 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1312 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:17.172977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b82312bc-8f6e-4d45-9734-055162c4d2a5 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:17.174895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b82312bc-8f6e-4d45-9734-055162c4d2a5 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:17.188714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b82312bc-8f6e-4d45-9734-055162c4d2a5 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:17.189241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b82312bc-8f6e-4d45-9734-055162c4d2a5 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:17.189669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b82312bc-8f6e-4d45-9734-055162c4d2a5 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:17.192257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b82312bc-8f6e-4d45-9734-055162c4d2a5 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:17.192755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b82312bc-8f6e-4d45-9734-055162c4d2a5 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:17.193863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b82312bc-8f6e-4d45-9734-055162c4d2a5 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:17.309390 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f908ba32-3ce3-4953-99bd-f9148a850989 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.764997 Sep 06 11:01:17.310143 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1182/2395] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 11:01:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:17.325236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-80a479da-4b1f-464d-bf23-447e446c6a74 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Action: 'create', calling method: .version_select at 0x7f90fd10ee50>, body: {"security_group_rule": {"parent_group_id": "6939e113-ce1b-47bf-bd37-22197293c698", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:17.454688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b82312bc-8f6e-4d45-9734-055162c4d2a5 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:17.469378 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b82312bc-8f6e-4d45-9734-055162c4d2a5 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.301193 Sep 06 11:01:17.469981 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1214/2396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:17 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:17.565878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e1bf1eef-5c32-4f27-8a48-47ca71c93a48 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:17.566837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e1bf1eef-5c32-4f27-8a48-47ca71c93a48 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:17.573539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1bf1eef-5c32-4f27-8a48-47ca71c93a48 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:17.575104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1bf1eef-5c32-4f27-8a48-47ca71c93a48 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:17.575104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1bf1eef-5c32-4f27-8a48-47ca71c93a48 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:17.575384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1bf1eef-5c32-4f27-8a48-47ca71c93a48 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:17.575689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1bf1eef-5c32-4f27-8a48-47ca71c93a48 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:17.576128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1bf1eef-5c32-4f27-8a48-47ca71c93a48 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:17.793844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e1bf1eef-5c32-4f27-8a48-47ca71c93a48 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:17.804169 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e1bf1eef-5c32-4f27-8a48-47ca71c93a48 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.242076 Sep 06 11:01:17.809156 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1215/2397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:17 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:17.812397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-91d85901-f6cb-4c59-803b-0077dc656f41 req-126b25b8-1414-4d24-8a17-2bab7656d878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3173985-c4ff-4e48-887a-baf5a5da0a9b", "name": "network-vif-plugged", "status": "completed", "tag": "e0d3bb72-f8aa-40dd-b454-b77384449641"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:17.825825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-91d85901-f6cb-4c59-803b-0077dc656f41 req-126b25b8-1414-4d24-8a17-2bab7656d878 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:17.825825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-91d85901-f6cb-4c59-803b-0077dc656f41 req-126b25b8-1414-4d24-8a17-2bab7656d878 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:17.825825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-91d85901-f6cb-4c59-803b-0077dc656f41 req-126b25b8-1414-4d24-8a17-2bab7656d878 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:17.839249 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-91d85901-f6cb-4c59-803b-0077dc656f41 req-126b25b8-1414-4d24-8a17-2bab7656d878 service nova] Creating event network-vif-plugged:e0d3bb72-f8aa-40dd-b454-b77384449641 for instance a3173985-c4ff-4e48-887a-baf5a5da0a9b on nch2-master-1 Sep 06 11:01:17.844543 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-91d85901-f6cb-4c59-803b-0077dc656f41 req-126b25b8-1414-4d24-8a17-2bab7656d878 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037503 Sep 06 11:01:17.845880 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1216/2398] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:17.854608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b0f68b6a-55af-48fd-ad71-45f64b492302 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:17.856221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b0f68b6a-55af-48fd-ad71-45f64b492302 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:17.866594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0f68b6a-55af-48fd-ad71-45f64b492302 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:17.867238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0f68b6a-55af-48fd-ad71-45f64b492302 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:17.867752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0f68b6a-55af-48fd-ad71-45f64b492302 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:17.868545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0f68b6a-55af-48fd-ad71-45f64b492302 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:17.869662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0f68b6a-55af-48fd-ad71-45f64b492302 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:17.870191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0f68b6a-55af-48fd-ad71-45f64b492302 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:18.092296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b0f68b6a-55af-48fd-ad71-45f64b492302 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:18.101058 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b0f68b6a-55af-48fd-ad71-45f64b492302 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.253474 Sep 06 11:01:18.101642 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1217/2399] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:17 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:18.118450 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-80a479da-4b1f-464d-bf23-447e446c6a74 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.799185 Sep 06 11:01:18.119640 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1183/2400] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 11:01:17 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:01:18.136884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aa52333d-a354-4b48-b405-228eed357e0c tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Action: 'create', calling method: .version_select at 0x7f90f39a1670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1128245250", "description": "tempest-description-2050024530"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:18.189787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-71237133-9b2f-4139-ab56-b828a683c8c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:18.190403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-71237133-9b2f-4139-ab56-b828a683c8c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:18.197598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71237133-9b2f-4139-ab56-b828a683c8c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:18.198093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71237133-9b2f-4139-ab56-b828a683c8c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:18.198537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71237133-9b2f-4139-ab56-b828a683c8c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:18.199405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71237133-9b2f-4139-ab56-b828a683c8c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:18.199877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71237133-9b2f-4139-ab56-b828a683c8c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:18.200320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71237133-9b2f-4139-ab56-b828a683c8c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:18.367062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-71237133-9b2f-4139-ab56-b828a683c8c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:18.375666 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-71237133-9b2f-4139-ab56-b828a683c8c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1312 microversion: 2.1 time: 0.189824 Sep 06 11:01:18.376245 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1184/2401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:18 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1312 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:18.493498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8bc09e12-3d8a-4bd8-ad66-5dc08f861ee8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:18.494951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8bc09e12-3d8a-4bd8-ad66-5dc08f861ee8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:18.502791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bc09e12-3d8a-4bd8-ad66-5dc08f861ee8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:18.503606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bc09e12-3d8a-4bd8-ad66-5dc08f861ee8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:18.504409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bc09e12-3d8a-4bd8-ad66-5dc08f861ee8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:18.505310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bc09e12-3d8a-4bd8-ad66-5dc08f861ee8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:18.506186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bc09e12-3d8a-4bd8-ad66-5dc08f861ee8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:18.507329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bc09e12-3d8a-4bd8-ad66-5dc08f861ee8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:18.662293 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aa52333d-a354-4b48-b405-228eed357e0c tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.529212 Sep 06 11:01:18.664393 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1218/2402] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 11:01:18 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:18.677773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-586868c9-1f5d-4b32-b386-f83101761c25 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Action: 'create', calling method: .version_select at 0x7f90fd006a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1700315072", "description": "tempest-description-1800206045"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:18.679308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8bc09e12-3d8a-4bd8-ad66-5dc08f861ee8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:18.690386 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8bc09e12-3d8a-4bd8-ad66-5dc08f861ee8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.200651 Sep 06 11:01:18.703135 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1185/2403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:18 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:18.829518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4645f79d-f5ab-41ca-a1ef-955d5533b007 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:18.830275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4645f79d-f5ab-41ca-a1ef-955d5533b007 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:18.838370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4645f79d-f5ab-41ca-a1ef-955d5533b007 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:18.839188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4645f79d-f5ab-41ca-a1ef-955d5533b007 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:18.839858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4645f79d-f5ab-41ca-a1ef-955d5533b007 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:18.840784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4645f79d-f5ab-41ca-a1ef-955d5533b007 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:18.841453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4645f79d-f5ab-41ca-a1ef-955d5533b007 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:18.842091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4645f79d-f5ab-41ca-a1ef-955d5533b007 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:19.006687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4645f79d-f5ab-41ca-a1ef-955d5533b007 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:19.016764 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4645f79d-f5ab-41ca-a1ef-955d5533b007 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.192034 Sep 06 11:01:19.017586 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1186/2404] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:18 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:19.127737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aa3264d8-9b05-4a36-b6a7-533295e45b59 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:19.128995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aa3264d8-9b05-4a36-b6a7-533295e45b59 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:19.136587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa3264d8-9b05-4a36-b6a7-533295e45b59 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:19.137238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa3264d8-9b05-4a36-b6a7-533295e45b59 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:19.137884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa3264d8-9b05-4a36-b6a7-533295e45b59 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:19.138618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa3264d8-9b05-4a36-b6a7-533295e45b59 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:19.139110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa3264d8-9b05-4a36-b6a7-533295e45b59 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:19.139555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa3264d8-9b05-4a36-b6a7-533295e45b59 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:19.184763 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-586868c9-1f5d-4b32-b386-f83101761c25 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.510514 Sep 06 11:01:19.186208 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1219/2405] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 11:01:18 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:19.201517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-de15fb16-b5c8-4d9e-8336-27c3dce618be tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Action: 'create', calling method: .version_select at 0x7f90f39823a0>, body: {"security_group_rule": {"parent_group_id": "823830e8-a1e0-4926-9528-6605bc288c4e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "2f63ca5d-3bf3-4c3d-8afc-e59ff5bbaefd"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:19.359728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aa3264d8-9b05-4a36-b6a7-533295e45b59 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:19.371503 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aa3264d8-9b05-4a36-b6a7-533295e45b59 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.249019 Sep 06 11:01:19.373116 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1187/2406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:19 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:19.402653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-02d843f2-7195-4d24-94b9-e128c0b9c663 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:19.403822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-02d843f2-7195-4d24-94b9-e128c0b9c663 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:19.413714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02d843f2-7195-4d24-94b9-e128c0b9c663 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:19.415130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02d843f2-7195-4d24-94b9-e128c0b9c663 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:19.416352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02d843f2-7195-4d24-94b9-e128c0b9c663 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:19.417335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02d843f2-7195-4d24-94b9-e128c0b9c663 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:19.418660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02d843f2-7195-4d24-94b9-e128c0b9c663 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:19.419325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02d843f2-7195-4d24-94b9-e128c0b9c663 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:19.730624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-02d843f2-7195-4d24-94b9-e128c0b9c663 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:19.739702 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-02d843f2-7195-4d24-94b9-e128c0b9c663 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1312 microversion: 2.1 time: 0.343686 Sep 06 11:01:19.740681 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1188/2407] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:19 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1312 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:19.749416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a23c0c4-5308-4c26-84c0-e75a2f1c34e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:19.757523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0a23c0c4-5308-4c26-84c0-e75a2f1c34e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:19.757523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a23c0c4-5308-4c26-84c0-e75a2f1c34e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:19.758446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a23c0c4-5308-4c26-84c0-e75a2f1c34e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:19.759146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a23c0c4-5308-4c26-84c0-e75a2f1c34e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:19.760053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a23c0c4-5308-4c26-84c0-e75a2f1c34e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:19.760673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a23c0c4-5308-4c26-84c0-e75a2f1c34e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:19.761279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a23c0c4-5308-4c26-84c0-e75a2f1c34e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:19.767768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:19.944719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0a23c0c4-5308-4c26-84c0-e75a2f1c34e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:19.954840 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0a23c0c4-5308-4c26-84c0-e75a2f1c34e2 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.210772 Sep 06 11:01:19.957518 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1189/2408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:19 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:19.960366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-0f6fb3d7-61fe-4204-8b81-3c58fec7592a req-5579103f-84da-4f43-93a6-ed76488409e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc46dc01-cd54-44a1-a379-0b0f8ff43991", "name": "network-vif-plugged", "status": "completed", "tag": "17d26200-b9e0-4b27-90ee-4779abc2a65e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:19.970261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0f6fb3d7-61fe-4204-8b81-3c58fec7592a req-5579103f-84da-4f43-93a6-ed76488409e3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:19.970738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0f6fb3d7-61fe-4204-8b81-3c58fec7592a req-5579103f-84da-4f43-93a6-ed76488409e3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:19.971210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0f6fb3d7-61fe-4204-8b81-3c58fec7592a req-5579103f-84da-4f43-93a6-ed76488409e3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:19.981893 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-de15fb16-b5c8-4d9e-8336-27c3dce618be tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.787321 Sep 06 11:01:19.982651 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1220/2409] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 11:01:19 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:01:19.984925 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-0f6fb3d7-61fe-4204-8b81-3c58fec7592a req-5579103f-84da-4f43-93a6-ed76488409e3 service nova] Creating event network-vif-plugged:17d26200-b9e0-4b27-90ee-4779abc2a65e for instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 on nch1-master-1 Sep 06 11:01:19.990436 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-0f6fb3d7-61fe-4204-8b81-3c58fec7592a req-5579103f-84da-4f43-93a6-ed76488409e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033503 Sep 06 11:01:19.990882 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1190/2410] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:19.997985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c9ed96f8-1cc8-4cdf-8b77-3b569134173c tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Action: 'create', calling method: .version_select at 0x7f90f3982430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1720535202", "description": "tempest-description-1233422835"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:20.058033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ea5dbfe3-a3e5-4ff8-bd96-55664f65df3d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:20.064927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ea5dbfe3-a3e5-4ff8-bd96-55664f65df3d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:20.074414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea5dbfe3-a3e5-4ff8-bd96-55664f65df3d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:20.077149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea5dbfe3-a3e5-4ff8-bd96-55664f65df3d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:20.077149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea5dbfe3-a3e5-4ff8-bd96-55664f65df3d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:20.077149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea5dbfe3-a3e5-4ff8-bd96-55664f65df3d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:20.077149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea5dbfe3-a3e5-4ff8-bd96-55664f65df3d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:20.078751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea5dbfe3-a3e5-4ff8-bd96-55664f65df3d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:20.363728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ea5dbfe3-a3e5-4ff8-bd96-55664f65df3d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:20.378986 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ea5dbfe3-a3e5-4ff8-bd96-55664f65df3d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.330970 Sep 06 11:01:20.381074 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1191/2411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:20 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:20.399477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84bcba5b-a40d-49af-a490-ad7331a623ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:20.400110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-84bcba5b-a40d-49af-a490-ad7331a623ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:20.407158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84bcba5b-a40d-49af-a490-ad7331a623ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:20.407708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84bcba5b-a40d-49af-a490-ad7331a623ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:20.408152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84bcba5b-a40d-49af-a490-ad7331a623ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:20.408892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84bcba5b-a40d-49af-a490-ad7331a623ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:20.409357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84bcba5b-a40d-49af-a490-ad7331a623ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:20.409791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84bcba5b-a40d-49af-a490-ad7331a623ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:20.603925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-84bcba5b-a40d-49af-a490-ad7331a623ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:20.615106 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84bcba5b-a40d-49af-a490-ad7331a623ac tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.219524 Sep 06 11:01:20.618159 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1192/2412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:20 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:20.626326 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c9ed96f8-1cc8-4cdf-8b77-3b569134173c tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.633552 Sep 06 11:01:20.628490 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1221/2413] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 11:01:19 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:20.642677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e6faf3a8-ebaf-4187-aeea-37c1d89bff9a tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Action: 'create', calling method: .version_select at 0x7f90fd0b9d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1286598473", "description": "tempest-description-1479614052"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:20.765234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f7624184-99db-4b3a-8d88-1d80b6c3b7ce tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:20.766224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f7624184-99db-4b3a-8d88-1d80b6c3b7ce tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:20.773118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7624184-99db-4b3a-8d88-1d80b6c3b7ce tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:20.773808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7624184-99db-4b3a-8d88-1d80b6c3b7ce tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:20.774257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7624184-99db-4b3a-8d88-1d80b6c3b7ce tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:20.778671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7624184-99db-4b3a-8d88-1d80b6c3b7ce tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:20.780665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7624184-99db-4b3a-8d88-1d80b6c3b7ce tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:20.789911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7624184-99db-4b3a-8d88-1d80b6c3b7ce tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:21.022369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f7624184-99db-4b3a-8d88-1d80b6c3b7ce tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:21.036830 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f7624184-99db-4b3a-8d88-1d80b6c3b7ce tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1312 microversion: 2.1 time: 0.274481 Sep 06 11:01:21.039095 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1222/2414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:20 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:21.053181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-033d1e66-93d0-4d71-87b3-c74e6ecc3795 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:21.055553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-033d1e66-93d0-4d71-87b3-c74e6ecc3795 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:21.075331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-033d1e66-93d0-4d71-87b3-c74e6ecc3795 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:21.075866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-033d1e66-93d0-4d71-87b3-c74e6ecc3795 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:21.077630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-033d1e66-93d0-4d71-87b3-c74e6ecc3795 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:21.077630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-033d1e66-93d0-4d71-87b3-c74e6ecc3795 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:21.080925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-033d1e66-93d0-4d71-87b3-c74e6ecc3795 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:21.083239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-033d1e66-93d0-4d71-87b3-c74e6ecc3795 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:21.126642 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e6faf3a8-ebaf-4187-aeea-37c1d89bff9a tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.488424 Sep 06 11:01:21.128149 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1193/2415] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 11:01:20 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:01:21.143254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b1b4b01b-dbd0-4bbd-9786-949daad1cafe tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Action: 'create', calling method: .version_select at 0x7f90fcf5ee50>, body: {"security_group_rule": {"parent_group_id": "80ce1dd1-19cb-4b5d-aee8-e6a5f9fd42e7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "4757a31e-e153-4288-9644-08810542aea8"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:21.352400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-033d1e66-93d0-4d71-87b3-c74e6ecc3795 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:21.363245 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-033d1e66-93d0-4d71-87b3-c74e6ecc3795 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.322400 Sep 06 11:01:21.363841 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1223/2416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:21 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:21.406634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-163a463a-d927-496c-bd5c-97b74d7d8308 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:21.407635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-163a463a-d927-496c-bd5c-97b74d7d8308 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:21.437853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-163a463a-d927-496c-bd5c-97b74d7d8308 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:21.438974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-163a463a-d927-496c-bd5c-97b74d7d8308 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:21.439652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-163a463a-d927-496c-bd5c-97b74d7d8308 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:21.441068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-163a463a-d927-496c-bd5c-97b74d7d8308 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:21.443678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-163a463a-d927-496c-bd5c-97b74d7d8308 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:21.444366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-163a463a-d927-496c-bd5c-97b74d7d8308 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:21.749435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-163a463a-d927-496c-bd5c-97b74d7d8308 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:21.762505 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-163a463a-d927-496c-bd5c-97b74d7d8308 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.357373 Sep 06 11:01:21.765513 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1224/2417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:21 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:21.783462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d504119e-21be-4877-8a4a-f987b34400ff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:21.784089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d504119e-21be-4877-8a4a-f987b34400ff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:21.790253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d504119e-21be-4877-8a4a-f987b34400ff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:21.790745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d504119e-21be-4877-8a4a-f987b34400ff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:21.808801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d504119e-21be-4877-8a4a-f987b34400ff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:21.816063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d504119e-21be-4877-8a4a-f987b34400ff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:21.816063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d504119e-21be-4877-8a4a-f987b34400ff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:21.816063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d504119e-21be-4877-8a4a-f987b34400ff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:22.055122 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b1b4b01b-dbd0-4bbd-9786-949daad1cafe tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.917768 Sep 06 11:01:22.055743 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1194/2418] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 11:01:21 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:22.069405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-5f07445e-d139-48df-80be-5733214fb951 req-f84f5464-6835-4e5d-aec2-f43048a31045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9db1902-3f12-48b6-a27f-425e4843424b", "name": "network-vif-plugged", "status": "completed", "tag": "1fa7746e-916f-47fe-a1b6-1454c7592311"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:22.079410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d504119e-21be-4877-8a4a-f987b34400ff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:22.093060 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d504119e-21be-4877-8a4a-f987b34400ff tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.326124 Sep 06 11:01:22.094078 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1225/2419] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:21 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:22.095454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5f07445e-d139-48df-80be-5733214fb951 req-f84f5464-6835-4e5d-aec2-f43048a31045 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:22.096331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5f07445e-d139-48df-80be-5733214fb951 req-f84f5464-6835-4e5d-aec2-f43048a31045 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:22.096985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5f07445e-d139-48df-80be-5733214fb951 req-f84f5464-6835-4e5d-aec2-f43048a31045 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:22.100562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f45a1eb2-222f-4a1f-b101-715ce615d7b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:22.101633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f45a1eb2-222f-4a1f-b101-715ce615d7b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:22.111683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f45a1eb2-222f-4a1f-b101-715ce615d7b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:22.112467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f45a1eb2-222f-4a1f-b101-715ce615d7b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:22.113175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f45a1eb2-222f-4a1f-b101-715ce615d7b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:22.114416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f45a1eb2-222f-4a1f-b101-715ce615d7b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:22.115104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f45a1eb2-222f-4a1f-b101-715ce615d7b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:22.115737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f45a1eb2-222f-4a1f-b101-715ce615d7b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:22.120640 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5f07445e-d139-48df-80be-5733214fb951 req-f84f5464-6835-4e5d-aec2-f43048a31045 service nova] Creating event network-vif-plugged:1fa7746e-916f-47fe-a1b6-1454c7592311 for instance d9db1902-3f12-48b6-a27f-425e4843424b on nch2-master-1 Sep 06 11:01:22.126810 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-5f07445e-d139-48df-80be-5733214fb951 req-f84f5464-6835-4e5d-aec2-f43048a31045 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068073 Sep 06 11:01:22.127139 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1195/2420] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:22.133231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-546be626-d719-45e2-9ec1-f9c6df457896 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Calling method '.version_select at 0x7f90f8520790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:22.465731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f45a1eb2-222f-4a1f-b101-715ce615d7b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:22.478306 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f45a1eb2-222f-4a1f-b101-715ce615d7b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1461 microversion: 2.1 time: 0.381680 Sep 06 11:01:22.479214 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1226/2421] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:22 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1461 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:22.497966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-663c7e0d-f62c-4446-938d-44afdb5a24f1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:22.499944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-663c7e0d-f62c-4446-938d-44afdb5a24f1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:22.514586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-663c7e0d-f62c-4446-938d-44afdb5a24f1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:22.515141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-663c7e0d-f62c-4446-938d-44afdb5a24f1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:22.515592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-663c7e0d-f62c-4446-938d-44afdb5a24f1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:22.520452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-663c7e0d-f62c-4446-938d-44afdb5a24f1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:22.521557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-663c7e0d-f62c-4446-938d-44afdb5a24f1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:22.522384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-663c7e0d-f62c-4446-938d-44afdb5a24f1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:22.753044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-663c7e0d-f62c-4446-938d-44afdb5a24f1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:22.757783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:22.775134 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-663c7e0d-f62c-4446-938d-44afdb5a24f1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.294377 Sep 06 11:01:22.776042 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1227/2422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:22 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:22.796620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:22.802863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:22.811735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:22.813979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:22.813979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:22.813979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:22.814464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:22.815110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:22.852274 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-546be626-d719-45e2-9ec1-f9c6df457896 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/4757a31e-e153-4288-9644-08810542aea8" status: 202 len: 0 microversion: 2.1 time: 0.723594 Sep 06 11:01:22.852726 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1196/2423] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:01:22 2022] DELETE /compute/v2.1/os-security-groups/4757a31e-e153-4288-9644-08810542aea8 => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:01:22.861672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dd055cca-d4f0-48e9-9180-5ddc70010257 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:22.862698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dd055cca-d4f0-48e9-9180-5ddc70010257 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:22.870882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd055cca-d4f0-48e9-9180-5ddc70010257 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:22.871806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd055cca-d4f0-48e9-9180-5ddc70010257 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:22.872544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd055cca-d4f0-48e9-9180-5ddc70010257 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:22.873612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd055cca-d4f0-48e9-9180-5ddc70010257 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:22.874630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd055cca-d4f0-48e9-9180-5ddc70010257 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:22.875302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd055cca-d4f0-48e9-9180-5ddc70010257 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:22.980982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:22.988974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Old instance type m1.heat2, new instance type m1.heat {{(pid=140876) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:01:23.003074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:01:23.003847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:01:23.004490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:01:23.005093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:01:23.005695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:01:23.227184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dd055cca-d4f0-48e9-9180-5ddc70010257 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:23.237688 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dd055cca-d4f0-48e9-9180-5ddc70010257 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.382586 Sep 06 11:01:23.238686 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1197/2424] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:22 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:23.264575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c4e034d0-90fa-48cf-9bf7-67f96485de24 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Calling method '.version_select at 0x7f90f85318b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:23.284894 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2718c2da-4048-4799-966d-90d4732c055c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "POST /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991/action" status: 202 len: 0 microversion: 2.1 time: 0.507082 Sep 06 11:01:23.287831 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1228/2425] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:01:22 2022] POST /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:01:23.298859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-74d557b3-7e70-4ee4-a88f-2fe918683d81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:23.299561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-74d557b3-7e70-4ee4-a88f-2fe918683d81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:23.317700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74d557b3-7e70-4ee4-a88f-2fe918683d81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:23.318288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74d557b3-7e70-4ee4-a88f-2fe918683d81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:23.319423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74d557b3-7e70-4ee4-a88f-2fe918683d81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:23.320172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74d557b3-7e70-4ee4-a88f-2fe918683d81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:23.320641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74d557b3-7e70-4ee4-a88f-2fe918683d81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:23.321081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74d557b3-7e70-4ee4-a88f-2fe918683d81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:23.415340 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c4e034d0-90fa-48cf-9bf7-67f96485de24 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/80ce1dd1-19cb-4b5d-aee8-e6a5f9fd42e7" status: 200 len: 248 microversion: 2.1 time: 0.160020 Sep 06 11:01:23.428083 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1198/2426] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 11:01:23 2022] GET /compute/v2.1/os-security-groups/80ce1dd1-19cb-4b5d-aee8-e6a5f9fd42e7 => generated 248 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:23.433987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b7ed4159-42bd-4992-8dc1-ecb8b3593764 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:23.434723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b7ed4159-42bd-4992-8dc1-ecb8b3593764 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:23.444826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ed4159-42bd-4992-8dc1-ecb8b3593764 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:23.445691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ed4159-42bd-4992-8dc1-ecb8b3593764 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:23.446368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ed4159-42bd-4992-8dc1-ecb8b3593764 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:23.448306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ed4159-42bd-4992-8dc1-ecb8b3593764 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:23.449473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ed4159-42bd-4992-8dc1-ecb8b3593764 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:23.450145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ed4159-42bd-4992-8dc1-ecb8b3593764 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:23.769830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-74d557b3-7e70-4ee4-a88f-2fe918683d81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:23.782962 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-74d557b3-7e70-4ee4-a88f-2fe918683d81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.492316 Sep 06 11:01:23.783169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b7ed4159-42bd-4992-8dc1-ecb8b3593764 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:23.802948 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1229/2427] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:23 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:23.808518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b93b9ab7-e599-4be4-92ae-d4cdfaf8ebd3 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Action: 'create', calling method: .version_select at 0x7f90f89fb3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1505536226", "description": "tempest-description-1470510147"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:23.809920 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b7ed4159-42bd-4992-8dc1-ecb8b3593764 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1470 microversion: 2.1 time: 0.380538 Sep 06 11:01:23.819305 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1199/2428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:23 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1470 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:23.831583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0fbc5ca6-ed3e-4f33-b5d8-ed56308f61c1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:23.832564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0fbc5ca6-ed3e-4f33-b5d8-ed56308f61c1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:23.845773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fbc5ca6-ed3e-4f33-b5d8-ed56308f61c1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:23.846548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fbc5ca6-ed3e-4f33-b5d8-ed56308f61c1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:23.847003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fbc5ca6-ed3e-4f33-b5d8-ed56308f61c1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:23.847760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fbc5ca6-ed3e-4f33-b5d8-ed56308f61c1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:23.848228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fbc5ca6-ed3e-4f33-b5d8-ed56308f61c1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:23.848673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fbc5ca6-ed3e-4f33-b5d8-ed56308f61c1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:24.233849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0fbc5ca6-ed3e-4f33-b5d8-ed56308f61c1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:24.255636 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0fbc5ca6-ed3e-4f33-b5d8-ed56308f61c1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.431111 Sep 06 11:01:24.256591 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1200/2429] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:23 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:24.273427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-4dd4ed4b-27b0-444a-95cd-84c47ac1bf7d req-1d894a94-dd27-4500-ba18-60729c9f1e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb6a214-824a-420b-8d7b-710ec9f8c9e4", "name": "network-vif-plugged", "status": "completed", "tag": "6e6a9c93-a942-41c8-95ff-9810c16226ef"}, {"server_uuid": "9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81", "name": "network-vif-plugged", "status": "completed", "tag": "0a3bdacc-8012-4dfe-a06a-cff2d912b42a"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:24.300545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4dd4ed4b-27b0-444a-95cd-84c47ac1bf7d req-1d894a94-dd27-4500-ba18-60729c9f1e32 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:24.301488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4dd4ed4b-27b0-444a-95cd-84c47ac1bf7d req-1d894a94-dd27-4500-ba18-60729c9f1e32 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:24.302148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4dd4ed4b-27b0-444a-95cd-84c47ac1bf7d req-1d894a94-dd27-4500-ba18-60729c9f1e32 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:24.321783 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-4dd4ed4b-27b0-444a-95cd-84c47ac1bf7d req-1d894a94-dd27-4500-ba18-60729c9f1e32 service nova] Creating event network-vif-plugged:6e6a9c93-a942-41c8-95ff-9810c16226ef for instance ccb6a214-824a-420b-8d7b-710ec9f8c9e4 on nch2-master-1 Sep 06 11:01:24.322954 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-4dd4ed4b-27b0-444a-95cd-84c47ac1bf7d req-1d894a94-dd27-4500-ba18-60729c9f1e32 service nova] Creating event network-vif-plugged:0a3bdacc-8012-4dfe-a06a-cff2d912b42a for instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 on nch1-master-1 Sep 06 11:01:24.335311 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-4dd4ed4b-27b0-444a-95cd-84c47ac1bf7d req-1d894a94-dd27-4500-ba18-60729c9f1e32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076738 Sep 06 11:01:24.336317 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1201/2430] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:24.356489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-403550e7-19dd-4958-8296-37bd372bbd0d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:24.357786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-403550e7-19dd-4958-8296-37bd372bbd0d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:24.364826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403550e7-19dd-4958-8296-37bd372bbd0d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:24.365514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403550e7-19dd-4958-8296-37bd372bbd0d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:24.366150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403550e7-19dd-4958-8296-37bd372bbd0d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:24.367203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403550e7-19dd-4958-8296-37bd372bbd0d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:24.367909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403550e7-19dd-4958-8296-37bd372bbd0d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:24.368631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403550e7-19dd-4958-8296-37bd372bbd0d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:24.657600 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b93b9ab7-e599-4be4-92ae-d4cdfaf8ebd3 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.853272 Sep 06 11:01:24.661194 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1230/2431] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 11:01:23 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:24.673284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-45935dd0-fb0a-4360-b613-9170e12b7a17 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Action: 'create', calling method: .version_select at 0x7f90f3966670>, body: {"security_group_rule": {"parent_group_id": "2d72e627-ebf1-46b6-bdae-467b13a98c1f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:24.825787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-403550e7-19dd-4958-8296-37bd372bbd0d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:24.839652 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-403550e7-19dd-4958-8296-37bd372bbd0d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.484859 Sep 06 11:01:24.841065 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1202/2432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:24 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:24.854747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c029737-0078-400d-a35c-38f3e19d1489 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:24.858105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1c029737-0078-400d-a35c-38f3e19d1489 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:24.864588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c029737-0078-400d-a35c-38f3e19d1489 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:24.865233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c029737-0078-400d-a35c-38f3e19d1489 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:24.865882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c029737-0078-400d-a35c-38f3e19d1489 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:24.866798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c029737-0078-400d-a35c-38f3e19d1489 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:24.867527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c029737-0078-400d-a35c-38f3e19d1489 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:24.868234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c029737-0078-400d-a35c-38f3e19d1489 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:25.017538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1c029737-0078-400d-a35c-38f3e19d1489 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:25.025792 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1c029737-0078-400d-a35c-38f3e19d1489 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.182834 Sep 06 11:01:25.026488 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1203/2433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:24 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:25.031825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b4c957bd-0b9c-41be-9bc8-b2484e1f6df5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:25.032537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b4c957bd-0b9c-41be-9bc8-b2484e1f6df5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:25.039730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4c957bd-0b9c-41be-9bc8-b2484e1f6df5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:25.040394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4c957bd-0b9c-41be-9bc8-b2484e1f6df5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:25.041308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4c957bd-0b9c-41be-9bc8-b2484e1f6df5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:25.041918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4c957bd-0b9c-41be-9bc8-b2484e1f6df5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:25.042398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4c957bd-0b9c-41be-9bc8-b2484e1f6df5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:25.043028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4c957bd-0b9c-41be-9bc8-b2484e1f6df5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:25.180477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b4c957bd-0b9c-41be-9bc8-b2484e1f6df5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:25.195056 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b4c957bd-0b9c-41be-9bc8-b2484e1f6df5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1470 microversion: 2.1 time: 0.164487 Sep 06 11:01:25.195056 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1204/2434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:25 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:25.288159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4aa7cf73-415f-47ee-b86c-5420824e877d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:25.290057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4aa7cf73-415f-47ee-b86c-5420824e877d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:25.298348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aa7cf73-415f-47ee-b86c-5420824e877d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:25.298846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aa7cf73-415f-47ee-b86c-5420824e877d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:25.299880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aa7cf73-415f-47ee-b86c-5420824e877d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:25.303338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aa7cf73-415f-47ee-b86c-5420824e877d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:25.307740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aa7cf73-415f-47ee-b86c-5420824e877d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:25.308412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aa7cf73-415f-47ee-b86c-5420824e877d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:25.565721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4aa7cf73-415f-47ee-b86c-5420824e877d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:25.575247 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4aa7cf73-415f-47ee-b86c-5420824e877d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1318 microversion: 2.1 time: 0.292417 Sep 06 11:01:25.575865 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1205/2435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:25 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:25.744541 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-45935dd0-fb0a-4360-b613-9170e12b7a17 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.074647 Sep 06 11:01:25.747178 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1231/2436] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 11:01:24 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:25.758616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b1d1947f-775f-4f90-abec-059491e070d7 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Action: 'create', calling method: .version_select at 0x7f90fcf8c8b0>, body: {"security_group_rule": {"parent_group_id": "2d72e627-ebf1-46b6-bdae-467b13a98c1f", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:25.865415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4a76be55-8a85-43db-9539-746222985e7d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:25.866548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4a76be55-8a85-43db-9539-746222985e7d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:25.875201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a76be55-8a85-43db-9539-746222985e7d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:25.877856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a76be55-8a85-43db-9539-746222985e7d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:25.877856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a76be55-8a85-43db-9539-746222985e7d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:25.877856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a76be55-8a85-43db-9539-746222985e7d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:25.879211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a76be55-8a85-43db-9539-746222985e7d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:25.879847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a76be55-8a85-43db-9539-746222985e7d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:26.153586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4a76be55-8a85-43db-9539-746222985e7d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:26.165834 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4a76be55-8a85-43db-9539-746222985e7d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.307746 Sep 06 11:01:26.167363 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1232/2437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:25 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:26.173762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cb3d1282-3561-4d0e-9f6d-b55869684da7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:26.174416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cb3d1282-3561-4d0e-9f6d-b55869684da7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:26.202480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3d1282-3561-4d0e-9f6d-b55869684da7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:26.203000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3d1282-3561-4d0e-9f6d-b55869684da7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:26.209576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3d1282-3561-4d0e-9f6d-b55869684da7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:26.210565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3d1282-3561-4d0e-9f6d-b55869684da7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:26.211245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3d1282-3561-4d0e-9f6d-b55869684da7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:26.211837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3d1282-3561-4d0e-9f6d-b55869684da7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:26.433923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cb3d1282-3561-4d0e-9f6d-b55869684da7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:26.449078 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b1d1947f-775f-4f90-abec-059491e070d7 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.694240 Sep 06 11:01:26.449987 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1206/2438] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Sep 6 11:01:25 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:26.455371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ef3089d5-6c8c-4ed5-a123-39b87340b5c2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:26.456157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ef3089d5-6c8c-4ed5-a123-39b87340b5c2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:26.460869 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cb3d1282-3561-4d0e-9f6d-b55869684da7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.291767 Sep 06 11:01:26.463763 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1233/2439] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:26 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:26.468563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef3089d5-6c8c-4ed5-a123-39b87340b5c2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:26.473097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-aa93113b-ff27-40f5-b5e1-4feebf759ee2 req-d175dc1f-57dd-402f-a543-560e69cc4344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81", "name": "network-vif-plugged", "status": "completed", "tag": "87158f46-00b8-4a2f-8c07-c467157d9ae5"}, {"server_uuid": "9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81", "name": "network-vif-plugged", "status": "completed", "tag": "d3917aae-e850-4b70-a2b1-89144d1d1fa7"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:26.473871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef3089d5-6c8c-4ed5-a123-39b87340b5c2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:26.477451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef3089d5-6c8c-4ed5-a123-39b87340b5c2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:26.477451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef3089d5-6c8c-4ed5-a123-39b87340b5c2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:26.480116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef3089d5-6c8c-4ed5-a123-39b87340b5c2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:26.483895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef3089d5-6c8c-4ed5-a123-39b87340b5c2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:26.501267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-aa93113b-ff27-40f5-b5e1-4feebf759ee2 req-d175dc1f-57dd-402f-a543-560e69cc4344 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:26.506444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-aa93113b-ff27-40f5-b5e1-4feebf759ee2 req-d175dc1f-57dd-402f-a543-560e69cc4344 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:26.507192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-aa93113b-ff27-40f5-b5e1-4feebf759ee2 req-d175dc1f-57dd-402f-a543-560e69cc4344 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:26.534288 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-aa93113b-ff27-40f5-b5e1-4feebf759ee2 req-d175dc1f-57dd-402f-a543-560e69cc4344 service nova] Creating event network-vif-plugged:87158f46-00b8-4a2f-8c07-c467157d9ae5 for instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 on nch1-master-1 Sep 06 11:01:26.535035 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-aa93113b-ff27-40f5-b5e1-4feebf759ee2 req-d175dc1f-57dd-402f-a543-560e69cc4344 service nova] Creating event network-vif-plugged:d3917aae-e850-4b70-a2b1-89144d1d1fa7 for instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 on nch1-master-1 Sep 06 11:01:26.550817 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-aa93113b-ff27-40f5-b5e1-4feebf759ee2 req-d175dc1f-57dd-402f-a543-560e69cc4344 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079175 Sep 06 11:01:26.551962 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1234/2440] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:26.562519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fc02eda6-5d30-42d7-8f34-9bdfec3d5a6b tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Calling method '.version_select at 0x7f90f397c0d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:26.718143 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fc02eda6-5d30-42d7-8f34-9bdfec3d5a6b tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/2d72e627-ebf1-46b6-bdae-467b13a98c1f" status: 200 len: 665 microversion: 2.1 time: 0.163955 Sep 06 11:01:26.719370 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1235/2441] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 11:01:26 2022] GET /compute/v2.1/os-security-groups/2d72e627-ebf1-46b6-bdae-467b13a98c1f => generated 665 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:26.733233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-72445077-ec34-4301-8e2a-514a13e717bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:26.737340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-72445077-ec34-4301-8e2a-514a13e717bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:26.756802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:26.759715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72445077-ec34-4301-8e2a-514a13e717bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:26.762126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72445077-ec34-4301-8e2a-514a13e717bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:26.762756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72445077-ec34-4301-8e2a-514a13e717bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:26.763743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72445077-ec34-4301-8e2a-514a13e717bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:26.765446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72445077-ec34-4301-8e2a-514a13e717bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:26.766063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72445077-ec34-4301-8e2a-514a13e717bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:26.793990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ef3089d5-6c8c-4ed5-a123-39b87340b5c2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:26.807508 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ef3089d5-6c8c-4ed5-a123-39b87340b5c2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1470 microversion: 2.1 time: 0.356196 Sep 06 11:01:26.808527 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1207/2442] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:26 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1470 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:26.813830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8a97178f-0d08-4d36-a19b-794b138b5367 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Calling method '.version_select at 0x7f90fcf8c8b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:27.429970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-72445077-ec34-4301-8e2a-514a13e717bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:27.439675 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-72445077-ec34-4301-8e2a-514a13e717bd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1467 microversion: 2.1 time: 0.719128 Sep 06 11:01:27.440598 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1236/2443] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:26 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1467 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:27.455862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-864c284a-e50d-472a-a747-24da192fe271 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:27.456773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-864c284a-e50d-472a-a747-24da192fe271 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:27.463880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-864c284a-e50d-472a-a747-24da192fe271 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:27.464798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-864c284a-e50d-472a-a747-24da192fe271 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:27.465582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-864c284a-e50d-472a-a747-24da192fe271 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:27.466476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-864c284a-e50d-472a-a747-24da192fe271 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:27.467193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-864c284a-e50d-472a-a747-24da192fe271 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:27.467635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-864c284a-e50d-472a-a747-24da192fe271 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:27.608094 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8a97178f-0d08-4d36-a19b-794b138b5367 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/100e1a6c-ac81-43c4-be46-01c49ef12a04" status: 202 len: 0 microversion: 2.1 time: 0.798315 Sep 06 11:01:27.609303 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1208/2444] 10.222.0.20 () {58 vars in 1287 bytes} [Tue Sep 6 11:01:26 2022] DELETE /compute/v2.1/os-security-group-rules/100e1a6c-ac81-43c4-be46-01c49ef12a04 => generated 0 bytes in 800 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:01:27.615233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-beb52a03-0c77-4c36-8f72-ddec1f226f8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:27.616064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-beb52a03-0c77-4c36-8f72-ddec1f226f8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: a3173985-c4ff-4e48-887a-baf5a5da0a9b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:27.633923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-beb52a03-0c77-4c36-8f72-ddec1f226f8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:27.639934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-beb52a03-0c77-4c36-8f72-ddec1f226f8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:27.640739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-beb52a03-0c77-4c36-8f72-ddec1f226f8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:27.642557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-beb52a03-0c77-4c36-8f72-ddec1f226f8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:27.643295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-beb52a03-0c77-4c36-8f72-ddec1f226f8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:27.643927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-beb52a03-0c77-4c36-8f72-ddec1f226f8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:27.650604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-864c284a-e50d-472a-a747-24da192fe271 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:27.660063 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-864c284a-e50d-472a-a747-24da192fe271 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1355 microversion: 2.1 time: 0.217868 Sep 06 11:01:27.660842 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1237/2445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:27 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1355 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:27.679652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b875c5a6-1a75-49db-bb7d-cd0520682614 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:27.680468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b875c5a6-1a75-49db-bb7d-cd0520682614 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:27.690594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b875c5a6-1a75-49db-bb7d-cd0520682614 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:27.691127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b875c5a6-1a75-49db-bb7d-cd0520682614 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:27.691581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b875c5a6-1a75-49db-bb7d-cd0520682614 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:27.692301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b875c5a6-1a75-49db-bb7d-cd0520682614 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:27.692762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b875c5a6-1a75-49db-bb7d-cd0520682614 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:27.693780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b875c5a6-1a75-49db-bb7d-cd0520682614 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:27.872348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-beb52a03-0c77-4c36-8f72-ddec1f226f8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:27.887854 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-beb52a03-0c77-4c36-8f72-ddec1f226f8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b" status: 200 len: 1467 microversion: 2.1 time: 0.276545 Sep 06 11:01:27.890850 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1209/2446] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:27 2022] GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b => generated 1467 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:27.897128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6eb34319-0405-4a27-ac3a-bc7d3eb756cd tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Calling method '.version_select at 0x7f90fcf8c8b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:27.941549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b875c5a6-1a75-49db-bb7d-cd0520682614 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:27.954134 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b875c5a6-1a75-49db-bb7d-cd0520682614 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.292078 Sep 06 11:01:27.954725 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1238/2447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:27 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:27.962426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a88e656c-9e97-43e8-b52e-424400bf5d58 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:27.968356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a88e656c-9e97-43e8-b52e-424400bf5d58 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:27.983785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a88e656c-9e97-43e8-b52e-424400bf5d58 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:27.984282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a88e656c-9e97-43e8-b52e-424400bf5d58 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:27.984723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a88e656c-9e97-43e8-b52e-424400bf5d58 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:27.985424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a88e656c-9e97-43e8-b52e-424400bf5d58 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:27.985881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a88e656c-9e97-43e8-b52e-424400bf5d58 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:27.986305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a88e656c-9e97-43e8-b52e-424400bf5d58 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:28.406156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a88e656c-9e97-43e8-b52e-424400bf5d58 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:28.426324 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a88e656c-9e97-43e8-b52e-424400bf5d58 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1470 microversion: 2.1 time: 0.462643 Sep 06 11:01:28.427955 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1239/2448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:27 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1470 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:28.441817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:28.449842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:28.455731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Searching by: {'reservation_id': 'r-fwnikmrs', 'deleted': False, 'project_id': '0a7af966e1b740a59920ff9370b5dade'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:01:28.476764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:28.477289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:28.477810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:28.478787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:28.479435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:28.483775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:28.560749 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6eb34319-0405-4a27-ac3a-bc7d3eb756cd tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2d72e627-ebf1-46b6-bdae-467b13a98c1f" status: 202 len: 0 microversion: 2.1 time: 0.668025 Sep 06 11:01:28.565736 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1210/2449] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:01:27 2022] DELETE /compute/v2.1/os-security-groups/2d72e627-ebf1-46b6-bdae-467b13a98c1f => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:01:28.573176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-79eeb362-903d-4da1-b4d2-be67a93e426b tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Calling method '.version_select at 0x7f90fcfc0ee0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:28.616004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:01:28.667710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG neutronclient.v2_0.client [None req-79eeb362-903d-4da1-b4d2-be67a93e426b tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4757a31e-e153-4288-9644-08810542aea8 does not exist", "detail": ""}} {{(pid=140875) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 11:01:28.668832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.security_group_api [None req-79eeb362-903d-4da1-b4d2-be67a93e426b tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Neutron security group 4757a31e-e153-4288-9644-08810542aea8 not found {{(pid=140875) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 11:01:28.669454 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-79eeb362-903d-4da1-b4d2-be67a93e426b tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] HTTP exception thrown: Security group 4757a31e-e153-4288-9644-08810542aea8 does not exist Sep 06 11:01:28.669454 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-a1296a71-7b8e-4883-9ec3-6c19d2a2abbe'] Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-79eeb362-903d-4da1-b4d2-be67a93e426b tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Request method failure captured: Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/os-security-groups/4757a31e-e153-4288-9644-08810542aea8 HTTP/1.1 Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyh59-rOhugHygErpUh_xPv10WJKauSlBm-LsupQsYXJUiW430qNW75SGG8RUYMSMGR02PYmjeSdhTnEhy-jYdwyu28H0zdbkqAz3uSyjO4hIbBxublsGt4oAuNtCSwAPptnGh8r55wNG3YyP-oTnWBOiPSQvSlvBd9dDe_xRky0YL8 Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4fe5fe7328b44d5589755674135f64d6 Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1536089964 Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4fe5fe7328b44d5589755674135f64d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fe5fe7328b44d5589755674135f64d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4fe5fe7328b44d5589755674135f64d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fe5fe7328b44d5589755674135f64d6"}]}] Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1536089964 Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4fe5fe7328b44d5589755674135f64d6 Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1536089964 Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-SecurityGroupRulesTestJSON-1536089964-project Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 924121a80acf4f72a356b4df01ce8692 Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1536089964-project Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: exception: Security group 4757a31e-e153-4288-9644-08810542aea8 does not exist Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-a1296a71-7b8e-4883-9ec3-6c19d2a2abbe'] Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '4757a31e-e153-4288-9644-08810542aea8'} Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 11:01:28.674347 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4757a31e-e153-4288-9644-08810542aea8 does not exist Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1296a71-7b8e-4883-9ec3-6c19d2a2abbe'] Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4757a31e-e153-4288-9644-08810542aea8 does not exist Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1296a71-7b8e-4883-9ec3-6c19d2a2abbe'] Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4757a31e-e153-4288-9644-08810542aea8 does not exist Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1296a71-7b8e-4883-9ec3-6c19d2a2abbe'] Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4757a31e-e153-4288-9644-08810542aea8 does not exist Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1296a71-7b8e-4883-9ec3-6c19d2a2abbe'] Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-79eeb362-903d-4da1-b4d2-be67a93e426b tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Returning 404 to user: Security group 4757a31e-e153-4288-9644-08810542aea8 does not exist Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: Neutron server returns request_ids: ['req-a1296a71-7b8e-4883-9ec3-6c19d2a2abbe'] {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:01:28.679916 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-79eeb362-903d-4da1-b4d2-be67a93e426b tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/4757a31e-e153-4288-9644-08810542aea8" status: 404 len: 194 microversion: 2.1 time: 0.110437 Sep 06 11:01:28.687197 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1211/2450] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:01:28 2022] DELETE /compute/v2.1/os-security-groups/4757a31e-e153-4288-9644-08810542aea8 => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:01:28.706404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-64670b20-f9d7-49f2-83e1-7b23cb512ca8 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:28.706404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-64670b20-f9d7-49f2-83e1-7b23cb512ca8 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:28.714646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:28.716472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64670b20-f9d7-49f2-83e1-7b23cb512ca8 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:28.717071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64670b20-f9d7-49f2-83e1-7b23cb512ca8 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:28.718085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64670b20-f9d7-49f2-83e1-7b23cb512ca8 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:28.718961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64670b20-f9d7-49f2-83e1-7b23cb512ca8 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:28.719471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64670b20-f9d7-49f2-83e1-7b23cb512ca8 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:28.720437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64670b20-f9d7-49f2-83e1-7b23cb512ca8 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:28.723611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:28.723898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:28.725139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:29.068540 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9626ae02-6463-4fc2-a1fd-b467b279ce9e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-fwnikmrs" status: 200 len: 2927 microversion: 2.1 time: 0.637475 Sep 06 11:01:29.069318 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1240/2451] 10.222.0.20 () {58 vars in 1197 bytes} [Tue Sep 6 11:01:28 2022] GET /compute/v2.1/servers/detail?reservation_id=r-fwnikmrs => generated 2927 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:29.074755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e59d92f5-789f-4d56-b645-f00882e999d1 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Calling method '.version_select at 0x7f90f3982940>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:29.117719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-64670b20-f9d7-49f2-83e1-7b23cb512ca8 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:29.128523 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-64670b20-f9d7-49f2-83e1-7b23cb512ca8 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1805 microversion: 2.1 time: 0.441428 Sep 06 11:01:29.129210 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1212/2452] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:28 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1805 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:29.134904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca5fe3a0-9cc5-466e-95f1-036a7cca24c0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:29.135903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca5fe3a0-9cc5-466e-95f1-036a7cca24c0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:29.143618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca5fe3a0-9cc5-466e-95f1-036a7cca24c0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:29.144711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca5fe3a0-9cc5-466e-95f1-036a7cca24c0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:29.145385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca5fe3a0-9cc5-466e-95f1-036a7cca24c0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:29.146427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca5fe3a0-9cc5-466e-95f1-036a7cca24c0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:29.147438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca5fe3a0-9cc5-466e-95f1-036a7cca24c0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:29.148102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca5fe3a0-9cc5-466e-95f1-036a7cca24c0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:29.412746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ca5fe3a0-9cc5-466e-95f1-036a7cca24c0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:29.421463 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ca5fe3a0-9cc5-466e-95f1-036a7cca24c0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.291165 Sep 06 11:01:29.422046 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1213/2453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:29 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:29.426622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-feb030cf-39c3-499a-b694-3ccf8cb3ca56 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:29.444555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.compute.server_groups [None req-feb030cf-39c3-499a-b694-3ccf8cb3ca56 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Querying cell a5a6b47c-7522-4a84-9be6-8ca7130ab6d7(cell1) for 2 instances {{(pid=140875) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 06 11:01:29.445321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-feb030cf-39c3-499a-b694-3ccf8cb3ca56 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:29.445835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-feb030cf-39c3-499a-b694-3ccf8cb3ca56 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:29.446260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-feb030cf-39c3-499a-b694-3ccf8cb3ca56 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:29.478660 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-feb030cf-39c3-499a-b694-3ccf8cb3ca56 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/877e8d5e-c9af-4b48-ae33-9f3498aa3a4f" status: 200 len: 265 microversion: 2.1 time: 0.055011 Sep 06 11:01:29.479276 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1214/2454] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:01:29 2022] GET /compute/v2.1/os-server-groups/877e8d5e-c9af-4b48-ae33-9f3498aa3a4f => generated 265 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:29.483912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1289a047-29cc-435f-bc39-5266ff2b3b0c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:29.484421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1289a047-29cc-435f-bc39-5266ff2b3b0c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:29.490188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1289a047-29cc-435f-bc39-5266ff2b3b0c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:29.490677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1289a047-29cc-435f-bc39-5266ff2b3b0c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:29.491169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1289a047-29cc-435f-bc39-5266ff2b3b0c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:29.491872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1289a047-29cc-435f-bc39-5266ff2b3b0c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:29.492342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1289a047-29cc-435f-bc39-5266ff2b3b0c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:29.492780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1289a047-29cc-435f-bc39-5266ff2b3b0c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:29.522765 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1289a047-29cc-435f-bc39-5266ff2b3b0c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81/ips" status: 200 len: 218 microversion: 2.1 time: 0.042357 Sep 06 11:01:29.523629 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1215/2455] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:01:29 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81/ips => generated 218 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:29.528062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8610be0d-4ebc-4045-97ec-e9b489ed7e3f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:29.528686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8610be0d-4ebc-4045-97ec-e9b489ed7e3f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:29.536126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8610be0d-4ebc-4045-97ec-e9b489ed7e3f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:29.536623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8610be0d-4ebc-4045-97ec-e9b489ed7e3f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:29.539424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8610be0d-4ebc-4045-97ec-e9b489ed7e3f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:29.539424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8610be0d-4ebc-4045-97ec-e9b489ed7e3f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:29.539424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8610be0d-4ebc-4045-97ec-e9b489ed7e3f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:29.539424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8610be0d-4ebc-4045-97ec-e9b489ed7e3f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:29.562444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:29.566031 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e59d92f5-789f-4d56-b645-f00882e999d1 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/80ce1dd1-19cb-4b5d-aee8-e6a5f9fd42e7" status: 202 len: 0 microversion: 2.1 time: 0.495416 Sep 06 11:01:29.566847 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1241/2456] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:01:29 2022] DELETE /compute/v2.1/os-security-groups/80ce1dd1-19cb-4b5d-aee8-e6a5f9fd42e7 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:01:29.576408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a1d45b6-ee8e-478e-8b6d-296908591d3e tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:29.577066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9a1d45b6-ee8e-478e-8b6d-296908591d3e tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] [instance: a3173985-c4ff-4e48-887a-baf5a5da0a9b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:29.588387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a1d45b6-ee8e-478e-8b6d-296908591d3e tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:29.589092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a1d45b6-ee8e-478e-8b6d-296908591d3e tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:29.590294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a1d45b6-ee8e-478e-8b6d-296908591d3e tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:29.591370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a1d45b6-ee8e-478e-8b6d-296908591d3e tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:29.592705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a1d45b6-ee8e-478e-8b6d-296908591d3e tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:29.593602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a1d45b6-ee8e-478e-8b6d-296908591d3e tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:29.780637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8610be0d-4ebc-4045-97ec-e9b489ed7e3f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:29.790081 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8610be0d-4ebc-4045-97ec-e9b489ed7e3f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1470 microversion: 2.1 time: 0.265541 Sep 06 11:01:29.791251 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1216/2457] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:29 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:29.814083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7b9772ef-d463-4f91-8595-55ed8002f158 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:29.815084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7b9772ef-d463-4f91-8595-55ed8002f158 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:29.821384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b9772ef-d463-4f91-8595-55ed8002f158 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:29.821840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b9772ef-d463-4f91-8595-55ed8002f158 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:29.822447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b9772ef-d463-4f91-8595-55ed8002f158 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:29.823576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b9772ef-d463-4f91-8595-55ed8002f158 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:29.824761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b9772ef-d463-4f91-8595-55ed8002f158 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:29.825213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b9772ef-d463-4f91-8595-55ed8002f158 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:29.857878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7b9772ef-d463-4f91-8595-55ed8002f158 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:01:29.871129 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a1d45b6-ee8e-478e-8b6d-296908591d3e tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b" status: 200 len: 1618 microversion: 2.1 time: 0.303180 Sep 06 11:01:29.872506 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1242/2458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:29 2022] GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b => generated 1618 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:29.880376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-23be9d57-2c4a-4147-b82a-0a39a048d785 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Calling method '.version_select at 0x7f90f3911d30>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:30.336770 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7b9772ef-d463-4f91-8595-55ed8002f158 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 204 len: 0 microversion: 2.1 time: 0.528208 Sep 06 11:01:30.336770 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1217/2459] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:01:29 2022] DELETE /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:01:30.343740 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-23be9d57-2c4a-4147-b82a-0a39a048d785 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2f63ca5d-3bf3-4c3d-8afc-e59ff5bbaefd" status: 202 len: 0 microversion: 2.1 time: 0.469869 Sep 06 11:01:30.348395 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1243/2460] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:01:29 2022] DELETE /compute/v2.1/os-security-groups/2f63ca5d-3bf3-4c3d-8afc-e59ff5bbaefd => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:01:30.350450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4b71e39a-11ef-4e8f-8508-8fbc5f24ce63 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:30.351208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4b71e39a-11ef-4e8f-8508-8fbc5f24ce63 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:30.355483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dcfacf16-f6a5-485a-b5f1-d025ffe7632a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:30.356711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dcfacf16-f6a5-485a-b5f1-d025ffe7632a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:30.364700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcfacf16-f6a5-485a-b5f1-d025ffe7632a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:30.364700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcfacf16-f6a5-485a-b5f1-d025ffe7632a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:30.366029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcfacf16-f6a5-485a-b5f1-d025ffe7632a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:30.366584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b71e39a-11ef-4e8f-8508-8fbc5f24ce63 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:30.367127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b71e39a-11ef-4e8f-8508-8fbc5f24ce63 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:30.367581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b71e39a-11ef-4e8f-8508-8fbc5f24ce63 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:30.367896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcfacf16-f6a5-485a-b5f1-d025ffe7632a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:30.368841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcfacf16-f6a5-485a-b5f1-d025ffe7632a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:30.369693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b71e39a-11ef-4e8f-8508-8fbc5f24ce63 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:30.370140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcfacf16-f6a5-485a-b5f1-d025ffe7632a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:30.370273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b71e39a-11ef-4e8f-8508-8fbc5f24ce63 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:30.370689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b71e39a-11ef-4e8f-8508-8fbc5f24ce63 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:30.611604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dcfacf16-f6a5-485a-b5f1-d025ffe7632a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:30.625663 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4b71e39a-11ef-4e8f-8508-8fbc5f24ce63 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 200 len: 1618 microversion: 2.1 time: 0.289023 Sep 06 11:01:30.634891 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dcfacf16-f6a5-485a-b5f1-d025ffe7632a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1811 microversion: 2.1 time: 0.279332 Sep 06 11:01:30.635195 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1218/2461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:30 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 1618 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:30.635286 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1244/2462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:30 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1811 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:30.647379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f1683451-ad4b-44e1-bd2f-ca24fcf07cf3 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Calling method '.version_select at 0x7f90fcfb8280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:30.656971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0f40d4c2-3a28-470f-90fe-ba4bbbbca688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:30.660337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0f40d4c2-3a28-470f-90fe-ba4bbbbca688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:30.674708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f40d4c2-3a28-470f-90fe-ba4bbbbca688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:30.678397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f40d4c2-3a28-470f-90fe-ba4bbbbca688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:30.678894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f40d4c2-3a28-470f-90fe-ba4bbbbca688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:30.679702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f40d4c2-3a28-470f-90fe-ba4bbbbca688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:30.685705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f40d4c2-3a28-470f-90fe-ba4bbbbca688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:30.686189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f40d4c2-3a28-470f-90fe-ba4bbbbca688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:30.945263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0f40d4c2-3a28-470f-90fe-ba4bbbbca688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:30.960335 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0f40d4c2-3a28-470f-90fe-ba4bbbbca688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.325970 Sep 06 11:01:30.971045 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1245/2463] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:30 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:30.987517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f2c85b8-e3d9-462b-a711-754837c9fc6b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Action: 'create', calling method: .version_select at 0x7f90f38510d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-506431312", "policies": ["anti-affinity"]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:31.021183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1f2c85b8-e3d9-462b-a711-754837c9fc6b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:01:31.028362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1f2c85b8-e3d9-462b-a711-754837c9fc6b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:01:31.058651 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f1683451-ad4b-44e1-bd2f-ca24fcf07cf3 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/823830e8-a1e0-4926-9528-6605bc288c4e" status: 202 len: 0 microversion: 2.1 time: 0.425703 Sep 06 11:01:31.063765 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1219/2464] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:01:30 2022] DELETE /compute/v2.1/os-security-groups/823830e8-a1e0-4926-9528-6605bc288c4e => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:01:31.071372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4f97c36f-3c09-42e5-9456-6ad8d668d1c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:31.072752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4f97c36f-3c09-42e5-9456-6ad8d668d1c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:31.089881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f97c36f-3c09-42e5-9456-6ad8d668d1c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:31.090421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f97c36f-3c09-42e5-9456-6ad8d668d1c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:31.091105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f97c36f-3c09-42e5-9456-6ad8d668d1c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:31.092328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f97c36f-3c09-42e5-9456-6ad8d668d1c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:31.092961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f97c36f-3c09-42e5-9456-6ad8d668d1c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:31.093400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f97c36f-3c09-42e5-9456-6ad8d668d1c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:31.175140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1f2c85b8-e3d9-462b-a711-754837c9fc6b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:01:31.183057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1f2c85b8-e3d9-462b-a711-754837c9fc6b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:01:31.197494 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1f2c85b8-e3d9-462b-a711-754837c9fc6b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.221017 Sep 06 11:01:31.199388 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1246/2465] 10.222.0.20 () {60 vars in 1174 bytes} [Tue Sep 6 11:01:30 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:31.211138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c01f58ba-6300-4fe9-aa22-32c4f7c00669 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Calling method '.version_select at 0x7f90f3851820>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:31.342366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4f97c36f-3c09-42e5-9456-6ad8d668d1c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:31.357358 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4f97c36f-3c09-42e5-9456-6ad8d668d1c0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1475 microversion: 2.1 time: 0.289672 Sep 06 11:01:31.359403 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1220/2466] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:31 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1475 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:31.382902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-515054658", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ed7e8173-1d06-4db0-b5ca-598294d2acec"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:31.446359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:01:31.708119 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c01f58ba-6300-4fe9-aa22-32c4f7c00669 tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/6939e113-ce1b-47bf-bd37-22197293c698" status: 202 len: 0 microversion: 2.1 time: 0.508110 Sep 06 11:01:31.708704 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1247/2467] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:01:31 2022] DELETE /compute/v2.1/os-security-groups/6939e113-ce1b-47bf-bd37-22197293c698 => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:01:31.713892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-30b0b0c6-a8b9-45f9-8c7e-2b8b714a31b4 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:31.714516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-30b0b0c6-a8b9-45f9-8c7e-2b8b714a31b4 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:31.728940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30b0b0c6-a8b9-45f9-8c7e-2b8b714a31b4 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:31.728940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30b0b0c6-a8b9-45f9-8c7e-2b8b714a31b4 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:31.728940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30b0b0c6-a8b9-45f9-8c7e-2b8b714a31b4 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:31.728940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30b0b0c6-a8b9-45f9-8c7e-2b8b714a31b4 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:31.728940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30b0b0c6-a8b9-45f9-8c7e-2b8b714a31b4 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:31.729324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30b0b0c6-a8b9-45f9-8c7e-2b8b714a31b4 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:31.803489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:01:31.804178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:01:31.804876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:01:31.805487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:01:31.807383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:01:31.826547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:31.827277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:31.828037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:31.829283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:31.830014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:31.830837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:31.855188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:01:31.861959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:01:31.894483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Going to run 2 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:01:31.894483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: d0610e78-f996-4342-a0c8-8ef481539a39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:01:32.020418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:01:32.028430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:01:32.039974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:32.067933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-30b0b0c6-a8b9-45f9-8c7e-2b8b714a31b4 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:32.076616 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-30b0b0c6-a8b9-45f9-8c7e-2b8b714a31b4 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1811 microversion: 2.1 time: 0.366912 Sep 06 11:01:32.077199 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1248/2468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:31 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1811 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:32.098490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e200005d-7c91-4ab5-9b4f-509efcd1e5eb tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] Calling method '.version_select at 0x7f90f39a10d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:32.151862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:01:32.159419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:01:32.208562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=d0610e78-f996-4342-a0c8-8ef481539a39,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:01:32.355336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:01:32.363489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:01:32.482018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:01:32.486230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'server_group_members'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:01:32.539262 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e7f4ab4c-7a47-4cb0-9db0-6a36a5eed9ce tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.161262 Sep 06 11:01:32.540047 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1221/2469] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:01:31 2022] POST /compute/v2.1/servers => generated 32 bytes in 1180 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 06 11:01:32.545542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-303753d9-8ab5-492c-a5bd-1f7bca2a27a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:32.546448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-303753d9-8ab5-492c-a5bd-1f7bca2a27a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:32.553892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-303753d9-8ab5-492c-a5bd-1f7bca2a27a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:32.554721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-303753d9-8ab5-492c-a5bd-1f7bca2a27a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:32.555497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-303753d9-8ab5-492c-a5bd-1f7bca2a27a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:32.556656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-303753d9-8ab5-492c-a5bd-1f7bca2a27a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:32.557277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-303753d9-8ab5-492c-a5bd-1f7bca2a27a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:32.558860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-303753d9-8ab5-492c-a5bd-1f7bca2a27a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:32.668870 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e200005d-7c91-4ab5-9b4f-509efcd1e5eb tempest-SecurityGroupRulesTestJSON-1536089964 tempest-SecurityGroupRulesTestJSON-1536089964-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/7d87ad0e-fd5b-4e6c-98ff-83ca4444dcc2" status: 202 len: 0 microversion: 2.1 time: 0.572688 Sep 06 11:01:32.668870 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1249/2470] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:01:32 2022] DELETE /compute/v2.1/os-security-groups/7d87ad0e-fd5b-4e6c-98ff-83ca4444dcc2 => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:01:32.673660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-500d0d79-0b77-48e6-b880-ad6fd6829906 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:32.674268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-500d0d79-0b77-48e6-b880-ad6fd6829906 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:32.688519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-500d0d79-0b77-48e6-b880-ad6fd6829906 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:32.690519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-500d0d79-0b77-48e6-b880-ad6fd6829906 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:32.693183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-500d0d79-0b77-48e6-b880-ad6fd6829906 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:32.694364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-500d0d79-0b77-48e6-b880-ad6fd6829906 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:32.695119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-500d0d79-0b77-48e6-b880-ad6fd6829906 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:32.697734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-500d0d79-0b77-48e6-b880-ad6fd6829906 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:32.959035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-303753d9-8ab5-492c-a5bd-1f7bca2a27a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:32.969111 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-303753d9-8ab5-492c-a5bd-1f7bca2a27a4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.427793 Sep 06 11:01:32.971194 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1222/2471] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:32 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:32.986916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dc69b068-75eb-4cca-8f94-2d1b3def2bed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:32.991843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dc69b068-75eb-4cca-8f94-2d1b3def2bed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:32.992619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dc69b068-75eb-4cca-8f94-2d1b3def2bed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Searching by: {'deleted': False, 'project_id': '0a7af966e1b740a59920ff9370b5dade'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:01:33.022892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc69b068-75eb-4cca-8f94-2d1b3def2bed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:33.032886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc69b068-75eb-4cca-8f94-2d1b3def2bed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:33.033651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc69b068-75eb-4cca-8f94-2d1b3def2bed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:33.034672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc69b068-75eb-4cca-8f94-2d1b3def2bed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:33.035377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc69b068-75eb-4cca-8f94-2d1b3def2bed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:33.036014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc69b068-75eb-4cca-8f94-2d1b3def2bed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:33.079932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-dc69b068-75eb-4cca-8f94-2d1b3def2bed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:01:33.125822 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dc69b068-75eb-4cca-8f94-2d1b3def2bed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.155004 Sep 06 11:01:33.126436 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1223/2472] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 11:01:32 2022] GET /compute/v2.1/servers => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:33.135158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8ee70624-25bc-4c05-8b62-8a4088d0e912 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:33.135158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8ee70624-25bc-4c05-8b62-8a4088d0e912 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:33.139763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ee70624-25bc-4c05-8b62-8a4088d0e912 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:33.140275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ee70624-25bc-4c05-8b62-8a4088d0e912 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:33.140731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ee70624-25bc-4c05-8b62-8a4088d0e912 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:33.141458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ee70624-25bc-4c05-8b62-8a4088d0e912 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:33.141933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ee70624-25bc-4c05-8b62-8a4088d0e912 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:33.142457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ee70624-25bc-4c05-8b62-8a4088d0e912 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:33.295815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-500d0d79-0b77-48e6-b880-ad6fd6829906 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:33.305765 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-500d0d79-0b77-48e6-b880-ad6fd6829906 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1475 microversion: 2.1 time: 0.636556 Sep 06 11:01:33.324112 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1250/2473] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:32 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1475 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:33.331437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fd9304cb-b6b7-48e9-a06d-737db7520d09 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:33.334815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fd9304cb-b6b7-48e9-a06d-737db7520d09 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:33.454832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fd9304cb-b6b7-48e9-a06d-737db7520d09 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:33.466448 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fd9304cb-b6b7-48e9-a06d-737db7520d09 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1218 microversion: 2.1 time: 0.136319 Sep 06 11:01:33.466946 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1251/2474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:33 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:33.476986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-b7d00111-c6c6-4bac-a346-c138553a7204 req-82204c71-76ad-4f5f-9cf9-9ce241577077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81", "name": "network-vif-deleted", "tag": "0a3bdacc-8012-4dfe-a06a-cff2d912b42a"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:33.503201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b7d00111-c6c6-4bac-a346-c138553a7204 req-82204c71-76ad-4f5f-9cf9-9ce241577077 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:33.503690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b7d00111-c6c6-4bac-a346-c138553a7204 req-82204c71-76ad-4f5f-9cf9-9ce241577077 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:33.506171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b7d00111-c6c6-4bac-a346-c138553a7204 req-82204c71-76ad-4f5f-9cf9-9ce241577077 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:33.509878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8ee70624-25bc-4c05-8b62-8a4088d0e912 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:33.526469 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8ee70624-25bc-4c05-8b62-8a4088d0e912 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1790 microversion: 2.1 time: 0.397560 Sep 06 11:01:33.542815 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1224/2475] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:33 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1790 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:33.543075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:33.543075 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-b7d00111-c6c6-4bac-a346-c138553a7204 req-82204c71-76ad-4f5f-9cf9-9ce241577077 service nova] Creating event network-vif-deleted:0a3bdacc-8012-4dfe-a06a-cff2d912b42a for instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 on nch1-master-1 Sep 06 11:01:33.545049 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-b7d00111-c6c6-4bac-a346-c138553a7204 req-82204c71-76ad-4f5f-9cf9-9ce241577077 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075814 Sep 06 11:01:33.548194 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1252/2476] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:34.001415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c63e6df-55ef-4517-a1c4-8fbb8c13095f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:34.002454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1c63e6df-55ef-4517-a1c4-8fbb8c13095f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:34.028731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c63e6df-55ef-4517-a1c4-8fbb8c13095f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:34.032396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c63e6df-55ef-4517-a1c4-8fbb8c13095f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:34.032867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c63e6df-55ef-4517-a1c4-8fbb8c13095f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:34.035638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c63e6df-55ef-4517-a1c4-8fbb8c13095f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:34.036382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c63e6df-55ef-4517-a1c4-8fbb8c13095f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:34.036590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c63e6df-55ef-4517-a1c4-8fbb8c13095f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:34.331976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c3a7e196-d8f2-4b59-9ee7-9a89ea2df0f5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:34.333303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c3a7e196-d8f2-4b59-9ee7-9a89ea2df0f5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:34.345897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3a7e196-d8f2-4b59-9ee7-9a89ea2df0f5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:34.347452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3a7e196-d8f2-4b59-9ee7-9a89ea2df0f5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:34.348186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3a7e196-d8f2-4b59-9ee7-9a89ea2df0f5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:34.349609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3a7e196-d8f2-4b59-9ee7-9a89ea2df0f5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:34.350244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3a7e196-d8f2-4b59-9ee7-9a89ea2df0f5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:34.351732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3a7e196-d8f2-4b59-9ee7-9a89ea2df0f5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:34.509974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1c63e6df-55ef-4517-a1c4-8fbb8c13095f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:34.517107 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1c63e6df-55ef-4517-a1c4-8fbb8c13095f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.525874 Sep 06 11:01:34.525315 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1225/2477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:33 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:34.545726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84becb18-2cc2-4ad8-ba03-a480ed053c2a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:34.546354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-84becb18-2cc2-4ad8-ba03-a480ed053c2a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:34.667782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-84becb18-2cc2-4ad8-ba03-a480ed053c2a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:34.668034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c3a7e196-d8f2-4b59-9ee7-9a89ea2df0f5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:34.677003 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c3a7e196-d8f2-4b59-9ee7-9a89ea2df0f5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1475 microversion: 2.1 time: 0.349776 Sep 06 11:01:34.678289 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1253/2478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:34 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1475 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:34.690679 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84becb18-2cc2-4ad8-ba03-a480ed053c2a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1218 microversion: 2.1 time: 0.142180 Sep 06 11:01:34.690679 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1226/2479] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:34 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:34.690980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2089fc7c-59c2-4bac-9744-cfdb772cd68b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:34.690980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2089fc7c-59c2-4bac-9744-cfdb772cd68b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:34.693580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2089fc7c-59c2-4bac-9744-cfdb772cd68b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:34.694311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2089fc7c-59c2-4bac-9744-cfdb772cd68b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:34.694934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2089fc7c-59c2-4bac-9744-cfdb772cd68b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:34.695836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2089fc7c-59c2-4bac-9744-cfdb772cd68b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:34.696937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2089fc7c-59c2-4bac-9744-cfdb772cd68b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:34.697646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2089fc7c-59c2-4bac-9744-cfdb772cd68b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:34.903353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2089fc7c-59c2-4bac-9744-cfdb772cd68b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:34.914852 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2089fc7c-59c2-4bac-9744-cfdb772cd68b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1654 microversion: 2.1 time: 0.235341 Sep 06 11:01:34.916108 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1254/2480] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:34 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1654 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:35.379885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bc76e604-9386-4a7a-962c-acae228a27a1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:35.382333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bc76e604-9386-4a7a-962c-acae228a27a1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:35.391135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc76e604-9386-4a7a-962c-acae228a27a1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:35.392476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc76e604-9386-4a7a-962c-acae228a27a1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:35.393253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc76e604-9386-4a7a-962c-acae228a27a1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:35.395595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc76e604-9386-4a7a-962c-acae228a27a1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:35.396233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc76e604-9386-4a7a-962c-acae228a27a1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:35.396888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc76e604-9386-4a7a-962c-acae228a27a1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:35.551542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9d5fd0e3-5ddb-4d75-b7b9-dbdfa57e5c2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:35.553423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9d5fd0e3-5ddb-4d75-b7b9-dbdfa57e5c2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:35.570072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d5fd0e3-5ddb-4d75-b7b9-dbdfa57e5c2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:35.570600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d5fd0e3-5ddb-4d75-b7b9-dbdfa57e5c2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:35.576771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d5fd0e3-5ddb-4d75-b7b9-dbdfa57e5c2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:35.576771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d5fd0e3-5ddb-4d75-b7b9-dbdfa57e5c2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:35.576771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d5fd0e3-5ddb-4d75-b7b9-dbdfa57e5c2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:35.576771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d5fd0e3-5ddb-4d75-b7b9-dbdfa57e5c2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:35.614015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bc76e604-9386-4a7a-962c-acae228a27a1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:35.641653 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bc76e604-9386-4a7a-962c-acae228a27a1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.267107 Sep 06 11:01:35.642850 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1227/2481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:35 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:35.653024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ddce9bfb-5b01-46ee-97c6-4476cd9fa956 req-bbfbe5ed-284a-4296-9153-85d29babc023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81", "name": "network-vif-deleted", "tag": "d3917aae-e850-4b70-a2b1-89144d1d1fa7"}, {"server_uuid": "9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81", "name": "network-vif-deleted", "tag": "87158f46-00b8-4a2f-8c07-c467157d9ae5"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:35.703916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ddce9bfb-5b01-46ee-97c6-4476cd9fa956 req-bbfbe5ed-284a-4296-9153-85d29babc023 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:35.703916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ddce9bfb-5b01-46ee-97c6-4476cd9fa956 req-bbfbe5ed-284a-4296-9153-85d29babc023 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:35.703916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ddce9bfb-5b01-46ee-97c6-4476cd9fa956 req-bbfbe5ed-284a-4296-9153-85d29babc023 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:35.726462 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ddce9bfb-5b01-46ee-97c6-4476cd9fa956 req-bbfbe5ed-284a-4296-9153-85d29babc023 service nova] Creating event network-vif-deleted:d3917aae-e850-4b70-a2b1-89144d1d1fa7 for instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 on nch1-master-1 Sep 06 11:01:35.728966 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ddce9bfb-5b01-46ee-97c6-4476cd9fa956 req-bbfbe5ed-284a-4296-9153-85d29babc023 service nova] Creating event network-vif-deleted:87158f46-00b8-4a2f-8c07-c467157d9ae5 for instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 on nch1-master-1 Sep 06 11:01:35.736435 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ddce9bfb-5b01-46ee-97c6-4476cd9fa956 req-bbfbe5ed-284a-4296-9153-85d29babc023 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090916 Sep 06 11:01:35.738101 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1228/2482] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:35.747126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ed3f0e18-da90-40d9-b4e5-506c38e1c39b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:35.748270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ed3f0e18-da90-40d9-b4e5-506c38e1c39b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:35.758960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed3f0e18-da90-40d9-b4e5-506c38e1c39b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:35.763857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed3f0e18-da90-40d9-b4e5-506c38e1c39b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:35.763857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed3f0e18-da90-40d9-b4e5-506c38e1c39b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:35.763857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed3f0e18-da90-40d9-b4e5-506c38e1c39b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:35.763857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed3f0e18-da90-40d9-b4e5-506c38e1c39b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:35.763857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed3f0e18-da90-40d9-b4e5-506c38e1c39b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:35.862967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ed3f0e18-da90-40d9-b4e5-506c38e1c39b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:35.872806 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ed3f0e18-da90-40d9-b4e5-506c38e1c39b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1222 microversion: 2.1 time: 0.133301 Sep 06 11:01:35.875335 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1229/2483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:35 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1222 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:35.886909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-42361722-6292-4e6e-9a57-4c1395787ca8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:35.893440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9d5fd0e3-5ddb-4d75-b7b9-dbdfa57e5c2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:35.896071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-42361722-6292-4e6e-9a57-4c1395787ca8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:35.901663 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9d5fd0e3-5ddb-4d75-b7b9-dbdfa57e5c2e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.354378 Sep 06 11:01:35.902257 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1255/2484] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:35 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:35.915172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42361722-6292-4e6e-9a57-4c1395787ca8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:35.915172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42361722-6292-4e6e-9a57-4c1395787ca8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:35.915172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42361722-6292-4e6e-9a57-4c1395787ca8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:35.915172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42361722-6292-4e6e-9a57-4c1395787ca8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:35.915172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42361722-6292-4e6e-9a57-4c1395787ca8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:35.915172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42361722-6292-4e6e-9a57-4c1395787ca8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:35.943501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:35.944592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:35.954379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:35.955141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:35.955792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:35.956751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:35.957558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:35.958150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:36.010069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:36.010823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:36.011497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:36.012119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lazy-loading 'fault' on Instance uuid 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:01:36.081752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:36.093353 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-739cce4f-04eb-4f10-8031-8bd7679044ba tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 200 len: 1303 microversion: 2.1 time: 0.155205 Sep 06 11:01:36.093953 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1256/2485] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:35 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:36.157995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-42361722-6292-4e6e-9a57-4c1395787ca8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:36.166618 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-42361722-6292-4e6e-9a57-4c1395787ca8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1475 microversion: 2.1 time: 0.284343 Sep 06 11:01:36.167241 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1230/2486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:35 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1475 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:36.670691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a190b52-8a01-4bdf-822c-8ea324bc1fb7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:36.672517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9a190b52-8a01-4bdf-822c-8ea324bc1fb7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:36.680544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a190b52-8a01-4bdf-822c-8ea324bc1fb7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:36.681878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a190b52-8a01-4bdf-822c-8ea324bc1fb7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:36.682510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a190b52-8a01-4bdf-822c-8ea324bc1fb7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:36.683787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a190b52-8a01-4bdf-822c-8ea324bc1fb7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:36.684319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a190b52-8a01-4bdf-822c-8ea324bc1fb7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:36.684868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a190b52-8a01-4bdf-822c-8ea324bc1fb7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:36.892078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9a190b52-8a01-4bdf-822c-8ea324bc1fb7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:36.898601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f744531c-4245-4172-8a41-c3f3cc04344a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:36.899265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f744531c-4245-4172-8a41-c3f3cc04344a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:36.900815 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a190b52-8a01-4bdf-822c-8ea324bc1fb7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.234214 Sep 06 11:01:36.901398 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1257/2487] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:36 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:36.906388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f744531c-4245-4172-8a41-c3f3cc04344a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:36.906894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f744531c-4245-4172-8a41-c3f3cc04344a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:36.911336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f744531c-4245-4172-8a41-c3f3cc04344a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:36.912355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f744531c-4245-4172-8a41-c3f3cc04344a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:36.912826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f744531c-4245-4172-8a41-c3f3cc04344a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:36.914744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f744531c-4245-4172-8a41-c3f3cc04344a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:36.927201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-01898154-9e50-4a59-b7a4-276690d1dc01 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:36.928076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-01898154-9e50-4a59-b7a4-276690d1dc01 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:36.935882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01898154-9e50-4a59-b7a4-276690d1dc01 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:36.936642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01898154-9e50-4a59-b7a4-276690d1dc01 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:36.937252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01898154-9e50-4a59-b7a4-276690d1dc01 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:36.938292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01898154-9e50-4a59-b7a4-276690d1dc01 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:36.938965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01898154-9e50-4a59-b7a4-276690d1dc01 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:36.939574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01898154-9e50-4a59-b7a4-276690d1dc01 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:37.003353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f744531c-4245-4172-8a41-c3f3cc04344a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:37.012501 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f744531c-4245-4172-8a41-c3f3cc04344a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1270 microversion: 2.1 time: 0.117790 Sep 06 11:01:37.013093 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1231/2488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:36 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1270 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:37.020063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-181405db-0ce8-4611-ab6e-01c43c68e79b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1348343637"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:37.022707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-181405db-0ce8-4611-ab6e-01c43c68e79b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:37.033928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-181405db-0ce8-4611-ab6e-01c43c68e79b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:37.034435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-181405db-0ce8-4611-ab6e-01c43c68e79b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:37.034883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-181405db-0ce8-4611-ab6e-01c43c68e79b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:37.035837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-181405db-0ce8-4611-ab6e-01c43c68e79b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:37.036488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-181405db-0ce8-4611-ab6e-01c43c68e79b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:37.037134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-181405db-0ce8-4611-ab6e-01c43c68e79b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:37.252437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-01898154-9e50-4a59-b7a4-276690d1dc01 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:37.265905 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-01898154-9e50-4a59-b7a4-276690d1dc01 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.342880 Sep 06 11:01:37.278671 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1258/2489] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:36 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:37.289751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a4d63cc1-9651-4c81-ad27-722e8a2ac0a3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:37.290138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a4d63cc1-9651-4c81-ad27-722e8a2ac0a3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:37.311494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4d63cc1-9651-4c81-ad27-722e8a2ac0a3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:37.319212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4d63cc1-9651-4c81-ad27-722e8a2ac0a3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:37.319212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4d63cc1-9651-4c81-ad27-722e8a2ac0a3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:37.319212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4d63cc1-9651-4c81-ad27-722e8a2ac0a3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:37.319212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4d63cc1-9651-4c81-ad27-722e8a2ac0a3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:37.319625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4d63cc1-9651-4c81-ad27-722e8a2ac0a3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:37.344043 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-a4d63cc1-9651-4c81-ad27-722e8a2ac0a3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] HTTP exception thrown: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a4d63cc1-9651-4c81-ad27-722e8a2ac0a3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Request method failure captured: Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 HTTP/1.1 Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyhUseLZJ8E18mBh1hkBQD0ylqWMAm9fJBkixY7hlncd1Jz8eDaMIPjqmuoTVa6iaVNJun0U3WC64l-cXfCpBVuJk3rJTMvWwWHUozrDtcbjvcQUrKpYCf2AmrDX1muQOJik2eT7tIgKL5t6SBQrMl69Cx_U94gHqpeKrkpMOeCcUf0 Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 91b83e289c414e499c91fc7f711774b7 Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestMultiNic-1879257848 Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91b83e289c414e499c91fc7f711774b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91b83e289c414e499c91fc7f711774b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91b83e289c414e499c91fc7f711774b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91b83e289c414e499c91fc7f711774b7"}]}] Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestMultiNic-1879257848 Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 91b83e289c414e499c91fc7f711774b7 Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestMultiNic-1879257848 Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestMultiNic-1879257848-project Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 99ebe881ffd44893879bb9e7ab63c9fd Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestMultiNic-1879257848-project Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81'} Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:37.346064 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:37.358416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:37.358416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:37.358416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:37.358416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:01:37.358416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:01:37.358416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:01:37.358416 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:37.358416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a4d63cc1-9651-4c81-ad27-722e8a2ac0a3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Returning 404 to user: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:01:37.358416 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a4d63cc1-9651-4c81-ad27-722e8a2ac0a3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 404 len: 111 microversion: 2.1 time: 0.067592 Sep 06 11:01:37.358416 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1259/2490] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:37 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:01:37.361891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eebd2af2-0820-4316-9e77-f35bfd4591f9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:37.362734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eebd2af2-0820-4316-9e77-f35bfd4591f9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:37.370497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eebd2af2-0820-4316-9e77-f35bfd4591f9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:37.371341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eebd2af2-0820-4316-9e77-f35bfd4591f9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:37.371937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eebd2af2-0820-4316-9e77-f35bfd4591f9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:37.375400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eebd2af2-0820-4316-9e77-f35bfd4591f9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:37.375400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eebd2af2-0820-4316-9e77-f35bfd4591f9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:37.375400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eebd2af2-0820-4316-9e77-f35bfd4591f9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:37.701123 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-181405db-0ce8-4611-ab6e-01c43c68e79b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.684547 Sep 06 11:01:37.701822 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1232/2491] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:01:37 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 06 11:01:38.043633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-be5c8348-0e7d-42ff-9146-3f0e2b0bf122 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:38.045483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-be5c8348-0e7d-42ff-9146-3f0e2b0bf122 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:38.061635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be5c8348-0e7d-42ff-9146-3f0e2b0bf122 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:38.062475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be5c8348-0e7d-42ff-9146-3f0e2b0bf122 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:38.063337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be5c8348-0e7d-42ff-9146-3f0e2b0bf122 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:38.065025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be5c8348-0e7d-42ff-9146-3f0e2b0bf122 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:38.068753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be5c8348-0e7d-42ff-9146-3f0e2b0bf122 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:38.070459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be5c8348-0e7d-42ff-9146-3f0e2b0bf122 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:38.077608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:38.082148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eebd2af2-0820-4316-9e77-f35bfd4591f9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:38.092877 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eebd2af2-0820-4316-9e77-f35bfd4591f9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1475 microversion: 2.1 time: 0.743065 Sep 06 11:01:38.107723 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1260/2492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:37 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1475 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:38.206278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-be5c8348-0e7d-42ff-9146-3f0e2b0bf122 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:38.226411 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-be5c8348-0e7d-42ff-9146-3f0e2b0bf122 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1288 microversion: 2.1 time: 0.189382 Sep 06 11:01:38.244142 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1233/2493] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:38 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1288 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:38.308417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-65b23eaa-84a6-437c-bdaf-28113bf07f2f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:38.309485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-65b23eaa-84a6-437c-bdaf-28113bf07f2f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:38.322993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65b23eaa-84a6-437c-bdaf-28113bf07f2f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:38.323849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65b23eaa-84a6-437c-bdaf-28113bf07f2f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:38.324736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65b23eaa-84a6-437c-bdaf-28113bf07f2f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:38.325782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65b23eaa-84a6-437c-bdaf-28113bf07f2f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:38.326469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65b23eaa-84a6-437c-bdaf-28113bf07f2f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:38.327155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65b23eaa-84a6-437c-bdaf-28113bf07f2f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:38.542096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:38.633257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-65b23eaa-84a6-437c-bdaf-28113bf07f2f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:38.656430 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-65b23eaa-84a6-437c-bdaf-28113bf07f2f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.356300 Sep 06 11:01:38.659729 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1261/2494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:38 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:39.134141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0c2fb6af-9674-48f3-b6a1-dc304d56e9b5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:39.135034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0c2fb6af-9674-48f3-b6a1-dc304d56e9b5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:39.143879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c2fb6af-9674-48f3-b6a1-dc304d56e9b5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:39.144650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c2fb6af-9674-48f3-b6a1-dc304d56e9b5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:39.145269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c2fb6af-9674-48f3-b6a1-dc304d56e9b5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:39.146258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c2fb6af-9674-48f3-b6a1-dc304d56e9b5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:39.146917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c2fb6af-9674-48f3-b6a1-dc304d56e9b5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:39.147566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c2fb6af-9674-48f3-b6a1-dc304d56e9b5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:39.258453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1d3addf1-143e-4de8-97c6-24e0839b3299 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:39.259226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1d3addf1-143e-4de8-97c6-24e0839b3299 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:39.266147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d3addf1-143e-4de8-97c6-24e0839b3299 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:39.266644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d3addf1-143e-4de8-97c6-24e0839b3299 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:39.267123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d3addf1-143e-4de8-97c6-24e0839b3299 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:39.267835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d3addf1-143e-4de8-97c6-24e0839b3299 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:39.268296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d3addf1-143e-4de8-97c6-24e0839b3299 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:39.268725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d3addf1-143e-4de8-97c6-24e0839b3299 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:39.497790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d3addf1-143e-4de8-97c6-24e0839b3299 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:39.530726 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1d3addf1-143e-4de8-97c6-24e0839b3299 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1276 microversion: 2.1 time: 0.277919 Sep 06 11:01:39.534168 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1262/2495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:39 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1276 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:39.556905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-998b0f61-4388-4a41-adb7-72803f5e19c0 req-406bd734-f011-4066-80c1-eaeb5b9528d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9db1902-3f12-48b6-a27f-425e4843424b", "name": "network-vif-unplugged", "status": "completed", "tag": "1fa7746e-916f-47fe-a1b6-1454c7592311"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:39.573349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-998b0f61-4388-4a41-adb7-72803f5e19c0 req-406bd734-f011-4066-80c1-eaeb5b9528d0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:39.573901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-998b0f61-4388-4a41-adb7-72803f5e19c0 req-406bd734-f011-4066-80c1-eaeb5b9528d0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:39.574527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-998b0f61-4388-4a41-adb7-72803f5e19c0 req-406bd734-f011-4066-80c1-eaeb5b9528d0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:39.590931 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-998b0f61-4388-4a41-adb7-72803f5e19c0 req-406bd734-f011-4066-80c1-eaeb5b9528d0 service nova] Creating event network-vif-unplugged:1fa7746e-916f-47fe-a1b6-1454c7592311 for instance d9db1902-3f12-48b6-a27f-425e4843424b on nch2-master-1 Sep 06 11:01:39.616116 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-998b0f61-4388-4a41-adb7-72803f5e19c0 req-406bd734-f011-4066-80c1-eaeb5b9528d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079767 Sep 06 11:01:39.619709 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1263/2496] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:39.697136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0dc744a9-a405-441f-a6d4-e22a4159f815 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:39.698056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0dc744a9-a405-441f-a6d4-e22a4159f815 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:39.701186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0c2fb6af-9674-48f3-b6a1-dc304d56e9b5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:39.708002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dc744a9-a405-441f-a6d4-e22a4159f815 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:39.708518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dc744a9-a405-441f-a6d4-e22a4159f815 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:39.709037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dc744a9-a405-441f-a6d4-e22a4159f815 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:39.710371 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0c2fb6af-9674-48f3-b6a1-dc304d56e9b5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1475 microversion: 2.1 time: 0.583898 Sep 06 11:01:39.710987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dc744a9-a405-441f-a6d4-e22a4159f815 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:39.711763 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1234/2497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:39 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1475 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:39.723994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dc744a9-a405-441f-a6d4-e22a4159f815 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:39.725365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dc744a9-a405-441f-a6d4-e22a4159f815 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:40.090494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0dc744a9-a405-441f-a6d4-e22a4159f815 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:40.098430 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0dc744a9-a405-441f-a6d4-e22a4159f815 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.412250 Sep 06 11:01:40.114954 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1264/2498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:39 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:40.557931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-87d17717-bf76-4756-b0f8-5915911a6d90 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:40.558555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-87d17717-bf76-4756-b0f8-5915911a6d90 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:40.577168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87d17717-bf76-4756-b0f8-5915911a6d90 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:40.580677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87d17717-bf76-4756-b0f8-5915911a6d90 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:40.597972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87d17717-bf76-4756-b0f8-5915911a6d90 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:40.614377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87d17717-bf76-4756-b0f8-5915911a6d90 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:40.614377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87d17717-bf76-4756-b0f8-5915911a6d90 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:40.614377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87d17717-bf76-4756-b0f8-5915911a6d90 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:40.737857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f6ada8fc-2723-4e54-b21c-27ff25566777 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:40.739306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f6ada8fc-2723-4e54-b21c-27ff25566777 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:40.766912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6ada8fc-2723-4e54-b21c-27ff25566777 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:40.767751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6ada8fc-2723-4e54-b21c-27ff25566777 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:40.771169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6ada8fc-2723-4e54-b21c-27ff25566777 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:40.772696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6ada8fc-2723-4e54-b21c-27ff25566777 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:40.773437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6ada8fc-2723-4e54-b21c-27ff25566777 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:40.774115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6ada8fc-2723-4e54-b21c-27ff25566777 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:41.218926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-87d17717-bf76-4756-b0f8-5915911a6d90 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:41.234641 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-87d17717-bf76-4756-b0f8-5915911a6d90 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1318 microversion: 2.1 time: 0.680478 Sep 06 11:01:41.235317 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1235/2499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:40 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1318 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:41.260021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-85d8ae11-a840-4140-bc71-3af5946c0970 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:41.260654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-85d8ae11-a840-4140-bc71-3af5946c0970 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:41.278977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85d8ae11-a840-4140-bc71-3af5946c0970 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:41.279403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85d8ae11-a840-4140-bc71-3af5946c0970 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:41.279853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85d8ae11-a840-4140-bc71-3af5946c0970 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:41.280628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85d8ae11-a840-4140-bc71-3af5946c0970 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:41.281171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85d8ae11-a840-4140-bc71-3af5946c0970 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:41.281608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85d8ae11-a840-4140-bc71-3af5946c0970 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:41.342271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f6ada8fc-2723-4e54-b21c-27ff25566777 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:41.351212 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f6ada8fc-2723-4e54-b21c-27ff25566777 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1475 microversion: 2.1 time: 0.620007 Sep 06 11:01:41.351802 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1265/2500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:40 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1475 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:41.682517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-85d8ae11-a840-4140-bc71-3af5946c0970 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:41.706385 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-85d8ae11-a840-4140-bc71-3af5946c0970 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1512 microversion: 2.1 time: 0.450867 Sep 06 11:01:41.724177 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1236/2501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:41 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1512 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:42.169597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-f0cb55ec-4933-4120-876d-78daa8bb4662 req-7b5d30c7-0ea3-454a-a78e-f5c0bfaec0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0610e78-f996-4342-a0c8-8ef481539a39", "tag": "98be110d-bd33-4cda-857e-725e035040fc"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:42.182896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f0cb55ec-4933-4120-876d-78daa8bb4662 req-7b5d30c7-0ea3-454a-a78e-f5c0bfaec0a9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:42.183420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f0cb55ec-4933-4120-876d-78daa8bb4662 req-7b5d30c7-0ea3-454a-a78e-f5c0bfaec0a9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:42.183864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f0cb55ec-4933-4120-876d-78daa8bb4662 req-7b5d30c7-0ea3-454a-a78e-f5c0bfaec0a9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:42.197461 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f0cb55ec-4933-4120-876d-78daa8bb4662 req-7b5d30c7-0ea3-454a-a78e-f5c0bfaec0a9 service nova] Creating event network-changed:98be110d-bd33-4cda-857e-725e035040fc for instance d0610e78-f996-4342-a0c8-8ef481539a39 on nch2-master-1 Sep 06 11:01:42.202550 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-f0cb55ec-4933-4120-876d-78daa8bb4662 req-7b5d30c7-0ea3-454a-a78e-f5c0bfaec0a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038315 Sep 06 11:01:42.203463 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1266/2502] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:42.262834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-53569641-b7f5-43bd-bc1b-39cf84b120a7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:42.263489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-53569641-b7f5-43bd-bc1b-39cf84b120a7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:42.269670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53569641-b7f5-43bd-bc1b-39cf84b120a7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:42.270166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53569641-b7f5-43bd-bc1b-39cf84b120a7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:42.270620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53569641-b7f5-43bd-bc1b-39cf84b120a7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:42.271372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53569641-b7f5-43bd-bc1b-39cf84b120a7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:42.272013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53569641-b7f5-43bd-bc1b-39cf84b120a7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:42.272451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53569641-b7f5-43bd-bc1b-39cf84b120a7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:42.378645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7445f545-84a1-406d-957f-e04bc2a38d47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:42.379726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7445f545-84a1-406d-957f-e04bc2a38d47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:42.387548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7445f545-84a1-406d-957f-e04bc2a38d47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:42.388058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7445f545-84a1-406d-957f-e04bc2a38d47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:42.388507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7445f545-84a1-406d-957f-e04bc2a38d47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:42.389420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7445f545-84a1-406d-957f-e04bc2a38d47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:42.389893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7445f545-84a1-406d-957f-e04bc2a38d47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:42.390329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7445f545-84a1-406d-957f-e04bc2a38d47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:43.062106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:43.122489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7445f545-84a1-406d-957f-e04bc2a38d47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:43.130713 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7445f545-84a1-406d-957f-e04bc2a38d47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1475 microversion: 2.1 time: 0.757128 Sep 06 11:01:43.131331 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1267/2503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:42 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1475 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:43.136966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d4747c04-f4b3-4d00-bdc6-8fc481e4dcc8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:43.137582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d4747c04-f4b3-4d00-bdc6-8fc481e4dcc8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:43.143437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4747c04-f4b3-4d00-bdc6-8fc481e4dcc8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:43.143866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4747c04-f4b3-4d00-bdc6-8fc481e4dcc8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:43.144316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4747c04-f4b3-4d00-bdc6-8fc481e4dcc8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:43.145013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4747c04-f4b3-4d00-bdc6-8fc481e4dcc8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:43.145483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4747c04-f4b3-4d00-bdc6-8fc481e4dcc8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:43.145922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4747c04-f4b3-4d00-bdc6-8fc481e4dcc8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:43.159817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-53569641-b7f5-43bd-bc1b-39cf84b120a7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:43.172057 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-53569641-b7f5-43bd-bc1b-39cf84b120a7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1318 microversion: 2.1 time: 0.913220 Sep 06 11:01:43.173278 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1237/2504] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:42 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1318 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:43.419598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ed0b7ded-448c-41a9-b179-8c7ee5329fbb req-fcad8bfb-3fa9-4513-a2e7-6e59abd0a73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9db1902-3f12-48b6-a27f-425e4843424b", "name": "network-vif-plugged", "status": "completed", "tag": "1fa7746e-916f-47fe-a1b6-1454c7592311"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:43.432324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ed0b7ded-448c-41a9-b179-8c7ee5329fbb req-fcad8bfb-3fa9-4513-a2e7-6e59abd0a73c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:43.433114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ed0b7ded-448c-41a9-b179-8c7ee5329fbb req-fcad8bfb-3fa9-4513-a2e7-6e59abd0a73c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:43.433888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ed0b7ded-448c-41a9-b179-8c7ee5329fbb req-fcad8bfb-3fa9-4513-a2e7-6e59abd0a73c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:43.449150 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ed0b7ded-448c-41a9-b179-8c7ee5329fbb req-fcad8bfb-3fa9-4513-a2e7-6e59abd0a73c service nova] Creating event network-vif-plugged:1fa7746e-916f-47fe-a1b6-1454c7592311 for instance d9db1902-3f12-48b6-a27f-425e4843424b on nch2-master-1 Sep 06 11:01:43.454396 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ed0b7ded-448c-41a9-b179-8c7ee5329fbb req-fcad8bfb-3fa9-4513-a2e7-6e59abd0a73c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040169 Sep 06 11:01:43.455455 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1238/2505] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:43.462396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:43.562869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d4747c04-f4b3-4d00-bdc6-8fc481e4dcc8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:43.583136 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d4747c04-f4b3-4d00-bdc6-8fc481e4dcc8 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1489 microversion: 2.1 time: 0.449692 Sep 06 11:01:43.584150 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1268/2506] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:43 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1489 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:43.610126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b543d3af-5a6a-42ab-b33b-955299b71152 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:43.611187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b543d3af-5a6a-42ab-b33b-955299b71152 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:43.620027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b543d3af-5a6a-42ab-b33b-955299b71152 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:43.620754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b543d3af-5a6a-42ab-b33b-955299b71152 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:43.621338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b543d3af-5a6a-42ab-b33b-955299b71152 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:43.622245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b543d3af-5a6a-42ab-b33b-955299b71152 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:43.622618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b543d3af-5a6a-42ab-b33b-955299b71152 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:43.623098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b543d3af-5a6a-42ab-b33b-955299b71152 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:43.650872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b543d3af-5a6a-42ab-b33b-955299b71152 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:01:43.942480 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b543d3af-5a6a-42ab-b33b-955299b71152 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 204 len: 0 microversion: 2.1 time: 0.336677 Sep 06 11:01:43.943275 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1239/2507] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:01:43 2022] DELETE /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:01:43.956165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1c69b54a-8344-42cf-aa8f-e782503da828 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:43.956843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1c69b54a-8344-42cf-aa8f-e782503da828 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:43.966598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c69b54a-8344-42cf-aa8f-e782503da828 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:43.966802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c69b54a-8344-42cf-aa8f-e782503da828 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:43.967219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c69b54a-8344-42cf-aa8f-e782503da828 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:43.967943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c69b54a-8344-42cf-aa8f-e782503da828 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:43.968462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c69b54a-8344-42cf-aa8f-e782503da828 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:43.968889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c69b54a-8344-42cf-aa8f-e782503da828 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:44.156579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-97407d98-fd31-459e-b4f9-168e434b71d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:44.157410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-97407d98-fd31-459e-b4f9-168e434b71d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:44.173235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97407d98-fd31-459e-b4f9-168e434b71d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:44.173235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97407d98-fd31-459e-b4f9-168e434b71d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:44.179304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97407d98-fd31-459e-b4f9-168e434b71d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:44.180281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97407d98-fd31-459e-b4f9-168e434b71d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:44.181392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97407d98-fd31-459e-b4f9-168e434b71d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:44.181392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97407d98-fd31-459e-b4f9-168e434b71d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:44.217702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1c69b54a-8344-42cf-aa8f-e782503da828 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:44.225887 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1c69b54a-8344-42cf-aa8f-e782503da828 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1495 microversion: 2.1 time: 0.273952 Sep 06 11:01:44.231548 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1269/2508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:43 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1495 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:44.247696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1717c915-798f-4dd8-8f0a-67a372227657 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:44.248374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1717c915-798f-4dd8-8f0a-67a372227657 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:44.262565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1717c915-798f-4dd8-8f0a-67a372227657 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:44.263092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1717c915-798f-4dd8-8f0a-67a372227657 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:44.263547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1717c915-798f-4dd8-8f0a-67a372227657 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:44.264274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1717c915-798f-4dd8-8f0a-67a372227657 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:44.264741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1717c915-798f-4dd8-8f0a-67a372227657 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:44.265175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1717c915-798f-4dd8-8f0a-67a372227657 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:44.652875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-97407d98-fd31-459e-b4f9-168e434b71d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:44.663375 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-97407d98-fd31-459e-b4f9-168e434b71d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1475 microversion: 2.1 time: 0.512315 Sep 06 11:01:44.664410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1717c915-798f-4dd8-8f0a-67a372227657 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:44.665549 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1240/2509] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:44 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1475 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:44.682122 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1717c915-798f-4dd8-8f0a-67a372227657 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1318 microversion: 2.1 time: 0.449098 Sep 06 11:01:44.687367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9e8adbcc-188d-4bd0-9971-29d0a5bad4ec req-8b984c1a-9bee-49eb-8faf-5f17c010323d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7010f81-896a-41e0-a729-74af2811a37f", "tag": "70cd59e8-08e7-4c5f-9c27-14f487ba2d7a"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:44.687602 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1270/2510] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:44 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:44.694343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=24 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:44.698363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9e8adbcc-188d-4bd0-9971-29d0a5bad4ec req-8b984c1a-9bee-49eb-8faf-5f17c010323d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:44.699115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9e8adbcc-188d-4bd0-9971-29d0a5bad4ec req-8b984c1a-9bee-49eb-8faf-5f17c010323d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:44.699799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9e8adbcc-188d-4bd0-9971-29d0a5bad4ec req-8b984c1a-9bee-49eb-8faf-5f17c010323d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:44.714670 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9e8adbcc-188d-4bd0-9971-29d0a5bad4ec req-8b984c1a-9bee-49eb-8faf-5f17c010323d service nova] Creating event network-changed:70cd59e8-08e7-4c5f-9c27-14f487ba2d7a for instance e7010f81-896a-41e0-a729-74af2811a37f on nch1-master-1 Sep 06 11:01:44.719964 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9e8adbcc-188d-4bd0-9971-29d0a5bad4ec req-8b984c1a-9bee-49eb-8faf-5f17c010323d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039223 Sep 06 11:01:44.720790 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1241/2511] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:45.260247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c7181116-86c3-4810-bf40-3210aa7d760b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:45.260892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c7181116-86c3-4810-bf40-3210aa7d760b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:45.285553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7181116-86c3-4810-bf40-3210aa7d760b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:45.286074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7181116-86c3-4810-bf40-3210aa7d760b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:45.286526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7181116-86c3-4810-bf40-3210aa7d760b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:45.293938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7181116-86c3-4810-bf40-3210aa7d760b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:45.297368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7181116-86c3-4810-bf40-3210aa7d760b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:45.297875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7181116-86c3-4810-bf40-3210aa7d760b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:45.311761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:45.691878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fe1097cc-4b25-4881-8231-93fa09ef6f17 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:45.692752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fe1097cc-4b25-4881-8231-93fa09ef6f17 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:45.706740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe1097cc-4b25-4881-8231-93fa09ef6f17 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:45.712813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe1097cc-4b25-4881-8231-93fa09ef6f17 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:45.712813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe1097cc-4b25-4881-8231-93fa09ef6f17 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:45.712813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe1097cc-4b25-4881-8231-93fa09ef6f17 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:45.715701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe1097cc-4b25-4881-8231-93fa09ef6f17 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:45.717633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe1097cc-4b25-4881-8231-93fa09ef6f17 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:45.894947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c7181116-86c3-4810-bf40-3210aa7d760b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:45.913993 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c7181116-86c3-4810-bf40-3210aa7d760b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1495 microversion: 2.1 time: 0.660440 Sep 06 11:01:45.914596 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1271/2512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:45 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1495 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:45.942174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f40c1156-3870-4eeb-837a-8248c6ced60d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:45.942802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f40c1156-3870-4eeb-837a-8248c6ced60d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:45.965127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f40c1156-3870-4eeb-837a-8248c6ced60d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:45.965642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f40c1156-3870-4eeb-837a-8248c6ced60d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:45.966082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f40c1156-3870-4eeb-837a-8248c6ced60d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:45.966985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f40c1156-3870-4eeb-837a-8248c6ced60d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:45.971924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f40c1156-3870-4eeb-837a-8248c6ced60d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:45.973652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f40c1156-3870-4eeb-837a-8248c6ced60d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:46.143746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fe1097cc-4b25-4881-8231-93fa09ef6f17 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:46.155715 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fe1097cc-4b25-4881-8231-93fa09ef6f17 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1475 microversion: 2.1 time: 0.467434 Sep 06 11:01:46.175558 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1242/2513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:45 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1475 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:46.316545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f40c1156-3870-4eeb-837a-8248c6ced60d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:46.345159 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f40c1156-3870-4eeb-837a-8248c6ced60d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1318 microversion: 2.1 time: 0.411345 Sep 06 11:01:46.366036 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1272/2514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:45 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:46.947642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9e99464b-c71c-4718-91a9-c392cb675d13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:46.948254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9e99464b-c71c-4718-91a9-c392cb675d13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:46.956673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e99464b-c71c-4718-91a9-c392cb675d13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:46.957448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e99464b-c71c-4718-91a9-c392cb675d13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:46.958048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e99464b-c71c-4718-91a9-c392cb675d13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:46.958968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e99464b-c71c-4718-91a9-c392cb675d13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:46.978503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e99464b-c71c-4718-91a9-c392cb675d13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:46.979354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e99464b-c71c-4718-91a9-c392cb675d13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:47.076298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1113467801", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "7b8bb435-4834-446e-ae66-8a7844957930"}, {"uuid": "541c0753-1994-4e8e-9ef6-82cb5c80712c"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:47.268236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] validate_networks() for [('7b8bb435-4834-446e-ae66-8a7844957930', None, None, None, None, None), ('541c0753-1994-4e8e-9ef6-82cb5c80712c', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:01:47.298410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9e99464b-c71c-4718-91a9-c392cb675d13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:47.325357 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9e99464b-c71c-4718-91a9-c392cb675d13 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1495 microversion: 2.1 time: 0.385505 Sep 06 11:01:47.326510 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1243/2515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:46 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1495 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:47.332430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c2d600bf-45ed-4bfe-8620-e1d6738bb9d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:47.333374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c2d600bf-45ed-4bfe-8620-e1d6738bb9d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:47.355130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2d600bf-45ed-4bfe-8620-e1d6738bb9d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:47.355718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2d600bf-45ed-4bfe-8620-e1d6738bb9d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:47.356180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2d600bf-45ed-4bfe-8620-e1d6738bb9d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:47.356968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2d600bf-45ed-4bfe-8620-e1d6738bb9d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:47.363412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2d600bf-45ed-4bfe-8620-e1d6738bb9d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:47.376304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2d600bf-45ed-4bfe-8620-e1d6738bb9d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:47.726513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c2d600bf-45ed-4bfe-8620-e1d6738bb9d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:47.750773 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c2d600bf-45ed-4bfe-8620-e1d6738bb9d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1475 microversion: 2.1 time: 0.418979 Sep 06 11:01:47.751717 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1244/2516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:47 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1475 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:47.762894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7700b791-5dea-48cd-970c-d31246dc4ff8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:47.764956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7700b791-5dea-48cd-970c-d31246dc4ff8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:47.784324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7700b791-5dea-48cd-970c-d31246dc4ff8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:47.789334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7700b791-5dea-48cd-970c-d31246dc4ff8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:47.789334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7700b791-5dea-48cd-970c-d31246dc4ff8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:47.789334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7700b791-5dea-48cd-970c-d31246dc4ff8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:47.789334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7700b791-5dea-48cd-970c-d31246dc4ff8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:47.789334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7700b791-5dea-48cd-970c-d31246dc4ff8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:48.578552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7700b791-5dea-48cd-970c-d31246dc4ff8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:48.601487 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7700b791-5dea-48cd-970c-d31246dc4ff8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1318 microversion: 2.1 time: 0.845846 Sep 06 11:01:48.607995 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1245/2517] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:47 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1318 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:48.634506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6fd63bc7-08c5-4cc6-a5b4-e148a2ce07f5 req-36757d07-a83f-4de1-9942-456c59a1a669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98250008-de3d-4d5c-8b09-152eadba1601", "name": "network-vif-deleted", "tag": "f3e0bff0-ed11-4125-8356-50bdbb50710e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:48.661710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:48.666909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6fd63bc7-08c5-4cc6-a5b4-e148a2ce07f5 req-36757d07-a83f-4de1-9942-456c59a1a669 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:48.671817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6fd63bc7-08c5-4cc6-a5b4-e148a2ce07f5 req-36757d07-a83f-4de1-9942-456c59a1a669 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:48.672502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6fd63bc7-08c5-4cc6-a5b4-e148a2ce07f5 req-36757d07-a83f-4de1-9942-456c59a1a669 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:48.735105 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6fd63bc7-08c5-4cc6-a5b4-e148a2ce07f5 req-36757d07-a83f-4de1-9942-456c59a1a669 service nova] Creating event network-vif-deleted:f3e0bff0-ed11-4125-8356-50bdbb50710e for instance 98250008-de3d-4d5c-8b09-152eadba1601 on nch1-master-1 Sep 06 11:01:48.772206 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6fd63bc7-08c5-4cc6-a5b4-e148a2ce07f5 req-36757d07-a83f-4de1-9942-456c59a1a669 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161742 Sep 06 11:01:48.780086 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1246/2518] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:48.803055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:48.808874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:48.846274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:48.848763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:48.850601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:48.854582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:48.856483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:48.858366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:49.035727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:49.036612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:49.038461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:49.041471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lazy-loading 'fault' on Instance uuid 98250008-de3d-4d5c-8b09-152eadba1601 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:01:49.328003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:49.357532 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e4fa411e-661b-45ac-9341-d6bea8e77d7a tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 200 len: 1305 microversion: 2.1 time: 0.574562 Sep 06 11:01:49.359325 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1247/2519] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:48 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 1305 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:49.384651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cde7c536-cfa4-4e9c-b559-bdc462f8c231 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:49.385327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cde7c536-cfa4-4e9c-b559-bdc462f8c231 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:49.403140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cde7c536-cfa4-4e9c-b559-bdc462f8c231 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:49.403811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cde7c536-cfa4-4e9c-b559-bdc462f8c231 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:49.404265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cde7c536-cfa4-4e9c-b559-bdc462f8c231 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:49.404981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cde7c536-cfa4-4e9c-b559-bdc462f8c231 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:49.405442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cde7c536-cfa4-4e9c-b559-bdc462f8c231 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:49.405872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cde7c536-cfa4-4e9c-b559-bdc462f8c231 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:49.605167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:01:49.606266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:01:49.606920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:01:49.607518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:01:49.608101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:01:49.611605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:49.627296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:49.630578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:49.632919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:49.634114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:49.637173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:49.637914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:49.698817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Getting quotas for project 91b83e289c414e499c91fc7f711774b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:01:49.725739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Getting quotas for user 99ebe881ffd44893879bb9e7ab63c9fd and project 91b83e289c414e499c91fc7f711774b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:01:49.759171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:01:49.768743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:01:49.910486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cde7c536-cfa4-4e9c-b559-bdc462f8c231 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:49.933478 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cde7c536-cfa4-4e9c-b559-bdc462f8c231 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1474 microversion: 2.1 time: 0.570797 Sep 06 11:01:49.935364 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1248/2520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:49 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1474 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:49.967330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-8af6b39f-3cfd-4ea1-b9b9-5321a3b433be req-b3d9b9d4-30a9-4bf2-97a1-e0855b163497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc46dc01-cd54-44a1-a379-0b0f8ff43991", "name": "network-vif-unplugged", "status": "completed", "tag": "17d26200-b9e0-4b27-90ee-4779abc2a65e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:49.995783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8af6b39f-3cfd-4ea1-b9b9-5321a3b433be req-b3d9b9d4-30a9-4bf2-97a1-e0855b163497 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:49.997613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8af6b39f-3cfd-4ea1-b9b9-5321a3b433be req-b3d9b9d4-30a9-4bf2-97a1-e0855b163497 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:49.998093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8af6b39f-3cfd-4ea1-b9b9-5321a3b433be req-b3d9b9d4-30a9-4bf2-97a1-e0855b163497 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:49.998290 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9274e603-edb6-48a7-b7ce-75d596258ff3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.944258 Sep 06 11:01:50.025685 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1273/2521] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:01:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:01:50.030848 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-8af6b39f-3cfd-4ea1-b9b9-5321a3b433be req-b3d9b9d4-30a9-4bf2-97a1-e0855b163497 service nova] Creating event network-vif-unplugged:17d26200-b9e0-4b27-90ee-4779abc2a65e for instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 on nch2-master-1 Sep 06 11:01:50.034370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ccf5d92e-8eac-4928-b0ef-78581f18cc0e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:50.043114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-8af6b39f-3cfd-4ea1-b9b9-5321a3b433be req-b3d9b9d4-30a9-4bf2-97a1-e0855b163497 service nova] Instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:01:50.046212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ccf5d92e-8eac-4928-b0ef-78581f18cc0e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:50.067408 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-8af6b39f-3cfd-4ea1-b9b9-5321a3b433be req-b3d9b9d4-30a9-4bf2-97a1-e0855b163497 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107259 Sep 06 11:01:50.071673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf5d92e-8eac-4928-b0ef-78581f18cc0e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:50.074080 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1249/2522] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:50.075489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf5d92e-8eac-4928-b0ef-78581f18cc0e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:50.080147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf5d92e-8eac-4928-b0ef-78581f18cc0e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:50.081152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf5d92e-8eac-4928-b0ef-78581f18cc0e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:50.082150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c1a767e0-8ac5-41e5-9bfa-c1c7b7430e2c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:50.083154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf5d92e-8eac-4928-b0ef-78581f18cc0e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:50.083364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c1a767e0-8ac5-41e5-9bfa-c1c7b7430e2c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:50.083942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf5d92e-8eac-4928-b0ef-78581f18cc0e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:50.845780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c1a767e0-8ac5-41e5-9bfa-c1c7b7430e2c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:50.859091 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c1a767e0-8ac5-41e5-9bfa-c1c7b7430e2c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1213 microversion: 2.1 time: 0.783346 Sep 06 11:01:50.862386 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1250/2523] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:50 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1213 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:50.873467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-20dc4b38-acf5-4883-b2d0-4f8cf15d142e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:50.881437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-20dc4b38-acf5-4883-b2d0-4f8cf15d142e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:50.912531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20dc4b38-acf5-4883-b2d0-4f8cf15d142e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:50.915106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20dc4b38-acf5-4883-b2d0-4f8cf15d142e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:50.915677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20dc4b38-acf5-4883-b2d0-4f8cf15d142e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:50.916828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20dc4b38-acf5-4883-b2d0-4f8cf15d142e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:50.919663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20dc4b38-acf5-4883-b2d0-4f8cf15d142e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:50.920749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20dc4b38-acf5-4883-b2d0-4f8cf15d142e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:50.927388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:50.940480 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-20dc4b38-acf5-4883-b2d0-4f8cf15d142e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-20dc4b38-acf5-4883-b2d0-4f8cf15d142e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 HTTP/1.1 Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '98250008-de3d-4d5c-8b09-152eadba1601'} Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:50.948642 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:01:50.953302 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:50.953302 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:50.953302 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:50.953302 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:01:50.953302 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:01:50.953302 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:01:50.953302 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:01:50.953302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-20dc4b38-acf5-4883-b2d0-4f8cf15d142e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:01:50.953302 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-20dc4b38-acf5-4883-b2d0-4f8cf15d142e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 404 len: 111 microversion: 2.1 time: 0.080991 Sep 06 11:01:50.953302 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1251/2524] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:50 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:01:50.963115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-31c39002-554a-49c7-a7f7-f1bc66aac1fb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:50.964066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-31c39002-554a-49c7-a7f7-f1bc66aac1fb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:50.998514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31c39002-554a-49c7-a7f7-f1bc66aac1fb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:51.000375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31c39002-554a-49c7-a7f7-f1bc66aac1fb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:51.001405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31c39002-554a-49c7-a7f7-f1bc66aac1fb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:51.003786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31c39002-554a-49c7-a7f7-f1bc66aac1fb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:51.006659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31c39002-554a-49c7-a7f7-f1bc66aac1fb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:51.009086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31c39002-554a-49c7-a7f7-f1bc66aac1fb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:51.095622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ccf5d92e-8eac-4928-b0ef-78581f18cc0e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:51.108331 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ccf5d92e-8eac-4928-b0ef-78581f18cc0e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1318 microversion: 2.1 time: 1.080950 Sep 06 11:01:51.111691 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1274/2525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:50 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1318 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:51.147185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-149791078", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "9312fcea-ff98-4f9b-847c-17d6e7290268"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:51.277556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] validate_networks() for [('9312fcea-ff98-4f9b-847c-17d6e7290268', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:01:52.026379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-31c39002-554a-49c7-a7f7-f1bc66aac1fb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:52.056748 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-31c39002-554a-49c7-a7f7-f1bc66aac1fb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1474 microversion: 2.1 time: 1.097877 Sep 06 11:01:52.085012 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1252/2526] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:50 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1474 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:52.114870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b5409581-74eb-41c4-9a24-d45cc5a24270 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:52.120758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b5409581-74eb-41c4-9a24-d45cc5a24270 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:52.156305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5409581-74eb-41c4-9a24-d45cc5a24270 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:52.156870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5409581-74eb-41c4-9a24-d45cc5a24270 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:52.157335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5409581-74eb-41c4-9a24-d45cc5a24270 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:52.158190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5409581-74eb-41c4-9a24-d45cc5a24270 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:52.158723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5409581-74eb-41c4-9a24-d45cc5a24270 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:52.159210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5409581-74eb-41c4-9a24-d45cc5a24270 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:52.484656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b5409581-74eb-41c4-9a24-d45cc5a24270 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:52.500264 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b5409581-74eb-41c4-9a24-d45cc5a24270 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1217 microversion: 2.1 time: 0.408847 Sep 06 11:01:52.511041 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1253/2527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:52 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1217 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:52.522894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-59a1503f-f154-4f56-9f9c-e5baad6fe774 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:52.522894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-59a1503f-f154-4f56-9f9c-e5baad6fe774 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:52.545028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59a1503f-f154-4f56-9f9c-e5baad6fe774 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:52.550647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59a1503f-f154-4f56-9f9c-e5baad6fe774 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:52.551309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59a1503f-f154-4f56-9f9c-e5baad6fe774 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:52.552407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59a1503f-f154-4f56-9f9c-e5baad6fe774 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:52.553004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59a1503f-f154-4f56-9f9c-e5baad6fe774 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:52.553564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59a1503f-f154-4f56-9f9c-e5baad6fe774 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:52.960746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-59a1503f-f154-4f56-9f9c-e5baad6fe774 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:52.988578 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-59a1503f-f154-4f56-9f9c-e5baad6fe774 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1318 microversion: 2.1 time: 0.476882 Sep 06 11:01:52.993682 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1254/2528] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:52 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:53.030658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-3b595fe1-c909-43e0-9b9d-d3e96becb9ef req-2744ea20-c978-4eb0-8bed-dfb8cbc37681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0610e78-f996-4342-a0c8-8ef481539a39", "name": "network-vif-plugged", "status": "completed", "tag": "98be110d-bd33-4cda-857e-725e035040fc"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:53.044328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3b595fe1-c909-43e0-9b9d-d3e96becb9ef req-2744ea20-c978-4eb0-8bed-dfb8cbc37681 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:53.045166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3b595fe1-c909-43e0-9b9d-d3e96becb9ef req-2744ea20-c978-4eb0-8bed-dfb8cbc37681 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:53.045804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3b595fe1-c909-43e0-9b9d-d3e96becb9ef req-2744ea20-c978-4eb0-8bed-dfb8cbc37681 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:53.060232 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-3b595fe1-c909-43e0-9b9d-d3e96becb9ef req-2744ea20-c978-4eb0-8bed-dfb8cbc37681 service nova] Creating event network-vif-plugged:98be110d-bd33-4cda-857e-725e035040fc for instance d0610e78-f996-4342-a0c8-8ef481539a39 on nch2-master-1 Sep 06 11:01:53.066937 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-3b595fe1-c909-43e0-9b9d-d3e96becb9ef req-2744ea20-c978-4eb0-8bed-dfb8cbc37681 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040378 Sep 06 11:01:53.069396 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1255/2529] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:01:53.092286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c26b4390-33e9-4829-81d5-c8bbf735e0f0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:53.109817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c26b4390-33e9-4829-81d5-c8bbf735e0f0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:53.117251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c26b4390-33e9-4829-81d5-c8bbf735e0f0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:53.118059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c26b4390-33e9-4829-81d5-c8bbf735e0f0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:53.118687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c26b4390-33e9-4829-81d5-c8bbf735e0f0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:53.119607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c26b4390-33e9-4829-81d5-c8bbf735e0f0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:53.120080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c26b4390-33e9-4829-81d5-c8bbf735e0f0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:53.120529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c26b4390-33e9-4829-81d5-c8bbf735e0f0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:53.207749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:01:53.208291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:01:53.209645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:01:53.210215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:01:53.210883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:01:53.226113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:53.226113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:53.226113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:53.226113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:53.227782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:53.228483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:53.303316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:01:53.317897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Getting quotas for user e19903666a1243e3a66411e30babe299 and project 4061aad7f45b4c6192c02f3179d13687. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:01:53.389345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:01:53.392268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:01:53.722118 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cae1b093-dd4c-44a7-8ebd-f193edc7c543 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.578809 Sep 06 11:01:53.723737 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1275/2530] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:01:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:01:53.733262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-943ee6ce-fa29-42ea-a6ce-fd7090d00485 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:53.734247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-943ee6ce-fa29-42ea-a6ce-fd7090d00485 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:53.743500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-943ee6ce-fa29-42ea-a6ce-fd7090d00485 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:53.745059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-943ee6ce-fa29-42ea-a6ce-fd7090d00485 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:53.745879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-943ee6ce-fa29-42ea-a6ce-fd7090d00485 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:53.747548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-943ee6ce-fa29-42ea-a6ce-fd7090d00485 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:53.748282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-943ee6ce-fa29-42ea-a6ce-fd7090d00485 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:53.749005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-943ee6ce-fa29-42ea-a6ce-fd7090d00485 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:53.792842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c26b4390-33e9-4829-81d5-c8bbf735e0f0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:53.835244 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c26b4390-33e9-4829-81d5-c8bbf735e0f0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1474 microversion: 2.1 time: 0.744632 Sep 06 11:01:53.840068 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1256/2531] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:53 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1474 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:53.877080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e1aac2f2-c866-4422-a655-cb81e5c67ceb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:53.877080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e1aac2f2-c866-4422-a655-cb81e5c67ceb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:54.093782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-943ee6ce-fa29-42ea-a6ce-fd7090d00485 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:54.104410 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-943ee6ce-fa29-42ea-a6ce-fd7090d00485 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1265 microversion: 2.1 time: 0.379183 Sep 06 11:01:54.104991 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1276/2532] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:53 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1265 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:54.138778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5f190323-c615-486e-819e-f448371e2d3e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:54.139821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5f190323-c615-486e-819e-f448371e2d3e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:54.148187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f190323-c615-486e-819e-f448371e2d3e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:54.149634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f190323-c615-486e-819e-f448371e2d3e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:54.150609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f190323-c615-486e-819e-f448371e2d3e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:54.151512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f190323-c615-486e-819e-f448371e2d3e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:54.152150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f190323-c615-486e-819e-f448371e2d3e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:54.152684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f190323-c615-486e-819e-f448371e2d3e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:54.223891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e1aac2f2-c866-4422-a655-cb81e5c67ceb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:54.234879 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e1aac2f2-c866-4422-a655-cb81e5c67ceb tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1214 microversion: 2.1 time: 0.392209 Sep 06 11:01:54.239660 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1257/2533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:53 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1214 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:54.266605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-c256d68f-07ba-4693-b1df-26102f1d2c1e req-3e48b19f-cd40-45a5-a0fd-56df2b2fe74b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc46dc01-cd54-44a1-a379-0b0f8ff43991", "tag": "17d26200-b9e0-4b27-90ee-4779abc2a65e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:54.295942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c256d68f-07ba-4693-b1df-26102f1d2c1e req-3e48b19f-cd40-45a5-a0fd-56df2b2fe74b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:54.297637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c256d68f-07ba-4693-b1df-26102f1d2c1e req-3e48b19f-cd40-45a5-a0fd-56df2b2fe74b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:54.302629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c256d68f-07ba-4693-b1df-26102f1d2c1e req-3e48b19f-cd40-45a5-a0fd-56df2b2fe74b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:54.368184 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-c256d68f-07ba-4693-b1df-26102f1d2c1e req-3e48b19f-cd40-45a5-a0fd-56df2b2fe74b service nova] Creating event network-changed:17d26200-b9e0-4b27-90ee-4779abc2a65e for instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 on nch2-master-1 Sep 06 11:01:54.384132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-c256d68f-07ba-4693-b1df-26102f1d2c1e req-3e48b19f-cd40-45a5-a0fd-56df2b2fe74b service nova] Instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:01:54.408360 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-c256d68f-07ba-4693-b1df-26102f1d2c1e req-3e48b19f-cd40-45a5-a0fd-56df2b2fe74b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153651 Sep 06 11:01:54.409755 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1258/2534] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:54.629732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5f190323-c615-486e-819e-f448371e2d3e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:54.645411 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5f190323-c615-486e-819e-f448371e2d3e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1318 microversion: 2.1 time: 0.509741 Sep 06 11:01:54.646773 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1277/2535] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:54 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:54.870034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9628e638-70d2-42cb-904e-253d107d3810 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:54.870876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9628e638-70d2-42cb-904e-253d107d3810 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:54.899922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9628e638-70d2-42cb-904e-253d107d3810 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:54.900427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9628e638-70d2-42cb-904e-253d107d3810 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:54.900879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9628e638-70d2-42cb-904e-253d107d3810 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:54.901608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9628e638-70d2-42cb-904e-253d107d3810 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:54.902079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9628e638-70d2-42cb-904e-253d107d3810 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:54.902511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9628e638-70d2-42cb-904e-253d107d3810 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:55.152019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a069f17-160d-4c66-9574-84eeebc1408f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:55.155992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9a069f17-160d-4c66-9574-84eeebc1408f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:55.182625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a069f17-160d-4c66-9574-84eeebc1408f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:55.192818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a069f17-160d-4c66-9574-84eeebc1408f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:55.196677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a069f17-160d-4c66-9574-84eeebc1408f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:55.199115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a069f17-160d-4c66-9574-84eeebc1408f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:55.199115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a069f17-160d-4c66-9574-84eeebc1408f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:55.206594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a069f17-160d-4c66-9574-84eeebc1408f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:55.493480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9a069f17-160d-4c66-9574-84eeebc1408f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:55.504610 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a069f17-160d-4c66-9574-84eeebc1408f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1271 microversion: 2.1 time: 0.368916 Sep 06 11:01:55.516645 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1278/2536] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:55 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1271 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:55.556203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-dade8914-5469-4bd9-8116-9a8ea9428f23 req-e3aa7f8c-f652-40c4-97fa-b26286ee6004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7010f81-896a-41e0-a729-74af2811a37f", "name": "network-vif-plugged", "status": "completed", "tag": "70cd59e8-08e7-4c5f-9c27-14f487ba2d7a"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:55.589679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9628e638-70d2-42cb-904e-253d107d3810 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:55.609738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dade8914-5469-4bd9-8116-9a8ea9428f23 req-e3aa7f8c-f652-40c4-97fa-b26286ee6004 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:55.611814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dade8914-5469-4bd9-8116-9a8ea9428f23 req-e3aa7f8c-f652-40c4-97fa-b26286ee6004 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:55.612758 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9628e638-70d2-42cb-904e-253d107d3810 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1474 microversion: 2.1 time: 0.735265 Sep 06 11:01:55.614100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dade8914-5469-4bd9-8116-9a8ea9428f23 req-e3aa7f8c-f652-40c4-97fa-b26286ee6004 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:55.625511 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1259/2537] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:54 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1474 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:55.639481 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-dade8914-5469-4bd9-8116-9a8ea9428f23 req-e3aa7f8c-f652-40c4-97fa-b26286ee6004 service nova] Creating event network-vif-plugged:70cd59e8-08e7-4c5f-9c27-14f487ba2d7a for instance e7010f81-896a-41e0-a729-74af2811a37f on nch1-master-1 Sep 06 11:01:55.653736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-43c0af05-179f-4f38-9e81-6327a923898e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:55.654641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-43c0af05-179f-4f38-9e81-6327a923898e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:55.685033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43c0af05-179f-4f38-9e81-6327a923898e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:55.686683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43c0af05-179f-4f38-9e81-6327a923898e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:55.693326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43c0af05-179f-4f38-9e81-6327a923898e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:55.698810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43c0af05-179f-4f38-9e81-6327a923898e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:55.699656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43c0af05-179f-4f38-9e81-6327a923898e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:55.700332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43c0af05-179f-4f38-9e81-6327a923898e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:55.721104 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-dade8914-5469-4bd9-8116-9a8ea9428f23 req-e3aa7f8c-f652-40c4-97fa-b26286ee6004 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170951 Sep 06 11:01:55.734163 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1279/2538] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:55.747044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6844e6e0-b43a-4f05-b86a-dffd18fa1c9c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:55.748055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6844e6e0-b43a-4f05-b86a-dffd18fa1c9c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:55.759669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6844e6e0-b43a-4f05-b86a-dffd18fa1c9c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:55.760874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6844e6e0-b43a-4f05-b86a-dffd18fa1c9c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:55.762427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6844e6e0-b43a-4f05-b86a-dffd18fa1c9c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:55.763533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6844e6e0-b43a-4f05-b86a-dffd18fa1c9c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:55.764351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6844e6e0-b43a-4f05-b86a-dffd18fa1c9c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:55.764969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6844e6e0-b43a-4f05-b86a-dffd18fa1c9c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:56.100473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-43c0af05-179f-4f38-9e81-6327a923898e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:56.112090 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-43c0af05-179f-4f38-9e81-6327a923898e tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1218 microversion: 2.1 time: 0.474603 Sep 06 11:01:56.112845 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1260/2539] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:55 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1218 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:56.500162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6844e6e0-b43a-4f05-b86a-dffd18fa1c9c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:56.510613 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6844e6e0-b43a-4f05-b86a-dffd18fa1c9c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1318 microversion: 2.1 time: 0.776554 Sep 06 11:01:56.511697 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1280/2540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:55 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:56.538527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0dc3bedd-1ced-4b4d-8ebf-1066fadd81eb tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:56.539563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0dc3bedd-1ced-4b4d-8ebf-1066fadd81eb tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:56.548127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dc3bedd-1ced-4b4d-8ebf-1066fadd81eb tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:56.548874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dc3bedd-1ced-4b4d-8ebf-1066fadd81eb tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:56.552418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dc3bedd-1ced-4b4d-8ebf-1066fadd81eb tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:56.553557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dc3bedd-1ced-4b4d-8ebf-1066fadd81eb tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:56.554218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dc3bedd-1ced-4b4d-8ebf-1066fadd81eb tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:56.554852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dc3bedd-1ced-4b4d-8ebf-1066fadd81eb tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:56.649720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-44dc19d7-97eb-4174-8954-65fd4f466b62 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:56.650422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-44dc19d7-97eb-4174-8954-65fd4f466b62 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:56.661681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44dc19d7-97eb-4174-8954-65fd4f466b62 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:56.662191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44dc19d7-97eb-4174-8954-65fd4f466b62 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:56.662644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44dc19d7-97eb-4174-8954-65fd4f466b62 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:56.669798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44dc19d7-97eb-4174-8954-65fd4f466b62 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:56.670331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44dc19d7-97eb-4174-8954-65fd4f466b62 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:56.672223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44dc19d7-97eb-4174-8954-65fd4f466b62 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:56.762951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0dc3bedd-1ced-4b4d-8ebf-1066fadd81eb tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:56.774167 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0dc3bedd-1ced-4b4d-8ebf-1066fadd81eb tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1271 microversion: 2.1 time: 0.239626 Sep 06 11:01:56.780130 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1261/2541] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:56 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:57.137016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84100a53-5961-44b6-8384-b26efcde2a5c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:57.138015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-84100a53-5961-44b6-8384-b26efcde2a5c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:57.151179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84100a53-5961-44b6-8384-b26efcde2a5c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:57.155616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84100a53-5961-44b6-8384-b26efcde2a5c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:57.157163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84100a53-5961-44b6-8384-b26efcde2a5c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:57.158045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84100a53-5961-44b6-8384-b26efcde2a5c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:57.160602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84100a53-5961-44b6-8384-b26efcde2a5c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:57.162425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84100a53-5961-44b6-8384-b26efcde2a5c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:57.234635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-44dc19d7-97eb-4174-8954-65fd4f466b62 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:57.248738 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-44dc19d7-97eb-4174-8954-65fd4f466b62 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1474 microversion: 2.1 time: 0.607848 Sep 06 11:01:57.249514 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1281/2542] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:56 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1474 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:57.335806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-84100a53-5961-44b6-8384-b26efcde2a5c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:57.361609 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84100a53-5961-44b6-8384-b26efcde2a5c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1266 microversion: 2.1 time: 0.217277 Sep 06 11:01:57.361609 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1262/2543] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:57 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:57.540298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4ad867c5-3898-43fb-9c2f-838122ccc6c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:57.540934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4ad867c5-3898-43fb-9c2f-838122ccc6c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:57.553121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ad867c5-3898-43fb-9c2f-838122ccc6c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:57.562470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ad867c5-3898-43fb-9c2f-838122ccc6c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:57.562470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ad867c5-3898-43fb-9c2f-838122ccc6c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:57.562470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ad867c5-3898-43fb-9c2f-838122ccc6c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:57.562470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ad867c5-3898-43fb-9c2f-838122ccc6c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:57.562470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ad867c5-3898-43fb-9c2f-838122ccc6c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:57.809571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0f21e906-9b86-4cd8-978d-f45f0a3251d9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:57.810930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0f21e906-9b86-4cd8-978d-f45f0a3251d9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:57.822874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f21e906-9b86-4cd8-978d-f45f0a3251d9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:57.824005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f21e906-9b86-4cd8-978d-f45f0a3251d9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:57.824644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f21e906-9b86-4cd8-978d-f45f0a3251d9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:57.825814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f21e906-9b86-4cd8-978d-f45f0a3251d9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:57.826668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f21e906-9b86-4cd8-978d-f45f0a3251d9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:57.827297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f21e906-9b86-4cd8-978d-f45f0a3251d9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:57.879575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4ad867c5-3898-43fb-9c2f-838122ccc6c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:57.898329 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4ad867c5-3898-43fb-9c2f-838122ccc6c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1318 microversion: 2.1 time: 0.363848 Sep 06 11:01:57.901629 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1282/2544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:57 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:58.081652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-00e54082-d9be-49b4-9399-af04c2ab45f0 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Calling method '.version_select at 0x7f90f3751d30>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:58.096018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0f21e906-9b86-4cd8-978d-f45f0a3251d9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:58.107111 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0f21e906-9b86-4cd8-978d-f45f0a3251d9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1313 microversion: 2.1 time: 0.304578 Sep 06 11:01:58.108882 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1263/2545] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:57 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:58.113315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-00e54082-d9be-49b4-9399-af04c2ab45f0 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c8504db-aab3-42c2-bf31-ec95a7517b4f does not exist", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 11:01:58.113920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.security_group_api [None req-00e54082-d9be-49b4-9399-af04c2ab45f0 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Neutron security group 7c8504db-aab3-42c2-bf31-ec95a7517b4f not found {{(pid=140876) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-00e54082-d9be-49b4-9399-af04c2ab45f0 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] HTTP exception thrown: Security group 7c8504db-aab3-42c2-bf31-ec95a7517b4f does not exist Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-52e5500f-aa8c-4e89-bd82-640d73709641'] Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-00e54082-d9be-49b4-9399-af04c2ab45f0 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Request method failure captured: Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-security-groups/7c8504db-aab3-42c2-bf31-ec95a7517b4f HTTP/1.1 Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyilQyupxCqj9x8LqqEPckQkiu_zBScgGhyn0ArforLfb4nABOwwbrxumjpmfLporMO6yacobpi7ZFnHn5-nali8USNotGxgUFg_cyKSuHmpzbsisfPco6NGmMkW7ldFjEIYLKi7QDyFAwSBHfUUMYjYzCqNTSk1mu4dgVyKeUe6t44 Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: a953396744854dcba117451ace5815de Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-760535780 Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a953396744854dcba117451ace5815de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a953396744854dcba117451ace5815de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a953396744854dcba117451ace5815de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a953396744854dcba117451ace5815de"}]}] Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-760535780 Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: a953396744854dcba117451ace5815de Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-760535780 Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsNegativeTestJSON-760535780-project Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d53d3a5df7974a03ad02b5ceca6f4425 Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-760535780-project Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: exception: Security group 7c8504db-aab3-42c2-bf31-ec95a7517b4f does not exist Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-52e5500f-aa8c-4e89-bd82-640d73709641'] Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '7c8504db-aab3-42c2-bf31-ec95a7517b4f'} Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 11:01:58.117440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7c8504db-aab3-42c2-bf31-ec95a7517b4f does not exist Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52e5500f-aa8c-4e89-bd82-640d73709641'] Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7c8504db-aab3-42c2-bf31-ec95a7517b4f does not exist Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52e5500f-aa8c-4e89-bd82-640d73709641'] Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7c8504db-aab3-42c2-bf31-ec95a7517b4f does not exist Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52e5500f-aa8c-4e89-bd82-640d73709641'] Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7c8504db-aab3-42c2-bf31-ec95a7517b4f does not exist Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52e5500f-aa8c-4e89-bd82-640d73709641'] Sep 06 11:01:58.122698 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.126615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-00e54082-d9be-49b4-9399-af04c2ab45f0 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Returning 404 to user: Security group 7c8504db-aab3-42c2-bf31-ec95a7517b4f does not exist Sep 06 11:01:58.126615 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-52e5500f-aa8c-4e89-bd82-640d73709641'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:01:58.127575 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-00e54082-d9be-49b4-9399-af04c2ab45f0 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/7c8504db-aab3-42c2-bf31-ec95a7517b4f" status: 404 len: 194 microversion: 2.1 time: 0.222915 Sep 06 11:01:58.132943 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1283/2546] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:01:57 2022] DELETE /compute/v2.1/os-security-groups/7c8504db-aab3-42c2-bf31-ec95a7517b4f => generated 194 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:01:58.138237 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e3fcd6cd-b69a-4c41-91da-c93d4d7107eb tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004101 Sep 06 11:01:58.140918 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1264/2547] 10.222.0.20 () {58 vars in 1164 bytes} [Tue Sep 6 11:01:58 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 11:01:58.150059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-37a97fb4-e701-4d12-9338-ca0325f2c0cc tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Calling method '.version_select at 0x7f90f37378b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:58.278295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-41569a6b-26a3-4f86-96b3-1beab86009c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:58.285205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-41569a6b-26a3-4f86-96b3-1beab86009c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:58.303350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41569a6b-26a3-4f86-96b3-1beab86009c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:58.308063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41569a6b-26a3-4f86-96b3-1beab86009c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:58.308534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41569a6b-26a3-4f86-96b3-1beab86009c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:58.311286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41569a6b-26a3-4f86-96b3-1beab86009c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:58.315903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41569a6b-26a3-4f86-96b3-1beab86009c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:58.319528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41569a6b-26a3-4f86-96b3-1beab86009c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:58.540602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-41569a6b-26a3-4f86-96b3-1beab86009c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:58.552641 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-41569a6b-26a3-4f86-96b3-1beab86009c4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1472 microversion: 2.1 time: 0.279498 Sep 06 11:01:58.554190 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1265/2548] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:58 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1472 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:58.559524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-99fe30d5-b10d-4394-8e33-7a1206d297d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:58.560490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-99fe30d5-b10d-4394-8e33-7a1206d297d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:58.566939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99fe30d5-b10d-4394-8e33-7a1206d297d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:58.568420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99fe30d5-b10d-4394-8e33-7a1206d297d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:58.569113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99fe30d5-b10d-4394-8e33-7a1206d297d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:58.570038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99fe30d5-b10d-4394-8e33-7a1206d297d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:58.570734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99fe30d5-b10d-4394-8e33-7a1206d297d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:58.571378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99fe30d5-b10d-4394-8e33-7a1206d297d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:58.584085 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-37a97fb4-e701-4d12-9338-ca0325f2c0cc tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.437827 Sep 06 11:01:58.594069 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1284/2549] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 11:01:58 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:01:58.599362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-10a4a4e7-378e-4a97-bafa-dc2ac3ddc0ea tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Calling method '.version_select at 0x7f90f3778e50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:58.742977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-99fe30d5-b10d-4394-8e33-7a1206d297d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:58.759802 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-99fe30d5-b10d-4394-8e33-7a1206d297d7 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1266 microversion: 2.1 time: 0.204032 Sep 06 11:01:58.760691 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1266/2550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:58 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:01:58.925985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-127b9b74-d8aa-4c16-be56-ac954ff1b2e4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:58.926613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-127b9b74-d8aa-4c16-be56-ac954ff1b2e4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:58.937171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-127b9b74-d8aa-4c16-be56-ac954ff1b2e4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:58.946748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-127b9b74-d8aa-4c16-be56-ac954ff1b2e4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:58.947475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-127b9b74-d8aa-4c16-be56-ac954ff1b2e4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:58.951925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-10a4a4e7-378e-4a97-bafa-dc2ac3ddc0ea tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 11:01:58.953280 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-10a4a4e7-378e-4a97-bafa-dc2ac3ddc0ea tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 06 11:01:58.953280 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-50f95704-b084-4b67-8435-a1859fecc6bc'] Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-10a4a4e7-378e-4a97-bafa-dc2ac3ddc0ea tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Request method failure captured: Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-security-groups/9da4ded7-efac-4dc1-ac73-9c7174ff1ea9 HTTP/1.1 Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyilQyupxCqj9x8LqqEPckQkiu_zBScgGhyn0ArforLfb4nABOwwbrxumjpmfLporMO6yacobpi7ZFnHn5-nali8USNotGxgUFg_cyKSuHmpzbsisfPco6NGmMkW7ldFjEIYLKi7QDyFAwSBHfUUMYjYzCqNTSk1mu4dgVyKeUe6t44 Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: a953396744854dcba117451ace5815de Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-760535780 Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a953396744854dcba117451ace5815de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a953396744854dcba117451ace5815de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a953396744854dcba117451ace5815de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a953396744854dcba117451ace5815de"}]}] Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-760535780 Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: a953396744854dcba117451ace5815de Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-760535780 Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsNegativeTestJSON-760535780-project Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d53d3a5df7974a03ad02b5ceca6f4425 Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-760535780-project Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: exception: Insufficient rights for removing default security group. Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-50f95704-b084-4b67-8435-a1859fecc6bc'] Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '9da4ded7-efac-4dc1-ac73-9c7174ff1ea9'} Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 11:01:58.962543 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50f95704-b084-4b67-8435-a1859fecc6bc'] Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50f95704-b084-4b67-8435-a1859fecc6bc'] Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50f95704-b084-4b67-8435-a1859fecc6bc'] Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50f95704-b084-4b67-8435-a1859fecc6bc'] Sep 06 11:01:58.967109 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:58.971361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-10a4a4e7-378e-4a97-bafa-dc2ac3ddc0ea tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 06 11:01:58.971361 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-50f95704-b084-4b67-8435-a1859fecc6bc'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:01:58.972513 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-10a4a4e7-378e-4a97-bafa-dc2ac3ddc0ea tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/9da4ded7-efac-4dc1-ac73-9c7174ff1ea9" status: 400 len: 182 microversion: 2.1 time: 0.377174 Sep 06 11:01:58.980586 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1285/2551] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:01:58 2022] DELETE /compute/v2.1/os-security-groups/9da4ded7-efac-4dc1-ac73-9c7174ff1ea9 => generated 182 bytes in 385 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:01:58.980767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-127b9b74-d8aa-4c16-be56-ac954ff1b2e4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:59.000411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-319884e3-0da8-462b-bb7a-e73e0a015609 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Calling method '.version_select at 0x7f90f3751d30>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:59.002283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-127b9b74-d8aa-4c16-be56-ac954ff1b2e4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.052s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:59.005720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-127b9b74-d8aa-4c16-be56-ac954ff1b2e4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:59.058594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-319884e3-0da8-462b-bb7a-e73e0a015609 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3e681417-0291-4664-b663-62b4b3f00e03 does not exist", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 11:01:59.059233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.security_group_api [None req-319884e3-0da8-462b-bb7a-e73e0a015609 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Neutron security group 3e681417-0291-4664-b663-62b4b3f00e03 not found {{(pid=140876) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 11:01:59.061061 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-319884e3-0da8-462b-bb7a-e73e0a015609 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] HTTP exception thrown: Security group 3e681417-0291-4664-b663-62b4b3f00e03 does not exist Sep 06 11:01:59.061061 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-6a05a1af-c140-496a-9928-d6e3031acd79'] Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-319884e3-0da8-462b-bb7a-e73e0a015609 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Request method failure captured: Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-security-groups/3e681417-0291-4664-b663-62b4b3f00e03 HTTP/1.1 Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyilQyupxCqj9x8LqqEPckQkiu_zBScgGhyn0ArforLfb4nABOwwbrxumjpmfLporMO6yacobpi7ZFnHn5-nali8USNotGxgUFg_cyKSuHmpzbsisfPco6NGmMkW7ldFjEIYLKi7QDyFAwSBHfUUMYjYzCqNTSk1mu4dgVyKeUe6t44 Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: a953396744854dcba117451ace5815de Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-760535780 Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a953396744854dcba117451ace5815de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a953396744854dcba117451ace5815de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a953396744854dcba117451ace5815de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a953396744854dcba117451ace5815de"}]}] Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-760535780 Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: a953396744854dcba117451ace5815de Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-760535780 Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsNegativeTestJSON-760535780-project Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d53d3a5df7974a03ad02b5ceca6f4425 Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-760535780-project Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: exception: Security group 3e681417-0291-4664-b663-62b4b3f00e03 does not exist Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-6a05a1af-c140-496a-9928-d6e3031acd79'] Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '3e681417-0291-4664-b663-62b4b3f00e03'} Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 11:01:59.069894 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3e681417-0291-4664-b663-62b4b3f00e03 does not exist Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a05a1af-c140-496a-9928-d6e3031acd79'] Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3e681417-0291-4664-b663-62b4b3f00e03 does not exist Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a05a1af-c140-496a-9928-d6e3031acd79'] Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3e681417-0291-4664-b663-62b4b3f00e03 does not exist Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a05a1af-c140-496a-9928-d6e3031acd79'] Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3e681417-0291-4664-b663-62b4b3f00e03 does not exist Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a05a1af-c140-496a-9928-d6e3031acd79'] Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-319884e3-0da8-462b-bb7a-e73e0a015609 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Returning 404 to user: Security group 3e681417-0291-4664-b663-62b4b3f00e03 does not exist Sep 06 11:01:59.074589 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-6a05a1af-c140-496a-9928-d6e3031acd79'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:01:59.081464 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-319884e3-0da8-462b-bb7a-e73e0a015609 tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/3e681417-0291-4664-b663-62b4b3f00e03" status: 404 len: 194 microversion: 2.1 time: 0.082899 Sep 06 11:01:59.081464 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1286/2552] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 11:01:58 2022] GET /compute/v2.1/os-security-groups/3e681417-0291-4664-b663-62b4b3f00e03 => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:01:59.131929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26bf4649-46c0-40fd-8d16-d2c5d6ff45dc tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Action: 'update', calling method: .version_select at 0x7f90f3773ca0>, body: {"security_group": {"name": "tempest-sg-727370206", "description": "tempest-description-1504210927"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:01:59.403124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG neutronclient.v2_0.client [None req-26bf4649-46c0-40fd-8d16-d2c5d6ff45dc tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b0d3e60f-13c6-418a-a724-2adeea851a76 does not exist", "detail": ""}} {{(pid=140876) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 06 11:01:59.404340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.security_group_api [None req-26bf4649-46c0-40fd-8d16-d2c5d6ff45dc tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Neutron security group b0d3e60f-13c6-418a-a724-2adeea851a76 not found {{(pid=140876) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 06 11:01:59.405820 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-26bf4649-46c0-40fd-8d16-d2c5d6ff45dc tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] HTTP exception thrown: Security group b0d3e60f-13c6-418a-a724-2adeea851a76 does not exist Sep 06 11:01:59.405820 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-1857a7cd-9f43-419e-bd41-fa4487842fe5'] Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26bf4649-46c0-40fd-8d16-d2c5d6ff45dc tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Request method failure captured: Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: request: PUT /compute/v2.1/os-security-groups/b0d3e60f-13c6-418a-a724-2adeea851a76 HTTP/1.1 Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 101 Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyilQyupxCqj9x8LqqEPckQkiu_zBScgGhyn0ArforLfb4nABOwwbrxumjpmfLporMO6yacobpi7ZFnHn5-nali8USNotGxgUFg_cyKSuHmpzbsisfPco6NGmMkW7ldFjEIYLKi7QDyFAwSBHfUUMYjYzCqNTSk1mu4dgVyKeUe6t44 Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: a953396744854dcba117451ace5815de Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-760535780 Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a953396744854dcba117451ace5815de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a953396744854dcba117451ace5815de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a953396744854dcba117451ace5815de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a953396744854dcba117451ace5815de"}]}] Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-760535780 Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: a953396744854dcba117451ace5815de Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-760535780 Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-SecurityGroupsNegativeTestJSON-760535780-project Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d53d3a5df7974a03ad02b5ceca6f4425 Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-760535780-project Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: {"security_group": {"name": "tempest-sg-727370206", "description": "tempest-description-1504210927"}} Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: exception: Security group b0d3e60f-13c6-418a-a724-2adeea851a76 does not exist Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-1857a7cd-9f43-419e-bd41-fa4487842fe5'] Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'b0d3e60f-13c6-418a-a724-2adeea851a76', 'body': {'security_group': {'name': 'tempest-sg-727370206', 'description': 'tempest-description-1504210927'}}} Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 06 11:01:59.408216 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b0d3e60f-13c6-418a-a724-2adeea851a76 does not exist Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1857a7cd-9f43-419e-bd41-fa4487842fe5'] Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b0d3e60f-13c6-418a-a724-2adeea851a76 does not exist Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1857a7cd-9f43-419e-bd41-fa4487842fe5'] Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b0d3e60f-13c6-418a-a724-2adeea851a76 does not exist Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1857a7cd-9f43-419e-bd41-fa4487842fe5'] Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b0d3e60f-13c6-418a-a724-2adeea851a76 does not exist Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1857a7cd-9f43-419e-bd41-fa4487842fe5'] Sep 06 11:01:59.412070 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:01:59.417968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26bf4649-46c0-40fd-8d16-d2c5d6ff45dc tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] Returning 404 to user: Security group b0d3e60f-13c6-418a-a724-2adeea851a76 does not exist Sep 06 11:01:59.417968 ncdv-master-1 devstack@n-api.service[140876]: Neutron server returns request_ids: ['req-1857a7cd-9f43-419e-bd41-fa4487842fe5'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:01:59.419285 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-26bf4649-46c0-40fd-8d16-d2c5d6ff45dc tempest-SecurityGroupsNegativeTestJSON-760535780 tempest-SecurityGroupsNegativeTestJSON-760535780-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/b0d3e60f-13c6-418a-a724-2adeea851a76" status: 404 len: 194 microversion: 2.1 time: 0.329217 Sep 06 11:01:59.426122 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1287/2553] 10.222.0.20 () {60 vars in 1290 bytes} [Tue Sep 6 11:01:59 2022] PUT /compute/v2.1/os-security-groups/b0d3e60f-13c6-418a-a724-2adeea851a76 => generated 194 bytes in 336 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:01:59.435703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-42b821c1-c777-4a7b-a082-dd412ba43b89 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:59.439948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-42b821c1-c777-4a7b-a082-dd412ba43b89 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:59.466815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42b821c1-c777-4a7b-a082-dd412ba43b89 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:59.468319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42b821c1-c777-4a7b-a082-dd412ba43b89 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:59.469056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42b821c1-c777-4a7b-a082-dd412ba43b89 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:59.470031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42b821c1-c777-4a7b-a082-dd412ba43b89 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:59.470758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42b821c1-c777-4a7b-a082-dd412ba43b89 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:59.471456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42b821c1-c777-4a7b-a082-dd412ba43b89 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:59.571478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-127b9b74-d8aa-4c16-be56-ac954ff1b2e4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:01:59.583076 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-127b9b74-d8aa-4c16-be56-ac954ff1b2e4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1468 microversion: 2.1 time: 0.661378 Sep 06 11:01:59.600103 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1267/2554] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:58 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1468 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:01:59.610936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f1294095-f858-4877-a835-9af3594145a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:01:59.612299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f1294095-f858-4877-a835-9af3594145a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:01:59.619931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1294095-f858-4877-a835-9af3594145a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:59.620816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1294095-f858-4877-a835-9af3594145a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:59.621486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1294095-f858-4877-a835-9af3594145a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:59.622436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1294095-f858-4877-a835-9af3594145a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:01:59.623281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1294095-f858-4877-a835-9af3594145a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:01:59.624802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1294095-f858-4877-a835-9af3594145a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:01:59.986167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-42b821c1-c777-4a7b-a082-dd412ba43b89 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:00.025038 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-42b821c1-c777-4a7b-a082-dd412ba43b89 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1334 microversion: 2.1 time: 0.596861 Sep 06 11:02:00.025690 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1288/2555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:59 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1334 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:00.220916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-502c5f99-45a0-4d9e-b713-909dc9b27ca1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:00.220916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-502c5f99-45a0-4d9e-b713-909dc9b27ca1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: d0610e78-f996-4342-a0c8-8ef481539a39] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:00.220916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-502c5f99-45a0-4d9e-b713-909dc9b27ca1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:00.220916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-502c5f99-45a0-4d9e-b713-909dc9b27ca1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:00.220916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-502c5f99-45a0-4d9e-b713-909dc9b27ca1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:00.220916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-502c5f99-45a0-4d9e-b713-909dc9b27ca1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:00.220916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-502c5f99-45a0-4d9e-b713-909dc9b27ca1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:00.220916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-502c5f99-45a0-4d9e-b713-909dc9b27ca1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:00.276793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f1294095-f858-4877-a835-9af3594145a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:00.309335 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f1294095-f858-4877-a835-9af3594145a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1469 microversion: 2.1 time: 0.706148 Sep 06 11:02:00.311686 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1268/2556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:01:59 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1469 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:00.318182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-973850fc-bfc6-4e1b-9fef-cbb88a0f7b78 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:00.318806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-973850fc-bfc6-4e1b-9fef-cbb88a0f7b78 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:00.339587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-973850fc-bfc6-4e1b-9fef-cbb88a0f7b78 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:00.340661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-973850fc-bfc6-4e1b-9fef-cbb88a0f7b78 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:00.341824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-973850fc-bfc6-4e1b-9fef-cbb88a0f7b78 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:00.342179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-973850fc-bfc6-4e1b-9fef-cbb88a0f7b78 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:00.342700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-973850fc-bfc6-4e1b-9fef-cbb88a0f7b78 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:00.343552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-973850fc-bfc6-4e1b-9fef-cbb88a0f7b78 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:00.463242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-973850fc-bfc6-4e1b-9fef-cbb88a0f7b78 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:00.471256 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-973850fc-bfc6-4e1b-9fef-cbb88a0f7b78 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1274 microversion: 2.1 time: 0.156807 Sep 06 11:02:00.487265 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1269/2557] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:00 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1274 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:00.487265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff2e8a98-a83e-47fa-aca1-37090c70d952 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:00.487265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff2e8a98-a83e-47fa-aca1-37090c70d952 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:00.487265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff2e8a98-a83e-47fa-aca1-37090c70d952 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:00.487265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff2e8a98-a83e-47fa-aca1-37090c70d952 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:00.487265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff2e8a98-a83e-47fa-aca1-37090c70d952 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:00.487265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff2e8a98-a83e-47fa-aca1-37090c70d952 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:00.496719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff2e8a98-a83e-47fa-aca1-37090c70d952 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:00.496719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff2e8a98-a83e-47fa-aca1-37090c70d952 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:00.504596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-502c5f99-45a0-4d9e-b713-909dc9b27ca1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:00.541910 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-502c5f99-45a0-4d9e-b713-909dc9b27ca1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/d0610e78-f996-4342-a0c8-8ef481539a39" status: 200 len: 1468 microversion: 2.1 time: 0.504421 Sep 06 11:02:00.547490 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1289/2558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:00 2022] GET /compute/v2.1/servers/d0610e78-f996-4342-a0c8-8ef481539a39 => generated 1468 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:00.573696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:00.579386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:00.580600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:00.588134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Searching by: {'reservation_id': 'r-zr5pz0uh', 'deleted': False, 'project_id': '0a7af966e1b740a59920ff9370b5dade'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:02:00.608873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:00.614124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:00.614908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:00.615931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:00.617398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:00.618074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:00.761581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:02:00.907977 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff2e8a98-a83e-47fa-aca1-37090c70d952 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "POST /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991/action" status: 204 len: 0 microversion: 2.1 time: 0.433832 Sep 06 11:02:00.910684 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1270/2559] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:02:00 2022] POST /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991/action => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:02:00.944450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-29d4861b-3a63-4be9-85ab-24253bd05f3e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:00.966156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-29d4861b-3a63-4be9-85ab-24253bd05f3e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:00.966156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29d4861b-3a63-4be9-85ab-24253bd05f3e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:00.966156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29d4861b-3a63-4be9-85ab-24253bd05f3e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:00.966156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29d4861b-3a63-4be9-85ab-24253bd05f3e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:00.966156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29d4861b-3a63-4be9-85ab-24253bd05f3e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:00.966156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29d4861b-3a63-4be9-85ab-24253bd05f3e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:00.966156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29d4861b-3a63-4be9-85ab-24253bd05f3e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:00.969295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:01.001744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:01.003563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:01.004326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:01.319520 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9861d4de-e1f9-4782-b599-c539813f373c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-zr5pz0uh" status: 200 len: 2929 microversion: 2.1 time: 0.750047 Sep 06 11:02:01.344377 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1290/2560] 10.222.0.20 () {58 vars in 1197 bytes} [Tue Sep 6 11:02:00 2022] GET /compute/v2.1/servers/detail?reservation_id=r-zr5pz0uh => generated 2929 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:01.350925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6289216c-7699-493f-8937-59652ed54a6d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:01.356171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6289216c-7699-493f-8937-59652ed54a6d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:01.359338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6289216c-7699-493f-8937-59652ed54a6d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:01.360094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6289216c-7699-493f-8937-59652ed54a6d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:01.360756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6289216c-7699-493f-8937-59652ed54a6d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:01.361796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6289216c-7699-493f-8937-59652ed54a6d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:01.362490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6289216c-7699-493f-8937-59652ed54a6d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:01.363330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6289216c-7699-493f-8937-59652ed54a6d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:01.560023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-29d4861b-3a63-4be9-85ab-24253bd05f3e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:01.573176 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-29d4861b-3a63-4be9-85ab-24253bd05f3e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1469 microversion: 2.1 time: 0.645804 Sep 06 11:02:01.574028 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1271/2561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:00 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1469 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:01.579829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5a1c1c55-de31-4e23-84e0-260088be7447 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:01.651179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.compute.server_groups [None req-5a1c1c55-de31-4e23-84e0-260088be7447 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Querying cell a5a6b47c-7522-4a84-9be6-8ca7130ab6d7(cell1) for 2 instances {{(pid=140875) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 06 11:02:01.658174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a1c1c55-de31-4e23-84e0-260088be7447 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:01.662801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a1c1c55-de31-4e23-84e0-260088be7447 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:01.663662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a1c1c55-de31-4e23-84e0-260088be7447 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:01.733092 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5a1c1c55-de31-4e23-84e0-260088be7447 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/ed7e8173-1d06-4db0-b5ca-598294d2acec" status: 200 len: 270 microversion: 2.1 time: 0.157034 Sep 06 11:02:01.739646 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1272/2562] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:02:01 2022] GET /compute/v2.1/os-server-groups/ed7e8173-1d06-4db0-b5ca-598294d2acec => generated 270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:01.760399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-91cd8184-2896-4acb-b567-dd41e4e55268 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:01.762932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-91cd8184-2896-4acb-b567-dd41e4e55268 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:01.778627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91cd8184-2896-4acb-b567-dd41e4e55268 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:01.779591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91cd8184-2896-4acb-b567-dd41e4e55268 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:01.781014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91cd8184-2896-4acb-b567-dd41e4e55268 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:01.782075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91cd8184-2896-4acb-b567-dd41e4e55268 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:01.782805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91cd8184-2896-4acb-b567-dd41e4e55268 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:01.783733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91cd8184-2896-4acb-b567-dd41e4e55268 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:02.781076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6289216c-7699-493f-8937-59652ed54a6d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:02.791937 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6289216c-7699-493f-8937-59652ed54a6d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1334 microversion: 2.1 time: 1.445934 Sep 06 11:02:02.793774 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1291/2563] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:01 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1334 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:02.799422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9059cf24-b75b-46bd-b08d-930a353cd432 req-f526c6bb-ba32-49f6-8881-44f5c9967ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53022c77-a7ad-42cd-843f-0a4ead29e639", "tag": "c01851d8-eec8-44e3-b8fa-7988a9dd1375"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:02.817857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9059cf24-b75b-46bd-b08d-930a353cd432 req-f526c6bb-ba32-49f6-8881-44f5c9967ad5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:02.818424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9059cf24-b75b-46bd-b08d-930a353cd432 req-f526c6bb-ba32-49f6-8881-44f5c9967ad5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:02.818933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9059cf24-b75b-46bd-b08d-930a353cd432 req-f526c6bb-ba32-49f6-8881-44f5c9967ad5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:02.840251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-91cd8184-2896-4acb-b567-dd41e4e55268 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:02.840716 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9059cf24-b75b-46bd-b08d-930a353cd432 req-f526c6bb-ba32-49f6-8881-44f5c9967ad5 service nova] Creating event network-changed:c01851d8-eec8-44e3-b8fa-7988a9dd1375 for instance 53022c77-a7ad-42cd-843f-0a4ead29e639 on nch1-master-1 Sep 06 11:02:02.841700 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-91cd8184-2896-4acb-b567-dd41e4e55268 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1314 microversion: 2.1 time: 1.097485 Sep 06 11:02:02.842502 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1273/2564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:01 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1314 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:02.847632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b17bbaa5-64eb-47ba-8400-3a615bc87dd2 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:02.848541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b17bbaa5-64eb-47ba-8400-3a615bc87dd2 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:02.858115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b17bbaa5-64eb-47ba-8400-3a615bc87dd2 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:02.866154 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9059cf24-b75b-46bd-b08d-930a353cd432 req-f526c6bb-ba32-49f6-8881-44f5c9967ad5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067529 Sep 06 11:02:02.866154 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1292/2565] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:02.866552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b17bbaa5-64eb-47ba-8400-3a615bc87dd2 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:02.866552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b17bbaa5-64eb-47ba-8400-3a615bc87dd2 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:02.867472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b17bbaa5-64eb-47ba-8400-3a615bc87dd2 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:02.868240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b17bbaa5-64eb-47ba-8400-3a615bc87dd2 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:02.868845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-06222d60-caf8-409d-b9ff-94e33349bcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:02.869148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b17bbaa5-64eb-47ba-8400-3a615bc87dd2 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:02.869569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-06222d60-caf8-409d-b9ff-94e33349bcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:02.876052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06222d60-caf8-409d-b9ff-94e33349bcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:02.876562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06222d60-caf8-409d-b9ff-94e33349bcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:02.883022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06222d60-caf8-409d-b9ff-94e33349bcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:02.888910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06222d60-caf8-409d-b9ff-94e33349bcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:02.888910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06222d60-caf8-409d-b9ff-94e33349bcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:02.888910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06222d60-caf8-409d-b9ff-94e33349bcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:03.636771 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b17bbaa5-64eb-47ba-8400-3a615bc87dd2 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1619 microversion: 2.1 time: 0.792864 Sep 06 11:02:03.647055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-06222d60-caf8-409d-b9ff-94e33349bcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:03.655914 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-06222d60-caf8-409d-b9ff-94e33349bcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1469 microversion: 2.1 time: 0.791341 Sep 06 11:02:03.656492 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1293/2567] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:02 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1469 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:03.657644 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1274/2567] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:02 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1619 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:03.668045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-38133526-72e5-4ad2-a9dd-1dc27e24e7df req-e0adbd3e-bfa9-48f9-a171-90773e9479ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc46dc01-cd54-44a1-a379-0b0f8ff43991", "name": "network-vif-plugged", "status": "completed", "tag": "17d26200-b9e0-4b27-90ee-4779abc2a65e"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:03.679031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24ecd235-dbda-4944-80ed-ab59fff9d1c3 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:03.679652 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-24ecd235-dbda-4944-80ed-ab59fff9d1c3 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] [instance: d0610e78-f996-4342-a0c8-8ef481539a39] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:03.685920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24ecd235-dbda-4944-80ed-ab59fff9d1c3 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:03.686425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24ecd235-dbda-4944-80ed-ab59fff9d1c3 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:03.686865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24ecd235-dbda-4944-80ed-ab59fff9d1c3 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:03.691975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24ecd235-dbda-4944-80ed-ab59fff9d1c3 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:03.692472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24ecd235-dbda-4944-80ed-ab59fff9d1c3 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:03.692971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24ecd235-dbda-4944-80ed-ab59fff9d1c3 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:03.697391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-38133526-72e5-4ad2-a9dd-1dc27e24e7df req-e0adbd3e-bfa9-48f9-a171-90773e9479ec service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:03.698007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-38133526-72e5-4ad2-a9dd-1dc27e24e7df req-e0adbd3e-bfa9-48f9-a171-90773e9479ec service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:03.700257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-38133526-72e5-4ad2-a9dd-1dc27e24e7df req-e0adbd3e-bfa9-48f9-a171-90773e9479ec service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:03.722042 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-38133526-72e5-4ad2-a9dd-1dc27e24e7df req-e0adbd3e-bfa9-48f9-a171-90773e9479ec service nova] Creating event network-vif-plugged:17d26200-b9e0-4b27-90ee-4779abc2a65e for instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 on nch2-master-1 Sep 06 11:02:03.731526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-38133526-72e5-4ad2-a9dd-1dc27e24e7df req-e0adbd3e-bfa9-48f9-a171-90773e9479ec service nova] Instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:02:03.750693 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-38133526-72e5-4ad2-a9dd-1dc27e24e7df req-e0adbd3e-bfa9-48f9-a171-90773e9479ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092855 Sep 06 11:02:03.757549 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1294/2568] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:03.847917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a7e69d0d-da4b-4cc3-90f3-ca8820c425bc tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:03.854193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a7e69d0d-da4b-4cc3-90f3-ca8820c425bc tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:03.897868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7e69d0d-da4b-4cc3-90f3-ca8820c425bc tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:03.900320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7e69d0d-da4b-4cc3-90f3-ca8820c425bc tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:03.903166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7e69d0d-da4b-4cc3-90f3-ca8820c425bc tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:03.903166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7e69d0d-da4b-4cc3-90f3-ca8820c425bc tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:03.907396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7e69d0d-da4b-4cc3-90f3-ca8820c425bc tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:03.907396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7e69d0d-da4b-4cc3-90f3-ca8820c425bc tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:03.920545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:04.116836 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-24ecd235-dbda-4944-80ed-ab59fff9d1c3 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d0610e78-f996-4342-a0c8-8ef481539a39" status: 200 len: 1619 microversion: 2.1 time: 0.436017 Sep 06 11:02:04.119105 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1275/2569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:03 2022] GET /compute/v2.1/servers/d0610e78-f996-4342-a0c8-8ef481539a39 => generated 1619 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:04.124188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-589a7fc9-e84c-4d98-af2b-7be57125d10f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:04.125118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-589a7fc9-e84c-4d98-af2b-7be57125d10f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:04.131563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-589a7fc9-e84c-4d98-af2b-7be57125d10f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:04.133266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-589a7fc9-e84c-4d98-af2b-7be57125d10f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:04.133970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-589a7fc9-e84c-4d98-af2b-7be57125d10f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:04.134937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-589a7fc9-e84c-4d98-af2b-7be57125d10f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:04.135684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-589a7fc9-e84c-4d98-af2b-7be57125d10f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:04.136375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-589a7fc9-e84c-4d98-af2b-7be57125d10f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:04.229258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:04.407618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a7e69d0d-da4b-4cc3-90f3-ca8820c425bc tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:04.419908 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a7e69d0d-da4b-4cc3-90f3-ca8820c425bc tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1334 microversion: 2.1 time: 0.593641 Sep 06 11:02:04.420809 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1295/2570] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:03 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1334 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:04.428521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1657776726", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "0d07bf04-ec2e-40a3-8916-aade0c51060b"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:04.491202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-589a7fc9-e84c-4d98-af2b-7be57125d10f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:04.506289 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-589a7fc9-e84c-4d98-af2b-7be57125d10f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1314 microversion: 2.1 time: 0.385787 Sep 06 11:02:04.519508 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1276/2571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:04 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:04.543958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:02:04.682467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a1647351-b5b9-4cc4-9505-868a9de3d356 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:04.683472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a1647351-b5b9-4cc4-9505-868a9de3d356 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:04.704240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1647351-b5b9-4cc4-9505-868a9de3d356 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:04.705295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1647351-b5b9-4cc4-9505-868a9de3d356 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:04.706918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1647351-b5b9-4cc4-9505-868a9de3d356 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:04.707982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1647351-b5b9-4cc4-9505-868a9de3d356 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:04.712674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1647351-b5b9-4cc4-9505-868a9de3d356 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:04.713434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1647351-b5b9-4cc4-9505-868a9de3d356 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:05.295174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a1647351-b5b9-4cc4-9505-868a9de3d356 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:05.305904 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a1647351-b5b9-4cc4-9505-868a9de3d356 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1469 microversion: 2.1 time: 0.627381 Sep 06 11:02:05.311482 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1277/2572] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:04 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1469 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:05.375052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:02:05.380953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:02:05.380953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:02:05.380953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:02:05.380953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:02:05.394848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:05.395409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:05.396115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:05.397072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:05.397748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:05.399039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:05.422472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:02:05.430558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:02:05.448944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6903de3f-919b-492e-8ae2-467bd132baf9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:05.449571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6903de3f-919b-492e-8ae2-467bd132baf9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:05.450119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:02:05.452606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:02:05.464821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6903de3f-919b-492e-8ae2-467bd132baf9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:05.468923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6903de3f-919b-492e-8ae2-467bd132baf9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:05.471667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6903de3f-919b-492e-8ae2-467bd132baf9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:05.474880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6903de3f-919b-492e-8ae2-467bd132baf9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:05.475654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6903de3f-919b-492e-8ae2-467bd132baf9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:05.477345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6903de3f-919b-492e-8ae2-467bd132baf9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:05.645391 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8d798c62-d766-489a-9663-d902dbee4e8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.223037 Sep 06 11:02:05.657067 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1296/2573] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:02:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:02:05.666480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-969ab6fb-e065-42be-8979-7bda86807f6d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:05.668999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-969ab6fb-e065-42be-8979-7bda86807f6d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:05.676493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-969ab6fb-e065-42be-8979-7bda86807f6d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:05.677252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-969ab6fb-e065-42be-8979-7bda86807f6d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:05.677957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-969ab6fb-e065-42be-8979-7bda86807f6d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:05.678869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-969ab6fb-e065-42be-8979-7bda86807f6d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:05.679559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-969ab6fb-e065-42be-8979-7bda86807f6d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:05.680157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-969ab6fb-e065-42be-8979-7bda86807f6d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:05.832950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6903de3f-919b-492e-8ae2-467bd132baf9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:05.850111 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6903de3f-919b-492e-8ae2-467bd132baf9 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1334 microversion: 2.1 time: 0.405900 Sep 06 11:02:05.867906 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1278/2574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:05 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1334 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:05.889555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-121a0f0d-777f-4103-af53-be006b6be9ad req-86823460-04f7-458d-a884-fa772f96b42f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5217df4d-be5e-4e14-a4ad-c690acc72f20", "tag": "c37f7843-aed1-4835-bdd5-25079688f7f3"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:05.916169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-121a0f0d-777f-4103-af53-be006b6be9ad req-86823460-04f7-458d-a884-fa772f96b42f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:05.917088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-121a0f0d-777f-4103-af53-be006b6be9ad req-86823460-04f7-458d-a884-fa772f96b42f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:05.920204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-121a0f0d-777f-4103-af53-be006b6be9ad req-86823460-04f7-458d-a884-fa772f96b42f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:05.948273 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-121a0f0d-777f-4103-af53-be006b6be9ad req-86823460-04f7-458d-a884-fa772f96b42f service nova] Creating event network-changed:c37f7843-aed1-4835-bdd5-25079688f7f3 for instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 on nch2-master-1 Sep 06 11:02:05.959513 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-121a0f0d-777f-4103-af53-be006b6be9ad req-86823460-04f7-458d-a884-fa772f96b42f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086005 Sep 06 11:02:05.962697 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1279/2575] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:05.972371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-48493f9c-60c2-4983-afab-93d898766c78 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:05.977137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-48493f9c-60c2-4983-afab-93d898766c78 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:06.008557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-969ab6fb-e065-42be-8979-7bda86807f6d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:06.026984 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-969ab6fb-e065-42be-8979-7bda86807f6d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1314 microversion: 2.1 time: 0.368099 Sep 06 11:02:06.030012 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1297/2576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:05 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:06.122726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-48493f9c-60c2-4983-afab-93d898766c78 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:06.142877 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-48493f9c-60c2-4983-afab-93d898766c78 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1217 microversion: 2.1 time: 0.178542 Sep 06 11:02:06.144173 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1280/2577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:05 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:06.178411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-335846e0-5976-464a-8262-2c36ab9c4b53 req-c29887e9-e73c-473c-aecb-5d0119b93e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53022c77-a7ad-42cd-843f-0a4ead29e639", "tag": "f5feaeb3-8243-4f2d-a254-f8b588b4e20f"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:06.203449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-335846e0-5976-464a-8262-2c36ab9c4b53 req-c29887e9-e73c-473c-aecb-5d0119b93e21 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:06.204206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-335846e0-5976-464a-8262-2c36ab9c4b53 req-c29887e9-e73c-473c-aecb-5d0119b93e21 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:06.204754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-335846e0-5976-464a-8262-2c36ab9c4b53 req-c29887e9-e73c-473c-aecb-5d0119b93e21 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:06.224967 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-335846e0-5976-464a-8262-2c36ab9c4b53 req-c29887e9-e73c-473c-aecb-5d0119b93e21 service nova] Creating event network-changed:f5feaeb3-8243-4f2d-a254-f8b588b4e20f for instance 53022c77-a7ad-42cd-843f-0a4ead29e639 on nch1-master-1 Sep 06 11:02:06.237530 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-335846e0-5976-464a-8262-2c36ab9c4b53 req-c29887e9-e73c-473c-aecb-5d0119b93e21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064768 Sep 06 11:02:06.244141 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1298/2578] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:06.340730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff7c43c4-e386-47b2-9584-136778d832cb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:06.342204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff7c43c4-e386-47b2-9584-136778d832cb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:06.355378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff7c43c4-e386-47b2-9584-136778d832cb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:06.356068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff7c43c4-e386-47b2-9584-136778d832cb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:06.356711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff7c43c4-e386-47b2-9584-136778d832cb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:06.357588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff7c43c4-e386-47b2-9584-136778d832cb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:06.358557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff7c43c4-e386-47b2-9584-136778d832cb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:06.359213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff7c43c4-e386-47b2-9584-136778d832cb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:06.670678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff7c43c4-e386-47b2-9584-136778d832cb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:06.682946 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff7c43c4-e386-47b2-9584-136778d832cb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1461 microversion: 2.1 time: 0.356688 Sep 06 11:02:06.695377 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1281/2579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:06 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1461 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:06.710488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0663c11d-f4b0-4ad2-a00c-444b491a1439 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:06.712503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0663c11d-f4b0-4ad2-a00c-444b491a1439 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:06.719442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0663c11d-f4b0-4ad2-a00c-444b491a1439 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:06.720193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0663c11d-f4b0-4ad2-a00c-444b491a1439 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:06.720814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0663c11d-f4b0-4ad2-a00c-444b491a1439 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:06.721731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0663c11d-f4b0-4ad2-a00c-444b491a1439 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:06.722436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0663c11d-f4b0-4ad2-a00c-444b491a1439 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:06.723046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0663c11d-f4b0-4ad2-a00c-444b491a1439 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:06.892700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4882fa95-95aa-473b-a5ce-dcd83023a06c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:06.897892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4882fa95-95aa-473b-a5ce-dcd83023a06c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:06.908365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4882fa95-95aa-473b-a5ce-dcd83023a06c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:06.917103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4882fa95-95aa-473b-a5ce-dcd83023a06c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:06.917770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4882fa95-95aa-473b-a5ce-dcd83023a06c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:06.923686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4882fa95-95aa-473b-a5ce-dcd83023a06c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:06.923686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4882fa95-95aa-473b-a5ce-dcd83023a06c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:06.923686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4882fa95-95aa-473b-a5ce-dcd83023a06c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:07.089908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0663c11d-f4b0-4ad2-a00c-444b491a1439 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:07.114414 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0663c11d-f4b0-4ad2-a00c-444b491a1439 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1461 microversion: 2.1 time: 0.408176 Sep 06 11:02:07.115742 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1299/2580] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:06 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1461 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:07.121568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ae3a49a0-1e6e-4dca-8301-2bdc5f29d850 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:07.122469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ae3a49a0-1e6e-4dca-8301-2bdc5f29d850 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:07.137929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae3a49a0-1e6e-4dca-8301-2bdc5f29d850 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:07.137929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae3a49a0-1e6e-4dca-8301-2bdc5f29d850 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:07.137929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae3a49a0-1e6e-4dca-8301-2bdc5f29d850 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:07.137929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae3a49a0-1e6e-4dca-8301-2bdc5f29d850 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:07.137929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae3a49a0-1e6e-4dca-8301-2bdc5f29d850 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:07.137929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae3a49a0-1e6e-4dca-8301-2bdc5f29d850 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:07.346837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4882fa95-95aa-473b-a5ce-dcd83023a06c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:07.352931 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4882fa95-95aa-473b-a5ce-dcd83023a06c tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1334 microversion: 2.1 time: 0.464057 Sep 06 11:02:07.354340 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1282/2581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:06 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1334 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:07.362139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd4b4adc-a759-4805-9f35-565e1f396fee tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Action: 'create', calling method: .version_select at 0x7f90f36cc040>, body: {"keypair": {"name": "tempest-keypair-91890228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOV8Fq7bP3iOobSwm9DggTXvU+CG1H5nMf+an/OjHTRs34nTT2/0oAoY4NUJZZGQ9WnlszkccOmYwHkM/4FV2Jxnr8jsJ1W4vhqVnXPK67f538wx4vTI9a3ETcWgfWPVjQ=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:07.381316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-fd4b4adc-a759-4805-9f35-565e1f396fee tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Getting quotas for project 2a1f6f54c8d24eaa9eae09e8f30c56f1. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:02:07.389088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-fd4b4adc-a759-4805-9f35-565e1f396fee tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Getting quotas for user 3b6e2046e3bd40b3b46802dfa796260b and project 2a1f6f54c8d24eaa9eae09e8f30c56f1. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:02:07.439154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ae3a49a0-1e6e-4dca-8301-2bdc5f29d850 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:07.449362 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ae3a49a0-1e6e-4dca-8301-2bdc5f29d850 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1314 microversion: 2.1 time: 0.332130 Sep 06 11:02:07.449941 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1300/2582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:07 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:07.455961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-74e62000-4716-48b3-8677-0832aa5f7551 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:07.456874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-74e62000-4716-48b3-8677-0832aa5f7551 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:07.472907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74e62000-4716-48b3-8677-0832aa5f7551 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:07.473404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74e62000-4716-48b3-8677-0832aa5f7551 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:07.473862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74e62000-4716-48b3-8677-0832aa5f7551 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:07.474599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74e62000-4716-48b3-8677-0832aa5f7551 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:07.475106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74e62000-4716-48b3-8677-0832aa5f7551 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:07.475541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74e62000-4716-48b3-8677-0832aa5f7551 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:07.539128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-74e62000-4716-48b3-8677-0832aa5f7551 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:07.551358 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-74e62000-4716-48b3-8677-0832aa5f7551 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1221 microversion: 2.1 time: 0.099014 Sep 06 11:02:07.551358 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1301/2583] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:07 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:07.738143 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd4b4adc-a759-4805-9f35-565e1f396fee tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.382288 Sep 06 11:02:07.741160 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1283/2584] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:02:07 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:08.380099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e46ca869-8436-49af-be52-b060308d2e4d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:08.380791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e46ca869-8436-49af-be52-b060308d2e4d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:08.397123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e46ca869-8436-49af-be52-b060308d2e4d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:08.397920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e46ca869-8436-49af-be52-b060308d2e4d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:08.398595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e46ca869-8436-49af-be52-b060308d2e4d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:08.400092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e46ca869-8436-49af-be52-b060308d2e4d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:08.415230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e46ca869-8436-49af-be52-b060308d2e4d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:08.420889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e46ca869-8436-49af-be52-b060308d2e4d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:08.473640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7637bb1c-5969-4016-ba0d-e58adcefe761 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:08.474951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7637bb1c-5969-4016-ba0d-e58adcefe761 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:08.491904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7637bb1c-5969-4016-ba0d-e58adcefe761 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:08.492614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7637bb1c-5969-4016-ba0d-e58adcefe761 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:08.492918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7637bb1c-5969-4016-ba0d-e58adcefe761 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:08.500126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7637bb1c-5969-4016-ba0d-e58adcefe761 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:08.500628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7637bb1c-5969-4016-ba0d-e58adcefe761 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:08.501081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7637bb1c-5969-4016-ba0d-e58adcefe761 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:09.090762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e46ca869-8436-49af-be52-b060308d2e4d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:09.105057 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e46ca869-8436-49af-be52-b060308d2e4d tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1334 microversion: 2.1 time: 0.730308 Sep 06 11:02:09.125308 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1302/2585] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:08 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1334 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:09.149608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7637bb1c-5969-4016-ba0d-e58adcefe761 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:09.162759 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7637bb1c-5969-4016-ba0d-e58adcefe761 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1314 microversion: 2.1 time: 0.689563 Sep 06 11:02:09.164705 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1284/2586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:08 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:09.170560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e92ca618-21a5-4afa-aac3-317ff70717d3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:09.171465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e92ca618-21a5-4afa-aac3-317ff70717d3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:09.178293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e92ca618-21a5-4afa-aac3-317ff70717d3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:09.178918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e92ca618-21a5-4afa-aac3-317ff70717d3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:09.180064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e92ca618-21a5-4afa-aac3-317ff70717d3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:09.180890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e92ca618-21a5-4afa-aac3-317ff70717d3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:09.182253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e92ca618-21a5-4afa-aac3-317ff70717d3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:09.182798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e92ca618-21a5-4afa-aac3-317ff70717d3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:09.284419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e92ca618-21a5-4afa-aac3-317ff70717d3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:09.294381 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e92ca618-21a5-4afa-aac3-317ff70717d3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1269 microversion: 2.1 time: 0.133444 Sep 06 11:02:09.295066 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1303/2587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:09 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1269 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:10.156163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-73cc1de0-4ff8-4d38-aa8d-75200835fa9a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:10.157529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-73cc1de0-4ff8-4d38-aa8d-75200835fa9a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:10.165312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73cc1de0-4ff8-4d38-aa8d-75200835fa9a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:10.166404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73cc1de0-4ff8-4d38-aa8d-75200835fa9a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:10.167293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73cc1de0-4ff8-4d38-aa8d-75200835fa9a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:10.168142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73cc1de0-4ff8-4d38-aa8d-75200835fa9a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:10.168769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73cc1de0-4ff8-4d38-aa8d-75200835fa9a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:10.169367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73cc1de0-4ff8-4d38-aa8d-75200835fa9a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:10.189501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d33cf446-e479-431f-b248-e82c23f237e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:10.190494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d33cf446-e479-431f-b248-e82c23f237e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:10.202776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d33cf446-e479-431f-b248-e82c23f237e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:10.203129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d33cf446-e479-431f-b248-e82c23f237e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:10.206328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d33cf446-e479-431f-b248-e82c23f237e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:10.207301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d33cf446-e479-431f-b248-e82c23f237e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:10.207792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d33cf446-e479-431f-b248-e82c23f237e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:10.208236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d33cf446-e479-431f-b248-e82c23f237e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:10.602852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d33cf446-e479-431f-b248-e82c23f237e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:10.631622 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d33cf446-e479-431f-b248-e82c23f237e0 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1314 microversion: 2.1 time: 0.434470 Sep 06 11:02:10.631622 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1304/2588] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:10 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:10.632028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-73cc1de0-4ff8-4d38-aa8d-75200835fa9a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:10.633085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b1c14991-729a-4b77-8b21-a6edc1773773 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:10.633085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b1c14991-729a-4b77-8b21-a6edc1773773 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:10.645523 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-73cc1de0-4ff8-4d38-aa8d-75200835fa9a tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1334 microversion: 2.1 time: 0.493810 Sep 06 11:02:10.646110 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1285/2589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:10 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1334 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:10.650640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1c14991-729a-4b77-8b21-a6edc1773773 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:10.651175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1c14991-729a-4b77-8b21-a6edc1773773 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:10.651805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1c14991-729a-4b77-8b21-a6edc1773773 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:10.652721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1c14991-729a-4b77-8b21-a6edc1773773 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:10.657176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1c14991-729a-4b77-8b21-a6edc1773773 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:10.657176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1c14991-729a-4b77-8b21-a6edc1773773 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:10.687178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-41050554-8422-423e-a30d-bbda947c8076 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:10.690722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-41050554-8422-423e-a30d-bbda947c8076 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:10.702424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41050554-8422-423e-a30d-bbda947c8076 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:10.705030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41050554-8422-423e-a30d-bbda947c8076 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:10.708686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41050554-8422-423e-a30d-bbda947c8076 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:10.708686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41050554-8422-423e-a30d-bbda947c8076 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:10.708686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41050554-8422-423e-a30d-bbda947c8076 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:10.708686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41050554-8422-423e-a30d-bbda947c8076 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:11.147812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b1c14991-729a-4b77-8b21-a6edc1773773 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:11.162297 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b1c14991-729a-4b77-8b21-a6edc1773773 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1277 microversion: 2.1 time: 0.541294 Sep 06 11:02:11.162885 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1305/2590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:10 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1277 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:11.440447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-41050554-8422-423e-a30d-bbda947c8076 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:11.449634 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-41050554-8422-423e-a30d-bbda947c8076 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.775966 Sep 06 11:02:11.450230 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1286/2591] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:10 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:11.473030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-199e3026-49bf-4ce5-89dd-c521e8a8dae0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-722663013"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:11.478035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-199e3026-49bf-4ce5-89dd-c521e8a8dae0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:11.489366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-199e3026-49bf-4ce5-89dd-c521e8a8dae0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:11.490118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-199e3026-49bf-4ce5-89dd-c521e8a8dae0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:11.490742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-199e3026-49bf-4ce5-89dd-c521e8a8dae0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:11.491884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-199e3026-49bf-4ce5-89dd-c521e8a8dae0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:11.491992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-199e3026-49bf-4ce5-89dd-c521e8a8dae0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:11.493543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-199e3026-49bf-4ce5-89dd-c521e8a8dae0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:11.649586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-47ec5eb7-ca9e-4cb0-8dac-85f585f25e30 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:11.650850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-47ec5eb7-ca9e-4cb0-8dac-85f585f25e30 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:11.654906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:11.659460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47ec5eb7-ca9e-4cb0-8dac-85f585f25e30 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:11.660228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47ec5eb7-ca9e-4cb0-8dac-85f585f25e30 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:11.660955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47ec5eb7-ca9e-4cb0-8dac-85f585f25e30 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:11.662387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47ec5eb7-ca9e-4cb0-8dac-85f585f25e30 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:11.663116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47ec5eb7-ca9e-4cb0-8dac-85f585f25e30 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:11.663687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47ec5eb7-ca9e-4cb0-8dac-85f585f25e30 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:12.044621 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-199e3026-49bf-4ce5-89dd-c521e8a8dae0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.575026 Sep 06 11:02:12.045711 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1306/2592] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:02:11 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 06 11:02:12.052676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-47ec5eb7-ca9e-4cb0-8dac-85f585f25e30 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:12.072683 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-47ec5eb7-ca9e-4cb0-8dac-85f585f25e30 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1314 microversion: 2.1 time: 0.428154 Sep 06 11:02:12.074199 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1287/2593] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:11 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:12.080278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-21b904f8-0131-48c5-8f55-ab95431d2f31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:12.081712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-21b904f8-0131-48c5-8f55-ab95431d2f31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:12.083613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eccc5dd2-9e2d-4bdf-b0b7-d415c9be4ac1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:12.089917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eccc5dd2-9e2d-4bdf-b0b7-d415c9be4ac1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:12.089917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:12.091238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21b904f8-0131-48c5-8f55-ab95431d2f31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:12.091899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21b904f8-0131-48c5-8f55-ab95431d2f31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:12.092498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21b904f8-0131-48c5-8f55-ab95431d2f31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:12.093220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21b904f8-0131-48c5-8f55-ab95431d2f31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:12.094026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21b904f8-0131-48c5-8f55-ab95431d2f31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:12.094619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21b904f8-0131-48c5-8f55-ab95431d2f31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:12.103221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eccc5dd2-9e2d-4bdf-b0b7-d415c9be4ac1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:12.103892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eccc5dd2-9e2d-4bdf-b0b7-d415c9be4ac1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:12.104361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eccc5dd2-9e2d-4bdf-b0b7-d415c9be4ac1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:12.105174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eccc5dd2-9e2d-4bdf-b0b7-d415c9be4ac1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:12.105643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eccc5dd2-9e2d-4bdf-b0b7-d415c9be4ac1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:12.106080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eccc5dd2-9e2d-4bdf-b0b7-d415c9be4ac1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:12.584898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eccc5dd2-9e2d-4bdf-b0b7-d415c9be4ac1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:12.596813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-21b904f8-0131-48c5-8f55-ab95431d2f31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:12.597963 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eccc5dd2-9e2d-4bdf-b0b7-d415c9be4ac1 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1334 microversion: 2.1 time: 0.549435 Sep 06 11:02:12.598818 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1307/2594] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:12 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1334 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:12.605827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7d084da0-5809-4748-901b-17a19d98c75e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:12.607294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7d084da0-5809-4748-901b-17a19d98c75e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:12.607601 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-21b904f8-0131-48c5-8f55-ab95431d2f31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.531986 Sep 06 11:02:12.615292 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1288/2595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:12 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:12.624723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d084da0-5809-4748-901b-17a19d98c75e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:12.625416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d084da0-5809-4748-901b-17a19d98c75e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:12.626198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d084da0-5809-4748-901b-17a19d98c75e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:12.627170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d084da0-5809-4748-901b-17a19d98c75e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:12.628071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d084da0-5809-4748-901b-17a19d98c75e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:12.628720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d084da0-5809-4748-901b-17a19d98c75e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:12.653195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-25e3c0e4-65a5-4667-ab4c-690f0b9e56ba tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Calling method '.version_select at 0x7f90f36c1e50>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:12.657064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25e3c0e4-65a5-4667-ab4c-690f0b9e56ba tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:12.657801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25e3c0e4-65a5-4667-ab4c-690f0b9e56ba tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:12.658470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25e3c0e4-65a5-4667-ab4c-690f0b9e56ba tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:12.668124 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-25e3c0e4-65a5-4667-ab4c-690f0b9e56ba tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.019026 Sep 06 11:02:12.669373 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1289/2596] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 11:02:12 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:02:12.698358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c6264aae-5fd6-4407-b2cb-c1c7842d0198 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:12.705894 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c6264aae-5fd6-4407-b2cb-c1c7842d0198 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011336 Sep 06 11:02:12.707053 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1290/2597] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 11:02:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:02:12.714711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d084da0-5809-4748-901b-17a19d98c75e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:12.718857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5d78674a-9ecb-49df-a12a-c1f54c75507b tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1712833111", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:12.722672 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7d084da0-5809-4748-901b-17a19d98c75e tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1275 microversion: 2.1 time: 0.122115 Sep 06 11:02:12.723352 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1308/2598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:12 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1275 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:12.817284 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5d78674a-9ecb-49df-a12a-c1f54c75507b tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.101985 Sep 06 11:02:12.824939 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1291/2599] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Sep 6 11:02:12 2022] POST /compute/v2.1/flavors => generated 499 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:02:12.830226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e0c782ef-0b61-4ef3-8d4b-6c69cff61402 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:12.839523 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e0c782ef-0b61-4ef3-8d4b-6c69cff61402 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013045 Sep 06 11:02:12.839999 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1309/2600] 10.222.0.20 () {58 vars in 1182 bytes} [Tue Sep 6 11:02:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:02:13.020363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-316439139", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "800d86de-8e09-4250-8d82-b77317d821e3"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:13.096734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d5976687-1850-4036-88dc-6abbcc614c2b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:13.097362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d5976687-1850-4036-88dc-6abbcc614c2b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:13.103758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5976687-1850-4036-88dc-6abbcc614c2b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:13.104253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5976687-1850-4036-88dc-6abbcc614c2b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:13.105905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:02:13.106196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5976687-1850-4036-88dc-6abbcc614c2b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:13.106927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5976687-1850-4036-88dc-6abbcc614c2b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:13.107666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5976687-1850-4036-88dc-6abbcc614c2b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:13.108062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5976687-1850-4036-88dc-6abbcc614c2b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:13.442788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d5976687-1850-4036-88dc-6abbcc614c2b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:13.455508 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d5976687-1850-4036-88dc-6abbcc614c2b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1314 microversion: 2.1 time: 0.359020 Sep 06 11:02:13.456822 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1310/2601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:13 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:13.474473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-896cf6c3-ccb7-4914-8e3d-8d050a5645b5 req-f88a3b31-3210-46ad-bf41-bd5631287a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5217df4d-be5e-4e14-a4ad-c690acc72f20", "name": "network-vif-plugged", "status": "completed", "tag": "c37f7843-aed1-4835-bdd5-25079688f7f3"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:13.488778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-896cf6c3-ccb7-4914-8e3d-8d050a5645b5 req-f88a3b31-3210-46ad-bf41-bd5631287a8a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:13.489612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-896cf6c3-ccb7-4914-8e3d-8d050a5645b5 req-f88a3b31-3210-46ad-bf41-bd5631287a8a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:13.490246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-896cf6c3-ccb7-4914-8e3d-8d050a5645b5 req-f88a3b31-3210-46ad-bf41-bd5631287a8a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:13.507041 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-896cf6c3-ccb7-4914-8e3d-8d050a5645b5 req-f88a3b31-3210-46ad-bf41-bd5631287a8a service nova] Creating event network-vif-plugged:c37f7843-aed1-4835-bdd5-25079688f7f3 for instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 on nch2-master-1 Sep 06 11:02:13.513453 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-896cf6c3-ccb7-4914-8e3d-8d050a5645b5 req-f88a3b31-3210-46ad-bf41-bd5631287a8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055037 Sep 06 11:02:13.515895 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1311/2602] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:13.560520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:02:13.560956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:02:13.561624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:02:13.562256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:02:13.562683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:02:13.577470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:13.578268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:13.578895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:13.579969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:13.580614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:13.581244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:13.605922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Getting quotas for project 2a1f6f54c8d24eaa9eae09e8f30c56f1. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:02:13.614735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Getting quotas for user 3b6e2046e3bd40b3b46802dfa796260b and project 2a1f6f54c8d24eaa9eae09e8f30c56f1. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:02:13.626724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bf4cc2b1-67a1-4d31-835e-303aad22b375 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:13.631177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bf4cc2b1-67a1-4d31-835e-303aad22b375 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:13.644462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf4cc2b1-67a1-4d31-835e-303aad22b375 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:13.645261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf4cc2b1-67a1-4d31-835e-303aad22b375 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:13.645484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:02:13.645715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf4cc2b1-67a1-4d31-835e-303aad22b375 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:13.648285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:02:13.648628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf4cc2b1-67a1-4d31-835e-303aad22b375 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:13.649266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf4cc2b1-67a1-4d31-835e-303aad22b375 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:13.649723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf4cc2b1-67a1-4d31-835e-303aad22b375 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:13.742659 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-62fbe55c-137d-432c-b6f4-57d96402c819 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734929 Sep 06 11:02:13.744591 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1292/2603] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:02:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:02:13.751227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-85ad045b-a54c-4a53-b5ca-5895daf3bb25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:13.761436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-85ad045b-a54c-4a53-b5ca-5895daf3bb25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:13.772175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85ad045b-a54c-4a53-b5ca-5895daf3bb25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:13.772916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85ad045b-a54c-4a53-b5ca-5895daf3bb25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:13.773531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85ad045b-a54c-4a53-b5ca-5895daf3bb25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:13.774442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85ad045b-a54c-4a53-b5ca-5895daf3bb25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:13.775098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85ad045b-a54c-4a53-b5ca-5895daf3bb25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:13.775695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85ad045b-a54c-4a53-b5ca-5895daf3bb25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:13.824747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:13.920434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bf4cc2b1-67a1-4d31-835e-303aad22b375 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:13.938044 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bf4cc2b1-67a1-4d31-835e-303aad22b375 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1334 microversion: 2.1 time: 0.314835 Sep 06 11:02:13.938044 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1312/2604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:13 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1334 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:13.948426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b5e62b6b-dc69-4949-ab81-68a2b30683fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:13.951761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b5e62b6b-dc69-4949-ab81-68a2b30683fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:13.966790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5e62b6b-dc69-4949-ab81-68a2b30683fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:13.966790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5e62b6b-dc69-4949-ab81-68a2b30683fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:13.966790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5e62b6b-dc69-4949-ab81-68a2b30683fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:13.970951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5e62b6b-dc69-4949-ab81-68a2b30683fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:13.972121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5e62b6b-dc69-4949-ab81-68a2b30683fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:13.973178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5e62b6b-dc69-4949-ab81-68a2b30683fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:14.069095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:14.102971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-85ad045b-a54c-4a53-b5ca-5895daf3bb25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:14.115727 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-85ad045b-a54c-4a53-b5ca-5895daf3bb25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.369410 Sep 06 11:02:14.116329 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1293/2605] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:13 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:14.141806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ef7c84a-14cd-48e1-a39f-a70b92ba7908 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:14.142659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ef7c84a-14cd-48e1-a39f-a70b92ba7908 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:14.220644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ef7c84a-14cd-48e1-a39f-a70b92ba7908 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:14.232227 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ef7c84a-14cd-48e1-a39f-a70b92ba7908 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1278 microversion: 2.1 time: 0.097531 Sep 06 11:02:14.242495 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1294/2606] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:14 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:14.278475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b5e62b6b-dc69-4949-ab81-68a2b30683fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:14.293410 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b5e62b6b-dc69-4949-ab81-68a2b30683fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1317 microversion: 2.1 time: 0.356427 Sep 06 11:02:14.295194 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1313/2607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:13 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:14.485264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-12f354cb-72f7-46f6-801c-611128a4a632 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:14.486205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-12f354cb-72f7-46f6-801c-611128a4a632 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:14.494196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12f354cb-72f7-46f6-801c-611128a4a632 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:14.494928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12f354cb-72f7-46f6-801c-611128a4a632 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:14.495571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12f354cb-72f7-46f6-801c-611128a4a632 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:14.496293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12f354cb-72f7-46f6-801c-611128a4a632 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:14.496915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12f354cb-72f7-46f6-801c-611128a4a632 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:14.497508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12f354cb-72f7-46f6-801c-611128a4a632 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:14.754469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-12f354cb-72f7-46f6-801c-611128a4a632 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:14.770791 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-12f354cb-72f7-46f6-801c-611128a4a632 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1314 microversion: 2.1 time: 0.290474 Sep 06 11:02:14.772082 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1295/2608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:14 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:14.927371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-8f50cfcd-bbe5-4237-bc63-f471010d6c7f req-e0bbcaa8-1a58-4208-815f-cc27e902e644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e806fa-6279-4cf1-b884-55a5a6437f44", "tag": "3e107cf1-da4c-4509-9df2-ae5edb4a12db"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:14.947002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8f50cfcd-bbe5-4237-bc63-f471010d6c7f req-e0bbcaa8-1a58-4208-815f-cc27e902e644 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:14.947720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8f50cfcd-bbe5-4237-bc63-f471010d6c7f req-e0bbcaa8-1a58-4208-815f-cc27e902e644 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:14.948191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8f50cfcd-bbe5-4237-bc63-f471010d6c7f req-e0bbcaa8-1a58-4208-815f-cc27e902e644 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:14.961066 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-8f50cfcd-bbe5-4237-bc63-f471010d6c7f req-e0bbcaa8-1a58-4208-815f-cc27e902e644 service nova] Creating event network-changed:3e107cf1-da4c-4509-9df2-ae5edb4a12db for instance 89e806fa-6279-4cf1-b884-55a5a6437f44 on nch2-master-1 Sep 06 11:02:14.961788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d630138b-37ad-4f20-9991-22bc205b1137 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:14.962504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d630138b-37ad-4f20-9991-22bc205b1137 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:14.965880 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-8f50cfcd-bbe5-4237-bc63-f471010d6c7f req-e0bbcaa8-1a58-4208-815f-cc27e902e644 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048279 Sep 06 11:02:14.966678 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1314/2609] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:14.974638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d630138b-37ad-4f20-9991-22bc205b1137 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:14.975178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d630138b-37ad-4f20-9991-22bc205b1137 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:14.975630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d630138b-37ad-4f20-9991-22bc205b1137 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:14.976477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d630138b-37ad-4f20-9991-22bc205b1137 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:14.976840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d630138b-37ad-4f20-9991-22bc205b1137 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:14.977302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d630138b-37ad-4f20-9991-22bc205b1137 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:15.141905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-20e9582e-b8bb-4ac4-86e6-9f679f210980 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:15.142630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-20e9582e-b8bb-4ac4-86e6-9f679f210980 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:15.157480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20e9582e-b8bb-4ac4-86e6-9f679f210980 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:15.165566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20e9582e-b8bb-4ac4-86e6-9f679f210980 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:15.167539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20e9582e-b8bb-4ac4-86e6-9f679f210980 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:15.168241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20e9582e-b8bb-4ac4-86e6-9f679f210980 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:15.170615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20e9582e-b8bb-4ac4-86e6-9f679f210980 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:15.171712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20e9582e-b8bb-4ac4-86e6-9f679f210980 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:15.202499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d630138b-37ad-4f20-9991-22bc205b1137 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:15.212836 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d630138b-37ad-4f20-9991-22bc205b1137 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1334 microversion: 2.1 time: 0.257941 Sep 06 11:02:15.213480 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1296/2610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:14 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1334 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:15.257747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ffc42ba-6399-4802-b00d-73833fb969fa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:15.258669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0ffc42ba-6399-4802-b00d-73833fb969fa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:15.270309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ffc42ba-6399-4802-b00d-73833fb969fa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:15.271123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ffc42ba-6399-4802-b00d-73833fb969fa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:15.271771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ffc42ba-6399-4802-b00d-73833fb969fa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:15.272863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ffc42ba-6399-4802-b00d-73833fb969fa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:15.273568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ffc42ba-6399-4802-b00d-73833fb969fa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:15.274187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ffc42ba-6399-4802-b00d-73833fb969fa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:15.369505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0ffc42ba-6399-4802-b00d-73833fb969fa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:15.377671 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0ffc42ba-6399-4802-b00d-73833fb969fa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1282 microversion: 2.1 time: 0.124743 Sep 06 11:02:15.378258 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1297/2611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:15 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1282 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:15.410391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-be03a247-9ad2-4224-95ad-6b9b8929aad7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:15.411314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-be03a247-9ad2-4224-95ad-6b9b8929aad7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:15.411883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-20e9582e-b8bb-4ac4-86e6-9f679f210980 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:15.415320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:15.425816 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-20e9582e-b8bb-4ac4-86e6-9f679f210980 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1686 microversion: 2.1 time: 0.288457 Sep 06 11:02:15.426548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be03a247-9ad2-4224-95ad-6b9b8929aad7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:15.439504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be03a247-9ad2-4224-95ad-6b9b8929aad7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:15.439504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be03a247-9ad2-4224-95ad-6b9b8929aad7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:15.439504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be03a247-9ad2-4224-95ad-6b9b8929aad7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:15.439504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be03a247-9ad2-4224-95ad-6b9b8929aad7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:15.439504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be03a247-9ad2-4224-95ad-6b9b8929aad7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:15.455733 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1315/2612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:15 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1686 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:15.559524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9b06559c-3b49-4f81-8433-995f0093f208 req-b30c332f-a817-4c0c-a28e-aa4825e53da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9db1902-3f12-48b6-a27f-425e4843424b", "name": "network-vif-unplugged", "status": "completed", "tag": "1fa7746e-916f-47fe-a1b6-1454c7592311"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:15.574177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=20 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:15.577399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9b06559c-3b49-4f81-8433-995f0093f208 req-b30c332f-a817-4c0c-a28e-aa4825e53da4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:15.578147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9b06559c-3b49-4f81-8433-995f0093f208 req-b30c332f-a817-4c0c-a28e-aa4825e53da4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:15.582522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9b06559c-3b49-4f81-8433-995f0093f208 req-b30c332f-a817-4c0c-a28e-aa4825e53da4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:15.625435 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9b06559c-3b49-4f81-8433-995f0093f208 req-b30c332f-a817-4c0c-a28e-aa4825e53da4 service nova] Creating event network-vif-unplugged:1fa7746e-916f-47fe-a1b6-1454c7592311 for instance d9db1902-3f12-48b6-a27f-425e4843424b on nch2-master-1 Sep 06 11:02:15.641519 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9b06559c-3b49-4f81-8433-995f0093f208 req-b30c332f-a817-4c0c-a28e-aa4825e53da4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086631 Sep 06 11:02:15.643973 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1316/2613] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:02:15.729777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-be03a247-9ad2-4224-95ad-6b9b8929aad7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:15.742286 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-be03a247-9ad2-4224-95ad-6b9b8929aad7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1317 microversion: 2.1 time: 0.348264 Sep 06 11:02:15.744039 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1298/2614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:15 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:15.799416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0776e83d-d772-47ba-a215-24a05b546a99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:15.800483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0776e83d-d772-47ba-a215-24a05b546a99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:15.822437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0776e83d-d772-47ba-a215-24a05b546a99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:15.822946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0776e83d-d772-47ba-a215-24a05b546a99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:15.823642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0776e83d-d772-47ba-a215-24a05b546a99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:15.824951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0776e83d-d772-47ba-a215-24a05b546a99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:15.830926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0776e83d-d772-47ba-a215-24a05b546a99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:15.831657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0776e83d-d772-47ba-a215-24a05b546a99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:16.107688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0776e83d-d772-47ba-a215-24a05b546a99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:16.116353 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0776e83d-d772-47ba-a215-24a05b546a99 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1501 microversion: 2.1 time: 0.323863 Sep 06 11:02:16.120692 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1317/2615] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:15 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1501 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:16.166730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a7a3758b-a0a4-4466-85f5-734409a56a38 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:16.168189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a7a3758b-a0a4-4466-85f5-734409a56a38 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:16.180821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7a3758b-a0a4-4466-85f5-734409a56a38 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:16.181611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7a3758b-a0a4-4466-85f5-734409a56a38 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:16.182208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7a3758b-a0a4-4466-85f5-734409a56a38 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:16.183106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7a3758b-a0a4-4466-85f5-734409a56a38 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:16.183762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7a3758b-a0a4-4466-85f5-734409a56a38 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:16.184416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7a3758b-a0a4-4466-85f5-734409a56a38 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:16.229337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-a7a3758b-a0a4-4466-85f5-734409a56a38 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lazy-loading 'flavor' on Instance uuid 5217df4d-be5e-4e14-a4ad-c690acc72f20 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:02:16.244244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c1c84c70-da1a-422e-b106-51ea1d851e13 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:16.245134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c1c84c70-da1a-422e-b106-51ea1d851e13 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:16.256274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1c84c70-da1a-422e-b106-51ea1d851e13 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:16.258999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1c84c70-da1a-422e-b106-51ea1d851e13 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:16.265100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1c84c70-da1a-422e-b106-51ea1d851e13 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:16.265100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1c84c70-da1a-422e-b106-51ea1d851e13 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:16.265100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1c84c70-da1a-422e-b106-51ea1d851e13 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:16.265767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1c84c70-da1a-422e-b106-51ea1d851e13 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:16.524153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c1c84c70-da1a-422e-b106-51ea1d851e13 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:16.539182 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c1c84c70-da1a-422e-b106-51ea1d851e13 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1334 microversion: 2.1 time: 0.296384 Sep 06 11:02:16.545471 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1318/2616] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:16 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1334 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:16.557652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9c1bbc1c-8cf9-4405-9594-8225e20faa9f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:16.561894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9c1bbc1c-8cf9-4405-9594-8225e20faa9f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:16.564913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c1bbc1c-8cf9-4405-9594-8225e20faa9f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:16.565517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c1bbc1c-8cf9-4405-9594-8225e20faa9f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:16.566027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c1bbc1c-8cf9-4405-9594-8225e20faa9f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:16.567001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c1bbc1c-8cf9-4405-9594-8225e20faa9f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:16.567694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c1bbc1c-8cf9-4405-9594-8225e20faa9f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:16.568169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9c1bbc1c-8cf9-4405-9594-8225e20faa9f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:16.658625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9c1bbc1c-8cf9-4405-9594-8225e20faa9f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:16.683813 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9c1bbc1c-8cf9-4405-9594-8225e20faa9f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1330 microversion: 2.1 time: 0.124894 Sep 06 11:02:16.683813 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1319/2617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:16 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1330 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:16.683813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-efb00454-91be-4ea1-9e2a-56806c9299b9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:16.683813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-efb00454-91be-4ea1-9e2a-56806c9299b9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:16.684253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efb00454-91be-4ea1-9e2a-56806c9299b9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:16.684442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efb00454-91be-4ea1-9e2a-56806c9299b9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:16.684880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efb00454-91be-4ea1-9e2a-56806c9299b9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:16.686177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efb00454-91be-4ea1-9e2a-56806c9299b9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:16.686856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efb00454-91be-4ea1-9e2a-56806c9299b9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:16.687482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efb00454-91be-4ea1-9e2a-56806c9299b9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:16.742791 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a7a3758b-a0a4-4466-85f5-734409a56a38 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "POST /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20/action" status: 202 len: 0 microversion: 2.1 time: 0.591473 Sep 06 11:02:16.742791 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1299/2618] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:02:16 2022] POST /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:02:16.747260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a0808454-8f2e-4306-ac70-32bc9ccc2d67 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:16.748080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a0808454-8f2e-4306-ac70-32bc9ccc2d67 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:16.757603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0808454-8f2e-4306-ac70-32bc9ccc2d67 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:16.758443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0808454-8f2e-4306-ac70-32bc9ccc2d67 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:16.760629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0808454-8f2e-4306-ac70-32bc9ccc2d67 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:16.763750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0808454-8f2e-4306-ac70-32bc9ccc2d67 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:16.765117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0808454-8f2e-4306-ac70-32bc9ccc2d67 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:16.765627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0808454-8f2e-4306-ac70-32bc9ccc2d67 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:16.895666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-efb00454-91be-4ea1-9e2a-56806c9299b9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:16.909295 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-efb00454-91be-4ea1-9e2a-56806c9299b9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1686 microversion: 2.1 time: 0.235833 Sep 06 11:02:16.929213 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1320/2619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:16 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1686 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:16.933863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5993d03b-8a98-4d2c-8474-1cebc5237e8c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:16.934484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5993d03b-8a98-4d2c-8474-1cebc5237e8c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:16.950777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5993d03b-8a98-4d2c-8474-1cebc5237e8c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:16.951311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5993d03b-8a98-4d2c-8474-1cebc5237e8c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:16.951757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5993d03b-8a98-4d2c-8474-1cebc5237e8c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:16.952474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5993d03b-8a98-4d2c-8474-1cebc5237e8c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:16.952935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5993d03b-8a98-4d2c-8474-1cebc5237e8c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:16.953388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5993d03b-8a98-4d2c-8474-1cebc5237e8c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:17.024511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a0808454-8f2e-4306-ac70-32bc9ccc2d67 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:17.036009 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a0808454-8f2e-4306-ac70-32bc9ccc2d67 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1509 microversion: 2.1 time: 0.295197 Sep 06 11:02:17.036978 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1300/2620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:16 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1509 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:17.306633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5993d03b-8a98-4d2c-8474-1cebc5237e8c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:17.317187 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5993d03b-8a98-4d2c-8474-1cebc5237e8c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1317 microversion: 2.1 time: 0.387133 Sep 06 11:02:17.317790 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1321/2621] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:16 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:17.564993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8196fe5c-e0d2-47c9-8f2d-530aaef3de32 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:17.566744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8196fe5c-e0d2-47c9-8f2d-530aaef3de32 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:17.574252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8196fe5c-e0d2-47c9-8f2d-530aaef3de32 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:17.575118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8196fe5c-e0d2-47c9-8f2d-530aaef3de32 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:17.576521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8196fe5c-e0d2-47c9-8f2d-530aaef3de32 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:17.578178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8196fe5c-e0d2-47c9-8f2d-530aaef3de32 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:17.578974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8196fe5c-e0d2-47c9-8f2d-530aaef3de32 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:17.579866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8196fe5c-e0d2-47c9-8f2d-530aaef3de32 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:17.681496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-b259274e-3911-416e-bb77-9816f92128d6 req-ac651f3e-fa8d-4b93-8185-e967078f7784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53022c77-a7ad-42cd-843f-0a4ead29e639", "name": "network-vif-plugged", "status": "completed", "tag": "f5feaeb3-8243-4f2d-a254-f8b588b4e20f"}, {"server_uuid": "53022c77-a7ad-42cd-843f-0a4ead29e639", "name": "network-vif-plugged", "status": "completed", "tag": "c01851d8-eec8-44e3-b8fa-7988a9dd1375"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:17.696992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b259274e-3911-416e-bb77-9816f92128d6 req-ac651f3e-fa8d-4b93-8185-e967078f7784 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:17.707922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b259274e-3911-416e-bb77-9816f92128d6 req-ac651f3e-fa8d-4b93-8185-e967078f7784 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:17.709066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b259274e-3911-416e-bb77-9816f92128d6 req-ac651f3e-fa8d-4b93-8185-e967078f7784 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:17.728375 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-b259274e-3911-416e-bb77-9816f92128d6 req-ac651f3e-fa8d-4b93-8185-e967078f7784 service nova] Creating event network-vif-plugged:f5feaeb3-8243-4f2d-a254-f8b588b4e20f for instance 53022c77-a7ad-42cd-843f-0a4ead29e639 on nch1-master-1 Sep 06 11:02:17.729446 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-b259274e-3911-416e-bb77-9816f92128d6 req-ac651f3e-fa8d-4b93-8185-e967078f7784 service nova] Creating event network-vif-plugged:c01851d8-eec8-44e3-b8fa-7988a9dd1375 for instance 53022c77-a7ad-42cd-843f-0a4ead29e639 on nch1-master-1 Sep 06 11:02:17.737315 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-b259274e-3911-416e-bb77-9816f92128d6 req-ac651f3e-fa8d-4b93-8185-e967078f7784 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062142 Sep 06 11:02:17.737953 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1322/2622] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:17.745749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c511639d-4635-4813-92a1-4488c9e2a601 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:17.746863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c511639d-4635-4813-92a1-4488c9e2a601 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:17.755533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c511639d-4635-4813-92a1-4488c9e2a601 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:17.757548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c511639d-4635-4813-92a1-4488c9e2a601 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:17.758320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c511639d-4635-4813-92a1-4488c9e2a601 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:17.759698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c511639d-4635-4813-92a1-4488c9e2a601 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:17.760336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c511639d-4635-4813-92a1-4488c9e2a601 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:17.760991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c511639d-4635-4813-92a1-4488c9e2a601 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:17.868689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c511639d-4635-4813-92a1-4488c9e2a601 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:17.894931 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c511639d-4635-4813-92a1-4488c9e2a601 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1336 microversion: 2.1 time: 0.155118 Sep 06 11:02:17.896099 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1323/2623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:17 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1336 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:17.928246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8196fe5c-e0d2-47c9-8f2d-530aaef3de32 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:17.941495 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8196fe5c-e0d2-47c9-8f2d-530aaef3de32 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1334 microversion: 2.1 time: 0.380467 Sep 06 11:02:17.946157 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1301/2624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:17 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1334 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:17.949621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cbdad697-faf4-4ce0-88bb-b6e66bf497d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:17.950467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cbdad697-faf4-4ce0-88bb-b6e66bf497d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:17.961777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbdad697-faf4-4ce0-88bb-b6e66bf497d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:17.967080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbdad697-faf4-4ce0-88bb-b6e66bf497d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:17.967080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbdad697-faf4-4ce0-88bb-b6e66bf497d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:17.967080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbdad697-faf4-4ce0-88bb-b6e66bf497d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:17.967080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbdad697-faf4-4ce0-88bb-b6e66bf497d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:17.967827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbdad697-faf4-4ce0-88bb-b6e66bf497d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:18.061391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b2b339e6-99a8-46a2-b317-9748bd7273b6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:18.063293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b2b339e6-99a8-46a2-b317-9748bd7273b6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:18.077258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2b339e6-99a8-46a2-b317-9748bd7273b6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:18.078724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2b339e6-99a8-46a2-b317-9748bd7273b6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:18.080037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2b339e6-99a8-46a2-b317-9748bd7273b6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:18.080816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2b339e6-99a8-46a2-b317-9748bd7273b6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:18.081318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2b339e6-99a8-46a2-b317-9748bd7273b6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:18.081984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2b339e6-99a8-46a2-b317-9748bd7273b6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:18.648134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cbdad697-faf4-4ce0-88bb-b6e66bf497d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:18.668110 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cbdad697-faf4-4ce0-88bb-b6e66bf497d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1686 microversion: 2.1 time: 0.732150 Sep 06 11:02:18.669399 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1324/2625] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:17 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1686 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:18.689961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a37cfea8-3c50-4032-a5e2-ba71600234b8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:18.691607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a37cfea8-3c50-4032-a5e2-ba71600234b8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:18.700990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a37cfea8-3c50-4032-a5e2-ba71600234b8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:18.701360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b2b339e6-99a8-46a2-b317-9748bd7273b6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:18.702325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a37cfea8-3c50-4032-a5e2-ba71600234b8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:18.703327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a37cfea8-3c50-4032-a5e2-ba71600234b8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:18.705128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a37cfea8-3c50-4032-a5e2-ba71600234b8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:18.708109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a37cfea8-3c50-4032-a5e2-ba71600234b8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:18.708964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a37cfea8-3c50-4032-a5e2-ba71600234b8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:18.720160 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b2b339e6-99a8-46a2-b317-9748bd7273b6 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1509 microversion: 2.1 time: 0.662567 Sep 06 11:02:18.724119 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1302/2626] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:18 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1509 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:18.931448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e6bb3cf0-b604-44fa-9fd3-4ab17d0e1f88 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:18.932410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e6bb3cf0-b604-44fa-9fd3-4ab17d0e1f88 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:18.950059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6bb3cf0-b604-44fa-9fd3-4ab17d0e1f88 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:18.950867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6bb3cf0-b604-44fa-9fd3-4ab17d0e1f88 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:18.951495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6bb3cf0-b604-44fa-9fd3-4ab17d0e1f88 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:18.954964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6bb3cf0-b604-44fa-9fd3-4ab17d0e1f88 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:18.955930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6bb3cf0-b604-44fa-9fd3-4ab17d0e1f88 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:18.967890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6bb3cf0-b604-44fa-9fd3-4ab17d0e1f88 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:18.973562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a37cfea8-3c50-4032-a5e2-ba71600234b8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:18.994730 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a37cfea8-3c50-4032-a5e2-ba71600234b8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1317 microversion: 2.1 time: 0.323717 Sep 06 11:02:18.995563 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1325/2627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:18 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:19.017607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-01f4c113-47fe-46bf-a988-020a5b902715 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:19.019744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-01f4c113-47fe-46bf-a988-020a5b902715 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:19.035135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01f4c113-47fe-46bf-a988-020a5b902715 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:19.038521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01f4c113-47fe-46bf-a988-020a5b902715 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:19.039798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01f4c113-47fe-46bf-a988-020a5b902715 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:19.041327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01f4c113-47fe-46bf-a988-020a5b902715 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:19.042296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01f4c113-47fe-46bf-a988-020a5b902715 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:19.043862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01f4c113-47fe-46bf-a988-020a5b902715 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:19.385933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e6bb3cf0-b604-44fa-9fd3-4ab17d0e1f88 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:19.411342 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e6bb3cf0-b604-44fa-9fd3-4ab17d0e1f88 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1378 microversion: 2.1 time: 0.484953 Sep 06 11:02:19.424671 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1303/2628] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:18 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1378 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:19.435510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-80ac43fa-00b9-49cd-b25d-12c7903b6663 req-c5882d37-f460-40e5-b2be-9f95e3ecdd14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0611012-ede1-4ec2-b586-e3ba1f562253", "tag": "ecc6e385-dc5e-4440-9b3e-e389cf5f0eed"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:19.454896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-80ac43fa-00b9-49cd-b25d-12c7903b6663 req-c5882d37-f460-40e5-b2be-9f95e3ecdd14 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:19.455676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-80ac43fa-00b9-49cd-b25d-12c7903b6663 req-c5882d37-f460-40e5-b2be-9f95e3ecdd14 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:19.456485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-80ac43fa-00b9-49cd-b25d-12c7903b6663 req-c5882d37-f460-40e5-b2be-9f95e3ecdd14 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:19.483570 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-80ac43fa-00b9-49cd-b25d-12c7903b6663 req-c5882d37-f460-40e5-b2be-9f95e3ecdd14 service nova] Creating event network-changed:ecc6e385-dc5e-4440-9b3e-e389cf5f0eed for instance b0611012-ede1-4ec2-b586-e3ba1f562253 on nch1-master-1 Sep 06 11:02:19.494288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-01f4c113-47fe-46bf-a988-020a5b902715 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:19.496396 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-80ac43fa-00b9-49cd-b25d-12c7903b6663 req-c5882d37-f460-40e5-b2be-9f95e3ecdd14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065634 Sep 06 11:02:19.497541 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1304/2629] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:19.507810 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-01f4c113-47fe-46bf-a988-020a5b902715 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1334 microversion: 2.1 time: 0.510050 Sep 06 11:02:19.508926 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1326/2630] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:18 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1334 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:19.700160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c74aecd0-b5cc-437c-9112-3e59f9d1dfb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:19.703985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c74aecd0-b5cc-437c-9112-3e59f9d1dfb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:19.719003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c74aecd0-b5cc-437c-9112-3e59f9d1dfb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:19.720155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c74aecd0-b5cc-437c-9112-3e59f9d1dfb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:19.722847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c74aecd0-b5cc-437c-9112-3e59f9d1dfb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:19.723782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c74aecd0-b5cc-437c-9112-3e59f9d1dfb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:19.724991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c74aecd0-b5cc-437c-9112-3e59f9d1dfb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:19.728277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c74aecd0-b5cc-437c-9112-3e59f9d1dfb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:19.751178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2fa7d2d1-e1c6-4b66-8348-efd247a9338d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:19.751893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2fa7d2d1-e1c6-4b66-8348-efd247a9338d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:19.760353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fa7d2d1-e1c6-4b66-8348-efd247a9338d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:19.765432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fa7d2d1-e1c6-4b66-8348-efd247a9338d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:19.767815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fa7d2d1-e1c6-4b66-8348-efd247a9338d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:19.771558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fa7d2d1-e1c6-4b66-8348-efd247a9338d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:19.771558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fa7d2d1-e1c6-4b66-8348-efd247a9338d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:19.771558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fa7d2d1-e1c6-4b66-8348-efd247a9338d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:20.121950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2fa7d2d1-e1c6-4b66-8348-efd247a9338d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:20.130721 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2fa7d2d1-e1c6-4b66-8348-efd247a9338d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1492 microversion: 2.1 time: 0.383469 Sep 06 11:02:20.131672 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1327/2631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:19 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1492 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:20.139750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b70e1a3b-4fcb-4978-b9d2-7c7fdf2f924c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:20.140968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b70e1a3b-4fcb-4978-b9d2-7c7fdf2f924c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:20.148847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b70e1a3b-4fcb-4978-b9d2-7c7fdf2f924c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:20.149621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b70e1a3b-4fcb-4978-b9d2-7c7fdf2f924c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:20.150485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b70e1a3b-4fcb-4978-b9d2-7c7fdf2f924c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:20.151491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b70e1a3b-4fcb-4978-b9d2-7c7fdf2f924c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:20.152190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b70e1a3b-4fcb-4978-b9d2-7c7fdf2f924c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:20.152977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b70e1a3b-4fcb-4978-b9d2-7c7fdf2f924c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:20.158163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c74aecd0-b5cc-437c-9112-3e59f9d1dfb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:20.170660 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c74aecd0-b5cc-437c-9112-3e59f9d1dfb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.476301 Sep 06 11:02:20.181757 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1305/2632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:19 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:20.196677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4bc74736-09ab-4b9a-ab06-0fe859871f28 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:20.200183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4bc74736-09ab-4b9a-ab06-0fe859871f28 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:20.219795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bc74736-09ab-4b9a-ab06-0fe859871f28 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:20.222301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bc74736-09ab-4b9a-ab06-0fe859871f28 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:20.222925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bc74736-09ab-4b9a-ab06-0fe859871f28 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:20.226941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bc74736-09ab-4b9a-ab06-0fe859871f28 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:20.227666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bc74736-09ab-4b9a-ab06-0fe859871f28 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:20.228349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bc74736-09ab-4b9a-ab06-0fe859871f28 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:20.294682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4bc74736-09ab-4b9a-ab06-0fe859871f28 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:02:20.471680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b70e1a3b-4fcb-4978-b9d2-7c7fdf2f924c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:20.492857 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b70e1a3b-4fcb-4978-b9d2-7c7fdf2f924c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1317 microversion: 2.1 time: 0.358848 Sep 06 11:02:20.503906 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1328/2633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:20 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:20.510727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-066b54ee-7b39-4e39-97ae-5d1c1398fc87 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:20.511772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-066b54ee-7b39-4e39-97ae-5d1c1398fc87 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:20.520334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-066b54ee-7b39-4e39-97ae-5d1c1398fc87 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:20.521110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-066b54ee-7b39-4e39-97ae-5d1c1398fc87 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:20.521972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-066b54ee-7b39-4e39-97ae-5d1c1398fc87 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:20.523616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-066b54ee-7b39-4e39-97ae-5d1c1398fc87 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:20.524257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-066b54ee-7b39-4e39-97ae-5d1c1398fc87 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:20.524931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-066b54ee-7b39-4e39-97ae-5d1c1398fc87 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:20.753955 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4bc74736-09ab-4b9a-ab06-0fe859871f28 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 204 len: 0 microversion: 2.1 time: 0.570316 Sep 06 11:02:20.755260 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1306/2634] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:02:20 2022] DELETE /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:02:20.762933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd53c9d3-b2ee-429b-ab77-e2498fc3500f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:20.764214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fd53c9d3-b2ee-429b-ab77-e2498fc3500f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:20.771705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd53c9d3-b2ee-429b-ab77-e2498fc3500f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:20.774767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd53c9d3-b2ee-429b-ab77-e2498fc3500f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:20.775991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd53c9d3-b2ee-429b-ab77-e2498fc3500f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:20.777296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd53c9d3-b2ee-429b-ab77-e2498fc3500f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:20.777990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd53c9d3-b2ee-429b-ab77-e2498fc3500f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:20.778800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd53c9d3-b2ee-429b-ab77-e2498fc3500f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:21.040407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-066b54ee-7b39-4e39-97ae-5d1c1398fc87 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:21.052509 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-066b54ee-7b39-4e39-97ae-5d1c1398fc87 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1378 microversion: 2.1 time: 0.546903 Sep 06 11:02:21.055274 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1329/2635] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:20 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1378 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:21.073196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c614dace-ddba-4974-ae0f-06d0faa0ed3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:21.074355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c614dace-ddba-4974-ae0f-06d0faa0ed3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:21.086253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c614dace-ddba-4974-ae0f-06d0faa0ed3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:21.087253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c614dace-ddba-4974-ae0f-06d0faa0ed3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:21.091819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c614dace-ddba-4974-ae0f-06d0faa0ed3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:21.093442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c614dace-ddba-4974-ae0f-06d0faa0ed3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:21.094542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c614dace-ddba-4974-ae0f-06d0faa0ed3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:21.095026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c614dace-ddba-4974-ae0f-06d0faa0ed3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:21.355398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fd53c9d3-b2ee-429b-ab77-e2498fc3500f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:21.378047 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd53c9d3-b2ee-429b-ab77-e2498fc3500f tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1669 microversion: 2.1 time: 0.615907 Sep 06 11:02:21.381907 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1307/2636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:20 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1669 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:21.407545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6cadc25c-4ac4-4621-8f87-83100fe0b5c8 req-361fdcf7-9b80-4b3f-b02c-b323c3df47c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9db1902-3f12-48b6-a27f-425e4843424b", "name": "network-vif-plugged", "status": "completed", "tag": "1fa7746e-916f-47fe-a1b6-1454c7592311"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:21.457627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6cadc25c-4ac4-4621-8f87-83100fe0b5c8 req-361fdcf7-9b80-4b3f-b02c-b323c3df47c3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:21.458362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6cadc25c-4ac4-4621-8f87-83100fe0b5c8 req-361fdcf7-9b80-4b3f-b02c-b323c3df47c3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:21.460128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6cadc25c-4ac4-4621-8f87-83100fe0b5c8 req-361fdcf7-9b80-4b3f-b02c-b323c3df47c3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:21.499862 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6cadc25c-4ac4-4621-8f87-83100fe0b5c8 req-361fdcf7-9b80-4b3f-b02c-b323c3df47c3 service nova] Creating event network-vif-plugged:1fa7746e-916f-47fe-a1b6-1454c7592311 for instance d9db1902-3f12-48b6-a27f-425e4843424b on nch2-master-1 Sep 06 11:02:21.517914 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6cadc25c-4ac4-4621-8f87-83100fe0b5c8 req-361fdcf7-9b80-4b3f-b02c-b323c3df47c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130611 Sep 06 11:02:21.518751 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1308/2637] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:21.533051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-359f2574-5175-47fd-90d1-b35b1e1f37da tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:21.538016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-359f2574-5175-47fd-90d1-b35b1e1f37da tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:21.565737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-359f2574-5175-47fd-90d1-b35b1e1f37da tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:21.567902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-359f2574-5175-47fd-90d1-b35b1e1f37da tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:21.568580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-359f2574-5175-47fd-90d1-b35b1e1f37da tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:21.569572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-359f2574-5175-47fd-90d1-b35b1e1f37da tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:21.577067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-359f2574-5175-47fd-90d1-b35b1e1f37da tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:21.577547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-359f2574-5175-47fd-90d1-b35b1e1f37da tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:21.583384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:21.761444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c614dace-ddba-4974-ae0f-06d0faa0ed3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:21.781189 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c614dace-ddba-4974-ae0f-06d0faa0ed3f tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1498 microversion: 2.1 time: 0.724753 Sep 06 11:02:21.782539 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1330/2638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:21 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1498 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:21.799887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d069903c-7430-464d-891d-873a3a418d72 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:21.800642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d069903c-7430-464d-891d-873a3a418d72 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:21.818242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d069903c-7430-464d-891d-873a3a418d72 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:21.825390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d069903c-7430-464d-891d-873a3a418d72 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:21.826230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d069903c-7430-464d-891d-873a3a418d72 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:21.836348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d069903c-7430-464d-891d-873a3a418d72 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:21.837057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d069903c-7430-464d-891d-873a3a418d72 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:21.840578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d069903c-7430-464d-891d-873a3a418d72 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:21.910954 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d069903c-7430-464d-891d-873a3a418d72 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639/ips" status: 200 len: 179 microversion: 2.1 time: 0.126952 Sep 06 11:02:21.939445 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1331/2639] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:02:21 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639/ips => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:21.948960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0fef9681-9f2d-4415-9daf-e8118780c38c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:21.960214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0fef9681-9f2d-4415-9daf-e8118780c38c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:21.988501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fef9681-9f2d-4415-9daf-e8118780c38c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:21.989012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fef9681-9f2d-4415-9daf-e8118780c38c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:21.990036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fef9681-9f2d-4415-9daf-e8118780c38c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:21.990237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fef9681-9f2d-4415-9daf-e8118780c38c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:21.998425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-359f2574-5175-47fd-90d1-b35b1e1f37da tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:21.998942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fef9681-9f2d-4415-9daf-e8118780c38c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:21.999904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fef9681-9f2d-4415-9daf-e8118780c38c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:22.015815 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-359f2574-5175-47fd-90d1-b35b1e1f37da tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.493521 Sep 06 11:02:22.039046 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1309/2640] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:21 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:22.056538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a75be617-c1e6-4bf5-b674-899cf6bac6ce tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:22.056538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a75be617-c1e6-4bf5-b674-899cf6bac6ce tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:22.058895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:22.101870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a75be617-c1e6-4bf5-b674-899cf6bac6ce tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:22.103724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a75be617-c1e6-4bf5-b674-899cf6bac6ce tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:22.106775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a75be617-c1e6-4bf5-b674-899cf6bac6ce tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:22.107785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a75be617-c1e6-4bf5-b674-899cf6bac6ce tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:22.109798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a75be617-c1e6-4bf5-b674-899cf6bac6ce tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:22.110451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a75be617-c1e6-4bf5-b674-899cf6bac6ce tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:22.169581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a75be617-c1e6-4bf5-b674-899cf6bac6ce tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:02:22.319118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0fef9681-9f2d-4415-9daf-e8118780c38c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:22.341600 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0fef9681-9f2d-4415-9daf-e8118780c38c tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1317 microversion: 2.1 time: 0.398647 Sep 06 11:02:22.342211 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1332/2641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:21 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:22.561285 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a75be617-c1e6-4bf5-b674-899cf6bac6ce tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 204 len: 0 microversion: 2.1 time: 0.515060 Sep 06 11:02:22.561725 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1310/2642] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:02:22 2022] DELETE /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:02:22.571249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8492f64d-126b-4ca0-a6c5-dfc9c6c8a2c1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:22.572065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8492f64d-126b-4ca0-a6c5-dfc9c6c8a2c1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:22.582141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-135222305", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "2e14709a-777d-42eb-b577-4fb177f97dc8"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:22.589904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8492f64d-126b-4ca0-a6c5-dfc9c6c8a2c1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:22.596640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8492f64d-126b-4ca0-a6c5-dfc9c6c8a2c1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:22.596640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8492f64d-126b-4ca0-a6c5-dfc9c6c8a2c1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:22.596640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8492f64d-126b-4ca0-a6c5-dfc9c6c8a2c1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:22.596640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8492f64d-126b-4ca0-a6c5-dfc9c6c8a2c1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:22.596640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8492f64d-126b-4ca0-a6c5-dfc9c6c8a2c1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:22.692204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] validate_networks() for [('2e14709a-777d-42eb-b577-4fb177f97dc8', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:02:23.090003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8492f64d-126b-4ca0-a6c5-dfc9c6c8a2c1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:23.104408 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8492f64d-126b-4ca0-a6c5-dfc9c6c8a2c1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1378 microversion: 2.1 time: 0.540909 Sep 06 11:02:23.107457 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1311/2643] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:22 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1378 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:23.113412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bb66de66-94b8-472c-a04a-2da153b014e7 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:23.120659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bb66de66-94b8-472c-a04a-2da153b014e7 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:23.130890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb66de66-94b8-472c-a04a-2da153b014e7 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:23.131418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb66de66-94b8-472c-a04a-2da153b014e7 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:23.132666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb66de66-94b8-472c-a04a-2da153b014e7 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:23.144184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb66de66-94b8-472c-a04a-2da153b014e7 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:23.145336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb66de66-94b8-472c-a04a-2da153b014e7 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:23.146071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb66de66-94b8-472c-a04a-2da153b014e7 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:23.597111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:23.603974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bb66de66-94b8-472c-a04a-2da153b014e7 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:23.613057 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bb66de66-94b8-472c-a04a-2da153b014e7 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1675 microversion: 2.1 time: 0.503028 Sep 06 11:02:23.614324 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1312/2644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:23 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1675 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:23.623437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aa0c1a85-95f3-4945-96ca-94ee55935b46 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:23.624655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aa0c1a85-95f3-4945-96ca-94ee55935b46 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:23.635499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa0c1a85-95f3-4945-96ca-94ee55935b46 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:23.636878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa0c1a85-95f3-4945-96ca-94ee55935b46 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:23.637567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa0c1a85-95f3-4945-96ca-94ee55935b46 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:23.638668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa0c1a85-95f3-4945-96ca-94ee55935b46 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:23.639416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa0c1a85-95f3-4945-96ca-94ee55935b46 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:23.640357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa0c1a85-95f3-4945-96ca-94ee55935b46 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:23.918851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:02:23.919268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:02:23.919715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:02:23.920137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:02:23.920745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:02:23.939795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:23.942503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:23.945224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:23.946251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:23.946913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:23.949409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aa0c1a85-95f3-4945-96ca-94ee55935b46 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:23.949759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:23.960001 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aa0c1a85-95f3-4945-96ca-94ee55935b46 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1498 microversion: 2.1 time: 0.343885 Sep 06 11:02:23.980470 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1313/2645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:23 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1498 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:23.988209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e451bed-0e63-4c0f-807b-69aa096d1327 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:23.988898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3e451bed-0e63-4c0f-807b-69aa096d1327 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:23.999224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e451bed-0e63-4c0f-807b-69aa096d1327 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:23.999726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e451bed-0e63-4c0f-807b-69aa096d1327 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:24.000171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e451bed-0e63-4c0f-807b-69aa096d1327 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:24.000884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e451bed-0e63-4c0f-807b-69aa096d1327 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:24.001346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e451bed-0e63-4c0f-807b-69aa096d1327 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:24.001775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e451bed-0e63-4c0f-807b-69aa096d1327 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:24.012272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Getting quotas for project 0e8540c8171e480b83fd68fbb5f159be. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:02:24.022885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Getting quotas for user 00e93a2f8ed643ba8bc92b4def1ce7f3 and project 0e8540c8171e480b83fd68fbb5f159be. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:02:24.044087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:02:24.046750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:02:24.225169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=14 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:24.281111 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-93e9b464-af1c-4029-858b-e66156b1e012 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.937649 Sep 06 11:02:24.284368 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1333/2646] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:02:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:02:24.304571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0cf4700a-97b1-4851-9c9a-76bcec172bb7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:24.306375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0cf4700a-97b1-4851-9c9a-76bcec172bb7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:24.346934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cf4700a-97b1-4851-9c9a-76bcec172bb7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:24.348196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cf4700a-97b1-4851-9c9a-76bcec172bb7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:24.348323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cf4700a-97b1-4851-9c9a-76bcec172bb7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:24.349267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cf4700a-97b1-4851-9c9a-76bcec172bb7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:24.350049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cf4700a-97b1-4851-9c9a-76bcec172bb7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:24.352092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cf4700a-97b1-4851-9c9a-76bcec172bb7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:24.444872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3e451bed-0e63-4c0f-807b-69aa096d1327 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:24.459974 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3e451bed-0e63-4c0f-807b-69aa096d1327 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.478260 Sep 06 11:02:24.475415 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1314/2647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:23 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:24.487891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8ae34159-9ae1-4008-9e5b-4a378a0326b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:24.489692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8ae34159-9ae1-4008-9e5b-4a378a0326b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:24.519447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ae34159-9ae1-4008-9e5b-4a378a0326b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:24.520405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ae34159-9ae1-4008-9e5b-4a378a0326b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:24.521038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ae34159-9ae1-4008-9e5b-4a378a0326b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:24.524677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ae34159-9ae1-4008-9e5b-4a378a0326b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:24.525396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ae34159-9ae1-4008-9e5b-4a378a0326b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:24.526021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ae34159-9ae1-4008-9e5b-4a378a0326b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:24.977116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0cf4700a-97b1-4851-9c9a-76bcec172bb7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:24.997218 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0cf4700a-97b1-4851-9c9a-76bcec172bb7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1317 microversion: 2.1 time: 0.711264 Sep 06 11:02:24.999062 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1334/2648] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:24 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1317 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:25.024795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-03157fb8-7440-44c1-b861-2ec370ce892f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:25.025431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-03157fb8-7440-44c1-b861-2ec370ce892f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:25.068915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8ae34159-9ae1-4008-9e5b-4a378a0326b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:25.086587 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8ae34159-9ae1-4008-9e5b-4a378a0326b2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1378 microversion: 2.1 time: 0.608392 Sep 06 11:02:25.087531 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1315/2649] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:24 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1378 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:25.095274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-10b9a9a5-bb0f-4547-ad71-b277ead58c77 req-1743c302-ac65-4171-ae10-d90c59ebd210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5217df4d-be5e-4e14-a4ad-c690acc72f20", "name": "network-vif-deleted", "tag": "c37f7843-aed1-4835-bdd5-25079688f7f3"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:25.115702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-10b9a9a5-bb0f-4547-ad71-b277ead58c77 req-1743c302-ac65-4171-ae10-d90c59ebd210 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:25.116684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-10b9a9a5-bb0f-4547-ad71-b277ead58c77 req-1743c302-ac65-4171-ae10-d90c59ebd210 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:25.117138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-10b9a9a5-bb0f-4547-ad71-b277ead58c77 req-1743c302-ac65-4171-ae10-d90c59ebd210 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:25.169991 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-10b9a9a5-bb0f-4547-ad71-b277ead58c77 req-1743c302-ac65-4171-ae10-d90c59ebd210 service nova] Creating event network-vif-deleted:c37f7843-aed1-4835-bdd5-25079688f7f3 for instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 on nch2-master-1 Sep 06 11:02:25.181378 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-10b9a9a5-bb0f-4547-ad71-b277ead58c77 req-1743c302-ac65-4171-ae10-d90c59ebd210 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092443 Sep 06 11:02:25.187003 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1316/2650] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:25.199184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4385bc32-7349-4299-87e5-da3e6c76cc1b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:25.199905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4385bc32-7349-4299-87e5-da3e6c76cc1b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:25.223202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4385bc32-7349-4299-87e5-da3e6c76cc1b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:25.227123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4385bc32-7349-4299-87e5-da3e6c76cc1b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:25.228259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4385bc32-7349-4299-87e5-da3e6c76cc1b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:25.229181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4385bc32-7349-4299-87e5-da3e6c76cc1b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:25.229834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4385bc32-7349-4299-87e5-da3e6c76cc1b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:25.230434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4385bc32-7349-4299-87e5-da3e6c76cc1b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:25.309075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-03157fb8-7440-44c1-b861-2ec370ce892f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:25.317847 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-03157fb8-7440-44c1-b861-2ec370ce892f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1217 microversion: 2.1 time: 0.317519 Sep 06 11:02:25.323044 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1335/2651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:24 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1217 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:25.333437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:25.349482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:25.375914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:25.376415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:25.379922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:25.382831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:25.382831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:25.382831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:25.502774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:25.513886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:25.514651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:25.515430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lazy-loading 'fault' on Instance uuid 5217df4d-be5e-4e14-a4ad-c690acc72f20 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:02:25.800363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19903666a1243e3a66411e30babe299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4061aad7f45b4c6192c02f3179d13687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:25.819675 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ef2dcd32-7abe-4fe3-9cce-93ad3302ea1c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 200 len: 1304 microversion: 2.1 time: 0.487871 Sep 06 11:02:25.819675 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1336/2652] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:25 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 1304 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:25.833774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-eb3459d3-8720-4471-9d38-49e6d03ea0b6 req-1ec9550a-d2e3-49c5-8be2-0ef97a688ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e806fa-6279-4cf1-b884-55a5a6437f44", "name": "network-vif-plugged", "status": "completed", "tag": "3e107cf1-da4c-4509-9df2-ae5edb4a12db"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:25.860253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-eb3459d3-8720-4471-9d38-49e6d03ea0b6 req-1ec9550a-d2e3-49c5-8be2-0ef97a688ca3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:25.862214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-eb3459d3-8720-4471-9d38-49e6d03ea0b6 req-1ec9550a-d2e3-49c5-8be2-0ef97a688ca3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:25.862871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-eb3459d3-8720-4471-9d38-49e6d03ea0b6 req-1ec9550a-d2e3-49c5-8be2-0ef97a688ca3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:25.913757 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-eb3459d3-8720-4471-9d38-49e6d03ea0b6 req-1ec9550a-d2e3-49c5-8be2-0ef97a688ca3 service nova] Creating event network-vif-plugged:3e107cf1-da4c-4509-9df2-ae5edb4a12db for instance 89e806fa-6279-4cf1-b884-55a5a6437f44 on nch2-master-1 Sep 06 11:02:25.926818 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-eb3459d3-8720-4471-9d38-49e6d03ea0b6 req-1ec9550a-d2e3-49c5-8be2-0ef97a688ca3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105572 Sep 06 11:02:25.928181 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1337/2653] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:25.941651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1d8bd65a-d731-48d3-ba41-e3f8f145ffed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:25.942399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1d8bd65a-d731-48d3-ba41-e3f8f145ffed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:25.958395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d8bd65a-d731-48d3-ba41-e3f8f145ffed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:25.958915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d8bd65a-d731-48d3-ba41-e3f8f145ffed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:25.962621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d8bd65a-d731-48d3-ba41-e3f8f145ffed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:25.962621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d8bd65a-d731-48d3-ba41-e3f8f145ffed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:25.962621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d8bd65a-d731-48d3-ba41-e3f8f145ffed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:25.964988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d8bd65a-d731-48d3-ba41-e3f8f145ffed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:26.012782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4385bc32-7349-4299-87e5-da3e6c76cc1b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:26.026498 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4385bc32-7349-4299-87e5-da3e6c76cc1b tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1654 microversion: 2.1 time: 0.837442 Sep 06 11:02:26.030096 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1317/2654] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:25 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1654 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:26.059634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-33352f5a-dd10-4d43-8e6f-af3d0b01a649 req-51c8b1c1-0ee3-46a9-9eec-a0d79976ef6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53022c77-a7ad-42cd-843f-0a4ead29e639", "name": "network-vif-deleted", "tag": "c01851d8-eec8-44e3-b8fa-7988a9dd1375"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:26.075939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-33352f5a-dd10-4d43-8e6f-af3d0b01a649 req-51c8b1c1-0ee3-46a9-9eec-a0d79976ef6e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:26.080636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-33352f5a-dd10-4d43-8e6f-af3d0b01a649 req-51c8b1c1-0ee3-46a9-9eec-a0d79976ef6e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:26.083267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-33352f5a-dd10-4d43-8e6f-af3d0b01a649 req-51c8b1c1-0ee3-46a9-9eec-a0d79976ef6e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:26.139930 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-33352f5a-dd10-4d43-8e6f-af3d0b01a649 req-51c8b1c1-0ee3-46a9-9eec-a0d79976ef6e service nova] Creating event network-vif-deleted:c01851d8-eec8-44e3-b8fa-7988a9dd1375 for instance 53022c77-a7ad-42cd-843f-0a4ead29e639 on nch1-master-1 Sep 06 11:02:26.146785 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-33352f5a-dd10-4d43-8e6f-af3d0b01a649 req-51c8b1c1-0ee3-46a9-9eec-a0d79976ef6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093317 Sep 06 11:02:26.148446 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1318/2655] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:26.156110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-586a0f5b-769c-49ff-bd4f-c227081a05ba tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:26.157402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-586a0f5b-769c-49ff-bd4f-c227081a05ba tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:26.165078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-586a0f5b-769c-49ff-bd4f-c227081a05ba tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:26.165891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-586a0f5b-769c-49ff-bd4f-c227081a05ba tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:26.166522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-586a0f5b-769c-49ff-bd4f-c227081a05ba tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:26.167502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-586a0f5b-769c-49ff-bd4f-c227081a05ba tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:26.168286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-586a0f5b-769c-49ff-bd4f-c227081a05ba tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:26.168907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-586a0f5b-769c-49ff-bd4f-c227081a05ba tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:26.513972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d8bd65a-d731-48d3-ba41-e3f8f145ffed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:26.527155 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1d8bd65a-d731-48d3-ba41-e3f8f145ffed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.593032 Sep 06 11:02:26.544583 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1338/2656] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:25 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:26.557894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-90c28272-59a1-4ca3-9a35-f46fed80a123 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:26.561629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-90c28272-59a1-4ca3-9a35-f46fed80a123 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:26.576219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90c28272-59a1-4ca3-9a35-f46fed80a123 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:26.577031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90c28272-59a1-4ca3-9a35-f46fed80a123 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:26.579418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90c28272-59a1-4ca3-9a35-f46fed80a123 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:26.584453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90c28272-59a1-4ca3-9a35-f46fed80a123 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:26.585956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90c28272-59a1-4ca3-9a35-f46fed80a123 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:26.587488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90c28272-59a1-4ca3-9a35-f46fed80a123 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:26.634437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-586a0f5b-769c-49ff-bd4f-c227081a05ba tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:26.649574 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-586a0f5b-769c-49ff-bd4f-c227081a05ba tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1317 microversion: 2.1 time: 0.499664 Sep 06 11:02:26.650191 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1319/2657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:26 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:26.668793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d1f7d418-fa1f-4ad6-a854-203b3ab7d5d7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:26.669461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d1f7d418-fa1f-4ad6-a854-203b3ab7d5d7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:26.683565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1f7d418-fa1f-4ad6-a854-203b3ab7d5d7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:26.688356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1f7d418-fa1f-4ad6-a854-203b3ab7d5d7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:26.688859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1f7d418-fa1f-4ad6-a854-203b3ab7d5d7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:26.696128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1f7d418-fa1f-4ad6-a854-203b3ab7d5d7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:26.696669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1f7d418-fa1f-4ad6-a854-203b3ab7d5d7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:26.697129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1f7d418-fa1f-4ad6-a854-203b3ab7d5d7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.231712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d1f7d418-fa1f-4ad6-a854-203b3ab7d5d7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:27.240612 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d1f7d418-fa1f-4ad6-a854-203b3ab7d5d7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1213 microversion: 2.1 time: 0.589336 Sep 06 11:02:27.256228 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1320/2658] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:26 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1213 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:27.256228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6cc61a41-4534-4e31-9690-501954d49527 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:27.256228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6cc61a41-4534-4e31-9690-501954d49527 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:27.258349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6cc61a41-4534-4e31-9690-501954d49527 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.258349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6cc61a41-4534-4e31-9690-501954d49527 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.258953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6cc61a41-4534-4e31-9690-501954d49527 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.259726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6cc61a41-4534-4e31-9690-501954d49527 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.260204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6cc61a41-4534-4e31-9690-501954d49527 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.260645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6cc61a41-4534-4e31-9690-501954d49527 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.285459 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-6cc61a41-4534-4e31-9690-501954d49527 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6cc61a41-4534-4e31-9690-501954d49527 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 HTTP/1.1 Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '5217df4d-be5e-4e14-a4ad-c690acc72f20'} Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:27.286024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.293232 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.293232 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:27.293232 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:27.293232 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:27.293232 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:27.293232 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.293232 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.293232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6cc61a41-4534-4e31-9690-501954d49527 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:27.293232 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6cc61a41-4534-4e31-9690-501954d49527 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 404 len: 111 microversion: 2.1 time: 0.048442 Sep 06 11:02:27.295488 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1321/2659] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:27 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:27.303361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-616696f0-33ef-4247-89db-f844338e6884 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:27.304486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-616696f0-33ef-4247-89db-f844338e6884 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:27.327364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-616696f0-33ef-4247-89db-f844338e6884 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.329697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-616696f0-33ef-4247-89db-f844338e6884 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.330314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-616696f0-33ef-4247-89db-f844338e6884 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.335813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-616696f0-33ef-4247-89db-f844338e6884 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.336552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-616696f0-33ef-4247-89db-f844338e6884 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.337208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-616696f0-33ef-4247-89db-f844338e6884 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.352006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-90c28272-59a1-4ca3-9a35-f46fed80a123 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:27.362027 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-90c28272-59a1-4ca3-9a35-f46fed80a123 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1378 microversion: 2.1 time: 0.816122 Sep 06 11:02:27.362779 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1339/2660] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:26 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1378 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:27.380754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9ecc3812-2ec4-4752-a87b-6c880e0f8d3d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:27.381252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9ecc3812-2ec4-4752-a87b-6c880e0f8d3d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:27.389336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ecc3812-2ec4-4752-a87b-6c880e0f8d3d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.390974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ecc3812-2ec4-4752-a87b-6c880e0f8d3d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.390974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ecc3812-2ec4-4752-a87b-6c880e0f8d3d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.391796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ecc3812-2ec4-4752-a87b-6c880e0f8d3d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.392423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ecc3812-2ec4-4752-a87b-6c880e0f8d3d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.393023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ecc3812-2ec4-4752-a87b-6c880e0f8d3d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.483732 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-9ecc3812-2ec4-4752-a87b-6c880e0f8d3d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9ecc3812-2ec4-4752-a87b-6c880e0f8d3d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 HTTP/1.1 Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '5217df4d-be5e-4e14-a4ad-c690acc72f20'} Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:27.486385 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:27.490994 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.490994 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.490994 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:27.490994 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.490994 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.490994 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:27.490994 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:27.490994 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:27.490994 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:27.490994 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.490994 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.490994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9ecc3812-2ec4-4752-a87b-6c880e0f8d3d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:27.491913 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9ecc3812-2ec4-4752-a87b-6c880e0f8d3d tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 404 len: 111 microversion: 2.1 time: 0.126777 Sep 06 11:02:27.493280 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1340/2661] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:02:27 2022] DELETE /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:27.509902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe0c6eb3-16c6-4635-8a37-4b95b43cdc7c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:27.510684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe0c6eb3-16c6-4635-8a37-4b95b43cdc7c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 5217df4d-be5e-4e14-a4ad-c690acc72f20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:27.518305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe0c6eb3-16c6-4635-8a37-4b95b43cdc7c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.519062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe0c6eb3-16c6-4635-8a37-4b95b43cdc7c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.519240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe0c6eb3-16c6-4635-8a37-4b95b43cdc7c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.520929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe0c6eb3-16c6-4635-8a37-4b95b43cdc7c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.520929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe0c6eb3-16c6-4635-8a37-4b95b43cdc7c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.521331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe0c6eb3-16c6-4635-8a37-4b95b43cdc7c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.539793 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-fe0c6eb3-16c6-4635-8a37-4b95b43cdc7c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe0c6eb3-16c6-4635-8a37-4b95b43cdc7c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 HTTP/1.1 Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '5217df4d-be5e-4e14-a4ad-c690acc72f20'} Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:27.541949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.556603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.556603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:27.556603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:27.556603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:27.556603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:27.556603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. Sep 06 11:02:27.556603 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.556603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe0c6eb3-16c6-4635-8a37-4b95b43cdc7c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 5217df4d-be5e-4e14-a4ad-c690acc72f20 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:27.556603 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe0c6eb3-16c6-4635-8a37-4b95b43cdc7c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20" status: 404 len: 111 microversion: 2.1 time: 0.048213 Sep 06 11:02:27.556603 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1341/2662] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:27 2022] GET /compute/v2.1/servers/5217df4d-be5e-4e14-a4ad-c690acc72f20 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:27.560078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dcd96926-af4e-4408-beec-6496f29454c4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:27.560933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dcd96926-af4e-4408-beec-6496f29454c4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:27.577575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcd96926-af4e-4408-beec-6496f29454c4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.582812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcd96926-af4e-4408-beec-6496f29454c4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.582812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcd96926-af4e-4408-beec-6496f29454c4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.582812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcd96926-af4e-4408-beec-6496f29454c4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.582812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcd96926-af4e-4408-beec-6496f29454c4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.582812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcd96926-af4e-4408-beec-6496f29454c4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.600162 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-dcd96926-af4e-4408-beec-6496f29454c4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dcd96926-af4e-4408-beec-6496f29454c4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 HTTP/1.1 Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '98250008-de3d-4d5c-8b09-152eadba1601'} Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:27.619336 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:27.624071 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:02:27.624071 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.624071 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:27.624071 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.624071 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.624071 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:27.624071 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:27.624071 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:27.624071 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:27.624071 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:02:27.624071 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.625974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dcd96926-af4e-4408-beec-6496f29454c4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:27.630413 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dcd96926-af4e-4408-beec-6496f29454c4 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 404 len: 111 microversion: 2.1 time: 0.076549 Sep 06 11:02:27.630575 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1342/2663] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:02:27 2022] DELETE /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:27.640942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b62bfe34-a266-428c-9bbf-ebf23f0b9696 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:27.646724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b62bfe34-a266-428c-9bbf-ebf23f0b9696 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:27.658130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b62bfe34-a266-428c-9bbf-ebf23f0b9696 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.658920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b62bfe34-a266-428c-9bbf-ebf23f0b9696 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.663191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-616696f0-33ef-4247-89db-f844338e6884 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ebe881ffd44893879bb9e7ab63c9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b83e289c414e499c91fc7f711774b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:27.667133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b62bfe34-a266-428c-9bbf-ebf23f0b9696 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.673910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b62bfe34-a266-428c-9bbf-ebf23f0b9696 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.675406 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-616696f0-33ef-4247-89db-f844338e6884 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 200 len: 1298 microversion: 2.1 time: 0.378354 Sep 06 11:02:27.677741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b62bfe34-a266-428c-9bbf-ebf23f0b9696 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.679123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b62bfe34-a266-428c-9bbf-ebf23f0b9696 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.696452 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1322/2664] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:27 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 1298 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:27.714415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ecf11728-6a9e-4575-bb9a-4413d14baa81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:27.717361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ecf11728-6a9e-4575-bb9a-4413d14baa81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 98250008-de3d-4d5c-8b09-152eadba1601] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:27.732715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:27.735574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecf11728-6a9e-4575-bb9a-4413d14baa81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.736415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecf11728-6a9e-4575-bb9a-4413d14baa81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.737254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecf11728-6a9e-4575-bb9a-4413d14baa81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.737991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecf11728-6a9e-4575-bb9a-4413d14baa81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.738628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecf11728-6a9e-4575-bb9a-4413d14baa81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.739516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecf11728-6a9e-4575-bb9a-4413d14baa81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.780209 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-ecf11728-6a9e-4575-bb9a-4413d14baa81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ecf11728-6a9e-4575-bb9a-4413d14baa81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 HTTP/1.1 Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '98250008-de3d-4d5c-8b09-152eadba1601'} Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:27.787927 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.792318 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:27.792318 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:27.792318 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:27.792318 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:27.792318 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:27.792318 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. Sep 06 11:02:27.792318 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:27.793746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ecf11728-6a9e-4575-bb9a-4413d14baa81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 98250008-de3d-4d5c-8b09-152eadba1601 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:27.794791 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ecf11728-6a9e-4575-bb9a-4413d14baa81 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601" status: 404 len: 111 microversion: 2.1 time: 0.096428 Sep 06 11:02:27.795549 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1323/2665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:27 2022] GET /compute/v2.1/servers/98250008-de3d-4d5c-8b09-152eadba1601 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:27.801002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e145a02f-9210-48f2-abd5-6f6b65556dc1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:27.801855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e145a02f-9210-48f2-abd5-6f6b65556dc1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:27.809170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e145a02f-9210-48f2-abd5-6f6b65556dc1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.809701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e145a02f-9210-48f2-abd5-6f6b65556dc1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.813452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e145a02f-9210-48f2-abd5-6f6b65556dc1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:27.814426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e145a02f-9210-48f2-abd5-6f6b65556dc1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:27.815797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e145a02f-9210-48f2-abd5-6f6b65556dc1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:27.816496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e145a02f-9210-48f2-abd5-6f6b65556dc1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.020023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e145a02f-9210-48f2-abd5-6f6b65556dc1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:28.032811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b62bfe34-a266-428c-9bbf-ebf23f0b9696 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:28.033075 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e145a02f-9210-48f2-abd5-6f6b65556dc1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1317 microversion: 2.1 time: 0.236098 Sep 06 11:02:28.034219 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1324/2666] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:27 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:28.039545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2be1d738-cf2e-4ab0-b0b7-ea4a7e3a179c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:28.041961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2be1d738-cf2e-4ab0-b0b7-ea4a7e3a179c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:28.042946 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b62bfe34-a266-428c-9bbf-ebf23f0b9696 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.409786 Sep 06 11:02:28.048725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2be1d738-cf2e-4ab0-b0b7-ea4a7e3a179c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.049492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2be1d738-cf2e-4ab0-b0b7-ea4a7e3a179c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.050162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2be1d738-cf2e-4ab0-b0b7-ea4a7e3a179c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.051117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2be1d738-cf2e-4ab0-b0b7-ea4a7e3a179c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.051792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2be1d738-cf2e-4ab0-b0b7-ea4a7e3a179c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.052435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2be1d738-cf2e-4ab0-b0b7-ea4a7e3a179c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.058467 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1343/2667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:27 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:28.069270 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-2be1d738-cf2e-4ab0-b0b7-ea4a7e3a179c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2be1d738-cf2e-4ab0-b0b7-ea4a7e3a179c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df HTTP/1.1 Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '267d4dad-b118-4f44-993b-81fd05e550df'} Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:28.071131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:28.074903 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:02:28.074903 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.074903 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.074903 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.074903 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.074903 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.074903 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.074903 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:28.074903 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:28.074903 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:02:28.074903 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.081161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2be1d738-cf2e-4ab0-b0b7-ea4a7e3a179c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:28.081161 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2be1d738-cf2e-4ab0-b0b7-ea4a7e3a179c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 404 len: 111 microversion: 2.1 time: 0.042497 Sep 06 11:02:28.081161 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1325/2668] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:02:28 2022] DELETE /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:28.091641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-05766076-b83c-4815-adb1-715b90e8c382 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:28.092714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-05766076-b83c-4815-adb1-715b90e8c382 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 267d4dad-b118-4f44-993b-81fd05e550df] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:28.108999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05766076-b83c-4815-adb1-715b90e8c382 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.109731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05766076-b83c-4815-adb1-715b90e8c382 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.110434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05766076-b83c-4815-adb1-715b90e8c382 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.111392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05766076-b83c-4815-adb1-715b90e8c382 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.112031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05766076-b83c-4815-adb1-715b90e8c382 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.112637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05766076-b83c-4815-adb1-715b90e8c382 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.130926 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-05766076-b83c-4815-adb1-715b90e8c382 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-05766076-b83c-4815-adb1-715b90e8c382 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df HTTP/1.1 Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '267d4dad-b118-4f44-993b-81fd05e550df'} Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.133211 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.138106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.138106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.138106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.138106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:28.138106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:28.138106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. Sep 06 11:02:28.138106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.139512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-05766076-b83c-4815-adb1-715b90e8c382 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 267d4dad-b118-4f44-993b-81fd05e550df could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:28.140585 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-05766076-b83c-4815-adb1-715b90e8c382 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df" status: 404 len: 111 microversion: 2.1 time: 0.056257 Sep 06 11:02:28.144186 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1344/2669] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:28 2022] GET /compute/v2.1/servers/267d4dad-b118-4f44-993b-81fd05e550df => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:28.149337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c253a424-0ec0-4bd1-ba7f-044f41f71688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:28.149912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c253a424-0ec0-4bd1-ba7f-044f41f71688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:28.167305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c253a424-0ec0-4bd1-ba7f-044f41f71688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.167305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c253a424-0ec0-4bd1-ba7f-044f41f71688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.167305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c253a424-0ec0-4bd1-ba7f-044f41f71688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.167758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c253a424-0ec0-4bd1-ba7f-044f41f71688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.168344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c253a424-0ec0-4bd1-ba7f-044f41f71688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.168891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c253a424-0ec0-4bd1-ba7f-044f41f71688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.183073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-1304e884-3fac-49ce-8e6a-96aeaabe87b6 req-a7a67763-04de-422d-bc78-ae6d7327565f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53022c77-a7ad-42cd-843f-0a4ead29e639", "name": "network-vif-deleted", "tag": "f5feaeb3-8243-4f2d-a254-f8b588b4e20f"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:28.193579 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-c253a424-0ec0-4bd1-ba7f-044f41f71688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c253a424-0ec0-4bd1-ba7f-044f41f71688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 HTTP/1.1 Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '21ecf20d-9dff-4421-be11-23b2fb67c1c3'} Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:28.199377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:28.203767 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 11:02:28.203767 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.203767 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.203767 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.203767 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.203767 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.203767 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.203767 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:28.203767 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:28.203767 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 11:02:28.203767 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.206372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1304e884-3fac-49ce-8e6a-96aeaabe87b6 req-a7a67763-04de-422d-bc78-ae6d7327565f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.206872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1304e884-3fac-49ce-8e6a-96aeaabe87b6 req-a7a67763-04de-422d-bc78-ae6d7327565f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.207347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1304e884-3fac-49ce-8e6a-96aeaabe87b6 req-a7a67763-04de-422d-bc78-ae6d7327565f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.208407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c253a424-0ec0-4bd1-ba7f-044f41f71688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:28.211464 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c253a424-0ec0-4bd1-ba7f-044f41f71688 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 404 len: 111 microversion: 2.1 time: 0.066005 Sep 06 11:02:28.212193 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1326/2670] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:02:28 2022] DELETE /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:28.226898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1019541f-63bc-4087-acbe-d8c954bd9b6b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:28.227541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1019541f-63bc-4087-acbe-d8c954bd9b6b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 21ecf20d-9dff-4421-be11-23b2fb67c1c3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:28.231387 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-1304e884-3fac-49ce-8e6a-96aeaabe87b6 req-a7a67763-04de-422d-bc78-ae6d7327565f service nova] Creating event network-vif-deleted:f5feaeb3-8243-4f2d-a254-f8b588b4e20f for instance 53022c77-a7ad-42cd-843f-0a4ead29e639 on nch1-master-1 Sep 06 11:02:28.237394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1019541f-63bc-4087-acbe-d8c954bd9b6b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.237900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1019541f-63bc-4087-acbe-d8c954bd9b6b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.238335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1019541f-63bc-4087-acbe-d8c954bd9b6b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.239092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1019541f-63bc-4087-acbe-d8c954bd9b6b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.239558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1019541f-63bc-4087-acbe-d8c954bd9b6b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.239988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1019541f-63bc-4087-acbe-d8c954bd9b6b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.247112 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-1304e884-3fac-49ce-8e6a-96aeaabe87b6 req-a7a67763-04de-422d-bc78-ae6d7327565f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086381 Sep 06 11:02:28.247718 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1345/2671] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:28.266245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-54a9ee37-d495-4de4-86e1-8f68253d2dea tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:28.267236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-54a9ee37-d495-4de4-86e1-8f68253d2dea tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:28.276151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54a9ee37-d495-4de4-86e1-8f68253d2dea tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.283195 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-1019541f-63bc-4087-acbe-d8c954bd9b6b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 11:02:28.284098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54a9ee37-d495-4de4-86e1-8f68253d2dea tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.284723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54a9ee37-d495-4de4-86e1-8f68253d2dea tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.285632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54a9ee37-d495-4de4-86e1-8f68253d2dea tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.286905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54a9ee37-d495-4de4-86e1-8f68253d2dea tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.289580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54a9ee37-d495-4de4-86e1-8f68253d2dea tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1019541f-63bc-4087-acbe-d8c954bd9b6b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 HTTP/1.1 Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '21ecf20d-9dff-4421-be11-23b2fb67c1c3'} Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.294916 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.299234 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.299234 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.299234 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.299234 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:28.299234 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:28.299234 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. Sep 06 11:02:28.299234 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.301987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1019541f-63bc-4087-acbe-d8c954bd9b6b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 21ecf20d-9dff-4421-be11-23b2fb67c1c3 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:28.303115 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1019541f-63bc-4087-acbe-d8c954bd9b6b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3" status: 404 len: 111 microversion: 2.1 time: 0.082810 Sep 06 11:02:28.305774 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1327/2672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:28 2022] GET /compute/v2.1/servers/21ecf20d-9dff-4421-be11-23b2fb67c1c3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:02:28.318238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8f73e8f8-c140-4ec8-85d9-1630b070866c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:28.318770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8f73e8f8-c140-4ec8-85d9-1630b070866c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: a1fd2e45-af36-4f43-be98-83ef902b0372] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:28.333957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f73e8f8-c140-4ec8-85d9-1630b070866c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.334472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f73e8f8-c140-4ec8-85d9-1630b070866c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.335496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f73e8f8-c140-4ec8-85d9-1630b070866c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.338299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f73e8f8-c140-4ec8-85d9-1630b070866c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.338779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f73e8f8-c140-4ec8-85d9-1630b070866c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.339254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f73e8f8-c140-4ec8-85d9-1630b070866c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.370806 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-8f73e8f8-c140-4ec8-85d9-1630b070866c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8f73e8f8-c140-4ec8-85d9-1630b070866c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/a1fd2e45-af36-4f43-be98-83ef902b0372 HTTP/1.1 Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'a1fd2e45-af36-4f43-be98-83ef902b0372'} Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:28.376914 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8f73e8f8-c140-4ec8-85d9-1630b070866c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8f73e8f8-c140-4ec8-85d9-1630b070866c tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1fd2e45-af36-4f43-be98-83ef902b0372" status: 404 len: 111 microversion: 2.1 time: 0.070050 Sep 06 11:02:28.383054 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1328/2673] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:02:28 2022] DELETE /compute/v2.1/servers/a1fd2e45-af36-4f43-be98-83ef902b0372 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:28.387239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-54a9ee37-d495-4de4-86e1-8f68253d2dea tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:28.394857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fc0284f5-cd57-4d59-ac8c-bfdaf8ff5473 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:28.395867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fc0284f5-cd57-4d59-ac8c-bfdaf8ff5473 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:28.409464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc0284f5-cd57-4d59-ac8c-bfdaf8ff5473 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.410158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc0284f5-cd57-4d59-ac8c-bfdaf8ff5473 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.410775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc0284f5-cd57-4d59-ac8c-bfdaf8ff5473 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.411679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc0284f5-cd57-4d59-ac8c-bfdaf8ff5473 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.412473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc0284f5-cd57-4d59-ac8c-bfdaf8ff5473 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.414024 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-54a9ee37-d495-4de4-86e1-8f68253d2dea tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1269 microversion: 2.1 time: 0.152452 Sep 06 11:02:28.414669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc0284f5-cd57-4d59-ac8c-bfdaf8ff5473 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.415913 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1346/2674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:28 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:28.437978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-211c4ab2-7098-4784-8cb1-6792404497e0 req-2432c296-9035-4732-86b9-28b7767149df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0611012-ede1-4ec2-b586-e3ba1f562253", "name": "network-vif-plugged", "status": "completed", "tag": "ecc6e385-dc5e-4440-9b3e-e389cf5f0eed"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:28.462781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-211c4ab2-7098-4784-8cb1-6792404497e0 req-2432c296-9035-4732-86b9-28b7767149df service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.463416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-211c4ab2-7098-4784-8cb1-6792404497e0 req-2432c296-9035-4732-86b9-28b7767149df service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.463872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-211c4ab2-7098-4784-8cb1-6792404497e0 req-2432c296-9035-4732-86b9-28b7767149df service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.471994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:28.481695 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-211c4ab2-7098-4784-8cb1-6792404497e0 req-2432c296-9035-4732-86b9-28b7767149df service nova] Creating event network-vif-plugged:ecc6e385-dc5e-4440-9b3e-e389cf5f0eed for instance b0611012-ede1-4ec2-b586-e3ba1f562253 on nch1-master-1 Sep 06 11:02:28.486673 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-211c4ab2-7098-4784-8cb1-6792404497e0 req-2432c296-9035-4732-86b9-28b7767149df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069468 Sep 06 11:02:28.487915 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1347/2675] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:28.493727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-066b7c39-f9e7-4447-967e-0b2d207e9d20 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:28.494694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-066b7c39-f9e7-4447-967e-0b2d207e9d20 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: a1fd2e45-af36-4f43-be98-83ef902b0372] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:28.506320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:28.506320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-066b7c39-f9e7-4447-967e-0b2d207e9d20 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.506320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-066b7c39-f9e7-4447-967e-0b2d207e9d20 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.506320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-066b7c39-f9e7-4447-967e-0b2d207e9d20 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.506320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-066b7c39-f9e7-4447-967e-0b2d207e9d20 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.506320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-066b7c39-f9e7-4447-967e-0b2d207e9d20 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.507754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-066b7c39-f9e7-4447-967e-0b2d207e9d20 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.524834 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-066b7c39-f9e7-4447-967e-0b2d207e9d20 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-066b7c39-f9e7-4447-967e-0b2d207e9d20 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/a1fd2e45-af36-4f43-be98-83ef902b0372 HTTP/1.1 Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'a1fd2e45-af36-4f43-be98-83ef902b0372'} Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.528335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.532232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.532232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.532232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.532232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:28.532232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:28.532232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. Sep 06 11:02:28.532232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.532232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-066b7c39-f9e7-4447-967e-0b2d207e9d20 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance a1fd2e45-af36-4f43-be98-83ef902b0372 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:28.533227 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-066b7c39-f9e7-4447-967e-0b2d207e9d20 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/a1fd2e45-af36-4f43-be98-83ef902b0372" status: 404 len: 111 microversion: 2.1 time: 0.043771 Sep 06 11:02:28.533902 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1348/2676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:28 2022] GET /compute/v2.1/servers/a1fd2e45-af36-4f43-be98-83ef902b0372 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:28.659376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fc0284f5-cd57-4d59-ac8c-bfdaf8ff5473 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:28.674572 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fc0284f5-cd57-4d59-ac8c-bfdaf8ff5473 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1378 microversion: 2.1 time: 0.291713 Sep 06 11:02:28.677673 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1329/2677] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:28 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1378 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:28.701033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-14845b97-e3f2-4513-9ba2-81a4b4686462 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:28.702645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-14845b97-e3f2-4513-9ba2-81a4b4686462 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:28.709090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14845b97-e3f2-4513-9ba2-81a4b4686462 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.710254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14845b97-e3f2-4513-9ba2-81a4b4686462 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.710719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14845b97-e3f2-4513-9ba2-81a4b4686462 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.711475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14845b97-e3f2-4513-9ba2-81a4b4686462 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:28.711924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14845b97-e3f2-4513-9ba2-81a4b4686462 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:28.712356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14845b97-e3f2-4513-9ba2-81a4b4686462 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:28.744349 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-14845b97-e3f2-4513-9ba2-81a4b4686462 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] HTTP exception thrown: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-14845b97-e3f2-4513-9ba2-81a4b4686462 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Request method failure captured: Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 HTTP/1.1 Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyhUseLZJ8E18mBh1hkBQD0ylqWMAm9fJBkixY7hlncd1Jz8eDaMIPjqmuoTVa6iaVNJun0U3WC64l-cXfCpBVuJk3rJTMvWwWHUozrDtcbjvcQUrKpYCf2AmrDX1muQOJik2eT7tIgKL5t6SBQrMl69Cx_U94gHqpeKrkpMOeCcUf0 Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 91b83e289c414e499c91fc7f711774b7 Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91b83e289c414e499c91fc7f711774b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91b83e289c414e499c91fc7f711774b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91b83e289c414e499c91fc7f711774b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91b83e289c414e499c91fc7f711774b7"}]}] Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 91b83e289c414e499c91fc7f711774b7 Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestMultiNic-1879257848-project Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 99ebe881ffd44893879bb9e7ab63c9fd Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestMultiNic-1879257848-project Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '53022c77-a7ad-42cd-843f-0a4ead29e639'} Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:28.745957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.752685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:28.752685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:28.752685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:28.752685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:28.752685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:28.752685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:28.752685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:28.752685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-14845b97-e3f2-4513-9ba2-81a4b4686462 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Returning 404 to user: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:28.752685 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-14845b97-e3f2-4513-9ba2-81a4b4686462 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 404 len: 111 microversion: 2.1 time: 0.051082 Sep 06 11:02:28.753727 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1349/2678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:28 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:29.058405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0fa1ec30-60e7-46fd-9957-eb2e59de7721 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:29.058985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0fa1ec30-60e7-46fd-9957-eb2e59de7721 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:29.066294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fa1ec30-60e7-46fd-9957-eb2e59de7721 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:29.071096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fa1ec30-60e7-46fd-9957-eb2e59de7721 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:29.071487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fa1ec30-60e7-46fd-9957-eb2e59de7721 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:29.072222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fa1ec30-60e7-46fd-9957-eb2e59de7721 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:29.072688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fa1ec30-60e7-46fd-9957-eb2e59de7721 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:29.073121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fa1ec30-60e7-46fd-9957-eb2e59de7721 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:29.084963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-42abd515-a69a-4e1a-8e27-d5b714174e2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:29.086485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-42abd515-a69a-4e1a-8e27-d5b714174e2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:29.098347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42abd515-a69a-4e1a-8e27-d5b714174e2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:29.106860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42abd515-a69a-4e1a-8e27-d5b714174e2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:29.108110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42abd515-a69a-4e1a-8e27-d5b714174e2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:29.110674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42abd515-a69a-4e1a-8e27-d5b714174e2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:29.111388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42abd515-a69a-4e1a-8e27-d5b714174e2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:29.122010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42abd515-a69a-4e1a-8e27-d5b714174e2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:29.527722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0fa1ec30-60e7-46fd-9957-eb2e59de7721 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:29.539893 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0fa1ec30-60e7-46fd-9957-eb2e59de7721 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1467 microversion: 2.1 time: 0.485977 Sep 06 11:02:29.542989 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1330/2679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:29 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1467 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:29.559785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4d582be3-1f92-4e08-95a6-559d6fb5bc3d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:29.561968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4d582be3-1f92-4e08-95a6-559d6fb5bc3d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:29.586208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d582be3-1f92-4e08-95a6-559d6fb5bc3d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:29.586208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d582be3-1f92-4e08-95a6-559d6fb5bc3d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:29.586580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d582be3-1f92-4e08-95a6-559d6fb5bc3d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:29.587354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d582be3-1f92-4e08-95a6-559d6fb5bc3d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:29.591478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d582be3-1f92-4e08-95a6-559d6fb5bc3d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:29.591991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d582be3-1f92-4e08-95a6-559d6fb5bc3d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:29.619603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-42abd515-a69a-4e1a-8e27-d5b714174e2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:29.639045 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-42abd515-a69a-4e1a-8e27-d5b714174e2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.558064 Sep 06 11:02:29.641440 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1350/2680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:29 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:29.693333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a1eac60b-0944-4c6b-aeba-6ad6cdf685d7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:29.697808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a1eac60b-0944-4c6b-aeba-6ad6cdf685d7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:29.712353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1eac60b-0944-4c6b-aeba-6ad6cdf685d7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:29.713158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1eac60b-0944-4c6b-aeba-6ad6cdf685d7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:29.714313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1eac60b-0944-4c6b-aeba-6ad6cdf685d7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:29.716625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1eac60b-0944-4c6b-aeba-6ad6cdf685d7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:29.717436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1eac60b-0944-4c6b-aeba-6ad6cdf685d7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:29.718068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1eac60b-0944-4c6b-aeba-6ad6cdf685d7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:29.728608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4d582be3-1f92-4e08-95a6-559d6fb5bc3d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:29.748107 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4d582be3-1f92-4e08-95a6-559d6fb5bc3d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1277 microversion: 2.1 time: 0.203394 Sep 06 11:02:29.756754 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1331/2681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:29 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:29.777859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7bf62e3d-c55d-4e59-b042-6db0ec7c2b8e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:29.779948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7bf62e3d-c55d-4e59-b042-6db0ec7c2b8e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:29.789338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bf62e3d-c55d-4e59-b042-6db0ec7c2b8e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:29.790217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bf62e3d-c55d-4e59-b042-6db0ec7c2b8e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:29.790845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bf62e3d-c55d-4e59-b042-6db0ec7c2b8e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:29.792926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bf62e3d-c55d-4e59-b042-6db0ec7c2b8e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:29.793749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bf62e3d-c55d-4e59-b042-6db0ec7c2b8e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:29.794375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bf62e3d-c55d-4e59-b042-6db0ec7c2b8e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:30.207366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7bf62e3d-c55d-4e59-b042-6db0ec7c2b8e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:30.217832 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7bf62e3d-c55d-4e59-b042-6db0ec7c2b8e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1378 microversion: 2.1 time: 0.449403 Sep 06 11:02:30.224168 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a1eac60b-0944-4c6b-aeba-6ad6cdf685d7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1618 microversion: 2.1 time: 0.579957 Sep 06 11:02:30.225099 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1351/2682] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:29 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1618 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:30.234307 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1332/2683] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:29 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1378 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:30.426636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-21697319", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["0d07bf04-ec2e-40a3-8916-aade0c51060b"]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:30.504464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:02:30.667409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-079e925b-ba1f-46e5-83eb-ff7e9201a4a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:30.668207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-079e925b-ba1f-46e5-83eb-ff7e9201a4a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:30.684744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-079e925b-ba1f-46e5-83eb-ff7e9201a4a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:30.685859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-079e925b-ba1f-46e5-83eb-ff7e9201a4a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:30.688065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-079e925b-ba1f-46e5-83eb-ff7e9201a4a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:30.689116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-079e925b-ba1f-46e5-83eb-ff7e9201a4a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:30.691897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-079e925b-ba1f-46e5-83eb-ff7e9201a4a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:30.694316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-079e925b-ba1f-46e5-83eb-ff7e9201a4a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:31.011180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:02:31.013299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:02:31.016337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:02:31.016337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:02:31.016337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:02:31.038830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:31.039731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:31.042196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:31.044211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:31.045028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:31.045870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:31.109336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:02:31.119252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:02:31.135705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-079e925b-ba1f-46e5-83eb-ff7e9201a4a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:31.140642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:02:31.144159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:02:31.199227 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-079e925b-ba1f-46e5-83eb-ff7e9201a4a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.516560 Sep 06 11:02:31.201525 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1333/2684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:30 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:31.234935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fdd328a5-898e-4694-a548-4aa8ad13689e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:31.242039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fdd328a5-898e-4694-a548-4aa8ad13689e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:31.259345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fdd328a5-898e-4694-a548-4aa8ad13689e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:31.260112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fdd328a5-898e-4694-a548-4aa8ad13689e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:31.262822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fdd328a5-898e-4694-a548-4aa8ad13689e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:31.264359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fdd328a5-898e-4694-a548-4aa8ad13689e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:31.266167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fdd328a5-898e-4694-a548-4aa8ad13689e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:31.267152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fdd328a5-898e-4694-a548-4aa8ad13689e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:31.369216 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2a456100-ac87-4cfe-bbdb-fd154e85b1ca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947784 Sep 06 11:02:31.370827 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1352/2685] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:02:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:02:31.376137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c691fc2d-340e-4a0b-a543-f94f8a61318c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:31.377229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c691fc2d-340e-4a0b-a543-f94f8a61318c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:31.387671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c691fc2d-340e-4a0b-a543-f94f8a61318c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:31.388541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c691fc2d-340e-4a0b-a543-f94f8a61318c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:31.389737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c691fc2d-340e-4a0b-a543-f94f8a61318c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:31.390835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c691fc2d-340e-4a0b-a543-f94f8a61318c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:31.391619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c691fc2d-340e-4a0b-a543-f94f8a61318c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:31.392510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c691fc2d-340e-4a0b-a543-f94f8a61318c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:31.890058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fdd328a5-898e-4694-a548-4aa8ad13689e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:31.900592 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fdd328a5-898e-4694-a548-4aa8ad13689e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1317 microversion: 2.1 time: 0.694700 Sep 06 11:02:31.907391 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1334/2686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:31 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:31.912391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b1a8cbb9-6f96-4bf9-a9a0-270ad09a3089 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:31.916979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b1a8cbb9-6f96-4bf9-a9a0-270ad09a3089 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:31.985687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c691fc2d-340e-4a0b-a543-f94f8a61318c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:31.997241 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c691fc2d-340e-4a0b-a543-f94f8a61318c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1528 microversion: 2.1 time: 0.624945 Sep 06 11:02:32.005536 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1353/2687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:31 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1528 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:32.026783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b1a8cbb9-6f96-4bf9-a9a0-270ad09a3089 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:32.032308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5beefb73-a1d5-48be-972b-eaffef5aaaaf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:32.036159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5beefb73-a1d5-48be-972b-eaffef5aaaaf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:32.050698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5beefb73-a1d5-48be-972b-eaffef5aaaaf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:32.051493 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b1a8cbb9-6f96-4bf9-a9a0-270ad09a3089 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1215 microversion: 2.1 time: 0.138074 Sep 06 11:02:32.052309 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1335/2688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:31 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:32.053014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5beefb73-a1d5-48be-972b-eaffef5aaaaf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:32.053885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5beefb73-a1d5-48be-972b-eaffef5aaaaf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:32.054810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5beefb73-a1d5-48be-972b-eaffef5aaaaf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:32.055477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5beefb73-a1d5-48be-972b-eaffef5aaaaf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:32.056101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5beefb73-a1d5-48be-972b-eaffef5aaaaf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:32.230499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-00fb79c0-e5b1-4048-85d6-06c49a98ef25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:32.237744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-00fb79c0-e5b1-4048-85d6-06c49a98ef25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:32.245364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00fb79c0-e5b1-4048-85d6-06c49a98ef25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:32.247613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00fb79c0-e5b1-4048-85d6-06c49a98ef25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:32.249177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00fb79c0-e5b1-4048-85d6-06c49a98ef25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:32.254052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00fb79c0-e5b1-4048-85d6-06c49a98ef25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:32.259505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00fb79c0-e5b1-4048-85d6-06c49a98ef25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:32.260252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-00fb79c0-e5b1-4048-85d6-06c49a98ef25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:32.556954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5beefb73-a1d5-48be-972b-eaffef5aaaaf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:32.592846 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5beefb73-a1d5-48be-972b-eaffef5aaaaf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1528 microversion: 2.1 time: 0.563759 Sep 06 11:02:32.593668 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1354/2689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:32 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1528 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:32.602592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8f248351-70f8-4378-af8b-990350553321 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:32.605365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8f248351-70f8-4378-af8b-990350553321 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:32.636171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-00fb79c0-e5b1-4048-85d6-06c49a98ef25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:32.654661 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-00fb79c0-e5b1-4048-85d6-06c49a98ef25 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.427747 Sep 06 11:02:32.658958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f248351-70f8-4378-af8b-990350553321 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:32.662514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f248351-70f8-4378-af8b-990350553321 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:32.663401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f248351-70f8-4378-af8b-990350553321 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:32.665549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f248351-70f8-4378-af8b-990350553321 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:32.667663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f248351-70f8-4378-af8b-990350553321 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:32.669915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f248351-70f8-4378-af8b-990350553321 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:32.671532 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1336/2690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:32 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:32.678138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-adcaeb55-ba2b-46b9-8458-7d930f2c575e tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:32.775189 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8f248351-70f8-4378-af8b-990350553321 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "POST /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743/action" status: 200 len: 24573 microversion: 2.1 time: 0.180137 Sep 06 11:02:32.775904 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1355/2691] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:02:32 2022] POST /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743/action => generated 24573 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:02:32.933474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2a70b8a1-069b-4e93-bc01-e48a2705ef20 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:32.934407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2a70b8a1-069b-4e93-bc01-e48a2705ef20 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:32.945734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a70b8a1-069b-4e93-bc01-e48a2705ef20 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:32.946517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a70b8a1-069b-4e93-bc01-e48a2705ef20 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:32.947265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a70b8a1-069b-4e93-bc01-e48a2705ef20 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:32.948224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a70b8a1-069b-4e93-bc01-e48a2705ef20 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:32.950779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a70b8a1-069b-4e93-bc01-e48a2705ef20 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:32.951495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a70b8a1-069b-4e93-bc01-e48a2705ef20 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.098394 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-adcaeb55-ba2b-46b9-8458-7d930f2c575e tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/800d86de-8e09-4250-8d82-b77317d821e3" status: 202 len: 0 microversion: 2.1 time: 0.420463 Sep 06 11:02:33.098394 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1337/2692] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:02:32 2022] DELETE /compute/v2.1/flavors/800d86de-8e09-4250-8d82-b77317d821e3 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:02:33.099673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3f7fd6b-b4ce-42e3-bd9a-60613f75c663 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:33.106508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f3f7fd6b-b4ce-42e3-bd9a-60613f75c663 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:33.107764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f3f7fd6b-b4ce-42e3-bd9a-60613f75c663 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Searching by: {'deleted': False, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:02:33.113913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3f7fd6b-b4ce-42e3-bd9a-60613f75c663 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.114409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3f7fd6b-b4ce-42e3-bd9a-60613f75c663 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.115056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3f7fd6b-b4ce-42e3-bd9a-60613f75c663 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.116321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3f7fd6b-b4ce-42e3-bd9a-60613f75c663 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.117149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3f7fd6b-b4ce-42e3-bd9a-60613f75c663 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.117895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3f7fd6b-b4ce-42e3-bd9a-60613f75c663 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.149937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-f3f7fd6b-b4ce-42e3-bd9a-60613f75c663 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:02:33.180191 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f3f7fd6b-b4ce-42e3-bd9a-60613f75c663 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.084595 Sep 06 11:02:33.180863 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1338/2693] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 11:02:33 2022] GET /compute/v2.1/servers => generated 343 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:33.187714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-23b5f8d5-10b5-416a-b78b-4053fde83f61 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:33.189813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-23b5f8d5-10b5-416a-b78b-4053fde83f61 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:33.202464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23b5f8d5-10b5-416a-b78b-4053fde83f61 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.202464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23b5f8d5-10b5-416a-b78b-4053fde83f61 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.202464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23b5f8d5-10b5-416a-b78b-4053fde83f61 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.202464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23b5f8d5-10b5-416a-b78b-4053fde83f61 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.202464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23b5f8d5-10b5-416a-b78b-4053fde83f61 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.202464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23b5f8d5-10b5-416a-b78b-4053fde83f61 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.230635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2a70b8a1-069b-4e93-bc01-e48a2705ef20 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:33.259742 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2a70b8a1-069b-4e93-bc01-e48a2705ef20 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1317 microversion: 2.1 time: 0.317182 Sep 06 11:02:33.259742 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1356/2694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:32 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:33.264963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-37b67fd8-b4d3-42b3-89b6-485867594fe6 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:33.309142 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-37b67fd8-b4d3-42b3-89b6-485867594fe6 tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058242 Sep 06 11:02:33.315640 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1357/2695] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 11:02:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:33.322799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-23b5f8d5-10b5-416a-b78b-4053fde83f61 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:33.327326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:33.332876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:33.333803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Searching by: {'deleted': False, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:02:33.340336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.341512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.341794 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-23b5f8d5-10b5-416a-b78b-4053fde83f61 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1219 microversion: 2.1 time: 0.159868 Sep 06 11:02:33.342092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.343057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.343610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.344116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.349624 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1339/2696] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:33 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:33.358928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eba1a5ff-3680-4ff4-bd61-c9125f7df2d3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:33.359638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-eba1a5ff-3680-4ff4-bd61-c9125f7df2d3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:33.367954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eba1a5ff-3680-4ff4-bd61-c9125f7df2d3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.368706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eba1a5ff-3680-4ff4-bd61-c9125f7df2d3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.369322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eba1a5ff-3680-4ff4-bd61-c9125f7df2d3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.370225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eba1a5ff-3680-4ff4-bd61-c9125f7df2d3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.371545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eba1a5ff-3680-4ff4-bd61-c9125f7df2d3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.372176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eba1a5ff-3680-4ff4-bd61-c9125f7df2d3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.391636 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-eba1a5ff-3680-4ff4-bd61-c9125f7df2d3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] HTTP exception thrown: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eba1a5ff-3680-4ff4-bd61-c9125f7df2d3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Request method failure captured: Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 HTTP/1.1 Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyhUseLZJ8E18mBh1hkBQD0ylqWMAm9fJBkixY7hlncd1Jz8eDaMIPjqmuoTVa6iaVNJun0U3WC64l-cXfCpBVuJk3rJTMvWwWHUozrDtcbjvcQUrKpYCf2AmrDX1muQOJik2eT7tIgKL5t6SBQrMl69Cx_U94gHqpeKrkpMOeCcUf0 Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 91b83e289c414e499c91fc7f711774b7 Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91b83e289c414e499c91fc7f711774b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91b83e289c414e499c91fc7f711774b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91b83e289c414e499c91fc7f711774b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91b83e289c414e499c91fc7f711774b7"}]}] Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 91b83e289c414e499c91fc7f711774b7 Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersTestMultiNic-1879257848-project Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 99ebe881ffd44893879bb9e7ab63c9fd Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersTestMultiNic-1879257848-project Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '53022c77-a7ad-42cd-843f-0a4ead29e639'} Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:33.395297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:33.400787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:33.400787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:33.400787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:33.400787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:33.400787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:33.400787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:33.400787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:33.400787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:33.400787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:33.400787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:33.400787 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:33.405298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eba1a5ff-3680-4ff4-bd61-c9125f7df2d3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Returning 404 to user: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:33.406428 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-eba1a5ff-3680-4ff4-bd61-c9125f7df2d3 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 404 len: 111 microversion: 2.1 time: 0.054334 Sep 06 11:02:33.407202 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1340/2697] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:02:33 2022] DELETE /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:33.412458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:33.418073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:02:33.432746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:33.439002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:33.456757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.459569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.460810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.463538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.464252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.466163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.552132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:33.559637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.560203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.560845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.700454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:33.709013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Old instance type tempest-test_resize_flavor_-1712833111, new instance type m1.heat {{(pid=140875) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:02:33.737541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:02:33.739302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:02:33.741958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:02:33.744179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:02:33.744908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:02:33.749175 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a0101212-bee2-49d5-a00b-4892de919187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.429527 Sep 06 11:02:33.750292 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1358/2698] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 11:02:33 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:33.765435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6bb41729-0813-4b87-a335-31c8bb6436fe tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:33.766074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6bb41729-0813-4b87-a335-31c8bb6436fe tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 53022c77-a7ad-42cd-843f-0a4ead29e639] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:33.778952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6bb41729-0813-4b87-a335-31c8bb6436fe tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.779172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6bb41729-0813-4b87-a335-31c8bb6436fe tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.781622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6bb41729-0813-4b87-a335-31c8bb6436fe tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.783669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6bb41729-0813-4b87-a335-31c8bb6436fe tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.785748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6bb41729-0813-4b87-a335-31c8bb6436fe tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.786390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6bb41729-0813-4b87-a335-31c8bb6436fe tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.842902 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-6bb41729-0813-4b87-a335-31c8bb6436fe tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] HTTP exception thrown: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6bb41729-0813-4b87-a335-31c8bb6436fe tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Request method failure captured: Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 HTTP/1.1 Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyhUseLZJ8E18mBh1hkBQD0ylqWMAm9fJBkixY7hlncd1Jz8eDaMIPjqmuoTVa6iaVNJun0U3WC64l-cXfCpBVuJk3rJTMvWwWHUozrDtcbjvcQUrKpYCf2AmrDX1muQOJik2eT7tIgKL5t6SBQrMl69Cx_U94gHqpeKrkpMOeCcUf0 Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 91b83e289c414e499c91fc7f711774b7 Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91b83e289c414e499c91fc7f711774b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91b83e289c414e499c91fc7f711774b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91b83e289c414e499c91fc7f711774b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91b83e289c414e499c91fc7f711774b7"}]}] Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 91b83e289c414e499c91fc7f711774b7 Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestMultiNic-1879257848-project Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 99ebe881ffd44893879bb9e7ab63c9fd Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestMultiNic-1879257848-project Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '53022c77-a7ad-42cd-843f-0a4ead29e639'} Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:33.844643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:33.849853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:33.849853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:33.849853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:33.849853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:33.849853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:33.849853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. Sep 06 11:02:33.849853 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:33.849853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6bb41729-0813-4b87-a335-31c8bb6436fe tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Returning 404 to user: Instance 53022c77-a7ad-42cd-843f-0a4ead29e639 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:33.849853 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6bb41729-0813-4b87-a335-31c8bb6436fe tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639" status: 404 len: 111 microversion: 2.1 time: 0.094751 Sep 06 11:02:33.849853 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1359/2699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:33 2022] GET /compute/v2.1/servers/53022c77-a7ad-42cd-843f-0a4ead29e639 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:33.852759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b176d7b2-ca29-4a20-80cc-4ebdf8b09d78 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:33.853141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b176d7b2-ca29-4a20-80cc-4ebdf8b09d78 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:33.859829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b176d7b2-ca29-4a20-80cc-4ebdf8b09d78 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.860336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b176d7b2-ca29-4a20-80cc-4ebdf8b09d78 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.864543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b176d7b2-ca29-4a20-80cc-4ebdf8b09d78 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:33.864543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b176d7b2-ca29-4a20-80cc-4ebdf8b09d78 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:33.864543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b176d7b2-ca29-4a20-80cc-4ebdf8b09d78 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:33.864543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b176d7b2-ca29-4a20-80cc-4ebdf8b09d78 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:34.080238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b176d7b2-ca29-4a20-80cc-4ebdf8b09d78 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:34.090072 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b176d7b2-ca29-4a20-80cc-4ebdf8b09d78 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.241921 Sep 06 11:02:34.093392 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1360/2700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:33 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:34.100355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-be4f6f64-cea2-4c0b-8591-55dfaa77137c tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:34.116475 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-be4f6f64-cea2-4c0b-8591-55dfaa77137c tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019807 Sep 06 11:02:34.117370 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1361/2701] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 11:02:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:34.122475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3974ebe8-e09f-4f84-a4b3-bf66ed107909 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:34.122978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3974ebe8-e09f-4f84-a4b3-bf66ed107909 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:34.129532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3974ebe8-e09f-4f84-a4b3-bf66ed107909 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:34.130313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3974ebe8-e09f-4f84-a4b3-bf66ed107909 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:34.130923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3974ebe8-e09f-4f84-a4b3-bf66ed107909 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:34.132803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3974ebe8-e09f-4f84-a4b3-bf66ed107909 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:34.133481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3974ebe8-e09f-4f84-a4b3-bf66ed107909 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:34.133871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3974ebe8-e09f-4f84-a4b3-bf66ed107909 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:34.161744 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-3974ebe8-e09f-4f84-a4b3-bf66ed107909 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] HTTP exception thrown: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3974ebe8-e09f-4f84-a4b3-bf66ed107909 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Request method failure captured: Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 HTTP/1.1 Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyhUseLZJ8E18mBh1hkBQD0ylqWMAm9fJBkixY7hlncd1Jz8eDaMIPjqmuoTVa6iaVNJun0U3WC64l-cXfCpBVuJk3rJTMvWwWHUozrDtcbjvcQUrKpYCf2AmrDX1muQOJik2eT7tIgKL5t6SBQrMl69Cx_U94gHqpeKrkpMOeCcUf0 Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 91b83e289c414e499c91fc7f711774b7 Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91b83e289c414e499c91fc7f711774b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91b83e289c414e499c91fc7f711774b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91b83e289c414e499c91fc7f711774b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91b83e289c414e499c91fc7f711774b7"}]}] Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 91b83e289c414e499c91fc7f711774b7 Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestMultiNic-1879257848-project Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 99ebe881ffd44893879bb9e7ab63c9fd Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestMultiNic-1879257848-project Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81'} Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:34.163679 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:34.174643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:02:34.174643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:34.174643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:34.174643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:34.174643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:34.174643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:34.174643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:34.174643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:34.174643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:34.174643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:02:34.174643 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:34.174643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3974ebe8-e09f-4f84-a4b3-bf66ed107909 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Returning 404 to user: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:34.174643 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3974ebe8-e09f-4f84-a4b3-bf66ed107909 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 404 len: 111 microversion: 2.1 time: 0.051935 Sep 06 11:02:34.175505 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-38504d54-d74e-4468-b1ff-35a0bb1120cc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "POST /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253/action" status: 202 len: 0 microversion: 2.1 time: 0.766604 Sep 06 11:02:34.176554 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1362/2702] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:02:34 2022] DELETE /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:34.178931 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1341/2703] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:02:33 2022] POST /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253/action => generated 0 bytes in 771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:02:34.182169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c1857521-0fef-4d9f-a592-b357411c2113 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:34.182988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c1857521-0fef-4d9f-a592-b357411c2113 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] [instance: 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:34.189676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1857521-0fef-4d9f-a592-b357411c2113 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:34.190398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1857521-0fef-4d9f-a592-b357411c2113 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:34.201251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1857521-0fef-4d9f-a592-b357411c2113 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:34.201251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1857521-0fef-4d9f-a592-b357411c2113 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:34.201251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1857521-0fef-4d9f-a592-b357411c2113 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:34.201251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1857521-0fef-4d9f-a592-b357411c2113 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:34.201625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bdfeef1b-d554-4e4d-86cb-66cf1ba58690 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:34.207231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bdfeef1b-d554-4e4d-86cb-66cf1ba58690 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:34.221493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdfeef1b-d554-4e4d-86cb-66cf1ba58690 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:34.221998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdfeef1b-d554-4e4d-86cb-66cf1ba58690 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:34.222446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdfeef1b-d554-4e4d-86cb-66cf1ba58690 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:34.224221 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-c1857521-0fef-4d9f-a592-b357411c2113 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] HTTP exception thrown: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:02:34.224351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdfeef1b-d554-4e4d-86cb-66cf1ba58690 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:34.224351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdfeef1b-d554-4e4d-86cb-66cf1ba58690 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:34.224351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdfeef1b-d554-4e4d-86cb-66cf1ba58690 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c1857521-0fef-4d9f-a592-b357411c2113 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Request method failure captured: Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 HTTP/1.1 Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyhUseLZJ8E18mBh1hkBQD0ylqWMAm9fJBkixY7hlncd1Jz8eDaMIPjqmuoTVa6iaVNJun0U3WC64l-cXfCpBVuJk3rJTMvWwWHUozrDtcbjvcQUrKpYCf2AmrDX1muQOJik2eT7tIgKL5t6SBQrMl69Cx_U94gHqpeKrkpMOeCcUf0 Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 91b83e289c414e499c91fc7f711774b7 Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91b83e289c414e499c91fc7f711774b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91b83e289c414e499c91fc7f711774b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91b83e289c414e499c91fc7f711774b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91b83e289c414e499c91fc7f711774b7"}]}] Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 91b83e289c414e499c91fc7f711774b7 Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestMultiNic-1879257848 Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestMultiNic-1879257848-project Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 99ebe881ffd44893879bb9e7ab63c9fd Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestMultiNic-1879257848-project Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81'} Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:34.224728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:34.228599 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:34.228599 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:34.228599 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:34.228599 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:34.228599 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:34.228599 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. Sep 06 11:02:34.228599 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:34.245392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c1857521-0fef-4d9f-a592-b357411c2113 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] Returning 404 to user: Instance 9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:34.250701 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c1857521-0fef-4d9f-a592-b357411c2113 tempest-ServersTestMultiNic-1879257848 tempest-ServersTestMultiNic-1879257848-project] 10.222.0.20 "GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81" status: 404 len: 111 microversion: 2.1 time: 0.068542 Sep 06 11:02:34.250701 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1363/2704] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:34 2022] GET /compute/v2.1/servers/9e3e99bf-6e6e-46ca-8dd4-4c52ffa7ac81 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:34.258280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-025c22dc-14ff-4b84-abcd-afff5773f585 req-d9f74d52-73f7-4a5b-8412-5fac4fb2e69f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8d6ab04-f643-4697-b4dd-3bed20fc385c", "tag": "d8da94dc-fb90-40ca-8ca2-a52292ba2029"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:34.286048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-025c22dc-14ff-4b84-abcd-afff5773f585 req-d9f74d52-73f7-4a5b-8412-5fac4fb2e69f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:34.286767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-025c22dc-14ff-4b84-abcd-afff5773f585 req-d9f74d52-73f7-4a5b-8412-5fac4fb2e69f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:34.287441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-025c22dc-14ff-4b84-abcd-afff5773f585 req-d9f74d52-73f7-4a5b-8412-5fac4fb2e69f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:34.322826 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-025c22dc-14ff-4b84-abcd-afff5773f585 req-d9f74d52-73f7-4a5b-8412-5fac4fb2e69f service nova] Creating event network-changed:d8da94dc-fb90-40ca-8ca2-a52292ba2029 for instance d8d6ab04-f643-4697-b4dd-3bed20fc385c on nch2-master-1 Sep 06 11:02:34.330312 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-025c22dc-14ff-4b84-abcd-afff5773f585 req-d9f74d52-73f7-4a5b-8412-5fac4fb2e69f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079688 Sep 06 11:02:34.331483 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1364/2705] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:34.337354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-971ad91a-1377-4a61-8c64-d9b2a497b38a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:34.338073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-971ad91a-1377-4a61-8c64-d9b2a497b38a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:34.349272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-971ad91a-1377-4a61-8c64-d9b2a497b38a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:34.350109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-971ad91a-1377-4a61-8c64-d9b2a497b38a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:34.350572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-971ad91a-1377-4a61-8c64-d9b2a497b38a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:34.351878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-971ad91a-1377-4a61-8c64-d9b2a497b38a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:34.362305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-971ad91a-1377-4a61-8c64-d9b2a497b38a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:34.362800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-971ad91a-1377-4a61-8c64-d9b2a497b38a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:34.681975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-971ad91a-1377-4a61-8c64-d9b2a497b38a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:34.692951 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-971ad91a-1377-4a61-8c64-d9b2a497b38a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1317 microversion: 2.1 time: 0.360001 Sep 06 11:02:34.698536 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1365/2706] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:34 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:34.728750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8a7ad84c-093b-4570-8237-ad9a07f0b09d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:34.730902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8a7ad84c-093b-4570-8237-ad9a07f0b09d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:34.745252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a7ad84c-093b-4570-8237-ad9a07f0b09d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:34.751889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a7ad84c-093b-4570-8237-ad9a07f0b09d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:34.752536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a7ad84c-093b-4570-8237-ad9a07f0b09d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:34.753394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a7ad84c-093b-4570-8237-ad9a07f0b09d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:34.755667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a7ad84c-093b-4570-8237-ad9a07f0b09d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:34.756917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a7ad84c-093b-4570-8237-ad9a07f0b09d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:34.761314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bdfeef1b-d554-4e4d-86cb-66cf1ba58690 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:34.771187 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bdfeef1b-d554-4e4d-86cb-66cf1ba58690 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1537 microversion: 2.1 time: 0.586830 Sep 06 11:02:34.771772 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1342/2707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:34 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1537 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:35.116954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c81a1f1f-52f2-4d17-a765-5d3119d17d62 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:35.117180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c81a1f1f-52f2-4d17-a765-5d3119d17d62 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:35.135687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c81a1f1f-52f2-4d17-a765-5d3119d17d62 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:35.136189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c81a1f1f-52f2-4d17-a765-5d3119d17d62 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:35.136632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c81a1f1f-52f2-4d17-a765-5d3119d17d62 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:35.137530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c81a1f1f-52f2-4d17-a765-5d3119d17d62 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:35.137994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c81a1f1f-52f2-4d17-a765-5d3119d17d62 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:35.138413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c81a1f1f-52f2-4d17-a765-5d3119d17d62 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:35.485252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8a7ad84c-093b-4570-8237-ad9a07f0b09d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:35.507759 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8a7ad84c-093b-4570-8237-ad9a07f0b09d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1267 microversion: 2.1 time: 0.790250 Sep 06 11:02:35.509156 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1366/2708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:34 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1267 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:35.723930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d3d5e679-31bc-4db9-bdcb-7ed82162582f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:35.724636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3d5e679-31bc-4db9-bdcb-7ed82162582f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:35.752109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d5e679-31bc-4db9-bdcb-7ed82162582f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:35.752109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d5e679-31bc-4db9-bdcb-7ed82162582f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:35.752109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d5e679-31bc-4db9-bdcb-7ed82162582f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:35.752109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d5e679-31bc-4db9-bdcb-7ed82162582f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:35.752109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d5e679-31bc-4db9-bdcb-7ed82162582f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:35.752109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d5e679-31bc-4db9-bdcb-7ed82162582f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:35.828312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c81a1f1f-52f2-4d17-a765-5d3119d17d62 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:35.839449 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c81a1f1f-52f2-4d17-a765-5d3119d17d62 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.726355 Sep 06 11:02:35.842219 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1343/2709] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:35 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:35.863864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a53abe29-efe2-466c-b517-d96728b2e339 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:35.865456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a53abe29-efe2-466c-b517-d96728b2e339 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:35.893945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a53abe29-efe2-466c-b517-d96728b2e339 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:35.894771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a53abe29-efe2-466c-b517-d96728b2e339 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:35.896049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a53abe29-efe2-466c-b517-d96728b2e339 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:35.897087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a53abe29-efe2-466c-b517-d96728b2e339 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:35.898337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a53abe29-efe2-466c-b517-d96728b2e339 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:35.899932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a53abe29-efe2-466c-b517-d96728b2e339 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:36.089206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d3d5e679-31bc-4db9-bdcb-7ed82162582f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:36.098361 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d3d5e679-31bc-4db9-bdcb-7ed82162582f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1317 microversion: 2.1 time: 0.378776 Sep 06 11:02:36.105784 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1367/2710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:35 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:36.432891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a53abe29-efe2-466c-b517-d96728b2e339 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:36.451459 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a53abe29-efe2-466c-b517-d96728b2e339 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1537 microversion: 2.1 time: 0.607960 Sep 06 11:02:36.453701 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1344/2711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:35 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1537 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:36.538699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1d6bc371-4aa4-4d21-9349-8449717bbe85 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:36.541528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1d6bc371-4aa4-4d21-9349-8449717bbe85 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:36.554204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d6bc371-4aa4-4d21-9349-8449717bbe85 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:36.555421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d6bc371-4aa4-4d21-9349-8449717bbe85 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:36.556597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d6bc371-4aa4-4d21-9349-8449717bbe85 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:36.558081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d6bc371-4aa4-4d21-9349-8449717bbe85 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:36.558851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d6bc371-4aa4-4d21-9349-8449717bbe85 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:36.559506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d6bc371-4aa4-4d21-9349-8449717bbe85 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:36.702083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d6bc371-4aa4-4d21-9349-8449717bbe85 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:36.714825 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1d6bc371-4aa4-4d21-9349-8449717bbe85 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1273 microversion: 2.1 time: 0.180800 Sep 06 11:02:36.715606 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1368/2712] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:36 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:36.867849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3d3ac7fb-a0de-4810-820c-b7a5498728e5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:36.870912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3d3ac7fb-a0de-4810-820c-b7a5498728e5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:36.904222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d3ac7fb-a0de-4810-820c-b7a5498728e5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:36.905148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d3ac7fb-a0de-4810-820c-b7a5498728e5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:36.905917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d3ac7fb-a0de-4810-820c-b7a5498728e5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:36.906839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d3ac7fb-a0de-4810-820c-b7a5498728e5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:36.907491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d3ac7fb-a0de-4810-820c-b7a5498728e5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:36.908125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d3ac7fb-a0de-4810-820c-b7a5498728e5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:37.134332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c5f4f58c-b363-47cc-ad44-de11271d703e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:37.137673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c5f4f58c-b363-47cc-ad44-de11271d703e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:37.169654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5f4f58c-b363-47cc-ad44-de11271d703e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:37.170173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5f4f58c-b363-47cc-ad44-de11271d703e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:37.170633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5f4f58c-b363-47cc-ad44-de11271d703e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:37.182798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5f4f58c-b363-47cc-ad44-de11271d703e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:37.193512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5f4f58c-b363-47cc-ad44-de11271d703e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:37.199325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5f4f58c-b363-47cc-ad44-de11271d703e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:37.226143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3d3ac7fb-a0de-4810-820c-b7a5498728e5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:37.247927 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3d3ac7fb-a0de-4810-820c-b7a5498728e5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.385339 Sep 06 11:02:37.252579 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1345/2713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:36 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:37.480274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-129b61b3-4d7e-4d2c-a705-ea8e961eab47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:37.480895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-129b61b3-4d7e-4d2c-a705-ea8e961eab47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:37.494857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-129b61b3-4d7e-4d2c-a705-ea8e961eab47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:37.495379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-129b61b3-4d7e-4d2c-a705-ea8e961eab47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:37.495823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-129b61b3-4d7e-4d2c-a705-ea8e961eab47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:37.496533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-129b61b3-4d7e-4d2c-a705-ea8e961eab47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:37.496991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-129b61b3-4d7e-4d2c-a705-ea8e961eab47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:37.497424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-129b61b3-4d7e-4d2c-a705-ea8e961eab47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:37.703996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c5f4f58c-b363-47cc-ad44-de11271d703e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:37.722132 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c5f4f58c-b363-47cc-ad44-de11271d703e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1317 microversion: 2.1 time: 0.592998 Sep 06 11:02:37.724354 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1369/2714] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:37 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1317 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:37.758022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba532084-803a-43ac-b400-0263b3116bdf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:37.759600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ba532084-803a-43ac-b400-0263b3116bdf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:37.795335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba532084-803a-43ac-b400-0263b3116bdf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:37.802494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba532084-803a-43ac-b400-0263b3116bdf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:37.809956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba532084-803a-43ac-b400-0263b3116bdf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:37.819762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba532084-803a-43ac-b400-0263b3116bdf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:37.819762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba532084-803a-43ac-b400-0263b3116bdf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:37.819762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba532084-803a-43ac-b400-0263b3116bdf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:38.108526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-129b61b3-4d7e-4d2c-a705-ea8e961eab47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:38.120620 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-129b61b3-4d7e-4d2c-a705-ea8e961eab47 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1537 microversion: 2.1 time: 0.644078 Sep 06 11:02:38.135927 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1346/2715] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:37 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1537 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:38.241961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ba532084-803a-43ac-b400-0263b3116bdf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:38.256280 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ba532084-803a-43ac-b400-0263b3116bdf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1315 microversion: 2.1 time: 0.510055 Sep 06 11:02:38.257908 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1370/2716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:37 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:38.276344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0c8b881a-6d25-4ae8-aa0a-aebeb9c918dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:38.276988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0c8b881a-6d25-4ae8-aa0a-aebeb9c918dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:38.285142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c8b881a-6d25-4ae8-aa0a-aebeb9c918dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:38.285654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c8b881a-6d25-4ae8-aa0a-aebeb9c918dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:38.286133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c8b881a-6d25-4ae8-aa0a-aebeb9c918dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:38.286854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c8b881a-6d25-4ae8-aa0a-aebeb9c918dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:38.287901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c8b881a-6d25-4ae8-aa0a-aebeb9c918dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:38.288347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c8b881a-6d25-4ae8-aa0a-aebeb9c918dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:38.292687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:38.436074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0c8b881a-6d25-4ae8-aa0a-aebeb9c918dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:38.445560 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0c8b881a-6d25-4ae8-aa0a-aebeb9c918dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.173794 Sep 06 11:02:38.446454 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1347/2717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:38 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:38.749055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dd836e31-412b-4a4f-893f-84a5c95e0ad6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:38.749650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dd836e31-412b-4a4f-893f-84a5c95e0ad6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:38.772554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd836e31-412b-4a4f-893f-84a5c95e0ad6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:38.772554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd836e31-412b-4a4f-893f-84a5c95e0ad6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:38.772554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd836e31-412b-4a4f-893f-84a5c95e0ad6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:38.772554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd836e31-412b-4a4f-893f-84a5c95e0ad6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:38.772554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd836e31-412b-4a4f-893f-84a5c95e0ad6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:38.772554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd836e31-412b-4a4f-893f-84a5c95e0ad6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:39.146061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d3d5c042-529d-461a-8a82-69ce325fb8b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:39.146721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d3d5c042-529d-461a-8a82-69ce325fb8b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:39.184646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3d5c042-529d-461a-8a82-69ce325fb8b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:39.185164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3d5c042-529d-461a-8a82-69ce325fb8b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:39.185628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3d5c042-529d-461a-8a82-69ce325fb8b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:39.186364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3d5c042-529d-461a-8a82-69ce325fb8b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:39.186839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3d5c042-529d-461a-8a82-69ce325fb8b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:39.187327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3d5c042-529d-461a-8a82-69ce325fb8b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:39.498596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dd836e31-412b-4a4f-893f-84a5c95e0ad6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:39.515779 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dd836e31-412b-4a4f-893f-84a5c95e0ad6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1317 microversion: 2.1 time: 0.770648 Sep 06 11:02:39.516648 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1371/2718] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:38 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:39.521336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1910b67d-940a-4ab0-bc6c-6f3de8ee1256 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:39.522683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1910b67d-940a-4ab0-bc6c-6f3de8ee1256 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:39.542648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1910b67d-940a-4ab0-bc6c-6f3de8ee1256 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:39.543542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1910b67d-940a-4ab0-bc6c-6f3de8ee1256 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:39.543995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1910b67d-940a-4ab0-bc6c-6f3de8ee1256 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:39.544724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1910b67d-940a-4ab0-bc6c-6f3de8ee1256 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:39.545503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1910b67d-940a-4ab0-bc6c-6f3de8ee1256 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:39.545905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1910b67d-940a-4ab0-bc6c-6f3de8ee1256 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:39.565733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d3d5c042-529d-461a-8a82-69ce325fb8b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:39.575940 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d3d5c042-529d-461a-8a82-69ce325fb8b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1537 microversion: 2.1 time: 0.434429 Sep 06 11:02:39.577257 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1348/2719] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:39 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1537 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:39.585561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6d413800-f438-4191-a9f5-b093587a9ad6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:39.590971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6d413800-f438-4191-a9f5-b093587a9ad6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:39.609945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d413800-f438-4191-a9f5-b093587a9ad6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:39.613818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d413800-f438-4191-a9f5-b093587a9ad6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:39.613818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d413800-f438-4191-a9f5-b093587a9ad6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:39.613818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d413800-f438-4191-a9f5-b093587a9ad6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:39.613818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d413800-f438-4191-a9f5-b093587a9ad6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:39.614539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d413800-f438-4191-a9f5-b093587a9ad6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.143124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6d413800-f438-4191-a9f5-b093587a9ad6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:40.152610 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6d413800-f438-4191-a9f5-b093587a9ad6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1681 microversion: 2.1 time: 0.573809 Sep 06 11:02:40.163493 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1349/2720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:39 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1681 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:40.180973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1910b67d-940a-4ab0-bc6c-6f3de8ee1256 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:40.182941 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1910b67d-940a-4ab0-bc6c-6f3de8ee1256 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1315 microversion: 2.1 time: 0.664597 Sep 06 11:02:40.183575 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1372/2721] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:39 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:40.382651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a15b0f30-067e-46dd-9169-e296d97af2b1 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:40.383281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a15b0f30-067e-46dd-9169-e296d97af2b1 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:40.394293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a15b0f30-067e-46dd-9169-e296d97af2b1 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:40.399334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a15b0f30-067e-46dd-9169-e296d97af2b1 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:40.399996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a15b0f30-067e-46dd-9169-e296d97af2b1 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.400750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a15b0f30-067e-46dd-9169-e296d97af2b1 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:40.401223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a15b0f30-067e-46dd-9169-e296d97af2b1 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:40.401655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a15b0f30-067e-46dd-9169-e296d97af2b1 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.419949 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-a15b0f30-067e-46dd-9169-e296d97af2b1 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a15b0f30-067e-46dd-9169-e296d97af2b1 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 HTTP/1.1 Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'b19d97c3-c476-487e-9dca-8b524376c2e6'} Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:40.422182 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:40.426812 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 11:02:40.426812 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.426812 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:40.426812 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.426812 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:40.426812 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:40.426812 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:40.426812 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:40.426812 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:40.426812 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 11:02:40.426812 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.428958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a15b0f30-067e-46dd-9169-e296d97af2b1 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:40.438270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a89ecb92-7bed-42d2-a96a-dd670a86b5e1 req-d80b7fee-5009-42e1-abbb-170270e0e8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03a0857e-06d2-4767-85e9-8fd3b2fe0103", "tag": "30e1eaa1-35ac-477b-9658-e04f301830e2"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:40.448795 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a15b0f30-067e-46dd-9169-e296d97af2b1 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 404 len: 111 microversion: 2.1 time: 0.070835 Sep 06 11:02:40.450229 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1350/2722] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:02:40 2022] DELETE /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:40.452288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a89ecb92-7bed-42d2-a96a-dd670a86b5e1 req-d80b7fee-5009-42e1-abbb-170270e0e8a1 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:40.452782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a89ecb92-7bed-42d2-a96a-dd670a86b5e1 req-d80b7fee-5009-42e1-abbb-170270e0e8a1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:40.455115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a89ecb92-7bed-42d2-a96a-dd670a86b5e1 req-d80b7fee-5009-42e1-abbb-170270e0e8a1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.460026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6282ceaa-f500-4c78-a234-d3bed84b36fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:40.461395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6282ceaa-f500-4c78-a234-d3bed84b36fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: b19d97c3-c476-487e-9dca-8b524376c2e6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:40.471935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6282ceaa-f500-4c78-a234-d3bed84b36fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:40.472753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6282ceaa-f500-4c78-a234-d3bed84b36fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:40.472882 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a89ecb92-7bed-42d2-a96a-dd670a86b5e1 req-d80b7fee-5009-42e1-abbb-170270e0e8a1 service nova] Creating event network-changed:30e1eaa1-35ac-477b-9658-e04f301830e2 for instance 03a0857e-06d2-4767-85e9-8fd3b2fe0103 on nch2-master-1 Sep 06 11:02:40.473948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6282ceaa-f500-4c78-a234-d3bed84b36fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.474931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6282ceaa-f500-4c78-a234-d3bed84b36fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:40.475925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6282ceaa-f500-4c78-a234-d3bed84b36fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:40.476931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6282ceaa-f500-4c78-a234-d3bed84b36fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.492444 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a89ecb92-7bed-42d2-a96a-dd670a86b5e1 req-d80b7fee-5009-42e1-abbb-170270e0e8a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057978 Sep 06 11:02:40.498965 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1373/2723] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:40.516626 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-6282ceaa-f500-4c78-a234-d3bed84b36fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6282ceaa-f500-4c78-a234-d3bed84b36fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 HTTP/1.1 Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'b19d97c3-c476-487e-9dca-8b524376c2e6'} Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:40.520572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.525444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:40.525444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:40.525444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:40.525444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:40.525444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:40.525444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. Sep 06 11:02:40.525444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.525444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6282ceaa-f500-4c78-a234-d3bed84b36fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance b19d97c3-c476-487e-9dca-8b524376c2e6 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:40.526387 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6282ceaa-f500-4c78-a234-d3bed84b36fa tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6" status: 404 len: 111 microversion: 2.1 time: 0.071709 Sep 06 11:02:40.527148 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1351/2724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:40 2022] GET /compute/v2.1/servers/b19d97c3-c476-487e-9dca-8b524376c2e6 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:02:40.537014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2d3c8cb6-443c-43dd-abe0-f2eee8ef19d5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:40.538176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2d3c8cb6-443c-43dd-abe0-f2eee8ef19d5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:40.544466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-781eb7f7-4c74-400d-9abb-df96df595e01 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:40.545503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-781eb7f7-4c74-400d-9abb-df96df595e01 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:40.549326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d3c8cb6-443c-43dd-abe0-f2eee8ef19d5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:40.553473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d3c8cb6-443c-43dd-abe0-f2eee8ef19d5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:40.553952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-781eb7f7-4c74-400d-9abb-df96df595e01 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:40.554631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-781eb7f7-4c74-400d-9abb-df96df595e01 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:40.555406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d3c8cb6-443c-43dd-abe0-f2eee8ef19d5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.555751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-781eb7f7-4c74-400d-9abb-df96df595e01 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.559742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-781eb7f7-4c74-400d-9abb-df96df595e01 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:40.559742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-781eb7f7-4c74-400d-9abb-df96df595e01 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:40.559742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-781eb7f7-4c74-400d-9abb-df96df595e01 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.560087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d3c8cb6-443c-43dd-abe0-f2eee8ef19d5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:40.560087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d3c8cb6-443c-43dd-abe0-f2eee8ef19d5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:40.560087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d3c8cb6-443c-43dd-abe0-f2eee8ef19d5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.628252 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-2d3c8cb6-443c-43dd-abe0-f2eee8ef19d5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2d3c8cb6-443c-43dd-abe0-f2eee8ef19d5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec HTTP/1.1 Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '26309c50-a09b-444e-ab44-913b9a12e5ec'} Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:40.630089 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:40.636685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 11:02:40.636685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.636685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:40.636685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.636685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:40.636685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:40.636685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:40.636685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:40.636685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:40.636685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 11:02:40.636685 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.636685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2d3c8cb6-443c-43dd-abe0-f2eee8ef19d5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:40.642554 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2d3c8cb6-443c-43dd-abe0-f2eee8ef19d5 tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 404 len: 111 microversion: 2.1 time: 0.110623 Sep 06 11:02:40.643210 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1374/2725] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:02:40 2022] DELETE /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:40.648738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-529a127c-7781-4d47-87e0-2d3303ef1a8d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:40.649366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-529a127c-7781-4d47-87e0-2d3303ef1a8d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:40.656399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-529a127c-7781-4d47-87e0-2d3303ef1a8d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:40.656905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-529a127c-7781-4d47-87e0-2d3303ef1a8d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:40.657347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-529a127c-7781-4d47-87e0-2d3303ef1a8d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.658470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-529a127c-7781-4d47-87e0-2d3303ef1a8d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:40.659130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-529a127c-7781-4d47-87e0-2d3303ef1a8d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:40.659728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-529a127c-7781-4d47-87e0-2d3303ef1a8d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.906855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-781eb7f7-4c74-400d-9abb-df96df595e01 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:40.916696 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-781eb7f7-4c74-400d-9abb-df96df595e01 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1317 microversion: 2.1 time: 0.380158 Sep 06 11:02:40.917301 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1352/2726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:40 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:40.939334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-106803ca-9d40-4648-bae0-aeb19eff323b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:40.945876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-106803ca-9d40-4648-bae0-aeb19eff323b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] [instance: 26309c50-a09b-444e-ab44-913b9a12e5ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:40.957656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-106803ca-9d40-4648-bae0-aeb19eff323b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:40.958700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-106803ca-9d40-4648-bae0-aeb19eff323b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:40.959516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-106803ca-9d40-4648-bae0-aeb19eff323b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.960520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-106803ca-9d40-4648-bae0-aeb19eff323b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:40.961677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-106803ca-9d40-4648-bae0-aeb19eff323b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:40.962119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-106803ca-9d40-4648-bae0-aeb19eff323b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:40.979862 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-106803ca-9d40-4648-bae0-aeb19eff323b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] HTTP exception thrown: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-106803ca-9d40-4648-bae0-aeb19eff323b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Request method failure captured: Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec HTTP/1.1 Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyeZFb1Wc5DWFXxQ1qBQ3R_CVkgEiRl9f_XvyuktL2FsNt9oAwimiKp5IguCIFFvlmXQtF3l7E9XRHfaLZbjjF1tT6BApPNSztnnhZ57-QFjvAmVthMdns0mE7iNeS67MjXnYvvMCDJFo3YICuEBEBxFTqYkSDF0SXBGfFdTRfAYuK0 Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4061aad7f45b4c6192c02f3179d13687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4061aad7f45b4c6192c02f3179d13687"}]}] Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4061aad7f45b4c6192c02f3179d13687 Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1228883101 Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e19903666a1243e3a66411e30babe299 Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-1228883101-project Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '26309c50-a09b-444e-ab44-913b9a12e5ec'} Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:02:40.987857 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.993351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:02:40.993351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:02:40.993351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:02:40.993351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:02:40.993351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:02:40.993351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. Sep 06 11:02:40.993351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:02:40.993351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-106803ca-9d40-4648-bae0-aeb19eff323b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] Returning 404 to user: Instance 26309c50-a09b-444e-ab44-913b9a12e5ec could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:02:40.993351 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-106803ca-9d40-4648-bae0-aeb19eff323b tempest-DeleteServersTestJSON-1228883101 tempest-DeleteServersTestJSON-1228883101-project] 10.222.0.20 "GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec" status: 404 len: 111 microversion: 2.1 time: 0.053571 Sep 06 11:02:40.994863 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1353/2727] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:40 2022] GET /compute/v2.1/servers/26309c50-a09b-444e-ab44-913b9a12e5ec => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:41.022796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-529a127c-7781-4d47-87e0-2d3303ef1a8d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:41.034589 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-529a127c-7781-4d47-87e0-2d3303ef1a8d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1542 microversion: 2.1 time: 0.390282 Sep 06 11:02:41.038329 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1375/2728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:40 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1542 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:41.188774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e4e5610b-5ec4-4747-a397-b0b747db3c20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:41.189404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e4e5610b-5ec4-4747-a397-b0b747db3c20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:41.207964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f4ca133-5e04-4e0d-aeef-88b52c4aa1f6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:41.213453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7f4ca133-5e04-4e0d-aeef-88b52c4aa1f6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:41.229742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f4ca133-5e04-4e0d-aeef-88b52c4aa1f6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:41.230221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f4ca133-5e04-4e0d-aeef-88b52c4aa1f6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:41.230735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f4ca133-5e04-4e0d-aeef-88b52c4aa1f6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:41.232096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f4ca133-5e04-4e0d-aeef-88b52c4aa1f6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:41.232899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f4ca133-5e04-4e0d-aeef-88b52c4aa1f6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:41.234079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f4ca133-5e04-4e0d-aeef-88b52c4aa1f6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:41.234741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4e5610b-5ec4-4747-a397-b0b747db3c20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:41.243102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4e5610b-5ec4-4747-a397-b0b747db3c20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:41.243576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4e5610b-5ec4-4747-a397-b0b747db3c20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:41.244341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4e5610b-5ec4-4747-a397-b0b747db3c20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:41.244814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4e5610b-5ec4-4747-a397-b0b747db3c20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:41.245245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4e5610b-5ec4-4747-a397-b0b747db3c20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:41.537845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f4ca133-5e04-4e0d-aeef-88b52c4aa1f6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:41.551707 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7f4ca133-5e04-4e0d-aeef-88b52c4aa1f6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1315 microversion: 2.1 time: 0.348357 Sep 06 11:02:41.556767 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1376/2729] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:41 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:41.557852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e4e5610b-5ec4-4747-a397-b0b747db3c20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:41.569704 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e4e5610b-5ec4-4747-a397-b0b747db3c20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.392222 Sep 06 11:02:41.571382 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1354/2730] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:41 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:41.940962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-16ec2ee5-7c43-46d5-bea4-f4d7132b3734 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:41.941943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-16ec2ee5-7c43-46d5-bea4-f4d7132b3734 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:41.949154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16ec2ee5-7c43-46d5-bea4-f4d7132b3734 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:41.950151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16ec2ee5-7c43-46d5-bea4-f4d7132b3734 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:41.950802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16ec2ee5-7c43-46d5-bea4-f4d7132b3734 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:41.951750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16ec2ee5-7c43-46d5-bea4-f4d7132b3734 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:41.952505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16ec2ee5-7c43-46d5-bea4-f4d7132b3734 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:41.953137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16ec2ee5-7c43-46d5-bea4-f4d7132b3734 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:42.065683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e260b038-6217-42c7-a43c-f8cc4cd476fd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:42.066476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e260b038-6217-42c7-a43c-f8cc4cd476fd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:42.074634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:42.078314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e260b038-6217-42c7-a43c-f8cc4cd476fd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:42.080667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e260b038-6217-42c7-a43c-f8cc4cd476fd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:42.080667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e260b038-6217-42c7-a43c-f8cc4cd476fd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:42.081342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e260b038-6217-42c7-a43c-f8cc4cd476fd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:42.081921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e260b038-6217-42c7-a43c-f8cc4cd476fd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:42.082231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e260b038-6217-42c7-a43c-f8cc4cd476fd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:42.119869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-16ec2ee5-7c43-46d5-bea4-f4d7132b3734 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:42.132437 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-16ec2ee5-7c43-46d5-bea4-f4d7132b3734 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1317 microversion: 2.1 time: 0.195263 Sep 06 11:02:42.135079 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1377/2731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:41 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:42.305515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e260b038-6217-42c7-a43c-f8cc4cd476fd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:42.317284 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e260b038-6217-42c7-a43c-f8cc4cd476fd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1542 microversion: 2.1 time: 0.254775 Sep 06 11:02:42.318559 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1355/2732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:42 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1542 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:42.579216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e7f3958e-fb14-4526-b2e7-c2b3575d79b7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:42.580067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e7f3958e-fb14-4526-b2e7-c2b3575d79b7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:42.587702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7f3958e-fb14-4526-b2e7-c2b3575d79b7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:42.588292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7f3958e-fb14-4526-b2e7-c2b3575d79b7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:42.588815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7f3958e-fb14-4526-b2e7-c2b3575d79b7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:42.589895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7f3958e-fb14-4526-b2e7-c2b3575d79b7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:42.590569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7f3958e-fb14-4526-b2e7-c2b3575d79b7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:42.591262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7f3958e-fb14-4526-b2e7-c2b3575d79b7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:42.756040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e7f3958e-fb14-4526-b2e7-c2b3575d79b7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:42.774659 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e7f3958e-fb14-4526-b2e7-c2b3575d79b7 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1315 microversion: 2.1 time: 0.192177 Sep 06 11:02:42.774659 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1378/2733] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:42 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:43.135125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-737dff72-620f-4e0f-a78d-8317c815ddde req-5038ceac-b5df-4a5c-8b30-b6c68327e5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d6ab04-f643-4697-b4dd-3bed20fc385c", "name": "network-vif-plugged", "status": "completed", "tag": "d8da94dc-fb90-40ca-8ca2-a52292ba2029"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:43.149942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:43.152990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-737dff72-620f-4e0f-a78d-8317c815ddde req-5038ceac-b5df-4a5c-8b30-b6c68327e5c4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:43.153488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-737dff72-620f-4e0f-a78d-8317c815ddde req-5038ceac-b5df-4a5c-8b30-b6c68327e5c4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:43.156337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-737dff72-620f-4e0f-a78d-8317c815ddde req-5038ceac-b5df-4a5c-8b30-b6c68327e5c4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:43.156597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5407cc44-eb06-4e58-9259-3a8ecb7028ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:43.156700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5407cc44-eb06-4e58-9259-3a8ecb7028ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:43.163316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5407cc44-eb06-4e58-9259-3a8ecb7028ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:43.163804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5407cc44-eb06-4e58-9259-3a8ecb7028ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:43.164431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5407cc44-eb06-4e58-9259-3a8ecb7028ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:43.165327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5407cc44-eb06-4e58-9259-3a8ecb7028ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:43.165795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5407cc44-eb06-4e58-9259-3a8ecb7028ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:43.166222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5407cc44-eb06-4e58-9259-3a8ecb7028ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:43.170139 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-737dff72-620f-4e0f-a78d-8317c815ddde req-5038ceac-b5df-4a5c-8b30-b6c68327e5c4 service nova] Creating event network-vif-plugged:d8da94dc-fb90-40ca-8ca2-a52292ba2029 for instance d8d6ab04-f643-4697-b4dd-3bed20fc385c on nch2-master-1 Sep 06 11:02:43.175847 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-737dff72-620f-4e0f-a78d-8317c815ddde req-5038ceac-b5df-4a5c-8b30-b6c68327e5c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047034 Sep 06 11:02:43.176971 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1356/2734] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:43.192513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:43.353744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3df37c60-53b5-4bd6-83e1-0ceeeb5f7d7e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:43.356327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3df37c60-53b5-4bd6-83e1-0ceeeb5f7d7e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:43.374362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:43.379813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3df37c60-53b5-4bd6-83e1-0ceeeb5f7d7e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:43.380581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3df37c60-53b5-4bd6-83e1-0ceeeb5f7d7e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:43.384844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3df37c60-53b5-4bd6-83e1-0ceeeb5f7d7e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:43.386029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3df37c60-53b5-4bd6-83e1-0ceeeb5f7d7e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:43.389935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3df37c60-53b5-4bd6-83e1-0ceeeb5f7d7e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:43.390739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3df37c60-53b5-4bd6-83e1-0ceeeb5f7d7e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:43.551586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=16 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:44.057957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5407cc44-eb06-4e58-9259-3a8ecb7028ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:44.068529 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5407cc44-eb06-4e58-9259-3a8ecb7028ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1317 microversion: 2.1 time: 0.916283 Sep 06 11:02:44.084774 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1379/2735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:43 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1317 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:44.091832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0882ce6b-9599-4322-affe-244a149f5ce8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:44.093761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0882ce6b-9599-4322-affe-244a149f5ce8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:44.101150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0882ce6b-9599-4322-affe-244a149f5ce8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:44.101863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0882ce6b-9599-4322-affe-244a149f5ce8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:44.102480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0882ce6b-9599-4322-affe-244a149f5ce8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:44.103417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0882ce6b-9599-4322-affe-244a149f5ce8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:44.104077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0882ce6b-9599-4322-affe-244a149f5ce8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:44.104731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0882ce6b-9599-4322-affe-244a149f5ce8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:44.283400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3df37c60-53b5-4bd6-83e1-0ceeeb5f7d7e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:44.296307 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3df37c60-53b5-4bd6-83e1-0ceeeb5f7d7e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1542 microversion: 2.1 time: 0.954355 Sep 06 11:02:44.296898 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1357/2736] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:43 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1542 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:44.304033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3f8c4027-1d06-492c-a2e6-2b0b651ed305 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:44.304957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3f8c4027-1d06-492c-a2e6-2b0b651ed305 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:44.314057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f8c4027-1d06-492c-a2e6-2b0b651ed305 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:44.314647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f8c4027-1d06-492c-a2e6-2b0b651ed305 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:44.315198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f8c4027-1d06-492c-a2e6-2b0b651ed305 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:44.316686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f8c4027-1d06-492c-a2e6-2b0b651ed305 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:44.317469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f8c4027-1d06-492c-a2e6-2b0b651ed305 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:44.317902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f8c4027-1d06-492c-a2e6-2b0b651ed305 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:44.328255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0882ce6b-9599-4322-affe-244a149f5ce8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:44.337698 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0882ce6b-9599-4322-affe-244a149f5ce8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.251776 Sep 06 11:02:44.338285 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1380/2737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:44 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:44.596001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3f8c4027-1d06-492c-a2e6-2b0b651ed305 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:44.641192 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3f8c4027-1d06-492c-a2e6-2b0b651ed305 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1315 microversion: 2.1 time: 0.341806 Sep 06 11:02:44.642396 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1358/2738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:44 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:45.100043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dde98845-4af7-445b-97e1-136531f0c725 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:45.100811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dde98845-4af7-445b-97e1-136531f0c725 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:45.110925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dde98845-4af7-445b-97e1-136531f0c725 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:45.111395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dde98845-4af7-445b-97e1-136531f0c725 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:45.111845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dde98845-4af7-445b-97e1-136531f0c725 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:45.112575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dde98845-4af7-445b-97e1-136531f0c725 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:45.113089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dde98845-4af7-445b-97e1-136531f0c725 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:45.113534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dde98845-4af7-445b-97e1-136531f0c725 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:45.192500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b0664ebe-5732-4792-bf82-05908c84479a req-c135ae34-75e1-48b5-94be-01828ada9df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9db1902-3f12-48b6-a27f-425e4843424b", "name": "network-vif-unplugged", "status": "completed", "tag": "1fa7746e-916f-47fe-a1b6-1454c7592311"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:45.204184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b0664ebe-5732-4792-bf82-05908c84479a req-c135ae34-75e1-48b5-94be-01828ada9df1 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:45.204814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b0664ebe-5732-4792-bf82-05908c84479a req-c135ae34-75e1-48b5-94be-01828ada9df1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:45.205477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b0664ebe-5732-4792-bf82-05908c84479a req-c135ae34-75e1-48b5-94be-01828ada9df1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:45.219296 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b0664ebe-5732-4792-bf82-05908c84479a req-c135ae34-75e1-48b5-94be-01828ada9df1 service nova] Creating event network-vif-unplugged:1fa7746e-916f-47fe-a1b6-1454c7592311 for instance d9db1902-3f12-48b6-a27f-425e4843424b on nch2-master-1 Sep 06 11:02:45.224448 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b0664ebe-5732-4792-bf82-05908c84479a req-c135ae34-75e1-48b5-94be-01828ada9df1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037629 Sep 06 11:02:45.225590 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1359/2739] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:02:45.322694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-54c305a0-b3f3-42ac-9c1e-2ce6d9bc4483 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:45.323970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-54c305a0-b3f3-42ac-9c1e-2ce6d9bc4483 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:45.332363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c305a0-b3f3-42ac-9c1e-2ce6d9bc4483 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:45.333123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c305a0-b3f3-42ac-9c1e-2ce6d9bc4483 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:45.333845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c305a0-b3f3-42ac-9c1e-2ce6d9bc4483 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:45.334737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c305a0-b3f3-42ac-9c1e-2ce6d9bc4483 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:45.335402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c305a0-b3f3-42ac-9c1e-2ce6d9bc4483 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:45.336011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c305a0-b3f3-42ac-9c1e-2ce6d9bc4483 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:45.513038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dde98845-4af7-445b-97e1-136531f0c725 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:45.521297 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dde98845-4af7-445b-97e1-136531f0c725 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1317 microversion: 2.1 time: 0.429860 Sep 06 11:02:45.522446 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1381/2740] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:45 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:45.587557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-54c305a0-b3f3-42ac-9c1e-2ce6d9bc4483 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:45.596664 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-54c305a0-b3f3-42ac-9c1e-2ce6d9bc4483 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1542 microversion: 2.1 time: 0.279452 Sep 06 11:02:45.597843 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1360/2741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:45 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1542 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:45.666576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b8d7d4b1-e76a-4548-8932-722814700506 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:45.667593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b8d7d4b1-e76a-4548-8932-722814700506 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:45.674967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8d7d4b1-e76a-4548-8932-722814700506 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:45.675488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8d7d4b1-e76a-4548-8932-722814700506 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:45.676030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8d7d4b1-e76a-4548-8932-722814700506 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:45.676705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8d7d4b1-e76a-4548-8932-722814700506 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:45.677171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8d7d4b1-e76a-4548-8932-722814700506 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:45.677946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8d7d4b1-e76a-4548-8932-722814700506 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:45.876493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b8d7d4b1-e76a-4548-8932-722814700506 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:45.894706 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b8d7d4b1-e76a-4548-8932-722814700506 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1315 microversion: 2.1 time: 0.232706 Sep 06 11:02:45.895865 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1382/2742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:45 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:46.551968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff4b24c5-2e77-4774-8226-3741ea099a72 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:46.552993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff4b24c5-2e77-4774-8226-3741ea099a72 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:46.563193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff4b24c5-2e77-4774-8226-3741ea099a72 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:46.580640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff4b24c5-2e77-4774-8226-3741ea099a72 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:46.581342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff4b24c5-2e77-4774-8226-3741ea099a72 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:46.582617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff4b24c5-2e77-4774-8226-3741ea099a72 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:46.583271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff4b24c5-2e77-4774-8226-3741ea099a72 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:46.584466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff4b24c5-2e77-4774-8226-3741ea099a72 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:46.625359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-903722e8-5dc0-4e93-97a7-70c0d031c2b4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:46.626007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-903722e8-5dc0-4e93-97a7-70c0d031c2b4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:46.639994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-903722e8-5dc0-4e93-97a7-70c0d031c2b4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:46.640676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-903722e8-5dc0-4e93-97a7-70c0d031c2b4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:46.641120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-903722e8-5dc0-4e93-97a7-70c0d031c2b4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:46.642008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-903722e8-5dc0-4e93-97a7-70c0d031c2b4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:46.642680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-903722e8-5dc0-4e93-97a7-70c0d031c2b4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:46.643297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-903722e8-5dc0-4e93-97a7-70c0d031c2b4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:46.985803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff4b24c5-2e77-4774-8226-3741ea099a72 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:46.986237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-903722e8-5dc0-4e93-97a7-70c0d031c2b4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:46.994357 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-903722e8-5dc0-4e93-97a7-70c0d031c2b4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1542 microversion: 2.1 time: 0.375312 Sep 06 11:02:46.994976 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1383/2743] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:46 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1542 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:46.995503 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff4b24c5-2e77-4774-8226-3741ea099a72 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1506 microversion: 2.1 time: 0.452990 Sep 06 11:02:46.998571 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1361/2744] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:46 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:47.009789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b06a7844-6aed-4c1b-b4ff-ef54fc75574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:47.011049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b06a7844-6aed-4c1b-b4ff-ef54fc75574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:47.029144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b06a7844-6aed-4c1b-b4ff-ef54fc75574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:47.029633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b06a7844-6aed-4c1b-b4ff-ef54fc75574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:47.030083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b06a7844-6aed-4c1b-b4ff-ef54fc75574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:47.030797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b06a7844-6aed-4c1b-b4ff-ef54fc75574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:47.031293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b06a7844-6aed-4c1b-b4ff-ef54fc75574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:47.031726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b06a7844-6aed-4c1b-b4ff-ef54fc75574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:47.033416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b38d3dd-fd10-4cb1-9e87-05e4680e5951 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:47.035278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2b38d3dd-fd10-4cb1-9e87-05e4680e5951 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:47.046247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b38d3dd-fd10-4cb1-9e87-05e4680e5951 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:47.048761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b38d3dd-fd10-4cb1-9e87-05e4680e5951 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:47.051270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b38d3dd-fd10-4cb1-9e87-05e4680e5951 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:47.051270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b38d3dd-fd10-4cb1-9e87-05e4680e5951 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:47.051270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b38d3dd-fd10-4cb1-9e87-05e4680e5951 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:47.055539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b38d3dd-fd10-4cb1-9e87-05e4680e5951 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:47.664152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2b38d3dd-fd10-4cb1-9e87-05e4680e5951 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:47.671887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b06a7844-6aed-4c1b-b4ff-ef54fc75574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:47.684873 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b06a7844-6aed-4c1b-b4ff-ef54fc75574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1315 microversion: 2.1 time: 0.684036 Sep 06 11:02:47.685209 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b38d3dd-fd10-4cb1-9e87-05e4680e5951 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1506 microversion: 2.1 time: 0.654816 Sep 06 11:02:47.685845 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1362/2745] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:47 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1506 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:47.698617 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1384/2746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:46 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:47.707105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-96d9b99d-5ea7-4896-b591-09de2f58b293 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:47.710338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-96d9b99d-5ea7-4896-b591-09de2f58b293 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:47.712957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:47.715935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:47.725253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:47.725762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:47.726214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:47.726872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96d9b99d-5ea7-4896-b591-09de2f58b293 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:47.727369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:47.727501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96d9b99d-5ea7-4896-b591-09de2f58b293 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:47.727846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96d9b99d-5ea7-4896-b591-09de2f58b293 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:47.728299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:47.728562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96d9b99d-5ea7-4896-b591-09de2f58b293 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:47.729027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96d9b99d-5ea7-4896-b591-09de2f58b293 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:47.729685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96d9b99d-5ea7-4896-b591-09de2f58b293 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:47.729841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:47.851511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:02:47.852458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:02:47.853214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:02:47.853881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:02:47.854525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:02:47.914926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-96d9b99d-5ea7-4896-b591-09de2f58b293 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:47.923456 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-96d9b99d-5ea7-4896-b591-09de2f58b293 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.235316 Sep 06 11:02:47.924165 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1363/2747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:47 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:47.948545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a9077023-e5a3-4124-8d95-8ad3ad6795ef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:47.949267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a9077023-e5a3-4124-8d95-8ad3ad6795ef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:47.957391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9077023-e5a3-4124-8d95-8ad3ad6795ef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:47.957888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9077023-e5a3-4124-8d95-8ad3ad6795ef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:47.958332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9077023-e5a3-4124-8d95-8ad3ad6795ef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:47.959801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9077023-e5a3-4124-8d95-8ad3ad6795ef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:47.960282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9077023-e5a3-4124-8d95-8ad3ad6795ef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:47.960989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9077023-e5a3-4124-8d95-8ad3ad6795ef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:48.070651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:48.079468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:48.082045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:48.082045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:48.082045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:48.082045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:48.086990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:48.133976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a9077023-e5a3-4124-8d95-8ad3ad6795ef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:48.143520 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a9077023-e5a3-4124-8d95-8ad3ad6795ef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.201440 Sep 06 11:02:48.145384 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1364/2748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:47 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:48.153582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1dc91e1c-3834-4e12-87e4-5ef20b8bf28c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:48.154530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1dc91e1c-3834-4e12-87e4-5ef20b8bf28c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:48.161333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dc91e1c-3834-4e12-87e4-5ef20b8bf28c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:48.162168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dc91e1c-3834-4e12-87e4-5ef20b8bf28c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:48.162828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dc91e1c-3834-4e12-87e4-5ef20b8bf28c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:48.163796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dc91e1c-3834-4e12-87e4-5ef20b8bf28c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:48.164479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dc91e1c-3834-4e12-87e4-5ef20b8bf28c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:48.165174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dc91e1c-3834-4e12-87e4-5ef20b8bf28c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:48.234861 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-027acddc-74cc-438d-bca4-93218d1339eb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "POST /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c/action" status: 202 len: 1108 microversion: 2.1 time: 0.525798 Sep 06 11:02:48.270682 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1385/2749] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:02:47 2022] POST /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c/action => generated 1108 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 06 11:02:48.277380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-271cdd82-fee5-44f6-abd5-8bbf22747917 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:48.278255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-271cdd82-fee5-44f6-abd5-8bbf22747917 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:48.284955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-271cdd82-fee5-44f6-abd5-8bbf22747917 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:48.285736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-271cdd82-fee5-44f6-abd5-8bbf22747917 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:48.286407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-271cdd82-fee5-44f6-abd5-8bbf22747917 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:48.287561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-271cdd82-fee5-44f6-abd5-8bbf22747917 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:48.288231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-271cdd82-fee5-44f6-abd5-8bbf22747917 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:48.288850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-271cdd82-fee5-44f6-abd5-8bbf22747917 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:48.508424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1dc91e1c-3834-4e12-87e4-5ef20b8bf28c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:48.525051 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1dc91e1c-3834-4e12-87e4-5ef20b8bf28c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1542 microversion: 2.1 time: 0.376599 Sep 06 11:02:48.525360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-271cdd82-fee5-44f6-abd5-8bbf22747917 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:48.525816 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1365/2750] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:48 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1542 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:48.536596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b14de369-6129-4186-84c1-889ee4e7a380 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:48.537647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b14de369-6129-4186-84c1-889ee4e7a380 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:48.545159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b14de369-6129-4186-84c1-889ee4e7a380 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:48.545959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b14de369-6129-4186-84c1-889ee4e7a380 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:48.546998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b14de369-6129-4186-84c1-889ee4e7a380 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:48.547937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b14de369-6129-4186-84c1-889ee4e7a380 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:48.548754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b14de369-6129-4186-84c1-889ee4e7a380 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:48.550059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b14de369-6129-4186-84c1-889ee4e7a380 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:48.550542 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-271cdd82-fee5-44f6-abd5-8bbf22747917 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.277786 Sep 06 11:02:48.552428 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1386/2751] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:48 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:48.579882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-41aa2927-8a1d-4289-8fca-8b814172bd5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:48.582695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-41aa2927-8a1d-4289-8fca-8b814172bd5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:48.611965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41aa2927-8a1d-4289-8fca-8b814172bd5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:48.611965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41aa2927-8a1d-4289-8fca-8b814172bd5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:48.611965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41aa2927-8a1d-4289-8fca-8b814172bd5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:48.611965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41aa2927-8a1d-4289-8fca-8b814172bd5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:48.611965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41aa2927-8a1d-4289-8fca-8b814172bd5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:48.611965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41aa2927-8a1d-4289-8fca-8b814172bd5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:48.751662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b14de369-6129-4186-84c1-889ee4e7a380 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:48.761442 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b14de369-6129-4186-84c1-889ee4e7a380 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.234210 Sep 06 11:02:48.762023 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1366/2752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:48 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:48.767848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-47c46a15-97b2-41e8-9395-addc580acd98 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:48.768758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-47c46a15-97b2-41e8-9395-addc580acd98 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:48.775952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47c46a15-97b2-41e8-9395-addc580acd98 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:48.776670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47c46a15-97b2-41e8-9395-addc580acd98 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:48.777392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47c46a15-97b2-41e8-9395-addc580acd98 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:48.778317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47c46a15-97b2-41e8-9395-addc580acd98 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:48.778781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47c46a15-97b2-41e8-9395-addc580acd98 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:48.779539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47c46a15-97b2-41e8-9395-addc580acd98 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:48.784259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:49.018066 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-41aa2927-8a1d-4289-8fca-8b814172bd5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.437587 Sep 06 11:02:49.019913 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1387/2753] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:02:48 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:02:49.033568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe2c9d32-95f6-4d70-b5e8-4d4c2ed11fa7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:49.036059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe2c9d32-95f6-4d70-b5e8-4d4c2ed11fa7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:49.049989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:49.053171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe2c9d32-95f6-4d70-b5e8-4d4c2ed11fa7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:49.057901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-47c46a15-97b2-41e8-9395-addc580acd98 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:49.058864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe2c9d32-95f6-4d70-b5e8-4d4c2ed11fa7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:49.062666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe2c9d32-95f6-4d70-b5e8-4d4c2ed11fa7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:49.062666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe2c9d32-95f6-4d70-b5e8-4d4c2ed11fa7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:49.063461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe2c9d32-95f6-4d70-b5e8-4d4c2ed11fa7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:49.064128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe2c9d32-95f6-4d70-b5e8-4d4c2ed11fa7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:49.075781 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-47c46a15-97b2-41e8-9395-addc580acd98 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1315 microversion: 2.1 time: 0.312500 Sep 06 11:02:49.094825 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1367/2754] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:48 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:49.277330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe2c9d32-95f6-4d70-b5e8-4d4c2ed11fa7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:49.285997 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe2c9d32-95f6-4d70-b5e8-4d4c2ed11fa7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1670 microversion: 2.1 time: 0.261079 Sep 06 11:02:49.286653 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1388/2755] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:49 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1670 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:49.554670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b4ec9c1e-2eae-4856-a0b0-2d9e0f3dfb1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:49.555477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b4ec9c1e-2eae-4856-a0b0-2d9e0f3dfb1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:49.558272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:49.569723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4ec9c1e-2eae-4856-a0b0-2d9e0f3dfb1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:49.577520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4ec9c1e-2eae-4856-a0b0-2d9e0f3dfb1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:49.577520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4ec9c1e-2eae-4856-a0b0-2d9e0f3dfb1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:49.579685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4ec9c1e-2eae-4856-a0b0-2d9e0f3dfb1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:49.580212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4ec9c1e-2eae-4856-a0b0-2d9e0f3dfb1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:49.580678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4ec9c1e-2eae-4856-a0b0-2d9e0f3dfb1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:49.785111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-63b7d86a-3968-4315-bef4-3f2d3124ebc7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:49.785743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-63b7d86a-3968-4315-bef4-3f2d3124ebc7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:49.799355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63b7d86a-3968-4315-bef4-3f2d3124ebc7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:49.799856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63b7d86a-3968-4315-bef4-3f2d3124ebc7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:49.800321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63b7d86a-3968-4315-bef4-3f2d3124ebc7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:49.808070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63b7d86a-3968-4315-bef4-3f2d3124ebc7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:49.808581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63b7d86a-3968-4315-bef4-3f2d3124ebc7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:49.809030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63b7d86a-3968-4315-bef4-3f2d3124ebc7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:49.970937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b4ec9c1e-2eae-4856-a0b0-2d9e0f3dfb1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:49.983111 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b4ec9c1e-2eae-4856-a0b0-2d9e0f3dfb1f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1542 microversion: 2.1 time: 0.434590 Sep 06 11:02:50.002106 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1368/2756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:49 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1542 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:50.104534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aadd4e5e-454e-4a4c-975b-d698e0cbe7bf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:50.105326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aadd4e5e-454e-4a4c-975b-d698e0cbe7bf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:50.122733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aadd4e5e-454e-4a4c-975b-d698e0cbe7bf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:50.123427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aadd4e5e-454e-4a4c-975b-d698e0cbe7bf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:50.123981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aadd4e5e-454e-4a4c-975b-d698e0cbe7bf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:50.124810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aadd4e5e-454e-4a4c-975b-d698e0cbe7bf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:50.125389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aadd4e5e-454e-4a4c-975b-d698e0cbe7bf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:50.125951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aadd4e5e-454e-4a4c-975b-d698e0cbe7bf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:50.199713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-63b7d86a-3968-4315-bef4-3f2d3124ebc7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:50.216398 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-63b7d86a-3968-4315-bef4-3f2d3124ebc7 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.435358 Sep 06 11:02:50.220122 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1389/2757] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:49 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:50.232133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-3c95805a-e480-4ccf-8804-bc2ba8543a65 req-cf06dcbe-0ea5-40eb-87c7-5c08b5d13483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a0857e-06d2-4767-85e9-8fd3b2fe0103", "name": "network-vif-plugged", "status": "completed", "tag": "30e1eaa1-35ac-477b-9658-e04f301830e2"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:50.245567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3c95805a-e480-4ccf-8804-bc2ba8543a65 req-cf06dcbe-0ea5-40eb-87c7-5c08b5d13483 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:50.246271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3c95805a-e480-4ccf-8804-bc2ba8543a65 req-cf06dcbe-0ea5-40eb-87c7-5c08b5d13483 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:50.247294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3c95805a-e480-4ccf-8804-bc2ba8543a65 req-cf06dcbe-0ea5-40eb-87c7-5c08b5d13483 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:50.267968 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-3c95805a-e480-4ccf-8804-bc2ba8543a65 req-cf06dcbe-0ea5-40eb-87c7-5c08b5d13483 service nova] Creating event network-vif-plugged:30e1eaa1-35ac-477b-9658-e04f301830e2 for instance 03a0857e-06d2-4767-85e9-8fd3b2fe0103 on nch2-master-1 Sep 06 11:02:50.277208 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-3c95805a-e480-4ccf-8804-bc2ba8543a65 req-cf06dcbe-0ea5-40eb-87c7-5c08b5d13483 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055188 Sep 06 11:02:50.278635 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1390/2758] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:50.314923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2dc61210-c609-48b3-8236-ea1bf22f172d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:50.316673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2dc61210-c609-48b3-8236-ea1bf22f172d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:50.317771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aadd4e5e-454e-4a4c-975b-d698e0cbe7bf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:50.323570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dc61210-c609-48b3-8236-ea1bf22f172d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:50.324074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dc61210-c609-48b3-8236-ea1bf22f172d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:50.326475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dc61210-c609-48b3-8236-ea1bf22f172d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:50.326475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dc61210-c609-48b3-8236-ea1bf22f172d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:50.326475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dc61210-c609-48b3-8236-ea1bf22f172d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:50.326475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dc61210-c609-48b3-8236-ea1bf22f172d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:50.338871 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aadd4e5e-454e-4a4c-975b-d698e0cbe7bf tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1315 microversion: 2.1 time: 0.234133 Sep 06 11:02:50.356845 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1369/2759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:50 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:50.596806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2dc61210-c609-48b3-8236-ea1bf22f172d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:50.609062 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2dc61210-c609-48b3-8236-ea1bf22f172d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1670 microversion: 2.1 time: 0.300503 Sep 06 11:02:50.639761 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1391/2760] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:50 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1670 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:51.012220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0f33c4a0-0f18-4669-b677-8b96b85eae9b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:51.015970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0f33c4a0-0f18-4669-b677-8b96b85eae9b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:51.021053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f33c4a0-0f18-4669-b677-8b96b85eae9b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:51.021792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f33c4a0-0f18-4669-b677-8b96b85eae9b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:51.022243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f33c4a0-0f18-4669-b677-8b96b85eae9b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:51.023002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f33c4a0-0f18-4669-b677-8b96b85eae9b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:51.023488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f33c4a0-0f18-4669-b677-8b96b85eae9b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:51.024116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f33c4a0-0f18-4669-b677-8b96b85eae9b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:51.220156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0f33c4a0-0f18-4669-b677-8b96b85eae9b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:51.230395 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0f33c4a0-0f18-4669-b677-8b96b85eae9b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1542 microversion: 2.1 time: 0.222265 Sep 06 11:02:51.237350 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1370/2761] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:51 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1542 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:51.247152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-27a290db-2b32-4afb-a23d-b2a0eace46d9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:51.248397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-27a290db-2b32-4afb-a23d-b2a0eace46d9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:51.258425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27a290db-2b32-4afb-a23d-b2a0eace46d9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:51.259240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27a290db-2b32-4afb-a23d-b2a0eace46d9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:51.260004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27a290db-2b32-4afb-a23d-b2a0eace46d9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:51.261100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27a290db-2b32-4afb-a23d-b2a0eace46d9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:51.261783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27a290db-2b32-4afb-a23d-b2a0eace46d9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:51.262416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27a290db-2b32-4afb-a23d-b2a0eace46d9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:51.373297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-30939acd-f67f-4003-a644-3a4ab138688d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:51.374882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-30939acd-f67f-4003-a644-3a4ab138688d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:51.390658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30939acd-f67f-4003-a644-3a4ab138688d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:51.391987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30939acd-f67f-4003-a644-3a4ab138688d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:51.392913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30939acd-f67f-4003-a644-3a4ab138688d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:51.393692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30939acd-f67f-4003-a644-3a4ab138688d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:51.394166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30939acd-f67f-4003-a644-3a4ab138688d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:51.394616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30939acd-f67f-4003-a644-3a4ab138688d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:51.467770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-27a290db-2b32-4afb-a23d-b2a0eace46d9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:51.482534 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-27a290db-2b32-4afb-a23d-b2a0eace46d9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.237765 Sep 06 11:02:51.484323 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1392/2762] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:51 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:51.640069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c6445a67-ca6f-46ee-9f46-c6f63d01329a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:51.640717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c6445a67-ca6f-46ee-9f46-c6f63d01329a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:51.661053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6445a67-ca6f-46ee-9f46-c6f63d01329a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:51.661587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6445a67-ca6f-46ee-9f46-c6f63d01329a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:51.665942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6445a67-ca6f-46ee-9f46-c6f63d01329a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:51.666927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6445a67-ca6f-46ee-9f46-c6f63d01329a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:51.667462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6445a67-ca6f-46ee-9f46-c6f63d01329a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:51.670327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6445a67-ca6f-46ee-9f46-c6f63d01329a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:51.700262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-30939acd-f67f-4003-a644-3a4ab138688d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:51.725798 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-30939acd-f67f-4003-a644-3a4ab138688d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1315 microversion: 2.1 time: 0.365803 Sep 06 11:02:51.726931 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1371/2763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:51 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:52.007958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c6445a67-ca6f-46ee-9f46-c6f63d01329a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:52.012187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:52.023871 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c6445a67-ca6f-46ee-9f46-c6f63d01329a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1675 microversion: 2.1 time: 0.382351 Sep 06 11:02:52.025047 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1393/2764] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:51 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1675 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:52.262062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-49e0eb1c-da62-45cc-8919-bbfca6754826 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:52.262746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-49e0eb1c-da62-45cc-8919-bbfca6754826 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:52.292706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49e0eb1c-da62-45cc-8919-bbfca6754826 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:52.293575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49e0eb1c-da62-45cc-8919-bbfca6754826 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:52.294224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49e0eb1c-da62-45cc-8919-bbfca6754826 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:52.295253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49e0eb1c-da62-45cc-8919-bbfca6754826 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:52.295910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49e0eb1c-da62-45cc-8919-bbfca6754826 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:52.296559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49e0eb1c-da62-45cc-8919-bbfca6754826 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:52.379683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ee9269f3-9ae3-4249-b76e-ab9910d645ed tempest-ComputeTenantNetworksTest-664866293 tempest-ComputeTenantNetworksTest-664866293-project] Calling method '.version_select at 0x7f90f368b700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:52.562993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-49e0eb1c-da62-45cc-8919-bbfca6754826 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:52.574965 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-49e0eb1c-da62-45cc-8919-bbfca6754826 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1542 microversion: 2.1 time: 0.317097 Sep 06 11:02:52.583906 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1394/2765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:52 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1542 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:02:52.590267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-741d1159-fa5a-4577-b4b7-4f076474f765 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:52.591585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-741d1159-fa5a-4577-b4b7-4f076474f765 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:52.599513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741d1159-fa5a-4577-b4b7-4f076474f765 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:52.600672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741d1159-fa5a-4577-b4b7-4f076474f765 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:52.602735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741d1159-fa5a-4577-b4b7-4f076474f765 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:52.602735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741d1159-fa5a-4577-b4b7-4f076474f765 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:52.603586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741d1159-fa5a-4577-b4b7-4f076474f765 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:52.604355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741d1159-fa5a-4577-b4b7-4f076474f765 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:53.150449 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ee9269f3-9ae3-4249-b76e-ab9910d645ed tempest-ComputeTenantNetworksTest-664866293 tempest-ComputeTenantNetworksTest-664866293-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.955873 Sep 06 11:02:53.151778 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1372/2766] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 11:02:52 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:53.173750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01896f84-794e-43c4-8395-4025718ca548 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:53.175433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-01896f84-794e-43c4-8395-4025718ca548 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:53.190829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01896f84-794e-43c4-8395-4025718ca548 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:53.198042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01896f84-794e-43c4-8395-4025718ca548 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:53.198772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01896f84-794e-43c4-8395-4025718ca548 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:53.199722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01896f84-794e-43c4-8395-4025718ca548 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:53.200361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01896f84-794e-43c4-8395-4025718ca548 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:53.201159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01896f84-794e-43c4-8395-4025718ca548 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:53.319341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-741d1159-fa5a-4577-b4b7-4f076474f765 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:53.329709 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-741d1159-fa5a-4577-b4b7-4f076474f765 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.744423 Sep 06 11:02:53.330309 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1395/2767] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:52 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:53.336168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2fee3e19-f419-48a5-a436-f84be937c41f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:53.336857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2fee3e19-f419-48a5-a436-f84be937c41f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:53.351585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fee3e19-f419-48a5-a436-f84be937c41f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:53.352315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fee3e19-f419-48a5-a436-f84be937c41f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:53.352832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fee3e19-f419-48a5-a436-f84be937c41f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:53.352832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fee3e19-f419-48a5-a436-f84be937c41f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:53.352832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fee3e19-f419-48a5-a436-f84be937c41f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:53.355677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fee3e19-f419-48a5-a436-f84be937c41f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:53.520048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-01896f84-794e-43c4-8395-4025718ca548 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:53.542450 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-01896f84-794e-43c4-8395-4025718ca548 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1465 microversion: 2.1 time: 0.381185 Sep 06 11:02:53.543070 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1373/2768] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:53 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1465 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:53.563829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ab6fed38-7779-44c9-a63a-edd2fc210538 tempest-ComputeTenantNetworksTest-664866293 tempest-ComputeTenantNetworksTest-664866293-project] Calling method '.version_select at 0x7f90fd10e700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:53.627973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2fee3e19-f419-48a5-a436-f84be937c41f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:53.648618 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2fee3e19-f419-48a5-a436-f84be937c41f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.316948 Sep 06 11:02:53.649224 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1396/2769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:53 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:53.654795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-35922ff5-6603-4ffb-8119-06167bd7c7b7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:53.658979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-35922ff5-6603-4ffb-8119-06167bd7c7b7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:53.671389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35922ff5-6603-4ffb-8119-06167bd7c7b7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:53.685409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35922ff5-6603-4ffb-8119-06167bd7c7b7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:53.685409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35922ff5-6603-4ffb-8119-06167bd7c7b7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:53.685409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35922ff5-6603-4ffb-8119-06167bd7c7b7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:53.686105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35922ff5-6603-4ffb-8119-06167bd7c7b7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:53.686105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35922ff5-6603-4ffb-8119-06167bd7c7b7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:53.727786 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ab6fed38-7779-44c9-a63a-edd2fc210538 tempest-ComputeTenantNetworksTest-664866293 tempest-ComputeTenantNetworksTest-664866293-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks/c9fa67d2-89da-4090-b833-7e03675deacb" status: 200 len: 140 microversion: 2.1 time: 0.182909 Sep 06 11:02:53.734276 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1374/2770] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 11:02:53 2022] GET /compute/v2.1/os-tenant-networks/c9fa67d2-89da-4090-b833-7e03675deacb => generated 140 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:53.740167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-99d6b387-de87-418d-8bc2-22e95c77fcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:53.740797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-99d6b387-de87-418d-8bc2-22e95c77fcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:53.759214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99d6b387-de87-418d-8bc2-22e95c77fcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:53.759719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99d6b387-de87-418d-8bc2-22e95c77fcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:53.760162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99d6b387-de87-418d-8bc2-22e95c77fcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:53.761404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99d6b387-de87-418d-8bc2-22e95c77fcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:53.761876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99d6b387-de87-418d-8bc2-22e95c77fcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:53.762315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99d6b387-de87-418d-8bc2-22e95c77fcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:54.128517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-99d6b387-de87-418d-8bc2-22e95c77fcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:54.137010 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-35922ff5-6603-4ffb-8119-06167bd7c7b7 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1616 microversion: 2.1 time: 0.486515 Sep 06 11:02:54.143336 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1397/2771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:53 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1616 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:54.149466 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-99d6b387-de87-418d-8bc2-22e95c77fcab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1542 microversion: 2.1 time: 0.413384 Sep 06 11:02:54.152616 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1375/2772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:53 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1542 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:54.155554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-05fc11c9-4e6a-4fb7-8a25-cd0239064580 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:54.159683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-05fc11c9-4e6a-4fb7-8a25-cd0239064580 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:54.173380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05fc11c9-4e6a-4fb7-8a25-cd0239064580 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:54.174797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05fc11c9-4e6a-4fb7-8a25-cd0239064580 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:54.175315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05fc11c9-4e6a-4fb7-8a25-cd0239064580 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:54.176060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05fc11c9-4e6a-4fb7-8a25-cd0239064580 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:54.176587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05fc11c9-4e6a-4fb7-8a25-cd0239064580 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:54.176965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05fc11c9-4e6a-4fb7-8a25-cd0239064580 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:54.246529 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-05fc11c9-4e6a-4fb7-8a25-cd0239064580 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 200 len: 322 microversion: 2.1 time: 0.099634 Sep 06 11:02:54.247391 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1398/2773] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:02:54 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 322 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:02:54.256799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-241d0f6a-e852-464e-b779-c346e69c238a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:54.257700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-241d0f6a-e852-464e-b779-c346e69c238a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:54.268795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-241d0f6a-e852-464e-b779-c346e69c238a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:54.269568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-241d0f6a-e852-464e-b779-c346e69c238a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:54.270388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-241d0f6a-e852-464e-b779-c346e69c238a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:54.271561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-241d0f6a-e852-464e-b779-c346e69c238a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:54.272276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-241d0f6a-e852-464e-b779-c346e69c238a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:54.272776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-241d0f6a-e852-464e-b779-c346e69c238a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:54.334750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1797596894", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "0d07bf04-ec2e-40a3-8916-aade0c51060b"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:54.407681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:02:54.578428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-241d0f6a-e852-464e-b779-c346e69c238a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:54.590886 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-241d0f6a-e852-464e-b779-c346e69c238a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.338274 Sep 06 11:02:54.591845 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1376/2774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:54 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:54.597226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-58323eec-3f25-4f51-bd63-c1b61c421bdd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:54.599900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-58323eec-3f25-4f51-bd63-c1b61c421bdd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:54.605741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58323eec-3f25-4f51-bd63-c1b61c421bdd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:54.606461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58323eec-3f25-4f51-bd63-c1b61c421bdd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:54.607186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58323eec-3f25-4f51-bd63-c1b61c421bdd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:54.608791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58323eec-3f25-4f51-bd63-c1b61c421bdd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:54.609427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58323eec-3f25-4f51-bd63-c1b61c421bdd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:54.610027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58323eec-3f25-4f51-bd63-c1b61c421bdd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:54.804032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:02:54.804724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:02:54.805403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:02:54.805980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:02:54.806561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:02:54.825620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:54.826297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:54.827588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:54.830242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:54.830909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:54.831618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:54.862967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-58323eec-3f25-4f51-bd63-c1b61c421bdd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:54.867593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for project 0a7af966e1b740a59920ff9370b5dade. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:02:54.887277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Getting quotas for user 9e84745e5df647d1921e8d1ffc08711c and project 0a7af966e1b740a59920ff9370b5dade. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:02:54.888400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:02:54.890876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:02:54.898180 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-58323eec-3f25-4f51-bd63-c1b61c421bdd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.305001 Sep 06 11:02:54.899229 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1377/2775] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:54 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:54.919189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-13534b44-eabf-4edb-9b29-ee397041e624 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:54.919932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-13534b44-eabf-4edb-9b29-ee397041e624 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:54.928277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13534b44-eabf-4edb-9b29-ee397041e624 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:54.931093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13534b44-eabf-4edb-9b29-ee397041e624 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:54.931765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13534b44-eabf-4edb-9b29-ee397041e624 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:54.932685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13534b44-eabf-4edb-9b29-ee397041e624 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:54.933408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13534b44-eabf-4edb-9b29-ee397041e624 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:54.934030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13534b44-eabf-4edb-9b29-ee397041e624 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:55.108090 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-32243f42-b3dd-4253-9b9c-c67431f7db05 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788986 Sep 06 11:02:55.118360 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1399/2776] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:02:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:02:55.130091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c29dadc5-8d9c-435e-a186-b718ca752ff6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:55.131577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c29dadc5-8d9c-435e-a186-b718ca752ff6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:55.160188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-13534b44-eabf-4edb-9b29-ee397041e624 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:55.167817 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-13534b44-eabf-4edb-9b29-ee397041e624 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.262808 Sep 06 11:02:55.169699 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1378/2777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:54 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:55.183965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-83983372-0f2f-44c8-b5d3-7e4ded0212ba tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:55.184621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-83983372-0f2f-44c8-b5d3-7e4ded0212ba tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:55.197775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83983372-0f2f-44c8-b5d3-7e4ded0212ba tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:55.198579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83983372-0f2f-44c8-b5d3-7e4ded0212ba tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:55.205874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83983372-0f2f-44c8-b5d3-7e4ded0212ba tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:55.207885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83983372-0f2f-44c8-b5d3-7e4ded0212ba tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:55.209196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83983372-0f2f-44c8-b5d3-7e4ded0212ba tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:55.209810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83983372-0f2f-44c8-b5d3-7e4ded0212ba tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:55.272264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c29dadc5-8d9c-435e-a186-b718ca752ff6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:55.275445 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c29dadc5-8d9c-435e-a186-b718ca752ff6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1217 microversion: 2.1 time: 0.150208 Sep 06 11:02:55.276230 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1400/2778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:55 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:55.298940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-056f8ea0-e5c1-474e-aff0-004903141f58 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:55.299606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-056f8ea0-e5c1-474e-aff0-004903141f58 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:55.347458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-056f8ea0-e5c1-474e-aff0-004903141f58 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:55.347458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-056f8ea0-e5c1-474e-aff0-004903141f58 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:55.347458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-056f8ea0-e5c1-474e-aff0-004903141f58 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:55.347458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-056f8ea0-e5c1-474e-aff0-004903141f58 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:55.347458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-056f8ea0-e5c1-474e-aff0-004903141f58 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:55.347458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-056f8ea0-e5c1-474e-aff0-004903141f58 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:55.555796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-83983372-0f2f-44c8-b5d3-7e4ded0212ba tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:55.566697 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-83983372-0f2f-44c8-b5d3-7e4ded0212ba tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1542 microversion: 2.1 time: 0.389692 Sep 06 11:02:55.568629 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1379/2779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:55 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1542 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:55.602229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-056f8ea0-e5c1-474e-aff0-004903141f58 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:55.610324 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-056f8ea0-e5c1-474e-aff0-004903141f58 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.331387 Sep 06 11:02:55.611245 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1401/2780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:55 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:55.638983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fa6830d5-87a6-4299-a511-48a12056347b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:55.639912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fa6830d5-87a6-4299-a511-48a12056347b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:55.658841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa6830d5-87a6-4299-a511-48a12056347b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:55.658841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa6830d5-87a6-4299-a511-48a12056347b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:55.658841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa6830d5-87a6-4299-a511-48a12056347b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:55.658841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa6830d5-87a6-4299-a511-48a12056347b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:55.658841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa6830d5-87a6-4299-a511-48a12056347b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:55.658841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa6830d5-87a6-4299-a511-48a12056347b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:55.922785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3bb8d5c0-8453-43ed-bbaa-e2445eb5e65d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:55.923718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fa6830d5-87a6-4299-a511-48a12056347b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:55.927819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3bb8d5c0-8453-43ed-bbaa-e2445eb5e65d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:55.942540 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fa6830d5-87a6-4299-a511-48a12056347b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.301537 Sep 06 11:02:55.946057 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1380/2781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:55 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:55.946373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bb8d5c0-8453-43ed-bbaa-e2445eb5e65d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:55.947323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bb8d5c0-8453-43ed-bbaa-e2445eb5e65d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:55.947940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bb8d5c0-8453-43ed-bbaa-e2445eb5e65d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:55.950376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bb8d5c0-8453-43ed-bbaa-e2445eb5e65d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:55.951042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bb8d5c0-8453-43ed-bbaa-e2445eb5e65d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:55.954377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bb8d5c0-8453-43ed-bbaa-e2445eb5e65d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:56.173693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3bb8d5c0-8453-43ed-bbaa-e2445eb5e65d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:56.181596 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3bb8d5c0-8453-43ed-bbaa-e2445eb5e65d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.262069 Sep 06 11:02:56.197067 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1402/2782] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:55 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:56.264376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1140671078", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "350b7fa2-cbf1-4a97-afcf-fd60d6924de1"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:02:56.316126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-670dbf29-5ad9-42c8-9458-f50f7381efe6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:56.319334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-670dbf29-5ad9-42c8-9458-f50f7381efe6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:56.372631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] validate_networks() for [('350b7fa2-cbf1-4a97-afcf-fd60d6924de1', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:02:56.590341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-670dbf29-5ad9-42c8-9458-f50f7381efe6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:56.599043 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-670dbf29-5ad9-42c8-9458-f50f7381efe6 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1217 microversion: 2.1 time: 0.300752 Sep 06 11:02:56.603194 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1403/2783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:56 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1217 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:56.620479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0636b727-f841-426e-aa23-e7228a1383d2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:56.622487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0636b727-f841-426e-aa23-e7228a1383d2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:56.656652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0636b727-f841-426e-aa23-e7228a1383d2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:56.658992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0636b727-f841-426e-aa23-e7228a1383d2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:56.662029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0636b727-f841-426e-aa23-e7228a1383d2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:56.663501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0636b727-f841-426e-aa23-e7228a1383d2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:56.664702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0636b727-f841-426e-aa23-e7228a1383d2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:56.666338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0636b727-f841-426e-aa23-e7228a1383d2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:57.242827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:02:57.242827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:02:57.242827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:02:57.242827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:02:57.242827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:02:57.243902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0636b727-f841-426e-aa23-e7228a1383d2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:57.257791 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0636b727-f841-426e-aa23-e7228a1383d2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1542 microversion: 2.1 time: 0.653069 Sep 06 11:02:57.261855 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1404/2784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:56 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1542 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:57.271307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:57.273567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:57.275850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:57.280482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:57.280482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:57.283064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8e6e8e70-eea8-4943-89a6-ec8e865184ec tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:57.283064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8e6e8e70-eea8-4943-89a6-ec8e865184ec tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:57.285611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:57.304664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e6e8e70-eea8-4943-89a6-ec8e865184ec tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:57.305462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e6e8e70-eea8-4943-89a6-ec8e865184ec tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:57.306095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e6e8e70-eea8-4943-89a6-ec8e865184ec tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:57.307720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e6e8e70-eea8-4943-89a6-ec8e865184ec tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:57.307720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e6e8e70-eea8-4943-89a6-ec8e865184ec tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:57.309283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e6e8e70-eea8-4943-89a6-ec8e865184ec tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:57.345489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Getting quotas for project dcd5ffec2c6246fb89ba181542692585. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:02:57.360247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Getting quotas for user f16abbf8a68344b68444ff8fc2795c67 and project dcd5ffec2c6246fb89ba181542692585. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:02:57.397793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:02:57.400954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:02:57.671799 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-77502824-78c9-43a6-89b7-86192fad81e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.405111 Sep 06 11:02:57.673186 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1381/2785] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:02:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:02:57.689558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8e6e8e70-eea8-4943-89a6-ec8e865184ec tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:57.696519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fed19092-bd63-4476-98e0-66c0123e8863 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:57.698638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fed19092-bd63-4476-98e0-66c0123e8863 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:57.703482 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8e6e8e70-eea8-4943-89a6-ec8e865184ec tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.436980 Sep 06 11:02:57.703482 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1405/2786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:57 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:57.715668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e1de9551-0d9a-4061-aad5-8ffcbe6897f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:57.716268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e1de9551-0d9a-4061-aad5-8ffcbe6897f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:57.727663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fed19092-bd63-4476-98e0-66c0123e8863 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:57.727982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fed19092-bd63-4476-98e0-66c0123e8863 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:57.729673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fed19092-bd63-4476-98e0-66c0123e8863 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:57.730667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fed19092-bd63-4476-98e0-66c0123e8863 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:57.731729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fed19092-bd63-4476-98e0-66c0123e8863 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:57.732909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fed19092-bd63-4476-98e0-66c0123e8863 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:57.970071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e1de9551-0d9a-4061-aad5-8ffcbe6897f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:57.990305 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e1de9551-0d9a-4061-aad5-8ffcbe6897f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1215 microversion: 2.1 time: 0.277541 Sep 06 11:02:57.990305 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1406/2787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:57 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:57.990504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fed19092-bd63-4476-98e0-66c0123e8863 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:58.009055 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fed19092-bd63-4476-98e0-66c0123e8863 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1269 microversion: 2.1 time: 0.332535 Sep 06 11:02:58.023191 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1382/2788] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:57 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1269 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:58.284828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-19cc2664-0008-4fb7-9a87-64cb02b537fc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:58.285665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-19cc2664-0008-4fb7-9a87-64cb02b537fc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:58.295312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19cc2664-0008-4fb7-9a87-64cb02b537fc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:58.296032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19cc2664-0008-4fb7-9a87-64cb02b537fc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:58.296664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19cc2664-0008-4fb7-9a87-64cb02b537fc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:58.297585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19cc2664-0008-4fb7-9a87-64cb02b537fc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:58.298233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19cc2664-0008-4fb7-9a87-64cb02b537fc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:58.298850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19cc2664-0008-4fb7-9a87-64cb02b537fc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:58.522517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19cc2664-0008-4fb7-9a87-64cb02b537fc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:58.538183 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-19cc2664-0008-4fb7-9a87-64cb02b537fc tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1541 microversion: 2.1 time: 0.252930 Sep 06 11:02:58.539049 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1407/2789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:58 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1541 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:58.729063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93e58afc-bb33-4279-839f-1157f3d91e4c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:58.729693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-93e58afc-bb33-4279-839f-1157f3d91e4c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:58.738569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e58afc-bb33-4279-839f-1157f3d91e4c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:58.744280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e58afc-bb33-4279-839f-1157f3d91e4c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:58.744280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e58afc-bb33-4279-839f-1157f3d91e4c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:58.744280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e58afc-bb33-4279-839f-1157f3d91e4c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:58.744280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e58afc-bb33-4279-839f-1157f3d91e4c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:58.744280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e58afc-bb33-4279-839f-1157f3d91e4c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:58.949703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-93e58afc-bb33-4279-839f-1157f3d91e4c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:58.961008 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-93e58afc-bb33-4279-839f-1157f3d91e4c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.233820 Sep 06 11:02:58.966340 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1383/2790] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:58 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:59.009412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cb259bf4-d706-4775-8a68-d5ab293f7993 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:59.010074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cb259bf4-d706-4775-8a68-d5ab293f7993 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:59.041425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e66e3595-9b1e-4342-96c4-e44e98de952a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:59.041972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e66e3595-9b1e-4342-96c4-e44e98de952a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:59.059185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e66e3595-9b1e-4342-96c4-e44e98de952a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:59.065325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e66e3595-9b1e-4342-96c4-e44e98de952a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:59.065878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e66e3595-9b1e-4342-96c4-e44e98de952a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:59.066954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e66e3595-9b1e-4342-96c4-e44e98de952a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:59.068306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e66e3595-9b1e-4342-96c4-e44e98de952a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:59.069177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e66e3595-9b1e-4342-96c4-e44e98de952a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:59.110592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cb259bf4-d706-4775-8a68-d5ab293f7993 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:59.130133 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cb259bf4-d706-4775-8a68-d5ab293f7993 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1215 microversion: 2.1 time: 0.126276 Sep 06 11:02:59.132641 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1408/2791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:59 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:59.209976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e66e3595-9b1e-4342-96c4-e44e98de952a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:59.219702 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e66e3595-9b1e-4342-96c4-e44e98de952a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1277 microversion: 2.1 time: 0.183359 Sep 06 11:02:59.223099 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1384/2792] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:59 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:02:59.573160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c8af2a67-c7b5-4fb2-8c9c-37efe3f1044e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:02:59.576202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c8af2a67-c7b5-4fb2-8c9c-37efe3f1044e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:02:59.599555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8af2a67-c7b5-4fb2-8c9c-37efe3f1044e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:59.599555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8af2a67-c7b5-4fb2-8c9c-37efe3f1044e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:59.599555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8af2a67-c7b5-4fb2-8c9c-37efe3f1044e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:59.599929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8af2a67-c7b5-4fb2-8c9c-37efe3f1044e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:02:59.602458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8af2a67-c7b5-4fb2-8c9c-37efe3f1044e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:02:59.604055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8af2a67-c7b5-4fb2-8c9c-37efe3f1044e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:02:59.937215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c8af2a67-c7b5-4fb2-8c9c-37efe3f1044e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:02:59.947502 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c8af2a67-c7b5-4fb2-8c9c-37efe3f1044e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1541 microversion: 2.1 time: 0.388842 Sep 06 11:02:59.957022 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1409/2793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:59 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1541 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:00.004713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7b204b11-cb68-4c80-95e9-f7042fe85eca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:00.006797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7b204b11-cb68-4c80-95e9-f7042fe85eca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:00.014230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b204b11-cb68-4c80-95e9-f7042fe85eca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:00.015055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b204b11-cb68-4c80-95e9-f7042fe85eca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:00.020586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b204b11-cb68-4c80-95e9-f7042fe85eca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:00.020586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b204b11-cb68-4c80-95e9-f7042fe85eca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:00.020586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b204b11-cb68-4c80-95e9-f7042fe85eca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:00.020586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b204b11-cb68-4c80-95e9-f7042fe85eca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:00.156518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-83d78faa-21a3-4b09-b710-fd11d3d39f09 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:00.162731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-83d78faa-21a3-4b09-b710-fd11d3d39f09 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:00.183189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83d78faa-21a3-4b09-b710-fd11d3d39f09 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:00.185014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83d78faa-21a3-4b09-b710-fd11d3d39f09 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:00.189566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83d78faa-21a3-4b09-b710-fd11d3d39f09 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:00.191779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83d78faa-21a3-4b09-b710-fd11d3d39f09 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:00.196152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83d78faa-21a3-4b09-b710-fd11d3d39f09 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:00.196783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83d78faa-21a3-4b09-b710-fd11d3d39f09 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:00.307598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7b204b11-cb68-4c80-95e9-f7042fe85eca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:00.315761 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7b204b11-cb68-4c80-95e9-f7042fe85eca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.329001 Sep 06 11:03:00.327233 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1385/2794] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:02:59 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:00.331098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7bd4d7f1-fa5f-4b01-a7de-0aa37f588856 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:00.331098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7bd4d7f1-fa5f-4b01-a7de-0aa37f588856 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:00.349576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bd4d7f1-fa5f-4b01-a7de-0aa37f588856 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:00.350091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bd4d7f1-fa5f-4b01-a7de-0aa37f588856 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:00.350547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bd4d7f1-fa5f-4b01-a7de-0aa37f588856 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:00.351310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bd4d7f1-fa5f-4b01-a7de-0aa37f588856 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:00.351784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bd4d7f1-fa5f-4b01-a7de-0aa37f588856 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:00.352225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bd4d7f1-fa5f-4b01-a7de-0aa37f588856 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:00.381733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-83d78faa-21a3-4b09-b710-fd11d3d39f09 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:00.394779 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-83d78faa-21a3-4b09-b710-fd11d3d39f09 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1211 microversion: 2.1 time: 0.243664 Sep 06 11:03:00.397359 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1410/2795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:00 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1211 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:00.419508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:00.494285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7bd4d7f1-fa5f-4b01-a7de-0aa37f588856 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:00.502000 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7bd4d7f1-fa5f-4b01-a7de-0aa37f588856 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1275 microversion: 2.1 time: 0.179713 Sep 06 11:03:00.503678 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1386/2796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:00 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:00.971275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26f64461-e102-47c5-b84c-7a1707efeadf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:00.973408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-26f64461-e102-47c5-b84c-7a1707efeadf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:00.991413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26f64461-e102-47c5-b84c-7a1707efeadf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:00.992198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26f64461-e102-47c5-b84c-7a1707efeadf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:00.992974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26f64461-e102-47c5-b84c-7a1707efeadf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:00.993952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26f64461-e102-47c5-b84c-7a1707efeadf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:00.995067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26f64461-e102-47c5-b84c-7a1707efeadf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:00.995843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26f64461-e102-47c5-b84c-7a1707efeadf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:01.307193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-26f64461-e102-47c5-b84c-7a1707efeadf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:01.320163 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-26f64461-e102-47c5-b84c-7a1707efeadf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1473 microversion: 2.1 time: 0.352847 Sep 06 11:03:01.321369 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1411/2797] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:00 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1473 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:01.340456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-52e040a1-a8cb-42d9-a15d-9d4b59735167 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:01.341200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-52e040a1-a8cb-42d9-a15d-9d4b59735167 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:01.349032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52e040a1-a8cb-42d9-a15d-9d4b59735167 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:01.349816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52e040a1-a8cb-42d9-a15d-9d4b59735167 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:01.350496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52e040a1-a8cb-42d9-a15d-9d4b59735167 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:01.351617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52e040a1-a8cb-42d9-a15d-9d4b59735167 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:01.352289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52e040a1-a8cb-42d9-a15d-9d4b59735167 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:01.356702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52e040a1-a8cb-42d9-a15d-9d4b59735167 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:01.426635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a30b1908-2292-4948-8f31-9a0e2b3debf1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:01.429087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a30b1908-2292-4948-8f31-9a0e2b3debf1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:01.436997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a30b1908-2292-4948-8f31-9a0e2b3debf1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:01.438721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a30b1908-2292-4948-8f31-9a0e2b3debf1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:01.439430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a30b1908-2292-4948-8f31-9a0e2b3debf1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:01.440569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a30b1908-2292-4948-8f31-9a0e2b3debf1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:01.441334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a30b1908-2292-4948-8f31-9a0e2b3debf1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:01.442123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a30b1908-2292-4948-8f31-9a0e2b3debf1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:01.559801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a30b1908-2292-4948-8f31-9a0e2b3debf1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:01.573851 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a30b1908-2292-4948-8f31-9a0e2b3debf1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1267 microversion: 2.1 time: 0.153043 Sep 06 11:03:01.575223 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1412/2798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:01 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:01.581128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a847f136-7ffc-448b-8807-24c28c344e24 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:01.582462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a847f136-7ffc-448b-8807-24c28c344e24 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:01.621340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a847f136-7ffc-448b-8807-24c28c344e24 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:01.625243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a847f136-7ffc-448b-8807-24c28c344e24 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:01.625243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a847f136-7ffc-448b-8807-24c28c344e24 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:01.625243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a847f136-7ffc-448b-8807-24c28c344e24 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:01.625583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a847f136-7ffc-448b-8807-24c28c344e24 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:01.625996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a847f136-7ffc-448b-8807-24c28c344e24 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:01.672526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-52e040a1-a8cb-42d9-a15d-9d4b59735167 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:01.690762 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-52e040a1-a8cb-42d9-a15d-9d4b59735167 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.353051 Sep 06 11:03:01.700108 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1387/2799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:01 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:01.893674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a847f136-7ffc-448b-8807-24c28c344e24 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:01.906856 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a847f136-7ffc-448b-8807-24c28c344e24 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1317 microversion: 2.1 time: 0.330321 Sep 06 11:03:01.908552 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1413/2800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:01 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:02.349508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ba65aaee-ecf9-496a-b75d-588e7059f3e0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:02.351368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ba65aaee-ecf9-496a-b75d-588e7059f3e0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:02.364779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba65aaee-ecf9-496a-b75d-588e7059f3e0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:02.365996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba65aaee-ecf9-496a-b75d-588e7059f3e0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:02.366776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba65aaee-ecf9-496a-b75d-588e7059f3e0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:02.367774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba65aaee-ecf9-496a-b75d-588e7059f3e0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:02.368489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba65aaee-ecf9-496a-b75d-588e7059f3e0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:02.369286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba65aaee-ecf9-496a-b75d-588e7059f3e0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:02.604694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-35783c11-8477-4355-b3da-273444532bad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:02.605957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-35783c11-8477-4355-b3da-273444532bad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:02.616564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35783c11-8477-4355-b3da-273444532bad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:02.617493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35783c11-8477-4355-b3da-273444532bad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:02.618133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35783c11-8477-4355-b3da-273444532bad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:02.619492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35783c11-8477-4355-b3da-273444532bad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:02.620132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35783c11-8477-4355-b3da-273444532bad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:02.620767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35783c11-8477-4355-b3da-273444532bad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:02.749153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ba65aaee-ecf9-496a-b75d-588e7059f3e0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:02.767396 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ba65aaee-ecf9-496a-b75d-588e7059f3e0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1470 microversion: 2.1 time: 0.420821 Sep 06 11:03:02.783827 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1388/2801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:02 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1470 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:02.784038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-35783c11-8477-4355-b3da-273444532bad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:02.786363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ee1ea020-54f7-4009-8e73-9c3953873686 req-fd2529d7-7b8e-45fc-930b-f5298e40d856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0611012-ede1-4ec2-b586-e3ba1f562253", "name": "network-vif-unplugged", "status": "completed", "tag": "ecc6e385-dc5e-4440-9b3e-e389cf5f0eed"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:02.803207 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-35783c11-8477-4355-b3da-273444532bad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1275 microversion: 2.1 time: 0.189880 Sep 06 11:03:02.803207 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1414/2802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:02 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:02.803207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-77d22b51-86ff-4979-85d0-2a706c338d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:02.804070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-77d22b51-86ff-4979-85d0-2a706c338d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:02.822937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ee1ea020-54f7-4009-8e73-9c3953873686 req-fd2529d7-7b8e-45fc-930b-f5298e40d856 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:02.823992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ee1ea020-54f7-4009-8e73-9c3953873686 req-fd2529d7-7b8e-45fc-930b-f5298e40d856 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:02.824591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ee1ea020-54f7-4009-8e73-9c3953873686 req-fd2529d7-7b8e-45fc-930b-f5298e40d856 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:02.832082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77d22b51-86ff-4979-85d0-2a706c338d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:02.832820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77d22b51-86ff-4979-85d0-2a706c338d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:02.834907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77d22b51-86ff-4979-85d0-2a706c338d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:02.835805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77d22b51-86ff-4979-85d0-2a706c338d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:02.839365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77d22b51-86ff-4979-85d0-2a706c338d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:02.840078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77d22b51-86ff-4979-85d0-2a706c338d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:02.845875 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ee1ea020-54f7-4009-8e73-9c3953873686 req-fd2529d7-7b8e-45fc-930b-f5298e40d856 service nova] Creating event network-vif-unplugged:ecc6e385-dc5e-4440-9b3e-e389cf5f0eed for instance b0611012-ede1-4ec2-b586-e3ba1f562253 on nch1-master-1 Sep 06 11:03:02.865919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-ee1ea020-54f7-4009-8e73-9c3953873686 req-fd2529d7-7b8e-45fc-930b-f5298e40d856 service nova] Instance b0611012-ede1-4ec2-b586-e3ba1f562253 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:03:02.890909 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ee1ea020-54f7-4009-8e73-9c3953873686 req-fd2529d7-7b8e-45fc-930b-f5298e40d856 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118599 Sep 06 11:03:02.891582 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1389/2803] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:02.903637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:02.919318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:02.921867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:02.945692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:02.946220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:02.950722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:02.951625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:02.954339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:02.954893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:03.073041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:03.073689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:03.076966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:03.082207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:03.082207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:03.082207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:03.178218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Getting quotas for project 2a1f6f54c8d24eaa9eae09e8f30c56f1. Resources: {'ram', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:03:03.186359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Getting quotas for user 3b6e2046e3bd40b3b46802dfa796260b and project 2a1f6f54c8d24eaa9eae09e8f30c56f1. Resources: {'ram', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:03:03.259126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77d22b51-86ff-4979-85d0-2a706c338d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:03.276134 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-77d22b51-86ff-4979-85d0-2a706c338d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.475290 Sep 06 11:03:03.289016 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1415/2804] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:02 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:03.289016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3cfa4e16-e155-4bdd-8744-8e1ca684b06a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:03.289016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3cfa4e16-e155-4bdd-8744-8e1ca684b06a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:03.299656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cfa4e16-e155-4bdd-8744-8e1ca684b06a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:03.301180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cfa4e16-e155-4bdd-8744-8e1ca684b06a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:03.301180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cfa4e16-e155-4bdd-8744-8e1ca684b06a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:03.303448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cfa4e16-e155-4bdd-8744-8e1ca684b06a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:03.304188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cfa4e16-e155-4bdd-8744-8e1ca684b06a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:03.304830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cfa4e16-e155-4bdd-8744-8e1ca684b06a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:03.548240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3cfa4e16-e155-4bdd-8744-8e1ca684b06a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:03.561190 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3cfa4e16-e155-4bdd-8744-8e1ca684b06a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1317 microversion: 2.1 time: 0.279781 Sep 06 11:03:03.563784 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1416/2805] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:03 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:03.643528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-56c91e40-2d5a-4263-8b28-47232b91c608 req-de530614-336e-4d81-98e3-0393d0ea5881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c9d14e-d098-43b1-9393-7a4ce19dbf19", "tag": "5eba5ffd-b64b-4ddd-abaa-43c6486a7799"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:03.668424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-56c91e40-2d5a-4263-8b28-47232b91c608 req-de530614-336e-4d81-98e3-0393d0ea5881 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:03.670984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-56c91e40-2d5a-4263-8b28-47232b91c608 req-de530614-336e-4d81-98e3-0393d0ea5881 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:03.671797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-56c91e40-2d5a-4263-8b28-47232b91c608 req-de530614-336e-4d81-98e3-0393d0ea5881 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:03.696899 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-56c91e40-2d5a-4263-8b28-47232b91c608 req-de530614-336e-4d81-98e3-0393d0ea5881 service nova] Creating event network-changed:5eba5ffd-b64b-4ddd-abaa-43c6486a7799 for instance 48c9d14e-d098-43b1-9393-7a4ce19dbf19 on nch1-master-1 Sep 06 11:03:03.703611 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-56c91e40-2d5a-4263-8b28-47232b91c608 req-de530614-336e-4d81-98e3-0393d0ea5881 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065167 Sep 06 11:03:03.705390 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1417/2806] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:03.737516 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-095558df-ace1-4c8d-954a-07cf7e757f74 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "POST /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253/action" status: 202 len: 0 microversion: 2.1 time: 0.844306 Sep 06 11:03:03.742959 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1390/2807] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:03:02 2022] POST /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:03:03.749818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-305b88d3-85e1-496c-bf6b-1be66185bba5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:03.750587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-305b88d3-85e1-496c-bf6b-1be66185bba5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:03.762530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-305b88d3-85e1-496c-bf6b-1be66185bba5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:03.763069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-305b88d3-85e1-496c-bf6b-1be66185bba5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:03.763533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-305b88d3-85e1-496c-bf6b-1be66185bba5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:03.764269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-305b88d3-85e1-496c-bf6b-1be66185bba5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:03.764740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-305b88d3-85e1-496c-bf6b-1be66185bba5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:03.769911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-305b88d3-85e1-496c-bf6b-1be66185bba5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:03.832340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60bab4ba-1332-40ae-9ba7-2c9435f591f8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:03.832340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-60bab4ba-1332-40ae-9ba7-2c9435f591f8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:03.851723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60bab4ba-1332-40ae-9ba7-2c9435f591f8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:03.853510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60bab4ba-1332-40ae-9ba7-2c9435f591f8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:03.855980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60bab4ba-1332-40ae-9ba7-2c9435f591f8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:03.860339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60bab4ba-1332-40ae-9ba7-2c9435f591f8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:03.863688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60bab4ba-1332-40ae-9ba7-2c9435f591f8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:03.865489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60bab4ba-1332-40ae-9ba7-2c9435f591f8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:04.083947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-60bab4ba-1332-40ae-9ba7-2c9435f591f8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:04.091887 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-60bab4ba-1332-40ae-9ba7-2c9435f591f8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1273 microversion: 2.1 time: 0.270660 Sep 06 11:03:04.099535 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1391/2808] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:03 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1273 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:04.309773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-305b88d3-85e1-496c-bf6b-1be66185bba5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:04.310026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ab2455b0-388c-4c20-b84b-2b139b38601d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:04.310659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ab2455b0-388c-4c20-b84b-2b139b38601d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:04.327983 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-305b88d3-85e1-496c-bf6b-1be66185bba5 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1469 microversion: 2.1 time: 0.583804 Sep 06 11:03:04.328605 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1418/2809] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:03 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1469 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:04.335853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab2455b0-388c-4c20-b84b-2b139b38601d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:04.336770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab2455b0-388c-4c20-b84b-2b139b38601d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:04.338713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab2455b0-388c-4c20-b84b-2b139b38601d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:04.339677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab2455b0-388c-4c20-b84b-2b139b38601d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:04.344996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab2455b0-388c-4c20-b84b-2b139b38601d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:04.344996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab2455b0-388c-4c20-b84b-2b139b38601d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:04.591143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-19a3d568-f676-4b36-a73c-e35a7886f753 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:04.592107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-19a3d568-f676-4b36-a73c-e35a7886f753 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:04.614493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19a3d568-f676-4b36-a73c-e35a7886f753 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:04.615025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19a3d568-f676-4b36-a73c-e35a7886f753 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:04.615482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19a3d568-f676-4b36-a73c-e35a7886f753 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:04.617101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19a3d568-f676-4b36-a73c-e35a7886f753 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:04.617578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19a3d568-f676-4b36-a73c-e35a7886f753 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:04.618338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19a3d568-f676-4b36-a73c-e35a7886f753 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:04.843597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:05.698853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ab2455b0-388c-4c20-b84b-2b139b38601d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:05.719710 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ab2455b0-388c-4c20-b84b-2b139b38601d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 1.414025 Sep 06 11:03:05.720618 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1392/2810] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:04 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:05.726467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c54db980-5354-4f49-bfc6-f58cf38b30de tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:05.727545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c54db980-5354-4f49-bfc6-f58cf38b30de tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:05.735292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54db980-5354-4f49-bfc6-f58cf38b30de tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:05.736293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54db980-5354-4f49-bfc6-f58cf38b30de tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:05.737345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54db980-5354-4f49-bfc6-f58cf38b30de tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:05.738402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54db980-5354-4f49-bfc6-f58cf38b30de tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:05.739053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54db980-5354-4f49-bfc6-f58cf38b30de tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:05.740247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54db980-5354-4f49-bfc6-f58cf38b30de tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:05.829934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19a3d568-f676-4b36-a73c-e35a7886f753 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:05.841932 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-19a3d568-f676-4b36-a73c-e35a7886f753 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1317 microversion: 2.1 time: 1.256370 Sep 06 11:03:05.843254 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1419/2811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:04 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1317 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:05.848544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eda5a0a0-eabd-45d3-a8bb-de2ec7885f65 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:05.850723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eda5a0a0-eabd-45d3-a8bb-de2ec7885f65 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:05.859206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eda5a0a0-eabd-45d3-a8bb-de2ec7885f65 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:05.860158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eda5a0a0-eabd-45d3-a8bb-de2ec7885f65 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:05.860912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eda5a0a0-eabd-45d3-a8bb-de2ec7885f65 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:05.862209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eda5a0a0-eabd-45d3-a8bb-de2ec7885f65 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:05.863076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eda5a0a0-eabd-45d3-a8bb-de2ec7885f65 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:05.864056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eda5a0a0-eabd-45d3-a8bb-de2ec7885f65 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:06.244630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eda5a0a0-eabd-45d3-a8bb-de2ec7885f65 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:06.255954 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eda5a0a0-eabd-45d3-a8bb-de2ec7885f65 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1469 microversion: 2.1 time: 0.411252 Sep 06 11:03:06.261426 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1420/2812] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:05 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1469 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:06.297633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c54db980-5354-4f49-bfc6-f58cf38b30de tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:06.306568 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c54db980-5354-4f49-bfc6-f58cf38b30de tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1315 microversion: 2.1 time: 0.584673 Sep 06 11:03:06.308082 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1393/2813] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:05 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:06.574704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-b829db18-9a5a-442f-b5dc-babb57518950 req-2d67fa43-bada-49f2-9dfd-d0dde2e56bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0611012-ede1-4ec2-b586-e3ba1f562253", "name": "network-vif-plugged", "status": "completed", "tag": "ecc6e385-dc5e-4440-9b3e-e389cf5f0eed"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:06.594833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b829db18-9a5a-442f-b5dc-babb57518950 req-2d67fa43-bada-49f2-9dfd-d0dde2e56bda service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:06.596616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b829db18-9a5a-442f-b5dc-babb57518950 req-2d67fa43-bada-49f2-9dfd-d0dde2e56bda service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:06.597393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b829db18-9a5a-442f-b5dc-babb57518950 req-2d67fa43-bada-49f2-9dfd-d0dde2e56bda service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:06.613794 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-b829db18-9a5a-442f-b5dc-babb57518950 req-2d67fa43-bada-49f2-9dfd-d0dde2e56bda service nova] Creating event network-vif-plugged:ecc6e385-dc5e-4440-9b3e-e389cf5f0eed for instance b0611012-ede1-4ec2-b586-e3ba1f562253 on nch1-master-1 Sep 06 11:03:06.624598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-b829db18-9a5a-442f-b5dc-babb57518950 req-2d67fa43-bada-49f2-9dfd-d0dde2e56bda service nova] Instance b0611012-ede1-4ec2-b586-e3ba1f562253 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:03:06.633382 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-b829db18-9a5a-442f-b5dc-babb57518950 req-2d67fa43-bada-49f2-9dfd-d0dde2e56bda service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072596 Sep 06 11:03:06.634013 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1421/2814] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:06.749858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5fdabb31-cb55-44fd-9758-7825a0e53891 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:06.750595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5fdabb31-cb55-44fd-9758-7825a0e53891 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:06.764679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fdabb31-cb55-44fd-9758-7825a0e53891 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:06.765413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fdabb31-cb55-44fd-9758-7825a0e53891 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:06.765851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fdabb31-cb55-44fd-9758-7825a0e53891 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:06.768164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fdabb31-cb55-44fd-9758-7825a0e53891 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:06.769599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fdabb31-cb55-44fd-9758-7825a0e53891 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:06.770203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fdabb31-cb55-44fd-9758-7825a0e53891 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:06.873416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d033d0d5-699f-4825-9287-e66928c7f8ed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:06.874223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d033d0d5-699f-4825-9287-e66928c7f8ed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:06.905083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d033d0d5-699f-4825-9287-e66928c7f8ed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:06.908078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d033d0d5-699f-4825-9287-e66928c7f8ed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:06.908534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d033d0d5-699f-4825-9287-e66928c7f8ed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:06.909373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d033d0d5-699f-4825-9287-e66928c7f8ed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:06.909847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d033d0d5-699f-4825-9287-e66928c7f8ed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:06.910286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d033d0d5-699f-4825-9287-e66928c7f8ed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:07.218985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5fdabb31-cb55-44fd-9758-7825a0e53891 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:07.237077 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5fdabb31-cb55-44fd-9758-7825a0e53891 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.492938 Sep 06 11:03:07.240454 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1394/2815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:06 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:07.252916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-8d498364-77b2-4589-adc9-4aa8fec231ff req-9f93224d-4a33-4f3a-bfa8-b58711c73060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e211e2-5fa6-4ea2-b67d-34cb290caf41", "tag": "e701f7a6-96d7-46c8-87a8-bb6c5c12dac8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:07.290133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8d498364-77b2-4589-adc9-4aa8fec231ff req-9f93224d-4a33-4f3a-bfa8-b58711c73060 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:07.290640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8d498364-77b2-4589-adc9-4aa8fec231ff req-9f93224d-4a33-4f3a-bfa8-b58711c73060 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:07.294427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8d498364-77b2-4589-adc9-4aa8fec231ff req-9f93224d-4a33-4f3a-bfa8-b58711c73060 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:07.342649 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-8d498364-77b2-4589-adc9-4aa8fec231ff req-9f93224d-4a33-4f3a-bfa8-b58711c73060 service nova] Creating event network-changed:e701f7a6-96d7-46c8-87a8-bb6c5c12dac8 for instance 11e211e2-5fa6-4ea2-b67d-34cb290caf41 on nch1-master-1 Sep 06 11:03:07.369874 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-8d498364-77b2-4589-adc9-4aa8fec231ff req-9f93224d-4a33-4f3a-bfa8-b58711c73060 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114250 Sep 06 11:03:07.369874 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1395/2816] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:07.382650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cf65d1e3-99d3-4e15-8bf0-af2fda96166a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:07.382650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cf65d1e3-99d3-4e15-8bf0-af2fda96166a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:07.393055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:07.398143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf65d1e3-99d3-4e15-8bf0-af2fda96166a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:07.398650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf65d1e3-99d3-4e15-8bf0-af2fda96166a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:07.399125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf65d1e3-99d3-4e15-8bf0-af2fda96166a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:07.404866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf65d1e3-99d3-4e15-8bf0-af2fda96166a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:07.408592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf65d1e3-99d3-4e15-8bf0-af2fda96166a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:07.409083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf65d1e3-99d3-4e15-8bf0-af2fda96166a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:07.633511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d033d0d5-699f-4825-9287-e66928c7f8ed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:07.648331 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d033d0d5-699f-4825-9287-e66928c7f8ed tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1317 microversion: 2.1 time: 0.780692 Sep 06 11:03:07.652174 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1422/2817] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:06 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1317 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:07.657146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-545b98ae-5024-4470-849d-58a641b8be48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:07.658023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-545b98ae-5024-4470-849d-58a641b8be48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:07.664891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-545b98ae-5024-4470-849d-58a641b8be48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:07.665557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-545b98ae-5024-4470-849d-58a641b8be48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:07.666279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-545b98ae-5024-4470-849d-58a641b8be48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:07.667187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-545b98ae-5024-4470-849d-58a641b8be48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:07.667804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-545b98ae-5024-4470-849d-58a641b8be48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:07.671102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-545b98ae-5024-4470-849d-58a641b8be48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:08.052516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cf65d1e3-99d3-4e15-8bf0-af2fda96166a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:08.059879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-545b98ae-5024-4470-849d-58a641b8be48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:08.060585 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cf65d1e3-99d3-4e15-8bf0-af2fda96166a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1469 microversion: 2.1 time: 0.697094 Sep 06 11:03:08.061414 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1396/2818] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:07 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1469 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:08.082094 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-545b98ae-5024-4470-849d-58a641b8be48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1315 microversion: 2.1 time: 0.428065 Sep 06 11:03:08.083713 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1423/2819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:07 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:08.268445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-79f17896-4c56-4e32-8d10-6180a984a44c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:08.269088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-79f17896-4c56-4e32-8d10-6180a984a44c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:08.278292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79f17896-4c56-4e32-8d10-6180a984a44c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:08.278815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79f17896-4c56-4e32-8d10-6180a984a44c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:08.279296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79f17896-4c56-4e32-8d10-6180a984a44c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:08.281796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79f17896-4c56-4e32-8d10-6180a984a44c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:08.282281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79f17896-4c56-4e32-8d10-6180a984a44c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:08.282727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79f17896-4c56-4e32-8d10-6180a984a44c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:08.468860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-79f17896-4c56-4e32-8d10-6180a984a44c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:08.476281 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-79f17896-4c56-4e32-8d10-6180a984a44c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.211800 Sep 06 11:03:08.476851 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1397/2820] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:08 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:08.675961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-31db23fe-0e07-45a6-b77b-f61a906be887 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:08.678698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-31db23fe-0e07-45a6-b77b-f61a906be887 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:08.683518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31db23fe-0e07-45a6-b77b-f61a906be887 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:08.684221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31db23fe-0e07-45a6-b77b-f61a906be887 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:08.685085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31db23fe-0e07-45a6-b77b-f61a906be887 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:08.685684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31db23fe-0e07-45a6-b77b-f61a906be887 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:08.686205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31db23fe-0e07-45a6-b77b-f61a906be887 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:08.686574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31db23fe-0e07-45a6-b77b-f61a906be887 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:08.839494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-31db23fe-0e07-45a6-b77b-f61a906be887 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:08.847271 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-31db23fe-0e07-45a6-b77b-f61a906be887 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1317 microversion: 2.1 time: 0.175828 Sep 06 11:03:08.852661 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1424/2821] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:08 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:09.086697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b2b0ac13-584a-4225-8632-dc4b21ce4ee3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:09.087251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b2b0ac13-584a-4225-8632-dc4b21ce4ee3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:09.096282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2b0ac13-584a-4225-8632-dc4b21ce4ee3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:09.097472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2b0ac13-584a-4225-8632-dc4b21ce4ee3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:09.098136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2b0ac13-584a-4225-8632-dc4b21ce4ee3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:09.099808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2b0ac13-584a-4225-8632-dc4b21ce4ee3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:09.102106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2b0ac13-584a-4225-8632-dc4b21ce4ee3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:09.103539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2b0ac13-584a-4225-8632-dc4b21ce4ee3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:09.112328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dd99308a-ba14-4801-8ae0-942d4bc5a511 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:09.114337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dd99308a-ba14-4801-8ae0-942d4bc5a511 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:09.137986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=14 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:09.139553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd99308a-ba14-4801-8ae0-942d4bc5a511 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:09.140062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd99308a-ba14-4801-8ae0-942d4bc5a511 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:09.149716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd99308a-ba14-4801-8ae0-942d4bc5a511 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:09.150968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd99308a-ba14-4801-8ae0-942d4bc5a511 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:09.151536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd99308a-ba14-4801-8ae0-942d4bc5a511 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:09.152869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd99308a-ba14-4801-8ae0-942d4bc5a511 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:09.405044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b2b0ac13-584a-4225-8632-dc4b21ce4ee3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:09.413850 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b2b0ac13-584a-4225-8632-dc4b21ce4ee3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1469 microversion: 2.1 time: 0.331694 Sep 06 11:03:09.414438 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1398/2822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:09 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1469 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:09.436625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dd99308a-ba14-4801-8ae0-942d4bc5a511 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:09.445471 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dd99308a-ba14-4801-8ae0-942d4bc5a511 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1315 microversion: 2.1 time: 0.342542 Sep 06 11:03:09.446352 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1425/2823] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:09 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:09.501997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-910492f5-6232-4453-b037-44e8d0b42851 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:09.502631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-910492f5-6232-4453-b037-44e8d0b42851 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:09.514743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-910492f5-6232-4453-b037-44e8d0b42851 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:09.515598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-910492f5-6232-4453-b037-44e8d0b42851 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:09.516214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-910492f5-6232-4453-b037-44e8d0b42851 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:09.517109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-910492f5-6232-4453-b037-44e8d0b42851 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:09.517735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-910492f5-6232-4453-b037-44e8d0b42851 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:09.518562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-910492f5-6232-4453-b037-44e8d0b42851 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:09.685046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-910492f5-6232-4453-b037-44e8d0b42851 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:09.694914 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-910492f5-6232-4453-b037-44e8d0b42851 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.197211 Sep 06 11:03:09.696153 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1399/2824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:09 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:09.873463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3aae983e-a4cb-47ce-a8a3-9888301a17c0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:09.874216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3aae983e-a4cb-47ce-a8a3-9888301a17c0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:09.882912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3aae983e-a4cb-47ce-a8a3-9888301a17c0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:09.883851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3aae983e-a4cb-47ce-a8a3-9888301a17c0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:09.888122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3aae983e-a4cb-47ce-a8a3-9888301a17c0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:09.889100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3aae983e-a4cb-47ce-a8a3-9888301a17c0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:09.889460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3aae983e-a4cb-47ce-a8a3-9888301a17c0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:09.891573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3aae983e-a4cb-47ce-a8a3-9888301a17c0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:10.046750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3aae983e-a4cb-47ce-a8a3-9888301a17c0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:10.059794 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3aae983e-a4cb-47ce-a8a3-9888301a17c0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1317 microversion: 2.1 time: 0.190354 Sep 06 11:03:10.063100 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1426/2825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:09 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:10.443168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-220d7016-ec0f-4097-bf18-7a40d3f2de8c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:10.443792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-220d7016-ec0f-4097-bf18-7a40d3f2de8c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:10.456456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-220d7016-ec0f-4097-bf18-7a40d3f2de8c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:10.456956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-220d7016-ec0f-4097-bf18-7a40d3f2de8c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:10.457396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-220d7016-ec0f-4097-bf18-7a40d3f2de8c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:10.459958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-220d7016-ec0f-4097-bf18-7a40d3f2de8c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:10.460664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-220d7016-ec0f-4097-bf18-7a40d3f2de8c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:10.462942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-220d7016-ec0f-4097-bf18-7a40d3f2de8c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:10.469821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-daa10a93-e1df-4889-a708-557184be732a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:10.470557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-daa10a93-e1df-4889-a708-557184be732a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:10.478553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:10.481808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daa10a93-e1df-4889-a708-557184be732a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:10.486932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daa10a93-e1df-4889-a708-557184be732a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:10.487571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daa10a93-e1df-4889-a708-557184be732a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:10.488342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daa10a93-e1df-4889-a708-557184be732a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:10.489441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daa10a93-e1df-4889-a708-557184be732a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:10.490203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daa10a93-e1df-4889-a708-557184be732a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:10.759979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-daa10a93-e1df-4889-a708-557184be732a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:10.770178 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-daa10a93-e1df-4889-a708-557184be732a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1315 microversion: 2.1 time: 0.304318 Sep 06 11:03:10.771028 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1427/2826] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:10 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:10.772852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-220d7016-ec0f-4097-bf18-7a40d3f2de8c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:10.777563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-04ad8c0d-cf3d-4ec2-afb8-4105cee69e2a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:10.778202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-04ad8c0d-cf3d-4ec2-afb8-4105cee69e2a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:10.783528 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-220d7016-ec0f-4097-bf18-7a40d3f2de8c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1469 microversion: 2.1 time: 0.344610 Sep 06 11:03:10.783528 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1400/2827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:10 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1469 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:10.799103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04ad8c0d-cf3d-4ec2-afb8-4105cee69e2a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:10.800245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04ad8c0d-cf3d-4ec2-afb8-4105cee69e2a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:10.800702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04ad8c0d-cf3d-4ec2-afb8-4105cee69e2a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:10.803840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04ad8c0d-cf3d-4ec2-afb8-4105cee69e2a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:10.804361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04ad8c0d-cf3d-4ec2-afb8-4105cee69e2a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:10.804815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04ad8c0d-cf3d-4ec2-afb8-4105cee69e2a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:10.989530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-04ad8c0d-cf3d-4ec2-afb8-4105cee69e2a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:10.997445 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-04ad8c0d-cf3d-4ec2-afb8-4105cee69e2a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.225170 Sep 06 11:03:10.998021 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1428/2828] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:10 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:11.084554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ed4abb5-8a54-4bdf-b27f-3b5abc604732 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:11.085177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ed4abb5-8a54-4bdf-b27f-3b5abc604732 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:11.091373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ed4abb5-8a54-4bdf-b27f-3b5abc604732 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:11.091875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ed4abb5-8a54-4bdf-b27f-3b5abc604732 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:11.092372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ed4abb5-8a54-4bdf-b27f-3b5abc604732 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:11.093071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ed4abb5-8a54-4bdf-b27f-3b5abc604732 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:11.093541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ed4abb5-8a54-4bdf-b27f-3b5abc604732 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:11.093979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ed4abb5-8a54-4bdf-b27f-3b5abc604732 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:11.096629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:11.283163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ed4abb5-8a54-4bdf-b27f-3b5abc604732 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:11.292452 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ed4abb5-8a54-4bdf-b27f-3b5abc604732 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1317 microversion: 2.1 time: 0.212298 Sep 06 11:03:11.293262 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1401/2829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:11 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:11.795523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4dc77bb0-9182-44dc-8e12-0d6d633cef8a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:11.796819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4dc77bb0-9182-44dc-8e12-0d6d633cef8a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:11.812156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4dc77bb0-9182-44dc-8e12-0d6d633cef8a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:11.818066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4dc77bb0-9182-44dc-8e12-0d6d633cef8a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:11.818066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4dc77bb0-9182-44dc-8e12-0d6d633cef8a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:11.818956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5705584f-2637-49d9-a7a5-312655ba7f54 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:11.818956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5705584f-2637-49d9-a7a5-312655ba7f54 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:11.819598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4dc77bb0-9182-44dc-8e12-0d6d633cef8a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:11.819598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4dc77bb0-9182-44dc-8e12-0d6d633cef8a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:11.819598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4dc77bb0-9182-44dc-8e12-0d6d633cef8a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:11.842823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5705584f-2637-49d9-a7a5-312655ba7f54 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:11.843960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5705584f-2637-49d9-a7a5-312655ba7f54 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:11.845765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5705584f-2637-49d9-a7a5-312655ba7f54 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:11.846777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5705584f-2637-49d9-a7a5-312655ba7f54 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:11.848711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5705584f-2637-49d9-a7a5-312655ba7f54 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:11.849316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5705584f-2637-49d9-a7a5-312655ba7f54 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:12.082357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4dc77bb0-9182-44dc-8e12-0d6d633cef8a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:12.091197 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4dc77bb0-9182-44dc-8e12-0d6d633cef8a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1315 microversion: 2.1 time: 0.300804 Sep 06 11:03:12.091898 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1429/2830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:11 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:12.096975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-257cae10-ae86-466c-a3f2-0a75ebd377ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:12.097628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-257cae10-ae86-466c-a3f2-0a75ebd377ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:12.106281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-257cae10-ae86-466c-a3f2-0a75ebd377ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:12.106958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-257cae10-ae86-466c-a3f2-0a75ebd377ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:12.107505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-257cae10-ae86-466c-a3f2-0a75ebd377ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:12.108231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-257cae10-ae86-466c-a3f2-0a75ebd377ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:12.108774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-257cae10-ae86-466c-a3f2-0a75ebd377ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:12.109429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-257cae10-ae86-466c-a3f2-0a75ebd377ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:12.114733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5705584f-2637-49d9-a7a5-312655ba7f54 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:12.123129 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5705584f-2637-49d9-a7a5-312655ba7f54 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1535 microversion: 2.1 time: 0.314175 Sep 06 11:03:12.123716 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1402/2831] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:11 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1535 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:12.290860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-257cae10-ae86-466c-a3f2-0a75ebd377ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:12.300772 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-257cae10-ae86-466c-a3f2-0a75ebd377ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.207040 Sep 06 11:03:12.315659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-82e99102-91f2-443e-8279-2903c5507b8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:12.316514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-82e99102-91f2-443e-8279-2903c5507b8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:12.317495 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1430/2832] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:12 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:12.325878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82e99102-91f2-443e-8279-2903c5507b8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:12.329206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82e99102-91f2-443e-8279-2903c5507b8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:12.329849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82e99102-91f2-443e-8279-2903c5507b8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:12.332702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82e99102-91f2-443e-8279-2903c5507b8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:12.332702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82e99102-91f2-443e-8279-2903c5507b8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:12.332702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82e99102-91f2-443e-8279-2903c5507b8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:12.521181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-82e99102-91f2-443e-8279-2903c5507b8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:12.531066 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-82e99102-91f2-443e-8279-2903c5507b8b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1317 microversion: 2.1 time: 0.219227 Sep 06 11:03:12.532212 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1403/2833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:12 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:12.606385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-1104f18b-0174-4683-acf7-1d4459575301 req-c80eb6db-49b9-4f95-a11a-ca9e27f44c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c9d14e-d098-43b1-9393-7a4ce19dbf19", "name": "network-vif-plugged", "status": "completed", "tag": "5eba5ffd-b64b-4ddd-abaa-43c6486a7799"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:12.619790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1104f18b-0174-4683-acf7-1d4459575301 req-c80eb6db-49b9-4f95-a11a-ca9e27f44c8e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:12.620284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1104f18b-0174-4683-acf7-1d4459575301 req-c80eb6db-49b9-4f95-a11a-ca9e27f44c8e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:12.620728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1104f18b-0174-4683-acf7-1d4459575301 req-c80eb6db-49b9-4f95-a11a-ca9e27f44c8e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:12.632862 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-1104f18b-0174-4683-acf7-1d4459575301 req-c80eb6db-49b9-4f95-a11a-ca9e27f44c8e service nova] Creating event network-vif-plugged:5eba5ffd-b64b-4ddd-abaa-43c6486a7799 for instance 48c9d14e-d098-43b1-9393-7a4ce19dbf19 on nch1-master-1 Sep 06 11:03:12.643407 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-1104f18b-0174-4683-acf7-1d4459575301 req-c80eb6db-49b9-4f95-a11a-ca9e27f44c8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041795 Sep 06 11:03:12.644309 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1431/2834] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:03:13.117224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6c268226-98b1-4b83-976b-8ffc8824b859 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:13.117789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6c268226-98b1-4b83-976b-8ffc8824b859 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:13.124407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=5 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:13.138951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c268226-98b1-4b83-976b-8ffc8824b859 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:13.150407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-634f2ae5-66e7-4db3-8807-fe95e73260a4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:13.151451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-634f2ae5-66e7-4db3-8807-fe95e73260a4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:13.155422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c268226-98b1-4b83-976b-8ffc8824b859 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:13.156899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c268226-98b1-4b83-976b-8ffc8824b859 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:13.157952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c268226-98b1-4b83-976b-8ffc8824b859 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:13.158377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c268226-98b1-4b83-976b-8ffc8824b859 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:13.161462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c268226-98b1-4b83-976b-8ffc8824b859 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:13.168369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-634f2ae5-66e7-4db3-8807-fe95e73260a4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:13.170186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-634f2ae5-66e7-4db3-8807-fe95e73260a4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:13.170657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-634f2ae5-66e7-4db3-8807-fe95e73260a4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:13.171431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-634f2ae5-66e7-4db3-8807-fe95e73260a4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:13.171908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-634f2ae5-66e7-4db3-8807-fe95e73260a4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:13.172769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-634f2ae5-66e7-4db3-8807-fe95e73260a4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:13.381154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6c268226-98b1-4b83-976b-8ffc8824b859 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:13.384550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-634f2ae5-66e7-4db3-8807-fe95e73260a4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:13.389566 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6c268226-98b1-4b83-976b-8ffc8824b859 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1315 microversion: 2.1 time: 0.277638 Sep 06 11:03:13.392632 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-634f2ae5-66e7-4db3-8807-fe95e73260a4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1535 microversion: 2.1 time: 0.249578 Sep 06 11:03:13.403394 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1432/2835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:13 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1535 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:13.403902 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1404/2836] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:13 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:13.407621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c094f9a0-86ce-41b8-a5be-fafbfc11b87a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:13.408245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c094f9a0-86ce-41b8-a5be-fafbfc11b87a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:13.414358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c094f9a0-86ce-41b8-a5be-fafbfc11b87a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:13.414855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c094f9a0-86ce-41b8-a5be-fafbfc11b87a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:13.415329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c094f9a0-86ce-41b8-a5be-fafbfc11b87a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:13.416033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c094f9a0-86ce-41b8-a5be-fafbfc11b87a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:13.416501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c094f9a0-86ce-41b8-a5be-fafbfc11b87a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:13.416936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c094f9a0-86ce-41b8-a5be-fafbfc11b87a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:13.554932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-30e608d3-d666-4d4b-80d6-0bdb41d298b0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:13.555861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-30e608d3-d666-4d4b-80d6-0bdb41d298b0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:13.556012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c094f9a0-86ce-41b8-a5be-fafbfc11b87a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:13.559239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:13.560368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:13.563578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30e608d3-d666-4d4b-80d6-0bdb41d298b0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:13.564215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30e608d3-d666-4d4b-80d6-0bdb41d298b0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:13.564680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30e608d3-d666-4d4b-80d6-0bdb41d298b0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:13.565055 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c094f9a0-86ce-41b8-a5be-fafbfc11b87a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.170390 Sep 06 11:03:13.565386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30e608d3-d666-4d4b-80d6-0bdb41d298b0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:13.565629 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1433/2837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:13 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:13.565856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30e608d3-d666-4d4b-80d6-0bdb41d298b0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:13.566291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30e608d3-d666-4d4b-80d6-0bdb41d298b0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:13.707547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-30e608d3-d666-4d4b-80d6-0bdb41d298b0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:13.716336 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-30e608d3-d666-4d4b-80d6-0bdb41d298b0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1317 microversion: 2.1 time: 0.166305 Sep 06 11:03:13.716918 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1405/2838] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:13 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:14.432354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-340fcb9b-7e32-454d-b3f4-096fa31aa6dd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:14.434526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-340fcb9b-7e32-454d-b3f4-096fa31aa6dd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:14.434697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-910eab94-7648-41e2-ad51-5b7a0254159e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:14.437856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-910eab94-7648-41e2-ad51-5b7a0254159e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:14.455842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-910eab94-7648-41e2-ad51-5b7a0254159e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:14.458029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-340fcb9b-7e32-454d-b3f4-096fa31aa6dd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:14.458534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-340fcb9b-7e32-454d-b3f4-096fa31aa6dd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:14.458993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-340fcb9b-7e32-454d-b3f4-096fa31aa6dd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:14.459757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-340fcb9b-7e32-454d-b3f4-096fa31aa6dd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:14.460275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-340fcb9b-7e32-454d-b3f4-096fa31aa6dd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:14.460720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-340fcb9b-7e32-454d-b3f4-096fa31aa6dd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:14.465508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-910eab94-7648-41e2-ad51-5b7a0254159e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:14.465974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-910eab94-7648-41e2-ad51-5b7a0254159e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:14.466726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-910eab94-7648-41e2-ad51-5b7a0254159e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:14.467235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-910eab94-7648-41e2-ad51-5b7a0254159e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:14.467721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-910eab94-7648-41e2-ad51-5b7a0254159e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:14.667620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-340fcb9b-7e32-454d-b3f4-096fa31aa6dd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:14.670647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-910eab94-7648-41e2-ad51-5b7a0254159e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:14.675614 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-340fcb9b-7e32-454d-b3f4-096fa31aa6dd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1315 microversion: 2.1 time: 0.265160 Sep 06 11:03:14.676260 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1434/2839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:14 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:14.681300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-12ccd437-658f-4906-8832-ef5c126cd00a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:14.681905 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-910eab94-7648-41e2-ad51-5b7a0254159e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1535 microversion: 2.1 time: 0.267463 Sep 06 11:03:14.682098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-12ccd437-658f-4906-8832-ef5c126cd00a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:14.682683 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1406/2840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:14 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1535 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:14.688081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12ccd437-658f-4906-8832-ef5c126cd00a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:14.691330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12ccd437-658f-4906-8832-ef5c126cd00a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:14.691330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12ccd437-658f-4906-8832-ef5c126cd00a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:14.691330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12ccd437-658f-4906-8832-ef5c126cd00a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:14.691330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12ccd437-658f-4906-8832-ef5c126cd00a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:14.691330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12ccd437-658f-4906-8832-ef5c126cd00a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:14.699688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6c3c8eea-7914-41c8-8eb6-80a5ca8f47bf req-83ac22af-9857-4c72-af27-d2c4f47bbb2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0611012-ede1-4ec2-b586-e3ba1f562253", "name": "network-vif-unplugged", "status": "completed", "tag": "ecc6e385-dc5e-4440-9b3e-e389cf5f0eed"}, {"server_uuid": "11e211e2-5fa6-4ea2-b67d-34cb290caf41", "name": "network-vif-plugged", "status": "completed", "tag": "e701f7a6-96d7-46c8-87a8-bb6c5c12dac8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:14.710683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6c3c8eea-7914-41c8-8eb6-80a5ca8f47bf req-83ac22af-9857-4c72-af27-d2c4f47bbb2d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:14.711267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6c3c8eea-7914-41c8-8eb6-80a5ca8f47bf req-83ac22af-9857-4c72-af27-d2c4f47bbb2d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:14.715538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6c3c8eea-7914-41c8-8eb6-80a5ca8f47bf req-83ac22af-9857-4c72-af27-d2c4f47bbb2d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:14.726806 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6c3c8eea-7914-41c8-8eb6-80a5ca8f47bf req-83ac22af-9857-4c72-af27-d2c4f47bbb2d service nova] Creating event network-vif-unplugged:ecc6e385-dc5e-4440-9b3e-e389cf5f0eed for instance b0611012-ede1-4ec2-b586-e3ba1f562253 on nch1-master-1 Sep 06 11:03:14.727366 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6c3c8eea-7914-41c8-8eb6-80a5ca8f47bf req-83ac22af-9857-4c72-af27-d2c4f47bbb2d service nova] Creating event network-vif-plugged:e701f7a6-96d7-46c8-87a8-bb6c5c12dac8 for instance 11e211e2-5fa6-4ea2-b67d-34cb290caf41 on nch1-master-1 Sep 06 11:03:14.738098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-6c3c8eea-7914-41c8-8eb6-80a5ca8f47bf req-83ac22af-9857-4c72-af27-d2c4f47bbb2d service nova] Instance b0611012-ede1-4ec2-b586-e3ba1f562253 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:03:14.748801 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6c3c8eea-7914-41c8-8eb6-80a5ca8f47bf req-83ac22af-9857-4c72-af27-d2c4f47bbb2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.055315 Sep 06 11:03:14.749983 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1407/2841] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:14.760828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-68e885f6-7f10-49d8-a606-2903d78170c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:14.762104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-68e885f6-7f10-49d8-a606-2903d78170c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:14.771375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e885f6-7f10-49d8-a606-2903d78170c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:14.771915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e885f6-7f10-49d8-a606-2903d78170c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:14.772515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e885f6-7f10-49d8-a606-2903d78170c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:14.773233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e885f6-7f10-49d8-a606-2903d78170c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:14.773705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e885f6-7f10-49d8-a606-2903d78170c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:14.774145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e885f6-7f10-49d8-a606-2903d78170c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:14.863882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-12ccd437-658f-4906-8832-ef5c126cd00a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:14.873130 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-12ccd437-658f-4906-8832-ef5c126cd00a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.195244 Sep 06 11:03:14.874193 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1435/2842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:14 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:14.943842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-68e885f6-7f10-49d8-a606-2903d78170c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:14.952526 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-68e885f6-7f10-49d8-a606-2903d78170c8 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1317 microversion: 2.1 time: 0.200829 Sep 06 11:03:14.953131 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1408/2843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:14 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:15.700544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4553f8b8-5b9e-44cf-a8ae-f718d7d4ce54 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:15.701598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4553f8b8-5b9e-44cf-a8ae-f718d7d4ce54 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:15.709872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-83aef01a-ce19-4ec5-853b-614aa707f4c8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:15.710501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-83aef01a-ce19-4ec5-853b-614aa707f4c8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:15.715443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4553f8b8-5b9e-44cf-a8ae-f718d7d4ce54 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:15.715443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4553f8b8-5b9e-44cf-a8ae-f718d7d4ce54 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:15.715443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4553f8b8-5b9e-44cf-a8ae-f718d7d4ce54 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:15.715443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4553f8b8-5b9e-44cf-a8ae-f718d7d4ce54 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:15.715443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4553f8b8-5b9e-44cf-a8ae-f718d7d4ce54 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:15.715443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4553f8b8-5b9e-44cf-a8ae-f718d7d4ce54 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:15.722330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83aef01a-ce19-4ec5-853b-614aa707f4c8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:15.722835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83aef01a-ce19-4ec5-853b-614aa707f4c8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:15.723333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83aef01a-ce19-4ec5-853b-614aa707f4c8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:15.724209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83aef01a-ce19-4ec5-853b-614aa707f4c8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:15.724682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83aef01a-ce19-4ec5-853b-614aa707f4c8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:15.725193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83aef01a-ce19-4ec5-853b-614aa707f4c8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:15.923365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4553f8b8-5b9e-44cf-a8ae-f718d7d4ce54 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:15.928275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-83aef01a-ce19-4ec5-853b-614aa707f4c8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:15.934891 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4553f8b8-5b9e-44cf-a8ae-f718d7d4ce54 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1315 microversion: 2.1 time: 0.238745 Sep 06 11:03:15.936005 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1436/2844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:15 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:15.938797 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-83aef01a-ce19-4ec5-853b-614aa707f4c8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1535 microversion: 2.1 time: 0.231395 Sep 06 11:03:15.938797 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1409/2845] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:15 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1535 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:15.941332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-888c6b26-59a9-454a-ac1f-db0a352bbd12 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:15.941980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-888c6b26-59a9-454a-ac1f-db0a352bbd12 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:15.949234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-888c6b26-59a9-454a-ac1f-db0a352bbd12 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:15.949234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-888c6b26-59a9-454a-ac1f-db0a352bbd12 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:15.949728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-888c6b26-59a9-454a-ac1f-db0a352bbd12 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:15.956972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-888c6b26-59a9-454a-ac1f-db0a352bbd12 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:15.956972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-888c6b26-59a9-454a-ac1f-db0a352bbd12 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:15.956972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-888c6b26-59a9-454a-ac1f-db0a352bbd12 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:15.976789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3ef8c98b-36ad-44d2-9e73-ea0364264ceb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:15.977370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3ef8c98b-36ad-44d2-9e73-ea0364264ceb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:15.983362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ef8c98b-36ad-44d2-9e73-ea0364264ceb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:15.990450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ef8c98b-36ad-44d2-9e73-ea0364264ceb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:15.990450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ef8c98b-36ad-44d2-9e73-ea0364264ceb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:15.990450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ef8c98b-36ad-44d2-9e73-ea0364264ceb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:15.990450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ef8c98b-36ad-44d2-9e73-ea0364264ceb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:15.990450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ef8c98b-36ad-44d2-9e73-ea0364264ceb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:16.185161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-888c6b26-59a9-454a-ac1f-db0a352bbd12 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:16.194329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3ef8c98b-36ad-44d2-9e73-ea0364264ceb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:16.202707 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3ef8c98b-36ad-44d2-9e73-ea0364264ceb tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1467 microversion: 2.1 time: 0.231041 Sep 06 11:03:16.203263 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-888c6b26-59a9-454a-ac1f-db0a352bbd12 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.265966 Sep 06 11:03:16.203731 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1410/2846] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:15 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1467 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:16.215431 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1437/2847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:15 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:16.231674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d40bf53b-167b-44ef-8ddb-0e56d7dffc50 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:16.233316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d40bf53b-167b-44ef-8ddb-0e56d7dffc50 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:16.241869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d40bf53b-167b-44ef-8ddb-0e56d7dffc50 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:16.251242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d40bf53b-167b-44ef-8ddb-0e56d7dffc50 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:16.251890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d40bf53b-167b-44ef-8ddb-0e56d7dffc50 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:16.253146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d40bf53b-167b-44ef-8ddb-0e56d7dffc50 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:16.254237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d40bf53b-167b-44ef-8ddb-0e56d7dffc50 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:16.255173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d40bf53b-167b-44ef-8ddb-0e56d7dffc50 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:16.412885 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d40bf53b-167b-44ef-8ddb-0e56d7dffc50 tempest-ServersOnMultiNodesTest-182749890 tempest-ServersOnMultiNodesTest-182749890-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1618 microversion: 2.1 time: 0.187000 Sep 06 11:03:16.413817 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1411/2848] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:16 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1618 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:16.438620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a302d846-039b-4ce9-a257-f698e52e447f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:16.439171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a302d846-039b-4ce9-a257-f698e52e447f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:16.445454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a302d846-039b-4ce9-a257-f698e52e447f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:16.446487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a302d846-039b-4ce9-a257-f698e52e447f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:16.447179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a302d846-039b-4ce9-a257-f698e52e447f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:16.448703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a302d846-039b-4ce9-a257-f698e52e447f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:16.449337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a302d846-039b-4ce9-a257-f698e52e447f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:16.449787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a302d846-039b-4ce9-a257-f698e52e447f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:16.487197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a302d846-039b-4ce9-a257-f698e52e447f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:03:16.774595 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a302d846-039b-4ce9-a257-f698e52e447f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "DELETE /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 204 len: 0 microversion: 2.1 time: 0.339661 Sep 06 11:03:16.775534 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1438/2849] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:03:16 2022] DELETE /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:03:16.783842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a2b0c25d-332b-40d4-980d-77ee0d6d5e8f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:16.784454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a2b0c25d-332b-40d4-980d-77ee0d6d5e8f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:16.791284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2b0c25d-332b-40d4-980d-77ee0d6d5e8f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:16.791771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2b0c25d-332b-40d4-980d-77ee0d6d5e8f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:16.792212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2b0c25d-332b-40d4-980d-77ee0d6d5e8f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:16.792900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2b0c25d-332b-40d4-980d-77ee0d6d5e8f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:16.793364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2b0c25d-332b-40d4-980d-77ee0d6d5e8f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:16.793794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2b0c25d-332b-40d4-980d-77ee0d6d5e8f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:16.939386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a2b0c25d-332b-40d4-980d-77ee0d6d5e8f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:16.948270 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a2b0c25d-332b-40d4-980d-77ee0d6d5e8f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1473 microversion: 2.1 time: 0.168688 Sep 06 11:03:16.948882 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1412/2850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:16 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1473 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:16.965594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3389c2d8-7853-4ce2-92a2-cc0513672678 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:16.966536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3389c2d8-7853-4ce2-92a2-cc0513672678 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:16.968536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-49a73172-9e2f-4895-a8c7-a28f01aa534d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:16.969582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-49a73172-9e2f-4895-a8c7-a28f01aa534d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:16.972647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3389c2d8-7853-4ce2-92a2-cc0513672678 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:16.973378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3389c2d8-7853-4ce2-92a2-cc0513672678 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:16.973890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3389c2d8-7853-4ce2-92a2-cc0513672678 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:16.974760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3389c2d8-7853-4ce2-92a2-cc0513672678 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:16.975428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3389c2d8-7853-4ce2-92a2-cc0513672678 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:16.976052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3389c2d8-7853-4ce2-92a2-cc0513672678 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:16.976180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49a73172-9e2f-4895-a8c7-a28f01aa534d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:16.976552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49a73172-9e2f-4895-a8c7-a28f01aa534d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:16.977179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49a73172-9e2f-4895-a8c7-a28f01aa534d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:16.978657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49a73172-9e2f-4895-a8c7-a28f01aa534d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:16.979371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49a73172-9e2f-4895-a8c7-a28f01aa534d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:16.980155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49a73172-9e2f-4895-a8c7-a28f01aa534d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:17.175507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3389c2d8-7853-4ce2-92a2-cc0513672678 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:17.183466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-49a73172-9e2f-4895-a8c7-a28f01aa534d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:17.185737 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3389c2d8-7853-4ce2-92a2-cc0513672678 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1502 microversion: 2.1 time: 0.225975 Sep 06 11:03:17.186323 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1439/2851] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:16 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:17.194482 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-49a73172-9e2f-4895-a8c7-a28f01aa534d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1528 microversion: 2.1 time: 0.231682 Sep 06 11:03:17.195751 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1413/2852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:16 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1528 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:17.212793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9525b593-38d6-4cdd-a0ee-89c906513548 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:17.217951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bc492ea6-daf7-48ef-934d-f4dd65aee68c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:17.218769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bc492ea6-daf7-48ef-934d-f4dd65aee68c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:17.219140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9525b593-38d6-4cdd-a0ee-89c906513548 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:17.219845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9525b593-38d6-4cdd-a0ee-89c906513548 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:17.220499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9525b593-38d6-4cdd-a0ee-89c906513548 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:17.226681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc492ea6-daf7-48ef-934d-f4dd65aee68c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:17.227210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc492ea6-daf7-48ef-934d-f4dd65aee68c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:17.227768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc492ea6-daf7-48ef-934d-f4dd65aee68c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:17.228684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc492ea6-daf7-48ef-934d-f4dd65aee68c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:17.229355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc492ea6-daf7-48ef-934d-f4dd65aee68c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:17.230011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc492ea6-daf7-48ef-934d-f4dd65aee68c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:17.245762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9525b593-38d6-4cdd-a0ee-89c906513548 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Going to try to stop instance {{(pid=140876) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 11:03:17.367844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bc492ea6-daf7-48ef-934d-f4dd65aee68c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:17.375650 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bc492ea6-daf7-48ef-934d-f4dd65aee68c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1528 microversion: 2.1 time: 0.161684 Sep 06 11:03:17.376245 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1414/2853] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:17 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1528 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:17.381275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dab8807e-9a9f-4fda-ad5b-b1c571688acc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:17.381884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dab8807e-9a9f-4fda-ad5b-b1c571688acc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:17.394333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dab8807e-9a9f-4fda-ad5b-b1c571688acc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:17.394860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dab8807e-9a9f-4fda-ad5b-b1c571688acc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:17.395324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dab8807e-9a9f-4fda-ad5b-b1c571688acc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:17.396076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dab8807e-9a9f-4fda-ad5b-b1c571688acc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:17.396690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dab8807e-9a9f-4fda-ad5b-b1c571688acc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:17.397133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dab8807e-9a9f-4fda-ad5b-b1c571688acc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:17.486448 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9525b593-38d6-4cdd-a0ee-89c906513548 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41/action" status: 202 len: 0 microversion: 2.1 time: 0.277490 Sep 06 11:03:17.487804 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1440/2854] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:03:17 2022] POST /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:03:17.492771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-41c40095-66f5-4f85-bcbf-eb58b5d2743c tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:17.499250 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-41c40095-66f5-4f85-bcbf-eb58b5d2743c tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] HTTP exception thrown: Flavor 800d86de-8e09-4250-8d82-b77317d821e3 could not be found. Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-41c40095-66f5-4f85-bcbf-eb58b5d2743c tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Request method failure captured: Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/flavors/800d86de-8e09-4250-8d82-b77317d821e3 HTTP/1.1 Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFygiB3HtbxznE8sxeQHF6VC1MHWSKTlTGbzK7ZCK922YY1Ov9sRXf6vqeuY3EIr_kHLnqwJHDoQg3wmjnzrUqz6RpAkeZkyty62u93LdRsROYYpK--_UHyf3N-7VV7DIx9t6w4IO5Rer__VualgRXlvqs8InemtbLjfyXw39p7SXRfQ Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e2d99cfecc7d499ea8a478b100e9b061 Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-MigrationsAdminTest-1547213554 Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e2d99cfecc7d499ea8a478b100e9b061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2d99cfecc7d499ea8a478b100e9b061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e2d99cfecc7d499ea8a478b100e9b061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2d99cfecc7d499ea8a478b100e9b061"}]}] Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-MigrationsAdminTest-1547213554 Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e2d99cfecc7d499ea8a478b100e9b061 Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-MigrationsAdminTest-1547213554 Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-MigrationsAdminTest-1547213554-project-admin Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3320982894964d85bef7eaa13a2f72ac Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-MigrationsAdminTest-1547213554-project-admin Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: exception: Flavor 800d86de-8e09-4250-8d82-b77317d821e3 could not be found. Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '800d86de-8e09-4250-8d82-b77317d821e3'} Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 800d86de-8e09-4250-8d82-b77317d821e3 could not be found. Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 800d86de-8e09-4250-8d82-b77317d821e3 could not be found. Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:17.505128 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:17.513329 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:17.513329 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:17.513329 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:17.513329 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:17.513329 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:03:17.513329 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:03:17.513329 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 800d86de-8e09-4250-8d82-b77317d821e3 could not be found. Sep 06 11:03:17.513329 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:17.513329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-41c40095-66f5-4f85-bcbf-eb58b5d2743c tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Returning 404 to user: Flavor 800d86de-8e09-4250-8d82-b77317d821e3 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:03:17.513329 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-41c40095-66f5-4f85-bcbf-eb58b5d2743c tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/800d86de-8e09-4250-8d82-b77317d821e3" status: 404 len: 109 microversion: 2.1 time: 0.018719 Sep 06 11:03:17.513329 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1441/2855] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:03:17 2022] DELETE /compute/v2.1/flavors/800d86de-8e09-4250-8d82-b77317d821e3 => generated 109 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:03:17.518194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4b273bdd-a799-41c0-893d-f7c4cfa396b5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:17.519208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4b273bdd-a799-41c0-893d-f7c4cfa396b5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:17.528988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b273bdd-a799-41c0-893d-f7c4cfa396b5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:17.532119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b273bdd-a799-41c0-893d-f7c4cfa396b5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:17.532119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b273bdd-a799-41c0-893d-f7c4cfa396b5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:17.532119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b273bdd-a799-41c0-893d-f7c4cfa396b5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:17.532119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b273bdd-a799-41c0-893d-f7c4cfa396b5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:17.532119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b273bdd-a799-41c0-893d-f7c4cfa396b5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:17.555483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dab8807e-9a9f-4fda-ad5b-b1c571688acc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:17.564605 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dab8807e-9a9f-4fda-ad5b-b1c571688acc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.187308 Sep 06 11:03:17.565512 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1415/2856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:17 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:17.658842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-687294371", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:17.711717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4b273bdd-a799-41c0-893d-f7c4cfa396b5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:17.715045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:03:17.730116 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4b273bdd-a799-41c0-893d-f7c4cfa396b5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.220862 Sep 06 11:03:17.732853 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1442/2857] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:17 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:17.973679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-84ee6844-fc72-4875-9c6b-ec612a34d521 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:17.974448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-84ee6844-fc72-4875-9c6b-ec612a34d521 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:17.980640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-84ee6844-fc72-4875-9c6b-ec612a34d521 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:17.981143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-84ee6844-fc72-4875-9c6b-ec612a34d521 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:17.981594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-84ee6844-fc72-4875-9c6b-ec612a34d521 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:17.982344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-84ee6844-fc72-4875-9c6b-ec612a34d521 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:17.982816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-84ee6844-fc72-4875-9c6b-ec612a34d521 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:17.983508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-84ee6844-fc72-4875-9c6b-ec612a34d521 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:17.997947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:03:17.998577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:03:18.000003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:03:18.000541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:03:18.001311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:03:18.016062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:18.016964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:18.017492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:18.020872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:18.021449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:18.023370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:18.044597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Getting quotas for project 2a1f6f54c8d24eaa9eae09e8f30c56f1. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:03:18.057008 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Getting quotas for user 3b6e2046e3bd40b3b46802dfa796260b and project 2a1f6f54c8d24eaa9eae09e8f30c56f1. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:03:18.074565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:03:18.077496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:03:18.156245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-84ee6844-fc72-4875-9c6b-ec612a34d521 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:18.164606 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-84ee6844-fc72-4875-9c6b-ec612a34d521 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1473 microversion: 2.1 time: 0.195949 Sep 06 11:03:18.165180 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1443/2858] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:17 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1473 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:18.268287 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a9569cba-db4a-44ec-8b0e-f6fd3abb5a61 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613865 Sep 06 11:03:18.272249 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1416/2859] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:03:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:03:18.281960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-33644fef-8edb-4789-863f-0b6f5140889b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:18.283734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-33644fef-8edb-4789-863f-0b6f5140889b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:18.411603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-33644fef-8edb-4789-863f-0b6f5140889b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:18.419040 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-33644fef-8edb-4789-863f-0b6f5140889b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1212 microversion: 2.1 time: 0.142389 Sep 06 11:03:18.420964 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1444/2860] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:18 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1212 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:18.482926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-86051bba-6873-4684-b02b-3b0b2e4a4015 req-e34f0800-ed79-4f8a-9f44-2a5ded7da65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0611012-ede1-4ec2-b586-e3ba1f562253", "name": "network-vif-plugged", "status": "completed", "tag": "ecc6e385-dc5e-4440-9b3e-e389cf5f0eed"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:18.513044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-86051bba-6873-4684-b02b-3b0b2e4a4015 req-e34f0800-ed79-4f8a-9f44-2a5ded7da65c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:18.515048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-86051bba-6873-4684-b02b-3b0b2e4a4015 req-e34f0800-ed79-4f8a-9f44-2a5ded7da65c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:18.515896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-86051bba-6873-4684-b02b-3b0b2e4a4015 req-e34f0800-ed79-4f8a-9f44-2a5ded7da65c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:18.538624 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-86051bba-6873-4684-b02b-3b0b2e4a4015 req-e34f0800-ed79-4f8a-9f44-2a5ded7da65c service nova] Creating event network-vif-plugged:ecc6e385-dc5e-4440-9b3e-e389cf5f0eed for instance b0611012-ede1-4ec2-b586-e3ba1f562253 on nch1-master-1 Sep 06 11:03:18.544969 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-86051bba-6873-4684-b02b-3b0b2e4a4015 req-e34f0800-ed79-4f8a-9f44-2a5ded7da65c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068117 Sep 06 11:03:18.546185 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1417/2861] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:18.590888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f9ee1b64-aadc-46e6-ad48-c6a42c9b5306 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:18.590888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f9ee1b64-aadc-46e6-ad48-c6a42c9b5306 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:18.597116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9ee1b64-aadc-46e6-ad48-c6a42c9b5306 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:18.597624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9ee1b64-aadc-46e6-ad48-c6a42c9b5306 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:18.598654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9ee1b64-aadc-46e6-ad48-c6a42c9b5306 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:18.599691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9ee1b64-aadc-46e6-ad48-c6a42c9b5306 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:18.600492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9ee1b64-aadc-46e6-ad48-c6a42c9b5306 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:18.601059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9ee1b64-aadc-46e6-ad48-c6a42c9b5306 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:18.755595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5597c97e-c205-4b47-ba70-931c99f5de91 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:18.756704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5597c97e-c205-4b47-ba70-931c99f5de91 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:18.764338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5597c97e-c205-4b47-ba70-931c99f5de91 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:18.765773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5597c97e-c205-4b47-ba70-931c99f5de91 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:18.765773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5597c97e-c205-4b47-ba70-931c99f5de91 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:18.766174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5597c97e-c205-4b47-ba70-931c99f5de91 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:18.766558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5597c97e-c205-4b47-ba70-931c99f5de91 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:18.767233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5597c97e-c205-4b47-ba70-931c99f5de91 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:18.774208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f9ee1b64-aadc-46e6-ad48-c6a42c9b5306 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:18.782421 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f9ee1b64-aadc-46e6-ad48-c6a42c9b5306 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.196561 Sep 06 11:03:18.783161 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1445/2862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:18 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:19.017392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5597c97e-c205-4b47-ba70-931c99f5de91 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:19.033722 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5597c97e-c205-4b47-ba70-931c99f5de91 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.277822 Sep 06 11:03:19.035558 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1418/2863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:18 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:19.086367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-98552613-8c89-49f9-8191-f788bc842664 req-b7b997a0-4451-478f-839f-3beed2f4733c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c9d14e-d098-43b1-9393-7a4ce19dbf19", "name": "network-vif-deleted", "tag": "5eba5ffd-b64b-4ddd-abaa-43c6486a7799"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:19.107569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-98552613-8c89-49f9-8191-f788bc842664 req-b7b997a0-4451-478f-839f-3beed2f4733c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:19.115418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-98552613-8c89-49f9-8191-f788bc842664 req-b7b997a0-4451-478f-839f-3beed2f4733c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:19.118422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-98552613-8c89-49f9-8191-f788bc842664 req-b7b997a0-4451-478f-839f-3beed2f4733c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:19.152110 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-98552613-8c89-49f9-8191-f788bc842664 req-b7b997a0-4451-478f-839f-3beed2f4733c service nova] Creating event network-vif-deleted:5eba5ffd-b64b-4ddd-abaa-43c6486a7799 for instance 48c9d14e-d098-43b1-9393-7a4ce19dbf19 on nch1-master-1 Sep 06 11:03:19.158287 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-98552613-8c89-49f9-8191-f788bc842664 req-b7b997a0-4451-478f-839f-3beed2f4733c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077645 Sep 06 11:03:19.158968 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1446/2864] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:19.190440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-03e9a2ec-362a-4592-93cc-3b0878a6106a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:19.191378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-03e9a2ec-362a-4592-93cc-3b0878a6106a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:19.200264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03e9a2ec-362a-4592-93cc-3b0878a6106a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:19.201389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03e9a2ec-362a-4592-93cc-3b0878a6106a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:19.201856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03e9a2ec-362a-4592-93cc-3b0878a6106a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:19.202587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03e9a2ec-362a-4592-93cc-3b0878a6106a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:19.203072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03e9a2ec-362a-4592-93cc-3b0878a6106a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:19.203514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03e9a2ec-362a-4592-93cc-3b0878a6106a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:19.226009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:19.292791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-03e9a2ec-362a-4592-93cc-3b0878a6106a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:19.299687 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-03e9a2ec-362a-4592-93cc-3b0878a6106a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1431 microversion: 2.1 time: 0.114608 Sep 06 11:03:19.300828 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1419/2865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:19 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1431 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:19.447090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fdd3bf2b-1713-4260-a54a-f59117569b0d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:19.447825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fdd3bf2b-1713-4260-a54a-f59117569b0d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:19.531720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fdd3bf2b-1713-4260-a54a-f59117569b0d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:19.541391 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fdd3bf2b-1713-4260-a54a-f59117569b0d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1212 microversion: 2.1 time: 0.099242 Sep 06 11:03:19.561949 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1447/2866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:19 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1212 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:19.813476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-591efbad-c579-4e6f-88f4-53cc85209f8a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:19.814098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-591efbad-c579-4e6f-88f4-53cc85209f8a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:19.821639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-591efbad-c579-4e6f-88f4-53cc85209f8a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:19.822681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-591efbad-c579-4e6f-88f4-53cc85209f8a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:19.823218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-591efbad-c579-4e6f-88f4-53cc85209f8a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:19.824063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-591efbad-c579-4e6f-88f4-53cc85209f8a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:19.824955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-591efbad-c579-4e6f-88f4-53cc85209f8a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:19.825422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-591efbad-c579-4e6f-88f4-53cc85209f8a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:20.055582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-591efbad-c579-4e6f-88f4-53cc85209f8a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:20.058946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-63dbbee9-a54a-4ed7-8082-9087f70f475c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:20.060874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-63dbbee9-a54a-4ed7-8082-9087f70f475c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:20.066698 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-591efbad-c579-4e6f-88f4-53cc85209f8a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1513 microversion: 2.1 time: 0.255467 Sep 06 11:03:20.066698 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1420/2867] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:19 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:20.070605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63dbbee9-a54a-4ed7-8082-9087f70f475c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:20.071315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63dbbee9-a54a-4ed7-8082-9087f70f475c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:20.071938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63dbbee9-a54a-4ed7-8082-9087f70f475c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:20.072673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63dbbee9-a54a-4ed7-8082-9087f70f475c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:20.073152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63dbbee9-a54a-4ed7-8082-9087f70f475c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:20.073594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63dbbee9-a54a-4ed7-8082-9087f70f475c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:20.210655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-63dbbee9-a54a-4ed7-8082-9087f70f475c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:20.218819 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-63dbbee9-a54a-4ed7-8082-9087f70f475c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.164024 Sep 06 11:03:20.219462 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1448/2868] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:20 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:20.323454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:20.324078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:20.330186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:20.330672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:20.331137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:20.331995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:20.333000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:20.333431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:20.364757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:20.365241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:20.365682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:20.366168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lazy-loading 'fault' on Instance uuid 48c9d14e-d098-43b1-9393-7a4ce19dbf19 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:03:20.414734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:20.423170 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-28cd83c8-bde6-43f1-8202-96ad883441ec tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 200 len: 1307 microversion: 2.1 time: 0.103913 Sep 06 11:03:20.423756 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1421/2869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:20 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:20.584849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b6cf845d-cd1d-47fd-a283-213e89b223b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:20.585711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b6cf845d-cd1d-47fd-a283-213e89b223b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:20.614778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6cf845d-cd1d-47fd-a283-213e89b223b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:20.630042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6cf845d-cd1d-47fd-a283-213e89b223b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:20.630785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6cf845d-cd1d-47fd-a283-213e89b223b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:20.632607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6cf845d-cd1d-47fd-a283-213e89b223b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:20.633473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6cf845d-cd1d-47fd-a283-213e89b223b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:20.634334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6cf845d-cd1d-47fd-a283-213e89b223b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:20.701507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b6cf845d-cd1d-47fd-a283-213e89b223b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:20.710364 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b6cf845d-cd1d-47fd-a283-213e89b223b8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1208 microversion: 2.1 time: 0.130260 Sep 06 11:03:20.710940 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1449/2870] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:20 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1208 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:21.089687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1b817d6c-ad57-4076-a3e2-dcf81a7f36f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:21.090304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1b817d6c-ad57-4076-a3e2-dcf81a7f36f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:21.097451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b817d6c-ad57-4076-a3e2-dcf81a7f36f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:21.097945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b817d6c-ad57-4076-a3e2-dcf81a7f36f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:21.099095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b817d6c-ad57-4076-a3e2-dcf81a7f36f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:21.099095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b817d6c-ad57-4076-a3e2-dcf81a7f36f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:21.099572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b817d6c-ad57-4076-a3e2-dcf81a7f36f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:21.100007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b817d6c-ad57-4076-a3e2-dcf81a7f36f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:21.245746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1b817d6c-ad57-4076-a3e2-dcf81a7f36f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:21.273047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-36714bfd-2897-4b44-a6dc-c4653f31a3ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:21.273047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-36714bfd-2897-4b44-a6dc-c4653f31a3ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:21.280801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36714bfd-2897-4b44-a6dc-c4653f31a3ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:21.286883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36714bfd-2897-4b44-a6dc-c4653f31a3ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:21.286883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36714bfd-2897-4b44-a6dc-c4653f31a3ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:21.286883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36714bfd-2897-4b44-a6dc-c4653f31a3ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:21.286883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36714bfd-2897-4b44-a6dc-c4653f31a3ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:21.286883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36714bfd-2897-4b44-a6dc-c4653f31a3ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:21.287626 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1b817d6c-ad57-4076-a3e2-dcf81a7f36f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1531 microversion: 2.1 time: 0.199967 Sep 06 11:03:21.287626 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1422/2871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:21 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1531 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:21.423296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-36714bfd-2897-4b44-a6dc-c4653f31a3ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:21.431765 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-36714bfd-2897-4b44-a6dc-c4653f31a3ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.191081 Sep 06 11:03:21.432340 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1450/2872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:21 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:21.446000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3afb48bf-d09e-4c29-9d62-f0e62e55b0fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:21.446656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3afb48bf-d09e-4c29-9d62-f0e62e55b0fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 48c9d14e-d098-43b1-9393-7a4ce19dbf19] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:21.453369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3afb48bf-d09e-4c29-9d62-f0e62e55b0fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:21.453870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3afb48bf-d09e-4c29-9d62-f0e62e55b0fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:21.464003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3afb48bf-d09e-4c29-9d62-f0e62e55b0fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:21.464003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3afb48bf-d09e-4c29-9d62-f0e62e55b0fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:21.464003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3afb48bf-d09e-4c29-9d62-f0e62e55b0fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:21.464003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3afb48bf-d09e-4c29-9d62-f0e62e55b0fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:21.469584 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-3afb48bf-d09e-4c29-9d62-f0e62e55b0fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] HTTP exception thrown: Instance 48c9d14e-d098-43b1-9393-7a4ce19dbf19 could not be found. Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3afb48bf-d09e-4c29-9d62-f0e62e55b0fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Request method failure captured: Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 HTTP/1.1 Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyhK9jZtW1DNORfwfRpR85Y8c-_tMHtG3Zvmm1PUkx_8Hh78J7D07mpIe0VOjywIx27PuMyL2q8quTjVO48e84bIJD3s_LW5pTYmlujPS4_Fm-TChnjJiUdBV3w5il4JD3oVz9FhIsPv7eYq78jkLQs8CmEWHfViPL5Ic4yWhP1Daig Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}] Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 9e84745e5df647d1921e8d1ffc08711c Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 48c9d14e-d098-43b1-9393-7a4ce19dbf19 could not be found. Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '48c9d14e-d098-43b1-9393-7a4ce19dbf19'} Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c9d14e-d098-43b1-9393-7a4ce19dbf19 could not be found. Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c9d14e-d098-43b1-9393-7a4ce19dbf19 could not be found. Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:21.471307 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:21.476749 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:21.476749 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:21.476749 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:21.476749 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:03:21.476749 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:03:21.476749 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c9d14e-d098-43b1-9393-7a4ce19dbf19 could not be found. Sep 06 11:03:21.476749 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:21.476749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3afb48bf-d09e-4c29-9d62-f0e62e55b0fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Returning 404 to user: Instance 48c9d14e-d098-43b1-9393-7a4ce19dbf19 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:03:21.476749 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3afb48bf-d09e-4c29-9d62-f0e62e55b0fe tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19" status: 404 len: 111 microversion: 2.1 time: 0.030652 Sep 06 11:03:21.476749 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1423/2873] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:21 2022] GET /compute/v2.1/servers/48c9d14e-d098-43b1-9393-7a4ce19dbf19 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:03:21.481830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1fb468a3-4985-4e70-a2b8-d2f471f0417d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:21.482361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1fb468a3-4985-4e70-a2b8-d2f471f0417d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:21.493795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fb468a3-4985-4e70-a2b8-d2f471f0417d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:21.493795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fb468a3-4985-4e70-a2b8-d2f471f0417d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:21.493795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fb468a3-4985-4e70-a2b8-d2f471f0417d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:21.493795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fb468a3-4985-4e70-a2b8-d2f471f0417d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:21.493795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fb468a3-4985-4e70-a2b8-d2f471f0417d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:21.493795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fb468a3-4985-4e70-a2b8-d2f471f0417d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:21.510780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:21.518284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1fb468a3-4985-4e70-a2b8-d2f471f0417d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:03:21.733866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ed920051-f08b-4e66-98aa-24d83e26b9cf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:21.734800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ed920051-f08b-4e66-98aa-24d83e26b9cf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:21.741266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed920051-f08b-4e66-98aa-24d83e26b9cf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:21.741752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed920051-f08b-4e66-98aa-24d83e26b9cf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:21.742186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed920051-f08b-4e66-98aa-24d83e26b9cf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:21.742908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed920051-f08b-4e66-98aa-24d83e26b9cf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:21.743493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed920051-f08b-4e66-98aa-24d83e26b9cf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:21.743937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed920051-f08b-4e66-98aa-24d83e26b9cf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:21.815627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ed920051-f08b-4e66-98aa-24d83e26b9cf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:21.824763 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ed920051-f08b-4e66-98aa-24d83e26b9cf tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1264 microversion: 2.1 time: 0.095584 Sep 06 11:03:21.825380 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1424/2874] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:21 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1264 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:21.985753 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1fb468a3-4985-4e70-a2b8-d2f471f0417d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "DELETE /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 204 len: 0 microversion: 2.1 time: 0.507480 Sep 06 11:03:21.988748 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1451/2875] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:03:21 2022] DELETE /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:03:21.996304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-25fa4794-a092-4a7d-ad6d-22a05c761984 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:21.997252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-25fa4794-a092-4a7d-ad6d-22a05c761984 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:22.003522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25fa4794-a092-4a7d-ad6d-22a05c761984 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:22.004625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25fa4794-a092-4a7d-ad6d-22a05c761984 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:22.005107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25fa4794-a092-4a7d-ad6d-22a05c761984 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:22.005784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25fa4794-a092-4a7d-ad6d-22a05c761984 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:22.006310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25fa4794-a092-4a7d-ad6d-22a05c761984 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:22.006742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25fa4794-a092-4a7d-ad6d-22a05c761984 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:22.144366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-25fa4794-a092-4a7d-ad6d-22a05c761984 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:22.154493 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-25fa4794-a092-4a7d-ad6d-22a05c761984 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1471 microversion: 2.1 time: 0.162662 Sep 06 11:03:22.155211 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1425/2876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:21 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:22.310567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-98151dd8-2c43-4e97-9eb6-2edb0b5995f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:22.311332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-98151dd8-2c43-4e97-9eb6-2edb0b5995f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:22.319842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98151dd8-2c43-4e97-9eb6-2edb0b5995f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:22.320335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98151dd8-2c43-4e97-9eb6-2edb0b5995f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:22.320782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98151dd8-2c43-4e97-9eb6-2edb0b5995f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:22.321624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98151dd8-2c43-4e97-9eb6-2edb0b5995f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:22.322133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98151dd8-2c43-4e97-9eb6-2edb0b5995f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:22.322573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-98151dd8-2c43-4e97-9eb6-2edb0b5995f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:22.455988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca58ad90-6c92-4587-bfad-8b86b4f5305d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:22.456619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca58ad90-6c92-4587-bfad-8b86b4f5305d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:22.465350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca58ad90-6c92-4587-bfad-8b86b4f5305d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:22.466098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca58ad90-6c92-4587-bfad-8b86b4f5305d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:22.466682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca58ad90-6c92-4587-bfad-8b86b4f5305d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:22.467814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca58ad90-6c92-4587-bfad-8b86b4f5305d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:22.468490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca58ad90-6c92-4587-bfad-8b86b4f5305d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:22.469266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca58ad90-6c92-4587-bfad-8b86b4f5305d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:22.562974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-98151dd8-2c43-4e97-9eb6-2edb0b5995f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:22.572880 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-98151dd8-2c43-4e97-9eb6-2edb0b5995f8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1519 microversion: 2.1 time: 0.266762 Sep 06 11:03:22.573469 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1452/2877] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:22 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1519 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:22.661704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ca58ad90-6c92-4587-bfad-8b86b4f5305d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:22.669675 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ca58ad90-6c92-4587-bfad-8b86b4f5305d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.217982 Sep 06 11:03:22.670264 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1426/2878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:22 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:22.854988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-82bd5f76-c4fd-4008-8796-bb3b9ff06ab3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:22.855676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-82bd5f76-c4fd-4008-8796-bb3b9ff06ab3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:22.867261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82bd5f76-c4fd-4008-8796-bb3b9ff06ab3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:22.868039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82bd5f76-c4fd-4008-8796-bb3b9ff06ab3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:22.868947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82bd5f76-c4fd-4008-8796-bb3b9ff06ab3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:22.870300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82bd5f76-c4fd-4008-8796-bb3b9ff06ab3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:22.872178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82bd5f76-c4fd-4008-8796-bb3b9ff06ab3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:22.873974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82bd5f76-c4fd-4008-8796-bb3b9ff06ab3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:23.117009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-82bd5f76-c4fd-4008-8796-bb3b9ff06ab3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:23.125310 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-82bd5f76-c4fd-4008-8796-bb3b9ff06ab3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1312 microversion: 2.1 time: 0.275423 Sep 06 11:03:23.127544 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1453/2879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:22 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1312 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:23.179930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c5ce8ed-1496-4c59-8feb-623d4c19c22b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:23.181288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c5ce8ed-1496-4c59-8feb-623d4c19c22b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:23.193761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c5ce8ed-1496-4c59-8feb-623d4c19c22b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:23.194697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c5ce8ed-1496-4c59-8feb-623d4c19c22b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:23.195616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c5ce8ed-1496-4c59-8feb-623d4c19c22b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:23.196937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c5ce8ed-1496-4c59-8feb-623d4c19c22b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:23.197606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c5ce8ed-1496-4c59-8feb-623d4c19c22b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:23.198831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c5ce8ed-1496-4c59-8feb-623d4c19c22b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:23.477451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2c5ce8ed-1496-4c59-8feb-623d4c19c22b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:23.486943 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c5ce8ed-1496-4c59-8feb-623d4c19c22b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1471 microversion: 2.1 time: 0.312497 Sep 06 11:03:23.488072 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1427/2880] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:23 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1471 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:23.597293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb4f0e24-3a78-4fa8-a4cc-b8dd01ad07e3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:23.597956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bb4f0e24-3a78-4fa8-a4cc-b8dd01ad07e3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:23.604959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb4f0e24-3a78-4fa8-a4cc-b8dd01ad07e3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:23.605451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb4f0e24-3a78-4fa8-a4cc-b8dd01ad07e3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:23.605903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb4f0e24-3a78-4fa8-a4cc-b8dd01ad07e3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:23.606662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb4f0e24-3a78-4fa8-a4cc-b8dd01ad07e3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:23.607118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb4f0e24-3a78-4fa8-a4cc-b8dd01ad07e3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:23.610016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb4f0e24-3a78-4fa8-a4cc-b8dd01ad07e3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:23.694107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2e1593a0-dc10-4dc8-b065-5778174aa55b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:23.695321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2e1593a0-dc10-4dc8-b065-5778174aa55b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:23.704489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e1593a0-dc10-4dc8-b065-5778174aa55b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:23.706071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e1593a0-dc10-4dc8-b065-5778174aa55b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:23.706746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e1593a0-dc10-4dc8-b065-5778174aa55b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:23.708413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e1593a0-dc10-4dc8-b065-5778174aa55b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:23.708948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e1593a0-dc10-4dc8-b065-5778174aa55b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:23.709600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e1593a0-dc10-4dc8-b065-5778174aa55b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:23.928444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bb4f0e24-3a78-4fa8-a4cc-b8dd01ad07e3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:23.939868 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bb4f0e24-3a78-4fa8-a4cc-b8dd01ad07e3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1519 microversion: 2.1 time: 0.346425 Sep 06 11:03:23.940825 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1454/2881] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:23 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1519 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:23.974110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2e1593a0-dc10-4dc8-b065-5778174aa55b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:23.982161 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2e1593a0-dc10-4dc8-b065-5778174aa55b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.293176 Sep 06 11:03:23.982832 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1428/2882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:23 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:24.155255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e2570025-fdcc-4415-9e96-3ab80fa188a8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:24.155364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f130b58a-b846-4b0d-a0f4-932a9449c319 req-7a9ff9a1-ad46-4a7e-9efe-52ff16fc1ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f3820c-e654-4eca-98de-9c5b2ec61763", "tag": "85f92e4a-b017-486e-a2da-1f2effdf2520"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:24.158255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e2570025-fdcc-4415-9e96-3ab80fa188a8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:24.166654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2570025-fdcc-4415-9e96-3ab80fa188a8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:24.167463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2570025-fdcc-4415-9e96-3ab80fa188a8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:24.168796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2570025-fdcc-4415-9e96-3ab80fa188a8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:24.169588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f130b58a-b846-4b0d-a0f4-932a9449c319 req-7a9ff9a1-ad46-4a7e-9efe-52ff16fc1ab3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:24.170195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f130b58a-b846-4b0d-a0f4-932a9449c319 req-7a9ff9a1-ad46-4a7e-9efe-52ff16fc1ab3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:24.170455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2570025-fdcc-4415-9e96-3ab80fa188a8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:24.170820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f130b58a-b846-4b0d-a0f4-932a9449c319 req-7a9ff9a1-ad46-4a7e-9efe-52ff16fc1ab3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:24.171416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2570025-fdcc-4415-9e96-3ab80fa188a8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:24.172031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2570025-fdcc-4415-9e96-3ab80fa188a8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:24.194933 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f130b58a-b846-4b0d-a0f4-932a9449c319 req-7a9ff9a1-ad46-4a7e-9efe-52ff16fc1ab3 service nova] Creating event network-changed:85f92e4a-b017-486e-a2da-1f2effdf2520 for instance b3f3820c-e654-4eca-98de-9c5b2ec61763 on nch1-master-1 Sep 06 11:03:24.204691 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f130b58a-b846-4b0d-a0f4-932a9449c319 req-7a9ff9a1-ad46-4a7e-9efe-52ff16fc1ab3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055496 Sep 06 11:03:24.206130 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1429/2883] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:24.403092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e2570025-fdcc-4415-9e96-3ab80fa188a8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:24.411795 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e2570025-fdcc-4415-9e96-3ab80fa188a8 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1312 microversion: 2.1 time: 0.266708 Sep 06 11:03:24.415854 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1455/2884] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:24 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1312 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:24.512672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f8d5d54e-1687-4a6d-b0dd-e51c6048a64b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:24.514273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f8d5d54e-1687-4a6d-b0dd-e51c6048a64b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:24.524795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8d5d54e-1687-4a6d-b0dd-e51c6048a64b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:24.525511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8d5d54e-1687-4a6d-b0dd-e51c6048a64b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:24.526308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8d5d54e-1687-4a6d-b0dd-e51c6048a64b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:24.527493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8d5d54e-1687-4a6d-b0dd-e51c6048a64b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:24.528218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8d5d54e-1687-4a6d-b0dd-e51c6048a64b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:24.528878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8d5d54e-1687-4a6d-b0dd-e51c6048a64b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:24.791476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f8d5d54e-1687-4a6d-b0dd-e51c6048a64b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:24.812112 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f8d5d54e-1687-4a6d-b0dd-e51c6048a64b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1471 microversion: 2.1 time: 0.294270 Sep 06 11:03:24.812112 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1430/2885] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:24 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1471 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:24.975290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe431b5b-1d36-434e-8927-e21f9314e096 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:24.975290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe431b5b-1d36-434e-8927-e21f9314e096 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:24.988064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe431b5b-1d36-434e-8927-e21f9314e096 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:24.988579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe431b5b-1d36-434e-8927-e21f9314e096 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:24.989857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe431b5b-1d36-434e-8927-e21f9314e096 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:24.993971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe431b5b-1d36-434e-8927-e21f9314e096 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:24.994508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe431b5b-1d36-434e-8927-e21f9314e096 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:24.995316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe431b5b-1d36-434e-8927-e21f9314e096 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:25.017833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d0f4baf5-4a56-4fea-88e3-f791acb7f18d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:25.018719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d0f4baf5-4a56-4fea-88e3-f791acb7f18d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:25.030565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0f4baf5-4a56-4fea-88e3-f791acb7f18d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:25.031268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0f4baf5-4a56-4fea-88e3-f791acb7f18d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:25.032223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0f4baf5-4a56-4fea-88e3-f791acb7f18d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:25.033119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0f4baf5-4a56-4fea-88e3-f791acb7f18d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:25.033752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0f4baf5-4a56-4fea-88e3-f791acb7f18d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:25.034354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0f4baf5-4a56-4fea-88e3-f791acb7f18d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:25.369994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d0f4baf5-4a56-4fea-88e3-f791acb7f18d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:25.406320 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d0f4baf5-4a56-4fea-88e3-f791acb7f18d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.403673 Sep 06 11:03:25.425762 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1431/2886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:25 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:25.450425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6f71a79c-8137-4ea3-b742-c82550f64c24 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:25.452566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6f71a79c-8137-4ea3-b742-c82550f64c24 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:25.471113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f71a79c-8137-4ea3-b742-c82550f64c24 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:25.472010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f71a79c-8137-4ea3-b742-c82550f64c24 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:25.473286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f71a79c-8137-4ea3-b742-c82550f64c24 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:25.474737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f71a79c-8137-4ea3-b742-c82550f64c24 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:25.476797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f71a79c-8137-4ea3-b742-c82550f64c24 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:25.477624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f71a79c-8137-4ea3-b742-c82550f64c24 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:25.484761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe431b5b-1d36-434e-8927-e21f9314e096 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:25.497898 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe431b5b-1d36-434e-8927-e21f9314e096 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1519 microversion: 2.1 time: 0.535983 Sep 06 11:03:25.498501 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1456/2887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:24 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1519 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:25.843332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1a5c5a8c-4314-48ad-9f9e-b269d7ebb123 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:25.845885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1a5c5a8c-4314-48ad-9f9e-b269d7ebb123 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:25.856183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a5c5a8c-4314-48ad-9f9e-b269d7ebb123 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:25.856695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a5c5a8c-4314-48ad-9f9e-b269d7ebb123 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:25.857150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a5c5a8c-4314-48ad-9f9e-b269d7ebb123 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:25.864183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a5c5a8c-4314-48ad-9f9e-b269d7ebb123 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:25.865980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a5c5a8c-4314-48ad-9f9e-b269d7ebb123 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:25.871498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a5c5a8c-4314-48ad-9f9e-b269d7ebb123 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:26.359303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1a5c5a8c-4314-48ad-9f9e-b269d7ebb123 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:26.368267 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1a5c5a8c-4314-48ad-9f9e-b269d7ebb123 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1471 microversion: 2.1 time: 0.528909 Sep 06 11:03:26.368858 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1457/2888] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:25 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1471 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:26.373685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-605536a6-9306-4a42-a526-dbcfc26d4bcf req-26155640-2098-458b-9e1f-bc2e84389015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d6ab04-f643-4697-b4dd-3bed20fc385c", "name": "network-vif-plugged", "status": "completed", "tag": "d8da94dc-fb90-40ca-8ca2-a52292ba2029"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:26.385451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-605536a6-9306-4a42-a526-dbcfc26d4bcf req-26155640-2098-458b-9e1f-bc2e84389015 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:26.391699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-605536a6-9306-4a42-a526-dbcfc26d4bcf req-26155640-2098-458b-9e1f-bc2e84389015 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:26.391699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-605536a6-9306-4a42-a526-dbcfc26d4bcf req-26155640-2098-458b-9e1f-bc2e84389015 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:26.399531 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-605536a6-9306-4a42-a526-dbcfc26d4bcf req-26155640-2098-458b-9e1f-bc2e84389015 service nova] Creating event network-vif-plugged:d8da94dc-fb90-40ca-8ca2-a52292ba2029 for instance d8d6ab04-f643-4697-b4dd-3bed20fc385c on nch2-master-1 Sep 06 11:03:26.400554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6f71a79c-8137-4ea3-b742-c82550f64c24 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:26.405539 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-605536a6-9306-4a42-a526-dbcfc26d4bcf req-26155640-2098-458b-9e1f-bc2e84389015 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035112 Sep 06 11:03:26.406982 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1458/2889] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:26.410683 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6f71a79c-8137-4ea3-b742-c82550f64c24 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1312 microversion: 2.1 time: 0.973992 Sep 06 11:03:26.411624 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1432/2890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:25 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1312 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:26.437329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ffde7ceb-91d7-4461-aa9f-5838a1ee3103 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:26.438050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ffde7ceb-91d7-4461-aa9f-5838a1ee3103 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:26.444545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffde7ceb-91d7-4461-aa9f-5838a1ee3103 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:26.445046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffde7ceb-91d7-4461-aa9f-5838a1ee3103 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:26.445497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffde7ceb-91d7-4461-aa9f-5838a1ee3103 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:26.446301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffde7ceb-91d7-4461-aa9f-5838a1ee3103 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:26.446706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffde7ceb-91d7-4461-aa9f-5838a1ee3103 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:26.447154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffde7ceb-91d7-4461-aa9f-5838a1ee3103 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:26.533491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3d92383-0a05-49ce-ae39-293d805f58a5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:26.534267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f3d92383-0a05-49ce-ae39-293d805f58a5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:26.553775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3d92383-0a05-49ce-ae39-293d805f58a5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:26.554293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3d92383-0a05-49ce-ae39-293d805f58a5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:26.554741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3d92383-0a05-49ce-ae39-293d805f58a5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:26.556478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3d92383-0a05-49ce-ae39-293d805f58a5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:26.557892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3d92383-0a05-49ce-ae39-293d805f58a5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:26.562612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3d92383-0a05-49ce-ae39-293d805f58a5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:27.401114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ffde7ceb-91d7-4461-aa9f-5838a1ee3103 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:27.409361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f3d92383-0a05-49ce-ae39-293d805f58a5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:27.411542 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ffde7ceb-91d7-4461-aa9f-5838a1ee3103 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.978448 Sep 06 11:03:27.412507 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1459/2891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:26 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:27.419162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-de7e20bb-b183-4a49-9d6d-796ac76bf19e req-13f1a29e-5cb1-4dd4-af9b-a727560b38e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a0857e-06d2-4767-85e9-8fd3b2fe0103", "name": "network-vif-deleted", "tag": "30e1eaa1-35ac-477b-9658-e04f301830e2"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:27.421768 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f3d92383-0a05-49ce-ae39-293d805f58a5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1519 microversion: 2.1 time: 0.903351 Sep 06 11:03:27.435472 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1433/2892] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:26 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1519 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:27.436644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-de7e20bb-b183-4a49-9d6d-796ac76bf19e req-13f1a29e-5cb1-4dd4-af9b-a727560b38e3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:27.437349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-de7e20bb-b183-4a49-9d6d-796ac76bf19e req-13f1a29e-5cb1-4dd4-af9b-a727560b38e3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:27.437963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-de7e20bb-b183-4a49-9d6d-796ac76bf19e req-13f1a29e-5cb1-4dd4-af9b-a727560b38e3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:27.448815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:27.452486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:27.454848 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-de7e20bb-b183-4a49-9d6d-796ac76bf19e req-13f1a29e-5cb1-4dd4-af9b-a727560b38e3 service nova] Creating event network-vif-deleted:30e1eaa1-35ac-477b-9658-e04f301830e2 for instance 03a0857e-06d2-4767-85e9-8fd3b2fe0103 on nch2-master-1 Sep 06 11:03:27.462528 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-de7e20bb-b183-4a49-9d6d-796ac76bf19e req-13f1a29e-5cb1-4dd4-af9b-a727560b38e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048526 Sep 06 11:03:27.468028 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1460/2893] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:27.468250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:27.468250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:27.468250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:27.468250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:27.470850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4740ec2b-8fd8-47c5-9493-bc24ff4c8496 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:27.471908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4740ec2b-8fd8-47c5-9493-bc24ff4c8496 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:27.478018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:27.478681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:27.481132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4740ec2b-8fd8-47c5-9493-bc24ff4c8496 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:27.482856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4740ec2b-8fd8-47c5-9493-bc24ff4c8496 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:27.483713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4740ec2b-8fd8-47c5-9493-bc24ff4c8496 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:27.484649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4740ec2b-8fd8-47c5-9493-bc24ff4c8496 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:27.485287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4740ec2b-8fd8-47c5-9493-bc24ff4c8496 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:27.485914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4740ec2b-8fd8-47c5-9493-bc24ff4c8496 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:27.537046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:27.537913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:27.542411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:27.542411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lazy-loading 'fault' on Instance uuid 03a0857e-06d2-4767-85e9-8fd3b2fe0103 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:03:27.600651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:27.609450 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dfccd802-f2c9-4b21-9a27-017ba089f733 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1305 microversion: 2.1 time: 0.172738 Sep 06 11:03:27.610242 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1434/2894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:27 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1305 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:27.747583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4740ec2b-8fd8-47c5-9493-bc24ff4c8496 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:27.756721 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4740ec2b-8fd8-47c5-9493-bc24ff4c8496 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1312 microversion: 2.1 time: 0.291662 Sep 06 11:03:27.770007 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1461/2895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:27 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1312 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:28.436660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5509ff5c-b8ea-4a04-9d17-1cb61a6fab43 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:28.438680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5509ff5c-b8ea-4a04-9d17-1cb61a6fab43 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:28.455952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-747f3407-0b12-43aa-b6c3-fcdea44614fc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:28.457703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:28.459721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-747f3407-0b12-43aa-b6c3-fcdea44614fc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:28.459866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:28.470019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-747f3407-0b12-43aa-b6c3-fcdea44614fc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:28.470702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5509ff5c-b8ea-4a04-9d17-1cb61a6fab43 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:28.477190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5509ff5c-b8ea-4a04-9d17-1cb61a6fab43 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:28.479306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-747f3407-0b12-43aa-b6c3-fcdea44614fc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:28.479306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-747f3407-0b12-43aa-b6c3-fcdea44614fc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:28.480872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5509ff5c-b8ea-4a04-9d17-1cb61a6fab43 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:28.481836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5509ff5c-b8ea-4a04-9d17-1cb61a6fab43 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:28.482540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-747f3407-0b12-43aa-b6c3-fcdea44614fc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:28.483242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-747f3407-0b12-43aa-b6c3-fcdea44614fc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:28.483697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-747f3407-0b12-43aa-b6c3-fcdea44614fc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:28.484875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5509ff5c-b8ea-4a04-9d17-1cb61a6fab43 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:28.485519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5509ff5c-b8ea-4a04-9d17-1cb61a6fab43 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:29.039543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5509ff5c-b8ea-4a04-9d17-1cb61a6fab43 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:29.044817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-747f3407-0b12-43aa-b6c3-fcdea44614fc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:29.050160 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5509ff5c-b8ea-4a04-9d17-1cb61a6fab43 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.619587 Sep 06 11:03:29.055419 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-747f3407-0b12-43aa-b6c3-fcdea44614fc tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1519 microversion: 2.1 time: 0.606938 Sep 06 11:03:29.057222 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1462/2896] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:28 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1519 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:29.062774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:29.063609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:29.066366 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1435/2897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:28 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:29.073834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6ee8ef7f-54e5-4f88-95aa-dc58589a2aa7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:29.075089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6ee8ef7f-54e5-4f88-95aa-dc58589a2aa7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:29.084312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:29.084892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:29.085361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:29.086122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:29.086596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:29.090666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:29.094875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ee8ef7f-54e5-4f88-95aa-dc58589a2aa7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:29.096820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ee8ef7f-54e5-4f88-95aa-dc58589a2aa7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:29.098943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ee8ef7f-54e5-4f88-95aa-dc58589a2aa7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:29.099988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ee8ef7f-54e5-4f88-95aa-dc58589a2aa7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:29.100690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ee8ef7f-54e5-4f88-95aa-dc58589a2aa7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:29.101310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ee8ef7f-54e5-4f88-95aa-dc58589a2aa7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:29.134935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:29.137641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:29.138142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:29.140582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lazy-loading 'fault' on Instance uuid 03a0857e-06d2-4767-85e9-8fd3b2fe0103 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:03:29.276150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:29.304291 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c6dc86b0-8c39-4207-a77c-763cbfe1b083 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 200 len: 1305 microversion: 2.1 time: 0.237174 Sep 06 11:03:29.304996 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1463/2898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:29 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 1305 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:29.406281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6ee8ef7f-54e5-4f88-95aa-dc58589a2aa7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:29.408553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:29.421205 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6ee8ef7f-54e5-4f88-95aa-dc58589a2aa7 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1312 microversion: 2.1 time: 0.353653 Sep 06 11:03:29.422510 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1436/2899] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:29 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:29.931367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dccaf2ab-9f3c-4ed8-a5e7-f3d30f1bbc7c tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Action: 'create', calling method: .version_select at 0x7f90fcf775e0>, body: {"keypair": {"name": "tempest-keypair-1585845559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGRZNsXitTqLZiXrCnkwymwmV1nw3qcFAAvIgNQVM867yJQR5dquFpT0dFrmfQAlAVmPYfEa2u7J2zvtystOyB2+fUimKRXd320UEgQEQRaRcjjL626UqnjJVynn+LuXQ=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:29.940932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:29.951353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-dccaf2ab-9f3c-4ed8-a5e7-f3d30f1bbc7c tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Getting quotas for project f753981cf9264d27b16090d7499bf372. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:03:29.959073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-dccaf2ab-9f3c-4ed8-a5e7-f3d30f1bbc7c tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Getting quotas for user 176b78609fe64a958eb12cddae83c0b9 and project f753981cf9264d27b16090d7499bf372. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:03:29.973000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:30.074181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b020492f-42e9-44af-a7d4-875c42073359 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:30.075410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b020492f-42e9-44af-a7d4-875c42073359 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:30.085058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b020492f-42e9-44af-a7d4-875c42073359 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.085813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b020492f-42e9-44af-a7d4-875c42073359 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.087576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b020492f-42e9-44af-a7d4-875c42073359 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.093047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b020492f-42e9-44af-a7d4-875c42073359 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.093047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b020492f-42e9-44af-a7d4-875c42073359 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.093047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b020492f-42e9-44af-a7d4-875c42073359 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.114747 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dccaf2ab-9f3c-4ed8-a5e7-f3d30f1bbc7c tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.187454 Sep 06 11:03:30.117244 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1464/2900] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Sep 6 11:03:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 191 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 11:03:30.131142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c897f469-59ca-47b1-a769-3e316cad8c87 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:30.132194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c897f469-59ca-47b1-a769-3e316cad8c87 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:30.140919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c897f469-59ca-47b1-a769-3e316cad8c87 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.141817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c897f469-59ca-47b1-a769-3e316cad8c87 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.142631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c897f469-59ca-47b1-a769-3e316cad8c87 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.143717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c897f469-59ca-47b1-a769-3e316cad8c87 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.144459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c897f469-59ca-47b1-a769-3e316cad8c87 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.145054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c897f469-59ca-47b1-a769-3e316cad8c87 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.365849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b020492f-42e9-44af-a7d4-875c42073359 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:30.385639 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b020492f-42e9-44af-a7d4-875c42073359 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.315150 Sep 06 11:03:30.403105 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1437/2901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:30 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:30.417343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c897f469-59ca-47b1-a769-3e316cad8c87 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:30.424771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-28f7263b-f437-4dd9-80e8-76711641eb89 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:30.426413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-28f7263b-f437-4dd9-80e8-76711641eb89 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 03a0857e-06d2-4767-85e9-8fd3b2fe0103] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:30.432508 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c897f469-59ca-47b1-a769-3e316cad8c87 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1504 microversion: 2.1 time: 0.313380 Sep 06 11:03:30.433373 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1465/2902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:30 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:30.447975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c36803b-2724-42d8-ad25-8da25f8d38ab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:30.448547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28f7263b-f437-4dd9-80e8-76711641eb89 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.449125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4c36803b-2724-42d8-ad25-8da25f8d38ab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:30.449986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28f7263b-f437-4dd9-80e8-76711641eb89 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.450441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28f7263b-f437-4dd9-80e8-76711641eb89 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.454233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28f7263b-f437-4dd9-80e8-76711641eb89 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.456455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28f7263b-f437-4dd9-80e8-76711641eb89 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.457582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28f7263b-f437-4dd9-80e8-76711641eb89 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.458668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c36803b-2724-42d8-ad25-8da25f8d38ab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.459431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c36803b-2724-42d8-ad25-8da25f8d38ab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.460041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c36803b-2724-42d8-ad25-8da25f8d38ab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.460927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c36803b-2724-42d8-ad25-8da25f8d38ab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.461706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c36803b-2724-42d8-ad25-8da25f8d38ab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.462322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c36803b-2724-42d8-ad25-8da25f8d38ab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.485897 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-28f7263b-f437-4dd9-80e8-76711641eb89 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] HTTP exception thrown: Instance 03a0857e-06d2-4767-85e9-8fd3b2fe0103 could not be found. Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-28f7263b-f437-4dd9-80e8-76711641eb89 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Request method failure captured: Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 HTTP/1.1 Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyhK9jZtW1DNORfwfRpR85Y8c-_tMHtG3Zvmm1PUkx_8Hh78J7D07mpIe0VOjywIx27PuMyL2q8quTjVO48e84bIJD3s_LW5pTYmlujPS4_Fm-TChnjJiUdBV3w5il4JD3oVz9FhIsPv7eYq78jkLQs8CmEWHfViPL5Ic4yWhP1Daig Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}] Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 9e84745e5df647d1921e8d1ffc08711c Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 03a0857e-06d2-4767-85e9-8fd3b2fe0103 could not be found. Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '03a0857e-06d2-4767-85e9-8fd3b2fe0103'} Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a0857e-06d2-4767-85e9-8fd3b2fe0103 could not be found. Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a0857e-06d2-4767-85e9-8fd3b2fe0103 could not be found. Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:30.487636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:30.493343 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:30.493343 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:30.493343 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:30.493343 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:03:30.493343 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:03:30.493343 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a0857e-06d2-4767-85e9-8fd3b2fe0103 could not be found. Sep 06 11:03:30.493343 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:30.496709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-28f7263b-f437-4dd9-80e8-76711641eb89 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Returning 404 to user: Instance 03a0857e-06d2-4767-85e9-8fd3b2fe0103 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:03:30.497720 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-28f7263b-f437-4dd9-80e8-76711641eb89 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103" status: 404 len: 111 microversion: 2.1 time: 0.093465 Sep 06 11:03:30.503140 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1438/2903] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:30 2022] GET /compute/v2.1/servers/03a0857e-06d2-4767-85e9-8fd3b2fe0103 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:03:30.509820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a46cd874-eaf6-49b9-9e9c-154d0ba468c3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:30.512503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a46cd874-eaf6-49b9-9e9c-154d0ba468c3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:30.517609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a46cd874-eaf6-49b9-9e9c-154d0ba468c3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.518146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a46cd874-eaf6-49b9-9e9c-154d0ba468c3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.518599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a46cd874-eaf6-49b9-9e9c-154d0ba468c3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.519396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a46cd874-eaf6-49b9-9e9c-154d0ba468c3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.520458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a46cd874-eaf6-49b9-9e9c-154d0ba468c3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.520895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a46cd874-eaf6-49b9-9e9c-154d0ba468c3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.760847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4c36803b-2724-42d8-ad25-8da25f8d38ab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:30.770788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a46cd874-eaf6-49b9-9e9c-154d0ba468c3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:30.780196 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4c36803b-2724-42d8-ad25-8da25f8d38ab tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1312 microversion: 2.1 time: 0.338706 Sep 06 11:03:30.783650 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1466/2904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:30 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1312 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:30.788809 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a46cd874-eaf6-49b9-9e9c-154d0ba468c3 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 200 len: 1504 microversion: 2.1 time: 0.283605 Sep 06 11:03:30.789630 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1439/2905] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:30 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:30.797879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c7316467-6a44-4b5c-ae91-da2bf4437234 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:30.798649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c7316467-6a44-4b5c-ae91-da2bf4437234 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:30.805907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7316467-6a44-4b5c-ae91-da2bf4437234 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.807450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7316467-6a44-4b5c-ae91-da2bf4437234 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.807450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7316467-6a44-4b5c-ae91-da2bf4437234 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.808131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7316467-6a44-4b5c-ae91-da2bf4437234 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.808856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7316467-6a44-4b5c-ae91-da2bf4437234 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.809505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7316467-6a44-4b5c-ae91-da2bf4437234 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.812865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-32bdb341-6374-4be1-8a57-f2d86d82e46a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:30.813571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-32bdb341-6374-4be1-8a57-f2d86d82e46a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:30.820681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32bdb341-6374-4be1-8a57-f2d86d82e46a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.821190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32bdb341-6374-4be1-8a57-f2d86d82e46a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.821649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32bdb341-6374-4be1-8a57-f2d86d82e46a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.822366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32bdb341-6374-4be1-8a57-f2d86d82e46a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:30.822829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32bdb341-6374-4be1-8a57-f2d86d82e46a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:30.823849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32bdb341-6374-4be1-8a57-f2d86d82e46a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:30.841507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c7316467-6a44-4b5c-ae91-da2bf4437234 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:03:30.855082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-32bdb341-6374-4be1-8a57-f2d86d82e46a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:03:30.874745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:31.231463 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c7316467-6a44-4b5c-ae91-da2bf4437234 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "DELETE /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 204 len: 0 microversion: 2.1 time: 0.441420 Sep 06 11:03:31.231463 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1467/2906] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:03:30 2022] DELETE /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:03:31.232145 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-32bdb341-6374-4be1-8a57-f2d86d82e46a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 204 len: 0 microversion: 2.1 time: 0.417888 Sep 06 11:03:31.232145 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1440/2907] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:03:30 2022] DELETE /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:03:31.237418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5346085b-2994-46b5-b94f-7dd3d293d1a3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:31.238781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5346085b-2994-46b5-b94f-7dd3d293d1a3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:31.251464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5346085b-2994-46b5-b94f-7dd3d293d1a3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:31.252137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5346085b-2994-46b5-b94f-7dd3d293d1a3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:31.252912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5346085b-2994-46b5-b94f-7dd3d293d1a3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:31.253892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5346085b-2994-46b5-b94f-7dd3d293d1a3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:31.254650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5346085b-2994-46b5-b94f-7dd3d293d1a3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:31.257250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5346085b-2994-46b5-b94f-7dd3d293d1a3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:31.259479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-4ac7c337-6405-4f50-8c89-78d8661a3ecd req-8783d39f-3da8-4cda-b742-2c868e7d7ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f3820c-e654-4eca-98de-9c5b2ec61763", "name": "network-vif-plugged", "status": "completed", "tag": "85f92e4a-b017-486e-a2da-1f2effdf2520"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:31.273409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4ac7c337-6405-4f50-8c89-78d8661a3ecd req-8783d39f-3da8-4cda-b742-2c868e7d7ee3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:31.274308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4ac7c337-6405-4f50-8c89-78d8661a3ecd req-8783d39f-3da8-4cda-b742-2c868e7d7ee3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:31.275121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4ac7c337-6405-4f50-8c89-78d8661a3ecd req-8783d39f-3da8-4cda-b742-2c868e7d7ee3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:31.290376 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-4ac7c337-6405-4f50-8c89-78d8661a3ecd req-8783d39f-3da8-4cda-b742-2c868e7d7ee3 service nova] Creating event network-vif-plugged:85f92e4a-b017-486e-a2da-1f2effdf2520 for instance b3f3820c-e654-4eca-98de-9c5b2ec61763 on nch1-master-1 Sep 06 11:03:31.298110 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-4ac7c337-6405-4f50-8c89-78d8661a3ecd req-8783d39f-3da8-4cda-b742-2c868e7d7ee3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067901 Sep 06 11:03:31.299727 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1468/2908] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:31.400084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1660270617", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "2e14709a-777d-42eb-b577-4fb177f97dc8"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:31.470001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] validate_networks() for [('2e14709a-777d-42eb-b577-4fb177f97dc8', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:03:31.624606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5346085b-2994-46b5-b94f-7dd3d293d1a3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:31.633445 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5346085b-2994-46b5-b94f-7dd3d293d1a3 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1473 microversion: 2.1 time: 0.400746 Sep 06 11:03:31.634023 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1441/2909] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:31 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1473 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:31.638557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-98b71559-c8d9-4856-8580-5cef79e38c97 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:31.639188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-98b71559-c8d9-4856-8580-5cef79e38c97 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:31.645814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98b71559-c8d9-4856-8580-5cef79e38c97 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:31.646565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98b71559-c8d9-4856-8580-5cef79e38c97 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:31.647003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98b71559-c8d9-4856-8580-5cef79e38c97 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:31.647724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98b71559-c8d9-4856-8580-5cef79e38c97 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:31.648187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98b71559-c8d9-4856-8580-5cef79e38c97 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:31.648619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98b71559-c8d9-4856-8580-5cef79e38c97 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:31.862035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-98b71559-c8d9-4856-8580-5cef79e38c97 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:31.870715 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-98b71559-c8d9-4856-8580-5cef79e38c97 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.235662 Sep 06 11:03:31.871341 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1442/2910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:31 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:31.876199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60ce90fa-edda-41eb-a5ea-d833d8404cbb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:31.885689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-60ce90fa-edda-41eb-a5ea-d833d8404cbb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:31.895507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:31.899537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60ce90fa-edda-41eb-a5ea-d833d8404cbb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:31.908071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60ce90fa-edda-41eb-a5ea-d833d8404cbb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:31.908071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60ce90fa-edda-41eb-a5ea-d833d8404cbb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:31.908071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60ce90fa-edda-41eb-a5ea-d833d8404cbb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:31.908071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60ce90fa-edda-41eb-a5ea-d833d8404cbb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:31.908071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60ce90fa-edda-41eb-a5ea-d833d8404cbb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:32.111289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-60ce90fa-edda-41eb-a5ea-d833d8404cbb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:32.119852 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-60ce90fa-edda-41eb-a5ea-d833d8404cbb tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1312 microversion: 2.1 time: 0.247461 Sep 06 11:03:32.120704 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1443/2911] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:31 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:32.218833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:03:32.219561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:03:32.220271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:03:32.220787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:03:32.221702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:03:32.232025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:32.232681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:32.233615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:32.234246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:32.234944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:32.236084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:32.261696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Getting quotas for project 0e8540c8171e480b83fd68fbb5f159be. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:03:32.268521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Getting quotas for user 00e93a2f8ed643ba8bc92b4def1ce7f3 and project 0e8540c8171e480b83fd68fbb5f159be. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:03:32.284329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:03:32.296720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:03:32.468618 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8b5c09e9-fe3d-45b5-a18a-355ff8e5d317 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.074681 Sep 06 11:03:32.476190 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1469/2912] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:03:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:03:32.481372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2820e4ce-ff68-49b9-8bfc-fabc22d04226 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:32.481994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2820e4ce-ff68-49b9-8bfc-fabc22d04226 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:32.568400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2820e4ce-ff68-49b9-8bfc-fabc22d04226 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:32.575346 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2820e4ce-ff68-49b9-8bfc-fabc22d04226 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1218 microversion: 2.1 time: 0.097996 Sep 06 11:03:32.575920 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1444/2913] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:32 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:32.656396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-00946c83-ed73-4b5e-890d-570eb90ccbca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:32.657024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-00946c83-ed73-4b5e-890d-570eb90ccbca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:32.666704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00946c83-ed73-4b5e-890d-570eb90ccbca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:32.667222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00946c83-ed73-4b5e-890d-570eb90ccbca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:32.667669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00946c83-ed73-4b5e-890d-570eb90ccbca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:32.668375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00946c83-ed73-4b5e-890d-570eb90ccbca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:32.669109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00946c83-ed73-4b5e-890d-570eb90ccbca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:32.669319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00946c83-ed73-4b5e-890d-570eb90ccbca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:32.855963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-00946c83-ed73-4b5e-890d-570eb90ccbca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:32.864122 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-00946c83-ed73-4b5e-890d-570eb90ccbca tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1473 microversion: 2.1 time: 0.211702 Sep 06 11:03:32.864701 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1470/2914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:32 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1473 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:32.894884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0538d9e6-9c73-4250-baaf-8087e8dbf5bf tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:32.895579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0538d9e6-9c73-4250-baaf-8087e8dbf5bf tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:32.901917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0538d9e6-9c73-4250-baaf-8087e8dbf5bf tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:32.902464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0538d9e6-9c73-4250-baaf-8087e8dbf5bf tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:32.902917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0538d9e6-9c73-4250-baaf-8087e8dbf5bf tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:32.905010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0538d9e6-9c73-4250-baaf-8087e8dbf5bf tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:32.905010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0538d9e6-9c73-4250-baaf-8087e8dbf5bf tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:32.905010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0538d9e6-9c73-4250-baaf-8087e8dbf5bf tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:33.061421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0538d9e6-9c73-4250-baaf-8087e8dbf5bf tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:33.093888 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0538d9e6-9c73-4250-baaf-8087e8dbf5bf tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.203713 Sep 06 11:03:33.111865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2120308397", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "91368869-b6a8-41c1-8f58-e1e8fd74b0a8"}, {"port": "6091afbd-6e3a-48d4-9bd0-a35e1dc72ec0", "tag": "port-1"}, {"port": "cbcd40f2-ac60-4973-9209-912e9fcab7d2", "tag": "port-2"}, {"uuid": "e29a7347-2ec8-4812-8309-478cb5fefc7d", "tag": "net-1"}, {"uuid": "e29a7347-2ec8-4812-8309-478cb5fefc7d"}, {"uuid": "f7de3808-8c26-45e4-9203-d20168f13f62", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f7de3808-8c26-45e4-9203-d20168f13f62", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "07bb7589-fa11-4232-8086-c15cca8ad494", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "6fa4f767-334d-44e6-a00b-ae05aa708fde", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "97c4f2af-7999-4949-95b8-1d95f5cb1b56", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1578803869"}], "key_name": "tempest-keypair-1585845559", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:33.115873 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1445/2915] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:32 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:33.147175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-221bd8e2-e076-4cac-bf3f-1f2bd0f68b19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:33.148905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-221bd8e2-e076-4cac-bf3f-1f2bd0f68b19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:33.156321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-221bd8e2-e076-4cac-bf3f-1f2bd0f68b19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:33.156938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-221bd8e2-e076-4cac-bf3f-1f2bd0f68b19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:33.157542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-221bd8e2-e076-4cac-bf3f-1f2bd0f68b19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:33.158930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-221bd8e2-e076-4cac-bf3f-1f2bd0f68b19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:33.159998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-221bd8e2-e076-4cac-bf3f-1f2bd0f68b19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:33.160962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-221bd8e2-e076-4cac-bf3f-1f2bd0f68b19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:33.301855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] validate_networks() for [('91368869-b6a8-41c1-8f58-e1e8fd74b0a8', None, None, None, None, None), (None, None, '6091afbd-6e3a-48d4-9bd0-a35e1dc72ec0', None, None, None), (None, None, 'cbcd40f2-ac60-4973-9209-912e9fcab7d2', None, None, None), ('e29a7347-2ec8-4812-8309-478cb5fefc7d', None, None, None, None, None), ('e29a7347-2ec8-4812-8309-478cb5fefc7d', None, None, None, None, None), ('f7de3808-8c26-45e4-9203-d20168f13f62', '10.2.2.100', None, None, None, None), ('f7de3808-8c26-45e4-9203-d20168f13f62', '10.2.2.200', None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:03:33.385334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-221bd8e2-e076-4cac-bf3f-1f2bd0f68b19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:33.398469 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-221bd8e2-e076-4cac-bf3f-1f2bd0f68b19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1461 microversion: 2.1 time: 0.257162 Sep 06 11:03:33.399845 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1446/2916] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:33 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1461 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:33.421034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7c0926aa-7f23-4210-a5e0-8c316657995d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:33.421660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7c0926aa-7f23-4210-a5e0-8c316657995d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:33.427802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c0926aa-7f23-4210-a5e0-8c316657995d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:33.428297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c0926aa-7f23-4210-a5e0-8c316657995d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:33.428742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c0926aa-7f23-4210-a5e0-8c316657995d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:33.429629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c0926aa-7f23-4210-a5e0-8c316657995d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:33.430096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c0926aa-7f23-4210-a5e0-8c316657995d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:33.430534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c0926aa-7f23-4210-a5e0-8c316657995d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:33.685032 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7c0926aa-7f23-4210-a5e0-8c316657995d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1612 microversion: 2.1 time: 0.267472 Sep 06 11:03:33.685843 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1447/2917] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:33 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1612 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:33.690171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d817d48f-92c8-4c9c-a295-8f81a4dbf821 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:33.690791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d817d48f-92c8-4c9c-a295-8f81a4dbf821 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:33.704246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d817d48f-92c8-4c9c-a295-8f81a4dbf821 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:33.708277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d817d48f-92c8-4c9c-a295-8f81a4dbf821 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:33.708277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d817d48f-92c8-4c9c-a295-8f81a4dbf821 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:33.708277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d817d48f-92c8-4c9c-a295-8f81a4dbf821 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:33.708277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d817d48f-92c8-4c9c-a295-8f81a4dbf821 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:33.708277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d817d48f-92c8-4c9c-a295-8f81a4dbf821 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:33.806548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d817d48f-92c8-4c9c-a295-8f81a4dbf821 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:33.817261 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d817d48f-92c8-4c9c-a295-8f81a4dbf821 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1222 microversion: 2.1 time: 0.129747 Sep 06 11:03:33.818182 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1448/2918] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:33 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:33.843531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f4cebd2e-9a87-456e-ab22-fea06475263d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:33.844262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f4cebd2e-9a87-456e-ab22-fea06475263d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:33.852523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4cebd2e-9a87-456e-ab22-fea06475263d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:33.853271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4cebd2e-9a87-456e-ab22-fea06475263d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:33.853912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4cebd2e-9a87-456e-ab22-fea06475263d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:33.854651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4cebd2e-9a87-456e-ab22-fea06475263d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:33.855136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4cebd2e-9a87-456e-ab22-fea06475263d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:33.863584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4cebd2e-9a87-456e-ab22-fea06475263d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:33.904971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f4cebd2e-9a87-456e-ab22-fea06475263d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3320982894964d85bef7eaa13a2f72ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d99cfecc7d499ea8a478b100e9b061', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:33.905949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f4cebd2e-9a87-456e-ab22-fea06475263d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] flavor_id is None. Assuming migration. {{(pid=140875) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 06 11:03:33.906817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f4cebd2e-9a87-456e-ab22-fea06475263d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140875) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:03:34.374251 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f4cebd2e-9a87-456e-ab22-fea06475263d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763/action" status: 202 len: 0 microversion: 2.1 time: 0.554423 Sep 06 11:03:34.376193 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1449/2919] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:03:33 2022] POST /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:03:34.391702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d96e00fa-8b79-4df3-93a3-359f4a46136f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:34.392415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d96e00fa-8b79-4df3-93a3-359f4a46136f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:34.402463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d96e00fa-8b79-4df3-93a3-359f4a46136f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:34.404018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d96e00fa-8b79-4df3-93a3-359f4a46136f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:34.413880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d96e00fa-8b79-4df3-93a3-359f4a46136f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:34.414972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d96e00fa-8b79-4df3-93a3-359f4a46136f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:34.415554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d96e00fa-8b79-4df3-93a3-359f4a46136f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:34.415958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d96e00fa-8b79-4df3-93a3-359f4a46136f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:34.872302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d96e00fa-8b79-4df3-93a3-359f4a46136f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:34.888878 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d96e00fa-8b79-4df3-93a3-359f4a46136f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 200 len: 1473 microversion: 2.1 time: 0.507481 Sep 06 11:03:34.903672 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1450/2920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:34 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 1473 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:34.910797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-302d1bfc-85cc-4657-9292-050c7dfcea74 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:34.914416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-302d1bfc-85cc-4657-9292-050c7dfcea74 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:34.931411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-302d1bfc-85cc-4657-9292-050c7dfcea74 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:34.931939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-302d1bfc-85cc-4657-9292-050c7dfcea74 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:34.932403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-302d1bfc-85cc-4657-9292-050c7dfcea74 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:34.933145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-302d1bfc-85cc-4657-9292-050c7dfcea74 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:34.937828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-302d1bfc-85cc-4657-9292-050c7dfcea74 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:34.938497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-302d1bfc-85cc-4657-9292-050c7dfcea74 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:35.375644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-302d1bfc-85cc-4657-9292-050c7dfcea74 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:35.380475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:35.402792 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-302d1bfc-85cc-4657-9292-050c7dfcea74 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.497883 Sep 06 11:03:35.403675 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1451/2921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:34 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:35.442385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3f0cae82-8f1e-4c1e-8591-0212715e8d7b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:35.445704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3f0cae82-8f1e-4c1e-8591-0212715e8d7b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:35.481230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f0cae82-8f1e-4c1e-8591-0212715e8d7b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:35.487726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f0cae82-8f1e-4c1e-8591-0212715e8d7b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:35.495820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f0cae82-8f1e-4c1e-8591-0212715e8d7b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:35.495820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f0cae82-8f1e-4c1e-8591-0212715e8d7b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:35.495820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f0cae82-8f1e-4c1e-8591-0212715e8d7b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:35.495820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f0cae82-8f1e-4c1e-8591-0212715e8d7b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:36.388651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3f0cae82-8f1e-4c1e-8591-0212715e8d7b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:36.397829 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3f0cae82-8f1e-4c1e-8591-0212715e8d7b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1470 microversion: 2.1 time: 0.976345 Sep 06 11:03:36.398414 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1452/2922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:35 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1470 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:36.403036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-fb6c44a8-a0f1-4d08-8960-0bf4bb102649 req-281a2c45-a6ed-4942-a883-7e70d1b6cf3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e806fa-6279-4cf1-b884-55a5a6437f44", "name": "network-vif-deleted", "tag": "3e107cf1-da4c-4509-9df2-ae5edb4a12db"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:36.413931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fb6c44a8-a0f1-4d08-8960-0bf4bb102649 req-281a2c45-a6ed-4942-a883-7e70d1b6cf3e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:36.413931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fb6c44a8-a0f1-4d08-8960-0bf4bb102649 req-281a2c45-a6ed-4942-a883-7e70d1b6cf3e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:36.414224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fb6c44a8-a0f1-4d08-8960-0bf4bb102649 req-281a2c45-a6ed-4942-a883-7e70d1b6cf3e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:36.428278 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-fb6c44a8-a0f1-4d08-8960-0bf4bb102649 req-281a2c45-a6ed-4942-a883-7e70d1b6cf3e service nova] Creating event network-vif-deleted:3e107cf1-da4c-4509-9df2-ae5edb4a12db for instance 89e806fa-6279-4cf1-b884-55a5a6437f44 on nch2-master-1 Sep 06 11:03:36.434036 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-fb6c44a8-a0f1-4d08-8960-0bf4bb102649 req-281a2c45-a6ed-4942-a883-7e70d1b6cf3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034250 Sep 06 11:03:36.447697 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1453/2923] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:36.447697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0658b3e6-448d-415d-94fd-0dc58efd6b4d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:36.447697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0658b3e6-448d-415d-94fd-0dc58efd6b4d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:36.448466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0658b3e6-448d-415d-94fd-0dc58efd6b4d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:36.448466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0658b3e6-448d-415d-94fd-0dc58efd6b4d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:36.448834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0658b3e6-448d-415d-94fd-0dc58efd6b4d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:36.449744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0658b3e6-448d-415d-94fd-0dc58efd6b4d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:36.450208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0658b3e6-448d-415d-94fd-0dc58efd6b4d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:36.450644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0658b3e6-448d-415d-94fd-0dc58efd6b4d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:36.658483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0658b3e6-448d-415d-94fd-0dc58efd6b4d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:36.668171 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0658b3e6-448d-415d-94fd-0dc58efd6b4d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1276 microversion: 2.1 time: 0.231986 Sep 06 11:03:36.669011 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1454/2924] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:36 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:36.675077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-51a745f0-d878-4282-9fbc-b2a65f983843 req-53b01264-1141-4c39-8833-a95407f46310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d6ab04-f643-4697-b4dd-3bed20fc385c", "name": "network-vif-deleted", "tag": "d8da94dc-fb90-40ca-8ca2-a52292ba2029"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:36.687454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-51a745f0-d878-4282-9fbc-b2a65f983843 req-53b01264-1141-4c39-8833-a95407f46310 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:36.688262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-51a745f0-d878-4282-9fbc-b2a65f983843 req-53b01264-1141-4c39-8833-a95407f46310 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:36.688968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-51a745f0-d878-4282-9fbc-b2a65f983843 req-53b01264-1141-4c39-8833-a95407f46310 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:36.701104 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-51a745f0-d878-4282-9fbc-b2a65f983843 req-53b01264-1141-4c39-8833-a95407f46310 service nova] Creating event network-vif-deleted:d8da94dc-fb90-40ca-8ca2-a52292ba2029 for instance d8d6ab04-f643-4697-b4dd-3bed20fc385c on nch2-master-1 Sep 06 11:03:36.707786 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-51a745f0-d878-4282-9fbc-b2a65f983843 req-53b01264-1141-4c39-8833-a95407f46310 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037386 Sep 06 11:03:36.708884 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1455/2925] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:36.714419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-acac5be1-aac7-4133-944c-2ca59bd13534 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:36.715167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-acac5be1-aac7-4133-944c-2ca59bd13534 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 89e806fa-6279-4cf1-b884-55a5a6437f44] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:36.721546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acac5be1-aac7-4133-944c-2ca59bd13534 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:36.721924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acac5be1-aac7-4133-944c-2ca59bd13534 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:36.723132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acac5be1-aac7-4133-944c-2ca59bd13534 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:36.723970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acac5be1-aac7-4133-944c-2ca59bd13534 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:36.724438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acac5be1-aac7-4133-944c-2ca59bd13534 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:36.724870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acac5be1-aac7-4133-944c-2ca59bd13534 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:36.740334 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-acac5be1-aac7-4133-944c-2ca59bd13534 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] HTTP exception thrown: Instance 89e806fa-6279-4cf1-b884-55a5a6437f44 could not be found. Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-acac5be1-aac7-4133-944c-2ca59bd13534 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Request method failure captured: Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 HTTP/1.1 Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyhK9jZtW1DNORfwfRpR85Y8c-_tMHtG3Zvmm1PUkx_8Hh78J7D07mpIe0VOjywIx27PuMyL2q8quTjVO48e84bIJD3s_LW5pTYmlujPS4_Fm-TChnjJiUdBV3w5il4JD3oVz9FhIsPv7eYq78jkLQs8CmEWHfViPL5Ic4yWhP1Daig Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}] Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 9e84745e5df647d1921e8d1ffc08711c Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 89e806fa-6279-4cf1-b884-55a5a6437f44 could not be found. Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '89e806fa-6279-4cf1-b884-55a5a6437f44'} Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89e806fa-6279-4cf1-b884-55a5a6437f44 could not be found. Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89e806fa-6279-4cf1-b884-55a5a6437f44 could not be found. Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:36.742020 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:36.746514 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:36.746514 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:36.746514 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:36.746514 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:03:36.746514 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:03:36.746514 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89e806fa-6279-4cf1-b884-55a5a6437f44 could not be found. Sep 06 11:03:36.746514 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:36.746514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-acac5be1-aac7-4133-944c-2ca59bd13534 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Returning 404 to user: Instance 89e806fa-6279-4cf1-b884-55a5a6437f44 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:03:36.746514 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-acac5be1-aac7-4133-944c-2ca59bd13534 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44" status: 404 len: 111 microversion: 2.1 time: 0.034698 Sep 06 11:03:36.746514 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1456/2926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:36 2022] GET /compute/v2.1/servers/89e806fa-6279-4cf1-b884-55a5a6437f44 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:03:36.751284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-51e0b79a-00b3-4584-a932-c3bfa3fae17a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:36.751898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-51e0b79a-00b3-4584-a932-c3bfa3fae17a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:36.760782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51e0b79a-00b3-4584-a932-c3bfa3fae17a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:36.761316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51e0b79a-00b3-4584-a932-c3bfa3fae17a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:36.761810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51e0b79a-00b3-4584-a932-c3bfa3fae17a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:36.764512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51e0b79a-00b3-4584-a932-c3bfa3fae17a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:36.764512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51e0b79a-00b3-4584-a932-c3bfa3fae17a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:36.764512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51e0b79a-00b3-4584-a932-c3bfa3fae17a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:37.008278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-51e0b79a-00b3-4584-a932-c3bfa3fae17a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:37.016197 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-51e0b79a-00b3-4584-a932-c3bfa3fae17a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.269834 Sep 06 11:03:37.016770 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1457/2927] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:36 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:37.024188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d5698d83-af6c-48f2-a6dc-d8aa2ab5405b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:37.025212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d5698d83-af6c-48f2-a6dc-d8aa2ab5405b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: d0610e78-f996-4342-a0c8-8ef481539a39] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:37.031693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5698d83-af6c-48f2-a6dc-d8aa2ab5405b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:37.032421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5698d83-af6c-48f2-a6dc-d8aa2ab5405b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:37.033025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5698d83-af6c-48f2-a6dc-d8aa2ab5405b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:37.033942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5698d83-af6c-48f2-a6dc-d8aa2ab5405b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:37.034697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5698d83-af6c-48f2-a6dc-d8aa2ab5405b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:37.035382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5698d83-af6c-48f2-a6dc-d8aa2ab5405b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:37.061898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d5698d83-af6c-48f2-a6dc-d8aa2ab5405b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: d0610e78-f996-4342-a0c8-8ef481539a39] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:03:37.550182 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d5698d83-af6c-48f2-a6dc-d8aa2ab5405b tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d0610e78-f996-4342-a0c8-8ef481539a39" status: 204 len: 0 microversion: 2.1 time: 0.531683 Sep 06 11:03:37.552269 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1458/2928] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:03:37 2022] DELETE /compute/v2.1/servers/d0610e78-f996-4342-a0c8-8ef481539a39 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:03:37.561185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bc35bf6f-cdac-40f6-a79d-a9110db4e750 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:37.562537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bc35bf6f-cdac-40f6-a79d-a9110db4e750 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:37.572930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc35bf6f-cdac-40f6-a79d-a9110db4e750 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:37.573864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc35bf6f-cdac-40f6-a79d-a9110db4e750 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:37.574505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc35bf6f-cdac-40f6-a79d-a9110db4e750 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:37.580723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc35bf6f-cdac-40f6-a79d-a9110db4e750 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:37.584973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc35bf6f-cdac-40f6-a79d-a9110db4e750 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:37.584973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc35bf6f-cdac-40f6-a79d-a9110db4e750 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:37.859937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bc35bf6f-cdac-40f6-a79d-a9110db4e750 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:37.868916 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bc35bf6f-cdac-40f6-a79d-a9110db4e750 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1470 microversion: 2.1 time: 0.313271 Sep 06 11:03:37.869594 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1459/2929] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:37 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1470 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:37.875174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e8549ff4-7bec-4463-befc-fdc65af68487 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:37.876656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e8549ff4-7bec-4463-befc-fdc65af68487 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:37.893617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8549ff4-7bec-4463-befc-fdc65af68487 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:37.894131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8549ff4-7bec-4463-befc-fdc65af68487 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:37.894760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8549ff4-7bec-4463-befc-fdc65af68487 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:37.895553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8549ff4-7bec-4463-befc-fdc65af68487 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:37.896357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8549ff4-7bec-4463-befc-fdc65af68487 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:37.896953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8549ff4-7bec-4463-befc-fdc65af68487 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:37.940935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e8549ff4-7bec-4463-befc-fdc65af68487 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:03:38.112693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:03:38.117172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:03:38.117952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:03:38.118674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:03:38.119360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:03:38.132888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:38.133841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:38.135035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:38.136080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:38.136838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:38.137488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:38.160899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Getting quotas for project f753981cf9264d27b16090d7499bf372. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:03:38.166942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Getting quotas for user 176b78609fe64a958eb12cddae83c0b9 and project f753981cf9264d27b16090d7499bf372. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:03:38.337856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:03:38.341589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='07bb7589-fa11-4232-8086-c15cca8ad494',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6fa4f767-334d-44e6-a00b-ae05aa708fde',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97c4f2af-7999-4949-95b8-1d95f5cb1b56',volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:03:38.432217 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e8549ff4-7bec-4463-befc-fdc65af68487 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 204 len: 0 microversion: 2.1 time: 0.561235 Sep 06 11:03:38.435508 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1460/2930] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:03:37 2022] DELETE /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:03:38.447287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-03f20fab-d3bb-4cfd-bc0d-e3dad71d67c8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:38.448017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-03f20fab-d3bb-4cfd-bc0d-e3dad71d67c8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:38.454271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03f20fab-d3bb-4cfd-bc0d-e3dad71d67c8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:38.454757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03f20fab-d3bb-4cfd-bc0d-e3dad71d67c8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:38.455685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03f20fab-d3bb-4cfd-bc0d-e3dad71d67c8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:38.457021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03f20fab-d3bb-4cfd-bc0d-e3dad71d67c8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:38.457469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03f20fab-d3bb-4cfd-bc0d-e3dad71d67c8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:38.458740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03f20fab-d3bb-4cfd-bc0d-e3dad71d67c8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:38.616383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-03f20fab-d3bb-4cfd-bc0d-e3dad71d67c8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:38.625030 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-03f20fab-d3bb-4cfd-bc0d-e3dad71d67c8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1318 microversion: 2.1 time: 0.183212 Sep 06 11:03:38.625610 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1461/2931] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:38 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:38.630892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e58d003f-c2d1-489e-ae82-eb8e021f7f34 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:38.631546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e58d003f-c2d1-489e-ae82-eb8e021f7f34 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:38.637922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e58d003f-c2d1-489e-ae82-eb8e021f7f34 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:38.638425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e58d003f-c2d1-489e-ae82-eb8e021f7f34 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:38.638880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e58d003f-c2d1-489e-ae82-eb8e021f7f34 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:38.639797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e58d003f-c2d1-489e-ae82-eb8e021f7f34 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:38.641182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e58d003f-c2d1-489e-ae82-eb8e021f7f34 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:38.642078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e58d003f-c2d1-489e-ae82-eb8e021f7f34 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:38.884370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e58d003f-c2d1-489e-ae82-eb8e021f7f34 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:38.894365 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e58d003f-c2d1-489e-ae82-eb8e021f7f34 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.267548 Sep 06 11:03:38.895649 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1462/2932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:38 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:38.901258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8eaffa10-8fed-49ef-a329-f635194b268d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:38.901886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8eaffa10-8fed-49ef-a329-f635194b268d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: d0610e78-f996-4342-a0c8-8ef481539a39] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:38.908894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eaffa10-8fed-49ef-a329-f635194b268d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:38.912172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eaffa10-8fed-49ef-a329-f635194b268d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:38.912725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eaffa10-8fed-49ef-a329-f635194b268d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:38.913561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eaffa10-8fed-49ef-a329-f635194b268d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:38.914152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eaffa10-8fed-49ef-a329-f635194b268d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:38.914737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eaffa10-8fed-49ef-a329-f635194b268d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:39.176515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8eaffa10-8fed-49ef-a329-f635194b268d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:39.186288 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8eaffa10-8fed-49ef-a329-f635194b268d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/d0610e78-f996-4342-a0c8-8ef481539a39" status: 200 len: 1474 microversion: 2.1 time: 0.289390 Sep 06 11:03:39.193374 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1463/2933] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:38 2022] GET /compute/v2.1/servers/d0610e78-f996-4342-a0c8-8ef481539a39 => generated 1474 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:39.202476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c639ed24-d334-4882-8676-b1c83065dccd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:39.205656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c639ed24-d334-4882-8676-b1c83065dccd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:39.220576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c639ed24-d334-4882-8676-b1c83065dccd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:39.222879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c639ed24-d334-4882-8676-b1c83065dccd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:39.227464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c639ed24-d334-4882-8676-b1c83065dccd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:39.228390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c639ed24-d334-4882-8676-b1c83065dccd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:39.228974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c639ed24-d334-4882-8676-b1c83065dccd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:39.229522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c639ed24-d334-4882-8676-b1c83065dccd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:39.455481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c639ed24-d334-4882-8676-b1c83065dccd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:39.464912 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c639ed24-d334-4882-8676-b1c83065dccd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1470 microversion: 2.1 time: 0.271225 Sep 06 11:03:39.468637 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1464/2934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:39 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1470 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:39.650980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-38876491-9612-4ac0-a6ff-155b72b31968 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:39.657272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-38876491-9612-4ac0-a6ff-155b72b31968 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:39.672319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38876491-9612-4ac0-a6ff-155b72b31968 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:39.672902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38876491-9612-4ac0-a6ff-155b72b31968 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:39.673274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38876491-9612-4ac0-a6ff-155b72b31968 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:39.683495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38876491-9612-4ac0-a6ff-155b72b31968 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:39.684068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38876491-9612-4ac0-a6ff-155b72b31968 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:39.688548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38876491-9612-4ac0-a6ff-155b72b31968 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:39.943755 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-254f5806-449f-4fa8-b8b5-b00f1d47f46a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.846995 Sep 06 11:03:39.956071 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1471/2935] 10.222.0.20 () {62 vars in 1189 bytes} [Tue Sep 6 11:03:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 6860 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 06 11:03:39.967685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-31872978-97d6-417f-b460-a0e6bec9f9bd req-0a54ceeb-e712-4ba8-b1dd-f6449b7f5e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0610e78-f996-4342-a0c8-8ef481539a39", "name": "network-vif-deleted", "tag": "98be110d-bd33-4cda-857e-725e035040fc"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:39.998161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-31872978-97d6-417f-b460-a0e6bec9f9bd req-0a54ceeb-e712-4ba8-b1dd-f6449b7f5e2a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:40.000790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-31872978-97d6-417f-b460-a0e6bec9f9bd req-0a54ceeb-e712-4ba8-b1dd-f6449b7f5e2a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:40.002190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-31872978-97d6-417f-b460-a0e6bec9f9bd req-0a54ceeb-e712-4ba8-b1dd-f6449b7f5e2a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:40.057568 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-31872978-97d6-417f-b460-a0e6bec9f9bd req-0a54ceeb-e712-4ba8-b1dd-f6449b7f5e2a service nova] Creating event network-vif-deleted:98be110d-bd33-4cda-857e-725e035040fc for instance d0610e78-f996-4342-a0c8-8ef481539a39 on nch2-master-1 Sep 06 11:03:40.072023 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-31872978-97d6-417f-b460-a0e6bec9f9bd req-0a54ceeb-e712-4ba8-b1dd-f6449b7f5e2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113396 Sep 06 11:03:40.075185 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1472/2936] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:40.094525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f035fe24-2f72-4a8c-be26-b011c1e5c87b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:40.119477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f035fe24-2f72-4a8c-be26-b011c1e5c87b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:40.124846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-38876491-9612-4ac0-a6ff-155b72b31968 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:40.147838 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-38876491-9612-4ac0-a6ff-155b72b31968 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1318 microversion: 2.1 time: 0.501080 Sep 06 11:03:40.153541 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1465/2937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:39 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:40.166082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f035fe24-2f72-4a8c-be26-b011c1e5c87b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:40.169206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f035fe24-2f72-4a8c-be26-b011c1e5c87b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:40.170752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2d9a9b54-b00e-4da7-9818-b2d4c03d0ead tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:40.171231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f035fe24-2f72-4a8c-be26-b011c1e5c87b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:40.172845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f035fe24-2f72-4a8c-be26-b011c1e5c87b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:40.173534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2d9a9b54-b00e-4da7-9818-b2d4c03d0ead tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:40.176251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f035fe24-2f72-4a8c-be26-b011c1e5c87b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:40.176728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f035fe24-2f72-4a8c-be26-b011c1e5c87b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:40.413636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2d9a9b54-b00e-4da7-9818-b2d4c03d0ead tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:40.433477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2d9a9b54-b00e-4da7-9818-b2d4c03d0ead tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:40.437320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2d9a9b54-b00e-4da7-9818-b2d4c03d0ead tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:40.441857 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2d9a9b54-b00e-4da7-9818-b2d4c03d0ead tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1286 microversion: 2.32 time: 0.284438 Sep 06 11:03:40.442547 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1466/2938] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:40 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1286 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:03:40.458963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:40.459987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: d0610e78-f996-4342-a0c8-8ef481539a39] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:40.482252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:40.484283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:40.485583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:40.486709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:40.494480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:40.494480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:40.547791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:40.548440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:40.549598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:40.551869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lazy-loading 'fault' on Instance uuid d0610e78-f996-4342-a0c8-8ef481539a39 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:03:40.679836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:40.684923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:40.692392 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0ff0cee4-371d-459c-8230-9a10ff71096d tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/d0610e78-f996-4342-a0c8-8ef481539a39" status: 200 len: 1308 microversion: 2.1 time: 0.246421 Sep 06 11:03:40.693193 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1467/2939] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:40 2022] GET /compute/v2.1/servers/d0610e78-f996-4342-a0c8-8ef481539a39 => generated 1308 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:40.699690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1600b791-7570-4a5d-b1a0-c4040631427d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:40.700506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1600b791-7570-4a5d-b1a0-c4040631427d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:40.708991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1600b791-7570-4a5d-b1a0-c4040631427d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:40.709674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1600b791-7570-4a5d-b1a0-c4040631427d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:40.710292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1600b791-7570-4a5d-b1a0-c4040631427d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:40.711245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1600b791-7570-4a5d-b1a0-c4040631427d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:40.711920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1600b791-7570-4a5d-b1a0-c4040631427d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:40.712522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1600b791-7570-4a5d-b1a0-c4040631427d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:41.014223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f035fe24-2f72-4a8c-be26-b011c1e5c87b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:41.022532 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f035fe24-2f72-4a8c-be26-b011c1e5c87b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.942301 Sep 06 11:03:41.023438 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1473/2940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:40 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:41.032188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-58a1eff0-39c6-4d80-955a-b755215b3d98 req-8626dfca-afd9-4bbd-89d5-b1e6f34908e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e167a8-c716-47ad-aa17-6ea18b4e9139", "tag": "8b55451f-3f5a-4377-923b-95e9928d1a17"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:41.043562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-58a1eff0-39c6-4d80-955a-b755215b3d98 req-8626dfca-afd9-4bbd-89d5-b1e6f34908e3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:41.044910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-58a1eff0-39c6-4d80-955a-b755215b3d98 req-8626dfca-afd9-4bbd-89d5-b1e6f34908e3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:41.045549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-58a1eff0-39c6-4d80-955a-b755215b3d98 req-8626dfca-afd9-4bbd-89d5-b1e6f34908e3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:41.058758 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-58a1eff0-39c6-4d80-955a-b755215b3d98 req-8626dfca-afd9-4bbd-89d5-b1e6f34908e3 service nova] Creating event network-changed:8b55451f-3f5a-4377-923b-95e9928d1a17 for instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 on nch2-master-1 Sep 06 11:03:41.070494 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-58a1eff0-39c6-4d80-955a-b755215b3d98 req-8626dfca-afd9-4bbd-89d5-b1e6f34908e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045435 Sep 06 11:03:41.071597 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1474/2941] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:41.181511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-94ca9a54-353e-4397-901a-7bbbcefc4578 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:41.182567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-94ca9a54-353e-4397-901a-7bbbcefc4578 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:41.195794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94ca9a54-353e-4397-901a-7bbbcefc4578 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:41.196287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94ca9a54-353e-4397-901a-7bbbcefc4578 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:41.196728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94ca9a54-353e-4397-901a-7bbbcefc4578 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:41.197440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94ca9a54-353e-4397-901a-7bbbcefc4578 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:41.197899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94ca9a54-353e-4397-901a-7bbbcefc4578 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:41.198340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94ca9a54-353e-4397-901a-7bbbcefc4578 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:41.207881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1600b791-7570-4a5d-b1a0-c4040631427d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:41.222878 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1600b791-7570-4a5d-b1a0-c4040631427d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1470 microversion: 2.1 time: 0.527840 Sep 06 11:03:41.241871 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1468/2942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:40 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1470 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:41.477264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e591a683-7bf6-4ea5-ac46-2ad94e91d6bc tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:41.481862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e591a683-7bf6-4ea5-ac46-2ad94e91d6bc tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:41.619073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e591a683-7bf6-4ea5-ac46-2ad94e91d6bc tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:41.627560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e591a683-7bf6-4ea5-ac46-2ad94e91d6bc tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:41.634524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e591a683-7bf6-4ea5-ac46-2ad94e91d6bc tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:41.636184 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e591a683-7bf6-4ea5-ac46-2ad94e91d6bc tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1286 microversion: 2.32 time: 0.167287 Sep 06 11:03:41.639204 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1469/2943] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:41 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1286 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:03:41.721961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8bd09165-afcf-4c42-8a6e-6799c161574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:41.726144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8bd09165-afcf-4c42-8a6e-6799c161574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: d0610e78-f996-4342-a0c8-8ef481539a39] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:41.730065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bd09165-afcf-4c42-8a6e-6799c161574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:41.730921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bd09165-afcf-4c42-8a6e-6799c161574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:41.731694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bd09165-afcf-4c42-8a6e-6799c161574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:41.732577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bd09165-afcf-4c42-8a6e-6799c161574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:41.733305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bd09165-afcf-4c42-8a6e-6799c161574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:41.735063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bd09165-afcf-4c42-8a6e-6799c161574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:41.755461 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-8bd09165-afcf-4c42-8a6e-6799c161574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] HTTP exception thrown: Instance d0610e78-f996-4342-a0c8-8ef481539a39 could not be found. Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8bd09165-afcf-4c42-8a6e-6799c161574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Request method failure captured: Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/d0610e78-f996-4342-a0c8-8ef481539a39 HTTP/1.1 Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyhK9jZtW1DNORfwfRpR85Y8c-_tMHtG3Zvmm1PUkx_8Hh78J7D07mpIe0VOjywIx27PuMyL2q8quTjVO48e84bIJD3s_LW5pTYmlujPS4_Fm-TChnjJiUdBV3w5il4JD3oVz9FhIsPv7eYq78jkLQs8CmEWHfViPL5Ic4yWhP1Daig Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}] Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 9e84745e5df647d1921e8d1ffc08711c Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance d0610e78-f996-4342-a0c8-8ef481539a39 could not be found. Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'd0610e78-f996-4342-a0c8-8ef481539a39'} Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0610e78-f996-4342-a0c8-8ef481539a39 could not be found. Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0610e78-f996-4342-a0c8-8ef481539a39 could not be found. Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:41.759580 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:41.764875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:41.764875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:41.764875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:41.764875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:03:41.764875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:03:41.764875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0610e78-f996-4342-a0c8-8ef481539a39 could not be found. Sep 06 11:03:41.764875 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:41.766855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8bd09165-afcf-4c42-8a6e-6799c161574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Returning 404 to user: Instance d0610e78-f996-4342-a0c8-8ef481539a39 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:03:41.768505 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8bd09165-afcf-4c42-8a6e-6799c161574f tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/d0610e78-f996-4342-a0c8-8ef481539a39" status: 404 len: 111 microversion: 2.1 time: 0.051908 Sep 06 11:03:41.770954 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1470/2944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:41 2022] GET /compute/v2.1/servers/d0610e78-f996-4342-a0c8-8ef481539a39 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:03:41.780997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-996c7eee-191f-480d-9770-0064240476d4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:41.781894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-996c7eee-191f-480d-9770-0064240476d4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:41.788038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-94ca9a54-353e-4397-901a-7bbbcefc4578 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:41.802676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-996c7eee-191f-480d-9770-0064240476d4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:41.803239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-996c7eee-191f-480d-9770-0064240476d4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:41.803699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-996c7eee-191f-480d-9770-0064240476d4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:41.804428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-996c7eee-191f-480d-9770-0064240476d4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:41.804898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-996c7eee-191f-480d-9770-0064240476d4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:41.805672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-996c7eee-191f-480d-9770-0064240476d4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:41.809449 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-94ca9a54-353e-4397-901a-7bbbcefc4578 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1318 microversion: 2.1 time: 0.632888 Sep 06 11:03:41.810078 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1475/2945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:41 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:42.005538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-996c7eee-191f-480d-9770-0064240476d4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:42.026407 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-996c7eee-191f-480d-9770-0064240476d4 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1432 microversion: 2.1 time: 0.251227 Sep 06 11:03:42.030000 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1471/2946] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:41 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1432 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:42.049637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f76759b7-0a82-4217-a239-83974a10b71f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:42.050953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f76759b7-0a82-4217-a239-83974a10b71f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:42.057771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f76759b7-0a82-4217-a239-83974a10b71f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:42.058571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f76759b7-0a82-4217-a239-83974a10b71f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:42.059052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f76759b7-0a82-4217-a239-83974a10b71f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:42.060529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f76759b7-0a82-4217-a239-83974a10b71f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:42.061000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f76759b7-0a82-4217-a239-83974a10b71f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:42.061442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f76759b7-0a82-4217-a239-83974a10b71f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:42.248711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f62fd04e-beb1-43d4-8770-42cc2bc63931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:42.249687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f62fd04e-beb1-43d4-8770-42cc2bc63931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:42.271802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f62fd04e-beb1-43d4-8770-42cc2bc63931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:42.277174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f62fd04e-beb1-43d4-8770-42cc2bc63931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:42.279856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f62fd04e-beb1-43d4-8770-42cc2bc63931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:42.280709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f62fd04e-beb1-43d4-8770-42cc2bc63931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:42.281217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f62fd04e-beb1-43d4-8770-42cc2bc63931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:42.281677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f62fd04e-beb1-43d4-8770-42cc2bc63931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:42.790645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f76759b7-0a82-4217-a239-83974a10b71f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:42.798907 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f76759b7-0a82-4217-a239-83974a10b71f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.754066 Sep 06 11:03:42.799522 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1476/2947] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:42 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:42.804185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-30152951-666b-4ee3-8526-aac7f72daeea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:42.804951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-30152951-666b-4ee3-8526-aac7f72daeea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:42.811601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30152951-666b-4ee3-8526-aac7f72daeea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:42.812107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30152951-666b-4ee3-8526-aac7f72daeea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:42.812647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30152951-666b-4ee3-8526-aac7f72daeea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:42.813255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30152951-666b-4ee3-8526-aac7f72daeea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:42.813793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30152951-666b-4ee3-8526-aac7f72daeea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:42.814180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30152951-666b-4ee3-8526-aac7f72daeea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:42.859375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f62fd04e-beb1-43d4-8770-42cc2bc63931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:42.869619 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f62fd04e-beb1-43d4-8770-42cc2bc63931 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1475 microversion: 2.1 time: 0.625554 Sep 06 11:03:42.893420 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1472/2948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:42 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1475 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:42.897513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-40f437d7-1b57-4924-9a5c-821677887266 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:42.898241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-40f437d7-1b57-4924-9a5c-821677887266 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:42.904833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40f437d7-1b57-4924-9a5c-821677887266 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:42.905606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40f437d7-1b57-4924-9a5c-821677887266 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:42.906342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40f437d7-1b57-4924-9a5c-821677887266 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:42.907474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40f437d7-1b57-4924-9a5c-821677887266 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:42.917863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40f437d7-1b57-4924-9a5c-821677887266 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:42.919103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40f437d7-1b57-4924-9a5c-821677887266 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:42.957433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-30152951-666b-4ee3-8526-aac7f72daeea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:42.970282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-30152951-666b-4ee3-8526-aac7f72daeea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:42.972231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-30152951-666b-4ee3-8526-aac7f72daeea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:42.973761 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-30152951-666b-4ee3-8526-aac7f72daeea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1528 microversion: 2.32 time: 0.173300 Sep 06 11:03:42.974446 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1477/2949] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:42 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1528 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:03:43.053577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:43.054249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:43.061152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:43.061649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:43.062733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:43.067050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:43.067050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:43.067050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:43.086640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-40f437d7-1b57-4924-9a5c-821677887266 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:43.096885 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-40f437d7-1b57-4924-9a5c-821677887266 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1318 microversion: 2.1 time: 0.207880 Sep 06 11:03:43.097442 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1473/2950] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:42 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:43.102354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ed7acc3c-7dd0-48b4-9b85-4107594ab054 req-b68a08d1-9363-43bb-8b2b-1e4637c9b676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7010f81-896a-41e0-a729-74af2811a37f", "name": "network-vif-deleted", "tag": "70cd59e8-08e7-4c5f-9c27-14f487ba2d7a"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:43.102767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:43.103290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:43.103737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:43.104205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lazy-loading 'fault' on Instance uuid e7010f81-896a-41e0-a729-74af2811a37f {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:03:43.112487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ed7acc3c-7dd0-48b4-9b85-4107594ab054 req-b68a08d1-9363-43bb-8b2b-1e4637c9b676 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:43.112970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ed7acc3c-7dd0-48b4-9b85-4107594ab054 req-b68a08d1-9363-43bb-8b2b-1e4637c9b676 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:43.113410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ed7acc3c-7dd0-48b4-9b85-4107594ab054 req-b68a08d1-9363-43bb-8b2b-1e4637c9b676 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:43.125997 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ed7acc3c-7dd0-48b4-9b85-4107594ab054 req-b68a08d1-9363-43bb-8b2b-1e4637c9b676 service nova] Creating event network-vif-deleted:70cd59e8-08e7-4c5f-9c27-14f487ba2d7a for instance e7010f81-896a-41e0-a729-74af2811a37f on nch1-master-1 Sep 06 11:03:43.132299 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ed7acc3c-7dd0-48b4-9b85-4107594ab054 req-b68a08d1-9363-43bb-8b2b-1e4637c9b676 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033108 Sep 06 11:03:43.133152 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1474/2951] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:43.151636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:43.164162 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe5a841a-093c-4fc4-ab17-8bc97dd0a586 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 200 len: 1308 microversion: 2.1 time: 0.110305 Sep 06 11:03:43.164162 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1478/2952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:43 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:43.822425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bca74876-7f7b-4899-8759-e4e1dc9aea2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:43.823171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bca74876-7f7b-4899-8759-e4e1dc9aea2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:43.830403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bca74876-7f7b-4899-8759-e4e1dc9aea2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:43.830900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bca74876-7f7b-4899-8759-e4e1dc9aea2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:43.831407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bca74876-7f7b-4899-8759-e4e1dc9aea2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:43.832120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bca74876-7f7b-4899-8759-e4e1dc9aea2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:43.832588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bca74876-7f7b-4899-8759-e4e1dc9aea2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:43.833024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bca74876-7f7b-4899-8759-e4e1dc9aea2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:43.901244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-704d55d4-3ff9-46b4-bb24-46edd0bebfd6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:43.901869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-704d55d4-3ff9-46b4-bb24-46edd0bebfd6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:43.920542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-704d55d4-3ff9-46b4-bb24-46edd0bebfd6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:43.921400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-704d55d4-3ff9-46b4-bb24-46edd0bebfd6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:43.922047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-704d55d4-3ff9-46b4-bb24-46edd0bebfd6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:43.922955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-704d55d4-3ff9-46b4-bb24-46edd0bebfd6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:43.923607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-704d55d4-3ff9-46b4-bb24-46edd0bebfd6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:43.924206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-704d55d4-3ff9-46b4-bb24-46edd0bebfd6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:44.072252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bca74876-7f7b-4899-8759-e4e1dc9aea2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:44.085224 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bca74876-7f7b-4899-8759-e4e1dc9aea2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.266237 Sep 06 11:03:44.086392 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1475/2953] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:43 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:44.099325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c123efb-c377-4f49-bfa5-304d7dae3452 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:44.101354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3c123efb-c377-4f49-bfa5-304d7dae3452 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:44.119704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c123efb-c377-4f49-bfa5-304d7dae3452 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:44.121467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c123efb-c377-4f49-bfa5-304d7dae3452 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:44.122846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c123efb-c377-4f49-bfa5-304d7dae3452 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:44.125107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c123efb-c377-4f49-bfa5-304d7dae3452 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:44.133096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c123efb-c377-4f49-bfa5-304d7dae3452 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:44.136313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c123efb-c377-4f49-bfa5-304d7dae3452 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:44.164614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-704d55d4-3ff9-46b4-bb24-46edd0bebfd6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:44.190276 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-704d55d4-3ff9-46b4-bb24-46edd0bebfd6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1475 microversion: 2.1 time: 0.280136 Sep 06 11:03:44.190276 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1479/2954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:43 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1475 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:44.190276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3cca6266-3cf0-4cb9-94aa-37228efc3def tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:44.190276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3cca6266-3cf0-4cb9-94aa-37228efc3def tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:44.207770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cca6266-3cf0-4cb9-94aa-37228efc3def tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:44.211168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cca6266-3cf0-4cb9-94aa-37228efc3def tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:44.211168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cca6266-3cf0-4cb9-94aa-37228efc3def tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:44.211168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cca6266-3cf0-4cb9-94aa-37228efc3def tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:44.211168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cca6266-3cf0-4cb9-94aa-37228efc3def tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:44.212315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cca6266-3cf0-4cb9-94aa-37228efc3def tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:44.309393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c123efb-c377-4f49-bfa5-304d7dae3452 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:44.336588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c123efb-c377-4f49-bfa5-304d7dae3452 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:44.339894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c123efb-c377-4f49-bfa5-304d7dae3452 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:44.341955 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3c123efb-c377-4f49-bfa5-304d7dae3452 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1576 microversion: 2.32 time: 0.253928 Sep 06 11:03:44.342715 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1476/2955] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:44 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1576 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:03:44.350728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9f207d7-d10a-4658-a39a-db2e3c67e9b9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:44.354424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c9f207d7-d10a-4658-a39a-db2e3c67e9b9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: e7010f81-896a-41e0-a729-74af2811a37f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:44.362710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9f207d7-d10a-4658-a39a-db2e3c67e9b9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:44.363958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9f207d7-d10a-4658-a39a-db2e3c67e9b9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:44.364444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9f207d7-d10a-4658-a39a-db2e3c67e9b9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:44.365671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9f207d7-d10a-4658-a39a-db2e3c67e9b9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:44.366144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9f207d7-d10a-4658-a39a-db2e3c67e9b9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:44.366586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9f207d7-d10a-4658-a39a-db2e3c67e9b9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:44.384614 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-c9f207d7-d10a-4658-a39a-db2e3c67e9b9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] HTTP exception thrown: Instance e7010f81-896a-41e0-a729-74af2811a37f could not be found. Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9f207d7-d10a-4658-a39a-db2e3c67e9b9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Request method failure captured: Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f HTTP/1.1 Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyhK9jZtW1DNORfwfRpR85Y8c-_tMHtG3Zvmm1PUkx_8Hh78J7D07mpIe0VOjywIx27PuMyL2q8quTjVO48e84bIJD3s_LW5pTYmlujPS4_Fm-TChnjJiUdBV3w5il4JD3oVz9FhIsPv7eYq78jkLQs8CmEWHfViPL5Ic4yWhP1Daig Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}] Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 9e84745e5df647d1921e8d1ffc08711c Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance e7010f81-896a-41e0-a729-74af2811a37f could not be found. Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'e7010f81-896a-41e0-a729-74af2811a37f'} Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7010f81-896a-41e0-a729-74af2811a37f could not be found. Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7010f81-896a-41e0-a729-74af2811a37f could not be found. Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:44.386341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:44.390390 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:44.390390 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:44.390390 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:44.390390 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:03:44.390390 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:03:44.390390 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7010f81-896a-41e0-a729-74af2811a37f could not be found. Sep 06 11:03:44.390390 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:03:44.390390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9f207d7-d10a-4658-a39a-db2e3c67e9b9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Returning 404 to user: Instance e7010f81-896a-41e0-a729-74af2811a37f could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:03:44.390390 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c9f207d7-d10a-4658-a39a-db2e3c67e9b9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f" status: 404 len: 111 microversion: 2.1 time: 0.043862 Sep 06 11:03:44.390390 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1477/2956] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:44 2022] GET /compute/v2.1/servers/e7010f81-896a-41e0-a729-74af2811a37f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:03:44.396959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-381adbbb-7a1b-4605-bc35-ccf986b25d80 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:44.447070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3cca6266-3cf0-4cb9-94aa-37228efc3def tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:44.453456 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3cca6266-3cf0-4cb9-94aa-37228efc3def tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1318 microversion: 2.1 time: 0.272732 Sep 06 11:03:44.454520 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1480/2957] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:44 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:44.581831 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-381adbbb-7a1b-4605-bc35-ccf986b25d80 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/ed7e8173-1d06-4db0-b5ca-598294d2acec" status: 204 len: 0 microversion: 2.1 time: 0.188601 Sep 06 11:03:44.582429 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1478/2958] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:03:44 2022] DELETE /compute/v2.1/os-server-groups/ed7e8173-1d06-4db0-b5ca-598294d2acec => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:03:44.590496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7f02f7e-ba74-4ead-ab0e-85b98b2e5cf0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:44.591030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d7f02f7e-ba74-4ead-ab0e-85b98b2e5cf0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: a3173985-c4ff-4e48-887a-baf5a5da0a9b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:44.597427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7f02f7e-ba74-4ead-ab0e-85b98b2e5cf0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:44.597922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7f02f7e-ba74-4ead-ab0e-85b98b2e5cf0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:44.598369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7f02f7e-ba74-4ead-ab0e-85b98b2e5cf0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:44.599104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7f02f7e-ba74-4ead-ab0e-85b98b2e5cf0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:44.599575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7f02f7e-ba74-4ead-ab0e-85b98b2e5cf0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:44.600117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7f02f7e-ba74-4ead-ab0e-85b98b2e5cf0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:44.636385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d7f02f7e-ba74-4ead-ab0e-85b98b2e5cf0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: a3173985-c4ff-4e48-887a-baf5a5da0a9b] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:03:45.042909 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d7f02f7e-ba74-4ead-ab0e-85b98b2e5cf0 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b" status: 204 len: 0 microversion: 2.1 time: 0.455989 Sep 06 11:03:45.043551 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1481/2959] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:03:44 2022] DELETE /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:03:45.052280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c5b8e09-092e-4a8a-bc7b-f076e0ac0a76 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:45.052793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c5b8e09-092e-4a8a-bc7b-f076e0ac0a76 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:45.056778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:45.060477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e09-092e-4a8a-bc7b-f076e0ac0a76 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:45.060982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e09-092e-4a8a-bc7b-f076e0ac0a76 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:45.061438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e09-092e-4a8a-bc7b-f076e0ac0a76 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:45.062160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e09-092e-4a8a-bc7b-f076e0ac0a76 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:45.062633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e09-092e-4a8a-bc7b-f076e0ac0a76 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:45.063164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e09-092e-4a8a-bc7b-f076e0ac0a76 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:45.090548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c5b8e09-092e-4a8a-bc7b-f076e0ac0a76 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:03:45.109660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8b9692ac-8585-4c25-8032-d8cf6a0b005b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:45.110523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8b9692ac-8585-4c25-8032-d8cf6a0b005b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:45.117474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b9692ac-8585-4c25-8032-d8cf6a0b005b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:45.117960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b9692ac-8585-4c25-8032-d8cf6a0b005b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:45.118403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b9692ac-8585-4c25-8032-d8cf6a0b005b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:45.119124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b9692ac-8585-4c25-8032-d8cf6a0b005b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:45.119585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b9692ac-8585-4c25-8032-d8cf6a0b005b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:45.120045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b9692ac-8585-4c25-8032-d8cf6a0b005b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:45.263937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8b9692ac-8585-4c25-8032-d8cf6a0b005b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:45.275739 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8b9692ac-8585-4c25-8032-d8cf6a0b005b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.170381 Sep 06 11:03:45.276330 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1482/2960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:45 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:45.286495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5c5398d2-6ba6-40c8-9210-bdc105d62a41 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:45.287140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5c5398d2-6ba6-40c8-9210-bdc105d62a41 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:45.300885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c5398d2-6ba6-40c8-9210-bdc105d62a41 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:45.301615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c5398d2-6ba6-40c8-9210-bdc105d62a41 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:45.302113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c5398d2-6ba6-40c8-9210-bdc105d62a41 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:45.302935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c5398d2-6ba6-40c8-9210-bdc105d62a41 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:45.303831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c5398d2-6ba6-40c8-9210-bdc105d62a41 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:45.303958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c5398d2-6ba6-40c8-9210-bdc105d62a41 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:45.458788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5c5398d2-6ba6-40c8-9210-bdc105d62a41 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:45.467115 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5c5398d2-6ba6-40c8-9210-bdc105d62a41 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1475 microversion: 2.1 time: 0.184911 Sep 06 11:03:45.467773 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1483/2961] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:45 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1475 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:45.473139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6370fb48-4b5a-443f-a128-19addaf7de58 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:45.474013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6370fb48-4b5a-443f-a128-19addaf7de58 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:45.488035 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c5b8e09-092e-4a8a-bc7b-f076e0ac0a76 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 204 len: 0 microversion: 2.1 time: 0.439270 Sep 06 11:03:45.488991 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1479/2962] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:03:45 2022] DELETE /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:03:45.493020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6370fb48-4b5a-443f-a128-19addaf7de58 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:45.493818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6370fb48-4b5a-443f-a128-19addaf7de58 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:45.494445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6370fb48-4b5a-443f-a128-19addaf7de58 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:45.495481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6370fb48-4b5a-443f-a128-19addaf7de58 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:45.496318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6370fb48-4b5a-443f-a128-19addaf7de58 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:45.496827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6370fb48-4b5a-443f-a128-19addaf7de58 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:45.510762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c5197b69-f362-4d7a-a6eb-8ce231ee6b0c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:45.514617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c5197b69-f362-4d7a-a6eb-8ce231ee6b0c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:45.524797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5197b69-f362-4d7a-a6eb-8ce231ee6b0c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:45.525332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5197b69-f362-4d7a-a6eb-8ce231ee6b0c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:45.525789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5197b69-f362-4d7a-a6eb-8ce231ee6b0c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:45.526499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5197b69-f362-4d7a-a6eb-8ce231ee6b0c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:45.526961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5197b69-f362-4d7a-a6eb-8ce231ee6b0c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:45.532015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5197b69-f362-4d7a-a6eb-8ce231ee6b0c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:45.594806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6370fb48-4b5a-443f-a128-19addaf7de58 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:45.599215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:45.606946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6370fb48-4b5a-443f-a128-19addaf7de58 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:45.608711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6370fb48-4b5a-443f-a128-19addaf7de58 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:45.610049 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6370fb48-4b5a-443f-a128-19addaf7de58 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1584 microversion: 2.32 time: 0.141127 Sep 06 11:03:45.611028 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1484/2963] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:45 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1584 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:03:45.615911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-83e740a8-4a65-4a02-9623-40871bfd7988 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:45.616632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-83e740a8-4a65-4a02-9623-40871bfd7988 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: a3173985-c4ff-4e48-887a-baf5a5da0a9b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:45.629839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83e740a8-4a65-4a02-9623-40871bfd7988 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:45.630409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83e740a8-4a65-4a02-9623-40871bfd7988 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:45.638355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83e740a8-4a65-4a02-9623-40871bfd7988 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:45.638470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83e740a8-4a65-4a02-9623-40871bfd7988 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:45.638973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83e740a8-4a65-4a02-9623-40871bfd7988 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:45.639520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83e740a8-4a65-4a02-9623-40871bfd7988 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:45.810793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c5197b69-f362-4d7a-a6eb-8ce231ee6b0c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:45.822134 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c5197b69-f362-4d7a-a6eb-8ce231ee6b0c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1318 microversion: 2.1 time: 0.324584 Sep 06 11:03:45.823052 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1480/2964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:45 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:45.850179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-83e740a8-4a65-4a02-9623-40871bfd7988 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:45.860769 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-83e740a8-4a65-4a02-9623-40871bfd7988 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b" status: 200 len: 1473 microversion: 2.1 time: 0.248215 Sep 06 11:03:45.861381 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1485/2965] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:45 2022] GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b => generated 1473 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:46.301272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-634bc85e-8976-4a9a-923a-d59a1e0f30f5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:46.302119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-634bc85e-8976-4a9a-923a-d59a1e0f30f5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:46.310503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-634bc85e-8976-4a9a-923a-d59a1e0f30f5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:46.311028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-634bc85e-8976-4a9a-923a-d59a1e0f30f5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:46.311497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-634bc85e-8976-4a9a-923a-d59a1e0f30f5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:46.312450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-634bc85e-8976-4a9a-923a-d59a1e0f30f5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:46.312995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-634bc85e-8976-4a9a-923a-d59a1e0f30f5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:46.313584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-634bc85e-8976-4a9a-923a-d59a1e0f30f5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:46.385898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a39dd233-ea12-47cf-8f26-10ac8e62f53f req-4145f94d-2483-43e6-8090-7392b91c322b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e167a8-c716-47ad-aa17-6ea18b4e9139", "name": "network-vif-plugged", "status": "completed", "tag": "8b55451f-3f5a-4377-923b-95e9928d1a17"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:46.405148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a39dd233-ea12-47cf-8f26-10ac8e62f53f req-4145f94d-2483-43e6-8090-7392b91c322b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:46.405908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a39dd233-ea12-47cf-8f26-10ac8e62f53f req-4145f94d-2483-43e6-8090-7392b91c322b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:46.408428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a39dd233-ea12-47cf-8f26-10ac8e62f53f req-4145f94d-2483-43e6-8090-7392b91c322b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:46.423855 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a39dd233-ea12-47cf-8f26-10ac8e62f53f req-4145f94d-2483-43e6-8090-7392b91c322b service nova] Creating event network-vif-plugged:8b55451f-3f5a-4377-923b-95e9928d1a17 for instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 on nch2-master-1 Sep 06 11:03:46.431096 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a39dd233-ea12-47cf-8f26-10ac8e62f53f req-4145f94d-2483-43e6-8090-7392b91c322b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049469 Sep 06 11:03:46.437431 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1486/2966] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:46.500142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3ac309a4-a03b-4028-a6e2-53a61411c816 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:46.501261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3ac309a4-a03b-4028-a6e2-53a61411c816 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:46.508864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ac309a4-a03b-4028-a6e2-53a61411c816 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:46.509585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ac309a4-a03b-4028-a6e2-53a61411c816 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:46.510190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ac309a4-a03b-4028-a6e2-53a61411c816 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:46.511095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ac309a4-a03b-4028-a6e2-53a61411c816 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:46.511731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ac309a4-a03b-4028-a6e2-53a61411c816 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:46.512359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ac309a4-a03b-4028-a6e2-53a61411c816 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:46.562144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-634bc85e-8976-4a9a-923a-d59a1e0f30f5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:46.579645 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-634bc85e-8976-4a9a-923a-d59a1e0f30f5 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.281428 Sep 06 11:03:46.583504 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1481/2967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:46 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:46.639211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7b6685ed-7345-4498-9e12-cf2026390f3f tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:46.639954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7b6685ed-7345-4498-9e12-cf2026390f3f tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:46.647764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b6685ed-7345-4498-9e12-cf2026390f3f tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:46.648329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b6685ed-7345-4498-9e12-cf2026390f3f tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:46.648902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b6685ed-7345-4498-9e12-cf2026390f3f tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:46.649672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b6685ed-7345-4498-9e12-cf2026390f3f tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:46.650146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b6685ed-7345-4498-9e12-cf2026390f3f tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:46.650585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b6685ed-7345-4498-9e12-cf2026390f3f tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:46.714588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3ac309a4-a03b-4028-a6e2-53a61411c816 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:46.723413 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3ac309a4-a03b-4028-a6e2-53a61411c816 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1475 microversion: 2.1 time: 0.234887 Sep 06 11:03:46.724009 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1487/2968] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:46 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1475 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:46.744022 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7b6685ed-7345-4498-9e12-cf2026390f3f tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:46.753322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7b6685ed-7345-4498-9e12-cf2026390f3f tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:46.754844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7b6685ed-7345-4498-9e12-cf2026390f3f tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:46.756076 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7b6685ed-7345-4498-9e12-cf2026390f3f tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1584 microversion: 2.32 time: 0.121825 Sep 06 11:03:46.756858 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1482/2969] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:46 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1584 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:03:46.884748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-852910c2-1468-4c39-b8b3-86c80d00c55a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:46.885480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-852910c2-1468-4c39-b8b3-86c80d00c55a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: a3173985-c4ff-4e48-887a-baf5a5da0a9b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:46.892776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-852910c2-1468-4c39-b8b3-86c80d00c55a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:46.893183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-852910c2-1468-4c39-b8b3-86c80d00c55a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:46.893668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-852910c2-1468-4c39-b8b3-86c80d00c55a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:46.894882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-852910c2-1468-4c39-b8b3-86c80d00c55a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:46.894882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-852910c2-1468-4c39-b8b3-86c80d00c55a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:46.895322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-852910c2-1468-4c39-b8b3-86c80d00c55a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:46.927896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-68d1e601-4225-44b0-bcb1-0fc3053bb417 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:46.928796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-68d1e601-4225-44b0-bcb1-0fc3053bb417 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:46.940366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68d1e601-4225-44b0-bcb1-0fc3053bb417 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:46.941365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68d1e601-4225-44b0-bcb1-0fc3053bb417 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:46.942337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68d1e601-4225-44b0-bcb1-0fc3053bb417 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:46.943689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68d1e601-4225-44b0-bcb1-0fc3053bb417 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:46.944574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68d1e601-4225-44b0-bcb1-0fc3053bb417 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:46.945424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68d1e601-4225-44b0-bcb1-0fc3053bb417 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:47.124686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-852910c2-1468-4c39-b8b3-86c80d00c55a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:47.133643 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-852910c2-1468-4c39-b8b3-86c80d00c55a tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b" status: 200 len: 1473 microversion: 2.1 time: 0.253073 Sep 06 11:03:47.134340 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1488/2970] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:46 2022] GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b => generated 1473 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:47.160096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-68d1e601-4225-44b0-bcb1-0fc3053bb417 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:47.169811 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-68d1e601-4225-44b0-bcb1-0fc3053bb417 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1318 microversion: 2.1 time: 0.248530 Sep 06 11:03:47.170400 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1483/2971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:46 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:47.603441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0229843d-4be8-4746-bffb-9e489d387725 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:47.603992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0229843d-4be8-4746-bffb-9e489d387725 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:47.611741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0229843d-4be8-4746-bffb-9e489d387725 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:47.612364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0229843d-4be8-4746-bffb-9e489d387725 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:47.612805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0229843d-4be8-4746-bffb-9e489d387725 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:47.613542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0229843d-4be8-4746-bffb-9e489d387725 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:47.614002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0229843d-4be8-4746-bffb-9e489d387725 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:47.614434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0229843d-4be8-4746-bffb-9e489d387725 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:47.746816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9bb88663-340c-43ab-9c0a-7d6ed72d0d19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:47.747474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9bb88663-340c-43ab-9c0a-7d6ed72d0d19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:47.756264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bb88663-340c-43ab-9c0a-7d6ed72d0d19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:47.756990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bb88663-340c-43ab-9c0a-7d6ed72d0d19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:47.758217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bb88663-340c-43ab-9c0a-7d6ed72d0d19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:47.759982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bb88663-340c-43ab-9c0a-7d6ed72d0d19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:47.763954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0229843d-4be8-4746-bffb-9e489d387725 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:47.767237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bb88663-340c-43ab-9c0a-7d6ed72d0d19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:47.771714 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0229843d-4be8-4746-bffb-9e489d387725 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1512 microversion: 2.1 time: 0.172225 Sep 06 11:03:47.777137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bb88663-340c-43ab-9c0a-7d6ed72d0d19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:47.777841 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1489/2972] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:47 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:47.786241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bfcc77f0-68dd-4d0c-81b7-27b4b4249f64 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:47.786872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bfcc77f0-68dd-4d0c-81b7-27b4b4249f64 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:47.806265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfcc77f0-68dd-4d0c-81b7-27b4b4249f64 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:47.806265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfcc77f0-68dd-4d0c-81b7-27b4b4249f64 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:47.806265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfcc77f0-68dd-4d0c-81b7-27b4b4249f64 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:47.806265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfcc77f0-68dd-4d0c-81b7-27b4b4249f64 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:47.806816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfcc77f0-68dd-4d0c-81b7-27b4b4249f64 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:47.807291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfcc77f0-68dd-4d0c-81b7-27b4b4249f64 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:48.031168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bfcc77f0-68dd-4d0c-81b7-27b4b4249f64 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:48.047423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bfcc77f0-68dd-4d0c-81b7-27b4b4249f64 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:48.048900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bfcc77f0-68dd-4d0c-81b7-27b4b4249f64 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:48.056790 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bfcc77f0-68dd-4d0c-81b7-27b4b4249f64 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1584 microversion: 2.32 time: 0.277845 Sep 06 11:03:48.057427 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1490/2973] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:47 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1584 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:03:48.157158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-345c7d18-6d53-467e-9b38-3433adb40776 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:48.158012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-345c7d18-6d53-467e-9b38-3433adb40776 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: a3173985-c4ff-4e48-887a-baf5a5da0a9b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:48.178287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:48.179085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:48.180201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=16 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:48.181851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-345c7d18-6d53-467e-9b38-3433adb40776 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:48.182359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-345c7d18-6d53-467e-9b38-3433adb40776 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:48.182814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-345c7d18-6d53-467e-9b38-3433adb40776 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:48.183577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-345c7d18-6d53-467e-9b38-3433adb40776 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:48.184053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-345c7d18-6d53-467e-9b38-3433adb40776 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:48.184822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-345c7d18-6d53-467e-9b38-3433adb40776 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:48.244188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9bb88663-340c-43ab-9c0a-7d6ed72d0d19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:48.255696 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9bb88663-340c-43ab-9c0a-7d6ed72d0d19 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1475 microversion: 2.1 time: 0.510927 Sep 06 11:03:48.256547 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1484/2974] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:47 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1475 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:48.270468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c49c4944-8c50-4759-b406-257996bbd4ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:48.271326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c49c4944-8c50-4759-b406-257996bbd4ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:48.279396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c49c4944-8c50-4759-b406-257996bbd4ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:48.280872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c49c4944-8c50-4759-b406-257996bbd4ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:48.281464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c49c4944-8c50-4759-b406-257996bbd4ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:48.286007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c49c4944-8c50-4759-b406-257996bbd4ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:48.286007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c49c4944-8c50-4759-b406-257996bbd4ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:48.286007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c49c4944-8c50-4759-b406-257996bbd4ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:48.457540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-345c7d18-6d53-467e-9b38-3433adb40776 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:48.466794 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-345c7d18-6d53-467e-9b38-3433adb40776 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b" status: 200 len: 1473 microversion: 2.1 time: 0.314207 Sep 06 11:03:48.468004 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1491/2975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:48 2022] GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b => generated 1473 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:48.541948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c49c4944-8c50-4759-b406-257996bbd4ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:48.553575 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c49c4944-8c50-4759-b406-257996bbd4ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1318 microversion: 2.1 time: 0.286916 Sep 06 11:03:48.563273 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1485/2976] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:48 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:48.797321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-38e0f8ac-ccb1-4fba-b02b-cf18abea40fd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:48.797958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-38e0f8ac-ccb1-4fba-b02b-cf18abea40fd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:48.809700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e0f8ac-ccb1-4fba-b02b-cf18abea40fd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:48.809700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e0f8ac-ccb1-4fba-b02b-cf18abea40fd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:48.809700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e0f8ac-ccb1-4fba-b02b-cf18abea40fd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:48.809700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e0f8ac-ccb1-4fba-b02b-cf18abea40fd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:48.809700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e0f8ac-ccb1-4fba-b02b-cf18abea40fd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:48.809700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38e0f8ac-ccb1-4fba-b02b-cf18abea40fd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:48.811854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-7a33adb5-384a-43b5-9f2b-887a544af20f req-cd4577b7-f8c9-47b5-b7f7-008a24dd416a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3173985-c4ff-4e48-887a-baf5a5da0a9b", "name": "network-vif-deleted", "tag": "e0d3bb72-f8aa-40dd-b454-b77384449641"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:48.833837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7a33adb5-384a-43b5-9f2b-887a544af20f req-cd4577b7-f8c9-47b5-b7f7-008a24dd416a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:48.837829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7a33adb5-384a-43b5-9f2b-887a544af20f req-cd4577b7-f8c9-47b5-b7f7-008a24dd416a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:48.838475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7a33adb5-384a-43b5-9f2b-887a544af20f req-cd4577b7-f8c9-47b5-b7f7-008a24dd416a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:48.862006 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7a33adb5-384a-43b5-9f2b-887a544af20f req-cd4577b7-f8c9-47b5-b7f7-008a24dd416a service nova] Creating event network-vif-deleted:e0d3bb72-f8aa-40dd-b454-b77384449641 for instance a3173985-c4ff-4e48-887a-baf5a5da0a9b on nch2-master-1 Sep 06 11:03:48.876869 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-7a33adb5-384a-43b5-9f2b-887a544af20f req-cd4577b7-f8c9-47b5-b7f7-008a24dd416a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072316 Sep 06 11:03:48.879150 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1486/2977] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:03:49.026638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-38e0f8ac-ccb1-4fba-b02b-cf18abea40fd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:49.035518 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-38e0f8ac-ccb1-4fba-b02b-cf18abea40fd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1489 microversion: 2.1 time: 0.241507 Sep 06 11:03:49.036647 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1492/2978] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:48 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1489 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:49.066780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-181b14e5-6a96-416a-ab3e-faa965ca9ee4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:49.075754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-181b14e5-6a96-416a-ab3e-faa965ca9ee4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:49.092503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76bbdcee-3fd9-4df0-aec0-a8475c05b3f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:49.093012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-76bbdcee-3fd9-4df0-aec0-a8475c05b3f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:49.102662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76bbdcee-3fd9-4df0-aec0-a8475c05b3f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:49.109617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-181b14e5-6a96-416a-ab3e-faa965ca9ee4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:49.109617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-181b14e5-6a96-416a-ab3e-faa965ca9ee4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:49.109617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-181b14e5-6a96-416a-ab3e-faa965ca9ee4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:49.110228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76bbdcee-3fd9-4df0-aec0-a8475c05b3f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:49.110228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76bbdcee-3fd9-4df0-aec0-a8475c05b3f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:49.110228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76bbdcee-3fd9-4df0-aec0-a8475c05b3f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:49.110228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76bbdcee-3fd9-4df0-aec0-a8475c05b3f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:49.110559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76bbdcee-3fd9-4df0-aec0-a8475c05b3f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:49.111960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-181b14e5-6a96-416a-ab3e-faa965ca9ee4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:49.112457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-181b14e5-6a96-416a-ab3e-faa965ca9ee4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:49.112945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-181b14e5-6a96-416a-ab3e-faa965ca9ee4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:49.160974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:49.270016 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-181b14e5-6a96-416a-ab3e-faa965ca9ee4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 200 len: 116 microversion: 2.1 time: 0.211828 Sep 06 11:03:49.271590 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1487/2979] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:03:49 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 116 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:49.281953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-45be83ff-5cea-45e1-9d92-4d84fa48dffe tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:49.288762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-45be83ff-5cea-45e1-9d92-4d84fa48dffe tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:49.311985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45be83ff-5cea-45e1-9d92-4d84fa48dffe tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:49.319089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45be83ff-5cea-45e1-9d92-4d84fa48dffe tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:49.322769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45be83ff-5cea-45e1-9d92-4d84fa48dffe tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:49.323614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45be83ff-5cea-45e1-9d92-4d84fa48dffe tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:49.324112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45be83ff-5cea-45e1-9d92-4d84fa48dffe tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:49.324567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45be83ff-5cea-45e1-9d92-4d84fa48dffe tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:49.883821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-45be83ff-5cea-45e1-9d92-4d84fa48dffe tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:49.895975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-76bbdcee-3fd9-4df0-aec0-a8475c05b3f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:49.899858 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-45be83ff-5cea-45e1-9d92-4d84fa48dffe tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1475 microversion: 2.1 time: 0.623607 Sep 06 11:03:49.904012 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1488/2980] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:49 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1475 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:49.909129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-69384786-b1d5-4677-98bd-9a49860120d8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:49.912643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-69384786-b1d5-4677-98bd-9a49860120d8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:49.920575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-76bbdcee-3fd9-4df0-aec0-a8475c05b3f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:49.921307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69384786-b1d5-4677-98bd-9a49860120d8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:49.922793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69384786-b1d5-4677-98bd-9a49860120d8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:49.924171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69384786-b1d5-4677-98bd-9a49860120d8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:49.925294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69384786-b1d5-4677-98bd-9a49860120d8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:49.926264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69384786-b1d5-4677-98bd-9a49860120d8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:49.927441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-76bbdcee-3fd9-4df0-aec0-a8475c05b3f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:49.927789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69384786-b1d5-4677-98bd-9a49860120d8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:49.930117 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-76bbdcee-3fd9-4df0-aec0-a8475c05b3f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1662 microversion: 2.32 time: 0.841840 Sep 06 11:03:49.940309 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1493/2981] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:49 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1662 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:03:49.950597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:49.952303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: a3173985-c4ff-4e48-887a-baf5a5da0a9b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:49.960568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:49.961406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:49.962063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:49.963693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:49.964320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:49.965054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:50.030039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:50.030039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:50.030039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:50.030039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lazy-loading 'fault' on Instance uuid a3173985-c4ff-4e48-887a-baf5a5da0a9b {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:03:50.139657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:50.161324 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-56cb7908-627a-4c63-ad00-831a8b41cc28 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b" status: 200 len: 1308 microversion: 2.1 time: 0.225161 Sep 06 11:03:50.162500 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1494/2982] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:49 2022] GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:50.169598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-41bf0cac-c883-47e7-99a8-c8032518325b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:50.177726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-41bf0cac-c883-47e7-99a8-c8032518325b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:50.205316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41bf0cac-c883-47e7-99a8-c8032518325b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:50.205833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41bf0cac-c883-47e7-99a8-c8032518325b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:50.206537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41bf0cac-c883-47e7-99a8-c8032518325b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:50.207363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41bf0cac-c883-47e7-99a8-c8032518325b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:50.209154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41bf0cac-c883-47e7-99a8-c8032518325b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:50.209850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41bf0cac-c883-47e7-99a8-c8032518325b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:50.341717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-69384786-b1d5-4677-98bd-9a49860120d8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:50.350046 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-69384786-b1d5-4677-98bd-9a49860120d8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.448442 Sep 06 11:03:50.350822 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1489/2983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:49 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:50.383469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7f93bb4b-b502-494d-893c-4f9bb3e31e12 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:50.384138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7f93bb4b-b502-494d-893c-4f9bb3e31e12 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:50.390336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f93bb4b-b502-494d-893c-4f9bb3e31e12 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:50.390829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f93bb4b-b502-494d-893c-4f9bb3e31e12 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:50.391303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f93bb4b-b502-494d-893c-4f9bb3e31e12 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:50.392020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f93bb4b-b502-494d-893c-4f9bb3e31e12 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:50.392510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f93bb4b-b502-494d-893c-4f9bb3e31e12 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:50.392949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f93bb4b-b502-494d-893c-4f9bb3e31e12 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:50.399883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-41bf0cac-c883-47e7-99a8-c8032518325b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:50.410364 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-41bf0cac-c883-47e7-99a8-c8032518325b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1507 microversion: 2.1 time: 0.244220 Sep 06 11:03:50.411003 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1495/2984] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:50 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:50.437377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fece3b7a-f853-4c8b-800c-22a712523eee tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:50.438324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fece3b7a-f853-4c8b-800c-22a712523eee tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:50.455815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fece3b7a-f853-4c8b-800c-22a712523eee tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:50.456629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fece3b7a-f853-4c8b-800c-22a712523eee tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:50.457972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fece3b7a-f853-4c8b-800c-22a712523eee tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:50.458970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fece3b7a-f853-4c8b-800c-22a712523eee tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:50.459555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fece3b7a-f853-4c8b-800c-22a712523eee tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:50.460070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fece3b7a-f853-4c8b-800c-22a712523eee tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:50.738693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7f93bb4b-b502-494d-893c-4f9bb3e31e12 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:50.746667 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7f93bb4b-b502-494d-893c-4f9bb3e31e12 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.369263 Sep 06 11:03:50.747579 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1490/2985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:50 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:50.767181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fece3b7a-f853-4c8b-800c-22a712523eee tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:50.770759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-413210de-f7d8-4c90-9ea4-c07c33b437f7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:50.772055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-413210de-f7d8-4c90-9ea4-c07c33b437f7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:50.778454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-413210de-f7d8-4c90-9ea4-c07c33b437f7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:50.795311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-413210de-f7d8-4c90-9ea4-c07c33b437f7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:50.795311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-413210de-f7d8-4c90-9ea4-c07c33b437f7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:50.795634 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fece3b7a-f853-4c8b-800c-22a712523eee tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1507 microversion: 2.1 time: 0.348296 Sep 06 11:03:50.795973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-413210de-f7d8-4c90-9ea4-c07c33b437f7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:50.795973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-413210de-f7d8-4c90-9ea4-c07c33b437f7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:50.796122 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1496/2986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:50 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:50.796198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-413210de-f7d8-4c90-9ea4-c07c33b437f7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:50.812907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c30b836f-3bf3-4e9b-a055-63465ddcbf19 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:50.815566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c30b836f-3bf3-4e9b-a055-63465ddcbf19 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:50.845754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c30b836f-3bf3-4e9b-a055-63465ddcbf19 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:50.845754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c30b836f-3bf3-4e9b-a055-63465ddcbf19 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:50.845754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c30b836f-3bf3-4e9b-a055-63465ddcbf19 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:50.846606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c30b836f-3bf3-4e9b-a055-63465ddcbf19 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:50.856171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c30b836f-3bf3-4e9b-a055-63465ddcbf19 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:50.856708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c30b836f-3bf3-4e9b-a055-63465ddcbf19 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:51.065908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-413210de-f7d8-4c90-9ea4-c07c33b437f7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:51.080045 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c30b836f-3bf3-4e9b-a055-63465ddcbf19 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "PUT /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1079 microversion: 2.1 time: 0.260323 Sep 06 11:03:51.080045 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1497/2987] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Sep 6 11:03:50 2022] PUT /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1079 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:51.080045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-d7707682-e0ad-4daf-beee-3088e6d53bac req-f789cd71-2a42-460a-91ed-7aba24225dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb6a214-824a-420b-8d7b-710ec9f8c9e4", "name": "network-vif-deleted", "tag": "6e6a9c93-a942-41c8-95ff-9810c16226ef"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:51.080691 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-413210de-f7d8-4c90-9ea4-c07c33b437f7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.313096 Sep 06 11:03:51.080691 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1491/2988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:50 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:51.101220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d7707682-e0ad-4daf-beee-3088e6d53bac req-f789cd71-2a42-460a-91ed-7aba24225dca service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:51.101730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d7707682-e0ad-4daf-beee-3088e6d53bac req-f789cd71-2a42-460a-91ed-7aba24225dca service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:51.102177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d7707682-e0ad-4daf-beee-3088e6d53bac req-f789cd71-2a42-460a-91ed-7aba24225dca service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:51.106688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2ee7ca75-0777-441d-8de8-eb89e1e2e909 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:51.109287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2ee7ca75-0777-441d-8de8-eb89e1e2e909 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:51.130581 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d7707682-e0ad-4daf-beee-3088e6d53bac req-f789cd71-2a42-460a-91ed-7aba24225dca service nova] Creating event network-vif-deleted:6e6a9c93-a942-41c8-95ff-9810c16226ef for instance ccb6a214-824a-420b-8d7b-710ec9f8c9e4 on nch2-master-1 Sep 06 11:03:51.146995 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-d7707682-e0ad-4daf-beee-3088e6d53bac req-f789cd71-2a42-460a-91ed-7aba24225dca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072268 Sep 06 11:03:51.148175 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1498/2989] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:51.158496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ee7ca75-0777-441d-8de8-eb89e1e2e909 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:51.159046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ee7ca75-0777-441d-8de8-eb89e1e2e909 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:51.159638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ee7ca75-0777-441d-8de8-eb89e1e2e909 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:51.166458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a4f621e1-3840-43c2-9e28-64ae748b228a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:51.167282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a4f621e1-3840-43c2-9e28-64ae748b228a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:51.171860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ee7ca75-0777-441d-8de8-eb89e1e2e909 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:51.174109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ee7ca75-0777-441d-8de8-eb89e1e2e909 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:51.176261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ee7ca75-0777-441d-8de8-eb89e1e2e909 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:51.180469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4f621e1-3840-43c2-9e28-64ae748b228a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:51.186014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4f621e1-3840-43c2-9e28-64ae748b228a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:51.186870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4f621e1-3840-43c2-9e28-64ae748b228a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:51.188929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4f621e1-3840-43c2-9e28-64ae748b228a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:51.189614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4f621e1-3840-43c2-9e28-64ae748b228a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:51.190501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4f621e1-3840-43c2-9e28-64ae748b228a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:51.609524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2ee7ca75-0777-441d-8de8-eb89e1e2e909 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:51.629428 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2ee7ca75-0777-441d-8de8-eb89e1e2e909 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1475 microversion: 2.1 time: 0.541735 Sep 06 11:03:51.631841 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1492/2990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:51 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1475 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:51.636329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:51.650145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1bba8ed1-2c8e-4976-9802-3359f0330b23 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:51.651475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1bba8ed1-2c8e-4976-9802-3359f0330b23 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:51.666523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bba8ed1-2c8e-4976-9802-3359f0330b23 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:51.667582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bba8ed1-2c8e-4976-9802-3359f0330b23 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:51.669134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bba8ed1-2c8e-4976-9802-3359f0330b23 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:51.672038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bba8ed1-2c8e-4976-9802-3359f0330b23 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:51.672696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bba8ed1-2c8e-4976-9802-3359f0330b23 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:51.675954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bba8ed1-2c8e-4976-9802-3359f0330b23 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:51.694295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a4f621e1-3840-43c2-9e28-64ae748b228a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:51.716377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a4f621e1-3840-43c2-9e28-64ae748b228a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:51.719500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a4f621e1-3840-43c2-9e28-64ae748b228a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:51.723576 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a4f621e1-3840-43c2-9e28-64ae748b228a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1709 microversion: 2.32 time: 0.571771 Sep 06 11:03:51.725971 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1499/2991] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:51 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1709 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:03:51.731999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8d6654ef-88d3-4fb6-845e-425dbc8731b2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:51.732889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8d6654ef-88d3-4fb6-845e-425dbc8731b2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:51.750274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d6654ef-88d3-4fb6-845e-425dbc8731b2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:51.751228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d6654ef-88d3-4fb6-845e-425dbc8731b2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:51.751909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d6654ef-88d3-4fb6-845e-425dbc8731b2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:51.752869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d6654ef-88d3-4fb6-845e-425dbc8731b2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:51.756530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d6654ef-88d3-4fb6-845e-425dbc8731b2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:51.757659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d6654ef-88d3-4fb6-845e-425dbc8731b2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:52.107682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8d6654ef-88d3-4fb6-845e-425dbc8731b2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:52.116562 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8d6654ef-88d3-4fb6-845e-425dbc8731b2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.389271 Sep 06 11:03:52.135976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1bba8ed1-2c8e-4976-9802-3359f0330b23 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:52.136603 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1500/2992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:51 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:52.137370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a19d4b7e-17d1-4bfb-bc6f-70852d20c936 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:52.138510 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1bba8ed1-2c8e-4976-9802-3359f0330b23 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1505 microversion: 2.1 time: 0.502980 Sep 06 11:03:52.142239 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1493/2993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:51 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:52.151045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a19d4b7e-17d1-4bfb-bc6f-70852d20c936 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: a3173985-c4ff-4e48-887a-baf5a5da0a9b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:52.176951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a19d4b7e-17d1-4bfb-bc6f-70852d20c936 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:52.178327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a19d4b7e-17d1-4bfb-bc6f-70852d20c936 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:52.178454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2cf808bb-2293-461b-baf7-abb9c0642259 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:52.182074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2cf808bb-2293-461b-baf7-abb9c0642259 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:52.182454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a19d4b7e-17d1-4bfb-bc6f-70852d20c936 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:52.182454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a19d4b7e-17d1-4bfb-bc6f-70852d20c936 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:52.183390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a19d4b7e-17d1-4bfb-bc6f-70852d20c936 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:52.184765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a19d4b7e-17d1-4bfb-bc6f-70852d20c936 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:52.192048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cf808bb-2293-461b-baf7-abb9c0642259 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:52.192908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cf808bb-2293-461b-baf7-abb9c0642259 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:52.193837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cf808bb-2293-461b-baf7-abb9c0642259 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:52.194935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cf808bb-2293-461b-baf7-abb9c0642259 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:52.195689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cf808bb-2293-461b-baf7-abb9c0642259 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:52.196355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2cf808bb-2293-461b-baf7-abb9c0642259 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:52.213237 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-a19d4b7e-17d1-4bfb-bc6f-70852d20c936 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] HTTP exception thrown: Instance a3173985-c4ff-4e48-887a-baf5a5da0a9b could not be found. Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a19d4b7e-17d1-4bfb-bc6f-70852d20c936 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Request method failure captured: Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b HTTP/1.1 Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyhK9jZtW1DNORfwfRpR85Y8c-_tMHtG3Zvmm1PUkx_8Hh78J7D07mpIe0VOjywIx27PuMyL2q8quTjVO48e84bIJD3s_LW5pTYmlujPS4_Fm-TChnjJiUdBV3w5il4JD3oVz9FhIsPv7eYq78jkLQs8CmEWHfViPL5Ic4yWhP1Daig Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}] Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 9e84745e5df647d1921e8d1ffc08711c Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance a3173985-c4ff-4e48-887a-baf5a5da0a9b could not be found. Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'a3173985-c4ff-4e48-887a-baf5a5da0a9b'} Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3173985-c4ff-4e48-887a-baf5a5da0a9b could not be found. Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3173985-c4ff-4e48-887a-baf5a5da0a9b could not be found. Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:52.215249 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:52.222549 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:52.222549 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:52.222549 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:52.222549 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:03:52.222549 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:03:52.222549 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3173985-c4ff-4e48-887a-baf5a5da0a9b could not be found. Sep 06 11:03:52.222549 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:52.229229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a19d4b7e-17d1-4bfb-bc6f-70852d20c936 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Returning 404 to user: Instance a3173985-c4ff-4e48-887a-baf5a5da0a9b could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:03:52.229229 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a19d4b7e-17d1-4bfb-bc6f-70852d20c936 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b" status: 404 len: 111 microversion: 2.1 time: 0.091778 Sep 06 11:03:52.230667 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1501/2994] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:52 2022] GET /compute/v2.1/servers/a3173985-c4ff-4e48-887a-baf5a5da0a9b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:03:52.241839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1c647fa2-4757-4e08-aa55-5b6e1880f5dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:52.242958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1c647fa2-4757-4e08-aa55-5b6e1880f5dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: ccb6a214-824a-420b-8d7b-710ec9f8c9e4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:52.258436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c647fa2-4757-4e08-aa55-5b6e1880f5dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:52.259776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c647fa2-4757-4e08-aa55-5b6e1880f5dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:52.260874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c647fa2-4757-4e08-aa55-5b6e1880f5dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:52.264495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c647fa2-4757-4e08-aa55-5b6e1880f5dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:52.266333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c647fa2-4757-4e08-aa55-5b6e1880f5dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:52.266915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c647fa2-4757-4e08-aa55-5b6e1880f5dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:52.298891 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-1c647fa2-4757-4e08-aa55-5b6e1880f5dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] HTTP exception thrown: Instance ccb6a214-824a-420b-8d7b-710ec9f8c9e4 could not be found. Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1c647fa2-4757-4e08-aa55-5b6e1880f5dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Request method failure captured: Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 HTTP/1.1 Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyhK9jZtW1DNORfwfRpR85Y8c-_tMHtG3Zvmm1PUkx_8Hh78J7D07mpIe0VOjywIx27PuMyL2q8quTjVO48e84bIJD3s_LW5pTYmlujPS4_Fm-TChnjJiUdBV3w5il4JD3oVz9FhIsPv7eYq78jkLQs8CmEWHfViPL5Ic4yWhP1Daig Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}] Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 9e84745e5df647d1921e8d1ffc08711c Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance ccb6a214-824a-420b-8d7b-710ec9f8c9e4 could not be found. Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ccb6a214-824a-420b-8d7b-710ec9f8c9e4'} Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccb6a214-824a-420b-8d7b-710ec9f8c9e4 could not be found. Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccb6a214-824a-420b-8d7b-710ec9f8c9e4 could not be found. Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:03:52.305724 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:52.309793 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:03:52.309793 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:03:52.309793 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:03:52.309793 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:03:52.309793 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:03:52.309793 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccb6a214-824a-420b-8d7b-710ec9f8c9e4 could not be found. Sep 06 11:03:52.309793 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:03:52.309793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1c647fa2-4757-4e08-aa55-5b6e1880f5dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Returning 404 to user: Instance ccb6a214-824a-420b-8d7b-710ec9f8c9e4 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:03:52.309793 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1c647fa2-4757-4e08-aa55-5b6e1880f5dd tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4" status: 404 len: 111 microversion: 2.1 time: 0.075515 Sep 06 11:03:52.309793 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1502/2995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:52 2022] GET /compute/v2.1/servers/ccb6a214-824a-420b-8d7b-710ec9f8c9e4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:03:52.321859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-20882212-5828-4823-92a6-44ef27ed7496 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:52.429068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2cf808bb-2293-461b-baf7-abb9c0642259 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:52.439910 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2cf808bb-2293-461b-baf7-abb9c0642259 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1505 microversion: 2.1 time: 0.267452 Sep 06 11:03:52.441899 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1494/2996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:52 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:52.453942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1239838577", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "350b7fa2-cbf1-4a97-afcf-fd60d6924de1"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:52.462350 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-20882212-5828-4823-92a6-44ef27ed7496 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/877e8d5e-c9af-4b48-ae33-9f3498aa3a4f" status: 204 len: 0 microversion: 2.1 time: 0.147281 Sep 06 11:03:52.463184 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1503/2997] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:03:52 2022] DELETE /compute/v2.1/os-server-groups/877e8d5e-c9af-4b48-ae33-9f3498aa3a4f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:03:52.471237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:52.474745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:52.493945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:52.495652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:52.496463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:52.498506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:52.506198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:52.506677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:52.511783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:52.564603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] validate_networks() for [('350b7fa2-cbf1-4a97-afcf-fd60d6924de1', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:03:52.646204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:03:52.648535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:03:52.649468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:03:52.652080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:03:52.652880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:03:52.922926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:52.930185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:52.930690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:52.931470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:52.932246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:52.932705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:52.933153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:52.962295 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-29828ff8-8f23-4cd4-8a34-6330372c19b6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "POST /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139/action" status: 202 len: 1111 microversion: 2.1 time: 0.494778 Sep 06 11:03:52.963233 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1504/2998] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:03:52 2022] POST /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139/action => generated 1111 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 06 11:03:52.968866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d563542e-f9d4-48d4-8c53-b1d2047b8640 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:52.969625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d563542e-f9d4-48d4-8c53-b1d2047b8640 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:52.976274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d563542e-f9d4-48d4-8c53-b1d2047b8640 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:52.977152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d563542e-f9d4-48d4-8c53-b1d2047b8640 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:52.977601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d563542e-f9d4-48d4-8c53-b1d2047b8640 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:52.978323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d563542e-f9d4-48d4-8c53-b1d2047b8640 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:52.978786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d563542e-f9d4-48d4-8c53-b1d2047b8640 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:52.979255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d563542e-f9d4-48d4-8c53-b1d2047b8640 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:53.008103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d563542e-f9d4-48d4-8c53-b1d2047b8640 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:03:53.270086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:03:53.270537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:03:53.270928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:03:53.271392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:03:53.271838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:03:53.298909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:53.299467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:53.300968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:53.301895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:53.302532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:53.303532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:53.347967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Getting quotas for project dcd5ffec2c6246fb89ba181542692585. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:03:53.356394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Getting quotas for user f16abbf8a68344b68444ff8fc2795c67 and project dcd5ffec2c6246fb89ba181542692585. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:03:53.387695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:03:53.395596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:03:53.443205 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d563542e-f9d4-48d4-8c53-b1d2047b8640 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 204 len: 0 microversion: 2.1 time: 0.478266 Sep 06 11:03:53.445005 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1505/2999] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:03:52 2022] DELETE /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:03:53.452352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-35a442e2-a7b8-48ac-99ef-3764714ec3a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:53.455595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-35a442e2-a7b8-48ac-99ef-3764714ec3a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:53.471789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35a442e2-a7b8-48ac-99ef-3764714ec3a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:53.473138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35a442e2-a7b8-48ac-99ef-3764714ec3a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:53.475560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35a442e2-a7b8-48ac-99ef-3764714ec3a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:53.478542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35a442e2-a7b8-48ac-99ef-3764714ec3a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:53.480212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35a442e2-a7b8-48ac-99ef-3764714ec3a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:53.482483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35a442e2-a7b8-48ac-99ef-3764714ec3a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:53.665409 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9b0b61d4-1f96-4fac-be51-5b0395ef5fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.222157 Sep 06 11:03:53.666086 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1495/3000] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:03:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:03:53.670952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-17f562f0-91af-4551-83e6-efc3748452f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:53.682229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-17f562f0-91af-4551-83e6-efc3748452f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:53.693592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f562f0-91af-4551-83e6-efc3748452f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:53.694108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f562f0-91af-4551-83e6-efc3748452f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:53.694703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f562f0-91af-4551-83e6-efc3748452f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:53.702801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f562f0-91af-4551-83e6-efc3748452f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:53.703570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f562f0-91af-4551-83e6-efc3748452f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:53.704192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f562f0-91af-4551-83e6-efc3748452f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:54.147944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-35a442e2-a7b8-48ac-99ef-3764714ec3a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:54.155532 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-35a442e2-a7b8-48ac-99ef-3764714ec3a0 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1475 microversion: 2.1 time: 0.709178 Sep 06 11:03:54.156109 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1506/3001] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:53 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1475 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:54.177204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-349302d4-1a96-4827-94bc-7564bfbdcdcf tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:54.178175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-349302d4-1a96-4827-94bc-7564bfbdcdcf tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:54.185361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-349302d4-1a96-4827-94bc-7564bfbdcdcf tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:54.186166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-349302d4-1a96-4827-94bc-7564bfbdcdcf tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:54.186798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-349302d4-1a96-4827-94bc-7564bfbdcdcf tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:54.187795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-349302d4-1a96-4827-94bc-7564bfbdcdcf tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:54.188515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-349302d4-1a96-4827-94bc-7564bfbdcdcf tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:54.189227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-349302d4-1a96-4827-94bc-7564bfbdcdcf tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:54.343813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-17f562f0-91af-4551-83e6-efc3748452f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:54.360052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-17f562f0-91af-4551-83e6-efc3748452f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:54.361620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-17f562f0-91af-4551-83e6-efc3748452f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:54.363511 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-17f562f0-91af-4551-83e6-efc3748452f2 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1756 microversion: 2.32 time: 0.695786 Sep 06 11:03:54.377379 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1496/3002] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:53 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1756 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:03:54.382330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bb4d1792-f157-4849-98f5-6b325ebe0db1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:54.383377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bb4d1792-f157-4849-98f5-6b325ebe0db1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:54.389783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb4d1792-f157-4849-98f5-6b325ebe0db1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:54.390290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb4d1792-f157-4849-98f5-6b325ebe0db1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:54.390745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb4d1792-f157-4849-98f5-6b325ebe0db1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:54.391513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb4d1792-f157-4849-98f5-6b325ebe0db1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:54.391987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb4d1792-f157-4849-98f5-6b325ebe0db1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:54.392432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb4d1792-f157-4849-98f5-6b325ebe0db1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:54.530385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-349302d4-1a96-4827-94bc-7564bfbdcdcf tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:54.544997 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-349302d4-1a96-4827-94bc-7564bfbdcdcf tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.384265 Sep 06 11:03:54.556074 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1507/3003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:54 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:54.568411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81f1061e-129d-43a6-a293-a5f9d3117c82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:54.569276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-81f1061e-129d-43a6-a293-a5f9d3117c82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:54.605959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bb4d1792-f157-4849-98f5-6b325ebe0db1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:54.615708 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bb4d1792-f157-4849-98f5-6b325ebe0db1 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1472 microversion: 2.1 time: 0.237021 Sep 06 11:03:54.616211 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1497/3004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:54 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:54.653470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-81f1061e-129d-43a6-a293-a5f9d3117c82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:54.664339 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-81f1061e-129d-43a6-a293-a5f9d3117c82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1215 microversion: 2.1 time: 0.106314 Sep 06 11:03:54.665507 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1508/3005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:54 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:55.184716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-09bc77b4-195a-4b7e-8895-f60016712c4b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:55.185411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-09bc77b4-195a-4b7e-8895-f60016712c4b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:55.193494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09bc77b4-195a-4b7e-8895-f60016712c4b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:55.194862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09bc77b4-195a-4b7e-8895-f60016712c4b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:55.200088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09bc77b4-195a-4b7e-8895-f60016712c4b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:55.200088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09bc77b4-195a-4b7e-8895-f60016712c4b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:55.200088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09bc77b4-195a-4b7e-8895-f60016712c4b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:55.200088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09bc77b4-195a-4b7e-8895-f60016712c4b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:55.392166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-387426c7-90e6-40a8-8ec4-e85a7c4eed51 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:55.392795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-387426c7-90e6-40a8-8ec4-e85a7c4eed51 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:55.402857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-387426c7-90e6-40a8-8ec4-e85a7c4eed51 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:55.403384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-387426c7-90e6-40a8-8ec4-e85a7c4eed51 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:55.404256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-387426c7-90e6-40a8-8ec4-e85a7c4eed51 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:55.405027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-387426c7-90e6-40a8-8ec4-e85a7c4eed51 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:55.405491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-387426c7-90e6-40a8-8ec4-e85a7c4eed51 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:55.406135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-387426c7-90e6-40a8-8ec4-e85a7c4eed51 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:55.560826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-09bc77b4-195a-4b7e-8895-f60016712c4b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:55.571414 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-09bc77b4-195a-4b7e-8895-f60016712c4b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1475 microversion: 2.1 time: 0.391147 Sep 06 11:03:55.572158 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1498/3006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:55 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1475 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:55.576889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff060bf2-49a1-440c-b1e9-42e21e206854 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:55.577511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff060bf2-49a1-440c-b1e9-42e21e206854 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:55.584471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff060bf2-49a1-440c-b1e9-42e21e206854 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:55.585242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff060bf2-49a1-440c-b1e9-42e21e206854 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:55.585848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff060bf2-49a1-440c-b1e9-42e21e206854 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:55.586851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff060bf2-49a1-440c-b1e9-42e21e206854 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:55.587497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff060bf2-49a1-440c-b1e9-42e21e206854 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:55.588088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff060bf2-49a1-440c-b1e9-42e21e206854 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:55.883485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-387426c7-90e6-40a8-8ec4-e85a7c4eed51 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:55.905109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-387426c7-90e6-40a8-8ec4-e85a7c4eed51 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:55.909115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-387426c7-90e6-40a8-8ec4-e85a7c4eed51 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:55.911634 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-387426c7-90e6-40a8-8ec4-e85a7c4eed51 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1756 microversion: 2.32 time: 0.525280 Sep 06 11:03:55.912937 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1509/3007] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:55 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1756 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:03:55.963181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8e15ff3e-33b5-4d5b-913e-3f57505088d9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:55.964482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8e15ff3e-33b5-4d5b-913e-3f57505088d9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:55.996178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e15ff3e-33b5-4d5b-913e-3f57505088d9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:55.996936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e15ff3e-33b5-4d5b-913e-3f57505088d9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:55.997686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e15ff3e-33b5-4d5b-913e-3f57505088d9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:55.998472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff060bf2-49a1-440c-b1e9-42e21e206854 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:56.000743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e15ff3e-33b5-4d5b-913e-3f57505088d9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:56.007116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e15ff3e-33b5-4d5b-913e-3f57505088d9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:56.010200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e15ff3e-33b5-4d5b-913e-3f57505088d9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:56.018016 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff060bf2-49a1-440c-b1e9-42e21e206854 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.444767 Sep 06 11:03:56.028702 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1499/3008] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:55 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:56.028702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2ea60395-0040-4e10-b195-1f9176d5607b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:56.028702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2ea60395-0040-4e10-b195-1f9176d5607b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:56.038540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ea60395-0040-4e10-b195-1f9176d5607b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:56.043984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ea60395-0040-4e10-b195-1f9176d5607b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:56.044555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ea60395-0040-4e10-b195-1f9176d5607b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:56.045386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ea60395-0040-4e10-b195-1f9176d5607b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:56.045928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ea60395-0040-4e10-b195-1f9176d5607b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:56.047591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ea60395-0040-4e10-b195-1f9176d5607b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:56.173469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2ea60395-0040-4e10-b195-1f9176d5607b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:56.178271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8e15ff3e-33b5-4d5b-913e-3f57505088d9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:56.193897 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8e15ff3e-33b5-4d5b-913e-3f57505088d9 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1430 microversion: 2.1 time: 0.254868 Sep 06 11:03:56.196057 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2ea60395-0040-4e10-b195-1f9176d5607b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1267 microversion: 2.1 time: 0.175925 Sep 06 11:03:56.196666 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1500/3009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:56 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:56.213147 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1510/3010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:55 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1430 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:56.219682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-140045da-91de-46fa-9495-c3885f60b132 req-5b44c640-9f91-47e2-b104-606e58b4bd68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d07bf04-ec2e-40a3-8916-aade0c51060b", "name": "network-vif-deleted", "tag": "09304fad-16f8-45c6-b370-7090613127a7"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:56.241187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-140045da-91de-46fa-9495-c3885f60b132 req-5b44c640-9f91-47e2-b104-606e58b4bd68 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:56.241861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-140045da-91de-46fa-9495-c3885f60b132 req-5b44c640-9f91-47e2-b104-606e58b4bd68 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:56.242598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-140045da-91de-46fa-9495-c3885f60b132 req-5b44c640-9f91-47e2-b104-606e58b4bd68 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:56.256904 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-140045da-91de-46fa-9495-c3885f60b132 req-5b44c640-9f91-47e2-b104-606e58b4bd68 service nova] Creating event network-vif-deleted:09304fad-16f8-45c6-b370-7090613127a7 for instance 0d07bf04-ec2e-40a3-8916-aade0c51060b on nch1-master-1 Sep 06 11:03:56.262508 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-140045da-91de-46fa-9495-c3885f60b132 req-5b44c640-9f91-47e2-b104-606e58b4bd68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056048 Sep 06 11:03:56.264084 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1501/3011] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:56.606826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8aa0fc22-3542-4800-94b5-232538a1b43f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:56.613953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8aa0fc22-3542-4800-94b5-232538a1b43f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:56.638873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa0fc22-3542-4800-94b5-232538a1b43f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:56.638873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa0fc22-3542-4800-94b5-232538a1b43f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:56.638873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa0fc22-3542-4800-94b5-232538a1b43f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:56.639888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa0fc22-3542-4800-94b5-232538a1b43f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:56.640755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa0fc22-3542-4800-94b5-232538a1b43f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:56.646697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa0fc22-3542-4800-94b5-232538a1b43f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:56.852238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8aa0fc22-3542-4800-94b5-232538a1b43f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:56.860383 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8aa0fc22-3542-4800-94b5-232538a1b43f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1475 microversion: 2.1 time: 0.267873 Sep 06 11:03:56.861972 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1511/3012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:56 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1475 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:56.943827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-012f0c0e-fff9-47e5-861a-ec06bfa7d822 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:56.944677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-012f0c0e-fff9-47e5-861a-ec06bfa7d822 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:56.952698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012f0c0e-fff9-47e5-861a-ec06bfa7d822 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:56.953424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012f0c0e-fff9-47e5-861a-ec06bfa7d822 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:56.954433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012f0c0e-fff9-47e5-861a-ec06bfa7d822 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:56.955543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012f0c0e-fff9-47e5-861a-ec06bfa7d822 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:56.956020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012f0c0e-fff9-47e5-861a-ec06bfa7d822 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:56.956551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012f0c0e-fff9-47e5-861a-ec06bfa7d822 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:57.049801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b1311083-17e0-467b-a2bc-0cfc89ceec05 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:57.051156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b1311083-17e0-467b-a2bc-0cfc89ceec05 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:57.057239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1311083-17e0-467b-a2bc-0cfc89ceec05 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:57.057726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1311083-17e0-467b-a2bc-0cfc89ceec05 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:57.058170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1311083-17e0-467b-a2bc-0cfc89ceec05 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:57.059091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1311083-17e0-467b-a2bc-0cfc89ceec05 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:57.059625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1311083-17e0-467b-a2bc-0cfc89ceec05 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:57.060057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1311083-17e0-467b-a2bc-0cfc89ceec05 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:57.230168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-012f0c0e-fff9-47e5-861a-ec06bfa7d822 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:57.241924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-012f0c0e-fff9-47e5-861a-ec06bfa7d822 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:57.244040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-012f0c0e-fff9-47e5-861a-ec06bfa7d822 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:57.245994 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-012f0c0e-fff9-47e5-861a-ec06bfa7d822 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1791 microversion: 2.32 time: 0.307540 Sep 06 11:03:57.246800 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1502/3013] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:56 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1791 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:03:57.252888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e82e6148-9ea2-40c0-87ae-6b1269728300 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:57.253814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e82e6148-9ea2-40c0-87ae-6b1269728300 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:57.260619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e82e6148-9ea2-40c0-87ae-6b1269728300 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:57.261364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e82e6148-9ea2-40c0-87ae-6b1269728300 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:57.262004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e82e6148-9ea2-40c0-87ae-6b1269728300 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:57.263053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e82e6148-9ea2-40c0-87ae-6b1269728300 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:57.263729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e82e6148-9ea2-40c0-87ae-6b1269728300 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:57.264400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e82e6148-9ea2-40c0-87ae-6b1269728300 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:57.326953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b1311083-17e0-467b-a2bc-0cfc89ceec05 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:57.335555 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b1311083-17e0-467b-a2bc-0cfc89ceec05 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.289666 Sep 06 11:03:57.336138 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1512/3014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:57 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:57.340949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:57.341575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:57.348089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:57.348629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:57.349074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:57.349776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:57.350240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:57.350671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:57.378490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e82e6148-9ea2-40c0-87ae-6b1269728300 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:57.391399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:57.391898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:57.392352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:57.392816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lazy-loading 'fault' on Instance uuid 0d07bf04-ec2e-40a3-8916-aade0c51060b {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:03:57.393061 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e82e6148-9ea2-40c0-87ae-6b1269728300 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1275 microversion: 2.1 time: 0.144531 Sep 06 11:03:57.393902 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1503/3015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:57 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1275 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:57.447198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:57.454952 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-035c223d-708d-4bbe-a75c-9f47fce0dbef tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1307 microversion: 2.1 time: 0.117665 Sep 06 11:03:57.456355 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1513/3016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:57 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:57.884471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-19f20398-599b-4886-b624-70885abe202d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:57.885101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-19f20398-599b-4886-b624-70885abe202d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:57.891646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19f20398-599b-4886-b624-70885abe202d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:57.892727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19f20398-599b-4886-b624-70885abe202d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:57.893505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19f20398-599b-4886-b624-70885abe202d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:57.894834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19f20398-599b-4886-b624-70885abe202d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:57.895341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19f20398-599b-4886-b624-70885abe202d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:57.895791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19f20398-599b-4886-b624-70885abe202d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:58.259984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-19f20398-599b-4886-b624-70885abe202d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:58.270842 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-19f20398-599b-4886-b624-70885abe202d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1475 microversion: 2.1 time: 0.390460 Sep 06 11:03:58.287686 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1504/3017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:57 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1475 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:58.296143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c14a199e-a5d2-4312-b73d-d9889c9cfe82 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:58.296771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c14a199e-a5d2-4312-b73d-d9889c9cfe82 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:58.306219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c14a199e-a5d2-4312-b73d-d9889c9cfe82 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:58.307367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c14a199e-a5d2-4312-b73d-d9889c9cfe82 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:58.307367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c14a199e-a5d2-4312-b73d-d9889c9cfe82 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:58.308092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c14a199e-a5d2-4312-b73d-d9889c9cfe82 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:58.308979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c14a199e-a5d2-4312-b73d-d9889c9cfe82 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:58.309434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c14a199e-a5d2-4312-b73d-d9889c9cfe82 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:58.361990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-079e94f5-3ba4-4509-ae2b-09361b361a93 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:58.363213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-079e94f5-3ba4-4509-ae2b-09361b361a93 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:58.370786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-079e94f5-3ba4-4509-ae2b-09361b361a93 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:58.371650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-079e94f5-3ba4-4509-ae2b-09361b361a93 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:58.372331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-079e94f5-3ba4-4509-ae2b-09361b361a93 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:58.373351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-079e94f5-3ba4-4509-ae2b-09361b361a93 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:58.374076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-079e94f5-3ba4-4509-ae2b-09361b361a93 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:58.375416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-079e94f5-3ba4-4509-ae2b-09361b361a93 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:58.743268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c14a199e-a5d2-4312-b73d-d9889c9cfe82 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:58.746772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-079e94f5-3ba4-4509-ae2b-09361b361a93 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:58.749924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:58.758074 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-079e94f5-3ba4-4509-ae2b-09361b361a93 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.400550 Sep 06 11:03:58.760289 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1505/3018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:58 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:58.767802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c14a199e-a5d2-4312-b73d-d9889c9cfe82 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:58.770923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c14a199e-a5d2-4312-b73d-d9889c9cfe82 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:58.773949 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c14a199e-a5d2-4312-b73d-d9889c9cfe82 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1838 microversion: 2.32 time: 0.481897 Sep 06 11:03:58.776790 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1514/3019] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:58 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1838 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:03:58.792561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:58.795355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:58.795824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2a3f99eb-4fb3-4333-b583-062c709f4d69 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:58.800685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2a3f99eb-4fb3-4333-b583-062c709f4d69 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:58.812543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:58.812664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:58.813164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:58.814088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a3f99eb-4fb3-4333-b583-062c709f4d69 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:58.814873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:58.816051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a3f99eb-4fb3-4333-b583-062c709f4d69 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:58.816382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:58.816893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:58.817794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a3f99eb-4fb3-4333-b583-062c709f4d69 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:58.818594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a3f99eb-4fb3-4333-b583-062c709f4d69 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:58.819923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a3f99eb-4fb3-4333-b583-062c709f4d69 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:58.820398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a3f99eb-4fb3-4333-b583-062c709f4d69 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:58.881660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:58.882162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:58.883051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:58.883735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lazy-loading 'fault' on Instance uuid 0d07bf04-ec2e-40a3-8916-aade0c51060b {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:03:58.996031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e84745e5df647d1921e8d1ffc08711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7af966e1b740a59920ff9370b5dade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:59.002463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2a3f99eb-4fb3-4333-b583-062c709f4d69 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:59.007301 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4127364d-7ec1-4796-af4f-29c4456a1902 tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 200 len: 1307 microversion: 2.1 time: 0.228569 Sep 06 11:03:59.008803 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1515/3020] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:58 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:59.017901 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2a3f99eb-4fb3-4333-b583-062c709f4d69 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1273 microversion: 2.1 time: 0.256313 Sep 06 11:03:59.018430 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1506/3021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:58 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:03:59.294252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f916de0d-10b6-47bf-a6c3-95538eee5de6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:59.294880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f916de0d-10b6-47bf-a6c3-95538eee5de6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:59.303166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f916de0d-10b6-47bf-a6c3-95538eee5de6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:59.304430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f916de0d-10b6-47bf-a6c3-95538eee5de6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:59.305106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f916de0d-10b6-47bf-a6c3-95538eee5de6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:59.306046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f916de0d-10b6-47bf-a6c3-95538eee5de6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:59.306759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f916de0d-10b6-47bf-a6c3-95538eee5de6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:59.307629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f916de0d-10b6-47bf-a6c3-95538eee5de6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:59.413950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b9ef74ea-e46a-46cc-a5fa-831d37ed9fdf req-08016696-ae68-4875-a264-6b9feb60a418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f3820c-e654-4eca-98de-9c5b2ec61763", "name": "network-vif-unplugged", "status": "completed", "tag": "85f92e4a-b017-486e-a2da-1f2effdf2520"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:03:59.430194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b9ef74ea-e46a-46cc-a5fa-831d37ed9fdf req-08016696-ae68-4875-a264-6b9feb60a418 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:59.430789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b9ef74ea-e46a-46cc-a5fa-831d37ed9fdf req-08016696-ae68-4875-a264-6b9feb60a418 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:59.431329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b9ef74ea-e46a-46cc-a5fa-831d37ed9fdf req-08016696-ae68-4875-a264-6b9feb60a418 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:59.446112 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b9ef74ea-e46a-46cc-a5fa-831d37ed9fdf req-08016696-ae68-4875-a264-6b9feb60a418 service nova] Creating event network-vif-unplugged:85f92e4a-b017-486e-a2da-1f2effdf2520 for instance b3f3820c-e654-4eca-98de-9c5b2ec61763 on nch2-master-1 Sep 06 11:03:59.451838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-b9ef74ea-e46a-46cc-a5fa-831d37ed9fdf req-08016696-ae68-4875-a264-6b9feb60a418 service nova] Instance b3f3820c-e654-4eca-98de-9c5b2ec61763 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:03:59.465903 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b9ef74ea-e46a-46cc-a5fa-831d37ed9fdf req-08016696-ae68-4875-a264-6b9feb60a418 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059344 Sep 06 11:03:59.466838 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1507/3022] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:03:59.656605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f916de0d-10b6-47bf-a6c3-95538eee5de6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:03:59.668005 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f916de0d-10b6-47bf-a6c3-95538eee5de6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1474 microversion: 2.1 time: 0.377835 Sep 06 11:03:59.669561 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1516/3023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:59 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1474 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:03:59.793686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b684c7ec-e8bb-4d42-8beb-1ac3c7811bb5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:59.794827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b684c7ec-e8bb-4d42-8beb-1ac3c7811bb5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:59.801793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b684c7ec-e8bb-4d42-8beb-1ac3c7811bb5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:59.802584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b684c7ec-e8bb-4d42-8beb-1ac3c7811bb5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:59.803312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b684c7ec-e8bb-4d42-8beb-1ac3c7811bb5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:59.804275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b684c7ec-e8bb-4d42-8beb-1ac3c7811bb5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:59.805007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b684c7ec-e8bb-4d42-8beb-1ac3c7811bb5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:59.805767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b684c7ec-e8bb-4d42-8beb-1ac3c7811bb5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:59.806551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8dc0ba9c-92cb-4756-9ae9-505fc287da52 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:03:59.807245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8dc0ba9c-92cb-4756-9ae9-505fc287da52 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:03:59.818018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8dc0ba9c-92cb-4756-9ae9-505fc287da52 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:59.818018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8dc0ba9c-92cb-4756-9ae9-505fc287da52 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:59.818018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8dc0ba9c-92cb-4756-9ae9-505fc287da52 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:59.818018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8dc0ba9c-92cb-4756-9ae9-505fc287da52 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:03:59.818018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8dc0ba9c-92cb-4756-9ae9-505fc287da52 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:03:59.818018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8dc0ba9c-92cb-4756-9ae9-505fc287da52 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:03:59.847508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:00.289960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b684c7ec-e8bb-4d42-8beb-1ac3c7811bb5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:00.297474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8dc0ba9c-92cb-4756-9ae9-505fc287da52 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:00.328780 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b684c7ec-e8bb-4d42-8beb-1ac3c7811bb5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.525674 Sep 06 11:04:00.328927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8dc0ba9c-92cb-4756-9ae9-505fc287da52 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:00.329375 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1508/3024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:59 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:00.329481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8dc0ba9c-92cb-4756-9ae9-505fc287da52 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:00.329481 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8dc0ba9c-92cb-4756-9ae9-505fc287da52 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1838 microversion: 2.32 time: 0.511996 Sep 06 11:04:00.329481 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1517/3025] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:03:59 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1838 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:00.336481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbc8b2fa-ad6a-47c0-adcb-9953dbfd29ad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:00.337117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fbc8b2fa-ad6a-47c0-adcb-9953dbfd29ad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] [instance: 0d07bf04-ec2e-40a3-8916-aade0c51060b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:00.337901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-67fde725-6ae0-4510-9546-e59cda7be371 req-ea3157a4-45f8-4078-afee-0c57c3e0e730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "tag": "53554e9a-68ab-46af-bf31-d81bb29cfac6"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:00.351846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-67fde725-6ae0-4510-9546-e59cda7be371 req-ea3157a4-45f8-4078-afee-0c57c3e0e730 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:00.352298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc8b2fa-ad6a-47c0-adcb-9953dbfd29ad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:00.352427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-67fde725-6ae0-4510-9546-e59cda7be371 req-ea3157a4-45f8-4078-afee-0c57c3e0e730 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:00.352787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-67fde725-6ae0-4510-9546-e59cda7be371 req-ea3157a4-45f8-4078-afee-0c57c3e0e730 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:00.352912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc8b2fa-ad6a-47c0-adcb-9953dbfd29ad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:00.353305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc8b2fa-ad6a-47c0-adcb-9953dbfd29ad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:00.354024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc8b2fa-ad6a-47c0-adcb-9953dbfd29ad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:00.356426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc8b2fa-ad6a-47c0-adcb-9953dbfd29ad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:00.357087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc8b2fa-ad6a-47c0-adcb-9953dbfd29ad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:00.369769 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-67fde725-6ae0-4510-9546-e59cda7be371 req-ea3157a4-45f8-4078-afee-0c57c3e0e730 service nova] Creating event network-changed:53554e9a-68ab-46af-bf31-d81bb29cfac6 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:00.376755 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-67fde725-6ae0-4510-9546-e59cda7be371 req-ea3157a4-45f8-4078-afee-0c57c3e0e730 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063825 Sep 06 11:04:00.379259 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1509/3026] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:00.386840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fe8af5de-072d-4af9-8790-ea4b7794a08a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:00.387442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fe8af5de-072d-4af9-8790-ea4b7794a08a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:00.392655 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-fbc8b2fa-ad6a-47c0-adcb-9953dbfd29ad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] HTTP exception thrown: Instance 0d07bf04-ec2e-40a3-8916-aade0c51060b could not be found. Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbc8b2fa-ad6a-47c0-adcb-9953dbfd29ad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Request method failure captured: Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b HTTP/1.1 Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyhK9jZtW1DNORfwfRpR85Y8c-_tMHtG3Zvmm1PUkx_8Hh78J7D07mpIe0VOjywIx27PuMyL2q8quTjVO48e84bIJD3s_LW5pTYmlujPS4_Fm-TChnjJiUdBV3w5il4JD3oVz9FhIsPv7eYq78jkLQs8CmEWHfViPL5Ic4yWhP1Daig Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a7af966e1b740a59920ff9370b5dade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a7af966e1b740a59920ff9370b5dade"}]}] Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0a7af966e1b740a59920ff9370b5dade Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-884679318 Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 9e84745e5df647d1921e8d1ffc08711c Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersOnMultiNodesTest-884679318-project Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 0d07bf04-ec2e-40a3-8916-aade0c51060b could not be found. Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '0d07bf04-ec2e-40a3-8916-aade0c51060b'} Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d07bf04-ec2e-40a3-8916-aade0c51060b could not be found. Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d07bf04-ec2e-40a3-8916-aade0c51060b could not be found. Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:00.396222 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:00.410579 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:00.410579 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:00.410579 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:00.410579 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:00.410579 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:00.410579 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d07bf04-ec2e-40a3-8916-aade0c51060b could not be found. Sep 06 11:04:00.410579 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:00.411765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8af5de-072d-4af9-8790-ea4b7794a08a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:00.411765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8af5de-072d-4af9-8790-ea4b7794a08a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:00.411765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8af5de-072d-4af9-8790-ea4b7794a08a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:00.412192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbc8b2fa-ad6a-47c0-adcb-9953dbfd29ad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] Returning 404 to user: Instance 0d07bf04-ec2e-40a3-8916-aade0c51060b could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:00.412342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8af5de-072d-4af9-8790-ea4b7794a08a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:00.412502 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fbc8b2fa-ad6a-47c0-adcb-9953dbfd29ad tempest-ServersOnMultiNodesTest-884679318 tempest-ServersOnMultiNodesTest-884679318-project] 10.222.0.20 "GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b" status: 404 len: 111 microversion: 2.1 time: 0.068348 Sep 06 11:04:00.412645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8af5de-072d-4af9-8790-ea4b7794a08a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:00.412794 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1518/3027] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:00 2022] GET /compute/v2.1/servers/0d07bf04-ec2e-40a3-8916-aade0c51060b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:04:00.412948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8af5de-072d-4af9-8790-ea4b7794a08a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:00.702984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-635b4f90-36d6-47fe-bd05-6f789a2dc474 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:00.704014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-635b4f90-36d6-47fe-bd05-6f789a2dc474 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:00.713095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-635b4f90-36d6-47fe-bd05-6f789a2dc474 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:00.713095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-635b4f90-36d6-47fe-bd05-6f789a2dc474 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:00.713095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-635b4f90-36d6-47fe-bd05-6f789a2dc474 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:00.715061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-635b4f90-36d6-47fe-bd05-6f789a2dc474 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:00.715850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-635b4f90-36d6-47fe-bd05-6f789a2dc474 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:00.716549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-635b4f90-36d6-47fe-bd05-6f789a2dc474 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:00.896154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fe8af5de-072d-4af9-8790-ea4b7794a08a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:00.921024 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fe8af5de-072d-4af9-8790-ea4b7794a08a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1315 microversion: 2.1 time: 0.535827 Sep 06 11:04:00.921024 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1510/3028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:00 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:01.124870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-635b4f90-36d6-47fe-bd05-6f789a2dc474 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:01.133869 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-635b4f90-36d6-47fe-bd05-6f789a2dc474 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1474 microversion: 2.1 time: 0.440345 Sep 06 11:04:01.134475 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1519/3029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:00 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1474 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:01.335919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cc6460e9-b02a-48a8-ab4a-1b7701f2db95 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:01.336875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cc6460e9-b02a-48a8-ab4a-1b7701f2db95 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:01.345020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc6460e9-b02a-48a8-ab4a-1b7701f2db95 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:01.345924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc6460e9-b02a-48a8-ab4a-1b7701f2db95 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:01.346225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0e3392d5-52ef-454d-b72f-d9592a763011 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:01.347520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0e3392d5-52ef-454d-b72f-d9592a763011 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:01.348051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc6460e9-b02a-48a8-ab4a-1b7701f2db95 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:01.349033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc6460e9-b02a-48a8-ab4a-1b7701f2db95 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:01.349618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc6460e9-b02a-48a8-ab4a-1b7701f2db95 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:01.350279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc6460e9-b02a-48a8-ab4a-1b7701f2db95 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:01.355711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e3392d5-52ef-454d-b72f-d9592a763011 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:01.356312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e3392d5-52ef-454d-b72f-d9592a763011 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:01.356753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e3392d5-52ef-454d-b72f-d9592a763011 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:01.357647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e3392d5-52ef-454d-b72f-d9592a763011 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:01.358419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e3392d5-52ef-454d-b72f-d9592a763011 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:01.359106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e3392d5-52ef-454d-b72f-d9592a763011 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:01.838912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cc6460e9-b02a-48a8-ab4a-1b7701f2db95 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:01.849831 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cc6460e9-b02a-48a8-ab4a-1b7701f2db95 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.518467 Sep 06 11:04:01.851110 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1511/3030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:01 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:01.856719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-3a2d417d-0828-4090-875d-62f9c4ea5cd2 req-10113e43-3201-4b48-affa-b29a486beceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f3820c-e654-4eca-98de-9c5b2ec61763", "tag": "85f92e4a-b017-486e-a2da-1f2effdf2520"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:01.871767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3a2d417d-0828-4090-875d-62f9c4ea5cd2 req-10113e43-3201-4b48-affa-b29a486beceb service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:01.872496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3a2d417d-0828-4090-875d-62f9c4ea5cd2 req-10113e43-3201-4b48-affa-b29a486beceb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:01.872938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3a2d417d-0828-4090-875d-62f9c4ea5cd2 req-10113e43-3201-4b48-affa-b29a486beceb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:01.881333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0e3392d5-52ef-454d-b72f-d9592a763011 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:01.894952 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-3a2d417d-0828-4090-875d-62f9c4ea5cd2 req-10113e43-3201-4b48-affa-b29a486beceb service nova] Creating event network-changed:85f92e4a-b017-486e-a2da-1f2effdf2520 for instance b3f3820c-e654-4eca-98de-9c5b2ec61763 on nch2-master-1 Sep 06 11:04:01.895728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0e3392d5-52ef-454d-b72f-d9592a763011 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:01.899335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0e3392d5-52ef-454d-b72f-d9592a763011 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:01.900580 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0e3392d5-52ef-454d-b72f-d9592a763011 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1859 microversion: 2.32 time: 0.559472 Sep 06 11:04:01.902267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-3a2d417d-0828-4090-875d-62f9c4ea5cd2 req-10113e43-3201-4b48-affa-b29a486beceb service nova] Instance b3f3820c-e654-4eca-98de-9c5b2ec61763 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:04:01.920986 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1520/3031] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:01 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1859 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:01.921287 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-3a2d417d-0828-4090-875d-62f9c4ea5cd2 req-10113e43-3201-4b48-affa-b29a486beceb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065220 Sep 06 11:04:01.922300 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1512/3032] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:01.946386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8b2f1732-daee-477c-938f-a9c8886a8067 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:01.952076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8b2f1732-daee-477c-938f-a9c8886a8067 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:01.954113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b2f1732-daee-477c-938f-a9c8886a8067 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:01.954609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b2f1732-daee-477c-938f-a9c8886a8067 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:01.955077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b2f1732-daee-477c-938f-a9c8886a8067 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:01.955892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b2f1732-daee-477c-938f-a9c8886a8067 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:01.956422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b2f1732-daee-477c-938f-a9c8886a8067 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:01.956854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b2f1732-daee-477c-938f-a9c8886a8067 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:02.166490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cd20e1d0-17f4-4a40-bff8-6e7aa1080e18 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:02.167539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cd20e1d0-17f4-4a40-bff8-6e7aa1080e18 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:02.177503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd20e1d0-17f4-4a40-bff8-6e7aa1080e18 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:02.178021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd20e1d0-17f4-4a40-bff8-6e7aa1080e18 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:02.178475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd20e1d0-17f4-4a40-bff8-6e7aa1080e18 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:02.179786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd20e1d0-17f4-4a40-bff8-6e7aa1080e18 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:02.180263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd20e1d0-17f4-4a40-bff8-6e7aa1080e18 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:02.180817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd20e1d0-17f4-4a40-bff8-6e7aa1080e18 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:02.288185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8b2f1732-daee-477c-938f-a9c8886a8067 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:02.297230 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8b2f1732-daee-477c-938f-a9c8886a8067 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1315 microversion: 2.1 time: 0.355101 Sep 06 11:04:02.297895 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1521/3033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:01 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:02.403135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a7d3c2c3-5c19-46a0-9539-36a395e0a528 req-4c249c2d-ce15-444c-9d56-2e30b69ef63a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "tag": "6091afbd-6e3a-48d4-9bd0-a35e1dc72ec0"}, {"name": "network-changed", "server_uuid": "c88e39d8-efc0-43bd-9160-a5402a494295", "tag": "00e489af-a594-4794-acf5-75217d6ef056"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:02.416111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a7d3c2c3-5c19-46a0-9539-36a395e0a528 req-4c249c2d-ce15-444c-9d56-2e30b69ef63a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:02.416664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a7d3c2c3-5c19-46a0-9539-36a395e0a528 req-4c249c2d-ce15-444c-9d56-2e30b69ef63a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:02.417527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a7d3c2c3-5c19-46a0-9539-36a395e0a528 req-4c249c2d-ce15-444c-9d56-2e30b69ef63a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:02.442957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cd20e1d0-17f4-4a40-bff8-6e7aa1080e18 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:02.449854 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a7d3c2c3-5c19-46a0-9539-36a395e0a528 req-4c249c2d-ce15-444c-9d56-2e30b69ef63a service nova] Creating event network-changed:6091afbd-6e3a-48d4-9bd0-a35e1dc72ec0 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:02.450402 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a7d3c2c3-5c19-46a0-9539-36a395e0a528 req-4c249c2d-ce15-444c-9d56-2e30b69ef63a service nova] Creating event network-changed:00e489af-a594-4794-acf5-75217d6ef056 for instance c88e39d8-efc0-43bd-9160-a5402a494295 on nch1-master-1 Sep 06 11:04:02.468346 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cd20e1d0-17f4-4a40-bff8-6e7aa1080e18 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1472 microversion: 2.1 time: 0.313612 Sep 06 11:04:02.470034 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1513/3034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:02 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:02.470177 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a7d3c2c3-5c19-46a0-9539-36a395e0a528 req-4c249c2d-ce15-444c-9d56-2e30b69ef63a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072410 Sep 06 11:04:02.470794 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1522/3035] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:02.876457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1f7cf135-8ef8-4e13-9db6-1692b1f8ad68 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:02.877196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1f7cf135-8ef8-4e13-9db6-1692b1f8ad68 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:02.883947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7cf135-8ef8-4e13-9db6-1692b1f8ad68 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:02.884566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7cf135-8ef8-4e13-9db6-1692b1f8ad68 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:02.885112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7cf135-8ef8-4e13-9db6-1692b1f8ad68 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:02.885936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7cf135-8ef8-4e13-9db6-1692b1f8ad68 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:02.886507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7cf135-8ef8-4e13-9db6-1692b1f8ad68 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:02.886945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7cf135-8ef8-4e13-9db6-1692b1f8ad68 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:02.927905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6de40561-a39a-4b4c-aff6-e9c44942cd12 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:02.928639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6de40561-a39a-4b4c-aff6-e9c44942cd12 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:02.935893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6de40561-a39a-4b4c-aff6-e9c44942cd12 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:02.936642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6de40561-a39a-4b4c-aff6-e9c44942cd12 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:02.937292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6de40561-a39a-4b4c-aff6-e9c44942cd12 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:02.938023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6de40561-a39a-4b4c-aff6-e9c44942cd12 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:02.938504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6de40561-a39a-4b4c-aff6-e9c44942cd12 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:02.938946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6de40561-a39a-4b4c-aff6-e9c44942cd12 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:03.211987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1f7cf135-8ef8-4e13-9db6-1692b1f8ad68 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:03.219636 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1f7cf135-8ef8-4e13-9db6-1692b1f8ad68 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.347241 Sep 06 11:04:03.220606 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1514/3036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:02 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:03.322726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b2fcf410-379a-4a82-9de6-afc2bbb1fe80 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:03.323630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b2fcf410-379a-4a82-9de6-afc2bbb1fe80 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:03.335547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:03.342055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2fcf410-379a-4a82-9de6-afc2bbb1fe80 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:03.342055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2fcf410-379a-4a82-9de6-afc2bbb1fe80 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:03.345261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2fcf410-379a-4a82-9de6-afc2bbb1fe80 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:03.347561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2fcf410-379a-4a82-9de6-afc2bbb1fe80 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:03.349219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2fcf410-379a-4a82-9de6-afc2bbb1fe80 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:03.349706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2fcf410-379a-4a82-9de6-afc2bbb1fe80 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:03.354442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6de40561-a39a-4b4c-aff6-e9c44942cd12 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:03.368859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6de40561-a39a-4b4c-aff6-e9c44942cd12 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:03.370829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6de40561-a39a-4b4c-aff6-e9c44942cd12 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:03.372528 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6de40561-a39a-4b4c-aff6-e9c44942cd12 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1859 microversion: 2.32 time: 0.449343 Sep 06 11:04:03.372790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:03.375912 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1523/3037] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:02 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1859 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:03.499995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9c58433-ee82-4406-9c78-fc9e8e6b72af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:03.502842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d9c58433-ee82-4406-9c78-fc9e8e6b72af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:03.517396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9c58433-ee82-4406-9c78-fc9e8e6b72af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:03.520262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9c58433-ee82-4406-9c78-fc9e8e6b72af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:03.522475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9c58433-ee82-4406-9c78-fc9e8e6b72af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:03.524118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9c58433-ee82-4406-9c78-fc9e8e6b72af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:03.524767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9c58433-ee82-4406-9c78-fc9e8e6b72af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:03.526164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9c58433-ee82-4406-9c78-fc9e8e6b72af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:03.595657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b2fcf410-379a-4a82-9de6-afc2bbb1fe80 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:03.609647 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b2fcf410-379a-4a82-9de6-afc2bbb1fe80 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1315 microversion: 2.1 time: 0.289852 Sep 06 11:04:03.612927 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1515/3038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:03 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:03.805624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d9c58433-ee82-4406-9c78-fc9e8e6b72af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:03.814089 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d9c58433-ee82-4406-9c78-fc9e8e6b72af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1472 microversion: 2.1 time: 0.319007 Sep 06 11:04:03.814827 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1524/3039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:03 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1472 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:04.244423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-72404f9f-f7ce-4474-9569-1e565d782838 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:04.245198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-72404f9f-f7ce-4474-9569-1e565d782838 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:04.254046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72404f9f-f7ce-4474-9569-1e565d782838 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:04.254920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72404f9f-f7ce-4474-9569-1e565d782838 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:04.255504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72404f9f-f7ce-4474-9569-1e565d782838 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:04.257711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72404f9f-f7ce-4474-9569-1e565d782838 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:04.268148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72404f9f-f7ce-4474-9569-1e565d782838 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:04.269276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72404f9f-f7ce-4474-9569-1e565d782838 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:04.376450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-e08dc1c3-777d-43bc-9446-d59b0c3f6178 req-6b67b031-2357-401c-b4bd-60660cb8125c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "tag": "cbcd40f2-ac60-4973-9209-912e9fcab7d2"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:04.401994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e08dc1c3-777d-43bc-9446-d59b0c3f6178 req-6b67b031-2357-401c-b4bd-60660cb8125c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:04.402481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e08dc1c3-777d-43bc-9446-d59b0c3f6178 req-6b67b031-2357-401c-b4bd-60660cb8125c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:04.403779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e08dc1c3-777d-43bc-9446-d59b0c3f6178 req-6b67b031-2357-401c-b4bd-60660cb8125c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:04.441782 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-e08dc1c3-777d-43bc-9446-d59b0c3f6178 req-6b67b031-2357-401c-b4bd-60660cb8125c service nova] Creating event network-changed:cbcd40f2-ac60-4973-9209-912e9fcab7d2 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:04.467437 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-e08dc1c3-777d-43bc-9446-d59b0c3f6178 req-6b67b031-2357-401c-b4bd-60660cb8125c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099558 Sep 06 11:04:04.469856 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1525/3040] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:04.484718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-65a99192-1b30-4600-91ca-5fb977afce32 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:04.485294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-65a99192-1b30-4600-91ca-5fb977afce32 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:04.496819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65a99192-1b30-4600-91ca-5fb977afce32 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:04.497610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65a99192-1b30-4600-91ca-5fb977afce32 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:04.498221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65a99192-1b30-4600-91ca-5fb977afce32 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:04.499288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65a99192-1b30-4600-91ca-5fb977afce32 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:04.506938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65a99192-1b30-4600-91ca-5fb977afce32 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:04.510615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65a99192-1b30-4600-91ca-5fb977afce32 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:04.659712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:04.928428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-72404f9f-f7ce-4474-9569-1e565d782838 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:04.937635 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-72404f9f-f7ce-4474-9569-1e565d782838 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.698018 Sep 06 11:04:04.938900 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1516/3041] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:04 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:04.945020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-61a89bff-6384-4ce9-a9d3-2cd8f49bbf2d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:04.945879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-61a89bff-6384-4ce9-a9d3-2cd8f49bbf2d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:04.952913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61a89bff-6384-4ce9-a9d3-2cd8f49bbf2d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:04.953800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61a89bff-6384-4ce9-a9d3-2cd8f49bbf2d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:04.954441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61a89bff-6384-4ce9-a9d3-2cd8f49bbf2d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:04.955519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61a89bff-6384-4ce9-a9d3-2cd8f49bbf2d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:04.956743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61a89bff-6384-4ce9-a9d3-2cd8f49bbf2d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:04.957196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61a89bff-6384-4ce9-a9d3-2cd8f49bbf2d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:05.308304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-65a99192-1b30-4600-91ca-5fb977afce32 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:05.318421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-65a99192-1b30-4600-91ca-5fb977afce32 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:05.320227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-65a99192-1b30-4600-91ca-5fb977afce32 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:05.321723 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-65a99192-1b30-4600-91ca-5fb977afce32 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.849065 Sep 06 11:04:05.322479 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1526/3042] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:04 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:05.327312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-876e0ccd-3cc5-4605-b9d0-7d54adb40623 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:05.328137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-876e0ccd-3cc5-4605-b9d0-7d54adb40623 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:05.338280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-876e0ccd-3cc5-4605-b9d0-7d54adb40623 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:05.342034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-876e0ccd-3cc5-4605-b9d0-7d54adb40623 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:05.342034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-876e0ccd-3cc5-4605-b9d0-7d54adb40623 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:05.342034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-876e0ccd-3cc5-4605-b9d0-7d54adb40623 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:05.342034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-876e0ccd-3cc5-4605-b9d0-7d54adb40623 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:05.342477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-876e0ccd-3cc5-4605-b9d0-7d54adb40623 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:05.426985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-61a89bff-6384-4ce9-a9d3-2cd8f49bbf2d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:05.438833 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-61a89bff-6384-4ce9-a9d3-2cd8f49bbf2d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1315 microversion: 2.1 time: 0.498197 Sep 06 11:04:05.439665 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1517/3043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:04 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:05.595405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-876e0ccd-3cc5-4605-b9d0-7d54adb40623 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:05.607701 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-876e0ccd-3cc5-4605-b9d0-7d54adb40623 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1469 microversion: 2.1 time: 0.283295 Sep 06 11:04:05.609580 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1527/3044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:05 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1469 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:05.632847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d01bd961-cafd-404a-a955-f327e1fb7051 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:05.633574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d01bd961-cafd-404a-a955-f327e1fb7051 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:05.640347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d01bd961-cafd-404a-a955-f327e1fb7051 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:05.640852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d01bd961-cafd-404a-a955-f327e1fb7051 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:05.644082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d01bd961-cafd-404a-a955-f327e1fb7051 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:05.644082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d01bd961-cafd-404a-a955-f327e1fb7051 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:05.644082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d01bd961-cafd-404a-a955-f327e1fb7051 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:05.644082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d01bd961-cafd-404a-a955-f327e1fb7051 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:05.680025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:05.748264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b290698-3054-4da5-922a-280ee571c77f tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Calling method '.version_select at 0x7f90f35d34c0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:05.765832 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-2b290698-3054-4da5-922a-280ee571c77f tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] HTTP exception thrown: Image not found. Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b290698-3054-4da5-922a-280ee571c77f tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Request method failure captured: Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/images/104ca2d2-de5a-4d70-86ad-7ce8a2fcc0f9/metadata/os_distro HTTP/1.1 Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFykkzKgr3-g3aSf_bUtNPaOiklFZx9SjXlPGzWk2B-3wTf7MwTJNE1xHnq_1T7-un2FrV_S4LnSxssDoz5eKeU0l3v-NjKR59C3Gz_8r4TFZtdnXyFweLRj-_krVyF7g937sLvsSIsqDAjSTPSgO18B3mMuJwCbnMY6LQAKspn3WLZg Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 02af2d2184304fe59a6cfc25f2df2332 Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02af2d2184304fe59a6cfc25f2df2332"}]}] Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 02af2d2184304fe59a6cfc25f2df2332 Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesMetadataNegativeTestJSON-264746476-project Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d16999eeb7cb427a9024867f457edd3f Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-264746476-project Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: exception: Image not found. Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'image_id': '104ca2d2-de5a-4d70-86ad-7ce8a2fcc0f9', 'id': 'os_distro'} Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 104ca2d2-de5a-4d70-86ad-7ce8a2fcc0f9 Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 06 11:04:05.773992 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 104ca2d2-de5a-4d70-86ad-7ce8a2fcc0f9 could not be found. Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b290698-3054-4da5-922a-280ee571c77f tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Returning 404 to user: Image not found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b290698-3054-4da5-922a-280ee571c77f tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] 10.222.0.20 "DELETE /compute/v2.1/images/104ca2d2-de5a-4d70-86ad-7ce8a2fcc0f9/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.333841 Sep 06 11:04:05.779291 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1518/3045] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Sep 6 11:04:05 2022] DELETE /compute/v2.1/images/104ca2d2-de5a-4d70-86ad-7ce8a2fcc0f9/metadata/os_distro => generated 62 bytes in 336 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:04:05.788156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-769fe006-bdbd-4022-9de5-987a0e8f2e86 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Calling method '.version_select at 0x7f90f36ccdc0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:05.820987 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-769fe006-bdbd-4022-9de5-987a0e8f2e86 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] HTTP exception thrown: Image not found. Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-769fe006-bdbd-4022-9de5-987a0e8f2e86 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Request method failure captured: Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/images/8f9a0718-2ebb-4615-8efa-21985602ad6d/metadata/os_version HTTP/1.1 Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFykkzKgr3-g3aSf_bUtNPaOiklFZx9SjXlPGzWk2B-3wTf7MwTJNE1xHnq_1T7-un2FrV_S4LnSxssDoz5eKeU0l3v-NjKR59C3Gz_8r4TFZtdnXyFweLRj-_krVyF7g937sLvsSIsqDAjSTPSgO18B3mMuJwCbnMY6LQAKspn3WLZg Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 02af2d2184304fe59a6cfc25f2df2332 Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02af2d2184304fe59a6cfc25f2df2332"}]}] Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 02af2d2184304fe59a6cfc25f2df2332 Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesMetadataNegativeTestJSON-264746476-project Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d16999eeb7cb427a9024867f457edd3f Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-264746476-project Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: exception: Image not found. Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'image_id': '8f9a0718-2ebb-4615-8efa-21985602ad6d', 'id': 'os_version'} Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8f9a0718-2ebb-4615-8efa-21985602ad6d Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 06 11:04:05.823180 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8f9a0718-2ebb-4615-8efa-21985602ad6d could not be found. Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-769fe006-bdbd-4022-9de5-987a0e8f2e86 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Returning 404 to user: Image not found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-769fe006-bdbd-4022-9de5-987a0e8f2e86 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] 10.222.0.20 "GET /compute/v2.1/images/8f9a0718-2ebb-4615-8efa-21985602ad6d/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.041540 Sep 06 11:04:05.828131 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1519/3046] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Sep 6 11:04:05 2022] GET /compute/v2.1/images/8f9a0718-2ebb-4615-8efa-21985602ad6d/metadata/os_version => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:04:05.840157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-66ce5c4e-4ba3-47b9-b61b-9d866a072ef4 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Calling method '.version_select at 0x7f90f369b310>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:05.862253 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-66ce5c4e-4ba3-47b9-b61b-9d866a072ef4 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] HTTP exception thrown: Image not found. Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-66ce5c4e-4ba3-47b9-b61b-9d866a072ef4 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Request method failure captured: Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/images/ba4def91-1966-43bc-9fff-05a75d59104a/metadata HTTP/1.1 Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFykkzKgr3-g3aSf_bUtNPaOiklFZx9SjXlPGzWk2B-3wTf7MwTJNE1xHnq_1T7-un2FrV_S4LnSxssDoz5eKeU0l3v-NjKR59C3Gz_8r4TFZtdnXyFweLRj-_krVyF7g937sLvsSIsqDAjSTPSgO18B3mMuJwCbnMY6LQAKspn3WLZg Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 02af2d2184304fe59a6cfc25f2df2332 Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02af2d2184304fe59a6cfc25f2df2332"}]}] Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 02af2d2184304fe59a6cfc25f2df2332 Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesMetadataNegativeTestJSON-264746476-project Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d16999eeb7cb427a9024867f457edd3f Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-264746476-project Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: exception: Image not found. Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'image_id': 'ba4def91-1966-43bc-9fff-05a75d59104a'} Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ba4def91-1966-43bc-9fff-05a75d59104a Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 06 11:04:05.864365 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ba4def91-1966-43bc-9fff-05a75d59104a could not be found. Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-66ce5c4e-4ba3-47b9-b61b-9d866a072ef4 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Returning 404 to user: Image not found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-66ce5c4e-4ba3-47b9-b61b-9d866a072ef4 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] 10.222.0.20 "GET /compute/v2.1/images/ba4def91-1966-43bc-9fff-05a75d59104a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.034806 Sep 06 11:04:05.868951 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1520/3047] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 11:04:05 2022] GET /compute/v2.1/images/ba4def91-1966-43bc-9fff-05a75d59104a/metadata => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 06 11:04:05.886183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-45748883-443a-41a5-af47-af2eebfec0de tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Action: 'update_all', calling method: .version_select at 0x7f90f36cbe50>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:05.903097 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-45748883-443a-41a5-af47-af2eebfec0de tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] HTTP exception thrown: Image not found. Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-45748883-443a-41a5-af47-af2eebfec0de tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Request method failure captured: Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: request: PUT /compute/v2.1/images/199a9c70-a52f-4a98-a69a-dba44d36a86e/metadata HTTP/1.1 Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 57 Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFykkzKgr3-g3aSf_bUtNPaOiklFZx9SjXlPGzWk2B-3wTf7MwTJNE1xHnq_1T7-un2FrV_S4LnSxssDoz5eKeU0l3v-NjKR59C3Gz_8r4TFZtdnXyFweLRj-_krVyF7g937sLvsSIsqDAjSTPSgO18B3mMuJwCbnMY6LQAKspn3WLZg Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 02af2d2184304fe59a6cfc25f2df2332 Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02af2d2184304fe59a6cfc25f2df2332"}]}] Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 02af2d2184304fe59a6cfc25f2df2332 Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesMetadataNegativeTestJSON-264746476-project Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d16999eeb7cb427a9024867f457edd3f Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-264746476-project Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: exception: Image not found. Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'image_id': '199a9c70-a52f-4a98-a69a-dba44d36a86e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 199a9c70-a52f-4a98-a69a-dba44d36a86e Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 06 11:04:05.905261 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 199a9c70-a52f-4a98-a69a-dba44d36a86e could not be found. Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-45748883-443a-41a5-af47-af2eebfec0de tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Returning 404 to user: Image not found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-45748883-443a-41a5-af47-af2eebfec0de tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] 10.222.0.20 "PUT /compute/v2.1/images/199a9c70-a52f-4a98-a69a-dba44d36a86e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035167 Sep 06 11:04:05.914722 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1521/3048] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:04:05 2022] PUT /compute/v2.1/images/199a9c70-a52f-4a98-a69a-dba44d36a86e/metadata => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 06 11:04:05.919218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8fe36cd9-e59c-49f1-ac7f-1c575efa5136 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Action: 'update', calling method: .version_select at 0x7f90f3620670>, body: {"meta": {"os_distro": "alt"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:05.947556 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-8fe36cd9-e59c-49f1-ac7f-1c575efa5136 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] HTTP exception thrown: Image not found. Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8fe36cd9-e59c-49f1-ac7f-1c575efa5136 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Request method failure captured: Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: request: PUT /compute/v2.1/images/965d467f-c15b-4fc8-96b6-a28df5a21e97/metadata/os_distro HTTP/1.1 Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 30 Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFykkzKgr3-g3aSf_bUtNPaOiklFZx9SjXlPGzWk2B-3wTf7MwTJNE1xHnq_1T7-un2FrV_S4LnSxssDoz5eKeU0l3v-NjKR59C3Gz_8r4TFZtdnXyFweLRj-_krVyF7g937sLvsSIsqDAjSTPSgO18B3mMuJwCbnMY6LQAKspn3WLZg Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 02af2d2184304fe59a6cfc25f2df2332 Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02af2d2184304fe59a6cfc25f2df2332"}]}] Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 02af2d2184304fe59a6cfc25f2df2332 Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesMetadataNegativeTestJSON-264746476-project Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d16999eeb7cb427a9024867f457edd3f Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-264746476-project Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: {"meta": {"os_distro": "alt"}} Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: exception: Image not found. Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'image_id': '965d467f-c15b-4fc8-96b6-a28df5a21e97', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 965d467f-c15b-4fc8-96b6-a28df5a21e97 Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 06 11:04:05.950183 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 965d467f-c15b-4fc8-96b6-a28df5a21e97 could not be found. Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8fe36cd9-e59c-49f1-ac7f-1c575efa5136 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Returning 404 to user: Image not found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8fe36cd9-e59c-49f1-ac7f-1c575efa5136 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] 10.222.0.20 "PUT /compute/v2.1/images/965d467f-c15b-4fc8-96b6-a28df5a21e97/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.037710 Sep 06 11:04:05.965408 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1522/3049] 10.222.0.20 () {60 vars in 1310 bytes} [Tue Sep 6 11:04:05 2022] PUT /compute/v2.1/images/965d467f-c15b-4fc8-96b6-a28df5a21e97/metadata/os_distro => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:04:05.971084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b778c861-8a78-4e02-b42b-fae8511aba32 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:05.972279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b778c861-8a78-4e02-b42b-fae8511aba32 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:05.978739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b778c861-8a78-4e02-b42b-fae8511aba32 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:05.979267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b778c861-8a78-4e02-b42b-fae8511aba32 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:05.979727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b778c861-8a78-4e02-b42b-fae8511aba32 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:05.980452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b778c861-8a78-4e02-b42b-fae8511aba32 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:05.980925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b778c861-8a78-4e02-b42b-fae8511aba32 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:05.981369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b778c861-8a78-4e02-b42b-fae8511aba32 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:06.044733 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d01bd961-cafd-404a-a955-f327e1fb7051 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "POST /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763/action" status: 202 len: 0 microversion: 2.1 time: 0.412596 Sep 06 11:04:06.048583 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1528/3050] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:05 2022] POST /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:04:06.073649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f4aa2b7-1190-4f70-805f-8e5069d44c80 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Action: 'create', calling method: .version_select at 0x7f90f929d430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:06.104177 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-4f4aa2b7-1190-4f70-805f-8e5069d44c80 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] HTTP exception thrown: Image not found. Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f4aa2b7-1190-4f70-805f-8e5069d44c80 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Request method failure captured: Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/images/e5643019-c6b5-4036-b9a9-5284fb3be3a0/metadata HTTP/1.1 Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 57 Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFykkzKgr3-g3aSf_bUtNPaOiklFZx9SjXlPGzWk2B-3wTf7MwTJNE1xHnq_1T7-un2FrV_S4LnSxssDoz5eKeU0l3v-NjKR59C3Gz_8r4TFZtdnXyFweLRj-_krVyF7g937sLvsSIsqDAjSTPSgO18B3mMuJwCbnMY6LQAKspn3WLZg Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 02af2d2184304fe59a6cfc25f2df2332 Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/02af2d2184304fe59a6cfc25f2df2332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/02af2d2184304fe59a6cfc25f2df2332"}]}] Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 02af2d2184304fe59a6cfc25f2df2332 Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-264746476 Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesMetadataNegativeTestJSON-264746476-project Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d16999eeb7cb427a9024867f457edd3f Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-264746476-project Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: exception: Image not found. Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'image_id': 'e5643019-c6b5-4036-b9a9-5284fb3be3a0', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e5643019-c6b5-4036-b9a9-5284fb3be3a0 Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 06 11:04:06.106847 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e5643019-c6b5-4036-b9a9-5284fb3be3a0 could not be found. Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 11:04:06.111272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:06.120602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f4aa2b7-1190-4f70-805f-8e5069d44c80 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] Returning 404 to user: Image not found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:06.120602 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4f4aa2b7-1190-4f70-805f-8e5069d44c80 tempest-ImagesMetadataNegativeTestJSON-264746476 tempest-ImagesMetadataNegativeTestJSON-264746476-project] 10.222.0.20 "POST /compute/v2.1/images/e5643019-c6b5-4036-b9a9-5284fb3be3a0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.066881 Sep 06 11:04:06.120602 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1529/3051] 10.222.0.20 () {60 vars in 1281 bytes} [Tue Sep 6 11:04:06 2022] POST /compute/v2.1/images/e5643019-c6b5-4036-b9a9-5284fb3be3a0/metadata => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:04:06.122059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d4270e9b-169c-4cb3-88e2-d21cd661a1a3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:06.124306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d4270e9b-169c-4cb3-88e2-d21cd661a1a3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:06.132997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4270e9b-169c-4cb3-88e2-d21cd661a1a3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:06.133593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4270e9b-169c-4cb3-88e2-d21cd661a1a3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:06.134051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4270e9b-169c-4cb3-88e2-d21cd661a1a3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:06.135102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4270e9b-169c-4cb3-88e2-d21cd661a1a3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:06.135582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4270e9b-169c-4cb3-88e2-d21cd661a1a3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:06.136026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4270e9b-169c-4cb3-88e2-d21cd661a1a3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:06.157469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b778c861-8a78-4e02-b42b-fae8511aba32 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:06.167070 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b778c861-8a78-4e02-b42b-fae8511aba32 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.206275 Sep 06 11:04:06.167750 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1523/3052] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:05 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:06.356645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3ebf37f-75b7-45ec-8d70-f83658d6ed69 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:06.357982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f3ebf37f-75b7-45ec-8d70-f83658d6ed69 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:06.370025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:06.378527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3ebf37f-75b7-45ec-8d70-f83658d6ed69 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:06.378527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3ebf37f-75b7-45ec-8d70-f83658d6ed69 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:06.378527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3ebf37f-75b7-45ec-8d70-f83658d6ed69 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:06.378527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3ebf37f-75b7-45ec-8d70-f83658d6ed69 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:06.378527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3ebf37f-75b7-45ec-8d70-f83658d6ed69 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:06.378527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3ebf37f-75b7-45ec-8d70-f83658d6ed69 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:06.383508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d4270e9b-169c-4cb3-88e2-d21cd661a1a3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:06.394627 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d4270e9b-169c-4cb3-88e2-d21cd661a1a3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1468 microversion: 2.1 time: 0.278087 Sep 06 11:04:06.399635 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1530/3053] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:06 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1468 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:06.465935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-56fb76ed-a367-4759-acaf-3c0938d642fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:06.466711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-56fb76ed-a367-4759-acaf-3c0938d642fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:06.478430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56fb76ed-a367-4759-acaf-3c0938d642fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:06.479566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56fb76ed-a367-4759-acaf-3c0938d642fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:06.481003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56fb76ed-a367-4759-acaf-3c0938d642fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:06.481923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56fb76ed-a367-4759-acaf-3c0938d642fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:06.483044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56fb76ed-a367-4759-acaf-3c0938d642fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:06.484525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56fb76ed-a367-4759-acaf-3c0938d642fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:06.800456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f3ebf37f-75b7-45ec-8d70-f83658d6ed69 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:06.811398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f3ebf37f-75b7-45ec-8d70-f83658d6ed69 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:06.823135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f3ebf37f-75b7-45ec-8d70-f83658d6ed69 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:06.826212 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f3ebf37f-75b7-45ec-8d70-f83658d6ed69 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.481969 Sep 06 11:04:06.828290 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1524/3054] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:06 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:04:06.849032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-82fbb254-94ad-49b6-80d0-daf762c4992b req-d9eef974-885f-4a3a-902e-dade3e476378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "tag": "049445db-4d1a-414d-a121-813328072bfc"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:06.870217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-56fb76ed-a367-4759-acaf-3c0938d642fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:06.887899 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-56fb76ed-a367-4759-acaf-3c0938d642fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1315 microversion: 2.1 time: 0.429183 Sep 06 11:04:06.889001 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1531/3055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:06 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:06.891354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-82fbb254-94ad-49b6-80d0-daf762c4992b req-d9eef974-885f-4a3a-902e-dade3e476378 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:06.893125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-82fbb254-94ad-49b6-80d0-daf762c4992b req-d9eef974-885f-4a3a-902e-dade3e476378 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:06.893998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-82fbb254-94ad-49b6-80d0-daf762c4992b req-d9eef974-885f-4a3a-902e-dade3e476378 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:06.922713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-cfef3251-ec21-4209-aad4-d73b488c9d3d req-f58f6063-7be9-49ff-8cfc-a741911461bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f3820c-e654-4eca-98de-9c5b2ec61763", "name": "network-vif-plugged", "status": "completed", "tag": "85f92e4a-b017-486e-a2da-1f2effdf2520"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:06.961969 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-82fbb254-94ad-49b6-80d0-daf762c4992b req-d9eef974-885f-4a3a-902e-dade3e476378 service nova] Creating event network-changed:049445db-4d1a-414d-a121-813328072bfc for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:06.969830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cfef3251-ec21-4209-aad4-d73b488c9d3d req-f58f6063-7be9-49ff-8cfc-a741911461bc service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:06.970321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cfef3251-ec21-4209-aad4-d73b488c9d3d req-f58f6063-7be9-49ff-8cfc-a741911461bc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:06.970796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cfef3251-ec21-4209-aad4-d73b488c9d3d req-f58f6063-7be9-49ff-8cfc-a741911461bc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:06.981291 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-82fbb254-94ad-49b6-80d0-daf762c4992b req-d9eef974-885f-4a3a-902e-dade3e476378 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150984 Sep 06 11:04:06.981850 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1525/3056] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:07.004910 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-cfef3251-ec21-4209-aad4-d73b488c9d3d req-f58f6063-7be9-49ff-8cfc-a741911461bc service nova] Creating event network-vif-plugged:85f92e4a-b017-486e-a2da-1f2effdf2520 for instance b3f3820c-e654-4eca-98de-9c5b2ec61763 on nch2-master-1 Sep 06 11:04:07.021128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-cfef3251-ec21-4209-aad4-d73b488c9d3d req-f58f6063-7be9-49ff-8cfc-a741911461bc service nova] Instance b3f3820c-e654-4eca-98de-9c5b2ec61763 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:04:07.046299 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-cfef3251-ec21-4209-aad4-d73b488c9d3d req-f58f6063-7be9-49ff-8cfc-a741911461bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156039 Sep 06 11:04:07.047369 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1532/3057] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:07.193910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-da091e95-f6c5-4b40-92be-178acae09fe2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:07.194634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-da091e95-f6c5-4b40-92be-178acae09fe2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:07.206865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da091e95-f6c5-4b40-92be-178acae09fe2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:07.207390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da091e95-f6c5-4b40-92be-178acae09fe2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:07.207836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da091e95-f6c5-4b40-92be-178acae09fe2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:07.208552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da091e95-f6c5-4b40-92be-178acae09fe2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:07.209012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da091e95-f6c5-4b40-92be-178acae09fe2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:07.216881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da091e95-f6c5-4b40-92be-178acae09fe2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:07.424423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ffdfe67a-809e-43f3-8de5-cdc31290a2af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:07.425503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ffdfe67a-809e-43f3-8de5-cdc31290a2af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:07.434185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffdfe67a-809e-43f3-8de5-cdc31290a2af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:07.434800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffdfe67a-809e-43f3-8de5-cdc31290a2af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:07.435325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffdfe67a-809e-43f3-8de5-cdc31290a2af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:07.444070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffdfe67a-809e-43f3-8de5-cdc31290a2af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:07.444070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffdfe67a-809e-43f3-8de5-cdc31290a2af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:07.444070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffdfe67a-809e-43f3-8de5-cdc31290a2af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:07.638232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-da091e95-f6c5-4b40-92be-178acae09fe2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:07.649286 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-da091e95-f6c5-4b40-92be-178acae09fe2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.460413 Sep 06 11:04:07.649968 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1526/3058] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:07 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:07.708410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ffdfe67a-809e-43f3-8de5-cdc31290a2af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:07.719171 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ffdfe67a-809e-43f3-8de5-cdc31290a2af tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1468 microversion: 2.1 time: 0.300863 Sep 06 11:04:07.719971 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1533/3059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:07 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1468 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:07.858106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-572b523f-78bc-4672-9c73-c40a56c0a594 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:07.858729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-572b523f-78bc-4672-9c73-c40a56c0a594 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:07.864723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-572b523f-78bc-4672-9c73-c40a56c0a594 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:07.865214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-572b523f-78bc-4672-9c73-c40a56c0a594 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:07.865837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-572b523f-78bc-4672-9c73-c40a56c0a594 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:07.866544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-572b523f-78bc-4672-9c73-c40a56c0a594 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:07.867226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-572b523f-78bc-4672-9c73-c40a56c0a594 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:07.867662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-572b523f-78bc-4672-9c73-c40a56c0a594 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:07.920314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-280b954b-9312-49bc-86e1-cd9d16fd8a46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:07.920314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-280b954b-9312-49bc-86e1-cd9d16fd8a46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:07.926703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-280b954b-9312-49bc-86e1-cd9d16fd8a46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:07.927226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-280b954b-9312-49bc-86e1-cd9d16fd8a46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:07.927674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-280b954b-9312-49bc-86e1-cd9d16fd8a46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:07.928386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-280b954b-9312-49bc-86e1-cd9d16fd8a46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:07.928848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-280b954b-9312-49bc-86e1-cd9d16fd8a46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:07.929287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-280b954b-9312-49bc-86e1-cd9d16fd8a46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:08.185224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-572b523f-78bc-4672-9c73-c40a56c0a594 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:08.199975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-572b523f-78bc-4672-9c73-c40a56c0a594 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:08.199975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-572b523f-78bc-4672-9c73-c40a56c0a594 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:08.200378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-280b954b-9312-49bc-86e1-cd9d16fd8a46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:08.200509 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-572b523f-78bc-4672-9c73-c40a56c0a594 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.344881 Sep 06 11:04:08.200509 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1527/3060] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:07 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:08.208755 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-280b954b-9312-49bc-86e1-cd9d16fd8a46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1315 microversion: 2.1 time: 0.293489 Sep 06 11:04:08.209330 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1534/3061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:07 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:08.672796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1249a21f-40f8-4c5c-8091-2bc42722b421 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:08.673609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1249a21f-40f8-4c5c-8091-2bc42722b421 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:08.682172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1249a21f-40f8-4c5c-8091-2bc42722b421 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:08.682681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1249a21f-40f8-4c5c-8091-2bc42722b421 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:08.683292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1249a21f-40f8-4c5c-8091-2bc42722b421 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:08.684560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1249a21f-40f8-4c5c-8091-2bc42722b421 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:08.685044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1249a21f-40f8-4c5c-8091-2bc42722b421 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:08.685508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1249a21f-40f8-4c5c-8091-2bc42722b421 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:08.742500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-99e98617-db62-4de3-b51e-b742ee462dc3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:08.743298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-99e98617-db62-4de3-b51e-b742ee462dc3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:08.757800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99e98617-db62-4de3-b51e-b742ee462dc3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:08.758597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99e98617-db62-4de3-b51e-b742ee462dc3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:08.759251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99e98617-db62-4de3-b51e-b742ee462dc3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:08.760176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99e98617-db62-4de3-b51e-b742ee462dc3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:08.762536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99e98617-db62-4de3-b51e-b742ee462dc3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:08.763214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99e98617-db62-4de3-b51e-b742ee462dc3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:08.954807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1249a21f-40f8-4c5c-8091-2bc42722b421 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:08.964004 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1249a21f-40f8-4c5c-8091-2bc42722b421 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.295072 Sep 06 11:04:08.969205 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1528/3062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:08 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:09.000249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6d485e45-3ea9-4df3-9a39-30b0be71b366 req-89ea7bf5-c95e-4df3-a84c-3feddbb80958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "tag": "ec288bce-0ab7-40a2-81eb-874eab5b26e6"}, {"name": "network-changed", "server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "tag": "8b3ac40a-47a0-4d01-ae00-cba282f046f8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:09.023712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6d485e45-3ea9-4df3-9a39-30b0be71b366 req-89ea7bf5-c95e-4df3-a84c-3feddbb80958 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:09.024486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6d485e45-3ea9-4df3-9a39-30b0be71b366 req-89ea7bf5-c95e-4df3-a84c-3feddbb80958 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:09.025143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6d485e45-3ea9-4df3-9a39-30b0be71b366 req-89ea7bf5-c95e-4df3-a84c-3feddbb80958 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:09.041717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-99e98617-db62-4de3-b51e-b742ee462dc3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:09.044908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:09.049985 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6d485e45-3ea9-4df3-9a39-30b0be71b366 req-89ea7bf5-c95e-4df3-a84c-3feddbb80958 service nova] Creating event network-changed:ec288bce-0ab7-40a2-81eb-874eab5b26e6 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:09.051122 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6d485e45-3ea9-4df3-9a39-30b0be71b366 req-89ea7bf5-c95e-4df3-a84c-3feddbb80958 service nova] Creating event network-changed:8b3ac40a-47a0-4d01-ae00-cba282f046f8 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:09.056304 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-99e98617-db62-4de3-b51e-b742ee462dc3 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1468 microversion: 2.1 time: 0.313692 Sep 06 11:04:09.057420 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6d485e45-3ea9-4df3-9a39-30b0be71b366 req-89ea7bf5-c95e-4df3-a84c-3feddbb80958 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061406 Sep 06 11:04:09.058591 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1535/3063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:08 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1468 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:09.059250 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1529/3064] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:09.067137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-614c56ea-ca9a-4d35-a7b3-0b4ddc8e5e34 req-9aa8ab14-68be-4e0a-b476-14a4c616e9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88e39d8-efc0-43bd-9160-a5402a494295", "name": "network-vif-plugged", "status": "completed", "tag": "00e489af-a594-4794-acf5-75217d6ef056"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:09.078204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-614c56ea-ca9a-4d35-a7b3-0b4ddc8e5e34 req-9aa8ab14-68be-4e0a-b476-14a4c616e9ed service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:09.078709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-614c56ea-ca9a-4d35-a7b3-0b4ddc8e5e34 req-9aa8ab14-68be-4e0a-b476-14a4c616e9ed service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:09.079968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-614c56ea-ca9a-4d35-a7b3-0b4ddc8e5e34 req-9aa8ab14-68be-4e0a-b476-14a4c616e9ed service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:09.152853 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-614c56ea-ca9a-4d35-a7b3-0b4ddc8e5e34 req-9aa8ab14-68be-4e0a-b476-14a4c616e9ed service nova] Creating event network-vif-plugged:00e489af-a594-4794-acf5-75217d6ef056 for instance c88e39d8-efc0-43bd-9160-a5402a494295 on nch1-master-1 Sep 06 11:04:09.165679 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-614c56ea-ca9a-4d35-a7b3-0b4ddc8e5e34 req-9aa8ab14-68be-4e0a-b476-14a4c616e9ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102526 Sep 06 11:04:09.166768 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1536/3065] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:09.226338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ab4612a7-3704-490d-a20f-3c40c8bbd6b6 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:09.227225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ab4612a7-3704-490d-a20f-3c40c8bbd6b6 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:09.233374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6d474613-07dd-4264-b196-fc3175dd9d31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:09.234566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6d474613-07dd-4264-b196-fc3175dd9d31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:09.238889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab4612a7-3704-490d-a20f-3c40c8bbd6b6 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:09.238889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab4612a7-3704-490d-a20f-3c40c8bbd6b6 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:09.239336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab4612a7-3704-490d-a20f-3c40c8bbd6b6 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:09.240282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab4612a7-3704-490d-a20f-3c40c8bbd6b6 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:09.240769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab4612a7-3704-490d-a20f-3c40c8bbd6b6 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:09.244961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab4612a7-3704-490d-a20f-3c40c8bbd6b6 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:09.245452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d474613-07dd-4264-b196-fc3175dd9d31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:09.248584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d474613-07dd-4264-b196-fc3175dd9d31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:09.249241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d474613-07dd-4264-b196-fc3175dd9d31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:09.250377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d474613-07dd-4264-b196-fc3175dd9d31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:09.250694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:09.251369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d474613-07dd-4264-b196-fc3175dd9d31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:09.253202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d474613-07dd-4264-b196-fc3175dd9d31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:09.743316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6d474613-07dd-4264-b196-fc3175dd9d31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:09.750792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ab4612a7-3704-490d-a20f-3c40c8bbd6b6 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:09.766625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ab4612a7-3704-490d-a20f-3c40c8bbd6b6 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:09.772767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ab4612a7-3704-490d-a20f-3c40c8bbd6b6 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:09.773798 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6d474613-07dd-4264-b196-fc3175dd9d31 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1315 microversion: 2.1 time: 0.544214 Sep 06 11:04:09.774421 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1537/3066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:09 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:09.775150 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ab4612a7-3704-490d-a20f-3c40c8bbd6b6 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.552947 Sep 06 11:04:09.782907 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1530/3067] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:09 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:09.995897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-607252b7-611c-4eb2-adf1-25da22387c50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:10.001902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-607252b7-611c-4eb2-adf1-25da22387c50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:10.002765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-607252b7-611c-4eb2-adf1-25da22387c50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:10.003493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-607252b7-611c-4eb2-adf1-25da22387c50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:10.003933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-607252b7-611c-4eb2-adf1-25da22387c50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:10.004895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-607252b7-611c-4eb2-adf1-25da22387c50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:10.005368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-607252b7-611c-4eb2-adf1-25da22387c50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:10.005789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-607252b7-611c-4eb2-adf1-25da22387c50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:10.082719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-36122a1f-ef6b-4c19-9a39-755b029cf17c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:10.083956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-36122a1f-ef6b-4c19-9a39-755b029cf17c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:10.112791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36122a1f-ef6b-4c19-9a39-755b029cf17c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:10.115771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36122a1f-ef6b-4c19-9a39-755b029cf17c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:10.120294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36122a1f-ef6b-4c19-9a39-755b029cf17c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:10.120294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36122a1f-ef6b-4c19-9a39-755b029cf17c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:10.120294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36122a1f-ef6b-4c19-9a39-755b029cf17c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:10.123914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36122a1f-ef6b-4c19-9a39-755b029cf17c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:10.404578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-607252b7-611c-4eb2-adf1-25da22387c50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:10.414562 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-607252b7-611c-4eb2-adf1-25da22387c50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.422763 Sep 06 11:04:10.415703 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1538/3068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:09 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:10.500019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-36122a1f-ef6b-4c19-9a39-755b029cf17c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:10.508711 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-36122a1f-ef6b-4c19-9a39-755b029cf17c tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1468 microversion: 2.1 time: 0.432380 Sep 06 11:04:10.509589 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1531/3069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:10 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1468 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:10.798526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-692d33a8-78de-472e-82dd-072341aba932 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:10.799327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-692d33a8-78de-472e-82dd-072341aba932 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:10.810967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-75fbbbdb-1aac-4b77-a6dc-b2e69dea98ab tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:10.811663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-75fbbbdb-1aac-4b77-a6dc-b2e69dea98ab tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:10.818961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-692d33a8-78de-472e-82dd-072341aba932 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:10.819795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-692d33a8-78de-472e-82dd-072341aba932 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:10.820271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-692d33a8-78de-472e-82dd-072341aba932 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:10.824592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-692d33a8-78de-472e-82dd-072341aba932 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:10.825257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-692d33a8-78de-472e-82dd-072341aba932 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:10.826332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-692d33a8-78de-472e-82dd-072341aba932 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:10.832893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75fbbbdb-1aac-4b77-a6dc-b2e69dea98ab tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:10.834255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75fbbbdb-1aac-4b77-a6dc-b2e69dea98ab tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:10.836283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75fbbbdb-1aac-4b77-a6dc-b2e69dea98ab tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:10.838855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75fbbbdb-1aac-4b77-a6dc-b2e69dea98ab tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:10.839666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75fbbbdb-1aac-4b77-a6dc-b2e69dea98ab tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:10.847730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75fbbbdb-1aac-4b77-a6dc-b2e69dea98ab tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:11.655331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-692d33a8-78de-472e-82dd-072341aba932 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:11.664972 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-692d33a8-78de-472e-82dd-072341aba932 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1315 microversion: 2.1 time: 0.872150 Sep 06 11:04:11.670178 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1539/3070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:10 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1315 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:11.684441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-0778bf90-cf05-4ec5-9235-d205b2e8ff20 req-b0f9a70f-5b46-49b7-a60e-23c285c7ba39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "tag": "62e35ca1-7670-4e3b-9d70-d70c74fb7d76"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:11.689484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-75fbbbdb-1aac-4b77-a6dc-b2e69dea98ab tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:11.695430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0778bf90-cf05-4ec5-9235-d205b2e8ff20 req-b0f9a70f-5b46-49b7-a60e-23c285c7ba39 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:11.695916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0778bf90-cf05-4ec5-9235-d205b2e8ff20 req-b0f9a70f-5b46-49b7-a60e-23c285c7ba39 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:11.696349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0778bf90-cf05-4ec5-9235-d205b2e8ff20 req-b0f9a70f-5b46-49b7-a60e-23c285c7ba39 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:11.701261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-75fbbbdb-1aac-4b77-a6dc-b2e69dea98ab tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:11.703039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-75fbbbdb-1aac-4b77-a6dc-b2e69dea98ab tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:11.704477 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-75fbbbdb-1aac-4b77-a6dc-b2e69dea98ab tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.899393 Sep 06 11:04:11.705258 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1532/3071] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:10 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:11.710841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-95337312-6fbf-49af-9a82-35267aa867b9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:11.711655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-95337312-6fbf-49af-9a82-35267aa867b9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:11.721004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95337312-6fbf-49af-9a82-35267aa867b9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:11.721004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95337312-6fbf-49af-9a82-35267aa867b9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:11.721004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95337312-6fbf-49af-9a82-35267aa867b9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:11.721004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95337312-6fbf-49af-9a82-35267aa867b9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:11.721004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95337312-6fbf-49af-9a82-35267aa867b9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:11.721004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95337312-6fbf-49af-9a82-35267aa867b9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:11.730237 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-0778bf90-cf05-4ec5-9235-d205b2e8ff20 req-b0f9a70f-5b46-49b7-a60e-23c285c7ba39 service nova] Creating event network-changed:62e35ca1-7670-4e3b-9d70-d70c74fb7d76 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:11.735628 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-0778bf90-cf05-4ec5-9235-d205b2e8ff20 req-b0f9a70f-5b46-49b7-a60e-23c285c7ba39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068724 Sep 06 11:04:11.740887 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1540/3072] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:11.746877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2cf7f53a-b4d1-4ac2-87e7-5914efea6477 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:11.747610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2cf7f53a-b4d1-4ac2-87e7-5914efea6477 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:11.756526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cf7f53a-b4d1-4ac2-87e7-5914efea6477 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:11.757151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cf7f53a-b4d1-4ac2-87e7-5914efea6477 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:11.757847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cf7f53a-b4d1-4ac2-87e7-5914efea6477 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:11.758740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cf7f53a-b4d1-4ac2-87e7-5914efea6477 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:11.759296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cf7f53a-b4d1-4ac2-87e7-5914efea6477 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:11.759811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cf7f53a-b4d1-4ac2-87e7-5914efea6477 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:12.156279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-95337312-6fbf-49af-9a82-35267aa867b9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:12.166986 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-95337312-6fbf-49af-9a82-35267aa867b9 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.459682 Sep 06 11:04:12.168741 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1533/3073] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:11 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:12.195368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2cf7f53a-b4d1-4ac2-87e7-5914efea6477 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:12.210268 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2cf7f53a-b4d1-4ac2-87e7-5914efea6477 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1468 microversion: 2.1 time: 0.467791 Sep 06 11:04:12.215758 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1541/3074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:11 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1468 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:12.504278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f018c3ed-6c36-411b-836d-aecbc50474b0 req-7f24b6db-b9a5-4cac-a6b6-c723ad65f677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f3820c-e654-4eca-98de-9c5b2ec61763", "name": "network-vif-unplugged", "status": "completed", "tag": "85f92e4a-b017-486e-a2da-1f2effdf2520"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:12.522731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f018c3ed-6c36-411b-836d-aecbc50474b0 req-7f24b6db-b9a5-4cac-a6b6-c723ad65f677 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:12.523566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f018c3ed-6c36-411b-836d-aecbc50474b0 req-7f24b6db-b9a5-4cac-a6b6-c723ad65f677 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:12.524612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f018c3ed-6c36-411b-836d-aecbc50474b0 req-7f24b6db-b9a5-4cac-a6b6-c723ad65f677 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:12.544453 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f018c3ed-6c36-411b-836d-aecbc50474b0 req-7f24b6db-b9a5-4cac-a6b6-c723ad65f677 service nova] Creating event network-vif-unplugged:85f92e4a-b017-486e-a2da-1f2effdf2520 for instance b3f3820c-e654-4eca-98de-9c5b2ec61763 on nch1-master-1 Sep 06 11:04:12.554583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-f018c3ed-6c36-411b-836d-aecbc50474b0 req-7f24b6db-b9a5-4cac-a6b6-c723ad65f677 service nova] Instance b3f3820c-e654-4eca-98de-9c5b2ec61763 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:04:12.574965 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f018c3ed-6c36-411b-836d-aecbc50474b0 req-7f24b6db-b9a5-4cac-a6b6-c723ad65f677 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081192 Sep 06 11:04:12.576119 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1534/3075] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:12.692294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2c9f9160-521a-4942-b963-982d7a82570b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:12.698469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2c9f9160-521a-4942-b963-982d7a82570b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:12.712313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c9f9160-521a-4942-b963-982d7a82570b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:12.721382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c9f9160-521a-4942-b963-982d7a82570b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:12.721382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c9f9160-521a-4942-b963-982d7a82570b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:12.721382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c9f9160-521a-4942-b963-982d7a82570b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:12.721382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c9f9160-521a-4942-b963-982d7a82570b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:12.721382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c9f9160-521a-4942-b963-982d7a82570b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:12.734475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fb77eed3-6599-4da4-b199-2ec81a3d82ce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:12.735232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb77eed3-6599-4da4-b199-2ec81a3d82ce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:12.758294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb77eed3-6599-4da4-b199-2ec81a3d82ce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:12.758807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb77eed3-6599-4da4-b199-2ec81a3d82ce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:12.759290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb77eed3-6599-4da4-b199-2ec81a3d82ce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:12.762889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb77eed3-6599-4da4-b199-2ec81a3d82ce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:12.763545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb77eed3-6599-4da4-b199-2ec81a3d82ce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:12.763999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb77eed3-6599-4da4-b199-2ec81a3d82ce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:13.183908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2c9f9160-521a-4942-b963-982d7a82570b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:13.192966 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2c9f9160-521a-4942-b963-982d7a82570b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1503 microversion: 2.1 time: 0.507706 Sep 06 11:04:13.193901 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1542/3076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:12 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1503 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:13.204293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-721e57eb-bc6d-486f-8bd6-8ea4f5633e2c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:13.204923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-721e57eb-bc6d-486f-8bd6-8ea4f5633e2c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:13.215589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-721e57eb-bc6d-486f-8bd6-8ea4f5633e2c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:13.216117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-721e57eb-bc6d-486f-8bd6-8ea4f5633e2c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:13.216717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-721e57eb-bc6d-486f-8bd6-8ea4f5633e2c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:13.217386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-721e57eb-bc6d-486f-8bd6-8ea4f5633e2c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:13.217853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-721e57eb-bc6d-486f-8bd6-8ea4f5633e2c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:13.218290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-721e57eb-bc6d-486f-8bd6-8ea4f5633e2c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:13.250366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb77eed3-6599-4da4-b199-2ec81a3d82ce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:13.290558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb77eed3-6599-4da4-b199-2ec81a3d82ce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:13.292793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb77eed3-6599-4da4-b199-2ec81a3d82ce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:13.294682 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fb77eed3-6599-4da4-b199-2ec81a3d82ce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.564549 Sep 06 11:04:13.295288 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1535/3077] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:12 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:04:13.304549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9dda585e-c89b-432a-9202-821f683e9277 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:13.313592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9dda585e-c89b-432a-9202-821f683e9277 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:13.338633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dda585e-c89b-432a-9202-821f683e9277 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:13.339252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dda585e-c89b-432a-9202-821f683e9277 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:13.339764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dda585e-c89b-432a-9202-821f683e9277 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:13.340506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dda585e-c89b-432a-9202-821f683e9277 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:13.340978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dda585e-c89b-432a-9202-821f683e9277 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:13.341421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dda585e-c89b-432a-9202-821f683e9277 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:13.418179 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9dda585e-c89b-432a-9202-821f683e9277 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action" status: 200 len: 14 microversion: 2.1 time: 0.121305 Sep 06 11:04:13.422443 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1536/3078] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:13 2022] POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:04:13.439796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fe720c1e-78c5-420e-8930-6330aeb94b49 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:13.440744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fe720c1e-78c5-420e-8930-6330aeb94b49 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:13.448533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe720c1e-78c5-420e-8930-6330aeb94b49 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:13.449033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe720c1e-78c5-420e-8930-6330aeb94b49 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:13.449486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe720c1e-78c5-420e-8930-6330aeb94b49 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:13.450211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe720c1e-78c5-420e-8930-6330aeb94b49 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:13.450708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe720c1e-78c5-420e-8930-6330aeb94b49 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:13.451169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe720c1e-78c5-420e-8930-6330aeb94b49 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:13.794196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-721e57eb-bc6d-486f-8bd6-8ea4f5633e2c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:13.794196 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-721e57eb-bc6d-486f-8bd6-8ea4f5633e2c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.551100 Sep 06 11:04:13.794196 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1543/3079] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:13 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:13.795252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fe720c1e-78c5-420e-8930-6330aeb94b49 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:13.802442 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fe720c1e-78c5-420e-8930-6330aeb94b49 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1468 microversion: 2.1 time: 0.377827 Sep 06 11:04:13.820560 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1537/3080] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:13 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1468 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:14.344232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e6da76ac-8b46-4818-bd60-386ace6f088e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:14.344232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e6da76ac-8b46-4818-bd60-386ace6f088e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:14.344232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6da76ac-8b46-4818-bd60-386ace6f088e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:14.344232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6da76ac-8b46-4818-bd60-386ace6f088e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:14.344232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6da76ac-8b46-4818-bd60-386ace6f088e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:14.344232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6da76ac-8b46-4818-bd60-386ace6f088e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:14.344232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6da76ac-8b46-4818-bd60-386ace6f088e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:14.344232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6da76ac-8b46-4818-bd60-386ace6f088e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:14.430681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-19e74616-7dee-4431-a521-8f3d9708260d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:14.434959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-19e74616-7dee-4431-a521-8f3d9708260d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:14.462337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19e74616-7dee-4431-a521-8f3d9708260d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:14.463978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19e74616-7dee-4431-a521-8f3d9708260d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:14.467767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19e74616-7dee-4431-a521-8f3d9708260d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:14.467767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19e74616-7dee-4431-a521-8f3d9708260d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:14.467767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19e74616-7dee-4431-a521-8f3d9708260d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:14.467767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19e74616-7dee-4431-a521-8f3d9708260d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:14.523832 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-19e74616-7dee-4431-a521-8f3d9708260d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action" status: 200 len: 14 microversion: 2.1 time: 0.096967 Sep 06 11:04:14.524483 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1538/3081] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:14 2022] POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 11:04:14.629027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-70c3bb1c-52d2-471b-943d-63ee0babaf5c req-34b8f935-4fb2-46ed-9098-10d69ee37062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f3820c-e654-4eca-98de-9c5b2ec61763", "tag": "85f92e4a-b017-486e-a2da-1f2effdf2520"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:14.654063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-70c3bb1c-52d2-471b-943d-63ee0babaf5c req-34b8f935-4fb2-46ed-9098-10d69ee37062 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:14.654859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-70c3bb1c-52d2-471b-943d-63ee0babaf5c req-34b8f935-4fb2-46ed-9098-10d69ee37062 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:14.655922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-70c3bb1c-52d2-471b-943d-63ee0babaf5c req-34b8f935-4fb2-46ed-9098-10d69ee37062 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:14.682809 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-70c3bb1c-52d2-471b-943d-63ee0babaf5c req-34b8f935-4fb2-46ed-9098-10d69ee37062 service nova] Creating event network-changed:85f92e4a-b017-486e-a2da-1f2effdf2520 for instance b3f3820c-e654-4eca-98de-9c5b2ec61763 on nch1-master-1 Sep 06 11:04:14.694132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-70c3bb1c-52d2-471b-943d-63ee0babaf5c req-34b8f935-4fb2-46ed-9098-10d69ee37062 service nova] Instance b3f3820c-e654-4eca-98de-9c5b2ec61763 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:04:14.711414 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-70c3bb1c-52d2-471b-943d-63ee0babaf5c req-34b8f935-4fb2-46ed-9098-10d69ee37062 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108099 Sep 06 11:04:14.712926 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1539/3082] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:14.778724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-329ed852-e345-4393-9218-5ec1c4f61a35 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:14.779542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-329ed852-e345-4393-9218-5ec1c4f61a35 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:14.798116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-329ed852-e345-4393-9218-5ec1c4f61a35 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:14.805052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-329ed852-e345-4393-9218-5ec1c4f61a35 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:14.805052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-329ed852-e345-4393-9218-5ec1c4f61a35 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:14.805052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-329ed852-e345-4393-9218-5ec1c4f61a35 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:14.805052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-329ed852-e345-4393-9218-5ec1c4f61a35 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:14.806022 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-329ed852-e345-4393-9218-5ec1c4f61a35 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:15.476011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e6da76ac-8b46-4818-bd60-386ace6f088e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:15.510002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e6da76ac-8b46-4818-bd60-386ace6f088e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:15.515535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e6da76ac-8b46-4818-bd60-386ace6f088e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:15.519204 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e6da76ac-8b46-4818-bd60-386ace6f088e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 1.195067 Sep 06 11:04:15.520242 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1544/3083] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:14 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:15.538862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-82565c9b-7cdc-46b1-837b-91bb1040996d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:15.539754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-82565c9b-7cdc-46b1-837b-91bb1040996d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:15.552496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82565c9b-7cdc-46b1-837b-91bb1040996d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:15.553279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82565c9b-7cdc-46b1-837b-91bb1040996d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:15.554710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82565c9b-7cdc-46b1-837b-91bb1040996d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:15.555734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82565c9b-7cdc-46b1-837b-91bb1040996d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:15.557167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82565c9b-7cdc-46b1-837b-91bb1040996d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:15.557819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82565c9b-7cdc-46b1-837b-91bb1040996d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:15.838684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-329ed852-e345-4393-9218-5ec1c4f61a35 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:15.849185 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-329ed852-e345-4393-9218-5ec1c4f61a35 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 1.074938 Sep 06 11:04:15.849185 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1540/3084] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:14 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:15.868335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01530f9d-0322-4557-b9d8-11a69deae81a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:15.870797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-01530f9d-0322-4557-b9d8-11a69deae81a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:15.878390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01530f9d-0322-4557-b9d8-11a69deae81a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:15.879750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01530f9d-0322-4557-b9d8-11a69deae81a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:15.880394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01530f9d-0322-4557-b9d8-11a69deae81a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:15.881288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01530f9d-0322-4557-b9d8-11a69deae81a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:15.882688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01530f9d-0322-4557-b9d8-11a69deae81a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:15.883451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01530f9d-0322-4557-b9d8-11a69deae81a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:15.958461 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-01530f9d-0322-4557-b9d8-11a69deae81a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action" status: 200 len: 14 microversion: 2.1 time: 0.108251 Sep 06 11:04:15.960382 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1541/3085] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:15 2022] POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:04:16.092244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-82565c9b-7cdc-46b1-837b-91bb1040996d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:16.101743 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-82565c9b-7cdc-46b1-837b-91bb1040996d tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1468 microversion: 2.1 time: 0.579325 Sep 06 11:04:16.102343 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1545/3086] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:15 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1468 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:16.547621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d187361f-9c56-44dd-adbc-8422bde57f7b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:16.548520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d187361f-9c56-44dd-adbc-8422bde57f7b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:16.556432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d187361f-9c56-44dd-adbc-8422bde57f7b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:16.557392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d187361f-9c56-44dd-adbc-8422bde57f7b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:16.558085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d187361f-9c56-44dd-adbc-8422bde57f7b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:16.558902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d187361f-9c56-44dd-adbc-8422bde57f7b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:16.559491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d187361f-9c56-44dd-adbc-8422bde57f7b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:16.560269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d187361f-9c56-44dd-adbc-8422bde57f7b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:16.872929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-afdec8a1-106c-4858-af53-cb187ed2f0df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:16.898140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-afdec8a1-106c-4858-af53-cb187ed2f0df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:16.921518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-afdec8a1-106c-4858-af53-cb187ed2f0df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:16.922888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-afdec8a1-106c-4858-af53-cb187ed2f0df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:16.923530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-afdec8a1-106c-4858-af53-cb187ed2f0df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:16.924644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-afdec8a1-106c-4858-af53-cb187ed2f0df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:16.927762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-afdec8a1-106c-4858-af53-cb187ed2f0df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:16.928600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-afdec8a1-106c-4858-af53-cb187ed2f0df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:16.981755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d187361f-9c56-44dd-adbc-8422bde57f7b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:17.000296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d187361f-9c56-44dd-adbc-8422bde57f7b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:17.002846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d187361f-9c56-44dd-adbc-8422bde57f7b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:17.004507 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d187361f-9c56-44dd-adbc-8422bde57f7b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.462469 Sep 06 11:04:17.007805 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1542/3087] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:16 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:17.011581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-40eb0eb0-d40a-4e47-8c3f-a0ef067a825e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:17.013780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-40eb0eb0-d40a-4e47-8c3f-a0ef067a825e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:17.021231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40eb0eb0-d40a-4e47-8c3f-a0ef067a825e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:17.021727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40eb0eb0-d40a-4e47-8c3f-a0ef067a825e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:17.022174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40eb0eb0-d40a-4e47-8c3f-a0ef067a825e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:17.022882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40eb0eb0-d40a-4e47-8c3f-a0ef067a825e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:17.023372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40eb0eb0-d40a-4e47-8c3f-a0ef067a825e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:17.027363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40eb0eb0-d40a-4e47-8c3f-a0ef067a825e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:17.277016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-afdec8a1-106c-4858-af53-cb187ed2f0df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:17.286106 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-afdec8a1-106c-4858-af53-cb187ed2f0df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.418416 Sep 06 11:04:17.296429 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1546/3088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:16 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:17.301246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c938c590-07f1-462b-9669-41fe878f4b2b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:17.305110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c938c590-07f1-462b-9669-41fe878f4b2b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:17.311749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c938c590-07f1-462b-9669-41fe878f4b2b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:17.312256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c938c590-07f1-462b-9669-41fe878f4b2b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:17.312706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c938c590-07f1-462b-9669-41fe878f4b2b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:17.314089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c938c590-07f1-462b-9669-41fe878f4b2b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:17.316176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c938c590-07f1-462b-9669-41fe878f4b2b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:17.317330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c938c590-07f1-462b-9669-41fe878f4b2b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:17.374694 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-40eb0eb0-d40a-4e47-8c3f-a0ef067a825e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action" status: 200 len: 14 microversion: 2.1 time: 0.367618 Sep 06 11:04:17.379185 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1543/3089] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:17 2022] POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action => generated 14 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:04:17.897795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c938c590-07f1-462b-9669-41fe878f4b2b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:17.907806 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c938c590-07f1-462b-9669-41fe878f4b2b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1468 microversion: 2.1 time: 0.614564 Sep 06 11:04:17.909267 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1547/3090] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:17 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1468 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:18.031536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d75673eb-1999-43bb-af7b-e56e452fe81a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:18.032584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d75673eb-1999-43bb-af7b-e56e452fe81a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:18.041230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d75673eb-1999-43bb-af7b-e56e452fe81a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:18.041725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d75673eb-1999-43bb-af7b-e56e452fe81a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:18.042205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d75673eb-1999-43bb-af7b-e56e452fe81a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:18.056177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d75673eb-1999-43bb-af7b-e56e452fe81a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:18.056812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d75673eb-1999-43bb-af7b-e56e452fe81a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:18.057276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d75673eb-1999-43bb-af7b-e56e452fe81a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:18.310695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a01a102d-369f-4efa-ba37-bf0c357a802b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:18.319829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a01a102d-369f-4efa-ba37-bf0c357a802b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:18.327353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a01a102d-369f-4efa-ba37-bf0c357a802b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:18.327850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a01a102d-369f-4efa-ba37-bf0c357a802b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:18.328737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a01a102d-369f-4efa-ba37-bf0c357a802b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:18.329622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a01a102d-369f-4efa-ba37-bf0c357a802b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:18.330916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a01a102d-369f-4efa-ba37-bf0c357a802b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:18.331808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a01a102d-369f-4efa-ba37-bf0c357a802b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:18.933420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d75673eb-1999-43bb-af7b-e56e452fe81a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:18.954135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d75673eb-1999-43bb-af7b-e56e452fe81a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:18.954135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d75673eb-1999-43bb-af7b-e56e452fe81a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:18.954135 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d75673eb-1999-43bb-af7b-e56e452fe81a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.924562 Sep 06 11:04:18.954135 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1544/3091] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:18 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:18.959316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-863f6f4a-aefb-41e6-83bd-019622b3731a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:18.962016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-863f6f4a-aefb-41e6-83bd-019622b3731a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:18.968890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-863f6f4a-aefb-41e6-83bd-019622b3731a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:18.969739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-863f6f4a-aefb-41e6-83bd-019622b3731a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:18.975187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-863f6f4a-aefb-41e6-83bd-019622b3731a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:18.975187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-863f6f4a-aefb-41e6-83bd-019622b3731a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:18.975187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-863f6f4a-aefb-41e6-83bd-019622b3731a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:18.975187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-863f6f4a-aefb-41e6-83bd-019622b3731a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:19.009751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a01a102d-369f-4efa-ba37-bf0c357a802b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:19.016444 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-863f6f4a-aefb-41e6-83bd-019622b3731a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action" status: 200 len: 14 microversion: 2.1 time: 0.062762 Sep 06 11:04:19.019255 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a01a102d-369f-4efa-ba37-bf0c357a802b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.712704 Sep 06 11:04:19.020017 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1548/3092] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:18 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:19.021934 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1545/3093] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:18 2022] POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:04:19.025393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f4c17bb-99aa-4e8c-83fe-950d79c36e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:19.026022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4f4c17bb-99aa-4e8c-83fe-950d79c36e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:19.032158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f4c17bb-99aa-4e8c-83fe-950d79c36e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:19.032850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f4c17bb-99aa-4e8c-83fe-950d79c36e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:19.034301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f4c17bb-99aa-4e8c-83fe-950d79c36e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:19.035170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f4c17bb-99aa-4e8c-83fe-950d79c36e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:19.035637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f4c17bb-99aa-4e8c-83fe-950d79c36e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:19.036235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f4c17bb-99aa-4e8c-83fe-950d79c36e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:19.413335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4f4c17bb-99aa-4e8c-83fe-950d79c36e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:19.423643 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4f4c17bb-99aa-4e8c-83fe-950d79c36e0b tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1461 microversion: 2.1 time: 0.402352 Sep 06 11:04:19.441279 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1549/3094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:19 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1461 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:19.448896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-08015805-8895-4194-9d37-df9bb2cb180d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:19.449570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-08015805-8895-4194-9d37-df9bb2cb180d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:19.457845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08015805-8895-4194-9d37-df9bb2cb180d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:19.464362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08015805-8895-4194-9d37-df9bb2cb180d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:19.464362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08015805-8895-4194-9d37-df9bb2cb180d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:19.464362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08015805-8895-4194-9d37-df9bb2cb180d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:19.464362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08015805-8895-4194-9d37-df9bb2cb180d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:19.464362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08015805-8895-4194-9d37-df9bb2cb180d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:19.751779 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-08015805-8895-4194-9d37-df9bb2cb180d tempest-MigrationsAdminTest-1547213554 tempest-MigrationsAdminTest-1547213554-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1612 microversion: 2.1 time: 0.307025 Sep 06 11:04:19.752762 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1546/3095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:19 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1612 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:19.784958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-99a24e82-f4c7-49cd-bce1-de5ac64dd723 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:19.792801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-99a24e82-f4c7-49cd-bce1-de5ac64dd723 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:19.792801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99a24e82-f4c7-49cd-bce1-de5ac64dd723 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:19.792801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99a24e82-f4c7-49cd-bce1-de5ac64dd723 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:19.793884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99a24e82-f4c7-49cd-bce1-de5ac64dd723 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:19.794624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99a24e82-f4c7-49cd-bce1-de5ac64dd723 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:19.795122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99a24e82-f4c7-49cd-bce1-de5ac64dd723 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:19.795787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99a24e82-f4c7-49cd-bce1-de5ac64dd723 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:19.832414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-99a24e82-f4c7-49cd-bce1-de5ac64dd723 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:04:19.978184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4383f579-2a96-4ea0-a155-0954b8a09e94 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:19.978805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4383f579-2a96-4ea0-a155-0954b8a09e94 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:19.988493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4383f579-2a96-4ea0-a155-0954b8a09e94 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:19.988992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4383f579-2a96-4ea0-a155-0954b8a09e94 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:19.989439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4383f579-2a96-4ea0-a155-0954b8a09e94 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:19.990177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4383f579-2a96-4ea0-a155-0954b8a09e94 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:19.990623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4383f579-2a96-4ea0-a155-0954b8a09e94 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:19.991081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4383f579-2a96-4ea0-a155-0954b8a09e94 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:20.144751 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-99a24e82-f4c7-49cd-bce1-de5ac64dd723 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 204 len: 0 microversion: 2.1 time: 0.364477 Sep 06 11:04:20.145356 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1550/3096] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:04:19 2022] DELETE /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:04:20.153690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-99a3d9d4-c053-4ae7-b56c-40d32c97037a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:20.156103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-99a3d9d4-c053-4ae7-b56c-40d32c97037a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:20.162739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99a3d9d4-c053-4ae7-b56c-40d32c97037a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:20.163276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99a3d9d4-c053-4ae7-b56c-40d32c97037a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:20.163857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99a3d9d4-c053-4ae7-b56c-40d32c97037a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:20.164577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99a3d9d4-c053-4ae7-b56c-40d32c97037a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:20.165042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99a3d9d4-c053-4ae7-b56c-40d32c97037a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:20.165478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99a3d9d4-c053-4ae7-b56c-40d32c97037a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:20.336945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4383f579-2a96-4ea0-a155-0954b8a09e94 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:20.347490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4383f579-2a96-4ea0-a155-0954b8a09e94 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:20.348990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4383f579-2a96-4ea0-a155-0954b8a09e94 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:20.350222 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4383f579-2a96-4ea0-a155-0954b8a09e94 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.376301 Sep 06 11:04:20.362885 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1547/3097] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:19 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:20.362885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e2890e01-5f13-45b4-a2b0-dd253ad8d6c2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:20.362885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e2890e01-5f13-45b4-a2b0-dd253ad8d6c2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:20.362885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2890e01-5f13-45b4-a2b0-dd253ad8d6c2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:20.364263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2890e01-5f13-45b4-a2b0-dd253ad8d6c2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:20.364263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2890e01-5f13-45b4-a2b0-dd253ad8d6c2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:20.364673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2890e01-5f13-45b4-a2b0-dd253ad8d6c2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:20.365728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2890e01-5f13-45b4-a2b0-dd253ad8d6c2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:20.366491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2890e01-5f13-45b4-a2b0-dd253ad8d6c2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:20.532287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e2890e01-5f13-45b4-a2b0-dd253ad8d6c2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:20.543625 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e2890e01-5f13-45b4-a2b0-dd253ad8d6c2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.191148 Sep 06 11:04:20.544219 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1548/3098] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:20 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:20.551256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eab9b326-67a8-42e9-8472-487ba1ec4132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:20.554009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-eab9b326-67a8-42e9-8472-487ba1ec4132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:20.558976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eab9b326-67a8-42e9-8472-487ba1ec4132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:20.559706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eab9b326-67a8-42e9-8472-487ba1ec4132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:20.560172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eab9b326-67a8-42e9-8472-487ba1ec4132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:20.561012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eab9b326-67a8-42e9-8472-487ba1ec4132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:20.562295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eab9b326-67a8-42e9-8472-487ba1ec4132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:20.562758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eab9b326-67a8-42e9-8472-487ba1ec4132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:20.568505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:20.714768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-eab9b326-67a8-42e9-8472-487ba1ec4132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:20.725961 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-eab9b326-67a8-42e9-8472-487ba1ec4132 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1467 microversion: 2.1 time: 0.179639 Sep 06 11:04:20.733026 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1549/3099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:20 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1467 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:20.953758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-647568004", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "126cb4c5-3368-47fc-8012-fb1ceb8b9ce3"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:21.018147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] validate_networks() for [('126cb4c5-3368-47fc-8012-fb1ceb8b9ce3', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:04:21.182573 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-99a3d9d4-c053-4ae7-b56c-40d32c97037a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action" status: 200 len: 14 microversion: 2.1 time: 1.033547 Sep 06 11:04:21.186945 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1551/3100] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:20 2022] POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action => generated 14 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:04:21.193203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-b81a0003-626c-40df-967e-3f07958aa779 req-bcb82b82-5ee0-4f5e-94b6-a563e9b46075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f3820c-e654-4eca-98de-9c5b2ec61763", "name": "network-vif-plugged", "status": "completed", "tag": "85f92e4a-b017-486e-a2da-1f2effdf2520"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:21.220036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b81a0003-626c-40df-967e-3f07958aa779 req-bcb82b82-5ee0-4f5e-94b6-a563e9b46075 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:21.224013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b81a0003-626c-40df-967e-3f07958aa779 req-bcb82b82-5ee0-4f5e-94b6-a563e9b46075 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:21.225202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b81a0003-626c-40df-967e-3f07958aa779 req-bcb82b82-5ee0-4f5e-94b6-a563e9b46075 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:21.248003 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-b81a0003-626c-40df-967e-3f07958aa779 req-bcb82b82-5ee0-4f5e-94b6-a563e9b46075 service nova] Creating event network-vif-plugged:85f92e4a-b017-486e-a2da-1f2effdf2520 for instance b3f3820c-e654-4eca-98de-9c5b2ec61763 on nch1-master-1 Sep 06 11:04:21.254149 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-b81a0003-626c-40df-967e-3f07958aa779 req-bcb82b82-5ee0-4f5e-94b6-a563e9b46075 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065413 Sep 06 11:04:21.255104 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1552/3101] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:21.395483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0b0b32de-89b2-47e2-a7e2-a976f6e44d7d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:21.395483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0b0b32de-89b2-47e2-a7e2-a976f6e44d7d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:21.401741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0b32de-89b2-47e2-a7e2-a976f6e44d7d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:21.402241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0b32de-89b2-47e2-a7e2-a976f6e44d7d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:21.402701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0b32de-89b2-47e2-a7e2-a976f6e44d7d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:21.403617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0b32de-89b2-47e2-a7e2-a976f6e44d7d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:21.404085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0b32de-89b2-47e2-a7e2-a976f6e44d7d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:21.404525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b0b32de-89b2-47e2-a7e2-a976f6e44d7d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:21.407837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:21.600260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:04:21.601513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:04:21.602221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:04:21.602649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:04:21.603229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:04:21.616063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:21.616818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:21.617521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:21.618240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:21.618712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:21.619296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:21.642319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Getting quotas for project dcec28a7e8334187af139cfaa47ec10f. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:04:21.649270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Getting quotas for user 7a1efa8720c8419ba917f0e9220689ac and project dcec28a7e8334187af139cfaa47ec10f. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:04:21.666223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:04:21.669236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:04:21.703901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0b0b32de-89b2-47e2-a7e2-a976f6e44d7d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:21.714941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0b0b32de-89b2-47e2-a7e2-a976f6e44d7d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:21.716396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0b0b32de-89b2-47e2-a7e2-a976f6e44d7d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:21.717781 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0b0b32de-89b2-47e2-a7e2-a976f6e44d7d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.337530 Sep 06 11:04:21.718511 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1553/3102] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:21 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:21.724076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ec81bffa-cac7-4d8d-a4ef-e4edbb7bf456 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:21.725138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ec81bffa-cac7-4d8d-a4ef-e4edbb7bf456 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:21.732205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec81bffa-cac7-4d8d-a4ef-e4edbb7bf456 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:21.732979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec81bffa-cac7-4d8d-a4ef-e4edbb7bf456 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:21.733591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec81bffa-cac7-4d8d-a4ef-e4edbb7bf456 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:21.735180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec81bffa-cac7-4d8d-a4ef-e4edbb7bf456 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:21.735808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec81bffa-cac7-4d8d-a4ef-e4edbb7bf456 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:21.736474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec81bffa-cac7-4d8d-a4ef-e4edbb7bf456 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:21.896378 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fc38be83-36a3-41a4-ba84-01a1cd434e47 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167569 Sep 06 11:04:21.901284 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1550/3103] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:04:21.922736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7b1d0c01-af0d-4316-9119-c84277fbc4f4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:21.925910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7b1d0c01-af0d-4316-9119-c84277fbc4f4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:21.936133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b1d0c01-af0d-4316-9119-c84277fbc4f4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:21.937738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b1d0c01-af0d-4316-9119-c84277fbc4f4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:21.940202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b1d0c01-af0d-4316-9119-c84277fbc4f4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:21.941416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b1d0c01-af0d-4316-9119-c84277fbc4f4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:21.942061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b1d0c01-af0d-4316-9119-c84277fbc4f4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:21.942697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b1d0c01-af0d-4316-9119-c84277fbc4f4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:22.052524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ec81bffa-cac7-4d8d-a4ef-e4edbb7bf456 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:22.060468 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ec81bffa-cac7-4d8d-a4ef-e4edbb7bf456 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.340687 Sep 06 11:04:22.061054 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1554/3104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:21 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:22.102059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-daf1100c-25cd-4eca-a1e3-bea66ca697ef tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:22.106369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-daf1100c-25cd-4eca-a1e3-bea66ca697ef tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:22.233064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-daf1100c-25cd-4eca-a1e3-bea66ca697ef tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:22.267927 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-daf1100c-25cd-4eca-a1e3-bea66ca697ef tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1216 microversion: 2.1 time: 0.185168 Sep 06 11:04:22.268824 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1555/3105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:22 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1216 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:22.275118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-031202a8-e534-47b6-bc30-aa2ee8591031 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:22.277819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-031202a8-e534-47b6-bc30-aa2ee8591031 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:22.289803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-031202a8-e534-47b6-bc30-aa2ee8591031 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:22.290316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-031202a8-e534-47b6-bc30-aa2ee8591031 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:22.290815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-031202a8-e534-47b6-bc30-aa2ee8591031 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:22.295398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-031202a8-e534-47b6-bc30-aa2ee8591031 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:22.295953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-031202a8-e534-47b6-bc30-aa2ee8591031 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:22.296720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-031202a8-e534-47b6-bc30-aa2ee8591031 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:22.341051 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-031202a8-e534-47b6-bc30-aa2ee8591031 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action" status: 200 len: 14 microversion: 2.1 time: 0.070550 Sep 06 11:04:22.341969 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1556/3106] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:22 2022] POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:04:22.386515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7b1d0c01-af0d-4316-9119-c84277fbc4f4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:22.395363 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7b1d0c01-af0d-4316-9119-c84277fbc4f4 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1467 microversion: 2.1 time: 0.480541 Sep 06 11:04:22.395960 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1551/3107] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:21 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1467 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:22.664526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a7b01f30-6605-416d-ab2c-2c34931bce4f req-f5e57dcf-8c65-4bb2-afc4-8177ccd1e376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f3820c-e654-4eca-98de-9c5b2ec61763", "name": "network-vif-deleted", "tag": "85f92e4a-b017-486e-a2da-1f2effdf2520"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:22.681157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a7b01f30-6605-416d-ab2c-2c34931bce4f req-f5e57dcf-8c65-4bb2-afc4-8177ccd1e376 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:22.682375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a7b01f30-6605-416d-ab2c-2c34931bce4f req-f5e57dcf-8c65-4bb2-afc4-8177ccd1e376 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:22.683090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a7b01f30-6605-416d-ab2c-2c34931bce4f req-f5e57dcf-8c65-4bb2-afc4-8177ccd1e376 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:22.705549 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a7b01f30-6605-416d-ab2c-2c34931bce4f req-f5e57dcf-8c65-4bb2-afc4-8177ccd1e376 service nova] Creating event network-vif-deleted:85f92e4a-b017-486e-a2da-1f2effdf2520 for instance b3f3820c-e654-4eca-98de-9c5b2ec61763 on nch1-master-1 Sep 06 11:04:22.711279 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a7b01f30-6605-416d-ab2c-2c34931bce4f req-f5e57dcf-8c65-4bb2-afc4-8177ccd1e376 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051726 Sep 06 11:04:22.713679 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1557/3108] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:22.756955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3dd64a33-8142-44b3-81db-b202914e345e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:22.758627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3dd64a33-8142-44b3-81db-b202914e345e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:22.766642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3dd64a33-8142-44b3-81db-b202914e345e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:22.767189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3dd64a33-8142-44b3-81db-b202914e345e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:22.767893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3dd64a33-8142-44b3-81db-b202914e345e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:22.768793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3dd64a33-8142-44b3-81db-b202914e345e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:22.769435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3dd64a33-8142-44b3-81db-b202914e345e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:22.770069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3dd64a33-8142-44b3-81db-b202914e345e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:23.080700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3dd64a33-8142-44b3-81db-b202914e345e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:23.091312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-667666c8-93f8-46ad-82b6-a824643c8617 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:23.094981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3dd64a33-8142-44b3-81db-b202914e345e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:23.095149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3dd64a33-8142-44b3-81db-b202914e345e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:23.096165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-667666c8-93f8-46ad-82b6-a824643c8617 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:23.097077 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3dd64a33-8142-44b3-81db-b202914e345e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.349177 Sep 06 11:04:23.097835 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1552/3109] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:22 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:23.109191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-667666c8-93f8-46ad-82b6-a824643c8617 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:23.109906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-667666c8-93f8-46ad-82b6-a824643c8617 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:23.110985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-667666c8-93f8-46ad-82b6-a824643c8617 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:23.112063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-667666c8-93f8-46ad-82b6-a824643c8617 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:23.112612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-667666c8-93f8-46ad-82b6-a824643c8617 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:23.113056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-667666c8-93f8-46ad-82b6-a824643c8617 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:23.297755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5a45644b-d03d-4cc1-affe-885f31de3018 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:23.298168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-667666c8-93f8-46ad-82b6-a824643c8617 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:23.299347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5a45644b-d03d-4cc1-affe-885f31de3018 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:23.306462 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-667666c8-93f8-46ad-82b6-a824643c8617 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.221024 Sep 06 11:04:23.307688 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1558/3110] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:23 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:23.365545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e841de1-6a44-4202-8338-5202ee624a86 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:23.369157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5e841de1-6a44-4202-8338-5202ee624a86 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:23.401386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5a45644b-d03d-4cc1-affe-885f31de3018 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:23.414964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e841de1-6a44-4202-8338-5202ee624a86 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:23.417860 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5a45644b-d03d-4cc1-affe-885f31de3018 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1216 microversion: 2.1 time: 0.121731 Sep 06 11:04:23.417860 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1553/3111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:23 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1216 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:23.419990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e841de1-6a44-4202-8338-5202ee624a86 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:23.421682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e841de1-6a44-4202-8338-5202ee624a86 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:23.423135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e841de1-6a44-4202-8338-5202ee624a86 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:23.424290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e841de1-6a44-4202-8338-5202ee624a86 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:23.425245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e841de1-6a44-4202-8338-5202ee624a86 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:23.433730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:23.436752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:23.474388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:23.474388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:23.474388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:23.474388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:23.474388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:23.474388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:23.525176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:23.525835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:23.526289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:23.526845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lazy-loading 'fault' on Instance uuid b3f3820c-e654-4eca-98de-9c5b2ec61763 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:04:23.591659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:23.599673 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b5738dba-dab0-4af6-8741-7205c46ef83e tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 200 len: 1302 microversion: 2.1 time: 0.178746 Sep 06 11:04:23.600257 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1554/3112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:23 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 1302 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:23.688165 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5e841de1-6a44-4202-8338-5202ee624a86 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action" status: 200 len: 8208 microversion: 2.1 time: 0.337744 Sep 06 11:04:23.689181 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1559/3113] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:23 2022] POST /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295/action => generated 8208 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:23.702529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7ded1e12-5dd6-487a-8b1f-2880d6365eaa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:23.703355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7ded1e12-5dd6-487a-8b1f-2880d6365eaa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:23.715365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ded1e12-5dd6-487a-8b1f-2880d6365eaa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:23.716275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ded1e12-5dd6-487a-8b1f-2880d6365eaa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:23.716987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ded1e12-5dd6-487a-8b1f-2880d6365eaa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:23.718315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ded1e12-5dd6-487a-8b1f-2880d6365eaa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:23.719173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ded1e12-5dd6-487a-8b1f-2880d6365eaa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:23.720207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ded1e12-5dd6-487a-8b1f-2880d6365eaa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:23.896905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7ded1e12-5dd6-487a-8b1f-2880d6365eaa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:23.907700 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7ded1e12-5dd6-487a-8b1f-2880d6365eaa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.212140 Sep 06 11:04:23.917046 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1555/3114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:23 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:23.940069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a15eb761-ad98-43df-8de9-a891972c5a3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:23.940779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a15eb761-ad98-43df-8de9-a891972c5a3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:23.948265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a15eb761-ad98-43df-8de9-a891972c5a3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:23.948778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a15eb761-ad98-43df-8de9-a891972c5a3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:23.949428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a15eb761-ad98-43df-8de9-a891972c5a3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:23.950136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a15eb761-ad98-43df-8de9-a891972c5a3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:23.950598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a15eb761-ad98-43df-8de9-a891972c5a3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:23.951716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a15eb761-ad98-43df-8de9-a891972c5a3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.092522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a15eb761-ad98-43df-8de9-a891972c5a3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:24.100514 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a15eb761-ad98-43df-8de9-a891972c5a3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.165665 Sep 06 11:04:24.101105 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1560/3115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:23 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:24.123608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-80ff5bef-266a-489b-b842-363a26af2aee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:24.124386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-80ff5bef-266a-489b-b842-363a26af2aee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:24.125127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1fbfe16f-2f43-4c98-8cc7-37d6aebc2a23 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:24.126006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1fbfe16f-2f43-4c98-8cc7-37d6aebc2a23 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:24.133075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80ff5bef-266a-489b-b842-363a26af2aee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.138070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80ff5bef-266a-489b-b842-363a26af2aee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.138070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80ff5bef-266a-489b-b842-363a26af2aee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.138305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbfe16f-2f43-4c98-8cc7-37d6aebc2a23 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.138411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80ff5bef-266a-489b-b842-363a26af2aee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.138508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbfe16f-2f43-4c98-8cc7-37d6aebc2a23 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.138635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80ff5bef-266a-489b-b842-363a26af2aee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.138735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbfe16f-2f43-4c98-8cc7-37d6aebc2a23 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.138840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80ff5bef-266a-489b-b842-363a26af2aee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.138936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbfe16f-2f43-4c98-8cc7-37d6aebc2a23 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.138936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbfe16f-2f43-4c98-8cc7-37d6aebc2a23 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.138936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbfe16f-2f43-4c98-8cc7-37d6aebc2a23 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.449712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-80ff5bef-266a-489b-b842-363a26af2aee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:24.454073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1fbfe16f-2f43-4c98-8cc7-37d6aebc2a23 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:24.460449 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-80ff5bef-266a-489b-b842-363a26af2aee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.340981 Sep 06 11:04:24.461037 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1556/3116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:24 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:24.466638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a5301961-735c-4e7a-85a0-3bec7b4620bb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:24.467547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a5301961-735c-4e7a-85a0-3bec7b4620bb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:24.474824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1fbfe16f-2f43-4c98-8cc7-37d6aebc2a23 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:24.477893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1fbfe16f-2f43-4c98-8cc7-37d6aebc2a23 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:24.479549 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1fbfe16f-2f43-4c98-8cc7-37d6aebc2a23 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.358603 Sep 06 11:04:24.480350 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1561/3117] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:24 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:04:24.491347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5301961-735c-4e7a-85a0-3bec7b4620bb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.491347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5301961-735c-4e7a-85a0-3bec7b4620bb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.491347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5301961-735c-4e7a-85a0-3bec7b4620bb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.491347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5301961-735c-4e7a-85a0-3bec7b4620bb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.491347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5301961-735c-4e7a-85a0-3bec7b4620bb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.491347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5301961-735c-4e7a-85a0-3bec7b4620bb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.509666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-630a2e83-6b30-4dba-9486-c6937a2726b4 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:24.511684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-630a2e83-6b30-4dba-9486-c6937a2726b4 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:24.520009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-630a2e83-6b30-4dba-9486-c6937a2726b4 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.523516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-630a2e83-6b30-4dba-9486-c6937a2726b4 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.523516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-630a2e83-6b30-4dba-9486-c6937a2726b4 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.525828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-630a2e83-6b30-4dba-9486-c6937a2726b4 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.526546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-630a2e83-6b30-4dba-9486-c6937a2726b4 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.527218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-630a2e83-6b30-4dba-9486-c6937a2726b4 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.636914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-630a2e83-6b30-4dba-9486-c6937a2726b4 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:24.647297 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-630a2e83-6b30-4dba-9486-c6937a2726b4 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1268 microversion: 2.1 time: 0.150533 Sep 06 11:04:24.648979 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1562/3118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:24 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:24.666932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7b943e45-2d49-4238-8935-62ab72ab67d7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:24.667622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7b943e45-2d49-4238-8935-62ab72ab67d7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:24.688509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b943e45-2d49-4238-8935-62ab72ab67d7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.689020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b943e45-2d49-4238-8935-62ab72ab67d7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.689562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b943e45-2d49-4238-8935-62ab72ab67d7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.690581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b943e45-2d49-4238-8935-62ab72ab67d7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.691905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b943e45-2d49-4238-8935-62ab72ab67d7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.692419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b943e45-2d49-4238-8935-62ab72ab67d7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.696169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a5301961-735c-4e7a-85a0-3bec7b4620bb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:24.705665 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a5301961-735c-4e7a-85a0-3bec7b4620bb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1516 microversion: 2.1 time: 0.242695 Sep 06 11:04:24.706446 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1557/3119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:24 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1516 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:24.711801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c58e8e8c-d9f9-4b66-b435-635aabae4efa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:24.712449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c58e8e8c-d9f9-4b66-b435-635aabae4efa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b3f3820c-e654-4eca-98de-9c5b2ec61763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:24.719385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c58e8e8c-d9f9-4b66-b435-635aabae4efa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.720376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c58e8e8c-d9f9-4b66-b435-635aabae4efa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.721749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c58e8e8c-d9f9-4b66-b435-635aabae4efa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.722773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c58e8e8c-d9f9-4b66-b435-635aabae4efa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.723544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c58e8e8c-d9f9-4b66-b435-635aabae4efa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.724260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c58e8e8c-d9f9-4b66-b435-635aabae4efa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.740595 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-c58e8e8c-d9f9-4b66-b435-635aabae4efa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] HTTP exception thrown: Instance b3f3820c-e654-4eca-98de-9c5b2ec61763 could not be found. Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c58e8e8c-d9f9-4b66-b435-635aabae4efa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Request method failure captured: Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 HTTP/1.1 Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyggiVGcEIOZAn3rsfB9ZJuhzgMAc4xHuGANTDtl4bhidO9S8CXVHNJGyQ1HxyHBQtXWuiiUncTVP6-qsBg5uwWdFT8nEvCGty2c1XbSTNKRGJkQEg8H4AlTz_Gl4UfRAG-pvTa_ZQxBWb0Abuie6GI_dvl1yHOiDUIVPvYSkbuus2Q Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 2a1f6f54c8d24eaa9eae09e8f30c56f1 Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-MigrationsAdminTest-412478146 Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}] Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-MigrationsAdminTest-412478146 Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 2a1f6f54c8d24eaa9eae09e8f30c56f1 Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-MigrationsAdminTest-412478146 Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-MigrationsAdminTest-412478146-project Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3b6e2046e3bd40b3b46802dfa796260b Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-MigrationsAdminTest-412478146-project Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance b3f3820c-e654-4eca-98de-9c5b2ec61763 could not be found. Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'b3f3820c-e654-4eca-98de-9c5b2ec61763'} Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f3820c-e654-4eca-98de-9c5b2ec61763 could not be found. Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f3820c-e654-4eca-98de-9c5b2ec61763 could not be found. Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:24.742546 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:24.750241 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:24.750241 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:24.750241 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:24.750241 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:24.750241 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:24.750241 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f3820c-e654-4eca-98de-9c5b2ec61763 could not be found. Sep 06 11:04:24.750241 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:24.750241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c58e8e8c-d9f9-4b66-b435-635aabae4efa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Returning 404 to user: Instance b3f3820c-e654-4eca-98de-9c5b2ec61763 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:24.750241 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c58e8e8c-d9f9-4b66-b435-635aabae4efa tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763" status: 404 len: 111 microversion: 2.1 time: 0.036425 Sep 06 11:04:24.750241 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1558/3120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:24 2022] GET /compute/v2.1/servers/b3f3820c-e654-4eca-98de-9c5b2ec61763 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:04:24.759853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7919d50c-b6e9-4b6d-9895-c0039a1a607f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:24.759853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7919d50c-b6e9-4b6d-9895-c0039a1a607f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:24.782155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7919d50c-b6e9-4b6d-9895-c0039a1a607f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.784900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7919d50c-b6e9-4b6d-9895-c0039a1a607f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.789348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7919d50c-b6e9-4b6d-9895-c0039a1a607f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.789348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7919d50c-b6e9-4b6d-9895-c0039a1a607f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.789348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7919d50c-b6e9-4b6d-9895-c0039a1a607f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.789348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7919d50c-b6e9-4b6d-9895-c0039a1a607f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.828544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7919d50c-b6e9-4b6d-9895-c0039a1a607f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:04:24.931808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7b943e45-2d49-4238-8935-62ab72ab67d7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:24.940770 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7b943e45-2d49-4238-8935-62ab72ab67d7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.291532 Sep 06 11:04:24.942153 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1563/3121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:24 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:24.964102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-56ed0a84-7b47-4b59-b0df-98bc89eff106 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:24.964695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-56ed0a84-7b47-4b59-b0df-98bc89eff106 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:24.971309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56ed0a84-7b47-4b59-b0df-98bc89eff106 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.971803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56ed0a84-7b47-4b59-b0df-98bc89eff106 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.972247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56ed0a84-7b47-4b59-b0df-98bc89eff106 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:24.972955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56ed0a84-7b47-4b59-b0df-98bc89eff106 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:24.973419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56ed0a84-7b47-4b59-b0df-98bc89eff106 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:24.973852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56ed0a84-7b47-4b59-b0df-98bc89eff106 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:25.257929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-56ed0a84-7b47-4b59-b0df-98bc89eff106 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Locking {{(pid=140876) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 06 11:04:25.312673 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7919d50c-b6e9-4b6d-9895-c0039a1a607f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 204 len: 0 microversion: 2.1 time: 0.559889 Sep 06 11:04:25.313275 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1559/3122] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:04:24 2022] DELETE /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:04:25.321907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5d6e4055-a2f5-4e5f-857c-73a8069734b9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:25.322642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5d6e4055-a2f5-4e5f-857c-73a8069734b9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:25.328601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d6e4055-a2f5-4e5f-857c-73a8069734b9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:25.329126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d6e4055-a2f5-4e5f-857c-73a8069734b9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:25.329687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d6e4055-a2f5-4e5f-857c-73a8069734b9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:25.331051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d6e4055-a2f5-4e5f-857c-73a8069734b9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:25.331515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d6e4055-a2f5-4e5f-857c-73a8069734b9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:25.332163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d6e4055-a2f5-4e5f-857c-73a8069734b9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:25.512702 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-56ed0a84-7b47-4b59-b0df-98bc89eff106 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.552281 Sep 06 11:04:25.514889 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1564/3123] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:24 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:04:25.522199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-206d3936-c03d-4380-9be0-916081cbbc8e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:25.523468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-206d3936-c03d-4380-9be0-916081cbbc8e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:25.537299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5d6e4055-a2f5-4e5f-857c-73a8069734b9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:25.553158 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5d6e4055-a2f5-4e5f-857c-73a8069734b9 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1534 microversion: 2.1 time: 0.235479 Sep 06 11:04:25.553626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-206d3936-c03d-4380-9be0-916081cbbc8e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:25.554222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-206d3936-c03d-4380-9be0-916081cbbc8e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:25.554428 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1560/3124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:25 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1534 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:25.554873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-206d3936-c03d-4380-9be0-916081cbbc8e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:25.555745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-206d3936-c03d-4380-9be0-916081cbbc8e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:25.556460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-206d3936-c03d-4380-9be0-916081cbbc8e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:25.557758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-206d3936-c03d-4380-9be0-916081cbbc8e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:25.559872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9d389562-c532-4a6f-91aa-599c4ee95b2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:25.560544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9d389562-c532-4a6f-91aa-599c4ee95b2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:25.567061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d389562-c532-4a6f-91aa-599c4ee95b2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:25.568347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d389562-c532-4a6f-91aa-599c4ee95b2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:25.568347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d389562-c532-4a6f-91aa-599c4ee95b2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:25.569306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d389562-c532-4a6f-91aa-599c4ee95b2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:25.569997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d389562-c532-4a6f-91aa-599c4ee95b2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:25.570598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d389562-c532-4a6f-91aa-599c4ee95b2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:25.846253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9d389562-c532-4a6f-91aa-599c4ee95b2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:25.857864 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9d389562-c532-4a6f-91aa-599c4ee95b2e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.301636 Sep 06 11:04:25.858460 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1561/3125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:25 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:25.881386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-310c600e-4901-43b3-adf6-bf89f3d5332f tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:25.882020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-310c600e-4901-43b3-adf6-bf89f3d5332f tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:25.887918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-206d3936-c03d-4380-9be0-916081cbbc8e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:25.894176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:25.896237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-310c600e-4901-43b3-adf6-bf89f3d5332f tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:25.897012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-310c600e-4901-43b3-adf6-bf89f3d5332f tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:25.897627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-310c600e-4901-43b3-adf6-bf89f3d5332f tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:25.898734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-310c600e-4901-43b3-adf6-bf89f3d5332f tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:25.899219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-310c600e-4901-43b3-adf6-bf89f3d5332f tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:25.899820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-310c600e-4901-43b3-adf6-bf89f3d5332f tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:25.901264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-206d3936-c03d-4380-9be0-916081cbbc8e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:25.919172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-206d3936-c03d-4380-9be0-916081cbbc8e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:25.919172 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-206d3936-c03d-4380-9be0-916081cbbc8e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.387610 Sep 06 11:04:25.919172 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1565/3126] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:25 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:25.919172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c4576d54-c54f-48d0-ad0d-c55c97142d86 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:25.919172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c4576d54-c54f-48d0-ad0d-c55c97142d86 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:25.919172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4576d54-c54f-48d0-ad0d-c55c97142d86 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:25.919172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4576d54-c54f-48d0-ad0d-c55c97142d86 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:25.919172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4576d54-c54f-48d0-ad0d-c55c97142d86 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:25.919172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4576d54-c54f-48d0-ad0d-c55c97142d86 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:25.920802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4576d54-c54f-48d0-ad0d-c55c97142d86 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:25.920802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4576d54-c54f-48d0-ad0d-c55c97142d86 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:26.014729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-310c600e-4901-43b3-adf6-bf89f3d5332f tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:26.024503 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-310c600e-4901-43b3-adf6-bf89f3d5332f tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1276 microversion: 2.1 time: 0.149381 Sep 06 11:04:26.025401 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1562/3127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:25 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:26.030507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01a282d5-0da8-4ff9-aa38-7c9670927260 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:26.038535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01a282d5-0da8-4ff9-aa38-7c9670927260 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:26.039312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01a282d5-0da8-4ff9-aa38-7c9670927260 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:26.044694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01a282d5-0da8-4ff9-aa38-7c9670927260 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:26.093003 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-01a282d5-0da8-4ff9-aa38-7c9670927260 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] HTTP exception thrown: Instance d9db1902-3f12-48b6-a27f-425e4843424b is locked Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01a282d5-0da8-4ff9-aa38-7c9670927260 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Request method failure captured: Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action HTTP/1.1 Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 15 Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyg2U48D630rtP93KctSUB55frBucaLCwvXam7s5D6muRGgpAdGYpf_Jd02qO6Wv-yScWLiyAR1qNAYbE0W-SGR2eaGszOp1OPVLx8OvqN3f_pV8xU0pTYMSFjaPG0NSAitsz90vg6hPWxi5nbHOISf77di5fAInBJEzZCthjFzILpY Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: dcd5ffec2c6246fb89ba181542692585 Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerActionsTestJSON-562575329 Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcd5ffec2c6246fb89ba181542692585"}]}] Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerActionsTestJSON-562575329 Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: dcd5ffec2c6246fb89ba181542692585 Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerActionsTestJSON-562575329 Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerActionsTestJSON-562575329-project Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: f16abbf8a68344b68444ff8fc2795c67 Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerActionsTestJSON-562575329-project Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: {"os-stop": {}} Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance d9db1902-3f12-48b6-a27f-425e4843424b is locked Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'd9db1902-3f12-48b6-a27f-425e4843424b', 'body': {'os-stop': {}}} Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance d9db1902-3f12-48b6-a27f-425e4843424b is locked Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance d9db1902-3f12-48b6-a27f-425e4843424b is locked Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9db1902-3f12-48b6-a27f-425e4843424b is locked Sep 06 11:04:26.094703 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:26.100914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01a282d5-0da8-4ff9-aa38-7c9670927260 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Returning 409 to user: Instance d9db1902-3f12-48b6-a27f-425e4843424b is locked {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:26.103971 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-01a282d5-0da8-4ff9-aa38-7c9670927260 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 409 len: 107 microversion: 2.1 time: 0.077124 Sep 06 11:04:26.109104 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1563/3128] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:26 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 107 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:04:26.116794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-edbf9186-eea8-47d8-9ba4-5a0a4b6f4999 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:26.117789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-edbf9186-eea8-47d8-9ba4-5a0a4b6f4999 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:26.124399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edbf9186-eea8-47d8-9ba4-5a0a4b6f4999 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:26.124708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c4576d54-c54f-48d0-ad0d-c55c97142d86 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:26.124927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edbf9186-eea8-47d8-9ba4-5a0a4b6f4999 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:26.125406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edbf9186-eea8-47d8-9ba4-5a0a4b6f4999 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:26.126260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edbf9186-eea8-47d8-9ba4-5a0a4b6f4999 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:26.126961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edbf9186-eea8-47d8-9ba4-5a0a4b6f4999 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:26.127484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edbf9186-eea8-47d8-9ba4-5a0a4b6f4999 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:26.137590 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c4576d54-c54f-48d0-ad0d-c55c97142d86 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1522 microversion: 2.1 time: 0.231603 Sep 06 11:04:26.138189 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1566/3129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:25 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:26.356093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-edbf9186-eea8-47d8-9ba4-5a0a4b6f4999 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Unlocking {{(pid=140875) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 06 11:04:26.398441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:26.534405 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-edbf9186-eea8-47d8-9ba4-5a0a4b6f4999 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.420169 Sep 06 11:04:26.535698 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1564/3130] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:26 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:04:26.545390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-79ee3608-40fd-4650-90d8-097e65688d71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:26.554623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ee3608-40fd-4650-90d8-097e65688d71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:26.555644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ee3608-40fd-4650-90d8-097e65688d71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:26.556291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ee3608-40fd-4650-90d8-097e65688d71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:26.581844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c930d797-14fb-4d18-bb2b-da20f8d3a636 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:26.582543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c930d797-14fb-4d18-bb2b-da20f8d3a636 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:26.585106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-79ee3608-40fd-4650-90d8-097e65688d71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Going to try to stop instance {{(pid=140876) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 11:04:26.593070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c930d797-14fb-4d18-bb2b-da20f8d3a636 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:26.598715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c930d797-14fb-4d18-bb2b-da20f8d3a636 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:26.599818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c930d797-14fb-4d18-bb2b-da20f8d3a636 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:26.600814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c930d797-14fb-4d18-bb2b-da20f8d3a636 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:26.601360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c930d797-14fb-4d18-bb2b-da20f8d3a636 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:26.601943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c930d797-14fb-4d18-bb2b-da20f8d3a636 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:26.785729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c930d797-14fb-4d18-bb2b-da20f8d3a636 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:26.793858 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c930d797-14fb-4d18-bb2b-da20f8d3a636 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1534 microversion: 2.1 time: 0.217174 Sep 06 11:04:26.794471 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1565/3131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:26 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1534 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:26.866092 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-79ee3608-40fd-4650-90d8-097e65688d71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.325833 Sep 06 11:04:26.870268 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1567/3132] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:26 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:04:26.876177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c2a22771-5d6e-422b-8eed-36dca806b6cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:26.877515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c2a22771-5d6e-422b-8eed-36dca806b6cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:26.897664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2a22771-5d6e-422b-8eed-36dca806b6cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:26.898175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2a22771-5d6e-422b-8eed-36dca806b6cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:26.898631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2a22771-5d6e-422b-8eed-36dca806b6cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:26.899387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2a22771-5d6e-422b-8eed-36dca806b6cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:26.899862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2a22771-5d6e-422b-8eed-36dca806b6cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:26.900302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2a22771-5d6e-422b-8eed-36dca806b6cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:26.935609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7988f904-a63f-4cc8-88d6-2a3db42c88b9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:26.936340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7988f904-a63f-4cc8-88d6-2a3db42c88b9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:26.946895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7988f904-a63f-4cc8-88d6-2a3db42c88b9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:26.947434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7988f904-a63f-4cc8-88d6-2a3db42c88b9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:26.947879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7988f904-a63f-4cc8-88d6-2a3db42c88b9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:26.948595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7988f904-a63f-4cc8-88d6-2a3db42c88b9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:26.949064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7988f904-a63f-4cc8-88d6-2a3db42c88b9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:26.949500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7988f904-a63f-4cc8-88d6-2a3db42c88b9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:26.978392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:27.256533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c2a22771-5d6e-422b-8eed-36dca806b6cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:27.268663 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c2a22771-5d6e-422b-8eed-36dca806b6cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.393322 Sep 06 11:04:27.268663 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1566/3133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:26 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:27.284430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ea33d68-d6c8-4e2f-a33f-ece7905469b1 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:27.284837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ea33d68-d6c8-4e2f-a33f-ece7905469b1 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:27.294204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ea33d68-d6c8-4e2f-a33f-ece7905469b1 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:27.294702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ea33d68-d6c8-4e2f-a33f-ece7905469b1 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:27.295219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ea33d68-d6c8-4e2f-a33f-ece7905469b1 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:27.295984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ea33d68-d6c8-4e2f-a33f-ece7905469b1 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:27.296399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ea33d68-d6c8-4e2f-a33f-ece7905469b1 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:27.296826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ea33d68-d6c8-4e2f-a33f-ece7905469b1 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:27.340498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7988f904-a63f-4cc8-88d6-2a3db42c88b9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:27.355817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7988f904-a63f-4cc8-88d6-2a3db42c88b9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:27.357238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7988f904-a63f-4cc8-88d6-2a3db42c88b9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:27.358770 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7988f904-a63f-4cc8-88d6-2a3db42c88b9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.427862 Sep 06 11:04:27.359361 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1568/3134] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:26 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:27.380513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b868650e-058e-43b5-8f9c-c2a67cf71445 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:27.382002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b868650e-058e-43b5-8f9c-c2a67cf71445 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:27.391935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b868650e-058e-43b5-8f9c-c2a67cf71445 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:27.392497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b868650e-058e-43b5-8f9c-c2a67cf71445 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:27.392949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b868650e-058e-43b5-8f9c-c2a67cf71445 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:27.393676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b868650e-058e-43b5-8f9c-c2a67cf71445 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:27.394134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b868650e-058e-43b5-8f9c-c2a67cf71445 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:27.394751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b868650e-058e-43b5-8f9c-c2a67cf71445 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:27.409273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ea33d68-d6c8-4e2f-a33f-ece7905469b1 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:27.420830 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ea33d68-d6c8-4e2f-a33f-ece7905469b1 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1274 microversion: 2.1 time: 0.153698 Sep 06 11:04:27.421574 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1567/3135] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:27 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:27.427850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-5e8040b4-63fb-4c18-b61b-6f7b67a74cc1 req-be724437-f8f4-4d4f-ae25-52109d9cbc9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0611012-ede1-4ec2-b586-e3ba1f562253", "name": "network-vif-deleted", "tag": "ecc6e385-dc5e-4440-9b3e-e389cf5f0eed"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:27.438611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5e8040b4-63fb-4c18-b61b-6f7b67a74cc1 req-be724437-f8f4-4d4f-ae25-52109d9cbc9e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:27.439599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5e8040b4-63fb-4c18-b61b-6f7b67a74cc1 req-be724437-f8f4-4d4f-ae25-52109d9cbc9e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:27.440167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5e8040b4-63fb-4c18-b61b-6f7b67a74cc1 req-be724437-f8f4-4d4f-ae25-52109d9cbc9e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:27.452770 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5e8040b4-63fb-4c18-b61b-6f7b67a74cc1 req-be724437-f8f4-4d4f-ae25-52109d9cbc9e service nova] Creating event network-vif-deleted:ecc6e385-dc5e-4440-9b3e-e389cf5f0eed for instance b0611012-ede1-4ec2-b586-e3ba1f562253 on nch1-master-1 Sep 06 11:04:27.459954 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-5e8040b4-63fb-4c18-b61b-6f7b67a74cc1 req-be724437-f8f4-4d4f-ae25-52109d9cbc9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035822 Sep 06 11:04:27.461020 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1568/3136] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:27.819350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:27.820394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:27.843110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:27.843297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:27.843771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:27.849366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:27.849896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:27.850361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:27.888541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:27.889694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:27.890454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:27.895106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lazy-loading 'fault' on Instance uuid b0611012-ede1-4ec2-b586-e3ba1f562253 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:04:27.965033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:27.982513 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-18dafbd9-fcb8-4542-b164-4d2046942880 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 200 len: 1368 microversion: 2.1 time: 0.168258 Sep 06 11:04:27.983132 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1569/3137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:27 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:28.039761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b868650e-058e-43b5-8f9c-c2a67cf71445 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:28.048081 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b868650e-058e-43b5-8f9c-c2a67cf71445 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1522 microversion: 2.1 time: 0.687378 Sep 06 11:04:28.048703 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1569/3138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:27 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1522 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:28.291755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4d2652a7-86db-44d9-be66-a4b3a6930b6d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:28.292830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4d2652a7-86db-44d9-be66-a4b3a6930b6d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:28.313125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d2652a7-86db-44d9-be66-a4b3a6930b6d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:28.313698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d2652a7-86db-44d9-be66-a4b3a6930b6d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:28.314765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d2652a7-86db-44d9-be66-a4b3a6930b6d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:28.315595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d2652a7-86db-44d9-be66-a4b3a6930b6d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:28.316110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d2652a7-86db-44d9-be66-a4b3a6930b6d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:28.316765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d2652a7-86db-44d9-be66-a4b3a6930b6d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:28.396961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-77b02da0-7af4-4ca3-8cdf-3101c86cdedb tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:28.397893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-77b02da0-7af4-4ca3-8cdf-3101c86cdedb tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:28.413872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77b02da0-7af4-4ca3-8cdf-3101c86cdedb tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:28.414634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77b02da0-7af4-4ca3-8cdf-3101c86cdedb tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:28.415798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77b02da0-7af4-4ca3-8cdf-3101c86cdedb tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:28.417301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77b02da0-7af4-4ca3-8cdf-3101c86cdedb tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:28.418814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77b02da0-7af4-4ca3-8cdf-3101c86cdedb tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:28.419747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77b02da0-7af4-4ca3-8cdf-3101c86cdedb tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:28.813107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4d2652a7-86db-44d9-be66-a4b3a6930b6d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:28.821805 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4d2652a7-86db-44d9-be66-a4b3a6930b6d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.535897 Sep 06 11:04:28.822396 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1570/3139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:28 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:28.827039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b0854d4-7b65-417b-a7af-fdbf01aaf970 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:28.827668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2b0854d4-7b65-417b-a7af-fdbf01aaf970 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:28.835834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b0854d4-7b65-417b-a7af-fdbf01aaf970 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:28.836401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b0854d4-7b65-417b-a7af-fdbf01aaf970 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:28.836857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b0854d4-7b65-417b-a7af-fdbf01aaf970 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:28.837573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b0854d4-7b65-417b-a7af-fdbf01aaf970 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:28.838283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b0854d4-7b65-417b-a7af-fdbf01aaf970 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:28.838626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b0854d4-7b65-417b-a7af-fdbf01aaf970 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:28.977763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77b02da0-7af4-4ca3-8cdf-3101c86cdedb tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:28.987843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77b02da0-7af4-4ca3-8cdf-3101c86cdedb tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:28.989343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77b02da0-7af4-4ca3-8cdf-3101c86cdedb tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:28.990513 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-77b02da0-7af4-4ca3-8cdf-3101c86cdedb tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.603142 Sep 06 11:04:28.991292 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1570/3140] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:28 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:29.005819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c01b27e2-d64d-4ae0-ae1b-a6dc466003d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:29.006443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c01b27e2-d64d-4ae0-ae1b-a6dc466003d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: b0611012-ede1-4ec2-b586-e3ba1f562253] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:29.015083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c01b27e2-d64d-4ae0-ae1b-a6dc466003d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:29.015579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c01b27e2-d64d-4ae0-ae1b-a6dc466003d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:29.016027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c01b27e2-d64d-4ae0-ae1b-a6dc466003d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:29.016741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c01b27e2-d64d-4ae0-ae1b-a6dc466003d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:29.017713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c01b27e2-d64d-4ae0-ae1b-a6dc466003d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:29.018144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c01b27e2-d64d-4ae0-ae1b-a6dc466003d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:29.031924 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-c01b27e2-d64d-4ae0-ae1b-a6dc466003d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] HTTP exception thrown: Instance b0611012-ede1-4ec2-b586-e3ba1f562253 could not be found. Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c01b27e2-d64d-4ae0-ae1b-a6dc466003d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Request method failure captured: Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 HTTP/1.1 Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyggiVGcEIOZAn3rsfB9ZJuhzgMAc4xHuGANTDtl4bhidO9S8CXVHNJGyQ1HxyHBQtXWuiiUncTVP6-qsBg5uwWdFT8nEvCGty2c1XbSTNKRGJkQEg8H4AlTz_Gl4UfRAG-pvTa_ZQxBWb0Abuie6GI_dvl1yHOiDUIVPvYSkbuus2Q Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2a1f6f54c8d24eaa9eae09e8f30c56f1 Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-MigrationsAdminTest-412478146 Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}] Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-MigrationsAdminTest-412478146 Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2a1f6f54c8d24eaa9eae09e8f30c56f1 Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-MigrationsAdminTest-412478146 Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-MigrationsAdminTest-412478146-project Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3b6e2046e3bd40b3b46802dfa796260b Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-MigrationsAdminTest-412478146-project Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance b0611012-ede1-4ec2-b586-e3ba1f562253 could not be found. Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'b0611012-ede1-4ec2-b586-e3ba1f562253'} Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0611012-ede1-4ec2-b586-e3ba1f562253 could not be found. Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0611012-ede1-4ec2-b586-e3ba1f562253 could not be found. Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:29.036936 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:29.046970 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:29.046970 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:29.046970 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:29.046970 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:29.046970 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:29.046970 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0611012-ede1-4ec2-b586-e3ba1f562253 could not be found. Sep 06 11:04:29.046970 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:29.046970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c01b27e2-d64d-4ae0-ae1b-a6dc466003d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Returning 404 to user: Instance b0611012-ede1-4ec2-b586-e3ba1f562253 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:29.046970 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c01b27e2-d64d-4ae0-ae1b-a6dc466003d6 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253" status: 404 len: 111 microversion: 2.1 time: 0.036340 Sep 06 11:04:29.046970 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1571/3141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:29 2022] GET /compute/v2.1/servers/b0611012-ede1-4ec2-b586-e3ba1f562253 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:04:29.049666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b0e5482f-443e-4ea1-8d42-54061aafe8c2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '.version_select at 0x7f90f89d73a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:29.164660 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b0e5482f-443e-4ea1-8d42-54061aafe8c2 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-91890228" status: 202 len: 0 microversion: 2.1 time: 0.121344 Sep 06 11:04:29.172225 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1572/3142] 10.222.0.20 () {58 vars in 1215 bytes} [Tue Sep 6 11:04:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-91890228 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:04:29.175424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-89cbea1a-9bbf-43a5-b5ef-b2fe1d198584 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:29.176419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-89cbea1a-9bbf-43a5-b5ef-b2fe1d198584 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:29.183753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:29.185946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89cbea1a-9bbf-43a5-b5ef-b2fe1d198584 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:29.186955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89cbea1a-9bbf-43a5-b5ef-b2fe1d198584 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:29.187735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89cbea1a-9bbf-43a5-b5ef-b2fe1d198584 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:29.188708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89cbea1a-9bbf-43a5-b5ef-b2fe1d198584 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:29.189625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89cbea1a-9bbf-43a5-b5ef-b2fe1d198584 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:29.190309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89cbea1a-9bbf-43a5-b5ef-b2fe1d198584 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:29.336901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2b0854d4-7b65-417b-a7af-fdbf01aaf970 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:29.346169 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b0854d4-7b65-417b-a7af-fdbf01aaf970 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1316 microversion: 2.1 time: 0.522105 Sep 06 11:04:29.346898 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1571/3143] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:28 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:29.450131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-89cbea1a-9bbf-43a5-b5ef-b2fe1d198584 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:29.471394 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-89cbea1a-9bbf-43a5-b5ef-b2fe1d198584 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1522 microversion: 2.1 time: 0.301178 Sep 06 11:04:29.487633 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1573/3144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:29 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:29.845978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-35c5fefc-eb7b-4404-afd3-d72c582fe702 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:29.846692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-35c5fefc-eb7b-4404-afd3-d72c582fe702 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:29.854367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35c5fefc-eb7b-4404-afd3-d72c582fe702 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:29.855142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35c5fefc-eb7b-4404-afd3-d72c582fe702 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:29.855849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35c5fefc-eb7b-4404-afd3-d72c582fe702 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:29.856949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35c5fefc-eb7b-4404-afd3-d72c582fe702 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:29.857629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35c5fefc-eb7b-4404-afd3-d72c582fe702 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:29.858591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35c5fefc-eb7b-4404-afd3-d72c582fe702 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:30.003450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9fc13202-2aa8-4f58-b112-a7ba8ec3fe6b req-e8426349-e8f4-4e0e-a30a-b6f1ea06dec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-plugged", "status": "completed", "tag": "8b3ac40a-47a0-4d01-ae00-cba282f046f8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:30.018109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9fc13202-2aa8-4f58-b112-a7ba8ec3fe6b req-e8426349-e8f4-4e0e-a30a-b6f1ea06dec6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:30.018613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9fc13202-2aa8-4f58-b112-a7ba8ec3fe6b req-e8426349-e8f4-4e0e-a30a-b6f1ea06dec6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:30.019274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9fc13202-2aa8-4f58-b112-a7ba8ec3fe6b req-e8426349-e8f4-4e0e-a30a-b6f1ea06dec6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:30.032220 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9fc13202-2aa8-4f58-b112-a7ba8ec3fe6b req-e8426349-e8f4-4e0e-a30a-b6f1ea06dec6 service nova] Creating event network-vif-plugged:8b3ac40a-47a0-4d01-ae00-cba282f046f8 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:30.040335 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9fc13202-2aa8-4f58-b112-a7ba8ec3fe6b req-e8426349-e8f4-4e0e-a30a-b6f1ea06dec6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039805 Sep 06 11:04:30.042639 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1574/3145] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:30.058237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2ae97a64-d4b3-41f2-ab1b-8ebfd642a352 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:30.058237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2ae97a64-d4b3-41f2-ab1b-8ebfd642a352 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:30.060916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ae97a64-d4b3-41f2-ab1b-8ebfd642a352 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:30.061444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ae97a64-d4b3-41f2-ab1b-8ebfd642a352 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:30.061870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ae97a64-d4b3-41f2-ab1b-8ebfd642a352 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:30.062586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ae97a64-d4b3-41f2-ab1b-8ebfd642a352 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:30.063572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ae97a64-d4b3-41f2-ab1b-8ebfd642a352 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:30.064942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ae97a64-d4b3-41f2-ab1b-8ebfd642a352 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:30.069108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-35c5fefc-eb7b-4404-afd3-d72c582fe702 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:30.078255 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-35c5fefc-eb7b-4404-afd3-d72c582fe702 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.236430 Sep 06 11:04:30.096499 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1572/3146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:29 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:30.120106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-02899bae-eaba-432c-9dc4-e75eb71f47ec req-a9f9d029-01b6-4176-8b7f-e21440af06e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b75d677b-b25f-42b2-8d2e-810a8f3a90de", "tag": "3d7f7080-5bc6-4c22-b3b2-50680793ae44"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:30.134409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-02899bae-eaba-432c-9dc4-e75eb71f47ec req-a9f9d029-01b6-4176-8b7f-e21440af06e6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:30.135220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-02899bae-eaba-432c-9dc4-e75eb71f47ec req-a9f9d029-01b6-4176-8b7f-e21440af06e6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:30.135834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-02899bae-eaba-432c-9dc4-e75eb71f47ec req-a9f9d029-01b6-4176-8b7f-e21440af06e6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:30.151335 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-02899bae-eaba-432c-9dc4-e75eb71f47ec req-a9f9d029-01b6-4176-8b7f-e21440af06e6 service nova] Creating event network-changed:3d7f7080-5bc6-4c22-b3b2-50680793ae44 for instance b75d677b-b25f-42b2-8d2e-810a8f3a90de on nch1-master-1 Sep 06 11:04:30.157394 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-02899bae-eaba-432c-9dc4-e75eb71f47ec req-a9f9d029-01b6-4176-8b7f-e21440af06e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040754 Sep 06 11:04:30.159172 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1573/3147] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:30.170417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3ea39e7f-e2f1-4d47-aba5-1984ec405fa1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:30.171606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3ea39e7f-e2f1-4d47-aba5-1984ec405fa1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:30.180791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ea39e7f-e2f1-4d47-aba5-1984ec405fa1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:30.186940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ea39e7f-e2f1-4d47-aba5-1984ec405fa1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:30.186940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ea39e7f-e2f1-4d47-aba5-1984ec405fa1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:30.186940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ea39e7f-e2f1-4d47-aba5-1984ec405fa1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:30.186940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ea39e7f-e2f1-4d47-aba5-1984ec405fa1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:30.186940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ea39e7f-e2f1-4d47-aba5-1984ec405fa1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:30.215421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3ea39e7f-e2f1-4d47-aba5-1984ec405fa1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:04:30.351474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2ae97a64-d4b3-41f2-ab1b-8ebfd642a352 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:30.366751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2ae97a64-d4b3-41f2-ab1b-8ebfd642a352 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:30.368313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2ae97a64-d4b3-41f2-ab1b-8ebfd642a352 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:30.369510 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2ae97a64-d4b3-41f2-ab1b-8ebfd642a352 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.325588 Sep 06 11:04:30.375367 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1575/3148] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:30 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:30.391092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-19ae173a-32ae-48a8-a6fb-8f730ce3b64a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:30.393018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-19ae173a-32ae-48a8-a6fb-8f730ce3b64a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:30.400353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19ae173a-32ae-48a8-a6fb-8f730ce3b64a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:30.400991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19ae173a-32ae-48a8-a6fb-8f730ce3b64a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:30.401542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19ae173a-32ae-48a8-a6fb-8f730ce3b64a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:30.402369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19ae173a-32ae-48a8-a6fb-8f730ce3b64a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:30.402941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19ae173a-32ae-48a8-a6fb-8f730ce3b64a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:30.403719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19ae173a-32ae-48a8-a6fb-8f730ce3b64a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:30.624651 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3ea39e7f-e2f1-4d47-aba5-1984ec405fa1 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 204 len: 0 microversion: 2.1 time: 0.458752 Sep 06 11:04:30.625840 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1574/3149] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:04:30 2022] DELETE /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:04:30.631590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dbfbb37b-29ba-484b-aa40-f8efb6f488ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:30.632300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dbfbb37b-29ba-484b-aa40-f8efb6f488ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:30.639542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbfbb37b-29ba-484b-aa40-f8efb6f488ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:30.640549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbfbb37b-29ba-484b-aa40-f8efb6f488ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:30.640997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbfbb37b-29ba-484b-aa40-f8efb6f488ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:30.641716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbfbb37b-29ba-484b-aa40-f8efb6f488ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:30.642722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbfbb37b-29ba-484b-aa40-f8efb6f488ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:30.643191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbfbb37b-29ba-484b-aa40-f8efb6f488ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:30.643678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19ae173a-32ae-48a8-a6fb-8f730ce3b64a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:30.652462 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-19ae173a-32ae-48a8-a6fb-8f730ce3b64a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1316 microversion: 2.1 time: 0.274905 Sep 06 11:04:30.654301 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1576/3150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:30 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:30.660126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e5bb530-3998-4fb7-841a-58032b13c2cd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:30.661034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4e5bb530-3998-4fb7-841a-58032b13c2cd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:30.668207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e5bb530-3998-4fb7-841a-58032b13c2cd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:30.669371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e5bb530-3998-4fb7-841a-58032b13c2cd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:30.669909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e5bb530-3998-4fb7-841a-58032b13c2cd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:30.670802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e5bb530-3998-4fb7-841a-58032b13c2cd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:30.671287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e5bb530-3998-4fb7-841a-58032b13c2cd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:30.671925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e5bb530-3998-4fb7-841a-58032b13c2cd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:31.040279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4e5bb530-3998-4fb7-841a-58032b13c2cd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:31.046885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dbfbb37b-29ba-484b-aa40-f8efb6f488ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:31.051528 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e5bb530-3998-4fb7-841a-58032b13c2cd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1467 microversion: 2.1 time: 0.395269 Sep 06 11:04:31.052342 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1577/3151] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:30 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1467 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:31.078132 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dbfbb37b-29ba-484b-aa40-f8efb6f488ad tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1522 microversion: 2.1 time: 0.450748 Sep 06 11:04:31.078974 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1575/3152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:30 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:31.105052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-846b1589-64e6-4b88-b73d-aeaf96b00937 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:31.105854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-846b1589-64e6-4b88-b73d-aeaf96b00937 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:31.112754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-846b1589-64e6-4b88-b73d-aeaf96b00937 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:31.113519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-846b1589-64e6-4b88-b73d-aeaf96b00937 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:31.114386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-846b1589-64e6-4b88-b73d-aeaf96b00937 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:31.115443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-846b1589-64e6-4b88-b73d-aeaf96b00937 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:31.116077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-846b1589-64e6-4b88-b73d-aeaf96b00937 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:31.116693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-846b1589-64e6-4b88-b73d-aeaf96b00937 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:31.362421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-846b1589-64e6-4b88-b73d-aeaf96b00937 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:31.371620 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-846b1589-64e6-4b88-b73d-aeaf96b00937 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.272943 Sep 06 11:04:31.375445 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1578/3153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:31 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:31.400169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2baec324-0423-4257-98ea-e5224182aa3a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:31.401647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2baec324-0423-4257-98ea-e5224182aa3a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:31.409871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2baec324-0423-4257-98ea-e5224182aa3a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:31.410863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2baec324-0423-4257-98ea-e5224182aa3a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:31.411671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2baec324-0423-4257-98ea-e5224182aa3a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:31.412622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2baec324-0423-4257-98ea-e5224182aa3a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:31.413503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2baec324-0423-4257-98ea-e5224182aa3a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:31.413950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2baec324-0423-4257-98ea-e5224182aa3a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:31.621422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2baec324-0423-4257-98ea-e5224182aa3a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:31.632858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2baec324-0423-4257-98ea-e5224182aa3a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:31.634916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2baec324-0423-4257-98ea-e5224182aa3a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:31.636327 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2baec324-0423-4257-98ea-e5224182aa3a tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.241209 Sep 06 11:04:31.637008 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1576/3154] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:31 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:31.680590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f408393-7b9c-42be-b63b-2fb8b68603c0 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:31.681335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1f408393-7b9c-42be-b63b-2fb8b68603c0 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:31.688135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f408393-7b9c-42be-b63b-2fb8b68603c0 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:31.688610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f408393-7b9c-42be-b63b-2fb8b68603c0 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:31.689591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f408393-7b9c-42be-b63b-2fb8b68603c0 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:31.690353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f408393-7b9c-42be-b63b-2fb8b68603c0 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:31.690816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f408393-7b9c-42be-b63b-2fb8b68603c0 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:31.691351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f408393-7b9c-42be-b63b-2fb8b68603c0 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:31.838672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1f408393-7b9c-42be-b63b-2fb8b68603c0 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:31.847811 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1f408393-7b9c-42be-b63b-2fb8b68603c0 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1316 microversion: 2.1 time: 0.171100 Sep 06 11:04:31.848911 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1579/3155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:31 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:32.056402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f7424228-1440-4f3e-8b85-3a40ee03d97d req-879e2ab3-b5d1-4a07-8aea-dbb9eb02261e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-plugged", "status": "completed", "tag": "53554e9a-68ab-46af-bf31-d81bb29cfac6"}, {"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-plugged", "status": "completed", "tag": "62e35ca1-7670-4e3b-9d70-d70c74fb7d76"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:32.061955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:32.068180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f7424228-1440-4f3e-8b85-3a40ee03d97d req-879e2ab3-b5d1-4a07-8aea-dbb9eb02261e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:32.068670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f7424228-1440-4f3e-8b85-3a40ee03d97d req-879e2ab3-b5d1-4a07-8aea-dbb9eb02261e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:32.069111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f7424228-1440-4f3e-8b85-3a40ee03d97d req-879e2ab3-b5d1-4a07-8aea-dbb9eb02261e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:32.078848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e00c445-be86-4086-ae9b-c2aef443d2dd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:32.080020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5e00c445-be86-4086-ae9b-c2aef443d2dd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:32.084385 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f7424228-1440-4f3e-8b85-3a40ee03d97d req-879e2ab3-b5d1-4a07-8aea-dbb9eb02261e service nova] Creating event network-vif-plugged:53554e9a-68ab-46af-bf31-d81bb29cfac6 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:32.084909 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f7424228-1440-4f3e-8b85-3a40ee03d97d req-879e2ab3-b5d1-4a07-8aea-dbb9eb02261e service nova] Creating event network-vif-plugged:62e35ca1-7670-4e3b-9d70-d70c74fb7d76 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:32.087135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e00c445-be86-4086-ae9b-c2aef443d2dd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:32.087624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e00c445-be86-4086-ae9b-c2aef443d2dd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:32.088064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e00c445-be86-4086-ae9b-c2aef443d2dd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:32.088765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e00c445-be86-4086-ae9b-c2aef443d2dd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:32.089374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e00c445-be86-4086-ae9b-c2aef443d2dd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:32.089875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e00c445-be86-4086-ae9b-c2aef443d2dd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:32.090413 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f7424228-1440-4f3e-8b85-3a40ee03d97d req-879e2ab3-b5d1-4a07-8aea-dbb9eb02261e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037804 Sep 06 11:04:32.091181 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1577/3156] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:32.114256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9b73e7d6-2903-4b17-93a9-bc87ce7312e8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:32.115069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9b73e7d6-2903-4b17-93a9-bc87ce7312e8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:32.122850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b73e7d6-2903-4b17-93a9-bc87ce7312e8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:32.123556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b73e7d6-2903-4b17-93a9-bc87ce7312e8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:32.124140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b73e7d6-2903-4b17-93a9-bc87ce7312e8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:32.124903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b73e7d6-2903-4b17-93a9-bc87ce7312e8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:32.125371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b73e7d6-2903-4b17-93a9-bc87ce7312e8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:32.125803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b73e7d6-2903-4b17-93a9-bc87ce7312e8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:32.250882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:32.404954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5e00c445-be86-4086-ae9b-c2aef443d2dd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:32.415356 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5e00c445-be86-4086-ae9b-c2aef443d2dd tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1467 microversion: 2.1 time: 0.340632 Sep 06 11:04:32.415982 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1580/3157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:32 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1467 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:32.421576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-72f28327-ef6a-448c-bba4-2250a20f722c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:32.422367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-72f28327-ef6a-448c-bba4-2250a20f722c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:32.427269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9b73e7d6-2903-4b17-93a9-bc87ce7312e8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:32.431448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72f28327-ef6a-448c-bba4-2250a20f722c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:32.431448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72f28327-ef6a-448c-bba4-2250a20f722c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:32.431448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72f28327-ef6a-448c-bba4-2250a20f722c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:32.431448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72f28327-ef6a-448c-bba4-2250a20f722c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:32.432281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72f28327-ef6a-448c-bba4-2250a20f722c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:32.432727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72f28327-ef6a-448c-bba4-2250a20f722c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:32.436948 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9b73e7d6-2903-4b17-93a9-bc87ce7312e8 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1522 microversion: 2.1 time: 0.326972 Sep 06 11:04:32.438150 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1578/3158] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:32 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:32.662333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-72f28327-ef6a-448c-bba4-2250a20f722c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:32.663677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-119d6615-0f96-47e3-9136-8369ca7b5dfe tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:32.664705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-119d6615-0f96-47e3-9136-8369ca7b5dfe tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:32.672644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-119d6615-0f96-47e3-9136-8369ca7b5dfe tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:32.676052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-119d6615-0f96-47e3-9136-8369ca7b5dfe tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:32.676052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-119d6615-0f96-47e3-9136-8369ca7b5dfe tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:32.676784 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-72f28327-ef6a-448c-bba4-2250a20f722c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.258996 Sep 06 11:04:32.677257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-119d6615-0f96-47e3-9136-8369ca7b5dfe tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:32.677437 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1581/3159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:32 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:32.690765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-119d6615-0f96-47e3-9136-8369ca7b5dfe tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:32.691463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-119d6615-0f96-47e3-9136-8369ca7b5dfe tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:32.872377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0bc8bea1-43d5-432e-a5e0-c16044bc2a7e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:32.873005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0bc8bea1-43d5-432e-a5e0-c16044bc2a7e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:32.879936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bc8bea1-43d5-432e-a5e0-c16044bc2a7e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:32.891616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bc8bea1-43d5-432e-a5e0-c16044bc2a7e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:32.891616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bc8bea1-43d5-432e-a5e0-c16044bc2a7e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:32.891616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bc8bea1-43d5-432e-a5e0-c16044bc2a7e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:32.891616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bc8bea1-43d5-432e-a5e0-c16044bc2a7e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:32.891616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bc8bea1-43d5-432e-a5e0-c16044bc2a7e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:32.938248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-119d6615-0f96-47e3-9136-8369ca7b5dfe tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:32.960135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-119d6615-0f96-47e3-9136-8369ca7b5dfe tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:32.962128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-119d6615-0f96-47e3-9136-8369ca7b5dfe tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:32.963482 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-119d6615-0f96-47e3-9136-8369ca7b5dfe tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.304113 Sep 06 11:04:32.964742 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1579/3160] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:32 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:04:33.053397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9b8c7546-8745-4cd8-bf5b-129c80eafcc6 req-4cb424b4-14ee-472e-a25e-7a4761f55e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc46dc01-cd54-44a1-a379-0b0f8ff43991", "name": "network-vif-deleted", "tag": "17d26200-b9e0-4b27-90ee-4779abc2a65e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:33.066644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9b8c7546-8745-4cd8-bf5b-129c80eafcc6 req-4cb424b4-14ee-472e-a25e-7a4761f55e0d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:33.067310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9b8c7546-8745-4cd8-bf5b-129c80eafcc6 req-4cb424b4-14ee-472e-a25e-7a4761f55e0d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:33.067620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9b8c7546-8745-4cd8-bf5b-129c80eafcc6 req-4cb424b4-14ee-472e-a25e-7a4761f55e0d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:33.080840 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9b8c7546-8745-4cd8-bf5b-129c80eafcc6 req-4cb424b4-14ee-472e-a25e-7a4761f55e0d service nova] Creating event network-vif-deleted:17d26200-b9e0-4b27-90ee-4779abc2a65e for instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 on nch2-master-1 Sep 06 11:04:33.093744 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9b8c7546-8745-4cd8-bf5b-129c80eafcc6 req-4cb424b4-14ee-472e-a25e-7a4761f55e0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044614 Sep 06 11:04:33.094374 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1580/3161] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:04:33.122226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0bc8bea1-43d5-432e-a5e0-c16044bc2a7e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:33.130513 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0bc8bea1-43d5-432e-a5e0-c16044bc2a7e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1316 microversion: 2.1 time: 0.262902 Sep 06 11:04:33.131101 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1582/3162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:32 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:33.435278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:33.440156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:33.446359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:33.447341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:33.447844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:33.448523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:33.449247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:33.449715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:33.450321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:33.456958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:33.464301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-835f753c-1288-4874-b052-7866c2c714b1 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:33.464913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-835f753c-1288-4874-b052-7866c2c714b1 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:33.475135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-835f753c-1288-4874-b052-7866c2c714b1 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:33.475135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-835f753c-1288-4874-b052-7866c2c714b1 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:33.475135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-835f753c-1288-4874-b052-7866c2c714b1 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:33.475135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-835f753c-1288-4874-b052-7866c2c714b1 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:33.475606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-835f753c-1288-4874-b052-7866c2c714b1 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:33.476043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-835f753c-1288-4874-b052-7866c2c714b1 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:33.494909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:33.494909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:33.494909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:33.494909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lazy-loading 'fault' on Instance uuid fc46dc01-cd54-44a1-a379-0b0f8ff43991 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:04:33.562026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:33.571961 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c4d00ad7-7a19-4337-90db-593e6ca9159f tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 200 len: 1302 microversion: 2.1 time: 0.137314 Sep 06 11:04:33.572808 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1581/3163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:33 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 1302 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:33.644550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-835f753c-1288-4874-b052-7866c2c714b1 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:33.649599 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-835f753c-1288-4874-b052-7866c2c714b1 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1522 microversion: 2.1 time: 0.191122 Sep 06 11:04:33.650425 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1583/3164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:33 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:33.705766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6f0a1927-b1a7-4057-85f6-275bd742abb6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:33.706385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6f0a1927-b1a7-4057-85f6-275bd742abb6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:33.712447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f0a1927-b1a7-4057-85f6-275bd742abb6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:33.712936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f0a1927-b1a7-4057-85f6-275bd742abb6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:33.713540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f0a1927-b1a7-4057-85f6-275bd742abb6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:33.714244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f0a1927-b1a7-4057-85f6-275bd742abb6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:33.714704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f0a1927-b1a7-4057-85f6-275bd742abb6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:33.715165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f0a1927-b1a7-4057-85f6-275bd742abb6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:33.847843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6f0a1927-b1a7-4057-85f6-275bd742abb6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:33.855493 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6f0a1927-b1a7-4057-85f6-275bd742abb6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.153759 Sep 06 11:04:33.856154 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1582/3165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:33 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:33.990308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5bf55162-a1e8-4234-9834-8a24718792ad tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:33.990929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5bf55162-a1e8-4234-9834-8a24718792ad tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:33.997585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bf55162-a1e8-4234-9834-8a24718792ad tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:33.998076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bf55162-a1e8-4234-9834-8a24718792ad tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:33.998520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bf55162-a1e8-4234-9834-8a24718792ad tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:33.999247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bf55162-a1e8-4234-9834-8a24718792ad tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:33.999734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bf55162-a1e8-4234-9834-8a24718792ad tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:34.000170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bf55162-a1e8-4234-9834-8a24718792ad tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:34.154253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0af096f2-51ae-484d-8439-905643969389 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:34.154879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0af096f2-51ae-484d-8439-905643969389 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:34.162910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0af096f2-51ae-484d-8439-905643969389 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:34.163436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0af096f2-51ae-484d-8439-905643969389 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:34.163892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0af096f2-51ae-484d-8439-905643969389 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:34.165200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0af096f2-51ae-484d-8439-905643969389 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:34.170466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0af096f2-51ae-484d-8439-905643969389 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:34.171650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0af096f2-51ae-484d-8439-905643969389 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:34.190745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5bf55162-a1e8-4234-9834-8a24718792ad tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:34.200143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5bf55162-a1e8-4234-9834-8a24718792ad tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:34.201782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5bf55162-a1e8-4234-9834-8a24718792ad tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:34.203046 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5bf55162-a1e8-4234-9834-8a24718792ad tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.217337 Sep 06 11:04:34.203706 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1584/3166] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:33 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:34.304248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0af096f2-51ae-484d-8439-905643969389 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:34.314364 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0af096f2-51ae-484d-8439-905643969389 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1316 microversion: 2.1 time: 0.163937 Sep 06 11:04:34.315372 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1583/3167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:34 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:34.594917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6e80ac63-c82b-4fc8-bba6-e83c2b6b7516 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:34.596287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6e80ac63-c82b-4fc8-bba6-e83c2b6b7516 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: fc46dc01-cd54-44a1-a379-0b0f8ff43991] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:34.603608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e80ac63-c82b-4fc8-bba6-e83c2b6b7516 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:34.604134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e80ac63-c82b-4fc8-bba6-e83c2b6b7516 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:34.604639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e80ac63-c82b-4fc8-bba6-e83c2b6b7516 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:34.605350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e80ac63-c82b-4fc8-bba6-e83c2b6b7516 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:34.605918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e80ac63-c82b-4fc8-bba6-e83c2b6b7516 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:34.606356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e80ac63-c82b-4fc8-bba6-e83c2b6b7516 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:34.620051 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-6e80ac63-c82b-4fc8-bba6-e83c2b6b7516 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] HTTP exception thrown: Instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 could not be found. Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6e80ac63-c82b-4fc8-bba6-e83c2b6b7516 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Request method failure captured: Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 HTTP/1.1 Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyggiVGcEIOZAn3rsfB9ZJuhzgMAc4xHuGANTDtl4bhidO9S8CXVHNJGyQ1HxyHBQtXWuiiUncTVP6-qsBg5uwWdFT8nEvCGty2c1XbSTNKRGJkQEg8H4AlTz_Gl4UfRAG-pvTa_ZQxBWb0Abuie6GI_dvl1yHOiDUIVPvYSkbuus2Q Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2a1f6f54c8d24eaa9eae09e8f30c56f1 Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-MigrationsAdminTest-412478146 Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}] Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-MigrationsAdminTest-412478146 Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2a1f6f54c8d24eaa9eae09e8f30c56f1 Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-MigrationsAdminTest-412478146 Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-MigrationsAdminTest-412478146-project Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3b6e2046e3bd40b3b46802dfa796260b Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-MigrationsAdminTest-412478146-project Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 could not be found. Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'fc46dc01-cd54-44a1-a379-0b0f8ff43991'} Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 could not be found. Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 could not be found. Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:34.621705 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:34.633137 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:34.633137 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:34.633137 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:34.633137 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:34.633137 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:34.633137 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 could not be found. Sep 06 11:04:34.633137 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:34.633137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6e80ac63-c82b-4fc8-bba6-e83c2b6b7516 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Returning 404 to user: Instance fc46dc01-cd54-44a1-a379-0b0f8ff43991 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:34.633137 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6e80ac63-c82b-4fc8-bba6-e83c2b6b7516 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991" status: 404 len: 111 microversion: 2.1 time: 0.032133 Sep 06 11:04:34.633137 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1585/3168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:34 2022] GET /compute/v2.1/servers/fc46dc01-cd54-44a1-a379-0b0f8ff43991 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:04:34.634098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dd0eedcc-64b4-4fc5-8a58-c5f9f5c74f21 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:34.634617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dd0eedcc-64b4-4fc5-8a58-c5f9f5c74f21 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:34.644243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd0eedcc-64b4-4fc5-8a58-c5f9f5c74f21 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:34.644749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd0eedcc-64b4-4fc5-8a58-c5f9f5c74f21 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:34.645198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd0eedcc-64b4-4fc5-8a58-c5f9f5c74f21 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:34.645983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd0eedcc-64b4-4fc5-8a58-c5f9f5c74f21 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:34.646458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd0eedcc-64b4-4fc5-8a58-c5f9f5c74f21 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:34.646892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd0eedcc-64b4-4fc5-8a58-c5f9f5c74f21 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:34.673959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dd0eedcc-64b4-4fc5-8a58-c5f9f5c74f21 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:04:34.686891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8143eb3f-3081-4f9d-9319-cfd2d941e285 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:34.687845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8143eb3f-3081-4f9d-9319-cfd2d941e285 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:34.694748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8143eb3f-3081-4f9d-9319-cfd2d941e285 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:34.707792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8143eb3f-3081-4f9d-9319-cfd2d941e285 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:34.707792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8143eb3f-3081-4f9d-9319-cfd2d941e285 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:34.707792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8143eb3f-3081-4f9d-9319-cfd2d941e285 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:34.707792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8143eb3f-3081-4f9d-9319-cfd2d941e285 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:34.707792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8143eb3f-3081-4f9d-9319-cfd2d941e285 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:34.845788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8143eb3f-3081-4f9d-9319-cfd2d941e285 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:34.853718 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8143eb3f-3081-4f9d-9319-cfd2d941e285 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1522 microversion: 2.1 time: 0.173107 Sep 06 11:04:34.854291 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1586/3169] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:34 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:34.879389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c8377aae-960b-4422-a0fa-ba996ce5babc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:34.880559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c8377aae-960b-4422-a0fa-ba996ce5babc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:34.886970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8377aae-960b-4422-a0fa-ba996ce5babc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:34.890694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8377aae-960b-4422-a0fa-ba996ce5babc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:34.890694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8377aae-960b-4422-a0fa-ba996ce5babc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:34.890694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8377aae-960b-4422-a0fa-ba996ce5babc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:34.890694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8377aae-960b-4422-a0fa-ba996ce5babc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:34.890694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8377aae-960b-4422-a0fa-ba996ce5babc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:35.019729 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dd0eedcc-64b4-4fc5-8a58-c5f9f5c74f21 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 204 len: 0 microversion: 2.1 time: 0.390043 Sep 06 11:04:35.020707 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1584/3170] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:04:34 2022] DELETE /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:04:35.029339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d30e8c05-5c8f-4350-96df-e71249a7e683 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:35.030107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d30e8c05-5c8f-4350-96df-e71249a7e683 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:35.037485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d30e8c05-5c8f-4350-96df-e71249a7e683 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:35.037985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d30e8c05-5c8f-4350-96df-e71249a7e683 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:35.038658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d30e8c05-5c8f-4350-96df-e71249a7e683 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:35.039407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d30e8c05-5c8f-4350-96df-e71249a7e683 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:35.039879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d30e8c05-5c8f-4350-96df-e71249a7e683 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:35.040318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d30e8c05-5c8f-4350-96df-e71249a7e683 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:35.054582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c8377aae-960b-4422-a0fa-ba996ce5babc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:35.063306 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c8377aae-960b-4422-a0fa-ba996ce5babc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.188169 Sep 06 11:04:35.064775 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1587/3171] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:34 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:35.203664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d30e8c05-5c8f-4350-96df-e71249a7e683 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:35.206734 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d30e8c05-5c8f-4350-96df-e71249a7e683 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1469 microversion: 2.1 time: 0.181631 Sep 06 11:04:35.207770 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1585/3172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:35 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:35.232787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c2475669-305b-4463-82ed-0010ea289fce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:35.235520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c2475669-305b-4463-82ed-0010ea289fce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:35.242497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2475669-305b-4463-82ed-0010ea289fce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:35.243378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2475669-305b-4463-82ed-0010ea289fce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:35.243842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2475669-305b-4463-82ed-0010ea289fce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:35.244595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2475669-305b-4463-82ed-0010ea289fce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:35.245276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2475669-305b-4463-82ed-0010ea289fce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:35.245706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2475669-305b-4463-82ed-0010ea289fce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:35.251244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:35.336728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-02fa88b9-afe4-444a-ae6f-cc21425018ed tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:35.337383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-02fa88b9-afe4-444a-ae6f-cc21425018ed tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:35.347138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02fa88b9-afe4-444a-ae6f-cc21425018ed tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:35.347894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02fa88b9-afe4-444a-ae6f-cc21425018ed tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:35.348537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02fa88b9-afe4-444a-ae6f-cc21425018ed tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:35.349437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02fa88b9-afe4-444a-ae6f-cc21425018ed tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:35.350071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02fa88b9-afe4-444a-ae6f-cc21425018ed tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:35.350667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02fa88b9-afe4-444a-ae6f-cc21425018ed tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:35.839138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c2475669-305b-4463-82ed-0010ea289fce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:35.854385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c2475669-305b-4463-82ed-0010ea289fce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:35.857688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c2475669-305b-4463-82ed-0010ea289fce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:35.860203 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c2475669-305b-4463-82ed-0010ea289fce tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.633860 Sep 06 11:04:35.861379 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1588/3173] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:35 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:35.866970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-02fa88b9-afe4-444a-ae6f-cc21425018ed tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:35.876742 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-02fa88b9-afe4-444a-ae6f-cc21425018ed tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1316 microversion: 2.1 time: 0.543858 Sep 06 11:04:35.879716 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1586/3174] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:35 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:35.881948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-e598ce52-18d2-4e09-9bde-73ddbc325968 req-2a8c6f4e-d009-44f8-af53-23d0953414b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-plugged", "status": "completed", "tag": "ec288bce-0ab7-40a2-81eb-874eab5b26e6"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:35.883334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-af7a4e26-8139-40ef-a984-7e6577aa88dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:35.884106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-af7a4e26-8139-40ef-a984-7e6577aa88dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:35.891306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af7a4e26-8139-40ef-a984-7e6577aa88dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:35.892637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af7a4e26-8139-40ef-a984-7e6577aa88dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:35.893373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af7a4e26-8139-40ef-a984-7e6577aa88dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:35.894260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af7a4e26-8139-40ef-a984-7e6577aa88dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:35.894881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af7a4e26-8139-40ef-a984-7e6577aa88dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:35.895607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af7a4e26-8139-40ef-a984-7e6577aa88dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:35.903966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e598ce52-18d2-4e09-9bde-73ddbc325968 req-2a8c6f4e-d009-44f8-af53-23d0953414b0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:35.905183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e598ce52-18d2-4e09-9bde-73ddbc325968 req-2a8c6f4e-d009-44f8-af53-23d0953414b0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:35.905183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e598ce52-18d2-4e09-9bde-73ddbc325968 req-2a8c6f4e-d009-44f8-af53-23d0953414b0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:35.922505 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-e598ce52-18d2-4e09-9bde-73ddbc325968 req-2a8c6f4e-d009-44f8-af53-23d0953414b0 service nova] Creating event network-vif-plugged:ec288bce-0ab7-40a2-81eb-874eab5b26e6 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:35.928698 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-e598ce52-18d2-4e09-9bde-73ddbc325968 req-2a8c6f4e-d009-44f8-af53-23d0953414b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065411 Sep 06 11:04:35.929940 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1589/3175] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:36.061825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af7a4e26-8139-40ef-a984-7e6577aa88dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:36.070005 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-af7a4e26-8139-40ef-a984-7e6577aa88dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1522 microversion: 2.1 time: 0.191352 Sep 06 11:04:36.070587 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1587/3176] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:35 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:36.088249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8950490e-c452-4e0b-81de-837f693d17ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:36.088956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8950490e-c452-4e0b-81de-837f693d17ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:36.096205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8950490e-c452-4e0b-81de-837f693d17ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:36.096692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8950490e-c452-4e0b-81de-837f693d17ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:36.097139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8950490e-c452-4e0b-81de-837f693d17ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:36.097974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8950490e-c452-4e0b-81de-837f693d17ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:36.098451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8950490e-c452-4e0b-81de-837f693d17ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:36.098866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8950490e-c452-4e0b-81de-837f693d17ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:36.233122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5e31ad26-9894-44e6-93bb-521548d948ad tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:36.233869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5e31ad26-9894-44e6-93bb-521548d948ad tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:36.245286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e31ad26-9894-44e6-93bb-521548d948ad tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:36.245703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e31ad26-9894-44e6-93bb-521548d948ad tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:36.246150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e31ad26-9894-44e6-93bb-521548d948ad tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:36.246890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e31ad26-9894-44e6-93bb-521548d948ad tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:36.247635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e31ad26-9894-44e6-93bb-521548d948ad tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:36.248074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e31ad26-9894-44e6-93bb-521548d948ad tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:36.272990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8950490e-c452-4e0b-81de-837f693d17ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:36.286327 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8950490e-c452-4e0b-81de-837f693d17ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.202291 Sep 06 11:04:36.290203 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1590/3177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:36 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:36.540249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5e31ad26-9894-44e6-93bb-521548d948ad tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:36.554910 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5e31ad26-9894-44e6-93bb-521548d948ad tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1469 microversion: 2.1 time: 0.328127 Sep 06 11:04:36.556208 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1588/3178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:36 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1469 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:36.896801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-79a1c245-3271-43b8-9378-c02e14d7f363 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:36.898453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-79a1c245-3271-43b8-9378-c02e14d7f363 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:36.906147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-42c87463-1386-4af4-ace7-09f55d46db75 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:36.907267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-42c87463-1386-4af4-ace7-09f55d46db75 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:36.916628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79a1c245-3271-43b8-9378-c02e14d7f363 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:36.917369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79a1c245-3271-43b8-9378-c02e14d7f363 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:36.918357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79a1c245-3271-43b8-9378-c02e14d7f363 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:36.919301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79a1c245-3271-43b8-9378-c02e14d7f363 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:36.919948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79a1c245-3271-43b8-9378-c02e14d7f363 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:36.920753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79a1c245-3271-43b8-9378-c02e14d7f363 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:36.931631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42c87463-1386-4af4-ace7-09f55d46db75 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:36.934902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42c87463-1386-4af4-ace7-09f55d46db75 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:36.936578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42c87463-1386-4af4-ace7-09f55d46db75 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:36.938504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42c87463-1386-4af4-ace7-09f55d46db75 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:36.939814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42c87463-1386-4af4-ace7-09f55d46db75 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:36.941460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42c87463-1386-4af4-ace7-09f55d46db75 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:37.325443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-42c87463-1386-4af4-ace7-09f55d46db75 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:37.338666 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-42c87463-1386-4af4-ace7-09f55d46db75 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1316 microversion: 2.1 time: 0.440602 Sep 06 11:04:37.343174 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1589/3179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:36 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:37.349378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2a1d59f8-a955-41c1-9f3b-2d0694c0e5ef tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:37.351332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2a1d59f8-a955-41c1-9f3b-2d0694c0e5ef tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:37.362612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-79a1c245-3271-43b8-9378-c02e14d7f363 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:37.369789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a1d59f8-a955-41c1-9f3b-2d0694c0e5ef tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:37.373806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a1d59f8-a955-41c1-9f3b-2d0694c0e5ef tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:37.373806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a1d59f8-a955-41c1-9f3b-2d0694c0e5ef tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:37.373806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a1d59f8-a955-41c1-9f3b-2d0694c0e5ef tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:37.375591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a1d59f8-a955-41c1-9f3b-2d0694c0e5ef tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:37.377993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a1d59f8-a955-41c1-9f3b-2d0694c0e5ef tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:37.386799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-79a1c245-3271-43b8-9378-c02e14d7f363 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:37.399432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-79a1c245-3271-43b8-9378-c02e14d7f363 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:37.402263 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-79a1c245-3271-43b8-9378-c02e14d7f363 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.514198 Sep 06 11:04:37.402841 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1591/3180] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:36 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:37.416362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-4ad0afae-5963-4043-85c2-364b160dabb0 req-147e28e5-74d0-4df5-afb8-28627204fe44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6acc0bc9-8746-46d4-b4bb-54029da58446", "name": "network-vif-deleted", "tag": "75a4b9ec-0116-4843-8da2-96eb38ec81a3"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:37.428659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4ad0afae-5963-4043-85c2-364b160dabb0 req-147e28e5-74d0-4df5-afb8-28627204fe44 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:37.429224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4ad0afae-5963-4043-85c2-364b160dabb0 req-147e28e5-74d0-4df5-afb8-28627204fe44 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:37.429733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4ad0afae-5963-4043-85c2-364b160dabb0 req-147e28e5-74d0-4df5-afb8-28627204fe44 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:37.442753 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-4ad0afae-5963-4043-85c2-364b160dabb0 req-147e28e5-74d0-4df5-afb8-28627204fe44 service nova] Creating event network-vif-deleted:75a4b9ec-0116-4843-8da2-96eb38ec81a3 for instance 6acc0bc9-8746-46d4-b4bb-54029da58446 on nch1-master-1 Sep 06 11:04:37.448946 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-4ad0afae-5963-4043-85c2-364b160dabb0 req-147e28e5-74d0-4df5-afb8-28627204fe44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043305 Sep 06 11:04:37.454960 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1592/3181] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:37.457392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f7104f2-5ad6-4611-b7aa-8bcecd376c5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:37.458493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7f7104f2-5ad6-4611-b7aa-8bcecd376c5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:37.471881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f7104f2-5ad6-4611-b7aa-8bcecd376c5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:37.472546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f7104f2-5ad6-4611-b7aa-8bcecd376c5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:37.500117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f7104f2-5ad6-4611-b7aa-8bcecd376c5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:37.501813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f7104f2-5ad6-4611-b7aa-8bcecd376c5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:37.513795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f7104f2-5ad6-4611-b7aa-8bcecd376c5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:37.514491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f7104f2-5ad6-4611-b7aa-8bcecd376c5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:37.566078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2a1d59f8-a955-41c1-9f3b-2d0694c0e5ef tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:37.577747 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2a1d59f8-a955-41c1-9f3b-2d0694c0e5ef tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1522 microversion: 2.1 time: 0.233090 Sep 06 11:04:37.578348 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1590/3182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:37 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:37.597638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1db6598d-5125-479d-bcfb-12a2064d457a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:37.598281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1db6598d-5125-479d-bcfb-12a2064d457a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:37.612280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1db6598d-5125-479d-bcfb-12a2064d457a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:37.612795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1db6598d-5125-479d-bcfb-12a2064d457a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:37.613252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1db6598d-5125-479d-bcfb-12a2064d457a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:37.613980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1db6598d-5125-479d-bcfb-12a2064d457a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:37.620983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1db6598d-5125-479d-bcfb-12a2064d457a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:37.622160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1db6598d-5125-479d-bcfb-12a2064d457a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:37.802729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1db6598d-5125-479d-bcfb-12a2064d457a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b6e2046e3bd40b3b46802dfa796260b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:37.810715 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1db6598d-5125-479d-bcfb-12a2064d457a tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 200 len: 1298 microversion: 2.1 time: 0.226507 Sep 06 11:04:37.811346 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1591/3183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:37 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 1298 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:37.814743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f7104f2-5ad6-4611-b7aa-8bcecd376c5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:37.823027 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7f7104f2-5ad6-4611-b7aa-8bcecd376c5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.371935 Sep 06 11:04:37.823598 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1593/3184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:37 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:37.962977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-964c857d-9f42-4925-9059-3144ab60ab31 req-3d4820e6-7e4a-4659-af7d-9b7a77123054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e167a8-c716-47ad-aa17-6ea18b4e9139", "name": "network-vif-plugged", "status": "completed", "tag": "8b55451f-3f5a-4377-923b-95e9928d1a17"}, {"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-plugged", "status": "completed", "tag": "cbcd40f2-ac60-4973-9209-912e9fcab7d2"}, {"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-plugged", "status": "completed", "tag": "6091afbd-6e3a-48d4-9bd0-a35e1dc72ec0"}, {"server_uuid": "b75d677b-b25f-42b2-8d2e-810a8f3a90de", "name": "network-vif-plugged", "status": "completed", "tag": "3d7f7080-5bc6-4c22-b3b2-50680793ae44"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:37.977223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-964c857d-9f42-4925-9059-3144ab60ab31 req-3d4820e6-7e4a-4659-af7d-9b7a77123054 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:37.977812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-964c857d-9f42-4925-9059-3144ab60ab31 req-3d4820e6-7e4a-4659-af7d-9b7a77123054 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:37.978523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-964c857d-9f42-4925-9059-3144ab60ab31 req-3d4820e6-7e4a-4659-af7d-9b7a77123054 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:38.009866 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-964c857d-9f42-4925-9059-3144ab60ab31 req-3d4820e6-7e4a-4659-af7d-9b7a77123054 service nova] Creating event network-vif-plugged:8b55451f-3f5a-4377-923b-95e9928d1a17 for instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 on nch2-master-1 Sep 06 11:04:38.010467 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-964c857d-9f42-4925-9059-3144ab60ab31 req-3d4820e6-7e4a-4659-af7d-9b7a77123054 service nova] Creating event network-vif-plugged:cbcd40f2-ac60-4973-9209-912e9fcab7d2 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:38.011214 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-964c857d-9f42-4925-9059-3144ab60ab31 req-3d4820e6-7e4a-4659-af7d-9b7a77123054 service nova] Creating event network-vif-plugged:6091afbd-6e3a-48d4-9bd0-a35e1dc72ec0 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:38.012327 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-964c857d-9f42-4925-9059-3144ab60ab31 req-3d4820e6-7e4a-4659-af7d-9b7a77123054 service nova] Creating event network-vif-plugged:3d7f7080-5bc6-4c22-b3b2-50680793ae44 for instance b75d677b-b25f-42b2-8d2e-810a8f3a90de on nch1-master-1 Sep 06 11:04:38.024316 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-964c857d-9f42-4925-9059-3144ab60ab31 req-3d4820e6-7e4a-4659-af7d-9b7a77123054 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.071607 Sep 06 11:04:38.025139 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1592/3185] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:38.367614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-19c42e32-d9f3-4e0c-9ef7-5b58e8740e20 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:38.368417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-19c42e32-d9f3-4e0c-9ef7-5b58e8740e20 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:38.375260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19c42e32-d9f3-4e0c-9ef7-5b58e8740e20 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:38.377029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19c42e32-d9f3-4e0c-9ef7-5b58e8740e20 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:38.377485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19c42e32-d9f3-4e0c-9ef7-5b58e8740e20 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:38.378386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19c42e32-d9f3-4e0c-9ef7-5b58e8740e20 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:38.378835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19c42e32-d9f3-4e0c-9ef7-5b58e8740e20 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:38.379319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19c42e32-d9f3-4e0c-9ef7-5b58e8740e20 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:38.432907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c1e34ca4-15bd-4e72-89d5-3c885166426b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:38.433739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c1e34ca4-15bd-4e72-89d5-3c885166426b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:38.441019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1e34ca4-15bd-4e72-89d5-3c885166426b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:38.441956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1e34ca4-15bd-4e72-89d5-3c885166426b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:38.442805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1e34ca4-15bd-4e72-89d5-3c885166426b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:38.443738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1e34ca4-15bd-4e72-89d5-3c885166426b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:38.444717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1e34ca4-15bd-4e72-89d5-3c885166426b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:38.451622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1e34ca4-15bd-4e72-89d5-3c885166426b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:38.630289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19c42e32-d9f3-4e0c-9ef7-5b58e8740e20 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:38.639700 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-19c42e32-d9f3-4e0c-9ef7-5b58e8740e20 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1316 microversion: 2.1 time: 0.276214 Sep 06 11:04:38.640349 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1594/3186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:38 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:38.645217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ddcae070-3332-4928-8897-98aa90482db5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:38.645824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ddcae070-3332-4928-8897-98aa90482db5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:38.652127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddcae070-3332-4928-8897-98aa90482db5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:38.652815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddcae070-3332-4928-8897-98aa90482db5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:38.653446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddcae070-3332-4928-8897-98aa90482db5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:38.654308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddcae070-3332-4928-8897-98aa90482db5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:38.654927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddcae070-3332-4928-8897-98aa90482db5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:38.655575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddcae070-3332-4928-8897-98aa90482db5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:38.693874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c1e34ca4-15bd-4e72-89d5-3c885166426b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:38.704124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c1e34ca4-15bd-4e72-89d5-3c885166426b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:38.705948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c1e34ca4-15bd-4e72-89d5-3c885166426b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:38.707177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c1e34ca4-15bd-4e72-89d5-3c885166426b tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.279832 Sep 06 11:04:38.707786 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1593/3187] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:38 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:04:38.801071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ddcae070-3332-4928-8897-98aa90482db5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:38.812315 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ddcae070-3332-4928-8897-98aa90482db5 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1522 microversion: 2.1 time: 0.167595 Sep 06 11:04:38.812315 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1595/3188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:38 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:38.834165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9f93ac7f-1177-4b99-a0d2-87fbb7425307 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:38.834813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9f93ac7f-1177-4b99-a0d2-87fbb7425307 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] [instance: 6acc0bc9-8746-46d4-b4bb-54029da58446] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:38.840931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f93ac7f-1177-4b99-a0d2-87fbb7425307 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:38.841423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f93ac7f-1177-4b99-a0d2-87fbb7425307 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:38.841864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f93ac7f-1177-4b99-a0d2-87fbb7425307 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:38.842779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f93ac7f-1177-4b99-a0d2-87fbb7425307 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:38.843434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f93ac7f-1177-4b99-a0d2-87fbb7425307 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:38.844028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f93ac7f-1177-4b99-a0d2-87fbb7425307 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:38.848095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f81c0a33-6cd2-4a51-be8e-a75173c5d047 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:38.849373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f81c0a33-6cd2-4a51-be8e-a75173c5d047 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:38.855360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f81c0a33-6cd2-4a51-be8e-a75173c5d047 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:38.855860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f81c0a33-6cd2-4a51-be8e-a75173c5d047 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:38.856457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f81c0a33-6cd2-4a51-be8e-a75173c5d047 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:38.857320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f81c0a33-6cd2-4a51-be8e-a75173c5d047 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:38.857792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f81c0a33-6cd2-4a51-be8e-a75173c5d047 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:38.858229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f81c0a33-6cd2-4a51-be8e-a75173c5d047 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:38.859182 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-9f93ac7f-1177-4b99-a0d2-87fbb7425307 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] HTTP exception thrown: Instance 6acc0bc9-8746-46d4-b4bb-54029da58446 could not be found. Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9f93ac7f-1177-4b99-a0d2-87fbb7425307 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Request method failure captured: Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 HTTP/1.1 Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyggiVGcEIOZAn3rsfB9ZJuhzgMAc4xHuGANTDtl4bhidO9S8CXVHNJGyQ1HxyHBQtXWuiiUncTVP6-qsBg5uwWdFT8nEvCGty2c1XbSTNKRGJkQEg8H4AlTz_Gl4UfRAG-pvTa_ZQxBWb0Abuie6GI_dvl1yHOiDUIVPvYSkbuus2Q Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 2a1f6f54c8d24eaa9eae09e8f30c56f1 Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-MigrationsAdminTest-412478146 Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a1f6f54c8d24eaa9eae09e8f30c56f1"}]}] Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-MigrationsAdminTest-412478146 Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 2a1f6f54c8d24eaa9eae09e8f30c56f1 Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-MigrationsAdminTest-412478146 Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-MigrationsAdminTest-412478146-project Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3b6e2046e3bd40b3b46802dfa796260b Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-MigrationsAdminTest-412478146-project Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 6acc0bc9-8746-46d4-b4bb-54029da58446 could not be found. Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '6acc0bc9-8746-46d4-b4bb-54029da58446'} Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6acc0bc9-8746-46d4-b4bb-54029da58446 could not be found. Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6acc0bc9-8746-46d4-b4bb-54029da58446 could not be found. Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:38.860959 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:38.865637 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:38.865637 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:38.865637 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:38.865637 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:38.865637 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:38.865637 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6acc0bc9-8746-46d4-b4bb-54029da58446 could not be found. Sep 06 11:04:38.865637 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:04:38.865637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9f93ac7f-1177-4b99-a0d2-87fbb7425307 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] Returning 404 to user: Instance 6acc0bc9-8746-46d4-b4bb-54029da58446 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:38.865637 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9f93ac7f-1177-4b99-a0d2-87fbb7425307 tempest-MigrationsAdminTest-412478146 tempest-MigrationsAdminTest-412478146-project] 10.222.0.20 "GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446" status: 404 len: 111 microversion: 2.1 time: 0.032450 Sep 06 11:04:38.865637 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1594/3189] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:38 2022] GET /compute/v2.1/servers/6acc0bc9-8746-46d4-b4bb-54029da58446 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:04:39.007130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f81c0a33-6cd2-4a51-be8e-a75173c5d047 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:39.015412 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f81c0a33-6cd2-4a51-be8e-a75173c5d047 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1655 microversion: 2.1 time: 0.172071 Sep 06 11:04:39.016000 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1596/3190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:38 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1655 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:39.045532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a0abdd16-7412-4ba6-84df-4b0970b11053 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:39.051839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0abdd16-7412-4ba6-84df-4b0970b11053 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:39.052326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0abdd16-7412-4ba6-84df-4b0970b11053 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:39.052802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0abdd16-7412-4ba6-84df-4b0970b11053 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:39.076622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a0abdd16-7412-4ba6-84df-4b0970b11053 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Going to try to start instance {{(pid=140875) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 11:04:39.306583 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a0abdd16-7412-4ba6-84df-4b0970b11053 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.264893 Sep 06 11:04:39.307475 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1595/3191] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:39 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:04:39.316235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4a9c35f6-ef53-4db5-b650-8540f503a68f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:39.316966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4a9c35f6-ef53-4db5-b650-8540f503a68f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:39.325017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a9c35f6-ef53-4db5-b650-8540f503a68f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:39.325017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a9c35f6-ef53-4db5-b650-8540f503a68f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:39.325017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a9c35f6-ef53-4db5-b650-8540f503a68f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:39.325017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a9c35f6-ef53-4db5-b650-8540f503a68f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:39.325371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a9c35f6-ef53-4db5-b650-8540f503a68f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:39.325618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a9c35f6-ef53-4db5-b650-8540f503a68f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:39.489749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4a9c35f6-ef53-4db5-b650-8540f503a68f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:39.498070 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4a9c35f6-ef53-4db5-b650-8540f503a68f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1664 microversion: 2.1 time: 0.186379 Sep 06 11:04:39.498662 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1597/3192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:39 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1664 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:39.669738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ee4d2993-cdb8-4c4b-86c1-420ddd20eddb tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:39.670576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ee4d2993-cdb8-4c4b-86c1-420ddd20eddb tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:39.680942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee4d2993-cdb8-4c4b-86c1-420ddd20eddb tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:39.683315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee4d2993-cdb8-4c4b-86c1-420ddd20eddb tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:39.683865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee4d2993-cdb8-4c4b-86c1-420ddd20eddb tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:39.689685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee4d2993-cdb8-4c4b-86c1-420ddd20eddb tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:39.690421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee4d2993-cdb8-4c4b-86c1-420ddd20eddb tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:39.691100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee4d2993-cdb8-4c4b-86c1-420ddd20eddb tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:39.699403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:39.735227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6e99589a-0c7e-49d4-bd03-bd725d7f51bf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:39.736052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6e99589a-0c7e-49d4-bd03-bd725d7f51bf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:39.753638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e99589a-0c7e-49d4-bd03-bd725d7f51bf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:39.754385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e99589a-0c7e-49d4-bd03-bd725d7f51bf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:39.755137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e99589a-0c7e-49d4-bd03-bd725d7f51bf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:39.756079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e99589a-0c7e-49d4-bd03-bd725d7f51bf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:39.756735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e99589a-0c7e-49d4-bd03-bd725d7f51bf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:39.757677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e99589a-0c7e-49d4-bd03-bd725d7f51bf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:40.179097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ee4d2993-cdb8-4c4b-86c1-420ddd20eddb tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:40.187143 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ee4d2993-cdb8-4c4b-86c1-420ddd20eddb tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1316 microversion: 2.1 time: 0.528273 Sep 06 11:04:40.187758 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1596/3193] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:39 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:40.205023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b14bc713-821b-4b7e-913a-a6549f1d0aeb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:40.205023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b14bc713-821b-4b7e-913a-a6549f1d0aeb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:40.206710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6e99589a-0c7e-49d4-bd03-bd725d7f51bf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:40.211192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b14bc713-821b-4b7e-913a-a6549f1d0aeb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:40.211691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b14bc713-821b-4b7e-913a-a6549f1d0aeb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:40.212141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b14bc713-821b-4b7e-913a-a6549f1d0aeb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:40.212857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b14bc713-821b-4b7e-913a-a6549f1d0aeb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:40.213364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b14bc713-821b-4b7e-913a-a6549f1d0aeb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:40.213800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b14bc713-821b-4b7e-913a-a6549f1d0aeb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:40.221310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6e99589a-0c7e-49d4-bd03-bd725d7f51bf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:40.223444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6e99589a-0c7e-49d4-bd03-bd725d7f51bf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:40.227917 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6e99589a-0c7e-49d4-bd03-bd725d7f51bf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.494651 Sep 06 11:04:40.244317 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1598/3194] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:39 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:40.253504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-ac70f153-3615-4494-8e66-5b44454bda25 req-99a059c3-bdc6-4e64-8532-78fca2def44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-plugged", "status": "completed", "tag": "049445db-4d1a-414d-a121-813328072bfc"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:40.266209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ac70f153-3615-4494-8e66-5b44454bda25 req-99a059c3-bdc6-4e64-8532-78fca2def44c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:40.266730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ac70f153-3615-4494-8e66-5b44454bda25 req-99a059c3-bdc6-4e64-8532-78fca2def44c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:40.267194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ac70f153-3615-4494-8e66-5b44454bda25 req-99a059c3-bdc6-4e64-8532-78fca2def44c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:40.286647 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-ac70f153-3615-4494-8e66-5b44454bda25 req-99a059c3-bdc6-4e64-8532-78fca2def44c service nova] Creating event network-vif-plugged:049445db-4d1a-414d-a121-813328072bfc for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:40.293480 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-ac70f153-3615-4494-8e66-5b44454bda25 req-99a059c3-bdc6-4e64-8532-78fca2def44c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047193 Sep 06 11:04:40.294260 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1599/3195] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:40.459203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b14bc713-821b-4b7e-913a-a6549f1d0aeb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:40.469832 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b14bc713-821b-4b7e-913a-a6549f1d0aeb tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1507 microversion: 2.1 time: 0.280805 Sep 06 11:04:40.480836 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1597/3196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:40 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:40.494053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1dfba73e-b8ca-45ef-98af-0ef0e5a4656c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:40.495359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1dfba73e-b8ca-45ef-98af-0ef0e5a4656c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:40.503670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dfba73e-b8ca-45ef-98af-0ef0e5a4656c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:40.508996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dfba73e-b8ca-45ef-98af-0ef0e5a4656c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:40.508996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dfba73e-b8ca-45ef-98af-0ef0e5a4656c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:40.508996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dfba73e-b8ca-45ef-98af-0ef0e5a4656c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:40.508996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dfba73e-b8ca-45ef-98af-0ef0e5a4656c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:40.508996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dfba73e-b8ca-45ef-98af-0ef0e5a4656c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:40.522525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-95338acd-5244-4f62-98c5-e140cfa30566 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:40.523551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-95338acd-5244-4f62-98c5-e140cfa30566 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:40.530865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95338acd-5244-4f62-98c5-e140cfa30566 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:40.531647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95338acd-5244-4f62-98c5-e140cfa30566 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:40.532923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95338acd-5244-4f62-98c5-e140cfa30566 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:40.533998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95338acd-5244-4f62-98c5-e140cfa30566 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:40.534683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95338acd-5244-4f62-98c5-e140cfa30566 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:40.535519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95338acd-5244-4f62-98c5-e140cfa30566 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:40.803941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1dfba73e-b8ca-45ef-98af-0ef0e5a4656c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:40.812622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-95338acd-5244-4f62-98c5-e140cfa30566 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:40.817744 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1dfba73e-b8ca-45ef-98af-0ef0e5a4656c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 200 len: 1507 microversion: 2.1 time: 0.327947 Sep 06 11:04:40.818749 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1600/3197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:40 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:40.822033 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-95338acd-5244-4f62-98c5-e140cfa30566 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1664 microversion: 2.1 time: 0.304176 Sep 06 11:04:40.822609 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1598/3198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:40 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1664 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:40.841976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6c896dac-21f9-49ae-a657-456eeb902d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:40.842520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6c896dac-21f9-49ae-a657-456eeb902d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:40.849437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c896dac-21f9-49ae-a657-456eeb902d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:40.849921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c896dac-21f9-49ae-a657-456eeb902d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:40.850362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c896dac-21f9-49ae-a657-456eeb902d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:40.851146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c896dac-21f9-49ae-a657-456eeb902d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:40.851569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c896dac-21f9-49ae-a657-456eeb902d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:40.851998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c896dac-21f9-49ae-a657-456eeb902d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:40.879525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6c896dac-21f9-49ae-a657-456eeb902d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:04:41.211635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1a76311c-d5b5-4aec-bf18-86675ff3ab83 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:41.212266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1a76311c-d5b5-4aec-bf18-86675ff3ab83 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:41.218599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a76311c-d5b5-4aec-bf18-86675ff3ab83 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:41.219124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a76311c-d5b5-4aec-bf18-86675ff3ab83 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:41.219579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a76311c-d5b5-4aec-bf18-86675ff3ab83 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:41.220903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a76311c-d5b5-4aec-bf18-86675ff3ab83 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:41.221378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a76311c-d5b5-4aec-bf18-86675ff3ab83 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:41.221965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a76311c-d5b5-4aec-bf18-86675ff3ab83 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:41.264672 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6c896dac-21f9-49ae-a657-456eeb902d91 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "DELETE /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 204 len: 0 microversion: 2.1 time: 0.426960 Sep 06 11:04:41.265249 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1601/3199] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:04:40 2022] DELETE /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:04:41.275524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b3259bce-4f4e-4233-b75e-fd33b419afd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:41.276252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b3259bce-4f4e-4233-b75e-fd33b419afd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:41.287795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3259bce-4f4e-4233-b75e-fd33b419afd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:41.292698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3259bce-4f4e-4233-b75e-fd33b419afd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:41.292698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3259bce-4f4e-4233-b75e-fd33b419afd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:41.293354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3259bce-4f4e-4233-b75e-fd33b419afd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:41.293837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3259bce-4f4e-4233-b75e-fd33b419afd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:41.294279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3259bce-4f4e-4233-b75e-fd33b419afd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:41.436750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1a76311c-d5b5-4aec-bf18-86675ff3ab83 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:41.454953 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1a76311c-d5b5-4aec-bf18-86675ff3ab83 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1505 microversion: 2.1 time: 0.246152 Sep 06 11:04:41.463710 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1599/3200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:41 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:41.477376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2041964399", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "2e14709a-777d-42eb-b577-4fb177f97dc8"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:41.552490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] validate_networks() for [('2e14709a-777d-42eb-b577-4fb177f97dc8', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:04:41.600122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b3259bce-4f4e-4233-b75e-fd33b419afd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:41.609678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b3259bce-4f4e-4233-b75e-fd33b419afd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:41.611239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b3259bce-4f4e-4233-b75e-fd33b419afd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:41.623036 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b3259bce-4f4e-4233-b75e-fd33b419afd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.342434 Sep 06 11:04:41.623036 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1602/3201] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:41 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:41.623036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-edc03d93-6007-43e7-903a-bf68fe5e7c4e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:41.623036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-edc03d93-6007-43e7-903a-bf68fe5e7c4e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:41.629399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edc03d93-6007-43e7-903a-bf68fe5e7c4e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:41.630167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edc03d93-6007-43e7-903a-bf68fe5e7c4e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:41.630835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edc03d93-6007-43e7-903a-bf68fe5e7c4e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:41.631859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edc03d93-6007-43e7-903a-bf68fe5e7c4e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:41.632845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edc03d93-6007-43e7-903a-bf68fe5e7c4e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:41.633348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edc03d93-6007-43e7-903a-bf68fe5e7c4e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:41.676685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-edc03d93-6007-43e7-903a-bf68fe5e7c4e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:41.676685 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-edc03d93-6007-43e7-903a-bf68fe5e7c4e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de/os-instance-actions/req-fc38be83-36a3-41a4-ba84-01a1cd434e47" status: 200 len: 313 microversion: 2.1 time: 0.052947 Sep 06 11:04:41.676685 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1603/3202] 10.222.0.20 () {58 vars in 1419 bytes} [Tue Sep 6 11:04:41 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de/os-instance-actions/req-fc38be83-36a3-41a4-ba84-01a1cd434e47 => generated 313 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:41.689391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6038adfb-02f2-47e1-b2a7-e6adc22268b2 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:41.691819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6038adfb-02f2-47e1-b2a7-e6adc22268b2 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:41.698425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6038adfb-02f2-47e1-b2a7-e6adc22268b2 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:41.698921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6038adfb-02f2-47e1-b2a7-e6adc22268b2 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:41.699449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6038adfb-02f2-47e1-b2a7-e6adc22268b2 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:41.700172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6038adfb-02f2-47e1-b2a7-e6adc22268b2 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:41.700641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6038adfb-02f2-47e1-b2a7-e6adc22268b2 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:41.701077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6038adfb-02f2-47e1-b2a7-e6adc22268b2 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:41.765150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:42.044888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:04:42.045413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:04:42.045792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:04:42.046211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:04:42.046655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:04:42.057257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:42.057687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:42.058132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:42.058873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:42.059443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:42.060070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:42.081538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Getting quotas for project 0e8540c8171e480b83fd68fbb5f159be. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:04:42.087320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Getting quotas for user 00e93a2f8ed643ba8bc92b4def1ce7f3 and project 0e8540c8171e480b83fd68fbb5f159be. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:04:42.090809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:42.102684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:04:42.105610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:04:42.120150 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6038adfb-02f2-47e1-b2a7-e6adc22268b2 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "POST /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de/action" status: 202 len: 0 microversion: 2.1 time: 0.442302 Sep 06 11:04:42.121024 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1604/3203] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:41 2022] POST /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:04:42.142804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ee783b12-adda-4637-b6e2-4162d115a222 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:42.142804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ee783b12-adda-4637-b6e2-4162d115a222 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:42.147978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee783b12-adda-4637-b6e2-4162d115a222 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:42.148742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee783b12-adda-4637-b6e2-4162d115a222 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:42.149199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee783b12-adda-4637-b6e2-4162d115a222 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:42.149925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee783b12-adda-4637-b6e2-4162d115a222 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:42.150446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee783b12-adda-4637-b6e2-4162d115a222 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:42.150888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee783b12-adda-4637-b6e2-4162d115a222 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:42.278847 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-31e7d38b-d000-4fbf-b445-f5fde54703d6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813647 Sep 06 11:04:42.279748 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1600/3204] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:04:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:04:42.296630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cd79f464-9b4d-4ab1-8726-9e06cbf640f8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:42.298708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cd79f464-9b4d-4ab1-8726-9e06cbf640f8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:42.313528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd79f464-9b4d-4ab1-8726-9e06cbf640f8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:42.314723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd79f464-9b4d-4ab1-8726-9e06cbf640f8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:42.315477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd79f464-9b4d-4ab1-8726-9e06cbf640f8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:42.316389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd79f464-9b4d-4ab1-8726-9e06cbf640f8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:42.317017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd79f464-9b4d-4ab1-8726-9e06cbf640f8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:42.317616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd79f464-9b4d-4ab1-8726-9e06cbf640f8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:42.332042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ee783b12-adda-4637-b6e2-4162d115a222 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:42.345122 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ee783b12-adda-4637-b6e2-4162d115a222 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.220717 Sep 06 11:04:42.346173 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1605/3205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:42 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:42.365891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26b3c61e-e387-40e2-9ceb-3aa7348a9036 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:42.370175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-26b3c61e-e387-40e2-9ceb-3aa7348a9036 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:42.517767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-26b3c61e-e387-40e2-9ceb-3aa7348a9036 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:42.524954 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-26b3c61e-e387-40e2-9ceb-3aa7348a9036 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1218 microversion: 2.1 time: 0.168731 Sep 06 11:04:42.525678 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1606/3206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:42 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:42.543487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6b7e802c-9d7f-4663-8929-bc6f43fd0f0e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:42.543487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6b7e802c-9d7f-4663-8929-bc6f43fd0f0e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:42.560667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b7e802c-9d7f-4663-8929-bc6f43fd0f0e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:42.561604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b7e802c-9d7f-4663-8929-bc6f43fd0f0e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:42.563266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b7e802c-9d7f-4663-8929-bc6f43fd0f0e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:42.563492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b7e802c-9d7f-4663-8929-bc6f43fd0f0e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:42.564819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b7e802c-9d7f-4663-8929-bc6f43fd0f0e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:42.565273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b7e802c-9d7f-4663-8929-bc6f43fd0f0e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:42.822852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cd79f464-9b4d-4ab1-8726-9e06cbf640f8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:42.832103 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cd79f464-9b4d-4ab1-8726-9e06cbf640f8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1507 microversion: 2.1 time: 0.548887 Sep 06 11:04:42.832909 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1601/3207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:42 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1507 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:42.866818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-30efe00a-be14-4768-ab45-1a9902a68c91 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:42.867491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-30efe00a-be14-4768-ab45-1a9902a68c91 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:42.877428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30efe00a-be14-4768-ab45-1a9902a68c91 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:42.878306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30efe00a-be14-4768-ab45-1a9902a68c91 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:42.878967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30efe00a-be14-4768-ab45-1a9902a68c91 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:42.884738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30efe00a-be14-4768-ab45-1a9902a68c91 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:42.884738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30efe00a-be14-4768-ab45-1a9902a68c91 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:42.884738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30efe00a-be14-4768-ab45-1a9902a68c91 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:42.899128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6b7e802c-9d7f-4663-8929-bc6f43fd0f0e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:42.913646 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6b7e802c-9d7f-4663-8929-bc6f43fd0f0e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.385296 Sep 06 11:04:42.923104 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1607/3208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:42 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:42.943589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e0c7a521-f3c3-44e4-a54c-59f0253a4bcc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:42.944255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e0c7a521-f3c3-44e4-a54c-59f0253a4bcc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:42.962506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0c7a521-f3c3-44e4-a54c-59f0253a4bcc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:42.971842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0c7a521-f3c3-44e4-a54c-59f0253a4bcc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:42.972419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0c7a521-f3c3-44e4-a54c-59f0253a4bcc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:42.973283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0c7a521-f3c3-44e4-a54c-59f0253a4bcc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:42.973862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0c7a521-f3c3-44e4-a54c-59f0253a4bcc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:42.976760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0c7a521-f3c3-44e4-a54c-59f0253a4bcc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:43.239862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-30efe00a-be14-4768-ab45-1a9902a68c91 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:43.256370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-30efe00a-be14-4768-ab45-1a9902a68c91 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:43.258936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-30efe00a-be14-4768-ab45-1a9902a68c91 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:43.263119 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-30efe00a-be14-4768-ab45-1a9902a68c91 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1880 microversion: 2.32 time: 0.414203 Sep 06 11:04:43.264674 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1602/3209] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:42 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1880 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:43.268962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e0c7a521-f3c3-44e4-a54c-59f0253a4bcc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Unlocking {{(pid=140876) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 06 11:04:43.488464 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e0c7a521-f3c3-44e4-a54c-59f0253a4bcc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.555363 Sep 06 11:04:43.489110 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1608/3210] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:42 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:04:43.506768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eae4132d-a399-489c-a4e7-9c6db236087c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:43.507730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-eae4132d-a399-489c-a4e7-9c6db236087c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:43.520574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eae4132d-a399-489c-a4e7-9c6db236087c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:43.522344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eae4132d-a399-489c-a4e7-9c6db236087c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:43.522973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eae4132d-a399-489c-a4e7-9c6db236087c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:43.524470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eae4132d-a399-489c-a4e7-9c6db236087c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:43.524984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eae4132d-a399-489c-a4e7-9c6db236087c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:43.526733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eae4132d-a399-489c-a4e7-9c6db236087c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:43.548933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-53327d7a-a30d-44e4-b626-31dda92c719d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:43.549555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-53327d7a-a30d-44e4-b626-31dda92c719d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:43.560244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-53327d7a-a30d-44e4-b626-31dda92c719d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:43.560743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-53327d7a-a30d-44e4-b626-31dda92c719d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:43.562670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-53327d7a-a30d-44e4-b626-31dda92c719d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:43.564085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-53327d7a-a30d-44e4-b626-31dda92c719d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:43.565687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-53327d7a-a30d-44e4-b626-31dda92c719d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:43.566343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-53327d7a-a30d-44e4-b626-31dda92c719d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:43.704719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-53327d7a-a30d-44e4-b626-31dda92c719d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:43.725097 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-53327d7a-a30d-44e4-b626-31dda92c719d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1222 microversion: 2.1 time: 0.180705 Sep 06 11:04:43.726967 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1609/3211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:43 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1222 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:43.820654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-eae4132d-a399-489c-a4e7-9c6db236087c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:43.832130 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-eae4132d-a399-489c-a4e7-9c6db236087c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.329092 Sep 06 11:04:43.832724 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1603/3212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:43 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:43.861631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9984ec80-664f-4d07-a5ad-fe4efd6b9c6e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:43.865106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-033820bb-f4cf-488f-b2f8-6660a35f4958 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:43.865596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-033820bb-f4cf-488f-b2f8-6660a35f4958 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:43.869738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9984ec80-664f-4d07-a5ad-fe4efd6b9c6e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:43.880241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-033820bb-f4cf-488f-b2f8-6660a35f4958 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:43.881066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9984ec80-664f-4d07-a5ad-fe4efd6b9c6e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:43.882328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-033820bb-f4cf-488f-b2f8-6660a35f4958 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:43.883089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-033820bb-f4cf-488f-b2f8-6660a35f4958 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:43.883374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9984ec80-664f-4d07-a5ad-fe4efd6b9c6e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:43.884183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9984ec80-664f-4d07-a5ad-fe4efd6b9c6e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:43.885288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9984ec80-664f-4d07-a5ad-fe4efd6b9c6e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:43.886301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-033820bb-f4cf-488f-b2f8-6660a35f4958 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:43.886827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9984ec80-664f-4d07-a5ad-fe4efd6b9c6e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:43.887311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9984ec80-664f-4d07-a5ad-fe4efd6b9c6e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:43.894569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-033820bb-f4cf-488f-b2f8-6660a35f4958 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:43.894569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-033820bb-f4cf-488f-b2f8-6660a35f4958 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:44.146888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9984ec80-664f-4d07-a5ad-fe4efd6b9c6e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:44.167954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-033820bb-f4cf-488f-b2f8-6660a35f4958 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:44.182998 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-033820bb-f4cf-488f-b2f8-6660a35f4958 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.331902 Sep 06 11:04:44.183362 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9984ec80-664f-4d07-a5ad-fe4efd6b9c6e tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1512 microversion: 2.1 time: 0.326400 Sep 06 11:04:44.183631 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1610/3213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:43 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:44.211730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c3df5ad-6c9f-49fd-b8e0-a5a4601a6791 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:44.212573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4c3df5ad-6c9f-49fd-b8e0-a5a4601a6791 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:44.220471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c3df5ad-6c9f-49fd-b8e0-a5a4601a6791 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:44.220980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c3df5ad-6c9f-49fd-b8e0-a5a4601a6791 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:44.222720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c3df5ad-6c9f-49fd-b8e0-a5a4601a6791 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:44.223530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c3df5ad-6c9f-49fd-b8e0-a5a4601a6791 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:44.235362 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1604/3214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:43 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:44.235708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c3df5ad-6c9f-49fd-b8e0-a5a4601a6791 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:44.235708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c3df5ad-6c9f-49fd-b8e0-a5a4601a6791 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:44.294275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d9e7b4e6-eed3-4486-97b9-c27f6fefa1e9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:44.295463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d9e7b4e6-eed3-4486-97b9-c27f6fefa1e9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:44.308940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9e7b4e6-eed3-4486-97b9-c27f6fefa1e9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:44.311925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9e7b4e6-eed3-4486-97b9-c27f6fefa1e9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:44.312667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9e7b4e6-eed3-4486-97b9-c27f6fefa1e9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:44.317631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9e7b4e6-eed3-4486-97b9-c27f6fefa1e9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:44.323194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9e7b4e6-eed3-4486-97b9-c27f6fefa1e9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:44.323923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9e7b4e6-eed3-4486-97b9-c27f6fefa1e9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:44.584332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4c3df5ad-6c9f-49fd-b8e0-a5a4601a6791 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:44.598086 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4c3df5ad-6c9f-49fd-b8e0-a5a4601a6791 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.391459 Sep 06 11:04:44.598983 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1611/3215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:44 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:44.608667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-3efae874-b05b-48fd-a417-49aab0a2ad02 req-86a36029-2a05-486b-b4a6-db44c50cc460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e167a8-c716-47ad-aa17-6ea18b4e9139", "name": "network-vif-deleted", "tag": "8b55451f-3f5a-4377-923b-95e9928d1a17"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:44.636712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3efae874-b05b-48fd-a417-49aab0a2ad02 req-86a36029-2a05-486b-b4a6-db44c50cc460 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:44.637602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3efae874-b05b-48fd-a417-49aab0a2ad02 req-86a36029-2a05-486b-b4a6-db44c50cc460 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:44.638178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3efae874-b05b-48fd-a417-49aab0a2ad02 req-86a36029-2a05-486b-b4a6-db44c50cc460 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:44.659566 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-3efae874-b05b-48fd-a417-49aab0a2ad02 req-86a36029-2a05-486b-b4a6-db44c50cc460 service nova] Creating event network-vif-deleted:8b55451f-3f5a-4377-923b-95e9928d1a17 for instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 on nch2-master-1 Sep 06 11:04:44.659814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d9e7b4e6-eed3-4486-97b9-c27f6fefa1e9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:44.675374 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-3efae874-b05b-48fd-a417-49aab0a2ad02 req-86a36029-2a05-486b-b4a6-db44c50cc460 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065926 Sep 06 11:04:44.675374 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1612/3216] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:44.675608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d9e7b4e6-eed3-4486-97b9-c27f6fefa1e9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:44.675608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d9e7b4e6-eed3-4486-97b9-c27f6fefa1e9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:44.675608 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d9e7b4e6-eed3-4486-97b9-c27f6fefa1e9 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 2830 microversion: 2.32 time: 0.385574 Sep 06 11:04:44.676273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-933778e8-781d-4c0b-af41-8329df90e78a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:44.677363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-933778e8-781d-4c0b-af41-8329df90e78a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:44.689708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-933778e8-781d-4c0b-af41-8329df90e78a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:44.690461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-933778e8-781d-4c0b-af41-8329df90e78a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:44.691035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-933778e8-781d-4c0b-af41-8329df90e78a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:44.691872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-933778e8-781d-4c0b-af41-8329df90e78a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:44.692445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-933778e8-781d-4c0b-af41-8329df90e78a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:44.693602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-933778e8-781d-4c0b-af41-8329df90e78a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:44.700099 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1605/3217] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:04:44 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 2830 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:04:44.722593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7dd273ea-bc2e-42b5-a8e3-bb69403cf06d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:44.723411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7dd273ea-bc2e-42b5-a8e3-bb69403cf06d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:44.730228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dd273ea-bc2e-42b5-a8e3-bb69403cf06d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:44.731054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dd273ea-bc2e-42b5-a8e3-bb69403cf06d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:44.731867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dd273ea-bc2e-42b5-a8e3-bb69403cf06d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:44.732813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dd273ea-bc2e-42b5-a8e3-bb69403cf06d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:44.733629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dd273ea-bc2e-42b5-a8e3-bb69403cf06d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:44.734325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7dd273ea-bc2e-42b5-a8e3-bb69403cf06d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:44.881637 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7dd273ea-bc2e-42b5-a8e3-bb69403cf06d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.163377 Sep 06 11:04:44.883240 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1606/3218] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Sep 6 11:04:44 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f/os-interface => generated 1831 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:04:44.894173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b41706f8-88c3-4538-a58f-ca8a21a81c7a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:44.894804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b41706f8-88c3-4538-a58f-ca8a21a81c7a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:44.907565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b41706f8-88c3-4538-a58f-ca8a21a81c7a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:44.910553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b41706f8-88c3-4538-a58f-ca8a21a81c7a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:44.910553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b41706f8-88c3-4538-a58f-ca8a21a81c7a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:44.912375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b41706f8-88c3-4538-a58f-ca8a21a81c7a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:44.913010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b41706f8-88c3-4538-a58f-ca8a21a81c7a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:44.913469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b41706f8-88c3-4538-a58f-ca8a21a81c7a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:44.966478 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-933778e8-781d-4c0b-af41-8329df90e78a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.297647 Sep 06 11:04:44.974317 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1613/3219] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:44 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:04:44.982738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1a8029b9-4660-43b3-a58f-039324336a85 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:44.983383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1a8029b9-4660-43b3-a58f-039324336a85 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:45.000615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a8029b9-4660-43b3-a58f-039324336a85 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:45.001752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a8029b9-4660-43b3-a58f-039324336a85 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:45.002209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a8029b9-4660-43b3-a58f-039324336a85 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:45.003072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a8029b9-4660-43b3-a58f-039324336a85 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:45.003527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a8029b9-4660-43b3-a58f-039324336a85 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:45.004553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a8029b9-4660-43b3-a58f-039324336a85 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:45.012930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b41706f8-88c3-4538-a58f-ca8a21a81c7a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:45.029482 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b41706f8-88c3-4538-a58f-ca8a21a81c7a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1270 microversion: 2.1 time: 0.137986 Sep 06 11:04:45.029482 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1607/3220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:44 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1270 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:45.249077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-08a230b7-1ce5-4736-93bb-591c65814880 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:45.250014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-08a230b7-1ce5-4736-93bb-591c65814880 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:45.257703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1a8029b9-4660-43b3-a58f-039324336a85 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:45.262758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08a230b7-1ce5-4736-93bb-591c65814880 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:45.263939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08a230b7-1ce5-4736-93bb-591c65814880 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:45.265052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08a230b7-1ce5-4736-93bb-591c65814880 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:45.267231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08a230b7-1ce5-4736-93bb-591c65814880 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:45.269105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08a230b7-1ce5-4736-93bb-591c65814880 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:45.269375 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1a8029b9-4660-43b3-a58f-039324336a85 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1673 microversion: 2.1 time: 0.293772 Sep 06 11:04:45.269568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08a230b7-1ce5-4736-93bb-591c65814880 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:45.270269 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1614/3221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:44 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1673 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:45.479445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5f4e1187-de5e-4846-9ceb-a7ad4325b8ef tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Action: 'update', calling method: .version_select at 0x7f90f3733ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:45.583956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f4e1187-de5e-4846-9ceb-a7ad4325b8ef tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:45.584797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f4e1187-de5e-4846-9ceb-a7ad4325b8ef tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:45.585318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f4e1187-de5e-4846-9ceb-a7ad4325b8ef tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:45.586064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f4e1187-de5e-4846-9ceb-a7ad4325b8ef tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:45.586747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f4e1187-de5e-4846-9ceb-a7ad4325b8ef tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:45.587438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f4e1187-de5e-4846-9ceb-a7ad4325b8ef tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:45.635764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:45.770153 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5f4e1187-de5e-4846-9ceb-a7ad4325b8ef tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/09aa9c49719543b2bf16f19f964acada" status: 200 len: 148 microversion: 2.57 time: 0.497091 Sep 06 11:04:45.773710 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1615/3222] 10.222.0.20 () {62 vars in 1303 bytes} [Tue Sep 6 11:04:45 2022] PUT /compute/v2.1/os-quota-sets/09aa9c49719543b2bf16f19f964acada => generated 148 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:04:45.794784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-03acc622-1589-46ab-8568-d44522c74b77 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Calling method '.version_select at 0x7f90f3871700>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:45.942551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03acc622-1589-46ab-8568-d44522c74b77 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:45.943731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03acc622-1589-46ab-8568-d44522c74b77 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:45.944435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03acc622-1589-46ab-8568-d44522c74b77 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:45.945616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03acc622-1589-46ab-8568-d44522c74b77 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:45.946292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03acc622-1589-46ab-8568-d44522c74b77 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:45.946743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03acc622-1589-46ab-8568-d44522c74b77 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:45.947554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-08a230b7-1ce5-4736-93bb-591c65814880 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:45.959437 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-08a230b7-1ce5-4736-93bb-591c65814880 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1505 microversion: 2.1 time: 0.713588 Sep 06 11:04:45.974933 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1608/3223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:45 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1505 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:45.981124 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-03acc622-1589-46ab-8568-d44522c74b77 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/09aa9c49719543b2bf16f19f964acada/detail" status: 200 len: 463 microversion: 2.57 time: 0.201964 Sep 06 11:04:45.984583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6659b551-e014-4ef2-9433-d9f2eb4fcecf tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '.version_select at 0x7f90fcfb89d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:45.985542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6659b551-e014-4ef2-9433-d9f2eb4fcecf tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:45.991207 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1616/3224] 10.222.0.20 () {60 vars in 1304 bytes} [Tue Sep 6 11:04:45 2022] GET /compute/v2.1/os-quota-sets/09aa9c49719543b2bf16f19f964acada/detail => generated 463 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:04:45.993099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6659b551-e014-4ef2-9433-d9f2eb4fcecf tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:45.993942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6659b551-e014-4ef2-9433-d9f2eb4fcecf tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:45.994649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6659b551-e014-4ef2-9433-d9f2eb4fcecf tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:45.995658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6659b551-e014-4ef2-9433-d9f2eb4fcecf tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:45.996351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6659b551-e014-4ef2-9433-d9f2eb4fcecf tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:45.997011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6659b551-e014-4ef2-9433-d9f2eb4fcecf tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:46.040691 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6659b551-e014-4ef2-9433-d9f2eb4fcecf tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.060632 Sep 06 11:04:46.041668 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1609/3225] 10.222.0.20 () {58 vars in 1296 bytes} [Tue Sep 6 11:04:45 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de/os-instance-actions => generated 611 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:04:46.056366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6e2ca764-9f07-4667-ad04-dcd3767d0ff8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:46.056635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6e2ca764-9f07-4667-ad04-dcd3767d0ff8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:46.067303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bd98d22b-0f8b-4c16-9c2b-653f0c432358 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:46.067303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bd98d22b-0f8b-4c16-9c2b-653f0c432358 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:46.068901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e2ca764-9f07-4667-ad04-dcd3767d0ff8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:46.069431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e2ca764-9f07-4667-ad04-dcd3767d0ff8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:46.069879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e2ca764-9f07-4667-ad04-dcd3767d0ff8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:46.070633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e2ca764-9f07-4667-ad04-dcd3767d0ff8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:46.071161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e2ca764-9f07-4667-ad04-dcd3767d0ff8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:46.071601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e2ca764-9f07-4667-ad04-dcd3767d0ff8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:46.074627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd98d22b-0f8b-4c16-9c2b-653f0c432358 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:46.075796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd98d22b-0f8b-4c16-9c2b-653f0c432358 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:46.076661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd98d22b-0f8b-4c16-9c2b-653f0c432358 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:46.077790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd98d22b-0f8b-4c16-9c2b-653f0c432358 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:46.078812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd98d22b-0f8b-4c16-9c2b-653f0c432358 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:46.080504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bd98d22b-0f8b-4c16-9c2b-653f0c432358 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:46.137450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6e2ca764-9f07-4667-ad04-dcd3767d0ff8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:04:46.210000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bd98d22b-0f8b-4c16-9c2b-653f0c432358 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:46.220847 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bd98d22b-0f8b-4c16-9c2b-653f0c432358 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1276 microversion: 2.1 time: 0.169713 Sep 06 11:04:46.224589 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1610/3226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:46 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:46.293475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Action: 'update', calling method: .version_select at 0x7f90f8544940>, body: {"quota_set": {"ram": "2048"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:46.401240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:46.401821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:46.402489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:46.403429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:46.404070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:46.404507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:46.456952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:46.457361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:46.457811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:46.458553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:46.459072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:46.459512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:46.601927 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6e2ca764-9f07-4667-ad04-dcd3767d0ff8 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 204 len: 0 microversion: 2.1 time: 0.551241 Sep 06 11:04:46.602524 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1617/3227] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:04:46 2022] DELETE /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:04:46.620687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7311ed9c-b01a-4adf-ad03-469831ce40f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:46.621481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7311ed9c-b01a-4adf-ad03-469831ce40f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:46.636733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7311ed9c-b01a-4adf-ad03-469831ce40f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:46.637230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7311ed9c-b01a-4adf-ad03-469831ce40f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:46.637684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7311ed9c-b01a-4adf-ad03-469831ce40f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:46.638400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7311ed9c-b01a-4adf-ad03-469831ce40f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:46.638864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7311ed9c-b01a-4adf-ad03-469831ce40f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:46.639332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7311ed9c-b01a-4adf-ad03-469831ce40f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:46.653568 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b58b633e-58e3-4760-a8bb-3ef6fe73709c tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/09aa9c49719543b2bf16f19f964acada?user_id=10c040d5eed84c3cbcd9a151e9ba4b4b" status: 200 len: 148 microversion: 2.57 time: 0.364119 Sep 06 11:04:46.656433 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1611/3228] 10.222.0.20 () {62 vars in 1384 bytes} [Tue Sep 6 11:04:46 2022] PUT /compute/v2.1/os-quota-sets/09aa9c49719543b2bf16f19f964acada?user_id=10c040d5eed84c3cbcd9a151e9ba4b4b => generated 148 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:04:46.676533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-5773f1e1-c7f8-4360-ab4b-2216869a6ff9 req-5fdd11ec-8e58-4675-922b-0c43beacd2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "tag": "53554e9a-68ab-46af-bf31-d81bb29cfac6"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:46.695319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5773f1e1-c7f8-4360-ab4b-2216869a6ff9 req-5fdd11ec-8e58-4675-922b-0c43beacd2b1 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:46.697637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5773f1e1-c7f8-4360-ab4b-2216869a6ff9 req-5fdd11ec-8e58-4675-922b-0c43beacd2b1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:46.698295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5773f1e1-c7f8-4360-ab4b-2216869a6ff9 req-5fdd11ec-8e58-4675-922b-0c43beacd2b1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:46.722577 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5773f1e1-c7f8-4360-ab4b-2216869a6ff9 req-5fdd11ec-8e58-4675-922b-0c43beacd2b1 service nova] Creating event network-changed:53554e9a-68ab-46af-bf31-d81bb29cfac6 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:04:46.735802 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-5773f1e1-c7f8-4360-ab4b-2216869a6ff9 req-5fdd11ec-8e58-4675-922b-0c43beacd2b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076694 Sep 06 11:04:46.736613 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1612/3229] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:46.745615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-42760493-e37e-4cb2-bdbf-dde08bac1e1a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:46.746715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-42760493-e37e-4cb2-bdbf-dde08bac1e1a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:46.753912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42760493-e37e-4cb2-bdbf-dde08bac1e1a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:46.754713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42760493-e37e-4cb2-bdbf-dde08bac1e1a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:46.759049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42760493-e37e-4cb2-bdbf-dde08bac1e1a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:46.759049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42760493-e37e-4cb2-bdbf-dde08bac1e1a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:46.759049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42760493-e37e-4cb2-bdbf-dde08bac1e1a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:46.759049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42760493-e37e-4cb2-bdbf-dde08bac1e1a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:47.138253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7311ed9c-b01a-4adf-ad03-469831ce40f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:47.145486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:SELECT=88,nova_cell1:INSERT=5 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:47.159349 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7311ed9c-b01a-4adf-ad03-469831ce40f3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1653 microversion: 2.1 time: 0.548115 Sep 06 11:04:47.160313 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1618/3230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:46 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1653 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:47.186229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-37182458-3d2a-4884-a43b-32035bd72af0 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Calling method '.version_select at 0x7f90f34f2ca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:47.246450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-42760493-e37e-4cb2-bdbf-dde08bac1e1a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:47.258609 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-42760493-e37e-4cb2-bdbf-dde08bac1e1a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1511 microversion: 2.1 time: 0.520227 Sep 06 11:04:47.259680 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1613/3231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:46 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1511 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:47.265142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9868cc6-e19d-49ff-9433-2eed730db1fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:47.266954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c9868cc6-e19d-49ff-9433-2eed730db1fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:47.276365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9868cc6-e19d-49ff-9433-2eed730db1fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:47.277252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9868cc6-e19d-49ff-9433-2eed730db1fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:47.277929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9868cc6-e19d-49ff-9433-2eed730db1fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:47.279239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9868cc6-e19d-49ff-9433-2eed730db1fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:47.279983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9868cc6-e19d-49ff-9433-2eed730db1fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:47.280754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9868cc6-e19d-49ff-9433-2eed730db1fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:47.361243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:47.516054 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-37182458-3d2a-4884-a43b-32035bd72af0 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/09aa9c49719543b2bf16f19f964acada?user_id=10c040d5eed84c3cbcd9a151e9ba4b4b" status: 200 len: 190 microversion: 2.57 time: 0.335330 Sep 06 11:04:47.517505 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1619/3232] 10.222.0.20 () {60 vars in 1364 bytes} [Tue Sep 6 11:04:47 2022] GET /compute/v2.1/os-quota-sets/09aa9c49719543b2bf16f19f964acada?user_id=10c040d5eed84c3cbcd9a151e9ba4b4b => generated 190 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:04:47.523070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b03d2f27-cb55-4f40-b7fb-099e5bb22a98 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:47.524033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b03d2f27-cb55-4f40-b7fb-099e5bb22a98 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:47.531363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b03d2f27-cb55-4f40-b7fb-099e5bb22a98 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:47.532077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b03d2f27-cb55-4f40-b7fb-099e5bb22a98 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:47.532901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b03d2f27-cb55-4f40-b7fb-099e5bb22a98 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:47.534299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b03d2f27-cb55-4f40-b7fb-099e5bb22a98 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:47.535603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b03d2f27-cb55-4f40-b7fb-099e5bb22a98 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:47.536280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b03d2f27-cb55-4f40-b7fb-099e5bb22a98 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:47.576521 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c9868cc6-e19d-49ff-9433-2eed730db1fa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.315083 Sep 06 11:04:47.583752 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1614/3233] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:04:47 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:04:47.589822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6b118067-9659-4a56-bdbb-4bf6d6e12870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:47.590608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6b118067-9659-4a56-bdbb-4bf6d6e12870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:47.598178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b118067-9659-4a56-bdbb-4bf6d6e12870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:47.599081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b118067-9659-4a56-bdbb-4bf6d6e12870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:47.600557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b118067-9659-4a56-bdbb-4bf6d6e12870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:47.600557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b118067-9659-4a56-bdbb-4bf6d6e12870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:47.601456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b118067-9659-4a56-bdbb-4bf6d6e12870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:47.601897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b118067-9659-4a56-bdbb-4bf6d6e12870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:47.868739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b03d2f27-cb55-4f40-b7fb-099e5bb22a98 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:47.883196 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b03d2f27-cb55-4f40-b7fb-099e5bb22a98 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1318 microversion: 2.1 time: 0.364143 Sep 06 11:04:47.884182 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1620/3234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:47 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:47.980322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6b118067-9659-4a56-bdbb-4bf6d6e12870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:47.991903 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6b118067-9659-4a56-bdbb-4bf6d6e12870 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1660 microversion: 2.1 time: 0.405655 Sep 06 11:04:47.994946 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1615/3235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:47 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1660 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:48.288742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-774a83d7-a547-42e3-944b-36e16fbf9e46 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:48.290112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-774a83d7-a547-42e3-944b-36e16fbf9e46 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:48.297228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-774a83d7-a547-42e3-944b-36e16fbf9e46 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:48.298544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-774a83d7-a547-42e3-944b-36e16fbf9e46 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:48.299391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-774a83d7-a547-42e3-944b-36e16fbf9e46 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:48.300301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-774a83d7-a547-42e3-944b-36e16fbf9e46 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:48.301124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-774a83d7-a547-42e3-944b-36e16fbf9e46 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:48.301754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-774a83d7-a547-42e3-944b-36e16fbf9e46 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:48.517512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-774a83d7-a547-42e3-944b-36e16fbf9e46 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:48.517512 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-774a83d7-a547-42e3-944b-36e16fbf9e46 tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1511 microversion: 2.1 time: 0.230595 Sep 06 11:04:48.517512 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1621/3236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:48 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:48.813432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-31898b22-311e-42c4-b484-e5e2ed3c62ec req-5185a006-ba88-4596-a489-7251ab92d45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b75d677b-b25f-42b2-8d2e-810a8f3a90de", "name": "network-vif-deleted", "tag": "3d7f7080-5bc6-4c22-b3b2-50680793ae44"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:48.834951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-31898b22-311e-42c4-b484-e5e2ed3c62ec req-5185a006-ba88-4596-a489-7251ab92d45b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:48.834951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-31898b22-311e-42c4-b484-e5e2ed3c62ec req-5185a006-ba88-4596-a489-7251ab92d45b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:48.834951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-31898b22-311e-42c4-b484-e5e2ed3c62ec req-5185a006-ba88-4596-a489-7251ab92d45b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:48.850426 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-31898b22-311e-42c4-b484-e5e2ed3c62ec req-5185a006-ba88-4596-a489-7251ab92d45b service nova] Creating event network-vif-deleted:3d7f7080-5bc6-4c22-b3b2-50680793ae44 for instance b75d677b-b25f-42b2-8d2e-810a8f3a90de on nch1-master-1 Sep 06 11:04:48.856473 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-31898b22-311e-42c4-b484-e5e2ed3c62ec req-5185a006-ba88-4596-a489-7251ab92d45b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047444 Sep 06 11:04:48.862662 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1616/3237] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:48.907615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9396f5e9-9a9b-4a6f-b59c-a609f8e380f6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:48.909931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9396f5e9-9a9b-4a6f-b59c-a609f8e380f6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:48.918050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9396f5e9-9a9b-4a6f-b59c-a609f8e380f6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:48.918912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9396f5e9-9a9b-4a6f-b59c-a609f8e380f6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:48.919562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9396f5e9-9a9b-4a6f-b59c-a609f8e380f6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:48.920444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9396f5e9-9a9b-4a6f-b59c-a609f8e380f6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:48.921120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9396f5e9-9a9b-4a6f-b59c-a609f8e380f6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:48.921721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9396f5e9-9a9b-4a6f-b59c-a609f8e380f6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:49.026099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-868543ae-1f5d-4db9-8f89-55c2093d1f6e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:49.026823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-868543ae-1f5d-4db9-8f89-55c2093d1f6e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:49.042058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-868543ae-1f5d-4db9-8f89-55c2093d1f6e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:49.042569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-868543ae-1f5d-4db9-8f89-55c2093d1f6e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:49.043044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-868543ae-1f5d-4db9-8f89-55c2093d1f6e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:49.043796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-868543ae-1f5d-4db9-8f89-55c2093d1f6e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:49.049715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-868543ae-1f5d-4db9-8f89-55c2093d1f6e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:49.051584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-868543ae-1f5d-4db9-8f89-55c2093d1f6e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:49.210014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9396f5e9-9a9b-4a6f-b59c-a609f8e380f6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:49.222342 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9396f5e9-9a9b-4a6f-b59c-a609f8e380f6 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1318 microversion: 2.1 time: 0.319154 Sep 06 11:04:49.222946 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1622/3238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:48 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:49.228731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-ed76d4d1-cdd4-4123-9f1a-850412e7e3e0 req-80859e7b-7051-4b5f-8640-a7ff852db5de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4061c9-7a94-4577-9467-729f159f463f", "tag": "0f7039e6-4b50-4e42-88c2-424fcf7f7191"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:49.244421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ed76d4d1-cdd4-4123-9f1a-850412e7e3e0 req-80859e7b-7051-4b5f-8640-a7ff852db5de service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:49.245157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ed76d4d1-cdd4-4123-9f1a-850412e7e3e0 req-80859e7b-7051-4b5f-8640-a7ff852db5de service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:49.246419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ed76d4d1-cdd4-4123-9f1a-850412e7e3e0 req-80859e7b-7051-4b5f-8640-a7ff852db5de service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:49.259722 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-ed76d4d1-cdd4-4123-9f1a-850412e7e3e0 req-80859e7b-7051-4b5f-8640-a7ff852db5de service nova] Creating event network-changed:0f7039e6-4b50-4e42-88c2-424fcf7f7191 for instance ac4061c9-7a94-4577-9467-729f159f463f on nch1-master-1 Sep 06 11:04:49.279061 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-ed76d4d1-cdd4-4123-9f1a-850412e7e3e0 req-80859e7b-7051-4b5f-8640-a7ff852db5de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052119 Sep 06 11:04:49.279061 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1623/3239] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:49.399820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-868543ae-1f5d-4db9-8f89-55c2093d1f6e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:49.409177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-868543ae-1f5d-4db9-8f89-55c2093d1f6e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.386874 Sep 06 11:04:49.409177 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1617/3240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:49 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:49.435546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d311bb38-8063-44f4-86a1-3e8c21fcc4cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:49.436369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d311bb38-8063-44f4-86a1-3e8c21fcc4cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:49.444335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d311bb38-8063-44f4-86a1-3e8c21fcc4cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:49.444882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d311bb38-8063-44f4-86a1-3e8c21fcc4cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:49.449347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d311bb38-8063-44f4-86a1-3e8c21fcc4cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:49.449347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d311bb38-8063-44f4-86a1-3e8c21fcc4cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:49.449347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d311bb38-8063-44f4-86a1-3e8c21fcc4cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:49.449347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d311bb38-8063-44f4-86a1-3e8c21fcc4cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:49.544175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:49.544175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:49.548183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:49.548777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:49.549511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:49.550315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:49.550840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:49.551507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:49.589116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:49.589680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:49.590130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:49.590595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lazy-loading 'fault' on Instance uuid b75d677b-b25f-42b2-8d2e-810a8f3a90de {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:04:49.663321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1efa8720c8419ba917f0e9220689ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcec28a7e8334187af139cfaa47ec10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:49.671290 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0d91df54-e78e-4d88-bb11-041f965100ec tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 200 len: 1306 microversion: 2.1 time: 0.137390 Sep 06 11:04:49.672228 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1618/3241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:49 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 1306 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:49.745032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d311bb38-8063-44f4-86a1-3e8c21fcc4cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:49.753512 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d311bb38-8063-44f4-86a1-3e8c21fcc4cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.322590 Sep 06 11:04:49.764269 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1624/3242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:49 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:49.777395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0851a48a-5c32-4237-8b99-fe0b9af7afae tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:49.778048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0851a48a-5c32-4237-8b99-fe0b9af7afae tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:49.785180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0851a48a-5c32-4237-8b99-fe0b9af7afae tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:49.785675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0851a48a-5c32-4237-8b99-fe0b9af7afae tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:49.786124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0851a48a-5c32-4237-8b99-fe0b9af7afae tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:49.786889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0851a48a-5c32-4237-8b99-fe0b9af7afae tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:49.787443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0851a48a-5c32-4237-8b99-fe0b9af7afae tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:49.787989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0851a48a-5c32-4237-8b99-fe0b9af7afae tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:50.010323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0851a48a-5c32-4237-8b99-fe0b9af7afae tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:50.018635 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0851a48a-5c32-4237-8b99-fe0b9af7afae tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.245373 Sep 06 11:04:50.019244 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1619/3243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:49 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:50.041475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb9c57c8-d77f-43be-8c96-558bf39a8574 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:50.042212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bb9c57c8-d77f-43be-8c96-558bf39a8574 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:50.049841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb9c57c8-d77f-43be-8c96-558bf39a8574 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:50.050402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb9c57c8-d77f-43be-8c96-558bf39a8574 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:50.050985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb9c57c8-d77f-43be-8c96-558bf39a8574 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:50.052039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb9c57c8-d77f-43be-8c96-558bf39a8574 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:50.052201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb9c57c8-d77f-43be-8c96-558bf39a8574 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:50.052652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb9c57c8-d77f-43be-8c96-558bf39a8574 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:50.203499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bb9c57c8-d77f-43be-8c96-558bf39a8574 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:50.212842 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bb9c57c8-d77f-43be-8c96-558bf39a8574 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.175154 Sep 06 11:04:50.216739 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1625/3244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:50 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:50.237126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-21fdff67-6935-49c5-810d-e5dccf16019d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:50.237773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-21fdff67-6935-49c5-810d-e5dccf16019d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:50.245315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21fdff67-6935-49c5-810d-e5dccf16019d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:50.245622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a59de8dc-88f3-4ffd-b69d-3ac2798cc3df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:50.246080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21fdff67-6935-49c5-810d-e5dccf16019d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:50.246761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21fdff67-6935-49c5-810d-e5dccf16019d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:50.246957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a59de8dc-88f3-4ffd-b69d-3ac2798cc3df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:50.247803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21fdff67-6935-49c5-810d-e5dccf16019d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:50.248877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21fdff67-6935-49c5-810d-e5dccf16019d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:50.249753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21fdff67-6935-49c5-810d-e5dccf16019d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:50.253494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a59de8dc-88f3-4ffd-b69d-3ac2798cc3df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:50.254189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a59de8dc-88f3-4ffd-b69d-3ac2798cc3df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:50.254835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a59de8dc-88f3-4ffd-b69d-3ac2798cc3df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:50.255772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a59de8dc-88f3-4ffd-b69d-3ac2798cc3df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:50.256427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a59de8dc-88f3-4ffd-b69d-3ac2798cc3df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:50.257020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a59de8dc-88f3-4ffd-b69d-3ac2798cc3df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:50.463090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-21fdff67-6935-49c5-810d-e5dccf16019d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:50.470140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a59de8dc-88f3-4ffd-b69d-3ac2798cc3df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:50.471677 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-21fdff67-6935-49c5-810d-e5dccf16019d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.239807 Sep 06 11:04:50.472275 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1620/3245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:50 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:50.478663 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a59de8dc-88f3-4ffd-b69d-3ac2798cc3df tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1318 microversion: 2.1 time: 0.236821 Sep 06 11:04:50.479264 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1626/3246] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:50 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:50.504096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3306266c-656a-4f4e-8632-0a026672265d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:50.504719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3306266c-656a-4f4e-8632-0a026672265d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:50.511130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3306266c-656a-4f4e-8632-0a026672265d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:50.511636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3306266c-656a-4f4e-8632-0a026672265d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:50.512114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3306266c-656a-4f4e-8632-0a026672265d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:50.513027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3306266c-656a-4f4e-8632-0a026672265d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:50.513686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3306266c-656a-4f4e-8632-0a026672265d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:50.514298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3306266c-656a-4f4e-8632-0a026672265d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:50.671928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3306266c-656a-4f4e-8632-0a026672265d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:50.681362 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3306266c-656a-4f4e-8632-0a026672265d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.181647 Sep 06 11:04:50.682056 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1621/3247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:50 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:50.696474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0e91918c-5195-4291-972e-18833341c34a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:50.697218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0e91918c-5195-4291-972e-18833341c34a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] [instance: b75d677b-b25f-42b2-8d2e-810a8f3a90de] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:50.705567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e91918c-5195-4291-972e-18833341c34a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:50.705567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e91918c-5195-4291-972e-18833341c34a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:50.706258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e91918c-5195-4291-972e-18833341c34a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:50.706556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e91918c-5195-4291-972e-18833341c34a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:50.707077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e91918c-5195-4291-972e-18833341c34a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:50.707514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e91918c-5195-4291-972e-18833341c34a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:50.721511 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-0e91918c-5195-4291-972e-18833341c34a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] HTTP exception thrown: Instance b75d677b-b25f-42b2-8d2e-810a8f3a90de could not be found. Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0e91918c-5195-4291-972e-18833341c34a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Request method failure captured: Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de HTTP/1.1 Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyk0cr7zAVVku4ymFudKykgptIzGQFGYh1izNKcugTfCg2wpL-jeBZerlSulEY3OssTDWyXhMU1xj233kmV00et0UW-GiB5GZkfN18d2aq6_5UVosPt8SSR-HRiy52nSuc8rGTHuapgsbiNFmArTF05JiWYjhg1LfnEoHp822kxPqNI Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: dcec28a7e8334187af139cfaa47ec10f Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-InstanceActionsTestJSON-2129402121 Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcec28a7e8334187af139cfaa47ec10f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcec28a7e8334187af139cfaa47ec10f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcec28a7e8334187af139cfaa47ec10f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcec28a7e8334187af139cfaa47ec10f"}]}] Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-InstanceActionsTestJSON-2129402121 Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: dcec28a7e8334187af139cfaa47ec10f Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2129402121 Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-InstanceActionsTestJSON-2129402121-project Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 7a1efa8720c8419ba917f0e9220689ac Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-InstanceActionsTestJSON-2129402121-project Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance b75d677b-b25f-42b2-8d2e-810a8f3a90de could not be found. Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'b75d677b-b25f-42b2-8d2e-810a8f3a90de'} Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b75d677b-b25f-42b2-8d2e-810a8f3a90de could not be found. Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b75d677b-b25f-42b2-8d2e-810a8f3a90de could not be found. Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:50.723259 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:50.730034 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:50.730034 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:50.730034 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:50.730034 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:50.730034 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:50.730034 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b75d677b-b25f-42b2-8d2e-810a8f3a90de could not be found. Sep 06 11:04:50.730034 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:50.730034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0e91918c-5195-4291-972e-18833341c34a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] Returning 404 to user: Instance b75d677b-b25f-42b2-8d2e-810a8f3a90de could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:50.730034 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0e91918c-5195-4291-972e-18833341c34a tempest-InstanceActionsTestJSON-2129402121 tempest-InstanceActionsTestJSON-2129402121-project] 10.222.0.20 "GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de" status: 404 len: 111 microversion: 2.1 time: 0.033568 Sep 06 11:04:50.730034 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1627/3248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:50 2022] GET /compute/v2.1/servers/b75d677b-b25f-42b2-8d2e-810a8f3a90de => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:04:51.505131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ced5b31c-3ee4-4084-a277-ed08ed518df2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:51.506746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ced5b31c-3ee4-4084-a277-ed08ed518df2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:51.514453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ced5b31c-3ee4-4084-a277-ed08ed518df2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:51.515288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ced5b31c-3ee4-4084-a277-ed08ed518df2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:51.517785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ced5b31c-3ee4-4084-a277-ed08ed518df2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:51.517785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ced5b31c-3ee4-4084-a277-ed08ed518df2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:51.518220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ced5b31c-3ee4-4084-a277-ed08ed518df2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:51.518908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ced5b31c-3ee4-4084-a277-ed08ed518df2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:51.859292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ced5b31c-3ee4-4084-a277-ed08ed518df2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:51.876419 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ced5b31c-3ee4-4084-a277-ed08ed518df2 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1318 microversion: 2.1 time: 0.370787 Sep 06 11:04:51.876419 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1622/3249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:51 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:52.902620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5f164eba-03c6-4fdc-9776-294ca333c228 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:52.905285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5f164eba-03c6-4fdc-9776-294ca333c228 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:52.924710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f164eba-03c6-4fdc-9776-294ca333c228 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:52.925605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f164eba-03c6-4fdc-9776-294ca333c228 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:52.927948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f164eba-03c6-4fdc-9776-294ca333c228 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:52.930054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f164eba-03c6-4fdc-9776-294ca333c228 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:52.930846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f164eba-03c6-4fdc-9776-294ca333c228 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:52.932091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f164eba-03c6-4fdc-9776-294ca333c228 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:53.176811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5f164eba-03c6-4fdc-9776-294ca333c228 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:53.185734 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5f164eba-03c6-4fdc-9776-294ca333c228 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1318 microversion: 2.1 time: 0.292947 Sep 06 11:04:53.187328 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1628/3250] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:52 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:53.993704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-568308398", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:54.080062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:04:54.212108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e022af80-0640-4086-8143-49229f0c7ebe tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:54.213768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e022af80-0640-4086-8143-49229f0c7ebe tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:54.224503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e022af80-0640-4086-8143-49229f0c7ebe tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:54.225442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e022af80-0640-4086-8143-49229f0c7ebe tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:54.226222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e022af80-0640-4086-8143-49229f0c7ebe tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:54.227681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e022af80-0640-4086-8143-49229f0c7ebe tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:54.228329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e022af80-0640-4086-8143-49229f0c7ebe tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:54.229267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e022af80-0640-4086-8143-49229f0c7ebe tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:54.455032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:04:54.456429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:04:54.456995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:04:54.457425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:04:54.457853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:04:54.483834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:54.483834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:54.483834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:54.483834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:54.483834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:54.483834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:54.488398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e022af80-0640-4086-8143-49229f0c7ebe tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:54.497873 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e022af80-0640-4086-8143-49229f0c7ebe tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1318 microversion: 2.1 time: 0.290965 Sep 06 11:04:54.499041 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1629/3251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:54 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:54.503591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Getting quotas for project 68d910e1900744518e3f12b3ded97a02. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:04:54.510138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Getting quotas for user c90fbe81777d4cfd9376bd1c412c188c and project 68d910e1900744518e3f12b3ded97a02. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:04:54.527701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:04:54.530523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:04:54.698844 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b8074ced-0c0e-4312-ba81-4a29f287e955 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961750 Sep 06 11:04:54.700913 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1623/3252] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:04:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:04:54.717829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eb8c7ae0-5661-4ddf-9a30-9f913e658883 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:54.718872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eb8c7ae0-5661-4ddf-9a30-9f913e658883 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:54.799351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eb8c7ae0-5661-4ddf-9a30-9f913e658883 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:54.813606 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eb8c7ae0-5661-4ddf-9a30-9f913e658883 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1222 microversion: 2.1 time: 0.105676 Sep 06 11:04:54.814524 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1630/3253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:54 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:55.206661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-d9ab1e8e-abad-447c-a701-0b8c20243e35 req-fad7e443-fb56-4f25-a67c-b37cb15969d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4061c9-7a94-4577-9467-729f159f463f", "name": "network-vif-plugged", "status": "completed", "tag": "0f7039e6-4b50-4e42-88c2-424fcf7f7191"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:55.235841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d9ab1e8e-abad-447c-a701-0b8c20243e35 req-fad7e443-fb56-4f25-a67c-b37cb15969d6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:55.236251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d9ab1e8e-abad-447c-a701-0b8c20243e35 req-fad7e443-fb56-4f25-a67c-b37cb15969d6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:55.236700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d9ab1e8e-abad-447c-a701-0b8c20243e35 req-fad7e443-fb56-4f25-a67c-b37cb15969d6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:55.260477 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-d9ab1e8e-abad-447c-a701-0b8c20243e35 req-fad7e443-fb56-4f25-a67c-b37cb15969d6 service nova] Creating event network-vif-plugged:0f7039e6-4b50-4e42-88c2-424fcf7f7191 for instance ac4061c9-7a94-4577-9467-729f159f463f on nch1-master-1 Sep 06 11:04:55.269804 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-d9ab1e8e-abad-447c-a701-0b8c20243e35 req-fad7e443-fb56-4f25-a67c-b37cb15969d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067924 Sep 06 11:04:55.270913 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1624/3254] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:04:55.525012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4b3018a1-af12-44c5-b6e9-777c4e999634 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:55.525636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4b3018a1-af12-44c5-b6e9-777c4e999634 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:55.540384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b3018a1-af12-44c5-b6e9-777c4e999634 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:55.540384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b3018a1-af12-44c5-b6e9-777c4e999634 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:55.540384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b3018a1-af12-44c5-b6e9-777c4e999634 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:55.541303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b3018a1-af12-44c5-b6e9-777c4e999634 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:55.541303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b3018a1-af12-44c5-b6e9-777c4e999634 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:55.541722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b3018a1-af12-44c5-b6e9-777c4e999634 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:55.837982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a5ca1767-6107-43ba-ac9b-d1ce36f7ff99 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:55.839142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a5ca1767-6107-43ba-ac9b-d1ce36f7ff99 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:55.961609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:55.972731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a5ca1767-6107-43ba-ac9b-d1ce36f7ff99 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:55.980568 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a5ca1767-6107-43ba-ac9b-d1ce36f7ff99 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1222 microversion: 2.1 time: 0.146776 Sep 06 11:04:55.981348 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1625/3255] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:55 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:55.994649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4b3018a1-af12-44c5-b6e9-777c4e999634 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:56.016173 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4b3018a1-af12-44c5-b6e9-777c4e999634 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1318 microversion: 2.1 time: 0.483961 Sep 06 11:04:56.019171 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1631/3256] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:55 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:57.004813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-af6729b2-2044-4437-b38b-c9d7a8368c6b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:57.006031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-af6729b2-2044-4437-b38b-c9d7a8368c6b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:57.014393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af6729b2-2044-4437-b38b-c9d7a8368c6b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:57.014888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af6729b2-2044-4437-b38b-c9d7a8368c6b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:57.015356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af6729b2-2044-4437-b38b-c9d7a8368c6b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:57.016117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af6729b2-2044-4437-b38b-c9d7a8368c6b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:57.016566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af6729b2-2044-4437-b38b-c9d7a8368c6b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:57.017018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af6729b2-2044-4437-b38b-c9d7a8368c6b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:57.039987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-64cdce40-5dee-41a6-b7ca-7720d1543a17 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:57.040850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-64cdce40-5dee-41a6-b7ca-7720d1543a17 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:57.053003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64cdce40-5dee-41a6-b7ca-7720d1543a17 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:57.053617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64cdce40-5dee-41a6-b7ca-7720d1543a17 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:57.054165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64cdce40-5dee-41a6-b7ca-7720d1543a17 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:57.055700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64cdce40-5dee-41a6-b7ca-7720d1543a17 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:57.056342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64cdce40-5dee-41a6-b7ca-7720d1543a17 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:57.056892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64cdce40-5dee-41a6-b7ca-7720d1543a17 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:57.087280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af6729b2-2044-4437-b38b-c9d7a8368c6b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:57.095356 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-af6729b2-2044-4437-b38b-c9d7a8368c6b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1226 microversion: 2.1 time: 0.095097 Sep 06 11:04:57.095932 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1626/3257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:56 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:57.260417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-64cdce40-5dee-41a6-b7ca-7720d1543a17 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:57.275239 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-64cdce40-5dee-41a6-b7ca-7720d1543a17 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1507 microversion: 2.1 time: 0.239946 Sep 06 11:04:57.283170 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1632/3258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:57 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:57.307642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0d50d4c7-dbee-451b-98b8-a539a730ae9c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:57.308983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0d50d4c7-dbee-451b-98b8-a539a730ae9c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:57.316123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d50d4c7-dbee-451b-98b8-a539a730ae9c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:57.319784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d50d4c7-dbee-451b-98b8-a539a730ae9c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:57.319784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d50d4c7-dbee-451b-98b8-a539a730ae9c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:57.319784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d50d4c7-dbee-451b-98b8-a539a730ae9c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:57.319784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d50d4c7-dbee-451b-98b8-a539a730ae9c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:57.319784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d50d4c7-dbee-451b-98b8-a539a730ae9c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:57.561011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0d50d4c7-dbee-451b-98b8-a539a730ae9c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:57.574262 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0d50d4c7-dbee-451b-98b8-a539a730ae9c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1507 microversion: 2.1 time: 0.271286 Sep 06 11:04:57.575796 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1627/3259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:57 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:57.608250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a47cf31-4941-4c5f-a5ec-60b11cbd9cfa tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:57.611537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9a47cf31-4941-4c5f-a5ec-60b11cbd9cfa tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:57.618760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a47cf31-4941-4c5f-a5ec-60b11cbd9cfa tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:57.619656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a47cf31-4941-4c5f-a5ec-60b11cbd9cfa tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:57.624784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a47cf31-4941-4c5f-a5ec-60b11cbd9cfa tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:57.624784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a47cf31-4941-4c5f-a5ec-60b11cbd9cfa tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:57.624784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a47cf31-4941-4c5f-a5ec-60b11cbd9cfa tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:57.624784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a47cf31-4941-4c5f-a5ec-60b11cbd9cfa tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:57.784051 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a47cf31-4941-4c5f-a5ec-60b11cbd9cfa tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "PUT /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1079 microversion: 2.1 time: 0.179643 Sep 06 11:04:57.791662 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1633/3260] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Sep 6 11:04:57 2022] PUT /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1079 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:57.809072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-58a32952-6a43-4619-a048-54d47cd9944c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:57.809856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-58a32952-6a43-4619-a048-54d47cd9944c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:57.813254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:57.825528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58a32952-6a43-4619-a048-54d47cd9944c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:57.826337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58a32952-6a43-4619-a048-54d47cd9944c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:57.827093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58a32952-6a43-4619-a048-54d47cd9944c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:57.829369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58a32952-6a43-4619-a048-54d47cd9944c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:57.829592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58a32952-6a43-4619-a048-54d47cd9944c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:57.830246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58a32952-6a43-4619-a048-54d47cd9944c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:58.038948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-58a32952-6a43-4619-a048-54d47cd9944c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:58.049330 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-58a32952-6a43-4619-a048-54d47cd9944c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1505 microversion: 2.1 time: 0.245812 Sep 06 11:04:58.049922 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1628/3261] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:57 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:58.073277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f73299cf-ba7f-48a2-ba4c-9700dd34da06 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:58.073933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f73299cf-ba7f-48a2-ba4c-9700dd34da06 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:58.080935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f73299cf-ba7f-48a2-ba4c-9700dd34da06 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:58.081494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f73299cf-ba7f-48a2-ba4c-9700dd34da06 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:58.082003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f73299cf-ba7f-48a2-ba4c-9700dd34da06 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:58.082770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f73299cf-ba7f-48a2-ba4c-9700dd34da06 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:58.083367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f73299cf-ba7f-48a2-ba4c-9700dd34da06 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:58.083878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f73299cf-ba7f-48a2-ba4c-9700dd34da06 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:58.126189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9dfd2a3c-8eef-4324-accf-93a1fb203833 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:58.126979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9dfd2a3c-8eef-4324-accf-93a1fb203833 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:58.134046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dfd2a3c-8eef-4324-accf-93a1fb203833 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:58.134681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dfd2a3c-8eef-4324-accf-93a1fb203833 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:58.135263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dfd2a3c-8eef-4324-accf-93a1fb203833 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:58.136080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dfd2a3c-8eef-4324-accf-93a1fb203833 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:58.136671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dfd2a3c-8eef-4324-accf-93a1fb203833 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:58.137209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dfd2a3c-8eef-4324-accf-93a1fb203833 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:58.261946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9dfd2a3c-8eef-4324-accf-93a1fb203833 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:58.277429 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9dfd2a3c-8eef-4324-accf-93a1fb203833 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1274 microversion: 2.1 time: 0.155884 Sep 06 11:04:58.277938 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1629/3262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:58 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1274 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:04:58.361446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f73299cf-ba7f-48a2-ba4c-9700dd34da06 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:58.369768 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f73299cf-ba7f-48a2-ba4c-9700dd34da06 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1505 microversion: 2.1 time: 0.302024 Sep 06 11:04:58.374895 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1634/3263] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:58 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:58.394305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-15f3a5df-ef04-4173-bbaf-ec95bd9605dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:58.397821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-15f3a5df-ef04-4173-bbaf-ec95bd9605dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:58.404380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15f3a5df-ef04-4173-bbaf-ec95bd9605dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:58.404881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15f3a5df-ef04-4173-bbaf-ec95bd9605dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:58.405335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15f3a5df-ef04-4173-bbaf-ec95bd9605dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:58.406052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15f3a5df-ef04-4173-bbaf-ec95bd9605dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:58.406548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15f3a5df-ef04-4173-bbaf-ec95bd9605dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:58.407755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15f3a5df-ef04-4173-bbaf-ec95bd9605dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:58.565417 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-15f3a5df-ef04-4173-bbaf-ec95bd9605dd tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "PUT /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1081 microversion: 2.1 time: 0.175137 Sep 06 11:04:58.566078 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1630/3264] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Sep 6 11:04:58 2022] PUT /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1081 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:58.585070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-41bc0092-43ec-4e3b-aa50-0c974ad89f50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:58.585680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-41bc0092-43ec-4e3b-aa50-0c974ad89f50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:58.591602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41bc0092-43ec-4e3b-aa50-0c974ad89f50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:58.592101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41bc0092-43ec-4e3b-aa50-0c974ad89f50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:58.592526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41bc0092-43ec-4e3b-aa50-0c974ad89f50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:58.593262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41bc0092-43ec-4e3b-aa50-0c974ad89f50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:58.593715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41bc0092-43ec-4e3b-aa50-0c974ad89f50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:58.594177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41bc0092-43ec-4e3b-aa50-0c974ad89f50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:58.776743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-41bc0092-43ec-4e3b-aa50-0c974ad89f50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:58.792300 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-41bc0092-43ec-4e3b-aa50-0c974ad89f50 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1507 microversion: 2.1 time: 0.211162 Sep 06 11:04:58.793495 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1635/3265] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:58 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:58.819555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3ca7a01e-afc7-4234-8788-1c3eeb2a29be tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:58.821261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3ca7a01e-afc7-4234-8788-1c3eeb2a29be tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:58.827175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ca7a01e-afc7-4234-8788-1c3eeb2a29be tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:58.827745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ca7a01e-afc7-4234-8788-1c3eeb2a29be tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:58.828296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ca7a01e-afc7-4234-8788-1c3eeb2a29be tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:58.829077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ca7a01e-afc7-4234-8788-1c3eeb2a29be tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:58.829640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ca7a01e-afc7-4234-8788-1c3eeb2a29be tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:58.830477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ca7a01e-afc7-4234-8788-1c3eeb2a29be tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:58.956299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ce6fbd6d-a04f-4d18-8f1a-92c1f0379afd tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-775087452", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:58.960031 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-ce6fbd6d-a04f-4d18-8f1a-92c1f0379afd tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] HTTP exception thrown: min_count must be <= max_count Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ce6fbd6d-a04f-4d18-8f1a-92c1f0379afd tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Request method failure captured: Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 183 Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyla_aQ-mbKKuQgwkMswu5XSjrhNSc33wgZc6qsrl-W2fiNdG21stPfwSVSjiIJQyUiXpRUr6SQ51b0vn6lXIT5SThnORAVktk9KSYCL_L-RQIHJfiD5Vi0_m3KUcjgacNeII-8UmxRpuLHsEEvNFazb1dmRlAzdcfzv164UX3DUCr4 Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3dcf8d9856f048a294fac0db9478b348 Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dcf8d9856f048a294fac0db9478b348"}]}] Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3dcf8d9856f048a294fac0db9478b348 Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-MultipleCreateNegativeTestJSON-181311241-project Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6a509a511b1e4375b20de5cd6b5897b6 Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-181311241-project Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-775087452", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: exception: min_count must be <= max_count Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-775087452', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 06 11:04:58.961614 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:58.977926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ce6fbd6d-a04f-4d18-8f1a-92c1f0379afd tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Returning 400 to user: min_count must be <= max_count {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:58.977926 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ce6fbd6d-a04f-4d18-8f1a-92c1f0379afd tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.136853 Sep 06 11:04:58.977926 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1636/3266] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:04:58 2022] POST /compute/v2.1/servers => generated 74 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 06 11:04:59.023975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5fad33d-3f2b-433d-9553-400668f6299d tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-43271871", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "max_count": 0}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5fad33d-3f2b-433d-9553-400668f6299d tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Request method failure captured: Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 166 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyla_aQ-mbKKuQgwkMswu5XSjrhNSc33wgZc6qsrl-W2fiNdG21stPfwSVSjiIJQyUiXpRUr6SQ51b0vn6lXIT5SThnORAVktk9KSYCL_L-RQIHJfiD5Vi0_m3KUcjgacNeII-8UmxRpuLHsEEvNFazb1dmRlAzdcfzv164UX3DUCr4 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3dcf8d9856f048a294fac0db9478b348 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dcf8d9856f048a294fac0db9478b348"}]}] Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3dcf8d9856f048a294fac0db9478b348 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-MultipleCreateNegativeTestJSON-181311241-project Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6a509a511b1e4375b20de5cd6b5897b6 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-181311241-project Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-43271871", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "max_count": 0}} Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-43271871', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'max_count': 0}}} Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 0 Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:04:59.028459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5fad33d-3f2b-433d-9553-400668f6299d tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a5fad33d-3f2b-433d-9553-400668f6299d tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010161 Sep 06 11:04:59.049515 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1637/3267] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:04:59 2022] POST /compute/v2.1/servers => generated 130 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 11:04:59.082997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-94234f51-e1f5-4ba8-921d-306a74531083 tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1876257072", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "max_count": 2.5}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-94234f51-e1f5-4ba8-921d-306a74531083 tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Request method failure captured: Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 170 Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyla_aQ-mbKKuQgwkMswu5XSjrhNSc33wgZc6qsrl-W2fiNdG21stPfwSVSjiIJQyUiXpRUr6SQ51b0vn6lXIT5SThnORAVktk9KSYCL_L-RQIHJfiD5Vi0_m3KUcjgacNeII-8UmxRpuLHsEEvNFazb1dmRlAzdcfzv164UX3DUCr4 Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3dcf8d9856f048a294fac0db9478b348 Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dcf8d9856f048a294fac0db9478b348"}]}] Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3dcf8d9856f048a294fac0db9478b348 Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-MultipleCreateNegativeTestJSON-181311241-project Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6a509a511b1e4375b20de5cd6b5897b6 Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-181311241-project Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1876257072", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "max_count": 2.5}} Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1876257072', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'max_count': 2.5}}} Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 2.5 Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:04:59.086987 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-94234f51-e1f5-4ba8-921d-306a74531083 tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-94234f51-e1f5-4ba8-921d-306a74531083 tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012201 Sep 06 11:04:59.115367 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1638/3268] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:04:59 2022] POST /compute/v2.1/servers => generated 139 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:04:59.121070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3ca7a01e-afc7-4234-8788-1c3eeb2a29be tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:59.137531 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3ca7a01e-afc7-4234-8788-1c3eeb2a29be tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1507 microversion: 2.1 time: 0.323451 Sep 06 11:04:59.138334 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1631/3269] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:58 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34db3fba-afb3-4e09-96f5-2406178f7327 tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-602303175", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "min_count": 0}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34db3fba-afb3-4e09-96f5-2406178f7327 tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Request method failure captured: Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 167 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyla_aQ-mbKKuQgwkMswu5XSjrhNSc33wgZc6qsrl-W2fiNdG21stPfwSVSjiIJQyUiXpRUr6SQ51b0vn6lXIT5SThnORAVktk9KSYCL_L-RQIHJfiD5Vi0_m3KUcjgacNeII-8UmxRpuLHsEEvNFazb1dmRlAzdcfzv164UX3DUCr4 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3dcf8d9856f048a294fac0db9478b348 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dcf8d9856f048a294fac0db9478b348"}]}] Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3dcf8d9856f048a294fac0db9478b348 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-MultipleCreateNegativeTestJSON-181311241-project Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6a509a511b1e4375b20de5cd6b5897b6 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-181311241-project Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-602303175", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "min_count": 0}} Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-602303175', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'min_count': 0}}} Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 0 Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:59.188036 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34db3fba-afb3-4e09-96f5-2406178f7327 tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-34db3fba-afb3-4e09-96f5-2406178f7327 tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009649 Sep 06 11:04:59.193311 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1639/3270] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:04:59 2022] POST /compute/v2.1/servers => generated 130 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 11:04:59.197322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0177309e-6160-4054-a9f7-e3d80a67ec1c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:59.197322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0177309e-6160-4054-a9f7-e3d80a67ec1c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:59.197322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0177309e-6160-4054-a9f7-e3d80a67ec1c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:59.197322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0177309e-6160-4054-a9f7-e3d80a67ec1c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:59.197322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0177309e-6160-4054-a9f7-e3d80a67ec1c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:59.197322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0177309e-6160-4054-a9f7-e3d80a67ec1c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:59.197322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0177309e-6160-4054-a9f7-e3d80a67ec1c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:59.197322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0177309e-6160-4054-a9f7-e3d80a67ec1c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:59.221471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:59.240695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0177309e-6160-4054-a9f7-e3d80a67ec1c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:04:59.262700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-756a4e9d-8520-4d6a-b8da-9b7eb84d8cba tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-844672427", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "min_count": 2.5}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-756a4e9d-8520-4d6a-b8da-9b7eb84d8cba tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Request method failure captured: Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 169 Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyla_aQ-mbKKuQgwkMswu5XSjrhNSc33wgZc6qsrl-W2fiNdG21stPfwSVSjiIJQyUiXpRUr6SQ51b0vn6lXIT5SThnORAVktk9KSYCL_L-RQIHJfiD5Vi0_m3KUcjgacNeII-8UmxRpuLHsEEvNFazb1dmRlAzdcfzv164UX3DUCr4 Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3dcf8d9856f048a294fac0db9478b348 Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3dcf8d9856f048a294fac0db9478b348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3dcf8d9856f048a294fac0db9478b348"}]}] Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3dcf8d9856f048a294fac0db9478b348 Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-181311241 Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-MultipleCreateNegativeTestJSON-181311241-project Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6a509a511b1e4375b20de5cd6b5897b6 Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-181311241-project Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-844672427", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "min_count": 2.5}} Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-844672427', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'min_count': 2.5}}} Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 2.5 Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:04:59.268956 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-756a4e9d-8520-4d6a-b8da-9b7eb84d8cba tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-756a4e9d-8520-4d6a-b8da-9b7eb84d8cba tempest-MultipleCreateNegativeTestJSON-181311241 tempest-MultipleCreateNegativeTestJSON-181311241-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.013190 Sep 06 11:04:59.274792 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1640/3271] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:04:59 2022] POST /compute/v2.1/servers => generated 139 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:04:59.310988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2fe6bc4d-8e22-4f60-8305-ae1aed10951c tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:59.310988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2fe6bc4d-8e22-4f60-8305-ae1aed10951c tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:59.317508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fe6bc4d-8e22-4f60-8305-ae1aed10951c tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:59.318756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fe6bc4d-8e22-4f60-8305-ae1aed10951c tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:59.319848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fe6bc4d-8e22-4f60-8305-ae1aed10951c tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:59.321232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fe6bc4d-8e22-4f60-8305-ae1aed10951c tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:59.321959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fe6bc4d-8e22-4f60-8305-ae1aed10951c tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:59.322649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fe6bc4d-8e22-4f60-8305-ae1aed10951c tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:59.397340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2fe6bc4d-8e22-4f60-8305-ae1aed10951c tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:04:59.405212 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2fe6bc4d-8e22-4f60-8305-ae1aed10951c tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1280 microversion: 2.1 time: 0.107007 Sep 06 11:04:59.405792 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1641/3272] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:59 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1280 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:04:59.694591 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0177309e-6160-4054-a9f7-e3d80a67ec1c tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 204 len: 0 microversion: 2.1 time: 0.517224 Sep 06 11:04:59.696013 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1632/3273] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:04:59 2022] DELETE /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:04:59.706985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9abd7466-8bc9-4800-950f-4751ef7258ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:59.707548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9abd7466-8bc9-4800-950f-4751ef7258ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:59.720183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9abd7466-8bc9-4800-950f-4751ef7258ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:59.720672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9abd7466-8bc9-4800-950f-4751ef7258ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:59.721115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9abd7466-8bc9-4800-950f-4751ef7258ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:59.721831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9abd7466-8bc9-4800-950f-4751ef7258ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:59.722290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9abd7466-8bc9-4800-950f-4751ef7258ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:59.722719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9abd7466-8bc9-4800-950f-4751ef7258ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:59.751643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9abd7466-8bc9-4800-950f-4751ef7258ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:04:59.767921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:59.867637 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.compute.api [None req-9abd7466-8bc9-4800-950f-4751ef7258ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Instance is already in deleting state, ignoring this request Sep 06 11:04:59.868908 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9abd7466-8bc9-4800-950f-4751ef7258ca tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 204 len: 0 microversion: 2.1 time: 0.165915 Sep 06 11:04:59.869493 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1642/3274] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:04:59 2022] DELETE /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:04:59.878757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-47c8deed-e8d7-4a60-a34e-1094e1197c9e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:04:59.879843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-47c8deed-e8d7-4a60-a34e-1094e1197c9e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:04:59.887939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47c8deed-e8d7-4a60-a34e-1094e1197c9e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:59.888691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47c8deed-e8d7-4a60-a34e-1094e1197c9e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:59.889444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47c8deed-e8d7-4a60-a34e-1094e1197c9e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:04:59.890501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47c8deed-e8d7-4a60-a34e-1094e1197c9e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:04:59.891914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47c8deed-e8d7-4a60-a34e-1094e1197c9e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:04:59.892537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47c8deed-e8d7-4a60-a34e-1094e1197c9e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:00.049808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-47c8deed-e8d7-4a60-a34e-1094e1197c9e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:00.057928 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-47c8deed-e8d7-4a60-a34e-1094e1197c9e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1513 microversion: 2.1 time: 0.183851 Sep 06 11:05:00.059868 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1633/3275] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:04:59 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:05:00.429413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-01749861-0786-4afb-8133-e56813f57e75 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:00.430006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-01749861-0786-4afb-8133-e56813f57e75 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:00.436878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01749861-0786-4afb-8133-e56813f57e75 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:00.437410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01749861-0786-4afb-8133-e56813f57e75 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:00.438356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01749861-0786-4afb-8133-e56813f57e75 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:00.439103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01749861-0786-4afb-8133-e56813f57e75 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:00.439570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01749861-0786-4afb-8133-e56813f57e75 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:00.440000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01749861-0786-4afb-8133-e56813f57e75 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:00.641330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-01749861-0786-4afb-8133-e56813f57e75 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:00.648955 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-01749861-0786-4afb-8133-e56813f57e75 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1322 microversion: 2.1 time: 0.223670 Sep 06 11:05:00.649551 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1643/3276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:00 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:01.083771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e6d7065b-d68a-4817-bec6-b0509c3f943f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:01.085159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e6d7065b-d68a-4817-bec6-b0509c3f943f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:01.099261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6d7065b-d68a-4817-bec6-b0509c3f943f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:01.100092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6d7065b-d68a-4817-bec6-b0509c3f943f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:01.101344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6d7065b-d68a-4817-bec6-b0509c3f943f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:01.102435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6d7065b-d68a-4817-bec6-b0509c3f943f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:01.107756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6d7065b-d68a-4817-bec6-b0509c3f943f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:01.107756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6d7065b-d68a-4817-bec6-b0509c3f943f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:01.366295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e6d7065b-d68a-4817-bec6-b0509c3f943f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:01.392455 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e6d7065b-d68a-4817-bec6-b0509c3f943f tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1513 microversion: 2.1 time: 0.311052 Sep 06 11:05:01.394009 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1634/3277] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:01 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1513 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:01.672675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1c8065f4-9ce0-44d6-a002-b4f925fd2900 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:01.673305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1c8065f4-9ce0-44d6-a002-b4f925fd2900 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:01.676200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-fbc4d485-2a3d-497a-8f69-71d68abb8127 req-e71161fa-f358-47be-9bfa-4655dc110259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4061c9-7a94-4577-9467-729f159f463f", "name": "network-vif-deleted", "tag": "0f7039e6-4b50-4e42-88c2-424fcf7f7191"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:01.686575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c8065f4-9ce0-44d6-a002-b4f925fd2900 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:01.687172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c8065f4-9ce0-44d6-a002-b4f925fd2900 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:01.688211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c8065f4-9ce0-44d6-a002-b4f925fd2900 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:01.688956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c8065f4-9ce0-44d6-a002-b4f925fd2900 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:01.689427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c8065f4-9ce0-44d6-a002-b4f925fd2900 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:01.689868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c8065f4-9ce0-44d6-a002-b4f925fd2900 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:01.699611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fbc4d485-2a3d-497a-8f69-71d68abb8127 req-e71161fa-f358-47be-9bfa-4655dc110259 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:01.700115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fbc4d485-2a3d-497a-8f69-71d68abb8127 req-e71161fa-f358-47be-9bfa-4655dc110259 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:01.702324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fbc4d485-2a3d-497a-8f69-71d68abb8127 req-e71161fa-f358-47be-9bfa-4655dc110259 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:01.729612 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-fbc4d485-2a3d-497a-8f69-71d68abb8127 req-e71161fa-f358-47be-9bfa-4655dc110259 service nova] Creating event network-vif-deleted:0f7039e6-4b50-4e42-88c2-424fcf7f7191 for instance ac4061c9-7a94-4577-9467-729f159f463f on nch1-master-1 Sep 06 11:05:01.760310 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-fbc4d485-2a3d-497a-8f69-71d68abb8127 req-e71161fa-f358-47be-9bfa-4655dc110259 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081761 Sep 06 11:05:01.760310 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1635/3278] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:05:01.774892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b41523c8-c4f0-44df-b2f1-f9de110288cc req-7e926ac4-fefd-4434-bc00-5a963b381b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4cd4189-c2cf-445f-8fc9-8956d1c8a389", "tag": "eb81a1bc-0930-4fb3-9d80-5d543f0bd21c"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:01.806285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b41523c8-c4f0-44df-b2f1-f9de110288cc req-7e926ac4-fefd-4434-bc00-5a963b381b5a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:01.806787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b41523c8-c4f0-44df-b2f1-f9de110288cc req-7e926ac4-fefd-4434-bc00-5a963b381b5a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:01.807338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b41523c8-c4f0-44df-b2f1-f9de110288cc req-7e926ac4-fefd-4434-bc00-5a963b381b5a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:01.824005 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b41523c8-c4f0-44df-b2f1-f9de110288cc req-7e926ac4-fefd-4434-bc00-5a963b381b5a service nova] Creating event network-changed:eb81a1bc-0930-4fb3-9d80-5d543f0bd21c for instance c4cd4189-c2cf-445f-8fc9-8956d1c8a389 on nch1-master-1 Sep 06 11:05:01.836956 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b41523c8-c4f0-44df-b2f1-f9de110288cc req-7e926ac4-fefd-4434-bc00-5a963b381b5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082034 Sep 06 11:05:01.838267 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1636/3279] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:01.995004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1c8065f4-9ce0-44d6-a002-b4f925fd2900 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:02.007797 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1c8065f4-9ce0-44d6-a002-b4f925fd2900 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1322 microversion: 2.1 time: 0.338682 Sep 06 11:05:02.032522 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1644/3280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:01 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:02.419160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:02.419853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:02.427847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:02.428345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:02.428801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:02.429516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:02.431047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:02.431047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:02.462691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:02.463441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:02.464246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:02.464572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lazy-loading 'fault' on Instance uuid ac4061c9-7a94-4577-9467-729f159f463f {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:05:02.516538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:02.525119 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b7a64c52-b83e-4ae9-baa3-48a2a262aa3b tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1308 microversion: 2.1 time: 0.111251 Sep 06 11:05:02.526395 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1637/3281] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:02 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:03.034387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-35321f29-a7de-4d27-82cf-7cfb7b19ed31 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:03.035671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-35321f29-a7de-4d27-82cf-7cfb7b19ed31 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:03.042738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35321f29-a7de-4d27-82cf-7cfb7b19ed31 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:03.043257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35321f29-a7de-4d27-82cf-7cfb7b19ed31 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:03.043834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35321f29-a7de-4d27-82cf-7cfb7b19ed31 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:03.045176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35321f29-a7de-4d27-82cf-7cfb7b19ed31 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:03.045844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35321f29-a7de-4d27-82cf-7cfb7b19ed31 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:03.046285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35321f29-a7de-4d27-82cf-7cfb7b19ed31 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:03.362346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-35321f29-a7de-4d27-82cf-7cfb7b19ed31 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:03.370385 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-35321f29-a7de-4d27-82cf-7cfb7b19ed31 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1322 microversion: 2.1 time: 0.341756 Sep 06 11:05:03.370974 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1645/3282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:03 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:03.557373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:03.558320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:03.568578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:03.570033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:03.570033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:03.570974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:03.571464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:03.571927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:03.610795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:03.611311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:03.611753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:03.612207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lazy-loading 'fault' on Instance uuid ac4061c9-7a94-4577-9467-729f159f463f {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:05:03.706447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e93a2f8ed643ba8bc92b4def1ce7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8540c8171e480b83fd68fbb5f159be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:03.728194 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cfedf0bd-5488-45a5-b389-841c6fe75e6e tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 200 len: 1308 microversion: 2.1 time: 0.174539 Sep 06 11:05:03.728712 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1638/3283] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:03 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:05:04.395818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed30647f-35b6-4218-b213-fe669507da2f tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:04.397192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ed30647f-35b6-4218-b213-fe669507da2f tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:04.408973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed30647f-35b6-4218-b213-fe669507da2f tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:04.412752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed30647f-35b6-4218-b213-fe669507da2f tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:04.412752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed30647f-35b6-4218-b213-fe669507da2f tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:04.412752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed30647f-35b6-4218-b213-fe669507da2f tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:04.412752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed30647f-35b6-4218-b213-fe669507da2f tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:04.412752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed30647f-35b6-4218-b213-fe669507da2f tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:04.580981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ed30647f-35b6-4218-b213-fe669507da2f tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:04.604544 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ed30647f-35b6-4218-b213-fe669507da2f tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1322 microversion: 2.1 time: 0.199982 Sep 06 11:05:04.605440 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1646/3284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:04 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:04.755515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-659a3601-1c11-4b07-8fba-df3c212f6836 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:04.756276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-659a3601-1c11-4b07-8fba-df3c212f6836 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: ac4061c9-7a94-4577-9467-729f159f463f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:04.759921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=9 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:04.770126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-659a3601-1c11-4b07-8fba-df3c212f6836 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:04.770718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-659a3601-1c11-4b07-8fba-df3c212f6836 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:04.771278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-659a3601-1c11-4b07-8fba-df3c212f6836 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:04.772067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-659a3601-1c11-4b07-8fba-df3c212f6836 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:04.772781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-659a3601-1c11-4b07-8fba-df3c212f6836 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:04.773319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-659a3601-1c11-4b07-8fba-df3c212f6836 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:04.789559 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-659a3601-1c11-4b07-8fba-df3c212f6836 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] HTTP exception thrown: Instance ac4061c9-7a94-4577-9467-729f159f463f could not be found. Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-659a3601-1c11-4b07-8fba-df3c212f6836 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Request method failure captured: Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f HTTP/1.1 Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyi931D7EHohb6LlEyJ40O6Icuid6L20nBMG4tMK095oe9wAC0M0irt7buKVOwiLgccXFc3prmzK5r1plwFC4-aeCzKU5ZtalWwVyBd5BsncDZ8yUAz-ZUmvo0GnOV1H0nI4dU-ovYglI9wXfaxvVNKEtbw8hzvjkBK9CdC5Qpn5ars Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0e8540c8171e480b83fd68fbb5f159be Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e8540c8171e480b83fd68fbb5f159be"}]}] Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0e8540c8171e480b83fd68fbb5f159be Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerDiskConfigTestJSON-1388785199-project Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 00e93a2f8ed643ba8bc92b4def1ce7f3 Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerDiskConfigTestJSON-1388785199-project Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance ac4061c9-7a94-4577-9467-729f159f463f could not be found. Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'ac4061c9-7a94-4577-9467-729f159f463f'} Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4061c9-7a94-4577-9467-729f159f463f could not be found. Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4061c9-7a94-4577-9467-729f159f463f could not be found. Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:04.791636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.797483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.797483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:04.797483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:04.797483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:04.797483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:04.797483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4061c9-7a94-4577-9467-729f159f463f could not be found. Sep 06 11:05:04.797483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.797483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-659a3601-1c11-4b07-8fba-df3c212f6836 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Returning 404 to user: Instance ac4061c9-7a94-4577-9467-729f159f463f could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:04.797483 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-659a3601-1c11-4b07-8fba-df3c212f6836 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f" status: 404 len: 111 microversion: 2.1 time: 0.043094 Sep 06 11:05:04.797483 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1639/3285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:04 2022] GET /compute/v2.1/servers/ac4061c9-7a94-4577-9467-729f159f463f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:04.802392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-79df7f71-9ca7-47f3-88ec-a9b16aacf2e4 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:04.803200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-79df7f71-9ca7-47f3-88ec-a9b16aacf2e4 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:04.805266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=18 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:04.816108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79df7f71-9ca7-47f3-88ec-a9b16aacf2e4 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:04.816108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79df7f71-9ca7-47f3-88ec-a9b16aacf2e4 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:04.816433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79df7f71-9ca7-47f3-88ec-a9b16aacf2e4 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:04.817034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79df7f71-9ca7-47f3-88ec-a9b16aacf2e4 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:04.817495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79df7f71-9ca7-47f3-88ec-a9b16aacf2e4 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:04.817931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79df7f71-9ca7-47f3-88ec-a9b16aacf2e4 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:04.837002 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-79df7f71-9ca7-47f3-88ec-a9b16aacf2e4 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] HTTP exception thrown: Instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 could not be found. Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-79df7f71-9ca7-47f3-88ec-a9b16aacf2e4 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Request method failure captured: Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 HTTP/1.1 Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyi931D7EHohb6LlEyJ40O6Icuid6L20nBMG4tMK095oe9wAC0M0irt7buKVOwiLgccXFc3prmzK5r1plwFC4-aeCzKU5ZtalWwVyBd5BsncDZ8yUAz-ZUmvo0GnOV1H0nI4dU-ovYglI9wXfaxvVNKEtbw8hzvjkBK9CdC5Qpn5ars Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0e8540c8171e480b83fd68fbb5f159be Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e8540c8171e480b83fd68fbb5f159be"}]}] Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0e8540c8171e480b83fd68fbb5f159be Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerDiskConfigTestJSON-1388785199-project Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 00e93a2f8ed643ba8bc92b4def1ce7f3 Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerDiskConfigTestJSON-1388785199-project Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 could not be found. Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '48e167a8-c716-47ad-aa17-6ea18b4e9139'} Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 could not be found. Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:05:04.838799 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 could not be found. Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 could not be found. Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-79df7f71-9ca7-47f3-88ec-a9b16aacf2e4 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Returning 404 to user: Instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-79df7f71-9ca7-47f3-88ec-a9b16aacf2e4 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "DELETE /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 404 len: 111 microversion: 2.1 time: 0.042335 Sep 06 11:05:04.843961 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1647/3286] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:05:04 2022] DELETE /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:04.852553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9668c1c-c6a3-4df5-9c03-982479c6523a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:04.853486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e9668c1c-c6a3-4df5-9c03-982479c6523a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: 48e167a8-c716-47ad-aa17-6ea18b4e9139] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:04.869263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9668c1c-c6a3-4df5-9c03-982479c6523a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:04.869932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9668c1c-c6a3-4df5-9c03-982479c6523a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:04.870534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9668c1c-c6a3-4df5-9c03-982479c6523a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:04.871491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9668c1c-c6a3-4df5-9c03-982479c6523a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:04.872169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9668c1c-c6a3-4df5-9c03-982479c6523a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:04.877615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9668c1c-c6a3-4df5-9c03-982479c6523a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-e9668c1c-c6a3-4df5-9c03-982479c6523a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] HTTP exception thrown: Instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 could not be found. Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9668c1c-c6a3-4df5-9c03-982479c6523a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Request method failure captured: Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 HTTP/1.1 Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyi931D7EHohb6LlEyJ40O6Icuid6L20nBMG4tMK095oe9wAC0M0irt7buKVOwiLgccXFc3prmzK5r1plwFC4-aeCzKU5ZtalWwVyBd5BsncDZ8yUAz-ZUmvo0GnOV1H0nI4dU-ovYglI9wXfaxvVNKEtbw8hzvjkBK9CdC5Qpn5ars Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0e8540c8171e480b83fd68fbb5f159be Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e8540c8171e480b83fd68fbb5f159be"}]}] Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0e8540c8171e480b83fd68fbb5f159be Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerDiskConfigTestJSON-1388785199-project Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 00e93a2f8ed643ba8bc92b4def1ce7f3 Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerDiskConfigTestJSON-1388785199-project Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 could not be found. Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '48e167a8-c716-47ad-aa17-6ea18b4e9139'} Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 could not be found. Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:05:04.906372 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 could not be found. Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 could not be found. Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9668c1c-c6a3-4df5-9c03-982479c6523a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Returning 404 to user: Instance 48e167a8-c716-47ad-aa17-6ea18b4e9139 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e9668c1c-c6a3-4df5-9c03-982479c6523a tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139" status: 404 len: 111 microversion: 2.1 time: 0.054538 Sep 06 11:05:04.911935 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1640/3287] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:04 2022] GET /compute/v2.1/servers/48e167a8-c716-47ad-aa17-6ea18b4e9139 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:04.914314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e13d24f-da50-4fb5-8dc2-5487fa01983d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:04.915354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4e13d24f-da50-4fb5-8dc2-5487fa01983d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:04.921361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e13d24f-da50-4fb5-8dc2-5487fa01983d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:04.921940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e13d24f-da50-4fb5-8dc2-5487fa01983d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:04.922453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e13d24f-da50-4fb5-8dc2-5487fa01983d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:04.923277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e13d24f-da50-4fb5-8dc2-5487fa01983d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:04.923805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e13d24f-da50-4fb5-8dc2-5487fa01983d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:04.924914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e13d24f-da50-4fb5-8dc2-5487fa01983d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:04.942805 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-4e13d24f-da50-4fb5-8dc2-5487fa01983d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] HTTP exception thrown: Instance d8d6ab04-f643-4697-b4dd-3bed20fc385c could not be found. Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e13d24f-da50-4fb5-8dc2-5487fa01983d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Request method failure captured: Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c HTTP/1.1 Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyi931D7EHohb6LlEyJ40O6Icuid6L20nBMG4tMK095oe9wAC0M0irt7buKVOwiLgccXFc3prmzK5r1plwFC4-aeCzKU5ZtalWwVyBd5BsncDZ8yUAz-ZUmvo0GnOV1H0nI4dU-ovYglI9wXfaxvVNKEtbw8hzvjkBK9CdC5Qpn5ars Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0e8540c8171e480b83fd68fbb5f159be Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e8540c8171e480b83fd68fbb5f159be"}]}] Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0e8540c8171e480b83fd68fbb5f159be Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerDiskConfigTestJSON-1388785199-project Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 00e93a2f8ed643ba8bc92b4def1ce7f3 Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerDiskConfigTestJSON-1388785199-project Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance d8d6ab04-f643-4697-b4dd-3bed20fc385c could not be found. Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'd8d6ab04-f643-4697-b4dd-3bed20fc385c'} Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d6ab04-f643-4697-b4dd-3bed20fc385c could not be found. Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:05:04.944479 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d6ab04-f643-4697-b4dd-3bed20fc385c could not be found. Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d6ab04-f643-4697-b4dd-3bed20fc385c could not be found. Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e13d24f-da50-4fb5-8dc2-5487fa01983d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Returning 404 to user: Instance d8d6ab04-f643-4697-b4dd-3bed20fc385c could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e13d24f-da50-4fb5-8dc2-5487fa01983d tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 404 len: 111 microversion: 2.1 time: 0.040006 Sep 06 11:05:04.955400 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1648/3288] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:05:04 2022] DELETE /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:04.957740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-041e0a8d-3fcc-4a1b-b88a-a501185ddc89 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:04.959306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-041e0a8d-3fcc-4a1b-b88a-a501185ddc89 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] [instance: d8d6ab04-f643-4697-b4dd-3bed20fc385c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:04.966834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041e0a8d-3fcc-4a1b-b88a-a501185ddc89 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:04.967379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041e0a8d-3fcc-4a1b-b88a-a501185ddc89 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:04.967835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041e0a8d-3fcc-4a1b-b88a-a501185ddc89 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:04.969188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041e0a8d-3fcc-4a1b-b88a-a501185ddc89 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:04.970263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041e0a8d-3fcc-4a1b-b88a-a501185ddc89 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:04.970755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041e0a8d-3fcc-4a1b-b88a-a501185ddc89 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:04.988482 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-041e0a8d-3fcc-4a1b-b88a-a501185ddc89 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] HTTP exception thrown: Instance d8d6ab04-f643-4697-b4dd-3bed20fc385c could not be found. Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-041e0a8d-3fcc-4a1b-b88a-a501185ddc89 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Request method failure captured: Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c HTTP/1.1 Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyi931D7EHohb6LlEyJ40O6Icuid6L20nBMG4tMK095oe9wAC0M0irt7buKVOwiLgccXFc3prmzK5r1plwFC4-aeCzKU5ZtalWwVyBd5BsncDZ8yUAz-ZUmvo0GnOV1H0nI4dU-ovYglI9wXfaxvVNKEtbw8hzvjkBK9CdC5Qpn5ars Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0e8540c8171e480b83fd68fbb5f159be Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e8540c8171e480b83fd68fbb5f159be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e8540c8171e480b83fd68fbb5f159be"}]}] Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0e8540c8171e480b83fd68fbb5f159be Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1388785199 Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerDiskConfigTestJSON-1388785199-project Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 00e93a2f8ed643ba8bc92b4def1ce7f3 Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerDiskConfigTestJSON-1388785199-project Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance d8d6ab04-f643-4697-b4dd-3bed20fc385c could not be found. Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'd8d6ab04-f643-4697-b4dd-3bed20fc385c'} Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d6ab04-f643-4697-b4dd-3bed20fc385c could not be found. Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d6ab04-f643-4697-b4dd-3bed20fc385c could not be found. Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:04.990639 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.995408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:04.995408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:04.995408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:04.995408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:04.995408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:04.995408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d6ab04-f643-4697-b4dd-3bed20fc385c could not be found. Sep 06 11:05:04.995408 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:04.995408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-041e0a8d-3fcc-4a1b-b88a-a501185ddc89 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] Returning 404 to user: Instance d8d6ab04-f643-4697-b4dd-3bed20fc385c could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:04.995408 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-041e0a8d-3fcc-4a1b-b88a-a501185ddc89 tempest-ServerDiskConfigTestJSON-1388785199 tempest-ServerDiskConfigTestJSON-1388785199-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c" status: 404 len: 111 microversion: 2.1 time: 0.040612 Sep 06 11:05:04.995408 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1641/3289] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:04 2022] GET /compute/v2.1/servers/d8d6ab04-f643-4697-b4dd-3bed20fc385c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:05.614299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eab8d992-40ee-41fd-8487-6a281018de2a tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:05.620461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eab8d992-40ee-41fd-8487-6a281018de2a tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:05.628643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eab8d992-40ee-41fd-8487-6a281018de2a tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:05.629142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eab8d992-40ee-41fd-8487-6a281018de2a tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:05.629578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eab8d992-40ee-41fd-8487-6a281018de2a tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:05.630274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eab8d992-40ee-41fd-8487-6a281018de2a tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:05.630732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eab8d992-40ee-41fd-8487-6a281018de2a tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:05.631200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eab8d992-40ee-41fd-8487-6a281018de2a tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:05.870349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eab8d992-40ee-41fd-8487-6a281018de2a tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:05.879065 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eab8d992-40ee-41fd-8487-6a281018de2a tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1322 microversion: 2.1 time: 0.268611 Sep 06 11:05:05.887212 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1649/3290] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:05 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:06.906800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b2f4a8e0-f9f6-4f53-a287-8e030618e992 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:06.907458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b2f4a8e0-f9f6-4f53-a287-8e030618e992 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:06.916796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=26 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:06.918557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2f4a8e0-f9f6-4f53-a287-8e030618e992 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:06.919075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2f4a8e0-f9f6-4f53-a287-8e030618e992 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:06.919542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2f4a8e0-f9f6-4f53-a287-8e030618e992 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:06.920241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2f4a8e0-f9f6-4f53-a287-8e030618e992 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:06.920704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2f4a8e0-f9f6-4f53-a287-8e030618e992 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:06.921136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2f4a8e0-f9f6-4f53-a287-8e030618e992 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:07.066483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b2f4a8e0-f9f6-4f53-a287-8e030618e992 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:07.077799 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b2f4a8e0-f9f6-4f53-a287-8e030618e992 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1322 microversion: 2.1 time: 0.177233 Sep 06 11:05:07.091158 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1642/3291] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:06 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:07.150154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-5b3648b4-853c-41f0-a7f7-dd7fef03b110 req-7783be05-a722-4c35-b1b1-8cdb4f6356e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4cd4189-c2cf-445f-8fc9-8956d1c8a389", "name": "network-vif-plugged", "status": "completed", "tag": "eb81a1bc-0930-4fb3-9d80-5d543f0bd21c"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:07.163858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5b3648b4-853c-41f0-a7f7-dd7fef03b110 req-7783be05-a722-4c35-b1b1-8cdb4f6356e3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:07.164471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5b3648b4-853c-41f0-a7f7-dd7fef03b110 req-7783be05-a722-4c35-b1b1-8cdb4f6356e3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:07.165191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5b3648b4-853c-41f0-a7f7-dd7fef03b110 req-7783be05-a722-4c35-b1b1-8cdb4f6356e3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:07.179965 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-5b3648b4-853c-41f0-a7f7-dd7fef03b110 req-7783be05-a722-4c35-b1b1-8cdb4f6356e3 service nova] Creating event network-vif-plugged:eb81a1bc-0930-4fb3-9d80-5d543f0bd21c for instance c4cd4189-c2cf-445f-8fc9-8956d1c8a389 on nch1-master-1 Sep 06 11:05:07.186125 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-5b3648b4-853c-41f0-a7f7-dd7fef03b110 req-7783be05-a722-4c35-b1b1-8cdb4f6356e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040209 Sep 06 11:05:07.187748 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1650/3292] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:08.101206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1de542a0-b583-442b-991e-dc4af7bea5d6 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:08.101828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1de542a0-b583-442b-991e-dc4af7bea5d6 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:08.115368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de542a0-b583-442b-991e-dc4af7bea5d6 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:08.118959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de542a0-b583-442b-991e-dc4af7bea5d6 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:08.118959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de542a0-b583-442b-991e-dc4af7bea5d6 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:08.119732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de542a0-b583-442b-991e-dc4af7bea5d6 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:08.120556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de542a0-b583-442b-991e-dc4af7bea5d6 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:08.121292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de542a0-b583-442b-991e-dc4af7bea5d6 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:08.600733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1de542a0-b583-442b-991e-dc4af7bea5d6 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:08.615315 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1de542a0-b583-442b-991e-dc4af7bea5d6 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1322 microversion: 2.1 time: 0.518355 Sep 06 11:05:08.616260 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1643/3293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:08 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1322 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:09.644462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c309f5ac-8a72-41cc-84fd-951278cb9ab1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:09.645336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c309f5ac-8a72-41cc-84fd-951278cb9ab1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:09.687634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c309f5ac-8a72-41cc-84fd-951278cb9ab1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:09.689710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c309f5ac-8a72-41cc-84fd-951278cb9ab1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:09.690240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c309f5ac-8a72-41cc-84fd-951278cb9ab1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:09.692008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c309f5ac-8a72-41cc-84fd-951278cb9ab1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:09.692622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c309f5ac-8a72-41cc-84fd-951278cb9ab1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:09.693137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c309f5ac-8a72-41cc-84fd-951278cb9ab1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:10.194891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c309f5ac-8a72-41cc-84fd-951278cb9ab1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:10.208950 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c309f5ac-8a72-41cc-84fd-951278cb9ab1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1472 microversion: 2.1 time: 0.570007 Sep 06 11:05:10.224008 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1651/3294] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:09 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1472 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:10.233060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e58b9b05-760f-468a-a92a-6971cbcf38a1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:10.233684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e58b9b05-760f-468a-a92a-6971cbcf38a1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:10.241240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e58b9b05-760f-468a-a92a-6971cbcf38a1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:10.248357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e58b9b05-760f-468a-a92a-6971cbcf38a1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:10.248357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e58b9b05-760f-468a-a92a-6971cbcf38a1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:10.248357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e58b9b05-760f-468a-a92a-6971cbcf38a1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:10.248357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e58b9b05-760f-468a-a92a-6971cbcf38a1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:10.248357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e58b9b05-760f-468a-a92a-6971cbcf38a1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:10.274686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e58b9b05-760f-468a-a92a-6971cbcf38a1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e58b9b05-760f-468a-a92a-6971cbcf38a1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Request method failure captured: Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389/diagnostics HTTP/1.1 Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFylUIrLbm2-Uk0lXjgS9giTIx-iggrahj-j6FBUfiy9_RW64SUr3U-3BNA78sFt5KIArgIT9bM17NqHtiuEW4Mqt1m1bcaZOYgqLmRfA86GJ8BRmuDiRZELbZbkdY3oxycEvHPyje0Ionx6WzsOqL_9ZanrI1XrIvMDDYvig8jSurjs Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 68d910e1900744518e3f12b3ded97a02 Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-688435909 Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68d910e1900744518e3f12b3ded97a02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68d910e1900744518e3f12b3ded97a02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68d910e1900744518e3f12b3ded97a02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68d910e1900744518e3f12b3ded97a02"}]}] Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-688435909 Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 68d910e1900744518e3f12b3ded97a02 Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-688435909 Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerDiagnosticsNegativeTest-688435909-project Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: c90fbe81777d4cfd9376bd1c412c188c Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-688435909-project Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'server_id': 'c4cd4189-c2cf-445f-8fc9-8956d1c8a389'} Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise self.value Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:10.282552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:10.287615 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:10.287615 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:10.287615 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 06 11:05:10.287615 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 06 11:05:10.287615 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 06 11:05:10.287615 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:10.287615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e58b9b05-760f-468a-a92a-6971cbcf38a1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:10.287615 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e58b9b05-760f-468a-a92a-6971cbcf38a1 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.055724 Sep 06 11:05:10.287615 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1644/3295] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:05:10 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389/diagnostics => generated 117 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:10.298137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4aec5166-e29c-4828-ab35-4b86f5418e30 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:10.298808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4aec5166-e29c-4828-ab35-4b86f5418e30 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:10.306754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4aec5166-e29c-4828-ab35-4b86f5418e30 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:10.311050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4aec5166-e29c-4828-ab35-4b86f5418e30 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:10.311050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4aec5166-e29c-4828-ab35-4b86f5418e30 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:10.311050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4aec5166-e29c-4828-ab35-4b86f5418e30 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:10.311050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4aec5166-e29c-4828-ab35-4b86f5418e30 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:10.311050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4aec5166-e29c-4828-ab35-4b86f5418e30 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:10.337414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4aec5166-e29c-4828-ab35-4b86f5418e30 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:05:10.815483 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4aec5166-e29c-4828-ab35-4b86f5418e30 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 204 len: 0 microversion: 2.1 time: 0.519511 Sep 06 11:05:10.815483 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1652/3296] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:05:10 2022] DELETE /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:05:10.823145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-78845ba3-e240-4659-b758-d780cc3f7e34 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:10.823782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-78845ba3-e240-4659-b758-d780cc3f7e34 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:10.836945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78845ba3-e240-4659-b758-d780cc3f7e34 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:10.849447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78845ba3-e240-4659-b758-d780cc3f7e34 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:10.850366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78845ba3-e240-4659-b758-d780cc3f7e34 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:10.851377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78845ba3-e240-4659-b758-d780cc3f7e34 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:10.854226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78845ba3-e240-4659-b758-d780cc3f7e34 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:10.854907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78845ba3-e240-4659-b758-d780cc3f7e34 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:11.634277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-78845ba3-e240-4659-b758-d780cc3f7e34 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:11.671968 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-78845ba3-e240-4659-b758-d780cc3f7e34 tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1478 microversion: 2.1 time: 0.852954 Sep 06 11:05:11.692009 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1645/3297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:10 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1478 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:12.035997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5ba04468-ec64-4ee1-865c-0112b5856cde tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Action: 'create', calling method: .version_select at 0x7f90f34f2c10>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1130381368", "policies": ["affinity"]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:12.094009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-5ba04468-ec64-4ee1-865c-0112b5856cde tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:12.104738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-5ba04468-ec64-4ee1-865c-0112b5856cde tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for user 25c807ed86984d78a148b08685b868af and project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:12.121944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:12.305599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-5ba04468-ec64-4ee1-865c-0112b5856cde tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:12.320381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-5ba04468-ec64-4ee1-865c-0112b5856cde tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for user 25c807ed86984d78a148b08685b868af and project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:12.353871 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5ba04468-ec64-4ee1-865c-0112b5856cde tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.536349 Sep 06 11:05:12.357391 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1653/3298] 10.222.0.20 () {60 vars in 1174 bytes} [Tue Sep 6 11:05:11 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:12.369059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-96de40c5-33f2-4a23-8225-c06123c1fbf7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Action: 'create', calling method: .version_select at 0x7f90f8b44e50>, body: {"server_group": {"name": "tempest-server-group-1694898736", "policies": ["affinity"]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:12.399948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-96de40c5-33f2-4a23-8225-c06123c1fbf7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:12.407172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-96de40c5-33f2-4a23-8225-c06123c1fbf7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for user 25c807ed86984d78a148b08685b868af and project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:12.590719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-96de40c5-33f2-4a23-8225-c06123c1fbf7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:12.600531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-96de40c5-33f2-4a23-8225-c06123c1fbf7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for user 25c807ed86984d78a148b08685b868af and project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:12.633984 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-96de40c5-33f2-4a23-8225-c06123c1fbf7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.267336 Sep 06 11:05:12.634990 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1646/3299] 10.222.0.20 () {60 vars in 1173 bytes} [Tue Sep 6 11:05:12 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:12.647868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4039b70e-fc68-47dc-b029-c9674e238933 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Action: 'create', calling method: .version_select at 0x7f90f34c1940>, body: {"server_group": {"name": "tempest-server-group-1694898736", "policies": ["affinity"]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:12.692249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-4039b70e-fc68-47dc-b029-c9674e238933 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:12.700964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-4039b70e-fc68-47dc-b029-c9674e238933 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for user 25c807ed86984d78a148b08685b868af and project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:12.705339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b0ee0e8e-b2c3-43c3-b005-ffce576e39da tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:12.706934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b0ee0e8e-b2c3-43c3-b005-ffce576e39da tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:12.737077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0ee0e8e-b2c3-43c3-b005-ffce576e39da tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:12.739529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0ee0e8e-b2c3-43c3-b005-ffce576e39da tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:12.741128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0ee0e8e-b2c3-43c3-b005-ffce576e39da tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:12.742672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0ee0e8e-b2c3-43c3-b005-ffce576e39da tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:12.743361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0ee0e8e-b2c3-43c3-b005-ffce576e39da tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:12.747344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0ee0e8e-b2c3-43c3-b005-ffce576e39da tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:12.843189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-4039b70e-fc68-47dc-b029-c9674e238933 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:12.850687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-4039b70e-fc68-47dc-b029-c9674e238933 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for user 25c807ed86984d78a148b08685b868af and project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:12.870411 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4039b70e-fc68-47dc-b029-c9674e238933 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.226672 Sep 06 11:05:12.871708 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1654/3300] 10.222.0.20 () {60 vars in 1173 bytes} [Tue Sep 6 11:05:12 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:12.885589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ffd41402-a494-4e91-837f-c77feed93aa1 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:13.025750 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ffd41402-a494-4e91-837f-c77feed93aa1 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/ff155269-1a6b-4b0f-996a-4c16bb93b13f" status: 204 len: 0 microversion: 2.1 time: 0.136263 Sep 06 11:05:13.025750 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1655/3301] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:05:12 2022] DELETE /compute/v2.1/os-server-groups/ff155269-1a6b-4b0f-996a-4c16bb93b13f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:05:13.030540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-674624c8-b2ad-4d7e-945a-3eae9217b568 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:13.042830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b0ee0e8e-b2c3-43c3-b005-ffce576e39da tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:13.064699 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-674624c8-b2ad-4d7e-945a-3eae9217b568 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.039133 Sep 06 11:05:13.065797 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1656/3302] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 11:05:13 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:13.070725 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b0ee0e8e-b2c3-43c3-b005-ffce576e39da tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1478 microversion: 2.1 time: 0.371857 Sep 06 11:05:13.078994 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1647/3303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:12 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1478 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:05:13.079185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-7626e034-369d-452a-b581-4351fc8cfc13 req-21e0d1a0-0dee-4d31-a40b-d1de783ea333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4cd4189-c2cf-445f-8fc9-8956d1c8a389", "name": "network-vif-deleted", "tag": "eb81a1bc-0930-4fb3-9d80-5d543f0bd21c"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:13.083799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-168b8efb-1050-40af-8a0c-a187d0241562 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:13.090550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7626e034-369d-452a-b581-4351fc8cfc13 req-21e0d1a0-0dee-4d31-a40b-d1de783ea333 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:13.091638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7626e034-369d-452a-b581-4351fc8cfc13 req-21e0d1a0-0dee-4d31-a40b-d1de783ea333 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:13.092279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7626e034-369d-452a-b581-4351fc8cfc13 req-21e0d1a0-0dee-4d31-a40b-d1de783ea333 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:13.108151 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-7626e034-369d-452a-b581-4351fc8cfc13 req-21e0d1a0-0dee-4d31-a40b-d1de783ea333 service nova] Creating event network-vif-deleted:eb81a1bc-0930-4fb3-9d80-5d543f0bd21c for instance c4cd4189-c2cf-445f-8fc9-8956d1c8a389 on nch1-master-1 Sep 06 11:05:13.115452 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-7626e034-369d-452a-b581-4351fc8cfc13 req-21e0d1a0-0dee-4d31-a40b-d1de783ea333 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045778 Sep 06 11:05:13.116877 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1657/3304] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:13.248078 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-168b8efb-1050-40af-8a0c-a187d0241562 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/231add9e-035e-43bc-9ff4-dae03c731bde" status: 204 len: 0 microversion: 2.1 time: 0.170287 Sep 06 11:05:13.248682 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1648/3305] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:05:13 2022] DELETE /compute/v2.1/os-server-groups/231add9e-035e-43bc-9ff4-dae03c731bde => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:05:13.262502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-16f539e4-ffff-40fa-beeb-bc4d51fcb9b4 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:13.282001 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-16f539e4-ffff-40fa-beeb-bc4d51fcb9b4 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.026663 Sep 06 11:05:13.294472 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1658/3306] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 11:05:13 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:13.304918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-95d8337e-0137-4112-8d68-09929dcf6621 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Action: 'create', calling method: .version_select at 0x7f90f8b44e50>, body: {"server_group": {"name": "tempest-server-group-2129698285", "policies": ["affinity"]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:13.330104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-95d8337e-0137-4112-8d68-09929dcf6621 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:13.335780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-95d8337e-0137-4112-8d68-09929dcf6621 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for user 25c807ed86984d78a148b08685b868af and project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:13.457173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:13.473387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-95d8337e-0137-4112-8d68-09929dcf6621 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:13.481136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-95d8337e-0137-4112-8d68-09929dcf6621 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for user 25c807ed86984d78a148b08685b868af and project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:13.500178 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-95d8337e-0137-4112-8d68-09929dcf6621 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.204432 Sep 06 11:05:13.501414 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1649/3307] 10.222.0.20 () {60 vars in 1173 bytes} [Tue Sep 6 11:05:13 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:13.514241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e4c20757-2731-435e-ac60-4a1fd82bec63 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:13.657311 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e4c20757-2731-435e-ac60-4a1fd82bec63 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/813bf267-4bda-44ff-9827-b72dff3cd14a" status: 204 len: 0 microversion: 2.1 time: 0.148998 Sep 06 11:05:13.658305 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1659/3308] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:05:13 2022] DELETE /compute/v2.1/os-server-groups/813bf267-4bda-44ff-9827-b72dff3cd14a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:05:13.668656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b6435967-b261-4fe9-8e74-b7f1a28be3fd tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:13.697199 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b6435967-b261-4fe9-8e74-b7f1a28be3fd tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.034665 Sep 06 11:05:13.698199 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1650/3309] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 11:05:13 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:13.712807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2057991e-65ee-4dc6-a1b8-59913175b492 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Action: 'create', calling method: .version_select at 0x7f90f349f160>, body: {"server_group": {"name": "tempest-server-group-1043611811", "policies": ["anti-affinity"]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:13.739598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-2057991e-65ee-4dc6-a1b8-59913175b492 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:13.745057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-2057991e-65ee-4dc6-a1b8-59913175b492 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for user 25c807ed86984d78a148b08685b868af and project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:13.868010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-2057991e-65ee-4dc6-a1b8-59913175b492 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:13.877388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-2057991e-65ee-4dc6-a1b8-59913175b492 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for user 25c807ed86984d78a148b08685b868af and project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_groups'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:13.898477 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2057991e-65ee-4dc6-a1b8-59913175b492 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.189934 Sep 06 11:05:13.899213 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1660/3310] 10.222.0.20 () {60 vars in 1173 bytes} [Tue Sep 6 11:05:13 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:13.917588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aaf512e3-9c6c-4d70-8ffd-525c89fd667c tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:14.041849 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aaf512e3-9c6c-4d70-8ffd-525c89fd667c tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/40a77a93-b080-4035-b2ad-d213cd8f21ce" status: 204 len: 0 microversion: 2.1 time: 0.134816 Sep 06 11:05:14.041849 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1651/3311] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:05:13 2022] DELETE /compute/v2.1/os-server-groups/40a77a93-b080-4035-b2ad-d213cd8f21ce => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:05:14.050352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5a05643e-f2ac-4416-b73f-4aa5a1164ddb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:14.062590 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5a05643e-f2ac-4416-b73f-4aa5a1164ddb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016030 Sep 06 11:05:14.064851 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1661/3312] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 11:05:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:14.102397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:14.103244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:14.110565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:14.111091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:14.111545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:14.112403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:14.112876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:14.113318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:14.164037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:14.164567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:14.165012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:14.165839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lazy-loading 'fault' on Instance uuid c4cd4189-c2cf-445f-8fc9-8956d1c8a389 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:05:14.195964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-940516300", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "6d074047-96dc-47dc-9eb5-0323f74cf595"}]}, "os:scheduler_hints": {"group": "31f3813a-e2c2-4678-b79d-a2429437b5dc"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:14.247458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90fbe81777d4cfd9376bd1c412c188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d910e1900744518e3f12b3ded97a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:14.271877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] validate_networks() for [('6d074047-96dc-47dc-9eb5-0323f74cf595', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:05:14.273170 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2ad72710-1a28-447e-94f3-95826ab9e10b tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 200 len: 1312 microversion: 2.1 time: 0.174429 Sep 06 11:05:14.274255 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1652/3313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:14 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:05:14.710714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:05:14.711300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:05:14.711779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:05:14.712192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:05:14.712608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:05:14.722383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:14.729195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:14.729683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:14.730180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:14.730931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:14.731422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:14.731889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:14.750811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:14.759279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for user 25c807ed86984d78a148b08685b868af and project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:14.773487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:05:14.775976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:05:14.908910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140876) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 06 11:05:14.936671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_group_members'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:14.950172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for user 25c807ed86984d78a148b08685b868af and project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_group_members'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:15.074501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_group_members'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:15.088349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Getting quotas for user 25c807ed86984d78a148b08685b868af and project ccbfa77f07dd4e69acfbea7657a922fd. Resources: {'server_group_members'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:15.129587 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-06fa3c4e-7a9b-4543-a090-aa74c4e11b75 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939659 Sep 06 11:05:15.130579 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1662/3314] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:05:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:05:15.144584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5df789eb-002f-4a23-a5b2-af84f55e85aa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:15.145211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5df789eb-002f-4a23-a5b2-af84f55e85aa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:15.219626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5df789eb-002f-4a23-a5b2-af84f55e85aa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:15.231191 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5df789eb-002f-4a23-a5b2-af84f55e85aa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1212 microversion: 2.1 time: 0.093129 Sep 06 11:05:15.235174 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1653/3315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:15 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:15.298399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0c66a3e2-8d97-4a98-a075-a362ced20ebf tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:15.299241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0c66a3e2-8d97-4a98-a075-a362ced20ebf tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] [instance: c4cd4189-c2cf-445f-8fc9-8956d1c8a389] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:15.305960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c66a3e2-8d97-4a98-a075-a362ced20ebf tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:15.306520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c66a3e2-8d97-4a98-a075-a362ced20ebf tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:15.306923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c66a3e2-8d97-4a98-a075-a362ced20ebf tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:15.307700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c66a3e2-8d97-4a98-a075-a362ced20ebf tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:15.308168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c66a3e2-8d97-4a98-a075-a362ced20ebf tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:15.308757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c66a3e2-8d97-4a98-a075-a362ced20ebf tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:15.338993 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-0c66a3e2-8d97-4a98-a075-a362ced20ebf tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] HTTP exception thrown: Instance c4cd4189-c2cf-445f-8fc9-8956d1c8a389 could not be found. Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0c66a3e2-8d97-4a98-a075-a362ced20ebf tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Request method failure captured: Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 HTTP/1.1 Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFylUIrLbm2-Uk0lXjgS9giTIx-iggrahj-j6FBUfiy9_RW64SUr3U-3BNA78sFt5KIArgIT9bM17NqHtiuEW4Mqt1m1bcaZOYgqLmRfA86GJ8BRmuDiRZELbZbkdY3oxycEvHPyje0Ionx6WzsOqL_9ZanrI1XrIvMDDYvig8jSurjs Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 68d910e1900744518e3f12b3ded97a02 Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-688435909 Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68d910e1900744518e3f12b3ded97a02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68d910e1900744518e3f12b3ded97a02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68d910e1900744518e3f12b3ded97a02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68d910e1900744518e3f12b3ded97a02"}]}] Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-688435909 Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 68d910e1900744518e3f12b3ded97a02 Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-688435909 Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerDiagnosticsNegativeTest-688435909-project Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: c90fbe81777d4cfd9376bd1c412c188c Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-688435909-project Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance c4cd4189-c2cf-445f-8fc9-8956d1c8a389 could not be found. Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'c4cd4189-c2cf-445f-8fc9-8956d1c8a389'} Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4cd4189-c2cf-445f-8fc9-8956d1c8a389 could not be found. Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4cd4189-c2cf-445f-8fc9-8956d1c8a389 could not be found. Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:15.340707 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:15.348521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:15.348521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:15.348521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:15.348521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:15.348521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:15.348521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:15.348521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4cd4189-c2cf-445f-8fc9-8956d1c8a389 could not be found. Sep 06 11:05:15.348521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:15.348521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0c66a3e2-8d97-4a98-a075-a362ced20ebf tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] Returning 404 to user: Instance c4cd4189-c2cf-445f-8fc9-8956d1c8a389 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:15.348521 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0c66a3e2-8d97-4a98-a075-a362ced20ebf tempest-ServerDiagnosticsNegativeTest-688435909 tempest-ServerDiagnosticsNegativeTest-688435909-project] 10.222.0.20 "GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389" status: 404 len: 111 microversion: 2.1 time: 0.048157 Sep 06 11:05:15.348521 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1663/3316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:15 2022] GET /compute/v2.1/servers/c4cd4189-c2cf-445f-8fc9-8956d1c8a389 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:16.256642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-475fb20d-e723-4cdc-bbbc-21100a8903eb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:16.257335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-475fb20d-e723-4cdc-bbbc-21100a8903eb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:16.356548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-475fb20d-e723-4cdc-bbbc-21100a8903eb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:16.367523 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-475fb20d-e723-4cdc-bbbc-21100a8903eb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1212 microversion: 2.1 time: 0.115205 Sep 06 11:05:16.371035 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1664/3317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:16 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1212 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:16.487393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ba743b86-1b5b-4a52-a750-edd1618541c2 tempest-PortsAdminExtendedAttrsTestJSON-1578786502 tempest-PortsAdminExtendedAttrsTestJSON-1578786502-project-admin] Calling method '.version_select at 0x7f90f8600550>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:16.489714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba743b86-1b5b-4a52-a750-edd1618541c2 tempest-PortsAdminExtendedAttrsTestJSON-1578786502 tempest-PortsAdminExtendedAttrsTestJSON-1578786502-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:16.490208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba743b86-1b5b-4a52-a750-edd1618541c2 tempest-PortsAdminExtendedAttrsTestJSON-1578786502 tempest-PortsAdminExtendedAttrsTestJSON-1578786502-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:16.490651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba743b86-1b5b-4a52-a750-edd1618541c2 tempest-PortsAdminExtendedAttrsTestJSON-1578786502 tempest-PortsAdminExtendedAttrsTestJSON-1578786502-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:16.507749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba743b86-1b5b-4a52-a750-edd1618541c2 tempest-PortsAdminExtendedAttrsTestJSON-1578786502 tempest-PortsAdminExtendedAttrsTestJSON-1578786502-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:16.508207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba743b86-1b5b-4a52-a750-edd1618541c2 tempest-PortsAdminExtendedAttrsTestJSON-1578786502 tempest-PortsAdminExtendedAttrsTestJSON-1578786502-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:16.508918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba743b86-1b5b-4a52-a750-edd1618541c2 tempest-PortsAdminExtendedAttrsTestJSON-1578786502 tempest-PortsAdminExtendedAttrsTestJSON-1578786502-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:16.522907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba743b86-1b5b-4a52-a750-edd1618541c2 tempest-PortsAdminExtendedAttrsTestJSON-1578786502 tempest-PortsAdminExtendedAttrsTestJSON-1578786502-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:16.523443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba743b86-1b5b-4a52-a750-edd1618541c2 tempest-PortsAdminExtendedAttrsTestJSON-1578786502 tempest-PortsAdminExtendedAttrsTestJSON-1578786502-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:16.523892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba743b86-1b5b-4a52-a750-edd1618541c2 tempest-PortsAdminExtendedAttrsTestJSON-1578786502 tempest-PortsAdminExtendedAttrsTestJSON-1578786502-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:16.533962 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ba743b86-1b5b-4a52-a750-edd1618541c2 tempest-PortsAdminExtendedAttrsTestJSON-1578786502 tempest-PortsAdminExtendedAttrsTestJSON-1578786502-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.283741 Sep 06 11:05:16.541209 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1654/3318] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 11:05:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:17.372507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e6af854-89fb-4061-96d1-1d273a41dd1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:17.375600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4e6af854-89fb-4061-96d1-1d273a41dd1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:17.381991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e6af854-89fb-4061-96d1-1d273a41dd1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:17.382977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e6af854-89fb-4061-96d1-1d273a41dd1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:17.384059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e6af854-89fb-4061-96d1-1d273a41dd1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:17.384792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e6af854-89fb-4061-96d1-1d273a41dd1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:17.385257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e6af854-89fb-4061-96d1-1d273a41dd1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:17.385696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e6af854-89fb-4061-96d1-1d273a41dd1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:17.394469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-166db907-2969-484e-9e0f-175c37726e5b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:17.395695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-166db907-2969-484e-9e0f-175c37726e5b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:17.407308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-166db907-2969-484e-9e0f-175c37726e5b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:17.408128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-166db907-2969-484e-9e0f-175c37726e5b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:17.408810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-166db907-2969-484e-9e0f-175c37726e5b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:17.410154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-166db907-2969-484e-9e0f-175c37726e5b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:17.410991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-166db907-2969-484e-9e0f-175c37726e5b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:17.411956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-166db907-2969-484e-9e0f-175c37726e5b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:17.526369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-166db907-2969-484e-9e0f-175c37726e5b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:17.540097 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-166db907-2969-484e-9e0f-175c37726e5b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1208 microversion: 2.1 time: 0.148664 Sep 06 11:05:17.545145 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1655/3319] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:17 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1208 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:17.644645 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e6af854-89fb-4061-96d1-1d273a41dd1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.494577 Sep 06 11:05:17.646047 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1665/3320] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:05:17 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:05:17.654196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-184f7a76-fc44-4cf0-8d71-683cab034165 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:17.655249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-184f7a76-fc44-4cf0-8d71-683cab034165 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:17.665521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-184f7a76-fc44-4cf0-8d71-683cab034165 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:17.666364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-184f7a76-fc44-4cf0-8d71-683cab034165 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:17.668762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-184f7a76-fc44-4cf0-8d71-683cab034165 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:17.669602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-184f7a76-fc44-4cf0-8d71-683cab034165 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:17.672772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-184f7a76-fc44-4cf0-8d71-683cab034165 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:17.673361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-184f7a76-fc44-4cf0-8d71-683cab034165 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:17.683109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:18.027908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-184f7a76-fc44-4cf0-8d71-683cab034165 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:18.045498 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-184f7a76-fc44-4cf0-8d71-683cab034165 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1670 microversion: 2.1 time: 0.395285 Sep 06 11:05:18.046154 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1656/3321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:17 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1670 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:05:18.571236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-970f3efd-e4c9-45d8-a72d-5f2d1081374b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:18.575727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-970f3efd-e4c9-45d8-a72d-5f2d1081374b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:18.596459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-970f3efd-e4c9-45d8-a72d-5f2d1081374b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:18.596952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-970f3efd-e4c9-45d8-a72d-5f2d1081374b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:18.599411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-970f3efd-e4c9-45d8-a72d-5f2d1081374b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:18.602712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-970f3efd-e4c9-45d8-a72d-5f2d1081374b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:18.605700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-970f3efd-e4c9-45d8-a72d-5f2d1081374b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:18.607942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-970f3efd-e4c9-45d8-a72d-5f2d1081374b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:18.880032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-970f3efd-e4c9-45d8-a72d-5f2d1081374b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:18.894729 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-970f3efd-e4c9-45d8-a72d-5f2d1081374b tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1272 microversion: 2.1 time: 0.329618 Sep 06 11:05:18.896188 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1666/3322] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:18 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1272 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:19.070821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0405cafa-08dd-4766-af46-1c2d8a28293e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:19.072100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0405cafa-08dd-4766-af46-1c2d8a28293e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:19.096770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0405cafa-08dd-4766-af46-1c2d8a28293e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:19.098553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0405cafa-08dd-4766-af46-1c2d8a28293e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:19.099223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0405cafa-08dd-4766-af46-1c2d8a28293e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:19.100186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0405cafa-08dd-4766-af46-1c2d8a28293e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:19.100968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0405cafa-08dd-4766-af46-1c2d8a28293e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:19.101599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0405cafa-08dd-4766-af46-1c2d8a28293e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:19.314213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0405cafa-08dd-4766-af46-1c2d8a28293e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:19.337231 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0405cafa-08dd-4766-af46-1c2d8a28293e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1670 microversion: 2.1 time: 0.271740 Sep 06 11:05:19.337954 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1657/3323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:19 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1670 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:19.926637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c3143e35-b463-49f0-9f4b-c3670c2a1b51 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:19.927292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c3143e35-b463-49f0-9f4b-c3670c2a1b51 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:19.936149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3143e35-b463-49f0-9f4b-c3670c2a1b51 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:19.941020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3143e35-b463-49f0-9f4b-c3670c2a1b51 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:19.941020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3143e35-b463-49f0-9f4b-c3670c2a1b51 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:19.941020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3143e35-b463-49f0-9f4b-c3670c2a1b51 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:19.941020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3143e35-b463-49f0-9f4b-c3670c2a1b51 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:19.941020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3143e35-b463-49f0-9f4b-c3670c2a1b51 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:20.073515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c3143e35-b463-49f0-9f4b-c3670c2a1b51 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:20.082324 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c3143e35-b463-49f0-9f4b-c3670c2a1b51 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1270 microversion: 2.1 time: 0.161758 Sep 06 11:05:20.082909 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1667/3324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:19 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:20.370475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cb5643f4-54f9-478f-b5c6-ec80f24c19d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:20.371157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cb5643f4-54f9-478f-b5c6-ec80f24c19d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:20.383134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb5643f4-54f9-478f-b5c6-ec80f24c19d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:20.384388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb5643f4-54f9-478f-b5c6-ec80f24c19d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:20.386056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb5643f4-54f9-478f-b5c6-ec80f24c19d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:20.387541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb5643f4-54f9-478f-b5c6-ec80f24c19d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:20.390789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb5643f4-54f9-478f-b5c6-ec80f24c19d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:20.392449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb5643f4-54f9-478f-b5c6-ec80f24c19d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:20.951836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cb5643f4-54f9-478f-b5c6-ec80f24c19d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:20.960203 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cb5643f4-54f9-478f-b5c6-ec80f24c19d0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.594280 Sep 06 11:05:20.960879 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1658/3325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:20 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:05:21.113300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ddb47a55-7bba-403e-bfaa-975ae4c7e010 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:21.114466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ddb47a55-7bba-403e-bfaa-975ae4c7e010 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:21.121736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddb47a55-7bba-403e-bfaa-975ae4c7e010 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:21.122484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddb47a55-7bba-403e-bfaa-975ae4c7e010 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:21.123167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddb47a55-7bba-403e-bfaa-975ae4c7e010 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:21.124728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddb47a55-7bba-403e-bfaa-975ae4c7e010 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:21.125359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddb47a55-7bba-403e-bfaa-975ae4c7e010 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:21.125954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddb47a55-7bba-403e-bfaa-975ae4c7e010 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:21.363931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ddb47a55-7bba-403e-bfaa-975ae4c7e010 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:21.374789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:21.380648 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ddb47a55-7bba-403e-bfaa-975ae4c7e010 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1312 microversion: 2.1 time: 0.271109 Sep 06 11:05:21.394242 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1668/3326] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:21 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1312 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:21.919692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-848797743", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": "none"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:21.982250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:05:21.982994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:05:21.983542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:05:21.985215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:05:21.985859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:05:21.995405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:21.995937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:21.996385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:21.997130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:21.997598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:21.998040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:22.017498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Getting quotas for project 53043c49bd5c4591bbfc72c443cf66ee. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:22.023124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Getting quotas for user 87109fdea86d40f38dc8dbeb664b9e5c and project 53043c49bd5c4591bbfc72c443cf66ee. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:22.037666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:05:22.041018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:05:22.170216 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e01602ef-85dd-479d-9bdd-13ed56fa9038 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.452188 Sep 06 11:05:22.171678 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1659/3327] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 11:05:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 11:05:22.184227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8a38bca3-4084-4238-972f-e617c4858afb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:22.188914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8a38bca3-4084-4238-972f-e617c4858afb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:22.410788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-10d0e239-f2ea-4a4e-b833-876e3a635ac0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:22.411709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-10d0e239-f2ea-4a4e-b833-876e3a635ac0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:22.425536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10d0e239-f2ea-4a4e-b833-876e3a635ac0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:22.426996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10d0e239-f2ea-4a4e-b833-876e3a635ac0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:22.428600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10d0e239-f2ea-4a4e-b833-876e3a635ac0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:22.431379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10d0e239-f2ea-4a4e-b833-876e3a635ac0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:22.432917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10d0e239-f2ea-4a4e-b833-876e3a635ac0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:22.434185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10d0e239-f2ea-4a4e-b833-876e3a635ac0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:22.703647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8a38bca3-4084-4238-972f-e617c4858afb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:22.737105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8a38bca3-4084-4238-972f-e617c4858afb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:22.739423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8a38bca3-4084-4238-972f-e617c4858afb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:22.746987 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8a38bca3-4084-4238-972f-e617c4858afb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1452 microversion: 2.91 time: 0.567469 Sep 06 11:05:22.748370 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1669/3328] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:22 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1452 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:22.809988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-46b459c4-81d1-4de7-8508-93c0250abc90 req-689acd0c-67ad-435e-9878-b35c0dc63b32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef1eb4f8-7766-40df-9650-11d2a3dd7886", "tag": "7f28b74c-d700-4e89-a2b8-13b21b98422a"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:22.822620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-46b459c4-81d1-4de7-8508-93c0250abc90 req-689acd0c-67ad-435e-9878-b35c0dc63b32 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:22.824359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-46b459c4-81d1-4de7-8508-93c0250abc90 req-689acd0c-67ad-435e-9878-b35c0dc63b32 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:22.824997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-46b459c4-81d1-4de7-8508-93c0250abc90 req-689acd0c-67ad-435e-9878-b35c0dc63b32 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:22.838964 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-46b459c4-81d1-4de7-8508-93c0250abc90 req-689acd0c-67ad-435e-9878-b35c0dc63b32 service nova] Creating event network-changed:7f28b74c-d700-4e89-a2b8-13b21b98422a for instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 on nch1-master-1 Sep 06 11:05:22.846243 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-46b459c4-81d1-4de7-8508-93c0250abc90 req-689acd0c-67ad-435e-9878-b35c0dc63b32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041138 Sep 06 11:05:22.847329 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1670/3329] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:22.919791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-10d0e239-f2ea-4a4e-b833-876e3a635ac0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:22.942612 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-10d0e239-f2ea-4a4e-b833-876e3a635ac0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1312 microversion: 2.1 time: 0.537757 Sep 06 11:05:22.943376 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1660/3330] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:22 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1312 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:05:23.789407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ac4e0859-f731-4ae7-857d-aea121a56636 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:23.792173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ac4e0859-f731-4ae7-857d-aea121a56636 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:23.830318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac4e0859-f731-4ae7-857d-aea121a56636 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:23.831876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac4e0859-f731-4ae7-857d-aea121a56636 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:23.832352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac4e0859-f731-4ae7-857d-aea121a56636 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:23.836189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac4e0859-f731-4ae7-857d-aea121a56636 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:23.838467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac4e0859-f731-4ae7-857d-aea121a56636 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:23.839037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac4e0859-f731-4ae7-857d-aea121a56636 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:23.955198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8f2c647b-5f85-4337-b86d-8de985a5d3c6 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] Action: 'create', calling method: .version_select at 0x7f90f8600b80>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:23.987291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ac4e0859-f731-4ae7-857d-aea121a56636 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:23.997426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ac4e0859-f731-4ae7-857d-aea121a56636 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:24.004686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ac4e0859-f731-4ae7-857d-aea121a56636 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:24.010344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8f2c647b-5f85-4337-b86d-8de985a5d3c6 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] Getting quotas for project 4cd27d5a79694b75923fb286a79dab47. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:24.016181 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ac4e0859-f731-4ae7-857d-aea121a56636 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1456 microversion: 2.91 time: 0.240690 Sep 06 11:05:24.021011 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1671/3331] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:23 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1456 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:24.023199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8f2c647b-5f85-4337-b86d-8de985a5d3c6 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] Getting quotas for user c7e6cd5d849746e8b2285ff04a23dfbb and project 4cd27d5a79694b75923fb286a79dab47. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:24.037885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0c236595-8c9e-4b73-b776-2aa689c31871 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:24.038614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0c236595-8c9e-4b73-b776-2aa689c31871 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:24.057620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c236595-8c9e-4b73-b776-2aa689c31871 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:24.061230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c236595-8c9e-4b73-b776-2aa689c31871 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:24.061230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c236595-8c9e-4b73-b776-2aa689c31871 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:24.061230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c236595-8c9e-4b73-b776-2aa689c31871 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:24.061230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c236595-8c9e-4b73-b776-2aa689c31871 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:24.061230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c236595-8c9e-4b73-b776-2aa689c31871 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:24.212050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8f2c647b-5f85-4337-b86d-8de985a5d3c6 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] Getting quotas for project 4cd27d5a79694b75923fb286a79dab47. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:24.220213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8f2c647b-5f85-4337-b86d-8de985a5d3c6 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] Getting quotas for user c7e6cd5d849746e8b2285ff04a23dfbb and project 4cd27d5a79694b75923fb286a79dab47. Resources: {'server_groups'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:24.227941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0c236595-8c9e-4b73-b776-2aa689c31871 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:24.240785 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0c236595-8c9e-4b73-b776-2aa689c31871 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1312 microversion: 2.1 time: 0.218402 Sep 06 11:05:24.242577 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1672/3332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:24 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1312 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:24.262305 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8f2c647b-5f85-4337-b86d-8de985a5d3c6 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.393909 Sep 06 11:05:24.262305 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1661/3333] 10.222.0.20 () {62 vars in 1214 bytes} [Tue Sep 6 11:05:23 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:05:24.272507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8d6ca1ed-3c31-4396-9f53-58905c93f153 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:24.290931 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8d6ca1ed-3c31-4396-9f53-58905c93f153 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.022285 Sep 06 11:05:24.292533 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1673/3334] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 6 11:05:24 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:05:24.304161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8ffbaf00-b200-49ad-93e8-9a30ce03cc8f tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:24.314779 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8ffbaf00-b200-49ad-93e8-9a30ce03cc8f tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/20a8b5fa-d1cd-4060-bf98-28d4aeb73b76" status: 200 len: 235 microversion: 2.64 time: 0.014416 Sep 06 11:05:24.315550 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1662/3335] 10.222.0.20 () {60 vars in 1304 bytes} [Tue Sep 6 11:05:24 2022] GET /compute/v2.1/os-server-groups/20a8b5fa-d1cd-4060-bf98-28d4aeb73b76 => generated 235 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:05:24.326725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b6ea0160-f6dd-4020-82c3-6aab0a869fc9 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:24.471169 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b6ea0160-f6dd-4020-82c3-6aab0a869fc9 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/20a8b5fa-d1cd-4060-bf98-28d4aeb73b76" status: 204 len: 0 microversion: 2.64 time: 0.148462 Sep 06 11:05:24.471839 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1674/3336] 10.222.0.20 () {60 vars in 1307 bytes} [Tue Sep 6 11:05:24 2022] DELETE /compute/v2.1/os-server-groups/20a8b5fa-d1cd-4060-bf98-28d4aeb73b76 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:05:24.482481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bbe01b76-3809-444c-9757-1a4e4d6f9cb7 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:24.490338 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-bbe01b76-3809-444c-9757-1a4e4d6f9cb7 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] HTTP exception thrown: Instance group 20a8b5fa-d1cd-4060-bf98-28d4aeb73b76 could not be found. Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bbe01b76-3809-444c-9757-1a4e4d6f9cb7 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] Request method failure captured: Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/os-server-groups/20a8b5fa-d1cd-4060-bf98-28d4aeb73b76 HTTP/1.1 Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFylzW2IqAxhpqOnuZsFlh4IuNcSM-reOMbXQtxQAmtAFiMbXEJ2nFxlm2_cgXYZu4Uq1r3KiskYvojc-I-jv7G7y-11TB7LCDTZjzEOKiK6goKmTa8lPmnSS-vdWFAFwOAdo_4rKRo9CF_GRl2q-MpxXImIraNzAt32uUb1aKb2WXZQ Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.64 Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 4cd27d5a79694b75923fb286a79dab47 Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerGroup264TestJSON-1410879939 Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4cd27d5a79694b75923fb286a79dab47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4cd27d5a79694b75923fb286a79dab47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4cd27d5a79694b75923fb286a79dab47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4cd27d5a79694b75923fb286a79dab47"}]}] Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerGroup264TestJSON-1410879939 Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 4cd27d5a79694b75923fb286a79dab47 Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1410879939 Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerGroup264TestJSON-1410879939-project Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: c7e6cd5d849746e8b2285ff04a23dfbb Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerGroup264TestJSON-1410879939-project Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance group 20a8b5fa-d1cd-4060-bf98-28d4aeb73b76 could not be found. Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '20a8b5fa-d1cd-4060-bf98-28d4aeb73b76'} Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 20a8b5fa-d1cd-4060-bf98-28d4aeb73b76 could not be found. Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 20a8b5fa-d1cd-4060-bf98-28d4aeb73b76 could not be found. Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:24.497315 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:24.509087 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:24.509087 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:24.509087 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:24.509087 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:24.509087 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 20a8b5fa-d1cd-4060-bf98-28d4aeb73b76 could not be found. Sep 06 11:05:24.509087 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:24.509087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bbe01b76-3809-444c-9757-1a4e4d6f9cb7 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] Returning 404 to user: Instance group 20a8b5fa-d1cd-4060-bf98-28d4aeb73b76 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:24.509087 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bbe01b76-3809-444c-9757-1a4e4d6f9cb7 tempest-ServerGroup264TestJSON-1410879939 tempest-ServerGroup264TestJSON-1410879939-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/20a8b5fa-d1cd-4060-bf98-28d4aeb73b76" status: 404 len: 117 microversion: 2.64 time: 0.021048 Sep 06 11:05:24.509087 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1663/3337] 10.222.0.20 () {60 vars in 1307 bytes} [Tue Sep 6 11:05:24 2022] DELETE /compute/v2.1/os-server-groups/20a8b5fa-d1cd-4060-bf98-28d4aeb73b76 => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:05:25.049878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:25.055067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-56850cb7-bb28-4917-a240-53c93b7db00d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:25.057658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-56850cb7-bb28-4917-a240-53c93b7db00d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:25.063412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56850cb7-bb28-4917-a240-53c93b7db00d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:25.063926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56850cb7-bb28-4917-a240-53c93b7db00d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:25.064572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56850cb7-bb28-4917-a240-53c93b7db00d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:25.065280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56850cb7-bb28-4917-a240-53c93b7db00d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:25.066110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56850cb7-bb28-4917-a240-53c93b7db00d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:25.067121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56850cb7-bb28-4917-a240-53c93b7db00d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:25.270481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-457baef7-c49f-4c93-9a5b-0cb9e9543b35 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:25.276032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-457baef7-c49f-4c93-9a5b-0cb9e9543b35 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:25.299048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-457baef7-c49f-4c93-9a5b-0cb9e9543b35 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:25.301330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-457baef7-c49f-4c93-9a5b-0cb9e9543b35 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:25.301330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-457baef7-c49f-4c93-9a5b-0cb9e9543b35 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:25.303415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-457baef7-c49f-4c93-9a5b-0cb9e9543b35 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:25.303903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-457baef7-c49f-4c93-9a5b-0cb9e9543b35 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:25.304449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-457baef7-c49f-4c93-9a5b-0cb9e9543b35 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:25.378395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-56850cb7-bb28-4917-a240-53c93b7db00d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:25.388279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-56850cb7-bb28-4917-a240-53c93b7db00d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:25.389907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-56850cb7-bb28-4917-a240-53c93b7db00d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:25.395817 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-56850cb7-bb28-4917-a240-53c93b7db00d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1504 microversion: 2.91 time: 0.346732 Sep 06 11:05:25.396764 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1675/3338] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:25 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:25.713592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-457baef7-c49f-4c93-9a5b-0cb9e9543b35 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:25.724343 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-457baef7-c49f-4c93-9a5b-0cb9e9543b35 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1312 microversion: 2.1 time: 0.458337 Sep 06 11:05:25.731874 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1664/3339] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:25 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1312 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:26.428799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-693d3d14-6fbd-4715-844b-02f348d4b115 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:26.430304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-693d3d14-6fbd-4715-844b-02f348d4b115 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:26.440978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-693d3d14-6fbd-4715-844b-02f348d4b115 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:26.442222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-693d3d14-6fbd-4715-844b-02f348d4b115 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:26.442969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-693d3d14-6fbd-4715-844b-02f348d4b115 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:26.443932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-693d3d14-6fbd-4715-844b-02f348d4b115 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:26.444506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-693d3d14-6fbd-4715-844b-02f348d4b115 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:26.445043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-693d3d14-6fbd-4715-844b-02f348d4b115 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:26.568657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-693d3d14-6fbd-4715-844b-02f348d4b115 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:26.581185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-693d3d14-6fbd-4715-844b-02f348d4b115 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:26.583236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-693d3d14-6fbd-4715-844b-02f348d4b115 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:26.590720 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-693d3d14-6fbd-4715-844b-02f348d4b115 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1510 microversion: 2.91 time: 0.166841 Sep 06 11:05:26.592061 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1676/3340] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:26 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:26.749704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bdf49fb9-1490-45ea-99d6-c21eede26b67 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:26.750985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bdf49fb9-1490-45ea-99d6-c21eede26b67 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:26.759295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdf49fb9-1490-45ea-99d6-c21eede26b67 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:26.759861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdf49fb9-1490-45ea-99d6-c21eede26b67 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:26.760322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdf49fb9-1490-45ea-99d6-c21eede26b67 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:26.761039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdf49fb9-1490-45ea-99d6-c21eede26b67 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:26.761509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdf49fb9-1490-45ea-99d6-c21eede26b67 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:26.761948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdf49fb9-1490-45ea-99d6-c21eede26b67 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:27.001972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bdf49fb9-1490-45ea-99d6-c21eede26b67 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:27.032516 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bdf49fb9-1490-45ea-99d6-c21eede26b67 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1312 microversion: 2.1 time: 0.268050 Sep 06 11:05:27.035921 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1665/3341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:26 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1312 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:27.620864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-45c21188-4e57-4420-b9c5-8680c84c1734 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:27.622438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-45c21188-4e57-4420-b9c5-8680c84c1734 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:27.630151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-45c21188-4e57-4420-b9c5-8680c84c1734 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:27.630742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-45c21188-4e57-4420-b9c5-8680c84c1734 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:27.631286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-45c21188-4e57-4420-b9c5-8680c84c1734 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:27.633527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-45c21188-4e57-4420-b9c5-8680c84c1734 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:27.634300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-45c21188-4e57-4420-b9c5-8680c84c1734 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:27.634820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-45c21188-4e57-4420-b9c5-8680c84c1734 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:27.735479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-45c21188-4e57-4420-b9c5-8680c84c1734 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:27.754519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-45c21188-4e57-4420-b9c5-8680c84c1734 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:27.758384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-45c21188-4e57-4420-b9c5-8680c84c1734 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:27.767253 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-45c21188-4e57-4420-b9c5-8680c84c1734 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1510 microversion: 2.91 time: 0.150169 Sep 06 11:05:27.768795 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1677/3342] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:27 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:28.066511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff9dc6a9-f976-41d0-981a-3d0822798950 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:28.071352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff9dc6a9-f976-41d0-981a-3d0822798950 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:28.085445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff9dc6a9-f976-41d0-981a-3d0822798950 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:28.086805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff9dc6a9-f976-41d0-981a-3d0822798950 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:28.087843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff9dc6a9-f976-41d0-981a-3d0822798950 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:28.090796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff9dc6a9-f976-41d0-981a-3d0822798950 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:28.092737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff9dc6a9-f976-41d0-981a-3d0822798950 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:28.094124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff9dc6a9-f976-41d0-981a-3d0822798950 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:28.643474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff9dc6a9-f976-41d0-981a-3d0822798950 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:28.665096 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff9dc6a9-f976-41d0-981a-3d0822798950 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1312 microversion: 2.1 time: 0.609625 Sep 06 11:05:28.667210 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1666/3343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:28 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1312 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:28.798048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-77371a92-ed46-482f-857a-30134f410671 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:28.799341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-77371a92-ed46-482f-857a-30134f410671 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:28.808584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77371a92-ed46-482f-857a-30134f410671 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:28.810666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77371a92-ed46-482f-857a-30134f410671 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:28.811702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77371a92-ed46-482f-857a-30134f410671 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:28.812741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77371a92-ed46-482f-857a-30134f410671 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:28.813370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77371a92-ed46-482f-857a-30134f410671 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:28.813887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77371a92-ed46-482f-857a-30134f410671 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:28.969526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77371a92-ed46-482f-857a-30134f410671 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:28.981304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77371a92-ed46-482f-857a-30134f410671 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:28.988593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77371a92-ed46-482f-857a-30134f410671 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:28.999216 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-77371a92-ed46-482f-857a-30134f410671 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1531 microversion: 2.91 time: 0.205498 Sep 06 11:05:29.000616 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1678/3344] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:28 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1531 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:29.094940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4e39b08d-c2bf-41c0-b56c-52c1c2e7114d tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:29.095625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4e39b08d-c2bf-41c0-b56c-52c1c2e7114d tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:29.104975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e39b08d-c2bf-41c0-b56c-52c1c2e7114d tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:29.105595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e39b08d-c2bf-41c0-b56c-52c1c2e7114d tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:29.106269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e39b08d-c2bf-41c0-b56c-52c1c2e7114d tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:29.107333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e39b08d-c2bf-41c0-b56c-52c1c2e7114d tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:29.108056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e39b08d-c2bf-41c0-b56c-52c1c2e7114d tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:29.108678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e39b08d-c2bf-41c0-b56c-52c1c2e7114d tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:29.233803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-4e39b08d-c2bf-41c0-b56c-52c1c2e7114d tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lazy-loading 'services' on Instance uuid 16d64eaf-0686-4d18-8b21-1eb52f4cda77 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:05:29.261218 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4e39b08d-c2bf-41c0-b56c-52c1c2e7114d tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1936 microversion: 2.91 time: 0.235626 Sep 06 11:05:29.263783 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1667/3345] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:29 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1936 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:29.306791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4164d0eb-5e0f-4527-a5db-9a8c04967d6e tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:29.308650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4164d0eb-5e0f-4527-a5db-9a8c04967d6e tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:29.309853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f5c9573b-414d-453b-af4d-58e0ca375fa9 req-0fc5c41b-282b-4e35-8997-0509f379621b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1eb4f8-7766-40df-9650-11d2a3dd7886", "name": "network-vif-plugged", "status": "completed", "tag": "7f28b74c-d700-4e89-a2b8-13b21b98422a"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:29.320306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=5 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:29.327905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4164d0eb-5e0f-4527-a5db-9a8c04967d6e tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:29.330877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4164d0eb-5e0f-4527-a5db-9a8c04967d6e tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:29.331958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4164d0eb-5e0f-4527-a5db-9a8c04967d6e tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:29.333358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4164d0eb-5e0f-4527-a5db-9a8c04967d6e tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:29.334345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4164d0eb-5e0f-4527-a5db-9a8c04967d6e tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:29.336892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4164d0eb-5e0f-4527-a5db-9a8c04967d6e tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:29.343990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f5c9573b-414d-453b-af4d-58e0ca375fa9 req-0fc5c41b-282b-4e35-8997-0509f379621b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:29.344923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f5c9573b-414d-453b-af4d-58e0ca375fa9 req-0fc5c41b-282b-4e35-8997-0509f379621b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:29.345598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f5c9573b-414d-453b-af4d-58e0ca375fa9 req-0fc5c41b-282b-4e35-8997-0509f379621b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:29.370286 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f5c9573b-414d-453b-af4d-58e0ca375fa9 req-0fc5c41b-282b-4e35-8997-0509f379621b service nova] Creating event network-vif-plugged:7f28b74c-d700-4e89-a2b8-13b21b98422a for instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 on nch1-master-1 Sep 06 11:05:29.383749 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f5c9573b-414d-453b-af4d-58e0ca375fa9 req-0fc5c41b-282b-4e35-8997-0509f379621b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091554 Sep 06 11:05:29.387811 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1668/3346] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:29.473642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-4164d0eb-5e0f-4527-a5db-9a8c04967d6e tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lazy-loading 'services' on Instance uuid 16d64eaf-0686-4d18-8b21-1eb52f4cda77 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:05:29.499109 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4164d0eb-5e0f-4527-a5db-9a8c04967d6e tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1936 microversion: 2.91 time: 0.207911 Sep 06 11:05:29.500274 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1679/3347] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:29 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1936 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:29.530744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9f28646a-cb59-4e6d-b39a-f4d4ebb4ecd6 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:29.534733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f28646a-cb59-4e6d-b39a-f4d4ebb4ecd6 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:29.535262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f28646a-cb59-4e6d-b39a-f4d4ebb4ecd6 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:29.535935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f28646a-cb59-4e6d-b39a-f4d4ebb4ecd6 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:29.536688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f28646a-cb59-4e6d-b39a-f4d4ebb4ecd6 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:29.537155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f28646a-cb59-4e6d-b39a-f4d4ebb4ecd6 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:29.537594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f28646a-cb59-4e6d-b39a-f4d4ebb4ecd6 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:29.564753 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9f28646a-cb59-4e6d-b39a-f4d4ebb4ecd6 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.038951 Sep 06 11:05:29.567400 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1669/3348] 10.222.0.20 () {60 vars in 1217 bytes} [Tue Sep 6 11:05:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:05:29.578057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c62f0cfb-23d2-4272-8625-a393ec5b1dc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:29.581650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c62f0cfb-23d2-4272-8625-a393ec5b1dc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:29.586374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c62f0cfb-23d2-4272-8625-a393ec5b1dc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:29.586873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c62f0cfb-23d2-4272-8625-a393ec5b1dc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:29.587353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c62f0cfb-23d2-4272-8625-a393ec5b1dc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:29.588063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c62f0cfb-23d2-4272-8625-a393ec5b1dc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:29.588530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c62f0cfb-23d2-4272-8625-a393ec5b1dc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:29.589456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c62f0cfb-23d2-4272-8625-a393ec5b1dc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:29.614726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-c62f0cfb-23d2-4272-8625-a393ec5b1dc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lazy-loading 'flavor' on Instance uuid 16d64eaf-0686-4d18-8b21-1eb52f4cda77 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:05:29.690675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5e65f6c0-cbc1-462c-9cc4-828cbcc0defa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:29.691717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5e65f6c0-cbc1-462c-9cc4-828cbcc0defa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:29.697734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e65f6c0-cbc1-462c-9cc4-828cbcc0defa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:29.698224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e65f6c0-cbc1-462c-9cc4-828cbcc0defa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:29.698672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e65f6c0-cbc1-462c-9cc4-828cbcc0defa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:29.699414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e65f6c0-cbc1-462c-9cc4-828cbcc0defa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:29.699878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e65f6c0-cbc1-462c-9cc4-828cbcc0defa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:29.700316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e65f6c0-cbc1-462c-9cc4-828cbcc0defa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:29.847651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5e65f6c0-cbc1-462c-9cc4-828cbcc0defa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:29.855929 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5e65f6c0-cbc1-462c-9cc4-828cbcc0defa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1312 microversion: 2.1 time: 0.169825 Sep 06 11:05:29.856579 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1670/3349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:29 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:05:30.432891 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c62f0cfb-23d2-4272-8625-a393ec5b1dc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "POST /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77/action" status: 202 len: 0 microversion: 2.91 time: 0.859196 Sep 06 11:05:30.434050 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1680/3350] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:05:29 2022] POST /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77/action => generated 0 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:05:30.442989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8bf0f7d0-4372-410f-97b0-eb65d1d6a73e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:30.443728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8bf0f7d0-4372-410f-97b0-eb65d1d6a73e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:30.450925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bf0f7d0-4372-410f-97b0-eb65d1d6a73e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:30.451844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bf0f7d0-4372-410f-97b0-eb65d1d6a73e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:30.451983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bf0f7d0-4372-410f-97b0-eb65d1d6a73e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:30.452624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bf0f7d0-4372-410f-97b0-eb65d1d6a73e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:30.453092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bf0f7d0-4372-410f-97b0-eb65d1d6a73e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:30.453522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bf0f7d0-4372-410f-97b0-eb65d1d6a73e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:30.528718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8bf0f7d0-4372-410f-97b0-eb65d1d6a73e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:30.538021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8bf0f7d0-4372-410f-97b0-eb65d1d6a73e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:30.539608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8bf0f7d0-4372-410f-97b0-eb65d1d6a73e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:30.544600 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8bf0f7d0-4372-410f-97b0-eb65d1d6a73e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.105877 Sep 06 11:05:30.545176 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1671/3351] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:30 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:30.882085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b2bbf1c3-72b4-4044-be71-b301dd6aeaeb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:30.882940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b2bbf1c3-72b4-4044-be71-b301dd6aeaeb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:30.886018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:30.891917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2bbf1c3-72b4-4044-be71-b301dd6aeaeb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:30.892417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2bbf1c3-72b4-4044-be71-b301dd6aeaeb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:30.892868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2bbf1c3-72b4-4044-be71-b301dd6aeaeb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:30.893582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2bbf1c3-72b4-4044-be71-b301dd6aeaeb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:30.894052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2bbf1c3-72b4-4044-be71-b301dd6aeaeb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:30.894532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2bbf1c3-72b4-4044-be71-b301dd6aeaeb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:31.060713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b2bbf1c3-72b4-4044-be71-b301dd6aeaeb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:31.069580 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b2bbf1c3-72b4-4044-be71-b301dd6aeaeb tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1498 microversion: 2.1 time: 0.192806 Sep 06 11:05:31.070188 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1681/3352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:30 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1498 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:31.093056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f16d207c-398a-4061-a0a8-ea867f93c1ff tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:31.107299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.compute.server_groups [None req-f16d207c-398a-4061-a0a8-ea867f93c1ff tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Querying cell a5a6b47c-7522-4a84-9be6-8ca7130ab6d7(cell1) for 1 instances {{(pid=140875) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 06 11:05:31.115437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f16d207c-398a-4061-a0a8-ea867f93c1ff tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:31.115437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f16d207c-398a-4061-a0a8-ea867f93c1ff tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:31.115437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f16d207c-398a-4061-a0a8-ea867f93c1ff tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:31.126204 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f16d207c-398a-4061-a0a8-ea867f93c1ff tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/31f3813a-e2c2-4678-b79d-a2429437b5dc" status: 200 len: 222 microversion: 2.1 time: 0.037528 Sep 06 11:05:31.126768 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1672/3353] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:05:31 2022] GET /compute/v2.1/os-server-groups/31f3813a-e2c2-4678-b79d-a2429437b5dc => generated 222 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:31.138295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-74350e85-dece-4b5f-9362-1e14a796f660 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:31.138820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-74350e85-dece-4b5f-9362-1e14a796f660 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:31.145612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74350e85-dece-4b5f-9362-1e14a796f660 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:31.146192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74350e85-dece-4b5f-9362-1e14a796f660 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:31.146647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74350e85-dece-4b5f-9362-1e14a796f660 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:31.147434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74350e85-dece-4b5f-9362-1e14a796f660 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:31.147904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74350e85-dece-4b5f-9362-1e14a796f660 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:31.148423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74350e85-dece-4b5f-9362-1e14a796f660 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:31.190326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-74350e85-dece-4b5f-9362-1e14a796f660 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:05:31.572654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d5c6eb80-fffe-42ab-9eec-b230952256ea tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:31.573323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d5c6eb80-fffe-42ab-9eec-b230952256ea tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:31.581409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5c6eb80-fffe-42ab-9eec-b230952256ea tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:31.581908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5c6eb80-fffe-42ab-9eec-b230952256ea tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:31.582361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5c6eb80-fffe-42ab-9eec-b230952256ea tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:31.583097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5c6eb80-fffe-42ab-9eec-b230952256ea tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:31.583743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5c6eb80-fffe-42ab-9eec-b230952256ea tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:31.584181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5c6eb80-fffe-42ab-9eec-b230952256ea tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:31.595654 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-74350e85-dece-4b5f-9362-1e14a796f660 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 204 len: 0 microversion: 2.1 time: 0.461271 Sep 06 11:05:31.598008 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1682/3354] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:05:31 2022] DELETE /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:05:31.604772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1a176c7c-a485-432c-bd4e-4e3f31e971fa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:31.605488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1a176c7c-a485-432c-bd4e-4e3f31e971fa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:31.615829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a176c7c-a485-432c-bd4e-4e3f31e971fa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:31.616576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a176c7c-a485-432c-bd4e-4e3f31e971fa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:31.617208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a176c7c-a485-432c-bd4e-4e3f31e971fa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:31.617930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a176c7c-a485-432c-bd4e-4e3f31e971fa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:31.618396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a176c7c-a485-432c-bd4e-4e3f31e971fa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:31.618828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a176c7c-a485-432c-bd4e-4e3f31e971fa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:31.676393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d5c6eb80-fffe-42ab-9eec-b230952256ea tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:31.685061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d5c6eb80-fffe-42ab-9eec-b230952256ea tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:31.687142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d5c6eb80-fffe-42ab-9eec-b230952256ea tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:31.692771 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d5c6eb80-fffe-42ab-9eec-b230952256ea tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.124463 Sep 06 11:05:31.695240 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1673/3355] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:31 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:31.787268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1a176c7c-a485-432c-bd4e-4e3f31e971fa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:31.795029 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1a176c7c-a485-432c-bd4e-4e3f31e971fa tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1504 microversion: 2.1 time: 0.194321 Sep 06 11:05:31.795613 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1683/3356] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:31 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:05:32.721409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-065665ce-63f2-4a0f-99f2-571f4eeeacc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:32.722029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-065665ce-63f2-4a0f-99f2-571f4eeeacc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:32.733678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-065665ce-63f2-4a0f-99f2-571f4eeeacc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:32.734440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-065665ce-63f2-4a0f-99f2-571f4eeeacc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:32.734907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-065665ce-63f2-4a0f-99f2-571f4eeeacc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:32.735662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-065665ce-63f2-4a0f-99f2-571f4eeeacc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:32.736128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-065665ce-63f2-4a0f-99f2-571f4eeeacc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:32.736772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-065665ce-63f2-4a0f-99f2-571f4eeeacc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:32.806783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-065665ce-63f2-4a0f-99f2-571f4eeeacc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:32.816493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-065665ce-63f2-4a0f-99f2-571f4eeeacc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:32.817961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-065665ce-63f2-4a0f-99f2-571f4eeeacc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:32.823229 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-065665ce-63f2-4a0f-99f2-571f4eeeacc3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.105998 Sep 06 11:05:32.824195 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1674/3357] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:32 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:32.833287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-be688931-f2f1-4389-a1a9-e1211b4fe8b3 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:32.834079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-be688931-f2f1-4389-a1a9-e1211b4fe8b3 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:32.838418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=42 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:32.844573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be688931-f2f1-4389-a1a9-e1211b4fe8b3 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:32.845179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be688931-f2f1-4389-a1a9-e1211b4fe8b3 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:32.845622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be688931-f2f1-4389-a1a9-e1211b4fe8b3 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:32.846329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be688931-f2f1-4389-a1a9-e1211b4fe8b3 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:32.846790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be688931-f2f1-4389-a1a9-e1211b4fe8b3 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:32.847256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be688931-f2f1-4389-a1a9-e1211b4fe8b3 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:33.104393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-be688931-f2f1-4389-a1a9-e1211b4fe8b3 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:33.113419 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-be688931-f2f1-4389-a1a9-e1211b4fe8b3 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1504 microversion: 2.1 time: 0.293156 Sep 06 11:05:33.129732 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1684/3358] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:32 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:33.602836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-d62e9732-ea33-45f2-b711-e3d22b6c0397 req-580b42f5-bdc6-4df5-a6d7-48ed08f4e830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1eb4f8-7766-40df-9650-11d2a3dd7886", "name": "network-vif-deleted", "tag": "7f28b74c-d700-4e89-a2b8-13b21b98422a"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:33.614543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d62e9732-ea33-45f2-b711-e3d22b6c0397 req-580b42f5-bdc6-4df5-a6d7-48ed08f4e830 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:33.615085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d62e9732-ea33-45f2-b711-e3d22b6c0397 req-580b42f5-bdc6-4df5-a6d7-48ed08f4e830 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:33.617755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d62e9732-ea33-45f2-b711-e3d22b6c0397 req-580b42f5-bdc6-4df5-a6d7-48ed08f4e830 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:33.630604 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-d62e9732-ea33-45f2-b711-e3d22b6c0397 req-580b42f5-bdc6-4df5-a6d7-48ed08f4e830 service nova] Creating event network-vif-deleted:7f28b74c-d700-4e89-a2b8-13b21b98422a for instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 on nch1-master-1 Sep 06 11:05:33.641777 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-d62e9732-ea33-45f2-b711-e3d22b6c0397 req-580b42f5-bdc6-4df5-a6d7-48ed08f4e830 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041198 Sep 06 11:05:33.641777 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1675/3359] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:33.852888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d643eec5-6a67-4615-98c2-9007f59b2bc7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:33.854616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d643eec5-6a67-4615-98c2-9007f59b2bc7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:33.863004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d643eec5-6a67-4615-98c2-9007f59b2bc7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:33.863697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d643eec5-6a67-4615-98c2-9007f59b2bc7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:33.864408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d643eec5-6a67-4615-98c2-9007f59b2bc7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:33.865479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d643eec5-6a67-4615-98c2-9007f59b2bc7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:33.866171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d643eec5-6a67-4615-98c2-9007f59b2bc7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:33.866883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d643eec5-6a67-4615-98c2-9007f59b2bc7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:33.894862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:33.945287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d643eec5-6a67-4615-98c2-9007f59b2bc7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:33.954537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d643eec5-6a67-4615-98c2-9007f59b2bc7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:33.956018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d643eec5-6a67-4615-98c2-9007f59b2bc7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:33.961015 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d643eec5-6a67-4615-98c2-9007f59b2bc7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.113122 Sep 06 11:05:33.961594 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1685/3360] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:33 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:34.142386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:34.143272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:34.150742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:34.151847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:34.152373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:34.153023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:34.153493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:34.153938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:34.189446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:34.189948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:34.190401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:34.190894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lazy-loading 'fault' on Instance uuid ef1eb4f8-7766-40df-9650-11d2a3dd7886 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:05:34.244910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c807ed86984d78a148b08685b868af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbfa77f07dd4e69acfbea7657a922fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:34.250097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=32 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:34.266921 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1f7a65da-470d-43c6-89f1-6c4f2753d991 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 200 len: 1302 microversion: 2.1 time: 0.133181 Sep 06 11:05:34.274698 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1676/3361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:34 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 1302 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:34.995271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a3b54a76-a6c3-4d34-ab64-7cdffb0d577c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:34.995898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a3b54a76-a6c3-4d34-ab64-7cdffb0d577c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:35.012430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3b54a76-a6c3-4d34-ab64-7cdffb0d577c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:35.016380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3b54a76-a6c3-4d34-ab64-7cdffb0d577c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:35.017089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3b54a76-a6c3-4d34-ab64-7cdffb0d577c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:35.018620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3b54a76-a6c3-4d34-ab64-7cdffb0d577c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:35.019470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3b54a76-a6c3-4d34-ab64-7cdffb0d577c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:35.020109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3b54a76-a6c3-4d34-ab64-7cdffb0d577c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:35.180346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a3b54a76-a6c3-4d34-ab64-7cdffb0d577c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:35.190604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a3b54a76-a6c3-4d34-ab64-7cdffb0d577c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:35.192265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a3b54a76-a6c3-4d34-ab64-7cdffb0d577c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:35.198224 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a3b54a76-a6c3-4d34-ab64-7cdffb0d577c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.207696 Sep 06 11:05:35.199561 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1686/3362] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:34 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:35.303661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dae63944-d06b-4f0f-a381-83ec112ef1c0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:35.306526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dae63944-d06b-4f0f-a381-83ec112ef1c0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:35.315925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dae63944-d06b-4f0f-a381-83ec112ef1c0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:35.316320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dae63944-d06b-4f0f-a381-83ec112ef1c0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:35.316788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dae63944-d06b-4f0f-a381-83ec112ef1c0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:35.318278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dae63944-d06b-4f0f-a381-83ec112ef1c0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:35.318986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dae63944-d06b-4f0f-a381-83ec112ef1c0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:35.319670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dae63944-d06b-4f0f-a381-83ec112ef1c0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-dae63944-d06b-4f0f-a381-83ec112ef1c0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] HTTP exception thrown: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dae63944-d06b-4f0f-a381-83ec112ef1c0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Request method failure captured: Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 HTTP/1.1 Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFylndU0T67ygnNTFKjcm9C2_UQVvqF0Z0PUUiaMzK7xZZbTVlAyyW-nyrMRtCYiNQljuu8mBp7uAeKOqt_uUjaxbRBgZoY2fraepceeldDz2hRD1XwfUlCp2hr9Y_489Md0az-CN_Gnh6Ycpvf1BaECP3N2p0ymmyZDzi65SvmPF78E Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}] Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 25c807ed86984d78a148b08685b868af Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'ef1eb4f8-7766-40df-9650-11d2a3dd7886'} Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:05:35.340878 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dae63944-d06b-4f0f-a381-83ec112ef1c0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Returning 404 to user: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dae63944-d06b-4f0f-a381-83ec112ef1c0 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 404 len: 111 microversion: 2.1 time: 0.042207 Sep 06 11:05:35.353047 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1677/3363] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:35 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:35.357137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e3be75e-9223-4504-851f-66e2a51fa877 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:35.375910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.compute.server_groups [None req-5e3be75e-9223-4504-851f-66e2a51fa877 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Querying cell a5a6b47c-7522-4a84-9be6-8ca7130ab6d7(cell1) for 1 instances {{(pid=140876) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 06 11:05:35.377042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e3be75e-9223-4504-851f-66e2a51fa877 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:35.378671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e3be75e-9223-4504-851f-66e2a51fa877 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:35.379420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e3be75e-9223-4504-851f-66e2a51fa877 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:35.406924 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5e3be75e-9223-4504-851f-66e2a51fa877 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.056790 Sep 06 11:05:35.407801 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1687/3364] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 11:05:35 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:35.419990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c15cdbd-7ae7-433d-bd6f-0593ddb05bc2 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:35.439386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.compute.server_groups [None req-1c15cdbd-7ae7-433d-bd6f-0593ddb05bc2 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Querying cell a5a6b47c-7522-4a84-9be6-8ca7130ab6d7(cell1) for 1 instances {{(pid=140875) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 06 11:05:35.440475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c15cdbd-7ae7-433d-bd6f-0593ddb05bc2 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:35.441034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c15cdbd-7ae7-433d-bd6f-0593ddb05bc2 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:35.441710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c15cdbd-7ae7-433d-bd6f-0593ddb05bc2 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:35.453826 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1c15cdbd-7ae7-433d-bd6f-0593ddb05bc2 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/31f3813a-e2c2-4678-b79d-a2429437b5dc" status: 200 len: 184 microversion: 2.1 time: 0.037584 Sep 06 11:05:35.454547 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1678/3365] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:05:35 2022] GET /compute/v2.1/os-server-groups/31f3813a-e2c2-4678-b79d-a2429437b5dc => generated 184 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:05:35.466654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5a8a5708-7084-4982-8b66-459c521013c7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:35.467885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5a8a5708-7084-4982-8b66-459c521013c7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:35.476514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a8a5708-7084-4982-8b66-459c521013c7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:35.476514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a8a5708-7084-4982-8b66-459c521013c7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:35.476514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a8a5708-7084-4982-8b66-459c521013c7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:35.476873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a8a5708-7084-4982-8b66-459c521013c7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:35.477035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a8a5708-7084-4982-8b66-459c521013c7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:35.477614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a8a5708-7084-4982-8b66-459c521013c7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:35.492383 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-5a8a5708-7084-4982-8b66-459c521013c7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] HTTP exception thrown: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5a8a5708-7084-4982-8b66-459c521013c7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Request method failure captured: Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 HTTP/1.1 Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFylndU0T67ygnNTFKjcm9C2_UQVvqF0Z0PUUiaMzK7xZZbTVlAyyW-nyrMRtCYiNQljuu8mBp7uAeKOqt_uUjaxbRBgZoY2fraepceeldDz2hRD1XwfUlCp2hr9Y_489Md0az-CN_Gnh6Ycpvf1BaECP3N2p0ymmyZDzi65SvmPF78E Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}] Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 25c807ed86984d78a148b08685b868af Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ef1eb4f8-7766-40df-9650-11d2a3dd7886'} Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:05:35.494085 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5a8a5708-7084-4982-8b66-459c521013c7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Returning 404 to user: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5a8a5708-7084-4982-8b66-459c521013c7 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 404 len: 111 microversion: 2.1 time: 0.033110 Sep 06 11:05:35.503765 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1688/3366] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:05:35 2022] DELETE /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:35.511127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5f8d37f4-db81-45e9-b518-f3e2e55703e9 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:35.511890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5f8d37f4-db81-45e9-b518-f3e2e55703e9 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] [instance: ef1eb4f8-7766-40df-9650-11d2a3dd7886] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:35.522851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f8d37f4-db81-45e9-b518-f3e2e55703e9 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:35.522851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f8d37f4-db81-45e9-b518-f3e2e55703e9 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:35.522851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f8d37f4-db81-45e9-b518-f3e2e55703e9 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:35.522851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f8d37f4-db81-45e9-b518-f3e2e55703e9 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:35.522851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f8d37f4-db81-45e9-b518-f3e2e55703e9 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:35.522851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f8d37f4-db81-45e9-b518-f3e2e55703e9 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:35.537984 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-5f8d37f4-db81-45e9-b518-f3e2e55703e9 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] HTTP exception thrown: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5f8d37f4-db81-45e9-b518-f3e2e55703e9 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Request method failure captured: Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 HTTP/1.1 Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFylndU0T67ygnNTFKjcm9C2_UQVvqF0Z0PUUiaMzK7xZZbTVlAyyW-nyrMRtCYiNQljuu8mBp7uAeKOqt_uUjaxbRBgZoY2fraepceeldDz2hRD1XwfUlCp2hr9Y_489Md0az-CN_Gnh6Ycpvf1BaECP3N2p0ymmyZDzi65SvmPF78E Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}] Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 25c807ed86984d78a148b08685b868af Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'ef1eb4f8-7766-40df-9650-11d2a3dd7886'} Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.539682 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.546809 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.546809 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.546809 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.546809 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:35.546809 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:35.546809 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. Sep 06 11:05:35.546809 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.546809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5f8d37f4-db81-45e9-b518-f3e2e55703e9 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Returning 404 to user: Instance ef1eb4f8-7766-40df-9650-11d2a3dd7886 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:35.546809 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5f8d37f4-db81-45e9-b518-f3e2e55703e9 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886" status: 404 len: 111 microversion: 2.1 time: 0.041070 Sep 06 11:05:35.550893 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1679/3367] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:35 2022] GET /compute/v2.1/servers/ef1eb4f8-7766-40df-9650-11d2a3dd7886 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:35.562975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-943c89dc-f088-4e82-99c8-baf508de391f tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:35.569260 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-943c89dc-f088-4e82-99c8-baf508de391f tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] HTTP exception thrown: Instance group 40a77a93-b080-4035-b2ad-d213cd8f21ce could not be found. Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-943c89dc-f088-4e82-99c8-baf508de391f tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Request method failure captured: Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-server-groups/40a77a93-b080-4035-b2ad-d213cd8f21ce HTTP/1.1 Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFylndU0T67ygnNTFKjcm9C2_UQVvqF0Z0PUUiaMzK7xZZbTVlAyyW-nyrMRtCYiNQljuu8mBp7uAeKOqt_uUjaxbRBgZoY2fraepceeldDz2hRD1XwfUlCp2hr9Y_489Md0az-CN_Gnh6Ycpvf1BaECP3N2p0ymmyZDzi65SvmPF78E Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}] Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 25c807ed86984d78a148b08685b868af Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance group 40a77a93-b080-4035-b2ad-d213cd8f21ce could not be found. Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '40a77a93-b080-4035-b2ad-d213cd8f21ce'} Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 40a77a93-b080-4035-b2ad-d213cd8f21ce could not be found. Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 40a77a93-b080-4035-b2ad-d213cd8f21ce could not be found. Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.571423 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.576335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.576335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.576335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:35.576335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:35.576335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 40a77a93-b080-4035-b2ad-d213cd8f21ce could not be found. Sep 06 11:05:35.576335 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.576335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-943c89dc-f088-4e82-99c8-baf508de391f tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Returning 404 to user: Instance group 40a77a93-b080-4035-b2ad-d213cd8f21ce could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:35.576335 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-943c89dc-f088-4e82-99c8-baf508de391f tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/40a77a93-b080-4035-b2ad-d213cd8f21ce" status: 404 len: 117 microversion: 2.1 time: 0.020707 Sep 06 11:05:35.576335 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1689/3368] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:05:35 2022] DELETE /compute/v2.1/os-server-groups/40a77a93-b080-4035-b2ad-d213cd8f21ce => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:35.582422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-660c6348-1f65-4a6f-99e8-8bc1d7c4d97f tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:35.588926 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-660c6348-1f65-4a6f-99e8-8bc1d7c4d97f tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] HTTP exception thrown: Instance group 813bf267-4bda-44ff-9827-b72dff3cd14a could not be found. Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-660c6348-1f65-4a6f-99e8-8bc1d7c4d97f tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Request method failure captured: Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/os-server-groups/813bf267-4bda-44ff-9827-b72dff3cd14a HTTP/1.1 Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFylndU0T67ygnNTFKjcm9C2_UQVvqF0Z0PUUiaMzK7xZZbTVlAyyW-nyrMRtCYiNQljuu8mBp7uAeKOqt_uUjaxbRBgZoY2fraepceeldDz2hRD1XwfUlCp2hr9Y_489Md0az-CN_Gnh6Ycpvf1BaECP3N2p0ymmyZDzi65SvmPF78E Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}] Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 25c807ed86984d78a148b08685b868af Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance group 813bf267-4bda-44ff-9827-b72dff3cd14a could not be found. Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '813bf267-4bda-44ff-9827-b72dff3cd14a'} Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 813bf267-4bda-44ff-9827-b72dff3cd14a could not be found. Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 813bf267-4bda-44ff-9827-b72dff3cd14a could not be found. Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.590638 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.597839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.597839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.597839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:35.597839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:35.597839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 813bf267-4bda-44ff-9827-b72dff3cd14a could not be found. Sep 06 11:05:35.597839 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.597839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-660c6348-1f65-4a6f-99e8-8bc1d7c4d97f tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Returning 404 to user: Instance group 813bf267-4bda-44ff-9827-b72dff3cd14a could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:35.597839 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-660c6348-1f65-4a6f-99e8-8bc1d7c4d97f tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/813bf267-4bda-44ff-9827-b72dff3cd14a" status: 404 len: 117 microversion: 2.1 time: 0.013877 Sep 06 11:05:35.597839 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1680/3369] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:05:35 2022] DELETE /compute/v2.1/os-server-groups/813bf267-4bda-44ff-9827-b72dff3cd14a => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:35.604163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-27968bff-b67e-4c3f-89d7-9a0987f63d5e tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:35.612216 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-27968bff-b67e-4c3f-89d7-9a0987f63d5e tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] HTTP exception thrown: Instance group 231add9e-035e-43bc-9ff4-dae03c731bde could not be found. Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-27968bff-b67e-4c3f-89d7-9a0987f63d5e tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Request method failure captured: Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-server-groups/231add9e-035e-43bc-9ff4-dae03c731bde HTTP/1.1 Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFylndU0T67ygnNTFKjcm9C2_UQVvqF0Z0PUUiaMzK7xZZbTVlAyyW-nyrMRtCYiNQljuu8mBp7uAeKOqt_uUjaxbRBgZoY2fraepceeldDz2hRD1XwfUlCp2hr9Y_489Md0az-CN_Gnh6Ycpvf1BaECP3N2p0ymmyZDzi65SvmPF78E Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}] Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 25c807ed86984d78a148b08685b868af Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance group 231add9e-035e-43bc-9ff4-dae03c731bde could not be found. Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '231add9e-035e-43bc-9ff4-dae03c731bde'} Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 231add9e-035e-43bc-9ff4-dae03c731bde could not be found. Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 231add9e-035e-43bc-9ff4-dae03c731bde could not be found. Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.613751 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.623355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.623355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.623355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:35.623355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:35.623355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 231add9e-035e-43bc-9ff4-dae03c731bde could not be found. Sep 06 11:05:35.623355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.623355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-27968bff-b67e-4c3f-89d7-9a0987f63d5e tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Returning 404 to user: Instance group 231add9e-035e-43bc-9ff4-dae03c731bde could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:35.623355 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-27968bff-b67e-4c3f-89d7-9a0987f63d5e tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/231add9e-035e-43bc-9ff4-dae03c731bde" status: 404 len: 117 microversion: 2.1 time: 0.014869 Sep 06 11:05:35.623355 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1690/3370] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:05:35 2022] DELETE /compute/v2.1/os-server-groups/231add9e-035e-43bc-9ff4-dae03c731bde => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:35.630024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-36acbea8-f4bc-4b8a-9f2c-27429752aa40 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:35.638475 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-36acbea8-f4bc-4b8a-9f2c-27429752aa40 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] HTTP exception thrown: Instance group ff155269-1a6b-4b0f-996a-4c16bb93b13f could not be found. Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-36acbea8-f4bc-4b8a-9f2c-27429752aa40 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Request method failure captured: Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/os-server-groups/ff155269-1a6b-4b0f-996a-4c16bb93b13f HTTP/1.1 Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFylndU0T67ygnNTFKjcm9C2_UQVvqF0Z0PUUiaMzK7xZZbTVlAyyW-nyrMRtCYiNQljuu8mBp7uAeKOqt_uUjaxbRBgZoY2fraepceeldDz2hRD1XwfUlCp2hr9Y_489Md0az-CN_Gnh6Ycpvf1BaECP3N2p0ymmyZDzi65SvmPF78E Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ccbfa77f07dd4e69acfbea7657a922fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccbfa77f07dd4e69acfbea7657a922fd"}]}] Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ccbfa77f07dd4e69acfbea7657a922fd Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerGroupTestJSON-1867667177 Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 25c807ed86984d78a148b08685b868af Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerGroupTestJSON-1867667177-project Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance group ff155269-1a6b-4b0f-996a-4c16bb93b13f could not be found. Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'ff155269-1a6b-4b0f-996a-4c16bb93b13f'} Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ff155269-1a6b-4b0f-996a-4c16bb93b13f could not be found. Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ff155269-1a6b-4b0f-996a-4c16bb93b13f could not be found. Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.645070 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:35.650210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:35.650210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:35.650210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:35.650210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:35.650210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ff155269-1a6b-4b0f-996a-4c16bb93b13f could not be found. Sep 06 11:05:35.650210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:35.650210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-36acbea8-f4bc-4b8a-9f2c-27429752aa40 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Returning 404 to user: Instance group ff155269-1a6b-4b0f-996a-4c16bb93b13f could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:35.650210 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-36acbea8-f4bc-4b8a-9f2c-27429752aa40 tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/ff155269-1a6b-4b0f-996a-4c16bb93b13f" status: 404 len: 117 microversion: 2.1 time: 0.015644 Sep 06 11:05:35.650210 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1681/3371] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:05:35 2022] DELETE /compute/v2.1/os-server-groups/ff155269-1a6b-4b0f-996a-4c16bb93b13f => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:05:35.652007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-08a60ed9-3efc-4e50-b891-cde9d63af4dd tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:35.790651 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-08a60ed9-3efc-4e50-b891-cde9d63af4dd tempest-ServerGroupTestJSON-1867667177 tempest-ServerGroupTestJSON-1867667177-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/31f3813a-e2c2-4678-b79d-a2429437b5dc" status: 204 len: 0 microversion: 2.1 time: 0.142317 Sep 06 11:05:35.791888 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1691/3372] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:05:35 2022] DELETE /compute/v2.1/os-server-groups/31f3813a-e2c2-4678-b79d-a2429437b5dc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:05:36.231909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-680c0331-cced-4c12-b454-d2c2a0769d4f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:36.233393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-680c0331-cced-4c12-b454-d2c2a0769d4f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:36.245581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-680c0331-cced-4c12-b454-d2c2a0769d4f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:36.246087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-680c0331-cced-4c12-b454-d2c2a0769d4f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:36.247201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-680c0331-cced-4c12-b454-d2c2a0769d4f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:36.251544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-680c0331-cced-4c12-b454-d2c2a0769d4f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:36.252229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-680c0331-cced-4c12-b454-d2c2a0769d4f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:36.254856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-680c0331-cced-4c12-b454-d2c2a0769d4f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:36.273096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:36.479858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-680c0331-cced-4c12-b454-d2c2a0769d4f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:36.496362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-680c0331-cced-4c12-b454-d2c2a0769d4f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:36.501948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-680c0331-cced-4c12-b454-d2c2a0769d4f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:36.518961 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-680c0331-cced-4c12-b454-d2c2a0769d4f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.291265 Sep 06 11:05:36.520244 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1682/3373] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:36 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:37.563375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c64f7ee4-d76b-4da1-804f-1ff09b88a6a3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:37.564046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c64f7ee4-d76b-4da1-804f-1ff09b88a6a3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:37.589926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c64f7ee4-d76b-4da1-804f-1ff09b88a6a3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:37.591129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c64f7ee4-d76b-4da1-804f-1ff09b88a6a3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:37.592053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c64f7ee4-d76b-4da1-804f-1ff09b88a6a3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:37.593513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c64f7ee4-d76b-4da1-804f-1ff09b88a6a3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:37.605147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c64f7ee4-d76b-4da1-804f-1ff09b88a6a3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:37.605147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c64f7ee4-d76b-4da1-804f-1ff09b88a6a3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:37.808044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c64f7ee4-d76b-4da1-804f-1ff09b88a6a3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:37.820231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c64f7ee4-d76b-4da1-804f-1ff09b88a6a3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:37.822129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c64f7ee4-d76b-4da1-804f-1ff09b88a6a3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:37.838050 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c64f7ee4-d76b-4da1-804f-1ff09b88a6a3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.288289 Sep 06 11:05:37.857080 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1692/3374] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:37 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:38.876209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9abd683-6206-4808-9b9e-7961ab92b2bc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:38.876843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c9abd683-6206-4808-9b9e-7961ab92b2bc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:38.901122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9abd683-6206-4808-9b9e-7961ab92b2bc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:38.901630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9abd683-6206-4808-9b9e-7961ab92b2bc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:38.902375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9abd683-6206-4808-9b9e-7961ab92b2bc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:38.905781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9abd683-6206-4808-9b9e-7961ab92b2bc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:38.906475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9abd683-6206-4808-9b9e-7961ab92b2bc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:38.907216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9abd683-6206-4808-9b9e-7961ab92b2bc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:39.173475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c9abd683-6206-4808-9b9e-7961ab92b2bc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:39.195803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c9abd683-6206-4808-9b9e-7961ab92b2bc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:39.195803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c9abd683-6206-4808-9b9e-7961ab92b2bc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:39.212917 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c9abd683-6206-4808-9b9e-7961ab92b2bc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.329168 Sep 06 11:05:39.214610 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1683/3375] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:38 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:39.808752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-627342917", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "4d275685-de06-4cb8-90b4-c5cbcbf133c3"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:39.880972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] validate_networks() for [('4d275685-de06-4cb8-90b4-c5cbcbf133c3', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:05:40.243351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84cfe355-a3c4-420a-979e-2613c41180b0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:40.244287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-84cfe355-a3c4-420a-979e-2613c41180b0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:40.249527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:40.258247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84cfe355-a3c4-420a-979e-2613c41180b0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:40.259127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84cfe355-a3c4-420a-979e-2613c41180b0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:40.261966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84cfe355-a3c4-420a-979e-2613c41180b0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:40.263002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84cfe355-a3c4-420a-979e-2613c41180b0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:40.263614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84cfe355-a3c4-420a-979e-2613c41180b0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:40.265570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84cfe355-a3c4-420a-979e-2613c41180b0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:40.441335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-84cfe355-a3c4-420a-979e-2613c41180b0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:40.461322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-84cfe355-a3c4-420a-979e-2613c41180b0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:40.463119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-84cfe355-a3c4-420a-979e-2613c41180b0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:40.481980 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84cfe355-a3c4-420a-979e-2613c41180b0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.242374 Sep 06 11:05:40.500130 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1684/3376] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:40 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:05:40.681425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:05:40.682188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:05:40.682851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:05:40.683514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:05:40.684117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:05:40.719495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:40.721735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:40.721735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:40.721735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:40.722805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:40.723692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:40.744791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Getting quotas for project ff448bc0ec7c43a38a4b8adb062afca6. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:40.751936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Getting quotas for user 596b0a6958704e9eb27683ee535a9b60 and project ff448bc0ec7c43a38a4b8adb062afca6. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:40.769939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:05:40.772745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:05:41.066434 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-15f7f577-2442-4ff8-aac6-16c294dd0f7b tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.482146 Sep 06 11:05:41.070433 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1693/3377] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:05:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:05:41.081994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e11d3e9b-8d2e-49d1-bd07-b8fe45388693 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:41.082883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e11d3e9b-8d2e-49d1-bd07-b8fe45388693 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:41.313300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e11d3e9b-8d2e-49d1-bd07-b8fe45388693 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:41.328296 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e11d3e9b-8d2e-49d1-bd07-b8fe45388693 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1223 microversion: 2.1 time: 0.249875 Sep 06 11:05:41.329811 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1685/3378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:41 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1223 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:41.517961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-27a8fa0e-32a3-44ed-be34-00958db64e3f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:41.518601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-27a8fa0e-32a3-44ed-be34-00958db64e3f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:41.530495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27a8fa0e-32a3-44ed-be34-00958db64e3f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:41.531002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27a8fa0e-32a3-44ed-be34-00958db64e3f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:41.531552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27a8fa0e-32a3-44ed-be34-00958db64e3f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:41.532434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27a8fa0e-32a3-44ed-be34-00958db64e3f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:41.534234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27a8fa0e-32a3-44ed-be34-00958db64e3f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:41.535064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27a8fa0e-32a3-44ed-be34-00958db64e3f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:41.765215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-27a8fa0e-32a3-44ed-be34-00958db64e3f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:41.779252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-27a8fa0e-32a3-44ed-be34-00958db64e3f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:41.784179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-27a8fa0e-32a3-44ed-be34-00958db64e3f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:41.798715 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-27a8fa0e-32a3-44ed-be34-00958db64e3f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.287973 Sep 06 11:05:41.802396 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1694/3379] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:41 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:42.354151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d65f1cd5-e624-47b2-9bef-8ac54bd1300e tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:42.354788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d65f1cd5-e624-47b2-9bef-8ac54bd1300e tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:42.527174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d65f1cd5-e624-47b2-9bef-8ac54bd1300e tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:42.541607 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d65f1cd5-e624-47b2-9bef-8ac54bd1300e tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1223 microversion: 2.1 time: 0.191794 Sep 06 11:05:42.547197 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1686/3380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:42 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1223 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:42.833888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d3743fc6-a0ff-406b-b22a-26748e830bd5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:42.836159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3743fc6-a0ff-406b-b22a-26748e830bd5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:42.849114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3743fc6-a0ff-406b-b22a-26748e830bd5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:42.854813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3743fc6-a0ff-406b-b22a-26748e830bd5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:42.854813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3743fc6-a0ff-406b-b22a-26748e830bd5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:42.854813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3743fc6-a0ff-406b-b22a-26748e830bd5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:42.854813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3743fc6-a0ff-406b-b22a-26748e830bd5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:42.854813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3743fc6-a0ff-406b-b22a-26748e830bd5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:43.011860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d3743fc6-a0ff-406b-b22a-26748e830bd5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:43.025535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d3743fc6-a0ff-406b-b22a-26748e830bd5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:43.027046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d3743fc6-a0ff-406b-b22a-26748e830bd5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:43.032518 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d3743fc6-a0ff-406b-b22a-26748e830bd5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.203681 Sep 06 11:05:43.033194 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1695/3381] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:42 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:43.574204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bb04228c-d3b2-44ef-bf37-165484640ce6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:43.575228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bb04228c-d3b2-44ef-bf37-165484640ce6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:43.583098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb04228c-d3b2-44ef-bf37-165484640ce6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:43.583719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb04228c-d3b2-44ef-bf37-165484640ce6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:43.584386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb04228c-d3b2-44ef-bf37-165484640ce6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:43.585436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb04228c-d3b2-44ef-bf37-165484640ce6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:43.586161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb04228c-d3b2-44ef-bf37-165484640ce6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:43.586793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb04228c-d3b2-44ef-bf37-165484640ce6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:43.756132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bb04228c-d3b2-44ef-bf37-165484640ce6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:43.769941 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bb04228c-d3b2-44ef-bf37-165484640ce6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1227 microversion: 2.1 time: 0.198684 Sep 06 11:05:43.771572 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1687/3382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:43 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1227 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:44.059928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-86b28fbc-826b-4455-a6ad-67be2fec0ea8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:44.060890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-86b28fbc-826b-4455-a6ad-67be2fec0ea8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:44.077085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86b28fbc-826b-4455-a6ad-67be2fec0ea8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:44.077601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86b28fbc-826b-4455-a6ad-67be2fec0ea8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:44.083769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86b28fbc-826b-4455-a6ad-67be2fec0ea8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:44.083769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86b28fbc-826b-4455-a6ad-67be2fec0ea8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:44.083769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86b28fbc-826b-4455-a6ad-67be2fec0ea8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:44.083769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-86b28fbc-826b-4455-a6ad-67be2fec0ea8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:44.189477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-86b28fbc-826b-4455-a6ad-67be2fec0ea8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:44.199927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-86b28fbc-826b-4455-a6ad-67be2fec0ea8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:44.201979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-86b28fbc-826b-4455-a6ad-67be2fec0ea8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:44.207676 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-86b28fbc-826b-4455-a6ad-67be2fec0ea8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.151702 Sep 06 11:05:44.208245 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1696/3383] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:44 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:44.797280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-efa9e3ff-423b-4690-a5b2-148c2b7f3a49 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:44.800462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-efa9e3ff-423b-4690-a5b2-148c2b7f3a49 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:44.804933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efa9e3ff-423b-4690-a5b2-148c2b7f3a49 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:44.805442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efa9e3ff-423b-4690-a5b2-148c2b7f3a49 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:44.805873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efa9e3ff-423b-4690-a5b2-148c2b7f3a49 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:44.806572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efa9e3ff-423b-4690-a5b2-148c2b7f3a49 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:44.807049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efa9e3ff-423b-4690-a5b2-148c2b7f3a49 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:44.807608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efa9e3ff-423b-4690-a5b2-148c2b7f3a49 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:44.877692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-efa9e3ff-423b-4690-a5b2-148c2b7f3a49 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:44.888257 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-efa9e3ff-423b-4690-a5b2-148c2b7f3a49 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1275 microversion: 2.1 time: 0.095363 Sep 06 11:05:44.889097 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1688/3384] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:44 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:45.238009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-153caf70-3805-4208-a4d4-0cf0b4280047 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:45.240115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-153caf70-3805-4208-a4d4-0cf0b4280047 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:45.249358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-153caf70-3805-4208-a4d4-0cf0b4280047 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:45.249810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-153caf70-3805-4208-a4d4-0cf0b4280047 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:45.250356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-153caf70-3805-4208-a4d4-0cf0b4280047 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:45.250970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-153caf70-3805-4208-a4d4-0cf0b4280047 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:45.251501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-153caf70-3805-4208-a4d4-0cf0b4280047 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:45.251945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-153caf70-3805-4208-a4d4-0cf0b4280047 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:45.384895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-153caf70-3805-4208-a4d4-0cf0b4280047 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:45.398015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-153caf70-3805-4208-a4d4-0cf0b4280047 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:45.399703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-153caf70-3805-4208-a4d4-0cf0b4280047 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:45.406471 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-153caf70-3805-4208-a4d4-0cf0b4280047 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.173213 Sep 06 11:05:45.407409 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1697/3385] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:45 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:45.911824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0fb9e7d1-a429-4ef8-a84f-41eaebe08dc4 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:45.912493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0fb9e7d1-a429-4ef8-a84f-41eaebe08dc4 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:45.919242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fb9e7d1-a429-4ef8-a84f-41eaebe08dc4 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:45.919731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fb9e7d1-a429-4ef8-a84f-41eaebe08dc4 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:45.920320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fb9e7d1-a429-4ef8-a84f-41eaebe08dc4 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:45.921026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fb9e7d1-a429-4ef8-a84f-41eaebe08dc4 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:45.921488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fb9e7d1-a429-4ef8-a84f-41eaebe08dc4 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:45.921947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fb9e7d1-a429-4ef8-a84f-41eaebe08dc4 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:46.123567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0fb9e7d1-a429-4ef8-a84f-41eaebe08dc4 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:46.132967 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0fb9e7d1-a429-4ef8-a84f-41eaebe08dc4 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1323 microversion: 2.1 time: 0.224784 Sep 06 11:05:46.135330 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1689/3386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:45 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1323 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:46.434709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81705fed-93f6-48a0-955b-f2b7dd965309 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:46.436094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-81705fed-93f6-48a0-955b-f2b7dd965309 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:46.455058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81705fed-93f6-48a0-955b-f2b7dd965309 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:46.455777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81705fed-93f6-48a0-955b-f2b7dd965309 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:46.456432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81705fed-93f6-48a0-955b-f2b7dd965309 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:46.457355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81705fed-93f6-48a0-955b-f2b7dd965309 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:46.458041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81705fed-93f6-48a0-955b-f2b7dd965309 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:46.458694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81705fed-93f6-48a0-955b-f2b7dd965309 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:46.560192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-81705fed-93f6-48a0-955b-f2b7dd965309 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:46.571553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-81705fed-93f6-48a0-955b-f2b7dd965309 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:46.573394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-81705fed-93f6-48a0-955b-f2b7dd965309 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:46.580268 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-81705fed-93f6-48a0-955b-f2b7dd965309 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.149856 Sep 06 11:05:46.585805 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1698/3387] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:46 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:47.160925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-adbbb1a2-4546-4c25-8128-c50fda80278d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:47.162008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-adbbb1a2-4546-4c25-8128-c50fda80278d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:47.171281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adbbb1a2-4546-4c25-8128-c50fda80278d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:47.174858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adbbb1a2-4546-4c25-8128-c50fda80278d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:47.175725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adbbb1a2-4546-4c25-8128-c50fda80278d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:47.177062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adbbb1a2-4546-4c25-8128-c50fda80278d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:47.178117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adbbb1a2-4546-4c25-8128-c50fda80278d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:47.179110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adbbb1a2-4546-4c25-8128-c50fda80278d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:47.266507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-3fee54b2-fd71-4691-9ddc-1c7c71e3ca84 req-feb3870f-d10d-4249-a364-3ee28fe7fde4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e91126-5a0b-426e-b1ed-c89d61c97763", "tag": "432c8561-98d0-4933-a0f2-ffeb835e2936"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:47.285972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3fee54b2-fd71-4691-9ddc-1c7c71e3ca84 req-feb3870f-d10d-4249-a364-3ee28fe7fde4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:47.287164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3fee54b2-fd71-4691-9ddc-1c7c71e3ca84 req-feb3870f-d10d-4249-a364-3ee28fe7fde4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:47.287885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3fee54b2-fd71-4691-9ddc-1c7c71e3ca84 req-feb3870f-d10d-4249-a364-3ee28fe7fde4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:47.307219 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-3fee54b2-fd71-4691-9ddc-1c7c71e3ca84 req-feb3870f-d10d-4249-a364-3ee28fe7fde4 service nova] Creating event network-changed:432c8561-98d0-4933-a0f2-ffeb835e2936 for instance d9e91126-5a0b-426e-b1ed-c89d61c97763 on nch2-master-1 Sep 06 11:05:47.314902 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-3fee54b2-fd71-4691-9ddc-1c7c71e3ca84 req-feb3870f-d10d-4249-a364-3ee28fe7fde4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211066 Sep 06 11:05:47.315973 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1690/3388] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:47.450015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-adbbb1a2-4546-4c25-8128-c50fda80278d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:47.464393 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-adbbb1a2-4546-4c25-8128-c50fda80278d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1323 microversion: 2.1 time: 0.310413 Sep 06 11:05:47.471664 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1699/3389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:47 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1323 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:47.609647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dffc0b43-a6ee-4695-bedd-2b14f291abb3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:47.610371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dffc0b43-a6ee-4695-bedd-2b14f291abb3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:47.621148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dffc0b43-a6ee-4695-bedd-2b14f291abb3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:47.621648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dffc0b43-a6ee-4695-bedd-2b14f291abb3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:47.622095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dffc0b43-a6ee-4695-bedd-2b14f291abb3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:47.623044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dffc0b43-a6ee-4695-bedd-2b14f291abb3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:47.623508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dffc0b43-a6ee-4695-bedd-2b14f291abb3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:47.624103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dffc0b43-a6ee-4695-bedd-2b14f291abb3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:47.701672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dffc0b43-a6ee-4695-bedd-2b14f291abb3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:47.711358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dffc0b43-a6ee-4695-bedd-2b14f291abb3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:47.712935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dffc0b43-a6ee-4695-bedd-2b14f291abb3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:47.720947 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dffc0b43-a6ee-4695-bedd-2b14f291abb3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.116280 Sep 06 11:05:47.734259 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1691/3390] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:47 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:48.500116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6e600410-0ffa-4e70-91a0-7fed13d3f2b1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:48.500995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6e600410-0ffa-4e70-91a0-7fed13d3f2b1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:48.509098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e600410-0ffa-4e70-91a0-7fed13d3f2b1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:48.509594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e600410-0ffa-4e70-91a0-7fed13d3f2b1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:48.510034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e600410-0ffa-4e70-91a0-7fed13d3f2b1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:48.510745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e600410-0ffa-4e70-91a0-7fed13d3f2b1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:48.511622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e600410-0ffa-4e70-91a0-7fed13d3f2b1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:48.512059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e600410-0ffa-4e70-91a0-7fed13d3f2b1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:48.750673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a80d8950-d349-4ac2-be9f-d74c275b860c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:48.751344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a80d8950-d349-4ac2-be9f-d74c275b860c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:48.759222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a80d8950-d349-4ac2-be9f-d74c275b860c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:48.759730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a80d8950-d349-4ac2-be9f-d74c275b860c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:48.760398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a80d8950-d349-4ac2-be9f-d74c275b860c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:48.761279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a80d8950-d349-4ac2-be9f-d74c275b860c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:48.761860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a80d8950-d349-4ac2-be9f-d74c275b860c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:48.763049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a80d8950-d349-4ac2-be9f-d74c275b860c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:49.056053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a80d8950-d349-4ac2-be9f-d74c275b860c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:49.065501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a80d8950-d349-4ac2-be9f-d74c275b860c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:49.066983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a80d8950-d349-4ac2-be9f-d74c275b860c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:49.073207 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a80d8950-d349-4ac2-be9f-d74c275b860c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.327105 Sep 06 11:05:49.074479 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1692/3391] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:48 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:05:49.191473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6e600410-0ffa-4e70-91a0-7fed13d3f2b1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:49.202787 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6e600410-0ffa-4e70-91a0-7fed13d3f2b1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1323 microversion: 2.1 time: 0.707026 Sep 06 11:05:49.203406 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1700/3392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:48 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1323 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:50.102013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bdcafb1e-0d98-49d3-bb55-447afa09eef6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:50.102764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bdcafb1e-0d98-49d3-bb55-447afa09eef6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:50.110972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdcafb1e-0d98-49d3-bb55-447afa09eef6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:50.121551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdcafb1e-0d98-49d3-bb55-447afa09eef6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:50.121551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdcafb1e-0d98-49d3-bb55-447afa09eef6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:50.121551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdcafb1e-0d98-49d3-bb55-447afa09eef6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:50.121551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdcafb1e-0d98-49d3-bb55-447afa09eef6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:50.121551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdcafb1e-0d98-49d3-bb55-447afa09eef6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:50.229977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4379a1d1-93c4-4aed-8871-a84caa287225 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:50.231665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4379a1d1-93c4-4aed-8871-a84caa287225 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:50.235059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bdcafb1e-0d98-49d3-bb55-447afa09eef6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:50.251307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4379a1d1-93c4-4aed-8871-a84caa287225 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:50.251872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4379a1d1-93c4-4aed-8871-a84caa287225 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:50.252321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4379a1d1-93c4-4aed-8871-a84caa287225 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:50.253249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4379a1d1-93c4-4aed-8871-a84caa287225 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:50.253877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4379a1d1-93c4-4aed-8871-a84caa287225 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:50.254497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4379a1d1-93c4-4aed-8871-a84caa287225 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:50.255333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bdcafb1e-0d98-49d3-bb55-447afa09eef6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:50.257664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bdcafb1e-0d98-49d3-bb55-447afa09eef6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:50.267271 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bdcafb1e-0d98-49d3-bb55-447afa09eef6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.169200 Sep 06 11:05:50.268197 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1693/3393] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:50 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:50.497854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4379a1d1-93c4-4aed-8871-a84caa287225 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:50.508209 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4379a1d1-93c4-4aed-8871-a84caa287225 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1323 microversion: 2.1 time: 0.283233 Sep 06 11:05:50.517595 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1701/3394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:50 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1323 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:51.299641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9bd44050-0d4b-4ab9-90e3-78445fa923e8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:51.300896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9bd44050-0d4b-4ab9-90e3-78445fa923e8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:51.309552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bd44050-0d4b-4ab9-90e3-78445fa923e8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:51.310803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bd44050-0d4b-4ab9-90e3-78445fa923e8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:51.311470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bd44050-0d4b-4ab9-90e3-78445fa923e8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:51.312505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bd44050-0d4b-4ab9-90e3-78445fa923e8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:51.313270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bd44050-0d4b-4ab9-90e3-78445fa923e8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:51.313879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bd44050-0d4b-4ab9-90e3-78445fa923e8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:51.415697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9bd44050-0d4b-4ab9-90e3-78445fa923e8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:51.426792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9bd44050-0d4b-4ab9-90e3-78445fa923e8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:51.429366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9bd44050-0d4b-4ab9-90e3-78445fa923e8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:51.437963 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9bd44050-0d4b-4ab9-90e3-78445fa923e8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.143832 Sep 06 11:05:51.455703 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1694/3395] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:51 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:51.539578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aaed6c78-202f-4e78-9395-5f347b907973 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:51.540552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aaed6c78-202f-4e78-9395-5f347b907973 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:51.548089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:51.548811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:51.551178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aaed6c78-202f-4e78-9395-5f347b907973 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:51.555132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aaed6c78-202f-4e78-9395-5f347b907973 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:51.555132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aaed6c78-202f-4e78-9395-5f347b907973 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:51.555132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aaed6c78-202f-4e78-9395-5f347b907973 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:51.555132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aaed6c78-202f-4e78-9395-5f347b907973 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:51.555132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aaed6c78-202f-4e78-9395-5f347b907973 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:51.792244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aaed6c78-202f-4e78-9395-5f347b907973 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:51.803264 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aaed6c78-202f-4e78-9395-5f347b907973 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1323 microversion: 2.1 time: 0.269352 Sep 06 11:05:51.804077 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1702/3396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:51 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1323 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:52.473243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e1db63ee-3e9d-44b9-aab5-3a95047e2de3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:52.477522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e1db63ee-3e9d-44b9-aab5-3a95047e2de3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:52.495922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1db63ee-3e9d-44b9-aab5-3a95047e2de3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:52.496539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1db63ee-3e9d-44b9-aab5-3a95047e2de3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:52.497252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1db63ee-3e9d-44b9-aab5-3a95047e2de3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:52.501382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1db63ee-3e9d-44b9-aab5-3a95047e2de3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:52.502144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1db63ee-3e9d-44b9-aab5-3a95047e2de3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:52.502974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1db63ee-3e9d-44b9-aab5-3a95047e2de3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:52.542135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:52.597376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e1db63ee-3e9d-44b9-aab5-3a95047e2de3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:52.609855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e1db63ee-3e9d-44b9-aab5-3a95047e2de3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:52.611479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e1db63ee-3e9d-44b9-aab5-3a95047e2de3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:52.625672 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e1db63ee-3e9d-44b9-aab5-3a95047e2de3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.154296 Sep 06 11:05:52.625672 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1703/3397] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:52 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:52.803082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ae9420f-e50e-4df0-ae67-ef8d196eeda1 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:52.805624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0ae9420f-e50e-4df0-ae67-ef8d196eeda1 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:52.815958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ae9420f-e50e-4df0-ae67-ef8d196eeda1 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:52.816687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ae9420f-e50e-4df0-ae67-ef8d196eeda1 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:52.820023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ae9420f-e50e-4df0-ae67-ef8d196eeda1 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:52.820023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ae9420f-e50e-4df0-ae67-ef8d196eeda1 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:52.820023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ae9420f-e50e-4df0-ae67-ef8d196eeda1 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:52.820023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ae9420f-e50e-4df0-ae67-ef8d196eeda1 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:52.873975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-aa68a3e9-6b33-460a-a16a-d437bc326316 req-55d1a42d-2a97-4f3b-b4ed-eaf95fa7f805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e91126-5a0b-426e-b1ed-c89d61c97763", "name": "network-vif-plugged", "status": "completed", "tag": "432c8561-98d0-4933-a0f2-ffeb835e2936"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:52.885602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-aa68a3e9-6b33-460a-a16a-d437bc326316 req-55d1a42d-2a97-4f3b-b4ed-eaf95fa7f805 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:52.886029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-aa68a3e9-6b33-460a-a16a-d437bc326316 req-55d1a42d-2a97-4f3b-b4ed-eaf95fa7f805 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:52.886746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-aa68a3e9-6b33-460a-a16a-d437bc326316 req-55d1a42d-2a97-4f3b-b4ed-eaf95fa7f805 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:52.893786 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0ae9420f-e50e-4df0-ae67-ef8d196eeda1 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "POST /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743/action" status: 200 len: 24573 microversion: 2.1 time: 0.530235 Sep 06 11:05:52.895342 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1695/3398] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:05:52 2022] POST /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743/action => generated 24573 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:05:52.909873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bb783bb4-7c77-4bed-bec8-e4d587708b7c tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:52.910618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bb783bb4-7c77-4bed-bec8-e4d587708b7c tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:52.918508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb783bb4-7c77-4bed-bec8-e4d587708b7c tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:52.919033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb783bb4-7c77-4bed-bec8-e4d587708b7c tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:52.920206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb783bb4-7c77-4bed-bec8-e4d587708b7c tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:52.920401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb783bb4-7c77-4bed-bec8-e4d587708b7c tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:52.921086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb783bb4-7c77-4bed-bec8-e4d587708b7c tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:52.921967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb783bb4-7c77-4bed-bec8-e4d587708b7c tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:52.924621 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-aa68a3e9-6b33-460a-a16a-d437bc326316 req-55d1a42d-2a97-4f3b-b4ed-eaf95fa7f805 service nova] Creating event network-vif-plugged:432c8561-98d0-4933-a0f2-ffeb835e2936 for instance d9e91126-5a0b-426e-b1ed-c89d61c97763 on nch2-master-1 Sep 06 11:05:52.933132 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-aa68a3e9-6b33-460a-a16a-d437bc326316 req-55d1a42d-2a97-4f3b-b4ed-eaf95fa7f805 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.313126 Sep 06 11:05:52.939320 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1704/3399] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:53.162988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-274385780", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:53.209594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bb783bb4-7c77-4bed-bec8-e4d587708b7c tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:53.220062 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bb783bb4-7c77-4bed-bec8-e4d587708b7c tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1323 microversion: 2.1 time: 0.323252 Sep 06 11:05:53.225932 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1696/3400] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:52 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1323 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:53.239262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-99668a10-2e15-4182-89c2-43f970470dd4 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:53.239772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-99668a10-2e15-4182-89c2-43f970470dd4 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:53.246661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99668a10-2e15-4182-89c2-43f970470dd4 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:53.247190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] validate_networks() for [('5ef98845-35d1-45af-b58f-dd2a8d99588e', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:05:53.250141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99668a10-2e15-4182-89c2-43f970470dd4 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:53.261737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99668a10-2e15-4182-89c2-43f970470dd4 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:53.262762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99668a10-2e15-4182-89c2-43f970470dd4 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:53.263195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99668a10-2e15-4182-89c2-43f970470dd4 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:53.263658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99668a10-2e15-4182-89c2-43f970470dd4 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:53.323155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-99668a10-2e15-4182-89c2-43f970470dd4 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:05:53.766169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:05:53.766640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:05:53.767115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:05:53.767753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:05:53.768178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:05:53.777646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:53.778138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:53.778583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:53.779934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:53.780851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:53.781660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:53.785686 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-99668a10-2e15-4182-89c2-43f970470dd4 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "DELETE /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 204 len: 0 microversion: 2.1 time: 0.558384 Sep 06 11:05:53.789630 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1697/3401] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:05:53 2022] DELETE /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:05:53.794812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9332197c-7597-464c-89ad-de17fb37559a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:53.796191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9332197c-7597-464c-89ad-de17fb37559a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:53.806631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9332197c-7597-464c-89ad-de17fb37559a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:53.807569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9332197c-7597-464c-89ad-de17fb37559a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:53.808095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9332197c-7597-464c-89ad-de17fb37559a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:53.808909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9332197c-7597-464c-89ad-de17fb37559a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:53.809601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9332197c-7597-464c-89ad-de17fb37559a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:53.810276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9332197c-7597-464c-89ad-de17fb37559a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:53.824709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Getting quotas for project 3bce0861528a4891b94d174e964456f0. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:53.827676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:53.832814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Getting quotas for user e94103c4c75b4f2d8b2cb1bd4b6bcf6a and project 3bce0861528a4891b94d174e964456f0. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:53.858542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:05:53.858542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:05:54.024629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9332197c-7597-464c-89ad-de17fb37559a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:54.047628 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9332197c-7597-464c-89ad-de17fb37559a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.259377 Sep 06 11:05:54.047817 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f641262e-5fb0-4237-9660-aca9c22b38bb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.097842 Sep 06 11:05:54.049463 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1698/3402] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:53 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:54.057565 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1705/3403] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:05:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:05:54.063277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-127c7627-9364-4576-8ed3-f6c357747ee3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:54.076435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-127c7627-9364-4576-8ed3-f6c357747ee3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:54.079912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aad5fc35-b16a-4e7c-b109-863a1409d000 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:54.080581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aad5fc35-b16a-4e7c-b109-863a1409d000 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:54.101094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aad5fc35-b16a-4e7c-b109-863a1409d000 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:54.101606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aad5fc35-b16a-4e7c-b109-863a1409d000 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:54.106951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:54.108215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-127c7627-9364-4576-8ed3-f6c357747ee3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:54.111658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-127c7627-9364-4576-8ed3-f6c357747ee3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:54.111658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-127c7627-9364-4576-8ed3-f6c357747ee3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:54.111658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-127c7627-9364-4576-8ed3-f6c357747ee3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:54.111658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-127c7627-9364-4576-8ed3-f6c357747ee3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:54.114223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aad5fc35-b16a-4e7c-b109-863a1409d000 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:54.115159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aad5fc35-b16a-4e7c-b109-863a1409d000 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:54.115664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aad5fc35-b16a-4e7c-b109-863a1409d000 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:54.116122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aad5fc35-b16a-4e7c-b109-863a1409d000 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:54.121514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-127c7627-9364-4576-8ed3-f6c357747ee3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:54.285990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-127c7627-9364-4576-8ed3-f6c357747ee3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:54.299816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-127c7627-9364-4576-8ed3-f6c357747ee3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:54.301322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-127c7627-9364-4576-8ed3-f6c357747ee3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:54.309528 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-127c7627-9364-4576-8ed3-f6c357747ee3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.257164 Sep 06 11:05:54.311499 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1699/3404] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:54 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:54.318885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-656b20ef-5bd6-4aed-b18c-9c6ac960ffa1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:54.320457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-656b20ef-5bd6-4aed-b18c-9c6ac960ffa1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:54.401134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-656b20ef-5bd6-4aed-b18c-9c6ac960ffa1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:54.403775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aad5fc35-b16a-4e7c-b109-863a1409d000 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:54.411596 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-656b20ef-5bd6-4aed-b18c-9c6ac960ffa1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1213 microversion: 2.1 time: 0.098252 Sep 06 11:05:54.413383 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aad5fc35-b16a-4e7c-b109-863a1409d000 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1606 microversion: 2.1 time: 0.354245 Sep 06 11:05:54.414183 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1706/3405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:54 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1606 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:54.414306 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1700/3406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:54 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:54.419032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2194eacd-b850-4b3a-a27f-dfdb13f94ddf tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:54.420056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2194eacd-b850-4b3a-a27f-dfdb13f94ddf tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:54.428906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-57040708-8fe3-46ea-a21e-97abd50f546a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:54.432021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-57040708-8fe3-46ea-a21e-97abd50f546a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:54.444827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2194eacd-b850-4b3a-a27f-dfdb13f94ddf tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:54.445327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2194eacd-b850-4b3a-a27f-dfdb13f94ddf tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:54.445773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2194eacd-b850-4b3a-a27f-dfdb13f94ddf tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:54.445922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57040708-8fe3-46ea-a21e-97abd50f546a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:54.446401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57040708-8fe3-46ea-a21e-97abd50f546a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:54.446615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2194eacd-b850-4b3a-a27f-dfdb13f94ddf tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:54.446867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57040708-8fe3-46ea-a21e-97abd50f546a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:54.447052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2194eacd-b850-4b3a-a27f-dfdb13f94ddf tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:54.447395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2194eacd-b850-4b3a-a27f-dfdb13f94ddf tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:54.447630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57040708-8fe3-46ea-a21e-97abd50f546a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:54.453545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57040708-8fe3-46ea-a21e-97abd50f546a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:54.455177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57040708-8fe3-46ea-a21e-97abd50f546a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:54.459166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:54.657148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2194eacd-b850-4b3a-a27f-dfdb13f94ddf tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:54.680094 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2194eacd-b850-4b3a-a27f-dfdb13f94ddf tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1323 microversion: 2.1 time: 0.264484 Sep 06 11:05:54.687248 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1707/3407] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:54 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1323 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:54.717432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-57040708-8fe3-46ea-a21e-97abd50f546a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:54.755284 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-57040708-8fe3-46ea-a21e-97abd50f546a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.333886 Sep 06 11:05:54.760119 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1701/3408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:54 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:54.785703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7feee997-9f38-4e4c-adb7-5cf5e27e37fc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:54.786664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7feee997-9f38-4e4c-adb7-5cf5e27e37fc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:54.799855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7feee997-9f38-4e4c-adb7-5cf5e27e37fc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:54.800442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7feee997-9f38-4e4c-adb7-5cf5e27e37fc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:54.800950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7feee997-9f38-4e4c-adb7-5cf5e27e37fc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:54.801740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7feee997-9f38-4e4c-adb7-5cf5e27e37fc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:54.802269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7feee997-9f38-4e4c-adb7-5cf5e27e37fc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:54.802766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7feee997-9f38-4e4c-adb7-5cf5e27e37fc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:54.812473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:55.295097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7feee997-9f38-4e4c-adb7-5cf5e27e37fc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:55.314898 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7feee997-9f38-4e4c-adb7-5cf5e27e37fc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.535147 Sep 06 11:05:55.316697 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1708/3409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:54 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:55.346984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3552b127-7dc1-43d1-8800-2f409018e523 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:55.347650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3552b127-7dc1-43d1-8800-2f409018e523 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:55.350574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-44a98541-05a8-4938-9820-00bd50ac678c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:55.351338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-44a98541-05a8-4938-9820-00bd50ac678c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:55.364343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44a98541-05a8-4938-9820-00bd50ac678c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:55.364771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3552b127-7dc1-43d1-8800-2f409018e523 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:55.365275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3552b127-7dc1-43d1-8800-2f409018e523 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:55.365724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3552b127-7dc1-43d1-8800-2f409018e523 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:55.366446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3552b127-7dc1-43d1-8800-2f409018e523 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:55.366974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44a98541-05a8-4938-9820-00bd50ac678c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:55.367449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44a98541-05a8-4938-9820-00bd50ac678c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:55.368152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44a98541-05a8-4938-9820-00bd50ac678c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:55.368709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3552b127-7dc1-43d1-8800-2f409018e523 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:55.369308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3552b127-7dc1-43d1-8800-2f409018e523 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:55.369939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44a98541-05a8-4938-9820-00bd50ac678c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:55.373032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44a98541-05a8-4938-9820-00bd50ac678c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:55.568176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3552b127-7dc1-43d1-8800-2f409018e523 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:55.585223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3552b127-7dc1-43d1-8800-2f409018e523 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:55.587883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3552b127-7dc1-43d1-8800-2f409018e523 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:55.596276 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3552b127-7dc1-43d1-8800-2f409018e523 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.258500 Sep 06 11:05:55.597147 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1709/3410] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:55 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:55.602358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5460f706-e6a7-4c16-8e60-8489b3fe3a90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:55.603274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5460f706-e6a7-4c16-8e60-8489b3fe3a90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:55.695453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5460f706-e6a7-4c16-8e60-8489b3fe3a90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:55.706715 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5460f706-e6a7-4c16-8e60-8489b3fe3a90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1213 microversion: 2.1 time: 0.108024 Sep 06 11:05:55.714725 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1710/3411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:55 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:55.721719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b53324cd-2144-41e9-8599-102309305d13 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:55.728718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b53324cd-2144-41e9-8599-102309305d13 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:55.746376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b53324cd-2144-41e9-8599-102309305d13 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:55.762526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b53324cd-2144-41e9-8599-102309305d13 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:55.765028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b53324cd-2144-41e9-8599-102309305d13 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:55.768397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b53324cd-2144-41e9-8599-102309305d13 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:55.770228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b53324cd-2144-41e9-8599-102309305d13 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:55.770806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b53324cd-2144-41e9-8599-102309305d13 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:56.080505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-44a98541-05a8-4938-9820-00bd50ac678c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:56.092803 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-44a98541-05a8-4938-9820-00bd50ac678c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.752512 Sep 06 11:05:56.093589 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1702/3412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:55 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:56.125983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f1fd8ac1-57b2-4020-a0fc-f3ba5d6ba2bd tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:56.126394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f1fd8ac1-57b2-4020-a0fc-f3ba5d6ba2bd tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:56.143667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1fd8ac1-57b2-4020-a0fc-f3ba5d6ba2bd tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:56.144186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1fd8ac1-57b2-4020-a0fc-f3ba5d6ba2bd tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:56.144644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1fd8ac1-57b2-4020-a0fc-f3ba5d6ba2bd tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:56.145441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1fd8ac1-57b2-4020-a0fc-f3ba5d6ba2bd tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:56.145923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1fd8ac1-57b2-4020-a0fc-f3ba5d6ba2bd tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:56.150360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1fd8ac1-57b2-4020-a0fc-f3ba5d6ba2bd tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:56.495375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b53324cd-2144-41e9-8599-102309305d13 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:56.509859 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b53324cd-2144-41e9-8599-102309305d13 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1606 microversion: 2.1 time: 0.793895 Sep 06 11:05:56.533296 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1711/3413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:55 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1606 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:56.557071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1345631318", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "350b7fa2-cbf1-4a97-afcf-fd60d6924de1"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:56.672988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] validate_networks() for [('350b7fa2-cbf1-4a97-afcf-fd60d6924de1', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:05:56.923166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f1fd8ac1-57b2-4020-a0fc-f3ba5d6ba2bd tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:56.949508 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f1fd8ac1-57b2-4020-a0fc-f3ba5d6ba2bd tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1520 microversion: 2.1 time: 0.823375 Sep 06 11:05:56.952076 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1703/3414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:56 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1520 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:56.966797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-de6713bd-05ab-4d81-8f97-c61a62e6ff28 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:56.973864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-de6713bd-05ab-4d81-8f97-c61a62e6ff28 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:56.988714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de6713bd-05ab-4d81-8f97-c61a62e6ff28 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:56.989565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de6713bd-05ab-4d81-8f97-c61a62e6ff28 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:56.990290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de6713bd-05ab-4d81-8f97-c61a62e6ff28 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:56.994760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de6713bd-05ab-4d81-8f97-c61a62e6ff28 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:56.995529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de6713bd-05ab-4d81-8f97-c61a62e6ff28 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:56.996619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de6713bd-05ab-4d81-8f97-c61a62e6ff28 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:57.761836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-de6713bd-05ab-4d81-8f97-c61a62e6ff28 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:57.772233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-de6713bd-05ab-4d81-8f97-c61a62e6ff28 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:57.773783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-de6713bd-05ab-4d81-8f97-c61a62e6ff28 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:57.791632 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-de6713bd-05ab-4d81-8f97-c61a62e6ff28 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1558 microversion: 2.91 time: 0.836916 Sep 06 11:05:57.794232 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1704/3415] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:56 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1558 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:57.800371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0abed498-cd74-40ed-9294-6cd15977fdc2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:57.803762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0abed498-cd74-40ed-9294-6cd15977fdc2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:57.816097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0abed498-cd74-40ed-9294-6cd15977fdc2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:57.817580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0abed498-cd74-40ed-9294-6cd15977fdc2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:57.818209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0abed498-cd74-40ed-9294-6cd15977fdc2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:57.819170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0abed498-cd74-40ed-9294-6cd15977fdc2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:57.820497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0abed498-cd74-40ed-9294-6cd15977fdc2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:57.821134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0abed498-cd74-40ed-9294-6cd15977fdc2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:57.983376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0abed498-cd74-40ed-9294-6cd15977fdc2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:57.993266 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0abed498-cd74-40ed-9294-6cd15977fdc2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1273 microversion: 2.1 time: 0.197532 Sep 06 11:05:57.999564 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1705/3416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:57 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:58.004908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-123bfceb-29dd-4285-83ac-837f8b55aef1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1156076976", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "4d275685-de06-4cb8-90b4-c5cbcbf133c3"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-123bfceb-29dd-4285-83ac-837f8b55aef1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Request method failure captured: Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 243 Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFymDIkXDDUGXKn-ZEPd9dy-p02Lg_FzPnfyt1pcg4N4qWE3v53-L6YO5DcG1806KIOSHH_0c27mNdATDLtXpz5xVi3k6o-Bf7ewVFSwTWnrlZi8xClxo8NcsGZ08kPucuLaXQyNlJewn6ShCyTk8GaCZprGef9oRsZ1_XDsVcDznOxo Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}] Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 596b0a6958704e9eb27683ee535a9b60 Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1156076976", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "4d275685-de06-4cb8-90b4-c5cbcbf133c3"}]}} Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1156076976', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '4d275685-de06-4cb8-90b4-c5cbcbf133c3'}]}}} Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:58.019831 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.024528 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.027802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-123bfceb-29dd-4285-83ac-837f8b55aef1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:58.031137 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-123bfceb-29dd-4285-83ac-837f8b55aef1 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.030024 Sep 06 11:05:58.036481 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1706/3417] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:05:57 2022] POST /compute/v2.1/servers => generated 175 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:05:58.042039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b5a92c69-bed7-4f62-adbe-f80741f1e187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:58.047262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b5a92c69-bed7-4f62-adbe-f80741f1e187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:58.063295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5a92c69-bed7-4f62-adbe-f80741f1e187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:58.068117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5a92c69-bed7-4f62-adbe-f80741f1e187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:58.072051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5a92c69-bed7-4f62-adbe-f80741f1e187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:58.073053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5a92c69-bed7-4f62-adbe-f80741f1e187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:58.073743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5a92c69-bed7-4f62-adbe-f80741f1e187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:58.076778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5a92c69-bed7-4f62-adbe-f80741f1e187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:58.368692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b5a92c69-bed7-4f62-adbe-f80741f1e187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:58.387356 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b5a92c69-bed7-4f62-adbe-f80741f1e187 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1538 microversion: 2.1 time: 0.348441 Sep 06 11:05:58.389430 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1707/3418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:58 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1538 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:58.407381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ac28a29-3f21-4c85-91df-9e396d28a1f9 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:58.410286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ac28a29-3f21-4c85-91df-9e396d28a1f9 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: 81c998cd-3b2b-4d20-ba2c-aeda19a666e0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:58.428992 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-9ac28a29-3f21-4c85-91df-9e396d28a1f9 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] HTTP exception thrown: Instance 81c998cd-3b2b-4d20-ba2c-aeda19a666e0 could not be found. Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ac28a29-3f21-4c85-91df-9e396d28a1f9 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Request method failure captured: Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/81c998cd-3b2b-4d20-ba2c-aeda19a666e0/metadata HTTP/1.1 Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFymDIkXDDUGXKn-ZEPd9dy-p02Lg_FzPnfyt1pcg4N4qWE3v53-L6YO5DcG1806KIOSHH_0c27mNdATDLtXpz5xVi3k6o-Bf7ewVFSwTWnrlZi8xClxo8NcsGZ08kPucuLaXQyNlJewn6ShCyTk8GaCZprGef9oRsZ1_XDsVcDznOxo Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}] Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 596b0a6958704e9eb27683ee535a9b60 Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 81c998cd-3b2b-4d20-ba2c-aeda19a666e0 could not be found. Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'server_id': '81c998cd-3b2b-4d20-ba2c-aeda19a666e0'} Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81c998cd-3b2b-4d20-ba2c-aeda19a666e0 could not be found. Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81c998cd-3b2b-4d20-ba2c-aeda19a666e0 could not be found. Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.435911 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.448403 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:58.448403 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:58.448403 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81c998cd-3b2b-4d20-ba2c-aeda19a666e0 could not be found. Sep 06 11:05:58.448403 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.448403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ac28a29-3f21-4c85-91df-9e396d28a1f9 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Returning 404 to user: Instance 81c998cd-3b2b-4d20-ba2c-aeda19a666e0 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:58.448403 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ac28a29-3f21-4c85-91df-9e396d28a1f9 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/81c998cd-3b2b-4d20-ba2c-aeda19a666e0/metadata" status: 404 len: 111 microversion: 2.1 time: 0.047079 Sep 06 11:05:58.448403 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1708/3419] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:05:58 2022] GET /compute/v2.1/servers/81c998cd-3b2b-4d20-ba2c-aeda19a666e0/metadata => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:58.509020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-043f3992-f31a-4caf-82ee-2edf1ed07479 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2127398681", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4d275685-de06-4cb8-90b4-c5cbcbf133c3"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-043f3992-f31a-4caf-82ee-2edf1ed07479 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Request method failure captured: Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 499 Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFymDIkXDDUGXKn-ZEPd9dy-p02Lg_FzPnfyt1pcg4N4qWE3v53-L6YO5DcG1806KIOSHH_0c27mNdATDLtXpz5xVi3k6o-Bf7ewVFSwTWnrlZi8xClxo8NcsGZ08kPucuLaXQyNlJewn6ShCyTk8GaCZprGef9oRsZ1_XDsVcDznOxo Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}] Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 596b0a6958704e9eb27683ee535a9b60 Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2127398681", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4d275685-de06-4cb8-90b4-c5cbcbf133c3"}]}} Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2127398681', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4d275685-de06-4cb8-90b4-c5cbcbf133c3'}]}}} Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 06 11:05:58.514019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-043f3992-f31a-4caf-82ee-2edf1ed07479 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-043f3992-f31a-4caf-82ee-2edf1ed07479 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.011111 Sep 06 11:05:58.519505 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1709/3420] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:05:58 2022] POST /compute/v2.1/servers => generated 687 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 11:05:58.590717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dd9fbf0d-caef-4522-bc70-1c49153ac0d6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1609979332", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4d275685-de06-4cb8-90b4-c5cbcbf133c3"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dd9fbf0d-caef-4522-bc70-1c49153ac0d6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Request method failure captured: Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 500 Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFymDIkXDDUGXKn-ZEPd9dy-p02Lg_FzPnfyt1pcg4N4qWE3v53-L6YO5DcG1806KIOSHH_0c27mNdATDLtXpz5xVi3k6o-Bf7ewVFSwTWnrlZi8xClxo8NcsGZ08kPucuLaXQyNlJewn6ShCyTk8GaCZprGef9oRsZ1_XDsVcDznOxo Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}] Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 596b0a6958704e9eb27683ee535a9b60 Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1609979332", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4d275685-de06-4cb8-90b4-c5cbcbf133c3"}]}} Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1609979332', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4d275685-de06-4cb8-90b4-c5cbcbf133c3'}]}}} Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 06 11:05:58.604049 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dd9fbf0d-caef-4522-bc70-1c49153ac0d6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:58.609636 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dd9fbf0d-caef-4522-bc70-1c49153ac0d6 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.029402 Sep 06 11:05:58.615599 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1710/3421] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:05:58 2022] POST /compute/v2.1/servers => generated 689 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:05:58.697814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca5f9029-1265-4d1f-934e-8e70d3893701 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-521372429", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4d275685-de06-4cb8-90b4-c5cbcbf133c3"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca5f9029-1265-4d1f-934e-8e70d3893701 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Request method failure captured: Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 753 Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFymDIkXDDUGXKn-ZEPd9dy-p02Lg_FzPnfyt1pcg4N4qWE3v53-L6YO5DcG1806KIOSHH_0c27mNdATDLtXpz5xVi3k6o-Bf7ewVFSwTWnrlZi8xClxo8NcsGZ08kPucuLaXQyNlJewn6ShCyTk8GaCZprGef9oRsZ1_XDsVcDznOxo Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}] Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 596b0a6958704e9eb27683ee535a9b60 Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-521372429", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4d275685-de06-4cb8-90b4-c5cbcbf133c3"}]}} Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-521372429', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4d275685-de06-4cb8-90b4-c5cbcbf133c3'}]}}} Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:05:58.702529 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:05:58.705490 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:05:58.711844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.711844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.711844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca5f9029-1265-4d1f-934e-8e70d3893701 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:58.711844 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ca5f9029-1265-4d1f-934e-8e70d3893701 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.014692 Sep 06 11:05:58.711844 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1711/3422] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:05:58 2022] POST /compute/v2.1/servers => generated 1197 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Sep 06 11:05:58.750115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:05:58.750635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:05:58.751478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:05:58.752258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:05:58.753287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:05:58.793869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f9df821d-eaf5-433a-94a7-41bec13bf38d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-208120354", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4d275685-de06-4cb8-90b4-c5cbcbf133c3"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f9df821d-eaf5-433a-94a7-41bec13bf38d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Request method failure captured: Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 1265 Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFymDIkXDDUGXKn-ZEPd9dy-p02Lg_FzPnfyt1pcg4N4qWE3v53-L6YO5DcG1806KIOSHH_0c27mNdATDLtXpz5xVi3k6o-Bf7ewVFSwTWnrlZi8xClxo8NcsGZ08kPucuLaXQyNlJewn6ShCyTk8GaCZprGef9oRsZ1_XDsVcDznOxo Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}] Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 596b0a6958704e9eb27683ee535a9b60 Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-208120354", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4d275685-de06-4cb8-90b4-c5cbcbf133c3"}]}} Sep 06 11:05:58.799837 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-208120354', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4d275685-de06-4cb8-90b4-c5cbcbf133c3'}]}}} Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.817330 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:05:58.819075 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:05:58.821487 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 06 11:05:58.821487 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.821487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f9df821d-eaf5-433a-94a7-41bec13bf38d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:58.821487 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f9df821d-eaf5-433a-94a7-41bec13bf38d tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.011686 Sep 06 11:05:58.821928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:58.822038 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1712/3423] 10.222.0.20 () {60 vars in 1148 bytes} [Tue Sep 6 11:05:58 2022] POST /compute/v2.1/servers => generated 2221 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 06 11:05:58.822140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:58.822140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:58.822140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:58.822140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:58.822140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:58.822614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6fdbff7b-f04a-4b09-9e7d-60909ddc34ac tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:58.822614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6fdbff7b-f04a-4b09-9e7d-60909ddc34ac tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: 2b8d1512-bb76-4505-bdbe-797ca4083879] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:58.833176 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-6fdbff7b-f04a-4b09-9e7d-60909ddc34ac tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] HTTP exception thrown: Instance 2b8d1512-bb76-4505-bdbe-797ca4083879 could not be found. Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6fdbff7b-f04a-4b09-9e7d-60909ddc34ac tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Request method failure captured: Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/2b8d1512-bb76-4505-bdbe-797ca4083879/metadata/test2 HTTP/1.1 Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFymDIkXDDUGXKn-ZEPd9dy-p02Lg_FzPnfyt1pcg4N4qWE3v53-L6YO5DcG1806KIOSHH_0c27mNdATDLtXpz5xVi3k6o-Bf7ewVFSwTWnrlZi8xClxo8NcsGZ08kPucuLaXQyNlJewn6ShCyTk8GaCZprGef9oRsZ1_XDsVcDznOxo Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}] Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 596b0a6958704e9eb27683ee535a9b60 Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 2b8d1512-bb76-4505-bdbe-797ca4083879 could not be found. Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'server_id': '2b8d1512-bb76-4505-bdbe-797ca4083879', 'id': 'test2'} Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8d1512-bb76-4505-bdbe-797ca4083879 could not be found. Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8d1512-bb76-4505-bdbe-797ca4083879 could not be found. Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:05:58.834728 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:05:58.847950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:05:58.847950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:05:58.847950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8d1512-bb76-4505-bdbe-797ca4083879 could not be found. Sep 06 11:05:58.847950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:05:58.847950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6fdbff7b-f04a-4b09-9e7d-60909ddc34ac tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Returning 404 to user: Instance 2b8d1512-bb76-4505-bdbe-797ca4083879 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:05:58.847950 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6fdbff7b-f04a-4b09-9e7d-60909ddc34ac tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/2b8d1512-bb76-4505-bdbe-797ca4083879/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.019956 Sep 06 11:05:58.847950 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1713/3424] 10.222.0.20 () {58 vars in 1281 bytes} [Tue Sep 6 11:05:58 2022] GET /compute/v2.1/servers/2b8d1512-bb76-4505-bdbe-797ca4083879/metadata/test2 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:05:58.862756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1a5b95bf-5726-4d84-9bcc-2926e2386db8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:58.863423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1a5b95bf-5726-4d84-9bcc-2926e2386db8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:58.883553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a5b95bf-5726-4d84-9bcc-2926e2386db8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:58.884067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a5b95bf-5726-4d84-9bcc-2926e2386db8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:58.884519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a5b95bf-5726-4d84-9bcc-2926e2386db8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:58.885255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a5b95bf-5726-4d84-9bcc-2926e2386db8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:58.885726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a5b95bf-5726-4d84-9bcc-2926e2386db8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:58.886166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a5b95bf-5726-4d84-9bcc-2926e2386db8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:58.915641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Getting quotas for project dcd5ffec2c6246fb89ba181542692585. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:05:58.923846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Getting quotas for user f16abbf8a68344b68444ff8fc2795c67 and project dcd5ffec2c6246fb89ba181542692585. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:05:58.938718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:05:58.941812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:05:59.095550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1a5b95bf-5726-4d84-9bcc-2926e2386db8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:59.105201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1a5b95bf-5726-4d84-9bcc-2926e2386db8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:59.107209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1a5b95bf-5726-4d84-9bcc-2926e2386db8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:59.113038 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1a5b95bf-5726-4d84-9bcc-2926e2386db8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.270534 Sep 06 11:05:59.136411 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1714/3425] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:05:58 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:05:59.143592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-41da3f02-0c86-4ad5-80b2-632a65a83136 req-84ea10f9-7a0d-4857-9729-66ccd87af51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c16b23-fea9-48c2-a5e0-ad2f3af9f743", "name": "network-vif-deleted", "tag": "d6f21549-bb52-41f9-ba87-a7a0452169a3"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:05:59.156410 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2882399f-94f2-4ac4-99d0-5273156c4683 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.611226 Sep 06 11:05:59.157926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-41da3f02-0c86-4ad5-80b2-632a65a83136 req-84ea10f9-7a0d-4857-9729-66ccd87af51b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:59.158928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-41da3f02-0c86-4ad5-80b2-632a65a83136 req-84ea10f9-7a0d-4857-9729-66ccd87af51b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:59.160850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-41da3f02-0c86-4ad5-80b2-632a65a83136 req-84ea10f9-7a0d-4857-9729-66ccd87af51b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:59.161766 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1712/3426] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:05:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:05:59.191545 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-41da3f02-0c86-4ad5-80b2-632a65a83136 req-84ea10f9-7a0d-4857-9729-66ccd87af51b service nova] Creating event network-vif-deleted:d6f21549-bb52-41f9-ba87-a7a0452169a3 for instance 98c16b23-fea9-48c2-a5e0-ad2f3af9f743 on nch2-master-1 Sep 06 11:05:59.197999 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-41da3f02-0c86-4ad5-80b2-632a65a83136 req-84ea10f9-7a0d-4857-9729-66ccd87af51b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059772 Sep 06 11:05:59.199093 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1715/3427] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:05:59.207502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-916fb044-0299-4d61-a405-2da14f2b7872 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:59.208022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-916fb044-0299-4d61-a405-2da14f2b7872 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:59.209070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2290c5c6-8ffe-416a-a542-00f75b8f288c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:59.209915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2290c5c6-8ffe-416a-a542-00f75b8f288c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:59.223337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2290c5c6-8ffe-416a-a542-00f75b8f288c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:59.224334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2290c5c6-8ffe-416a-a542-00f75b8f288c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:59.225035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2290c5c6-8ffe-416a-a542-00f75b8f288c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:59.226000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2290c5c6-8ffe-416a-a542-00f75b8f288c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:59.227209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2290c5c6-8ffe-416a-a542-00f75b8f288c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:59.227952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2290c5c6-8ffe-416a-a542-00f75b8f288c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:59.228585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-916fb044-0299-4d61-a405-2da14f2b7872 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:59.229090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-916fb044-0299-4d61-a405-2da14f2b7872 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:59.229538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-916fb044-0299-4d61-a405-2da14f2b7872 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:59.230269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-916fb044-0299-4d61-a405-2da14f2b7872 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:59.230734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-916fb044-0299-4d61-a405-2da14f2b7872 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:59.237449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-916fb044-0299-4d61-a405-2da14f2b7872 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:59.335379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-916fb044-0299-4d61-a405-2da14f2b7872 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:05:59.428103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2290c5c6-8ffe-416a-a542-00f75b8f288c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:59.443721 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2290c5c6-8ffe-416a-a542-00f75b8f288c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1271 microversion: 2.1 time: 0.243073 Sep 06 11:05:59.462187 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1716/3428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:59 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:59.495715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8eb4a025-caf2-49bb-add6-5b60c20c23b7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:59.499154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8eb4a025-caf2-49bb-add6-5b60c20c23b7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:59.634583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8eb4a025-caf2-49bb-add6-5b60c20c23b7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:05:59.656938 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8eb4a025-caf2-49bb-add6-5b60c20c23b7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1215 microversion: 2.1 time: 0.193235 Sep 06 11:05:59.670416 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1717/3429] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:59 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1215 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:05:59.708160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a311838c-880a-444c-bbb6-e4323526d1c8 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:59.718832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a311838c-880a-444c-bbb6-e4323526d1c8 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:59.739809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a311838c-880a-444c-bbb6-e4323526d1c8 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:59.740475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a311838c-880a-444c-bbb6-e4323526d1c8 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:59.741294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a311838c-880a-444c-bbb6-e4323526d1c8 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:59.742433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a311838c-880a-444c-bbb6-e4323526d1c8 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:59.743323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a311838c-880a-444c-bbb6-e4323526d1c8 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:59.743974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a311838c-880a-444c-bbb6-e4323526d1c8 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:59.900642 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-916fb044-0299-4d61-a405-2da14f2b7872 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 204 len: 0 microversion: 2.1 time: 0.704622 Sep 06 11:05:59.900642 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1713/3430] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:05:59 2022] DELETE /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:05:59.910853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-35773b5a-23d5-4a59-9988-f85994db70bc tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:05:59.911839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-35773b5a-23d5-4a59-9988-f85994db70bc tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:05:59.940120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35773b5a-23d5-4a59-9988-f85994db70bc tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:59.955236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35773b5a-23d5-4a59-9988-f85994db70bc tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:59.955754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35773b5a-23d5-4a59-9988-f85994db70bc tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:59.956479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35773b5a-23d5-4a59-9988-f85994db70bc tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:05:59.983851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35773b5a-23d5-4a59-9988-f85994db70bc tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:05:59.986805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35773b5a-23d5-4a59-9988-f85994db70bc tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:05:59.988991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a311838c-880a-444c-bbb6-e4323526d1c8 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:00.001393 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a311838c-880a-444c-bbb6-e4323526d1c8 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1251 microversion: 2.1 time: 0.329046 Sep 06 11:06:00.014348 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1718/3431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:59 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1251 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:00.153207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b51727c2-26c6-4ff4-893f-b1c0d0adb6bd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:00.154411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b51727c2-26c6-4ff4-893f-b1c0d0adb6bd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:00.167475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b51727c2-26c6-4ff4-893f-b1c0d0adb6bd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:00.170238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b51727c2-26c6-4ff4-893f-b1c0d0adb6bd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:00.170709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b51727c2-26c6-4ff4-893f-b1c0d0adb6bd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:00.171526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b51727c2-26c6-4ff4-893f-b1c0d0adb6bd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:00.175585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b51727c2-26c6-4ff4-893f-b1c0d0adb6bd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:00.178367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b51727c2-26c6-4ff4-893f-b1c0d0adb6bd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:00.563547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b51727c2-26c6-4ff4-893f-b1c0d0adb6bd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:00.574225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b51727c2-26c6-4ff4-893f-b1c0d0adb6bd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:00.592112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b51727c2-26c6-4ff4-893f-b1c0d0adb6bd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:00.610905 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b51727c2-26c6-4ff4-893f-b1c0d0adb6bd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.465862 Sep 06 11:06:00.615512 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1719/3432] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:00 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:00.628447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56c810dc-3f0a-4d89-aa94-c94b51eb44f1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:00.629082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56c810dc-3f0a-4d89-aa94-c94b51eb44f1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:00.647603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56c810dc-3f0a-4d89-aa94-c94b51eb44f1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:00.649331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56c810dc-3f0a-4d89-aa94-c94b51eb44f1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:00.657183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56c810dc-3f0a-4d89-aa94-c94b51eb44f1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:00.657428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56c810dc-3f0a-4d89-aa94-c94b51eb44f1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:00.663329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56c810dc-3f0a-4d89-aa94-c94b51eb44f1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:00.664438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56c810dc-3f0a-4d89-aa94-c94b51eb44f1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:00.890502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-35773b5a-23d5-4a59-9988-f85994db70bc tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:00.900640 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-35773b5a-23d5-4a59-9988-f85994db70bc tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1526 microversion: 2.1 time: 0.997480 Sep 06 11:06:00.907541 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1714/3433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:05:59 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1526 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:00.924698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3b8f43d0-b492-4786-9a19-1439608dfe20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:00.925560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3b8f43d0-b492-4786-9a19-1439608dfe20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:01.126418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3b8f43d0-b492-4786-9a19-1439608dfe20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:01.129554 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3b8f43d0-b492-4786-9a19-1439608dfe20 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1215 microversion: 2.1 time: 0.217590 Sep 06 11:06:01.130673 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1715/3434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:00 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:01.148020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:01.165433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:01.179874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:01.180378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:01.185034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:01.187655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:01.190424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:01.195463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:01.224998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-56c810dc-3f0a-4d89-aa94-c94b51eb44f1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:01.236239 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56c810dc-3f0a-4d89-aa94-c94b51eb44f1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1313 microversion: 2.1 time: 0.619524 Sep 06 11:06:01.236987 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1720/3435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:00 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:01.311410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:01.320081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:01.320081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:01.320468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lazy-loading 'fault' on Instance uuid 98c16b23-fea9-48c2-a5e0-ad2f3af9f743 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:06:01.524609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a880494fb3144a58afd1fbfa8eff6cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2ed3ceca87459d8b6db473a08b3464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:01.532027 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-69005297-24a9-4be1-b028-b6b70388b30f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 200 len: 1256 microversion: 2.1 time: 0.391263 Sep 06 11:06:01.548046 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1716/3436] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:01 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 1256 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:01.648710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b1b6f9d2-fd0a-4b06-a3f6-1d0c109afdec tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:01.649379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b1b6f9d2-fd0a-4b06-a3f6-1d0c109afdec tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:01.674105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b1b6f9d2-fd0a-4b06-a3f6-1d0c109afdec tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:01.676428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b1b6f9d2-fd0a-4b06-a3f6-1d0c109afdec tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:01.676766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b1b6f9d2-fd0a-4b06-a3f6-1d0c109afdec tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:01.677606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b1b6f9d2-fd0a-4b06-a3f6-1d0c109afdec tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:01.679829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b1b6f9d2-fd0a-4b06-a3f6-1d0c109afdec tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:01.680284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b1b6f9d2-fd0a-4b06-a3f6-1d0c109afdec tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:01.930426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-67b075be-7df0-4205-97ae-7816b3ede129 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:01.931215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-67b075be-7df0-4205-97ae-7816b3ede129 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:01.963979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67b075be-7df0-4205-97ae-7816b3ede129 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:01.964540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67b075be-7df0-4205-97ae-7816b3ede129 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:01.964956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67b075be-7df0-4205-97ae-7816b3ede129 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:01.965672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67b075be-7df0-4205-97ae-7816b3ede129 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:01.966680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67b075be-7df0-4205-97ae-7816b3ede129 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:01.967128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67b075be-7df0-4205-97ae-7816b3ede129 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:01.986970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b1b6f9d2-fd0a-4b06-a3f6-1d0c109afdec tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:01.998600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b1b6f9d2-fd0a-4b06-a3f6-1d0c109afdec tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:02.000105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b1b6f9d2-fd0a-4b06-a3f6-1d0c109afdec tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:02.025419 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b1b6f9d2-fd0a-4b06-a3f6-1d0c109afdec tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.385758 Sep 06 11:06:02.026016 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1721/3437] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:01 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:02.161690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-021846e4-617f-4429-8e94-9a0e6327d1aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:02.162260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-021846e4-617f-4429-8e94-9a0e6327d1aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:02.171753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-021846e4-617f-4429-8e94-9a0e6327d1aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:02.173828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-021846e4-617f-4429-8e94-9a0e6327d1aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:02.173828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-021846e4-617f-4429-8e94-9a0e6327d1aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:02.174285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-021846e4-617f-4429-8e94-9a0e6327d1aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:02.174753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-021846e4-617f-4429-8e94-9a0e6327d1aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:02.175229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-021846e4-617f-4429-8e94-9a0e6327d1aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:02.494348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-021846e4-617f-4429-8e94-9a0e6327d1aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:02.509364 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-021846e4-617f-4429-8e94-9a0e6327d1aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1267 microversion: 2.1 time: 0.351593 Sep 06 11:06:02.511621 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1722/3438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:02 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1267 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:02.521043 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0e5816c8-5e0b-405d-b046-4edd44070f98 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:02.525977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0e5816c8-5e0b-405d-b046-4edd44070f98 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:02.549941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e5816c8-5e0b-405d-b046-4edd44070f98 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:02.550593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e5816c8-5e0b-405d-b046-4edd44070f98 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:02.551510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e5816c8-5e0b-405d-b046-4edd44070f98 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:02.553055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e5816c8-5e0b-405d-b046-4edd44070f98 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:02.553754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e5816c8-5e0b-405d-b046-4edd44070f98 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:02.554409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e5816c8-5e0b-405d-b046-4edd44070f98 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:02.939295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-67b075be-7df0-4205-97ae-7816b3ede129 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:02.950726 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-67b075be-7df0-4205-97ae-7816b3ede129 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1526 microversion: 2.1 time: 1.023118 Sep 06 11:06:02.956797 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1717/3439] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:01 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1526 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:02.957326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7bf4e564-e49a-42c1-8f84-72609c613739 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:02.958160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7bf4e564-e49a-42c1-8f84-72609c613739 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] [instance: 98c16b23-fea9-48c2-a5e0-ad2f3af9f743] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:02.965819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7bf4e564-e49a-42c1-8f84-72609c613739 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:02.966616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7bf4e564-e49a-42c1-8f84-72609c613739 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:02.967280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7bf4e564-e49a-42c1-8f84-72609c613739 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:02.968205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7bf4e564-e49a-42c1-8f84-72609c613739 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:02.969038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7bf4e564-e49a-42c1-8f84-72609c613739 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:02.969705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7bf4e564-e49a-42c1-8f84-72609c613739 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:02.992106 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-7bf4e564-e49a-42c1-8f84-72609c613739 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] HTTP exception thrown: Instance 98c16b23-fea9-48c2-a5e0-ad2f3af9f743 could not be found. Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7bf4e564-e49a-42c1-8f84-72609c613739 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Request method failure captured: Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 HTTP/1.1 Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyfPSQP6gyAn7mH1OwlBP53rqvh19EocubOIBrTMX56JE_8bh6mW3W_vVYdNwuAcIkK3M1gqzJkcqTu119tuSiL7ajOLiA9IFptdPUtwk1EcFpuyFMxIDwc-WfRDMAbKO5PVns_Z6iK8YtgOkzirIvMnC5a0B--HbiK7dBijY8jOCyI Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aa2ed3ceca87459d8b6db473a08b3464 Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestBootFromVolume-577790625 Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa2ed3ceca87459d8b6db473a08b3464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa2ed3ceca87459d8b6db473a08b3464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa2ed3ceca87459d8b6db473a08b3464"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa2ed3ceca87459d8b6db473a08b3464"}]}] Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestBootFromVolume-577790625 Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aa2ed3ceca87459d8b6db473a08b3464 Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestBootFromVolume-577790625 Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestBootFromVolume-577790625-project Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: a880494fb3144a58afd1fbfa8eff6cb4 Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestBootFromVolume-577790625-project Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 98c16b23-fea9-48c2-a5e0-ad2f3af9f743 could not be found. Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '98c16b23-fea9-48c2-a5e0-ad2f3af9f743'} Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98c16b23-fea9-48c2-a5e0-ad2f3af9f743 could not be found. Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98c16b23-fea9-48c2-a5e0-ad2f3af9f743 could not be found. Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:06:02.994948 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:06:03.000286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:06:03.000286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:06:03.000286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:06:03.000286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:06:03.000286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:06:03.000286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98c16b23-fea9-48c2-a5e0-ad2f3af9f743 could not be found. Sep 06 11:06:03.000286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:06:03.000286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7bf4e564-e49a-42c1-8f84-72609c613739 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Returning 404 to user: Instance 98c16b23-fea9-48c2-a5e0-ad2f3af9f743 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:06:03.002340 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7bf4e564-e49a-42c1-8f84-72609c613739 tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743" status: 404 len: 111 microversion: 2.1 time: 0.049132 Sep 06 11:06:03.003470 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1718/3440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:02 2022] GET /compute/v2.1/servers/98c16b23-fea9-48c2-a5e0-ad2f3af9f743 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:06:03.013533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-83154ac7-89ca-43da-a55e-b00a734a029f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] Calling method '.version_select at 0x7f90f33ea940>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:03.081368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0e5816c8-5e0b-405d-b046-4edd44070f98 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:03.114680 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-83154ac7-89ca-43da-a55e-b00a734a029f tempest-ServersTestBootFromVolume-577790625 tempest-ServersTestBootFromVolume-577790625-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-395680744" status: 202 len: 0 microversion: 2.1 time: 0.103612 Sep 06 11:06:03.116518 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1719/3441] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 11:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-395680744 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:06:03.124375 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0e5816c8-5e0b-405d-b046-4edd44070f98 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1313 microversion: 2.1 time: 0.609863 Sep 06 11:06:03.126991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e49f0ba4-c2ef-4dc3-954c-253c2f8b1abe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:03.127857 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1723/3442] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:02 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:03.148300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e49f0ba4-c2ef-4dc3-954c-253c2f8b1abe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:03.164935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e49f0ba4-c2ef-4dc3-954c-253c2f8b1abe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:03.165737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e49f0ba4-c2ef-4dc3-954c-253c2f8b1abe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:03.166639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e49f0ba4-c2ef-4dc3-954c-253c2f8b1abe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:03.167860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e49f0ba4-c2ef-4dc3-954c-253c2f8b1abe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:03.168526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e49f0ba4-c2ef-4dc3-954c-253c2f8b1abe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:03.169694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e49f0ba4-c2ef-4dc3-954c-253c2f8b1abe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:03.366520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e49f0ba4-c2ef-4dc3-954c-253c2f8b1abe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:03.377067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e49f0ba4-c2ef-4dc3-954c-253c2f8b1abe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:03.378936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e49f0ba4-c2ef-4dc3-954c-253c2f8b1abe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:03.394992 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e49f0ba4-c2ef-4dc3-954c-253c2f8b1abe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.275798 Sep 06 11:06:03.396174 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1720/3443] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:03 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:03.538454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8a8606fb-b350-4954-9254-a295a8b06c8e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:03.539116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8a8606fb-b350-4954-9254-a295a8b06c8e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:03.554536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a8606fb-b350-4954-9254-a295a8b06c8e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:03.554536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a8606fb-b350-4954-9254-a295a8b06c8e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:03.554536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a8606fb-b350-4954-9254-a295a8b06c8e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:03.554536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a8606fb-b350-4954-9254-a295a8b06c8e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:03.554536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a8606fb-b350-4954-9254-a295a8b06c8e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:03.554536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a8606fb-b350-4954-9254-a295a8b06c8e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:03.567720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-17f84bf9-9590-405a-ad0b-dffe73c3e7a4 req-9cb22098-c60f-4b61-861a-30bcfa6fa055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e91126-5a0b-426e-b1ed-c89d61c97763", "name": "network-vif-deleted", "tag": "432c8561-98d0-4933-a0f2-ffeb835e2936"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:03.582574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-17f84bf9-9590-405a-ad0b-dffe73c3e7a4 req-9cb22098-c60f-4b61-861a-30bcfa6fa055 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:03.584708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-17f84bf9-9590-405a-ad0b-dffe73c3e7a4 req-9cb22098-c60f-4b61-861a-30bcfa6fa055 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:03.585680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-17f84bf9-9590-405a-ad0b-dffe73c3e7a4 req-9cb22098-c60f-4b61-861a-30bcfa6fa055 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:03.614242 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-17f84bf9-9590-405a-ad0b-dffe73c3e7a4 req-9cb22098-c60f-4b61-861a-30bcfa6fa055 service nova] Creating event network-vif-deleted:432c8561-98d0-4933-a0f2-ffeb835e2936 for instance d9e91126-5a0b-426e-b1ed-c89d61c97763 on nch2-master-1 Sep 06 11:06:03.636723 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-17f84bf9-9590-405a-ad0b-dffe73c3e7a4 req-9cb22098-c60f-4b61-861a-30bcfa6fa055 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073500 Sep 06 11:06:03.646825 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1721/3444] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:06:03.796602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8a8606fb-b350-4954-9254-a295a8b06c8e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:03.805403 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8a8606fb-b350-4954-9254-a295a8b06c8e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1285 microversion: 2.1 time: 0.271112 Sep 06 11:06:03.805995 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1724/3445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:03 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1285 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:03.979615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:03.980955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:03.996331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:04.001896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:04.002362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:04.005539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:04.006038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:04.006488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:04.102993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:04.104705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:04.108098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:04.108098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lazy-loading 'fault' on Instance uuid d9e91126-5a0b-426e-b1ed-c89d61c97763 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:06:04.153297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6967ccf4-20d1-4b99-8cce-a375f7956a0b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:04.154322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6967ccf4-20d1-4b99-8cce-a375f7956a0b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:04.183557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6967ccf4-20d1-4b99-8cce-a375f7956a0b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:04.184278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6967ccf4-20d1-4b99-8cce-a375f7956a0b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:04.187097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6967ccf4-20d1-4b99-8cce-a375f7956a0b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:04.188264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6967ccf4-20d1-4b99-8cce-a375f7956a0b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:04.190302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6967ccf4-20d1-4b99-8cce-a375f7956a0b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:04.191232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6967ccf4-20d1-4b99-8cce-a375f7956a0b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:04.234991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596b0a6958704e9eb27683ee535a9b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff448bc0ec7c43a38a4b8adb062afca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:04.250279 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6a33a369-ba08-4eae-88bf-7097cecef02a tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 200 len: 1313 microversion: 2.1 time: 0.276264 Sep 06 11:06:04.250903 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1722/3446] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:03 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:04.433293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9b0070a-a32d-4df8-b079-48d1ed359d49 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:04.435002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d9b0070a-a32d-4df8-b079-48d1ed359d49 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:04.452786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9b0070a-a32d-4df8-b079-48d1ed359d49 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:04.453534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9b0070a-a32d-4df8-b079-48d1ed359d49 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:04.455510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9b0070a-a32d-4df8-b079-48d1ed359d49 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:04.456438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9b0070a-a32d-4df8-b079-48d1ed359d49 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:04.458899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9b0070a-a32d-4df8-b079-48d1ed359d49 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:04.459544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9b0070a-a32d-4df8-b079-48d1ed359d49 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:04.676929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d9b0070a-a32d-4df8-b079-48d1ed359d49 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:04.688055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d9b0070a-a32d-4df8-b079-48d1ed359d49 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:04.689966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d9b0070a-a32d-4df8-b079-48d1ed359d49 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:04.711922 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d9b0070a-a32d-4df8-b079-48d1ed359d49 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.284765 Sep 06 11:06:04.720802 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1723/3447] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:04 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:04.830674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-262972e8-4744-4741-a2a3-009e0b338ed2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:04.831397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-262972e8-4744-4741-a2a3-009e0b338ed2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:04.839540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-262972e8-4744-4741-a2a3-009e0b338ed2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:04.844080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-262972e8-4744-4741-a2a3-009e0b338ed2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:04.844736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-262972e8-4744-4741-a2a3-009e0b338ed2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:04.846690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-262972e8-4744-4741-a2a3-009e0b338ed2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:04.849661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-262972e8-4744-4741-a2a3-009e0b338ed2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:04.850299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-262972e8-4744-4741-a2a3-009e0b338ed2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:05.589518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6967ccf4-20d1-4b99-8cce-a375f7956a0b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:05.595797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-262972e8-4744-4741-a2a3-009e0b338ed2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:05.602333 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6967ccf4-20d1-4b99-8cce-a375f7956a0b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1313 microversion: 2.1 time: 1.453931 Sep 06 11:06:05.609463 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1725/3448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:04 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1313 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:05.613455 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-262972e8-4744-4741-a2a3-009e0b338ed2 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1273 microversion: 2.1 time: 0.786520 Sep 06 11:06:05.630118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e07e909-ac71-43be-ba03-fd20d60c7661 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:05.630118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3e07e909-ac71-43be-ba03-fd20d60c7661 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] [instance: d9e91126-5a0b-426e-b1ed-c89d61c97763] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:05.636464 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1724/3449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:04 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1273 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:05.660455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e07e909-ac71-43be-ba03-fd20d60c7661 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:05.664302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e07e909-ac71-43be-ba03-fd20d60c7661 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:05.665344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e07e909-ac71-43be-ba03-fd20d60c7661 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:05.665982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e07e909-ac71-43be-ba03-fd20d60c7661 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:05.666443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e07e909-ac71-43be-ba03-fd20d60c7661 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:05.667582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e07e909-ac71-43be-ba03-fd20d60c7661 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:05.673014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-8c93808e-9874-4c77-93ad-e56a7e2f2549 req-4b001866-46ef-4873-9d62-eb7c50f633e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d118b2-ff1f-4582-857b-f44decc2d05b", "tag": "808efaee-c13b-4a8c-8b64-7e38b370aa4b"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:05.703172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8c93808e-9874-4c77-93ad-e56a7e2f2549 req-4b001866-46ef-4873-9d62-eb7c50f633e2 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:05.714944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8c93808e-9874-4c77-93ad-e56a7e2f2549 req-4b001866-46ef-4873-9d62-eb7c50f633e2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:05.715728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8c93808e-9874-4c77-93ad-e56a7e2f2549 req-4b001866-46ef-4873-9d62-eb7c50f633e2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:05.723345 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-3e07e909-ac71-43be-ba03-fd20d60c7661 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] HTTP exception thrown: Instance d9e91126-5a0b-426e-b1ed-c89d61c97763 could not be found. Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e07e909-ac71-43be-ba03-fd20d60c7661 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Request method failure captured: Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 HTTP/1.1 Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFymDIkXDDUGXKn-ZEPd9dy-p02Lg_FzPnfyt1pcg4N4qWE3v53-L6YO5DcG1806KIOSHH_0c27mNdATDLtXpz5xVi3k6o-Bf7ewVFSwTWnrlZi8xClxo8NcsGZ08kPucuLaXQyNlJewn6ShCyTk8GaCZprGef9oRsZ1_XDsVcDznOxo Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff448bc0ec7c43a38a4b8adb062afca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff448bc0ec7c43a38a4b8adb062afca6"}]}] Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ff448bc0ec7c43a38a4b8adb062afca6 Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1444313845 Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 596b0a6958704e9eb27683ee535a9b60 Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1444313845-project Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance d9e91126-5a0b-426e-b1ed-c89d61c97763 could not be found. Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'd9e91126-5a0b-426e-b1ed-c89d61c97763'} Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e91126-5a0b-426e-b1ed-c89d61c97763 could not be found. Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e91126-5a0b-426e-b1ed-c89d61c97763 could not be found. Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:06:05.725128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:06:05.730949 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:06:05.730949 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:06:05.730949 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:06:05.730949 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:06:05.730949 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:06:05.730949 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:06:05.730949 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e91126-5a0b-426e-b1ed-c89d61c97763 could not be found. Sep 06 11:06:05.730949 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:06:05.730949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e07e909-ac71-43be-ba03-fd20d60c7661 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] Returning 404 to user: Instance d9e91126-5a0b-426e-b1ed-c89d61c97763 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:06:05.730949 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3e07e909-ac71-43be-ba03-fd20d60c7661 tempest-ServerMetadataNegativeTestJSON-1444313845 tempest-ServerMetadataNegativeTestJSON-1444313845-project] 10.222.0.20 "GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763" status: 404 len: 111 microversion: 2.1 time: 0.115618 Sep 06 11:06:05.739149 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1726/3450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:05 2022] GET /compute/v2.1/servers/d9e91126-5a0b-426e-b1ed-c89d61c97763 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:06:05.749761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-515da037-01c6-4385-bd49-bdb00c9259e4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:05.750800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-515da037-01c6-4385-bd49-bdb00c9259e4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:05.766343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-515da037-01c6-4385-bd49-bdb00c9259e4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:05.768662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-515da037-01c6-4385-bd49-bdb00c9259e4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:05.768662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-515da037-01c6-4385-bd49-bdb00c9259e4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:05.768894 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-8c93808e-9874-4c77-93ad-e56a7e2f2549 req-4b001866-46ef-4873-9d62-eb7c50f633e2 service nova] Creating event network-changed:808efaee-c13b-4a8c-8b64-7e38b370aa4b for instance c4d118b2-ff1f-4582-857b-f44decc2d05b on nch1-master-1 Sep 06 11:06:05.768993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-515da037-01c6-4385-bd49-bdb00c9259e4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:05.768993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-515da037-01c6-4385-bd49-bdb00c9259e4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:05.769168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-515da037-01c6-4385-bd49-bdb00c9259e4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:05.782711 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-8c93808e-9874-4c77-93ad-e56a7e2f2549 req-4b001866-46ef-4873-9d62-eb7c50f633e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112317 Sep 06 11:06:05.785506 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1725/3451] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:06:05.791563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:06.162780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-515da037-01c6-4385-bd49-bdb00c9259e4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:06.176474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-515da037-01c6-4385-bd49-bdb00c9259e4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:06.192177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-515da037-01c6-4385-bd49-bdb00c9259e4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:06.212234 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-515da037-01c6-4385-bd49-bdb00c9259e4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.470241 Sep 06 11:06:06.213324 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1727/3452] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:05 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:06.636093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b6149faf-7706-44a5-91a8-49a11beff957 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:06.637933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b6149faf-7706-44a5-91a8-49a11beff957 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:06.647280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d3d9b863-8c24-4d35-9043-1ca8169fbf9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:06.648068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d3d9b863-8c24-4d35-9043-1ca8169fbf9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:06.659140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6149faf-7706-44a5-91a8-49a11beff957 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:06.659657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6149faf-7706-44a5-91a8-49a11beff957 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:06.661961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6149faf-7706-44a5-91a8-49a11beff957 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:06.662921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3d9b863-8c24-4d35-9043-1ca8169fbf9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:06.663555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3d9b863-8c24-4d35-9043-1ca8169fbf9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:06.666190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3d9b863-8c24-4d35-9043-1ca8169fbf9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:06.667825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3d9b863-8c24-4d35-9043-1ca8169fbf9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:06.667967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6149faf-7706-44a5-91a8-49a11beff957 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:06.668131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6149faf-7706-44a5-91a8-49a11beff957 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:06.668604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6149faf-7706-44a5-91a8-49a11beff957 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:06.684248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3d9b863-8c24-4d35-9043-1ca8169fbf9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:06.739511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3d9b863-8c24-4d35-9043-1ca8169fbf9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:07.134579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b6149faf-7706-44a5-91a8-49a11beff957 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:07.151729 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b6149faf-7706-44a5-91a8-49a11beff957 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1313 microversion: 2.1 time: 0.521626 Sep 06 11:06:07.153033 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1726/3453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:06 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1313 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:07.252314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4fc88c0c-e796-4f85-9d3a-ac1c45baf45e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:07.253213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4fc88c0c-e796-4f85-9d3a-ac1c45baf45e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:07.264126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fc88c0c-e796-4f85-9d3a-ac1c45baf45e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:07.268066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fc88c0c-e796-4f85-9d3a-ac1c45baf45e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:07.268660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fc88c0c-e796-4f85-9d3a-ac1c45baf45e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:07.269511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fc88c0c-e796-4f85-9d3a-ac1c45baf45e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:07.271716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fc88c0c-e796-4f85-9d3a-ac1c45baf45e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:07.272471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fc88c0c-e796-4f85-9d3a-ac1c45baf45e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:07.450136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d3d9b863-8c24-4d35-9043-1ca8169fbf9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:07.460704 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d3d9b863-8c24-4d35-9043-1ca8169fbf9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1315 microversion: 2.1 time: 0.818071 Sep 06 11:06:07.465752 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1728/3454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:06 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1315 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:07.582203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4fc88c0c-e796-4f85-9d3a-ac1c45baf45e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:07.600869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4fc88c0c-e796-4f85-9d3a-ac1c45baf45e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:07.602520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4fc88c0c-e796-4f85-9d3a-ac1c45baf45e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:07.618667 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4fc88c0c-e796-4f85-9d3a-ac1c45baf45e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.370642 Sep 06 11:06:07.619594 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1727/3455] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:07 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:08.179332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e337de30-71f0-44db-b772-657c2a0c6219 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:08.180311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e337de30-71f0-44db-b772-657c2a0c6219 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:08.188520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e337de30-71f0-44db-b772-657c2a0c6219 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:08.189714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e337de30-71f0-44db-b772-657c2a0c6219 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:08.190237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e337de30-71f0-44db-b772-657c2a0c6219 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:08.191189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e337de30-71f0-44db-b772-657c2a0c6219 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:08.191882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e337de30-71f0-44db-b772-657c2a0c6219 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:08.192401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e337de30-71f0-44db-b772-657c2a0c6219 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:08.495756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b6d2a033-8ba7-4b81-a358-0f3dd3b21858 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:08.497560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b6d2a033-8ba7-4b81-a358-0f3dd3b21858 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:08.521411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6d2a033-8ba7-4b81-a358-0f3dd3b21858 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:08.524682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6d2a033-8ba7-4b81-a358-0f3dd3b21858 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:08.525179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6d2a033-8ba7-4b81-a358-0f3dd3b21858 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:08.525968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6d2a033-8ba7-4b81-a358-0f3dd3b21858 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:08.530458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6d2a033-8ba7-4b81-a358-0f3dd3b21858 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:08.531251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6d2a033-8ba7-4b81-a358-0f3dd3b21858 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:08.556637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:08.692102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e337de30-71f0-44db-b772-657c2a0c6219 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:08.706759 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e337de30-71f0-44db-b772-657c2a0c6219 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1313 microversion: 2.1 time: 0.531569 Sep 06 11:06:08.724779 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1729/3456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:08 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1313 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:08.861080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-794b178f-0ce9-49e8-86bf-dd7617e72ce8 req-e43fb81d-e593-4a70-adef-68b6a29edde5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3642cc-7e32-44a8-915b-a0e3deaf8374", "tag": "ddec8ef5-9c9d-4abe-967d-d24b40f80c54"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:08.875866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:08.877736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-794b178f-0ce9-49e8-86bf-dd7617e72ce8 req-e43fb81d-e593-4a70-adef-68b6a29edde5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:08.878442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-794b178f-0ce9-49e8-86bf-dd7617e72ce8 req-e43fb81d-e593-4a70-adef-68b6a29edde5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:08.879124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-794b178f-0ce9-49e8-86bf-dd7617e72ce8 req-e43fb81d-e593-4a70-adef-68b6a29edde5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:08.897983 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-794b178f-0ce9-49e8-86bf-dd7617e72ce8 req-e43fb81d-e593-4a70-adef-68b6a29edde5 service nova] Creating event network-changed:ddec8ef5-9c9d-4abe-967d-d24b40f80c54 for instance 4a3642cc-7e32-44a8-915b-a0e3deaf8374 on nch2-master-1 Sep 06 11:06:08.928949 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-794b178f-0ce9-49e8-86bf-dd7617e72ce8 req-e43fb81d-e593-4a70-adef-68b6a29edde5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202582 Sep 06 11:06:08.936397 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1730/3457] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:06:08.972681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-66db9225-8b43-43a9-8373-6394256650f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:08.988332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-66db9225-8b43-43a9-8373-6394256650f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:09.017888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66db9225-8b43-43a9-8373-6394256650f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:09.018830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66db9225-8b43-43a9-8373-6394256650f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:09.026402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66db9225-8b43-43a9-8373-6394256650f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:09.026402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66db9225-8b43-43a9-8373-6394256650f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:09.026402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66db9225-8b43-43a9-8373-6394256650f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:09.026402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66db9225-8b43-43a9-8373-6394256650f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:09.189496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b6d2a033-8ba7-4b81-a358-0f3dd3b21858 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:09.204807 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b6d2a033-8ba7-4b81-a358-0f3dd3b21858 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1315 microversion: 2.1 time: 0.718453 Sep 06 11:06:09.205425 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1728/3458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:08 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1315 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:09.281204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-66db9225-8b43-43a9-8373-6394256650f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:09.296962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-66db9225-8b43-43a9-8373-6394256650f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:09.302460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-66db9225-8b43-43a9-8373-6394256650f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:09.318860 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-66db9225-8b43-43a9-8373-6394256650f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.373576 Sep 06 11:06:09.320931 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1731/3459] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:08 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:09.735120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-13f81e4f-2c9d-4dde-990f-dc5814f40a35 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:09.736145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-13f81e4f-2c9d-4dde-990f-dc5814f40a35 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:09.763809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13f81e4f-2c9d-4dde-990f-dc5814f40a35 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:09.764437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13f81e4f-2c9d-4dde-990f-dc5814f40a35 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:09.764903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13f81e4f-2c9d-4dde-990f-dc5814f40a35 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:09.765647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13f81e4f-2c9d-4dde-990f-dc5814f40a35 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:09.768407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13f81e4f-2c9d-4dde-990f-dc5814f40a35 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:09.775198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13f81e4f-2c9d-4dde-990f-dc5814f40a35 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:10.063960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-13f81e4f-2c9d-4dde-990f-dc5814f40a35 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:10.077192 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-13f81e4f-2c9d-4dde-990f-dc5814f40a35 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1313 microversion: 2.1 time: 0.347999 Sep 06 11:06:10.077192 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1729/3460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:09 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:10.231998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-781623ab-e06b-4abf-9235-f85c56592b3b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:10.232624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-781623ab-e06b-4abf-9235-f85c56592b3b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:10.242520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:10.248010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-781623ab-e06b-4abf-9235-f85c56592b3b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:10.250827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-781623ab-e06b-4abf-9235-f85c56592b3b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:10.252444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-781623ab-e06b-4abf-9235-f85c56592b3b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:10.254041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-781623ab-e06b-4abf-9235-f85c56592b3b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:10.255696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-781623ab-e06b-4abf-9235-f85c56592b3b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:10.257392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-781623ab-e06b-4abf-9235-f85c56592b3b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:10.358120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0f842268-6b93-4037-a476-54b087c8022a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:10.359292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0f842268-6b93-4037-a476-54b087c8022a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:10.371610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f842268-6b93-4037-a476-54b087c8022a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:10.373004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f842268-6b93-4037-a476-54b087c8022a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:10.375732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f842268-6b93-4037-a476-54b087c8022a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:10.376728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f842268-6b93-4037-a476-54b087c8022a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:10.379750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f842268-6b93-4037-a476-54b087c8022a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:10.380481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f842268-6b93-4037-a476-54b087c8022a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:10.886365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0f842268-6b93-4037-a476-54b087c8022a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:10.897877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0f842268-6b93-4037-a476-54b087c8022a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:10.900373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0f842268-6b93-4037-a476-54b087c8022a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:10.907349 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0f842268-6b93-4037-a476-54b087c8022a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.553213 Sep 06 11:06:10.921238 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1730/3461] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:10 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:11.104201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-543c016c-cd75-4a9b-bf0a-517766d26076 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:11.105335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-543c016c-cd75-4a9b-bf0a-517766d26076 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:11.117637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:11.127173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-543c016c-cd75-4a9b-bf0a-517766d26076 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:11.129970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-543c016c-cd75-4a9b-bf0a-517766d26076 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:11.131541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-543c016c-cd75-4a9b-bf0a-517766d26076 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:11.140159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-781623ab-e06b-4abf-9235-f85c56592b3b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:11.155875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-543c016c-cd75-4a9b-bf0a-517766d26076 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:11.156827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-543c016c-cd75-4a9b-bf0a-517766d26076 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:11.157553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-543c016c-cd75-4a9b-bf0a-517766d26076 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:11.158656 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-781623ab-e06b-4abf-9235-f85c56592b3b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1315 microversion: 2.1 time: 0.931983 Sep 06 11:06:11.173961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=16 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:11.182554 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1732/3462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:10 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1315 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:11.789043 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-d78d8a8b-6892-4f2b-a4a1-aea82d493a07 req-4b00dda7-3901-4fe9-96d3-cbd8fb7fbe94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d118b2-ff1f-4582-857b-f44decc2d05b", "name": "network-vif-plugged", "status": "completed", "tag": "808efaee-c13b-4a8c-8b64-7e38b370aa4b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:11.820289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d78d8a8b-6892-4f2b-a4a1-aea82d493a07 req-4b00dda7-3901-4fe9-96d3-cbd8fb7fbe94 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:11.821675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d78d8a8b-6892-4f2b-a4a1-aea82d493a07 req-4b00dda7-3901-4fe9-96d3-cbd8fb7fbe94 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:11.825241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d78d8a8b-6892-4f2b-a4a1-aea82d493a07 req-4b00dda7-3901-4fe9-96d3-cbd8fb7fbe94 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:11.858740 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-d78d8a8b-6892-4f2b-a4a1-aea82d493a07 req-4b00dda7-3901-4fe9-96d3-cbd8fb7fbe94 service nova] Creating event network-vif-plugged:808efaee-c13b-4a8c-8b64-7e38b370aa4b for instance c4d118b2-ff1f-4582-857b-f44decc2d05b on nch1-master-1 Sep 06 11:06:11.876406 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-d78d8a8b-6892-4f2b-a4a1-aea82d493a07 req-4b00dda7-3901-4fe9-96d3-cbd8fb7fbe94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089895 Sep 06 11:06:11.896131 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1733/3463] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:06:11.943506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-57204dde-d98b-4975-b2d7-1b6de51e98c8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:11.945230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-57204dde-d98b-4975-b2d7-1b6de51e98c8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:11.971799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57204dde-d98b-4975-b2d7-1b6de51e98c8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:11.973197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57204dde-d98b-4975-b2d7-1b6de51e98c8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:11.975215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57204dde-d98b-4975-b2d7-1b6de51e98c8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:11.980700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57204dde-d98b-4975-b2d7-1b6de51e98c8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:11.984772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57204dde-d98b-4975-b2d7-1b6de51e98c8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:11.989851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57204dde-d98b-4975-b2d7-1b6de51e98c8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:11.993763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-543c016c-cd75-4a9b-bf0a-517766d26076 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:12.049237 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-543c016c-cd75-4a9b-bf0a-517766d26076 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1313 microversion: 2.1 time: 0.951634 Sep 06 11:06:12.057260 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1731/3464] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:11 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1313 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:12.188947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ee7a9c7c-f952-45e3-a3be-1fbe37d99225 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:12.190005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ee7a9c7c-f952-45e3-a3be-1fbe37d99225 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:12.205268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee7a9c7c-f952-45e3-a3be-1fbe37d99225 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:12.206003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee7a9c7c-f952-45e3-a3be-1fbe37d99225 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:12.206659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee7a9c7c-f952-45e3-a3be-1fbe37d99225 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:12.207880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee7a9c7c-f952-45e3-a3be-1fbe37d99225 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:12.208609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee7a9c7c-f952-45e3-a3be-1fbe37d99225 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:12.209284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee7a9c7c-f952-45e3-a3be-1fbe37d99225 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:12.427408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-57204dde-d98b-4975-b2d7-1b6de51e98c8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:12.445572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-57204dde-d98b-4975-b2d7-1b6de51e98c8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:12.452107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-57204dde-d98b-4975-b2d7-1b6de51e98c8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:12.467158 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-57204dde-d98b-4975-b2d7-1b6de51e98c8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.530982 Sep 06 11:06:12.467794 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1734/3465] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:11 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:12.660419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ee7a9c7c-f952-45e3-a3be-1fbe37d99225 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:12.670123 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ee7a9c7c-f952-45e3-a3be-1fbe37d99225 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1315 microversion: 2.1 time: 0.484972 Sep 06 11:06:12.679370 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1732/3466] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:12 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:13.080094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bde6ca93-f11d-4f90-8690-dc0df61e3e22 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:13.080740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bde6ca93-f11d-4f90-8690-dc0df61e3e22 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:13.104856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde6ca93-f11d-4f90-8690-dc0df61e3e22 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:13.105581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde6ca93-f11d-4f90-8690-dc0df61e3e22 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:13.109054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde6ca93-f11d-4f90-8690-dc0df61e3e22 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:13.111427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde6ca93-f11d-4f90-8690-dc0df61e3e22 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:13.116565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde6ca93-f11d-4f90-8690-dc0df61e3e22 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:13.116565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bde6ca93-f11d-4f90-8690-dc0df61e3e22 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:13.467599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bde6ca93-f11d-4f90-8690-dc0df61e3e22 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:13.476044 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bde6ca93-f11d-4f90-8690-dc0df61e3e22 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1313 microversion: 2.1 time: 0.401259 Sep 06 11:06:13.476855 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1735/3467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:13 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:13.497793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-50dffb37-4592-4b19-861d-a1419417d1cb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:13.498628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-50dffb37-4592-4b19-861d-a1419417d1cb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:13.509080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50dffb37-4592-4b19-861d-a1419417d1cb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:13.509586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50dffb37-4592-4b19-861d-a1419417d1cb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:13.510036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50dffb37-4592-4b19-861d-a1419417d1cb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:13.510751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50dffb37-4592-4b19-861d-a1419417d1cb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:13.518334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50dffb37-4592-4b19-861d-a1419417d1cb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:13.518886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50dffb37-4592-4b19-861d-a1419417d1cb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:13.707418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ccb4049a-a3a9-42fe-9df9-5feb39cc776d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:13.708435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ccb4049a-a3a9-42fe-9df9-5feb39cc776d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:13.717206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccb4049a-a3a9-42fe-9df9-5feb39cc776d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:13.721700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccb4049a-a3a9-42fe-9df9-5feb39cc776d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:13.722432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccb4049a-a3a9-42fe-9df9-5feb39cc776d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:13.723595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccb4049a-a3a9-42fe-9df9-5feb39cc776d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:13.728516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccb4049a-a3a9-42fe-9df9-5feb39cc776d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:13.729236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccb4049a-a3a9-42fe-9df9-5feb39cc776d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:14.099054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-50dffb37-4592-4b19-861d-a1419417d1cb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:14.112374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-50dffb37-4592-4b19-861d-a1419417d1cb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:14.117572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-50dffb37-4592-4b19-861d-a1419417d1cb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:14.134718 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-50dffb37-4592-4b19-861d-a1419417d1cb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.641980 Sep 06 11:06:14.151975 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1733/3468] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:13 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:14.283330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ccb4049a-a3a9-42fe-9df9-5feb39cc776d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:14.291399 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ccb4049a-a3a9-42fe-9df9-5feb39cc776d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1315 microversion: 2.1 time: 0.587909 Sep 06 11:06:14.292004 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1736/3469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:13 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:14.509610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2bc538b5-be52-47f0-a026-2d136071f868 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:14.510801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2bc538b5-be52-47f0-a026-2d136071f868 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:14.528552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bc538b5-be52-47f0-a026-2d136071f868 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:14.529375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bc538b5-be52-47f0-a026-2d136071f868 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:14.529820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bc538b5-be52-47f0-a026-2d136071f868 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:14.530557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bc538b5-be52-47f0-a026-2d136071f868 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:14.531100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bc538b5-be52-47f0-a026-2d136071f868 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:14.531521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bc538b5-be52-47f0-a026-2d136071f868 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:14.794695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2bc538b5-be52-47f0-a026-2d136071f868 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:14.821897 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2bc538b5-be52-47f0-a026-2d136071f868 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1498 microversion: 2.1 time: 0.315603 Sep 06 11:06:14.823881 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1734/3470] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:14 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1498 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:14.852511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b95d70f-fb15-4389-8670-d4978d9c38a4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:14.856609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2b95d70f-fb15-4389-8670-d4978d9c38a4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:14.884128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b95d70f-fb15-4389-8670-d4978d9c38a4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:14.884973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b95d70f-fb15-4389-8670-d4978d9c38a4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:14.885615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b95d70f-fb15-4389-8670-d4978d9c38a4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:14.891581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b95d70f-fb15-4389-8670-d4978d9c38a4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:14.892314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b95d70f-fb15-4389-8670-d4978d9c38a4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:14.896064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b95d70f-fb15-4389-8670-d4978d9c38a4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:14.997329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-2b95d70f-fb15-4389-8670-d4978d9c38a4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'flavor' on Instance uuid c4d118b2-ff1f-4582-857b-f44decc2d05b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:06:15.173346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2cb577f7-08fc-43a8-8331-7239c06a5260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:15.174434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2cb577f7-08fc-43a8-8331-7239c06a5260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:15.200307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cb577f7-08fc-43a8-8331-7239c06a5260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:15.201135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cb577f7-08fc-43a8-8331-7239c06a5260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:15.201856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cb577f7-08fc-43a8-8331-7239c06a5260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:15.204740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cb577f7-08fc-43a8-8331-7239c06a5260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:15.205477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cb577f7-08fc-43a8-8331-7239c06a5260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:15.206099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cb577f7-08fc-43a8-8331-7239c06a5260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:15.491865 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b95d70f-fb15-4389-8670-d4978d9c38a4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "POST /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b/action" status: 200 len: 32 microversion: 2.1 time: 0.642404 Sep 06 11:06:15.492428 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1737/3471] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:06:14 2022] POST /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b/action => generated 32 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:06:15.509096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84a52213-8947-4af1-8b2d-51ed5be27807 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:15.512982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-84a52213-8947-4af1-8b2d-51ed5be27807 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:15.530814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84a52213-8947-4af1-8b2d-51ed5be27807 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:15.531757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84a52213-8947-4af1-8b2d-51ed5be27807 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:15.532498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84a52213-8947-4af1-8b2d-51ed5be27807 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:15.533477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84a52213-8947-4af1-8b2d-51ed5be27807 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:15.534163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84a52213-8947-4af1-8b2d-51ed5be27807 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:15.534811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84a52213-8947-4af1-8b2d-51ed5be27807 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:15.566636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2cb577f7-08fc-43a8-8331-7239c06a5260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:15.586178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2cb577f7-08fc-43a8-8331-7239c06a5260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:15.603336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2cb577f7-08fc-43a8-8331-7239c06a5260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:15.629206 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2cb577f7-08fc-43a8-8331-7239c06a5260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.461668 Sep 06 11:06:15.632649 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1735/3472] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:15 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:15.674469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-96b7eeda-2a1f-419e-9ca2-8a5a059e9a76 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:15.697635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-96b7eeda-2a1f-419e-9ca2-8a5a059e9a76 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:15.709920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96b7eeda-2a1f-419e-9ca2-8a5a059e9a76 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:15.710737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96b7eeda-2a1f-419e-9ca2-8a5a059e9a76 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:15.711432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96b7eeda-2a1f-419e-9ca2-8a5a059e9a76 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:15.712587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96b7eeda-2a1f-419e-9ca2-8a5a059e9a76 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:15.713279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96b7eeda-2a1f-419e-9ca2-8a5a059e9a76 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:15.713884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96b7eeda-2a1f-419e-9ca2-8a5a059e9a76 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:16.245403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-84a52213-8947-4af1-8b2d-51ed5be27807 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:16.249231 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84a52213-8947-4af1-8b2d-51ed5be27807 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1315 microversion: 2.1 time: 0.755242 Sep 06 11:06:16.250537 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1738/3473] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:15 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:16.296290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-96b7eeda-2a1f-419e-9ca2-8a5a059e9a76 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:16.305961 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-96b7eeda-2a1f-419e-9ca2-8a5a059e9a76 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.671933 Sep 06 11:06:16.307052 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1736/3474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:15 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:16.666250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ef7c7813-9088-48c9-923a-f88d32db2d11 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:16.667195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ef7c7813-9088-48c9-923a-f88d32db2d11 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:16.676111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef7c7813-9088-48c9-923a-f88d32db2d11 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:16.678380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef7c7813-9088-48c9-923a-f88d32db2d11 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:16.680204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef7c7813-9088-48c9-923a-f88d32db2d11 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:16.680955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef7c7813-9088-48c9-923a-f88d32db2d11 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:16.681460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef7c7813-9088-48c9-923a-f88d32db2d11 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:16.681867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef7c7813-9088-48c9-923a-f88d32db2d11 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:16.809816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ef7c7813-9088-48c9-923a-f88d32db2d11 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:16.825787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ef7c7813-9088-48c9-923a-f88d32db2d11 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:16.837606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ef7c7813-9088-48c9-923a-f88d32db2d11 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:16.846454 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ef7c7813-9088-48c9-923a-f88d32db2d11 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.184102 Sep 06 11:06:16.855564 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1739/3475] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:16 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:17.274154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-faba597a-6cc5-4456-b812-df134e63f7dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:17.279670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-faba597a-6cc5-4456-b812-df134e63f7dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:17.307178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-faba597a-6cc5-4456-b812-df134e63f7dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:17.311784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-faba597a-6cc5-4456-b812-df134e63f7dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:17.316809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-faba597a-6cc5-4456-b812-df134e63f7dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:17.316809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-faba597a-6cc5-4456-b812-df134e63f7dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:17.316809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-faba597a-6cc5-4456-b812-df134e63f7dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:17.332509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1ded3177-5ec0-4a5a-a29c-5442a3cee143 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:17.333142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1ded3177-5ec0-4a5a-a29c-5442a3cee143 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:17.338841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-faba597a-6cc5-4456-b812-df134e63f7dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:17.355512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1ded3177-5ec0-4a5a-a29c-5442a3cee143 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:17.356564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1ded3177-5ec0-4a5a-a29c-5442a3cee143 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:17.358100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1ded3177-5ec0-4a5a-a29c-5442a3cee143 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:17.358856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1ded3177-5ec0-4a5a-a29c-5442a3cee143 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:17.361481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1ded3177-5ec0-4a5a-a29c-5442a3cee143 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:17.365305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1ded3177-5ec0-4a5a-a29c-5442a3cee143 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:17.875694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-faba597a-6cc5-4456-b812-df134e63f7dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:17.889444 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-faba597a-6cc5-4456-b812-df134e63f7dc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1315 microversion: 2.1 time: 0.619444 Sep 06 11:06:17.895531 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1737/3476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:17 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:17.902078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7727060b-e5f3-42f7-a135-047e6aad28ce tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:17.904060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7727060b-e5f3-42f7-a135-047e6aad28ce tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:17.935673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1ded3177-5ec0-4a5a-a29c-5442a3cee143 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:17.948322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7727060b-e5f3-42f7-a135-047e6aad28ce tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:17.951197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7727060b-e5f3-42f7-a135-047e6aad28ce tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:17.951884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7727060b-e5f3-42f7-a135-047e6aad28ce tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:17.958466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7727060b-e5f3-42f7-a135-047e6aad28ce tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:17.958466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7727060b-e5f3-42f7-a135-047e6aad28ce tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:17.960719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7727060b-e5f3-42f7-a135-047e6aad28ce tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:17.963473 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1ded3177-5ec0-4a5a-a29c-5442a3cee143 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.633332 Sep 06 11:06:17.964184 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1740/3477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:17 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:18.177894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7727060b-e5f3-42f7-a135-047e6aad28ce tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:18.192817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7727060b-e5f3-42f7-a135-047e6aad28ce tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:18.197844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7727060b-e5f3-42f7-a135-047e6aad28ce tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:18.211268 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7727060b-e5f3-42f7-a135-047e6aad28ce tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.317442 Sep 06 11:06:18.211864 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1738/3478] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:17 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:18.690631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a6448b75-53e4-44e2-afea-ee7c0cc033ab req-c8b2ed0c-2a6d-4ff1-bcf1-1b71174cb39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3642cc-7e32-44a8-915b-a0e3deaf8374", "name": "network-vif-plugged", "status": "completed", "tag": "ddec8ef5-9c9d-4abe-967d-d24b40f80c54"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:18.722943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a6448b75-53e4-44e2-afea-ee7c0cc033ab req-c8b2ed0c-2a6d-4ff1-bcf1-1b71174cb39a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:18.729074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a6448b75-53e4-44e2-afea-ee7c0cc033ab req-c8b2ed0c-2a6d-4ff1-bcf1-1b71174cb39a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:18.731741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a6448b75-53e4-44e2-afea-ee7c0cc033ab req-c8b2ed0c-2a6d-4ff1-bcf1-1b71174cb39a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:18.764486 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a6448b75-53e4-44e2-afea-ee7c0cc033ab req-c8b2ed0c-2a6d-4ff1-bcf1-1b71174cb39a service nova] Creating event network-vif-plugged:ddec8ef5-9c9d-4abe-967d-d24b40f80c54 for instance 4a3642cc-7e32-44a8-915b-a0e3deaf8374 on nch2-master-1 Sep 06 11:06:18.775066 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a6448b75-53e4-44e2-afea-ee7c0cc033ab req-c8b2ed0c-2a6d-4ff1-bcf1-1b71174cb39a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087296 Sep 06 11:06:18.785336 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1741/3479] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:06:18.920178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-037dadaf-7f6d-4b99-a4d1-a46e4eb09766 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:18.922407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-037dadaf-7f6d-4b99-a4d1-a46e4eb09766 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:18.934198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-037dadaf-7f6d-4b99-a4d1-a46e4eb09766 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:18.939922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-037dadaf-7f6d-4b99-a4d1-a46e4eb09766 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:18.941001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-037dadaf-7f6d-4b99-a4d1-a46e4eb09766 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:18.946055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-037dadaf-7f6d-4b99-a4d1-a46e4eb09766 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:18.946662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-037dadaf-7f6d-4b99-a4d1-a46e4eb09766 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:18.947550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-037dadaf-7f6d-4b99-a4d1-a46e4eb09766 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:18.997933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01661352-dcde-491d-9248-c5c393b67e8d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:18.997933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-01661352-dcde-491d-9248-c5c393b67e8d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:19.013808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01661352-dcde-491d-9248-c5c393b67e8d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:19.019504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01661352-dcde-491d-9248-c5c393b67e8d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:19.022597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01661352-dcde-491d-9248-c5c393b67e8d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:19.028414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01661352-dcde-491d-9248-c5c393b67e8d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:19.030878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01661352-dcde-491d-9248-c5c393b67e8d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:19.031518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01661352-dcde-491d-9248-c5c393b67e8d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:19.259897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-01661352-dcde-491d-9248-c5c393b67e8d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:19.271994 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-01661352-dcde-491d-9248-c5c393b67e8d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.287471 Sep 06 11:06:19.272602 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1742/3480] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:18 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:19.279050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-037dadaf-7f6d-4b99-a4d1-a46e4eb09766 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:19.292615 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-037dadaf-7f6d-4b99-a4d1-a46e4eb09766 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1315 microversion: 2.1 time: 0.374914 Sep 06 11:06:19.292615 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1739/3481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:18 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:19.299492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2fa3d349-b8c1-4453-a357-ef0bf9cb6b36 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:19.300115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2fa3d349-b8c1-4453-a357-ef0bf9cb6b36 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:19.312283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:19.314404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2fa3d349-b8c1-4453-a357-ef0bf9cb6b36 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:19.314901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2fa3d349-b8c1-4453-a357-ef0bf9cb6b36 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:19.315374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2fa3d349-b8c1-4453-a357-ef0bf9cb6b36 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:19.316085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2fa3d349-b8c1-4453-a357-ef0bf9cb6b36 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:19.316550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2fa3d349-b8c1-4453-a357-ef0bf9cb6b36 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:19.316984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2fa3d349-b8c1-4453-a357-ef0bf9cb6b36 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:19.411409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2fa3d349-b8c1-4453-a357-ef0bf9cb6b36 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:19.414544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:19.425093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2fa3d349-b8c1-4453-a357-ef0bf9cb6b36 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:19.427400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2fa3d349-b8c1-4453-a357-ef0bf9cb6b36 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:19.433652 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2fa3d349-b8c1-4453-a357-ef0bf9cb6b36 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.149912 Sep 06 11:06:19.434766 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1743/3482] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:19 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:20.296842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f8bb1d16-9671-4abd-8e7a-cb0d67262d33 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:20.297464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f8bb1d16-9671-4abd-8e7a-cb0d67262d33 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:20.304186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8bb1d16-9671-4abd-8e7a-cb0d67262d33 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:20.304753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8bb1d16-9671-4abd-8e7a-cb0d67262d33 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:20.305270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8bb1d16-9671-4abd-8e7a-cb0d67262d33 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:20.306038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8bb1d16-9671-4abd-8e7a-cb0d67262d33 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:20.306587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8bb1d16-9671-4abd-8e7a-cb0d67262d33 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:20.307109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8bb1d16-9671-4abd-8e7a-cb0d67262d33 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:20.315446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-04ed9ee3-1ea4-481f-8572-5497c278425a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:20.316869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-04ed9ee3-1ea4-481f-8572-5497c278425a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:20.339168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04ed9ee3-1ea4-481f-8572-5497c278425a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:20.339686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04ed9ee3-1ea4-481f-8572-5497c278425a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:20.340583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04ed9ee3-1ea4-481f-8572-5497c278425a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:20.341954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04ed9ee3-1ea4-481f-8572-5497c278425a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:20.342542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04ed9ee3-1ea4-481f-8572-5497c278425a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:20.347430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04ed9ee3-1ea4-481f-8572-5497c278425a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:20.513223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f8bb1d16-9671-4abd-8e7a-cb0d67262d33 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:20.529544 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f8bb1d16-9671-4abd-8e7a-cb0d67262d33 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.238093 Sep 06 11:06:20.531412 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1740/3483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:20 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:20.538939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6e1d8e55-1cc7-45e4-999f-20063ddad0f3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:20.539868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6e1d8e55-1cc7-45e4-999f-20063ddad0f3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:20.548276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e1d8e55-1cc7-45e4-999f-20063ddad0f3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:20.549180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e1d8e55-1cc7-45e4-999f-20063ddad0f3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:20.550060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e1d8e55-1cc7-45e4-999f-20063ddad0f3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:20.551132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e1d8e55-1cc7-45e4-999f-20063ddad0f3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:20.551838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e1d8e55-1cc7-45e4-999f-20063ddad0f3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:20.553261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e1d8e55-1cc7-45e4-999f-20063ddad0f3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:20.599782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-04ed9ee3-1ea4-481f-8572-5497c278425a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:20.609952 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-04ed9ee3-1ea4-481f-8572-5497c278425a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1315 microversion: 2.1 time: 0.299640 Sep 06 11:06:20.626706 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1744/3484] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:20 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:20.721858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6e1d8e55-1cc7-45e4-999f-20063ddad0f3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:20.738632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6e1d8e55-1cc7-45e4-999f-20063ddad0f3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:20.740356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6e1d8e55-1cc7-45e4-999f-20063ddad0f3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:20.747970 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6e1d8e55-1cc7-45e4-999f-20063ddad0f3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.214387 Sep 06 11:06:20.749340 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1741/3485] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:20 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:21.120304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-166965832", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": "none"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:21.206568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:06:21.207069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:06:21.208295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:06:21.208608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:06:21.209040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:06:21.236505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:21.237597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:21.243152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:21.243152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:21.243152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:21.243152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:21.260957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Getting quotas for project dc50b9ebed5448079b548f6087330aa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:06:21.267755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Getting quotas for user 6ec3877b92b943dc85a7f656b4db93ca and project dc50b9ebed5448079b548f6087330aa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:06:21.285788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:06:21.288221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 549cea0b-4d4c-48f2-b7d4-12caa020ef87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:06:21.556276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f483edf6-b2e4-4dce-9895-8bc27c2e9af9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:21.557051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f483edf6-b2e4-4dce-9895-8bc27c2e9af9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:21.567100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f483edf6-b2e4-4dce-9895-8bc27c2e9af9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:21.567633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f483edf6-b2e4-4dce-9895-8bc27c2e9af9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:21.568127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f483edf6-b2e4-4dce-9895-8bc27c2e9af9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:21.570602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f483edf6-b2e4-4dce-9895-8bc27c2e9af9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:21.571201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f483edf6-b2e4-4dce-9895-8bc27c2e9af9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:21.571708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f483edf6-b2e4-4dce-9895-8bc27c2e9af9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:21.729704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f483edf6-b2e4-4dce-9895-8bc27c2e9af9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:21.737745 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f483edf6-b2e4-4dce-9895-8bc27c2e9af9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.187184 Sep 06 11:06:21.738327 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1742/3486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:21 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:21.742837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1ab1bc90-2330-4751-aa29-1b79131992d1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:21.743473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1ab1bc90-2330-4751-aa29-1b79131992d1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:21.749659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ab1bc90-2330-4751-aa29-1b79131992d1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:21.750204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ab1bc90-2330-4751-aa29-1b79131992d1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:21.750771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ab1bc90-2330-4751-aa29-1b79131992d1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:21.751514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ab1bc90-2330-4751-aa29-1b79131992d1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:21.751985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ab1bc90-2330-4751-aa29-1b79131992d1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:21.752426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ab1bc90-2330-4751-aa29-1b79131992d1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:21.764705 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-35f38aba-beb5-4504-9611-c628fc178f02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.837031 Sep 06 11:06:21.766366 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1745/3487] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 11:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 11:06:21.791900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9992d73-a6c8-4dba-8057-b8141865d0b7 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:21.791900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e9992d73-a6c8-4dba-8057-b8141865d0b7 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 549cea0b-4d4c-48f2-b7d4-12caa020ef87] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:21.884232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e9992d73-a6c8-4dba-8057-b8141865d0b7 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:21.895978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e9992d73-a6c8-4dba-8057-b8141865d0b7 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:21.900664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e9992d73-a6c8-4dba-8057-b8141865d0b7 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:21.902063 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e9992d73-a6c8-4dba-8057-b8141865d0b7 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87" status: 200 len: 1277 microversion: 2.47 time: 0.123977 Sep 06 11:06:21.915780 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1746/3488] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:21 2022] GET /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87 => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:21.925853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6111f2d0-76ef-48c7-a781-3349a8215730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:21.930695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6111f2d0-76ef-48c7-a781-3349a8215730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:21.962285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6111f2d0-76ef-48c7-a781-3349a8215730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:21.964814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6111f2d0-76ef-48c7-a781-3349a8215730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:21.965107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6111f2d0-76ef-48c7-a781-3349a8215730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:21.965839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6111f2d0-76ef-48c7-a781-3349a8215730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:21.966305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6111f2d0-76ef-48c7-a781-3349a8215730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:21.966740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6111f2d0-76ef-48c7-a781-3349a8215730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:22.041868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1ab1bc90-2330-4751-aa29-1b79131992d1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:22.057871 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1ab1bc90-2330-4751-aa29-1b79131992d1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1502 microversion: 2.1 time: 0.318438 Sep 06 11:06:22.063977 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1743/3489] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:21 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1502 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:22.086351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f741f093-03d6-4f15-a739-33aa454b3f82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:22.087117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f741f093-03d6-4f15-a739-33aa454b3f82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:22.108232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f741f093-03d6-4f15-a739-33aa454b3f82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:22.108595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f741f093-03d6-4f15-a739-33aa454b3f82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:22.109055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f741f093-03d6-4f15-a739-33aa454b3f82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:22.109786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f741f093-03d6-4f15-a739-33aa454b3f82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:22.110261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f741f093-03d6-4f15-a739-33aa454b3f82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:22.112070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f741f093-03d6-4f15-a739-33aa454b3f82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:22.125820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6111f2d0-76ef-48c7-a781-3349a8215730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:22.138140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6111f2d0-76ef-48c7-a781-3349a8215730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:22.140197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6111f2d0-76ef-48c7-a781-3349a8215730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:22.146132 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6111f2d0-76ef-48c7-a781-3349a8215730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.226269 Sep 06 11:06:22.147636 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1747/3490] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:21 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:22.247901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-154908411", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": "none"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:22.330496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:06:22.335085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:06:22.335085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:06:22.335085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:06:22.335085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:06:22.347182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:22.347742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:22.348602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:22.349418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:22.350069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:22.350511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:22.372025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Getting quotas for project dc50b9ebed5448079b548f6087330aa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:06:22.381075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Getting quotas for user 6ec3877b92b943dc85a7f656b4db93ca and project dc50b9ebed5448079b548f6087330aa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:06:22.400104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:06:22.403674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:06:22.421255 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.network.security_group_api [None req-f741f093-03d6-4f15-a739-33aa454b3f82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Removing security group 422fc7a4-b04a-4b94-8bb3-edb1cccba35e from port ddec8ef5-9c9d-4abe-967d-d24b40f80c54 Sep 06 11:06:22.559410 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-de0263b2-e70d-4282-b78c-50acdcd17f68 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.317803 Sep 06 11:06:22.561724 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1748/3491] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 11:06:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 11:06:22.584017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4ed352cb-98bb-4f00-8025-3e349fa59b9f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:22.593757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4ed352cb-98bb-4f00-8025-3e349fa59b9f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:22.664904 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4ed352cb-98bb-4f00-8025-3e349fa59b9f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "PUT /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 991 microversion: 2.47 time: 0.084798 Sep 06 11:06:22.684003 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1749/3492] 10.222.0.20 () {62 vars in 1297 bytes} [Tue Sep 6 11:06:22 2022] PUT /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:06:22.691538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c7123efb-d45a-4223-9d33-000c3761aef2 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:22.692251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c7123efb-d45a-4223-9d33-000c3761aef2 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:22.814575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c7123efb-d45a-4223-9d33-000c3761aef2 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:22.830983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c7123efb-d45a-4223-9d33-000c3761aef2 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:22.846254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c7123efb-d45a-4223-9d33-000c3761aef2 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:22.846254 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c7123efb-d45a-4223-9d33-000c3761aef2 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1277 microversion: 2.47 time: 0.156873 Sep 06 11:06:22.846254 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1750/3493] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:22 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:22.869313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c65d57bd-d26b-49bc-b2b6-2d48f6cd3030 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:22.871970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c65d57bd-d26b-49bc-b2b6-2d48f6cd3030 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:22.880264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c65d57bd-d26b-49bc-b2b6-2d48f6cd3030 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:22.880777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c65d57bd-d26b-49bc-b2b6-2d48f6cd3030 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:22.881225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c65d57bd-d26b-49bc-b2b6-2d48f6cd3030 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:22.882370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c65d57bd-d26b-49bc-b2b6-2d48f6cd3030 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:22.883127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c65d57bd-d26b-49bc-b2b6-2d48f6cd3030 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:22.883565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c65d57bd-d26b-49bc-b2b6-2d48f6cd3030 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:23.368655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c65d57bd-d26b-49bc-b2b6-2d48f6cd3030 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:23.377468 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c65d57bd-d26b-49bc-b2b6-2d48f6cd3030 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.529756 Sep 06 11:06:23.378061 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1751/3494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:22 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:23.386634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8675c586-1df5-47db-840c-08b04ab841a4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:23.387383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8675c586-1df5-47db-840c-08b04ab841a4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:23.393818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8675c586-1df5-47db-840c-08b04ab841a4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:23.394309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8675c586-1df5-47db-840c-08b04ab841a4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:23.394758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8675c586-1df5-47db-840c-08b04ab841a4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:23.395565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8675c586-1df5-47db-840c-08b04ab841a4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:23.396030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8675c586-1df5-47db-840c-08b04ab841a4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:23.396468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8675c586-1df5-47db-840c-08b04ab841a4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:23.419304 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f741f093-03d6-4f15-a739-33aa454b3f82 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374/action" status: 202 len: 0 microversion: 2.1 time: 1.337671 Sep 06 11:06:23.420844 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1744/3495] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:06:22 2022] POST /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374/action => generated 0 bytes in 1340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:06:23.429308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-149fe714-2447-4cb6-ab40-dd96680227bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:23.430912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-149fe714-2447-4cb6-ab40-dd96680227bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:23.437181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-149fe714-2447-4cb6-ab40-dd96680227bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:23.437684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-149fe714-2447-4cb6-ab40-dd96680227bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:23.438366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-149fe714-2447-4cb6-ab40-dd96680227bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:23.439634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-149fe714-2447-4cb6-ab40-dd96680227bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:23.440401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-149fe714-2447-4cb6-ab40-dd96680227bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:23.441009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-149fe714-2447-4cb6-ab40-dd96680227bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:23.446327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:23.558715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8675c586-1df5-47db-840c-08b04ab841a4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:23.573668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8675c586-1df5-47db-840c-08b04ab841a4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:23.575581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8675c586-1df5-47db-840c-08b04ab841a4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:23.582222 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8675c586-1df5-47db-840c-08b04ab841a4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.202796 Sep 06 11:06:23.582982 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1752/3496] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:23 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:23.588482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-408e3a7e-b136-4bbe-9e1f-8e448c9892d8 req-2b18d382-85ca-457e-bfa7-74f4a60c516c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3642cc-7e32-44a8-915b-a0e3deaf8374", "tag": "ddec8ef5-9c9d-4abe-967d-d24b40f80c54"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:23.610102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-149fe714-2447-4cb6-ab40-dd96680227bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:23.618923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-408e3a7e-b136-4bbe-9e1f-8e448c9892d8 req-2b18d382-85ca-457e-bfa7-74f4a60c516c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:23.620234 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-149fe714-2447-4cb6-ab40-dd96680227bb tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1460 microversion: 2.1 time: 0.193931 Sep 06 11:06:23.621744 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1745/3497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:23 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1460 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:23.621957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-408e3a7e-b136-4bbe-9e1f-8e448c9892d8 req-2b18d382-85ca-457e-bfa7-74f4a60c516c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:23.622893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-408e3a7e-b136-4bbe-9e1f-8e448c9892d8 req-2b18d382-85ca-457e-bfa7-74f4a60c516c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:23.643575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-761fc831-1031-4288-91d9-cc560957b4cd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:23.644444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-761fc831-1031-4288-91d9-cc560957b4cd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:23.650198 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-408e3a7e-b136-4bbe-9e1f-8e448c9892d8 req-2b18d382-85ca-457e-bfa7-74f4a60c516c service nova] Creating event network-changed:ddec8ef5-9c9d-4abe-967d-d24b40f80c54 for instance 4a3642cc-7e32-44a8-915b-a0e3deaf8374 on nch2-master-1 Sep 06 11:06:23.652912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-761fc831-1031-4288-91d9-cc560957b4cd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:23.652912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-761fc831-1031-4288-91d9-cc560957b4cd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:23.653406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-761fc831-1031-4288-91d9-cc560957b4cd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:23.654316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-761fc831-1031-4288-91d9-cc560957b4cd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:23.654969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-761fc831-1031-4288-91d9-cc560957b4cd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:23.655625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-761fc831-1031-4288-91d9-cc560957b4cd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:23.680438 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-408e3a7e-b136-4bbe-9e1f-8e448c9892d8 req-2b18d382-85ca-457e-bfa7-74f4a60c516c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095904 Sep 06 11:06:23.681424 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1753/3498] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:06:23.871099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1f356a6d-ac6f-4e8d-9425-09b5cb3c61f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:23.872758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1f356a6d-ac6f-4e8d-9425-09b5cb3c61f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:23.883316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f356a6d-ac6f-4e8d-9425-09b5cb3c61f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:23.884298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f356a6d-ac6f-4e8d-9425-09b5cb3c61f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:23.887821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f356a6d-ac6f-4e8d-9425-09b5cb3c61f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:23.888495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f356a6d-ac6f-4e8d-9425-09b5cb3c61f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:23.888977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f356a6d-ac6f-4e8d-9425-09b5cb3c61f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:23.889434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f356a6d-ac6f-4e8d-9425-09b5cb3c61f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:23.895357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-761fc831-1031-4288-91d9-cc560957b4cd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:23.901203 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-761fc831-1031-4288-91d9-cc560957b4cd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.261552 Sep 06 11:06:23.901789 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1746/3499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:23 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:23.935052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c3a9563-83cf-4a68-b797-36a698ba5906 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:23.937752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8c3a9563-83cf-4a68-b797-36a698ba5906 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:23.942803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c3a9563-83cf-4a68-b797-36a698ba5906 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:23.943484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c3a9563-83cf-4a68-b797-36a698ba5906 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:23.944037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c3a9563-83cf-4a68-b797-36a698ba5906 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:23.944990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c3a9563-83cf-4a68-b797-36a698ba5906 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:23.945563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c3a9563-83cf-4a68-b797-36a698ba5906 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:23.946102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c3a9563-83cf-4a68-b797-36a698ba5906 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:24.002342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1f356a6d-ac6f-4e8d-9425-09b5cb3c61f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:24.010193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1f356a6d-ac6f-4e8d-9425-09b5cb3c61f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:24.012679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1f356a6d-ac6f-4e8d-9425-09b5cb3c61f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:24.014023 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1f356a6d-ac6f-4e8d-9425-09b5cb3c61f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1281 microversion: 2.47 time: 0.147942 Sep 06 11:06:24.015189 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1754/3500] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:23 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1281 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:24.113909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8c3a9563-83cf-4a68-b797-36a698ba5906 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:24.122904 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8c3a9563-83cf-4a68-b797-36a698ba5906 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.191971 Sep 06 11:06:24.123544 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1747/3501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:23 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:24.157995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0d0523a8-298c-4daa-9ab2-0514679fbb87 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:24.157995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0d0523a8-298c-4daa-9ab2-0514679fbb87 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:24.157995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d0523a8-298c-4daa-9ab2-0514679fbb87 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:24.157995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d0523a8-298c-4daa-9ab2-0514679fbb87 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:24.157995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d0523a8-298c-4daa-9ab2-0514679fbb87 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:24.157995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d0523a8-298c-4daa-9ab2-0514679fbb87 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:24.157995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d0523a8-298c-4daa-9ab2-0514679fbb87 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:24.157995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d0523a8-298c-4daa-9ab2-0514679fbb87 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:24.359368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0d0523a8-298c-4daa-9ab2-0514679fbb87 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:24.367738 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0d0523a8-298c-4daa-9ab2-0514679fbb87 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.225706 Sep 06 11:06:24.368326 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1755/3502] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:24 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:24.392339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-915a063f-31d7-4857-8297-96ea47ae094e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:24.392946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-915a063f-31d7-4857-8297-96ea47ae094e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:24.402407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-915a063f-31d7-4857-8297-96ea47ae094e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:24.405057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cbb318b4-be28-47b7-a59b-315040727710 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:24.405799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-915a063f-31d7-4857-8297-96ea47ae094e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:24.406415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-915a063f-31d7-4857-8297-96ea47ae094e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:24.407344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-915a063f-31d7-4857-8297-96ea47ae094e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:24.408516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cbb318b4-be28-47b7-a59b-315040727710 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:24.410499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-915a063f-31d7-4857-8297-96ea47ae094e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:24.411208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-915a063f-31d7-4857-8297-96ea47ae094e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:24.426084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbb318b4-be28-47b7-a59b-315040727710 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:24.426926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbb318b4-be28-47b7-a59b-315040727710 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:24.427538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbb318b4-be28-47b7-a59b-315040727710 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:24.432841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbb318b4-be28-47b7-a59b-315040727710 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:24.434142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbb318b4-be28-47b7-a59b-315040727710 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:24.434794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbb318b4-be28-47b7-a59b-315040727710 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:24.687484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-915a063f-31d7-4857-8297-96ea47ae094e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:24.691582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cbb318b4-be28-47b7-a59b-315040727710 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:24.699374 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-915a063f-31d7-4857-8297-96ea47ae094e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.311161 Sep 06 11:06:24.703100 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cbb318b4-be28-47b7-a59b-315040727710 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.302725 Sep 06 11:06:24.703273 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1748/3503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:24 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:24.703384 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1756/3504] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:24 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:24.705873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7c73fae1-b679-47b1-b4f3-4971675fa14a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:24.706475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7c73fae1-b679-47b1-b4f3-4971675fa14a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:24.712445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c73fae1-b679-47b1-b4f3-4971675fa14a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:24.712931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c73fae1-b679-47b1-b4f3-4971675fa14a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:24.713398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c73fae1-b679-47b1-b4f3-4971675fa14a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:24.714089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c73fae1-b679-47b1-b4f3-4971675fa14a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:24.714564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c73fae1-b679-47b1-b4f3-4971675fa14a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:24.715066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c73fae1-b679-47b1-b4f3-4971675fa14a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:24.823875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7c73fae1-b679-47b1-b4f3-4971675fa14a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:24.833892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7c73fae1-b679-47b1-b4f3-4971675fa14a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:24.835308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1903643924", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "350b7fa2-cbf1-4a97-afcf-fd60d6924de1"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:24.835454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7c73fae1-b679-47b1-b4f3-4971675fa14a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:24.847202 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7c73fae1-b679-47b1-b4f3-4971675fa14a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1535 microversion: 2.91 time: 0.144756 Sep 06 11:06:24.848009 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1749/3505] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:24 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1535 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:24.895299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] validate_networks() for [('350b7fa2-cbf1-4a97-afcf-fd60d6924de1', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:06:25.053275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2e63b2e4-be07-402b-b5ba-e1095209fcbf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:25.054351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2e63b2e4-be07-402b-b5ba-e1095209fcbf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:25.063145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e63b2e4-be07-402b-b5ba-e1095209fcbf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:25.064109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e63b2e4-be07-402b-b5ba-e1095209fcbf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:25.065238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e63b2e4-be07-402b-b5ba-e1095209fcbf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:25.066455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e63b2e4-be07-402b-b5ba-e1095209fcbf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:25.067197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e63b2e4-be07-402b-b5ba-e1095209fcbf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:25.067873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e63b2e4-be07-402b-b5ba-e1095209fcbf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:25.154957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2e63b2e4-be07-402b-b5ba-e1095209fcbf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:25.165060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2e63b2e4-be07-402b-b5ba-e1095209fcbf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:25.174343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2e63b2e4-be07-402b-b5ba-e1095209fcbf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:25.174343 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2e63b2e4-be07-402b-b5ba-e1095209fcbf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1329 microversion: 2.47 time: 0.131483 Sep 06 11:06:25.174343 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1750/3506] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:25 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1329 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:25.350585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:06:25.351197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:06:25.352060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:06:25.352575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:06:25.353090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:06:25.363556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:25.364177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:25.364704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:25.365506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:25.366036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:25.366534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:25.385651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Getting quotas for project dcd5ffec2c6246fb89ba181542692585. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:06:25.393683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Getting quotas for user f16abbf8a68344b68444ff8fc2795c67 and project dcd5ffec2c6246fb89ba181542692585. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:06:25.409066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:06:25.413134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:06:25.612478 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-458af5b5-aea7-4296-9cd9-27450b12d10c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781530 Sep 06 11:06:25.613178 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1757/3507] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:06:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:06:25.624829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-96ec81ce-3aec-422b-a29a-ac13b697193e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:25.625585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-96ec81ce-3aec-422b-a29a-ac13b697193e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:25.681916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-96ec81ce-3aec-422b-a29a-ac13b697193e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:25.705024 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-96ec81ce-3aec-422b-a29a-ac13b697193e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1215 microversion: 2.1 time: 0.070364 Sep 06 11:06:25.705024 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1751/3508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:25 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:25.725035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c690e0f6-aa5a-4ede-bbf7-539f7c1be898 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:25.725744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c690e0f6-aa5a-4ede-bbf7-539f7c1be898 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:25.744858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c690e0f6-aa5a-4ede-bbf7-539f7c1be898 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:25.745697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c690e0f6-aa5a-4ede-bbf7-539f7c1be898 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:25.746901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c690e0f6-aa5a-4ede-bbf7-539f7c1be898 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:25.751938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c690e0f6-aa5a-4ede-bbf7-539f7c1be898 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:25.752531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c690e0f6-aa5a-4ede-bbf7-539f7c1be898 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:25.753070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c690e0f6-aa5a-4ede-bbf7-539f7c1be898 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:25.886386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f45825f0-b559-454d-8aba-13b773f599dc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:25.888924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f45825f0-b559-454d-8aba-13b773f599dc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:25.910661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f45825f0-b559-454d-8aba-13b773f599dc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:25.919555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f45825f0-b559-454d-8aba-13b773f599dc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:25.929094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f45825f0-b559-454d-8aba-13b773f599dc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:25.931425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f45825f0-b559-454d-8aba-13b773f599dc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:25.931425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f45825f0-b559-454d-8aba-13b773f599dc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:25.931425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f45825f0-b559-454d-8aba-13b773f599dc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:26.056708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f45825f0-b559-454d-8aba-13b773f599dc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:26.077800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c690e0f6-aa5a-4ede-bbf7-539f7c1be898 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:26.089460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f45825f0-b559-454d-8aba-13b773f599dc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:26.091932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f45825f0-b559-454d-8aba-13b773f599dc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:26.102036 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c690e0f6-aa5a-4ede-bbf7-539f7c1be898 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.381510 Sep 06 11:06:26.106433 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1758/3509] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:25 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:26.125220 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f45825f0-b559-454d-8aba-13b773f599dc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1535 microversion: 2.91 time: 0.244547 Sep 06 11:06:26.125220 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1752/3510] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:25 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1535 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:26.203543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff1892e7-9933-46be-a2d8-03d96c76af57 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:26.204712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff1892e7-9933-46be-a2d8-03d96c76af57 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:26.219856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff1892e7-9933-46be-a2d8-03d96c76af57 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:26.220368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff1892e7-9933-46be-a2d8-03d96c76af57 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:26.220819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff1892e7-9933-46be-a2d8-03d96c76af57 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:26.221548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff1892e7-9933-46be-a2d8-03d96c76af57 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:26.222343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff1892e7-9933-46be-a2d8-03d96c76af57 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:26.223120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff1892e7-9933-46be-a2d8-03d96c76af57 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:26.324769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff1892e7-9933-46be-a2d8-03d96c76af57 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:26.335367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff1892e7-9933-46be-a2d8-03d96c76af57 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:26.340754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff1892e7-9933-46be-a2d8-03d96c76af57 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:26.340754 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff1892e7-9933-46be-a2d8-03d96c76af57 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1337 microversion: 2.47 time: 0.147106 Sep 06 11:06:26.340754 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1759/3511] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:26 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1337 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:26.716505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5f937007-c1fa-40cd-8573-aa6c326aa7ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:26.717049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5f937007-c1fa-40cd-8573-aa6c326aa7ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:26.780484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5f937007-c1fa-40cd-8573-aa6c326aa7ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:26.789566 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5f937007-c1fa-40cd-8573-aa6c326aa7ad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1215 microversion: 2.1 time: 0.077439 Sep 06 11:06:26.790728 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1753/3512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:26 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:27.130354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b126404d-d8c8-466f-9123-5d037ecd3f23 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:27.131224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b126404d-d8c8-466f-9123-5d037ecd3f23 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:27.141331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b126404d-d8c8-466f-9123-5d037ecd3f23 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:27.142006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b126404d-d8c8-466f-9123-5d037ecd3f23 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:27.142661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b126404d-d8c8-466f-9123-5d037ecd3f23 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:27.143641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b126404d-d8c8-466f-9123-5d037ecd3f23 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:27.144216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b126404d-d8c8-466f-9123-5d037ecd3f23 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:27.144712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b126404d-d8c8-466f-9123-5d037ecd3f23 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:27.155934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7cbec8c6-5f12-433d-a1b1-3fab12d301d6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:27.156926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7cbec8c6-5f12-433d-a1b1-3fab12d301d6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:27.164997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cbec8c6-5f12-433d-a1b1-3fab12d301d6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:27.165904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cbec8c6-5f12-433d-a1b1-3fab12d301d6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:27.166653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cbec8c6-5f12-433d-a1b1-3fab12d301d6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:27.167761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cbec8c6-5f12-433d-a1b1-3fab12d301d6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:27.168492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cbec8c6-5f12-433d-a1b1-3fab12d301d6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:27.169183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cbec8c6-5f12-433d-a1b1-3fab12d301d6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:27.309628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7cbec8c6-5f12-433d-a1b1-3fab12d301d6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:27.318512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7cbec8c6-5f12-433d-a1b1-3fab12d301d6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:27.320514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7cbec8c6-5f12-433d-a1b1-3fab12d301d6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:27.328467 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7cbec8c6-5f12-433d-a1b1-3fab12d301d6 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1478 microversion: 2.91 time: 0.176494 Sep 06 11:06:27.348295 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1754/3513] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:27 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1478 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:27.358750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-67fa26ee-14fa-43ec-93dc-37dfbcd6577b tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch1-master-1"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:27.361669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-67fa26ee-14fa-43ec-93dc-37dfbcd6577b tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:27.364295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b126404d-d8c8-466f-9123-5d037ecd3f23 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:27.369844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67fa26ee-14fa-43ec-93dc-37dfbcd6577b tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:27.372134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67fa26ee-14fa-43ec-93dc-37dfbcd6577b tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:27.373419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67fa26ee-14fa-43ec-93dc-37dfbcd6577b tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:27.375131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67fa26ee-14fa-43ec-93dc-37dfbcd6577b tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:27.375817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67fa26ee-14fa-43ec-93dc-37dfbcd6577b tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:27.376457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67fa26ee-14fa-43ec-93dc-37dfbcd6577b tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:27.393576 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b126404d-d8c8-466f-9123-5d037ecd3f23 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.260757 Sep 06 11:06:27.395094 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1760/3514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:27 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:27.407088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9dfc831e-43e8-4413-96b0-efe444c67543 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:27.410049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9dfc831e-43e8-4413-96b0-efe444c67543 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:27.421581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dfc831e-43e8-4413-96b0-efe444c67543 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:27.422086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dfc831e-43e8-4413-96b0-efe444c67543 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:27.422540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dfc831e-43e8-4413-96b0-efe444c67543 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:27.423296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dfc831e-43e8-4413-96b0-efe444c67543 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:27.423767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dfc831e-43e8-4413-96b0-efe444c67543 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:27.424338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9dfc831e-43e8-4413-96b0-efe444c67543 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:27.492124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-67fa26ee-14fa-43ec-93dc-37dfbcd6577b tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch1-master-1". {{(pid=140876) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 11:06:27.542021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9dfc831e-43e8-4413-96b0-efe444c67543 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:27.552964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9dfc831e-43e8-4413-96b0-efe444c67543 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:27.554694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9dfc831e-43e8-4413-96b0-efe444c67543 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:27.555989 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9dfc831e-43e8-4413-96b0-efe444c67543 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1335 microversion: 2.47 time: 0.159331 Sep 06 11:06:27.557126 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1761/3515] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:27 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1335 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:27.814772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-532e8607-c84a-4f7c-a194-096603492e9f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:27.815692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-532e8607-c84a-4f7c-a194-096603492e9f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:27.822752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-532e8607-c84a-4f7c-a194-096603492e9f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:27.823226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-532e8607-c84a-4f7c-a194-096603492e9f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:27.823656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-532e8607-c84a-4f7c-a194-096603492e9f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:27.824960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-532e8607-c84a-4f7c-a194-096603492e9f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:27.825421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-532e8607-c84a-4f7c-a194-096603492e9f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:27.825920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-532e8607-c84a-4f7c-a194-096603492e9f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:27.932534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-532e8607-c84a-4f7c-a194-096603492e9f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:27.938693 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-67fa26ee-14fa-43ec-93dc-37dfbcd6577b tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77/action" status: 202 len: 0 microversion: 2.91 time: 0.583735 Sep 06 11:06:27.955775 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-532e8607-c84a-4f7c-a194-096603492e9f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1267 microversion: 2.1 time: 0.141443 Sep 06 11:06:27.956446 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1762/3517] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:27 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:27.957767 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1755/3517] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:06:27 2022] POST /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:06:27.975583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cbd7251c-1b6e-406d-a2a8-f4e39986f8f7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:27.976670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cbd7251c-1b6e-406d-a2a8-f4e39986f8f7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:27.984636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbd7251c-1b6e-406d-a2a8-f4e39986f8f7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:27.985921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbd7251c-1b6e-406d-a2a8-f4e39986f8f7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:27.986709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbd7251c-1b6e-406d-a2a8-f4e39986f8f7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:27.987462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbd7251c-1b6e-406d-a2a8-f4e39986f8f7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:27.987920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbd7251c-1b6e-406d-a2a8-f4e39986f8f7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:27.988357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbd7251c-1b6e-406d-a2a8-f4e39986f8f7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:28.098516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cbd7251c-1b6e-406d-a2a8-f4e39986f8f7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:28.108621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cbd7251c-1b6e-406d-a2a8-f4e39986f8f7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:28.110208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cbd7251c-1b6e-406d-a2a8-f4e39986f8f7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:28.113596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:28.117436 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cbd7251c-1b6e-406d-a2a8-f4e39986f8f7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1486 microversion: 2.91 time: 0.159584 Sep 06 11:06:28.122819 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1763/3518] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:27 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1486 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:28.418951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a0ce60a6-da81-4936-b438-09f6e791c795 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:28.419904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a0ce60a6-da81-4936-b438-09f6e791c795 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:28.443395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0ce60a6-da81-4936-b438-09f6e791c795 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:28.445620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0ce60a6-da81-4936-b438-09f6e791c795 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:28.446276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0ce60a6-da81-4936-b438-09f6e791c795 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:28.447958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0ce60a6-da81-4936-b438-09f6e791c795 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:28.452318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0ce60a6-da81-4936-b438-09f6e791c795 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:28.452997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0ce60a6-da81-4936-b438-09f6e791c795 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:28.588590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-90bbc57e-c045-46ed-bb07-8639b9a78658 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:28.589343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-90bbc57e-c045-46ed-bb07-8639b9a78658 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:28.604579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90bbc57e-c045-46ed-bb07-8639b9a78658 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:28.606409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90bbc57e-c045-46ed-bb07-8639b9a78658 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:28.610300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90bbc57e-c045-46ed-bb07-8639b9a78658 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:28.612287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90bbc57e-c045-46ed-bb07-8639b9a78658 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:28.613895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90bbc57e-c045-46ed-bb07-8639b9a78658 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:28.614542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90bbc57e-c045-46ed-bb07-8639b9a78658 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:28.786123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-90bbc57e-c045-46ed-bb07-8639b9a78658 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:28.800217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-90bbc57e-c045-46ed-bb07-8639b9a78658 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:28.803920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-90bbc57e-c045-46ed-bb07-8639b9a78658 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:28.805174 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-90bbc57e-c045-46ed-bb07-8639b9a78658 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1335 microversion: 2.47 time: 0.222923 Sep 06 11:06:28.820118 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1764/3519] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:28 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1335 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:28.836131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a0ce60a6-da81-4936-b438-09f6e791c795 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:28.846658 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a0ce60a6-da81-4936-b438-09f6e791c795 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.432542 Sep 06 11:06:28.852918 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1756/3520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:28 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:28.981462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-920a3b67-ee6f-42eb-9711-6446a06beb49 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:28.982252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-920a3b67-ee6f-42eb-9711-6446a06beb49 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:28.988481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-920a3b67-ee6f-42eb-9711-6446a06beb49 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:28.989398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-920a3b67-ee6f-42eb-9711-6446a06beb49 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:28.989999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-920a3b67-ee6f-42eb-9711-6446a06beb49 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:28.990997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-920a3b67-ee6f-42eb-9711-6446a06beb49 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:28.991724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-920a3b67-ee6f-42eb-9711-6446a06beb49 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:28.992525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-920a3b67-ee6f-42eb-9711-6446a06beb49 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:29.090087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-920a3b67-ee6f-42eb-9711-6446a06beb49 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:29.099805 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-920a3b67-ee6f-42eb-9711-6446a06beb49 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1273 microversion: 2.1 time: 0.122025 Sep 06 11:06:29.100922 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1765/3521] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:28 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:29.147204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-446f788c-f247-4394-ab7d-0980129b9d91 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:29.148440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-446f788c-f247-4394-ab7d-0980129b9d91 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:29.155654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-446f788c-f247-4394-ab7d-0980129b9d91 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:29.156521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-446f788c-f247-4394-ab7d-0980129b9d91 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:29.157186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-446f788c-f247-4394-ab7d-0980129b9d91 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:29.158154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-446f788c-f247-4394-ab7d-0980129b9d91 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:29.158826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-446f788c-f247-4394-ab7d-0980129b9d91 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:29.159485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-446f788c-f247-4394-ab7d-0980129b9d91 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:29.252021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-446f788c-f247-4394-ab7d-0980129b9d91 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:29.262007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-446f788c-f247-4394-ab7d-0980129b9d91 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:29.263545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-446f788c-f247-4394-ab7d-0980129b9d91 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:29.268894 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-446f788c-f247-4394-ab7d-0980129b9d91 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1486 microversion: 2.91 time: 0.125744 Sep 06 11:06:29.281496 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1757/3522] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:29 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1486 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:29.837577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8106e8ca-6a4a-4a66-b2c9-b59ffed4fc8e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:29.840016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8106e8ca-6a4a-4a66-b2c9-b59ffed4fc8e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:29.853668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8106e8ca-6a4a-4a66-b2c9-b59ffed4fc8e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:29.854413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8106e8ca-6a4a-4a66-b2c9-b59ffed4fc8e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:29.858384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8106e8ca-6a4a-4a66-b2c9-b59ffed4fc8e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:29.859895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8106e8ca-6a4a-4a66-b2c9-b59ffed4fc8e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:29.869057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8106e8ca-6a4a-4a66-b2c9-b59ffed4fc8e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:29.874183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8106e8ca-6a4a-4a66-b2c9-b59ffed4fc8e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:29.880280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b330b6f7-03c2-47b8-ad40-068133d068e3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:29.880907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b330b6f7-03c2-47b8-ad40-068133d068e3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:29.891563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b330b6f7-03c2-47b8-ad40-068133d068e3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:29.892068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b330b6f7-03c2-47b8-ad40-068133d068e3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:29.892519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b330b6f7-03c2-47b8-ad40-068133d068e3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:29.892795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:29.893238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b330b6f7-03c2-47b8-ad40-068133d068e3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:29.914287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b330b6f7-03c2-47b8-ad40-068133d068e3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:29.914287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b330b6f7-03c2-47b8-ad40-068133d068e3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:30.021918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8106e8ca-6a4a-4a66-b2c9-b59ffed4fc8e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:30.043774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8106e8ca-6a4a-4a66-b2c9-b59ffed4fc8e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:30.045485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8106e8ca-6a4a-4a66-b2c9-b59ffed4fc8e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:30.047205 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8106e8ca-6a4a-4a66-b2c9-b59ffed4fc8e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1335 microversion: 2.47 time: 0.217223 Sep 06 11:06:30.047361 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1766/3523] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:29 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1335 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:30.127244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ec613688-978f-4bf9-b5c4-8da2d4965296 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:30.128118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ec613688-978f-4bf9-b5c4-8da2d4965296 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:30.137958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec613688-978f-4bf9-b5c4-8da2d4965296 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:30.138476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec613688-978f-4bf9-b5c4-8da2d4965296 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:30.138943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec613688-978f-4bf9-b5c4-8da2d4965296 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:30.147702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec613688-978f-4bf9-b5c4-8da2d4965296 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:30.152663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec613688-978f-4bf9-b5c4-8da2d4965296 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:30.152663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec613688-978f-4bf9-b5c4-8da2d4965296 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:30.479566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b330b6f7-03c2-47b8-ad40-068133d068e3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:30.499931 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b330b6f7-03c2-47b8-ad40-068133d068e3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.624165 Sep 06 11:06:30.500541 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1758/3524] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:29 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:30.505511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-493b42c9-2a0a-4b0f-aee4-54e661b15bf1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:30.511905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ec613688-978f-4bf9-b5c4-8da2d4965296 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:30.519933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-493b42c9-2a0a-4b0f-aee4-54e661b15bf1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:30.522848 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ec613688-978f-4bf9-b5c4-8da2d4965296 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1315 microversion: 2.1 time: 0.399757 Sep 06 11:06:30.535311 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1767/3525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:30 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:30.541149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-493b42c9-2a0a-4b0f-aee4-54e661b15bf1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:30.541896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-493b42c9-2a0a-4b0f-aee4-54e661b15bf1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:30.542343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-493b42c9-2a0a-4b0f-aee4-54e661b15bf1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:30.543107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-493b42c9-2a0a-4b0f-aee4-54e661b15bf1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:30.543572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-493b42c9-2a0a-4b0f-aee4-54e661b15bf1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:30.544006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-493b42c9-2a0a-4b0f-aee4-54e661b15bf1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:30.659247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-493b42c9-2a0a-4b0f-aee4-54e661b15bf1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:30.671151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-493b42c9-2a0a-4b0f-aee4-54e661b15bf1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:30.672631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-493b42c9-2a0a-4b0f-aee4-54e661b15bf1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:30.685517 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-493b42c9-2a0a-4b0f-aee4-54e661b15bf1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.183520 Sep 06 11:06:30.691466 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1759/3526] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:30 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:31.078883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c9f5ef1-12e5-4130-8fd3-c928b4675561 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:31.079530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3c9f5ef1-12e5-4130-8fd3-c928b4675561 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:31.087736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c9f5ef1-12e5-4130-8fd3-c928b4675561 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:31.088227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c9f5ef1-12e5-4130-8fd3-c928b4675561 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:31.093576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c9f5ef1-12e5-4130-8fd3-c928b4675561 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:31.093576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c9f5ef1-12e5-4130-8fd3-c928b4675561 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:31.093576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c9f5ef1-12e5-4130-8fd3-c928b4675561 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:31.093576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c9f5ef1-12e5-4130-8fd3-c928b4675561 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:31.214982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c9f5ef1-12e5-4130-8fd3-c928b4675561 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:31.226421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c9f5ef1-12e5-4130-8fd3-c928b4675561 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:31.228412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c9f5ef1-12e5-4130-8fd3-c928b4675561 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:31.229805 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3c9f5ef1-12e5-4130-8fd3-c928b4675561 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1356 microversion: 2.47 time: 0.155939 Sep 06 11:06:31.231097 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1768/3527] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:31 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:31.264942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:31.268138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:31.275609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:31.276239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:31.278383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:31.278383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:31.278383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:31.278849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:31.395759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ec59afb7-0cf1-4650-92b5-38adbd4f6412 req-1843d4b3-5237-4eed-99ec-759e6cba7f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79338947-1b4d-41ad-a75d-6f1141500c45", "tag": "3d2d3924-0410-4fb4-aecd-20198e16c4f1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:31.437701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ec59afb7-0cf1-4650-92b5-38adbd4f6412 req-1843d4b3-5237-4eed-99ec-759e6cba7f8a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:31.446216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ec59afb7-0cf1-4650-92b5-38adbd4f6412 req-1843d4b3-5237-4eed-99ec-759e6cba7f8a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:31.448519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ec59afb7-0cf1-4650-92b5-38adbd4f6412 req-1843d4b3-5237-4eed-99ec-759e6cba7f8a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:31.466984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:06:31.467746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:06:31.479484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:06:31.483566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:06:31.488961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:06:31.490595 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ec59afb7-0cf1-4650-92b5-38adbd4f6412 req-1843d4b3-5237-4eed-99ec-759e6cba7f8a service nova] Creating event network-changed:3d2d3924-0410-4fb4-aecd-20198e16c4f1 for instance 79338947-1b4d-41ad-a75d-6f1141500c45 on nch1-master-1 Sep 06 11:06:31.508867 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ec59afb7-0cf1-4650-92b5-38adbd4f6412 req-1843d4b3-5237-4eed-99ec-759e6cba7f8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117340 Sep 06 11:06:31.509920 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1769/3528] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:06:31.531129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a902cbf-21b6-4a1c-a7f0-462ea056b791 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:31.531953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0a902cbf-21b6-4a1c-a7f0-462ea056b791 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:31.555597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a902cbf-21b6-4a1c-a7f0-462ea056b791 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:31.558005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a902cbf-21b6-4a1c-a7f0-462ea056b791 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:31.559573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a902cbf-21b6-4a1c-a7f0-462ea056b791 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:31.560461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a902cbf-21b6-4a1c-a7f0-462ea056b791 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:31.561011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a902cbf-21b6-4a1c-a7f0-462ea056b791 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:31.561523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a902cbf-21b6-4a1c-a7f0-462ea056b791 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:31.768335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:31.775950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:31.776530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:31.777498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:31.778214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:31.787415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:31.787415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:31.787415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:31.847913 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0aea932c-b53b-477f-a8f9-549a0594b4e9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "POST /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9/action" status: 202 len: 1078 microversion: 2.47 time: 0.587089 Sep 06 11:06:31.858328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0a902cbf-21b6-4a1c-a7f0-462ea056b791 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:31.863969 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1760/3529] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:06:31 2022] POST /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9/action => generated 1078 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 06 11:06:31.870119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-28fe7739-404c-47b5-ae53-d801a17430f9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:31.871001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-28fe7739-404c-47b5-ae53-d801a17430f9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:31.872826 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0a902cbf-21b6-4a1c-a7f0-462ea056b791 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.346637 Sep 06 11:06:31.877805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28fe7739-404c-47b5-ae53-d801a17430f9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:31.878303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28fe7739-404c-47b5-ae53-d801a17430f9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:31.878752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28fe7739-404c-47b5-ae53-d801a17430f9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:31.879479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28fe7739-404c-47b5-ae53-d801a17430f9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:31.880111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28fe7739-404c-47b5-ae53-d801a17430f9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:31.880707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28fe7739-404c-47b5-ae53-d801a17430f9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:31.891163 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1770/3530] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:31 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:31.914319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1fbac55b-b10f-4bb2-9f78-bb1b69a9eb72 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:31.919330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1fbac55b-b10f-4bb2-9f78-bb1b69a9eb72 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:31.936211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1fbac55b-b10f-4bb2-9f78-bb1b69a9eb72 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:31.939819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1fbac55b-b10f-4bb2-9f78-bb1b69a9eb72 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:31.940922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1fbac55b-b10f-4bb2-9f78-bb1b69a9eb72 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:31.947386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1fbac55b-b10f-4bb2-9f78-bb1b69a9eb72 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:31.947386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1fbac55b-b10f-4bb2-9f78-bb1b69a9eb72 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:31.947386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1fbac55b-b10f-4bb2-9f78-bb1b69a9eb72 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:32.150734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1fbac55b-b10f-4bb2-9f78-bb1b69a9eb72 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:32.168573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1fbac55b-b10f-4bb2-9f78-bb1b69a9eb72 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:32.170202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1fbac55b-b10f-4bb2-9f78-bb1b69a9eb72 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:32.177535 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1fbac55b-b10f-4bb2-9f78-bb1b69a9eb72 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.284341 Sep 06 11:06:32.178419 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1771/3531] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:31 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:32.183489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-512479cb-94dd-45bc-bec6-a9332a40375b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:32.184341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-512479cb-94dd-45bc-bec6-a9332a40375b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:32.191204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-512479cb-94dd-45bc-bec6-a9332a40375b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:32.192003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-512479cb-94dd-45bc-bec6-a9332a40375b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:32.202700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-512479cb-94dd-45bc-bec6-a9332a40375b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:32.202700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-512479cb-94dd-45bc-bec6-a9332a40375b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:32.202700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-512479cb-94dd-45bc-bec6-a9332a40375b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:32.202700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-512479cb-94dd-45bc-bec6-a9332a40375b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:32.233492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-28fe7739-404c-47b5-ae53-d801a17430f9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:32.243731 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-28fe7739-404c-47b5-ae53-d801a17430f9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1315 microversion: 2.1 time: 0.377731 Sep 06 11:06:32.244679 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1761/3532] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:31 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:32.288405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-512479cb-94dd-45bc-bec6-a9332a40375b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:32.299035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-512479cb-94dd-45bc-bec6-a9332a40375b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:32.301860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-512479cb-94dd-45bc-bec6-a9332a40375b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:32.304133 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-512479cb-94dd-45bc-bec6-a9332a40375b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.124258 Sep 06 11:06:32.305036 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1772/3533] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:32 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:32.315104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-367752745", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "8b8ff46b-a0ab-491a-a7ea-dd1a2de0e2b7"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:32.420326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] validate_networks() for [('8b8ff46b-a0ab-491a-a7ea-dd1a2de0e2b7', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:06:32.897253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5ee9b647-d07e-4f66-8fd1-851b745a74d4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:32.898035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5ee9b647-d07e-4f66-8fd1-851b745a74d4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:32.910782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ee9b647-d07e-4f66-8fd1-851b745a74d4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:32.911616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ee9b647-d07e-4f66-8fd1-851b745a74d4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:32.912264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ee9b647-d07e-4f66-8fd1-851b745a74d4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:32.913810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ee9b647-d07e-4f66-8fd1-851b745a74d4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:32.914283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ee9b647-d07e-4f66-8fd1-851b745a74d4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:32.914718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ee9b647-d07e-4f66-8fd1-851b745a74d4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:33.122583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5ee9b647-d07e-4f66-8fd1-851b745a74d4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:33.134921 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5ee9b647-d07e-4f66-8fd1-851b745a74d4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.241692 Sep 06 11:06:33.135634 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1773/3534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:32 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:33.212564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e97209c8-a4bb-449c-a9b1-1a1d5a04d5b8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:33.213277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e97209c8-a4bb-449c-a9b1-1a1d5a04d5b8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:33.219851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e97209c8-a4bb-449c-a9b1-1a1d5a04d5b8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:33.220600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e97209c8-a4bb-449c-a9b1-1a1d5a04d5b8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:33.221054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e97209c8-a4bb-449c-a9b1-1a1d5a04d5b8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:33.221771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e97209c8-a4bb-449c-a9b1-1a1d5a04d5b8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:33.222239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e97209c8-a4bb-449c-a9b1-1a1d5a04d5b8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:33.222675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e97209c8-a4bb-449c-a9b1-1a1d5a04d5b8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:33.316209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e97209c8-a4bb-449c-a9b1-1a1d5a04d5b8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:33.331495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e97209c8-a4bb-449c-a9b1-1a1d5a04d5b8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:33.331495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e97209c8-a4bb-449c-a9b1-1a1d5a04d5b8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:33.349141 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e97209c8-a4bb-449c-a9b1-1a1d5a04d5b8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.140235 Sep 06 11:06:33.350836 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1774/3535] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:33 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:33.356867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ec53493e-3e58-48d4-8196-38f2930d61d3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:33.358752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ec53493e-3e58-48d4-8196-38f2930d61d3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:33.368995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec53493e-3e58-48d4-8196-38f2930d61d3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:33.370698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec53493e-3e58-48d4-8196-38f2930d61d3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:33.371444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec53493e-3e58-48d4-8196-38f2930d61d3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:33.372273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec53493e-3e58-48d4-8196-38f2930d61d3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:33.372858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec53493e-3e58-48d4-8196-38f2930d61d3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:33.375098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec53493e-3e58-48d4-8196-38f2930d61d3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:33.399523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:06:33.400750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:06:33.401516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:06:33.404710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:06:33.406824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:06:33.440908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:33.441919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:33.442591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:33.446213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:33.447038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:33.447707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:33.505252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Getting quotas for project 3ae9ee2e2f5d439786309f06030582b9. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:06:33.508024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:33.513225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Getting quotas for user d0db5bafa61d44b981696fdae685d811 and project 3ae9ee2e2f5d439786309f06030582b9. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:06:33.564554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:06:33.573314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:06:33.679429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ec53493e-3e58-48d4-8196-38f2930d61d3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:33.691038 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ec53493e-3e58-48d4-8196-38f2930d61d3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1315 microversion: 2.1 time: 0.338749 Sep 06 11:06:33.692214 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1775/3536] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:33 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:33.697276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-87928eeb-d6ed-4d51-b1aa-240197c4975e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:33.698300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-87928eeb-d6ed-4d51-b1aa-240197c4975e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:33.710831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87928eeb-d6ed-4d51-b1aa-240197c4975e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:33.711318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87928eeb-d6ed-4d51-b1aa-240197c4975e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:33.712035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87928eeb-d6ed-4d51-b1aa-240197c4975e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:33.713055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87928eeb-d6ed-4d51-b1aa-240197c4975e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:33.713726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87928eeb-d6ed-4d51-b1aa-240197c4975e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:33.714798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87928eeb-d6ed-4d51-b1aa-240197c4975e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:33.732506 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3ce81b7d-a473-40bd-b556-b9fd37c25f4e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.486473 Sep 06 11:06:33.740626 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1762/3537] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 11:06:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 11:06:33.746640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-92865cdc-6677-48d3-9a15-f1cf342d289b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:33.747542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-92865cdc-6677-48d3-9a15-f1cf342d289b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:33.827630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-87928eeb-d6ed-4d51-b1aa-240197c4975e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:33.838046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-87928eeb-d6ed-4d51-b1aa-240197c4975e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:33.844962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-87928eeb-d6ed-4d51-b1aa-240197c4975e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:33.846567 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-87928eeb-d6ed-4d51-b1aa-240197c4975e tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.152996 Sep 06 11:06:33.853693 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1776/3538] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:33 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:33.879065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-92865cdc-6677-48d3-9a15-f1cf342d289b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:33.889930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-92865cdc-6677-48d3-9a15-f1cf342d289b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:33.891792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-92865cdc-6677-48d3-9a15-f1cf342d289b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:33.894324 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-92865cdc-6677-48d3-9a15-f1cf342d289b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1258 microversion: 2.21 time: 0.151149 Sep 06 11:06:33.927190 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1763/3539] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:33 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:34.168168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f102cd1a-f8f5-476b-8d5e-db67b7dc05f7 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:34.169238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f102cd1a-f8f5-476b-8d5e-db67b7dc05f7 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:34.188869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f102cd1a-f8f5-476b-8d5e-db67b7dc05f7 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:34.189380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f102cd1a-f8f5-476b-8d5e-db67b7dc05f7 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:34.189916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f102cd1a-f8f5-476b-8d5e-db67b7dc05f7 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:34.202682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f102cd1a-f8f5-476b-8d5e-db67b7dc05f7 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:34.202682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f102cd1a-f8f5-476b-8d5e-db67b7dc05f7 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:34.207172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f102cd1a-f8f5-476b-8d5e-db67b7dc05f7 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:34.379251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8176aae5-80ad-4f19-ae81-b822360f9f79 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:34.380510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8176aae5-80ad-4f19-ae81-b822360f9f79 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:34.390051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8176aae5-80ad-4f19-ae81-b822360f9f79 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:34.400816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8176aae5-80ad-4f19-ae81-b822360f9f79 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:34.402054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8176aae5-80ad-4f19-ae81-b822360f9f79 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:34.403141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8176aae5-80ad-4f19-ae81-b822360f9f79 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:34.404012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8176aae5-80ad-4f19-ae81-b822360f9f79 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:34.404644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8176aae5-80ad-4f19-ae81-b822360f9f79 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:34.472579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f102cd1a-f8f5-476b-8d5e-db67b7dc05f7 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:34.481810 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f102cd1a-f8f5-476b-8d5e-db67b7dc05f7 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.327627 Sep 06 11:06:34.482406 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1777/3540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:34 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:34.580052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8176aae5-80ad-4f19-ae81-b822360f9f79 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:34.589014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8176aae5-80ad-4f19-ae81-b822360f9f79 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:34.601992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8176aae5-80ad-4f19-ae81-b822360f9f79 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:34.611670 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8176aae5-80ad-4f19-ae81-b822360f9f79 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.237362 Sep 06 11:06:34.615036 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1764/3541] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:34 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:34.723535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a4cd6f92-8558-4249-ba98-437d99e82b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:34.724326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a4cd6f92-8558-4249-ba98-437d99e82b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:34.731389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4cd6f92-8558-4249-ba98-437d99e82b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:34.736114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4cd6f92-8558-4249-ba98-437d99e82b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:34.736114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4cd6f92-8558-4249-ba98-437d99e82b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:34.736114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4cd6f92-8558-4249-ba98-437d99e82b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:34.736114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4cd6f92-8558-4249-ba98-437d99e82b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:34.736114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4cd6f92-8558-4249-ba98-437d99e82b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:34.893473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-496153bd-c63a-446a-b057-3f73c45c6f5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:34.894392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-496153bd-c63a-446a-b057-3f73c45c6f5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:34.932685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-496153bd-c63a-446a-b057-3f73c45c6f5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:34.935123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-496153bd-c63a-446a-b057-3f73c45c6f5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:34.935760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-496153bd-c63a-446a-b057-3f73c45c6f5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:34.936652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-496153bd-c63a-446a-b057-3f73c45c6f5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:34.942555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-496153bd-c63a-446a-b057-3f73c45c6f5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:34.944403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-496153bd-c63a-446a-b057-3f73c45c6f5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:35.090925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-496153bd-c63a-446a-b057-3f73c45c6f5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:35.091365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a4cd6f92-8558-4249-ba98-437d99e82b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:35.112984 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a4cd6f92-8558-4249-ba98-437d99e82b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1315 microversion: 2.1 time: 0.387042 Sep 06 11:06:35.112984 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1778/3542] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:34 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:35.113244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-496153bd-c63a-446a-b057-3f73c45c6f5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:35.113244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-496153bd-c63a-446a-b057-3f73c45c6f5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:35.113244 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-496153bd-c63a-446a-b057-3f73c45c6f5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.232825 Sep 06 11:06:35.113244 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1765/3543] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:34 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:35.113637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-54b36e09-1b19-47d8-b4a9-d5b93c33ea32 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:35.113637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-54b36e09-1b19-47d8-b4a9-d5b93c33ea32 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:35.174824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-54b36e09-1b19-47d8-b4a9-d5b93c33ea32 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:35.191964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-54b36e09-1b19-47d8-b4a9-d5b93c33ea32 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:35.191964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-54b36e09-1b19-47d8-b4a9-d5b93c33ea32 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:35.191964 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-54b36e09-1b19-47d8-b4a9-d5b93c33ea32 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1258 microversion: 2.21 time: 0.082457 Sep 06 11:06:35.191964 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1779/3544] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:35 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1258 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:35.518365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4d29fbae-d87b-468b-8393-4ff016a882c1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:35.522123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4d29fbae-d87b-468b-8393-4ff016a882c1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:35.540401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d29fbae-d87b-468b-8393-4ff016a882c1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:35.541361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d29fbae-d87b-468b-8393-4ff016a882c1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:35.542048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d29fbae-d87b-468b-8393-4ff016a882c1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:35.544328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d29fbae-d87b-468b-8393-4ff016a882c1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:35.545103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d29fbae-d87b-468b-8393-4ff016a882c1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:35.546094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d29fbae-d87b-468b-8393-4ff016a882c1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:35.646560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-745c06dc-e838-4617-923c-fb995a8da42d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:35.650226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-745c06dc-e838-4617-923c-fb995a8da42d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:35.650226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:35.669806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-745c06dc-e838-4617-923c-fb995a8da42d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:35.672787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-745c06dc-e838-4617-923c-fb995a8da42d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:35.679138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-745c06dc-e838-4617-923c-fb995a8da42d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:35.679138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-745c06dc-e838-4617-923c-fb995a8da42d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:35.679138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-745c06dc-e838-4617-923c-fb995a8da42d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:35.679138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-745c06dc-e838-4617-923c-fb995a8da42d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:35.851382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-745c06dc-e838-4617-923c-fb995a8da42d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:35.868025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-745c06dc-e838-4617-923c-fb995a8da42d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:35.873565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-745c06dc-e838-4617-923c-fb995a8da42d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:35.888372 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-745c06dc-e838-4617-923c-fb995a8da42d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.246407 Sep 06 11:06:35.916139 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1780/3545] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:35 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:35.951440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4d29fbae-d87b-468b-8393-4ff016a882c1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:35.962942 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4d29fbae-d87b-468b-8393-4ff016a882c1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.457840 Sep 06 11:06:35.966456 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1766/3546] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:35 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:36.131770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ebbb2c69-e63f-4ab2-82f6-0dc8fd9b3898 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:36.136784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ebbb2c69-e63f-4ab2-82f6-0dc8fd9b3898 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:36.140477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ebbb2c69-e63f-4ab2-82f6-0dc8fd9b3898 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:36.143360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f78f086d-5582-401e-96b3-b2d4242af025 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:36.148517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f78f086d-5582-401e-96b3-b2d4242af025 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:36.149275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ebbb2c69-e63f-4ab2-82f6-0dc8fd9b3898 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:36.150760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ebbb2c69-e63f-4ab2-82f6-0dc8fd9b3898 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:36.152029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ebbb2c69-e63f-4ab2-82f6-0dc8fd9b3898 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:36.158869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f78f086d-5582-401e-96b3-b2d4242af025 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:36.159377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ebbb2c69-e63f-4ab2-82f6-0dc8fd9b3898 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:36.160000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ebbb2c69-e63f-4ab2-82f6-0dc8fd9b3898 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:36.160384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f78f086d-5582-401e-96b3-b2d4242af025 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:36.161723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f78f086d-5582-401e-96b3-b2d4242af025 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:36.162886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f78f086d-5582-401e-96b3-b2d4242af025 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:36.163617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f78f086d-5582-401e-96b3-b2d4242af025 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:36.164536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f78f086d-5582-401e-96b3-b2d4242af025 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:36.559336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f78f086d-5582-401e-96b3-b2d4242af025 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:36.577055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f78f086d-5582-401e-96b3-b2d4242af025 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:36.579217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f78f086d-5582-401e-96b3-b2d4242af025 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:36.581011 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f78f086d-5582-401e-96b3-b2d4242af025 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.442586 Sep 06 11:06:36.582522 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1767/3547] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:36 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:36.589066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1e95ca52-fb9f-4134-89ab-5ef248adb775 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:36.590922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1e95ca52-fb9f-4134-89ab-5ef248adb775 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:36.622156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e95ca52-fb9f-4134-89ab-5ef248adb775 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:36.624422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e95ca52-fb9f-4134-89ab-5ef248adb775 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:36.625501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e95ca52-fb9f-4134-89ab-5ef248adb775 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:36.629538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e95ca52-fb9f-4134-89ab-5ef248adb775 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:36.630603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e95ca52-fb9f-4134-89ab-5ef248adb775 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:36.631641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e95ca52-fb9f-4134-89ab-5ef248adb775 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:36.685893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ebbb2c69-e63f-4ab2-82f6-0dc8fd9b3898 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:36.706547 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ebbb2c69-e63f-4ab2-82f6-0dc8fd9b3898 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1315 microversion: 2.1 time: 0.579017 Sep 06 11:06:36.707167 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1781/3548] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:36 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:36.764474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1e95ca52-fb9f-4134-89ab-5ef248adb775 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:36.788289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1e95ca52-fb9f-4134-89ab-5ef248adb775 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:36.796015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1e95ca52-fb9f-4134-89ab-5ef248adb775 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:36.802597 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1e95ca52-fb9f-4134-89ab-5ef248adb775 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1310 microversion: 2.21 time: 0.213817 Sep 06 11:06:36.805049 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1768/3549] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:36 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1310 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:36.921401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f525518b-2417-44fb-9a10-e831ef8296d3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:36.922025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f525518b-2417-44fb-9a10-e831ef8296d3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:36.945521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f525518b-2417-44fb-9a10-e831ef8296d3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:36.945521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f525518b-2417-44fb-9a10-e831ef8296d3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:36.945521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f525518b-2417-44fb-9a10-e831ef8296d3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:36.945521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f525518b-2417-44fb-9a10-e831ef8296d3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:36.945521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f525518b-2417-44fb-9a10-e831ef8296d3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:36.945521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f525518b-2417-44fb-9a10-e831ef8296d3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:36.991660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-768fc721-8e8a-4d36-8f8e-84b2f7dee23d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:36.992235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-768fc721-8e8a-4d36-8f8e-84b2f7dee23d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:37.004016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-768fc721-8e8a-4d36-8f8e-84b2f7dee23d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:37.004943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-768fc721-8e8a-4d36-8f8e-84b2f7dee23d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:37.005587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-768fc721-8e8a-4d36-8f8e-84b2f7dee23d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:37.006482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-768fc721-8e8a-4d36-8f8e-84b2f7dee23d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:37.007184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-768fc721-8e8a-4d36-8f8e-84b2f7dee23d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:37.008058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-768fc721-8e8a-4d36-8f8e-84b2f7dee23d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:37.064759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f525518b-2417-44fb-9a10-e831ef8296d3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:37.080523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f525518b-2417-44fb-9a10-e831ef8296d3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:37.089704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f525518b-2417-44fb-9a10-e831ef8296d3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:37.089704 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f525518b-2417-44fb-9a10-e831ef8296d3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.170792 Sep 06 11:06:37.100813 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1782/3550] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:36 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:37.252460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-768fc721-8e8a-4d36-8f8e-84b2f7dee23d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:37.262363 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-768fc721-8e8a-4d36-8f8e-84b2f7dee23d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.274584 Sep 06 11:06:37.278743 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1769/3551] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:36 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:37.614895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-18d59c82-7d17-4ee7-9699-00f321ec144d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:37.615867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-18d59c82-7d17-4ee7-9699-00f321ec144d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:37.624848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18d59c82-7d17-4ee7-9699-00f321ec144d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:37.628835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18d59c82-7d17-4ee7-9699-00f321ec144d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:37.628835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18d59c82-7d17-4ee7-9699-00f321ec144d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:37.628835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18d59c82-7d17-4ee7-9699-00f321ec144d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:37.628835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18d59c82-7d17-4ee7-9699-00f321ec144d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:37.628835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18d59c82-7d17-4ee7-9699-00f321ec144d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:37.777133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-e0d00637-b329-4c38-aaae-b954242f81a4 req-20dfa54b-6ca3-41ae-9ae2-8a521bb63457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79338947-1b4d-41ad-a75d-6f1141500c45", "name": "network-vif-plugged", "status": "completed", "tag": "3d2d3924-0410-4fb4-aecd-20198e16c4f1"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:37.777133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e0d00637-b329-4c38-aaae-b954242f81a4 req-20dfa54b-6ca3-41ae-9ae2-8a521bb63457 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:37.777133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e0d00637-b329-4c38-aaae-b954242f81a4 req-20dfa54b-6ca3-41ae-9ae2-8a521bb63457 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:37.777133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e0d00637-b329-4c38-aaae-b954242f81a4 req-20dfa54b-6ca3-41ae-9ae2-8a521bb63457 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:37.777133 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-e0d00637-b329-4c38-aaae-b954242f81a4 req-20dfa54b-6ca3-41ae-9ae2-8a521bb63457 service nova] Creating event network-vif-plugged:3d2d3924-0410-4fb4-aecd-20198e16c4f1 for instance 79338947-1b4d-41ad-a75d-6f1141500c45 on nch1-master-1 Sep 06 11:06:37.777133 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-e0d00637-b329-4c38-aaae-b954242f81a4 req-20dfa54b-6ca3-41ae-9ae2-8a521bb63457 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048923 Sep 06 11:06:37.777133 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1770/3552] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:06:37.777133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-91a029ec-df61-43cc-a11d-f7d99a053629 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:37.777133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-91a029ec-df61-43cc-a11d-f7d99a053629 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:37.785141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91a029ec-df61-43cc-a11d-f7d99a053629 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:37.785705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91a029ec-df61-43cc-a11d-f7d99a053629 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:37.787597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91a029ec-df61-43cc-a11d-f7d99a053629 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:37.789476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91a029ec-df61-43cc-a11d-f7d99a053629 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:37.791128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91a029ec-df61-43cc-a11d-f7d99a053629 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:37.793118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91a029ec-df61-43cc-a11d-f7d99a053629 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:37.801802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-18d59c82-7d17-4ee7-9699-00f321ec144d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:37.812440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-18d59c82-7d17-4ee7-9699-00f321ec144d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:37.814598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-18d59c82-7d17-4ee7-9699-00f321ec144d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:37.824743 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-18d59c82-7d17-4ee7-9699-00f321ec144d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.214127 Sep 06 11:06:37.825966 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1783/3553] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:37 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:37.837878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e27fb5e4-1391-4e31-9782-3ac196770b04 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:37.838770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e27fb5e4-1391-4e31-9782-3ac196770b04 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:37.856371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e27fb5e4-1391-4e31-9782-3ac196770b04 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:37.857201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e27fb5e4-1391-4e31-9782-3ac196770b04 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:37.858037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e27fb5e4-1391-4e31-9782-3ac196770b04 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:37.858940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e27fb5e4-1391-4e31-9782-3ac196770b04 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:37.859724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e27fb5e4-1391-4e31-9782-3ac196770b04 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:37.860349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e27fb5e4-1391-4e31-9782-3ac196770b04 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:37.887500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:37.996087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e27fb5e4-1391-4e31-9782-3ac196770b04 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:38.009969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e27fb5e4-1391-4e31-9782-3ac196770b04 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:38.016294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e27fb5e4-1391-4e31-9782-3ac196770b04 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:38.017568 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e27fb5e4-1391-4e31-9782-3ac196770b04 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1310 microversion: 2.21 time: 0.183579 Sep 06 11:06:38.019759 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1784/3554] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:37 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1310 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:38.119139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-91a029ec-df61-43cc-a11d-f7d99a053629 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:38.119493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ea4381cd-8a57-4086-9529-0d0064b7e5fc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:38.119493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ea4381cd-8a57-4086-9529-0d0064b7e5fc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:38.126793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea4381cd-8a57-4086-9529-0d0064b7e5fc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:38.127548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea4381cd-8a57-4086-9529-0d0064b7e5fc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:38.128005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea4381cd-8a57-4086-9529-0d0064b7e5fc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:38.129055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea4381cd-8a57-4086-9529-0d0064b7e5fc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:38.130155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea4381cd-8a57-4086-9529-0d0064b7e5fc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:38.130812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea4381cd-8a57-4086-9529-0d0064b7e5fc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:38.131175 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-91a029ec-df61-43cc-a11d-f7d99a053629 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1315 microversion: 2.1 time: 0.377841 Sep 06 11:06:38.131687 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1771/3555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:37 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:38.211326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ea4381cd-8a57-4086-9529-0d0064b7e5fc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:38.224248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ea4381cd-8a57-4086-9529-0d0064b7e5fc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:38.226192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ea4381cd-8a57-4086-9529-0d0064b7e5fc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:38.238940 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ea4381cd-8a57-4086-9529-0d0064b7e5fc tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.124845 Sep 06 11:06:38.239589 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1785/3556] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:38 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:38.302906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ad892bde-3d61-43fa-8264-82318ba990f6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:38.302906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ad892bde-3d61-43fa-8264-82318ba990f6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:38.309999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad892bde-3d61-43fa-8264-82318ba990f6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:38.310110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad892bde-3d61-43fa-8264-82318ba990f6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:38.310676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad892bde-3d61-43fa-8264-82318ba990f6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:38.324375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad892bde-3d61-43fa-8264-82318ba990f6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:38.325441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad892bde-3d61-43fa-8264-82318ba990f6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:38.326114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad892bde-3d61-43fa-8264-82318ba990f6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:38.801846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ad892bde-3d61-43fa-8264-82318ba990f6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:38.809889 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ad892bde-3d61-43fa-8264-82318ba990f6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.518344 Sep 06 11:06:38.810389 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1772/3557] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:38 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:38.854264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ba439888-0644-41cf-be40-8002a690458b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:38.854907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ba439888-0644-41cf-be40-8002a690458b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:38.861963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba439888-0644-41cf-be40-8002a690458b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:38.862449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba439888-0644-41cf-be40-8002a690458b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:38.862891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba439888-0644-41cf-be40-8002a690458b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:38.863611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba439888-0644-41cf-be40-8002a690458b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:38.864071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba439888-0644-41cf-be40-8002a690458b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:38.864500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba439888-0644-41cf-be40-8002a690458b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:38.934330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ba439888-0644-41cf-be40-8002a690458b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:38.944517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ba439888-0644-41cf-be40-8002a690458b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:38.946062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ba439888-0644-41cf-be40-8002a690458b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:38.947317 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ba439888-0644-41cf-be40-8002a690458b tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.097354 Sep 06 11:06:38.947903 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1786/3558] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:38 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:39.072597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-69756154-d70a-42b0-a405-df7cc78ff2a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:39.072597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-69756154-d70a-42b0-a405-df7cc78ff2a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:39.072597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69756154-d70a-42b0-a405-df7cc78ff2a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:39.072597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69756154-d70a-42b0-a405-df7cc78ff2a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:39.072597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69756154-d70a-42b0-a405-df7cc78ff2a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:39.072597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69756154-d70a-42b0-a405-df7cc78ff2a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:39.072597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69756154-d70a-42b0-a405-df7cc78ff2a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:39.072597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69756154-d70a-42b0-a405-df7cc78ff2a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:39.125500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-69756154-d70a-42b0-a405-df7cc78ff2a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:39.130986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-69756154-d70a-42b0-a405-df7cc78ff2a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:39.132777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-69756154-d70a-42b0-a405-df7cc78ff2a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:39.133897 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-69756154-d70a-42b0-a405-df7cc78ff2a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1310 microversion: 2.21 time: 0.090375 Sep 06 11:06:39.134479 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1773/3559] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:39 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:39.157310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-83dfd06a-2422-4af4-a1b3-b0e22663f56a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:39.158204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-83dfd06a-2422-4af4-a1b3-b0e22663f56a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:39.164430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83dfd06a-2422-4af4-a1b3-b0e22663f56a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:39.164927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83dfd06a-2422-4af4-a1b3-b0e22663f56a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:39.165372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83dfd06a-2422-4af4-a1b3-b0e22663f56a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:39.166103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83dfd06a-2422-4af4-a1b3-b0e22663f56a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:39.166562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83dfd06a-2422-4af4-a1b3-b0e22663f56a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:39.166992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83dfd06a-2422-4af4-a1b3-b0e22663f56a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:39.271306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e21c5bcd-19d4-4af9-a925-75a1cc295efb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:39.272016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e21c5bcd-19d4-4af9-a925-75a1cc295efb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:39.278281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e21c5bcd-19d4-4af9-a925-75a1cc295efb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:39.278781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e21c5bcd-19d4-4af9-a925-75a1cc295efb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:39.279253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e21c5bcd-19d4-4af9-a925-75a1cc295efb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:39.280175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e21c5bcd-19d4-4af9-a925-75a1cc295efb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:39.280649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e21c5bcd-19d4-4af9-a925-75a1cc295efb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:39.281083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e21c5bcd-19d4-4af9-a925-75a1cc295efb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:39.316954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-83dfd06a-2422-4af4-a1b3-b0e22663f56a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:39.326928 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-83dfd06a-2422-4af4-a1b3-b0e22663f56a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1315 microversion: 2.1 time: 0.173568 Sep 06 11:06:39.329547 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1787/3560] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:39 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:39.362441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e21c5bcd-19d4-4af9-a925-75a1cc295efb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:39.371515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e21c5bcd-19d4-4af9-a925-75a1cc295efb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:39.372994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e21c5bcd-19d4-4af9-a925-75a1cc295efb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:39.378535 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e21c5bcd-19d4-4af9-a925-75a1cc295efb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.111566 Sep 06 11:06:39.379119 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1774/3561] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:39 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:39.833825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9be4d6c2-eb43-46c1-b4b3-108515022117 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:39.834866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9be4d6c2-eb43-46c1-b4b3-108515022117 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:39.842264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be4d6c2-eb43-46c1-b4b3-108515022117 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:39.842898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be4d6c2-eb43-46c1-b4b3-108515022117 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:39.843376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be4d6c2-eb43-46c1-b4b3-108515022117 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:39.844096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be4d6c2-eb43-46c1-b4b3-108515022117 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:39.846422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be4d6c2-eb43-46c1-b4b3-108515022117 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:39.846876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9be4d6c2-eb43-46c1-b4b3-108515022117 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:39.973875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-70052520-d6dd-44af-abd1-335aa48fbfcc tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:39.974554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-70052520-d6dd-44af-abd1-335aa48fbfcc tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:39.985474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70052520-d6dd-44af-abd1-335aa48fbfcc tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:39.986176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70052520-d6dd-44af-abd1-335aa48fbfcc tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:39.986624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70052520-d6dd-44af-abd1-335aa48fbfcc tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:39.987353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70052520-d6dd-44af-abd1-335aa48fbfcc tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:39.987814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70052520-d6dd-44af-abd1-335aa48fbfcc tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:39.988242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70052520-d6dd-44af-abd1-335aa48fbfcc tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:39.988922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9be4d6c2-eb43-46c1-b4b3-108515022117 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:39.998831 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9be4d6c2-eb43-46c1-b4b3-108515022117 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.168780 Sep 06 11:06:40.003484 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1788/3562] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:39 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:40.063351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-70052520-d6dd-44af-abd1-335aa48fbfcc tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:40.073313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-70052520-d6dd-44af-abd1-335aa48fbfcc tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:40.075171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-70052520-d6dd-44af-abd1-335aa48fbfcc tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:40.076414 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-70052520-d6dd-44af-abd1-335aa48fbfcc tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.106535 Sep 06 11:06:40.077408 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1775/3563] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:39 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:40.159804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c4be8de1-2d05-4e66-891e-974ab75db28d tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:40.160433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c4be8de1-2d05-4e66-891e-974ab75db28d tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:40.167088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4be8de1-2d05-4e66-891e-974ab75db28d tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:40.167596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4be8de1-2d05-4e66-891e-974ab75db28d tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:40.168051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4be8de1-2d05-4e66-891e-974ab75db28d tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:40.168757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4be8de1-2d05-4e66-891e-974ab75db28d tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:40.169279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4be8de1-2d05-4e66-891e-974ab75db28d tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:40.169725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4be8de1-2d05-4e66-891e-974ab75db28d tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:40.242861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c4be8de1-2d05-4e66-891e-974ab75db28d tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:40.252407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c4be8de1-2d05-4e66-891e-974ab75db28d tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:40.253894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c4be8de1-2d05-4e66-891e-974ab75db28d tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:40.255057 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c4be8de1-2d05-4e66-891e-974ab75db28d tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1318 microversion: 2.21 time: 0.099273 Sep 06 11:06:40.262637 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1789/3564] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:40 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:40.366996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7b4c5b20-ffc2-4e07-8ca4-d88d589ee25b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:40.372031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7b4c5b20-ffc2-4e07-8ca4-d88d589ee25b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:40.382994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b4c5b20-ffc2-4e07-8ca4-d88d589ee25b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:40.383525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b4c5b20-ffc2-4e07-8ca4-d88d589ee25b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:40.383948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b4c5b20-ffc2-4e07-8ca4-d88d589ee25b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:40.384671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b4c5b20-ffc2-4e07-8ca4-d88d589ee25b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:40.385124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b4c5b20-ffc2-4e07-8ca4-d88d589ee25b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:40.385598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b4c5b20-ffc2-4e07-8ca4-d88d589ee25b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:40.414704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6310f409-0dc4-4df2-b0e0-f2997448808f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:40.415682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6310f409-0dc4-4df2-b0e0-f2997448808f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:40.423919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6310f409-0dc4-4df2-b0e0-f2997448808f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:40.424926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6310f409-0dc4-4df2-b0e0-f2997448808f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:40.425325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6310f409-0dc4-4df2-b0e0-f2997448808f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:40.426047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6310f409-0dc4-4df2-b0e0-f2997448808f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:40.426519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6310f409-0dc4-4df2-b0e0-f2997448808f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:40.427043 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6310f409-0dc4-4df2-b0e0-f2997448808f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:40.531370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6310f409-0dc4-4df2-b0e0-f2997448808f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:40.540878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6310f409-0dc4-4df2-b0e0-f2997448808f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:40.543094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6310f409-0dc4-4df2-b0e0-f2997448808f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:40.549417 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6310f409-0dc4-4df2-b0e0-f2997448808f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.139073 Sep 06 11:06:40.562305 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1790/3565] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:40 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:40.562921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7b4c5b20-ffc2-4e07-8ca4-d88d589ee25b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:40.568643 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7b4c5b20-ffc2-4e07-8ca4-d88d589ee25b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1315 microversion: 2.1 time: 0.206999 Sep 06 11:06:40.575575 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1776/3566] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:40 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:41.022724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-59cced6f-ce14-4130-8981-0d6c2e5da55f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:41.024135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-59cced6f-ce14-4130-8981-0d6c2e5da55f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:41.038513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59cced6f-ce14-4130-8981-0d6c2e5da55f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:41.038687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59cced6f-ce14-4130-8981-0d6c2e5da55f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:41.039179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59cced6f-ce14-4130-8981-0d6c2e5da55f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:41.039909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59cced6f-ce14-4130-8981-0d6c2e5da55f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:41.040376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59cced6f-ce14-4130-8981-0d6c2e5da55f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:41.040842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59cced6f-ce14-4130-8981-0d6c2e5da55f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:41.111040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-540a5e2a-503b-4cb9-a6d7-53d461884098 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:41.111793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-540a5e2a-503b-4cb9-a6d7-53d461884098 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:41.123936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-540a5e2a-503b-4cb9-a6d7-53d461884098 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:41.124589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-540a5e2a-503b-4cb9-a6d7-53d461884098 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:41.125126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-540a5e2a-503b-4cb9-a6d7-53d461884098 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:41.126109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-540a5e2a-503b-4cb9-a6d7-53d461884098 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:41.126657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-540a5e2a-503b-4cb9-a6d7-53d461884098 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:41.127293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-540a5e2a-503b-4cb9-a6d7-53d461884098 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:41.237379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-540a5e2a-503b-4cb9-a6d7-53d461884098 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:41.246006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-540a5e2a-503b-4cb9-a6d7-53d461884098 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:41.247651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-540a5e2a-503b-4cb9-a6d7-53d461884098 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:41.249346 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-540a5e2a-503b-4cb9-a6d7-53d461884098 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.147214 Sep 06 11:06:41.268841 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1777/3567] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:41 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:41.282367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4a250644-6e70-4f97-893b-c8cf8bba05c9 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:41.283539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4a250644-6e70-4f97-893b-c8cf8bba05c9 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:41.289859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a250644-6e70-4f97-893b-c8cf8bba05c9 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:41.290609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a250644-6e70-4f97-893b-c8cf8bba05c9 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:41.291175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a250644-6e70-4f97-893b-c8cf8bba05c9 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:41.292005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a250644-6e70-4f97-893b-c8cf8bba05c9 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:41.292583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a250644-6e70-4f97-893b-c8cf8bba05c9 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:41.293114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a250644-6e70-4f97-893b-c8cf8bba05c9 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:41.293262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-59cced6f-ce14-4130-8981-0d6c2e5da55f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:41.307734 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-59cced6f-ce14-4130-8981-0d6c2e5da55f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.289160 Sep 06 11:06:41.312379 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1791/3568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:41 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:41.373441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4a250644-6e70-4f97-893b-c8cf8bba05c9 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:41.384801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4a250644-6e70-4f97-893b-c8cf8bba05c9 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:41.386815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4a250644-6e70-4f97-893b-c8cf8bba05c9 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:41.388418 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4a250644-6e70-4f97-893b-c8cf8bba05c9 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1318 microversion: 2.21 time: 0.110600 Sep 06 11:06:41.389274 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1778/3569] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:41 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1318 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:41.592561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1056070c-6327-44e5-a115-38a706044adc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:41.593656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-31e07ddb-e3b1-4507-9b8d-a40d6ced4748 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:41.594182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1056070c-6327-44e5-a115-38a706044adc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:41.595133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-31e07ddb-e3b1-4507-9b8d-a40d6ced4748 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:41.608793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1056070c-6327-44e5-a115-38a706044adc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:41.609861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31e07ddb-e3b1-4507-9b8d-a40d6ced4748 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:41.610620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1056070c-6327-44e5-a115-38a706044adc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:41.611155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31e07ddb-e3b1-4507-9b8d-a40d6ced4748 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:41.611810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1056070c-6327-44e5-a115-38a706044adc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:41.612369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31e07ddb-e3b1-4507-9b8d-a40d6ced4748 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:41.613236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31e07ddb-e3b1-4507-9b8d-a40d6ced4748 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:41.614240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1056070c-6327-44e5-a115-38a706044adc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:41.614938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1056070c-6327-44e5-a115-38a706044adc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:41.615944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31e07ddb-e3b1-4507-9b8d-a40d6ced4748 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:41.616691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1056070c-6327-44e5-a115-38a706044adc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:41.617787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31e07ddb-e3b1-4507-9b8d-a40d6ced4748 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:41.652533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:41.753493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-31e07ddb-e3b1-4507-9b8d-a40d6ced4748 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:41.764295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-31e07ddb-e3b1-4507-9b8d-a40d6ced4748 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:41.770812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-31e07ddb-e3b1-4507-9b8d-a40d6ced4748 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:41.778465 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-31e07ddb-e3b1-4507-9b8d-a40d6ced4748 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.197132 Sep 06 11:06:41.779963 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1792/3570] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:41 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:41.886504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1056070c-6327-44e5-a115-38a706044adc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:41.891180 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1056070c-6327-44e5-a115-38a706044adc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1315 microversion: 2.1 time: 0.302551 Sep 06 11:06:41.903560 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1779/3571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:41 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:42.276800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-31bc72eb-edfc-4855-a5ea-8e7e147cef45 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:42.282033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-31bc72eb-edfc-4855-a5ea-8e7e147cef45 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:42.287122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bc72eb-edfc-4855-a5ea-8e7e147cef45 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:42.288160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bc72eb-edfc-4855-a5ea-8e7e147cef45 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:42.289266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bc72eb-edfc-4855-a5ea-8e7e147cef45 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:42.290476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bc72eb-edfc-4855-a5ea-8e7e147cef45 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:42.291131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bc72eb-edfc-4855-a5ea-8e7e147cef45 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:42.292652 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31bc72eb-edfc-4855-a5ea-8e7e147cef45 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:42.345501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-da7c369d-2ed3-4813-94d4-08af4e5ff86a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:42.346891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-da7c369d-2ed3-4813-94d4-08af4e5ff86a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:42.360852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da7c369d-2ed3-4813-94d4-08af4e5ff86a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:42.363358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da7c369d-2ed3-4813-94d4-08af4e5ff86a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:42.364230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da7c369d-2ed3-4813-94d4-08af4e5ff86a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:42.370022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da7c369d-2ed3-4813-94d4-08af4e5ff86a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:42.371344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da7c369d-2ed3-4813-94d4-08af4e5ff86a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:42.372204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da7c369d-2ed3-4813-94d4-08af4e5ff86a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:42.375820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-31bc72eb-edfc-4855-a5ea-8e7e147cef45 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:42.386390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-31bc72eb-edfc-4855-a5ea-8e7e147cef45 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:42.388809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-31bc72eb-edfc-4855-a5ea-8e7e147cef45 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:42.389851 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-31bc72eb-edfc-4855-a5ea-8e7e147cef45 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.117575 Sep 06 11:06:42.390726 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1793/3572] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:42 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:42.415623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-80d301ea-b9a7-49ce-a9ed-86290ade94b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:42.418001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-80d301ea-b9a7-49ce-a9ed-86290ade94b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:42.431067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80d301ea-b9a7-49ce-a9ed-86290ade94b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:42.431594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80d301ea-b9a7-49ce-a9ed-86290ade94b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:42.432093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80d301ea-b9a7-49ce-a9ed-86290ade94b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:42.433243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80d301ea-b9a7-49ce-a9ed-86290ade94b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:42.436768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80d301ea-b9a7-49ce-a9ed-86290ade94b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:42.438656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-80d301ea-b9a7-49ce-a9ed-86290ade94b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:42.585953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-80d301ea-b9a7-49ce-a9ed-86290ade94b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:42.595371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-80d301ea-b9a7-49ce-a9ed-86290ade94b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:42.596841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-80d301ea-b9a7-49ce-a9ed-86290ade94b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:42.597974 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-80d301ea-b9a7-49ce-a9ed-86290ade94b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1318 microversion: 2.21 time: 0.187660 Sep 06 11:06:42.598877 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1794/3573] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:42 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:42.626044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-da7c369d-2ed3-4813-94d4-08af4e5ff86a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:42.634710 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-da7c369d-2ed3-4813-94d4-08af4e5ff86a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.294358 Sep 06 11:06:42.636101 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1780/3574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:42 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:42.822842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e341cbc1-e516-429e-9f39-e01e5db61b27 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:42.822842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e341cbc1-e516-429e-9f39-e01e5db61b27 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:42.827921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e341cbc1-e516-429e-9f39-e01e5db61b27 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:42.828494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e341cbc1-e516-429e-9f39-e01e5db61b27 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:42.829011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e341cbc1-e516-429e-9f39-e01e5db61b27 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:42.829978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e341cbc1-e516-429e-9f39-e01e5db61b27 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:42.830559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e341cbc1-e516-429e-9f39-e01e5db61b27 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:42.831108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e341cbc1-e516-429e-9f39-e01e5db61b27 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:42.916157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5b995814-aab2-4bf4-a8fe-b21a884e4581 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:42.917107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5b995814-aab2-4bf4-a8fe-b21a884e4581 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:42.921748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e341cbc1-e516-429e-9f39-e01e5db61b27 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:42.930890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b995814-aab2-4bf4-a8fe-b21a884e4581 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:42.933075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e341cbc1-e516-429e-9f39-e01e5db61b27 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:42.934938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e341cbc1-e516-429e-9f39-e01e5db61b27 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:42.937788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b995814-aab2-4bf4-a8fe-b21a884e4581 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:42.938464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b995814-aab2-4bf4-a8fe-b21a884e4581 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:42.941584 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e341cbc1-e516-429e-9f39-e01e5db61b27 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.130606 Sep 06 11:06:42.942589 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1795/3575] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:42 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:42.943055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b995814-aab2-4bf4-a8fe-b21a884e4581 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:42.944002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b995814-aab2-4bf4-a8fe-b21a884e4581 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:42.944803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b995814-aab2-4bf4-a8fe-b21a884e4581 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:43.103574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5b995814-aab2-4bf4-a8fe-b21a884e4581 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:43.112143 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5b995814-aab2-4bf4-a8fe-b21a884e4581 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1315 microversion: 2.1 time: 0.200277 Sep 06 11:06:43.112721 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1781/3576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:42 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:43.420499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3d9ff908-7cc9-477f-88fa-11b804eb20ea tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:43.421124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3d9ff908-7cc9-477f-88fa-11b804eb20ea tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:43.428497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d9ff908-7cc9-477f-88fa-11b804eb20ea tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:43.428990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d9ff908-7cc9-477f-88fa-11b804eb20ea tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:43.429434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d9ff908-7cc9-477f-88fa-11b804eb20ea tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:43.430210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d9ff908-7cc9-477f-88fa-11b804eb20ea tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:43.430907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d9ff908-7cc9-477f-88fa-11b804eb20ea tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:43.431638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d9ff908-7cc9-477f-88fa-11b804eb20ea tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:43.502474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3d9ff908-7cc9-477f-88fa-11b804eb20ea tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:43.512580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3d9ff908-7cc9-477f-88fa-11b804eb20ea tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:43.513971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3d9ff908-7cc9-477f-88fa-11b804eb20ea tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:43.515433 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3d9ff908-7cc9-477f-88fa-11b804eb20ea tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.099579 Sep 06 11:06:43.527083 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1796/3577] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:43 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:43.624342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb1e40eb-0472-4050-8d59-ec216b6c70b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:43.624996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fb1e40eb-0472-4050-8d59-ec216b6c70b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:43.628388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:43.631917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb1e40eb-0472-4050-8d59-ec216b6c70b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:43.632668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb1e40eb-0472-4050-8d59-ec216b6c70b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:43.633117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb1e40eb-0472-4050-8d59-ec216b6c70b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:43.634044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb1e40eb-0472-4050-8d59-ec216b6c70b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:43.634499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb1e40eb-0472-4050-8d59-ec216b6c70b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:43.634934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb1e40eb-0472-4050-8d59-ec216b6c70b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:43.659241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b5be0aaf-ea23-4db1-b759-e5a105b9f73f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:43.660421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b5be0aaf-ea23-4db1-b759-e5a105b9f73f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:43.670459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5be0aaf-ea23-4db1-b759-e5a105b9f73f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:43.671455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5be0aaf-ea23-4db1-b759-e5a105b9f73f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:43.676598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5be0aaf-ea23-4db1-b759-e5a105b9f73f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:43.676598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5be0aaf-ea23-4db1-b759-e5a105b9f73f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:43.676598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5be0aaf-ea23-4db1-b759-e5a105b9f73f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:43.676598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5be0aaf-ea23-4db1-b759-e5a105b9f73f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:43.704164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fb1e40eb-0472-4050-8d59-ec216b6c70b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:43.712757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fb1e40eb-0472-4050-8d59-ec216b6c70b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:43.714780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fb1e40eb-0472-4050-8d59-ec216b6c70b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:43.715933 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fb1e40eb-0472-4050-8d59-ec216b6c70b0 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1318 microversion: 2.21 time: 0.096372 Sep 06 11:06:43.716491 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1782/3578] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:43 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1318 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:43.818292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b5be0aaf-ea23-4db1-b759-e5a105b9f73f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:43.826199 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b5be0aaf-ea23-4db1-b759-e5a105b9f73f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.171768 Sep 06 11:06:43.826781 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1797/3579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:43 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:43.975140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d6bbe77b-9b31-40b9-98e9-e1282231b4a0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:43.975678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d6bbe77b-9b31-40b9-98e9-e1282231b4a0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:43.977729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:43.988301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d6bbe77b-9b31-40b9-98e9-e1282231b4a0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:43.989138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d6bbe77b-9b31-40b9-98e9-e1282231b4a0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:43.989658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d6bbe77b-9b31-40b9-98e9-e1282231b4a0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:43.990596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d6bbe77b-9b31-40b9-98e9-e1282231b4a0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:43.991112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d6bbe77b-9b31-40b9-98e9-e1282231b4a0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:43.991557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d6bbe77b-9b31-40b9-98e9-e1282231b4a0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:44.062084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d6bbe77b-9b31-40b9-98e9-e1282231b4a0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:44.072377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d6bbe77b-9b31-40b9-98e9-e1282231b4a0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:44.072377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d6bbe77b-9b31-40b9-98e9-e1282231b4a0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:44.077530 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d6bbe77b-9b31-40b9-98e9-e1282231b4a0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.110021 Sep 06 11:06:44.078312 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1783/3580] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:43 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:44.136599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1aeaae88-739a-4022-8662-2067d4d07d1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:44.137219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1aeaae88-739a-4022-8662-2067d4d07d1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:44.143297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1aeaae88-739a-4022-8662-2067d4d07d1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:44.143793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1aeaae88-739a-4022-8662-2067d4d07d1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:44.144246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1aeaae88-739a-4022-8662-2067d4d07d1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:44.144982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1aeaae88-739a-4022-8662-2067d4d07d1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:44.145450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1aeaae88-739a-4022-8662-2067d4d07d1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:44.145915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1aeaae88-739a-4022-8662-2067d4d07d1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:44.316648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1aeaae88-739a-4022-8662-2067d4d07d1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:44.327560 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1aeaae88-739a-4022-8662-2067d4d07d1e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1502 microversion: 2.1 time: 0.195349 Sep 06 11:06:44.328505 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1798/3581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:44 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:44.351358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c4cd7c73-8d1b-4702-bfc8-2d019289086d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:44.352427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c4cd7c73-8d1b-4702-bfc8-2d019289086d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:44.358916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4cd7c73-8d1b-4702-bfc8-2d019289086d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:44.360142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4cd7c73-8d1b-4702-bfc8-2d019289086d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:44.360142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4cd7c73-8d1b-4702-bfc8-2d019289086d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:44.360759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4cd7c73-8d1b-4702-bfc8-2d019289086d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:44.361228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4cd7c73-8d1b-4702-bfc8-2d019289086d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:44.361662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4cd7c73-8d1b-4702-bfc8-2d019289086d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:44.533794 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c4cd7c73-8d1b-4702-bfc8-2d019289086d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45/action" status: 202 len: 0 microversion: 2.1 time: 0.186750 Sep 06 11:06:44.534690 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1784/3582] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:06:44 2022] POST /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:06:44.550915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cfc321a0-5280-498a-86fd-7d5123a9702b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:44.552300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cfc321a0-5280-498a-86fd-7d5123a9702b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:44.559832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfc321a0-5280-498a-86fd-7d5123a9702b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:44.565908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6971355a-d026-4d2e-8802-4704588bdb8f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:44.566792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfc321a0-5280-498a-86fd-7d5123a9702b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:44.570146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6971355a-d026-4d2e-8802-4704588bdb8f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:44.570303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfc321a0-5280-498a-86fd-7d5123a9702b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:44.570481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfc321a0-5280-498a-86fd-7d5123a9702b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:44.571162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfc321a0-5280-498a-86fd-7d5123a9702b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:44.571776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfc321a0-5280-498a-86fd-7d5123a9702b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:44.582959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6971355a-d026-4d2e-8802-4704588bdb8f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:44.583658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6971355a-d026-4d2e-8802-4704588bdb8f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:44.584106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6971355a-d026-4d2e-8802-4704588bdb8f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:44.584833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6971355a-d026-4d2e-8802-4704588bdb8f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:44.585299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6971355a-d026-4d2e-8802-4704588bdb8f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:44.585734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6971355a-d026-4d2e-8802-4704588bdb8f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:44.689378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6971355a-d026-4d2e-8802-4704588bdb8f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:44.699192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6971355a-d026-4d2e-8802-4704588bdb8f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:44.702242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6971355a-d026-4d2e-8802-4704588bdb8f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:44.703676 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6971355a-d026-4d2e-8802-4704588bdb8f tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.142147 Sep 06 11:06:44.704523 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1785/3583] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:44 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:44.749312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5bf3f757-b0d8-4b78-8f48-fe46c2217b56 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:44.750084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5bf3f757-b0d8-4b78-8f48-fe46c2217b56 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:44.759525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bf3f757-b0d8-4b78-8f48-fe46c2217b56 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:44.760031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bf3f757-b0d8-4b78-8f48-fe46c2217b56 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:44.760513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bf3f757-b0d8-4b78-8f48-fe46c2217b56 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:44.761594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bf3f757-b0d8-4b78-8f48-fe46c2217b56 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:44.762050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bf3f757-b0d8-4b78-8f48-fe46c2217b56 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:44.762530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bf3f757-b0d8-4b78-8f48-fe46c2217b56 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:44.800896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cfc321a0-5280-498a-86fd-7d5123a9702b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:44.811683 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cfc321a0-5280-498a-86fd-7d5123a9702b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1507 microversion: 2.1 time: 0.272327 Sep 06 11:06:44.812428 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1799/3584] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:44 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:44.852918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1942bc84-b395-4464-b2fb-bc6a71e6cd1e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:44.852918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1942bc84-b395-4464-b2fb-bc6a71e6cd1e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:44.859237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1942bc84-b395-4464-b2fb-bc6a71e6cd1e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:44.859939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1942bc84-b395-4464-b2fb-bc6a71e6cd1e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:44.860492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1942bc84-b395-4464-b2fb-bc6a71e6cd1e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:44.861367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1942bc84-b395-4464-b2fb-bc6a71e6cd1e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:44.862070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1942bc84-b395-4464-b2fb-bc6a71e6cd1e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:44.862736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1942bc84-b395-4464-b2fb-bc6a71e6cd1e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:44.951189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5bf3f757-b0d8-4b78-8f48-fe46c2217b56 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:44.960553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5bf3f757-b0d8-4b78-8f48-fe46c2217b56 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:44.962346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5bf3f757-b0d8-4b78-8f48-fe46c2217b56 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:44.967181 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5bf3f757-b0d8-4b78-8f48-fe46c2217b56 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1370 microversion: 2.21 time: 0.224641 Sep 06 11:06:44.967181 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1786/3585] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:44 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:45.052980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1942bc84-b395-4464-b2fb-bc6a71e6cd1e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:45.061512 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1942bc84-b395-4464-b2fb-bc6a71e6cd1e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.214947 Sep 06 11:06:45.062090 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1800/3586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:44 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:45.106092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bd272d24-f1b2-4d36-882d-f5f3cd20fb66 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:45.106629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bd272d24-f1b2-4d36-882d-f5f3cd20fb66 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:45.113739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd272d24-f1b2-4d36-882d-f5f3cd20fb66 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:45.114233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd272d24-f1b2-4d36-882d-f5f3cd20fb66 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:45.114686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd272d24-f1b2-4d36-882d-f5f3cd20fb66 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:45.115421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd272d24-f1b2-4d36-882d-f5f3cd20fb66 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:45.115886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd272d24-f1b2-4d36-882d-f5f3cd20fb66 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:45.116321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd272d24-f1b2-4d36-882d-f5f3cd20fb66 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:45.186158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bd272d24-f1b2-4d36-882d-f5f3cd20fb66 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:45.194291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bd272d24-f1b2-4d36-882d-f5f3cd20fb66 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:45.195762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bd272d24-f1b2-4d36-882d-f5f3cd20fb66 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:45.200825 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bd272d24-f1b2-4d36-882d-f5f3cd20fb66 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.099290 Sep 06 11:06:45.201609 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1787/3587] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:45 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:45.422120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-431aadce-a652-47ce-b684-26dd9822ec17 req-28da98fb-5ff2-45b8-bed1-97aa3a2c95cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03", "tag": "f19d5b9a-8d84-4b51-8a7b-2f2a39e3466e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:45.427444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=24 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:45.432908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-431aadce-a652-47ce-b684-26dd9822ec17 req-28da98fb-5ff2-45b8-bed1-97aa3a2c95cf service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:45.435667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-431aadce-a652-47ce-b684-26dd9822ec17 req-28da98fb-5ff2-45b8-bed1-97aa3a2c95cf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:45.435667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-431aadce-a652-47ce-b684-26dd9822ec17 req-28da98fb-5ff2-45b8-bed1-97aa3a2c95cf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:45.438000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:45.446867 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-431aadce-a652-47ce-b684-26dd9822ec17 req-28da98fb-5ff2-45b8-bed1-97aa3a2c95cf service nova] Creating event network-changed:f19d5b9a-8d84-4b51-8a7b-2f2a39e3466e for instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 on nch1-master-1 Sep 06 11:06:45.451836 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-431aadce-a652-47ce-b684-26dd9822ec17 req-28da98fb-5ff2-45b8-bed1-97aa3a2c95cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033519 Sep 06 11:06:45.452437 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1801/3588] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:06:45.729462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c85ef02e-8a10-487d-befb-4f9ae3b1451a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:45.730082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c85ef02e-8a10-487d-befb-4f9ae3b1451a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:45.736251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c85ef02e-8a10-487d-befb-4f9ae3b1451a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:45.736733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c85ef02e-8a10-487d-befb-4f9ae3b1451a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:45.737185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c85ef02e-8a10-487d-befb-4f9ae3b1451a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:45.738062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c85ef02e-8a10-487d-befb-4f9ae3b1451a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:45.738553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c85ef02e-8a10-487d-befb-4f9ae3b1451a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:45.742176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c85ef02e-8a10-487d-befb-4f9ae3b1451a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:45.804742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c85ef02e-8a10-487d-befb-4f9ae3b1451a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:45.813129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c85ef02e-8a10-487d-befb-4f9ae3b1451a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:45.814667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c85ef02e-8a10-487d-befb-4f9ae3b1451a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:45.815891 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c85ef02e-8a10-487d-befb-4f9ae3b1451a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.090489 Sep 06 11:06:45.816448 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1788/3589] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:45 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:45.838271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca7b21ee-63f5-4fe8-aae3-82da8d3e915a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:45.839723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca7b21ee-63f5-4fe8-aae3-82da8d3e915a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:45.846540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca7b21ee-63f5-4fe8-aae3-82da8d3e915a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:45.847058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca7b21ee-63f5-4fe8-aae3-82da8d3e915a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:45.847536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca7b21ee-63f5-4fe8-aae3-82da8d3e915a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:45.848273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca7b21ee-63f5-4fe8-aae3-82da8d3e915a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:45.848731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca7b21ee-63f5-4fe8-aae3-82da8d3e915a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:45.849171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca7b21ee-63f5-4fe8-aae3-82da8d3e915a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:45.990661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b6803ea7-3b52-4249-86c2-b94714876e55 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:45.991312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b6803ea7-3b52-4249-86c2-b94714876e55 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:45.998190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6803ea7-3b52-4249-86c2-b94714876e55 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:45.998944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6803ea7-3b52-4249-86c2-b94714876e55 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:45.999497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6803ea7-3b52-4249-86c2-b94714876e55 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:46.000290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6803ea7-3b52-4249-86c2-b94714876e55 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:46.000768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6803ea7-3b52-4249-86c2-b94714876e55 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:46.001217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6803ea7-3b52-4249-86c2-b94714876e55 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:46.009025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ca7b21ee-63f5-4fe8-aae3-82da8d3e915a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:46.020951 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ca7b21ee-63f5-4fe8-aae3-82da8d3e915a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1487 microversion: 2.1 time: 0.190025 Sep 06 11:06:46.035035 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1802/3590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:45 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1487 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:46.045472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9a0c5e34-4822-4787-9b00-4c266e2bf9b6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:46.046037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9a0c5e34-4822-4787-9b00-4c266e2bf9b6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:46.052371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a0c5e34-4822-4787-9b00-4c266e2bf9b6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:46.052871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a0c5e34-4822-4787-9b00-4c266e2bf9b6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:46.057207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a0c5e34-4822-4787-9b00-4c266e2bf9b6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:46.057207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a0c5e34-4822-4787-9b00-4c266e2bf9b6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:46.057207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a0c5e34-4822-4787-9b00-4c266e2bf9b6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:46.057207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a0c5e34-4822-4787-9b00-4c266e2bf9b6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:46.085377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-9a0c5e34-4822-4787-9b00-4c266e2bf9b6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'flavor' on Instance uuid 79338947-1b4d-41ad-a75d-6f1141500c45 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:06:46.211868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b6803ea7-3b52-4249-86c2-b94714876e55 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:46.221223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b6803ea7-3b52-4249-86c2-b94714876e55 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:46.224669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b6803ea7-3b52-4249-86c2-b94714876e55 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:46.224669 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b6803ea7-3b52-4249-86c2-b94714876e55 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1358 microversion: 2.21 time: 0.238720 Sep 06 11:06:46.225805 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1789/3591] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:45 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:46.231405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f2beef6d-e2bb-456a-b73d-8c5b7dda6e57 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:46.232497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f2beef6d-e2bb-456a-b73d-8c5b7dda6e57 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:46.239102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2beef6d-e2bb-456a-b73d-8c5b7dda6e57 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:46.239923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2beef6d-e2bb-456a-b73d-8c5b7dda6e57 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:46.240653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2beef6d-e2bb-456a-b73d-8c5b7dda6e57 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:46.241656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2beef6d-e2bb-456a-b73d-8c5b7dda6e57 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:46.242538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2beef6d-e2bb-456a-b73d-8c5b7dda6e57 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:46.243252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2beef6d-e2bb-456a-b73d-8c5b7dda6e57 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:46.406590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f2beef6d-e2bb-456a-b73d-8c5b7dda6e57 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:46.414683 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f2beef6d-e2bb-456a-b73d-8c5b7dda6e57 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.187470 Sep 06 11:06:46.415291 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1790/3592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:46 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:46.421197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c3ddd9db-7670-4d2f-8fa8-1fe5b1ab9d3d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:46.421817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c3ddd9db-7670-4d2f-8fa8-1fe5b1ab9d3d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:46.434603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3ddd9db-7670-4d2f-8fa8-1fe5b1ab9d3d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:46.435374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3ddd9db-7670-4d2f-8fa8-1fe5b1ab9d3d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:46.442374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3ddd9db-7670-4d2f-8fa8-1fe5b1ab9d3d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:46.442374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3ddd9db-7670-4d2f-8fa8-1fe5b1ab9d3d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:46.442374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3ddd9db-7670-4d2f-8fa8-1fe5b1ab9d3d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:46.442374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3ddd9db-7670-4d2f-8fa8-1fe5b1ab9d3d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:46.524747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c3ddd9db-7670-4d2f-8fa8-1fe5b1ab9d3d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:46.536287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c3ddd9db-7670-4d2f-8fa8-1fe5b1ab9d3d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:46.537784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c3ddd9db-7670-4d2f-8fa8-1fe5b1ab9d3d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:46.550330 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c3ddd9db-7670-4d2f-8fa8-1fe5b1ab9d3d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.134029 Sep 06 11:06:46.550910 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1791/3593] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:46 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:46.694016 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9a0c5e34-4822-4787-9b00-4c266e2bf9b6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45/action" status: 202 len: 0 microversion: 2.1 time: 0.652154 Sep 06 11:06:46.694606 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1803/3594] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:06:46 2022] POST /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:06:46.703162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f45e84d-1d0c-473e-b913-ba23a7feb6e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:46.703942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7f45e84d-1d0c-473e-b913-ba23a7feb6e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:46.711130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f45e84d-1d0c-473e-b913-ba23a7feb6e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:46.711783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f45e84d-1d0c-473e-b913-ba23a7feb6e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:46.712463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f45e84d-1d0c-473e-b913-ba23a7feb6e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:46.713276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f45e84d-1d0c-473e-b913-ba23a7feb6e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:46.714316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f45e84d-1d0c-473e-b913-ba23a7feb6e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:46.714761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f45e84d-1d0c-473e-b913-ba23a7feb6e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:46.845250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-457404bc-e565-452e-acf5-a7d3b9780361 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:46.845971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-457404bc-e565-452e-acf5-a7d3b9780361 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:46.849169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:46.853991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f45e84d-1d0c-473e-b913-ba23a7feb6e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:46.856902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-457404bc-e565-452e-acf5-a7d3b9780361 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:46.857415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-457404bc-e565-452e-acf5-a7d3b9780361 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:46.857876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-457404bc-e565-452e-acf5-a7d3b9780361 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:46.858600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-457404bc-e565-452e-acf5-a7d3b9780361 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:46.859215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-457404bc-e565-452e-acf5-a7d3b9780361 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:46.859666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-457404bc-e565-452e-acf5-a7d3b9780361 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:46.862472 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7f45e84d-1d0c-473e-b913-ba23a7feb6e8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1493 microversion: 2.1 time: 0.163352 Sep 06 11:06:46.863412 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1792/3595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:46 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1493 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:46.930528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-457404bc-e565-452e-acf5-a7d3b9780361 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:46.939190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-457404bc-e565-452e-acf5-a7d3b9780361 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:46.940713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-457404bc-e565-452e-acf5-a7d3b9780361 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:46.941889 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-457404bc-e565-452e-acf5-a7d3b9780361 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.101879 Sep 06 11:06:46.942457 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1804/3596] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:46 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:47.251306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5e038ce-6cb3-4e58-a242-c81d5c3e5716 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:47.251856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a5e038ce-6cb3-4e58-a242-c81d5c3e5716 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:47.258684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5e038ce-6cb3-4e58-a242-c81d5c3e5716 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:47.259364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5e038ce-6cb3-4e58-a242-c81d5c3e5716 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:47.259694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5e038ce-6cb3-4e58-a242-c81d5c3e5716 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:47.260401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5e038ce-6cb3-4e58-a242-c81d5c3e5716 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:47.260867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5e038ce-6cb3-4e58-a242-c81d5c3e5716 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:47.261297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5e038ce-6cb3-4e58-a242-c81d5c3e5716 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:47.407775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a5e038ce-6cb3-4e58-a242-c81d5c3e5716 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:47.416124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a5e038ce-6cb3-4e58-a242-c81d5c3e5716 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:47.418313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a5e038ce-6cb3-4e58-a242-c81d5c3e5716 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:47.419487 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a5e038ce-6cb3-4e58-a242-c81d5c3e5716 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1358 microversion: 2.21 time: 0.172219 Sep 06 11:06:47.420045 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1793/3597] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:47 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:47.444011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-144fbde8-0221-4921-a5ee-cf788bb5c73c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:47.444656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-144fbde8-0221-4921-a5ee-cf788bb5c73c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:47.450565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-144fbde8-0221-4921-a5ee-cf788bb5c73c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:47.451191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-144fbde8-0221-4921-a5ee-cf788bb5c73c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:47.451524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-144fbde8-0221-4921-a5ee-cf788bb5c73c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:47.452224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-144fbde8-0221-4921-a5ee-cf788bb5c73c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:47.452705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-144fbde8-0221-4921-a5ee-cf788bb5c73c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:47.453132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-144fbde8-0221-4921-a5ee-cf788bb5c73c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:47.578684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1942336a-343f-4081-b224-db78dd96af75 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:47.579615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1942336a-343f-4081-b224-db78dd96af75 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:47.585962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1942336a-343f-4081-b224-db78dd96af75 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:47.586470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1942336a-343f-4081-b224-db78dd96af75 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:47.586924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1942336a-343f-4081-b224-db78dd96af75 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:47.587340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-144fbde8-0221-4921-a5ee-cf788bb5c73c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:47.587661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1942336a-343f-4081-b224-db78dd96af75 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:47.588358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1942336a-343f-4081-b224-db78dd96af75 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:47.589041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1942336a-343f-4081-b224-db78dd96af75 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:47.597590 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-144fbde8-0221-4921-a5ee-cf788bb5c73c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.157462 Sep 06 11:06:47.598167 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1805/3598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:47 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:47.658679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1942336a-343f-4081-b224-db78dd96af75 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:47.667370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1942336a-343f-4081-b224-db78dd96af75 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:47.669486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1942336a-343f-4081-b224-db78dd96af75 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:47.674644 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1942336a-343f-4081-b224-db78dd96af75 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.100809 Sep 06 11:06:47.675289 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1794/3599] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:47 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:47.886155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bdffc971-564b-4173-8210-295ce4d14872 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:47.887411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bdffc971-564b-4173-8210-295ce4d14872 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:47.900867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdffc971-564b-4173-8210-295ce4d14872 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:47.902881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdffc971-564b-4173-8210-295ce4d14872 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:47.902881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdffc971-564b-4173-8210-295ce4d14872 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:47.903353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdffc971-564b-4173-8210-295ce4d14872 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:47.903826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdffc971-564b-4173-8210-295ce4d14872 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:47.904273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdffc971-564b-4173-8210-295ce4d14872 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:47.967297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dc30ff4e-44a4-4875-bdb8-2ab5fdcbe3d9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:47.967935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dc30ff4e-44a4-4875-bdb8-2ab5fdcbe3d9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:47.974814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc30ff4e-44a4-4875-bdb8-2ab5fdcbe3d9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:47.981125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc30ff4e-44a4-4875-bdb8-2ab5fdcbe3d9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:47.981125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc30ff4e-44a4-4875-bdb8-2ab5fdcbe3d9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:47.981125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc30ff4e-44a4-4875-bdb8-2ab5fdcbe3d9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:47.981125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc30ff4e-44a4-4875-bdb8-2ab5fdcbe3d9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:47.981125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc30ff4e-44a4-4875-bdb8-2ab5fdcbe3d9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:47.982323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:48.050059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dc30ff4e-44a4-4875-bdb8-2ab5fdcbe3d9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:48.058978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dc30ff4e-44a4-4875-bdb8-2ab5fdcbe3d9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:48.060943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dc30ff4e-44a4-4875-bdb8-2ab5fdcbe3d9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:48.062157 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dc30ff4e-44a4-4875-bdb8-2ab5fdcbe3d9 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.099149 Sep 06 11:06:48.062713 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1795/3600] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:47 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:48.078836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bdffc971-564b-4173-8210-295ce4d14872 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:48.088899 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bdffc971-564b-4173-8210-295ce4d14872 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1493 microversion: 2.1 time: 0.206901 Sep 06 11:06:48.090049 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1806/3601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:47 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1493 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:48.444548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7e9e9875-9c8d-464b-b2f4-ad6c243eb31e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:48.445172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7e9e9875-9c8d-464b-b2f4-ad6c243eb31e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:48.453199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e9e9875-9c8d-464b-b2f4-ad6c243eb31e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:48.453697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e9e9875-9c8d-464b-b2f4-ad6c243eb31e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:48.454152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e9e9875-9c8d-464b-b2f4-ad6c243eb31e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:48.456330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e9e9875-9c8d-464b-b2f4-ad6c243eb31e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:48.456330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e9e9875-9c8d-464b-b2f4-ad6c243eb31e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:48.456330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e9e9875-9c8d-464b-b2f4-ad6c243eb31e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:48.584461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7e9e9875-9c8d-464b-b2f4-ad6c243eb31e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:48.592795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7e9e9875-9c8d-464b-b2f4-ad6c243eb31e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:48.594274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7e9e9875-9c8d-464b-b2f4-ad6c243eb31e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:48.595433 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7e9e9875-9c8d-464b-b2f4-ad6c243eb31e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1358 microversion: 2.21 time: 0.154873 Sep 06 11:06:48.596010 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1796/3602] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:48 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:48.621510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-210cbc35-9cfc-421f-b150-c843ec02f414 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:48.622144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-210cbc35-9cfc-421f-b150-c843ec02f414 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:48.628189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-210cbc35-9cfc-421f-b150-c843ec02f414 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:48.628693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-210cbc35-9cfc-421f-b150-c843ec02f414 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:48.629209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-210cbc35-9cfc-421f-b150-c843ec02f414 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:48.629914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-210cbc35-9cfc-421f-b150-c843ec02f414 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:48.630384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-210cbc35-9cfc-421f-b150-c843ec02f414 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:48.630825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-210cbc35-9cfc-421f-b150-c843ec02f414 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:48.702303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9039541c-99fd-4c9c-8946-e02df9ff38d9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:48.703263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9039541c-99fd-4c9c-8946-e02df9ff38d9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:48.709347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9039541c-99fd-4c9c-8946-e02df9ff38d9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:48.710050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9039541c-99fd-4c9c-8946-e02df9ff38d9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:48.710445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9039541c-99fd-4c9c-8946-e02df9ff38d9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:48.711280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9039541c-99fd-4c9c-8946-e02df9ff38d9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:48.711823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9039541c-99fd-4c9c-8946-e02df9ff38d9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:48.712336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9039541c-99fd-4c9c-8946-e02df9ff38d9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:48.787941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9039541c-99fd-4c9c-8946-e02df9ff38d9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:48.793205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-210cbc35-9cfc-421f-b150-c843ec02f414 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:48.796750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9039541c-99fd-4c9c-8946-e02df9ff38d9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:48.798218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9039541c-99fd-4c9c-8946-e02df9ff38d9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:48.801179 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-210cbc35-9cfc-421f-b150-c843ec02f414 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.184263 Sep 06 11:06:48.801763 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1807/3603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:48 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:48.803309 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9039541c-99fd-4c9c-8946-e02df9ff38d9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1531 microversion: 2.91 time: 0.104963 Sep 06 11:06:48.804033 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1797/3604] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:48 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1531 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:48.830533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-571c52a1-6c03-4949-ba04-c3b78756adcf tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:48.831177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-571c52a1-6c03-4949-ba04-c3b78756adcf tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:48.837177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-571c52a1-6c03-4949-ba04-c3b78756adcf tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:48.837670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-571c52a1-6c03-4949-ba04-c3b78756adcf tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:48.838126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-571c52a1-6c03-4949-ba04-c3b78756adcf tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:48.838824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-571c52a1-6c03-4949-ba04-c3b78756adcf tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:48.839326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-571c52a1-6c03-4949-ba04-c3b78756adcf tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:48.840280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-571c52a1-6c03-4949-ba04-c3b78756adcf tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:48.914220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-571c52a1-6c03-4949-ba04-c3b78756adcf tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lazy-loading 'services' on Instance uuid 16d64eaf-0686-4d18-8b21-1eb52f4cda77 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:06:48.933132 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-571c52a1-6c03-4949-ba04-c3b78756adcf tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1936 microversion: 2.91 time: 0.106202 Sep 06 11:06:48.939211 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1808/3605] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:48 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1936 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:48.960699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0583f090-fcff-4a85-bccb-52f9bfae208d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:48.961257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0583f090-fcff-4a85-bccb-52f9bfae208d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:48.968337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0583f090-fcff-4a85-bccb-52f9bfae208d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:48.968949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0583f090-fcff-4a85-bccb-52f9bfae208d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:48.969278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0583f090-fcff-4a85-bccb-52f9bfae208d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:48.969985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0583f090-fcff-4a85-bccb-52f9bfae208d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:48.970458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0583f090-fcff-4a85-bccb-52f9bfae208d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:48.970898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0583f090-fcff-4a85-bccb-52f9bfae208d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:48.994738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-0583f090-fcff-4a85-bccb-52f9bfae208d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lazy-loading 'flavor' on Instance uuid 16d64eaf-0686-4d18-8b21-1eb52f4cda77 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:06:49.090373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ab1e9f0-7cc0-4932-ae37-a9fcf5f8e067 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:49.090994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ab1e9f0-7cc0-4932-ae37-a9fcf5f8e067 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:49.097248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ab1e9f0-7cc0-4932-ae37-a9fcf5f8e067 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:49.098493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ab1e9f0-7cc0-4932-ae37-a9fcf5f8e067 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:49.098493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ab1e9f0-7cc0-4932-ae37-a9fcf5f8e067 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:49.098856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ab1e9f0-7cc0-4932-ae37-a9fcf5f8e067 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:49.099345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ab1e9f0-7cc0-4932-ae37-a9fcf5f8e067 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:49.099782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ab1e9f0-7cc0-4932-ae37-a9fcf5f8e067 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:49.167403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ab1e9f0-7cc0-4932-ae37-a9fcf5f8e067 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:49.176356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ab1e9f0-7cc0-4932-ae37-a9fcf5f8e067 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:49.177999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ab1e9f0-7cc0-4932-ae37-a9fcf5f8e067 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:49.179204 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ab1e9f0-7cc0-4932-ae37-a9fcf5f8e067 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.093379 Sep 06 11:06:49.179785 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1809/3606] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:49 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:49.184173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ae811e3f-0887-44db-a9d6-b4e4acee4e46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:49.184778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ae811e3f-0887-44db-a9d6-b4e4acee4e46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:49.190536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae811e3f-0887-44db-a9d6-b4e4acee4e46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:49.191049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae811e3f-0887-44db-a9d6-b4e4acee4e46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:49.191501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae811e3f-0887-44db-a9d6-b4e4acee4e46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:49.192192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae811e3f-0887-44db-a9d6-b4e4acee4e46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:49.192653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae811e3f-0887-44db-a9d6-b4e4acee4e46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:49.193085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae811e3f-0887-44db-a9d6-b4e4acee4e46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:49.324942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ae811e3f-0887-44db-a9d6-b4e4acee4e46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:49.335394 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ae811e3f-0887-44db-a9d6-b4e4acee4e46 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1514 microversion: 2.1 time: 0.154540 Sep 06 11:06:49.351395 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1810/3607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:49 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:49.472988 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0583f090-fcff-4a85-bccb-52f9bfae208d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "POST /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77/action" status: 202 len: 0 microversion: 2.91 time: 0.516122 Sep 06 11:06:49.473641 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1798/3608] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:06:48 2022] POST /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:06:49.482261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-256af17e-846f-4b2c-92ed-df201d0ce771 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:49.488210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-256af17e-846f-4b2c-92ed-df201d0ce771 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:49.489701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-256af17e-846f-4b2c-92ed-df201d0ce771 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:49.490195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-256af17e-846f-4b2c-92ed-df201d0ce771 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:49.490637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-256af17e-846f-4b2c-92ed-df201d0ce771 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:49.491371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-256af17e-846f-4b2c-92ed-df201d0ce771 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:49.491828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-256af17e-846f-4b2c-92ed-df201d0ce771 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:49.492254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-256af17e-846f-4b2c-92ed-df201d0ce771 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:49.557289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-256af17e-846f-4b2c-92ed-df201d0ce771 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:49.565606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-256af17e-846f-4b2c-92ed-df201d0ce771 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:49.567398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-256af17e-846f-4b2c-92ed-df201d0ce771 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:49.572303 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-256af17e-846f-4b2c-92ed-df201d0ce771 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.094336 Sep 06 11:06:49.572959 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1811/3609] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:49 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:49.622443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ce9c8297-f8ec-4608-8bfe-d51124307b88 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:49.623277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ce9c8297-f8ec-4608-8bfe-d51124307b88 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:49.634672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce9c8297-f8ec-4608-8bfe-d51124307b88 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:49.635284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce9c8297-f8ec-4608-8bfe-d51124307b88 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:49.635812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce9c8297-f8ec-4608-8bfe-d51124307b88 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:49.637093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce9c8297-f8ec-4608-8bfe-d51124307b88 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:49.637560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce9c8297-f8ec-4608-8bfe-d51124307b88 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:49.637991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce9c8297-f8ec-4608-8bfe-d51124307b88 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:49.778871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce9c8297-f8ec-4608-8bfe-d51124307b88 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:49.787171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce9c8297-f8ec-4608-8bfe-d51124307b88 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:49.790216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce9c8297-f8ec-4608-8bfe-d51124307b88 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:49.790216 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ce9c8297-f8ec-4608-8bfe-d51124307b88 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1358 microversion: 2.21 time: 0.172522 Sep 06 11:06:49.790444 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1799/3610] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:49 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:49.825195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6e1ec6ec-1cfa-4981-8041-59accc2c5803 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:49.825809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6e1ec6ec-1cfa-4981-8041-59accc2c5803 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:49.832106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e1ec6ec-1cfa-4981-8041-59accc2c5803 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:49.832591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e1ec6ec-1cfa-4981-8041-59accc2c5803 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:49.833035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e1ec6ec-1cfa-4981-8041-59accc2c5803 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:49.833728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e1ec6ec-1cfa-4981-8041-59accc2c5803 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:49.834213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e1ec6ec-1cfa-4981-8041-59accc2c5803 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:49.836206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e1ec6ec-1cfa-4981-8041-59accc2c5803 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:49.967758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6e1ec6ec-1cfa-4981-8041-59accc2c5803 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:49.975814 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6e1ec6ec-1cfa-4981-8041-59accc2c5803 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.155131 Sep 06 11:06:49.976393 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1812/3611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:49 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:50.205419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-89c78a9e-8e46-40a9-98df-260eddbb70bf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:50.206033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-89c78a9e-8e46-40a9-98df-260eddbb70bf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:50.209628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:50.213136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89c78a9e-8e46-40a9-98df-260eddbb70bf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:50.213623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89c78a9e-8e46-40a9-98df-260eddbb70bf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:50.214064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89c78a9e-8e46-40a9-98df-260eddbb70bf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:50.214769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89c78a9e-8e46-40a9-98df-260eddbb70bf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:50.215319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89c78a9e-8e46-40a9-98df-260eddbb70bf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:50.215703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89c78a9e-8e46-40a9-98df-260eddbb70bf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:50.279517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-89c78a9e-8e46-40a9-98df-260eddbb70bf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:50.287999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-89c78a9e-8e46-40a9-98df-260eddbb70bf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:50.289470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-89c78a9e-8e46-40a9-98df-260eddbb70bf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:50.290645 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-89c78a9e-8e46-40a9-98df-260eddbb70bf tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.089232 Sep 06 11:06:50.291255 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1800/3612] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:50 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:50.363978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bac2b14f-8ecd-4bbf-a7de-cbde2aa4c63c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:50.364599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bac2b14f-8ecd-4bbf-a7de-cbde2aa4c63c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:50.370788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bac2b14f-8ecd-4bbf-a7de-cbde2aa4c63c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:50.371329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bac2b14f-8ecd-4bbf-a7de-cbde2aa4c63c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:50.371782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bac2b14f-8ecd-4bbf-a7de-cbde2aa4c63c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:50.372536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bac2b14f-8ecd-4bbf-a7de-cbde2aa4c63c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:50.373034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bac2b14f-8ecd-4bbf-a7de-cbde2aa4c63c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:50.373657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bac2b14f-8ecd-4bbf-a7de-cbde2aa4c63c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:50.509287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bac2b14f-8ecd-4bbf-a7de-cbde2aa4c63c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:50.517508 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bac2b14f-8ecd-4bbf-a7de-cbde2aa4c63c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1514 microversion: 2.1 time: 0.157588 Sep 06 11:06:50.518092 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1813/3613] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:50 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:50.602426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9cb4d5a9-e15d-4a54-8996-959af9e72dfe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:50.603055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9cb4d5a9-e15d-4a54-8996-959af9e72dfe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:50.610324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cb4d5a9-e15d-4a54-8996-959af9e72dfe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:50.610811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cb4d5a9-e15d-4a54-8996-959af9e72dfe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:50.611283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cb4d5a9-e15d-4a54-8996-959af9e72dfe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:50.611974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cb4d5a9-e15d-4a54-8996-959af9e72dfe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:50.612440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cb4d5a9-e15d-4a54-8996-959af9e72dfe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:50.612866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cb4d5a9-e15d-4a54-8996-959af9e72dfe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:50.677200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9cb4d5a9-e15d-4a54-8996-959af9e72dfe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:50.685370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9cb4d5a9-e15d-4a54-8996-959af9e72dfe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:50.686873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9cb4d5a9-e15d-4a54-8996-959af9e72dfe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:50.691681 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9cb4d5a9-e15d-4a54-8996-959af9e72dfe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.094035 Sep 06 11:06:50.692250 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1801/3614] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:50 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:50.814540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-797e89f5-9f37-4769-9657-1ee67b34de6c tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:50.815248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-797e89f5-9f37-4769-9657-1ee67b34de6c tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:50.821349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-797e89f5-9f37-4769-9657-1ee67b34de6c tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:50.821840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-797e89f5-9f37-4769-9657-1ee67b34de6c tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:50.822286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-797e89f5-9f37-4769-9657-1ee67b34de6c tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:50.822984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-797e89f5-9f37-4769-9657-1ee67b34de6c tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:50.823473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-797e89f5-9f37-4769-9657-1ee67b34de6c tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:50.824443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-797e89f5-9f37-4769-9657-1ee67b34de6c tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:50.957127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-797e89f5-9f37-4769-9657-1ee67b34de6c tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:50.965947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-797e89f5-9f37-4769-9657-1ee67b34de6c tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:50.967534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-797e89f5-9f37-4769-9657-1ee67b34de6c tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:50.968639 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-797e89f5-9f37-4769-9657-1ee67b34de6c tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1358 microversion: 2.21 time: 0.158121 Sep 06 11:06:50.969214 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1814/3615] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:50 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:51.000517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c7015a16-a4ea-45ee-828c-c8220d31e721 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:51.001099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c7015a16-a4ea-45ee-828c-c8220d31e721 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:51.007828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7015a16-a4ea-45ee-828c-c8220d31e721 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:51.012424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7015a16-a4ea-45ee-828c-c8220d31e721 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:51.012424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7015a16-a4ea-45ee-828c-c8220d31e721 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:51.012424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7015a16-a4ea-45ee-828c-c8220d31e721 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:51.012424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7015a16-a4ea-45ee-828c-c8220d31e721 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:51.012424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7015a16-a4ea-45ee-828c-c8220d31e721 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:51.144534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c7015a16-a4ea-45ee-828c-c8220d31e721 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:51.153058 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c7015a16-a4ea-45ee-828c-c8220d31e721 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1504 microversion: 2.1 time: 0.157205 Sep 06 11:06:51.153619 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1802/3616] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:50 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:51.321375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-06749975-0d8b-42b3-b166-765d8529c58d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:51.321375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-06749975-0d8b-42b3-b166-765d8529c58d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:51.326325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06749975-0d8b-42b3-b166-765d8529c58d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:51.326824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06749975-0d8b-42b3-b166-765d8529c58d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:51.327356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06749975-0d8b-42b3-b166-765d8529c58d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:51.328564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06749975-0d8b-42b3-b166-765d8529c58d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:51.329045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06749975-0d8b-42b3-b166-765d8529c58d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:51.329528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06749975-0d8b-42b3-b166-765d8529c58d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:51.399456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-06749975-0d8b-42b3-b166-765d8529c58d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:51.409191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-06749975-0d8b-42b3-b166-765d8529c58d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:51.412599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-06749975-0d8b-42b3-b166-765d8529c58d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:51.412599 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-06749975-0d8b-42b3-b166-765d8529c58d tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.098206 Sep 06 11:06:51.412968 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1815/3617] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:51 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:51.541638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f4308543-df00-47a8-8ace-5fe8196f56aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:51.542902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f4308543-df00-47a8-8ace-5fe8196f56aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:51.550188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4308543-df00-47a8-8ace-5fe8196f56aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:51.550917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4308543-df00-47a8-8ace-5fe8196f56aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:51.551524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4308543-df00-47a8-8ace-5fe8196f56aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:51.552300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4308543-df00-47a8-8ace-5fe8196f56aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:51.552750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4308543-df00-47a8-8ace-5fe8196f56aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:51.553188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4308543-df00-47a8-8ace-5fe8196f56aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:51.710257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-bc64a27c-df3e-4d0e-83d8-85b4ebd02093 req-73776814-c8d2-42f9-99e1-4d297d717d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03", "name": "network-vif-plugged", "status": "completed", "tag": "f19d5b9a-8d84-4b51-8a7b-2f2a39e3466e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:51.725577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f4308543-df00-47a8-8ace-5fe8196f56aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:51.729663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bc64a27c-df3e-4d0e-83d8-85b4ebd02093 req-73776814-c8d2-42f9-99e1-4d297d717d06 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:51.730200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bc64a27c-df3e-4d0e-83d8-85b4ebd02093 req-73776814-c8d2-42f9-99e1-4d297d717d06 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:51.730649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bc64a27c-df3e-4d0e-83d8-85b4ebd02093 req-73776814-c8d2-42f9-99e1-4d297d717d06 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:51.734717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:51.735134 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f4308543-df00-47a8-8ace-5fe8196f56aa tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1509 microversion: 2.1 time: 0.197739 Sep 06 11:06:51.736251 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1803/3618] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:51 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:51.742235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-56f5da29-02e8-4b00-b084-8298883fc730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:51.751447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-56f5da29-02e8-4b00-b084-8298883fc730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:51.751447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56f5da29-02e8-4b00-b084-8298883fc730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:51.751447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56f5da29-02e8-4b00-b084-8298883fc730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:51.751447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56f5da29-02e8-4b00-b084-8298883fc730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:51.752320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56f5da29-02e8-4b00-b084-8298883fc730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:51.753014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56f5da29-02e8-4b00-b084-8298883fc730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:51.753595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56f5da29-02e8-4b00-b084-8298883fc730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:51.756510 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-bc64a27c-df3e-4d0e-83d8-85b4ebd02093 req-73776814-c8d2-42f9-99e1-4d297d717d06 service nova] Creating event network-vif-plugged:f19d5b9a-8d84-4b51-8a7b-2f2a39e3466e for instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 on nch1-master-1 Sep 06 11:06:51.773383 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-bc64a27c-df3e-4d0e-83d8-85b4ebd02093 req-73776814-c8d2-42f9-99e1-4d297d717d06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066838 Sep 06 11:06:51.775731 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1816/3619] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:06:51.905153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-56f5da29-02e8-4b00-b084-8298883fc730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:51.918691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-56f5da29-02e8-4b00-b084-8298883fc730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:51.919738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-56f5da29-02e8-4b00-b084-8298883fc730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:51.925448 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-56f5da29-02e8-4b00-b084-8298883fc730 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.187927 Sep 06 11:06:51.926216 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1804/3620] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:51 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:51.994544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-101eb576-fbe3-456c-a89a-58a04b5d75dc tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:51.995360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-101eb576-fbe3-456c-a89a-58a04b5d75dc tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:52.004460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-101eb576-fbe3-456c-a89a-58a04b5d75dc tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:52.004925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-101eb576-fbe3-456c-a89a-58a04b5d75dc tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:52.005383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-101eb576-fbe3-456c-a89a-58a04b5d75dc tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:52.006197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-101eb576-fbe3-456c-a89a-58a04b5d75dc tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:52.006820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-101eb576-fbe3-456c-a89a-58a04b5d75dc tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:52.008383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-101eb576-fbe3-456c-a89a-58a04b5d75dc tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:52.152950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-101eb576-fbe3-456c-a89a-58a04b5d75dc tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:52.161080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-101eb576-fbe3-456c-a89a-58a04b5d75dc tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:52.162558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-101eb576-fbe3-456c-a89a-58a04b5d75dc tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:52.163725 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-101eb576-fbe3-456c-a89a-58a04b5d75dc tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1358 microversion: 2.21 time: 0.173515 Sep 06 11:06:52.164304 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1817/3621] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:51 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:52.178488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9ec81141-e02d-4b10-9e4e-b8ab0e28a41b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:52.179139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9ec81141-e02d-4b10-9e4e-b8ab0e28a41b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:52.185451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec81141-e02d-4b10-9e4e-b8ab0e28a41b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:52.185961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec81141-e02d-4b10-9e4e-b8ab0e28a41b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:52.186413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec81141-e02d-4b10-9e4e-b8ab0e28a41b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:52.187211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec81141-e02d-4b10-9e4e-b8ab0e28a41b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:52.187685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec81141-e02d-4b10-9e4e-b8ab0e28a41b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:52.188171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec81141-e02d-4b10-9e4e-b8ab0e28a41b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:52.329906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9ec81141-e02d-4b10-9e4e-b8ab0e28a41b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:52.339176 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9ec81141-e02d-4b10-9e4e-b8ab0e28a41b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1484 microversion: 2.1 time: 0.165185 Sep 06 11:06:52.351528 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1805/3622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:52 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1484 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:52.439951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9a25a1bb-74ab-45df-9092-c1206831d8f6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:52.441353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9a25a1bb-74ab-45df-9092-c1206831d8f6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:52.451356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a25a1bb-74ab-45df-9092-c1206831d8f6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:52.451723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a25a1bb-74ab-45df-9092-c1206831d8f6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:52.452157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a25a1bb-74ab-45df-9092-c1206831d8f6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:52.453190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a25a1bb-74ab-45df-9092-c1206831d8f6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:52.453770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a25a1bb-74ab-45df-9092-c1206831d8f6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:52.454303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a25a1bb-74ab-45df-9092-c1206831d8f6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:52.493025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1867202810", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:52.540539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9a25a1bb-74ab-45df-9092-c1206831d8f6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:52.549677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9a25a1bb-74ab-45df-9092-c1206831d8f6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:52.552186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9a25a1bb-74ab-45df-9092-c1206831d8f6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:52.553586 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9a25a1bb-74ab-45df-9092-c1206831d8f6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.119453 Sep 06 11:06:52.556617 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1818/3623] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:52 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:52.570176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] validate_networks() for [('5ef98845-35d1-45af-b58f-dd2a8d99588e', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:06:52.760543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f5ac14e8-cdcb-4e4a-80ea-3b4602691e4c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:52.762031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f5ac14e8-cdcb-4e4a-80ea-3b4602691e4c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:52.769319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5ac14e8-cdcb-4e4a-80ea-3b4602691e4c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:52.770049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5ac14e8-cdcb-4e4a-80ea-3b4602691e4c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:52.770670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5ac14e8-cdcb-4e4a-80ea-3b4602691e4c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:52.771567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5ac14e8-cdcb-4e4a-80ea-3b4602691e4c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:52.772246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5ac14e8-cdcb-4e4a-80ea-3b4602691e4c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:52.773137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5ac14e8-cdcb-4e4a-80ea-3b4602691e4c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:53.049128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f5ac14e8-cdcb-4e4a-80ea-3b4602691e4c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:53.062450 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f5ac14e8-cdcb-4e4a-80ea-3b4602691e4c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1509 microversion: 2.1 time: 0.302878 Sep 06 11:06:53.064174 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1819/3624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:52 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1509 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:53.069776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d1b43419-89e2-4efa-82fe-c38e3bdfaaa2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:53.070594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d1b43419-89e2-4efa-82fe-c38e3bdfaaa2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:53.077673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1b43419-89e2-4efa-82fe-c38e3bdfaaa2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:53.078492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1b43419-89e2-4efa-82fe-c38e3bdfaaa2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:53.079521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1b43419-89e2-4efa-82fe-c38e3bdfaaa2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:53.080512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1b43419-89e2-4efa-82fe-c38e3bdfaaa2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:53.081727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1b43419-89e2-4efa-82fe-c38e3bdfaaa2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:53.082215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1b43419-89e2-4efa-82fe-c38e3bdfaaa2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:53.176329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:06:53.177045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:06:53.177706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:06:53.178366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:06:53.178964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:06:53.191823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:53.192515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:53.193165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:53.193866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d1b43419-89e2-4efa-82fe-c38e3bdfaaa2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:53.194315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:53.194975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:53.195608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:53.215480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Getting quotas for project 3bce0861528a4891b94d174e964456f0. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:06:53.217423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d1b43419-89e2-4efa-82fe-c38e3bdfaaa2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:53.219478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d1b43419-89e2-4efa-82fe-c38e3bdfaaa2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:53.221387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Getting quotas for user e94103c4c75b4f2d8b2cb1bd4b6bcf6a and project 3bce0861528a4891b94d174e964456f0. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:06:53.226064 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d1b43419-89e2-4efa-82fe-c38e3bdfaaa2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.160542 Sep 06 11:06:53.235788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:06:53.238611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:06:53.240141 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1820/3625] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:53 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:53.253975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56a2b2c5-d727-4ed7-9000-3426821f630e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:53.254804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56a2b2c5-d727-4ed7-9000-3426821f630e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:53.262255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56a2b2c5-d727-4ed7-9000-3426821f630e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:53.263090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56a2b2c5-d727-4ed7-9000-3426821f630e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:53.263762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56a2b2c5-d727-4ed7-9000-3426821f630e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:53.264779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56a2b2c5-d727-4ed7-9000-3426821f630e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:53.265576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56a2b2c5-d727-4ed7-9000-3426821f630e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:53.266210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56a2b2c5-d727-4ed7-9000-3426821f630e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:53.443755 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f868e5d5-9d2c-45e2-bc17-f97654ff3e56 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.955414 Sep 06 11:06:53.444806 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1806/3626] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:06:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:06:53.450150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-56a2b2c5-d727-4ed7-9000-3426821f630e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:53.466855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-56a2b2c5-d727-4ed7-9000-3426821f630e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:53.466855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-56a2b2c5-d727-4ed7-9000-3426821f630e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:53.466855 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56a2b2c5-d727-4ed7-9000-3426821f630e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1358 microversion: 2.21 time: 0.222986 Sep 06 11:06:53.467290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4602f0fd-b2c1-4cf3-adce-83cc16513bd5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:53.467429 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1821/3627] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:53 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:53.476800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4602f0fd-b2c1-4cf3-adce-83cc16513bd5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:53.586926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4602f0fd-b2c1-4cf3-adce-83cc16513bd5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:53.596541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6eca7bfe-eca5-4aad-b3f3-110e25b685f1 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:53.597269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6eca7bfe-eca5-4aad-b3f3-110e25b685f1 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:53.607225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6eca7bfe-eca5-4aad-b3f3-110e25b685f1 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:53.607783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6eca7bfe-eca5-4aad-b3f3-110e25b685f1 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:53.608229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6eca7bfe-eca5-4aad-b3f3-110e25b685f1 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:53.612829 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4602f0fd-b2c1-4cf3-adce-83cc16513bd5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1214 microversion: 2.1 time: 0.158583 Sep 06 11:06:53.618594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6eca7bfe-eca5-4aad-b3f3-110e25b685f1 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:53.618594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6eca7bfe-eca5-4aad-b3f3-110e25b685f1 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:53.618594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6eca7bfe-eca5-4aad-b3f3-110e25b685f1 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:53.618915 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1807/3628] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:53 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:53.703066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6eca7bfe-eca5-4aad-b3f3-110e25b685f1 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:53.715147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6eca7bfe-eca5-4aad-b3f3-110e25b685f1 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:53.715147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6eca7bfe-eca5-4aad-b3f3-110e25b685f1 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:53.716263 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6eca7bfe-eca5-4aad-b3f3-110e25b685f1 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.127032 Sep 06 11:06:53.735652 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1822/3629] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:53 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:53.791833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9064a565-a0ca-4c04-975d-c0b037a9e932 req-876db193-2eab-4d14-ae51-4231497531d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79338947-1b4d-41ad-a75d-6f1141500c45", "name": "network-vif-plugged", "status": "completed", "tag": "3d2d3924-0410-4fb4-aecd-20198e16c4f1"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:53.811426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9064a565-a0ca-4c04-975d-c0b037a9e932 req-876db193-2eab-4d14-ae51-4231497531d9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:53.812163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9064a565-a0ca-4c04-975d-c0b037a9e932 req-876db193-2eab-4d14-ae51-4231497531d9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:53.812608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9064a565-a0ca-4c04-975d-c0b037a9e932 req-876db193-2eab-4d14-ae51-4231497531d9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:53.826984 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9064a565-a0ca-4c04-975d-c0b037a9e932 req-876db193-2eab-4d14-ae51-4231497531d9 service nova] Creating event network-vif-plugged:3d2d3924-0410-4fb4-aecd-20198e16c4f1 for instance 79338947-1b4d-41ad-a75d-6f1141500c45 on nch1-master-1 Sep 06 11:06:53.831975 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9064a565-a0ca-4c04-975d-c0b037a9e932 req-876db193-2eab-4d14-ae51-4231497531d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043972 Sep 06 11:06:53.832582 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1808/3630] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:06:54.088606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a22d6d5c-8bff-4eb2-8890-fd70011af2cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:54.089778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a22d6d5c-8bff-4eb2-8890-fd70011af2cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:54.101105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a22d6d5c-8bff-4eb2-8890-fd70011af2cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:54.101105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a22d6d5c-8bff-4eb2-8890-fd70011af2cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:54.101105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a22d6d5c-8bff-4eb2-8890-fd70011af2cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:54.101105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a22d6d5c-8bff-4eb2-8890-fd70011af2cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:54.101105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a22d6d5c-8bff-4eb2-8890-fd70011af2cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:54.101105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a22d6d5c-8bff-4eb2-8890-fd70011af2cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:54.258750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-102b9319-2951-4f93-93d0-dad336af4ec7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:54.259487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-102b9319-2951-4f93-93d0-dad336af4ec7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:54.270867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-102b9319-2951-4f93-93d0-dad336af4ec7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:54.271756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-102b9319-2951-4f93-93d0-dad336af4ec7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:54.272553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-102b9319-2951-4f93-93d0-dad336af4ec7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:54.273526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-102b9319-2951-4f93-93d0-dad336af4ec7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:54.274380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-102b9319-2951-4f93-93d0-dad336af4ec7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:54.275063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-102b9319-2951-4f93-93d0-dad336af4ec7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:54.279788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a22d6d5c-8bff-4eb2-8890-fd70011af2cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:54.288153 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a22d6d5c-8bff-4eb2-8890-fd70011af2cc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1509 microversion: 2.1 time: 0.203537 Sep 06 11:06:54.289070 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1823/3631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:54 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:54.352032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-102b9319-2951-4f93-93d0-dad336af4ec7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:54.363226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-102b9319-2951-4f93-93d0-dad336af4ec7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:54.365055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-102b9319-2951-4f93-93d0-dad336af4ec7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:54.371051 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-102b9319-2951-4f93-93d0-dad336af4ec7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.117136 Sep 06 11:06:54.371844 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1809/3632] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:54 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:54.492505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f5b73852-a89e-4309-8504-892bb8c8ef87 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:54.493592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f5b73852-a89e-4309-8504-892bb8c8ef87 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:54.501434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5b73852-a89e-4309-8504-892bb8c8ef87 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:54.502280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5b73852-a89e-4309-8504-892bb8c8ef87 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:54.502800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5b73852-a89e-4309-8504-892bb8c8ef87 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:54.503621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5b73852-a89e-4309-8504-892bb8c8ef87 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:54.504165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5b73852-a89e-4309-8504-892bb8c8ef87 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:54.504674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5b73852-a89e-4309-8504-892bb8c8ef87 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:54.650266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe3e1103-cdbe-47e1-8e3e-115d803b73dc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:54.652252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe3e1103-cdbe-47e1-8e3e-115d803b73dc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:54.657555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f5b73852-a89e-4309-8504-892bb8c8ef87 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:54.668693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f5b73852-a89e-4309-8504-892bb8c8ef87 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:54.670335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f5b73852-a89e-4309-8504-892bb8c8ef87 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:54.671732 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f5b73852-a89e-4309-8504-892bb8c8ef87 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1551 microversion: 2.21 time: 0.183894 Sep 06 11:06:54.683519 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1824/3633] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:54 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1551 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:54.701157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca3e37b9-9b77-4770-bd63-b887b6d979d2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:54.701671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca3e37b9-9b77-4770-bd63-b887b6d979d2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:54.709123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca3e37b9-9b77-4770-bd63-b887b6d979d2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:54.709632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca3e37b9-9b77-4770-bd63-b887b6d979d2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:54.710328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca3e37b9-9b77-4770-bd63-b887b6d979d2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:54.711262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca3e37b9-9b77-4770-bd63-b887b6d979d2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:54.711733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca3e37b9-9b77-4770-bd63-b887b6d979d2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:54.712179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca3e37b9-9b77-4770-bd63-b887b6d979d2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:54.744587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca3e37b9-9b77-4770-bd63-b887b6d979d2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:06:54.756986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe3e1103-cdbe-47e1-8e3e-115d803b73dc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:54.767459 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe3e1103-cdbe-47e1-8e3e-115d803b73dc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1214 microversion: 2.1 time: 0.131306 Sep 06 11:06:54.768800 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1810/3634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:54 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:54.777420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c5f7ea8c-ce4c-42d4-aba7-7b0ada00df66 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:54.778318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c5f7ea8c-ce4c-42d4-aba7-7b0ada00df66 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:54.789701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5f7ea8c-ce4c-42d4-aba7-7b0ada00df66 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:54.790477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5f7ea8c-ce4c-42d4-aba7-7b0ada00df66 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:54.794826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5f7ea8c-ce4c-42d4-aba7-7b0ada00df66 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:54.796185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5f7ea8c-ce4c-42d4-aba7-7b0ada00df66 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:54.796930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5f7ea8c-ce4c-42d4-aba7-7b0ada00df66 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:54.797665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c5f7ea8c-ce4c-42d4-aba7-7b0ada00df66 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:54.882000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c5f7ea8c-ce4c-42d4-aba7-7b0ada00df66 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:54.900617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c5f7ea8c-ce4c-42d4-aba7-7b0ada00df66 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:54.902643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c5f7ea8c-ce4c-42d4-aba7-7b0ada00df66 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:54.904438 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c5f7ea8c-ce4c-42d4-aba7-7b0ada00df66 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.133717 Sep 06 11:06:54.905445 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1811/3635] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:54 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:55.021868 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ca3e37b9-9b77-4770-bd63-b887b6d979d2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 204 len: 0 microversion: 2.21 time: 0.324134 Sep 06 11:06:55.027652 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1825/3636] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:06:54 2022] DELETE /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:06:55.032825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-154afaaf-19e9-48ad-b131-f09a5b97a32e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:55.033454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-154afaaf-19e9-48ad-b131-f09a5b97a32e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:55.040523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-154afaaf-19e9-48ad-b131-f09a5b97a32e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:55.041083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-154afaaf-19e9-48ad-b131-f09a5b97a32e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:55.041540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-154afaaf-19e9-48ad-b131-f09a5b97a32e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:55.047690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-154afaaf-19e9-48ad-b131-f09a5b97a32e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:55.048214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-154afaaf-19e9-48ad-b131-f09a5b97a32e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:55.048698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-154afaaf-19e9-48ad-b131-f09a5b97a32e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:55.218281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-154afaaf-19e9-48ad-b131-f09a5b97a32e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:55.228401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-154afaaf-19e9-48ad-b131-f09a5b97a32e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:55.230449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-154afaaf-19e9-48ad-b131-f09a5b97a32e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:55.231697 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-154afaaf-19e9-48ad-b131-f09a5b97a32e tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1557 microversion: 2.21 time: 0.202925 Sep 06 11:06:55.232282 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1812/3637] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:55 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1557 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:55.314541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3701443a-b2e4-4552-ac33-c3632b5534e1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:55.321639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3701443a-b2e4-4552-ac33-c3632b5534e1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:55.334234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3701443a-b2e4-4552-ac33-c3632b5534e1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:55.335093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3701443a-b2e4-4552-ac33-c3632b5534e1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:55.339790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3701443a-b2e4-4552-ac33-c3632b5534e1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:55.339790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3701443a-b2e4-4552-ac33-c3632b5534e1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:55.339790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3701443a-b2e4-4552-ac33-c3632b5534e1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:55.339790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3701443a-b2e4-4552-ac33-c3632b5534e1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:55.401509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c380c276-1e19-401b-9389-95bb5f079f8b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:55.402767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c380c276-1e19-401b-9389-95bb5f079f8b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:55.412294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c380c276-1e19-401b-9389-95bb5f079f8b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:55.413202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c380c276-1e19-401b-9389-95bb5f079f8b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:55.413914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c380c276-1e19-401b-9389-95bb5f079f8b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:55.415187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c380c276-1e19-401b-9389-95bb5f079f8b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:55.415540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c380c276-1e19-401b-9389-95bb5f079f8b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:55.416190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c380c276-1e19-401b-9389-95bb5f079f8b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:55.419875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:55.497983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c380c276-1e19-401b-9389-95bb5f079f8b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:55.510682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c380c276-1e19-401b-9389-95bb5f079f8b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:55.513309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c380c276-1e19-401b-9389-95bb5f079f8b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:55.515141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3701443a-b2e4-4552-ac33-c3632b5534e1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:55.522347 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c380c276-1e19-401b-9389-95bb5f079f8b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.125970 Sep 06 11:06:55.522945 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1813/3638] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:55 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:55.524560 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3701443a-b2e4-4552-ac33-c3632b5534e1 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1509 microversion: 2.1 time: 0.214863 Sep 06 11:06:55.525283 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1826/3639] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:55 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:55.794083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e8d562dd-1856-4866-9854-52fe386ae1db tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:55.794786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e8d562dd-1856-4866-9854-52fe386ae1db tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:55.807113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8d562dd-1856-4866-9854-52fe386ae1db tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:55.807587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8d562dd-1856-4866-9854-52fe386ae1db tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:55.808538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8d562dd-1856-4866-9854-52fe386ae1db tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:55.809256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8d562dd-1856-4866-9854-52fe386ae1db tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:55.812923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8d562dd-1856-4866-9854-52fe386ae1db tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:55.812923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8d562dd-1856-4866-9854-52fe386ae1db tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:55.910767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e8d562dd-1856-4866-9854-52fe386ae1db tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:55.917819 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e8d562dd-1856-4866-9854-52fe386ae1db tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1266 microversion: 2.1 time: 0.127721 Sep 06 11:06:55.920816 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1814/3640] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:55 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:55.931761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4ffea2ca-be35-4b9d-a0c1-d1fd23899ae4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:55.933571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4ffea2ca-be35-4b9d-a0c1-d1fd23899ae4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:55.941383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ffea2ca-be35-4b9d-a0c1-d1fd23899ae4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:55.942095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ffea2ca-be35-4b9d-a0c1-d1fd23899ae4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:55.942745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ffea2ca-be35-4b9d-a0c1-d1fd23899ae4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:55.943665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ffea2ca-be35-4b9d-a0c1-d1fd23899ae4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:55.944291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ffea2ca-be35-4b9d-a0c1-d1fd23899ae4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:55.944948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ffea2ca-be35-4b9d-a0c1-d1fd23899ae4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:56.053882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4ffea2ca-be35-4b9d-a0c1-d1fd23899ae4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:56.071476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4ffea2ca-be35-4b9d-a0c1-d1fd23899ae4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:56.074046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4ffea2ca-be35-4b9d-a0c1-d1fd23899ae4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:56.077103 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4ffea2ca-be35-4b9d-a0c1-d1fd23899ae4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.148850 Sep 06 11:06:56.087765 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1827/3641] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:55 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:56.262904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-acdeac84-39d5-479d-96f8-fe2d59374f96 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:56.263852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-acdeac84-39d5-479d-96f8-fe2d59374f96 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:56.271601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acdeac84-39d5-479d-96f8-fe2d59374f96 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:56.273413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acdeac84-39d5-479d-96f8-fe2d59374f96 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:56.274228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acdeac84-39d5-479d-96f8-fe2d59374f96 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:56.275192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acdeac84-39d5-479d-96f8-fe2d59374f96 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:56.275989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acdeac84-39d5-479d-96f8-fe2d59374f96 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:56.276631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acdeac84-39d5-479d-96f8-fe2d59374f96 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:56.443344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-acdeac84-39d5-479d-96f8-fe2d59374f96 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:56.463111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-acdeac84-39d5-479d-96f8-fe2d59374f96 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:56.465413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-acdeac84-39d5-479d-96f8-fe2d59374f96 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:56.466778 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-acdeac84-39d5-479d-96f8-fe2d59374f96 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1557 microversion: 2.21 time: 0.211597 Sep 06 11:06:56.467588 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1815/3642] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:56 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1557 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:56.553615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-41a4eb3e-abbb-49d5-846e-b5af3c50ac3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:56.554239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-41a4eb3e-abbb-49d5-846e-b5af3c50ac3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:56.561180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8aa31e65-71f4-40ee-91cd-5b1e5f6f4717 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:56.562876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8aa31e65-71f4-40ee-91cd-5b1e5f6f4717 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:56.571142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41a4eb3e-abbb-49d5-846e-b5af3c50ac3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:56.571662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41a4eb3e-abbb-49d5-846e-b5af3c50ac3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:56.583138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41a4eb3e-abbb-49d5-846e-b5af3c50ac3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:56.583138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41a4eb3e-abbb-49d5-846e-b5af3c50ac3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:56.583138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41a4eb3e-abbb-49d5-846e-b5af3c50ac3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:56.583138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41a4eb3e-abbb-49d5-846e-b5af3c50ac3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:56.585755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa31e65-71f4-40ee-91cd-5b1e5f6f4717 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:56.586258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa31e65-71f4-40ee-91cd-5b1e5f6f4717 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:56.586701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa31e65-71f4-40ee-91cd-5b1e5f6f4717 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:56.593312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa31e65-71f4-40ee-91cd-5b1e5f6f4717 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:56.593816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa31e65-71f4-40ee-91cd-5b1e5f6f4717 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:56.594266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa31e65-71f4-40ee-91cd-5b1e5f6f4717 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:56.749354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8aa31e65-71f4-40ee-91cd-5b1e5f6f4717 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:56.758829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8aa31e65-71f4-40ee-91cd-5b1e5f6f4717 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:56.760706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8aa31e65-71f4-40ee-91cd-5b1e5f6f4717 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:56.766810 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8aa31e65-71f4-40ee-91cd-5b1e5f6f4717 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.215583 Sep 06 11:06:56.779401 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1816/3643] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:56 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:56.855385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-41a4eb3e-abbb-49d5-846e-b5af3c50ac3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:56.864795 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-41a4eb3e-abbb-49d5-846e-b5af3c50ac3f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1509 microversion: 2.1 time: 0.318525 Sep 06 11:06:56.866734 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1828/3644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:56 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1509 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:56.948170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-51b9680c-1d99-4a56-8fcd-c2df2472d83a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:56.949350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-51b9680c-1d99-4a56-8fcd-c2df2472d83a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:56.960034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51b9680c-1d99-4a56-8fcd-c2df2472d83a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:56.960540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51b9680c-1d99-4a56-8fcd-c2df2472d83a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:56.961044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51b9680c-1d99-4a56-8fcd-c2df2472d83a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:56.961755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51b9680c-1d99-4a56-8fcd-c2df2472d83a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:56.962218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51b9680c-1d99-4a56-8fcd-c2df2472d83a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:56.970548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51b9680c-1d99-4a56-8fcd-c2df2472d83a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:57.064950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-51b9680c-1d99-4a56-8fcd-c2df2472d83a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:57.076369 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-51b9680c-1d99-4a56-8fcd-c2df2472d83a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1274 microversion: 2.1 time: 0.132014 Sep 06 11:06:57.077546 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1817/3645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:56 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:57.108514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c116e97-11b3-4552-a096-ef3a6c61ec38 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:57.109212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3c116e97-11b3-4552-a096-ef3a6c61ec38 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:57.122082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c116e97-11b3-4552-a096-ef3a6c61ec38 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:57.122908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c116e97-11b3-4552-a096-ef3a6c61ec38 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:57.124021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c116e97-11b3-4552-a096-ef3a6c61ec38 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:57.125731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c116e97-11b3-4552-a096-ef3a6c61ec38 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:57.126503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c116e97-11b3-4552-a096-ef3a6c61ec38 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:57.127167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c116e97-11b3-4552-a096-ef3a6c61ec38 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:57.207823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c116e97-11b3-4552-a096-ef3a6c61ec38 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:57.217903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c116e97-11b3-4552-a096-ef3a6c61ec38 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:57.219922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c116e97-11b3-4552-a096-ef3a6c61ec38 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:57.221488 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3c116e97-11b3-4552-a096-ef3a6c61ec38 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.117259 Sep 06 11:06:57.222252 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1829/3646] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:57 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:57.498090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e672b6b6-23bd-4104-a8ce-89f9c6e169e4 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:57.498839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e672b6b6-23bd-4104-a8ce-89f9c6e169e4 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:57.513368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e672b6b6-23bd-4104-a8ce-89f9c6e169e4 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:57.516505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e672b6b6-23bd-4104-a8ce-89f9c6e169e4 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:57.516696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e672b6b6-23bd-4104-a8ce-89f9c6e169e4 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:57.523362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e672b6b6-23bd-4104-a8ce-89f9c6e169e4 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:57.524601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e672b6b6-23bd-4104-a8ce-89f9c6e169e4 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:57.526288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e672b6b6-23bd-4104-a8ce-89f9c6e169e4 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:57.575669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-eadfd187-3b05-4d91-889a-223c59efa01e req-4a18db7f-f6bf-4204-8c64-0e8b0f16802d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03", "name": "network-vif-deleted", "tag": "f19d5b9a-8d84-4b51-8a7b-2f2a39e3466e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:06:57.601552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-eadfd187-3b05-4d91-889a-223c59efa01e req-4a18db7f-f6bf-4204-8c64-0e8b0f16802d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:57.602045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-eadfd187-3b05-4d91-889a-223c59efa01e req-4a18db7f-f6bf-4204-8c64-0e8b0f16802d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:57.602701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-eadfd187-3b05-4d91-889a-223c59efa01e req-4a18db7f-f6bf-4204-8c64-0e8b0f16802d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:57.636148 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-eadfd187-3b05-4d91-889a-223c59efa01e req-4a18db7f-f6bf-4204-8c64-0e8b0f16802d service nova] Creating event network-vif-deleted:f19d5b9a-8d84-4b51-8a7b-2f2a39e3466e for instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 on nch1-master-1 Sep 06 11:06:57.645008 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-eadfd187-3b05-4d91-889a-223c59efa01e req-4a18db7f-f6bf-4204-8c64-0e8b0f16802d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073015 Sep 06 11:06:57.645942 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1830/3647] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:06:57.662846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e672b6b6-23bd-4104-a8ce-89f9c6e169e4 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:57.683819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e672b6b6-23bd-4104-a8ce-89f9c6e169e4 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:57.685796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e672b6b6-23bd-4104-a8ce-89f9c6e169e4 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:57.688105 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e672b6b6-23bd-4104-a8ce-89f9c6e169e4 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1515 microversion: 2.21 time: 0.197130 Sep 06 11:06:57.688688 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1818/3648] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:57 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:57.797467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-953abbe1-1519-4a4a-a920-84ce3bcf798c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:57.798179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-953abbe1-1519-4a4a-a920-84ce3bcf798c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:57.806655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-953abbe1-1519-4a4a-a920-84ce3bcf798c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:57.807814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-953abbe1-1519-4a4a-a920-84ce3bcf798c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:57.808841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-953abbe1-1519-4a4a-a920-84ce3bcf798c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:57.809584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-953abbe1-1519-4a4a-a920-84ce3bcf798c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:57.810352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-953abbe1-1519-4a4a-a920-84ce3bcf798c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:57.811411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-953abbe1-1519-4a4a-a920-84ce3bcf798c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:57.889866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2b288818-d451-46fe-9b21-2b131e89a7e3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:57.891388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2b288818-d451-46fe-9b21-2b131e89a7e3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:57.919568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2b288818-d451-46fe-9b21-2b131e89a7e3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:57.920090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2b288818-d451-46fe-9b21-2b131e89a7e3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:57.920552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2b288818-d451-46fe-9b21-2b131e89a7e3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:57.928050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2b288818-d451-46fe-9b21-2b131e89a7e3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:57.931826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2b288818-d451-46fe-9b21-2b131e89a7e3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:57.932297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2b288818-d451-46fe-9b21-2b131e89a7e3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:57.936373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-953abbe1-1519-4a4a-a920-84ce3bcf798c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:57.946102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-953abbe1-1519-4a4a-a920-84ce3bcf798c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:57.948157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-953abbe1-1519-4a4a-a920-84ce3bcf798c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:57.955045 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-953abbe1-1519-4a4a-a920-84ce3bcf798c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.162158 Sep 06 11:06:57.966572 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1831/3649] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:57 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:58.105746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0b97fd81-c7d3-4707-8a0d-c718dfbf4288 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:58.108018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0b97fd81-c7d3-4707-8a0d-c718dfbf4288 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:58.112751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b97fd81-c7d3-4707-8a0d-c718dfbf4288 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:58.113689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b97fd81-c7d3-4707-8a0d-c718dfbf4288 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:58.114138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b97fd81-c7d3-4707-8a0d-c718dfbf4288 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:58.115064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b97fd81-c7d3-4707-8a0d-c718dfbf4288 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:58.115708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b97fd81-c7d3-4707-8a0d-c718dfbf4288 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:58.116376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b97fd81-c7d3-4707-8a0d-c718dfbf4288 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:58.135387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:58.158331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2b288818-d451-46fe-9b21-2b131e89a7e3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:58.168127 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2b288818-d451-46fe-9b21-2b131e89a7e3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1509 microversion: 2.1 time: 0.282013 Sep 06 11:06:58.169073 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1819/3650] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:57 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:58.195279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0b97fd81-c7d3-4707-8a0d-c718dfbf4288 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:58.205123 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0b97fd81-c7d3-4707-8a0d-c718dfbf4288 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1272 microversion: 2.1 time: 0.107511 Sep 06 11:06:58.205866 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1832/3651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:58 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:58.252564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4320168-aa81-4ac4-9cd9-c26530e5bbe8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:58.253208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b4320168-aa81-4ac4-9cd9-c26530e5bbe8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:58.277497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4320168-aa81-4ac4-9cd9-c26530e5bbe8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:58.277497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4320168-aa81-4ac4-9cd9-c26530e5bbe8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:58.277497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4320168-aa81-4ac4-9cd9-c26530e5bbe8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:58.277497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4320168-aa81-4ac4-9cd9-c26530e5bbe8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:58.277497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4320168-aa81-4ac4-9cd9-c26530e5bbe8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:58.277497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4320168-aa81-4ac4-9cd9-c26530e5bbe8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:58.443362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b4320168-aa81-4ac4-9cd9-c26530e5bbe8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:58.453385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b4320168-aa81-4ac4-9cd9-c26530e5bbe8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:58.460994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b4320168-aa81-4ac4-9cd9-c26530e5bbe8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:58.462530 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b4320168-aa81-4ac4-9cd9-c26530e5bbe8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.214446 Sep 06 11:06:58.463710 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1820/3652] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:58 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:58.720712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:58.721655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:58.730284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:58.731125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:58.731910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:58.733292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:58.733938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:58.734549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:58.804895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:58.805776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:58.806601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:58.807266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lazy-loading 'fault' on Instance uuid 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:06:58.864186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:58.873326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:58.875083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0db5bafa61d44b981696fdae685d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9ee2e2f5d439786309f06030582b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:58.876331 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4c780387-6a6c-4e10-821c-be7dbce3188b tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 200 len: 1348 microversion: 2.21 time: 0.159521 Sep 06 11:06:58.877430 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1833/3653] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:58 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 1348 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:58.986525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5fc21853-3043-4110-9d01-635e8b891307 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:58.987648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5fc21853-3043-4110-9d01-635e8b891307 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:58.996210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fc21853-3043-4110-9d01-635e8b891307 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:58.997188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fc21853-3043-4110-9d01-635e8b891307 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:58.997904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fc21853-3043-4110-9d01-635e8b891307 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:58.998924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fc21853-3043-4110-9d01-635e8b891307 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:58.999503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fc21853-3043-4110-9d01-635e8b891307 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:59.013363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fc21853-3043-4110-9d01-635e8b891307 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:59.113513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5fc21853-3043-4110-9d01-635e8b891307 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:59.126083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5fc21853-3043-4110-9d01-635e8b891307 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:59.128031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5fc21853-3043-4110-9d01-635e8b891307 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:59.134517 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5fc21853-3043-4110-9d01-635e8b891307 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.151954 Sep 06 11:06:59.135250 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1821/3654] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:58 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:06:59.193491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ea921e31-a860-47a8-9917-5ecf7c429891 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:59.194175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ea921e31-a860-47a8-9917-5ecf7c429891 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:59.202194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea921e31-a860-47a8-9917-5ecf7c429891 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:59.206439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea921e31-a860-47a8-9917-5ecf7c429891 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:59.206439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea921e31-a860-47a8-9917-5ecf7c429891 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:59.206439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea921e31-a860-47a8-9917-5ecf7c429891 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:59.206439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea921e31-a860-47a8-9917-5ecf7c429891 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:59.206439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea921e31-a860-47a8-9917-5ecf7c429891 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:59.231043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e3276fac-a7f1-4416-95eb-90b113205551 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:59.232750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e3276fac-a7f1-4416-95eb-90b113205551 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:59.240059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3276fac-a7f1-4416-95eb-90b113205551 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:59.240854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3276fac-a7f1-4416-95eb-90b113205551 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:59.241611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3276fac-a7f1-4416-95eb-90b113205551 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:59.242783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3276fac-a7f1-4416-95eb-90b113205551 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:59.243406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3276fac-a7f1-4416-95eb-90b113205551 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:59.244091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3276fac-a7f1-4416-95eb-90b113205551 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:59.456575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e3276fac-a7f1-4416-95eb-90b113205551 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:59.471200 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e3276fac-a7f1-4416-95eb-90b113205551 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1314 microversion: 2.1 time: 0.245172 Sep 06 11:06:59.472225 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1822/3655] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:59 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:06:59.492327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d62cbdc2-bf04-4102-be1e-1083017ec3f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:59.492975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d62cbdc2-bf04-4102-be1e-1083017ec3f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:59.503932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d62cbdc2-bf04-4102-be1e-1083017ec3f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:59.504917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d62cbdc2-bf04-4102-be1e-1083017ec3f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:59.505685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d62cbdc2-bf04-4102-be1e-1083017ec3f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:59.506623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d62cbdc2-bf04-4102-be1e-1083017ec3f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:59.507763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d62cbdc2-bf04-4102-be1e-1083017ec3f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:59.508396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d62cbdc2-bf04-4102-be1e-1083017ec3f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:59.528545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ea921e31-a860-47a8-9917-5ecf7c429891 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:59.540755 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ea921e31-a860-47a8-9917-5ecf7c429891 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1509 microversion: 2.1 time: 0.351332 Sep 06 11:06:59.541364 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1834/3656] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:06:59 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1509 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:06:59.623107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d62cbdc2-bf04-4102-be1e-1083017ec3f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:59.633540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d62cbdc2-bf04-4102-be1e-1083017ec3f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:59.635676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d62cbdc2-bf04-4102-be1e-1083017ec3f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:06:59.637419 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d62cbdc2-bf04-4102-be1e-1083017ec3f8 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1365 microversion: 2.47 time: 0.151264 Sep 06 11:06:59.638592 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1823/3657] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:59 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:06:59.913380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e91af3a-352f-46a7-83e1-f2716d597fac tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:59.914158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3e91af3a-352f-46a7-83e1-f2716d597fac tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:59.922511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e91af3a-352f-46a7-83e1-f2716d597fac tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:59.953944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e91af3a-352f-46a7-83e1-f2716d597fac tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:59.953944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e91af3a-352f-46a7-83e1-f2716d597fac tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:59.953944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e91af3a-352f-46a7-83e1-f2716d597fac tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:59.953944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e91af3a-352f-46a7-83e1-f2716d597fac tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:59.953944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e91af3a-352f-46a7-83e1-f2716d597fac tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:59.953944 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-3e91af3a-352f-46a7-83e1-f2716d597fac tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] HTTP exception thrown: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e91af3a-352f-46a7-83e1-f2716d597fac tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Request method failure captured: Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 HTTP/1.1 Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFym3p0IH_xDjOHMoScdZdoIweL9dFs41AF-7G9CtSHmrfPBRqAoZkxEhl3uXq01RHGT_cRHqj_xgVutVNNO-YSKVvon_DQSXTYbYW1wUaTe3a-oNEDdaWVVu5CHX8FpOlMfjjaFbC8rDEX04QD7HFkig57ODD89TPgRD5q0Jl1Uh8ZA Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.21 Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 3ae9ee2e2f5d439786309f06030582b9 Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-InstanceActionsV221TestJSON-51084861 Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ae9ee2e2f5d439786309f06030582b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ae9ee2e2f5d439786309f06030582b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ae9ee2e2f5d439786309f06030582b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ae9ee2e2f5d439786309f06030582b9"}]}] Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-InstanceActionsV221TestJSON-51084861 Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 3ae9ee2e2f5d439786309f06030582b9 Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-51084861 Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-InstanceActionsV221TestJSON-51084861-project Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d0db5bafa61d44b981696fdae685d811 Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-InstanceActionsV221TestJSON-51084861-project Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03'} Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:06:59.955036 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:06:59.963050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:06:59.963050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:06:59.963050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:06:59.963050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:06:59.963050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:06:59.963050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:06:59.963050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:06:59.963050 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:06:59.963050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e91af3a-352f-46a7-83e1-f2716d597fac tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Returning 404 to user: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:06:59.963050 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3e91af3a-352f-46a7-83e1-f2716d597fac tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 404 len: 111 microversion: 2.21 time: 0.047048 Sep 06 11:06:59.963050 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1835/3658] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:06:59 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:06:59.966490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed3d0e6a-beab-41eb-99c5-be9fcac87fa5 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '.version_select at 0x7f90f8ab6310>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:06:59.967121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ed3d0e6a-beab-41eb-99c5-be9fcac87fa5 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:06:59.973469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed3d0e6a-beab-41eb-99c5-be9fcac87fa5 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:59.976995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed3d0e6a-beab-41eb-99c5-be9fcac87fa5 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:59.976995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed3d0e6a-beab-41eb-99c5-be9fcac87fa5 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:06:59.976995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed3d0e6a-beab-41eb-99c5-be9fcac87fa5 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:06:59.976995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed3d0e6a-beab-41eb-99c5-be9fcac87fa5 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:06:59.976995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed3d0e6a-beab-41eb-99c5-be9fcac87fa5 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:00.055583 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ed3d0e6a-beab-41eb-99c5-be9fcac87fa5 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.094653 Sep 06 11:07:00.056385 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1824/3659] 10.222.0.20 () {60 vars in 1337 bytes} [Tue Sep 6 11:06:59 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03/os-instance-actions => generated 611 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:07:00.072502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-790e2223-37f1-422e-8ffb-23aa1815f0a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:00.073890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-790e2223-37f1-422e-8ffb-23aa1815f0a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:00.089906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-790e2223-37f1-422e-8ffb-23aa1815f0a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:00.091430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-790e2223-37f1-422e-8ffb-23aa1815f0a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:00.092066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-790e2223-37f1-422e-8ffb-23aa1815f0a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:00.093095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-790e2223-37f1-422e-8ffb-23aa1815f0a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:00.093876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-790e2223-37f1-422e-8ffb-23aa1815f0a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:00.094569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-790e2223-37f1-422e-8ffb-23aa1815f0a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:00.114434 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-790e2223-37f1-422e-8ffb-23aa1815f0a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] HTTP exception thrown: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-790e2223-37f1-422e-8ffb-23aa1815f0a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Request method failure captured: Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 HTTP/1.1 Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFym3p0IH_xDjOHMoScdZdoIweL9dFs41AF-7G9CtSHmrfPBRqAoZkxEhl3uXq01RHGT_cRHqj_xgVutVNNO-YSKVvon_DQSXTYbYW1wUaTe3a-oNEDdaWVVu5CHX8FpOlMfjjaFbC8rDEX04QD7HFkig57ODD89TPgRD5q0Jl1Uh8ZA Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.21 Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 3ae9ee2e2f5d439786309f06030582b9 Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-InstanceActionsV221TestJSON-51084861 Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ae9ee2e2f5d439786309f06030582b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ae9ee2e2f5d439786309f06030582b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ae9ee2e2f5d439786309f06030582b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ae9ee2e2f5d439786309f06030582b9"}]}] Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-InstanceActionsV221TestJSON-51084861 Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 3ae9ee2e2f5d439786309f06030582b9 Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-51084861 Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-InstanceActionsV221TestJSON-51084861-project Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d0db5bafa61d44b981696fdae685d811 Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-InstanceActionsV221TestJSON-51084861-project Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03'} Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:07:00.116694 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-790e2223-37f1-422e-8ffb-23aa1815f0a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Returning 404 to user: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-790e2223-37f1-422e-8ffb-23aa1815f0a2 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 404 len: 111 microversion: 2.21 time: 0.051868 Sep 06 11:07:00.125929 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1836/3660] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:07:00 2022] DELETE /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:07:00.132732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ab478093-4e70-4f21-8e06-1ffbafadb961 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:00.133471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ab478093-4e70-4f21-8e06-1ffbafadb961 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] [instance: 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:00.142045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab478093-4e70-4f21-8e06-1ffbafadb961 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:00.144581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab478093-4e70-4f21-8e06-1ffbafadb961 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:00.144581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab478093-4e70-4f21-8e06-1ffbafadb961 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:00.144581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab478093-4e70-4f21-8e06-1ffbafadb961 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:00.144581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab478093-4e70-4f21-8e06-1ffbafadb961 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:00.145215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab478093-4e70-4f21-8e06-1ffbafadb961 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:00.165328 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-ab478093-4e70-4f21-8e06-1ffbafadb961 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] HTTP exception thrown: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:07:00.167725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7cf8ae33-58b7-4a47-888f-3cb6e492731d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ab478093-4e70-4f21-8e06-1ffbafadb961 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Request method failure captured: Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 HTTP/1.1 Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFym3p0IH_xDjOHMoScdZdoIweL9dFs41AF-7G9CtSHmrfPBRqAoZkxEhl3uXq01RHGT_cRHqj_xgVutVNNO-YSKVvon_DQSXTYbYW1wUaTe3a-oNEDdaWVVu5CHX8FpOlMfjjaFbC8rDEX04QD7HFkig57ODD89TPgRD5q0Jl1Uh8ZA Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Openstack-Nova-Api-Version: 2.21 Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3ae9ee2e2f5d439786309f06030582b9 Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-InstanceActionsV221TestJSON-51084861 Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ae9ee2e2f5d439786309f06030582b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ae9ee2e2f5d439786309f06030582b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ae9ee2e2f5d439786309f06030582b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ae9ee2e2f5d439786309f06030582b9"}]}] Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-InstanceActionsV221TestJSON-51084861 Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3ae9ee2e2f5d439786309f06030582b9 Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-51084861 Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-InstanceActionsV221TestJSON-51084861-project Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: d0db5bafa61d44b981696fdae685d811 Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-InstanceActionsV221TestJSON-51084861-project Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03'} Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:00.168030 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:00.181925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:00.181925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:00.181925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:00.181925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:00.181925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:07:00.181925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:07:00.181925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. Sep 06 11:07:00.181925 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:00.183329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7cf8ae33-58b7-4a47-888f-3cb6e492731d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:00.183457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ab478093-4e70-4f21-8e06-1ffbafadb961 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] Returning 404 to user: Instance 2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:07:00.183457 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ab478093-4e70-4f21-8e06-1ffbafadb961 tempest-InstanceActionsV221TestJSON-51084861 tempest-InstanceActionsV221TestJSON-51084861-project] 10.222.0.20 "GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03" status: 404 len: 111 microversion: 2.21 time: 0.041699 Sep 06 11:07:00.183457 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1825/3661] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:00 2022] GET /compute/v2.1/servers/2968b12b-a0c9-4bc9-8cb6-936fbbc3ae03 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:07:00.190821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7cf8ae33-58b7-4a47-888f-3cb6e492731d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:00.191700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7cf8ae33-58b7-4a47-888f-3cb6e492731d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:00.193928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7cf8ae33-58b7-4a47-888f-3cb6e492731d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:00.194670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7cf8ae33-58b7-4a47-888f-3cb6e492731d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:00.195186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7cf8ae33-58b7-4a47-888f-3cb6e492731d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:00.195983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7cf8ae33-58b7-4a47-888f-3cb6e492731d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:00.378172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7cf8ae33-58b7-4a47-888f-3cb6e492731d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:00.399582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7cf8ae33-58b7-4a47-888f-3cb6e492731d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:00.401741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7cf8ae33-58b7-4a47-888f-3cb6e492731d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:00.412580 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7cf8ae33-58b7-4a47-888f-3cb6e492731d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.253025 Sep 06 11:07:00.415080 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1837/3662] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:00 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:00.502129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2f29c775-9e4f-44b4-b580-4c5d87381875 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:00.509201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2f29c775-9e4f-44b4-b580-4c5d87381875 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:00.517131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f29c775-9e4f-44b4-b580-4c5d87381875 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:00.523604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f29c775-9e4f-44b4-b580-4c5d87381875 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:00.523604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f29c775-9e4f-44b4-b580-4c5d87381875 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:00.523604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f29c775-9e4f-44b4-b580-4c5d87381875 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:00.523604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f29c775-9e4f-44b4-b580-4c5d87381875 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:00.523604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f29c775-9e4f-44b4-b580-4c5d87381875 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:00.565974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d170daaa-6614-4ddb-a00b-e56f2b1dc4a3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:00.566593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d170daaa-6614-4ddb-a00b-e56f2b1dc4a3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:00.576503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d170daaa-6614-4ddb-a00b-e56f2b1dc4a3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:00.576989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d170daaa-6614-4ddb-a00b-e56f2b1dc4a3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:00.579054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d170daaa-6614-4ddb-a00b-e56f2b1dc4a3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:00.581146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d170daaa-6614-4ddb-a00b-e56f2b1dc4a3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:00.581793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d170daaa-6614-4ddb-a00b-e56f2b1dc4a3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:00.587884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d170daaa-6614-4ddb-a00b-e56f2b1dc4a3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:01.194811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2f29c775-9e4f-44b4-b580-4c5d87381875 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:01.209042 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2f29c775-9e4f-44b4-b580-4c5d87381875 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1314 microversion: 2.1 time: 0.709629 Sep 06 11:07:01.211215 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1826/3663] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:00 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:01.237486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-13bae667-1e1c-403a-b59d-dbf55c052e2e req-111f97ef-37aa-4805-90e3-6de8dac81e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8d78eee-0953-4593-b34f-271f88c7125b", "tag": "a5cc4081-f537-4898-af7a-401941c6fe02"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:01.252097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-13bae667-1e1c-403a-b59d-dbf55c052e2e req-111f97ef-37aa-4805-90e3-6de8dac81e3d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:01.253322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-13bae667-1e1c-403a-b59d-dbf55c052e2e req-111f97ef-37aa-4805-90e3-6de8dac81e3d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:01.253965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-13bae667-1e1c-403a-b59d-dbf55c052e2e req-111f97ef-37aa-4805-90e3-6de8dac81e3d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:01.270844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d170daaa-6614-4ddb-a00b-e56f2b1dc4a3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:01.282824 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-13bae667-1e1c-403a-b59d-dbf55c052e2e req-111f97ef-37aa-4805-90e3-6de8dac81e3d service nova] Creating event network-changed:a5cc4081-f537-4898-af7a-401941c6fe02 for instance d8d78eee-0953-4593-b34f-271f88c7125b on nch2-master-1 Sep 06 11:07:01.284879 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d170daaa-6614-4ddb-a00b-e56f2b1dc4a3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1509 microversion: 2.1 time: 0.723041 Sep 06 11:07:01.291903 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-13bae667-1e1c-403a-b59d-dbf55c052e2e req-111f97ef-37aa-4805-90e3-6de8dac81e3d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076348 Sep 06 11:07:01.293139 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1827/3664] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:01.299670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8653ba24-2ac6-40a4-8a70-eb667114cb02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:01.300775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8653ba24-2ac6-40a4-8a70-eb667114cb02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:01.306682 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1838/3665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:00 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1509 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:01.307530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8653ba24-2ac6-40a4-8a70-eb667114cb02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:01.308292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8653ba24-2ac6-40a4-8a70-eb667114cb02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:01.309094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8653ba24-2ac6-40a4-8a70-eb667114cb02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:01.310100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8653ba24-2ac6-40a4-8a70-eb667114cb02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:01.310831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8653ba24-2ac6-40a4-8a70-eb667114cb02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:01.311470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8653ba24-2ac6-40a4-8a70-eb667114cb02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:01.449059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c6a96daa-2067-40f4-8b2d-98257b1921c1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:01.449686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c6a96daa-2067-40f4-8b2d-98257b1921c1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:01.460075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6a96daa-2067-40f4-8b2d-98257b1921c1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:01.461059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6a96daa-2067-40f4-8b2d-98257b1921c1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:01.471202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6a96daa-2067-40f4-8b2d-98257b1921c1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:01.472657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6a96daa-2067-40f4-8b2d-98257b1921c1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:01.473281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6a96daa-2067-40f4-8b2d-98257b1921c1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:01.473909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6a96daa-2067-40f4-8b2d-98257b1921c1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:01.494924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8653ba24-2ac6-40a4-8a70-eb667114cb02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:01.511219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8653ba24-2ac6-40a4-8a70-eb667114cb02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:01.516473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8653ba24-2ac6-40a4-8a70-eb667114cb02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:01.522839 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8653ba24-2ac6-40a4-8a70-eb667114cb02 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1371 microversion: 2.47 time: 0.227937 Sep 06 11:07:01.524338 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1828/3666] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:01 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:01.639641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c6a96daa-2067-40f4-8b2d-98257b1921c1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:01.648735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c6a96daa-2067-40f4-8b2d-98257b1921c1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:01.650590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c6a96daa-2067-40f4-8b2d-98257b1921c1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:01.657760 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c6a96daa-2067-40f4-8b2d-98257b1921c1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.213809 Sep 06 11:07:01.659021 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1839/3667] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:01 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:02.236161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d3e63308-230d-422a-9985-4663d44dde09 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:02.237081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3e63308-230d-422a-9985-4663d44dde09 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:02.244728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e63308-230d-422a-9985-4663d44dde09 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:02.246137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e63308-230d-422a-9985-4663d44dde09 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:02.247479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e63308-230d-422a-9985-4663d44dde09 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:02.247898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e63308-230d-422a-9985-4663d44dde09 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:02.248550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e63308-230d-422a-9985-4663d44dde09 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:02.249208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e63308-230d-422a-9985-4663d44dde09 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:02.317915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-df9c8faa-e553-4195-bd2b-0a51f753e883 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:02.318621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-df9c8faa-e553-4195-bd2b-0a51f753e883 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:02.334927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df9c8faa-e553-4195-bd2b-0a51f753e883 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:02.335778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df9c8faa-e553-4195-bd2b-0a51f753e883 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:02.336403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df9c8faa-e553-4195-bd2b-0a51f753e883 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:02.337355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df9c8faa-e553-4195-bd2b-0a51f753e883 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:02.337996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df9c8faa-e553-4195-bd2b-0a51f753e883 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:02.339298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df9c8faa-e553-4195-bd2b-0a51f753e883 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:02.669990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d3e63308-230d-422a-9985-4663d44dde09 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:02.945794 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d3e63308-230d-422a-9985-4663d44dde09 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1314 microversion: 2.1 time: 0.453734 Sep 06 11:07:02.945794 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1829/3668] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:02 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:02.945794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fc00f302-b18c-4e48-913a-3adc831638e6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:02.945794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fc00f302-b18c-4e48-913a-3adc831638e6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:02.945794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc00f302-b18c-4e48-913a-3adc831638e6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:02.945794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc00f302-b18c-4e48-913a-3adc831638e6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:02.945794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc00f302-b18c-4e48-913a-3adc831638e6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:02.945794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc00f302-b18c-4e48-913a-3adc831638e6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:02.945794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc00f302-b18c-4e48-913a-3adc831638e6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:02.945794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc00f302-b18c-4e48-913a-3adc831638e6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:02.949876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-df9c8faa-e553-4195-bd2b-0a51f753e883 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:02.949876 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-df9c8faa-e553-4195-bd2b-0a51f753e883 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1509 microversion: 2.1 time: 0.629385 Sep 06 11:07:02.949876 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1840/3669] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:02 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1509 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:02.959403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5e6b99ad-cc8c-41d0-b504-7c5aa58ae852 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:02.960500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5e6b99ad-cc8c-41d0-b504-7c5aa58ae852 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:02.972917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e6b99ad-cc8c-41d0-b504-7c5aa58ae852 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:02.974548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e6b99ad-cc8c-41d0-b504-7c5aa58ae852 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:02.975416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e6b99ad-cc8c-41d0-b504-7c5aa58ae852 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:02.976558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e6b99ad-cc8c-41d0-b504-7c5aa58ae852 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:02.977514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e6b99ad-cc8c-41d0-b504-7c5aa58ae852 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:02.978377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e6b99ad-cc8c-41d0-b504-7c5aa58ae852 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:03.083789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fc00f302-b18c-4e48-913a-3adc831638e6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:03.097188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fc00f302-b18c-4e48-913a-3adc831638e6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:03.108550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fc00f302-b18c-4e48-913a-3adc831638e6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:03.110138 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fc00f302-b18c-4e48-913a-3adc831638e6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1371 microversion: 2.47 time: 0.417239 Sep 06 11:07:03.111596 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1830/3670] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:02 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1371 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:03.150781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5e6b99ad-cc8c-41d0-b504-7c5aa58ae852 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:03.163996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5e6b99ad-cc8c-41d0-b504-7c5aa58ae852 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:03.165506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5e6b99ad-cc8c-41d0-b504-7c5aa58ae852 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:03.178281 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5e6b99ad-cc8c-41d0-b504-7c5aa58ae852 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.225085 Sep 06 11:07:03.179418 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1841/3671] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:02 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:03.710208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-88ef6b8e-b824-4923-bb5b-67183e332c51 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:03.711446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-88ef6b8e-b824-4923-bb5b-67183e332c51 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:03.713501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:03.720151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88ef6b8e-b824-4923-bb5b-67183e332c51 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:03.720661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88ef6b8e-b824-4923-bb5b-67183e332c51 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:03.721109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88ef6b8e-b824-4923-bb5b-67183e332c51 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:03.721824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88ef6b8e-b824-4923-bb5b-67183e332c51 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:03.722432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88ef6b8e-b824-4923-bb5b-67183e332c51 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:03.723882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88ef6b8e-b824-4923-bb5b-67183e332c51 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:03.758220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:03.990302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4fbc1fdc-02cb-4c18-bbdd-93fe0e19a133 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:03.991143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4fbc1fdc-02cb-4c18-bbdd-93fe0e19a133 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:04.014874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fbc1fdc-02cb-4c18-bbdd-93fe0e19a133 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:04.014874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fbc1fdc-02cb-4c18-bbdd-93fe0e19a133 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:04.014874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fbc1fdc-02cb-4c18-bbdd-93fe0e19a133 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:04.014874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fbc1fdc-02cb-4c18-bbdd-93fe0e19a133 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:04.014874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fbc1fdc-02cb-4c18-bbdd-93fe0e19a133 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:04.014874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4fbc1fdc-02cb-4c18-bbdd-93fe0e19a133 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:04.200827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-88ef6b8e-b824-4923-bb5b-67183e332c51 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:04.214477 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-88ef6b8e-b824-4923-bb5b-67183e332c51 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1314 microversion: 2.1 time: 0.508143 Sep 06 11:07:04.232470 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1831/3672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:03 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:04.232470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0666b74e-7871-43f1-a7bc-6a5d77186fc5 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:04.232470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0666b74e-7871-43f1-a7bc-6a5d77186fc5 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:04.232470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0666b74e-7871-43f1-a7bc-6a5d77186fc5 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:04.232470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0666b74e-7871-43f1-a7bc-6a5d77186fc5 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:04.232886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0666b74e-7871-43f1-a7bc-6a5d77186fc5 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:04.234318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0666b74e-7871-43f1-a7bc-6a5d77186fc5 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:04.234795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0666b74e-7871-43f1-a7bc-6a5d77186fc5 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:04.236068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0666b74e-7871-43f1-a7bc-6a5d77186fc5 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:04.353080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0666b74e-7871-43f1-a7bc-6a5d77186fc5 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:04.358178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4fbc1fdc-02cb-4c18-bbdd-93fe0e19a133 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:04.362255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0666b74e-7871-43f1-a7bc-6a5d77186fc5 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:04.363749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0666b74e-7871-43f1-a7bc-6a5d77186fc5 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:04.364937 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0666b74e-7871-43f1-a7bc-6a5d77186fc5 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1356 microversion: 2.47 time: 0.147823 Sep 06 11:07:04.367320 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4fbc1fdc-02cb-4c18-bbdd-93fe0e19a133 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1509 microversion: 2.1 time: 0.394341 Sep 06 11:07:04.375672 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1842/3673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:03 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:04.376638 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1832/3674] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:04 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:04.388744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-33c4e687-6362-41d0-bb6a-fa6aea67e3af tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:04.389360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-33c4e687-6362-41d0-bb6a-fa6aea67e3af tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:04.392363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:04.398397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33c4e687-6362-41d0-bb6a-fa6aea67e3af tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:04.398508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:04.398910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33c4e687-6362-41d0-bb6a-fa6aea67e3af tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:04.399490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33c4e687-6362-41d0-bb6a-fa6aea67e3af tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:04.401918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33c4e687-6362-41d0-bb6a-fa6aea67e3af tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:04.401918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33c4e687-6362-41d0-bb6a-fa6aea67e3af tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:04.401918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33c4e687-6362-41d0-bb6a-fa6aea67e3af tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:04.404191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:04.405253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Searching by: {'deleted': False, 'project_id': 'dc50b9ebed5448079b548f6087330aa6'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:07:04.411738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:04.412385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:04.412979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:04.413991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:04.414669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:04.415344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:04.478399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-33c4e687-6362-41d0-bb6a-fa6aea67e3af tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:04.489877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-33c4e687-6362-41d0-bb6a-fa6aea67e3af tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:04.493447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-33c4e687-6362-41d0-bb6a-fa6aea67e3af tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:04.509845 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-33c4e687-6362-41d0-bb6a-fa6aea67e3af tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.135301 Sep 06 11:07:04.523740 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1843/3675] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:04 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:04.561970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:07:04.670990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:04.678623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:04.679480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:04.680148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:04.696495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:04.699459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:04.758392 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d46446ac-5216-4ddb-8bee-fc2fb1a71ba6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.363735 Sep 06 11:07:04.759925 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1833/3676] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Sep 6 11:07:04 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:04.794269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c61c91f-fae3-4e65-a2ab-1c3cb8060769 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:04.794759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1c61c91f-fae3-4e65-a2ab-1c3cb8060769 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:04.806411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c61c91f-fae3-4e65-a2ab-1c3cb8060769 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:04.806946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c61c91f-fae3-4e65-a2ab-1c3cb8060769 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:04.808038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c61c91f-fae3-4e65-a2ab-1c3cb8060769 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:04.808884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c61c91f-fae3-4e65-a2ab-1c3cb8060769 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:04.809287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c61c91f-fae3-4e65-a2ab-1c3cb8060769 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:04.809726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c61c91f-fae3-4e65-a2ab-1c3cb8060769 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:04.843273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1c61c91f-fae3-4e65-a2ab-1c3cb8060769 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:07:05.240546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-160218de-4dc9-48d4-a903-183bd3bba577 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:05.241179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-160218de-4dc9-48d4-a903-183bd3bba577 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:05.244214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:05.248417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-160218de-4dc9-48d4-a903-183bd3bba577 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:05.248918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-160218de-4dc9-48d4-a903-183bd3bba577 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:05.249373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-160218de-4dc9-48d4-a903-183bd3bba577 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:05.250096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-160218de-4dc9-48d4-a903-183bd3bba577 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:05.250570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-160218de-4dc9-48d4-a903-183bd3bba577 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:05.251052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-160218de-4dc9-48d4-a903-183bd3bba577 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:05.325013 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1c61c91f-fae3-4e65-a2ab-1c3cb8060769 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "DELETE /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 204 len: 0 microversion: 2.47 time: 0.533994 Sep 06 11:07:05.328762 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1844/3677] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:07:04 2022] DELETE /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:07:05.334166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f2eba5cd-417c-4412-9225-0add148284b3 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:05.340136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f2eba5cd-417c-4412-9225-0add148284b3 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:05.349348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2eba5cd-417c-4412-9225-0add148284b3 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:05.349348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2eba5cd-417c-4412-9225-0add148284b3 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:05.349348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2eba5cd-417c-4412-9225-0add148284b3 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:05.349348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2eba5cd-417c-4412-9225-0add148284b3 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:05.349955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2eba5cd-417c-4412-9225-0add148284b3 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:05.350386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2eba5cd-417c-4412-9225-0add148284b3 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:05.465362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f2eba5cd-417c-4412-9225-0add148284b3 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:05.488674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f2eba5cd-417c-4412-9225-0add148284b3 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:05.491180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f2eba5cd-417c-4412-9225-0add148284b3 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:05.492503 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f2eba5cd-417c-4412-9225-0add148284b3 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1362 microversion: 2.47 time: 0.162571 Sep 06 11:07:05.493508 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1845/3678] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:05 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:07:05.501268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-22bb2b16-a2e9-46c6-9cfa-0377533a7098 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:05.503370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-22bb2b16-a2e9-46c6-9cfa-0377533a7098 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:05.511472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22bb2b16-a2e9-46c6-9cfa-0377533a7098 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:05.512253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22bb2b16-a2e9-46c6-9cfa-0377533a7098 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:05.512909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22bb2b16-a2e9-46c6-9cfa-0377533a7098 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:05.514281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22bb2b16-a2e9-46c6-9cfa-0377533a7098 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:05.515221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22bb2b16-a2e9-46c6-9cfa-0377533a7098 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:05.515895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22bb2b16-a2e9-46c6-9cfa-0377533a7098 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:05.558764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-160218de-4dc9-48d4-a903-183bd3bba577 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:05.573358 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-160218de-4dc9-48d4-a903-183bd3bba577 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1314 microversion: 2.1 time: 0.336646 Sep 06 11:07:05.575198 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1834/3679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:05 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:05.584743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5ed35f43-9375-49b4-b88b-ea8b2682156a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:05.585676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5ed35f43-9375-49b4-b88b-ea8b2682156a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:05.603131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5ed35f43-9375-49b4-b88b-ea8b2682156a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:05.604897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5ed35f43-9375-49b4-b88b-ea8b2682156a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:05.605875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5ed35f43-9375-49b4-b88b-ea8b2682156a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:05.607543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5ed35f43-9375-49b4-b88b-ea8b2682156a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:05.608152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5ed35f43-9375-49b4-b88b-ea8b2682156a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:05.609507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5ed35f43-9375-49b4-b88b-ea8b2682156a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:05.728824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5ed35f43-9375-49b4-b88b-ea8b2682156a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:05.740255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5ed35f43-9375-49b4-b88b-ea8b2682156a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:05.741815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5ed35f43-9375-49b4-b88b-ea8b2682156a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:05.747092 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5ed35f43-9375-49b4-b88b-ea8b2682156a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.170450 Sep 06 11:07:05.748101 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1835/3680] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:05 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:05.802258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-22bb2b16-a2e9-46c6-9cfa-0377533a7098 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:05.810125 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-22bb2b16-a2e9-46c6-9cfa-0377533a7098 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1509 microversion: 2.1 time: 0.315052 Sep 06 11:07:05.810694 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1846/3681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:05 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:06.525526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d8c1c841-34f5-4f1c-b3d7-a2bbe24d28b6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:06.526191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d8c1c841-34f5-4f1c-b3d7-a2bbe24d28b6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:06.532649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8c1c841-34f5-4f1c-b3d7-a2bbe24d28b6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:06.533326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8c1c841-34f5-4f1c-b3d7-a2bbe24d28b6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:06.534069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8c1c841-34f5-4f1c-b3d7-a2bbe24d28b6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:06.535163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8c1c841-34f5-4f1c-b3d7-a2bbe24d28b6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:06.535772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8c1c841-34f5-4f1c-b3d7-a2bbe24d28b6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:06.536349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8c1c841-34f5-4f1c-b3d7-a2bbe24d28b6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:06.599057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-59a36d91-6d16-4040-9e3e-fc1eb23ca94f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:06.600323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-59a36d91-6d16-4040-9e3e-fc1eb23ca94f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:06.609188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59a36d91-6d16-4040-9e3e-fc1eb23ca94f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:06.609864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59a36d91-6d16-4040-9e3e-fc1eb23ca94f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:06.610446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59a36d91-6d16-4040-9e3e-fc1eb23ca94f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:06.611318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59a36d91-6d16-4040-9e3e-fc1eb23ca94f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:06.611911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59a36d91-6d16-4040-9e3e-fc1eb23ca94f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:06.612834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59a36d91-6d16-4040-9e3e-fc1eb23ca94f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:06.634801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d8c1c841-34f5-4f1c-b3d7-a2bbe24d28b6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:06.643810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d8c1c841-34f5-4f1c-b3d7-a2bbe24d28b6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:06.645457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d8c1c841-34f5-4f1c-b3d7-a2bbe24d28b6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:06.647609 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d8c1c841-34f5-4f1c-b3d7-a2bbe24d28b6 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1362 microversion: 2.47 time: 0.126823 Sep 06 11:07:06.659226 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1836/3682] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:06 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1362 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:06.776194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-906ea4c6-65f4-4d25-8513-da7119ff2fca tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:06.776829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-906ea4c6-65f4-4d25-8513-da7119ff2fca tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:06.788554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-906ea4c6-65f4-4d25-8513-da7119ff2fca tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:06.788554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-906ea4c6-65f4-4d25-8513-da7119ff2fca tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:06.788554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-906ea4c6-65f4-4d25-8513-da7119ff2fca tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:06.788966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-906ea4c6-65f4-4d25-8513-da7119ff2fca tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:06.789436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-906ea4c6-65f4-4d25-8513-da7119ff2fca tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:06.789875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-906ea4c6-65f4-4d25-8513-da7119ff2fca tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:07.163732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-906ea4c6-65f4-4d25-8513-da7119ff2fca tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:07.173637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-906ea4c6-65f4-4d25-8513-da7119ff2fca tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:07.175812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-906ea4c6-65f4-4d25-8513-da7119ff2fca tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:07.182105 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-906ea4c6-65f4-4d25-8513-da7119ff2fca tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.409751 Sep 06 11:07:07.183238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-59a36d91-6d16-4040-9e3e-fc1eb23ca94f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:07.183469 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1837/3683] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:06 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:07:07.188300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7e9d1e6c-0ab3-4f7d-88e8-626ba5359fab tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:07.189095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7e9d1e6c-0ab3-4f7d-88e8-626ba5359fab tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:07.194749 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-59a36d91-6d16-4040-9e3e-fc1eb23ca94f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1314 microversion: 2.1 time: 0.599529 Sep 06 11:07:07.196635 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1847/3684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:06 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:07.197201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e9d1e6c-0ab3-4f7d-88e8-626ba5359fab tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:07.197845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e9d1e6c-0ab3-4f7d-88e8-626ba5359fab tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:07.213188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e9d1e6c-0ab3-4f7d-88e8-626ba5359fab tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:07.213188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e9d1e6c-0ab3-4f7d-88e8-626ba5359fab tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:07.214100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e9d1e6c-0ab3-4f7d-88e8-626ba5359fab tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:07.214991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e9d1e6c-0ab3-4f7d-88e8-626ba5359fab tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:07.270981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-293072942", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "a3de7662-e9a7-4ef7-8131-31b8128a0fb3"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:07.342310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] validate_networks() for [('a3de7662-e9a7-4ef7-8131-31b8128a0fb3', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:07:07.467297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7e9d1e6c-0ab3-4f7d-88e8-626ba5359fab tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:07.492432 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7e9d1e6c-0ab3-4f7d-88e8-626ba5359fab tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1506 microversion: 2.1 time: 0.301175 Sep 06 11:07:07.507053 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1838/3685] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:07 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:07.681707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:07.683777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:07.691337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:07.692502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:07.692957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:07.693784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:07.694525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:07.694961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:07.730760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:07.731282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:07.731726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:07.732179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lazy-loading 'fault' on Instance uuid 547d3e0f-4c0f-4951-8bae-1e04bb9915a9 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:07.783501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:07.792902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:07.794395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:07.795655 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b1146592-cc13-4148-b2cc-d3a6ea91cfb0 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 200 len: 1367 microversion: 2.47 time: 0.118337 Sep 06 11:07:07.804945 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1839/3686] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:07 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 1367 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:07:07.806099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:07:07.806099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:07:07.806628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:07:07.806762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:07:07.807743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:07:07.816859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:07.817341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:07.817782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:07.818511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:07.818971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:07.819427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:07.836743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Getting quotas for project 534a6b8f7bb04d4e9e3493388bd1d86e. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:07:07.842528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Getting quotas for user 86e756626ac4446e907deba71a0ebeb2 and project 534a6b8f7bb04d4e9e3493388bd1d86e. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:07:07.855772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:07:07.858153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:07:08.027750 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1aac9ee9-78cb-4685-8885-608ddba51fa3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762137 Sep 06 11:07:08.028466 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1848/3687] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:07:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:07:08.039608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-df75292e-e2bb-46ec-8a7e-c7373d6d399a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:08.040235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-df75292e-e2bb-46ec-8a7e-c7373d6d399a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:08.106310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-df75292e-e2bb-46ec-8a7e-c7373d6d399a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:08.113918 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-df75292e-e2bb-46ec-8a7e-c7373d6d399a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1213 microversion: 2.1 time: 0.078156 Sep 06 11:07:08.114498 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1840/3688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:08 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:08.221174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ed40ca52-1489-499e-804b-d465a1bb32d5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:08.222027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a74abecb-0abc-40a5-8084-69e2e7d72c4c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:08.222308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ed40ca52-1489-499e-804b-d465a1bb32d5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:08.222664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a74abecb-0abc-40a5-8084-69e2e7d72c4c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:08.230945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed40ca52-1489-499e-804b-d465a1bb32d5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:08.232413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed40ca52-1489-499e-804b-d465a1bb32d5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:08.233051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed40ca52-1489-499e-804b-d465a1bb32d5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:08.233976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed40ca52-1489-499e-804b-d465a1bb32d5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:08.234627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed40ca52-1489-499e-804b-d465a1bb32d5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:08.235368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed40ca52-1489-499e-804b-d465a1bb32d5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:08.240660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a74abecb-0abc-40a5-8084-69e2e7d72c4c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:08.240660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a74abecb-0abc-40a5-8084-69e2e7d72c4c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:08.240859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:08.241598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a74abecb-0abc-40a5-8084-69e2e7d72c4c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:08.242376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a74abecb-0abc-40a5-8084-69e2e7d72c4c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:08.242859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a74abecb-0abc-40a5-8084-69e2e7d72c4c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:08.246367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a74abecb-0abc-40a5-8084-69e2e7d72c4c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:08.355334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a74abecb-0abc-40a5-8084-69e2e7d72c4c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:08.376121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a74abecb-0abc-40a5-8084-69e2e7d72c4c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:08.379147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a74abecb-0abc-40a5-8084-69e2e7d72c4c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:08.384445 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a74abecb-0abc-40a5-8084-69e2e7d72c4c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.166357 Sep 06 11:07:08.385045 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1841/3689] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:08 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:07:08.415156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ed40ca52-1489-499e-804b-d465a1bb32d5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:08.433295 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ed40ca52-1489-499e-804b-d465a1bb32d5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1314 microversion: 2.1 time: 0.206575 Sep 06 11:07:08.433295 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1849/3690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:08 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:08.517558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e0a91d6-d4fa-4bc4-94c5-64dd2d986a64 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:08.518193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5e0a91d6-d4fa-4bc4-94c5-64dd2d986a64 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:08.524343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0a91d6-d4fa-4bc4-94c5-64dd2d986a64 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:08.524841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0a91d6-d4fa-4bc4-94c5-64dd2d986a64 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:08.525342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0a91d6-d4fa-4bc4-94c5-64dd2d986a64 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:08.526629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0a91d6-d4fa-4bc4-94c5-64dd2d986a64 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:08.527072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0a91d6-d4fa-4bc4-94c5-64dd2d986a64 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:08.527514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0a91d6-d4fa-4bc4-94c5-64dd2d986a64 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:08.679728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5e0a91d6-d4fa-4bc4-94c5-64dd2d986a64 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:08.688734 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5e0a91d6-d4fa-4bc4-94c5-64dd2d986a64 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1506 microversion: 2.1 time: 0.175089 Sep 06 11:07:08.690036 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1842/3691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:08 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:08.721719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-d2592da1-d229-4e74-9b20-6b3c30685ccb req-a2a2dac6-78f4-49a5-9174-45e62efe4705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d78eee-0953-4593-b34f-271f88c7125b", "name": "network-vif-plugged", "status": "completed", "tag": "a5cc4081-f537-4898-af7a-401941c6fe02"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:08.734037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d2592da1-d229-4e74-9b20-6b3c30685ccb req-a2a2dac6-78f4-49a5-9174-45e62efe4705 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:08.735674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d2592da1-d229-4e74-9b20-6b3c30685ccb req-a2a2dac6-78f4-49a5-9174-45e62efe4705 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:08.735674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d2592da1-d229-4e74-9b20-6b3c30685ccb req-a2a2dac6-78f4-49a5-9174-45e62efe4705 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:08.746003 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-d2592da1-d229-4e74-9b20-6b3c30685ccb req-a2a2dac6-78f4-49a5-9174-45e62efe4705 service nova] Creating event network-vif-plugged:a5cc4081-f537-4898-af7a-401941c6fe02 for instance d8d78eee-0953-4593-b34f-271f88c7125b on nch2-master-1 Sep 06 11:07:08.750797 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-d2592da1-d229-4e74-9b20-6b3c30685ccb req-a2a2dac6-78f4-49a5-9174-45e62efe4705 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033252 Sep 06 11:07:08.751432 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1850/3692] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:08.827003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-789d7a95-254d-4c9d-a9ea-0db70d799acb tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:08.827647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-789d7a95-254d-4c9d-a9ea-0db70d799acb tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 547d3e0f-4c0f-4951-8bae-1e04bb9915a9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:08.836030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-789d7a95-254d-4c9d-a9ea-0db70d799acb tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:08.836749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-789d7a95-254d-4c9d-a9ea-0db70d799acb tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:08.837546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-789d7a95-254d-4c9d-a9ea-0db70d799acb tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:08.838263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-789d7a95-254d-4c9d-a9ea-0db70d799acb tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:08.839645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-789d7a95-254d-4c9d-a9ea-0db70d799acb tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:08.840219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-789d7a95-254d-4c9d-a9ea-0db70d799acb tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:08.861304 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-789d7a95-254d-4c9d-a9ea-0db70d799acb tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] HTTP exception thrown: Instance 547d3e0f-4c0f-4951-8bae-1e04bb9915a9 could not be found. Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-789d7a95-254d-4c9d-a9ea-0db70d799acb tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Request method failure captured: Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 HTTP/1.1 Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFymsGD6mBhO9JS9wLWD4YalqF_h9ayjwBsy56MDRG7MzYIr_0XpbNkXta5f4tkeYZYYbqcmxEY7XI93X-17wE9Ck4rsKGc5rqpjZH0eGND5YiR_VmBrEmpSJbW9sx3zh_3yO2X87IZTwF2NHBgu0T8aV5ITKB4DXlTUU64Yy8zw3BIo Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Openstack-Nova-Api-Version: 2.47 Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: dc50b9ebed5448079b548f6087330aa6 Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerShowV247Test-1848086445 Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc50b9ebed5448079b548f6087330aa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc50b9ebed5448079b548f6087330aa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc50b9ebed5448079b548f6087330aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc50b9ebed5448079b548f6087330aa6"}]}] Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerShowV247Test-1848086445 Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: dc50b9ebed5448079b548f6087330aa6 Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerShowV247Test-1848086445 Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerShowV247Test-1848086445-project Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6ec3877b92b943dc85a7f656b4db93ca Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerShowV247Test-1848086445-project Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 547d3e0f-4c0f-4951-8bae-1e04bb9915a9 could not be found. Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '547d3e0f-4c0f-4951-8bae-1e04bb9915a9'} Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 547d3e0f-4c0f-4951-8bae-1e04bb9915a9 could not be found. Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 547d3e0f-4c0f-4951-8bae-1e04bb9915a9 could not be found. Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:08.863260 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:08.866425 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:08.866425 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:08.866425 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:08.866425 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:07:08.866425 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:07:08.866425 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 547d3e0f-4c0f-4951-8bae-1e04bb9915a9 could not be found. Sep 06 11:07:08.866425 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:08.866425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-789d7a95-254d-4c9d-a9ea-0db70d799acb tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Returning 404 to user: Instance 547d3e0f-4c0f-4951-8bae-1e04bb9915a9 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:07:08.866425 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-789d7a95-254d-4c9d-a9ea-0db70d799acb tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9" status: 404 len: 111 microversion: 2.47 time: 0.045992 Sep 06 11:07:08.866425 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1843/3693] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:08 2022] GET /compute/v2.1/servers/547d3e0f-4c0f-4951-8bae-1e04bb9915a9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:07:08.875376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-91476125-a865-4dd8-a12b-f81a210119f4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:08.876833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-91476125-a865-4dd8-a12b-f81a210119f4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 549cea0b-4d4c-48f2-b7d4-12caa020ef87] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:08.891955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91476125-a865-4dd8-a12b-f81a210119f4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:08.891955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91476125-a865-4dd8-a12b-f81a210119f4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:08.891955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91476125-a865-4dd8-a12b-f81a210119f4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:08.891955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91476125-a865-4dd8-a12b-f81a210119f4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:08.891955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91476125-a865-4dd8-a12b-f81a210119f4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:08.891955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91476125-a865-4dd8-a12b-f81a210119f4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:08.927095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-91476125-a865-4dd8-a12b-f81a210119f4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 549cea0b-4d4c-48f2-b7d4-12caa020ef87] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:07:09.138774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1213bfbd-08ef-472d-8780-f768133b8da4 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:09.139366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1213bfbd-08ef-472d-8780-f768133b8da4 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:09.194501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1213bfbd-08ef-472d-8780-f768133b8da4 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:09.202204 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1213bfbd-08ef-472d-8780-f768133b8da4 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1213 microversion: 2.1 time: 0.068904 Sep 06 11:07:09.202787 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1844/3694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:09 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:09.335033 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-91476125-a865-4dd8-a12b-f81a210119f4 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "DELETE /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87" status: 204 len: 0 microversion: 2.47 time: 0.464967 Sep 06 11:07:09.335652 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1851/3695] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:07:08 2022] DELETE /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:07:09.343949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-97d8dc9b-3a8b-4017-a33e-552e371a2f90 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:09.344579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-97d8dc9b-3a8b-4017-a33e-552e371a2f90 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 549cea0b-4d4c-48f2-b7d4-12caa020ef87] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:09.351953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97d8dc9b-3a8b-4017-a33e-552e371a2f90 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:09.352454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97d8dc9b-3a8b-4017-a33e-552e371a2f90 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:09.352912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97d8dc9b-3a8b-4017-a33e-552e371a2f90 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:09.353639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97d8dc9b-3a8b-4017-a33e-552e371a2f90 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:09.354132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97d8dc9b-3a8b-4017-a33e-552e371a2f90 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:09.354569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97d8dc9b-3a8b-4017-a33e-552e371a2f90 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:09.416042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5041a6de-4362-461d-b303-6c4b7894bc6e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:09.417096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5041a6de-4362-461d-b303-6c4b7894bc6e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:09.424037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5041a6de-4362-461d-b303-6c4b7894bc6e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:09.424969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5041a6de-4362-461d-b303-6c4b7894bc6e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:09.425521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5041a6de-4362-461d-b303-6c4b7894bc6e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:09.426348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5041a6de-4362-461d-b303-6c4b7894bc6e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:09.426925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5041a6de-4362-461d-b303-6c4b7894bc6e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:09.427219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-97d8dc9b-3a8b-4017-a33e-552e371a2f90 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:09.427633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5041a6de-4362-461d-b303-6c4b7894bc6e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:09.438606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-97d8dc9b-3a8b-4017-a33e-552e371a2f90 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:09.440288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-97d8dc9b-3a8b-4017-a33e-552e371a2f90 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:09.441938 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-97d8dc9b-3a8b-4017-a33e-552e371a2f90 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87" status: 200 len: 1362 microversion: 2.47 time: 0.101625 Sep 06 11:07:09.444233 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1845/3696] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:09 2022] GET /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87 => generated 1362 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:09.449861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0678dda4-8c73-48a8-81e8-84e9fb7f1fd1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:09.450542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0678dda4-8c73-48a8-81e8-84e9fb7f1fd1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:09.457102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0678dda4-8c73-48a8-81e8-84e9fb7f1fd1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:09.457600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0678dda4-8c73-48a8-81e8-84e9fb7f1fd1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:09.458056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0678dda4-8c73-48a8-81e8-84e9fb7f1fd1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:09.458898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0678dda4-8c73-48a8-81e8-84e9fb7f1fd1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:09.459390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0678dda4-8c73-48a8-81e8-84e9fb7f1fd1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:09.459832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0678dda4-8c73-48a8-81e8-84e9fb7f1fd1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:09.565680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5041a6de-4362-461d-b303-6c4b7894bc6e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:09.575801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5041a6de-4362-461d-b303-6c4b7894bc6e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:09.577423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5041a6de-4362-461d-b303-6c4b7894bc6e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:09.584398 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5041a6de-4362-461d-b303-6c4b7894bc6e tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.172763 Sep 06 11:07:09.595044 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1852/3697] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:09 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:07:09.645874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0678dda4-8c73-48a8-81e8-84e9fb7f1fd1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:09.654906 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0678dda4-8c73-48a8-81e8-84e9fb7f1fd1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1314 microversion: 2.1 time: 0.209454 Sep 06 11:07:09.655834 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1846/3698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:09 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:09.712429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-de45d4ce-d4d9-4750-9d68-2333c5409b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:09.713292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-de45d4ce-d4d9-4750-9d68-2333c5409b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:09.719752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de45d4ce-d4d9-4750-9d68-2333c5409b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:09.720373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de45d4ce-d4d9-4750-9d68-2333c5409b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:09.720929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de45d4ce-d4d9-4750-9d68-2333c5409b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:09.721755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de45d4ce-d4d9-4750-9d68-2333c5409b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:09.722704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de45d4ce-d4d9-4750-9d68-2333c5409b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:09.723403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de45d4ce-d4d9-4750-9d68-2333c5409b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:09.866826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-de45d4ce-d4d9-4750-9d68-2333c5409b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:09.875386 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-de45d4ce-d4d9-4750-9d68-2333c5409b88 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 200 len: 1509 microversion: 2.1 time: 0.167128 Sep 06 11:07:09.890358 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1853/3699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:09 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:09.898452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1de485c5-fa6b-47a7-a8bf-b1f80e77a7ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:09.899102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1de485c5-fa6b-47a7-a8bf-b1f80e77a7ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:09.908172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de485c5-fa6b-47a7-a8bf-b1f80e77a7ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:09.908857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de485c5-fa6b-47a7-a8bf-b1f80e77a7ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:09.909315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de485c5-fa6b-47a7-a8bf-b1f80e77a7ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:09.910324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de485c5-fa6b-47a7-a8bf-b1f80e77a7ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:09.910942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de485c5-fa6b-47a7-a8bf-b1f80e77a7ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:09.911420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de485c5-fa6b-47a7-a8bf-b1f80e77a7ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.058374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1de485c5-fa6b-47a7-a8bf-b1f80e77a7ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:10.068269 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1de485c5-fa6b-47a7-a8bf-b1f80e77a7ba tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.173730 Sep 06 11:07:10.068873 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1847/3700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:09 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:10.101306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ea383380-26aa-4ac6-8ea4-1055a781535b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:10.102084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ea383380-26aa-4ac6-8ea4-1055a781535b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:10.111532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea383380-26aa-4ac6-8ea4-1055a781535b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.112383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea383380-26aa-4ac6-8ea4-1055a781535b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.113318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea383380-26aa-4ac6-8ea4-1055a781535b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.114192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea383380-26aa-4ac6-8ea4-1055a781535b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.114753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea383380-26aa-4ac6-8ea4-1055a781535b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.118571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea383380-26aa-4ac6-8ea4-1055a781535b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.237445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-648aef67-e178-4ce5-be5b-94fed22029b3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:10.238837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-648aef67-e178-4ce5-be5b-94fed22029b3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:10.264720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-648aef67-e178-4ce5-be5b-94fed22029b3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.267150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-648aef67-e178-4ce5-be5b-94fed22029b3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.268180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-648aef67-e178-4ce5-be5b-94fed22029b3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.270591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-648aef67-e178-4ce5-be5b-94fed22029b3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.273752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-648aef67-e178-4ce5-be5b-94fed22029b3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.275777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-648aef67-e178-4ce5-be5b-94fed22029b3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.294218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ea383380-26aa-4ac6-8ea4-1055a781535b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:10.305124 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ea383380-26aa-4ac6-8ea4-1055a781535b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.208237 Sep 06 11:07:10.324926 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1854/3701] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:10 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:10.330886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-46c01f59-0802-4657-b958-c7c52485d226 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:10.331724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-46c01f59-0802-4657-b958-c7c52485d226 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:10.338191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46c01f59-0802-4657-b958-c7c52485d226 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.339566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46c01f59-0802-4657-b958-c7c52485d226 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.340152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46c01f59-0802-4657-b958-c7c52485d226 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.341000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46c01f59-0802-4657-b958-c7c52485d226 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.341589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46c01f59-0802-4657-b958-c7c52485d226 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.342147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46c01f59-0802-4657-b958-c7c52485d226 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.357191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-648aef67-e178-4ce5-be5b-94fed22029b3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:10.366717 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-648aef67-e178-4ce5-be5b-94fed22029b3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1209 microversion: 2.1 time: 0.142937 Sep 06 11:07:10.367347 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1848/3702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:10 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1209 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:10.470772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-39af8e98-1c77-414a-abb9-d6085d2aeb92 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:10.471495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-39af8e98-1c77-414a-abb9-d6085d2aeb92 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 549cea0b-4d4c-48f2-b7d4-12caa020ef87] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:10.477726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39af8e98-1c77-414a-abb9-d6085d2aeb92 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.478219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39af8e98-1c77-414a-abb9-d6085d2aeb92 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.478661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39af8e98-1c77-414a-abb9-d6085d2aeb92 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.479407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39af8e98-1c77-414a-abb9-d6085d2aeb92 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.479870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39af8e98-1c77-414a-abb9-d6085d2aeb92 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.480305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39af8e98-1c77-414a-abb9-d6085d2aeb92 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.496159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:10.563337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-39af8e98-1c77-414a-abb9-d6085d2aeb92 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:10.572509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-39af8e98-1c77-414a-abb9-d6085d2aeb92 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:10.574791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-39af8e98-1c77-414a-abb9-d6085d2aeb92 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:10.576225 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-39af8e98-1c77-414a-abb9-d6085d2aeb92 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87" status: 200 len: 1362 microversion: 2.47 time: 0.109626 Sep 06 11:07:10.576975 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1849/3703] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:10 2022] GET /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87 => generated 1362 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:07:10.612320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-46c01f59-0802-4657-b958-c7c52485d226 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:10.613514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5c2877b5-9d93-4c9a-89f4-21bff8642b4b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:10.620343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5c2877b5-9d93-4c9a-89f4-21bff8642b4b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:10.621313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c2877b5-9d93-4c9a-89f4-21bff8642b4b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.621814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c2877b5-9d93-4c9a-89f4-21bff8642b4b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.622324 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-46c01f59-0802-4657-b958-c7c52485d226 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.295370 Sep 06 11:07:10.622439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c2877b5-9d93-4c9a-89f4-21bff8642b4b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.627040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c2877b5-9d93-4c9a-89f4-21bff8642b4b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.627167 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1855/3704] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:10 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:10.627251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c2877b5-9d93-4c9a-89f4-21bff8642b4b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.627251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c2877b5-9d93-4c9a-89f4-21bff8642b4b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.646443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e3a8c706-107c-4f84-a847-f6d7b866136c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:10.647146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e3a8c706-107c-4f84-a847-f6d7b866136c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:10.653592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3a8c706-107c-4f84-a847-f6d7b866136c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.654349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3a8c706-107c-4f84-a847-f6d7b866136c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.654939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3a8c706-107c-4f84-a847-f6d7b866136c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.655833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3a8c706-107c-4f84-a847-f6d7b866136c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.656492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3a8c706-107c-4f84-a847-f6d7b866136c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.657095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3a8c706-107c-4f84-a847-f6d7b866136c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.746781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5c2877b5-9d93-4c9a-89f4-21bff8642b4b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:10.755869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5c2877b5-9d93-4c9a-89f4-21bff8642b4b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:10.758010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5c2877b5-9d93-4c9a-89f4-21bff8642b4b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:10.764530 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5c2877b5-9d93-4c9a-89f4-21bff8642b4b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.155071 Sep 06 11:07:10.765264 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1850/3705] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:10 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:10.770105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fa20cce0-58fd-4629-8802-84cc5fa3c560 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:10.770863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fa20cce0-58fd-4629-8802-84cc5fa3c560 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:10.778188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa20cce0-58fd-4629-8802-84cc5fa3c560 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.778826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa20cce0-58fd-4629-8802-84cc5fa3c560 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.783468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa20cce0-58fd-4629-8802-84cc5fa3c560 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.783468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa20cce0-58fd-4629-8802-84cc5fa3c560 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.783468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa20cce0-58fd-4629-8802-84cc5fa3c560 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.783468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa20cce0-58fd-4629-8802-84cc5fa3c560 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.893258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e3a8c706-107c-4f84-a847-f6d7b866136c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:10.915489 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e3a8c706-107c-4f84-a847-f6d7b866136c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.259227 Sep 06 11:07:10.915489 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1856/3706] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:10 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:10.915489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-09062421-20c7-4cb7-9a76-ffb975b32e7a req-a5e5221b-bc06-4ee6-8ccd-876e3f03874a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79338947-1b4d-41ad-a75d-6f1141500c45", "name": "network-vif-unplugged", "status": "completed", "tag": "3d2d3924-0410-4fb4-aecd-20198e16c4f1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:10.923299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-09062421-20c7-4cb7-9a76-ffb975b32e7a req-a5e5221b-bc06-4ee6-8ccd-876e3f03874a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.923925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-09062421-20c7-4cb7-9a76-ffb975b32e7a req-a5e5221b-bc06-4ee6-8ccd-876e3f03874a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.924528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-09062421-20c7-4cb7-9a76-ffb975b32e7a req-a5e5221b-bc06-4ee6-8ccd-876e3f03874a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.938253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.compute.server_external_events [req-09062421-20c7-4cb7-9a76-ffb975b32e7a req-a5e5221b-bc06-4ee6-8ccd-876e3f03874a service nova] Unable to find a host for instance 79338947-1b4d-41ad-a75d-6f1141500c45. Dropping event network-vif-unplugged {{(pid=140875) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 06 11:07:10.939193 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-09062421-20c7-4cb7-9a76-ffb975b32e7a req-a5e5221b-bc06-4ee6-8ccd-876e3f03874a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035809 Sep 06 11:07:10.939787 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1857/3707] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 06 11:07:10.944367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-af28c4fd-3028-4992-8eef-dcd3cb7c935d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:10.951087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af28c4fd-3028-4992-8eef-dcd3cb7c935d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:10.951587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af28c4fd-3028-4992-8eef-dcd3cb7c935d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:10.952036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af28c4fd-3028-4992-8eef-dcd3cb7c935d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:10.975204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-af28c4fd-3028-4992-8eef-dcd3cb7c935d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Going to try to stop instance {{(pid=140875) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 11:07:11.005481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fa20cce0-58fd-4629-8802-84cc5fa3c560 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:11.013599 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fa20cce0-58fd-4629-8802-84cc5fa3c560 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1500 microversion: 2.1 time: 0.247239 Sep 06 11:07:11.014180 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1851/3708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:10 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1500 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:11.036575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-569142f2-5c17-419a-90dd-a6848285d1c3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:11.038978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-569142f2-5c17-419a-90dd-a6848285d1c3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:11.045531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569142f2-5c17-419a-90dd-a6848285d1c3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:11.046025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569142f2-5c17-419a-90dd-a6848285d1c3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:11.046476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569142f2-5c17-419a-90dd-a6848285d1c3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:11.047254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569142f2-5c17-419a-90dd-a6848285d1c3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:11.047723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569142f2-5c17-419a-90dd-a6848285d1c3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:11.048161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569142f2-5c17-419a-90dd-a6848285d1c3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:11.074019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-569142f2-5c17-419a-90dd-a6848285d1c3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'flavor' on Instance uuid d8d78eee-0953-4593-b34f-271f88c7125b {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:11.190157 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-af28c4fd-3028-4992-8eef-dcd3cb7c935d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.249099 Sep 06 11:07:11.192153 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1858/3709] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:07:10 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:07:11.209837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9251d76-bbf2-47b2-817a-ae5ac9b33650 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:11.210554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e9251d76-bbf2-47b2-817a-ae5ac9b33650 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:11.230581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9251d76-bbf2-47b2-817a-ae5ac9b33650 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:11.231137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9251d76-bbf2-47b2-817a-ae5ac9b33650 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:11.231618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9251d76-bbf2-47b2-817a-ae5ac9b33650 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:11.232345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9251d76-bbf2-47b2-817a-ae5ac9b33650 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:11.233092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9251d76-bbf2-47b2-817a-ae5ac9b33650 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:11.233267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e9251d76-bbf2-47b2-817a-ae5ac9b33650 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:11.384503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e9251d76-bbf2-47b2-817a-ae5ac9b33650 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:11.393596 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e9251d76-bbf2-47b2-817a-ae5ac9b33650 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.187973 Sep 06 11:07:11.401812 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1859/3710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:11 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:11.401812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c2dcf24f-078f-4994-9214-dfe3893ed5a7 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:11.401812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c2dcf24f-078f-4994-9214-dfe3893ed5a7 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:11.409244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2dcf24f-078f-4994-9214-dfe3893ed5a7 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:11.410368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2dcf24f-078f-4994-9214-dfe3893ed5a7 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:11.412068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2dcf24f-078f-4994-9214-dfe3893ed5a7 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:11.413262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2dcf24f-078f-4994-9214-dfe3893ed5a7 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:11.413738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2dcf24f-078f-4994-9214-dfe3893ed5a7 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:11.414176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2dcf24f-078f-4994-9214-dfe3893ed5a7 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:11.466285 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-569142f2-5c17-419a-90dd-a6848285d1c3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "POST /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b/action" status: 200 len: 32 microversion: 2.1 time: 0.433538 Sep 06 11:07:11.466986 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1852/3711] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:07:11 2022] POST /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b/action => generated 32 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 11:07:11.476864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-65abe0af-ab60-430e-bc71-d3c1be4d75c5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:11.477591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-65abe0af-ab60-430e-bc71-d3c1be4d75c5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:11.489801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65abe0af-ab60-430e-bc71-d3c1be4d75c5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:11.491106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65abe0af-ab60-430e-bc71-d3c1be4d75c5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:11.492451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65abe0af-ab60-430e-bc71-d3c1be4d75c5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:11.493424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65abe0af-ab60-430e-bc71-d3c1be4d75c5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:11.494834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65abe0af-ab60-430e-bc71-d3c1be4d75c5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:11.495526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65abe0af-ab60-430e-bc71-d3c1be4d75c5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:11.503785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c2dcf24f-078f-4994-9214-dfe3893ed5a7 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:11.513471 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c2dcf24f-078f-4994-9214-dfe3893ed5a7 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1273 microversion: 2.1 time: 0.116848 Sep 06 11:07:11.514520 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1860/3712] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:11 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:11.607038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9e4898cb-6267-4d98-b1c4-c47a07759a5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:11.609375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9e4898cb-6267-4d98-b1c4-c47a07759a5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 549cea0b-4d4c-48f2-b7d4-12caa020ef87] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:11.616198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e4898cb-6267-4d98-b1c4-c47a07759a5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:11.616843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e4898cb-6267-4d98-b1c4-c47a07759a5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:11.617537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e4898cb-6267-4d98-b1c4-c47a07759a5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:11.618392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e4898cb-6267-4d98-b1c4-c47a07759a5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:11.618963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e4898cb-6267-4d98-b1c4-c47a07759a5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:11.619547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e4898cb-6267-4d98-b1c4-c47a07759a5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:11.717113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-65abe0af-ab60-430e-bc71-d3c1be4d75c5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:11.726018 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-65abe0af-ab60-430e-bc71-d3c1be4d75c5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.253304 Sep 06 11:07:11.726803 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1853/3713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:11 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:11.741765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9e4898cb-6267-4d98-b1c4-c47a07759a5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:11.750304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9e4898cb-6267-4d98-b1c4-c47a07759a5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:11.751998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9e4898cb-6267-4d98-b1c4-c47a07759a5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:11.753165 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9e4898cb-6267-4d98-b1c4-c47a07759a5a tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87" status: 200 len: 1362 microversion: 2.47 time: 0.154650 Sep 06 11:07:11.753725 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1861/3714] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:11 2022] GET /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:07:11.796114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eb485db2-cf39-4b0d-8ef3-7693f32bfefb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:11.796945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eb485db2-cf39-4b0d-8ef3-7693f32bfefb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:11.802934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb485db2-cf39-4b0d-8ef3-7693f32bfefb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:11.803468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb485db2-cf39-4b0d-8ef3-7693f32bfefb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:11.803956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb485db2-cf39-4b0d-8ef3-7693f32bfefb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:11.804670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb485db2-cf39-4b0d-8ef3-7693f32bfefb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:11.805141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb485db2-cf39-4b0d-8ef3-7693f32bfefb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:11.805584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb485db2-cf39-4b0d-8ef3-7693f32bfefb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:11.883453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eb485db2-cf39-4b0d-8ef3-7693f32bfefb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:11.898472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eb485db2-cf39-4b0d-8ef3-7693f32bfefb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:11.900295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eb485db2-cf39-4b0d-8ef3-7693f32bfefb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:11.908175 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eb485db2-cf39-4b0d-8ef3-7693f32bfefb tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.116101 Sep 06 11:07:11.908959 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1854/3715] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:11 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:12.421868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ac3b151b-dfb4-4839-ba58-75ed481c454b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:12.423996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ac3b151b-dfb4-4839-ba58-75ed481c454b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:12.443626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac3b151b-dfb4-4839-ba58-75ed481c454b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:12.444429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac3b151b-dfb4-4839-ba58-75ed481c454b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:12.444889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac3b151b-dfb4-4839-ba58-75ed481c454b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:12.445674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac3b151b-dfb4-4839-ba58-75ed481c454b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:12.446330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac3b151b-dfb4-4839-ba58-75ed481c454b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:12.449103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac3b151b-dfb4-4839-ba58-75ed481c454b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:12.537983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c4e4f86a-0490-4dad-909c-0a16f19d6a3b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:12.538763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c4e4f86a-0490-4dad-909c-0a16f19d6a3b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:12.548584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4e4f86a-0490-4dad-909c-0a16f19d6a3b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:12.549624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4e4f86a-0490-4dad-909c-0a16f19d6a3b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:12.550242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4e4f86a-0490-4dad-909c-0a16f19d6a3b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:12.551257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4e4f86a-0490-4dad-909c-0a16f19d6a3b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:12.554150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4e4f86a-0490-4dad-909c-0a16f19d6a3b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:12.559370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4e4f86a-0490-4dad-909c-0a16f19d6a3b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:12.656138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c4e4f86a-0490-4dad-909c-0a16f19d6a3b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:12.672330 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c4e4f86a-0490-4dad-909c-0a16f19d6a3b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1271 microversion: 2.1 time: 0.138357 Sep 06 11:07:12.686544 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1855/3716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:12 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:12.710298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ac3b151b-dfb4-4839-ba58-75ed481c454b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:12.718867 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ac3b151b-dfb4-4839-ba58-75ed481c454b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.303331 Sep 06 11:07:12.719925 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1862/3717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:12 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:12.751768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9de94479-939c-498f-a042-4eb69d0c4e19 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:12.752319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9de94479-939c-498f-a042-4eb69d0c4e19 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:12.758971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9de94479-939c-498f-a042-4eb69d0c4e19 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:12.759815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9de94479-939c-498f-a042-4eb69d0c4e19 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:12.760357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9de94479-939c-498f-a042-4eb69d0c4e19 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:12.761428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9de94479-939c-498f-a042-4eb69d0c4e19 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:12.762032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9de94479-939c-498f-a042-4eb69d0c4e19 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:12.770702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9de94479-939c-498f-a042-4eb69d0c4e19 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:12.780553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:12.781895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 549cea0b-4d4c-48f2-b7d4-12caa020ef87] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:12.790874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:12.792452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:12.793141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:12.794409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:12.797397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:12.797397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:12.853468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:12.854648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:12.855305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:12.855765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lazy-loading 'fault' on Instance uuid 549cea0b-4d4c-48f2-b7d4-12caa020ef87 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:12.934796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:12.943852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:12.945316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec3877b92b943dc85a7f656b4db93ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc50b9ebed5448079b548f6087330aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:12.946543 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-12199ab6-7b18-471f-b489-b04f12c55887 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87" status: 200 len: 1367 microversion: 2.47 time: 0.170631 Sep 06 11:07:12.957507 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1863/3718] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:12 2022] GET /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:12.957507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c6e185d1-bb5e-465f-86c8-332e7c8b219f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:12.957507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c6e185d1-bb5e-465f-86c8-332e7c8b219f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:12.965449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6e185d1-bb5e-465f-86c8-332e7c8b219f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:12.966105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6e185d1-bb5e-465f-86c8-332e7c8b219f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:12.966768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6e185d1-bb5e-465f-86c8-332e7c8b219f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:12.967767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6e185d1-bb5e-465f-86c8-332e7c8b219f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:12.968782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6e185d1-bb5e-465f-86c8-332e7c8b219f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:12.969513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c6e185d1-bb5e-465f-86c8-332e7c8b219f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:12.975110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:13.055359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c6e185d1-bb5e-465f-86c8-332e7c8b219f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:13.059993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9de94479-939c-498f-a042-4eb69d0c4e19 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:13.063894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c6e185d1-bb5e-465f-86c8-332e7c8b219f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:13.066607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c6e185d1-bb5e-465f-86c8-332e7c8b219f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:13.071893 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9de94479-939c-498f-a042-4eb69d0c4e19 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.324391 Sep 06 11:07:13.073732 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1856/3719] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:12 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:13.091150 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c6e185d1-bb5e-465f-86c8-332e7c8b219f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.142494 Sep 06 11:07:13.091941 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1864/3720] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:12 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:13.698975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c67609f4-5990-467d-a13c-aa2d56dd83bf tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:13.700532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c67609f4-5990-467d-a13c-aa2d56dd83bf tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:13.710700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c67609f4-5990-467d-a13c-aa2d56dd83bf tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:13.711583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c67609f4-5990-467d-a13c-aa2d56dd83bf tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:13.712310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c67609f4-5990-467d-a13c-aa2d56dd83bf tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:13.713442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c67609f4-5990-467d-a13c-aa2d56dd83bf tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:13.714144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c67609f4-5990-467d-a13c-aa2d56dd83bf tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:13.714805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c67609f4-5990-467d-a13c-aa2d56dd83bf tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:13.743605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9074e515-dca4-4e3b-bcea-306ba318e8e9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:13.744362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9074e515-dca4-4e3b-bcea-306ba318e8e9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:13.759412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9074e515-dca4-4e3b-bcea-306ba318e8e9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:13.760722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9074e515-dca4-4e3b-bcea-306ba318e8e9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:13.761368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9074e515-dca4-4e3b-bcea-306ba318e8e9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:13.762195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9074e515-dca4-4e3b-bcea-306ba318e8e9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:13.762669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9074e515-dca4-4e3b-bcea-306ba318e8e9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:13.763150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9074e515-dca4-4e3b-bcea-306ba318e8e9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:14.094669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c67609f4-5990-467d-a13c-aa2d56dd83bf tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:14.108069 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c67609f4-5990-467d-a13c-aa2d56dd83bf tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1313 microversion: 2.1 time: 0.415412 Sep 06 11:07:14.123858 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1857/3721] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:13 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:14.130823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b2fec3ba-c045-40d7-8ac6-66f0e0c78186 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:14.131515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b2fec3ba-c045-40d7-8ac6-66f0e0c78186 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] [instance: 549cea0b-4d4c-48f2-b7d4-12caa020ef87] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:14.139397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fec3ba-c045-40d7-8ac6-66f0e0c78186 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:14.140108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fec3ba-c045-40d7-8ac6-66f0e0c78186 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:14.140727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fec3ba-c045-40d7-8ac6-66f0e0c78186 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:14.141969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fec3ba-c045-40d7-8ac6-66f0e0c78186 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:14.142588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fec3ba-c045-40d7-8ac6-66f0e0c78186 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:14.143264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2fec3ba-c045-40d7-8ac6-66f0e0c78186 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:14.159824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9074e515-dca4-4e3b-bcea-306ba318e8e9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:14.161684 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-b2fec3ba-c045-40d7-8ac6-66f0e0c78186 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] HTTP exception thrown: Instance 549cea0b-4d4c-48f2-b7d4-12caa020ef87 could not be found. Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b2fec3ba-c045-40d7-8ac6-66f0e0c78186 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Request method failure captured: Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87 HTTP/1.1 Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFymsGD6mBhO9JS9wLWD4YalqF_h9ayjwBsy56MDRG7MzYIr_0XpbNkXta5f4tkeYZYYbqcmxEY7XI93X-17wE9Ck4rsKGc5rqpjZH0eGND5YiR_VmBrEmpSJbW9sx3zh_3yO2X87IZTwF2NHBgu0T8aV5ITKB4DXlTUU64Yy8zw3BIo Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Openstack-Nova-Api-Version: 2.47 Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: dc50b9ebed5448079b548f6087330aa6 Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerShowV247Test-1848086445 Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc50b9ebed5448079b548f6087330aa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc50b9ebed5448079b548f6087330aa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc50b9ebed5448079b548f6087330aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc50b9ebed5448079b548f6087330aa6"}]}] Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerShowV247Test-1848086445 Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: dc50b9ebed5448079b548f6087330aa6 Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerShowV247Test-1848086445 Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerShowV247Test-1848086445-project Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6ec3877b92b943dc85a7f656b4db93ca Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerShowV247Test-1848086445-project Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 549cea0b-4d4c-48f2-b7d4-12caa020ef87 could not be found. Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '549cea0b-4d4c-48f2-b7d4-12caa020ef87'} Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549cea0b-4d4c-48f2-b7d4-12caa020ef87 could not be found. Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549cea0b-4d4c-48f2-b7d4-12caa020ef87 could not be found. Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:14.165052 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:14.169589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:14.169589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:14.169589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:14.169589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:07:14.169589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:07:14.169589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549cea0b-4d4c-48f2-b7d4-12caa020ef87 could not be found. Sep 06 11:07:14.169589 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:14.171718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b2fec3ba-c045-40d7-8ac6-66f0e0c78186 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] Returning 404 to user: Instance 549cea0b-4d4c-48f2-b7d4-12caa020ef87 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:07:14.173845 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b2fec3ba-c045-40d7-8ac6-66f0e0c78186 tempest-ServerShowV247Test-1848086445 tempest-ServerShowV247Test-1848086445-project] 10.222.0.20 "GET /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87" status: 404 len: 111 microversion: 2.47 time: 0.048551 Sep 06 11:07:14.175228 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9074e515-dca4-4e3b-bcea-306ba318e8e9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.435475 Sep 06 11:07:14.175613 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1858/3722] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:14 2022] GET /compute/v2.1/servers/549cea0b-4d4c-48f2-b7d4-12caa020ef87 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:07:14.183846 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1865/3723] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:13 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:14.196605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8ccca310-86dd-4692-b239-5c7cf467fccd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:14.197248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8ccca310-86dd-4692-b239-5c7cf467fccd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:14.198168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-912b8544-82f3-4cfb-8360-a98452e779a8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:14.198796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-912b8544-82f3-4cfb-8360-a98452e779a8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:14.216900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-912b8544-82f3-4cfb-8360-a98452e779a8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:14.217185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ccca310-86dd-4692-b239-5c7cf467fccd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:14.217267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-912b8544-82f3-4cfb-8360-a98452e779a8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:14.217342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ccca310-86dd-4692-b239-5c7cf467fccd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:14.217440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ccca310-86dd-4692-b239-5c7cf467fccd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:14.217577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-912b8544-82f3-4cfb-8360-a98452e779a8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:14.219980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ccca310-86dd-4692-b239-5c7cf467fccd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:14.220606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ccca310-86dd-4692-b239-5c7cf467fccd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:14.221362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-912b8544-82f3-4cfb-8360-a98452e779a8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:14.221885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-912b8544-82f3-4cfb-8360-a98452e779a8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:14.222342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-912b8544-82f3-4cfb-8360-a98452e779a8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:14.222547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ccca310-86dd-4692-b239-5c7cf467fccd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:14.388571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8ccca310-86dd-4692-b239-5c7cf467fccd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:14.401710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8ccca310-86dd-4692-b239-5c7cf467fccd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:14.403221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8ccca310-86dd-4692-b239-5c7cf467fccd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:14.410757 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8ccca310-86dd-4692-b239-5c7cf467fccd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.225004 Sep 06 11:07:14.411752 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1866/3724] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:14 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:14.467042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:14.524250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-912b8544-82f3-4cfb-8360-a98452e779a8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:14.536238 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-912b8544-82f3-4cfb-8360-a98452e779a8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.358808 Sep 06 11:07:14.537346 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1859/3725] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:14 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:14.654588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-3ac82079-b98f-425d-a9af-6695f9abedcb req-9e9bd116-37cd-437a-9c75-13ec3a0147fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c93ad3-522c-4df2-8654-f8ef007b95e2", "tag": "b437278e-4964-4c05-8aba-db0ad7ce621c"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:14.664637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3ac82079-b98f-425d-a9af-6695f9abedcb req-9e9bd116-37cd-437a-9c75-13ec3a0147fe service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:14.665212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3ac82079-b98f-425d-a9af-6695f9abedcb req-9e9bd116-37cd-437a-9c75-13ec3a0147fe service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:14.665653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3ac82079-b98f-425d-a9af-6695f9abedcb req-9e9bd116-37cd-437a-9c75-13ec3a0147fe service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:14.682204 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-3ac82079-b98f-425d-a9af-6695f9abedcb req-9e9bd116-37cd-437a-9c75-13ec3a0147fe service nova] Creating event network-changed:b437278e-4964-4c05-8aba-db0ad7ce621c for instance 51c93ad3-522c-4df2-8654-f8ef007b95e2 on nch1-master-1 Sep 06 11:07:14.702419 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-3ac82079-b98f-425d-a9af-6695f9abedcb req-9e9bd116-37cd-437a-9c75-13ec3a0147fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052471 Sep 06 11:07:14.704648 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1867/3726] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:15.139754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4cc52916-e13b-46ca-89ef-f87d96c8f7fa tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:15.140479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4cc52916-e13b-46ca-89ef-f87d96c8f7fa tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:15.149330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cc52916-e13b-46ca-89ef-f87d96c8f7fa tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:15.150192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cc52916-e13b-46ca-89ef-f87d96c8f7fa tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:15.150876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cc52916-e13b-46ca-89ef-f87d96c8f7fa tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:15.151824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cc52916-e13b-46ca-89ef-f87d96c8f7fa tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:15.152495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cc52916-e13b-46ca-89ef-f87d96c8f7fa tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:15.153141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cc52916-e13b-46ca-89ef-f87d96c8f7fa tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:15.207805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c7ad11b-cf67-48e6-8ff7-c6f1296c3fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:15.208785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9c7ad11b-cf67-48e6-8ff7-c6f1296c3fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:15.224422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c7ad11b-cf67-48e6-8ff7-c6f1296c3fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:15.226638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c7ad11b-cf67-48e6-8ff7-c6f1296c3fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:15.227892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c7ad11b-cf67-48e6-8ff7-c6f1296c3fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:15.229715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c7ad11b-cf67-48e6-8ff7-c6f1296c3fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:15.232458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c7ad11b-cf67-48e6-8ff7-c6f1296c3fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:15.232547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c7ad11b-cf67-48e6-8ff7-c6f1296c3fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:15.471855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4cc52916-e13b-46ca-89ef-f87d96c8f7fa tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:15.481767 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4cc52916-e13b-46ca-89ef-f87d96c8f7fa tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1313 microversion: 2.1 time: 0.349207 Sep 06 11:07:15.483004 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1860/3727] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:15 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:15.502174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c776bfe7-e36d-4f35-a10a-63d2388bf064 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:15.503222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c776bfe7-e36d-4f35-a10a-63d2388bf064 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:15.512940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c776bfe7-e36d-4f35-a10a-63d2388bf064 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:15.513785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c776bfe7-e36d-4f35-a10a-63d2388bf064 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:15.514506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c776bfe7-e36d-4f35-a10a-63d2388bf064 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:15.515497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c776bfe7-e36d-4f35-a10a-63d2388bf064 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:15.516182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c776bfe7-e36d-4f35-a10a-63d2388bf064 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:15.517634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c776bfe7-e36d-4f35-a10a-63d2388bf064 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:15.627461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c776bfe7-e36d-4f35-a10a-63d2388bf064 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:15.631004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c7ad11b-cf67-48e6-8ff7-c6f1296c3fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:15.639725 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9c7ad11b-cf67-48e6-8ff7-c6f1296c3fc9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.438529 Sep 06 11:07:15.643615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c776bfe7-e36d-4f35-a10a-63d2388bf064 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:15.646434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c776bfe7-e36d-4f35-a10a-63d2388bf064 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:15.653992 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c776bfe7-e36d-4f35-a10a-63d2388bf064 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.169605 Sep 06 11:07:15.655412 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1868/3728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:15 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:15.656382 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1861/3729] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:15 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:15.661910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d04d6d8a-480a-45da-989a-75252f950af5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:15.662710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d04d6d8a-480a-45da-989a-75252f950af5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:15.669453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d04d6d8a-480a-45da-989a-75252f950af5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:15.670105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d04d6d8a-480a-45da-989a-75252f950af5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:15.670692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d04d6d8a-480a-45da-989a-75252f950af5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:15.671605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d04d6d8a-480a-45da-989a-75252f950af5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:15.672862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d04d6d8a-480a-45da-989a-75252f950af5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:15.673450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d04d6d8a-480a-45da-989a-75252f950af5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:15.949721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d04d6d8a-480a-45da-989a-75252f950af5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:15.957720 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d04d6d8a-480a-45da-989a-75252f950af5 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.301183 Sep 06 11:07:15.958376 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1869/3730] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:15 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:16.505489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-38c10377-b819-44c1-9c17-0df492dcb330 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:16.506720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-38c10377-b819-44c1-9c17-0df492dcb330 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:16.515184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38c10377-b819-44c1-9c17-0df492dcb330 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:16.515868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38c10377-b819-44c1-9c17-0df492dcb330 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:16.516472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38c10377-b819-44c1-9c17-0df492dcb330 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:16.517341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38c10377-b819-44c1-9c17-0df492dcb330 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:16.517943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38c10377-b819-44c1-9c17-0df492dcb330 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:16.518557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38c10377-b819-44c1-9c17-0df492dcb330 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:16.666342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c169279-77d3-47cd-a13d-99910268dd9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:16.667569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3c169279-77d3-47cd-a13d-99910268dd9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:16.678798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c169279-77d3-47cd-a13d-99910268dd9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:16.679397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c169279-77d3-47cd-a13d-99910268dd9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:16.679856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c169279-77d3-47cd-a13d-99910268dd9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:16.681415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c169279-77d3-47cd-a13d-99910268dd9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:16.681415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c169279-77d3-47cd-a13d-99910268dd9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:16.681605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c169279-77d3-47cd-a13d-99910268dd9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:16.789214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-38c10377-b819-44c1-9c17-0df492dcb330 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:16.800761 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-38c10377-b819-44c1-9c17-0df492dcb330 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1313 microversion: 2.1 time: 0.299076 Sep 06 11:07:16.801360 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1862/3731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:16 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:16.818407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:16.819952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:16.827487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:16.828254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:16.828785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:16.830067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:16.830634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:16.831223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:16.878471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c169279-77d3-47cd-a13d-99910268dd9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:16.891354 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3c169279-77d3-47cd-a13d-99910268dd9c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.229372 Sep 06 11:07:16.892797 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1870/3732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:16 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:16.914861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:16.926613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:16.929756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:16.938118 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1558 microversion: 2.91 time: 0.135599 Sep 06 11:07:16.939708 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1863/3733] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:16 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1558 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:16.983728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-57dca475-f00c-4784-973e-0e9e871492a2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:16.988540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-57dca475-f00c-4784-973e-0e9e871492a2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:16.992521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57dca475-f00c-4784-973e-0e9e871492a2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:16.993568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57dca475-f00c-4784-973e-0e9e871492a2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:16.994270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57dca475-f00c-4784-973e-0e9e871492a2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:16.995396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57dca475-f00c-4784-973e-0e9e871492a2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:17.002967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57dca475-f00c-4784-973e-0e9e871492a2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:17.004919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57dca475-f00c-4784-973e-0e9e871492a2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:17.249753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-57dca475-f00c-4784-973e-0e9e871492a2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:17.259590 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-57dca475-f00c-4784-973e-0e9e871492a2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.280433 Sep 06 11:07:17.277033 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1871/3734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:16 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:17.390541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:17.391618 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a2bda977-62fd-41ac-8f5b-756a0327aa5d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001444 Sep 06 11:07:17.392245 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1864/3735] 10.222.0.20 () {56 vars in 886 bytes} [Tue Sep 6 11:07:17 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 06 11:07:17.825431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3300fc85-e076-41b4-9d27-b39e47cf119a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:17.826051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3300fc85-e076-41b4-9d27-b39e47cf119a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:17.830107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:17.833734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3300fc85-e076-41b4-9d27-b39e47cf119a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:17.834230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3300fc85-e076-41b4-9d27-b39e47cf119a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:17.834678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3300fc85-e076-41b4-9d27-b39e47cf119a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:17.835410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3300fc85-e076-41b4-9d27-b39e47cf119a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:17.835876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3300fc85-e076-41b4-9d27-b39e47cf119a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:17.836314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3300fc85-e076-41b4-9d27-b39e47cf119a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:17.851730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:17.917779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-809418df-4252-4a0a-9985-0cbd0dcdb154 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:17.919074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-809418df-4252-4a0a-9985-0cbd0dcdb154 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:17.926671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-809418df-4252-4a0a-9985-0cbd0dcdb154 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:17.927508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-809418df-4252-4a0a-9985-0cbd0dcdb154 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:17.928111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-809418df-4252-4a0a-9985-0cbd0dcdb154 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:17.929060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-809418df-4252-4a0a-9985-0cbd0dcdb154 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:17.929680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-809418df-4252-4a0a-9985-0cbd0dcdb154 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:17.930291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-809418df-4252-4a0a-9985-0cbd0dcdb154 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:18.065900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3300fc85-e076-41b4-9d27-b39e47cf119a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:18.074071 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3300fc85-e076-41b4-9d27-b39e47cf119a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1313 microversion: 2.1 time: 0.252651 Sep 06 11:07:18.074897 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1872/3736] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:17 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:18.096167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f475d7f1-dde8-459f-b652-82167b884ac3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:18.096793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f475d7f1-dde8-459f-b652-82167b884ac3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:18.104179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f475d7f1-dde8-459f-b652-82167b884ac3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:18.105096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f475d7f1-dde8-459f-b652-82167b884ac3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:18.105732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f475d7f1-dde8-459f-b652-82167b884ac3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:18.106443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f475d7f1-dde8-459f-b652-82167b884ac3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:18.106909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f475d7f1-dde8-459f-b652-82167b884ac3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:18.107366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f475d7f1-dde8-459f-b652-82167b884ac3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:18.130350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-809418df-4252-4a0a-9985-0cbd0dcdb154 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:18.133309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:18.142214 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-809418df-4252-4a0a-9985-0cbd0dcdb154 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.228647 Sep 06 11:07:18.142674 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1865/3737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:17 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:18.188677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f475d7f1-dde8-459f-b652-82167b884ac3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:18.197963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f475d7f1-dde8-459f-b652-82167b884ac3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:18.199803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f475d7f1-dde8-459f-b652-82167b884ac3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:18.206867 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f475d7f1-dde8-459f-b652-82167b884ac3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1558 microversion: 2.91 time: 0.120030 Sep 06 11:07:18.219686 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1873/3738] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:18 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1558 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:18.285603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cd139a48-30ae-402b-bb14-ce8fee9a824e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:18.286269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cd139a48-30ae-402b-bb14-ce8fee9a824e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:18.289228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:18.293330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd139a48-30ae-402b-bb14-ce8fee9a824e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:18.293823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd139a48-30ae-402b-bb14-ce8fee9a824e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:18.294261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd139a48-30ae-402b-bb14-ce8fee9a824e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:18.294965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd139a48-30ae-402b-bb14-ce8fee9a824e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:18.295575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd139a48-30ae-402b-bb14-ce8fee9a824e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:18.295870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cd139a48-30ae-402b-bb14-ce8fee9a824e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:18.377133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1590979564", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "2a5978b1-4dbd-4a39-a9e0-f69712cbd9d8"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:18.435367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] validate_networks() for [('2a5978b1-4dbd-4a39-a9e0-f69712cbd9d8', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:07:18.462733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cd139a48-30ae-402b-bb14-ce8fee9a824e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:18.472481 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cd139a48-30ae-402b-bb14-ce8fee9a824e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.190600 Sep 06 11:07:18.488596 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1874/3739] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:18 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:18.870630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:07:18.871115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:07:18.871600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:07:18.872038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:07:18.872456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:07:18.881935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=17 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:18.883216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:18.883821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:18.884371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:18.885792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:18.886379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:18.886982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:18.904660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Getting quotas for project e2f1118744894767a4ab5c9bddc8e5fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:07:18.910351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Getting quotas for user 2b51397c5872403c86210c2dc7f85735 and project e2f1118744894767a4ab5c9bddc8e5fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:07:18.925082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Going to run 3 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:07:18.927541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:07:19.100369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0b0b61b3-7e75-4330-ac11-295517a421d6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:19.101070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0b0b61b3-7e75-4330-ac11-295517a421d6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:19.109894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b0b61b3-7e75-4330-ac11-295517a421d6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:19.110391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b0b61b3-7e75-4330-ac11-295517a421d6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:19.111766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b0b61b3-7e75-4330-ac11-295517a421d6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:19.112552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b0b61b3-7e75-4330-ac11-295517a421d6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:19.113096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b0b61b3-7e75-4330-ac11-295517a421d6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:19.113648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b0b61b3-7e75-4330-ac11-295517a421d6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:19.117506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=52698341-5c8b-434b-82d4-5d35faf1b2fa,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:07:19.151387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:19.270678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0b0b61b3-7e75-4330-ac11-295517a421d6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:19.278976 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0b0b61b3-7e75-4330-ac11-295517a421d6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1313 microversion: 2.1 time: 0.182384 Sep 06 11:07:19.279721 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1875/3740] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:19 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:19.286391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d5dbd7da-b71e-4e87-8269-ec87174e336c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:19.291690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d5dbd7da-b71e-4e87-8269-ec87174e336c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:19.293524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5dbd7da-b71e-4e87-8269-ec87174e336c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:19.294213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5dbd7da-b71e-4e87-8269-ec87174e336c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:19.294902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5dbd7da-b71e-4e87-8269-ec87174e336c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:19.295783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5dbd7da-b71e-4e87-8269-ec87174e336c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:19.296154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=18170fa5-02fe-4fcb-8bfc-90e7223ea0f6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:07:19.296608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5dbd7da-b71e-4e87-8269-ec87174e336c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:19.297051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5dbd7da-b71e-4e87-8269-ec87174e336c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:19.453040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d5dbd7da-b71e-4e87-8269-ec87174e336c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:19.463426 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d5dbd7da-b71e-4e87-8269-ec87174e336c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.182460 Sep 06 11:07:19.464187 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1876/3741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:19 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:19.469985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b5242452-d7c0-404c-b2fe-9c5e1416b42c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:19.470946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b5242452-d7c0-404c-b2fe-9c5e1416b42c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:19.481528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5242452-d7c0-404c-b2fe-9c5e1416b42c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:19.482347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5242452-d7c0-404c-b2fe-9c5e1416b42c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:19.483072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5242452-d7c0-404c-b2fe-9c5e1416b42c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:19.484262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5242452-d7c0-404c-b2fe-9c5e1416b42c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:19.485650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5242452-d7c0-404c-b2fe-9c5e1416b42c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:19.486351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5242452-d7c0-404c-b2fe-9c5e1416b42c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:19.586231 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1cf4a52d-158a-47df-a3aa-3a25388d1751 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345546 Sep 06 11:07:19.586952 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1866/3742] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:07:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:07:19.600040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b5242452-d7c0-404c-b2fe-9c5e1416b42c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:19.605200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:19.605867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:19.610218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b5242452-d7c0-404c-b2fe-9c5e1416b42c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:19.611874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b5242452-d7c0-404c-b2fe-9c5e1416b42c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:19.617936 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b5242452-d7c0-404c-b2fe-9c5e1416b42c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.152196 Sep 06 11:07:19.618679 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1877/3743] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:19 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:19.628020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-924c7126-fd39-4178-b855-7cd68fca3385 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:19.636656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-924c7126-fd39-4178-b855-7cd68fca3385 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:19.637680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-924c7126-fd39-4178-b855-7cd68fca3385 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Searching by: {'deleted': False, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:07:19.649745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:19.650263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:19.651292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:19.672901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:19.672901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:19.672901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:19.682552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-924c7126-fd39-4178-b855-7cd68fca3385 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:19.685418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-924c7126-fd39-4178-b855-7cd68fca3385 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:19.685903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-924c7126-fd39-4178-b855-7cd68fca3385 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:19.687219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-924c7126-fd39-4178-b855-7cd68fca3385 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:19.687697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-924c7126-fd39-4178-b855-7cd68fca3385 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:19.688135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-924c7126-fd39-4178-b855-7cd68fca3385 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:19.722223 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-924c7126-fd39-4178-b855-7cd68fca3385 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.100808 Sep 06 11:07:19.731135 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1878/3744] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 11:07:19 2022] GET /compute/v2.1/servers => generated 1018 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:19.739605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-765f6505-85ff-44f4-8b5f-028b37bf123d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:19.745974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-765f6505-85ff-44f4-8b5f-028b37bf123d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:19.851765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-765f6505-85ff-44f4-8b5f-028b37bf123d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:19.863346 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-765f6505-85ff-44f4-8b5f-028b37bf123d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1223 microversion: 2.1 time: 0.127640 Sep 06 11:07:19.864458 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1879/3745] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:19 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1223 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:19.960647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:19.969394 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.380006 Sep 06 11:07:19.971673 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1867/3746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:19 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:20.302370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:20.303965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1887f3b3-897a-4249-a120-f44ddafc01e3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:20.304665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1887f3b3-897a-4249-a120-f44ddafc01e3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:20.309229 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002344 Sep 06 11:07:20.309229 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1868/3747] 10.222.0.20 () {56 vars in 886 bytes} [Tue Sep 6 11:07:20 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Sep 06 11:07:20.313714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1887f3b3-897a-4249-a120-f44ddafc01e3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:20.314212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1887f3b3-897a-4249-a120-f44ddafc01e3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:20.314659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1887f3b3-897a-4249-a120-f44ddafc01e3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:20.316691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:20.318104 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001720 Sep 06 11:07:20.323773 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1869/3748] 10.222.0.20 () {54 vars in 1035 bytes} [Tue Sep 6 11:07:20 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 06 11:07:20.323936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1887f3b3-897a-4249-a120-f44ddafc01e3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:20.323936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1887f3b3-897a-4249-a120-f44ddafc01e3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:20.323936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1887f3b3-897a-4249-a120-f44ddafc01e3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:20.327142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:20.328337 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001673 Sep 06 11:07:20.329060 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1870/3749] 10.222.0.20 () {54 vars in 1041 bytes} [Tue Sep 6 11:07:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:07:20.341168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:20.342582 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe9325a9-5ca0-4c8e-8fbd-431ae0b84db3 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002147 Sep 06 11:07:20.343051 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1871/3750] 10.222.0.20 () {56 vars in 886 bytes} [Tue Sep 6 11:07:20 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 06 11:07:20.491096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2adaeb15-e223-4e06-842a-791e0e8dfdad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:20.491754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2adaeb15-e223-4e06-842a-791e0e8dfdad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:20.512384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2adaeb15-e223-4e06-842a-791e0e8dfdad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:20.513657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2adaeb15-e223-4e06-842a-791e0e8dfdad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:20.514407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2adaeb15-e223-4e06-842a-791e0e8dfdad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:20.520917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2adaeb15-e223-4e06-842a-791e0e8dfdad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:20.520917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2adaeb15-e223-4e06-842a-791e0e8dfdad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:20.521366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2adaeb15-e223-4e06-842a-791e0e8dfdad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:20.553115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1887f3b3-897a-4249-a120-f44ddafc01e3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:20.567294 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1887f3b3-897a-4249-a120-f44ddafc01e3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1313 microversion: 2.1 time: 0.267541 Sep 06 11:07:20.574523 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1880/3751] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:20 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:20.654667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b9f7adc6-0849-4920-ae27-43d65950c1a8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:20.655480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b9f7adc6-0849-4920-ae27-43d65950c1a8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:20.670154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9f7adc6-0849-4920-ae27-43d65950c1a8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:20.692724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9f7adc6-0849-4920-ae27-43d65950c1a8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:20.694985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9f7adc6-0849-4920-ae27-43d65950c1a8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:20.695796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9f7adc6-0849-4920-ae27-43d65950c1a8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:20.696282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9f7adc6-0849-4920-ae27-43d65950c1a8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:20.696739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9f7adc6-0849-4920-ae27-43d65950c1a8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:20.767345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2adaeb15-e223-4e06-842a-791e0e8dfdad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:20.778813 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2adaeb15-e223-4e06-842a-791e0e8dfdad tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.292596 Sep 06 11:07:20.782626 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1872/3752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:20 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:20.822091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b9f7adc6-0849-4920-ae27-43d65950c1a8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:20.833202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b9f7adc6-0849-4920-ae27-43d65950c1a8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:20.834937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b9f7adc6-0849-4920-ae27-43d65950c1a8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:20.844854 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b9f7adc6-0849-4920-ae27-43d65950c1a8 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.194402 Sep 06 11:07:20.845972 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1881/3753] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:20 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:07:20.895457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-769c514c-8ea4-430d-8fbd-f62bc78c0901 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:20.896501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-769c514c-8ea4-430d-8fbd-f62bc78c0901 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:20.959214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-769c514c-8ea4-430d-8fbd-f62bc78c0901 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:20.969002 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-769c514c-8ea4-430d-8fbd-f62bc78c0901 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1223 microversion: 2.1 time: 0.086755 Sep 06 11:07:20.970306 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1873/3754] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:20 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:21.000453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b4cfcf61-23ea-449d-a73b-f58ae6066e8b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:21.001343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b4cfcf61-23ea-449d-a73b-f58ae6066e8b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:21.009212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4cfcf61-23ea-449d-a73b-f58ae6066e8b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:21.010153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4cfcf61-23ea-449d-a73b-f58ae6066e8b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:21.010697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4cfcf61-23ea-449d-a73b-f58ae6066e8b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:21.011554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4cfcf61-23ea-449d-a73b-f58ae6066e8b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:21.012228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4cfcf61-23ea-449d-a73b-f58ae6066e8b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:21.012883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4cfcf61-23ea-449d-a73b-f58ae6066e8b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:21.276442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b4cfcf61-23ea-449d-a73b-f58ae6066e8b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:21.288152 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b4cfcf61-23ea-449d-a73b-f58ae6066e8b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.294117 Sep 06 11:07:21.288989 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1882/3755] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:20 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:21.608235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5f9680ee-5921-485d-9212-4912517d717e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:21.609215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5f9680ee-5921-485d-9212-4912517d717e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:21.617560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f9680ee-5921-485d-9212-4912517d717e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:21.618459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f9680ee-5921-485d-9212-4912517d717e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:21.619636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f9680ee-5921-485d-9212-4912517d717e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:21.620586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f9680ee-5921-485d-9212-4912517d717e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:21.621224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f9680ee-5921-485d-9212-4912517d717e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:21.621819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f9680ee-5921-485d-9212-4912517d717e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:21.808879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0af9c53f-00c3-4e09-a227-b8c527ca0f96 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:21.810185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0af9c53f-00c3-4e09-a227-b8c527ca0f96 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:21.832472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0af9c53f-00c3-4e09-a227-b8c527ca0f96 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:21.833267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0af9c53f-00c3-4e09-a227-b8c527ca0f96 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:21.833881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0af9c53f-00c3-4e09-a227-b8c527ca0f96 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:21.837080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0af9c53f-00c3-4e09-a227-b8c527ca0f96 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:21.838557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0af9c53f-00c3-4e09-a227-b8c527ca0f96 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:21.840014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0af9c53f-00c3-4e09-a227-b8c527ca0f96 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:21.880029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5f9680ee-5921-485d-9212-4912517d717e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:21.900050 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5f9680ee-5921-485d-9212-4912517d717e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1313 microversion: 2.1 time: 0.306054 Sep 06 11:07:21.913423 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1874/3756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:21 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:21.925082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-14f3d534-d08d-45fa-a777-e0667724af9a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:21.925753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-14f3d534-d08d-45fa-a777-e0667724af9a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:21.939738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14f3d534-d08d-45fa-a777-e0667724af9a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:21.940475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14f3d534-d08d-45fa-a777-e0667724af9a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:21.941842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:21.942020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14f3d534-d08d-45fa-a777-e0667724af9a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:21.943102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14f3d534-d08d-45fa-a777-e0667724af9a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:21.944666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14f3d534-d08d-45fa-a777-e0667724af9a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:21.945641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-14f3d534-d08d-45fa-a777-e0667724af9a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:22.104987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-14f3d534-d08d-45fa-a777-e0667724af9a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:22.144760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-14f3d534-d08d-45fa-a777-e0667724af9a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:22.147424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-14f3d534-d08d-45fa-a777-e0667724af9a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:22.155598 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-14f3d534-d08d-45fa-a777-e0667724af9a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.240462 Sep 06 11:07:22.156988 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1875/3757] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:21 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:22.163183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-396e0010-7223-4073-9f2c-31d4bad0bbb8 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:22.164291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-396e0010-7223-4073-9f2c-31d4bad0bbb8 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:22.252302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0af9c53f-00c3-4e09-a227-b8c527ca0f96 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:22.265397 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0af9c53f-00c3-4e09-a227-b8c527ca0f96 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1678 microversion: 2.1 time: 0.461295 Sep 06 11:07:22.266634 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1883/3758] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:21 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1678 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:22.288239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9af49f47-0081-4cf6-b44d-8f48f12ab7d5 req-a7e9b8ed-f6b7-4621-8890-6d2b2f041c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c93ad3-522c-4df2-8654-f8ef007b95e2", "name": "network-vif-plugged", "status": "completed", "tag": "b437278e-4964-4c05-8aba-db0ad7ce621c"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:22.303277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-396e0010-7223-4073-9f2c-31d4bad0bbb8 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:22.315610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9af49f47-0081-4cf6-b44d-8f48f12ab7d5 req-a7e9b8ed-f6b7-4621-8890-6d2b2f041c1a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:22.317322 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-396e0010-7223-4073-9f2c-31d4bad0bbb8 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1223 microversion: 2.1 time: 0.152301 Sep 06 11:07:22.317814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9af49f47-0081-4cf6-b44d-8f48f12ab7d5 req-a7e9b8ed-f6b7-4621-8890-6d2b2f041c1a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:22.329502 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1876/3759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:22 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1223 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:22.329502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-12029447-38a3-46f5-a28f-112ddc926397 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:22.329502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-12029447-38a3-46f5-a28f-112ddc926397 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:22.337151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9af49f47-0081-4cf6-b44d-8f48f12ab7d5 req-a7e9b8ed-f6b7-4621-8890-6d2b2f041c1a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:22.344820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12029447-38a3-46f5-a28f-112ddc926397 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:22.345335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12029447-38a3-46f5-a28f-112ddc926397 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:22.347550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12029447-38a3-46f5-a28f-112ddc926397 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:22.347550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12029447-38a3-46f5-a28f-112ddc926397 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:22.347550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12029447-38a3-46f5-a28f-112ddc926397 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:22.348485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12029447-38a3-46f5-a28f-112ddc926397 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:22.369451 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9af49f47-0081-4cf6-b44d-8f48f12ab7d5 req-a7e9b8ed-f6b7-4621-8890-6d2b2f041c1a service nova] Creating event network-vif-plugged:b437278e-4964-4c05-8aba-db0ad7ce621c for instance 51c93ad3-522c-4df2-8654-f8ef007b95e2 on nch1-master-1 Sep 06 11:07:22.378156 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9af49f47-0081-4cf6-b44d-8f48f12ab7d5 req-a7e9b8ed-f6b7-4621-8890-6d2b2f041c1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092575 Sep 06 11:07:22.378156 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1884/3760] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:22.659417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-12029447-38a3-46f5-a28f-112ddc926397 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:22.668508 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-12029447-38a3-46f5-a28f-112ddc926397 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.349020 Sep 06 11:07:22.679466 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1877/3761] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:22 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:22.927859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8a1a7fff-6b5a-44ca-8f00-d2fa8ee6dcf5 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:22.932158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8a1a7fff-6b5a-44ca-8f00-d2fa8ee6dcf5 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:22.935400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a1a7fff-6b5a-44ca-8f00-d2fa8ee6dcf5 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:22.935906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a1a7fff-6b5a-44ca-8f00-d2fa8ee6dcf5 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:22.936358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a1a7fff-6b5a-44ca-8f00-d2fa8ee6dcf5 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:22.937292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a1a7fff-6b5a-44ca-8f00-d2fa8ee6dcf5 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:22.937755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a1a7fff-6b5a-44ca-8f00-d2fa8ee6dcf5 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:22.938181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a1a7fff-6b5a-44ca-8f00-d2fa8ee6dcf5 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:23.133251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8a1a7fff-6b5a-44ca-8f00-d2fa8ee6dcf5 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:23.147861 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8a1a7fff-6b5a-44ca-8f00-d2fa8ee6dcf5 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1313 microversion: 2.1 time: 0.225619 Sep 06 11:07:23.148447 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1885/3762] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:22 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:23.187500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a53f3376-9c71-4e36-b995-eeaa6a2d3a5f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:23.188241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a53f3376-9c71-4e36-b995-eeaa6a2d3a5f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:23.195339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a53f3376-9c71-4e36-b995-eeaa6a2d3a5f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:23.205027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a53f3376-9c71-4e36-b995-eeaa6a2d3a5f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:23.205632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a53f3376-9c71-4e36-b995-eeaa6a2d3a5f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:23.206443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a53f3376-9c71-4e36-b995-eeaa6a2d3a5f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:23.207258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a53f3376-9c71-4e36-b995-eeaa6a2d3a5f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:23.207933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a53f3376-9c71-4e36-b995-eeaa6a2d3a5f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:23.290695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a53f3376-9c71-4e36-b995-eeaa6a2d3a5f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:23.298929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3a5123f2-6749-4175-87b1-36e8ff2dd653 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:23.299585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3a5123f2-6749-4175-87b1-36e8ff2dd653 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:23.302759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a53f3376-9c71-4e36-b995-eeaa6a2d3a5f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:23.304627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a53f3376-9c71-4e36-b995-eeaa6a2d3a5f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:23.311999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a5123f2-6749-4175-87b1-36e8ff2dd653 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:23.312476 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a53f3376-9c71-4e36-b995-eeaa6a2d3a5f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.128690 Sep 06 11:07:23.312905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a5123f2-6749-4175-87b1-36e8ff2dd653 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:23.313640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a5123f2-6749-4175-87b1-36e8ff2dd653 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:23.314634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a5123f2-6749-4175-87b1-36e8ff2dd653 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:23.315339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a5123f2-6749-4175-87b1-36e8ff2dd653 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:23.315456 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1878/3763] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:23 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:23.316045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a5123f2-6749-4175-87b1-36e8ff2dd653 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:23.345352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e5269a5e-59d7-4c5d-8a8f-200c9bdae729 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:23.353610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e5269a5e-59d7-4c5d-8a8f-200c9bdae729 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:23.560559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e5269a5e-59d7-4c5d-8a8f-200c9bdae729 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:23.569626 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e5269a5e-59d7-4c5d-8a8f-200c9bdae729 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1223 microversion: 2.1 time: 0.229358 Sep 06 11:07:23.570269 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1879/3764] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:23 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1223 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:23.637529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3a5123f2-6749-4175-87b1-36e8ff2dd653 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:23.654283 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3a5123f2-6749-4175-87b1-36e8ff2dd653 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1655 microversion: 2.1 time: 0.359865 Sep 06 11:07:23.666015 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1886/3765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:23 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1655 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:23.698518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3e9f3102-43ee-4ba4-9122-039497bf4a3c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:23.699057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-54c53e4d-4f1a-483c-a749-17447a57299f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:23.699591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3e9f3102-43ee-4ba4-9122-039497bf4a3c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:23.706881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e9f3102-43ee-4ba4-9122-039497bf4a3c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:23.709166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e9f3102-43ee-4ba4-9122-039497bf4a3c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:23.709838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e9f3102-43ee-4ba4-9122-039497bf4a3c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:23.710778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e9f3102-43ee-4ba4-9122-039497bf4a3c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:23.711444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e9f3102-43ee-4ba4-9122-039497bf4a3c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:23.712022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e9f3102-43ee-4ba4-9122-039497bf4a3c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:23.714984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c53e4d-4f1a-483c-a749-17447a57299f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:23.715709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c53e4d-4f1a-483c-a749-17447a57299f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:23.720397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c53e4d-4f1a-483c-a749-17447a57299f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:23.770338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-54c53e4d-4f1a-483c-a749-17447a57299f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Going to try to start instance {{(pid=140875) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 11:07:23.912975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3e9f3102-43ee-4ba4-9122-039497bf4a3c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:23.935321 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3e9f3102-43ee-4ba4-9122-039497bf4a3c tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.230346 Sep 06 11:07:23.935321 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1880/3766] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:23 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:24.075342 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-54c53e4d-4f1a-483c-a749-17447a57299f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.380896 Sep 06 11:07:24.076771 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1887/3767] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:07:23 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:07:24.087258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-286a049b-e220-456a-89ef-9099916dc98a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:24.088496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-286a049b-e220-456a-89ef-9099916dc98a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:24.096187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-286a049b-e220-456a-89ef-9099916dc98a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:24.097163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-286a049b-e220-456a-89ef-9099916dc98a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:24.097768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-286a049b-e220-456a-89ef-9099916dc98a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:24.098789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-286a049b-e220-456a-89ef-9099916dc98a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:24.099421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-286a049b-e220-456a-89ef-9099916dc98a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:24.100005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-286a049b-e220-456a-89ef-9099916dc98a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:24.176224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0028b677-6bfa-4f21-9378-d0eefca0b999 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:24.177358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0028b677-6bfa-4f21-9378-d0eefca0b999 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:24.185420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0028b677-6bfa-4f21-9378-d0eefca0b999 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:24.186835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0028b677-6bfa-4f21-9378-d0eefca0b999 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:24.187539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0028b677-6bfa-4f21-9378-d0eefca0b999 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:24.189157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0028b677-6bfa-4f21-9378-d0eefca0b999 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:24.191087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0028b677-6bfa-4f21-9378-d0eefca0b999 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:24.191769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0028b677-6bfa-4f21-9378-d0eefca0b999 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:24.440789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-286a049b-e220-456a-89ef-9099916dc98a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:24.444290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0028b677-6bfa-4f21-9378-d0eefca0b999 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:24.456860 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-286a049b-e220-456a-89ef-9099916dc98a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1664 microversion: 2.1 time: 0.373177 Sep 06 11:07:24.461488 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0028b677-6bfa-4f21-9378-d0eefca0b999 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1496 microversion: 2.1 time: 0.287651 Sep 06 11:07:24.461488 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1888/3768] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:24 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1496 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:24.463372 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1881/3769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:24 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1664 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:24.479214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d617e958-1985-4f1e-a44b-cbd2d38c006c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:24.479214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d617e958-1985-4f1e-a44b-cbd2d38c006c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:24.479214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d617e958-1985-4f1e-a44b-cbd2d38c006c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:24.479214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d617e958-1985-4f1e-a44b-cbd2d38c006c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:24.479214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d617e958-1985-4f1e-a44b-cbd2d38c006c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:24.479214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d617e958-1985-4f1e-a44b-cbd2d38c006c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:24.479214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d617e958-1985-4f1e-a44b-cbd2d38c006c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:24.479214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d617e958-1985-4f1e-a44b-cbd2d38c006c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:24.597790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-59459ba5-b6b8-451f-babb-b5c56d1b99e1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:24.598772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-59459ba5-b6b8-451f-babb-b5c56d1b99e1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:24.618159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59459ba5-b6b8-451f-babb-b5c56d1b99e1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:24.619332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59459ba5-b6b8-451f-babb-b5c56d1b99e1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:24.621023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59459ba5-b6b8-451f-babb-b5c56d1b99e1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:24.621704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59459ba5-b6b8-451f-babb-b5c56d1b99e1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:24.623556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59459ba5-b6b8-451f-babb-b5c56d1b99e1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:24.625227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59459ba5-b6b8-451f-babb-b5c56d1b99e1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:24.668773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d617e958-1985-4f1e-a44b-cbd2d38c006c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:24.685595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d617e958-1985-4f1e-a44b-cbd2d38c006c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:24.695382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d617e958-1985-4f1e-a44b-cbd2d38c006c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:24.715412 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d617e958-1985-4f1e-a44b-cbd2d38c006c tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.250170 Sep 06 11:07:24.715412 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1889/3770] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:24 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:24.814890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-59459ba5-b6b8-451f-babb-b5c56d1b99e1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:24.839427 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-59459ba5-b6b8-451f-babb-b5c56d1b99e1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1219 microversion: 2.1 time: 0.248777 Sep 06 11:07:24.842537 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1882/3771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:24 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1219 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:24.949948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8ea8313d-7019-411d-8db3-68c1b95182d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:24.950768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8ea8313d-7019-411d-8db3-68c1b95182d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:24.980039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ea8313d-7019-411d-8db3-68c1b95182d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:24.981061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ea8313d-7019-411d-8db3-68c1b95182d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:24.982924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ea8313d-7019-411d-8db3-68c1b95182d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:24.983887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ea8313d-7019-411d-8db3-68c1b95182d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:24.988861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ea8313d-7019-411d-8db3-68c1b95182d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:24.988861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ea8313d-7019-411d-8db3-68c1b95182d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:25.357273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8ea8313d-7019-411d-8db3-68c1b95182d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:25.375594 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8ea8313d-7019-411d-8db3-68c1b95182d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.426640 Sep 06 11:07:25.377084 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1890/3772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:24 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:25.506618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-91c5cc72-ab06-49b8-869f-2384a6a5a9bd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:25.508793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-91c5cc72-ab06-49b8-869f-2384a6a5a9bd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:25.519371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91c5cc72-ab06-49b8-869f-2384a6a5a9bd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:25.520024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91c5cc72-ab06-49b8-869f-2384a6a5a9bd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:25.520573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91c5cc72-ab06-49b8-869f-2384a6a5a9bd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:25.521548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91c5cc72-ab06-49b8-869f-2384a6a5a9bd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:25.522235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91c5cc72-ab06-49b8-869f-2384a6a5a9bd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:25.522829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-91c5cc72-ab06-49b8-869f-2384a6a5a9bd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:25.746456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5b1f0df7-5fdd-4e50-b161-031501cac955 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:25.747324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5b1f0df7-5fdd-4e50-b161-031501cac955 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:25.755496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b1f0df7-5fdd-4e50-b161-031501cac955 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:25.756218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b1f0df7-5fdd-4e50-b161-031501cac955 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:25.756829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b1f0df7-5fdd-4e50-b161-031501cac955 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:25.758732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b1f0df7-5fdd-4e50-b161-031501cac955 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:25.759407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b1f0df7-5fdd-4e50-b161-031501cac955 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:25.760668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b1f0df7-5fdd-4e50-b161-031501cac955 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:25.976972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5b1f0df7-5fdd-4e50-b161-031501cac955 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:25.977368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-91c5cc72-ab06-49b8-869f-2384a6a5a9bd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:25.977368 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-91c5cc72-ab06-49b8-869f-2384a6a5a9bd tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1664 microversion: 2.1 time: 0.382755 Sep 06 11:07:25.977368 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1883/3773] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:25 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1664 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:25.977368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5200e3d0-578c-4833-90c5-4877b36e4b77 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:25.977706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5b1f0df7-5fdd-4e50-b161-031501cac955 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:25.977805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5200e3d0-578c-4833-90c5-4877b36e4b77 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:25.977894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5b1f0df7-5fdd-4e50-b161-031501cac955 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:25.977894 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5b1f0df7-5fdd-4e50-b161-031501cac955 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.156104 Sep 06 11:07:25.978068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5200e3d0-578c-4833-90c5-4877b36e4b77 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:25.978068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5200e3d0-578c-4833-90c5-4877b36e4b77 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:25.978068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5200e3d0-578c-4833-90c5-4877b36e4b77 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:25.978818 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1891/3774] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:25 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:07:25.978906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5200e3d0-578c-4833-90c5-4877b36e4b77 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:25.978906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5200e3d0-578c-4833-90c5-4877b36e4b77 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:25.978906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5200e3d0-578c-4833-90c5-4877b36e4b77 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:25.980009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1d34f304-4c12-4818-b5d7-0899f93cc308 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:25.980009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1d34f304-4c12-4818-b5d7-0899f93cc308 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:25.980009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d34f304-4c12-4818-b5d7-0899f93cc308 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:25.980009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d34f304-4c12-4818-b5d7-0899f93cc308 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:25.980009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d34f304-4c12-4818-b5d7-0899f93cc308 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:25.980009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d34f304-4c12-4818-b5d7-0899f93cc308 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:25.980009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d34f304-4c12-4818-b5d7-0899f93cc308 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:25.980009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d34f304-4c12-4818-b5d7-0899f93cc308 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:25.980673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5200e3d0-578c-4833-90c5-4877b36e4b77 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:07:26.052301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1d34f304-4c12-4818-b5d7-0899f93cc308 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:26.061693 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1d34f304-4c12-4818-b5d7-0899f93cc308 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1275 microversion: 2.1 time: 0.161148 Sep 06 11:07:26.062456 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1892/3775] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:25 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:26.405185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-da57d9a9-ebc2-444b-90c6-15b5d78982cb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:26.406600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-da57d9a9-ebc2-444b-90c6-15b5d78982cb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:26.437086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da57d9a9-ebc2-444b-90c6-15b5d78982cb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:26.438171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da57d9a9-ebc2-444b-90c6-15b5d78982cb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:26.439970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da57d9a9-ebc2-444b-90c6-15b5d78982cb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:26.443335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da57d9a9-ebc2-444b-90c6-15b5d78982cb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:26.444607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da57d9a9-ebc2-444b-90c6-15b5d78982cb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:26.445477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da57d9a9-ebc2-444b-90c6-15b5d78982cb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:26.551416 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5200e3d0-578c-4833-90c5-4877b36e4b77 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 204 len: 0 microversion: 2.1 time: 0.663911 Sep 06 11:07:26.552571 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1884/3776] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:07:25 2022] DELETE /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:07:26.563151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7cd7e930-43db-48c2-9d4a-cf4cd7778d0a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:26.564648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7cd7e930-43db-48c2-9d4a-cf4cd7778d0a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:26.578852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cd7e930-43db-48c2-9d4a-cf4cd7778d0a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:26.579523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cd7e930-43db-48c2-9d4a-cf4cd7778d0a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:26.580056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cd7e930-43db-48c2-9d4a-cf4cd7778d0a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:26.581399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cd7e930-43db-48c2-9d4a-cf4cd7778d0a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:26.582137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cd7e930-43db-48c2-9d4a-cf4cd7778d0a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:26.582655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cd7e930-43db-48c2-9d4a-cf4cd7778d0a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:27.023441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-da57d9a9-ebc2-444b-90c6-15b5d78982cb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:27.068467 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-da57d9a9-ebc2-444b-90c6-15b5d78982cb tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.669408 Sep 06 11:07:27.092102 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1893/3777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:26 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:27.092102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a9a88920-026a-4323-bfec-530387d45998 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:27.092102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a9a88920-026a-4323-bfec-530387d45998 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:27.107662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9a88920-026a-4323-bfec-530387d45998 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:27.108307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9a88920-026a-4323-bfec-530387d45998 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:27.108926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9a88920-026a-4323-bfec-530387d45998 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:27.109756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9a88920-026a-4323-bfec-530387d45998 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:27.110702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9a88920-026a-4323-bfec-530387d45998 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:27.112483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9a88920-026a-4323-bfec-530387d45998 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:27.138315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7cd7e930-43db-48c2-9d4a-cf4cd7778d0a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:27.147374 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7cd7e930-43db-48c2-9d4a-cf4cd7778d0a tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1502 microversion: 2.1 time: 0.589623 Sep 06 11:07:27.149298 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1885/3778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:26 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1502 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:27.154379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4844ff38-174d-4d4d-be58-ebefffae9785 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:27.155904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4844ff38-174d-4d4d-be58-ebefffae9785 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:27.182182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4844ff38-174d-4d4d-be58-ebefffae9785 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:27.188230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4844ff38-174d-4d4d-be58-ebefffae9785 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:27.188987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4844ff38-174d-4d4d-be58-ebefffae9785 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:27.190194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4844ff38-174d-4d4d-be58-ebefffae9785 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:27.190829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4844ff38-174d-4d4d-be58-ebefffae9785 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:27.191462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4844ff38-174d-4d4d-be58-ebefffae9785 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:27.374107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4844ff38-174d-4d4d-be58-ebefffae9785 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:27.383581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4844ff38-174d-4d4d-be58-ebefffae9785 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:27.385849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4844ff38-174d-4d4d-be58-ebefffae9785 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:27.391983 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4844ff38-174d-4d4d-be58-ebefffae9785 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.241401 Sep 06 11:07:27.392788 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1886/3779] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:27 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:27.413669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d26a9265-c526-40d5-86bb-3a04f8ecd248 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:27.414490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d26a9265-c526-40d5-86bb-3a04f8ecd248 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:27.427354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d26a9265-c526-40d5-86bb-3a04f8ecd248 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:27.430115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d26a9265-c526-40d5-86bb-3a04f8ecd248 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:27.430115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d26a9265-c526-40d5-86bb-3a04f8ecd248 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:27.430115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d26a9265-c526-40d5-86bb-3a04f8ecd248 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:27.430511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d26a9265-c526-40d5-86bb-3a04f8ecd248 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:27.431754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d26a9265-c526-40d5-86bb-3a04f8ecd248 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:27.477048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a9a88920-026a-4323-bfec-530387d45998 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:27.487805 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a9a88920-026a-4323-bfec-530387d45998 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.412917 Sep 06 11:07:27.489013 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1894/3780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:27 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:27.519061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-10aad57e-d63d-4917-92fb-9de80b3b719d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:27.519953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-10aad57e-d63d-4917-92fb-9de80b3b719d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:27.525511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d26a9265-c526-40d5-86bb-3a04f8ecd248 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:27.529864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10aad57e-d63d-4917-92fb-9de80b3b719d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:27.531048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10aad57e-d63d-4917-92fb-9de80b3b719d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:27.531048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10aad57e-d63d-4917-92fb-9de80b3b719d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:27.531862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10aad57e-d63d-4917-92fb-9de80b3b719d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:27.532380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10aad57e-d63d-4917-92fb-9de80b3b719d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:27.532968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10aad57e-d63d-4917-92fb-9de80b3b719d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:27.534569 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d26a9265-c526-40d5-86bb-3a04f8ecd248 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1281 microversion: 2.1 time: 0.140600 Sep 06 11:07:27.547040 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1887/3781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:27 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1281 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:27.809402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-10aad57e-d63d-4917-92fb-9de80b3b719d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:27.818305 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-10aad57e-d63d-4917-92fb-9de80b3b719d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.304134 Sep 06 11:07:27.818900 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1895/3782] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:27 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:27.852627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9e4a64d-f6de-40f9-944b-620ad0fadb50 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:27.853967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d9e4a64d-f6de-40f9-944b-620ad0fadb50 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:27.871940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9e4a64d-f6de-40f9-944b-620ad0fadb50 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:27.874692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9e4a64d-f6de-40f9-944b-620ad0fadb50 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:27.875424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9e4a64d-f6de-40f9-944b-620ad0fadb50 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:27.877590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9e4a64d-f6de-40f9-944b-620ad0fadb50 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:27.878345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9e4a64d-f6de-40f9-944b-620ad0fadb50 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:27.880756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9e4a64d-f6de-40f9-944b-620ad0fadb50 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:27.930656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:28.101979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e575328-2831-46ae-bd18-523c8aadc749 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:28.103250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e575328-2831-46ae-bd18-523c8aadc749 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:28.117598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e575328-2831-46ae-bd18-523c8aadc749 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:28.121241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e575328-2831-46ae-bd18-523c8aadc749 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:28.121932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e575328-2831-46ae-bd18-523c8aadc749 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:28.122865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e575328-2831-46ae-bd18-523c8aadc749 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:28.126931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e575328-2831-46ae-bd18-523c8aadc749 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:28.127492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e575328-2831-46ae-bd18-523c8aadc749 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:28.435224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d9e4a64d-f6de-40f9-944b-620ad0fadb50 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:28.449005 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d9e4a64d-f6de-40f9-944b-620ad0fadb50 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.602328 Sep 06 11:07:28.449780 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1888/3783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:27 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:28.455707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5dc690bc-7cd4-4a2f-9fa3-e9e23fceaaf6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:28.460183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5dc690bc-7cd4-4a2f-9fa3-e9e23fceaaf6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:28.474158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5dc690bc-7cd4-4a2f-9fa3-e9e23fceaaf6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:28.474671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5dc690bc-7cd4-4a2f-9fa3-e9e23fceaaf6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:28.475159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5dc690bc-7cd4-4a2f-9fa3-e9e23fceaaf6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:28.475894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5dc690bc-7cd4-4a2f-9fa3-e9e23fceaaf6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:28.476370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5dc690bc-7cd4-4a2f-9fa3-e9e23fceaaf6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:28.489507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5dc690bc-7cd4-4a2f-9fa3-e9e23fceaaf6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:28.811826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7e575328-2831-46ae-bd18-523c8aadc749 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:28.820578 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e575328-2831-46ae-bd18-523c8aadc749 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.724638 Sep 06 11:07:28.839604 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1896/3784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:28 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:28.845827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ee08b6e-3905-461d-bade-445497367127 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:28.846862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ee08b6e-3905-461d-bade-445497367127 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:28.853838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ee08b6e-3905-461d-bade-445497367127 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:28.854576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ee08b6e-3905-461d-bade-445497367127 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:28.855236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ee08b6e-3905-461d-bade-445497367127 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:28.856113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ee08b6e-3905-461d-bade-445497367127 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:28.856734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ee08b6e-3905-461d-bade-445497367127 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:28.857330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ee08b6e-3905-461d-bade-445497367127 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:28.894669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:28.971167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ee08b6e-3905-461d-bade-445497367127 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:28.996817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ee08b6e-3905-461d-bade-445497367127 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:28.999374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ee08b6e-3905-461d-bade-445497367127 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:29.011793 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ee08b6e-3905-461d-bade-445497367127 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.170257 Sep 06 11:07:29.013155 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1897/3785] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:28 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:29.018731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9d2daaff-9ef5-4a0b-b105-5742d4d19943 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:29.020247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9d2daaff-9ef5-4a0b-b105-5742d4d19943 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:29.032255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d2daaff-9ef5-4a0b-b105-5742d4d19943 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:29.033039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d2daaff-9ef5-4a0b-b105-5742d4d19943 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:29.034023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d2daaff-9ef5-4a0b-b105-5742d4d19943 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:29.034914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d2daaff-9ef5-4a0b-b105-5742d4d19943 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:29.035579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d2daaff-9ef5-4a0b-b105-5742d4d19943 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:29.036214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d2daaff-9ef5-4a0b-b105-5742d4d19943 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:29.190008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5dc690bc-7cd4-4a2f-9fa3-e9e23fceaaf6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:29.209391 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5dc690bc-7cd4-4a2f-9fa3-e9e23fceaaf6 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1502 microversion: 2.1 time: 0.757627 Sep 06 11:07:29.236757 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1889/3786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:28 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1502 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:29.254628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-52f4caf4-f3e2-4d45-95ad-e91e801970a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:29.255546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-52f4caf4-f3e2-4d45-95ad-e91e801970a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:29.266722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52f4caf4-f3e2-4d45-95ad-e91e801970a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:29.267557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52f4caf4-f3e2-4d45-95ad-e91e801970a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:29.268473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52f4caf4-f3e2-4d45-95ad-e91e801970a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:29.269902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52f4caf4-f3e2-4d45-95ad-e91e801970a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:29.270534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52f4caf4-f3e2-4d45-95ad-e91e801970a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:29.271179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52f4caf4-f3e2-4d45-95ad-e91e801970a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:29.486341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9d2daaff-9ef5-4a0b-b105-5742d4d19943 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:29.502253 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9d2daaff-9ef5-4a0b-b105-5742d4d19943 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.480447 Sep 06 11:07:29.502253 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1898/3787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:29 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:29.513612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-d1e0e836-9bb8-49bc-88f2-a26dd0eb7b6d req-1bd60ef9-f948-4592-939d-55862983605b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52698341-5c8b-434b-82d4-5d35faf1b2fa", "tag": "d19cb20a-5745-48f3-85ab-cd40490e46d8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:29.530057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d1e0e836-9bb8-49bc-88f2-a26dd0eb7b6d req-1bd60ef9-f948-4592-939d-55862983605b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:29.531392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d1e0e836-9bb8-49bc-88f2-a26dd0eb7b6d req-1bd60ef9-f948-4592-939d-55862983605b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:29.535278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d1e0e836-9bb8-49bc-88f2-a26dd0eb7b6d req-1bd60ef9-f948-4592-939d-55862983605b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:29.571257 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-d1e0e836-9bb8-49bc-88f2-a26dd0eb7b6d req-1bd60ef9-f948-4592-939d-55862983605b service nova] Creating event network-changed:d19cb20a-5745-48f3-85ab-cd40490e46d8 for instance 52698341-5c8b-434b-82d4-5d35faf1b2fa on nch2-master-1 Sep 06 11:07:29.583997 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-d1e0e836-9bb8-49bc-88f2-a26dd0eb7b6d req-1bd60ef9-f948-4592-939d-55862983605b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087179 Sep 06 11:07:29.591362 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1899/3788] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:29.602199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-74ae3103-3600-47a1-80c0-8c6d739a5619 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:29.603356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-74ae3103-3600-47a1-80c0-8c6d739a5619 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:29.624578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ae3103-3600-47a1-80c0-8c6d739a5619 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:29.629359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ae3103-3600-47a1-80c0-8c6d739a5619 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:29.630307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ae3103-3600-47a1-80c0-8c6d739a5619 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:29.631378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ae3103-3600-47a1-80c0-8c6d739a5619 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:29.634157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ae3103-3600-47a1-80c0-8c6d739a5619 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:29.635432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74ae3103-3600-47a1-80c0-8c6d739a5619 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:29.687409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:29.708773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:29.860771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:30.161257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-52f4caf4-f3e2-4d45-95ad-e91e801970a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:30.175554 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-52f4caf4-f3e2-4d45-95ad-e91e801970a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1323 microversion: 2.1 time: 0.933273 Sep 06 11:07:30.195749 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1890/3789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:29 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1323 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:30.201657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ec5836d6-c231-403e-9bee-04aeb55cf4b6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:30.202555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ec5836d6-c231-403e-9bee-04aeb55cf4b6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:30.208914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec5836d6-c231-403e-9bee-04aeb55cf4b6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:30.209667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec5836d6-c231-403e-9bee-04aeb55cf4b6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:30.210357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec5836d6-c231-403e-9bee-04aeb55cf4b6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:30.211454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec5836d6-c231-403e-9bee-04aeb55cf4b6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:30.212129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec5836d6-c231-403e-9bee-04aeb55cf4b6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:30.213411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec5836d6-c231-403e-9bee-04aeb55cf4b6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:30.232907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-74ae3103-3600-47a1-80c0-8c6d739a5619 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:30.242372 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-74ae3103-3600-47a1-80c0-8c6d739a5619 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.649591 Sep 06 11:07:30.243223 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1900/3790] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:29 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:30.248424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5418d571-da18-4b6f-a2fc-276b8175b8ab tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:30.249034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5418d571-da18-4b6f-a2fc-276b8175b8ab tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:30.255486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5418d571-da18-4b6f-a2fc-276b8175b8ab tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:30.255984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5418d571-da18-4b6f-a2fc-276b8175b8ab tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:30.256619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5418d571-da18-4b6f-a2fc-276b8175b8ab tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:30.258255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5418d571-da18-4b6f-a2fc-276b8175b8ab tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:30.259139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5418d571-da18-4b6f-a2fc-276b8175b8ab tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:30.259996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5418d571-da18-4b6f-a2fc-276b8175b8ab tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:30.422224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5418d571-da18-4b6f-a2fc-276b8175b8ab tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:30.431338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5418d571-da18-4b6f-a2fc-276b8175b8ab tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:30.438321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5418d571-da18-4b6f-a2fc-276b8175b8ab tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:30.452218 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5418d571-da18-4b6f-a2fc-276b8175b8ab tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.207604 Sep 06 11:07:30.456887 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1901/3791] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:30 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:30.471173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3a9bd9a1-5e42-4ca0-975d-e55575d2f35e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:30.479451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3a9bd9a1-5e42-4ca0-975d-e55575d2f35e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:30.491213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a9bd9a1-5e42-4ca0-975d-e55575d2f35e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:30.493971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a9bd9a1-5e42-4ca0-975d-e55575d2f35e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:30.498370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a9bd9a1-5e42-4ca0-975d-e55575d2f35e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:30.498370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a9bd9a1-5e42-4ca0-975d-e55575d2f35e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:30.498370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a9bd9a1-5e42-4ca0-975d-e55575d2f35e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:30.498370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a9bd9a1-5e42-4ca0-975d-e55575d2f35e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:30.601247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ec5836d6-c231-403e-9bee-04aeb55cf4b6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:30.612069 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ec5836d6-c231-403e-9bee-04aeb55cf4b6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.414550 Sep 06 11:07:30.614066 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1891/3792] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:30 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:30.619412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2eef0b03-826a-4701-aac2-a5b77141c00e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:30.620292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2eef0b03-826a-4701-aac2-a5b77141c00e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:30.633081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2eef0b03-826a-4701-aac2-a5b77141c00e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:30.633938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2eef0b03-826a-4701-aac2-a5b77141c00e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:30.635252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2eef0b03-826a-4701-aac2-a5b77141c00e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:30.636207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2eef0b03-826a-4701-aac2-a5b77141c00e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:30.639070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2eef0b03-826a-4701-aac2-a5b77141c00e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:30.639575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2eef0b03-826a-4701-aac2-a5b77141c00e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:30.667387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-2eef0b03-826a-4701-aac2-a5b77141c00e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'flavor' on Instance uuid d9db1902-3f12-48b6-a27f-425e4843424b {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:30.671902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3a9bd9a1-5e42-4ca0-975d-e55575d2f35e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:30.680619 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3a9bd9a1-5e42-4ca0-975d-e55575d2f35e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1460 microversion: 2.1 time: 0.222308 Sep 06 11:07:30.685448 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1902/3793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:30 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1460 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:30.690614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-4fbb3674-1d52-4e43-b26f-2ec29ba78bd8 req-5a5cc19a-0159-4bd8-b19d-26ee42f8dca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c93ad3-522c-4df2-8654-f8ef007b95e2", "name": "network-vif-deleted", "tag": "b437278e-4964-4c05-8aba-db0ad7ce621c"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:30.721179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4fbb3674-1d52-4e43-b26f-2ec29ba78bd8 req-5a5cc19a-0159-4bd8-b19d-26ee42f8dca0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:30.723979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4fbb3674-1d52-4e43-b26f-2ec29ba78bd8 req-5a5cc19a-0159-4bd8-b19d-26ee42f8dca0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:30.725995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4fbb3674-1d52-4e43-b26f-2ec29ba78bd8 req-5a5cc19a-0159-4bd8-b19d-26ee42f8dca0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:30.752371 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-4fbb3674-1d52-4e43-b26f-2ec29ba78bd8 req-5a5cc19a-0159-4bd8-b19d-26ee42f8dca0 service nova] Creating event network-vif-deleted:b437278e-4964-4c05-8aba-db0ad7ce621c for instance 51c93ad3-522c-4df2-8654-f8ef007b95e2 on nch1-master-1 Sep 06 11:07:30.758978 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-4fbb3674-1d52-4e43-b26f-2ec29ba78bd8 req-5a5cc19a-0159-4bd8-b19d-26ee42f8dca0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071825 Sep 06 11:07:30.760469 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1903/3794] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:31.206370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aa4501dd-c2e2-4e2e-86cf-dd67926742f7 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:31.281655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aa4501dd-c2e2-4e2e-86cf-dd67926742f7 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:31.282343 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2eef0b03-826a-4701-aac2-a5b77141c00e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.592810 Sep 06 11:07:31.282343 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1892/3795] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:07:30 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:07:31.282843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa4501dd-c2e2-4e2e-86cf-dd67926742f7 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:31.282843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa4501dd-c2e2-4e2e-86cf-dd67926742f7 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:31.282843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa4501dd-c2e2-4e2e-86cf-dd67926742f7 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:31.282843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa4501dd-c2e2-4e2e-86cf-dd67926742f7 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:31.282843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa4501dd-c2e2-4e2e-86cf-dd67926742f7 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:31.282843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa4501dd-c2e2-4e2e-86cf-dd67926742f7 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:31.303688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8fd5d705-dbb1-4016-a4b8-7c5b07609b9b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:31.304867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8fd5d705-dbb1-4016-a4b8-7c5b07609b9b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:31.326792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fd5d705-dbb1-4016-a4b8-7c5b07609b9b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:31.330371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fd5d705-dbb1-4016-a4b8-7c5b07609b9b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:31.330944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fd5d705-dbb1-4016-a4b8-7c5b07609b9b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:31.331844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fd5d705-dbb1-4016-a4b8-7c5b07609b9b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:31.338070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fd5d705-dbb1-4016-a4b8-7c5b07609b9b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:31.339093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fd5d705-dbb1-4016-a4b8-7c5b07609b9b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:31.498472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aa4501dd-c2e2-4e2e-86cf-dd67926742f7 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:31.509399 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aa4501dd-c2e2-4e2e-86cf-dd67926742f7 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1323 microversion: 2.1 time: 0.308752 Sep 06 11:07:31.524475 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1904/3796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:31 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:31.537254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-72a5535f-39c2-4d18-bf53-3589c1262eaf tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:31.538308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-72a5535f-39c2-4d18-bf53-3589c1262eaf tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:31.548062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72a5535f-39c2-4d18-bf53-3589c1262eaf tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:31.548885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72a5535f-39c2-4d18-bf53-3589c1262eaf tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:31.549429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72a5535f-39c2-4d18-bf53-3589c1262eaf tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:31.550389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72a5535f-39c2-4d18-bf53-3589c1262eaf tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:31.550936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72a5535f-39c2-4d18-bf53-3589c1262eaf tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:31.551460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72a5535f-39c2-4d18-bf53-3589c1262eaf tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:31.703334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-72a5535f-39c2-4d18-bf53-3589c1262eaf tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:31.719296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-72a5535f-39c2-4d18-bf53-3589c1262eaf tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:31.719937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8fd5d705-dbb1-4016-a4b8-7c5b07609b9b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:31.721575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-72a5535f-39c2-4d18-bf53-3589c1262eaf tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:31.730081 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8fd5d705-dbb1-4016-a4b8-7c5b07609b9b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1676 microversion: 2.1 time: 0.438411 Sep 06 11:07:31.731329 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-72a5535f-39c2-4d18-bf53-3589c1262eaf tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.205251 Sep 06 11:07:31.732408 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1905/3797] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:31 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:31.751121 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1893/3798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:31 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1676 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:31.751342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f08fd0a0-7e2e-483f-8bd8-7264ac00f809 req-0627d209-fdfd-48a9-b165-990edc18a1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18170fa5-02fe-4fcb-8bfc-90e7223ea0f6", "tag": "b25adc4b-2f95-4609-afb0-171ed181d753"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:31.756315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-116d3fba-0971-49e2-bfdf-882e33bd1b2b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:31.757978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-116d3fba-0971-49e2-bfdf-882e33bd1b2b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:31.770942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-116d3fba-0971-49e2-bfdf-882e33bd1b2b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:31.775420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-116d3fba-0971-49e2-bfdf-882e33bd1b2b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:31.775420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-116d3fba-0971-49e2-bfdf-882e33bd1b2b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:31.775420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-116d3fba-0971-49e2-bfdf-882e33bd1b2b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:31.775420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-116d3fba-0971-49e2-bfdf-882e33bd1b2b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:31.775420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-116d3fba-0971-49e2-bfdf-882e33bd1b2b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:31.775827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f08fd0a0-7e2e-483f-8bd8-7264ac00f809 req-0627d209-fdfd-48a9-b165-990edc18a1e5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:31.775827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f08fd0a0-7e2e-483f-8bd8-7264ac00f809 req-0627d209-fdfd-48a9-b165-990edc18a1e5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:31.776145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f08fd0a0-7e2e-483f-8bd8-7264ac00f809 req-0627d209-fdfd-48a9-b165-990edc18a1e5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:31.803620 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f08fd0a0-7e2e-483f-8bd8-7264ac00f809 req-0627d209-fdfd-48a9-b165-990edc18a1e5 service nova] Creating event network-changed:b25adc4b-2f95-4609-afb0-171ed181d753 for instance 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 on nch1-master-1 Sep 06 11:07:31.812689 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f08fd0a0-7e2e-483f-8bd8-7264ac00f809 req-0627d209-fdfd-48a9-b165-990edc18a1e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078836 Sep 06 11:07:31.813790 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1906/3799] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:31.820866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:31.821857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:31.835629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:31.835629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:31.835629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:31.835629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:31.835629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:31.835629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:31.890636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:31.892359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:31.893047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:31.893742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lazy-loading 'fault' on Instance uuid 51c93ad3-522c-4df2-8654-f8ef007b95e2 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:31.998666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:32.022783 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e14c3bbf-e31f-4951-b2cc-818187b065e8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 200 len: 1303 microversion: 2.1 time: 0.200700 Sep 06 11:07:32.023829 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1907/3800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:31 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 1303 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:32.132143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-116d3fba-0971-49e2-bfdf-882e33bd1b2b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:32.150799 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-116d3fba-0971-49e2-bfdf-882e33bd1b2b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.405627 Sep 06 11:07:32.157069 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1894/3801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:31 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:32.543035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a31d8fe0-cbb5-41ab-9ed3-a36c1ac746f2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:32.545650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a31d8fe0-cbb5-41ab-9ed3-a36c1ac746f2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:32.555316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a31d8fe0-cbb5-41ab-9ed3-a36c1ac746f2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:32.557541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a31d8fe0-cbb5-41ab-9ed3-a36c1ac746f2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:32.558426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a31d8fe0-cbb5-41ab-9ed3-a36c1ac746f2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:32.559315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a31d8fe0-cbb5-41ab-9ed3-a36c1ac746f2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:32.559839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a31d8fe0-cbb5-41ab-9ed3-a36c1ac746f2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:32.560476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a31d8fe0-cbb5-41ab-9ed3-a36c1ac746f2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:32.765343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a226f4f9-ca2e-4d23-967c-693fe9eb0a09 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:32.766506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a226f4f9-ca2e-4d23-967c-693fe9eb0a09 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:32.779644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a226f4f9-ca2e-4d23-967c-693fe9eb0a09 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:32.786925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a226f4f9-ca2e-4d23-967c-693fe9eb0a09 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:32.789103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a226f4f9-ca2e-4d23-967c-693fe9eb0a09 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:32.791317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a226f4f9-ca2e-4d23-967c-693fe9eb0a09 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:32.796304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a226f4f9-ca2e-4d23-967c-693fe9eb0a09 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:32.797502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a226f4f9-ca2e-4d23-967c-693fe9eb0a09 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:32.924937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a31d8fe0-cbb5-41ab-9ed3-a36c1ac746f2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:32.933333 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a31d8fe0-cbb5-41ab-9ed3-a36c1ac746f2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1323 microversion: 2.1 time: 0.398859 Sep 06 11:07:32.934480 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1908/3802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:32 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1323 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:32.953225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b6ee2686-0be0-4d95-baa8-8012ec2d60a0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:32.954828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b6ee2686-0be0-4d95-baa8-8012ec2d60a0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:32.962228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6ee2686-0be0-4d95-baa8-8012ec2d60a0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:32.962750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6ee2686-0be0-4d95-baa8-8012ec2d60a0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:32.963226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6ee2686-0be0-4d95-baa8-8012ec2d60a0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:32.967891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6ee2686-0be0-4d95-baa8-8012ec2d60a0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:32.969679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6ee2686-0be0-4d95-baa8-8012ec2d60a0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:32.970341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b6ee2686-0be0-4d95-baa8-8012ec2d60a0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:32.980879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a226f4f9-ca2e-4d23-967c-693fe9eb0a09 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:33.003073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a226f4f9-ca2e-4d23-967c-693fe9eb0a09 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:33.012928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a226f4f9-ca2e-4d23-967c-693fe9eb0a09 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:33.024026 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a226f4f9-ca2e-4d23-967c-693fe9eb0a09 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.266344 Sep 06 11:07:33.025322 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1895/3803] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:32 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:33.047979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-b2ee8862-5379-48af-aa30-fd93f3fb5ba7 req-95441056-88a9-4380-9e70-8a016fe563b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "350357dd-33e7-47c7-8552-f7b07b29ce83", "tag": "8f24e839-3595-4d73-99ef-c5d9a014ebbd"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:33.063922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b2ee8862-5379-48af-aa30-fd93f3fb5ba7 req-95441056-88a9-4380-9e70-8a016fe563b5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:33.069878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b2ee8862-5379-48af-aa30-fd93f3fb5ba7 req-95441056-88a9-4380-9e70-8a016fe563b5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:33.069878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b2ee8862-5379-48af-aa30-fd93f3fb5ba7 req-95441056-88a9-4380-9e70-8a016fe563b5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:33.078206 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-b2ee8862-5379-48af-aa30-fd93f3fb5ba7 req-95441056-88a9-4380-9e70-8a016fe563b5 service nova] Creating event network-changed:8f24e839-3595-4d73-99ef-c5d9a014ebbd for instance 350357dd-33e7-47c7-8552-f7b07b29ce83 on nch2-master-1 Sep 06 11:07:33.083963 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-b2ee8862-5379-48af-aa30-fd93f3fb5ba7 req-95441056-88a9-4380-9e70-8a016fe563b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039991 Sep 06 11:07:33.085102 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1896/3804] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:07:33.091502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7241a36b-58e5-4b55-9da5-a9bb5f7fe090 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:33.092576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7241a36b-58e5-4b55-9da5-a9bb5f7fe090 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 51c93ad3-522c-4df2-8654-f8ef007b95e2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:33.099607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7241a36b-58e5-4b55-9da5-a9bb5f7fe090 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:33.100258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7241a36b-58e5-4b55-9da5-a9bb5f7fe090 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:33.100935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7241a36b-58e5-4b55-9da5-a9bb5f7fe090 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:33.101876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7241a36b-58e5-4b55-9da5-a9bb5f7fe090 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:33.102704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7241a36b-58e5-4b55-9da5-a9bb5f7fe090 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:33.103932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7241a36b-58e5-4b55-9da5-a9bb5f7fe090 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:33.124705 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-7241a36b-58e5-4b55-9da5-a9bb5f7fe090 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] HTTP exception thrown: Instance 51c93ad3-522c-4df2-8654-f8ef007b95e2 could not be found. Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7241a36b-58e5-4b55-9da5-a9bb5f7fe090 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Request method failure captured: Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 HTTP/1.1 Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFynXXGOZsQsK0mZZhBHBelBc0OtLnIv9DRLHtl4Qs0rCAt0VPgnKsoLow3xjOCfuVwruf6RqQlnNHVYMFIJti37CpEkZ6kdIwAEBpGYZJcNKsLmK1ut5_I09aN9b4L3Z4FUMLUedHCV9q2DFfa7Ci3ZbxMwtluYsLGYUjzZvCCNfdcs Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 534a6b8f7bb04d4e9e3493388bd1d86e Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-VolumesActionsTest-968355216 Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_534a6b8f7bb04d4e9e3493388bd1d86e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/534a6b8f7bb04d4e9e3493388bd1d86e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/534a6b8f7bb04d4e9e3493388bd1d86e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/534a6b8f7bb04d4e9e3493388bd1d86e"}]}] Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-VolumesActionsTest-968355216 Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 534a6b8f7bb04d4e9e3493388bd1d86e Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-VolumesActionsTest-968355216 Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-VolumesActionsTest-968355216-project Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 86e756626ac4446e907deba71a0ebeb2 Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-VolumesActionsTest-968355216-project Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 51c93ad3-522c-4df2-8654-f8ef007b95e2 could not be found. Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '51c93ad3-522c-4df2-8654-f8ef007b95e2'} Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c93ad3-522c-4df2-8654-f8ef007b95e2 could not be found. Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c93ad3-522c-4df2-8654-f8ef007b95e2 could not be found. Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:33.127655 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:33.130929 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:33.130929 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:33.130929 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:33.130929 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:07:33.130929 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:07:33.130929 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c93ad3-522c-4df2-8654-f8ef007b95e2 could not be found. Sep 06 11:07:33.130929 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:33.133294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7241a36b-58e5-4b55-9da5-a9bb5f7fe090 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Returning 404 to user: Instance 51c93ad3-522c-4df2-8654-f8ef007b95e2 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:07:33.134765 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7241a36b-58e5-4b55-9da5-a9bb5f7fe090 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2" status: 404 len: 111 microversion: 2.1 time: 0.048275 Sep 06 11:07:33.136047 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1897/3805] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:33 2022] GET /compute/v2.1/servers/51c93ad3-522c-4df2-8654-f8ef007b95e2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:07:33.179402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-84aca54f-d7de-461f-afa2-6c8c014c9ad0 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:33.180839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-84aca54f-d7de-461f-afa2-6c8c014c9ad0 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:33.192425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-84aca54f-d7de-461f-afa2-6c8c014c9ad0 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:33.195253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-84aca54f-d7de-461f-afa2-6c8c014c9ad0 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:33.195990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-84aca54f-d7de-461f-afa2-6c8c014c9ad0 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:33.198878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-84aca54f-d7de-461f-afa2-6c8c014c9ad0 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:33.200919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-84aca54f-d7de-461f-afa2-6c8c014c9ad0 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:33.202516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-84aca54f-d7de-461f-afa2-6c8c014c9ad0 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:33.565381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=11 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:33.716760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b6ee2686-0be0-4d95-baa8-8012ec2d60a0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:33.730810 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b6ee2686-0be0-4d95-baa8-8012ec2d60a0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1659 microversion: 2.1 time: 0.794969 Sep 06 11:07:33.731447 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1909/3806] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:32 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1659 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:33.740932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1919554594", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "a3de7662-e9a7-4ef7-8131-31b8128a0fb3"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:33.758194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-84aca54f-d7de-461f-afa2-6c8c014c9ad0 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:33.768708 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-84aca54f-d7de-461f-afa2-6c8c014c9ad0 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.594668 Sep 06 11:07:33.778806 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1898/3807] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:33 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:33.783765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-101bacca-8d56-48bd-ac22-5fc7b40f0d57 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:33.784314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-101bacca-8d56-48bd-ac22-5fc7b40f0d57 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:33.792041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-101bacca-8d56-48bd-ac22-5fc7b40f0d57 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:33.792866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-101bacca-8d56-48bd-ac22-5fc7b40f0d57 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:33.797728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-101bacca-8d56-48bd-ac22-5fc7b40f0d57 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:33.807416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-101bacca-8d56-48bd-ac22-5fc7b40f0d57 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:33.810117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-101bacca-8d56-48bd-ac22-5fc7b40f0d57 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:33.810761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-101bacca-8d56-48bd-ac22-5fc7b40f0d57 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:33.865643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] validate_networks() for [('a3de7662-e9a7-4ef7-8131-31b8128a0fb3', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:07:34.160302 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-101bacca-8d56-48bd-ac22-5fc7b40f0d57 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action" status: 202 len: 0 microversion: 2.1 time: 0.380593 Sep 06 11:07:34.161275 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1899/3808] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:07:33 2022] POST /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:07:34.171385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b881bd6b-6da2-432d-84c4-423f8fd9b2bd tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:34.179000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b881bd6b-6da2-432d-84c4-423f8fd9b2bd tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:34.185978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b881bd6b-6da2-432d-84c4-423f8fd9b2bd tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:34.186478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b881bd6b-6da2-432d-84c4-423f8fd9b2bd tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:34.186928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b881bd6b-6da2-432d-84c4-423f8fd9b2bd tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:34.187685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b881bd6b-6da2-432d-84c4-423f8fd9b2bd tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:34.188337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b881bd6b-6da2-432d-84c4-423f8fd9b2bd tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:34.188777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b881bd6b-6da2-432d-84c4-423f8fd9b2bd tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:34.396599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b881bd6b-6da2-432d-84c4-423f8fd9b2bd tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:34.407130 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b881bd6b-6da2-432d-84c4-423f8fd9b2bd tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1323 microversion: 2.1 time: 0.244292 Sep 06 11:07:34.410419 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1900/3809] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:34 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1323 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:34.421382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9cbfd0f3-6662-46e8-98a1-87b00fec6c80 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:34.422026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9cbfd0f3-6662-46e8-98a1-87b00fec6c80 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:34.440694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cbfd0f3-6662-46e8-98a1-87b00fec6c80 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:34.443335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cbfd0f3-6662-46e8-98a1-87b00fec6c80 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:34.443797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cbfd0f3-6662-46e8-98a1-87b00fec6c80 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:34.445148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cbfd0f3-6662-46e8-98a1-87b00fec6c80 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:34.445618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cbfd0f3-6662-46e8-98a1-87b00fec6c80 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:34.447223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cbfd0f3-6662-46e8-98a1-87b00fec6c80 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:34.637763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9cbfd0f3-6662-46e8-98a1-87b00fec6c80 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:34.652303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9cbfd0f3-6662-46e8-98a1-87b00fec6c80 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:34.663212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9cbfd0f3-6662-46e8-98a1-87b00fec6c80 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:34.670918 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9cbfd0f3-6662-46e8-98a1-87b00fec6c80 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.256533 Sep 06 11:07:34.671573 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1901/3810] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:34 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:34.687927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b1050d76-1ff8-44ba-b158-834ab167ccef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:34.688567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b1050d76-1ff8-44ba-b158-834ab167ccef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:34.704690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1050d76-1ff8-44ba-b158-834ab167ccef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:34.705301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1050d76-1ff8-44ba-b158-834ab167ccef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:34.709768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1050d76-1ff8-44ba-b158-834ab167ccef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:34.709768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1050d76-1ff8-44ba-b158-834ab167ccef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:34.709768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1050d76-1ff8-44ba-b158-834ab167ccef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:34.709768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1050d76-1ff8-44ba-b158-834ab167ccef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:35.062766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:07:35.063365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:07:35.063691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:07:35.064107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:07:35.064525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:07:35.076283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:35.078488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:35.078488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:35.079229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:35.080643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:35.082519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:35.091140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b1050d76-1ff8-44ba-b158-834ab167ccef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:35.099954 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b1050d76-1ff8-44ba-b158-834ab167ccef tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1665 microversion: 2.1 time: 0.427353 Sep 06 11:07:35.106337 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1902/3811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:34 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1665 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:35.112469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Getting quotas for project 534a6b8f7bb04d4e9e3493388bd1d86e. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:07:35.113794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e0130015-4d69-4e97-803b-63cc28f9fcc4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:35.114497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e0130015-4d69-4e97-803b-63cc28f9fcc4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:35.120538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Getting quotas for user 86e756626ac4446e907deba71a0ebeb2 and project 534a6b8f7bb04d4e9e3493388bd1d86e. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:07:35.123818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0130015-4d69-4e97-803b-63cc28f9fcc4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:35.124402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0130015-4d69-4e97-803b-63cc28f9fcc4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:35.124926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0130015-4d69-4e97-803b-63cc28f9fcc4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:35.132742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0130015-4d69-4e97-803b-63cc28f9fcc4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:35.133595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0130015-4d69-4e97-803b-63cc28f9fcc4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:35.136061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0130015-4d69-4e97-803b-63cc28f9fcc4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:35.139293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:35.141134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:07:35.143909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:07:35.302025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e0130015-4d69-4e97-803b-63cc28f9fcc4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:35.304636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:35.313648 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e0130015-4d69-4e97-803b-63cc28f9fcc4 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.208577 Sep 06 11:07:35.314994 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1903/3812] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:35 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:35.320976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-7cfa4f27-45c7-49ca-9c47-3ee9562262fd req-ab056794-01aa-40cb-aa82-ea70e2feffdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52698341-5c8b-434b-82d4-5d35faf1b2fa", "name": "network-vif-plugged", "status": "completed", "tag": "d19cb20a-5745-48f3-85ab-cd40490e46d8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:35.333663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7cfa4f27-45c7-49ca-9c47-3ee9562262fd req-ab056794-01aa-40cb-aa82-ea70e2feffdb service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:35.334390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7cfa4f27-45c7-49ca-9c47-3ee9562262fd req-ab056794-01aa-40cb-aa82-ea70e2feffdb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:35.335040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7cfa4f27-45c7-49ca-9c47-3ee9562262fd req-ab056794-01aa-40cb-aa82-ea70e2feffdb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:35.353697 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-7cfa4f27-45c7-49ca-9c47-3ee9562262fd req-ab056794-01aa-40cb-aa82-ea70e2feffdb service nova] Creating event network-vif-plugged:d19cb20a-5745-48f3-85ab-cd40490e46d8 for instance 52698341-5c8b-434b-82d4-5d35faf1b2fa on nch2-master-1 Sep 06 11:07:35.359089 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-7cfa4f27-45c7-49ca-9c47-3ee9562262fd req-ab056794-01aa-40cb-aa82-ea70e2feffdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042597 Sep 06 11:07:35.359917 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1904/3813] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:35.422831 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-34afa166-f288-469f-a0d3-1c7a340753de tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689935 Sep 06 11:07:35.423744 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1910/3814] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:07:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:07:35.441208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e9fb9f7b-0964-425b-9f7d-a32cdf8d63da tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:35.442296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e9fb9f7b-0964-425b-9f7d-a32cdf8d63da tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:35.449658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9fb9f7b-0964-425b-9f7d-a32cdf8d63da tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:35.450165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9fb9f7b-0964-425b-9f7d-a32cdf8d63da tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:35.450623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9fb9f7b-0964-425b-9f7d-a32cdf8d63da tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:35.451567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9fb9f7b-0964-425b-9f7d-a32cdf8d63da tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:35.452092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9fb9f7b-0964-425b-9f7d-a32cdf8d63da tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:35.452542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9fb9f7b-0964-425b-9f7d-a32cdf8d63da tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:35.459413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a0efd34-f26a-4a36-a7ad-4bae14058dce tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:35.459413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0a0efd34-f26a-4a36-a7ad-4bae14058dce tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:35.525092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0a0efd34-f26a-4a36-a7ad-4bae14058dce tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:35.546043 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0a0efd34-f26a-4a36-a7ad-4bae14058dce tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1214 microversion: 2.1 time: 0.089830 Sep 06 11:07:35.546043 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1911/3815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:35 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:35.673510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e9fb9f7b-0964-425b-9f7d-a32cdf8d63da tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:35.682298 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e9fb9f7b-0964-425b-9f7d-a32cdf8d63da tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1323 microversion: 2.1 time: 0.246338 Sep 06 11:07:35.682999 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1905/3816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:35 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:35.701155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8267b9a6-bac5-42e3-9bd4-dd8525474665 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:35.701791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8267b9a6-bac5-42e3-9bd4-dd8525474665 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:35.710583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8267b9a6-bac5-42e3-9bd4-dd8525474665 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:35.711154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8267b9a6-bac5-42e3-9bd4-dd8525474665 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:35.711608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8267b9a6-bac5-42e3-9bd4-dd8525474665 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:35.712855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8267b9a6-bac5-42e3-9bd4-dd8525474665 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:35.713854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8267b9a6-bac5-42e3-9bd4-dd8525474665 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:35.714355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8267b9a6-bac5-42e3-9bd4-dd8525474665 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:35.790033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8267b9a6-bac5-42e3-9bd4-dd8525474665 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:35.801034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8267b9a6-bac5-42e3-9bd4-dd8525474665 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:35.802690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8267b9a6-bac5-42e3-9bd4-dd8525474665 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:35.809570 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8267b9a6-bac5-42e3-9bd4-dd8525474665 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.113532 Sep 06 11:07:35.810088 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1912/3817] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:35 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:36.128001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-523fa39c-c303-4d50-8821-ccca5cceaee8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:36.128627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-523fa39c-c303-4d50-8821-ccca5cceaee8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:36.141529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-523fa39c-c303-4d50-8821-ccca5cceaee8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:36.142037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-523fa39c-c303-4d50-8821-ccca5cceaee8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:36.142493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-523fa39c-c303-4d50-8821-ccca5cceaee8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:36.143241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-523fa39c-c303-4d50-8821-ccca5cceaee8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:36.144463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-523fa39c-c303-4d50-8821-ccca5cceaee8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:36.153306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-523fa39c-c303-4d50-8821-ccca5cceaee8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:36.343645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2e17072f-fb2b-411e-bfe3-cde3896f3871 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:36.344285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2e17072f-fb2b-411e-bfe3-cde3896f3871 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:36.355720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e17072f-fb2b-411e-bfe3-cde3896f3871 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:36.358511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e17072f-fb2b-411e-bfe3-cde3896f3871 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:36.359269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e17072f-fb2b-411e-bfe3-cde3896f3871 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:36.366388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e17072f-fb2b-411e-bfe3-cde3896f3871 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:36.367959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e17072f-fb2b-411e-bfe3-cde3896f3871 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:36.368465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e17072f-fb2b-411e-bfe3-cde3896f3871 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:36.496567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-523fa39c-c303-4d50-8821-ccca5cceaee8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:36.504734 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-523fa39c-c303-4d50-8821-ccca5cceaee8 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1665 microversion: 2.1 time: 0.380666 Sep 06 11:07:36.505315 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1906/3818] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:36 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1665 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:36.561416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-56cbd8f6-0658-4a93-9b25-13d0ca44d050 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:36.562238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-56cbd8f6-0658-4a93-9b25-13d0ca44d050 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:36.565609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:36.634914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-56cbd8f6-0658-4a93-9b25-13d0ca44d050 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:36.642411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2e17072f-fb2b-411e-bfe3-cde3896f3871 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:36.642702 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-56cbd8f6-0658-4a93-9b25-13d0ca44d050 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1214 microversion: 2.1 time: 0.085386 Sep 06 11:07:36.643430 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1907/3819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:36 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:36.653488 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2e17072f-fb2b-411e-bfe3-cde3896f3871 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.320080 Sep 06 11:07:36.654128 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1913/3820] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:36 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:36.708105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c0057b2-a525-4806-9c69-b36687f9c9d9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:36.708831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4c0057b2-a525-4806-9c69-b36687f9c9d9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:36.715696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c0057b2-a525-4806-9c69-b36687f9c9d9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:36.716198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c0057b2-a525-4806-9c69-b36687f9c9d9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:36.716652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c0057b2-a525-4806-9c69-b36687f9c9d9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:36.717361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c0057b2-a525-4806-9c69-b36687f9c9d9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:36.717829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c0057b2-a525-4806-9c69-b36687f9c9d9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:36.718293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c0057b2-a525-4806-9c69-b36687f9c9d9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:36.842466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-375dc2fb-1c27-4278-b0da-fb205043ea98 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:36.843393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-375dc2fb-1c27-4278-b0da-fb205043ea98 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:36.854434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375dc2fb-1c27-4278-b0da-fb205043ea98 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:36.855385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375dc2fb-1c27-4278-b0da-fb205043ea98 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:36.856038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375dc2fb-1c27-4278-b0da-fb205043ea98 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:36.857223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375dc2fb-1c27-4278-b0da-fb205043ea98 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:36.857326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375dc2fb-1c27-4278-b0da-fb205043ea98 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:36.857765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375dc2fb-1c27-4278-b0da-fb205043ea98 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:36.889414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4c0057b2-a525-4806-9c69-b36687f9c9d9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:36.900435 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4c0057b2-a525-4806-9c69-b36687f9c9d9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1323 microversion: 2.1 time: 0.195085 Sep 06 11:07:36.903088 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1908/3821] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:36 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1323 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:36.980385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-375dc2fb-1c27-4278-b0da-fb205043ea98 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:36.990767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-375dc2fb-1c27-4278-b0da-fb205043ea98 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:36.992571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-375dc2fb-1c27-4278-b0da-fb205043ea98 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:36.999777 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-375dc2fb-1c27-4278-b0da-fb205043ea98 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.162220 Sep 06 11:07:37.000645 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1914/3822] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:36 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:07:37.536598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7de96eeb-da21-459f-9cc8-cc3df9da9004 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:37.537794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7de96eeb-da21-459f-9cc8-cc3df9da9004 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:37.546069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7de96eeb-da21-459f-9cc8-cc3df9da9004 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:37.546584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7de96eeb-da21-459f-9cc8-cc3df9da9004 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:37.547056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7de96eeb-da21-459f-9cc8-cc3df9da9004 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:37.547977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7de96eeb-da21-459f-9cc8-cc3df9da9004 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:37.548440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7de96eeb-da21-459f-9cc8-cc3df9da9004 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:37.548922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7de96eeb-da21-459f-9cc8-cc3df9da9004 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:37.674123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4ce64caf-1ffa-45ce-9a27-6ddf08475212 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:37.675110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4ce64caf-1ffa-45ce-9a27-6ddf08475212 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:37.682364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ce64caf-1ffa-45ce-9a27-6ddf08475212 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:37.682861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ce64caf-1ffa-45ce-9a27-6ddf08475212 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:37.683527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ce64caf-1ffa-45ce-9a27-6ddf08475212 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:37.684246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ce64caf-1ffa-45ce-9a27-6ddf08475212 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:37.685445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ce64caf-1ffa-45ce-9a27-6ddf08475212 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:37.685883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ce64caf-1ffa-45ce-9a27-6ddf08475212 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:37.751160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7de96eeb-da21-459f-9cc8-cc3df9da9004 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:37.767356 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7de96eeb-da21-459f-9cc8-cc3df9da9004 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1665 microversion: 2.1 time: 0.228603 Sep 06 11:07:37.767356 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1909/3823] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:37 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1665 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:37.767356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4eb6408-4fe6-4e98-ae1e-d0cbf273d5b8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:37.767731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b4eb6408-4fe6-4e98-ae1e-d0cbf273d5b8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:37.776721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4eb6408-4fe6-4e98-ae1e-d0cbf273d5b8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:37.777653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4eb6408-4fe6-4e98-ae1e-d0cbf273d5b8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:37.778260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4eb6408-4fe6-4e98-ae1e-d0cbf273d5b8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:37.779452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4eb6408-4fe6-4e98-ae1e-d0cbf273d5b8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:37.780149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4eb6408-4fe6-4e98-ae1e-d0cbf273d5b8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:37.780796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4eb6408-4fe6-4e98-ae1e-d0cbf273d5b8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:37.782188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4ce64caf-1ffa-45ce-9a27-6ddf08475212 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:37.791075 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4ce64caf-1ffa-45ce-9a27-6ddf08475212 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1210 microversion: 2.1 time: 0.128181 Sep 06 11:07:37.791665 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1915/3824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:37 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1210 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:37.931479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5da10464-f5e1-47e1-ab71-6d6bd4ba6192 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:37.932625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5da10464-f5e1-47e1-ab71-6d6bd4ba6192 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:37.940270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5da10464-f5e1-47e1-ab71-6d6bd4ba6192 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:37.942328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5da10464-f5e1-47e1-ab71-6d6bd4ba6192 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:37.943193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5da10464-f5e1-47e1-ab71-6d6bd4ba6192 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:37.943954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5da10464-f5e1-47e1-ab71-6d6bd4ba6192 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:37.944546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5da10464-f5e1-47e1-ab71-6d6bd4ba6192 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:37.945315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5da10464-f5e1-47e1-ab71-6d6bd4ba6192 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:37.989454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b4eb6408-4fe6-4e98-ae1e-d0cbf273d5b8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:38.000438 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b4eb6408-4fe6-4e98-ae1e-d0cbf273d5b8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.237472 Sep 06 11:07:38.001703 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1910/3825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:37 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:38.038865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d019fc50-1511-431e-9278-cd154c8bd5c5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:38.039884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d019fc50-1511-431e-9278-cd154c8bd5c5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:38.053715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d019fc50-1511-431e-9278-cd154c8bd5c5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:38.054565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d019fc50-1511-431e-9278-cd154c8bd5c5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:38.055219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d019fc50-1511-431e-9278-cd154c8bd5c5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:38.056463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d019fc50-1511-431e-9278-cd154c8bd5c5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:38.057304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d019fc50-1511-431e-9278-cd154c8bd5c5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:38.057900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d019fc50-1511-431e-9278-cd154c8bd5c5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:38.147326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d019fc50-1511-431e-9278-cd154c8bd5c5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:38.154995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5da10464-f5e1-47e1-ab71-6d6bd4ba6192 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:38.157723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d019fc50-1511-431e-9278-cd154c8bd5c5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:38.159630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d019fc50-1511-431e-9278-cd154c8bd5c5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:38.163794 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5da10464-f5e1-47e1-ab71-6d6bd4ba6192 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1323 microversion: 2.1 time: 0.236770 Sep 06 11:07:38.164387 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1916/3826] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:37 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1323 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:38.165206 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d019fc50-1511-431e-9278-cd154c8bd5c5 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1553 microversion: 2.91 time: 0.131784 Sep 06 11:07:38.167056 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1911/3827] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:38 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1553 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:07:38.169859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-79646c39-39e6-467c-b395-05ff0c53a95a req-6d430f2f-49bf-4143-a27b-4f3fa13cb2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18170fa5-02fe-4fcb-8bfc-90e7223ea0f6", "name": "network-vif-plugged", "status": "completed", "tag": "b25adc4b-2f95-4609-afb0-171ed181d753"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:38.179499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-79646c39-39e6-467c-b395-05ff0c53a95a req-6d430f2f-49bf-4143-a27b-4f3fa13cb2b9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:38.179986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-79646c39-39e6-467c-b395-05ff0c53a95a req-6d430f2f-49bf-4143-a27b-4f3fa13cb2b9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:38.180425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-79646c39-39e6-467c-b395-05ff0c53a95a req-6d430f2f-49bf-4143-a27b-4f3fa13cb2b9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:38.191957 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-79646c39-39e6-467c-b395-05ff0c53a95a req-6d430f2f-49bf-4143-a27b-4f3fa13cb2b9 service nova] Creating event network-vif-plugged:b25adc4b-2f95-4609-afb0-171ed181d753 for instance 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 on nch1-master-1 Sep 06 11:07:38.197292 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-79646c39-39e6-467c-b395-05ff0c53a95a req-6d430f2f-49bf-4143-a27b-4f3fa13cb2b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031263 Sep 06 11:07:38.197875 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1917/3828] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:38.792172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2de48988-7de2-4b2f-b000-aaa9987be186 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:38.792910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2de48988-7de2-4b2f-b000-aaa9987be186 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:38.801392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2de48988-7de2-4b2f-b000-aaa9987be186 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:38.801882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2de48988-7de2-4b2f-b000-aaa9987be186 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:38.802335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2de48988-7de2-4b2f-b000-aaa9987be186 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:38.803125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2de48988-7de2-4b2f-b000-aaa9987be186 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:38.803571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2de48988-7de2-4b2f-b000-aaa9987be186 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:38.804103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2de48988-7de2-4b2f-b000-aaa9987be186 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:38.818376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f1727ed0-7bee-4dac-a642-bec10a08de0b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:38.823089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f1727ed0-7bee-4dac-a642-bec10a08de0b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:38.825850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1727ed0-7bee-4dac-a642-bec10a08de0b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:38.826350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1727ed0-7bee-4dac-a642-bec10a08de0b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:38.826797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1727ed0-7bee-4dac-a642-bec10a08de0b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:38.827547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1727ed0-7bee-4dac-a642-bec10a08de0b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:38.828015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1727ed0-7bee-4dac-a642-bec10a08de0b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:38.828454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1727ed0-7bee-4dac-a642-bec10a08de0b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:38.909530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f1727ed0-7bee-4dac-a642-bec10a08de0b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:38.919744 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f1727ed0-7bee-4dac-a642-bec10a08de0b tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1266 microversion: 2.1 time: 0.105690 Sep 06 11:07:38.920516 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1918/3829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:38 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:38.968197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2de48988-7de2-4b2f-b000-aaa9987be186 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:38.976623 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2de48988-7de2-4b2f-b000-aaa9987be186 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.188965 Sep 06 11:07:38.977392 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1912/3830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:38 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:39.001117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-44e43b15-e70f-401b-8ae9-3c5ee2f052e4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:39.001738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-44e43b15-e70f-401b-8ae9-3c5ee2f052e4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:39.008987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44e43b15-e70f-401b-8ae9-3c5ee2f052e4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:39.009481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44e43b15-e70f-401b-8ae9-3c5ee2f052e4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:39.009929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44e43b15-e70f-401b-8ae9-3c5ee2f052e4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:39.010633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44e43b15-e70f-401b-8ae9-3c5ee2f052e4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:39.011158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44e43b15-e70f-401b-8ae9-3c5ee2f052e4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:39.011606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44e43b15-e70f-401b-8ae9-3c5ee2f052e4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:39.028290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-097daf09-5fc7-4d15-80ca-bd3e8c810d84 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:39.029214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-097daf09-5fc7-4d15-80ca-bd3e8c810d84 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:39.042858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-097daf09-5fc7-4d15-80ca-bd3e8c810d84 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:39.043641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-097daf09-5fc7-4d15-80ca-bd3e8c810d84 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:39.044775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-097daf09-5fc7-4d15-80ca-bd3e8c810d84 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:39.045517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-097daf09-5fc7-4d15-80ca-bd3e8c810d84 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:39.046044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-097daf09-5fc7-4d15-80ca-bd3e8c810d84 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:39.046484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-097daf09-5fc7-4d15-80ca-bd3e8c810d84 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:39.219164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-44e43b15-e70f-401b-8ae9-3c5ee2f052e4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:39.228864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-097daf09-5fc7-4d15-80ca-bd3e8c810d84 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:39.233957 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-44e43b15-e70f-401b-8ae9-3c5ee2f052e4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1668 microversion: 2.1 time: 0.236644 Sep 06 11:07:39.237345 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1919/3831] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:38 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1668 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:39.251189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e085bb78-89d3-4c12-a9e3-5c44be3901ef tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:39.255786 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-097daf09-5fc7-4d15-80ca-bd3e8c810d84 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.230010 Sep 06 11:07:39.255914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e085bb78-89d3-4c12-a9e3-5c44be3901ef tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:39.267061 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1913/3832] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:39 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:39.267255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e085bb78-89d3-4c12-a9e3-5c44be3901ef tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:39.267255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e085bb78-89d3-4c12-a9e3-5c44be3901ef tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:39.267255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e085bb78-89d3-4c12-a9e3-5c44be3901ef tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:39.267540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e5bb825c-5985-43db-b62b-dd9ca4ac7551 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:39.267625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e085bb78-89d3-4c12-a9e3-5c44be3901ef tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:39.267707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e5bb825c-5985-43db-b62b-dd9ca4ac7551 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:39.267786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e085bb78-89d3-4c12-a9e3-5c44be3901ef tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:39.267786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e085bb78-89d3-4c12-a9e3-5c44be3901ef tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:39.270958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:39.276069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5bb825c-5985-43db-b62b-dd9ca4ac7551 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:39.276746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5bb825c-5985-43db-b62b-dd9ca4ac7551 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:39.277357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5bb825c-5985-43db-b62b-dd9ca4ac7551 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:39.278457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5bb825c-5985-43db-b62b-dd9ca4ac7551 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:39.279564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5bb825c-5985-43db-b62b-dd9ca4ac7551 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:39.280232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5bb825c-5985-43db-b62b-dd9ca4ac7551 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:39.383964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e5bb825c-5985-43db-b62b-dd9ca4ac7551 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:39.396227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e5bb825c-5985-43db-b62b-dd9ca4ac7551 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:39.398193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e5bb825c-5985-43db-b62b-dd9ca4ac7551 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:39.404239 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e5bb825c-5985-43db-b62b-dd9ca4ac7551 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1535 microversion: 2.91 time: 0.144363 Sep 06 11:07:39.405037 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1914/3833] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:39 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1535 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:39.428636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:39.429394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:39.436052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:39.436763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:39.437366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:39.439226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:39.439849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:39.440475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:39.471203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:07:39.478337 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.compute.api [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Working on deleting snapshot 884f3475-841f-49f9-a21c-44639b94aba0 from shelved instance... Sep 06 11:07:39.550475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e085bb78-89d3-4c12-a9e3-5c44be3901ef tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:39.559240 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e085bb78-89d3-4c12-a9e3-5c44be3901ef tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1323 microversion: 2.1 time: 0.320553 Sep 06 11:07:39.560112 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1920/3834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:39 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:39.943863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b543ff95-9136-40b9-b865-e5aaf2630335 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:39.949449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b543ff95-9136-40b9-b865-e5aaf2630335 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:39.952505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b543ff95-9136-40b9-b865-e5aaf2630335 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:39.952861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b543ff95-9136-40b9-b865-e5aaf2630335 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:39.953306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b543ff95-9136-40b9-b865-e5aaf2630335 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:39.954015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b543ff95-9136-40b9-b865-e5aaf2630335 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:39.954528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b543ff95-9136-40b9-b865-e5aaf2630335 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:39.955401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b543ff95-9136-40b9-b865-e5aaf2630335 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:40.024444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b543ff95-9136-40b9-b865-e5aaf2630335 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:40.032258 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b543ff95-9136-40b9-b865-e5aaf2630335 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1266 microversion: 2.1 time: 0.092314 Sep 06 11:07:40.032840 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1921/3835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:39 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:40.212350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-79f943ac-a1e0-4f11-a189-47d924a483c7 req-863bc392-3411-4cb6-96f1-ec80543a3ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "350357dd-33e7-47c7-8552-f7b07b29ce83", "name": "network-vif-plugged", "status": "completed", "tag": "8f24e839-3595-4d73-99ef-c5d9a014ebbd"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:40.222085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-79f943ac-a1e0-4f11-a189-47d924a483c7 req-863bc392-3411-4cb6-96f1-ec80543a3ac0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:40.222571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-79f943ac-a1e0-4f11-a189-47d924a483c7 req-863bc392-3411-4cb6-96f1-ec80543a3ac0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:40.223035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-79f943ac-a1e0-4f11-a189-47d924a483c7 req-863bc392-3411-4cb6-96f1-ec80543a3ac0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:40.234673 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-79f943ac-a1e0-4f11-a189-47d924a483c7 req-863bc392-3411-4cb6-96f1-ec80543a3ac0 service nova] Creating event network-vif-plugged:8f24e839-3595-4d73-99ef-c5d9a014ebbd for instance 350357dd-33e7-47c7-8552-f7b07b29ce83 on nch2-master-1 Sep 06 11:07:40.239557 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-79f943ac-a1e0-4f11-a189-47d924a483c7 req-863bc392-3411-4cb6-96f1-ec80543a3ac0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031249 Sep 06 11:07:40.240152 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1922/3836] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:07:40.286510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2611c127-486d-4c52-9634-8c621bc792e1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:40.287499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2611c127-486d-4c52-9634-8c621bc792e1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:40.294973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2611c127-486d-4c52-9634-8c621bc792e1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:40.295720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2611c127-486d-4c52-9634-8c621bc792e1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:40.296166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2611c127-486d-4c52-9634-8c621bc792e1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:40.296936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2611c127-486d-4c52-9634-8c621bc792e1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:40.297401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2611c127-486d-4c52-9634-8c621bc792e1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:40.297837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2611c127-486d-4c52-9634-8c621bc792e1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:40.497884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2611c127-486d-4c52-9634-8c621bc792e1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:40.505923 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2611c127-486d-4c52-9634-8c621bc792e1 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.223929 Sep 06 11:07:40.506502 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1923/3837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:40 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:40.511314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dc8492e9-1876-431f-950c-04f54b51563b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:40.511926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dc8492e9-1876-431f-950c-04f54b51563b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:40.517792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc8492e9-1876-431f-950c-04f54b51563b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:40.518286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc8492e9-1876-431f-950c-04f54b51563b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:40.518740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc8492e9-1876-431f-950c-04f54b51563b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:40.519473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc8492e9-1876-431f-950c-04f54b51563b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:40.519949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc8492e9-1876-431f-950c-04f54b51563b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:40.520389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc8492e9-1876-431f-950c-04f54b51563b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:40.589301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dc8492e9-1876-431f-950c-04f54b51563b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:40.597800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dc8492e9-1876-431f-950c-04f54b51563b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:40.599666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dc8492e9-1876-431f-950c-04f54b51563b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:40.604876 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dc8492e9-1876-431f-950c-04f54b51563b tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1535 microversion: 2.91 time: 0.097400 Sep 06 11:07:40.623033 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1924/3838] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:40 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1535 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:40.623033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a18ca9bd-0adc-4c0e-9550-26cd2f795969 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:40.623033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a18ca9bd-0adc-4c0e-9550-26cd2f795969 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:40.623033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a18ca9bd-0adc-4c0e-9550-26cd2f795969 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:40.623033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a18ca9bd-0adc-4c0e-9550-26cd2f795969 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:40.623033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a18ca9bd-0adc-4c0e-9550-26cd2f795969 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:40.623033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a18ca9bd-0adc-4c0e-9550-26cd2f795969 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:40.623033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a18ca9bd-0adc-4c0e-9550-26cd2f795969 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:40.623033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a18ca9bd-0adc-4c0e-9550-26cd2f795969 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:40.766051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a18ca9bd-0adc-4c0e-9550-26cd2f795969 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:40.775211 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a18ca9bd-0adc-4c0e-9550-26cd2f795969 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1323 microversion: 2.1 time: 0.167841 Sep 06 11:07:40.775793 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1925/3839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:40 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:41.055399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-332e77a1-4dd4-4b0b-888d-3262c030fdd3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:41.056316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-332e77a1-4dd4-4b0b-888d-3262c030fdd3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:41.066347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-332e77a1-4dd4-4b0b-888d-3262c030fdd3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:41.066860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-332e77a1-4dd4-4b0b-888d-3262c030fdd3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:41.067504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-332e77a1-4dd4-4b0b-888d-3262c030fdd3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:41.068288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-332e77a1-4dd4-4b0b-888d-3262c030fdd3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:41.068918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-332e77a1-4dd4-4b0b-888d-3262c030fdd3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:41.069356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-332e77a1-4dd4-4b0b-888d-3262c030fdd3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:41.201974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-332e77a1-4dd4-4b0b-888d-3262c030fdd3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:41.211948 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-332e77a1-4dd4-4b0b-888d-3262c030fdd3 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1274 microversion: 2.1 time: 0.160481 Sep 06 11:07:41.213419 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1926/3840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:41 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:41.270557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Doing local delete in cell a5a6b47c-7522-4a84-9be6-8ca7130ab6d7(cell1) {{(pid=140876) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 06 11:07:41.272030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:41.272677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:41.273118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:41.273539 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.compute.api [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 06 11:07:41.279928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] deallocate_for_instance() {{(pid=140876) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 06 11:07:41.529664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2a22a875-6371-402a-8ad1-5057741d7ace tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:41.530279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2a22a875-6371-402a-8ad1-5057741d7ace tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:41.537131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a22a875-6371-402a-8ad1-5057741d7ace tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:41.537577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a22a875-6371-402a-8ad1-5057741d7ace tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:41.538020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a22a875-6371-402a-8ad1-5057741d7ace tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:41.538731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a22a875-6371-402a-8ad1-5057741d7ace tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:41.539234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a22a875-6371-402a-8ad1-5057741d7ace tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:41.539666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a22a875-6371-402a-8ad1-5057741d7ace tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:42.196502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2a22a875-6371-402a-8ad1-5057741d7ace tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:42.204578 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2a22a875-6371-402a-8ad1-5057741d7ace tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1486 microversion: 2.1 time: 0.678951 Sep 06 11:07:42.205143 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1927/3841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:41 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1486 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:42.209993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-148c0849-8ada-481a-bfc1-262160b44475 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:42.210793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-148c0849-8ada-481a-bfc1-262160b44475 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:42.218511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-148c0849-8ada-481a-bfc1-262160b44475 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:42.219031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-148c0849-8ada-481a-bfc1-262160b44475 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:42.219555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-148c0849-8ada-481a-bfc1-262160b44475 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:42.220460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-148c0849-8ada-481a-bfc1-262160b44475 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:42.221082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-148c0849-8ada-481a-bfc1-262160b44475 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:42.221518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-148c0849-8ada-481a-bfc1-262160b44475 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:42.318168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-148c0849-8ada-481a-bfc1-262160b44475 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:42.327149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-148c0849-8ada-481a-bfc1-262160b44475 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:42.328536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-148c0849-8ada-481a-bfc1-262160b44475 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:42.333839 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-148c0849-8ada-481a-bfc1-262160b44475 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1478 microversion: 2.91 time: 0.127398 Sep 06 11:07:42.334482 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1928/3842] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:42 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1478 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:42.339662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-baeae570-acdf-45a2-90c0-d30247aecf4a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:42.340277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-baeae570-acdf-45a2-90c0-d30247aecf4a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:42.347705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-baeae570-acdf-45a2-90c0-d30247aecf4a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:42.347705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-baeae570-acdf-45a2-90c0-d30247aecf4a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:42.347705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-baeae570-acdf-45a2-90c0-d30247aecf4a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:42.348131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-baeae570-acdf-45a2-90c0-d30247aecf4a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:42.348249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-baeae570-acdf-45a2-90c0-d30247aecf4a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:42.348869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-baeae570-acdf-45a2-90c0-d30247aecf4a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:42.662395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-baeae570-acdf-45a2-90c0-d30247aecf4a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:42.674313 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-baeae570-acdf-45a2-90c0-d30247aecf4a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1516 microversion: 2.1 time: 0.338587 Sep 06 11:07:42.674901 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1929/3843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:42 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1516 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:42.700812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e13c5f09-9a07-46de-9f22-9ea05829983b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:42.701366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e13c5f09-9a07-46de-9f22-9ea05829983b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:42.722081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e13c5f09-9a07-46de-9f22-9ea05829983b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:42.722872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e13c5f09-9a07-46de-9f22-9ea05829983b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:42.722872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e13c5f09-9a07-46de-9f22-9ea05829983b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:42.723373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e13c5f09-9a07-46de-9f22-9ea05829983b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:42.723842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e13c5f09-9a07-46de-9f22-9ea05829983b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:42.724329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e13c5f09-9a07-46de-9f22-9ea05829983b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:42.880130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Updating instance_info_cache with network_info: [] {{(pid=140876) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 06 11:07:43.046386 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e13c5f09-9a07-46de-9f22-9ea05829983b tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "POST /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b/action" status: 202 len: 0 microversion: 2.1 time: 0.357499 Sep 06 11:07:43.050730 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1930/3844] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:07:42 2022] POST /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:07:43.052960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f7c95e9e-8547-4952-bf07-324146fe7598 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:43.053672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f7c95e9e-8547-4952-bf07-324146fe7598 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:43.061310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7c95e9e-8547-4952-bf07-324146fe7598 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:43.061811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7c95e9e-8547-4952-bf07-324146fe7598 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:43.062248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7c95e9e-8547-4952-bf07-324146fe7598 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:43.063037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7c95e9e-8547-4952-bf07-324146fe7598 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:43.063650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7c95e9e-8547-4952-bf07-324146fe7598 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:43.064266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7c95e9e-8547-4952-bf07-324146fe7598 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:43.347997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f7c95e9e-8547-4952-bf07-324146fe7598 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:43.359451 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f7c95e9e-8547-4952-bf07-324146fe7598 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1314 microversion: 2.1 time: 0.310559 Sep 06 11:07:43.377158 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1931/3845] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:43 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:43.385751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-da5c4a83-3c1f-41a1-9298-a3eafcc6b10f tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch2-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:43.389921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-da5c4a83-3c1f-41a1-9298-a3eafcc6b10f tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:43.399881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da5c4a83-3c1f-41a1-9298-a3eafcc6b10f tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:43.401254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da5c4a83-3c1f-41a1-9298-a3eafcc6b10f tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:43.401877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da5c4a83-3c1f-41a1-9298-a3eafcc6b10f tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:43.403189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da5c4a83-3c1f-41a1-9298-a3eafcc6b10f tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:43.404121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da5c4a83-3c1f-41a1-9298-a3eafcc6b10f tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:43.405281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-da5c4a83-3c1f-41a1-9298-a3eafcc6b10f tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:43.506880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-da5c4a83-3c1f-41a1-9298-a3eafcc6b10f tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch2-master-1". {{(pid=140875) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 11:07:43.655539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:43.782936 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d0d85ee7-367f-4078-a934-40c5fabb28c3 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "DELETE /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 204 len: 0 microversion: 2.1 time: 4.376665 Sep 06 11:07:43.783691 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1915/3846] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:07:39 2022] DELETE /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 0 bytes in 4378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:07:43.788697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7af49e72-b9d4-456d-8ee8-fc3159d4105b tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:43.789328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7af49e72-b9d4-456d-8ee8-fc3159d4105b tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:43.796062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7af49e72-b9d4-456d-8ee8-fc3159d4105b tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:43.796566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7af49e72-b9d4-456d-8ee8-fc3159d4105b tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:43.797021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7af49e72-b9d4-456d-8ee8-fc3159d4105b tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:43.797735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7af49e72-b9d4-456d-8ee8-fc3159d4105b tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:43.798205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7af49e72-b9d4-456d-8ee8-fc3159d4105b tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:43.798647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7af49e72-b9d4-456d-8ee8-fc3159d4105b tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:43.820528 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-da5c4a83-3c1f-41a1-9298-a3eafcc6b10f tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77/action" status: 202 len: 0 microversion: 2.91 time: 0.442007 Sep 06 11:07:43.821872 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1932/3847] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:07:43 2022] POST /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:07:43.828185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-c9c309ec-5891-4577-82b1-b2a29a87d88a req-6d7f0495-dc27-4232-9599-12273ac04621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79338947-1b4d-41ad-a75d-6f1141500c45", "name": "network-vif-deleted", "tag": "3d2d3924-0410-4fb4-aecd-20198e16c4f1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:43.841358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c9c309ec-5891-4577-82b1-b2a29a87d88a req-6d7f0495-dc27-4232-9599-12273ac04621 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:43.842238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c9c309ec-5891-4577-82b1-b2a29a87d88a req-6d7f0495-dc27-4232-9599-12273ac04621 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:43.842770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c9c309ec-5891-4577-82b1-b2a29a87d88a req-6d7f0495-dc27-4232-9599-12273ac04621 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:43.856454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.compute.server_external_events [req-c9c309ec-5891-4577-82b1-b2a29a87d88a req-6d7f0495-dc27-4232-9599-12273ac04621 service nova] Unable to find a host for instance 79338947-1b4d-41ad-a75d-6f1141500c45. Dropping event network-vif-deleted {{(pid=140875) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 06 11:07:43.857362 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-c9c309ec-5891-4577-82b1-b2a29a87d88a req-6d7f0495-dc27-4232-9599-12273ac04621 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.034412 Sep 06 11:07:43.858193 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1933/3848] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 06 11:07:43.863038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f4646fe8-300a-4adf-8d4b-550c841fe0d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:43.868387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f4646fe8-300a-4adf-8d4b-550c841fe0d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:43.870588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4646fe8-300a-4adf-8d4b-550c841fe0d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:43.870588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4646fe8-300a-4adf-8d4b-550c841fe0d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:43.871083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4646fe8-300a-4adf-8d4b-550c841fe0d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:43.872266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4646fe8-300a-4adf-8d4b-550c841fe0d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:43.872266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4646fe8-300a-4adf-8d4b-550c841fe0d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:43.872918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4646fe8-300a-4adf-8d4b-550c841fe0d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.170389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7af49e72-b9d4-456d-8ee8-fc3159d4105b tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:44.176078 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7af49e72-b9d4-456d-8ee8-fc3159d4105b tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6" status: 200 len: 1517 microversion: 2.1 time: 0.391090 Sep 06 11:07:44.176797 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1916/3849] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:43 2022] GET /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 => generated 1517 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:44.181817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76d1e506-bab0-4b62-88ec-f14c7403bc8b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:44.182700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-76d1e506-bab0-4b62-88ec-f14c7403bc8b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 79338947-1b4d-41ad-a75d-6f1141500c45] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:44.189093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76d1e506-bab0-4b62-88ec-f14c7403bc8b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.189813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76d1e506-bab0-4b62-88ec-f14c7403bc8b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.190479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76d1e506-bab0-4b62-88ec-f14c7403bc8b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.191436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76d1e506-bab0-4b62-88ec-f14c7403bc8b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.192104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76d1e506-bab0-4b62-88ec-f14c7403bc8b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.192742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76d1e506-bab0-4b62-88ec-f14c7403bc8b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.208232 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-76d1e506-bab0-4b62-88ec-f14c7403bc8b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] HTTP exception thrown: Instance 79338947-1b4d-41ad-a75d-6f1141500c45 could not be found. Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76d1e506-bab0-4b62-88ec-f14c7403bc8b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Request method failure captured: Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 HTTP/1.1 Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyg2U48D630rtP93KctSUB55frBucaLCwvXam7s5D6muRGgpAdGYpf_Jd02qO6Wv-yScWLiyAR1qNAYbE0W-SGR2eaGszOp1OPVLx8OvqN3f_pV8xU0pTYMSFjaPG0NSAitsz90vg6hPWxi5nbHOISf77di5fAInBJEzZCthjFzILpY Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: dcd5ffec2c6246fb89ba181542692585 Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerActionsTestJSON-562575329 Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcd5ffec2c6246fb89ba181542692585"}]}] Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerActionsTestJSON-562575329 Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: dcd5ffec2c6246fb89ba181542692585 Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerActionsTestJSON-562575329 Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerActionsTestJSON-562575329-project Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: f16abbf8a68344b68444ff8fc2795c67 Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerActionsTestJSON-562575329-project Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 79338947-1b4d-41ad-a75d-6f1141500c45 could not be found. Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '79338947-1b4d-41ad-a75d-6f1141500c45'} Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79338947-1b4d-41ad-a75d-6f1141500c45 could not be found. Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79338947-1b4d-41ad-a75d-6f1141500c45 could not be found. Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:44.210078 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:44.214869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:44.214869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:44.214869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:44.214869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:07:44.214869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:07:44.214869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79338947-1b4d-41ad-a75d-6f1141500c45 could not be found. Sep 06 11:07:44.214869 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:07:44.214869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76d1e506-bab0-4b62-88ec-f14c7403bc8b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Returning 404 to user: Instance 79338947-1b4d-41ad-a75d-6f1141500c45 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:07:44.214869 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-76d1e506-bab0-4b62-88ec-f14c7403bc8b tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45" status: 404 len: 111 microversion: 2.1 time: 0.033527 Sep 06 11:07:44.215896 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1917/3850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:44 2022] GET /compute/v2.1/servers/79338947-1b4d-41ad-a75d-6f1141500c45 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:07:44.221426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8546225d-4404-4ab6-adc0-b1720ab25d01 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:44.222050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8546225d-4404-4ab6-adc0-b1720ab25d01 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:44.228950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8546225d-4404-4ab6-adc0-b1720ab25d01 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.229510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8546225d-4404-4ab6-adc0-b1720ab25d01 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.229920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8546225d-4404-4ab6-adc0-b1720ab25d01 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.230632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8546225d-4404-4ab6-adc0-b1720ab25d01 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.231143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8546225d-4404-4ab6-adc0-b1720ab25d01 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.231583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8546225d-4404-4ab6-adc0-b1720ab25d01 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.244457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f4646fe8-300a-4adf-8d4b-550c841fe0d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:44.247878 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f4646fe8-300a-4adf-8d4b-550c841fe0d9 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1494 microversion: 2.1 time: 0.388734 Sep 06 11:07:44.259426 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1934/3851] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:43 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1494 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:44.268271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cf783314-3b99-4252-b31f-910a2c82cb75 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:44.268271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cf783314-3b99-4252-b31f-910a2c82cb75 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:44.274886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf783314-3b99-4252-b31f-910a2c82cb75 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.275422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf783314-3b99-4252-b31f-910a2c82cb75 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.275868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf783314-3b99-4252-b31f-910a2c82cb75 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.276577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf783314-3b99-4252-b31f-910a2c82cb75 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.277106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf783314-3b99-4252-b31f-910a2c82cb75 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.277706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf783314-3b99-4252-b31f-910a2c82cb75 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.353283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8546225d-4404-4ab6-adc0-b1720ab25d01 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:44.363846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8546225d-4404-4ab6-adc0-b1720ab25d01 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:44.365338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8546225d-4404-4ab6-adc0-b1720ab25d01 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:44.371747 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8546225d-4404-4ab6-adc0-b1720ab25d01 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1486 microversion: 2.91 time: 0.154696 Sep 06 11:07:44.377957 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1918/3852] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:44 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1486 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:44.378212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e983ec73-4bd6-433a-ab71-0b450c3440c6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:44.378895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e983ec73-4bd6-433a-ab71-0b450c3440c6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:44.386143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e983ec73-4bd6-433a-ab71-0b450c3440c6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.386828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e983ec73-4bd6-433a-ab71-0b450c3440c6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.387472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e983ec73-4bd6-433a-ab71-0b450c3440c6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.388327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e983ec73-4bd6-433a-ab71-0b450c3440c6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.388936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e983ec73-4bd6-433a-ab71-0b450c3440c6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.389509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e983ec73-4bd6-433a-ab71-0b450c3440c6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.424440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e983ec73-4bd6-433a-ab71-0b450c3440c6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:07:44.554277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cf783314-3b99-4252-b31f-910a2c82cb75 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:44.557914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:44.568514 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cf783314-3b99-4252-b31f-910a2c82cb75 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1516 microversion: 2.1 time: 0.303824 Sep 06 11:07:44.568514 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1935/3853] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:44 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1516 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:44.570838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1a81e651-4dc8-4544-a11a-eb6e2e93a662 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:44.572255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1a81e651-4dc8-4544-a11a-eb6e2e93a662 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:44.578677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a81e651-4dc8-4544-a11a-eb6e2e93a662 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.579326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a81e651-4dc8-4544-a11a-eb6e2e93a662 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.579643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a81e651-4dc8-4544-a11a-eb6e2e93a662 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.580706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a81e651-4dc8-4544-a11a-eb6e2e93a662 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.581309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a81e651-4dc8-4544-a11a-eb6e2e93a662 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.581883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a81e651-4dc8-4544-a11a-eb6e2e93a662 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.824318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1a81e651-4dc8-4544-a11a-eb6e2e93a662 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:44.832264 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1a81e651-4dc8-4544-a11a-eb6e2e93a662 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1314 microversion: 2.1 time: 0.266066 Sep 06 11:07:44.832825 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1936/3854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:44 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:44.847366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e1ee9bb1-9a6d-45bc-ab2e-d052ccc197a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:44.848059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e1ee9bb1-9a6d-45bc-ab2e-d052ccc197a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:44.854848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1ee9bb1-9a6d-45bc-ab2e-d052ccc197a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.855533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1ee9bb1-9a6d-45bc-ab2e-d052ccc197a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.856052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1ee9bb1-9a6d-45bc-ab2e-d052ccc197a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.856783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1ee9bb1-9a6d-45bc-ab2e-d052ccc197a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.857369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1ee9bb1-9a6d-45bc-ab2e-d052ccc197a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.857838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1ee9bb1-9a6d-45bc-ab2e-d052ccc197a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.886988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e1ee9bb1-9a6d-45bc-ab2e-d052ccc197a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:07:44.912315 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e983ec73-4bd6-433a-ab71-0b450c3440c6 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 204 len: 0 microversion: 2.1 time: 0.537668 Sep 06 11:07:44.913402 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1919/3855] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:07:44 2022] DELETE /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:07:44.926436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c8c7512c-5a81-44f3-a6af-f88216a49029 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:44.927645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c8c7512c-5a81-44f3-a6af-f88216a49029 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:44.937407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8c7512c-5a81-44f3-a6af-f88216a49029 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.938247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8c7512c-5a81-44f3-a6af-f88216a49029 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.938983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8c7512c-5a81-44f3-a6af-f88216a49029 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:44.940038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8c7512c-5a81-44f3-a6af-f88216a49029 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:44.940782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8c7512c-5a81-44f3-a6af-f88216a49029 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:44.941573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8c7512c-5a81-44f3-a6af-f88216a49029 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:45.088985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c8c7512c-5a81-44f3-a6af-f88216a49029 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:45.094138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:45.099121 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c8c7512c-5a81-44f3-a6af-f88216a49029 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1466 microversion: 2.1 time: 0.178666 Sep 06 11:07:45.099900 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1920/3856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:44 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1466 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:45.277215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-52ab8761-c8b6-4d67-b2a6-6a0761bfae9e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:45.277965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-52ab8761-c8b6-4d67-b2a6-6a0761bfae9e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:45.282607 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e1ee9bb1-9a6d-45bc-ab2e-d052ccc197a6 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 204 len: 0 microversion: 2.1 time: 0.442290 Sep 06 11:07:45.287226 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1937/3857] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:07:44 2022] DELETE /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:07:45.291278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52ab8761-c8b6-4d67-b2a6-6a0761bfae9e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:45.291278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52ab8761-c8b6-4d67-b2a6-6a0761bfae9e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:45.291278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52ab8761-c8b6-4d67-b2a6-6a0761bfae9e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:45.291543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52ab8761-c8b6-4d67-b2a6-6a0761bfae9e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:45.292075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52ab8761-c8b6-4d67-b2a6-6a0761bfae9e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:45.292655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52ab8761-c8b6-4d67-b2a6-6a0761bfae9e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:45.297445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9e26de04-e421-4872-8ea4-aa92ef7f207c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:45.298090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9e26de04-e421-4872-8ea4-aa92ef7f207c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:45.304229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e26de04-e421-4872-8ea4-aa92ef7f207c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:45.304724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e26de04-e421-4872-8ea4-aa92ef7f207c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:45.305188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e26de04-e421-4872-8ea4-aa92ef7f207c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:45.305920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e26de04-e421-4872-8ea4-aa92ef7f207c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:45.306384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e26de04-e421-4872-8ea4-aa92ef7f207c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:45.306819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e26de04-e421-4872-8ea4-aa92ef7f207c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:45.529842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:45.612881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-52ab8761-c8b6-4d67-b2a6-6a0761bfae9e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:45.621070 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-52ab8761-c8b6-4d67-b2a6-6a0761bfae9e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1494 microversion: 2.1 time: 0.348937 Sep 06 11:07:45.622191 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1921/3858] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:45 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1494 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:45.623270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9e26de04-e421-4872-8ea4-aa92ef7f207c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:45.627236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-adaf4a5c-5b4e-458d-8094-7716ff9385cd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:45.627712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-adaf4a5c-5b4e-458d-8094-7716ff9385cd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:45.632600 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9e26de04-e421-4872-8ea4-aa92ef7f207c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1522 microversion: 2.1 time: 0.339209 Sep 06 11:07:45.634969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adaf4a5c-5b4e-458d-8094-7716ff9385cd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:45.635492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adaf4a5c-5b4e-458d-8094-7716ff9385cd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:45.637070 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1938/3859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:45 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:45.637343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adaf4a5c-5b4e-458d-8094-7716ff9385cd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:45.637343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adaf4a5c-5b4e-458d-8094-7716ff9385cd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:45.637876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adaf4a5c-5b4e-458d-8094-7716ff9385cd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:45.638318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-adaf4a5c-5b4e-458d-8094-7716ff9385cd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:45.710915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-adaf4a5c-5b4e-458d-8094-7716ff9385cd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:45.721531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-adaf4a5c-5b4e-458d-8094-7716ff9385cd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:45.723111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-adaf4a5c-5b4e-458d-8094-7716ff9385cd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:45.729928 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-adaf4a5c-5b4e-458d-8094-7716ff9385cd tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1486 microversion: 2.91 time: 0.105873 Sep 06 11:07:45.730551 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1922/3860] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:45 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1486 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:45.855253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a7d355c5-6e3d-41a8-b0d4-44b79a552402 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:45.855789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a7d355c5-6e3d-41a8-b0d4-44b79a552402 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:45.861890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7d355c5-6e3d-41a8-b0d4-44b79a552402 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:45.862405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7d355c5-6e3d-41a8-b0d4-44b79a552402 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:45.862842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7d355c5-6e3d-41a8-b0d4-44b79a552402 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:45.863565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7d355c5-6e3d-41a8-b0d4-44b79a552402 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:45.864025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7d355c5-6e3d-41a8-b0d4-44b79a552402 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:45.864454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7d355c5-6e3d-41a8-b0d4-44b79a552402 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:45.886381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-99a0235a-4dce-43f3-9aec-027f8ecaca8f req-f9073460-7294-40e8-a595-c65804a9c224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e879944-3ef1-460a-93cb-8c07843f9996", "tag": "5912061f-ec5b-443b-bbe4-7e658236d514"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:45.898060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-99a0235a-4dce-43f3-9aec-027f8ecaca8f req-f9073460-7294-40e8-a595-c65804a9c224 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:45.898660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-99a0235a-4dce-43f3-9aec-027f8ecaca8f req-f9073460-7294-40e8-a595-c65804a9c224 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:45.899216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-99a0235a-4dce-43f3-9aec-027f8ecaca8f req-f9073460-7294-40e8-a595-c65804a9c224 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:45.914005 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-99a0235a-4dce-43f3-9aec-027f8ecaca8f req-f9073460-7294-40e8-a595-c65804a9c224 service nova] Creating event network-changed:5912061f-ec5b-443b-bbe4-7e658236d514 for instance 0e879944-3ef1-460a-93cb-8c07843f9996 on nch1-master-1 Sep 06 11:07:45.919192 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-99a0235a-4dce-43f3-9aec-027f8ecaca8f req-f9073460-7294-40e8-a595-c65804a9c224 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037481 Sep 06 11:07:45.920022 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1923/3861] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:45.999000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a7d355c5-6e3d-41a8-b0d4-44b79a552402 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:46.006853 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a7d355c5-6e3d-41a8-b0d4-44b79a552402 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1314 microversion: 2.1 time: 0.155612 Sep 06 11:07:46.007719 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1939/3862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:45 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:46.126124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-80bfef37-88d5-42f3-ac7c-3787c2c1a5c0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:46.126781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-80bfef37-88d5-42f3-ac7c-3787c2c1a5c0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:46.134393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80bfef37-88d5-42f3-ac7c-3787c2c1a5c0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:46.134904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80bfef37-88d5-42f3-ac7c-3787c2c1a5c0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:46.135391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80bfef37-88d5-42f3-ac7c-3787c2c1a5c0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:46.136276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80bfef37-88d5-42f3-ac7c-3787c2c1a5c0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:46.136748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80bfef37-88d5-42f3-ac7c-3787c2c1a5c0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:46.137241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80bfef37-88d5-42f3-ac7c-3787c2c1a5c0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:46.241843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-80bfef37-88d5-42f3-ac7c-3787c2c1a5c0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:46.250794 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-80bfef37-88d5-42f3-ac7c-3787c2c1a5c0 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1466 microversion: 2.1 time: 0.129405 Sep 06 11:07:46.251621 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1924/3863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:46 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1466 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:46.655255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-041f5b42-5c5a-4c30-853a-0305ad8a764f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:46.655907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-041f5b42-5c5a-4c30-853a-0305ad8a764f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:46.660900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-10a15c37-7586-4a08-8df8-031c3efac580 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:46.661530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-10a15c37-7586-4a08-8df8-031c3efac580 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:46.668466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041f5b42-5c5a-4c30-853a-0305ad8a764f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:46.668466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041f5b42-5c5a-4c30-853a-0305ad8a764f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:46.668466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041f5b42-5c5a-4c30-853a-0305ad8a764f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:46.668753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:46.668828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041f5b42-5c5a-4c30-853a-0305ad8a764f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:46.668828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041f5b42-5c5a-4c30-853a-0305ad8a764f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:46.668828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041f5b42-5c5a-4c30-853a-0305ad8a764f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:46.670379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10a15c37-7586-4a08-8df8-031c3efac580 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:46.670882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10a15c37-7586-4a08-8df8-031c3efac580 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:46.671364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10a15c37-7586-4a08-8df8-031c3efac580 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:46.672083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10a15c37-7586-4a08-8df8-031c3efac580 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:46.672554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10a15c37-7586-4a08-8df8-031c3efac580 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:46.672996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10a15c37-7586-4a08-8df8-031c3efac580 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:46.972212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-041f5b42-5c5a-4c30-853a-0305ad8a764f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:46.975304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-10a15c37-7586-4a08-8df8-031c3efac580 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:46.982341 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-041f5b42-5c5a-4c30-853a-0305ad8a764f tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1494 microversion: 2.1 time: 0.333371 Sep 06 11:07:46.983188 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1940/3864] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:46 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1494 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:46.984922 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-10a15c37-7586-4a08-8df8-031c3efac580 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1522 microversion: 2.1 time: 0.328254 Sep 06 11:07:46.985876 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1925/3865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:46 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:46.998252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fb14d917-c441-4767-acb6-b6d7be7ef8f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:46.998252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb14d917-c441-4767-acb6-b6d7be7ef8f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:46.998252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb14d917-c441-4767-acb6-b6d7be7ef8f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:46.998252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb14d917-c441-4767-acb6-b6d7be7ef8f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:46.998252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb14d917-c441-4767-acb6-b6d7be7ef8f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:46.998252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb14d917-c441-4767-acb6-b6d7be7ef8f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:46.998252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb14d917-c441-4767-acb6-b6d7be7ef8f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:46.998252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb14d917-c441-4767-acb6-b6d7be7ef8f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:47.031685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4568aa58-c45c-4193-9d2e-852df2a55202 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:47.032410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4568aa58-c45c-4193-9d2e-852df2a55202 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:47.038971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4568aa58-c45c-4193-9d2e-852df2a55202 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:47.043383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4568aa58-c45c-4193-9d2e-852df2a55202 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:47.043383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4568aa58-c45c-4193-9d2e-852df2a55202 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:47.043383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4568aa58-c45c-4193-9d2e-852df2a55202 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:47.043383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4568aa58-c45c-4193-9d2e-852df2a55202 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:47.043383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4568aa58-c45c-4193-9d2e-852df2a55202 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:47.113933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb14d917-c441-4767-acb6-b6d7be7ef8f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:47.122977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb14d917-c441-4767-acb6-b6d7be7ef8f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:47.124660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb14d917-c441-4767-acb6-b6d7be7ef8f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:47.129903 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fb14d917-c441-4767-acb6-b6d7be7ef8f9 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1486 microversion: 2.91 time: 0.145457 Sep 06 11:07:47.130582 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1941/3866] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:46 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1486 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:47.279379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ce1534a8-b39a-4be4-9c29-a31c5ccef95e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:47.280024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ce1534a8-b39a-4be4-9c29-a31c5ccef95e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:47.286083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce1534a8-b39a-4be4-9c29-a31c5ccef95e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:47.286624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce1534a8-b39a-4be4-9c29-a31c5ccef95e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:47.287088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce1534a8-b39a-4be4-9c29-a31c5ccef95e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:47.287803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce1534a8-b39a-4be4-9c29-a31c5ccef95e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:47.288428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce1534a8-b39a-4be4-9c29-a31c5ccef95e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:47.288868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce1534a8-b39a-4be4-9c29-a31c5ccef95e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:47.329038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4568aa58-c45c-4193-9d2e-852df2a55202 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:47.349030 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4568aa58-c45c-4193-9d2e-852df2a55202 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1314 microversion: 2.1 time: 0.321231 Sep 06 11:07:47.350134 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1926/3867] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:47 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:47.433977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ce1534a8-b39a-4be4-9c29-a31c5ccef95e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:47.442092 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ce1534a8-b39a-4be4-9c29-a31c5ccef95e tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1466 microversion: 2.1 time: 0.167993 Sep 06 11:07:47.442690 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1942/3868] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:47 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1466 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:48.005894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6e0da023-6174-4f53-b564-9a00f4324efd tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:48.006588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6e0da023-6174-4f53-b564-9a00f4324efd tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:48.009351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-42543000-8aaf-464a-9d27-fae69e75f231 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:48.010008 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-42543000-8aaf-464a-9d27-fae69e75f231 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:48.014785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e0da023-6174-4f53-b564-9a00f4324efd tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.015373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e0da023-6174-4f53-b564-9a00f4324efd tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.015901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e0da023-6174-4f53-b564-9a00f4324efd tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.016675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e0da023-6174-4f53-b564-9a00f4324efd tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.017597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e0da023-6174-4f53-b564-9a00f4324efd tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.017723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42543000-8aaf-464a-9d27-fae69e75f231 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.018114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e0da023-6174-4f53-b564-9a00f4324efd tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.018221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42543000-8aaf-464a-9d27-fae69e75f231 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.018606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42543000-8aaf-464a-9d27-fae69e75f231 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.019351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42543000-8aaf-464a-9d27-fae69e75f231 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.019874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42543000-8aaf-464a-9d27-fae69e75f231 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.020242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42543000-8aaf-464a-9d27-fae69e75f231 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.241191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6e0da023-6174-4f53-b564-9a00f4324efd tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:48.247636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-42543000-8aaf-464a-9d27-fae69e75f231 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:48.249717 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6e0da023-6174-4f53-b564-9a00f4324efd tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1500 microversion: 2.1 time: 0.248048 Sep 06 11:07:48.250477 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1927/3869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:48 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1500 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:48.255246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0bf2fd0d-50ec-4f1e-8e95-f0afa6803efe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:48.255757 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-42543000-8aaf-464a-9d27-fae69e75f231 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1522 microversion: 2.1 time: 0.250897 Sep 06 11:07:48.255894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0bf2fd0d-50ec-4f1e-8e95-f0afa6803efe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:48.256527 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1943/3870] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:48 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:48.262016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bf2fd0d-50ec-4f1e-8e95-f0afa6803efe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.262505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bf2fd0d-50ec-4f1e-8e95-f0afa6803efe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.263169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bf2fd0d-50ec-4f1e-8e95-f0afa6803efe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.263882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bf2fd0d-50ec-4f1e-8e95-f0afa6803efe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.264352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bf2fd0d-50ec-4f1e-8e95-f0afa6803efe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.264788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bf2fd0d-50ec-4f1e-8e95-f0afa6803efe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.281969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-580c89c0-7319-47b6-b314-a92b70dcb669 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:48.282468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-580c89c0-7319-47b6-b314-a92b70dcb669 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:48.291890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-580c89c0-7319-47b6-b314-a92b70dcb669 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.292467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-580c89c0-7319-47b6-b314-a92b70dcb669 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.293004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-580c89c0-7319-47b6-b314-a92b70dcb669 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.294054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-580c89c0-7319-47b6-b314-a92b70dcb669 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.294337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-580c89c0-7319-47b6-b314-a92b70dcb669 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.294838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-580c89c0-7319-47b6-b314-a92b70dcb669 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.321859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-580c89c0-7319-47b6-b314-a92b70dcb669 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:07:48.332392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0bf2fd0d-50ec-4f1e-8e95-f0afa6803efe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:48.347814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0bf2fd0d-50ec-4f1e-8e95-f0afa6803efe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:48.349484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0bf2fd0d-50ec-4f1e-8e95-f0afa6803efe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:48.355431 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0bf2fd0d-50ec-4f1e-8e95-f0afa6803efe tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1486 microversion: 2.91 time: 0.103755 Sep 06 11:07:48.358185 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1928/3871] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:48 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1486 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:48.374588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-442f3ec0-a4da-455a-b5cb-e2a09d39f7e2 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:48.378789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-442f3ec0-a4da-455a-b5cb-e2a09d39f7e2 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:48.381302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-442f3ec0-a4da-455a-b5cb-e2a09d39f7e2 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.381786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-442f3ec0-a4da-455a-b5cb-e2a09d39f7e2 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.382231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-442f3ec0-a4da-455a-b5cb-e2a09d39f7e2 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.383230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-442f3ec0-a4da-455a-b5cb-e2a09d39f7e2 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.383725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-442f3ec0-a4da-455a-b5cb-e2a09d39f7e2 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.384156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-442f3ec0-a4da-455a-b5cb-e2a09d39f7e2 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.540436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-442f3ec0-a4da-455a-b5cb-e2a09d39f7e2 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:48.551952 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-442f3ec0-a4da-455a-b5cb-e2a09d39f7e2 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1314 microversion: 2.1 time: 0.181126 Sep 06 11:07:48.552713 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1929/3872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:48 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:48.559279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-62df8643-2bc4-4312-a3c0-fed0c7e608a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:48.559279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-62df8643-2bc4-4312-a3c0-fed0c7e608a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:48.564045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62df8643-2bc4-4312-a3c0-fed0c7e608a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.564788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62df8643-2bc4-4312-a3c0-fed0c7e608a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.565251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62df8643-2bc4-4312-a3c0-fed0c7e608a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.565355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:48.565959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62df8643-2bc4-4312-a3c0-fed0c7e608a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.566626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62df8643-2bc4-4312-a3c0-fed0c7e608a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.567108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62df8643-2bc4-4312-a3c0-fed0c7e608a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.630418 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-580c89c0-7319-47b6-b314-a92b70dcb669 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 204 len: 0 microversion: 2.1 time: 0.351985 Sep 06 11:07:48.631499 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1944/3873] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:07:48 2022] DELETE /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:07:48.640281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5659de2f-e40a-47b3-b4c3-bb422ee464d8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:48.640995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5659de2f-e40a-47b3-b4c3-bb422ee464d8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:48.646948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5659de2f-e40a-47b3-b4c3-bb422ee464d8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.647484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5659de2f-e40a-47b3-b4c3-bb422ee464d8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.647933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5659de2f-e40a-47b3-b4c3-bb422ee464d8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.648712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5659de2f-e40a-47b3-b4c3-bb422ee464d8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:48.649800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5659de2f-e40a-47b3-b4c3-bb422ee464d8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:48.650239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5659de2f-e40a-47b3-b4c3-bb422ee464d8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:48.654060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-62df8643-2bc4-4312-a3c0-fed0c7e608a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:48.662531 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-62df8643-2bc4-4312-a3c0-fed0c7e608a7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1466 microversion: 2.1 time: 0.108510 Sep 06 11:07:48.663360 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1930/3874] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:48 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1466 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:48.790725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5659de2f-e40a-47b3-b4c3-bb422ee464d8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:48.798860 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5659de2f-e40a-47b3-b4c3-bb422ee464d8 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.162578 Sep 06 11:07:48.799736 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1945/3875] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:48 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:49.280855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-568843af-0c4b-437d-a5a1-bc04c6f94c8d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:49.281484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-568843af-0c4b-437d-a5a1-bc04c6f94c8d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:49.289190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-568843af-0c4b-437d-a5a1-bc04c6f94c8d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:49.289895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-568843af-0c4b-437d-a5a1-bc04c6f94c8d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:49.290373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-568843af-0c4b-437d-a5a1-bc04c6f94c8d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:49.291277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-568843af-0c4b-437d-a5a1-bc04c6f94c8d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:49.291942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-568843af-0c4b-437d-a5a1-bc04c6f94c8d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:49.292385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-568843af-0c4b-437d-a5a1-bc04c6f94c8d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:49.384103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fc79f022-3680-43c2-a5dc-eeaf75775864 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:49.385245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fc79f022-3680-43c2-a5dc-eeaf75775864 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:49.392832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc79f022-3680-43c2-a5dc-eeaf75775864 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:49.393335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc79f022-3680-43c2-a5dc-eeaf75775864 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:49.393787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc79f022-3680-43c2-a5dc-eeaf75775864 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:49.394507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc79f022-3680-43c2-a5dc-eeaf75775864 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:49.395037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc79f022-3680-43c2-a5dc-eeaf75775864 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:49.395424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc79f022-3680-43c2-a5dc-eeaf75775864 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:49.430681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-568843af-0c4b-437d-a5a1-bc04c6f94c8d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:49.443415 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-568843af-0c4b-437d-a5a1-bc04c6f94c8d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1522 microversion: 2.1 time: 0.166315 Sep 06 11:07:49.445609 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1931/3876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:49 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:49.464114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fc79f022-3680-43c2-a5dc-eeaf75775864 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:49.472342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fc79f022-3680-43c2-a5dc-eeaf75775864 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:49.473814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fc79f022-3680-43c2-a5dc-eeaf75775864 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:49.478735 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fc79f022-3680-43c2-a5dc-eeaf75775864 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1488 microversion: 2.91 time: 0.099390 Sep 06 11:07:49.479348 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1946/3877] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:49 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1488 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:07:49.578169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c6b5e290-b2a9-4dd3-8a1c-16013cd75fb1 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:49.578926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c6b5e290-b2a9-4dd3-8a1c-16013cd75fb1 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:49.585511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6b5e290-b2a9-4dd3-8a1c-16013cd75fb1 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:49.590550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6b5e290-b2a9-4dd3-8a1c-16013cd75fb1 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:49.590550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6b5e290-b2a9-4dd3-8a1c-16013cd75fb1 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:49.590550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6b5e290-b2a9-4dd3-8a1c-16013cd75fb1 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:49.590550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6b5e290-b2a9-4dd3-8a1c-16013cd75fb1 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:49.590550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6b5e290-b2a9-4dd3-8a1c-16013cd75fb1 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:49.593077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:DELETE=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:49.691157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cdee7560-a56c-459f-9224-1e4e3765ec48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:49.691784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cdee7560-a56c-459f-9224-1e4e3765ec48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:49.701051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cdee7560-a56c-459f-9224-1e4e3765ec48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:49.701766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cdee7560-a56c-459f-9224-1e4e3765ec48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:49.702396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cdee7560-a56c-459f-9224-1e4e3765ec48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:49.703288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cdee7560-a56c-459f-9224-1e4e3765ec48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:49.703900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cdee7560-a56c-459f-9224-1e4e3765ec48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:49.704653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cdee7560-a56c-459f-9224-1e4e3765ec48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:49.735250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c6b5e290-b2a9-4dd3-8a1c-16013cd75fb1 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:49.743983 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c6b5e290-b2a9-4dd3-8a1c-16013cd75fb1 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1314 microversion: 2.1 time: 0.170031 Sep 06 11:07:49.756292 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1932/3878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:49 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:49.792243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cdee7560-a56c-459f-9224-1e4e3765ec48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:49.800311 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cdee7560-a56c-459f-9224-1e4e3765ec48 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1466 microversion: 2.1 time: 0.113390 Sep 06 11:07:49.801061 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1947/3879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:49 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1466 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:49.825006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3a74aa3e-9e47-4d47-bc43-8c3f68153949 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:49.825624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3a74aa3e-9e47-4d47-bc43-8c3f68153949 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:49.831665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a74aa3e-9e47-4d47-bc43-8c3f68153949 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:49.832167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a74aa3e-9e47-4d47-bc43-8c3f68153949 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:49.832595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a74aa3e-9e47-4d47-bc43-8c3f68153949 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:49.833315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a74aa3e-9e47-4d47-bc43-8c3f68153949 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:49.834018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a74aa3e-9e47-4d47-bc43-8c3f68153949 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:49.834433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a74aa3e-9e47-4d47-bc43-8c3f68153949 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:49.977991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3a74aa3e-9e47-4d47-bc43-8c3f68153949 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:49.987422 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3a74aa3e-9e47-4d47-bc43-8c3f68153949 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.168885 Sep 06 11:07:49.988184 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1933/3880] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:49 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:50.469543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-130e2b0a-1e95-4827-9dd5-f4418789c867 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:50.470172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-130e2b0a-1e95-4827-9dd5-f4418789c867 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:50.480699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-130e2b0a-1e95-4827-9dd5-f4418789c867 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:50.481330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-130e2b0a-1e95-4827-9dd5-f4418789c867 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:50.484028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-130e2b0a-1e95-4827-9dd5-f4418789c867 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:50.484028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-130e2b0a-1e95-4827-9dd5-f4418789c867 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:50.484028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-130e2b0a-1e95-4827-9dd5-f4418789c867 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:50.484028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-130e2b0a-1e95-4827-9dd5-f4418789c867 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:50.511584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-77669880-2ac9-41cc-9657-0a018c434663 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:50.512117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-77669880-2ac9-41cc-9657-0a018c434663 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:50.519938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77669880-2ac9-41cc-9657-0a018c434663 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:50.520565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77669880-2ac9-41cc-9657-0a018c434663 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:50.521117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77669880-2ac9-41cc-9657-0a018c434663 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:50.521998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77669880-2ac9-41cc-9657-0a018c434663 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:50.522527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77669880-2ac9-41cc-9657-0a018c434663 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:50.523097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77669880-2ac9-41cc-9657-0a018c434663 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:50.600651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77669880-2ac9-41cc-9657-0a018c434663 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:50.610564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77669880-2ac9-41cc-9657-0a018c434663 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:50.612876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77669880-2ac9-41cc-9657-0a018c434663 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:50.619724 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-77669880-2ac9-41cc-9657-0a018c434663 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1488 microversion: 2.91 time: 0.112857 Sep 06 11:07:50.620306 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1934/3881] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:50 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1488 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:50.647582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-130e2b0a-1e95-4827-9dd5-f4418789c867 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:50.662729 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-130e2b0a-1e95-4827-9dd5-f4418789c867 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1522 microversion: 2.1 time: 0.191434 Sep 06 11:07:50.662729 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1948/3882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:50 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:50.769627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-06d4fdfa-79c5-48d7-8943-9f673fda326f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:50.770247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-06d4fdfa-79c5-48d7-8943-9f673fda326f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:50.776307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06d4fdfa-79c5-48d7-8943-9f673fda326f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:50.776800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06d4fdfa-79c5-48d7-8943-9f673fda326f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:50.783198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06d4fdfa-79c5-48d7-8943-9f673fda326f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:50.783198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06d4fdfa-79c5-48d7-8943-9f673fda326f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:50.783198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06d4fdfa-79c5-48d7-8943-9f673fda326f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:50.783198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06d4fdfa-79c5-48d7-8943-9f673fda326f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:50.825062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c920b3f0-9958-47d7-ba09-ee5bb420bb03 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:50.825681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c920b3f0-9958-47d7-ba09-ee5bb420bb03 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:50.831915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c920b3f0-9958-47d7-ba09-ee5bb420bb03 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:50.832397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c920b3f0-9958-47d7-ba09-ee5bb420bb03 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:50.832834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c920b3f0-9958-47d7-ba09-ee5bb420bb03 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:50.833531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c920b3f0-9958-47d7-ba09-ee5bb420bb03 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:50.833988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c920b3f0-9958-47d7-ba09-ee5bb420bb03 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:50.834778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c920b3f0-9958-47d7-ba09-ee5bb420bb03 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:50.838964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:51.275512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c920b3f0-9958-47d7-ba09-ee5bb420bb03 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:51.284004 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c920b3f0-9958-47d7-ba09-ee5bb420bb03 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1466 microversion: 2.1 time: 0.463522 Sep 06 11:07:51.284701 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1949/3883] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:50 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1466 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:51.289470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-06d4fdfa-79c5-48d7-8943-9f673fda326f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:51.290752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e97f0586-2e72-4c8d-8658-6e6b34d893e2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:51.291586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e97f0586-2e72-4c8d-8658-6e6b34d893e2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:51.297962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e97f0586-2e72-4c8d-8658-6e6b34d893e2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:51.298118 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-06d4fdfa-79c5-48d7-8943-9f673fda326f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1314 microversion: 2.1 time: 0.532624 Sep 06 11:07:51.298631 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1935/3884] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:50 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:51.299037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e97f0586-2e72-4c8d-8658-6e6b34d893e2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:51.299554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e97f0586-2e72-4c8d-8658-6e6b34d893e2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:51.300455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e97f0586-2e72-4c8d-8658-6e6b34d893e2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:51.301111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e97f0586-2e72-4c8d-8658-6e6b34d893e2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:51.301627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e97f0586-2e72-4c8d-8658-6e6b34d893e2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:51.437815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e97f0586-2e72-4c8d-8658-6e6b34d893e2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:51.445547 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e97f0586-2e72-4c8d-8658-6e6b34d893e2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.159604 Sep 06 11:07:51.446202 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1950/3885] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:51 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:51.652477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0edbefab-d029-4750-b169-0c7cf23e81c7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:51.653778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0edbefab-d029-4750-b169-0c7cf23e81c7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:51.661060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0edbefab-d029-4750-b169-0c7cf23e81c7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:51.664772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0edbefab-d029-4750-b169-0c7cf23e81c7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:51.664772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0edbefab-d029-4750-b169-0c7cf23e81c7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:51.664772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0edbefab-d029-4750-b169-0c7cf23e81c7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:51.664772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0edbefab-d029-4750-b169-0c7cf23e81c7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:51.664772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0edbefab-d029-4750-b169-0c7cf23e81c7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:51.678930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-10b77aee-6eee-42fb-bc18-ccfaaf86910c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:51.679848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-10b77aee-6eee-42fb-bc18-ccfaaf86910c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:51.687212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10b77aee-6eee-42fb-bc18-ccfaaf86910c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:51.687778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10b77aee-6eee-42fb-bc18-ccfaaf86910c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:51.688271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10b77aee-6eee-42fb-bc18-ccfaaf86910c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:51.689150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10b77aee-6eee-42fb-bc18-ccfaaf86910c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:51.689789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10b77aee-6eee-42fb-bc18-ccfaaf86910c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:51.690376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10b77aee-6eee-42fb-bc18-ccfaaf86910c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:51.738756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0edbefab-d029-4750-b169-0c7cf23e81c7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:51.749337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0edbefab-d029-4750-b169-0c7cf23e81c7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:51.750884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0edbefab-d029-4750-b169-0c7cf23e81c7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:51.759810 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0edbefab-d029-4750-b169-0c7cf23e81c7 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1488 microversion: 2.91 time: 0.112189 Sep 06 11:07:51.761216 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1936/3886] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:51 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1488 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:51.837470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-10b77aee-6eee-42fb-bc18-ccfaaf86910c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:51.845545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-7ea5cb34-60eb-42d0-b6cb-8289b88b1f64 req-1b82cb51-00b6-4218-8872-832aa0ad29e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e879944-3ef1-460a-93cb-8c07843f9996", "name": "network-vif-plugged", "status": "completed", "tag": "5912061f-ec5b-443b-bbe4-7e658236d514"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:51.846456 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-10b77aee-6eee-42fb-bc18-ccfaaf86910c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1522 microversion: 2.1 time: 0.172594 Sep 06 11:07:51.858028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ea5cb34-60eb-42d0-b6cb-8289b88b1f64 req-1b82cb51-00b6-4218-8872-832aa0ad29e1 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:51.858624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ea5cb34-60eb-42d0-b6cb-8289b88b1f64 req-1b82cb51-00b6-4218-8872-832aa0ad29e1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:51.859169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ea5cb34-60eb-42d0-b6cb-8289b88b1f64 req-1b82cb51-00b6-4218-8872-832aa0ad29e1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:51.859527 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1951/3887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:51 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:51.872228 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-7ea5cb34-60eb-42d0-b6cb-8289b88b1f64 req-1b82cb51-00b6-4218-8872-832aa0ad29e1 service nova] Creating event network-vif-plugged:5912061f-ec5b-443b-bbe4-7e658236d514 for instance 0e879944-3ef1-460a-93cb-8c07843f9996 on nch1-master-1 Sep 06 11:07:51.879347 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-7ea5cb34-60eb-42d0-b6cb-8289b88b1f64 req-1b82cb51-00b6-4218-8872-832aa0ad29e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036494 Sep 06 11:07:51.879347 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1937/3888] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:07:52.308564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8916e329-9238-45d8-8bee-606ec7fe4894 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:52.309185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8916e329-9238-45d8-8bee-606ec7fe4894 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:52.320039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8916e329-9238-45d8-8bee-606ec7fe4894 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:52.320039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8916e329-9238-45d8-8bee-606ec7fe4894 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:52.320039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8916e329-9238-45d8-8bee-606ec7fe4894 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:52.320039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8916e329-9238-45d8-8bee-606ec7fe4894 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:52.320039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8916e329-9238-45d8-8bee-606ec7fe4894 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:52.320039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8916e329-9238-45d8-8bee-606ec7fe4894 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:52.323876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba00db92-33db-4ad7-b101-c9605d40b914 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:52.324698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ba00db92-33db-4ad7-b101-c9605d40b914 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:52.332166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba00db92-33db-4ad7-b101-c9605d40b914 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:52.332971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba00db92-33db-4ad7-b101-c9605d40b914 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:52.333891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba00db92-33db-4ad7-b101-c9605d40b914 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:52.334820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba00db92-33db-4ad7-b101-c9605d40b914 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:52.335609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba00db92-33db-4ad7-b101-c9605d40b914 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:52.336123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba00db92-33db-4ad7-b101-c9605d40b914 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:52.437743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8916e329-9238-45d8-8bee-606ec7fe4894 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:52.445517 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8916e329-9238-45d8-8bee-606ec7fe4894 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1466 microversion: 2.1 time: 0.141533 Sep 06 11:07:52.446084 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1952/3889] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:52 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1466 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:52.468894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a859aa4c-b4a3-429d-a614-4d9f486446cc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:52.469506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a859aa4c-b4a3-429d-a614-4d9f486446cc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:52.475831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a859aa4c-b4a3-429d-a614-4d9f486446cc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:52.476322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a859aa4c-b4a3-429d-a614-4d9f486446cc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:52.476762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a859aa4c-b4a3-429d-a614-4d9f486446cc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:52.477464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a859aa4c-b4a3-429d-a614-4d9f486446cc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:52.477926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a859aa4c-b4a3-429d-a614-4d9f486446cc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:52.478896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a859aa4c-b4a3-429d-a614-4d9f486446cc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:52.509794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ba00db92-33db-4ad7-b101-c9605d40b914 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:52.518341 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ba00db92-33db-4ad7-b101-c9605d40b914 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1314 microversion: 2.1 time: 0.200369 Sep 06 11:07:52.518931 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1938/3890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:52 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:52.699825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a859aa4c-b4a3-429d-a614-4d9f486446cc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:52.711518 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a859aa4c-b4a3-429d-a614-4d9f486446cc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1506 microversion: 2.1 time: 0.246356 Sep 06 11:07:52.724273 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1953/3891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:52 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:52.791910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8afafe1e-e484-49ba-894d-360b320996d2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:52.792531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8afafe1e-e484-49ba-894d-360b320996d2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:52.802588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8afafe1e-e484-49ba-894d-360b320996d2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:52.803119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8afafe1e-e484-49ba-894d-360b320996d2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:52.803568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8afafe1e-e484-49ba-894d-360b320996d2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:52.804792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8afafe1e-e484-49ba-894d-360b320996d2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:52.805268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8afafe1e-e484-49ba-894d-360b320996d2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:52.805817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8afafe1e-e484-49ba-894d-360b320996d2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:52.870677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-efb8a7b6-7506-4168-8879-e1239d6397eb tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:52.871897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-efb8a7b6-7506-4168-8879-e1239d6397eb tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:52.878773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efb8a7b6-7506-4168-8879-e1239d6397eb tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:52.879417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efb8a7b6-7506-4168-8879-e1239d6397eb tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:52.880091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efb8a7b6-7506-4168-8879-e1239d6397eb tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:52.881019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efb8a7b6-7506-4168-8879-e1239d6397eb tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:52.881925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efb8a7b6-7506-4168-8879-e1239d6397eb tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:52.888421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efb8a7b6-7506-4168-8879-e1239d6397eb tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:52.910295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8afafe1e-e484-49ba-894d-360b320996d2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:52.933999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8afafe1e-e484-49ba-894d-360b320996d2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:52.935779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8afafe1e-e484-49ba-894d-360b320996d2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:52.941470 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8afafe1e-e484-49ba-894d-360b320996d2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1488 microversion: 2.91 time: 0.154584 Sep 06 11:07:52.951178 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1939/3892] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:52 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1488 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:53.157309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-efb8a7b6-7506-4168-8879-e1239d6397eb tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:53.193381 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-efb8a7b6-7506-4168-8879-e1239d6397eb tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1522 microversion: 2.1 time: 0.318957 Sep 06 11:07:53.194062 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1954/3893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:52 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:53.471699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6a54f505-3ebe-4ecb-8644-72d3d2a8ae81 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:53.473319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6a54f505-3ebe-4ecb-8644-72d3d2a8ae81 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:53.480115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a54f505-3ebe-4ecb-8644-72d3d2a8ae81 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:53.481036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a54f505-3ebe-4ecb-8644-72d3d2a8ae81 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:53.481725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a54f505-3ebe-4ecb-8644-72d3d2a8ae81 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:53.486889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a54f505-3ebe-4ecb-8644-72d3d2a8ae81 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:53.487740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a54f505-3ebe-4ecb-8644-72d3d2a8ae81 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:53.488403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a54f505-3ebe-4ecb-8644-72d3d2a8ae81 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:53.541942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ac49d8d0-3d37-422c-a6ec-8b7fd78ac367 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:53.542635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ac49d8d0-3d37-422c-a6ec-8b7fd78ac367 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:53.553750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac49d8d0-3d37-422c-a6ec-8b7fd78ac367 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:53.556987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac49d8d0-3d37-422c-a6ec-8b7fd78ac367 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:53.557462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac49d8d0-3d37-422c-a6ec-8b7fd78ac367 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:53.558837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac49d8d0-3d37-422c-a6ec-8b7fd78ac367 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:53.566108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac49d8d0-3d37-422c-a6ec-8b7fd78ac367 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:53.566662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac49d8d0-3d37-422c-a6ec-8b7fd78ac367 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:53.630035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6a54f505-3ebe-4ecb-8644-72d3d2a8ae81 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:53.639856 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6a54f505-3ebe-4ecb-8644-72d3d2a8ae81 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1466 microversion: 2.1 time: 0.173552 Sep 06 11:07:53.641626 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1940/3894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:53 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1466 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:53.647359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-4a3f5422-4372-4252-a92e-9e68d5c9e87b req-76f0912b-f92a-4d1c-8e6d-2f05b9ed0084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52698341-5c8b-434b-82d4-5d35faf1b2fa", "name": "network-vif-deleted", "tag": "d19cb20a-5745-48f3-85ab-cd40490e46d8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:53.657640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:53.660346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4a3f5422-4372-4252-a92e-9e68d5c9e87b req-76f0912b-f92a-4d1c-8e6d-2f05b9ed0084 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:53.661175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4a3f5422-4372-4252-a92e-9e68d5c9e87b req-76f0912b-f92a-4d1c-8e6d-2f05b9ed0084 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:53.661894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4a3f5422-4372-4252-a92e-9e68d5c9e87b req-76f0912b-f92a-4d1c-8e6d-2f05b9ed0084 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:53.704738 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-4a3f5422-4372-4252-a92e-9e68d5c9e87b req-76f0912b-f92a-4d1c-8e6d-2f05b9ed0084 service nova] Creating event network-vif-deleted:d19cb20a-5745-48f3-85ab-cd40490e46d8 for instance 52698341-5c8b-434b-82d4-5d35faf1b2fa on nch2-master-1 Sep 06 11:07:53.723251 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-4a3f5422-4372-4252-a92e-9e68d5c9e87b req-76f0912b-f92a-4d1c-8e6d-2f05b9ed0084 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080005 Sep 06 11:07:53.724226 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1941/3895] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:53.730024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-dcaf0183-6f10-43a3-b405-22fceeda2e61 req-4de41828-a208-47a7-917c-6743bc3e338d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3642cc-7e32-44a8-915b-a0e3deaf8374", "name": "network-vif-deleted", "tag": "ddec8ef5-9c9d-4abe-967d-d24b40f80c54"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:53.754669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dcaf0183-6f10-43a3-b405-22fceeda2e61 req-4de41828-a208-47a7-917c-6743bc3e338d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:53.757884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dcaf0183-6f10-43a3-b405-22fceeda2e61 req-4de41828-a208-47a7-917c-6743bc3e338d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:53.759563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dcaf0183-6f10-43a3-b405-22fceeda2e61 req-4de41828-a208-47a7-917c-6743bc3e338d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:53.785761 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-dcaf0183-6f10-43a3-b405-22fceeda2e61 req-4de41828-a208-47a7-917c-6743bc3e338d service nova] Creating event network-vif-deleted:ddec8ef5-9c9d-4abe-967d-d24b40f80c54 for instance 4a3642cc-7e32-44a8-915b-a0e3deaf8374 on nch2-master-1 Sep 06 11:07:53.804070 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-dcaf0183-6f10-43a3-b405-22fceeda2e61 req-4de41828-a208-47a7-917c-6743bc3e338d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078231 Sep 06 11:07:53.811996 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1942/3896] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:53.819214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a8a45c67-2025-4309-b7a9-8c77702454be tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:53.824273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a8a45c67-2025-4309-b7a9-8c77702454be tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:53.835457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8a45c67-2025-4309-b7a9-8c77702454be tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:53.838398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8a45c67-2025-4309-b7a9-8c77702454be tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:53.838398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8a45c67-2025-4309-b7a9-8c77702454be tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:53.838398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8a45c67-2025-4309-b7a9-8c77702454be tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:53.838653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8a45c67-2025-4309-b7a9-8c77702454be tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:53.839218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8a45c67-2025-4309-b7a9-8c77702454be tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:54.035351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a8a45c67-2025-4309-b7a9-8c77702454be tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:54.045389 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a8a45c67-2025-4309-b7a9-8c77702454be tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1464 microversion: 2.1 time: 0.231323 Sep 06 11:07:54.052560 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1943/3897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:53 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1464 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:54.052560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0ec6f12b-ec73-4885-a9e8-11827ea27496 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:54.052560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0ec6f12b-ec73-4885-a9e8-11827ea27496 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:54.059762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ec6f12b-ec73-4885-a9e8-11827ea27496 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:54.060641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ec6f12b-ec73-4885-a9e8-11827ea27496 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:54.061298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ec6f12b-ec73-4885-a9e8-11827ea27496 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:54.062224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ec6f12b-ec73-4885-a9e8-11827ea27496 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:54.062911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ec6f12b-ec73-4885-a9e8-11827ea27496 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:54.063592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ec6f12b-ec73-4885-a9e8-11827ea27496 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:54.105461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ac49d8d0-3d37-422c-a6ec-8b7fd78ac367 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:54.114429 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ac49d8d0-3d37-422c-a6ec-8b7fd78ac367 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1497 microversion: 2.1 time: 0.576714 Sep 06 11:07:54.115516 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1955/3898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:53 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1497 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:54.151045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0ec6f12b-ec73-4885-a9e8-11827ea27496 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:54.181434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0ec6f12b-ec73-4885-a9e8-11827ea27496 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:54.183252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0ec6f12b-ec73-4885-a9e8-11827ea27496 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:54.192017 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0ec6f12b-ec73-4885-a9e8-11827ea27496 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.144507 Sep 06 11:07:54.192992 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1944/3899] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:54 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:54.225232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:54.225232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:54.229720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:54.230493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:54.231208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:54.232152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:54.232615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:54.233047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:54.269594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:54.270475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:54.271346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:54.272010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 52698341-5c8b-434b-82d4-5d35faf1b2fa {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:54.330986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:54.339434 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0d8b6b41-b8b7-4b30-b71d-a84203898953 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1313 microversion: 2.1 time: 0.121978 Sep 06 11:07:54.340008 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1956/3900] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:54 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1313 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:54.667581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:54.668206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:54.675257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:54.676033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:54.676811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:54.677749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:54.678615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:54.679598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:54.739136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:54.739893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:54.740509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:54.750322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid 4a3642cc-7e32-44a8-915b-a0e3deaf8374 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:54.804042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:54.817298 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5c548a9a-1fa4-4e50-8bc4-5519b40220d9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1305 microversion: 2.1 time: 0.153705 Sep 06 11:07:54.818150 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1945/3901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:54 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1305 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:55.072967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:55.074326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:55.084706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.085301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.085828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.086559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.087049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.087712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.127432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.128090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.131651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.132718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'fault' on Instance uuid d8d78eee-0953-4593-b34f-271f88c7125b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:55.197815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:55.208282 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-11e518d7-b5a2-421c-8677-ec42cabf4cbc tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1304 microversion: 2.1 time: 0.140006 Sep 06 11:07:55.211496 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1957/3902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:55 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:55.232940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-279b6dc3-5961-407d-819c-2cebeb743dd3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:55.232940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-279b6dc3-5961-407d-819c-2cebeb743dd3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:55.238720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-279b6dc3-5961-407d-819c-2cebeb743dd3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.244284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-279b6dc3-5961-407d-819c-2cebeb743dd3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.244869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-279b6dc3-5961-407d-819c-2cebeb743dd3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.245877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-279b6dc3-5961-407d-819c-2cebeb743dd3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.246576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-279b6dc3-5961-407d-819c-2cebeb743dd3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.247290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-279b6dc3-5961-407d-819c-2cebeb743dd3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.317039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-11ac76e5-65dc-4437-95c7-ce707b097ca8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:55.317739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-11ac76e5-65dc-4437-95c7-ce707b097ca8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:55.330714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11ac76e5-65dc-4437-95c7-ce707b097ca8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.342522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11ac76e5-65dc-4437-95c7-ce707b097ca8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.343337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11ac76e5-65dc-4437-95c7-ce707b097ca8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.344326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11ac76e5-65dc-4437-95c7-ce707b097ca8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.345062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11ac76e5-65dc-4437-95c7-ce707b097ca8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.345599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-279b6dc3-5961-407d-819c-2cebeb743dd3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:55.345962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11ac76e5-65dc-4437-95c7-ce707b097ca8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.364563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-279b6dc3-5961-407d-819c-2cebeb743dd3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:55.368510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-279b6dc3-5961-407d-819c-2cebeb743dd3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:55.375962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-11ac76e5-65dc-4437-95c7-ce707b097ca8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:07:55.385308 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-279b6dc3-5961-407d-819c-2cebeb743dd3 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.158945 Sep 06 11:07:55.386097 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1946/3903] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:55 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:55.398067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:55.398494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:55.411807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.412317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.412786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.413501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.413966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.414409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.476494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.476983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.477599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.478807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 52698341-5c8b-434b-82d4-5d35faf1b2fa {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:55.528202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:55.536649 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b558e0f8-a67c-4517-846b-27c2731af5b1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1313 microversion: 2.1 time: 0.148675 Sep 06 11:07:55.547064 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1947/3904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:55 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:55.722786 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-11ac76e5-65dc-4437-95c7-ce707b097ca8 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 204 len: 0 microversion: 2.1 time: 0.409322 Sep 06 11:07:55.723684 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1958/3905] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:07:55 2022] DELETE /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:07:55.735585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-28932635-811f-4e9d-a41f-a7273d1eb2dc tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:55.736468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-28932635-811f-4e9d-a41f-a7273d1eb2dc tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:55.744690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28932635-811f-4e9d-a41f-a7273d1eb2dc tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.745199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28932635-811f-4e9d-a41f-a7273d1eb2dc tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.745685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28932635-811f-4e9d-a41f-a7273d1eb2dc tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.746413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28932635-811f-4e9d-a41f-a7273d1eb2dc tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.746877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28932635-811f-4e9d-a41f-a7273d1eb2dc tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.747502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28932635-811f-4e9d-a41f-a7273d1eb2dc tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.843776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:55.844515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:55.851340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.854004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.854004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.854004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.854260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.854670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.917751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.918393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.918980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.919531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid 4a3642cc-7e32-44a8-915b-a0e3deaf8374 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:55.939240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-28932635-811f-4e9d-a41f-a7273d1eb2dc tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:55.948808 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-28932635-811f-4e9d-a41f-a7273d1eb2dc tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1503 microversion: 2.1 time: 0.220552 Sep 06 11:07:55.949718 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1948/3906] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:55 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:55.963524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-be9c88f7-6bfa-4b8f-83ee-fd3420eff2f4 req-99c8b05b-1643-4144-b93d-461bbf5ee798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d78eee-0953-4593-b34f-271f88c7125b", "name": "network-vif-deleted", "tag": "a5cc4081-f537-4898-af7a-401941c6fe02"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:55.974570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-be9c88f7-6bfa-4b8f-83ee-fd3420eff2f4 req-99c8b05b-1643-4144-b93d-461bbf5ee798 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:55.974996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-be9c88f7-6bfa-4b8f-83ee-fd3420eff2f4 req-99c8b05b-1643-4144-b93d-461bbf5ee798 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:55.975481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-be9c88f7-6bfa-4b8f-83ee-fd3420eff2f4 req-99c8b05b-1643-4144-b93d-461bbf5ee798 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:55.978723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:55.986845 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a971b01e-fc7b-49ec-a4b3-356701e86209 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1305 microversion: 2.1 time: 0.147996 Sep 06 11:07:56.000181 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1959/3907] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:55 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1305 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:56.000389 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-be9c88f7-6bfa-4b8f-83ee-fd3420eff2f4 req-99c8b05b-1643-4144-b93d-461bbf5ee798 service nova] Creating event network-vif-deleted:a5cc4081-f537-4898-af7a-401941c6fe02 for instance d8d78eee-0953-4593-b34f-271f88c7125b on nch2-master-1 Sep 06 11:07:56.004915 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-be9c88f7-6bfa-4b8f-83ee-fd3420eff2f4 req-99c8b05b-1643-4144-b93d-461bbf5ee798 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053882 Sep 06 11:07:56.005564 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1949/3908] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:56.231098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:56.240830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:56.256572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:56.258546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:56.259742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:56.260673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:56.261306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:56.261886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:56.304669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:56.305164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:56.305609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:56.306631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'fault' on Instance uuid d8d78eee-0953-4593-b34f-271f88c7125b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:56.352520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:56.361377 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6bc1bd1e-9aa7-43f6-a432-85fbbb801c90 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1304 microversion: 2.1 time: 0.134390 Sep 06 11:07:56.361962 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1960/3909] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:56 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:56.418903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b0294b7f-8350-4e26-873e-cd8024b8353d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:56.419708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b0294b7f-8350-4e26-873e-cd8024b8353d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:56.426858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0294b7f-8350-4e26-873e-cd8024b8353d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:56.427375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0294b7f-8350-4e26-873e-cd8024b8353d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:56.427822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0294b7f-8350-4e26-873e-cd8024b8353d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:56.428750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0294b7f-8350-4e26-873e-cd8024b8353d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:56.429188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0294b7f-8350-4e26-873e-cd8024b8353d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:56.429622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0294b7f-8350-4e26-873e-cd8024b8353d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:56.506421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b0294b7f-8350-4e26-873e-cd8024b8353d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:56.510363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:56.518124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b0294b7f-8350-4e26-873e-cd8024b8353d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:56.519862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b0294b7f-8350-4e26-873e-cd8024b8353d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:56.525918 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b0294b7f-8350-4e26-873e-cd8024b8353d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.114468 Sep 06 11:07:56.526507 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1950/3910] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:56 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:56.562405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:56.563194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:56.569483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:56.570170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:56.570825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:56.572217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:56.572692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:56.573127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:56.608287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:56.608964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:56.609574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:56.610175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 52698341-5c8b-434b-82d4-5d35faf1b2fa {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:56.661938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:56.670337 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7df34488-731d-49aa-ba71-dead4ed0589d tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1313 microversion: 2.1 time: 0.111749 Sep 06 11:07:56.670927 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1961/3911] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:56 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1313 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:56.974706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fc4dfb2a-6b2c-435d-952d-2ab4f8b9a149 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:56.975355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fc4dfb2a-6b2c-435d-952d-2ab4f8b9a149 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:56.983626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc4dfb2a-6b2c-435d-952d-2ab4f8b9a149 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:56.984136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc4dfb2a-6b2c-435d-952d-2ab4f8b9a149 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:56.984582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc4dfb2a-6b2c-435d-952d-2ab4f8b9a149 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:56.985303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc4dfb2a-6b2c-435d-952d-2ab4f8b9a149 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:56.985769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc4dfb2a-6b2c-435d-952d-2ab4f8b9a149 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:56.986225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc4dfb2a-6b2c-435d-952d-2ab4f8b9a149 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:57.012156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:57.013212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:57.027704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:57.028330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:57.028873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:57.029829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:57.030406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:57.031034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:57.058037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:57.081161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:57.081906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:57.082359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:57.082808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid 4a3642cc-7e32-44a8-915b-a0e3deaf8374 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:57.219490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:57.229768 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8371c90a-9bf3-469a-a830-0ec16a8b0931 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1305 microversion: 2.1 time: 0.222268 Sep 06 11:07:57.239768 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1962/3912] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:57 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1305 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:57.380078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fc4dfb2a-6b2c-435d-952d-2ab4f8b9a149 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:57.399508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:57.399508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:57.400412 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fc4dfb2a-6b2c-435d-952d-2ab4f8b9a149 tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1503 microversion: 2.1 time: 0.429806 Sep 06 11:07:57.405068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:57.405547 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1951/3913] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:56 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1503 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:57.406269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:57.406897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:57.407672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:57.408146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:57.408587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:57.447814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:57.449065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:57.449769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:57.450242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'fault' on Instance uuid d8d78eee-0953-4593-b34f-271f88c7125b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:57.523832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:57.537870 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-822d1360-33c5-488a-af6c-5862f81b1de2 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1304 microversion: 2.1 time: 0.151594 Sep 06 11:07:57.548204 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1963/3914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:57 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:57.558105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b3300ce9-404d-40e9-954b-4007c49f8d9d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:57.559294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b3300ce9-404d-40e9-954b-4007c49f8d9d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:57.567079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3300ce9-404d-40e9-954b-4007c49f8d9d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:57.567966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3300ce9-404d-40e9-954b-4007c49f8d9d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:57.568892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3300ce9-404d-40e9-954b-4007c49f8d9d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:57.570098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3300ce9-404d-40e9-954b-4007c49f8d9d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:57.570900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3300ce9-404d-40e9-954b-4007c49f8d9d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:57.572329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3300ce9-404d-40e9-954b-4007c49f8d9d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:57.693582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:57.694554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:57.701954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:57.702664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b3300ce9-404d-40e9-954b-4007c49f8d9d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:57.703160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:57.703871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:57.704833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:57.705523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:57.706182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:57.713320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b3300ce9-404d-40e9-954b-4007c49f8d9d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:57.716570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b3300ce9-404d-40e9-954b-4007c49f8d9d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:57.735554 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b3300ce9-404d-40e9-954b-4007c49f8d9d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.182704 Sep 06 11:07:57.736903 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1952/3915] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:57 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:57.767875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:57.768697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:57.769345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:57.770008 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 52698341-5c8b-434b-82d4-5d35faf1b2fa {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:57.840935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:57.852036 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4bfe75ee-0ffa-406e-bbfd-2783c99e2c85 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1313 microversion: 2.1 time: 0.162355 Sep 06 11:07:57.870760 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1964/3916] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:57 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:07:58.081047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-5b4feca6-181c-49d7-bc95-9674938f4195 req-5a2bc915-a54a-4d9d-9bf8-f317929b8e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e879944-3ef1-460a-93cb-8c07843f9996", "name": "network-vif-deleted", "tag": "5912061f-ec5b-443b-bbe4-7e658236d514"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:07:58.092586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5b4feca6-181c-49d7-bc95-9674938f4195 req-5a2bc915-a54a-4d9d-9bf8-f317929b8e6a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.093084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5b4feca6-181c-49d7-bc95-9674938f4195 req-5a2bc915-a54a-4d9d-9bf8-f317929b8e6a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.093516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5b4feca6-181c-49d7-bc95-9674938f4195 req-5a2bc915-a54a-4d9d-9bf8-f317929b8e6a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.107035 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-5b4feca6-181c-49d7-bc95-9674938f4195 req-5a2bc915-a54a-4d9d-9bf8-f317929b8e6a service nova] Creating event network-vif-deleted:5912061f-ec5b-443b-bbe4-7e658236d514 for instance 0e879944-3ef1-460a-93cb-8c07843f9996 on nch1-master-1 Sep 06 11:07:58.112122 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-5b4feca6-181c-49d7-bc95-9674938f4195 req-5a2bc915-a54a-4d9d-9bf8-f317929b8e6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035776 Sep 06 11:07:58.112991 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1953/3917] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:07:58.259888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:58.260514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:58.270753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.271461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.272113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.273030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.273670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.274310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.310320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.310952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.311656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.312336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid 4a3642cc-7e32-44a8-915b-a0e3deaf8374 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:58.356103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:58.364554 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d56bba9a-383a-4408-a815-8576f973332a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1305 microversion: 2.1 time: 0.109423 Sep 06 11:07:58.367330 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1965/3918] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:58 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1305 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:58.432138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:58.432879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:58.441019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.442124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.442660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.443422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.444040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.444482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.483226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.484020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.484671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.485283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lazy-loading 'fault' on Instance uuid 0e879944-3ef1-460a-93cb-8c07843f9996 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:58.536940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e756626ac4446e907deba71a0ebeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534a6b8f7bb04d4e9e3493388bd1d86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:58.546756 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cb3258d5-f5c7-4813-9205-a9acdef80a1e tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 200 len: 1304 microversion: 2.1 time: 0.119629 Sep 06 11:07:58.547955 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1954/3919] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:58 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:58.566106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:58.566731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:58.574007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.574519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.574984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.575813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.576290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.577022 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.630939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.631810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.632745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.633220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'fault' on Instance uuid d8d78eee-0953-4593-b34f-271f88c7125b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:58.697697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:58.706261 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6e2d9892-e489-4ebb-974d-ec036cd14f87 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1304 microversion: 2.1 time: 0.148826 Sep 06 11:07:58.707598 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1966/3920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:58 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1304 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:58.772172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8fe193a5-782d-4770-89f2-936328cbd882 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:58.772802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8fe193a5-782d-4770-89f2-936328cbd882 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:58.782071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fe193a5-782d-4770-89f2-936328cbd882 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.787001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fe193a5-782d-4770-89f2-936328cbd882 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.787910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fe193a5-782d-4770-89f2-936328cbd882 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.789224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fe193a5-782d-4770-89f2-936328cbd882 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.790977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fe193a5-782d-4770-89f2-936328cbd882 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.791471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fe193a5-782d-4770-89f2-936328cbd882 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.888794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8fe193a5-782d-4770-89f2-936328cbd882 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:58.889067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:58.889601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:58.898294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8fe193a5-782d-4770-89f2-936328cbd882 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:58.898990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.900073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.900514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.901358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.902059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.902707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.906358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8fe193a5-782d-4770-89f2-936328cbd882 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:58.914744 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8fe193a5-782d-4770-89f2-936328cbd882 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.145926 Sep 06 11:07:58.916582 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1955/3921] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:58 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:07:58.943020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:58.943583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:58.944080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:58.944539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 52698341-5c8b-434b-82d4-5d35faf1b2fa {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:58.989206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:58.999586 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-372e50c2-a656-464a-af8a-7b63d154b5bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1313 microversion: 2.1 time: 0.119850 Sep 06 11:07:59.000476 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1967/3922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:58 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1313 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:59.390154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:59.390833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:59.398390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:59.401995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:59.401995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:59.401995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:59.401995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:59.401995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:59.448333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:59.448822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:59.449639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:59.450248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid 4a3642cc-7e32-44a8-915b-a0e3deaf8374 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:59.501580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:59.512967 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ecf2a265-573f-4b13-b71c-0fda3a033bb9 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1305 microversion: 2.1 time: 0.126897 Sep 06 11:07:59.520095 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1956/3923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:59 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:59.574640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3133d973-2a3d-41f4-b8df-36e243fa799f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:59.575279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3133d973-2a3d-41f4-b8df-36e243fa799f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] [instance: 0e879944-3ef1-460a-93cb-8c07843f9996] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:59.584249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3133d973-2a3d-41f4-b8df-36e243fa799f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:59.585041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3133d973-2a3d-41f4-b8df-36e243fa799f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:59.586045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3133d973-2a3d-41f4-b8df-36e243fa799f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:59.587395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3133d973-2a3d-41f4-b8df-36e243fa799f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:59.588074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3133d973-2a3d-41f4-b8df-36e243fa799f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:59.588580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3133d973-2a3d-41f4-b8df-36e243fa799f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:59.604131 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-3133d973-2a3d-41f4-b8df-36e243fa799f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] HTTP exception thrown: Instance 0e879944-3ef1-460a-93cb-8c07843f9996 could not be found. Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3133d973-2a3d-41f4-b8df-36e243fa799f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Request method failure captured: Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 HTTP/1.1 Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFynXXGOZsQsK0mZZhBHBelBc0OtLnIv9DRLHtl4Qs0rCAt0VPgnKsoLow3xjOCfuVwruf6RqQlnNHVYMFIJti37CpEkZ6kdIwAEBpGYZJcNKsLmK1ut5_I09aN9b4L3Z4FUMLUedHCV9q2DFfa7Ci3ZbxMwtluYsLGYUjzZvCCNfdcs Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 534a6b8f7bb04d4e9e3493388bd1d86e Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-VolumesActionsTest-968355216 Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_534a6b8f7bb04d4e9e3493388bd1d86e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/534a6b8f7bb04d4e9e3493388bd1d86e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/534a6b8f7bb04d4e9e3493388bd1d86e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/534a6b8f7bb04d4e9e3493388bd1d86e"}]}] Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-VolumesActionsTest-968355216 Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 534a6b8f7bb04d4e9e3493388bd1d86e Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-VolumesActionsTest-968355216 Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-VolumesActionsTest-968355216-project Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 86e756626ac4446e907deba71a0ebeb2 Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-VolumesActionsTest-968355216-project Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 0e879944-3ef1-460a-93cb-8c07843f9996 could not be found. Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '0e879944-3ef1-460a-93cb-8c07843f9996'} Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e879944-3ef1-460a-93cb-8c07843f9996 could not be found. Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e879944-3ef1-460a-93cb-8c07843f9996 could not be found. Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:07:59.606478 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:07:59.610364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:07:59.610364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:07:59.610364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:07:59.610364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:07:59.610364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:07:59.610364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e879944-3ef1-460a-93cb-8c07843f9996 could not be found. Sep 06 11:07:59.610364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:07:59.612507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3133d973-2a3d-41f4-b8df-36e243fa799f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] Returning 404 to user: Instance 0e879944-3ef1-460a-93cb-8c07843f9996 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:07:59.613615 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3133d973-2a3d-41f4-b8df-36e243fa799f tempest-VolumesActionsTest-968355216 tempest-VolumesActionsTest-968355216-project] 10.222.0.20 "GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996" status: 404 len: 111 microversion: 2.1 time: 0.044028 Sep 06 11:07:59.614189 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1968/3924] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:59 2022] GET /compute/v2.1/servers/0e879944-3ef1-460a-93cb-8c07843f9996 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:07:59.745168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:59.746387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:59.760052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:59.760648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:59.761178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:59.761988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:59.762781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:59.763393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:59.805639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:59.806851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:59.807334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:59.808108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'fault' on Instance uuid d8d78eee-0953-4593-b34f-271f88c7125b {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:07:59.866727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:07:59.882583 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fc91a669-edff-4bf3-ba45-ba099b5ee995 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1304 microversion: 2.1 time: 0.149626 Sep 06 11:07:59.898796 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1957/3925] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:07:59 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:59.950469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a38be15-6d6a-4849-bb13-6414c2d28d7a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:07:59.951859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0a38be15-6d6a-4849-bb13-6414c2d28d7a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:07:59.964921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a38be15-6d6a-4849-bb13-6414c2d28d7a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:59.965786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a38be15-6d6a-4849-bb13-6414c2d28d7a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:59.966447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a38be15-6d6a-4849-bb13-6414c2d28d7a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:07:59.967775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a38be15-6d6a-4849-bb13-6414c2d28d7a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:07:59.968540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a38be15-6d6a-4849-bb13-6414c2d28d7a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:07:59.969338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a38be15-6d6a-4849-bb13-6414c2d28d7a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:00.037502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:00.039137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:00.063249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:00.064443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:00.070344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:00.070344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:00.070344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:00.070344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:00.122308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:00.126735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:00.126735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:00.126735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 52698341-5c8b-434b-82d4-5d35faf1b2fa {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:00.189576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:00.198541 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-204f5216-de57-4b46-8cb3-dc49065df4aa tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1313 microversion: 2.1 time: 0.175179 Sep 06 11:08:00.210866 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1958/3926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:00 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:00.424958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0a38be15-6d6a-4849-bb13-6414c2d28d7a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:00.438348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0a38be15-6d6a-4849-bb13-6414c2d28d7a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:00.441660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0a38be15-6d6a-4849-bb13-6414c2d28d7a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:00.448906 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0a38be15-6d6a-4849-bb13-6414c2d28d7a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.507531 Sep 06 11:08:00.449763 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1969/3927] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:07:59 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:08:00.536807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:00.537449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:00.545733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:00.546235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:00.546677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:00.547639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:00.548301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:00.549576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:00.611785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:00.612681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:00.613531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:00.616991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid 4a3642cc-7e32-44a8-915b-a0e3deaf8374 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:00.678965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:00.690238 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6ce1280b-ed95-477d-b2e7-fb479595060d tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1305 microversion: 2.1 time: 0.157768 Sep 06 11:08:00.690798 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1959/3928] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:00 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1305 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:00.909929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:00.911281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:00.921960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:00.923211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:00.924220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:00.925811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:00.927778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:00.929120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:00.981287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:00.982154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:00.982868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:00.983572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'fault' on Instance uuid d8d78eee-0953-4593-b34f-271f88c7125b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:01.056723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:01.074114 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-350e13f3-6936-40f9-85c3-1671630c516d tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1304 microversion: 2.1 time: 0.164533 Sep 06 11:08:01.084900 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1970/3929] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:00 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1304 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:01.229714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:01.230341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:01.239082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:01.239594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:01.242331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:01.247878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:01.248691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:01.249373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:01.317670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:01.318660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:01.319694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:01.320584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 52698341-5c8b-434b-82d4-5d35faf1b2fa {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:01.410203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:01.437883 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-68ff1bb9-9199-4663-beac-ace54d4269b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1313 microversion: 2.1 time: 0.213090 Sep 06 11:08:01.445625 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1960/3930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:01 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:01.480611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aa6151ef-3b34-40da-8249-4881e9c00260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:01.481343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aa6151ef-3b34-40da-8249-4881e9c00260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:01.500166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa6151ef-3b34-40da-8249-4881e9c00260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:01.500785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa6151ef-3b34-40da-8249-4881e9c00260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:01.501317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa6151ef-3b34-40da-8249-4881e9c00260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:01.502264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa6151ef-3b34-40da-8249-4881e9c00260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:01.502815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa6151ef-3b34-40da-8249-4881e9c00260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:01.503357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa6151ef-3b34-40da-8249-4881e9c00260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:01.642678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aa6151ef-3b34-40da-8249-4881e9c00260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:01.654234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aa6151ef-3b34-40da-8249-4881e9c00260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:01.656160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aa6151ef-3b34-40da-8249-4881e9c00260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:01.668302 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aa6151ef-3b34-40da-8249-4881e9c00260 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.192245 Sep 06 11:08:01.669716 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1971/3931] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:01 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:08:01.725265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:01.726013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:01.739546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:01.744428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:01.744428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:01.744428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:01.744428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:01.744428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:01.795774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:01.796633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:01.799139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:01.799139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid 4a3642cc-7e32-44a8-915b-a0e3deaf8374 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:01.861118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:01.871154 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-363af7ac-2ebe-478e-a326-b02aad4da540 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1305 microversion: 2.1 time: 0.151045 Sep 06 11:08:01.872404 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1961/3932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:01 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1305 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:02.105820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:02.106425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:02.114026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:02.118892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:02.118892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:02.118892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:02.118892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:02.118892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:02.156095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:02.156827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:02.157483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:02.157931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'fault' on Instance uuid d8d78eee-0953-4593-b34f-271f88c7125b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:02.207478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:02.217484 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5eb06588-3da5-4cad-9f4e-2bc03bb627cf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1304 microversion: 2.1 time: 0.116018 Sep 06 11:08:02.219694 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1972/3933] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:02 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:02.475803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:02.476351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:02.485292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:02.485814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:02.486263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:02.486977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:02.487463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:02.488000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:02.524714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:02.525207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:02.525655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:02.526122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 52698341-5c8b-434b-82d4-5d35faf1b2fa {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:02.583314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:02.596325 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d69cca26-0823-4e07-9df9-714c42de6285 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1313 microversion: 2.1 time: 0.124494 Sep 06 11:08:02.606492 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1962/3934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:02 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1313 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:02.706482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b1bc5bd-9ca3-4b2d-8ca2-ef5bd22c4f33 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:02.707448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2b1bc5bd-9ca3-4b2d-8ca2-ef5bd22c4f33 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:02.714931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b1bc5bd-9ca3-4b2d-8ca2-ef5bd22c4f33 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:02.715476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b1bc5bd-9ca3-4b2d-8ca2-ef5bd22c4f33 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:02.715924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b1bc5bd-9ca3-4b2d-8ca2-ef5bd22c4f33 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:02.716645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b1bc5bd-9ca3-4b2d-8ca2-ef5bd22c4f33 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:02.717112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b1bc5bd-9ca3-4b2d-8ca2-ef5bd22c4f33 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:02.717548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b1bc5bd-9ca3-4b2d-8ca2-ef5bd22c4f33 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:02.796710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2b1bc5bd-9ca3-4b2d-8ca2-ef5bd22c4f33 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:02.813234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2b1bc5bd-9ca3-4b2d-8ca2-ef5bd22c4f33 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:02.814741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2b1bc5bd-9ca3-4b2d-8ca2-ef5bd22c4f33 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:02.820513 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b1bc5bd-9ca3-4b2d-8ca2-ef5bd22c4f33 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.124074 Sep 06 11:08:02.821301 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1973/3935] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:02 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:08:02.899140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:02.900113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:02.923521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:02.924236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:02.924707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:02.925490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:02.925962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:02.926406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:02.967130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:02.967769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:02.968321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:02.968997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid 4a3642cc-7e32-44a8-915b-a0e3deaf8374 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:03.021565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:03.038883 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e3feb452-9257-423b-96ef-c1ae9d7948af tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1305 microversion: 2.1 time: 0.144828 Sep 06 11:08:03.051271 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1963/3936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:02 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1305 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:03.248480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:03.249811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:03.256690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:03.260549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:03.261306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:03.261972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:03.262937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:03.263656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:03.264328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:03.307886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:03.308724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:03.309379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:03.309850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'fault' on Instance uuid d8d78eee-0953-4593-b34f-271f88c7125b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:03.373435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:03.390057 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd9f21f0-bd7f-4980-8e0a-49bba840f1af tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1304 microversion: 2.1 time: 0.145440 Sep 06 11:08:03.390057 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1974/3937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:03 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:03.638505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:03.639172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:03.646126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:03.646650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:03.647138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:03.647911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:03.648535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:03.649000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:03.699838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:03.699838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:03.699838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:03.699838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 52698341-5c8b-434b-82d4-5d35faf1b2fa {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:03.777319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:03.785852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:03.788853 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ff6ab292-5b92-483b-970b-7be30f0b122a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1313 microversion: 2.1 time: 0.155580 Sep 06 11:08:03.803652 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1964/3938] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:03 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:03.849782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-af8c051c-b3f4-409e-9173-ce30f90258db tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:03.850528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-af8c051c-b3f4-409e-9173-ce30f90258db tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:03.862307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af8c051c-b3f4-409e-9173-ce30f90258db tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:03.867633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af8c051c-b3f4-409e-9173-ce30f90258db tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:03.872222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af8c051c-b3f4-409e-9173-ce30f90258db tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:03.874204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af8c051c-b3f4-409e-9173-ce30f90258db tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:03.874651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af8c051c-b3f4-409e-9173-ce30f90258db tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:03.875391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af8c051c-b3f4-409e-9173-ce30f90258db tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:03.977519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af8c051c-b3f4-409e-9173-ce30f90258db tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:03.987698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af8c051c-b3f4-409e-9173-ce30f90258db tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:03.989822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af8c051c-b3f4-409e-9173-ce30f90258db tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:03.996873 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-af8c051c-b3f4-409e-9173-ce30f90258db tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.151865 Sep 06 11:08:03.998320 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1975/3939] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:03 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:08:04.065730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:04.066540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:04.075372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:04.075893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:04.076358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:04.077132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:04.078114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:04.078564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:04.128973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:04.129404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:04.129969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:04.130442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid 4a3642cc-7e32-44a8-915b-a0e3deaf8374 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:04.175962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:04.186779 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4cf5000f-8911-4004-be7b-c3fe161d1370 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1305 microversion: 2.1 time: 0.124698 Sep 06 11:08:04.187615 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1965/3940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:04 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1305 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:04.417059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:04.417777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:04.425201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:04.425811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:04.426384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:04.427348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:04.427680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:04.428126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:04.464125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:04.464629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:04.465147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:04.465616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'fault' on Instance uuid d8d78eee-0953-4593-b34f-271f88c7125b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:04.468790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:04.513158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:04.522067 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-938a36fa-8269-49de-a383-bb2a25520aa6 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1304 microversion: 2.1 time: 0.109939 Sep 06 11:08:04.522647 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1976/3941] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:04 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:04.817879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:04.819889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:04.855259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:04.855259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:04.855259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:04.855259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:04.855259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:04.855259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:04.934684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:04.935590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:04.936530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:04.937807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 52698341-5c8b-434b-82d4-5d35faf1b2fa {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:05.007619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:05.028255 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-37416d88-fdd8-45d3-9e8c-fb7955b5b855 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1313 microversion: 2.1 time: 0.217429 Sep 06 11:08:05.028619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ebce517-339a-49a2-b334-42c28b229997 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:05.029429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0ebce517-339a-49a2-b334-42c28b229997 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:05.035975 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1966/3942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:04 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:05.038464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ebce517-339a-49a2-b334-42c28b229997 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:05.038962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ebce517-339a-49a2-b334-42c28b229997 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:05.039426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ebce517-339a-49a2-b334-42c28b229997 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:05.041155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ebce517-339a-49a2-b334-42c28b229997 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:05.041782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ebce517-339a-49a2-b334-42c28b229997 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:05.042368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ebce517-339a-49a2-b334-42c28b229997 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:05.131410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0ebce517-339a-49a2-b334-42c28b229997 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:05.141539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0ebce517-339a-49a2-b334-42c28b229997 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:05.143057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0ebce517-339a-49a2-b334-42c28b229997 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:05.153003 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0ebce517-339a-49a2-b334-42c28b229997 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.129229 Sep 06 11:08:05.153878 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1977/3943] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:05 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:08:05.211950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:05.213225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:05.220681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:05.221438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:05.222043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:05.222972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:05.223473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:05.224311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:05.299745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:05.312112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:05.315870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:05.316966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid 4a3642cc-7e32-44a8-915b-a0e3deaf8374 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:05.374821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:05.384649 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f6eb1e5d-7493-4248-8343-6f7eb2eadb5a tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 200 len: 1305 microversion: 2.1 time: 0.176874 Sep 06 11:08:05.385251 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1967/3944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:05 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 1305 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:05.545958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:05.547857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:05.573669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:05.574191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:05.575510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:05.580759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:05.580759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:05.580759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:05.622262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:05.623040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:05.623784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:05.624414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'fault' on Instance uuid d8d78eee-0953-4593-b34f-271f88c7125b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:05.687624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:05.704687 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-39c05c7e-09c6-49e0-aea2-aab68401dfdf tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 200 len: 1304 microversion: 2.1 time: 0.160988 Sep 06 11:08:05.705274 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1978/3945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:05 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 1304 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:06.057460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:06.061848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:06.067779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:06.068658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:06.069252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:06.070209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:06.070935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:06.072009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:06.126134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:06.126767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:06.128995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:06.128995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 52698341-5c8b-434b-82d4-5d35faf1b2fa {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:06.188481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-73b3c52f-0cc9-4851-858d-365a6d80bdc0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:06.193448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-73b3c52f-0cc9-4851-858d-365a6d80bdc0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:06.218225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73b3c52f-0cc9-4851-858d-365a6d80bdc0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:06.219184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73b3c52f-0cc9-4851-858d-365a6d80bdc0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:06.219884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73b3c52f-0cc9-4851-858d-365a6d80bdc0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:06.221720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73b3c52f-0cc9-4851-858d-365a6d80bdc0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:06.222451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73b3c52f-0cc9-4851-858d-365a6d80bdc0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:06.223451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73b3c52f-0cc9-4851-858d-365a6d80bdc0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:06.234977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:06.254056 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-db83b1a3-27fb-45f8-b79e-07dff91fdd36 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 200 len: 1313 microversion: 2.1 time: 0.202891 Sep 06 11:08:06.255251 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1968/3946] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:06 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:06.410314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-044d6365-7a68-4c57-b104-1d5fd74dabbc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:06.411128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-044d6365-7a68-4c57-b104-1d5fd74dabbc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 4a3642cc-7e32-44a8-915b-a0e3deaf8374] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:06.418050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-73b3c52f-0cc9-4851-858d-365a6d80bdc0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:06.424118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-044d6365-7a68-4c57-b104-1d5fd74dabbc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:06.424805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-044d6365-7a68-4c57-b104-1d5fd74dabbc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:06.425410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-044d6365-7a68-4c57-b104-1d5fd74dabbc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:06.426295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-044d6365-7a68-4c57-b104-1d5fd74dabbc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:06.426909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-044d6365-7a68-4c57-b104-1d5fd74dabbc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:06.427506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-044d6365-7a68-4c57-b104-1d5fd74dabbc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:06.438339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-73b3c52f-0cc9-4851-858d-365a6d80bdc0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:06.442842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-73b3c52f-0cc9-4851-858d-365a6d80bdc0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:06.450242 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-044d6365-7a68-4c57-b104-1d5fd74dabbc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] HTTP exception thrown: Instance 4a3642cc-7e32-44a8-915b-a0e3deaf8374 could not be found. Sep 06 11:08:06.451133 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-73b3c52f-0cc9-4851-858d-365a6d80bdc0 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.269223 Sep 06 11:08:06.452612 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1979/3947] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:06 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-044d6365-7a68-4c57-b104-1d5fd74dabbc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Request method failure captured: Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 HTTP/1.1 Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyg2U48D630rtP93KctSUB55frBucaLCwvXam7s5D6muRGgpAdGYpf_Jd02qO6Wv-yScWLiyAR1qNAYbE0W-SGR2eaGszOp1OPVLx8OvqN3f_pV8xU0pTYMSFjaPG0NSAitsz90vg6hPWxi5nbHOISf77di5fAInBJEzZCthjFzILpY Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: dcd5ffec2c6246fb89ba181542692585 Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerActionsTestJSON-562575329 Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcd5ffec2c6246fb89ba181542692585"}]}] Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerActionsTestJSON-562575329 Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: dcd5ffec2c6246fb89ba181542692585 Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerActionsTestJSON-562575329 Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerActionsTestJSON-562575329-project Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: f16abbf8a68344b68444ff8fc2795c67 Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerActionsTestJSON-562575329-project Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 4a3642cc-7e32-44a8-915b-a0e3deaf8374 could not be found. Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '4a3642cc-7e32-44a8-915b-a0e3deaf8374'} Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a3642cc-7e32-44a8-915b-a0e3deaf8374 could not be found. Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a3642cc-7e32-44a8-915b-a0e3deaf8374 could not be found. Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:06.463264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:06.466858 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:06.466858 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:06.466858 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:06.466858 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:08:06.466858 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:08:06.466858 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a3642cc-7e32-44a8-915b-a0e3deaf8374 could not be found. Sep 06 11:08:06.466858 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:06.466858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-044d6365-7a68-4c57-b104-1d5fd74dabbc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Returning 404 to user: Instance 4a3642cc-7e32-44a8-915b-a0e3deaf8374 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:06.466858 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-044d6365-7a68-4c57-b104-1d5fd74dabbc tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374" status: 404 len: 111 microversion: 2.1 time: 0.059397 Sep 06 11:08:06.471591 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1969/3948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:06 2022] GET /compute/v2.1/servers/4a3642cc-7e32-44a8-915b-a0e3deaf8374 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:08:06.482271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a2a73620-fe09-424c-be68-23a5aae9f218 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:06.482789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a2a73620-fe09-424c-be68-23a5aae9f218 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:06.495443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2a73620-fe09-424c-be68-23a5aae9f218 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:06.496189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2a73620-fe09-424c-be68-23a5aae9f218 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:06.496812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2a73620-fe09-424c-be68-23a5aae9f218 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:06.497694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2a73620-fe09-424c-be68-23a5aae9f218 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:06.498307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2a73620-fe09-424c-be68-23a5aae9f218 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:06.498949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2a73620-fe09-424c-be68-23a5aae9f218 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:06.543735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a2a73620-fe09-424c-be68-23a5aae9f218 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:08:06.731402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c887e6f9-c606-4947-8992-834a9e57f8ce tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:06.732120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c887e6f9-c606-4947-8992-834a9e57f8ce tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: d8d78eee-0953-4593-b34f-271f88c7125b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:06.735269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:06.739936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c887e6f9-c606-4947-8992-834a9e57f8ce tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:06.740432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c887e6f9-c606-4947-8992-834a9e57f8ce tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:06.740872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c887e6f9-c606-4947-8992-834a9e57f8ce tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:06.741787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c887e6f9-c606-4947-8992-834a9e57f8ce tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:06.742407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c887e6f9-c606-4947-8992-834a9e57f8ce tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:06.743093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c887e6f9-c606-4947-8992-834a9e57f8ce tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:06.765717 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-c887e6f9-c606-4947-8992-834a9e57f8ce tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] HTTP exception thrown: Instance d8d78eee-0953-4593-b34f-271f88c7125b could not be found. Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c887e6f9-c606-4947-8992-834a9e57f8ce tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Request method failure captured: Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b HTTP/1.1 Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFymQFf_Q-RVNXq0Js72U49OBKrsHRpx9vRkOS5Vx5uWzkWSovCm78m1w8SwO7nQePeE4l_Wfdtx7i7OZNY3l0deXQTqYDJ6C33Db8PZsCYpnlW8DBz4jqtHnSd6p3Z8v1t8bN91vxf0TDHQt0HB-FSEPgYW7UYVAbsf3CDDLgWsWYx4 Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3bce0861528a4891b94d174e964456f0 Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerRescueTestJSON-1088994803 Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3bce0861528a4891b94d174e964456f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3bce0861528a4891b94d174e964456f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3bce0861528a4891b94d174e964456f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3bce0861528a4891b94d174e964456f0"}]}] Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerRescueTestJSON-1088994803 Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3bce0861528a4891b94d174e964456f0 Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerRescueTestJSON-1088994803 Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerRescueTestJSON-1088994803-project Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e94103c4c75b4f2d8b2cb1bd4b6bcf6a Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerRescueTestJSON-1088994803-project Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance d8d78eee-0953-4593-b34f-271f88c7125b could not be found. Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'd8d78eee-0953-4593-b34f-271f88c7125b'} Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d78eee-0953-4593-b34f-271f88c7125b could not be found. Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d78eee-0953-4593-b34f-271f88c7125b could not be found. Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:06.779134 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:06.783288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:06.783288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:06.783288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:06.783288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:08:06.783288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:08:06.783288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d78eee-0953-4593-b34f-271f88c7125b could not be found. Sep 06 11:08:06.783288 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:06.783288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c887e6f9-c606-4947-8992-834a9e57f8ce tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Returning 404 to user: Instance d8d78eee-0953-4593-b34f-271f88c7125b could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:06.783288 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c887e6f9-c606-4947-8992-834a9e57f8ce tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b" status: 404 len: 111 microversion: 2.1 time: 0.054176 Sep 06 11:08:06.783288 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1970/3949] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:06 2022] GET /compute/v2.1/servers/d8d78eee-0953-4593-b34f-271f88c7125b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:08:06.789601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-31afe72e-4e56-45b9-8362-fbb704a8b80a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:06.790334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-31afe72e-4e56-45b9-8362-fbb704a8b80a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:06.798322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31afe72e-4e56-45b9-8362-fbb704a8b80a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:06.798899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31afe72e-4e56-45b9-8362-fbb704a8b80a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:06.800763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31afe72e-4e56-45b9-8362-fbb704a8b80a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:06.812549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31afe72e-4e56-45b9-8362-fbb704a8b80a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:06.812549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31afe72e-4e56-45b9-8362-fbb704a8b80a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:06.812549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31afe72e-4e56-45b9-8362-fbb704a8b80a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:06.872485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-31afe72e-4e56-45b9-8362-fbb704a8b80a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:08:07.092743 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a2a73620-fe09-424c-be68-23a5aae9f218 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 204 len: 0 microversion: 2.1 time: 0.613985 Sep 06 11:08:07.098485 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1980/3950] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:08:06 2022] DELETE /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:08:07.122274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1d526c67-1d4c-4529-8dd7-0d49f126c936 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:07.124857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1d526c67-1d4c-4529-8dd7-0d49f126c936 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:07.132558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d526c67-1d4c-4529-8dd7-0d49f126c936 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:07.133153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d526c67-1d4c-4529-8dd7-0d49f126c936 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:07.133719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d526c67-1d4c-4529-8dd7-0d49f126c936 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:07.134693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d526c67-1d4c-4529-8dd7-0d49f126c936 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:07.135504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d526c67-1d4c-4529-8dd7-0d49f126c936 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:07.136049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d526c67-1d4c-4529-8dd7-0d49f126c936 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:07.374070 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-31afe72e-4e56-45b9-8362-fbb704a8b80a tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 204 len: 0 microversion: 2.1 time: 0.588103 Sep 06 11:08:07.375459 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1971/3951] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:08:06 2022] DELETE /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:08:07.385199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bec6b752-1a18-4e07-ad05-b47ab20dafd1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:07.386042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bec6b752-1a18-4e07-ad05-b47ab20dafd1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:07.402074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bec6b752-1a18-4e07-ad05-b47ab20dafd1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:07.402657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bec6b752-1a18-4e07-ad05-b47ab20dafd1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:07.403344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bec6b752-1a18-4e07-ad05-b47ab20dafd1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:07.404379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bec6b752-1a18-4e07-ad05-b47ab20dafd1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:07.404972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bec6b752-1a18-4e07-ad05-b47ab20dafd1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:07.405361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bec6b752-1a18-4e07-ad05-b47ab20dafd1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:07.408168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1d526c67-1d4c-4529-8dd7-0d49f126c936 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:07.420015 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1d526c67-1d4c-4529-8dd7-0d49f126c936 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1509 microversion: 2.1 time: 0.317702 Sep 06 11:08:07.421207 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1981/3952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:07 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1509 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:07.426711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8aebf0ec-b5bb-44ab-a2d2-6825d446fc94 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:07.427595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8aebf0ec-b5bb-44ab-a2d2-6825d446fc94 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:07.454376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aebf0ec-b5bb-44ab-a2d2-6825d446fc94 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:07.457012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aebf0ec-b5bb-44ab-a2d2-6825d446fc94 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:07.465706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aebf0ec-b5bb-44ab-a2d2-6825d446fc94 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:07.465706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aebf0ec-b5bb-44ab-a2d2-6825d446fc94 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:07.465706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aebf0ec-b5bb-44ab-a2d2-6825d446fc94 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:07.465706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aebf0ec-b5bb-44ab-a2d2-6825d446fc94 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:07.467407 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-bec6b752-1a18-4e07-ad05-b47ab20dafd1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] HTTP exception thrown: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bec6b752-1a18-4e07-ad05-b47ab20dafd1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Request method failure captured: Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa HTTP/1.1 Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFynmZVM_AVNoOqYUccx5KUvFZKCJAysXxMbDG6-DuAO5gPEBLLFcZbOigCU_YXhXtSGkA2RJsNuSLiSOb3vC2pTZlh_hyhIDhbds50p-SWtVHdomPJFcq8P-2RXWA330Dp3eHdiTl-PmwjMLs78nZ5NRNKc6YxxJJVsMwO0plQ1gJGc Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}] Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 2b51397c5872403c86210c2dc7f85735 Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '52698341-5c8b-434b-82d4-5d35faf1b2fa'} Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:07.469107 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:07.472694 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:07.472694 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:07.472694 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:07.472694 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:07.472694 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:08:07.472694 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:08:07.472694 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:07.472694 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:07.472694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bec6b752-1a18-4e07-ad05-b47ab20dafd1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Returning 404 to user: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:07.472694 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bec6b752-1a18-4e07-ad05-b47ab20dafd1 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 404 len: 111 microversion: 2.1 time: 0.092797 Sep 06 11:08:07.472694 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1972/3953] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:07 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:08:07.488981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d5473259-0a02-483b-801f-70184b1d359c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:07.501134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d5473259-0a02-483b-801f-70184b1d359c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:07.507817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d5473259-0a02-483b-801f-70184b1d359c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:08:07.519027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5473259-0a02-483b-801f-70184b1d359c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:07.523090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5473259-0a02-483b-801f-70184b1d359c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:07.523841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5473259-0a02-483b-801f-70184b1d359c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:07.525574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5473259-0a02-483b-801f-70184b1d359c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:07.527212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5473259-0a02-483b-801f-70184b1d359c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:07.530829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5473259-0a02-483b-801f-70184b1d359c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:07.640282 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d5473259-0a02-483b-801f-70184b1d359c tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.160715 Sep 06 11:08:07.641677 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1973/3954] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:08:07 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:08:07.656780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-db41ca15-5d59-4286-90f9-4aee15f6d19a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:07.657857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-db41ca15-5d59-4286-90f9-4aee15f6d19a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:07.665068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db41ca15-5d59-4286-90f9-4aee15f6d19a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:07.668693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db41ca15-5d59-4286-90f9-4aee15f6d19a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:07.668693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db41ca15-5d59-4286-90f9-4aee15f6d19a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:07.668693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db41ca15-5d59-4286-90f9-4aee15f6d19a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:07.668693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db41ca15-5d59-4286-90f9-4aee15f6d19a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:07.668693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db41ca15-5d59-4286-90f9-4aee15f6d19a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:07.760274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-db41ca15-5d59-4286-90f9-4aee15f6d19a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:07.771211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-db41ca15-5d59-4286-90f9-4aee15f6d19a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:07.774015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-db41ca15-5d59-4286-90f9-4aee15f6d19a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:07.780577 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-db41ca15-5d59-4286-90f9-4aee15f6d19a tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.137528 Sep 06 11:08:07.792992 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1974/3955] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:07 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:08:07.793274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8aebf0ec-b5bb-44ab-a2d2-6825d446fc94 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:07.793386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cbb25181-433a-4c4d-8fd7-03badf665af9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:07.796970 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8aebf0ec-b5bb-44ab-a2d2-6825d446fc94 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1490 microversion: 2.1 time: 0.374293 Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cbb25181-433a-4c4d-8fd7-03badf665af9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Request method failure captured: Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFynmZVM_AVNoOqYUccx5KUvFZKCJAysXxMbDG6-DuAO5gPEBLLFcZbOigCU_YXhXtSGkA2RJsNuSLiSOb3vC2pTZlh_hyhIDhbds50p-SWtVHdomPJFcq8P-2RXWA330Dp3eHdiTl-PmwjMLs78nZ5NRNKc6YxxJJVsMwO0plQ1gJGc Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}] Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 2b51397c5872403c86210c2dc7f85735 Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: action_args: {} Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 06 11:08:07.798047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:07.802576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cbb25181-433a-4c4d-8fd7-03badf665af9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:07.803675 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cbb25181-433a-4c4d-8fd7-03badf665af9 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.020259 Sep 06 11:08:07.814042 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1975/3956] 10.222.0.20 () {58 vars in 1182 bytes} [Tue Sep 6 11:08:07 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:08:07.814267 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1982/3957] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:07 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1490 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:07.822803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8875da28-8005-4976-be91-c0c8b0993405 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:07.826767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8875da28-8005-4976-be91-c0c8b0993405 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:07.827496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8875da28-8005-4976-be91-c0c8b0993405 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Searching by: {'deleted': False, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:08:07.837720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8875da28-8005-4976-be91-c0c8b0993405 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:07.838220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8875da28-8005-4976-be91-c0c8b0993405 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:07.838674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8875da28-8005-4976-be91-c0c8b0993405 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:07.839579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8875da28-8005-4976-be91-c0c8b0993405 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:07.845091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8875da28-8005-4976-be91-c0c8b0993405 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:07.845091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8875da28-8005-4976-be91-c0c8b0993405 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:07.882044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-8875da28-8005-4976-be91-c0c8b0993405 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:08:08.008917 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8875da28-8005-4976-be91-c0c8b0993405 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.194662 Sep 06 11:08:08.013072 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1976/3958] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 11:08:07 2022] GET /compute/v2.1/servers => generated 683 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:08:08.025755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ace8b817-791e-43ad-bb20-9136d9bf92f3 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:08.031805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ace8b817-791e-43ad-bb20-9136d9bf92f3 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:08.032587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.compute.servers [None req-ace8b817-791e-43ad-bb20-9136d9bf92f3 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Removing options 'limit' from query {{(pid=140875) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 06 11:08:08.033617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ace8b817-791e-43ad-bb20-9136d9bf92f3 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Searching by: {'deleted': False, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:08:08.039458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ace8b817-791e-43ad-bb20-9136d9bf92f3 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.040791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ace8b817-791e-43ad-bb20-9136d9bf92f3 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.041834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ace8b817-791e-43ad-bb20-9136d9bf92f3 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.043608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ace8b817-791e-43ad-bb20-9136d9bf92f3 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.044753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ace8b817-791e-43ad-bb20-9136d9bf92f3 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.046268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ace8b817-791e-43ad-bb20-9136d9bf92f3 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.111821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-ace8b817-791e-43ad-bb20-9136d9bf92f3 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:08:08.203263 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ace8b817-791e-43ad-bb20-9136d9bf92f3 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.181548 Sep 06 11:08:08.211227 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1983/3959] 10.222.0.20 () {58 vars in 1144 bytes} [Tue Sep 6 11:08:08 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:08:08.221945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2d55c0f6-4f7f-4c3a-b7ff-04c2dc3fbf56 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2d55c0f6-4f7f-4c3a-b7ff-04c2dc3fbf56 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Request method failure captured: Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFynmZVM_AVNoOqYUccx5KUvFZKCJAysXxMbDG6-DuAO5gPEBLLFcZbOigCU_YXhXtSGkA2RJsNuSLiSOb3vC2pTZlh_hyhIDhbds50p-SWtVHdomPJFcq8P-2RXWA330Dp3eHdiTl-PmwjMLs78nZ5NRNKc6YxxJJVsMwO0plQ1gJGc Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}] Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 2b51397c5872403c86210c2dc7f85735 Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: action_args: {} Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi '-1' Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 06 11:08:08.228636 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2d55c0f6-4f7f-4c3a-b7ff-04c2dc3fbf56 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2d55c0f6-4f7f-4c3a-b7ff-04c2dc3fbf56 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.017193 Sep 06 11:08:08.245295 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1977/3960] 10.222.0.20 () {58 vars in 1142 bytes} [Tue Sep 6 11:08:08 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:08:08.253303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1d422b56-4294-4d7e-b475-9ba1c99909ff tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1d422b56-4294-4d7e-b475-9ba1c99909ff tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Request method failure captured: Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFynmZVM_AVNoOqYUccx5KUvFZKCJAysXxMbDG6-DuAO5gPEBLLFcZbOigCU_YXhXtSGkA2RJsNuSLiSOb3vC2pTZlh_hyhIDhbds50p-SWtVHdomPJFcq8P-2RXWA330Dp3eHdiTl-PmwjMLs78nZ5NRNKc6YxxJJVsMwO0plQ1gJGc Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}] Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 2b51397c5872403c86210c2dc7f85735 Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: action_args: {} Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'testing' Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 06 11:08:08.260150 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1d422b56-4294-4d7e-b475-9ba1c99909ff tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1d422b56-4294-4d7e-b475-9ba1c99909ff tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.013200 Sep 06 11:08:08.268576 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1984/3961] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 11:08:08 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:08:08.276726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f1cc14ab-8f98-468d-a467-f71c82548962 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:08.283934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f1cc14ab-8f98-468d-a467-f71c82548962 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:08.285529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f1cc14ab-8f98-468d-a467-f71c82548962 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:08:08.305115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.compute.servers [None req-f1cc14ab-8f98-468d-a467-f71c82548962 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Flavor 'non_existing_flavor' could not be found {{(pid=140876) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 06 11:08:08.307060 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f1cc14ab-8f98-468d-a467-f71c82548962 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.035043 Sep 06 11:08:08.308252 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1978/3962] 10.222.0.20 () {58 vars in 1178 bytes} [Tue Sep 6 11:08:08 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:08:08.322411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0686b32f-2933-49bd-9e99-86d817176324 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:08.330617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0686b32f-2933-49bd-9e99-86d817176324 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:08.331811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0686b32f-2933-49bd-9e99-86d817176324 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:08:08.341434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0686b32f-2933-49bd-9e99-86d817176324 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.342287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0686b32f-2933-49bd-9e99-86d817176324 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.345301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0686b32f-2933-49bd-9e99-86d817176324 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.346689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0686b32f-2933-49bd-9e99-86d817176324 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.347661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0686b32f-2933-49bd-9e99-86d817176324 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.352842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0686b32f-2933-49bd-9e99-86d817176324 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.454640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a4318501-af88-415b-9844-86837be2cf71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:08.455907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a4318501-af88-415b-9844-86837be2cf71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:08.476362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4318501-af88-415b-9844-86837be2cf71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.477493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4318501-af88-415b-9844-86837be2cf71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.478526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4318501-af88-415b-9844-86837be2cf71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.484799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4318501-af88-415b-9844-86837be2cf71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.484799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4318501-af88-415b-9844-86837be2cf71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.484799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4318501-af88-415b-9844-86837be2cf71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.489016 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0686b32f-2933-49bd-9e99-86d817176324 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.172335 Sep 06 11:08:08.490783 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1985/3963] 10.222.0.20 () {58 vars in 1174 bytes} [Tue Sep 6 11:08:08 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:08:08.504297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6e62507f-fcd0-47be-ab24-ce36f3194a55 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:08.513345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6e62507f-fcd0-47be-ab24-ce36f3194a55 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:08.514608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6e62507f-fcd0-47be-ab24-ce36f3194a55 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:08:08.520599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e62507f-fcd0-47be-ab24-ce36f3194a55 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.521643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e62507f-fcd0-47be-ab24-ce36f3194a55 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.522198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e62507f-fcd0-47be-ab24-ce36f3194a55 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.523105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e62507f-fcd0-47be-ab24-ce36f3194a55 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.523684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e62507f-fcd0-47be-ab24-ce36f3194a55 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.528181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e62507f-fcd0-47be-ab24-ce36f3194a55 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.642390 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6e62507f-fcd0-47be-ab24-ce36f3194a55 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.138925 Sep 06 11:08:08.645954 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1986/3964] 10.222.0.20 () {58 vars in 1184 bytes} [Tue Sep 6 11:08:08 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 11:08:08.658755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:08.664143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:08.669421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Searching by: {'deleted': False, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:08:08.671713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.672314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.673461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.674288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.674905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.675923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.691061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a4318501-af88-415b-9844-86837be2cf71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:08.701968 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a4318501-af88-415b-9844-86837be2cf71 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1509 microversion: 2.1 time: 0.256788 Sep 06 11:08:08.702579 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1979/3965] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:08 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:08.713042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:08:08.751703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:08.762775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.763323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.763926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.816563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-94075683-2241-4dc5-8b85-1517609a5027 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:08.817283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-94075683-2241-4dc5-8b85-1517609a5027 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:08.837803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94075683-2241-4dc5-8b85-1517609a5027 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.845968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94075683-2241-4dc5-8b85-1517609a5027 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.845968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94075683-2241-4dc5-8b85-1517609a5027 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.845968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94075683-2241-4dc5-8b85-1517609a5027 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.845968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94075683-2241-4dc5-8b85-1517609a5027 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.845968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94075683-2241-4dc5-8b85-1517609a5027 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.929164 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-74b7b920-cf98-43fa-905f-219674a01f6f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.278308 Sep 06 11:08:08.929459 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1987/3966] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 11:08:08 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:08.934880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f605bb86-0d07-4230-99c4-09821b88a554 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:08.935700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f605bb86-0d07-4230-99c4-09821b88a554 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:08.942196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f605bb86-0d07-4230-99c4-09821b88a554 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.942909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f605bb86-0d07-4230-99c4-09821b88a554 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.943537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f605bb86-0d07-4230-99c4-09821b88a554 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.944427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f605bb86-0d07-4230-99c4-09821b88a554 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:08.945364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f605bb86-0d07-4230-99c4-09821b88a554 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:08.945960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f605bb86-0d07-4230-99c4-09821b88a554 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:08.968676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-94075683-2241-4dc5-8b85-1517609a5027 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:08.978200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-94075683-2241-4dc5-8b85-1517609a5027 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:08.979846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-94075683-2241-4dc5-8b85-1517609a5027 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:08.985845 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-94075683-2241-4dc5-8b85-1517609a5027 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.173599 Sep 06 11:08:08.986973 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1980/3967] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:08 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:08:09.006216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5cce80eb-b534-425c-81b7-c063108105eb tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:09.021870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5cce80eb-b534-425c-81b7-c063108105eb tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:09.024608 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5cce80eb-b534-425c-81b7-c063108105eb tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.031641 Sep 06 11:08:09.026097 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1981/3968] 10.222.0.20 () {58 vars in 1178 bytes} [Tue Sep 6 11:08:08 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:08:09.043361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e5f54925-3516-4d8a-841b-373597d096ec tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:09.055072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e5f54925-3516-4d8a-841b-373597d096ec tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:09.056700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e5f54925-3516-4d8a-841b-373597d096ec tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Searching by: {'deleted': False, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:08:09.062668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5f54925-3516-4d8a-841b-373597d096ec tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:09.063198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5f54925-3516-4d8a-841b-373597d096ec tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:09.063703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5f54925-3516-4d8a-841b-373597d096ec tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:09.064462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5f54925-3516-4d8a-841b-373597d096ec tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:09.064910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5f54925-3516-4d8a-841b-373597d096ec tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:09.065351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5f54925-3516-4d8a-841b-373597d096ec tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:09.097797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-e5f54925-3516-4d8a-841b-373597d096ec tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:08:09.131931 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e5f54925-3516-4d8a-841b-373597d096ec tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.096023 Sep 06 11:08:09.132801 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1982/3969] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 11:08:09 2022] GET /compute/v2.1/servers => generated 683 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:08:09.146990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81b5332b-bf32-4569-a9d1-e142258e0c90 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:09.147686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-81b5332b-bf32-4569-a9d1-e142258e0c90 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:09.156579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81b5332b-bf32-4569-a9d1-e142258e0c90 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:09.157255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81b5332b-bf32-4569-a9d1-e142258e0c90 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:09.157900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81b5332b-bf32-4569-a9d1-e142258e0c90 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:09.158766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81b5332b-bf32-4569-a9d1-e142258e0c90 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:09.159464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81b5332b-bf32-4569-a9d1-e142258e0c90 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:09.159971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81b5332b-bf32-4569-a9d1-e142258e0c90 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:09.161503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f605bb86-0d07-4230-99c4-09821b88a554 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:09.171069 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f605bb86-0d07-4230-99c4-09821b88a554 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1490 microversion: 2.1 time: 0.240362 Sep 06 11:08:09.171657 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1988/3970] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:08 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1490 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:09.175360 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-81b5332b-bf32-4569-a9d1-e142258e0c90 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] HTTP exception thrown: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81b5332b-bf32-4569-a9d1-e142258e0c90 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Request method failure captured: Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa HTTP/1.1 Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFynmZVM_AVNoOqYUccx5KUvFZKCJAysXxMbDG6-DuAO5gPEBLLFcZbOigCU_YXhXtSGkA2RJsNuSLiSOb3vC2pTZlh_hyhIDhbds50p-SWtVHdomPJFcq8P-2RXWA330Dp3eHdiTl-PmwjMLs78nZ5NRNKc6YxxJJVsMwO0plQ1gJGc Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}] Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 2b51397c5872403c86210c2dc7f85735 Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '52698341-5c8b-434b-82d4-5d35faf1b2fa'} Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:08:09.177079 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81b5332b-bf32-4569-a9d1-e142258e0c90 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Returning 404 to user: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-81b5332b-bf32-4569-a9d1-e142258e0c90 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 404 len: 111 microversion: 2.1 time: 0.035455 Sep 06 11:08:09.184232 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1983/3971] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:08:09 2022] DELETE /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:08:09.189034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c3a60a0c-60db-4e13-b77d-1d791aa31321 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:09.189540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c3a60a0c-60db-4e13-b77d-1d791aa31321 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:09.195594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3a60a0c-60db-4e13-b77d-1d791aa31321 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:09.199165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3a60a0c-60db-4e13-b77d-1d791aa31321 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:09.199165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3a60a0c-60db-4e13-b77d-1d791aa31321 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:09.199165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3a60a0c-60db-4e13-b77d-1d791aa31321 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:09.199165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3a60a0c-60db-4e13-b77d-1d791aa31321 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:09.199165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3a60a0c-60db-4e13-b77d-1d791aa31321 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:09.229434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c3a60a0c-60db-4e13-b77d-1d791aa31321 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:08:09.522388 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c3a60a0c-60db-4e13-b77d-1d791aa31321 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "DELETE /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6" status: 204 len: 0 microversion: 2.1 time: 0.338893 Sep 06 11:08:09.523101 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1989/3972] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:08:09 2022] DELETE /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:08:09.533948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-770480b6-06d6-4b61-b68d-90fb6f76c1b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:09.535919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-770480b6-06d6-4b61-b68d-90fb6f76c1b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:09.555604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-770480b6-06d6-4b61-b68d-90fb6f76c1b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:09.556946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-770480b6-06d6-4b61-b68d-90fb6f76c1b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:09.561203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-770480b6-06d6-4b61-b68d-90fb6f76c1b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:09.564015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-770480b6-06d6-4b61-b68d-90fb6f76c1b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:09.565031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-770480b6-06d6-4b61-b68d-90fb6f76c1b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:09.566013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-770480b6-06d6-4b61-b68d-90fb6f76c1b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:09.604099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-770480b6-06d6-4b61-b68d-90fb6f76c1b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:08:09.618791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:09.752114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-221fdee6-c8cb-4db1-afd7-bedb0c410d95 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:09.758275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-221fdee6-c8cb-4db1-afd7-bedb0c410d95 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:09.781320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-221fdee6-c8cb-4db1-afd7-bedb0c410d95 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:09.782520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-221fdee6-c8cb-4db1-afd7-bedb0c410d95 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:09.783659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-221fdee6-c8cb-4db1-afd7-bedb0c410d95 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:09.785537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-221fdee6-c8cb-4db1-afd7-bedb0c410d95 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:09.786875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-221fdee6-c8cb-4db1-afd7-bedb0c410d95 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:09.790261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-221fdee6-c8cb-4db1-afd7-bedb0c410d95 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:10.031357 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-770480b6-06d6-4b61-b68d-90fb6f76c1b2 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "DELETE /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 204 len: 0 microversion: 2.1 time: 0.503013 Sep 06 11:08:10.038414 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1984/3973] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:08:09 2022] DELETE /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:08:10.054951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ac4aaf49-c4ac-4992-aeaf-a62c81b51cd2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:10.058820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ac4aaf49-c4ac-4992-aeaf-a62c81b51cd2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:10.074785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac4aaf49-c4ac-4992-aeaf-a62c81b51cd2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:10.075616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac4aaf49-c4ac-4992-aeaf-a62c81b51cd2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:10.079215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac4aaf49-c4ac-4992-aeaf-a62c81b51cd2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:10.079992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac4aaf49-c4ac-4992-aeaf-a62c81b51cd2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:10.080647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac4aaf49-c4ac-4992-aeaf-a62c81b51cd2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:10.081253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac4aaf49-c4ac-4992-aeaf-a62c81b51cd2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:10.122809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-221fdee6-c8cb-4db1-afd7-bedb0c410d95 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:10.127439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:10.146142 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-221fdee6-c8cb-4db1-afd7-bedb0c410d95 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1509 microversion: 2.1 time: 0.398108 Sep 06 11:08:10.148278 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1990/3974] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:09 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1509 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:10.173928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93d87699-f9e6-4fa5-9fd2-ae0821df0d9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:10.180355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-93d87699-f9e6-4fa5-9fd2-ae0821df0d9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 52698341-5c8b-434b-82d4-5d35faf1b2fa] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:10.206527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93d87699-f9e6-4fa5-9fd2-ae0821df0d9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:10.213555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93d87699-f9e6-4fa5-9fd2-ae0821df0d9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:10.214578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93d87699-f9e6-4fa5-9fd2-ae0821df0d9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:10.216015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93d87699-f9e6-4fa5-9fd2-ae0821df0d9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:10.219918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93d87699-f9e6-4fa5-9fd2-ae0821df0d9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:10.220863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93d87699-f9e6-4fa5-9fd2-ae0821df0d9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:10.253444 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-93d87699-f9e6-4fa5-9fd2-ae0821df0d9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] HTTP exception thrown: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93d87699-f9e6-4fa5-9fd2-ae0821df0d9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Request method failure captured: Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa HTTP/1.1 Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFynmZVM_AVNoOqYUccx5KUvFZKCJAysXxMbDG6-DuAO5gPEBLLFcZbOigCU_YXhXtSGkA2RJsNuSLiSOb3vC2pTZlh_hyhIDhbds50p-SWtVHdomPJFcq8P-2RXWA330Dp3eHdiTl-PmwjMLs78nZ5NRNKc6YxxJJVsMwO0plQ1gJGc Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}] Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 2b51397c5872403c86210c2dc7f85735 Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '52698341-5c8b-434b-82d4-5d35faf1b2fa'} Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:10.256443 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:10.265512 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:10.265512 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:10.265512 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:10.265512 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:10.265512 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:08:10.265512 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:08:10.265512 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. Sep 06 11:08:10.265512 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:10.265512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93d87699-f9e6-4fa5-9fd2-ae0821df0d9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Returning 404 to user: Instance 52698341-5c8b-434b-82d4-5d35faf1b2fa could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:10.265512 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-93d87699-f9e6-4fa5-9fd2-ae0821df0d9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa" status: 404 len: 111 microversion: 2.1 time: 0.108951 Sep 06 11:08:10.272002 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1991/3975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:10 2022] GET /compute/v2.1/servers/52698341-5c8b-434b-82d4-5d35faf1b2fa => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:08:10.311331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c3285e9-1b91-4229-bdf3-2885e1f4af95 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:10.314738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1c3285e9-1b91-4229-bdf3-2885e1f4af95 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:10.318339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ac4aaf49-c4ac-4992-aeaf-a62c81b51cd2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:10.330397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c3285e9-1b91-4229-bdf3-2885e1f4af95 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:10.331976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c3285e9-1b91-4229-bdf3-2885e1f4af95 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:10.333053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c3285e9-1b91-4229-bdf3-2885e1f4af95 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:10.334621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c3285e9-1b91-4229-bdf3-2885e1f4af95 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:10.335664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c3285e9-1b91-4229-bdf3-2885e1f4af95 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:10.337841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c3285e9-1b91-4229-bdf3-2885e1f4af95 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:10.350739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ac4aaf49-c4ac-4992-aeaf-a62c81b51cd2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:10.353504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ac4aaf49-c4ac-4992-aeaf-a62c81b51cd2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:10.379223 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ac4aaf49-c4ac-4992-aeaf-a62c81b51cd2 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.338780 Sep 06 11:08:10.384291 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1985/3976] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:10 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:08:10.424542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f7521fb9-5f2e-4f22-b304-3b35d104085a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:10.431542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f7521fb9-5f2e-4f22-b304-3b35d104085a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:10.450141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7521fb9-5f2e-4f22-b304-3b35d104085a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:10.450886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7521fb9-5f2e-4f22-b304-3b35d104085a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:10.451484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7521fb9-5f2e-4f22-b304-3b35d104085a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:10.453946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7521fb9-5f2e-4f22-b304-3b35d104085a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:10.454546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7521fb9-5f2e-4f22-b304-3b35d104085a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:10.455139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f7521fb9-5f2e-4f22-b304-3b35d104085a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:10.810528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1c3285e9-1b91-4229-bdf3-2885e1f4af95 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:10.828415 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1c3285e9-1b91-4229-bdf3-2885e1f4af95 tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1490 microversion: 2.1 time: 0.551457 Sep 06 11:08:10.829382 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1992/3977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:10 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1490 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:10.838627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f7521fb9-5f2e-4f22-b304-3b35d104085a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:10.850545 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f7521fb9-5f2e-4f22-b304-3b35d104085a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6" status: 200 len: 1523 microversion: 2.1 time: 0.464574 Sep 06 11:08:10.852919 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1986/3978] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:10 2022] GET /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 => generated 1523 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:11.173057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dd21e4e8-5616-4d88-82ce-dd13d64f838c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:11.174350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dd21e4e8-5616-4d88-82ce-dd13d64f838c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:11.184460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd21e4e8-5616-4d88-82ce-dd13d64f838c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:11.185271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd21e4e8-5616-4d88-82ce-dd13d64f838c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:11.185851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd21e4e8-5616-4d88-82ce-dd13d64f838c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:11.186601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd21e4e8-5616-4d88-82ce-dd13d64f838c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:11.187097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd21e4e8-5616-4d88-82ce-dd13d64f838c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:11.193427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd21e4e8-5616-4d88-82ce-dd13d64f838c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:11.351799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dd21e4e8-5616-4d88-82ce-dd13d64f838c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:11.365564 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dd21e4e8-5616-4d88-82ce-dd13d64f838c tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1509 microversion: 2.1 time: 0.192639 Sep 06 11:08:11.365564 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1993/3979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:11 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:11.432183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-50789fe6-4397-44bd-9ad0-7d956fb5a942 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:11.437484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-50789fe6-4397-44bd-9ad0-7d956fb5a942 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:11.449867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50789fe6-4397-44bd-9ad0-7d956fb5a942 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:11.450429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50789fe6-4397-44bd-9ad0-7d956fb5a942 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:11.458310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50789fe6-4397-44bd-9ad0-7d956fb5a942 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:11.458310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50789fe6-4397-44bd-9ad0-7d956fb5a942 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:11.458310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50789fe6-4397-44bd-9ad0-7d956fb5a942 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:11.458310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50789fe6-4397-44bd-9ad0-7d956fb5a942 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:11.696316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-50789fe6-4397-44bd-9ad0-7d956fb5a942 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:11.732748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-50789fe6-4397-44bd-9ad0-7d956fb5a942 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:11.749480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-50789fe6-4397-44bd-9ad0-7d956fb5a942 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:11.763351 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-50789fe6-4397-44bd-9ad0-7d956fb5a942 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1544 microversion: 2.91 time: 0.333587 Sep 06 11:08:11.768604 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1987/3980] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:11 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1544 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:08:11.864750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ca18dc7-1d2b-4783-bb1c-64e029ff39ac tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:11.866060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ca18dc7-1d2b-4783-bb1c-64e029ff39ac tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:11.894361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eed650f4-948c-4bc3-8359-db1c8ecdaf5a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:11.896265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eed650f4-948c-4bc3-8359-db1c8ecdaf5a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:11.921223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca18dc7-1d2b-4783-bb1c-64e029ff39ac tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:11.921823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca18dc7-1d2b-4783-bb1c-64e029ff39ac tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:11.922292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca18dc7-1d2b-4783-bb1c-64e029ff39ac tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:11.923080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca18dc7-1d2b-4783-bb1c-64e029ff39ac tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:11.924810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eed650f4-948c-4bc3-8359-db1c8ecdaf5a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:11.928636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eed650f4-948c-4bc3-8359-db1c8ecdaf5a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:11.935286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eed650f4-948c-4bc3-8359-db1c8ecdaf5a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:11.935491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca18dc7-1d2b-4783-bb1c-64e029ff39ac tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:11.935614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eed650f4-948c-4bc3-8359-db1c8ecdaf5a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:11.935614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eed650f4-948c-4bc3-8359-db1c8ecdaf5a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:11.935614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eed650f4-948c-4bc3-8359-db1c8ecdaf5a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:11.935859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca18dc7-1d2b-4783-bb1c-64e029ff39ac tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:12.379294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ca18dc7-1d2b-4783-bb1c-64e029ff39ac tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:12.398479 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ca18dc7-1d2b-4783-bb1c-64e029ff39ac tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1490 microversion: 2.1 time: 0.536511 Sep 06 11:08:12.421834 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1994/3981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:11 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1490 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:12.439095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b67177be-63da-4cd7-8963-6f7a151580cf req-4de70799-5e92-4c6e-8884-78b981571ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88e39d8-efc0-43bd-9160-a5402a494295", "name": "network-vif-unplugged", "status": "completed", "tag": "00e489af-a594-4794-acf5-75217d6ef056"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:12.453722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b67177be-63da-4cd7-8963-6f7a151580cf req-4de70799-5e92-4c6e-8884-78b981571ce5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:12.454562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b67177be-63da-4cd7-8963-6f7a151580cf req-4de70799-5e92-4c6e-8884-78b981571ce5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:12.455092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b67177be-63da-4cd7-8963-6f7a151580cf req-4de70799-5e92-4c6e-8884-78b981571ce5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:12.473070 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b67177be-63da-4cd7-8963-6f7a151580cf req-4de70799-5e92-4c6e-8884-78b981571ce5 service nova] Creating event network-vif-unplugged:00e489af-a594-4794-acf5-75217d6ef056 for instance c88e39d8-efc0-43bd-9160-a5402a494295 on nch1-master-1 Sep 06 11:08:12.479052 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b67177be-63da-4cd7-8963-6f7a151580cf req-4de70799-5e92-4c6e-8884-78b981571ce5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053167 Sep 06 11:08:12.480485 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1995/3982] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:08:12.488292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5da57d58-9705-4d36-bb29-e07c7152196f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:12.489313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5da57d58-9705-4d36-bb29-e07c7152196f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:12.500877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5da57d58-9705-4d36-bb29-e07c7152196f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:12.502315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5da57d58-9705-4d36-bb29-e07c7152196f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:12.503395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5da57d58-9705-4d36-bb29-e07c7152196f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:12.504992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5da57d58-9705-4d36-bb29-e07c7152196f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:12.506094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5da57d58-9705-4d36-bb29-e07c7152196f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:12.507885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5da57d58-9705-4d36-bb29-e07c7152196f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:12.853878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eed650f4-948c-4bc3-8359-db1c8ecdaf5a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:12.906914 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eed650f4-948c-4bc3-8359-db1c8ecdaf5a tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6" status: 200 len: 1523 microversion: 2.1 time: 1.017846 Sep 06 11:08:12.912079 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1988/3983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:11 2022] GET /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 => generated 1523 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:12.948641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3427f636-963a-4943-8cc5-71265a8fbc94 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:12.949804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3427f636-963a-4943-8cc5-71265a8fbc94 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:13.012456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3427f636-963a-4943-8cc5-71265a8fbc94 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:13.015617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3427f636-963a-4943-8cc5-71265a8fbc94 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:13.015617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3427f636-963a-4943-8cc5-71265a8fbc94 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:13.034398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3427f636-963a-4943-8cc5-71265a8fbc94 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:13.034969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3427f636-963a-4943-8cc5-71265a8fbc94 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:13.041104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3427f636-963a-4943-8cc5-71265a8fbc94 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:13.410011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5da57d58-9705-4d36-bb29-e07c7152196f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:13.427768 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5da57d58-9705-4d36-bb29-e07c7152196f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1509 microversion: 2.1 time: 0.945621 Sep 06 11:08:13.431899 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1996/3984] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:12 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1509 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:13.456093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-2fa637e7-69bb-4e41-8bd4-ef2309a4a026 req-54665484-7edb-45bc-8699-e452a28d5ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18170fa5-02fe-4fcb-8bfc-90e7223ea0f6", "name": "network-vif-deleted", "tag": "b25adc4b-2f95-4609-afb0-171ed181d753"}, {"server_uuid": "c4d118b2-ff1f-4582-857b-f44decc2d05b", "name": "network-vif-deleted", "tag": "808efaee-c13b-4a8c-8b64-7e38b370aa4b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:13.469325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2fa637e7-69bb-4e41-8bd4-ef2309a4a026 req-54665484-7edb-45bc-8699-e452a28d5ec6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:13.470071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2fa637e7-69bb-4e41-8bd4-ef2309a4a026 req-54665484-7edb-45bc-8699-e452a28d5ec6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:13.472548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2fa637e7-69bb-4e41-8bd4-ef2309a4a026 req-54665484-7edb-45bc-8699-e452a28d5ec6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:13.510378 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-2fa637e7-69bb-4e41-8bd4-ef2309a4a026 req-54665484-7edb-45bc-8699-e452a28d5ec6 service nova] Creating event network-vif-deleted:b25adc4b-2f95-4609-afb0-171ed181d753 for instance 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 on nch1-master-1 Sep 06 11:08:13.511186 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-2fa637e7-69bb-4e41-8bd4-ef2309a4a026 req-54665484-7edb-45bc-8699-e452a28d5ec6 service nova] Creating event network-vif-deleted:808efaee-c13b-4a8c-8b64-7e38b370aa4b for instance c4d118b2-ff1f-4582-857b-f44decc2d05b on nch1-master-1 Sep 06 11:08:13.519921 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-2fa637e7-69bb-4e41-8bd4-ef2309a4a026 req-54665484-7edb-45bc-8699-e452a28d5ec6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074214 Sep 06 11:08:13.521812 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1997/3985] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:08:13.534983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:13.536610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:13.547259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:13.548225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:13.548907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:13.549803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:13.550413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:13.551157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:13.582712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3427f636-963a-4943-8cc5-71265a8fbc94 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:13.598856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3427f636-963a-4943-8cc5-71265a8fbc94 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:13.600998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3427f636-963a-4943-8cc5-71265a8fbc94 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:13.617124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:13.620522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:13.622020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:13.623222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'fault' on Instance uuid c4d118b2-ff1f-4582-857b-f44decc2d05b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:13.625367 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3427f636-963a-4943-8cc5-71265a8fbc94 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1531 microversion: 2.91 time: 0.709000 Sep 06 11:08:13.625991 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1989/3986] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:12 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1531 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:08:13.662067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c7e7171b-f5b5-4ec3-9cc7-36aae6368081 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:13.662927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c7e7171b-f5b5-4ec3-9cc7-36aae6368081 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:13.684886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e7171b-f5b5-4ec3-9cc7-36aae6368081 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:13.699809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e7171b-f5b5-4ec3-9cc7-36aae6368081 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:13.699809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e7171b-f5b5-4ec3-9cc7-36aae6368081 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:13.700383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e7171b-f5b5-4ec3-9cc7-36aae6368081 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:13.701092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e7171b-f5b5-4ec3-9cc7-36aae6368081 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:13.701688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e7171b-f5b5-4ec3-9cc7-36aae6368081 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:13.831942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:13.858726 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3c79d756-caf1-49b7-a5e5-b29e40c9942e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1303 microversion: 2.1 time: 0.335469 Sep 06 11:08:13.860177 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1998/3987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:13 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1303 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:13.938283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:13.939398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:13.956226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:13.956944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:13.959342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:13.959342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:13.959342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:13.960338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:14.058500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:14.062388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:14.066267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-c7e7171b-f5b5-4ec3-9cc7-36aae6368081 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] Lazy-loading 'services' on Instance uuid 16d64eaf-0686-4d18-8b21-1eb52f4cda77 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:14.069996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:14.072810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:14.141427 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c7e7171b-f5b5-4ec3-9cc7-36aae6368081 tempest-UnshelveToHostMultiNodesTest-472366281 tempest-UnshelveToHostMultiNodesTest-472366281-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1936 microversion: 2.91 time: 0.483282 Sep 06 11:08:14.145233 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1990/3988] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:13 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1936 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:08:14.158562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-3a9a04f2-783d-49d1-bd2d-8fa08ea326e3 req-d5ad1128-383d-4a97-a18d-9d5f1107dec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88e39d8-efc0-43bd-9160-a5402a494295", "name": "network-vif-deleted", "tag": "00e489af-a594-4794-acf5-75217d6ef056"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:14.214961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3a9a04f2-783d-49d1-bd2d-8fa08ea326e3 req-d5ad1128-383d-4a97-a18d-9d5f1107dec9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:14.215882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3a9a04f2-783d-49d1-bd2d-8fa08ea326e3 req-d5ad1128-383d-4a97-a18d-9d5f1107dec9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:14.217499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3a9a04f2-783d-49d1-bd2d-8fa08ea326e3 req-d5ad1128-383d-4a97-a18d-9d5f1107dec9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:14.247690 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-3a9a04f2-783d-49d1-bd2d-8fa08ea326e3 req-d5ad1128-383d-4a97-a18d-9d5f1107dec9 service nova] Creating event network-vif-deleted:00e489af-a594-4794-acf5-75217d6ef056 for instance c88e39d8-efc0-43bd-9160-a5402a494295 on nch1-master-1 Sep 06 11:08:14.265411 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-3a9a04f2-783d-49d1-bd2d-8fa08ea326e3 req-d5ad1128-383d-4a97-a18d-9d5f1107dec9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110977 Sep 06 11:08:14.268436 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1991/3989] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:08:14.274733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0a1f9317-232e-4034-8f6b-78d1dd16405f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:14.282651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0a1f9317-232e-4034-8f6b-78d1dd16405f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:14.299033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a1f9317-232e-4034-8f6b-78d1dd16405f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:14.299901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a1f9317-232e-4034-8f6b-78d1dd16405f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:14.300387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a1f9317-232e-4034-8f6b-78d1dd16405f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:14.301592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:14.302358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a1f9317-232e-4034-8f6b-78d1dd16405f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:14.304308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a1f9317-232e-4034-8f6b-78d1dd16405f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:14.304884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a1f9317-232e-4034-8f6b-78d1dd16405f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:14.352505 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-989e07ae-0577-4334-902b-2d59be24bc63 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6" status: 200 len: 1313 microversion: 2.1 time: 0.418951 Sep 06 11:08:14.356134 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 1999/3990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:13 2022] GET /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:14.410956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0a1f9317-232e-4034-8f6b-78d1dd16405f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:08:14.458807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:14.460099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:14.473608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:14.475514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:14.484811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:14.487513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:14.493950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:14.494755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:14.615566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:14.615566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:14.615566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:14.616259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid c88e39d8-efc0-43bd-9160-a5402a494295 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:14.692836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:14.709965 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9b04d154-c8cb-4725-8d7f-0c47b7dd5b11 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1305 microversion: 2.1 time: 0.256612 Sep 06 11:08:14.710709 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2000/3991] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:14 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1305 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:14.884463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:14.886109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:14.898087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:14.898876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:14.899471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:14.900445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:14.901368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:14.902066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:14.943959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:14.944235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:14.944500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:14.945032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lazy-loading 'fault' on Instance uuid c4d118b2-ff1f-4582-857b-f44decc2d05b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:15.005579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bce0861528a4891b94d174e964456f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:15.014752 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d5056b76-e942-47d6-b38b-1c37b07b7eca tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 200 len: 1303 microversion: 2.1 time: 0.134383 Sep 06 11:08:15.015407 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2001/3992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:14 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:15.231554 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0a1f9317-232e-4034-8f6b-78d1dd16405f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 204 len: 0 microversion: 2.91 time: 0.960824 Sep 06 11:08:15.232961 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1992/3993] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:08:14 2022] DELETE /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 0 bytes in 964 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:08:15.241982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9fec6665-d367-495b-b435-d043825a6d6f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:15.243258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9fec6665-d367-495b-b435-d043825a6d6f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:15.249451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fec6665-d367-495b-b435-d043825a6d6f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:15.249970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fec6665-d367-495b-b435-d043825a6d6f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:15.251334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fec6665-d367-495b-b435-d043825a6d6f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:15.252253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fec6665-d367-495b-b435-d043825a6d6f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:15.252772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fec6665-d367-495b-b435-d043825a6d6f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:15.253227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9fec6665-d367-495b-b435-d043825a6d6f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:15.401210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:15.401210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:15.406184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:15.406695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:15.407175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:15.407899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:15.408364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:15.408804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:15.419406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9fec6665-d367-495b-b435-d043825a6d6f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:15.439057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9fec6665-d367-495b-b435-d043825a6d6f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:15.448192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9fec6665-d367-495b-b435-d043825a6d6f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:15.457998 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9fec6665-d367-495b-b435-d043825a6d6f tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.220546 Sep 06 11:08:15.471043 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2002/3994] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:15 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:08:15.534475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:15.536113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:15.538672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:15.540211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:15.656041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:15.663451 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6c402627-8bbd-4b69-96fe-6b6ed0a09e46 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6" status: 200 len: 1313 microversion: 2.1 time: 0.274548 Sep 06 11:08:15.664046 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1993/3995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:15 2022] GET /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:15.738319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:15.739597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:15.760318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:15.763199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:15.763683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:15.764466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:15.765696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:15.766905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:15.849118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:15.850110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:15.853323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:15.854073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid c88e39d8-efc0-43bd-9160-a5402a494295 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:16.040525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2003cb93-8be5-4536-8f2f-d7263774245e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:16.042937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2003cb93-8be5-4536-8f2f-d7263774245e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] [instance: c4d118b2-ff1f-4582-857b-f44decc2d05b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:16.062448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2003cb93-8be5-4536-8f2f-d7263774245e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:16.066720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2003cb93-8be5-4536-8f2f-d7263774245e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:16.067258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2003cb93-8be5-4536-8f2f-d7263774245e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:16.068033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2003cb93-8be5-4536-8f2f-d7263774245e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:16.068497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2003cb93-8be5-4536-8f2f-d7263774245e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:16.069033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2003cb93-8be5-4536-8f2f-d7263774245e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:16.091536 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-2003cb93-8be5-4536-8f2f-d7263774245e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] HTTP exception thrown: Instance c4d118b2-ff1f-4582-857b-f44decc2d05b could not be found. Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2003cb93-8be5-4536-8f2f-d7263774245e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Request method failure captured: Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b HTTP/1.1 Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFymQFf_Q-RVNXq0Js72U49OBKrsHRpx9vRkOS5Vx5uWzkWSovCm78m1w8SwO7nQePeE4l_Wfdtx7i7OZNY3l0deXQTqYDJ6C33Db8PZsCYpnlW8DBz4jqtHnSd6p3Z8v1t8bN91vxf0TDHQt0HB-FSEPgYW7UYVAbsf3CDDLgWsWYx4 Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3bce0861528a4891b94d174e964456f0 Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerRescueTestJSON-1088994803 Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3bce0861528a4891b94d174e964456f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3bce0861528a4891b94d174e964456f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3bce0861528a4891b94d174e964456f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3bce0861528a4891b94d174e964456f0"}]}] Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerRescueTestJSON-1088994803 Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3bce0861528a4891b94d174e964456f0 Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerRescueTestJSON-1088994803 Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerRescueTestJSON-1088994803-project Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e94103c4c75b4f2d8b2cb1bd4b6bcf6a Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerRescueTestJSON-1088994803-project Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance c4d118b2-ff1f-4582-857b-f44decc2d05b could not be found. Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'c4d118b2-ff1f-4582-857b-f44decc2d05b'} Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d118b2-ff1f-4582-857b-f44decc2d05b could not be found. Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d118b2-ff1f-4582-857b-f44decc2d05b could not be found. Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:16.094879 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:16.099032 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:16.099032 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:16.099032 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:16.099032 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:08:16.099032 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:08:16.099032 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d118b2-ff1f-4582-857b-f44decc2d05b could not be found. Sep 06 11:08:16.099032 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:16.101261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2003cb93-8be5-4536-8f2f-d7263774245e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] Returning 404 to user: Instance c4d118b2-ff1f-4582-857b-f44decc2d05b could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:16.101261 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2003cb93-8be5-4536-8f2f-d7263774245e tempest-ServerRescueTestJSON-1088994803 tempest-ServerRescueTestJSON-1088994803-project] 10.222.0.20 "GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b" status: 404 len: 111 microversion: 2.1 time: 0.066938 Sep 06 11:08:16.103331 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1994/3996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:16 2022] GET /compute/v2.1/servers/c4d118b2-ff1f-4582-857b-f44decc2d05b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:08:16.205806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:16.225405 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c0030013-9d83-4f52-a60e-68509efcdcd4 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 200 len: 1305 microversion: 2.1 time: 0.490932 Sep 06 11:08:16.242413 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2003/3997] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:15 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 1305 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:16.306674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-72ff4e17-0f5c-4a4f-86b4-4584fc7029cd req-85167f2d-c8f9-4123-aafe-16fdfbb12cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "350357dd-33e7-47c7-8552-f7b07b29ce83", "name": "network-vif-deleted", "tag": "8f24e839-3595-4d73-99ef-c5d9a014ebbd"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:16.362974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-72ff4e17-0f5c-4a4f-86b4-4584fc7029cd req-85167f2d-c8f9-4123-aafe-16fdfbb12cad service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:16.363509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-72ff4e17-0f5c-4a4f-86b4-4584fc7029cd req-85167f2d-c8f9-4123-aafe-16fdfbb12cad service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:16.363962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-72ff4e17-0f5c-4a4f-86b4-4584fc7029cd req-85167f2d-c8f9-4123-aafe-16fdfbb12cad service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:16.417669 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-72ff4e17-0f5c-4a4f-86b4-4584fc7029cd req-85167f2d-c8f9-4123-aafe-16fdfbb12cad service nova] Creating event network-vif-deleted:8f24e839-3595-4d73-99ef-c5d9a014ebbd for instance 350357dd-33e7-47c7-8552-f7b07b29ce83 on nch2-master-1 Sep 06 11:08:16.447754 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-72ff4e17-0f5c-4a4f-86b4-4584fc7029cd req-85167f2d-c8f9-4123-aafe-16fdfbb12cad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142385 Sep 06 11:08:16.449245 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1995/3998] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:08:16.490885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f9b3c7b4-2ff2-47bd-8edd-69b36bb68315 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:16.491606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f9b3c7b4-2ff2-47bd-8edd-69b36bb68315 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:16.516723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9b3c7b4-2ff2-47bd-8edd-69b36bb68315 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:16.520853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9b3c7b4-2ff2-47bd-8edd-69b36bb68315 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:16.522097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9b3c7b4-2ff2-47bd-8edd-69b36bb68315 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:16.523161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9b3c7b4-2ff2-47bd-8edd-69b36bb68315 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:16.524509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9b3c7b4-2ff2-47bd-8edd-69b36bb68315 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:16.525219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9b3c7b4-2ff2-47bd-8edd-69b36bb68315 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:16.615881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f9b3c7b4-2ff2-47bd-8edd-69b36bb68315 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:16.628758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f9b3c7b4-2ff2-47bd-8edd-69b36bb68315 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:16.630255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f9b3c7b4-2ff2-47bd-8edd-69b36bb68315 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:16.638110 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f9b3c7b4-2ff2-47bd-8edd-69b36bb68315 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.152052 Sep 06 11:08:16.638737 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2004/3999] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:16 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:08:16.693487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0961dfcb-c864-468b-9215-d5d37a8ece9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:16.696464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0961dfcb-c864-468b-9215-d5d37a8ece9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:16.704209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0961dfcb-c864-468b-9215-d5d37a8ece9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:16.705660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0961dfcb-c864-468b-9215-d5d37a8ece9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:16.706485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0961dfcb-c864-468b-9215-d5d37a8ece9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:16.709980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0961dfcb-c864-468b-9215-d5d37a8ece9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:16.710693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0961dfcb-c864-468b-9215-d5d37a8ece9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:16.711424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0961dfcb-c864-468b-9215-d5d37a8ece9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:16.739153 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-0961dfcb-c864-468b-9215-d5d37a8ece9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] HTTP exception thrown: Instance 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 could not be found. Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0961dfcb-c864-468b-9215-d5d37a8ece9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Request method failure captured: Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 HTTP/1.1 Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFynmZVM_AVNoOqYUccx5KUvFZKCJAysXxMbDG6-DuAO5gPEBLLFcZbOigCU_YXhXtSGkA2RJsNuSLiSOb3vC2pTZlh_hyhIDhbds50p-SWtVHdomPJFcq8P-2RXWA330Dp3eHdiTl-PmwjMLs78nZ5NRNKc6YxxJJVsMwO0plQ1gJGc Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}] Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 2b51397c5872403c86210c2dc7f85735 Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 could not be found. Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '18170fa5-02fe-4fcb-8bfc-90e7223ea0f6'} Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 could not be found. Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 could not be found. Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:16.743950 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:16.748161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:16.748161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:16.748161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:16.748161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:16.748161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:08:16.748161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:08:16.748161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 could not be found. Sep 06 11:08:16.748161 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:16.750401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0961dfcb-c864-468b-9215-d5d37a8ece9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Returning 404 to user: Instance 18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:16.751865 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0961dfcb-c864-468b-9215-d5d37a8ece9f tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6" status: 404 len: 111 microversion: 2.1 time: 0.063944 Sep 06 11:08:16.755456 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1996/4000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:16 2022] GET /compute/v2.1/servers/18170fa5-02fe-4fcb-8bfc-90e7223ea0f6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:08:16.762533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:16.763487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:16.772053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:16.774255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:16.775120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:16.776447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:16.778086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:16.778796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:16.779429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:16.825683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:16.826433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:16.827229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:16.830271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lazy-loading 'fault' on Instance uuid 350357dd-33e7-47c7-8552-f7b07b29ce83 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:16.898312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51397c5872403c86210c2dc7f85735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f1118744894767a4ab5c9bddc8e5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:16.908974 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7ff86495-e0df-41ae-b085-3e67f5ed22bf tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 200 len: 1313 microversion: 2.1 time: 0.151343 Sep 06 11:08:16.927467 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2005/4001] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:16 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:17.263971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-68c15d20-36e1-438e-b65f-1dd1c21609ed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:17.264927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-68c15d20-36e1-438e-b65f-1dd1c21609ed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: c88e39d8-efc0-43bd-9160-a5402a494295] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:17.282433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68c15d20-36e1-438e-b65f-1dd1c21609ed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:17.288083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68c15d20-36e1-438e-b65f-1dd1c21609ed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:17.290094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68c15d20-36e1-438e-b65f-1dd1c21609ed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:17.293436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68c15d20-36e1-438e-b65f-1dd1c21609ed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:17.294370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68c15d20-36e1-438e-b65f-1dd1c21609ed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:17.295569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68c15d20-36e1-438e-b65f-1dd1c21609ed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:17.318302 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-68c15d20-36e1-438e-b65f-1dd1c21609ed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] HTTP exception thrown: Instance c88e39d8-efc0-43bd-9160-a5402a494295 could not be found. Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-68c15d20-36e1-438e-b65f-1dd1c21609ed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Request method failure captured: Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 HTTP/1.1 Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyg2U48D630rtP93KctSUB55frBucaLCwvXam7s5D6muRGgpAdGYpf_Jd02qO6Wv-yScWLiyAR1qNAYbE0W-SGR2eaGszOp1OPVLx8OvqN3f_pV8xU0pTYMSFjaPG0NSAitsz90vg6hPWxi5nbHOISf77di5fAInBJEzZCthjFzILpY Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: dcd5ffec2c6246fb89ba181542692585 Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerActionsTestJSON-562575329 Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcd5ffec2c6246fb89ba181542692585"}]}] Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerActionsTestJSON-562575329 Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: dcd5ffec2c6246fb89ba181542692585 Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerActionsTestJSON-562575329 Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerActionsTestJSON-562575329-project Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: f16abbf8a68344b68444ff8fc2795c67 Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerActionsTestJSON-562575329-project Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance c88e39d8-efc0-43bd-9160-a5402a494295 could not be found. Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'c88e39d8-efc0-43bd-9160-a5402a494295'} Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c88e39d8-efc0-43bd-9160-a5402a494295 could not be found. Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c88e39d8-efc0-43bd-9160-a5402a494295 could not be found. Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:17.326193 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:17.334459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:17.334459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:17.334459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:17.334459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:08:17.334459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:08:17.334459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c88e39d8-efc0-43bd-9160-a5402a494295 could not be found. Sep 06 11:08:17.334459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:17.334459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-68c15d20-36e1-438e-b65f-1dd1c21609ed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Returning 404 to user: Instance c88e39d8-efc0-43bd-9160-a5402a494295 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:17.334459 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-68c15d20-36e1-438e-b65f-1dd1c21609ed tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295" status: 404 len: 111 microversion: 2.1 time: 0.083385 Sep 06 11:08:17.335530 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1997/4002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:17 2022] GET /compute/v2.1/servers/c88e39d8-efc0-43bd-9160-a5402a494295 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:08:17.346712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5694865a-b51e-4f16-8c1d-30a8931f2960 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:17.347542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5694865a-b51e-4f16-8c1d-30a8931f2960 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:17.365424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5694865a-b51e-4f16-8c1d-30a8931f2960 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:17.366687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5694865a-b51e-4f16-8c1d-30a8931f2960 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:17.367197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5694865a-b51e-4f16-8c1d-30a8931f2960 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:17.371677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5694865a-b51e-4f16-8c1d-30a8931f2960 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:17.375351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5694865a-b51e-4f16-8c1d-30a8931f2960 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:17.378368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5694865a-b51e-4f16-8c1d-30a8931f2960 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:17.414537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5694865a-b51e-4f16-8c1d-30a8931f2960 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:08:17.454528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:17.670780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c1641ae4-8503-48d1-936e-1fc132aae1f1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:17.671650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c1641ae4-8503-48d1-936e-1fc132aae1f1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:17.688792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1641ae4-8503-48d1-936e-1fc132aae1f1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:17.689320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1641ae4-8503-48d1-936e-1fc132aae1f1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:17.690017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1641ae4-8503-48d1-936e-1fc132aae1f1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:17.690928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1641ae4-8503-48d1-936e-1fc132aae1f1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:17.693101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1641ae4-8503-48d1-936e-1fc132aae1f1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:17.693757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1641ae4-8503-48d1-936e-1fc132aae1f1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:17.783838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c1641ae4-8503-48d1-936e-1fc132aae1f1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:17.795404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c1641ae4-8503-48d1-936e-1fc132aae1f1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:17.797855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c1641ae4-8503-48d1-936e-1fc132aae1f1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:17.806202 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c1641ae4-8503-48d1-936e-1fc132aae1f1 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1537 microversion: 2.91 time: 0.141030 Sep 06 11:08:17.822562 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1998/4003] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:17 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1537 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:08:17.943972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3963b1af-5294-4adc-ace3-e4f246889f04 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:17.944972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3963b1af-5294-4adc-ace3-e4f246889f04 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] [instance: 350357dd-33e7-47c7-8552-f7b07b29ce83] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:17.964814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3963b1af-5294-4adc-ace3-e4f246889f04 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:17.966861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3963b1af-5294-4adc-ace3-e4f246889f04 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:17.967617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3963b1af-5294-4adc-ace3-e4f246889f04 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:17.973138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3963b1af-5294-4adc-ace3-e4f246889f04 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:17.973736 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5694865a-b51e-4f16-8c1d-30a8931f2960 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "DELETE /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 204 len: 0 microversion: 2.1 time: 0.633129 Sep 06 11:08:17.977252 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2006/4004] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:08:17 2022] DELETE /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:08:17.977397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3963b1af-5294-4adc-ace3-e4f246889f04 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:17.977397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3963b1af-5294-4adc-ace3-e4f246889f04 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:17.986361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2adb54a1-995f-4799-8b54-3312608a1bc7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:17.987875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2adb54a1-995f-4799-8b54-3312608a1bc7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:18.003938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2adb54a1-995f-4799-8b54-3312608a1bc7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:18.005359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2adb54a1-995f-4799-8b54-3312608a1bc7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:18.006637 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-3963b1af-5294-4adc-ace3-e4f246889f04 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] HTTP exception thrown: Instance 350357dd-33e7-47c7-8552-f7b07b29ce83 could not be found. Sep 06 11:08:18.009795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2adb54a1-995f-4799-8b54-3312608a1bc7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:18.011204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2adb54a1-995f-4799-8b54-3312608a1bc7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3963b1af-5294-4adc-ace3-e4f246889f04 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Request method failure captured: Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 HTTP/1.1 Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFynmZVM_AVNoOqYUccx5KUvFZKCJAysXxMbDG6-DuAO5gPEBLLFcZbOigCU_YXhXtSGkA2RJsNuSLiSOb3vC2pTZlh_hyhIDhbds50p-SWtVHdomPJFcq8P-2RXWA330Dp3eHdiTl-PmwjMLs78nZ5NRNKc6YxxJJVsMwO0plQ1gJGc Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e2f1118744894767a4ab5c9bddc8e5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2f1118744894767a4ab5c9bddc8e5fb"}]}] Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e2f1118744894767a4ab5c9bddc8e5fb Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1891390276 Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 2b51397c5872403c86210c2dc7f85735 Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ListServersNegativeTestJSON-1891390276-project Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 350357dd-33e7-47c7-8552-f7b07b29ce83 could not be found. Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '350357dd-33e7-47c7-8552-f7b07b29ce83'} Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 350357dd-33e7-47c7-8552-f7b07b29ce83 could not be found. Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 350357dd-33e7-47c7-8552-f7b07b29ce83 could not be found. Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:18.011573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:18.017007 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:18.017007 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:18.017007 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:18.017007 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:18.017007 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:08:18.017007 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:08:18.017007 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 350357dd-33e7-47c7-8552-f7b07b29ce83 could not be found. Sep 06 11:08:18.017007 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:08:18.017617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2adb54a1-995f-4799-8b54-3312608a1bc7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:18.017617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2adb54a1-995f-4799-8b54-3312608a1bc7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:18.021720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3963b1af-5294-4adc-ace3-e4f246889f04 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] Returning 404 to user: Instance 350357dd-33e7-47c7-8552-f7b07b29ce83 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:18.030511 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3963b1af-5294-4adc-ace3-e4f246889f04 tempest-ListServersNegativeTestJSON-1891390276 tempest-ListServersNegativeTestJSON-1891390276-project] 10.222.0.20 "GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83" status: 404 len: 111 microversion: 2.1 time: 0.089672 Sep 06 11:08:18.032207 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 1999/4005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:17 2022] GET /compute/v2.1/servers/350357dd-33e7-47c7-8552-f7b07b29ce83 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:08:18.635919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2adb54a1-995f-4799-8b54-3312608a1bc7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:18.644791 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2adb54a1-995f-4799-8b54-3312608a1bc7 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1495 microversion: 2.1 time: 0.665584 Sep 06 11:08:18.648261 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2007/4006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:17 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1495 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:18.838237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:18.839605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:18.874957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:18.876537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:18.879667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:18.883520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:18.894207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:18.895458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:19.010589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:19.011264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:19.012018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:19.012751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lazy-loading 'fault' on Instance uuid 16d64eaf-0686-4d18-8b21-1eb52f4cda77 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:19.071703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:19.160380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:19.181247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:19.183133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87109fdea86d40f38dc8dbeb664b9e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53043c49bd5c4591bbfc72c443cf66ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:19.194365 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-51a07d31-8525-4c0d-a892-0aa63a539ae4 tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 200 len: 1542 microversion: 2.91 time: 0.363820 Sep 06 11:08:19.208126 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2000/4007] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:18 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 1542 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:08:19.451351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:19.453911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:19.675986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-57a87564-2e71-4171-8990-5d02cbfc72df tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:19.676606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-57a87564-2e71-4171-8990-5d02cbfc72df tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:19.686479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57a87564-2e71-4171-8990-5d02cbfc72df tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:19.686991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57a87564-2e71-4171-8990-5d02cbfc72df tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:19.699457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57a87564-2e71-4171-8990-5d02cbfc72df tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:19.700255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57a87564-2e71-4171-8990-5d02cbfc72df tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:19.700752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57a87564-2e71-4171-8990-5d02cbfc72df tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:19.701204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57a87564-2e71-4171-8990-5d02cbfc72df tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:19.810126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:19.860471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f7ed0ce3-d019-497f-8944-78861f5aa0df tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:19.862890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f7ed0ce3-d019-497f-8944-78861f5aa0df tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:19.889518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7ed0ce3-d019-497f-8944-78861f5aa0df tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:19.892584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7ed0ce3-d019-497f-8944-78861f5aa0df tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:19.892584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7ed0ce3-d019-497f-8944-78861f5aa0df tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:19.899121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7ed0ce3-d019-497f-8944-78861f5aa0df tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:19.900134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7ed0ce3-d019-497f-8944-78861f5aa0df tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:19.900797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7ed0ce3-d019-497f-8944-78861f5aa0df tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:20.033650 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f7ed0ce3-d019-497f-8944-78861f5aa0df tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "POST /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f/action" status: 200 len: 24580 microversion: 2.32 time: 0.592907 Sep 06 11:08:20.035284 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2008/4008] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:08:19 2022] POST /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f/action => generated 24580 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:08:20.226575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f4167816-0db0-4c5d-bff9-da9b2e03ec1d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:20.227965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f4167816-0db0-4c5d-bff9-da9b2e03ec1d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] [instance: 16d64eaf-0686-4d18-8b21-1eb52f4cda77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:20.243529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4167816-0db0-4c5d-bff9-da9b2e03ec1d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:20.255848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4167816-0db0-4c5d-bff9-da9b2e03ec1d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:20.259163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4167816-0db0-4c5d-bff9-da9b2e03ec1d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:20.264865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4167816-0db0-4c5d-bff9-da9b2e03ec1d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:20.267587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4167816-0db0-4c5d-bff9-da9b2e03ec1d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:20.268075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4167816-0db0-4c5d-bff9-da9b2e03ec1d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:20.342127 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-f4167816-0db0-4c5d-bff9-da9b2e03ec1d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] HTTP exception thrown: Instance 16d64eaf-0686-4d18-8b21-1eb52f4cda77 could not be found. Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f4167816-0db0-4c5d-bff9-da9b2e03ec1d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Request method failure captured: Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 HTTP/1.1 Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFylwoWCjxQm-dVmi0YTcYjMOPASXboEaT0Ets2lfmXBex6uPkTDFTbU-1aRbCMRCNX0ZoyDzCHdqleg-XEHDwEwr1EDFC3EgQ8XmEgg_MRHQy2glNsZkG5TqMRHrNvDna44rXGYxqDHixL1nUGz46TTEBaPq2Dry8zOW5DViLGeP-P4 Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.91 Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 53043c49bd5c4591bbfc72c443cf66ee Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-728540941 Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53043c49bd5c4591bbfc72c443cf66ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53043c49bd5c4591bbfc72c443cf66ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53043c49bd5c4591bbfc72c443cf66ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53043c49bd5c4591bbfc72c443cf66ee"}]}] Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-728540941 Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 53043c49bd5c4591bbfc72c443cf66ee Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-728540941 Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-UnshelveToHostMultiNodesTest-728540941-project Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 87109fdea86d40f38dc8dbeb664b9e5c Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-728540941-project Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 16d64eaf-0686-4d18-8b21-1eb52f4cda77 could not be found. Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '16d64eaf-0686-4d18-8b21-1eb52f4cda77'} Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16d64eaf-0686-4d18-8b21-1eb52f4cda77 could not be found. Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16d64eaf-0686-4d18-8b21-1eb52f4cda77 could not be found. Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:20.348159 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:20.356038 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:20.356038 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:20.356038 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:20.356038 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:20.356038 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:08:20.356038 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:08:20.356038 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16d64eaf-0686-4d18-8b21-1eb52f4cda77 could not be found. Sep 06 11:08:20.356038 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:20.356038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f4167816-0db0-4c5d-bff9-da9b2e03ec1d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] Returning 404 to user: Instance 16d64eaf-0686-4d18-8b21-1eb52f4cda77 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:20.356038 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f4167816-0db0-4c5d-bff9-da9b2e03ec1d tempest-UnshelveToHostMultiNodesTest-728540941 tempest-UnshelveToHostMultiNodesTest-728540941-project] 10.222.0.20 "GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77" status: 404 len: 111 microversion: 2.91 time: 0.129887 Sep 06 11:08:20.362331 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2009/4009] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:08:20 2022] GET /compute/v2.1/servers/16d64eaf-0686-4d18-8b21-1eb52f4cda77 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 06 11:08:20.398541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-589c16d1-b358-45c9-8901-9c650778c833 req-1bbbab5a-0bff-4f02-af89-fb184e2c2708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e211e2-5fa6-4ea2-b67d-34cb290caf41", "name": "network-vif-deleted", "tag": "e701f7a6-96d7-46c8-87a8-bb6c5c12dac8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:20.398795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-57a87564-2e71-4171-8990-5d02cbfc72df tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:20.405361 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-57a87564-2e71-4171-8990-5d02cbfc72df tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1495 microversion: 2.1 time: 0.733510 Sep 06 11:08:20.416722 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2001/4010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:19 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1495 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:20.419259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-589c16d1-b358-45c9-8901-9c650778c833 req-1bbbab5a-0bff-4f02-af89-fb184e2c2708 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:20.420553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-589c16d1-b358-45c9-8901-9c650778c833 req-1bbbab5a-0bff-4f02-af89-fb184e2c2708 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:20.421604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-589c16d1-b358-45c9-8901-9c650778c833 req-1bbbab5a-0bff-4f02-af89-fb184e2c2708 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:20.453557 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-589c16d1-b358-45c9-8901-9c650778c833 req-1bbbab5a-0bff-4f02-af89-fb184e2c2708 service nova] Creating event network-vif-deleted:e701f7a6-96d7-46c8-87a8-bb6c5c12dac8 for instance 11e211e2-5fa6-4ea2-b67d-34cb290caf41 on nch1-master-1 Sep 06 11:08:20.460853 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-589c16d1-b358-45c9-8901-9c650778c833 req-1bbbab5a-0bff-4f02-af89-fb184e2c2708 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086447 Sep 06 11:08:20.464892 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2010/4011] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:08:21.448671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:21.450678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:21.467925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:21.469109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:21.470153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:21.472020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:21.473160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:21.474656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:21.584617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:21.584617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:21.584617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:21.584617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid 11e211e2-5fa6-4ea2-b67d-34cb290caf41 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:21.626642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:21.640100 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b788cbc3-8ed0-4ec4-ac77-f8bb0537b643 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 200 len: 1305 microversion: 2.1 time: 0.198121 Sep 06 11:08:21.641859 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2002/4012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:21 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 1305 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:22.670531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1be0454e-35a7-465a-bc23-76541a244a26 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:22.681931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1be0454e-35a7-465a-bc23-76541a244a26 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: 11e211e2-5fa6-4ea2-b67d-34cb290caf41] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:22.690430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1be0454e-35a7-465a-bc23-76541a244a26 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:22.692882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1be0454e-35a7-465a-bc23-76541a244a26 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:22.693670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1be0454e-35a7-465a-bc23-76541a244a26 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:22.694502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1be0454e-35a7-465a-bc23-76541a244a26 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:22.696763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1be0454e-35a7-465a-bc23-76541a244a26 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:22.697308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1be0454e-35a7-465a-bc23-76541a244a26 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:22.738195 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-1be0454e-35a7-465a-bc23-76541a244a26 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] HTTP exception thrown: Instance 11e211e2-5fa6-4ea2-b67d-34cb290caf41 could not be found. Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1be0454e-35a7-465a-bc23-76541a244a26 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Request method failure captured: Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 HTTP/1.1 Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyg2U48D630rtP93KctSUB55frBucaLCwvXam7s5D6muRGgpAdGYpf_Jd02qO6Wv-yScWLiyAR1qNAYbE0W-SGR2eaGszOp1OPVLx8OvqN3f_pV8xU0pTYMSFjaPG0NSAitsz90vg6hPWxi5nbHOISf77di5fAInBJEzZCthjFzILpY Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: dcd5ffec2c6246fb89ba181542692585 Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerActionsTestJSON-562575329 Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcd5ffec2c6246fb89ba181542692585"}]}] Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerActionsTestJSON-562575329 Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: dcd5ffec2c6246fb89ba181542692585 Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerActionsTestJSON-562575329 Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerActionsTestJSON-562575329-project Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: f16abbf8a68344b68444ff8fc2795c67 Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerActionsTestJSON-562575329-project Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 11e211e2-5fa6-4ea2-b67d-34cb290caf41 could not be found. Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '11e211e2-5fa6-4ea2-b67d-34cb290caf41'} Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e211e2-5fa6-4ea2-b67d-34cb290caf41 could not be found. Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e211e2-5fa6-4ea2-b67d-34cb290caf41 could not be found. Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:22.742737 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:22.746297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:22.746297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:22.746297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:22.746297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:08:22.746297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:08:22.746297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e211e2-5fa6-4ea2-b67d-34cb290caf41 could not be found. Sep 06 11:08:22.746297 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:22.747955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1be0454e-35a7-465a-bc23-76541a244a26 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Returning 404 to user: Instance 11e211e2-5fa6-4ea2-b67d-34cb290caf41 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:22.749034 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1be0454e-35a7-465a-bc23-76541a244a26 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41" status: 404 len: 111 microversion: 2.1 time: 0.083570 Sep 06 11:08:22.752138 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2011/4013] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:22 2022] GET /compute/v2.1/servers/11e211e2-5fa6-4ea2-b67d-34cb290caf41 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:08:22.759615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-54b593e6-5175-4006-9f83-e46416c40f5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:22.760740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-54b593e6-5175-4006-9f83-e46416c40f5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:22.782539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:22.811945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54b593e6-5175-4006-9f83-e46416c40f5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:22.821265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54b593e6-5175-4006-9f83-e46416c40f5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:22.821265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54b593e6-5175-4006-9f83-e46416c40f5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:22.821265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54b593e6-5175-4006-9f83-e46416c40f5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:22.821265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54b593e6-5175-4006-9f83-e46416c40f5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:22.821265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54b593e6-5175-4006-9f83-e46416c40f5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:22.858427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-54b593e6-5175-4006-9f83-e46416c40f5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:08:23.372208 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-54b593e6-5175-4006-9f83-e46416c40f5f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 204 len: 0 microversion: 2.1 time: 0.616486 Sep 06 11:08:23.374827 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2003/4014] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:08:22 2022] DELETE /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:08:23.383849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9b49582b-126f-4f4c-a273-3b141a10f3ee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:23.385668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9b49582b-126f-4f4c-a273-3b141a10f3ee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:23.417695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b49582b-126f-4f4c-a273-3b141a10f3ee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:23.418319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b49582b-126f-4f4c-a273-3b141a10f3ee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:23.425860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b49582b-126f-4f4c-a273-3b141a10f3ee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:23.448795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b49582b-126f-4f4c-a273-3b141a10f3ee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:23.451268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b49582b-126f-4f4c-a273-3b141a10f3ee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:23.452334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b49582b-126f-4f4c-a273-3b141a10f3ee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:23.973725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9b49582b-126f-4f4c-a273-3b141a10f3ee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:23.986383 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9b49582b-126f-4f4c-a273-3b141a10f3ee tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1674 microversion: 2.1 time: 0.607069 Sep 06 11:08:23.989509 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2012/4015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:23 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1674 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:25.021038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-56edbbd5-8444-4745-9cb6-042e6715b020 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:25.023091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-56edbbd5-8444-4745-9cb6-042e6715b020 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:25.071859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56edbbd5-8444-4745-9cb6-042e6715b020 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:25.075820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56edbbd5-8444-4745-9cb6-042e6715b020 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:25.078368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56edbbd5-8444-4745-9cb6-042e6715b020 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:25.080291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56edbbd5-8444-4745-9cb6-042e6715b020 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:25.081908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56edbbd5-8444-4745-9cb6-042e6715b020 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:25.082560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56edbbd5-8444-4745-9cb6-042e6715b020 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:26.489529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-56edbbd5-8444-4745-9cb6-042e6715b020 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:26.526336 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-56edbbd5-8444-4745-9cb6-042e6715b020 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1674 microversion: 2.1 time: 1.510139 Sep 06 11:08:26.544056 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2004/4016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:25 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1674 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:27.256573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-6d9e3606-14b8-4b55-ab7d-56c543dc0f51 req-8c0d4094-6000-4e3c-9f78-7fecf9c9bd3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9db1902-3f12-48b6-a27f-425e4843424b", "name": "network-vif-deleted", "tag": "1fa7746e-916f-47fe-a1b6-1454c7592311"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:27.284537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6d9e3606-14b8-4b55-ab7d-56c543dc0f51 req-8c0d4094-6000-4e3c-9f78-7fecf9c9bd3b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:27.286308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6d9e3606-14b8-4b55-ab7d-56c543dc0f51 req-8c0d4094-6000-4e3c-9f78-7fecf9c9bd3b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:27.289352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6d9e3606-14b8-4b55-ab7d-56c543dc0f51 req-8c0d4094-6000-4e3c-9f78-7fecf9c9bd3b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:27.305038 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-6d9e3606-14b8-4b55-ab7d-56c543dc0f51 req-8c0d4094-6000-4e3c-9f78-7fecf9c9bd3b service nova] Creating event network-vif-deleted:1fa7746e-916f-47fe-a1b6-1454c7592311 for instance d9db1902-3f12-48b6-a27f-425e4843424b on nch2-master-1 Sep 06 11:08:27.319181 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-6d9e3606-14b8-4b55-ab7d-56c543dc0f51 req-8c0d4094-6000-4e3c-9f78-7fecf9c9bd3b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068630 Sep 06 11:08:27.324471 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2005/4017] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:08:27.426040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1214144036", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:27.561066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f86a088-1f55-4bf4-9324-1fe7c2171344 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:27.561845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4f86a088-1f55-4bf4-9324-1fe7c2171344 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:27.587216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f86a088-1f55-4bf4-9324-1fe7c2171344 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:27.592142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f86a088-1f55-4bf4-9324-1fe7c2171344 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:27.592142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f86a088-1f55-4bf4-9324-1fe7c2171344 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:27.592663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f86a088-1f55-4bf4-9324-1fe7c2171344 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:27.594421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f86a088-1f55-4bf4-9324-1fe7c2171344 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:27.595126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f86a088-1f55-4bf4-9324-1fe7c2171344 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:27.649066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] validate_networks() for None {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:08:27.830930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4f86a088-1f55-4bf4-9324-1fe7c2171344 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:27.843887 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4f86a088-1f55-4bf4-9324-1fe7c2171344 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1322 microversion: 2.1 time: 0.288568 Sep 06 11:08:27.862127 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2006/4018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:27 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:28.121153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:08:28.124689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:08:28.124689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:08:28.124689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:08:28.124689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:08:28.136731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:28.137492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:28.138127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:28.138980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:28.139484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:28.139932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:28.170449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Getting quotas for project 3298773c4bd9452c90a38334e7a0cdc1. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:08:28.176790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Getting quotas for user f160a950e90c445698d7f5ea36944398 and project 3298773c4bd9452c90a38334e7a0cdc1. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:08:28.201460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:08:28.204526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:08:28.453311 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ca0f79c6-291c-4b17-ac88-8634c4b5b229 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.353582 Sep 06 11:08:28.455291 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2013/4019] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:08:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:08:28.469331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-31a3bb8f-9118-4f75-bfe4-46240c438a78 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:28.470310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-31a3bb8f-9118-4f75-bfe4-46240c438a78 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:28.655055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-31a3bb8f-9118-4f75-bfe4-46240c438a78 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:28.662596 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-31a3bb8f-9118-4f75-bfe4-46240c438a78 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1217 microversion: 2.1 time: 0.199273 Sep 06 11:08:28.669777 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2007/4020] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:28 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1217 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:28.870645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:28.872876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:28.913080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:28.916908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:28.917397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:28.918174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:28.918677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:28.919127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:29.061347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:29.063872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:29.067763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:29.068515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lazy-loading 'fault' on Instance uuid d9db1902-3f12-48b6-a27f-425e4843424b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:08:29.249331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16abbf8a68344b68444ff8fc2795c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd5ffec2c6246fb89ba181542692585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:29.271192 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-54584a9b-0ae2-4ac6-9dbb-54450636913f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 200 len: 1327 microversion: 2.1 time: 0.403347 Sep 06 11:08:29.275968 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2014/4021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:28 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 1327 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:29.702580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7d72721a-c133-42aa-bf0e-57191d4ef064 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:29.703252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7d72721a-c133-42aa-bf0e-57191d4ef064 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:29.819081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d72721a-c133-42aa-bf0e-57191d4ef064 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:29.827719 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7d72721a-c133-42aa-bf0e-57191d4ef064 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1217 microversion: 2.1 time: 0.130680 Sep 06 11:08:29.828848 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2008/4022] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:29 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:30.296283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b5cfd765-0788-4a5a-bcf3-ef0e0468a188 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:30.297049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b5cfd765-0788-4a5a-bcf3-ef0e0468a188 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] [instance: d9db1902-3f12-48b6-a27f-425e4843424b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:30.307131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5cfd765-0788-4a5a-bcf3-ef0e0468a188 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:30.310585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5cfd765-0788-4a5a-bcf3-ef0e0468a188 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:30.310585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5cfd765-0788-4a5a-bcf3-ef0e0468a188 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:30.310585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5cfd765-0788-4a5a-bcf3-ef0e0468a188 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:30.310585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5cfd765-0788-4a5a-bcf3-ef0e0468a188 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:30.310585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5cfd765-0788-4a5a-bcf3-ef0e0468a188 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:30.350476 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-b5cfd765-0788-4a5a-bcf3-ef0e0468a188 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] HTTP exception thrown: Instance d9db1902-3f12-48b6-a27f-425e4843424b could not be found. Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b5cfd765-0788-4a5a-bcf3-ef0e0468a188 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Request method failure captured: Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b HTTP/1.1 Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyg2U48D630rtP93KctSUB55frBucaLCwvXam7s5D6muRGgpAdGYpf_Jd02qO6Wv-yScWLiyAR1qNAYbE0W-SGR2eaGszOp1OPVLx8OvqN3f_pV8xU0pTYMSFjaPG0NSAitsz90vg6hPWxi5nbHOISf77di5fAInBJEzZCthjFzILpY Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: dcd5ffec2c6246fb89ba181542692585 Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerActionsTestJSON-562575329 Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcd5ffec2c6246fb89ba181542692585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcd5ffec2c6246fb89ba181542692585"}]}] Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerActionsTestJSON-562575329 Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: dcd5ffec2c6246fb89ba181542692585 Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerActionsTestJSON-562575329 Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerActionsTestJSON-562575329-project Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: f16abbf8a68344b68444ff8fc2795c67 Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerActionsTestJSON-562575329-project Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance d9db1902-3f12-48b6-a27f-425e4843424b could not be found. Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'd9db1902-3f12-48b6-a27f-425e4843424b'} Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9db1902-3f12-48b6-a27f-425e4843424b could not be found. Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9db1902-3f12-48b6-a27f-425e4843424b could not be found. Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:08:30.353582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:30.357910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:08:30.357910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:08:30.357910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:08:30.357910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:08:30.357910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:08:30.357910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9db1902-3f12-48b6-a27f-425e4843424b could not be found. Sep 06 11:08:30.357910 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:08:30.360023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b5cfd765-0788-4a5a-bcf3-ef0e0468a188 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Returning 404 to user: Instance d9db1902-3f12-48b6-a27f-425e4843424b could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:08:30.361318 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b5cfd765-0788-4a5a-bcf3-ef0e0468a188 tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b" status: 404 len: 111 microversion: 2.1 time: 0.069170 Sep 06 11:08:30.364054 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2015/4023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:30 2022] GET /compute/v2.1/servers/d9db1902-3f12-48b6-a27f-425e4843424b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:08:30.374010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f68e1a78-5ce3-4b3d-818f-b154ebf4c90f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] Calling method '.version_select at 0x7f90f3751af0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:30.521603 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f68e1a78-5ce3-4b3d-818f-b154ebf4c90f tempest-ServerActionsTestJSON-562575329 tempest-ServerActionsTestJSON-562575329-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-137077139" status: 202 len: 0 microversion: 2.1 time: 0.152919 Sep 06 11:08:30.533679 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2009/4024] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 11:08:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-137077139 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:08:30.854007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9126a524-7319-4e71-b1f3-0a81f5e684bb tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:30.854702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9126a524-7319-4e71-b1f3-0a81f5e684bb tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:30.861369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9126a524-7319-4e71-b1f3-0a81f5e684bb tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:30.862117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9126a524-7319-4e71-b1f3-0a81f5e684bb tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:30.862740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9126a524-7319-4e71-b1f3-0a81f5e684bb tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:30.863678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9126a524-7319-4e71-b1f3-0a81f5e684bb tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:30.864303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9126a524-7319-4e71-b1f3-0a81f5e684bb tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:30.864975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9126a524-7319-4e71-b1f3-0a81f5e684bb tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:31.081973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9126a524-7319-4e71-b1f3-0a81f5e684bb tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:31.095483 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9126a524-7319-4e71-b1f3-0a81f5e684bb tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1221 microversion: 2.1 time: 0.243847 Sep 06 11:08:31.101846 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2016/4025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:30 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1221 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:32.122131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d404ff77-5f24-4349-9e26-b7838fed1f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:32.136819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d404ff77-5f24-4349-9e26-b7838fed1f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:32.165408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d404ff77-5f24-4349-9e26-b7838fed1f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:32.170212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d404ff77-5f24-4349-9e26-b7838fed1f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:32.173002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d404ff77-5f24-4349-9e26-b7838fed1f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:32.182563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d404ff77-5f24-4349-9e26-b7838fed1f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:32.182563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d404ff77-5f24-4349-9e26-b7838fed1f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:32.182563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d404ff77-5f24-4349-9e26-b7838fed1f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:32.343442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d404ff77-5f24-4349-9e26-b7838fed1f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:32.357436 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d404ff77-5f24-4349-9e26-b7838fed1f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1269 microversion: 2.1 time: 0.240548 Sep 06 11:08:32.359831 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2010/4026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:32 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1269 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:33.386808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f0c4e04c-459e-44ce-b073-87de64ee7932 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:33.388353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f0c4e04c-459e-44ce-b073-87de64ee7932 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:33.407195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0c4e04c-459e-44ce-b073-87de64ee7932 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:33.410456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0c4e04c-459e-44ce-b073-87de64ee7932 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:33.412782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0c4e04c-459e-44ce-b073-87de64ee7932 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:33.419856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0c4e04c-459e-44ce-b073-87de64ee7932 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:33.421250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0c4e04c-459e-44ce-b073-87de64ee7932 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:33.425190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0c4e04c-459e-44ce-b073-87de64ee7932 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:33.865974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f0c4e04c-459e-44ce-b073-87de64ee7932 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:33.881109 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f0c4e04c-459e-44ce-b073-87de64ee7932 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1275 microversion: 2.1 time: 0.500338 Sep 06 11:08:33.904730 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2017/4027] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:33 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1275 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:34.925029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-292a314d-81a4-4dee-a1dc-de91108c8e46 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:34.926090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-292a314d-81a4-4dee-a1dc-de91108c8e46 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:34.958593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-292a314d-81a4-4dee-a1dc-de91108c8e46 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:34.963643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-292a314d-81a4-4dee-a1dc-de91108c8e46 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:34.965432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-292a314d-81a4-4dee-a1dc-de91108c8e46 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:34.969899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-292a314d-81a4-4dee-a1dc-de91108c8e46 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:34.972893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-292a314d-81a4-4dee-a1dc-de91108c8e46 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:34.974135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-292a314d-81a4-4dee-a1dc-de91108c8e46 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:35.382746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-292a314d-81a4-4dee-a1dc-de91108c8e46 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:35.403218 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-292a314d-81a4-4dee-a1dc-de91108c8e46 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1275 microversion: 2.1 time: 0.490185 Sep 06 11:08:35.404621 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2011/4028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:34 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1275 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:36.434885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fac695a2-4efe-423a-a8d0-2f33e1343576 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:36.436843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fac695a2-4efe-423a-a8d0-2f33e1343576 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:36.457862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac695a2-4efe-423a-a8d0-2f33e1343576 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:36.461786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac695a2-4efe-423a-a8d0-2f33e1343576 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:36.463417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac695a2-4efe-423a-a8d0-2f33e1343576 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:36.465633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac695a2-4efe-423a-a8d0-2f33e1343576 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:36.468161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac695a2-4efe-423a-a8d0-2f33e1343576 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:36.473572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fac695a2-4efe-423a-a8d0-2f33e1343576 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:36.924764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fac695a2-4efe-423a-a8d0-2f33e1343576 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:36.932292 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fac695a2-4efe-423a-a8d0-2f33e1343576 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1275 microversion: 2.1 time: 0.505364 Sep 06 11:08:36.932903 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2018/4029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:36 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1275 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:37.963839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-be562a01-f3ad-4361-a3b7-739e2340b6a3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:37.966170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-be562a01-f3ad-4361-a3b7-739e2340b6a3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:37.986301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be562a01-f3ad-4361-a3b7-739e2340b6a3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:37.987120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be562a01-f3ad-4361-a3b7-739e2340b6a3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:37.987755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be562a01-f3ad-4361-a3b7-739e2340b6a3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:37.988642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be562a01-f3ad-4361-a3b7-739e2340b6a3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:37.989263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be562a01-f3ad-4361-a3b7-739e2340b6a3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:37.989854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be562a01-f3ad-4361-a3b7-739e2340b6a3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:39.144778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-be562a01-f3ad-4361-a3b7-739e2340b6a3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:39.159339 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-be562a01-f3ad-4361-a3b7-739e2340b6a3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1317 microversion: 2.1 time: 1.207109 Sep 06 11:08:39.165399 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2012/4030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:37 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1317 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:40.189850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-55f38685-0604-4c86-bdbb-645ee93da196 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:40.191773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-55f38685-0604-4c86-bdbb-645ee93da196 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:40.196298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:40.197325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:40.204645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55f38685-0604-4c86-bdbb-645ee93da196 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:40.205575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55f38685-0604-4c86-bdbb-645ee93da196 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:40.206233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55f38685-0604-4c86-bdbb-645ee93da196 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:40.207333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55f38685-0604-4c86-bdbb-645ee93da196 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:40.208102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55f38685-0604-4c86-bdbb-645ee93da196 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:40.208806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55f38685-0604-4c86-bdbb-645ee93da196 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:41.179193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-55f38685-0604-4c86-bdbb-645ee93da196 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:41.192780 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-55f38685-0604-4c86-bdbb-645ee93da196 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1317 microversion: 2.1 time: 1.007629 Sep 06 11:08:41.194120 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2019/4031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:40 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1317 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:42.031902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-1cde9ba4-aa61-4827-ab53-205694652e87 req-17be9e5a-0a9a-4561-aa26-771662caaafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8762ab58-4c4e-4711-9e22-0a35fe149c05", "tag": "655e13ee-c750-4d4e-a975-d750b1032e66"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:42.079865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:42.095595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1cde9ba4-aa61-4827-ab53-205694652e87 req-17be9e5a-0a9a-4561-aa26-771662caaafd service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:42.097177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1cde9ba4-aa61-4827-ab53-205694652e87 req-17be9e5a-0a9a-4561-aa26-771662caaafd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:42.098995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1cde9ba4-aa61-4827-ab53-205694652e87 req-17be9e5a-0a9a-4561-aa26-771662caaafd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:42.143049 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-1cde9ba4-aa61-4827-ab53-205694652e87 req-17be9e5a-0a9a-4561-aa26-771662caaafd service nova] Creating event network-changed:655e13ee-c750-4d4e-a975-d750b1032e66 for instance 8762ab58-4c4e-4711-9e22-0a35fe149c05 on nch1-master-1 Sep 06 11:08:42.155071 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-1cde9ba4-aa61-4827-ab53-205694652e87 req-17be9e5a-0a9a-4561-aa26-771662caaafd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135424 Sep 06 11:08:42.157919 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2013/4032] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:08:42.231994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6d085883-2342-4507-9568-b919bfe91f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:42.232640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6d085883-2342-4507-9568-b919bfe91f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:42.246266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d085883-2342-4507-9568-b919bfe91f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:42.248248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d085883-2342-4507-9568-b919bfe91f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:42.248744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d085883-2342-4507-9568-b919bfe91f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:42.251938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d085883-2342-4507-9568-b919bfe91f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:42.253477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d085883-2342-4507-9568-b919bfe91f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:42.258519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d085883-2342-4507-9568-b919bfe91f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:42.455201 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:08:42.455414 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 11:08:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 (ip 10.222.0.20) !!! Sep 06 11:08:43.177892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6d085883-2342-4507-9568-b919bfe91f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:43.190697 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6d085883-2342-4507-9568-b919bfe91f4b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1317 microversion: 2.1 time: 0.963177 Sep 06 11:08:43.192538 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2020/4033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:42 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1317 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:44.224651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a9584433-e3ce-468f-ae2d-33636ae5c606 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:44.227209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a9584433-e3ce-468f-ae2d-33636ae5c606 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:44.248990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a9584433-e3ce-468f-ae2d-33636ae5c606 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:44.249664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a9584433-e3ce-468f-ae2d-33636ae5c606 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:44.250609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a9584433-e3ce-468f-ae2d-33636ae5c606 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:44.251521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a9584433-e3ce-468f-ae2d-33636ae5c606 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:44.252219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a9584433-e3ce-468f-ae2d-33636ae5c606 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:44.252873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a9584433-e3ce-468f-ae2d-33636ae5c606 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:44.830186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a9584433-e3ce-468f-ae2d-33636ae5c606 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:44.840476 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a9584433-e3ce-468f-ae2d-33636ae5c606 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1317 microversion: 2.1 time: 0.625793 Sep 06 11:08:44.842009 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2014/4034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:44 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1317 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:45.871281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ee132e4f-4d2b-4a65-9091-317c9b692a2e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:45.871957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ee132e4f-4d2b-4a65-9091-317c9b692a2e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:45.889321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee132e4f-4d2b-4a65-9091-317c9b692a2e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:45.896810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee132e4f-4d2b-4a65-9091-317c9b692a2e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:45.898258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee132e4f-4d2b-4a65-9091-317c9b692a2e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:45.898813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee132e4f-4d2b-4a65-9091-317c9b692a2e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:45.902276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee132e4f-4d2b-4a65-9091-317c9b692a2e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:45.903534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee132e4f-4d2b-4a65-9091-317c9b692a2e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:46.107831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1168386422", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "2b6d54f6-d98d-4b3b-a85b-d2cdef494cc4"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:46.266097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] validate_networks() for [('2b6d54f6-d98d-4b3b-a85b-d2cdef494cc4', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:08:46.337861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ee132e4f-4d2b-4a65-9091-317c9b692a2e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:46.354165 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ee132e4f-4d2b-4a65-9091-317c9b692a2e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1317 microversion: 2.1 time: 0.484607 Sep 06 11:08:46.365365 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2015/4035] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:45 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:47.395037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe069622-dd54-4137-a9cc-776a1d3268da tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:47.395919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe069622-dd54-4137-a9cc-776a1d3268da tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:47.425921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe069622-dd54-4137-a9cc-776a1d3268da tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:47.428397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe069622-dd54-4137-a9cc-776a1d3268da tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:47.429549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe069622-dd54-4137-a9cc-776a1d3268da tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:47.432729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe069622-dd54-4137-a9cc-776a1d3268da tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:47.433481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe069622-dd54-4137-a9cc-776a1d3268da tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:47.435438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe069622-dd54-4137-a9cc-776a1d3268da tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:48.292468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe069622-dd54-4137-a9cc-776a1d3268da tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:48.310702 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe069622-dd54-4137-a9cc-776a1d3268da tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1317 microversion: 2.1 time: 0.930046 Sep 06 11:08:48.311695 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2016/4036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:47 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1317 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:48.648058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:08:48.648857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:08:48.648857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:08:48.649281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:08:48.650251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:08:48.681659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:48.691767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:48.692656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:48.693553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:48.695233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:48.696630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:48.699480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:48.726516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:48.764528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Getting quotas for project eb1353cb350f4463862e78e75c5b2e50. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:08:48.783978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Getting quotas for user b3257d707d4e47bd9c68496acf8788ad and project eb1353cb350f4463862e78e75c5b2e50. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:08:48.814954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:08:48.817301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:08:49.117441 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56fdc34f-5d8d-4ce1-8102-3152d0b63b53 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.466809 Sep 06 11:08:49.124017 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2021/4037] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:08:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:08:49.140249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0e8b7390-e37b-4630-a06c-539247ec00e4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:49.140895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0e8b7390-e37b-4630-a06c-539247ec00e4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:49.341056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6a8dd7a3-e422-40ca-b76c-c67403b9a743 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:49.350203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6a8dd7a3-e422-40ca-b76c-c67403b9a743 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:49.371693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8dd7a3-e422-40ca-b76c-c67403b9a743 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:49.377098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8dd7a3-e422-40ca-b76c-c67403b9a743 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:49.381014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8dd7a3-e422-40ca-b76c-c67403b9a743 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:49.393943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8dd7a3-e422-40ca-b76c-c67403b9a743 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:49.393943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8dd7a3-e422-40ca-b76c-c67403b9a743 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:49.400400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a8dd7a3-e422-40ca-b76c-c67403b9a743 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:49.491953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0e8b7390-e37b-4630-a06c-539247ec00e4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:49.503196 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0e8b7390-e37b-4630-a06c-539247ec00e4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1217 microversion: 2.1 time: 0.369437 Sep 06 11:08:49.546093 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2017/4038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:49 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1217 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:49.798081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6a8dd7a3-e422-40ca-b76c-c67403b9a743 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:49.819622 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6a8dd7a3-e422-40ca-b76c-c67403b9a743 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1317 microversion: 2.1 time: 0.484294 Sep 06 11:08:49.827630 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2022/4039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:49 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:50.054631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-13239549", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:50.136664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] validate_networks() for [('d95aa1af-6b57-409c-9474-d23f6e216956', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:08:50.569289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-83d1ffcd-50e3-4ea2-8922-86dba6d28c95 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:50.570143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-83d1ffcd-50e3-4ea2-8922-86dba6d28c95 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:50.701342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-83d1ffcd-50e3-4ea2-8922-86dba6d28c95 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:50.721336 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-83d1ffcd-50e3-4ea2-8922-86dba6d28c95 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1217 microversion: 2.1 time: 0.161420 Sep 06 11:08:50.723750 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2023/4040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:50 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:50.848330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2a2868fc-be2c-4151-9ab3-160c6e96b342 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:50.849096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2a2868fc-be2c-4151-9ab3-160c6e96b342 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:50.874261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a2868fc-be2c-4151-9ab3-160c6e96b342 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:50.879462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a2868fc-be2c-4151-9ab3-160c6e96b342 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:50.882576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a2868fc-be2c-4151-9ab3-160c6e96b342 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:50.886746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a2868fc-be2c-4151-9ab3-160c6e96b342 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:50.888657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a2868fc-be2c-4151-9ab3-160c6e96b342 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:50.890575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a2868fc-be2c-4151-9ab3-160c6e96b342 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:51.217975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:08:51.217975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:08:51.217975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:08:51.217975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:08:51.217975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:08:51.251351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:51.252712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:51.253336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:51.254325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:51.254968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:51.255999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:51.277101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:51.300197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Getting quotas for project 887d04ff8eee40e59ec6dd248dd5b548. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:08:51.301674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2a2868fc-be2c-4151-9ab3-160c6e96b342 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:51.307545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Getting quotas for user 3e45dfaf9fd949548bca37303a117bb1 and project 887d04ff8eee40e59ec6dd248dd5b548. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:08:51.321425 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2a2868fc-be2c-4151-9ab3-160c6e96b342 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1317 microversion: 2.1 time: 0.477719 Sep 06 11:08:51.322632 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2024/4041] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:50 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:51.329789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:08:51.337332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:08:51.519158 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8cc41c43-947f-41db-9882-de99e2f56f33 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.579001 Sep 06 11:08:51.538219 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2018/4042] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:08:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:08:51.558963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f8df4bba-0118-43af-b187-962861fa4a63 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:51.560066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f8df4bba-0118-43af-b187-962861fa4a63 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:51.675681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f8df4bba-0118-43af-b187-962861fa4a63 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:51.690263 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f8df4bba-0118-43af-b187-962861fa4a63 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1220 microversion: 2.1 time: 0.143914 Sep 06 11:08:51.694438 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2025/4043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:51 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1220 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:51.754691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-038d1ea4-8f97-4a96-88fe-d8d326881ccc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:51.762686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-038d1ea4-8f97-4a96-88fe-d8d326881ccc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:51.769427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-038d1ea4-8f97-4a96-88fe-d8d326881ccc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:51.770412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-038d1ea4-8f97-4a96-88fe-d8d326881ccc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:51.775778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-038d1ea4-8f97-4a96-88fe-d8d326881ccc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:51.776964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-038d1ea4-8f97-4a96-88fe-d8d326881ccc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:51.778389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-038d1ea4-8f97-4a96-88fe-d8d326881ccc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:51.779183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-038d1ea4-8f97-4a96-88fe-d8d326881ccc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:51.886565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-038d1ea4-8f97-4a96-88fe-d8d326881ccc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:51.896229 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-038d1ea4-8f97-4a96-88fe-d8d326881ccc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1221 microversion: 2.1 time: 0.146318 Sep 06 11:08:51.897923 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2019/4044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:51 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:51.914652 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-959758834", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:51.994699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] validate_networks() for [('d95aa1af-6b57-409c-9474-d23f6e216956', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:08:52.353506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9affcddb-92b6-4816-adbe-761db7de0bc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:52.356216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9affcddb-92b6-4816-adbe-761db7de0bc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:52.378834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9affcddb-92b6-4816-adbe-761db7de0bc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:52.384911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9affcddb-92b6-4816-adbe-761db7de0bc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:52.384911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9affcddb-92b6-4816-adbe-761db7de0bc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:52.384911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9affcddb-92b6-4816-adbe-761db7de0bc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:52.384911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9affcddb-92b6-4816-adbe-761db7de0bc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:52.384911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9affcddb-92b6-4816-adbe-761db7de0bc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:52.786899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:08:52.789191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:08:52.789998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:08:52.790681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:08:52.791368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:08:52.811754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:52.812505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:52.813266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:52.814297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:52.814414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9affcddb-92b6-4816-adbe-761db7de0bc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:52.815591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:52.816296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:52.839101 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9affcddb-92b6-4816-adbe-761db7de0bc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1317 microversion: 2.1 time: 0.488647 Sep 06 11:08:52.841286 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2020/4045] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:52 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:52.892491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Getting quotas for project 887d04ff8eee40e59ec6dd248dd5b548. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:08:52.911360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Getting quotas for user 3e45dfaf9fd949548bca37303a117bb1 and project 887d04ff8eee40e59ec6dd248dd5b548. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:08:52.925739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6a52068e-4524-4019-8dcc-58bbc8c1ff51 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:52.926836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6a52068e-4524-4019-8dcc-58bbc8c1ff51 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:52.934655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a52068e-4524-4019-8dcc-58bbc8c1ff51 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:52.936020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a52068e-4524-4019-8dcc-58bbc8c1ff51 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:52.936928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a52068e-4524-4019-8dcc-58bbc8c1ff51 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:52.938061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a52068e-4524-4019-8dcc-58bbc8c1ff51 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:52.939134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a52068e-4524-4019-8dcc-58bbc8c1ff51 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:52.939791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a52068e-4524-4019-8dcc-58bbc8c1ff51 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:52.955708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:08:52.966745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:08:53.102116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6a52068e-4524-4019-8dcc-58bbc8c1ff51 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:53.127396 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6a52068e-4524-4019-8dcc-58bbc8c1ff51 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1269 microversion: 2.1 time: 0.209107 Sep 06 11:08:53.134212 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2021/4046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:52 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1269 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:53.293939 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cb921a29-6e01-4bba-ae6d-4db59cedb3e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.387098 Sep 06 11:08:53.298202 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2026/4047] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:08:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:08:53.317056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6763f9b1-2d2c-42b0-9462-2324a9c8d473 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:53.336032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6763f9b1-2d2c-42b0-9462-2324a9c8d473 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:53.338044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:53.452539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6763f9b1-2d2c-42b0-9462-2324a9c8d473 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:53.487465 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6763f9b1-2d2c-42b0-9462-2324a9c8d473 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1221 microversion: 2.1 time: 0.174190 Sep 06 11:08:53.509195 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2022/4048] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:53 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1221 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:53.871339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-882e3080-1882-43dc-89e5-056529c9dd41 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:53.872280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-882e3080-1882-43dc-89e5-056529c9dd41 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:53.893576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-882e3080-1882-43dc-89e5-056529c9dd41 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:53.894925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-882e3080-1882-43dc-89e5-056529c9dd41 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:53.895824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-882e3080-1882-43dc-89e5-056529c9dd41 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:53.897948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-882e3080-1882-43dc-89e5-056529c9dd41 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:53.899972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-882e3080-1882-43dc-89e5-056529c9dd41 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:53.900524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-882e3080-1882-43dc-89e5-056529c9dd41 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:54.162366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6657f314-4185-43fc-9711-1140c5e46491 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:54.164395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6657f314-4185-43fc-9711-1140c5e46491 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:54.175350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6657f314-4185-43fc-9711-1140c5e46491 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:54.175862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6657f314-4185-43fc-9711-1140c5e46491 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:54.187316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6657f314-4185-43fc-9711-1140c5e46491 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:54.188743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6657f314-4185-43fc-9711-1140c5e46491 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:54.190469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6657f314-4185-43fc-9711-1140c5e46491 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:54.191447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6657f314-4185-43fc-9711-1140c5e46491 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:54.363135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-882e3080-1882-43dc-89e5-056529c9dd41 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:54.365311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6657f314-4185-43fc-9711-1140c5e46491 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:54.380566 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-882e3080-1882-43dc-89e5-056529c9dd41 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1317 microversion: 2.1 time: 0.519554 Sep 06 11:08:54.381967 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2027/4049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:53 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:54.389341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-db37085c-a0db-446d-9a8f-640a512a1be4 req-291a746a-cf25-4981-86c5-615a767e8d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8762ab58-4c4e-4711-9e22-0a35fe149c05", "name": "network-vif-plugged", "status": "completed", "tag": "655e13ee-c750-4d4e-a975-d750b1032e66"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:54.404935 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6657f314-4185-43fc-9711-1140c5e46491 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1287 microversion: 2.1 time: 0.246922 Sep 06 11:08:54.406127 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2023/4050] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:54 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1287 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:54.425532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-db37085c-a0db-446d-9a8f-640a512a1be4 req-291a746a-cf25-4981-86c5-615a767e8d7d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:54.426440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-db37085c-a0db-446d-9a8f-640a512a1be4 req-291a746a-cf25-4981-86c5-615a767e8d7d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:54.427233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-db37085c-a0db-446d-9a8f-640a512a1be4 req-291a746a-cf25-4981-86c5-615a767e8d7d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:54.471851 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-db37085c-a0db-446d-9a8f-640a512a1be4 req-291a746a-cf25-4981-86c5-615a767e8d7d service nova] Creating event network-vif-plugged:655e13ee-c750-4d4e-a975-d750b1032e66 for instance 8762ab58-4c4e-4711-9e22-0a35fe149c05 on nch1-master-1 Sep 06 11:08:54.485082 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-db37085c-a0db-446d-9a8f-640a512a1be4 req-291a746a-cf25-4981-86c5-615a767e8d7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101254 Sep 06 11:08:54.485744 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2028/4051] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:08:54.519159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f902f3d3-b496-48de-9413-36e3addc80c9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:54.519934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f902f3d3-b496-48de-9413-36e3addc80c9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:54.908730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f902f3d3-b496-48de-9413-36e3addc80c9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:54.918035 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f902f3d3-b496-48de-9413-36e3addc80c9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1221 microversion: 2.1 time: 0.408658 Sep 06 11:08:54.919799 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2024/4052] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:54 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1221 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:55.411849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5553d672-6782-4cea-83fc-aff9dcb2bf0e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:55.414221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5553d672-6782-4cea-83fc-aff9dcb2bf0e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:55.434256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-05953263-7ade-4d75-aa4c-0d103d515403 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:55.435341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-05953263-7ade-4d75-aa4c-0d103d515403 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:55.464684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5553d672-6782-4cea-83fc-aff9dcb2bf0e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:55.465268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5553d672-6782-4cea-83fc-aff9dcb2bf0e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:55.468437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5553d672-6782-4cea-83fc-aff9dcb2bf0e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:55.471739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5553d672-6782-4cea-83fc-aff9dcb2bf0e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:55.474763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5553d672-6782-4cea-83fc-aff9dcb2bf0e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:55.481523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05953263-7ade-4d75-aa4c-0d103d515403 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:55.482119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05953263-7ade-4d75-aa4c-0d103d515403 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:55.482455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5553d672-6782-4cea-83fc-aff9dcb2bf0e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:55.483790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05953263-7ade-4d75-aa4c-0d103d515403 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:55.489924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05953263-7ade-4d75-aa4c-0d103d515403 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:55.490904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05953263-7ade-4d75-aa4c-0d103d515403 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:55.494294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05953263-7ade-4d75-aa4c-0d103d515403 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:55.777422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-05953263-7ade-4d75-aa4c-0d103d515403 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:55.786854 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-05953263-7ade-4d75-aa4c-0d103d515403 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1275 microversion: 2.1 time: 0.359959 Sep 06 11:08:55.792102 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2025/4053] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:55 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1275 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:55.869819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5553d672-6782-4cea-83fc-aff9dcb2bf0e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:55.891551 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5553d672-6782-4cea-83fc-aff9dcb2bf0e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1317 microversion: 2.1 time: 0.489310 Sep 06 11:08:55.894526 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2029/4054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:55 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:55.944228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6b963d89-50c1-49d6-aca3-576cce4e2b71 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:55.945822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6b963d89-50c1-49d6-aca3-576cce4e2b71 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:55.954280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b963d89-50c1-49d6-aca3-576cce4e2b71 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:55.954505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b963d89-50c1-49d6-aca3-576cce4e2b71 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:55.955120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b963d89-50c1-49d6-aca3-576cce4e2b71 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:55.956260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b963d89-50c1-49d6-aca3-576cce4e2b71 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:55.956825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b963d89-50c1-49d6-aca3-576cce4e2b71 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:55.957361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b963d89-50c1-49d6-aca3-576cce4e2b71 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:56.164194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6b963d89-50c1-49d6-aca3-576cce4e2b71 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:56.189170 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6b963d89-50c1-49d6-aca3-576cce4e2b71 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1217 microversion: 2.1 time: 0.239758 Sep 06 11:08:56.210042 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2026/4055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:55 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1217 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:56.814935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f4a86339-221a-45e9-b464-a30b56e6472c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:56.815682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f4a86339-221a-45e9-b464-a30b56e6472c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:56.839995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4a86339-221a-45e9-b464-a30b56e6472c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:56.841962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4a86339-221a-45e9-b464-a30b56e6472c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:56.842460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4a86339-221a-45e9-b464-a30b56e6472c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:56.845992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4a86339-221a-45e9-b464-a30b56e6472c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:56.848197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4a86339-221a-45e9-b464-a30b56e6472c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:56.856784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4a86339-221a-45e9-b464-a30b56e6472c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:56.917140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-05e0c654-2b1e-4119-aa51-d7af33fbe214 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:56.917771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-05e0c654-2b1e-4119-aa51-d7af33fbe214 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:56.940641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05e0c654-2b1e-4119-aa51-d7af33fbe214 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:56.941148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05e0c654-2b1e-4119-aa51-d7af33fbe214 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:56.941611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05e0c654-2b1e-4119-aa51-d7af33fbe214 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:56.957773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05e0c654-2b1e-4119-aa51-d7af33fbe214 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:56.958291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05e0c654-2b1e-4119-aa51-d7af33fbe214 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:56.961201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05e0c654-2b1e-4119-aa51-d7af33fbe214 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:57.850695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f4a86339-221a-45e9-b464-a30b56e6472c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:57.865159 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f4a86339-221a-45e9-b464-a30b56e6472c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1317 microversion: 2.1 time: 1.054098 Sep 06 11:08:57.866490 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2030/4056] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:56 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1317 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:57.876067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8b56aacc-cb35-48dd-aca5-d5d0882d664b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:57.889033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8b56aacc-cb35-48dd-aca5-d5d0882d664b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:57.898666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8b56aacc-cb35-48dd-aca5-d5d0882d664b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:57.899507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8b56aacc-cb35-48dd-aca5-d5d0882d664b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:57.900948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8b56aacc-cb35-48dd-aca5-d5d0882d664b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:57.902079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8b56aacc-cb35-48dd-aca5-d5d0882d664b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:57.902716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8b56aacc-cb35-48dd-aca5-d5d0882d664b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:57.903381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8b56aacc-cb35-48dd-aca5-d5d0882d664b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:58.003364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-05e0c654-2b1e-4119-aa51-d7af33fbe214 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:58.028326 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-05e0c654-2b1e-4119-aa51-d7af33fbe214 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1467 microversion: 2.1 time: 1.113689 Sep 06 11:08:58.033557 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2027/4057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:56 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1467 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:58.061442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-add3eb6e-2957-44ca-a785-e040494b3b18 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-404949447", "metadata": {"image_type": "test"}}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:58.081533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-add3eb6e-2957-44ca-a785-e040494b3b18 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:58.112837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-add3eb6e-2957-44ca-a785-e040494b3b18 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:58.113692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-add3eb6e-2957-44ca-a785-e040494b3b18 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:58.114427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-add3eb6e-2957-44ca-a785-e040494b3b18 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:58.115464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-add3eb6e-2957-44ca-a785-e040494b3b18 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:58.116118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-add3eb6e-2957-44ca-a785-e040494b3b18 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:58.117524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-add3eb6e-2957-44ca-a785-e040494b3b18 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:58.226389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-add3eb6e-2957-44ca-a785-e040494b3b18 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Getting quotas for project 3298773c4bd9452c90a38334e7a0cdc1. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:08:58.227752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-add3eb6e-2957-44ca-a785-e040494b3b18 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Getting quotas for user f160a950e90c445698d7f5ea36944398 and project 3298773c4bd9452c90a38334e7a0cdc1. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:08:58.270035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8b56aacc-cb35-48dd-aca5-d5d0882d664b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:58.284075 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8b56aacc-cb35-48dd-aca5-d5d0882d664b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1291 microversion: 2.1 time: 0.414568 Sep 06 11:08:58.284432 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2031/4058] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:57 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1291 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:58.843834 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-add3eb6e-2957-44ca-a785-e040494b3b18 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "POST /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05/action" status: 202 len: 0 microversion: 2.1 time: 0.786936 Sep 06 11:08:58.856207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-de69d212-1d0c-4aaa-92a0-b066fe9a34b8 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90fd181430>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:58.864671 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2028/4059] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:08:58 2022] POST /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05/action => generated 0 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 06 11:08:58.918842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1edaa8d1-15cc-4b6e-b58e-3a3436497655 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:58.920457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1edaa8d1-15cc-4b6e-b58e-3a3436497655 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:58.934158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1edaa8d1-15cc-4b6e-b58e-3a3436497655 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:58.934865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1edaa8d1-15cc-4b6e-b58e-3a3436497655 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:58.936642 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-de69d212-1d0c-4aaa-92a0-b066fe9a34b8 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.084712 Sep 06 11:08:58.938800 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2032/4060] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:58 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:58.957762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1edaa8d1-15cc-4b6e-b58e-3a3436497655 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:58.957762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1edaa8d1-15cc-4b6e-b58e-3a3436497655 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:58.957762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1edaa8d1-15cc-4b6e-b58e-3a3436497655 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:58.957762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1edaa8d1-15cc-4b6e-b58e-3a3436497655 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:59.314902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-59f33698-1d35-47c6-a8a9-756fa4000e21 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:08:59.315737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-59f33698-1d35-47c6-a8a9-756fa4000e21 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:08:59.340576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59f33698-1d35-47c6-a8a9-756fa4000e21 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:59.343284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59f33698-1d35-47c6-a8a9-756fa4000e21 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:59.344608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59f33698-1d35-47c6-a8a9-756fa4000e21 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:59.348059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59f33698-1d35-47c6-a8a9-756fa4000e21 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:59.349107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59f33698-1d35-47c6-a8a9-756fa4000e21 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:59.350322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59f33698-1d35-47c6-a8a9-756fa4000e21 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:59.444321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1edaa8d1-15cc-4b6e-b58e-3a3436497655 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:59.457915 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1edaa8d1-15cc-4b6e-b58e-3a3436497655 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1317 microversion: 2.1 time: 0.552406 Sep 06 11:08:59.459396 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2029/4061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:58 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1317 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:08:59.547645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-59f33698-1d35-47c6-a8a9-756fa4000e21 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:08:59.562442 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-59f33698-1d35-47c6-a8a9-756fa4000e21 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1279 microversion: 2.1 time: 0.254861 Sep 06 11:08:59.568041 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2033/4062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:08:59 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1279 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:08:59.692910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-f063ae05-d731-4eaf-8a12-49ebd646d1bf req-d1f71aea-f7ff-464c-aa9b-22ee88908cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6b562e-65df-42fb-be91-bf8f1659216e", "tag": "04a1b4ae-4f04-4559-bb58-4d06e235e632"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:08:59.704262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f063ae05-d731-4eaf-8a12-49ebd646d1bf req-d1f71aea-f7ff-464c-aa9b-22ee88908cc7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:08:59.705101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f063ae05-d731-4eaf-8a12-49ebd646d1bf req-d1f71aea-f7ff-464c-aa9b-22ee88908cc7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:08:59.705554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f063ae05-d731-4eaf-8a12-49ebd646d1bf req-d1f71aea-f7ff-464c-aa9b-22ee88908cc7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:08:59.719357 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f063ae05-d731-4eaf-8a12-49ebd646d1bf req-d1f71aea-f7ff-464c-aa9b-22ee88908cc7 service nova] Creating event network-changed:04a1b4ae-4f04-4559-bb58-4d06e235e632 for instance dc6b562e-65df-42fb-be91-bf8f1659216e on nch2-master-1 Sep 06 11:08:59.724620 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-f063ae05-d731-4eaf-8a12-49ebd646d1bf req-d1f71aea-f7ff-464c-aa9b-22ee88908cc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035597 Sep 06 11:08:59.725587 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2030/4063] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:08:59.954037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-95fe17ce-2a08-477c-a6d8-d66c540e0366 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3e9ef70>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:00.035292 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-95fe17ce-2a08-477c-a6d8-d66c540e0366 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.081736 Sep 06 11:09:00.047797 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2034/4064] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:59 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:00.495685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0ee6cbed-dfdd-48fe-a07a-1c751a1f762c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:00.497470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0ee6cbed-dfdd-48fe-a07a-1c751a1f762c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:00.534074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ee6cbed-dfdd-48fe-a07a-1c751a1f762c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:00.537658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ee6cbed-dfdd-48fe-a07a-1c751a1f762c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:00.542066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ee6cbed-dfdd-48fe-a07a-1c751a1f762c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:00.545070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ee6cbed-dfdd-48fe-a07a-1c751a1f762c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:00.545806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ee6cbed-dfdd-48fe-a07a-1c751a1f762c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:00.555991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ee6cbed-dfdd-48fe-a07a-1c751a1f762c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:00.623324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c5bdad5d-9941-4bf8-96e8-b7b4fc2b0ddb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:00.624341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c5bdad5d-9941-4bf8-96e8-b7b4fc2b0ddb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:00.651780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5bdad5d-9941-4bf8-96e8-b7b4fc2b0ddb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:00.659213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5bdad5d-9941-4bf8-96e8-b7b4fc2b0ddb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:00.659952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5bdad5d-9941-4bf8-96e8-b7b4fc2b0ddb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:00.660780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5bdad5d-9941-4bf8-96e8-b7b4fc2b0ddb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:00.661275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5bdad5d-9941-4bf8-96e8-b7b4fc2b0ddb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:00.661720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5bdad5d-9941-4bf8-96e8-b7b4fc2b0ddb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:01.278584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:01.922048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c5bdad5d-9941-4bf8-96e8-b7b4fc2b0ddb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:01.945590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0ee6cbed-dfdd-48fe-a07a-1c751a1f762c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:01.946911 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c5bdad5d-9941-4bf8-96e8-b7b4fc2b0ddb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1321 microversion: 2.1 time: 1.356298 Sep 06 11:09:01.948147 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2035/4065] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:00 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1321 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:01.955842 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0ee6cbed-dfdd-48fe-a07a-1c751a1f762c tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1317 microversion: 2.1 time: 1.465890 Sep 06 11:09:01.957693 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2031/4066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:00 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1317 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:01.968228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f6f2890f-db59-403c-8ab2-4f4e706c2e8d tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90fd1609d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:02.026451 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f6f2890f-db59-403c-8ab2-4f4e706c2e8d tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.076707 Sep 06 11:09:02.037086 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2036/4067] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:01 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:02.939059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-cb4bdd4c-c84a-4fd7-af46-d78f2a06abc3 req-e1f890c0-f36d-4820-a992-d4d347389a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff803c3-3d0d-490a-b950-9bab6ccc1fc3", "tag": "60c8b190-e1bd-4d24-805b-0941dc9a3697"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:02.968236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cb4bdd4c-c84a-4fd7-af46-d78f2a06abc3 req-e1f890c0-f36d-4820-a992-d4d347389a4d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:02.968236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cb4bdd4c-c84a-4fd7-af46-d78f2a06abc3 req-e1f890c0-f36d-4820-a992-d4d347389a4d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:02.968236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cb4bdd4c-c84a-4fd7-af46-d78f2a06abc3 req-e1f890c0-f36d-4820-a992-d4d347389a4d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:02.975469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c56ec3e-5672-4f96-a380-2afdb88e7bfa tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:02.976801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1c56ec3e-5672-4f96-a380-2afdb88e7bfa tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:02.997328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:02.998781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=16 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:03.011607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c56ec3e-5672-4f96-a380-2afdb88e7bfa tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:03.018140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c56ec3e-5672-4f96-a380-2afdb88e7bfa tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:03.018392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c56ec3e-5672-4f96-a380-2afdb88e7bfa tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:03.019399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c56ec3e-5672-4f96-a380-2afdb88e7bfa tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:03.020882 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-cb4bdd4c-c84a-4fd7-af46-d78f2a06abc3 req-e1f890c0-f36d-4820-a992-d4d347389a4d service nova] Creating event network-changed:60c8b190-e1bd-4d24-805b-0941dc9a3697 for instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 on nch1-master-1 Sep 06 11:09:03.022136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c56ec3e-5672-4f96-a380-2afdb88e7bfa tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:03.024390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c56ec3e-5672-4f96-a380-2afdb88e7bfa tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:03.040413 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-cb4bdd4c-c84a-4fd7-af46-d78f2a06abc3 req-e1f890c0-f36d-4820-a992-d4d347389a4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099936 Sep 06 11:09:03.043804 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2032/4068] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:09:03.056458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6b30ffe8-59b7-42f9-a97c-25005a70df24 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:03.057360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6b30ffe8-59b7-42f9-a97c-25005a70df24 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:03.085352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b30ffe8-59b7-42f9-a97c-25005a70df24 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:03.085870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b30ffe8-59b7-42f9-a97c-25005a70df24 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:03.086313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b30ffe8-59b7-42f9-a97c-25005a70df24 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:03.087096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b30ffe8-59b7-42f9-a97c-25005a70df24 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:03.087571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b30ffe8-59b7-42f9-a97c-25005a70df24 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:03.088014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b30ffe8-59b7-42f9-a97c-25005a70df24 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:03.494910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6b30ffe8-59b7-42f9-a97c-25005a70df24 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:03.511705 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6b30ffe8-59b7-42f9-a97c-25005a70df24 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1317 microversion: 2.1 time: 0.458250 Sep 06 11:09:03.511705 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2033/4069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:03 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:03.511705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7c7dae4e-3ecd-4ec7-ab6e-a7686a4b2702 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f37608b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:03.526830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1c56ec3e-5672-4f96-a380-2afdb88e7bfa tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:03.535939 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1c56ec3e-5672-4f96-a380-2afdb88e7bfa tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1321 microversion: 2.1 time: 0.566222 Sep 06 11:09:03.562697 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2037/4070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:02 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1321 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:03.567251 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7c7dae4e-3ecd-4ec7-ab6e-a7686a4b2702 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.060477 Sep 06 11:09:03.568222 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2034/4071] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:03 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:04.399055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a7cce67e-50a7-4688-8284-ec66318ac7cd req-0b5043ea-a282-46cb-afab-1020288e86a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8762ab58-4c4e-4711-9e22-0a35fe149c05", "name": "network-vif-plugged", "status": "completed", "tag": "655e13ee-c750-4d4e-a975-d750b1032e66"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:04.437827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a7cce67e-50a7-4688-8284-ec66318ac7cd req-0b5043ea-a282-46cb-afab-1020288e86a9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:04.456661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a7cce67e-50a7-4688-8284-ec66318ac7cd req-0b5043ea-a282-46cb-afab-1020288e86a9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:04.465494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a7cce67e-50a7-4688-8284-ec66318ac7cd req-0b5043ea-a282-46cb-afab-1020288e86a9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:04.509420 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a7cce67e-50a7-4688-8284-ec66318ac7cd req-0b5043ea-a282-46cb-afab-1020288e86a9 service nova] Creating event network-vif-plugged:655e13ee-c750-4d4e-a975-d750b1032e66 for instance 8762ab58-4c4e-4711-9e22-0a35fe149c05 on nch1-master-1 Sep 06 11:09:04.532363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-6c6d9052-56a7-477f-a9bc-06459803da5a req-cc848c6c-535b-43f8-b05a-0c30e6abf747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97907bbb-c089-4899-8d70-8c012daf803b", "tag": "76edc669-c87b-4c08-923b-c5192a5d4d54"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:04.538319 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a7cce67e-50a7-4688-8284-ec66318ac7cd req-0b5043ea-a282-46cb-afab-1020288e86a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145368 Sep 06 11:09:04.540592 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2038/4072] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:09:04.570949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0625c58e-1597-4acf-85ac-a2c4a5b43fc2 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:04.577753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0625c58e-1597-4acf-85ac-a2c4a5b43fc2 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:04.603622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0625c58e-1597-4acf-85ac-a2c4a5b43fc2 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:04.604598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0625c58e-1597-4acf-85ac-a2c4a5b43fc2 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:04.610109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0625c58e-1597-4acf-85ac-a2c4a5b43fc2 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:04.611511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0625c58e-1597-4acf-85ac-a2c4a5b43fc2 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:04.616600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0625c58e-1597-4acf-85ac-a2c4a5b43fc2 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:04.629257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6c6d9052-56a7-477f-a9bc-06459803da5a req-cc848c6c-535b-43f8-b05a-0c30e6abf747 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:04.629965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6c6d9052-56a7-477f-a9bc-06459803da5a req-cc848c6c-535b-43f8-b05a-0c30e6abf747 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:04.631160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6c6d9052-56a7-477f-a9bc-06459803da5a req-cc848c6c-535b-43f8-b05a-0c30e6abf747 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:04.638152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0625c58e-1597-4acf-85ac-a2c4a5b43fc2 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:04.659895 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-6c6d9052-56a7-477f-a9bc-06459803da5a req-cc848c6c-535b-43f8-b05a-0c30e6abf747 service nova] Creating event network-changed:76edc669-c87b-4c08-923b-c5192a5d4d54 for instance 97907bbb-c089-4899-8d70-8c012daf803b on nch2-master-1 Sep 06 11:09:04.671589 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-6c6d9052-56a7-477f-a9bc-06459803da5a req-cc848c6c-535b-43f8-b05a-0c30e6abf747 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144211 Sep 06 11:09:04.674128 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2035/4073] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:09:04.688754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-27b6938f-1515-4c9a-9303-8630920c33df tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:04.704659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-27b6938f-1515-4c9a-9303-8630920c33df tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:04.705369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27b6938f-1515-4c9a-9303-8630920c33df tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:04.705713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27b6938f-1515-4c9a-9303-8630920c33df tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:04.712532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27b6938f-1515-4c9a-9303-8630920c33df tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:04.713384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27b6938f-1515-4c9a-9303-8630920c33df tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:04.713886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27b6938f-1515-4c9a-9303-8630920c33df tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:04.714341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27b6938f-1515-4c9a-9303-8630920c33df tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:04.914265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:05.200437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-27b6938f-1515-4c9a-9303-8630920c33df tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:05.210766 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-27b6938f-1515-4c9a-9303-8630920c33df tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1321 microversion: 2.1 time: 0.534853 Sep 06 11:09:05.234363 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2036/4074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:04 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1321 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:05.244689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7851ee5f-6d1b-4720-ad67-593ffa1c827c tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3990670>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:05.251749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0625c58e-1597-4acf-85ac-a2c4a5b43fc2 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:05.269376 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0625c58e-1597-4acf-85ac-a2c4a5b43fc2 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1317 microversion: 2.1 time: 0.727498 Sep 06 11:09:05.277882 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2039/4075] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:04 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1317 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:05.336697 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7851ee5f-6d1b-4720-ad67-593ffa1c827c tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.100503 Sep 06 11:09:05.337335 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2037/4076] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:05 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:05.571404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-274757318", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "915d6a67-956b-435e-bf2a-e2d023c853b6"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:05.647516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] validate_networks() for [('915d6a67-956b-435e-bf2a-e2d023c853b6', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:09:06.255707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b9101b0d-513b-438e-9787-f58f69a92a54 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:06.255707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b9101b0d-513b-438e-9787-f58f69a92a54 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:06.255707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9101b0d-513b-438e-9787-f58f69a92a54 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:06.255707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9101b0d-513b-438e-9787-f58f69a92a54 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:06.255707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9101b0d-513b-438e-9787-f58f69a92a54 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:06.256557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9101b0d-513b-438e-9787-f58f69a92a54 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:06.257382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9101b0d-513b-438e-9787-f58f69a92a54 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:06.257981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9101b0d-513b-438e-9787-f58f69a92a54 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:07.014469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:09:07.016712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:09:07.017525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:09:07.018062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:09:07.019229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:09:07.045294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:07.049641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:07.051203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:07.055598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:07.056513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:07.057429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:07.111123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Getting quotas for project 2b481aea2f954dd7a003f847cff2cbeb. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:09:07.124946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Getting quotas for user e8fa57e6acb6405788cdacdf1b318c10 and project 2b481aea2f954dd7a003f847cff2cbeb. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:09:07.161347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:09:07.166889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:09:07.301190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b9101b0d-513b-438e-9787-f58f69a92a54 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:07.327220 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b9101b0d-513b-438e-9787-f58f69a92a54 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1321 microversion: 2.1 time: 1.074868 Sep 06 11:09:07.328904 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2038/4077] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:06 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1321 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:07.347140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-db5ca6dd-cc7d-4bcc-ba7b-d06770df83bc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:07.347140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-db5ca6dd-cc7d-4bcc-ba7b-d06770df83bc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:07.352471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db5ca6dd-cc7d-4bcc-ba7b-d06770df83bc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:07.353379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db5ca6dd-cc7d-4bcc-ba7b-d06770df83bc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:07.353996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db5ca6dd-cc7d-4bcc-ba7b-d06770df83bc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:07.354942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db5ca6dd-cc7d-4bcc-ba7b-d06770df83bc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:07.355615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db5ca6dd-cc7d-4bcc-ba7b-d06770df83bc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:07.356220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db5ca6dd-cc7d-4bcc-ba7b-d06770df83bc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:07.388647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:07.527589 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fc08b0c8-ce4f-42cc-b6ae-f3522a4932bf tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.246281 Sep 06 11:09:07.529781 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2040/4078] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:09:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:09:07.554306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-597e940f-9378-4d33-a4f2-0707eb6ac04b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f33cce50>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:07.664273 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-597e940f-9378-4d33-a4f2-0707eb6ac04b tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.128191 Sep 06 11:09:07.664863 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2041/4079] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:07 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:07.673323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d3949c2b-d853-451e-8c7e-ec729b2a37a8 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:07.682672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d3949c2b-d853-451e-8c7e-ec729b2a37a8 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:07.806070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-db5ca6dd-cc7d-4bcc-ba7b-d06770df83bc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:07.822605 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-db5ca6dd-cc7d-4bcc-ba7b-d06770df83bc tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1317 microversion: 2.1 time: 0.491081 Sep 06 11:09:07.841880 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2039/4080] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:07 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:07.861330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d3949c2b-d853-451e-8c7e-ec729b2a37a8 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:07.870291 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d3949c2b-d853-451e-8c7e-ec729b2a37a8 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1224 microversion: 2.1 time: 0.203726 Sep 06 11:09:07.874436 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2042/4081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:07 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1224 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:08.345358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eb7a8b6f-0e44-4039-84fe-b560de6df08d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:08.346059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eb7a8b6f-0e44-4039-84fe-b560de6df08d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:08.362864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb7a8b6f-0e44-4039-84fe-b560de6df08d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:08.363395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb7a8b6f-0e44-4039-84fe-b560de6df08d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:08.363853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb7a8b6f-0e44-4039-84fe-b560de6df08d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:08.364679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb7a8b6f-0e44-4039-84fe-b560de6df08d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:08.365146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb7a8b6f-0e44-4039-84fe-b560de6df08d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:08.365593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb7a8b6f-0e44-4039-84fe-b560de6df08d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:08.691193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff0d3661-bd72-420c-a741-190ddf54bcc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3e9eaf0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:08.803219 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff0d3661-bd72-420c-a741-190ddf54bcc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.126420 Sep 06 11:09:08.817616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eb7a8b6f-0e44-4039-84fe-b560de6df08d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:08.824507 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2043/4082] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:08 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:08.840871 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eb7a8b6f-0e44-4039-84fe-b560de6df08d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1321 microversion: 2.1 time: 0.499108 Sep 06 11:09:08.845496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-da4dff6c-f73b-451b-b9d0-171ec4f6034c req-dedd27ea-f329-46e2-8696-e8520f59eb4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6b562e-65df-42fb-be91-bf8f1659216e", "name": "network-vif-plugged", "status": "completed", "tag": "04a1b4ae-4f04-4559-bb58-4d06e235e632"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:08.849653 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2040/4083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:08 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:08.854652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fd7d4e06-326f-4226-9bb4-93263ea1f3ff tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:08.866289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fd7d4e06-326f-4226-9bb4-93263ea1f3ff tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:08.871967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-da4dff6c-f73b-451b-b9d0-171ec4f6034c req-dedd27ea-f329-46e2-8696-e8520f59eb4c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:08.874786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-da4dff6c-f73b-451b-b9d0-171ec4f6034c req-dedd27ea-f329-46e2-8696-e8520f59eb4c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:08.878310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-da4dff6c-f73b-451b-b9d0-171ec4f6034c req-dedd27ea-f329-46e2-8696-e8520f59eb4c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:08.904522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd7d4e06-326f-4226-9bb4-93263ea1f3ff tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:08.911653 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-da4dff6c-f73b-451b-b9d0-171ec4f6034c req-dedd27ea-f329-46e2-8696-e8520f59eb4c service nova] Creating event network-vif-plugged:04a1b4ae-4f04-4559-bb58-4d06e235e632 for instance dc6b562e-65df-42fb-be91-bf8f1659216e on nch2-master-1 Sep 06 11:09:08.919853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd7d4e06-326f-4226-9bb4-93263ea1f3ff tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:08.920638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd7d4e06-326f-4226-9bb4-93263ea1f3ff tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:08.921422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd7d4e06-326f-4226-9bb4-93263ea1f3ff tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:08.923091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd7d4e06-326f-4226-9bb4-93263ea1f3ff tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:08.923607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd7d4e06-326f-4226-9bb4-93263ea1f3ff tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:08.924889 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-da4dff6c-f73b-451b-b9d0-171ec4f6034c req-dedd27ea-f329-46e2-8696-e8520f59eb4c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083489 Sep 06 11:09:08.926152 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2044/4084] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:09:08.946517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-21dee31d-0983-4e28-8c91-207cd7757a6f tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:08.946517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-21dee31d-0983-4e28-8c91-207cd7757a6f tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:09.351721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-21dee31d-0983-4e28-8c91-207cd7757a6f tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:09.386631 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-21dee31d-0983-4e28-8c91-207cd7757a6f tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1224 microversion: 2.1 time: 0.455848 Sep 06 11:09:09.415775 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2045/4085] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:08 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1224 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:09.720780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fd7d4e06-326f-4226-9bb4-93263ea1f3ff tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:09.738693 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fd7d4e06-326f-4226-9bb4-93263ea1f3ff tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1317 microversion: 2.1 time: 0.887796 Sep 06 11:09:09.755913 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2041/4086] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:08 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1317 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:09.826923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c4150bb-0918-4537-a842-8480ad880ab5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90fd096f70>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:09.865771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8522e4d9-a43f-44d3-bea6-b846eeae5268 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:09.866392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8522e4d9-a43f-44d3-bea6-b846eeae5268 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:09.876354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8522e4d9-a43f-44d3-bea6-b846eeae5268 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:09.882639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8522e4d9-a43f-44d3-bea6-b846eeae5268 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:09.886909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8522e4d9-a43f-44d3-bea6-b846eeae5268 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:09.889992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8522e4d9-a43f-44d3-bea6-b846eeae5268 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:09.894370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8522e4d9-a43f-44d3-bea6-b846eeae5268 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:09.902921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8522e4d9-a43f-44d3-bea6-b846eeae5268 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:09.942959 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3c4150bb-0918-4537-a842-8480ad880ab5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.127117 Sep 06 11:09:09.951582 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2046/4087] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:09 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:10.431459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f0b08ddd-e5fc-4976-ad18-0dae5b75ebdc tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:10.432093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f0b08ddd-e5fc-4976-ad18-0dae5b75ebdc tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:10.444272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0b08ddd-e5fc-4976-ad18-0dae5b75ebdc tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:10.444852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0b08ddd-e5fc-4976-ad18-0dae5b75ebdc tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:10.449392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0b08ddd-e5fc-4976-ad18-0dae5b75ebdc tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:10.456359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0b08ddd-e5fc-4976-ad18-0dae5b75ebdc tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:10.457545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0b08ddd-e5fc-4976-ad18-0dae5b75ebdc tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:10.458164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0b08ddd-e5fc-4976-ad18-0dae5b75ebdc tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:10.492247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8522e4d9-a43f-44d3-bea6-b846eeae5268 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:10.522881 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8522e4d9-a43f-44d3-bea6-b846eeae5268 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1321 microversion: 2.1 time: 0.660870 Sep 06 11:09:10.524743 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2042/4088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:09 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1321 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:10.602386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f0b08ddd-e5fc-4976-ad18-0dae5b75ebdc tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:10.614490 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f0b08ddd-e5fc-4976-ad18-0dae5b75ebdc tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1228 microversion: 2.1 time: 0.189664 Sep 06 11:09:10.616763 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2047/4089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:10 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1228 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:10.767134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-27c60461-7359-4be3-a9e5-8b312b7b0801 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:10.767722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-27c60461-7359-4be3-a9e5-8b312b7b0801 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:10.780329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27c60461-7359-4be3-a9e5-8b312b7b0801 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:10.781530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27c60461-7359-4be3-a9e5-8b312b7b0801 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:10.782179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27c60461-7359-4be3-a9e5-8b312b7b0801 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:10.786822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27c60461-7359-4be3-a9e5-8b312b7b0801 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:10.787557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27c60461-7359-4be3-a9e5-8b312b7b0801 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:10.788208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27c60461-7359-4be3-a9e5-8b312b7b0801 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:10.954180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-10a9e4f2-2fa9-4431-9a7c-d78c8b79ee44 req-fb7301cc-043a-4610-bc48-0d9508279cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff803c3-3d0d-490a-b950-9bab6ccc1fc3", "name": "network-vif-plugged", "status": "completed", "tag": "60c8b190-e1bd-4d24-805b-0941dc9a3697"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:10.973068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-10a9e4f2-2fa9-4431-9a7c-d78c8b79ee44 req-fb7301cc-043a-4610-bc48-0d9508279cbf service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:10.981074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-10a9e4f2-2fa9-4431-9a7c-d78c8b79ee44 req-fb7301cc-043a-4610-bc48-0d9508279cbf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:10.981642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-10a9e4f2-2fa9-4431-9a7c-d78c8b79ee44 req-fb7301cc-043a-4610-bc48-0d9508279cbf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:11.005780 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-10a9e4f2-2fa9-4431-9a7c-d78c8b79ee44 req-fb7301cc-043a-4610-bc48-0d9508279cbf service nova] Creating event network-vif-plugged:60c8b190-e1bd-4d24-805b-0941dc9a3697 for instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 on nch1-master-1 Sep 06 11:09:11.016583 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-10a9e4f2-2fa9-4431-9a7c-d78c8b79ee44 req-fb7301cc-043a-4610-bc48-0d9508279cbf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067717 Sep 06 11:09:11.017314 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2048/4090] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:09:11.025695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd5177f0-c4f9-45b4-8998-f26948f1b308 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3dbbd30>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:11.055618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-27c60461-7359-4be3-a9e5-8b312b7b0801 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:11.101920 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd5177f0-c4f9-45b4-8998-f26948f1b308 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.082589 Sep 06 11:09:11.102935 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2049/4091] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:11 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:11.115506 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-27c60461-7359-4be3-a9e5-8b312b7b0801 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1317 microversion: 2.1 time: 0.333834 Sep 06 11:09:11.115506 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2043/4092] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:10 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:11.546030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b5dfb21e-8a96-4210-8e76-322e8d047ae6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:11.547647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b5dfb21e-8a96-4210-8e76-322e8d047ae6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:11.557568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5dfb21e-8a96-4210-8e76-322e8d047ae6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:11.558584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5dfb21e-8a96-4210-8e76-322e8d047ae6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:11.559301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5dfb21e-8a96-4210-8e76-322e8d047ae6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:11.560254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5dfb21e-8a96-4210-8e76-322e8d047ae6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:11.560918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5dfb21e-8a96-4210-8e76-322e8d047ae6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:11.561540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5dfb21e-8a96-4210-8e76-322e8d047ae6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:11.642159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0e182528-2aa8-499d-a228-81e3cd5450b6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:11.643280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0e182528-2aa8-499d-a228-81e3cd5450b6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:11.652284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e182528-2aa8-499d-a228-81e3cd5450b6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:11.653075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e182528-2aa8-499d-a228-81e3cd5450b6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:11.653682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e182528-2aa8-499d-a228-81e3cd5450b6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:11.654617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e182528-2aa8-499d-a228-81e3cd5450b6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:11.655279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e182528-2aa8-499d-a228-81e3cd5450b6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:11.655893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e182528-2aa8-499d-a228-81e3cd5450b6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:11.837251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b5dfb21e-8a96-4210-8e76-322e8d047ae6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:11.838980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0e182528-2aa8-499d-a228-81e3cd5450b6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:11.848336 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b5dfb21e-8a96-4210-8e76-322e8d047ae6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1321 microversion: 2.1 time: 0.306246 Sep 06 11:09:11.850309 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0e182528-2aa8-499d-a228-81e3cd5450b6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1276 microversion: 2.1 time: 0.212591 Sep 06 11:09:11.851403 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2050/4093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:11 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:11.873404 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2044/4094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:11 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:12.137993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2c1d686d-02c5-44a7-a289-09352f2b2e9d tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90fcf77430>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:12.140182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-92aca9aa-67ba-44e5-b676-b9581422e9b4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:12.140875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-92aca9aa-67ba-44e5-b676-b9581422e9b4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:12.175317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92aca9aa-67ba-44e5-b676-b9581422e9b4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:12.180046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92aca9aa-67ba-44e5-b676-b9581422e9b4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:12.180503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92aca9aa-67ba-44e5-b676-b9581422e9b4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:12.181268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92aca9aa-67ba-44e5-b676-b9581422e9b4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:12.181768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92aca9aa-67ba-44e5-b676-b9581422e9b4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:12.182923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92aca9aa-67ba-44e5-b676-b9581422e9b4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:12.236820 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2c1d686d-02c5-44a7-a289-09352f2b2e9d tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.103575 Sep 06 11:09:12.238739 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2045/4095] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:12 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:12.488389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-92aca9aa-67ba-44e5-b676-b9581422e9b4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:12.499776 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-92aca9aa-67ba-44e5-b676-b9581422e9b4 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1505 microversion: 2.1 time: 0.368556 Sep 06 11:09:12.522714 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2051/4096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:12 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1505 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:12.540955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e48091e-4ad6-41da-8a0c-bad7cd10ddbd tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:12.543396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4e48091e-4ad6-41da-8a0c-bad7cd10ddbd tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:12.575479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e48091e-4ad6-41da-8a0c-bad7cd10ddbd tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:12.578620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e48091e-4ad6-41da-8a0c-bad7cd10ddbd tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:12.579771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e48091e-4ad6-41da-8a0c-bad7cd10ddbd tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:12.580967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e48091e-4ad6-41da-8a0c-bad7cd10ddbd tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:12.586099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e48091e-4ad6-41da-8a0c-bad7cd10ddbd tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:12.589816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e48091e-4ad6-41da-8a0c-bad7cd10ddbd tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:12.669133 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e48091e-4ad6-41da-8a0c-bad7cd10ddbd tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e/ips" status: 200 len: 108 microversion: 2.1 time: 0.139868 Sep 06 11:09:12.687269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-171f250c-4c74-4590-991d-887c08ec6c92 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:12.687795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-171f250c-4c74-4590-991d-887c08ec6c92 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:12.691170 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2046/4097] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:09:12 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e/ips => generated 108 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:09:12.695542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-171f250c-4c74-4590-991d-887c08ec6c92 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:12.696056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-171f250c-4c74-4590-991d-887c08ec6c92 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:12.696514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-171f250c-4c74-4590-991d-887c08ec6c92 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:12.697244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-171f250c-4c74-4590-991d-887c08ec6c92 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:12.697712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-171f250c-4c74-4590-991d-887c08ec6c92 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:12.698331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-171f250c-4c74-4590-991d-887c08ec6c92 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:12.733991 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-171f250c-4c74-4590-991d-887c08ec6c92 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e/ips" status: 200 len: 108 microversion: 2.1 time: 0.053973 Sep 06 11:09:12.734834 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2052/4098] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:09:12 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e/ips => generated 108 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:09:12.747517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-89c66910-88ef-4bf6-8725-7dcb5b066ada tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:12.748456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-89c66910-88ef-4bf6-8725-7dcb5b066ada tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:12.756852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89c66910-88ef-4bf6-8725-7dcb5b066ada tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:12.758013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89c66910-88ef-4bf6-8725-7dcb5b066ada tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:12.758632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89c66910-88ef-4bf6-8725-7dcb5b066ada tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:12.768214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89c66910-88ef-4bf6-8725-7dcb5b066ada tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:12.768214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89c66910-88ef-4bf6-8725-7dcb5b066ada tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:12.768214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89c66910-88ef-4bf6-8725-7dcb5b066ada tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:12.801498 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-89c66910-88ef-4bf6-8725-7dcb5b066ada tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e/ips/tempest-ServerAddressesTestJSON-744689367-network" status: 200 len: 93 microversion: 2.1 time: 0.056963 Sep 06 11:09:12.813881 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2047/4099] 10.222.0.20 () {58 vars in 1398 bytes} [Tue Sep 6 11:09:12 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e/ips/tempest-ServerAddressesTestJSON-744689367-network => generated 93 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:09:12.816276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-54fceafd-7d41-412d-bf1f-66a452579abf tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:12.816460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-54fceafd-7d41-412d-bf1f-66a452579abf tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:12.829618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54fceafd-7d41-412d-bf1f-66a452579abf tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:12.830179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54fceafd-7d41-412d-bf1f-66a452579abf tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:12.830650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54fceafd-7d41-412d-bf1f-66a452579abf tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:12.831538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54fceafd-7d41-412d-bf1f-66a452579abf tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:12.832048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54fceafd-7d41-412d-bf1f-66a452579abf tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:12.832496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54fceafd-7d41-412d-bf1f-66a452579abf tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:12.874484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-478699e3-743a-4b71-bca5-058b2f11587e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:12.875762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-478699e3-743a-4b71-bca5-058b2f11587e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:12.894949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-478699e3-743a-4b71-bca5-058b2f11587e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:12.901846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-478699e3-743a-4b71-bca5-058b2f11587e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:12.902580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-478699e3-743a-4b71-bca5-058b2f11587e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:12.905328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-478699e3-743a-4b71-bca5-058b2f11587e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:12.906041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-478699e3-743a-4b71-bca5-058b2f11587e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:12.908097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-478699e3-743a-4b71-bca5-058b2f11587e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:12.917440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-54fceafd-7d41-412d-bf1f-66a452579abf tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:09:12.928626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:13.055537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-478699e3-743a-4b71-bca5-058b2f11587e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:13.070292 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-478699e3-743a-4b71-bca5-058b2f11587e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1284 microversion: 2.1 time: 0.198769 Sep 06 11:09:13.072847 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2048/4100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:12 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:13.085308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c66a3d4-b440-4abc-98cd-83341378ae08 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:13.101085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8c66a3d4-b440-4abc-98cd-83341378ae08 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:13.115892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c66a3d4-b440-4abc-98cd-83341378ae08 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:13.120349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c66a3d4-b440-4abc-98cd-83341378ae08 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:13.121152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c66a3d4-b440-4abc-98cd-83341378ae08 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:13.122167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c66a3d4-b440-4abc-98cd-83341378ae08 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:13.123905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c66a3d4-b440-4abc-98cd-83341378ae08 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:13.124574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c66a3d4-b440-4abc-98cd-83341378ae08 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:13.425233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8c66a3d4-b440-4abc-98cd-83341378ae08 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:13.434643 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8c66a3d4-b440-4abc-98cd-83341378ae08 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1514 microversion: 2.1 time: 0.359899 Sep 06 11:09:13.436901 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2049/4101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:13 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1514 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:13.441710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8d3924dd-9fb4-41d8-9449-f76438c496cd tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f859e790>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:13.446713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:13.578602 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8d3924dd-9fb4-41d8-9449-f76438c496cd tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.138917 Sep 06 11:09:13.586774 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2050/4102] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:13 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:13.596920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-af2a8773-3fbc-4695-9c93-ad869e22c52b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:13.603635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-af2a8773-3fbc-4695-9c93-ad869e22c52b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:13.631752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af2a8773-3fbc-4695-9c93-ad869e22c52b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:13.632552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af2a8773-3fbc-4695-9c93-ad869e22c52b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:13.633022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af2a8773-3fbc-4695-9c93-ad869e22c52b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:13.633779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af2a8773-3fbc-4695-9c93-ad869e22c52b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:13.634323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af2a8773-3fbc-4695-9c93-ad869e22c52b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:13.634772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af2a8773-3fbc-4695-9c93-ad869e22c52b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:13.658373 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-54fceafd-7d41-412d-bf1f-66a452579abf tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 204 len: 0 microversion: 2.1 time: 0.832842 Sep 06 11:09:13.658373 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2053/4103] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:09:12 2022] DELETE /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 0 bytes in 835 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:09:13.901070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-173a4cc0-d513-4be1-93cc-eb110d293b60 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:13.901070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-173a4cc0-d513-4be1-93cc-eb110d293b60 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:13.901070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-173a4cc0-d513-4be1-93cc-eb110d293b60 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:13.901070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-173a4cc0-d513-4be1-93cc-eb110d293b60 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:13.901070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-173a4cc0-d513-4be1-93cc-eb110d293b60 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:13.901070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-173a4cc0-d513-4be1-93cc-eb110d293b60 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:13.901070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-173a4cc0-d513-4be1-93cc-eb110d293b60 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:13.901070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-173a4cc0-d513-4be1-93cc-eb110d293b60 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:13.904304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-af2a8773-3fbc-4695-9c93-ad869e22c52b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lazy-loading 'flavor' on Instance uuid 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:09:14.038287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-173a4cc0-d513-4be1-93cc-eb110d293b60 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:14.052417 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-173a4cc0-d513-4be1-93cc-eb110d293b60 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1511 microversion: 2.1 time: 0.397798 Sep 06 11:09:14.055460 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2054/4104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:13 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1511 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:14.075664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-cacdea63-1215-4f85-8e3c-4f9da3caf4f5 req-c0f27538-07d7-491b-937e-2a4ae35f145a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97907bbb-c089-4899-8d70-8c012daf803b", "name": "network-vif-plugged", "status": "completed", "tag": "76edc669-c87b-4c08-923b-c5192a5d4d54"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:14.093571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-cacdea63-1215-4f85-8e3c-4f9da3caf4f5 req-c0f27538-07d7-491b-937e-2a4ae35f145a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:14.094484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-cacdea63-1215-4f85-8e3c-4f9da3caf4f5 req-c0f27538-07d7-491b-937e-2a4ae35f145a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:14.102897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-cacdea63-1215-4f85-8e3c-4f9da3caf4f5 req-c0f27538-07d7-491b-937e-2a4ae35f145a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:14.112445 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-cacdea63-1215-4f85-8e3c-4f9da3caf4f5 req-c0f27538-07d7-491b-937e-2a4ae35f145a service nova] Creating event network-vif-plugged:76edc669-c87b-4c08-923b-c5192a5d4d54 for instance 97907bbb-c089-4899-8d70-8c012daf803b on nch2-master-1 Sep 06 11:09:14.117776 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-cacdea63-1215-4f85-8e3c-4f9da3caf4f5 req-c0f27538-07d7-491b-937e-2a4ae35f145a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059641 Sep 06 11:09:14.119046 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2055/4105] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:09:14.126550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-42ffcbae-feef-41a5-ba21-729a95edb306 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:14.127570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-42ffcbae-feef-41a5-ba21-729a95edb306 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:14.135355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42ffcbae-feef-41a5-ba21-729a95edb306 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:14.136077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42ffcbae-feef-41a5-ba21-729a95edb306 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:14.137515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42ffcbae-feef-41a5-ba21-729a95edb306 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:14.138426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42ffcbae-feef-41a5-ba21-729a95edb306 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:14.139083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42ffcbae-feef-41a5-ba21-729a95edb306 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:14.139673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42ffcbae-feef-41a5-ba21-729a95edb306 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:14.266009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-42ffcbae-feef-41a5-ba21-729a95edb306 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:14.283443 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-42ffcbae-feef-41a5-ba21-729a95edb306 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1282 microversion: 2.1 time: 0.162723 Sep 06 11:09:14.284352 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2056/4106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:14 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:14.434319 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-af2a8773-3fbc-4695-9c93-ad869e22c52b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3/action" status: 200 len: 32 microversion: 2.1 time: 0.845548 Sep 06 11:09:14.435392 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2051/4107] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:09:13 2022] POST /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3/action => generated 32 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:09:14.445974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b259b020-6adc-40a5-8903-4db5bf4edace tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:14.447202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b259b020-6adc-40a5-8903-4db5bf4edace tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:14.454834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b259b020-6adc-40a5-8903-4db5bf4edace tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:14.455671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b259b020-6adc-40a5-8903-4db5bf4edace tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:14.456336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b259b020-6adc-40a5-8903-4db5bf4edace tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:14.457639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b259b020-6adc-40a5-8903-4db5bf4edace tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:14.458769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b259b020-6adc-40a5-8903-4db5bf4edace tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:14.459671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b259b020-6adc-40a5-8903-4db5bf4edace tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:14.604788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0a8be1f6-6840-4f9d-9574-9f71c86f2309 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f397caf0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:14.700798 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0a8be1f6-6840-4f9d-9574-9f71c86f2309 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.101985 Sep 06 11:09:14.712719 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2052/4108] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:14 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:14.988626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b259b020-6adc-40a5-8903-4db5bf4edace tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:15.006784 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b259b020-6adc-40a5-8903-4db5bf4edace tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.560612 Sep 06 11:09:15.007936 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2057/4109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:14 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:15.082767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-023d894f-6bbd-4289-a7ab-80401b4fc543 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:15.084081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-023d894f-6bbd-4289-a7ab-80401b4fc543 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:15.105325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-023d894f-6bbd-4289-a7ab-80401b4fc543 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:15.105870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-023d894f-6bbd-4289-a7ab-80401b4fc543 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:15.106343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-023d894f-6bbd-4289-a7ab-80401b4fc543 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:15.107134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-023d894f-6bbd-4289-a7ab-80401b4fc543 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:15.109519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-023d894f-6bbd-4289-a7ab-80401b4fc543 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:15.109519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-023d894f-6bbd-4289-a7ab-80401b4fc543 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:15.308528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-65193533-4c2a-4b41-b979-ab2524fa1541 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:15.309167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-65193533-4c2a-4b41-b979-ab2524fa1541 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:15.321095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65193533-4c2a-4b41-b979-ab2524fa1541 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:15.321620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65193533-4c2a-4b41-b979-ab2524fa1541 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:15.322083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65193533-4c2a-4b41-b979-ab2524fa1541 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:15.322823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65193533-4c2a-4b41-b979-ab2524fa1541 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:15.335918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65193533-4c2a-4b41-b979-ab2524fa1541 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:15.337372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65193533-4c2a-4b41-b979-ab2524fa1541 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:15.397684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-023d894f-6bbd-4289-a7ab-80401b4fc543 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:15.407848 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-023d894f-6bbd-4289-a7ab-80401b4fc543 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1511 microversion: 2.1 time: 0.329041 Sep 06 11:09:15.408445 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2053/4110] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:15 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:15.718071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fd61604c-2cdb-4e9d-af8e-a90690481b10 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f8749040>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:15.787805 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fd61604c-2cdb-4e9d-af8e-a90690481b10 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.073604 Sep 06 11:09:15.789881 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2054/4111] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:15 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:15.891827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-65193533-4c2a-4b41-b979-ab2524fa1541 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:15.898697 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-65193533-4c2a-4b41-b979-ab2524fa1541 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1324 microversion: 2.1 time: 0.594202 Sep 06 11:09:15.911232 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2058/4112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:15 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1324 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:16.110717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fce23bee-1941-40f7-b7b8-65a1e77453cc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:16.110717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fce23bee-1941-40f7-b7b8-65a1e77453cc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:16.110717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fce23bee-1941-40f7-b7b8-65a1e77453cc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:16.110717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fce23bee-1941-40f7-b7b8-65a1e77453cc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:16.110717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fce23bee-1941-40f7-b7b8-65a1e77453cc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:16.110717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fce23bee-1941-40f7-b7b8-65a1e77453cc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:16.110717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fce23bee-1941-40f7-b7b8-65a1e77453cc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:16.110717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fce23bee-1941-40f7-b7b8-65a1e77453cc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:16.383150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fce23bee-1941-40f7-b7b8-65a1e77453cc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:16.397485 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fce23bee-1941-40f7-b7b8-65a1e77453cc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.368780 Sep 06 11:09:16.417578 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2055/4113] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:16 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:16.444456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-abbfe9bc-3b57-463d-b667-6d04bf23c333 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:16.445379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-abbfe9bc-3b57-463d-b667-6d04bf23c333 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:16.459523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abbfe9bc-3b57-463d-b667-6d04bf23c333 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:16.460692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abbfe9bc-3b57-463d-b667-6d04bf23c333 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:16.461322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abbfe9bc-3b57-463d-b667-6d04bf23c333 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:16.462970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abbfe9bc-3b57-463d-b667-6d04bf23c333 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:16.463727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abbfe9bc-3b57-463d-b667-6d04bf23c333 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:16.466462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abbfe9bc-3b57-463d-b667-6d04bf23c333 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:16.759527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-abbfe9bc-3b57-463d-b667-6d04bf23c333 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:16.769158 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-abbfe9bc-3b57-463d-b667-6d04bf23c333 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1511 microversion: 2.1 time: 0.330194 Sep 06 11:09:16.771003 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2059/4114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:16 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1511 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:16.806730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-de53103d-ba4d-49e7-8ff9-a264d8623bf5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f870d310>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:16.885090 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-de53103d-ba4d-49e7-8ff9-a264d8623bf5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.077103 Sep 06 11:09:16.885090 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2056/4115] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:16 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:16.925701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dda892f7-d89c-4d43-9baf-b1bcf753894e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:16.926331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dda892f7-d89c-4d43-9baf-b1bcf753894e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:16.941631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dda892f7-d89c-4d43-9baf-b1bcf753894e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:16.945963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dda892f7-d89c-4d43-9baf-b1bcf753894e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:16.946800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dda892f7-d89c-4d43-9baf-b1bcf753894e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:16.949077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dda892f7-d89c-4d43-9baf-b1bcf753894e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:16.949792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dda892f7-d89c-4d43-9baf-b1bcf753894e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:16.951562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dda892f7-d89c-4d43-9baf-b1bcf753894e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:17.087520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:17.424749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3d6c6e9a-433f-4c9a-aab4-d561a6e9b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:17.425401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3d6c6e9a-433f-4c9a-aab4-d561a6e9b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:17.435787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d6c6e9a-433f-4c9a-aab4-d561a6e9b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:17.439728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d6c6e9a-433f-4c9a-aab4-d561a6e9b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:17.440424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d6c6e9a-433f-4c9a-aab4-d561a6e9b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:17.441637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d6c6e9a-433f-4c9a-aab4-d561a6e9b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:17.442250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d6c6e9a-433f-4c9a-aab4-d561a6e9b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:17.444458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d6c6e9a-433f-4c9a-aab4-d561a6e9b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:17.606196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dda892f7-d89c-4d43-9baf-b1bcf753894e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:17.622164 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dda892f7-d89c-4d43-9baf-b1bcf753894e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1324 microversion: 2.1 time: 0.697717 Sep 06 11:09:17.623263 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2060/4116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:16 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1324 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:17.628454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e15c7f95-e17a-4949-9b16-1b392eb03d59 req-d001948c-4725-471a-8c70-dd934f51e12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6b562e-65df-42fb-be91-bf8f1659216e", "name": "network-vif-deleted", "tag": "04a1b4ae-4f04-4559-bb58-4d06e235e632"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:17.645282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e15c7f95-e17a-4949-9b16-1b392eb03d59 req-d001948c-4725-471a-8c70-dd934f51e12d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:17.646465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e15c7f95-e17a-4949-9b16-1b392eb03d59 req-d001948c-4725-471a-8c70-dd934f51e12d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:17.647186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e15c7f95-e17a-4949-9b16-1b392eb03d59 req-d001948c-4725-471a-8c70-dd934f51e12d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:17.672995 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e15c7f95-e17a-4949-9b16-1b392eb03d59 req-d001948c-4725-471a-8c70-dd934f51e12d service nova] Creating event network-vif-deleted:04a1b4ae-4f04-4559-bb58-4d06e235e632 for instance dc6b562e-65df-42fb-be91-bf8f1659216e on nch2-master-1 Sep 06 11:09:17.678587 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e15c7f95-e17a-4949-9b16-1b392eb03d59 req-d001948c-4725-471a-8c70-dd934f51e12d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053647 Sep 06 11:09:17.679838 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2061/4117] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:09:17.786498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3d6c6e9a-433f-4c9a-aab4-d561a6e9b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:17.797462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6f6b058b-513c-41ed-8e43-0969013fcfcb tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:17.798395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6f6b058b-513c-41ed-8e43-0969013fcfcb tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:17.800748 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3d6c6e9a-433f-4c9a-aab4-d561a6e9b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.380929 Sep 06 11:09:17.801919 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2057/4118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:17 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:17.806738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f6b058b-513c-41ed-8e43-0969013fcfcb tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:17.807622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f6b058b-513c-41ed-8e43-0969013fcfcb tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:17.808384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f6b058b-513c-41ed-8e43-0969013fcfcb tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:17.824784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f6b058b-513c-41ed-8e43-0969013fcfcb tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:17.830322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f6b058b-513c-41ed-8e43-0969013fcfcb tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:17.830322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f6b058b-513c-41ed-8e43-0969013fcfcb tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:17.895910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0a46250b-478c-4943-ab9a-9c570fd28eab tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f8d90160>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:17.940265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6f6b058b-513c-41ed-8e43-0969013fcfcb tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:17.953515 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6f6b058b-513c-41ed-8e43-0969013fcfcb tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1302 microversion: 2.1 time: 0.161474 Sep 06 11:09:17.955057 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2062/4119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:17 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1302 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:18.013288 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0a46250b-478c-4943-ab9a-9c570fd28eab tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.121266 Sep 06 11:09:18.022345 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2058/4120] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:17 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:18.659913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-12c0e3c0-5123-4351-a8c3-82deefedd2df tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:18.661561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-12c0e3c0-5123-4351-a8c3-82deefedd2df tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:18.681601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12c0e3c0-5123-4351-a8c3-82deefedd2df tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:18.682124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12c0e3c0-5123-4351-a8c3-82deefedd2df tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:18.682591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12c0e3c0-5123-4351-a8c3-82deefedd2df tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:18.683361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12c0e3c0-5123-4351-a8c3-82deefedd2df tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:18.699408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12c0e3c0-5123-4351-a8c3-82deefedd2df tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:18.699408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12c0e3c0-5123-4351-a8c3-82deefedd2df tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:18.834653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f88d5507-a9c8-4d0a-9e1f-d2f533d4b192 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:18.836202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f88d5507-a9c8-4d0a-9e1f-d2f533d4b192 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:18.850962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f88d5507-a9c8-4d0a-9e1f-d2f533d4b192 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:18.856178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f88d5507-a9c8-4d0a-9e1f-d2f533d4b192 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:18.856887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f88d5507-a9c8-4d0a-9e1f-d2f533d4b192 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:18.860203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f88d5507-a9c8-4d0a-9e1f-d2f533d4b192 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:18.865280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f88d5507-a9c8-4d0a-9e1f-d2f533d4b192 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:18.865280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f88d5507-a9c8-4d0a-9e1f-d2f533d4b192 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:19.097727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-12c0e3c0-5123-4351-a8c3-82deefedd2df tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:19.107537 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-12c0e3c0-5123-4351-a8c3-82deefedd2df tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1324 microversion: 2.1 time: 0.464837 Sep 06 11:09:19.111614 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2063/4121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:18 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1324 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:19.122378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:19.135172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:19.153561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:19.154348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:19.155283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:19.156312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:19.157009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:19.157686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:19.209482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:19.214870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:19.214870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:19.214870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lazy-loading 'fault' on Instance uuid dc6b562e-65df-42fb-be91-bf8f1659216e {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:09:19.247371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f88d5507-a9c8-4d0a-9e1f-d2f533d4b192 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:19.269712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3257d707d4e47bd9c68496acf8788ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1353cb350f4463862e78e75c5b2e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:19.271272 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f88d5507-a9c8-4d0a-9e1f-d2f533d4b192 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.440913 Sep 06 11:09:19.288177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-067aa564-ad1c-4c74-aa32-bcc93d675773 tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 200 len: 1307 microversion: 2.1 time: 0.172934 Sep 06 11:09:19.297658 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2064/4123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:19 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 1307 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:19.300209 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2059/4123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:18 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:19.304494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cc29080c-0b12-42ce-8b9f-0edea65fa987 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3dffee0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:19.376789 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cc29080c-0b12-42ce-8b9f-0edea65fa987 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.077555 Sep 06 11:09:19.377421 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2065/4124] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:19 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:19.706658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-6d66544d-7471-43b6-a5a8-afde10c164ec req-ac264f7b-806a-4c3a-a639-3cf963f0e7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8cd243-7e0d-4b5a-8631-72eabb6e839c", "tag": "a9b657d8-66c0-40d8-88e6-10275deb7cd7"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:19.724568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6d66544d-7471-43b6-a5a8-afde10c164ec req-ac264f7b-806a-4c3a-a639-3cf963f0e7f3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:19.725567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6d66544d-7471-43b6-a5a8-afde10c164ec req-ac264f7b-806a-4c3a-a639-3cf963f0e7f3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:19.725908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6d66544d-7471-43b6-a5a8-afde10c164ec req-ac264f7b-806a-4c3a-a639-3cf963f0e7f3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:19.753506 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-6d66544d-7471-43b6-a5a8-afde10c164ec req-ac264f7b-806a-4c3a-a639-3cf963f0e7f3 service nova] Creating event network-changed:a9b657d8-66c0-40d8-88e6-10275deb7cd7 for instance dc8cd243-7e0d-4b5a-8631-72eabb6e839c on nch1-master-1 Sep 06 11:09:19.763989 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-6d66544d-7471-43b6-a5a8-afde10c164ec req-ac264f7b-806a-4c3a-a639-3cf963f0e7f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061051 Sep 06 11:09:19.764630 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2060/4125] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:09:20.140443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=10 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:20.147674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c37f27b4-a2ff-44c0-9faa-40db2ace4da1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:20.148570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c37f27b4-a2ff-44c0-9faa-40db2ace4da1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:20.164568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c37f27b4-a2ff-44c0-9faa-40db2ace4da1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:20.167746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c37f27b4-a2ff-44c0-9faa-40db2ace4da1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:20.170383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c37f27b4-a2ff-44c0-9faa-40db2ace4da1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:20.171347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c37f27b4-a2ff-44c0-9faa-40db2ace4da1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:20.171919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c37f27b4-a2ff-44c0-9faa-40db2ace4da1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:20.172454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c37f27b4-a2ff-44c0-9faa-40db2ace4da1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:20.305076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0a67f08a-36d5-4b6a-8d62-34cdc485b47d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:20.306743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0a67f08a-36d5-4b6a-8d62-34cdc485b47d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:20.327270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a67f08a-36d5-4b6a-8d62-34cdc485b47d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:20.329431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a67f08a-36d5-4b6a-8d62-34cdc485b47d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:20.330074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a67f08a-36d5-4b6a-8d62-34cdc485b47d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:20.331453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a67f08a-36d5-4b6a-8d62-34cdc485b47d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:20.332260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a67f08a-36d5-4b6a-8d62-34cdc485b47d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:20.333514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a67f08a-36d5-4b6a-8d62-34cdc485b47d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:20.352289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:20.577152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c37f27b4-a2ff-44c0-9faa-40db2ace4da1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:20.590241 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c37f27b4-a2ff-44c0-9faa-40db2ace4da1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1324 microversion: 2.1 time: 0.450671 Sep 06 11:09:20.608057 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2066/4126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:20 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1324 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:20.619413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e898c7f-62ff-4256-b314-468fdedde37e tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:20.620098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e898c7f-62ff-4256-b314-468fdedde37e tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] [instance: dc6b562e-65df-42fb-be91-bf8f1659216e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:20.629155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e898c7f-62ff-4256-b314-468fdedde37e tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:20.629626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e898c7f-62ff-4256-b314-468fdedde37e tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:20.630375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e898c7f-62ff-4256-b314-468fdedde37e tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:20.631281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e898c7f-62ff-4256-b314-468fdedde37e tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:20.631814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e898c7f-62ff-4256-b314-468fdedde37e tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:20.632750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e898c7f-62ff-4256-b314-468fdedde37e tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:20.654112 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-7e898c7f-62ff-4256-b314-468fdedde37e tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] HTTP exception thrown: Instance dc6b562e-65df-42fb-be91-bf8f1659216e could not be found. Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e898c7f-62ff-4256-b314-468fdedde37e tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Request method failure captured: Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e HTTP/1.1 Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyo9_J7aUzWHv1fUIh0nS_nhichzUtL6ssNhCeKSJF5JCFprA-cFJosxmCNbNroHoMcXPY41bfJQ-R8oelBvng5C04ZpnMjLn3b_61xSMgczEuRztkXsrgDqE_ceW86XI1vgLGUeuBiyqwcpEnYon4y9D84AJcOklJoUI-OekbWTb6c Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: eb1353cb350f4463862e78e75c5b2e50 Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerAddressesTestJSON-1500364156 Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eb1353cb350f4463862e78e75c5b2e50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb1353cb350f4463862e78e75c5b2e50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eb1353cb350f4463862e78e75c5b2e50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb1353cb350f4463862e78e75c5b2e50"}]}] Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerAddressesTestJSON-1500364156 Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: eb1353cb350f4463862e78e75c5b2e50 Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1500364156 Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerAddressesTestJSON-1500364156-project Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: b3257d707d4e47bd9c68496acf8788ad Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerAddressesTestJSON-1500364156-project Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance dc6b562e-65df-42fb-be91-bf8f1659216e could not be found. Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'dc6b562e-65df-42fb-be91-bf8f1659216e'} Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6b562e-65df-42fb-be91-bf8f1659216e could not be found. Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6b562e-65df-42fb-be91-bf8f1659216e could not be found. Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:20.656341 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:09:20.663268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:20.663268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:20.663268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:20.663268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:09:20.663268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:09:20.663268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6b562e-65df-42fb-be91-bf8f1659216e could not be found. Sep 06 11:09:20.663268 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:09:20.663268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e898c7f-62ff-4256-b314-468fdedde37e tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] Returning 404 to user: Instance dc6b562e-65df-42fb-be91-bf8f1659216e could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:09:20.663268 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e898c7f-62ff-4256-b314-468fdedde37e tempest-ServerAddressesTestJSON-1500364156 tempest-ServerAddressesTestJSON-1500364156-project] 10.222.0.20 "GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e" status: 404 len: 111 microversion: 2.1 time: 0.048846 Sep 06 11:09:20.664772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0a67f08a-36d5-4b6a-8d62-34cdc485b47d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:20.667204 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2067/4127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:20 2022] GET /compute/v2.1/servers/dc6b562e-65df-42fb-be91-bf8f1659216e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:09:20.674338 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0a67f08a-36d5-4b6a-8d62-34cdc485b47d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.374425 Sep 06 11:09:20.674938 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2061/4128] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:20 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:20.691076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-30ddff1d-eee0-49b4-bb7e-60b8583ecc98 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f8b7dee0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:20.758698 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-30ddff1d-eee0-49b4-bb7e-60b8583ecc98 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.091635 Sep 06 11:09:20.759863 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2068/4129] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:20 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:21.622588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4a0029c8-123d-4570-a512-3be314a30de1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:21.623606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4a0029c8-123d-4570-a512-3be314a30de1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:21.642391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a0029c8-123d-4570-a512-3be314a30de1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:21.642882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a0029c8-123d-4570-a512-3be314a30de1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:21.643357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a0029c8-123d-4570-a512-3be314a30de1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:21.644076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a0029c8-123d-4570-a512-3be314a30de1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:21.644833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a0029c8-123d-4570-a512-3be314a30de1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:21.645307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4a0029c8-123d-4570-a512-3be314a30de1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:21.711343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2d0ad709-0052-4e1c-814f-25187e42afcc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:21.724709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2d0ad709-0052-4e1c-814f-25187e42afcc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:21.748071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d0ad709-0052-4e1c-814f-25187e42afcc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:21.750677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d0ad709-0052-4e1c-814f-25187e42afcc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:21.753142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d0ad709-0052-4e1c-814f-25187e42afcc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:21.757620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d0ad709-0052-4e1c-814f-25187e42afcc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:21.758175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d0ad709-0052-4e1c-814f-25187e42afcc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:21.763142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d0ad709-0052-4e1c-814f-25187e42afcc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:22.299632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2d0ad709-0052-4e1c-814f-25187e42afcc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:22.315333 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2d0ad709-0052-4e1c-814f-25187e42afcc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.613385 Sep 06 11:09:22.316120 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2069/4130] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:21 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:22.325208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a33d0bde-054e-4ff7-939d-95f12c2a3913 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f33cc280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:22.357223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4a0029c8-123d-4570-a512-3be314a30de1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:22.368621 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4a0029c8-123d-4570-a512-3be314a30de1 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1324 microversion: 2.1 time: 0.750132 Sep 06 11:09:22.383369 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2062/4131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:21 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1324 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:22.392768 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a33d0bde-054e-4ff7-939d-95f12c2a3913 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1423 microversion: 2.1 time: 0.075595 Sep 06 11:09:22.393606 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2070/4132] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:22 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:23.346079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1efdbb6a-0c94-4d4c-8dfb-675013e30f43 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:23.347102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1efdbb6a-0c94-4d4c-8dfb-675013e30f43 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:23.365200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1efdbb6a-0c94-4d4c-8dfb-675013e30f43 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:23.366151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1efdbb6a-0c94-4d4c-8dfb-675013e30f43 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:23.367095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1efdbb6a-0c94-4d4c-8dfb-675013e30f43 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:23.368383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1efdbb6a-0c94-4d4c-8dfb-675013e30f43 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:23.369725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1efdbb6a-0c94-4d4c-8dfb-675013e30f43 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:23.370569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1efdbb6a-0c94-4d4c-8dfb-675013e30f43 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:23.398222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f342038c-cb84-4558-8235-7e6ff5c87fb3 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:23.399131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f342038c-cb84-4558-8235-7e6ff5c87fb3 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:23.425546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f342038c-cb84-4558-8235-7e6ff5c87fb3 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:23.426056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f342038c-cb84-4558-8235-7e6ff5c87fb3 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:23.426541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f342038c-cb84-4558-8235-7e6ff5c87fb3 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:23.427350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f342038c-cb84-4558-8235-7e6ff5c87fb3 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:23.427848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f342038c-cb84-4558-8235-7e6ff5c87fb3 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:23.428287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f342038c-cb84-4558-8235-7e6ff5c87fb3 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:23.805182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f342038c-cb84-4558-8235-7e6ff5c87fb3 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:23.810332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1efdbb6a-0c94-4d4c-8dfb-675013e30f43 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:23.826745 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1efdbb6a-0c94-4d4c-8dfb-675013e30f43 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.488347 Sep 06 11:09:23.828133 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f342038c-cb84-4558-8235-7e6ff5c87fb3 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1324 microversion: 2.1 time: 0.437263 Sep 06 11:09:23.829305 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2063/4133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:23 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:23.831104 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2071/4134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:23 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1324 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:23.835853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e443cf4-229a-46f7-9efa-e338bca76fc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f39fcee0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:23.903109 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5e443cf4-229a-46f7-9efa-e338bca76fc5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1432 microversion: 2.1 time: 0.072200 Sep 06 11:09:23.914705 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2064/4135] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:23 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1432 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:23.919116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f31d08cf-aa4a-4661-967e-b3e3d98b9776 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f33cc5e0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:24.013519 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f31d08cf-aa4a-4661-967e-b3e3d98b9776 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 200 len: 1432 microversion: 2.1 time: 0.098753 Sep 06 11:09:24.031042 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2072/4136] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:23 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 1432 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:24.037923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-17129991-32a5-4ba9-8e29-1c7684fdd4e7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:24.041017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-17129991-32a5-4ba9-8e29-1c7684fdd4e7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:24.044910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17129991-32a5-4ba9-8e29-1c7684fdd4e7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:24.045420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17129991-32a5-4ba9-8e29-1c7684fdd4e7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:24.045874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17129991-32a5-4ba9-8e29-1c7684fdd4e7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:24.046826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17129991-32a5-4ba9-8e29-1c7684fdd4e7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:24.047321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17129991-32a5-4ba9-8e29-1c7684fdd4e7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:24.047945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17129991-32a5-4ba9-8e29-1c7684fdd4e7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:24.285433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-17129991-32a5-4ba9-8e29-1c7684fdd4e7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:24.297449 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-17129991-32a5-4ba9-8e29-1c7684fdd4e7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1467 microversion: 2.1 time: 0.264664 Sep 06 11:09:24.298280 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2065/4137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:24 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1467 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:24.321581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0affffae-ee3c-4f80-ba9b-99af22ba30c4 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f857e8b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:24.376417 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0affffae-ee3c-4f80-ba9b-99af22ba30c4 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f" status: 200 len: 784 microversion: 2.1 time: 0.058809 Sep 06 11:09:24.377708 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2073/4138] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:24 2022] GET /compute/v2.1/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f => generated 784 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:09:24.398701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2bbb9e9d-ab42-4a62-819a-b454861e71e4 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:24.413176 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2bbb9e9d-ab42-4a62-819a-b454861e71e4 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022959 Sep 06 11:09:24.419990 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2066/4139] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 11:09:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:09:24.429444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-09cf89af-c338-4b47-99ac-2a96f31a3eb7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90fd1173a0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:24.725425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-68479f6a-adb8-4c0f-a7b4-af7b7b86c795 req-bc92517d-a07f-4381-a3c8-abe2cd407521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8cd243-7e0d-4b5a-8631-72eabb6e839c", "name": "network-vif-plugged", "status": "completed", "tag": "a9b657d8-66c0-40d8-88e6-10275deb7cd7"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:24.745606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-68479f6a-adb8-4c0f-a7b4-af7b7b86c795 req-bc92517d-a07f-4381-a3c8-abe2cd407521 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:24.746098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-68479f6a-adb8-4c0f-a7b4-af7b7b86c795 req-bc92517d-a07f-4381-a3c8-abe2cd407521 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:24.746651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-68479f6a-adb8-4c0f-a7b4-af7b7b86c795 req-bc92517d-a07f-4381-a3c8-abe2cd407521 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:24.763627 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-68479f6a-adb8-4c0f-a7b4-af7b7b86c795 req-bc92517d-a07f-4381-a3c8-abe2cd407521 service nova] Creating event network-vif-plugged:a9b657d8-66c0-40d8-88e6-10275deb7cd7 for instance dc8cd243-7e0d-4b5a-8631-72eabb6e839c on nch1-master-1 Sep 06 11:09:24.769097 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-68479f6a-adb8-4c0f-a7b4-af7b7b86c795 req-bc92517d-a07f-4381-a3c8-abe2cd407521 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047491 Sep 06 11:09:24.770823 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2067/4140] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:09:24.853348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0d9f7b68-047b-4beb-8b0c-8678d3cd2323 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:24.854065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0d9f7b68-047b-4beb-8b0c-8678d3cd2323 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:24.871848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9f7b68-047b-4beb-8b0c-8678d3cd2323 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:24.872348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9f7b68-047b-4beb-8b0c-8678d3cd2323 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:24.886928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9f7b68-047b-4beb-8b0c-8678d3cd2323 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:24.888051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9f7b68-047b-4beb-8b0c-8678d3cd2323 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:24.888407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9f7b68-047b-4beb-8b0c-8678d3cd2323 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:24.888928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9f7b68-047b-4beb-8b0c-8678d3cd2323 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:25.516321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0d9f7b68-047b-4beb-8b0c-8678d3cd2323 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:25.532933 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0d9f7b68-047b-4beb-8b0c-8678d3cd2323 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.683846 Sep 06 11:09:25.536412 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2068/4141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:24 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:25.542206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2e945482-3e59-4835-8678-b145c79b820b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:25.542841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2e945482-3e59-4835-8678-b145c79b820b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:25.550315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e945482-3e59-4835-8678-b145c79b820b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:25.568228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e945482-3e59-4835-8678-b145c79b820b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:25.568228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e945482-3e59-4835-8678-b145c79b820b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:25.568228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e945482-3e59-4835-8678-b145c79b820b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:25.568228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e945482-3e59-4835-8678-b145c79b820b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:25.568228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e945482-3e59-4835-8678-b145c79b820b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:25.899831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2e945482-3e59-4835-8678-b145c79b820b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:25.899831 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2e945482-3e59-4835-8678-b145c79b820b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1324 microversion: 2.1 time: 0.351138 Sep 06 11:09:25.899831 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2069/4142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:25 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1324 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:26.267597 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-09cf89af-c338-4b47-99ac-2a96f31a3eb7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "DELETE /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 204 len: 0 microversion: 2.1 time: 1.843913 Sep 06 11:09:26.272319 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2074/4143] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:24 2022] DELETE /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 0 bytes in 1845 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:09:26.277586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-98c93e4f-4525-4af3-a0af-73914f2f95f8 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3773280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:26.304376 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-98c93e4f-4525-4af3-a0af-73914f2f95f8 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] HTTP exception thrown: Image not found. Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-98c93e4f-4525-4af3-a0af-73914f2f95f8 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Request method failure captured: Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 HTTP/1.1 Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyoqKcjLxHxUSZXcDUu0vw_xyPqyN7FJlKebgqxyWNs6pE8E1kaJyktQHlBXm_WzqgfytA1v7f3stYZOVul9hkcuOTaIh8NQH5EZqf5s3wzVchfbCJNtGBabI_G0860DV_NEMF05u5EOrKZjV4L7vTvj6RqobU8WwiXvTUuwVf1seDI Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3298773c4bd9452c90a38334e7a0cdc1 Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesOneServerTestJSON-1432909336 Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3298773c4bd9452c90a38334e7a0cdc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3298773c4bd9452c90a38334e7a0cdc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3298773c4bd9452c90a38334e7a0cdc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3298773c4bd9452c90a38334e7a0cdc1"}]}] Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesOneServerTestJSON-1432909336 Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3298773c4bd9452c90a38334e7a0cdc1 Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1432909336 Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesOneServerTestJSON-1432909336-project Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: f160a950e90c445698d7f5ea36944398 Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesOneServerTestJSON-1432909336-project Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: exception: Image not found. Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '5beb9ed4-96fd-478a-aa8f-9e870c6e6d14'} Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 06 11:09:26.316595 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 could not be found. Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-98c93e4f-4525-4af3-a0af-73914f2f95f8 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Returning 404 to user: Image not found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-98c93e4f-4525-4af3-a0af-73914f2f95f8 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 404 len: 62 microversion: 2.1 time: 0.046382 Sep 06 11:09:26.321431 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2070/4144] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:26 2022] GET /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:09:26.337207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f6efe014-6748-42d0-b0df-93558d5c348e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-256658723"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:26.340143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f6efe014-6748-42d0-b0df-93558d5c348e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:26.346926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6efe014-6748-42d0-b0df-93558d5c348e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:26.347524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6efe014-6748-42d0-b0df-93558d5c348e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:26.347972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6efe014-6748-42d0-b0df-93558d5c348e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:26.348688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6efe014-6748-42d0-b0df-93558d5c348e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:26.349161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6efe014-6748-42d0-b0df-93558d5c348e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:26.349593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6efe014-6748-42d0-b0df-93558d5c348e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:26.578055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0e43d738-4a68-46b9-8ce2-16d06007de76 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:26.581875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0e43d738-4a68-46b9-8ce2-16d06007de76 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:26.597791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e43d738-4a68-46b9-8ce2-16d06007de76 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:26.599278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e43d738-4a68-46b9-8ce2-16d06007de76 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:26.600322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e43d738-4a68-46b9-8ce2-16d06007de76 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:26.603175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e43d738-4a68-46b9-8ce2-16d06007de76 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:26.604302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e43d738-4a68-46b9-8ce2-16d06007de76 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:26.619328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e43d738-4a68-46b9-8ce2-16d06007de76 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:26.684197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:27.043875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0e43d738-4a68-46b9-8ce2-16d06007de76 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:27.064692 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f6efe014-6748-42d0-b0df-93558d5c348e tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "POST /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05/action" status: 202 len: 0 microversion: 2.1 time: 0.733114 Sep 06 11:09:27.074974 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2075/4145] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:09:26 2022] POST /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05/action => generated 0 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 06 11:09:27.080177 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0e43d738-4a68-46b9-8ce2-16d06007de76 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.502073 Sep 06 11:09:27.096236 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2071/4146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:26 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:27.097402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6e3f63e3-f541-49ce-a715-c90baf5653d7 req-6ab5898f-400c-4884-b953-d3c20db890f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8762ab58-4c4e-4711-9e22-0a35fe149c05", "name": "network-vif-unplugged", "status": "completed", "tag": "655e13ee-c750-4d4e-a975-d750b1032e66"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:27.108626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-33ecb7fc-f4e6-4e72-bedf-1b422cbe1536 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:27.109252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-33ecb7fc-f4e6-4e72-bedf-1b422cbe1536 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:27.119159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6e3f63e3-f541-49ce-a715-c90baf5653d7 req-6ab5898f-400c-4884-b953-d3c20db890f3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:27.119950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6e3f63e3-f541-49ce-a715-c90baf5653d7 req-6ab5898f-400c-4884-b953-d3c20db890f3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:27.120133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33ecb7fc-f4e6-4e72-bedf-1b422cbe1536 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:27.120791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6e3f63e3-f541-49ce-a715-c90baf5653d7 req-6ab5898f-400c-4884-b953-d3c20db890f3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:27.120977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33ecb7fc-f4e6-4e72-bedf-1b422cbe1536 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:27.121590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33ecb7fc-f4e6-4e72-bedf-1b422cbe1536 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:27.122477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33ecb7fc-f4e6-4e72-bedf-1b422cbe1536 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:27.123144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33ecb7fc-f4e6-4e72-bedf-1b422cbe1536 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:27.123740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33ecb7fc-f4e6-4e72-bedf-1b422cbe1536 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:27.138144 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6e3f63e3-f541-49ce-a715-c90baf5653d7 req-6ab5898f-400c-4884-b953-d3c20db890f3 service nova] Creating event network-vif-unplugged:655e13ee-c750-4d4e-a975-d750b1032e66 for instance 8762ab58-4c4e-4711-9e22-0a35fe149c05 on nch1-master-1 Sep 06 11:09:27.146265 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6e3f63e3-f541-49ce-a715-c90baf5653d7 req-6ab5898f-400c-4884-b953-d3c20db890f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068488 Sep 06 11:09:27.151221 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2076/4147] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:09:27.158856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2adfbe77-3a69-4955-b7c3-76bbf340a4e7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f8b7dee0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:27.235744 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2adfbe77-3a69-4955-b7c3-76bbf340a4e7 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.081401 Sep 06 11:09:27.236358 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2077/4148] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:27 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:27.473990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-33ecb7fc-f4e6-4e72-bedf-1b422cbe1536 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:27.487625 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-33ecb7fc-f4e6-4e72-bedf-1b422cbe1536 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1521 microversion: 2.1 time: 0.383178 Sep 06 11:09:27.488471 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2072/4149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:27 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:27.516920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-851e7150-89da-461c-9e94-aefb9fc5da54 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:27.518926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-851e7150-89da-461c-9e94-aefb9fc5da54 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:27.540872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-851e7150-89da-461c-9e94-aefb9fc5da54 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:27.541476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-851e7150-89da-461c-9e94-aefb9fc5da54 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:27.542831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-851e7150-89da-461c-9e94-aefb9fc5da54 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:27.543650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-851e7150-89da-461c-9e94-aefb9fc5da54 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:27.544175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-851e7150-89da-461c-9e94-aefb9fc5da54 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:27.547886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-851e7150-89da-461c-9e94-aefb9fc5da54 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:27.598494 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-851e7150-89da-461c-9e94-aefb9fc5da54 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] HTTP exception thrown: Instance is not a member of specified network Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-851e7150-89da-461c-9e94-aefb9fc5da54 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Request method failure captured: Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c/ips/invalid HTTP/1.1 Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFypQ5YmJXnBTcyhF8Zt9OkR6hjfM9lZUJHn4Bguwm-gtyiQ9wKzaRAqd0BIzOKPomlGupIUF_GP5EZHiVgKZl7LwDp0WuzLlTMcWvcxh2zrFdNIBEzYpFHc_Vbjwufq7AIfuLXP65jccQtxnzFACuHZv7wxNhe76p6c6wl0fe-aBloI Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 2b481aea2f954dd7a003f847cff2cbeb Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1970412495 Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2b481aea2f954dd7a003f847cff2cbeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2b481aea2f954dd7a003f847cff2cbeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2b481aea2f954dd7a003f847cff2cbeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2b481aea2f954dd7a003f847cff2cbeb"}]}] Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1970412495 Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 2b481aea2f954dd7a003f847cff2cbeb Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1970412495 Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerAddressesNegativeTestJSON-1970412495-project Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: e8fa57e6acb6405788cdacdf1b318c10 Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1970412495-project Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance is not a member of specified network Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'server_id': 'dc8cd243-7e0d-4b5a-8631-72eabb6e839c', 'id': 'invalid'} Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 06 11:09:27.614577 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:09:27.617899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-851e7150-89da-461c-9e94-aefb9fc5da54 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Returning 404 to user: Instance is not a member of specified network {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:09:27.617899 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-851e7150-89da-461c-9e94-aefb9fc5da54 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.105321 Sep 06 11:09:27.623225 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2078/4150] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:09:27 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c/ips/invalid => generated 91 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:09:27.628052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f04c3973-18b5-4523-88e4-dd8c7efb8fce tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:27.628052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f04c3973-18b5-4523-88e4-dd8c7efb8fce tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Failed to fetch instance by id 999 {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 06 11:09:27.628052 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-f04c3973-18b5-4523-88e4-dd8c7efb8fce tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] HTTP exception thrown: Instance 999 could not be found. Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f04c3973-18b5-4523-88e4-dd8c7efb8fce tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Request method failure captured: Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFypQ5YmJXnBTcyhF8Zt9OkR6hjfM9lZUJHn4Bguwm-gtyiQ9wKzaRAqd0BIzOKPomlGupIUF_GP5EZHiVgKZl7LwDp0WuzLlTMcWvcxh2zrFdNIBEzYpFHc_Vbjwufq7AIfuLXP65jccQtxnzFACuHZv7wxNhe76p6c6wl0fe-aBloI Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2b481aea2f954dd7a003f847cff2cbeb Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1970412495 Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2b481aea2f954dd7a003f847cff2cbeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2b481aea2f954dd7a003f847cff2cbeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2b481aea2f954dd7a003f847cff2cbeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2b481aea2f954dd7a003f847cff2cbeb"}]}] Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1970412495 Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2b481aea2f954dd7a003f847cff2cbeb Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1970412495 Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerAddressesNegativeTestJSON-1970412495-project Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e8fa57e6acb6405788cdacdf1b318c10 Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1970412495-project Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 999 could not be found. Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'server_id': '999'} Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 06 11:09:27.631447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:27.636483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f04c3973-18b5-4523-88e4-dd8c7efb8fce tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Returning 404 to user: Instance 999 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:09:27.636483 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f04c3973-18b5-4523-88e4-dd8c7efb8fce tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.009938 Sep 06 11:09:27.639070 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2073/4151] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 11:09:27 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:09:27.650658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fa63938b-d976-4cf9-b83a-ba21e176cefe tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:27.651782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fa63938b-d976-4cf9-b83a-ba21e176cefe tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:27.680467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa63938b-d976-4cf9-b83a-ba21e176cefe tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:27.680467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa63938b-d976-4cf9-b83a-ba21e176cefe tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:27.680467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa63938b-d976-4cf9-b83a-ba21e176cefe tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:27.680467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa63938b-d976-4cf9-b83a-ba21e176cefe tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:27.680467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa63938b-d976-4cf9-b83a-ba21e176cefe tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:27.680467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa63938b-d976-4cf9-b83a-ba21e176cefe tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:27.727950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fa63938b-d976-4cf9-b83a-ba21e176cefe tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:09:28.106361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2960e45b-e0ae-44e3-8c65-b7d38d6c0d7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:28.107171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2960e45b-e0ae-44e3-8c65-b7d38d6c0d7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:28.119648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2960e45b-e0ae-44e3-8c65-b7d38d6c0d7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:28.120089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2960e45b-e0ae-44e3-8c65-b7d38d6c0d7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:28.120795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2960e45b-e0ae-44e3-8c65-b7d38d6c0d7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:28.121658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2960e45b-e0ae-44e3-8c65-b7d38d6c0d7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:28.122406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2960e45b-e0ae-44e3-8c65-b7d38d6c0d7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:28.122879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2960e45b-e0ae-44e3-8c65-b7d38d6c0d7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:28.293550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2960e45b-e0ae-44e3-8c65-b7d38d6c0d7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:28.302254 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2960e45b-e0ae-44e3-8c65-b7d38d6c0d7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.201931 Sep 06 11:09:28.302846 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2074/4152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:28 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:28.313515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3985f260-1a32-4455-a642-385ed436b47c tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f39a1dc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:28.367997 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3985f260-1a32-4455-a642-385ed436b47c tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.064039 Sep 06 11:09:28.368622 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2075/4153] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:28 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:28.383162 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fa63938b-d976-4cf9-b83a-ba21e176cefe tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 204 len: 0 microversion: 2.1 time: 0.742605 Sep 06 11:09:28.384162 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2079/4154] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:09:27 2022] DELETE /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:09:28.393382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ff3cabcc-691a-4c23-b3c0-fd4b8276f876 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:28.396414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ff3cabcc-691a-4c23-b3c0-fd4b8276f876 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:28.403093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff3cabcc-691a-4c23-b3c0-fd4b8276f876 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:28.403640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff3cabcc-691a-4c23-b3c0-fd4b8276f876 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:28.404179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff3cabcc-691a-4c23-b3c0-fd4b8276f876 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:28.405093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff3cabcc-691a-4c23-b3c0-fd4b8276f876 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:28.405558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff3cabcc-691a-4c23-b3c0-fd4b8276f876 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:28.406164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff3cabcc-691a-4c23-b3c0-fd4b8276f876 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:28.624128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ff3cabcc-691a-4c23-b3c0-fd4b8276f876 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:28.634320 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ff3cabcc-691a-4c23-b3c0-fd4b8276f876 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1527 microversion: 2.1 time: 0.244839 Sep 06 11:09:28.635683 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2076/4155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:28 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1527 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:29.336187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ae5672aa-af7c-42dc-8af0-ec73da4f31b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:29.337675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ae5672aa-af7c-42dc-8af0-ec73da4f31b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:29.345842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae5672aa-af7c-42dc-8af0-ec73da4f31b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:29.346867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae5672aa-af7c-42dc-8af0-ec73da4f31b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:29.347327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae5672aa-af7c-42dc-8af0-ec73da4f31b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:29.348217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae5672aa-af7c-42dc-8af0-ec73da4f31b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:29.349047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae5672aa-af7c-42dc-8af0-ec73da4f31b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:29.349644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae5672aa-af7c-42dc-8af0-ec73da4f31b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:29.388209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-277c57f7-657a-4608-a89c-703e1d4a0d49 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f33721f0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:29.450107 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-277c57f7-657a-4608-a89c-703e1d4a0d49 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.068975 Sep 06 11:09:29.451233 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2077/4156] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:29 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:29.580871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ae5672aa-af7c-42dc-8af0-ec73da4f31b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:29.592977 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ae5672aa-af7c-42dc-8af0-ec73da4f31b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.264343 Sep 06 11:09:29.596542 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2080/4157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:29 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:29.665563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e901012d-786b-4359-b40d-d824e48df76b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:29.666387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e901012d-786b-4359-b40d-d824e48df76b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:29.668675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=98 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:29.674853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e901012d-786b-4359-b40d-d824e48df76b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:29.675386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e901012d-786b-4359-b40d-d824e48df76b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:29.675843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e901012d-786b-4359-b40d-d824e48df76b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:29.677269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e901012d-786b-4359-b40d-d824e48df76b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:29.677555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e901012d-786b-4359-b40d-d824e48df76b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:29.682103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e901012d-786b-4359-b40d-d824e48df76b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:29.847436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e901012d-786b-4359-b40d-d824e48df76b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:29.856597 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e901012d-786b-4359-b40d-d824e48df76b tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1527 microversion: 2.1 time: 0.195800 Sep 06 11:09:29.857187 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2078/4158] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:29 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1527 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:30.480948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ad7a5fdc-51f8-4167-b328-fa7f4982e91c tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3dbb550>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:30.546626 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ad7a5fdc-51f8-4167-b328-fa7f4982e91c tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.081664 Sep 06 11:09:30.547833 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2081/4159] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:30 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:30.620899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c90acac5-f4b1-480b-bd12-481063cea30a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:30.621548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c90acac5-f4b1-480b-bd12-481063cea30a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:30.630510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c90acac5-f4b1-480b-bd12-481063cea30a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:30.632941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c90acac5-f4b1-480b-bd12-481063cea30a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:30.632941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c90acac5-f4b1-480b-bd12-481063cea30a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:30.632941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c90acac5-f4b1-480b-bd12-481063cea30a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:30.633599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c90acac5-f4b1-480b-bd12-481063cea30a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:30.634202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c90acac5-f4b1-480b-bd12-481063cea30a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:30.674815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-0df5d5d2-7b7a-487b-b84a-cd9c05e1f51c req-c78555f8-381c-453f-a281-69bcb567c016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8cd243-7e0d-4b5a-8631-72eabb6e839c", "name": "network-vif-deleted", "tag": "a9b657d8-66c0-40d8-88e6-10275deb7cd7"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:30.692694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0df5d5d2-7b7a-487b-b84a-cd9c05e1f51c req-c78555f8-381c-453f-a281-69bcb567c016 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:30.693499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0df5d5d2-7b7a-487b-b84a-cd9c05e1f51c req-c78555f8-381c-453f-a281-69bcb567c016 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:30.694107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0df5d5d2-7b7a-487b-b84a-cd9c05e1f51c req-c78555f8-381c-453f-a281-69bcb567c016 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:30.713292 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-0df5d5d2-7b7a-487b-b84a-cd9c05e1f51c req-c78555f8-381c-453f-a281-69bcb567c016 service nova] Creating event network-vif-deleted:a9b657d8-66c0-40d8-88e6-10275deb7cd7 for instance dc8cd243-7e0d-4b5a-8631-72eabb6e839c on nch1-master-1 Sep 06 11:09:30.725675 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-0df5d5d2-7b7a-487b-b84a-cd9c05e1f51c req-c78555f8-381c-453f-a281-69bcb567c016 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056911 Sep 06 11:09:30.727697 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2082/4160] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:09:30.862187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c90acac5-f4b1-480b-bd12-481063cea30a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:30.872845 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c90acac5-f4b1-480b-bd12-481063cea30a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.257979 Sep 06 11:09:30.874158 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2079/4161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:30 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:30.893550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bc47d685-4412-44d3-bf05-5bb5ce6289d6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:30.894335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bc47d685-4412-44d3-bf05-5bb5ce6289d6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:30.915477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc47d685-4412-44d3-bf05-5bb5ce6289d6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:30.915982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc47d685-4412-44d3-bf05-5bb5ce6289d6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:30.916645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc47d685-4412-44d3-bf05-5bb5ce6289d6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:30.917550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc47d685-4412-44d3-bf05-5bb5ce6289d6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:30.918176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc47d685-4412-44d3-bf05-5bb5ce6289d6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:30.918780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc47d685-4412-44d3-bf05-5bb5ce6289d6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:31.016738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bc47d685-4412-44d3-bf05-5bb5ce6289d6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:31.034086 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bc47d685-4412-44d3-bf05-5bb5ce6289d6 tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1309 microversion: 2.1 time: 0.145062 Sep 06 11:09:31.048608 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2083/4162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:30 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1309 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:31.564238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-95256de2-ceaa-4342-bb81-193f41031f51 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f859e0d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:31.649408 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-95256de2-ceaa-4342-bb81-193f41031f51 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.089620 Sep 06 11:09:31.650502 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2080/4163] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:31 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:31.915535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4e642ad0-38c0-4df8-babf-e041ce06f0b6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:31.918072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4e642ad0-38c0-4df8-babf-e041ce06f0b6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:31.929275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e642ad0-38c0-4df8-babf-e041ce06f0b6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:31.930286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e642ad0-38c0-4df8-babf-e041ce06f0b6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:31.931058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e642ad0-38c0-4df8-babf-e041ce06f0b6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:31.932690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e642ad0-38c0-4df8-babf-e041ce06f0b6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:31.933593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e642ad0-38c0-4df8-babf-e041ce06f0b6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:31.934365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e642ad0-38c0-4df8-babf-e041ce06f0b6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:32.058869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:32.060821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:32.081505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:32.084541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:32.085437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:32.086416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:32.087640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:32.088349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:32.139051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4e642ad0-38c0-4df8-babf-e041ce06f0b6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:32.147788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:32.151505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:32.152285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:32.153022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lazy-loading 'fault' on Instance uuid dc8cd243-7e0d-4b5a-8631-72eabb6e839c {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:09:32.156264 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4e642ad0-38c0-4df8-babf-e041ce06f0b6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.252852 Sep 06 11:09:32.156891 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2084/4164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:31 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:32.215941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fa57e6acb6405788cdacdf1b318c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b481aea2f954dd7a003f847cff2cbeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:32.224794 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-af36de6f-f5fb-401b-968c-ac546b1e5d9e tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 200 len: 1314 microversion: 2.1 time: 0.170233 Sep 06 11:09:32.225383 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2081/4165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:32 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:32.258552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-98e56538-14bb-4ba2-9aed-8268832344f9 req-bd79de34-9e7e-460d-8d88-7f8fcccce420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8762ab58-4c4e-4711-9e22-0a35fe149c05", "name": "network-vif-plugged", "status": "completed", "tag": "655e13ee-c750-4d4e-a975-d750b1032e66"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:32.270965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-98e56538-14bb-4ba2-9aed-8268832344f9 req-bd79de34-9e7e-460d-8d88-7f8fcccce420 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:32.271480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-98e56538-14bb-4ba2-9aed-8268832344f9 req-bd79de34-9e7e-460d-8d88-7f8fcccce420 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:32.271929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-98e56538-14bb-4ba2-9aed-8268832344f9 req-bd79de34-9e7e-460d-8d88-7f8fcccce420 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:32.283467 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-98e56538-14bb-4ba2-9aed-8268832344f9 req-bd79de34-9e7e-460d-8d88-7f8fcccce420 service nova] Creating event network-vif-plugged:655e13ee-c750-4d4e-a975-d750b1032e66 for instance 8762ab58-4c4e-4711-9e22-0a35fe149c05 on nch1-master-1 Sep 06 11:09:32.289141 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-98e56538-14bb-4ba2-9aed-8268832344f9 req-bd79de34-9e7e-460d-8d88-7f8fcccce420 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035743 Sep 06 11:09:32.289755 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2085/4166] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:09:32.666870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e566d6b9-6c1c-437c-a401-e5f9017443d2 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3760940>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:32.745614 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e566d6b9-6c1c-437c-a401-e5f9017443d2 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.082685 Sep 06 11:09:32.746691 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2082/4167] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:32 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:33.185866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f2a6d2e8-1013-4b11-963a-7944d6fb7646 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:33.187362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f2a6d2e8-1013-4b11-963a-7944d6fb7646 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:33.205518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2a6d2e8-1013-4b11-963a-7944d6fb7646 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:33.206244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2a6d2e8-1013-4b11-963a-7944d6fb7646 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:33.206819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2a6d2e8-1013-4b11-963a-7944d6fb7646 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:33.208395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2a6d2e8-1013-4b11-963a-7944d6fb7646 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:33.209220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2a6d2e8-1013-4b11-963a-7944d6fb7646 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:33.209921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2a6d2e8-1013-4b11-963a-7944d6fb7646 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:33.253477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-065c9c77-dbc4-4bdb-8276-9e41fb5fb9cb tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:33.256775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-065c9c77-dbc4-4bdb-8276-9e41fb5fb9cb tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] [instance: dc8cd243-7e0d-4b5a-8631-72eabb6e839c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:33.288980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-065c9c77-dbc4-4bdb-8276-9e41fb5fb9cb tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:33.290553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-065c9c77-dbc4-4bdb-8276-9e41fb5fb9cb tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:33.291397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-065c9c77-dbc4-4bdb-8276-9e41fb5fb9cb tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:33.292389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-065c9c77-dbc4-4bdb-8276-9e41fb5fb9cb tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:33.293027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-065c9c77-dbc4-4bdb-8276-9e41fb5fb9cb tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:33.294296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-065c9c77-dbc4-4bdb-8276-9e41fb5fb9cb tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:33.339491 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-065c9c77-dbc4-4bdb-8276-9e41fb5fb9cb tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] HTTP exception thrown: Instance dc8cd243-7e0d-4b5a-8631-72eabb6e839c could not be found. Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-065c9c77-dbc4-4bdb-8276-9e41fb5fb9cb tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Request method failure captured: Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c HTTP/1.1 Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFypQ5YmJXnBTcyhF8Zt9OkR6hjfM9lZUJHn4Bguwm-gtyiQ9wKzaRAqd0BIzOKPomlGupIUF_GP5EZHiVgKZl7LwDp0WuzLlTMcWvcxh2zrFdNIBEzYpFHc_Vbjwufq7AIfuLXP65jccQtxnzFACuHZv7wxNhe76p6c6wl0fe-aBloI Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2b481aea2f954dd7a003f847cff2cbeb Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1970412495 Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2b481aea2f954dd7a003f847cff2cbeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2b481aea2f954dd7a003f847cff2cbeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2b481aea2f954dd7a003f847cff2cbeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2b481aea2f954dd7a003f847cff2cbeb"}]}] Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1970412495 Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2b481aea2f954dd7a003f847cff2cbeb Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1970412495 Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerAddressesNegativeTestJSON-1970412495-project Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: e8fa57e6acb6405788cdacdf1b318c10 Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1970412495-project Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance dc8cd243-7e0d-4b5a-8631-72eabb6e839c could not be found. Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'dc8cd243-7e0d-4b5a-8631-72eabb6e839c'} Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8cd243-7e0d-4b5a-8631-72eabb6e839c could not be found. Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8cd243-7e0d-4b5a-8631-72eabb6e839c could not be found. Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:33.342076 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:33.345586 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:33.345586 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:33.345586 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:33.345586 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:33.345586 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:09:33.345586 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:09:33.345586 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8cd243-7e0d-4b5a-8631-72eabb6e839c could not be found. Sep 06 11:09:33.345586 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:33.354130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-065c9c77-dbc4-4bdb-8276-9e41fb5fb9cb tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] Returning 404 to user: Instance dc8cd243-7e0d-4b5a-8631-72eabb6e839c could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:09:33.359263 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-065c9c77-dbc4-4bdb-8276-9e41fb5fb9cb tempest-ServerAddressesNegativeTestJSON-1970412495 tempest-ServerAddressesNegativeTestJSON-1970412495-project] 10.222.0.20 "GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c" status: 404 len: 111 microversion: 2.1 time: 0.109599 Sep 06 11:09:33.360728 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2083/4168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:33 2022] GET /compute/v2.1/servers/dc8cd243-7e0d-4b5a-8631-72eabb6e839c => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:09:33.525940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f2a6d2e8-1013-4b11-963a-7944d6fb7646 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:33.543631 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f2a6d2e8-1013-4b11-963a-7944d6fb7646 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.355259 Sep 06 11:09:33.544626 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2086/4169] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:33 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:33.762437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b2856331-0933-4a2f-ad17-9c67b887a078 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3905f70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:33.876765 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b2856331-0933-4a2f-ad17-9c67b887a078 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.118361 Sep 06 11:09:33.887365 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2084/4170] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:33 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:34.571998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-92095e43-86b9-4b77-b065-549b04cdec84 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:34.588323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-92095e43-86b9-4b77-b065-549b04cdec84 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:34.614580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92095e43-86b9-4b77-b065-549b04cdec84 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:34.616972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92095e43-86b9-4b77-b065-549b04cdec84 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:34.616972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92095e43-86b9-4b77-b065-549b04cdec84 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:34.616972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92095e43-86b9-4b77-b065-549b04cdec84 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:34.633990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92095e43-86b9-4b77-b065-549b04cdec84 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:34.635208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92095e43-86b9-4b77-b065-549b04cdec84 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:34.909406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-19938224-9c7d-40a1-b20a-777aba5c40bf tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f38209d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:35.009264 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-19938224-9c7d-40a1-b20a-777aba5c40bf tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.106437 Sep 06 11:09:35.015376 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2085/4171] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:34 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:35.100405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-92095e43-86b9-4b77-b065-549b04cdec84 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:35.115758 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-92095e43-86b9-4b77-b065-549b04cdec84 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.549601 Sep 06 11:09:35.138285 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2087/4172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:34 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:36.030259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d314fa0f-3787-46b3-9ec5-4cd680303d2d tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3724820>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:36.103034 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d314fa0f-3787-46b3-9ec5-4cd680303d2d tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.076830 Sep 06 11:09:36.104622 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2086/4173] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:36 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:36.146031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8d7a0d79-23aa-424d-8430-f6bb9883afb8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:36.146669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8d7a0d79-23aa-424d-8430-f6bb9883afb8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:36.159323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d7a0d79-23aa-424d-8430-f6bb9883afb8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:36.160386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d7a0d79-23aa-424d-8430-f6bb9883afb8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:36.161148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d7a0d79-23aa-424d-8430-f6bb9883afb8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:36.162151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d7a0d79-23aa-424d-8430-f6bb9883afb8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:36.166252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d7a0d79-23aa-424d-8430-f6bb9883afb8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:36.171002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d7a0d79-23aa-424d-8430-f6bb9883afb8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:36.974452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8d7a0d79-23aa-424d-8430-f6bb9883afb8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:37.024528 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8d7a0d79-23aa-424d-8430-f6bb9883afb8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.881832 Sep 06 11:09:37.048643 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2088/4174] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:36 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:37.123688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4e83078-e541-450b-bf30-a8bdc4ad678a tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3820e50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:37.213967 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b4e83078-e541-450b-bf30-a8bdc4ad678a tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.092353 Sep 06 11:09:37.217408 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2087/4175] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:37 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:38.062080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1e71d75e-2686-430d-8fde-5d0556bae673 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:38.063659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1e71d75e-2686-430d-8fde-5d0556bae673 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:38.079067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e71d75e-2686-430d-8fde-5d0556bae673 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:38.083844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e71d75e-2686-430d-8fde-5d0556bae673 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:38.086724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e71d75e-2686-430d-8fde-5d0556bae673 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:38.088383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e71d75e-2686-430d-8fde-5d0556bae673 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:38.089505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e71d75e-2686-430d-8fde-5d0556bae673 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:38.091884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e71d75e-2686-430d-8fde-5d0556bae673 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:38.234414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dc0abb90-ce01-46e9-a992-5b5b2a1e2244 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3737e50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:38.389945 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dc0abb90-ce01-46e9-a992-5b5b2a1e2244 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.148289 Sep 06 11:09:38.389945 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2088/4176] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:38 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:38.596835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1e71d75e-2686-430d-8fde-5d0556bae673 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:38.618495 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1e71d75e-2686-430d-8fde-5d0556bae673 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.560169 Sep 06 11:09:38.621785 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2089/4177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:38 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:39.400716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-97d5b867-e272-43c8-9d7f-b16a2a11ac64 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f859e0d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:39.535932 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-97d5b867-e272-43c8-9d7f-b16a2a11ac64 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.141171 Sep 06 11:09:39.536539 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2089/4178] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:39 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:39.657986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93e49c6e-9f81-41ec-9b6a-cc0331cb22d8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:39.666417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-93e49c6e-9f81-41ec-9b6a-cc0331cb22d8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:39.697770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e49c6e-9f81-41ec-9b6a-cc0331cb22d8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:39.704995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e49c6e-9f81-41ec-9b6a-cc0331cb22d8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:39.708231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e49c6e-9f81-41ec-9b6a-cc0331cb22d8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:39.709235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e49c6e-9f81-41ec-9b6a-cc0331cb22d8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:39.709977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e49c6e-9f81-41ec-9b6a-cc0331cb22d8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:39.710646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e49c6e-9f81-41ec-9b6a-cc0331cb22d8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:40.008517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-93e49c6e-9f81-41ec-9b6a-cc0331cb22d8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:40.021688 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-93e49c6e-9f81-41ec-9b6a-cc0331cb22d8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.373615 Sep 06 11:09:40.024087 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2090/4179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:39 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:40.553716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-40d58917-00f6-4ebc-a58d-d0888223d356 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3905160>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:40.628062 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-40d58917-00f6-4ebc-a58d-d0888223d356 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.079630 Sep 06 11:09:40.629609 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2090/4180] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:40 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:41.051558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cff223c5-ae68-49df-ae82-5957ac9b9a4f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:41.053486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cff223c5-ae68-49df-ae82-5957ac9b9a4f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:41.097016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cff223c5-ae68-49df-ae82-5957ac9b9a4f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:41.100924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cff223c5-ae68-49df-ae82-5957ac9b9a4f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:41.101707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cff223c5-ae68-49df-ae82-5957ac9b9a4f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:41.105005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cff223c5-ae68-49df-ae82-5957ac9b9a4f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:41.109429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cff223c5-ae68-49df-ae82-5957ac9b9a4f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:41.109429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cff223c5-ae68-49df-ae82-5957ac9b9a4f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:41.285388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cff223c5-ae68-49df-ae82-5957ac9b9a4f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:41.308642 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cff223c5-ae68-49df-ae82-5957ac9b9a4f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.264422 Sep 06 11:09:41.309576 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2091/4181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:41 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:41.649254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6bd16249-ba87-4e92-9eee-06164d212c68 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3820790>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:41.750123 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6bd16249-ba87-4e92-9eee-06164d212c68 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.107266 Sep 06 11:09:41.765055 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2091/4182] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:41 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:42.336267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-db03f032-5af8-444d-9c86-ac41bf42e6a1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:42.339108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-db03f032-5af8-444d-9c86-ac41bf42e6a1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:42.351743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db03f032-5af8-444d-9c86-ac41bf42e6a1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:42.352250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db03f032-5af8-444d-9c86-ac41bf42e6a1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:42.352700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db03f032-5af8-444d-9c86-ac41bf42e6a1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:42.353427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db03f032-5af8-444d-9c86-ac41bf42e6a1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:42.353893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db03f032-5af8-444d-9c86-ac41bf42e6a1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:42.358941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db03f032-5af8-444d-9c86-ac41bf42e6a1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:42.659288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-db03f032-5af8-444d-9c86-ac41bf42e6a1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:42.672352 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-db03f032-5af8-444d-9c86-ac41bf42e6a1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.340166 Sep 06 11:09:42.725330 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2092/4183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:42 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:42.779090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9c5014c1-4fe9-4f9d-a29e-a395a586722d tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f8ade5e0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:42.907479 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9c5014c1-4fe9-4f9d-a29e-a395a586722d tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.140774 Sep 06 11:09:42.921398 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2092/4184] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:42 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:43.698338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5b86d7d3-d822-4e3f-bffd-eeff03f102ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:43.700333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5b86d7d3-d822-4e3f-bffd-eeff03f102ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:43.717751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b86d7d3-d822-4e3f-bffd-eeff03f102ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:43.719231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b86d7d3-d822-4e3f-bffd-eeff03f102ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:43.723056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b86d7d3-d822-4e3f-bffd-eeff03f102ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:43.723056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b86d7d3-d822-4e3f-bffd-eeff03f102ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:43.723056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b86d7d3-d822-4e3f-bffd-eeff03f102ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:43.727260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5b86d7d3-d822-4e3f-bffd-eeff03f102ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:43.924841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5d89b30b-2416-4ab2-bdf8-bf9117ef881a tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f39e0550>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:43.937705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=9 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:43.938539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=81 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:44.018593 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5d89b30b-2416-4ab2-bdf8-bf9117ef881a tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.099172 Sep 06 11:09:44.029994 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2093/4185] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:43 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:44.338584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5b86d7d3-d822-4e3f-bffd-eeff03f102ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:44.352407 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5b86d7d3-d822-4e3f-bffd-eeff03f102ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.658461 Sep 06 11:09:44.357760 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2093/4186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:43 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:45.038639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-512c39b4-1efe-4a21-8cad-fbb6f32dd3e9 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f344caf0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:45.125096 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-512c39b4-1efe-4a21-8cad-fbb6f32dd3e9 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.081761 Sep 06 11:09:45.135561 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2094/4187] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:45 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:45.386111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb6c0f15-13c2-4dd4-ac16-055c1c8a9f02 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:45.387498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fb6c0f15-13c2-4dd4-ac16-055c1c8a9f02 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:45.401394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb6c0f15-13c2-4dd4-ac16-055c1c8a9f02 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:45.404275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb6c0f15-13c2-4dd4-ac16-055c1c8a9f02 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:45.405029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb6c0f15-13c2-4dd4-ac16-055c1c8a9f02 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:45.407125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb6c0f15-13c2-4dd4-ac16-055c1c8a9f02 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:45.409856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb6c0f15-13c2-4dd4-ac16-055c1c8a9f02 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:45.410620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb6c0f15-13c2-4dd4-ac16-055c1c8a9f02 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:45.710759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fb6c0f15-13c2-4dd4-ac16-055c1c8a9f02 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:45.728213 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fb6c0f15-13c2-4dd4-ac16-055c1c8a9f02 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.345984 Sep 06 11:09:45.748383 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2095/4188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:45 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:45.860368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1216734947", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "06bcce77-5216-410c-b234-907ed8c93b33"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:45.890559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:45.976157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] validate_networks() for [('06bcce77-5216-410c-b234-907ed8c93b33', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:09:46.145036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1a7ac895-e7a7-41e9-8ff7-b5780910acaa tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f39f1820>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:46.218559 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1a7ac895-e7a7-41e9-8ff7-b5780910acaa tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.077632 Sep 06 11:09:46.223203 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2096/4189] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:46 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:46.757866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f696a9d-b8f3-45b7-9482-9ebb333f41ee tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:46.758493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7f696a9d-b8f3-45b7-9482-9ebb333f41ee tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:46.766777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f696a9d-b8f3-45b7-9482-9ebb333f41ee tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:46.771486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f696a9d-b8f3-45b7-9482-9ebb333f41ee tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:46.771486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f696a9d-b8f3-45b7-9482-9ebb333f41ee tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:46.771486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f696a9d-b8f3-45b7-9482-9ebb333f41ee tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:46.771486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f696a9d-b8f3-45b7-9482-9ebb333f41ee tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:46.771486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f696a9d-b8f3-45b7-9482-9ebb333f41ee tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:47.358755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f696a9d-b8f3-45b7-9482-9ebb333f41ee tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:47.368707 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7f696a9d-b8f3-45b7-9482-9ebb333f41ee tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.615238 Sep 06 11:09:47.383881 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2097/4190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:46 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:47.392671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-192b0a62-e307-4359-8d71-7d316585c194 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f344c700>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:47.493001 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-192b0a62-e307-4359-8d71-7d316585c194 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.107155 Sep 06 11:09:47.495166 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2098/4191] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:47 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:47.619194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:09:47.619714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:09:47.621134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:09:47.621816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:09:47.623647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:09:47.639669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:47.639669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:47.639669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:47.640533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:47.641228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:47.641835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:47.669366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Getting quotas for project 2ca2ee6cad064b14bd68229c859db365. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:09:47.676978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Getting quotas for user 14cbba91d5874eb3992ff869ff32e98a and project 2ca2ee6cad064b14bd68229c859db365. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:09:47.694869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:09:47.702819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:09:47.897562 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6af47ba2-1d49-42df-80c4-edd8540d7abf tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.629775 Sep 06 11:09:47.897562 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2094/4192] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:09:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:09:47.904008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-47d57290-4c97-460a-809f-06dcfd7e70a1 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:47.904931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-47d57290-4c97-460a-809f-06dcfd7e70a1 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:48.009927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-47d57290-4c97-460a-809f-06dcfd7e70a1 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:48.021746 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-47d57290-4c97-460a-809f-06dcfd7e70a1 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1216 microversion: 2.1 time: 0.122820 Sep 06 11:09:48.022722 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2099/4193] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:47 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1216 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:48.401793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5f1b4c70-5adb-42df-8404-54453cf95c3d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:48.401793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5f1b4c70-5adb-42df-8404-54453cf95c3d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:48.451925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f1b4c70-5adb-42df-8404-54453cf95c3d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:48.452637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f1b4c70-5adb-42df-8404-54453cf95c3d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:48.453355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f1b4c70-5adb-42df-8404-54453cf95c3d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:48.454104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f1b4c70-5adb-42df-8404-54453cf95c3d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:48.454574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f1b4c70-5adb-42df-8404-54453cf95c3d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:48.455040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f1b4c70-5adb-42df-8404-54453cf95c3d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:48.465298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:48.513730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1d876be0-711c-46c1-85d4-bc948fac44de tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f344c280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:48.597241 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1d876be0-711c-46c1-85d4-bc948fac44de tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.087495 Sep 06 11:09:48.608834 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2100/4194] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:48 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:48.835960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5f1b4c70-5adb-42df-8404-54453cf95c3d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:48.863248 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5f1b4c70-5adb-42df-8404-54453cf95c3d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1520 microversion: 2.1 time: 0.463782 Sep 06 11:09:48.865072 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2095/4195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:48 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1520 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:49.062969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-822c1463-ba1d-4369-af05-587386503708 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:49.063944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-822c1463-ba1d-4369-af05-587386503708 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:49.318427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-822c1463-ba1d-4369-af05-587386503708 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:49.357848 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-822c1463-ba1d-4369-af05-587386503708 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1216 microversion: 2.1 time: 0.299783 Sep 06 11:09:49.388972 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2101/4196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:49 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1216 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:49.620949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e41a6932-8bf9-477f-b628-f5b84fd367be tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f8cc84c0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:49.748919 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e41a6932-8bf9-477f-b628-f5b84fd367be tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.132379 Sep 06 11:09:49.750775 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2096/4197] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:49 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:49.894563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0a40b656-b813-46a7-97b2-fc76977121b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:49.895223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0a40b656-b813-46a7-97b2-fc76977121b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:49.922718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a40b656-b813-46a7-97b2-fc76977121b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:49.923384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a40b656-b813-46a7-97b2-fc76977121b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:49.923957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a40b656-b813-46a7-97b2-fc76977121b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:49.924709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a40b656-b813-46a7-97b2-fc76977121b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:49.925253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a40b656-b813-46a7-97b2-fc76977121b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:49.925662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0a40b656-b813-46a7-97b2-fc76977121b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:50.401105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a042e769-5cf4-46b2-9873-bdc5f2607f8d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:50.401960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a042e769-5cf4-46b2-9873-bdc5f2607f8d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:50.686507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a042e769-5cf4-46b2-9873-bdc5f2607f8d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:50.712510 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a042e769-5cf4-46b2-9873-bdc5f2607f8d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1216 microversion: 2.1 time: 0.316074 Sep 06 11:09:50.713560 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2097/4198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:50 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1216 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:50.783620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0a40b656-b813-46a7-97b2-fc76977121b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:50.784224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0479d1f2-c2b9-4f19-af26-601725673f7c tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f817f820>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:50.785255 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0a40b656-b813-46a7-97b2-fc76977121b8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1500 microversion: 2.1 time: 0.884249 Sep 06 11:09:50.785255 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2102/4199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:49 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1500 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:50.810972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f92c9d78-7ecd-4c0a-b7b9-8fe3fa6d320b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:50.811199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f92c9d78-7ecd-4c0a-b7b9-8fe3fa6d320b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:50.829760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f92c9d78-7ecd-4c0a-b7b9-8fe3fa6d320b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:50.830271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f92c9d78-7ecd-4c0a-b7b9-8fe3fa6d320b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:50.830722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f92c9d78-7ecd-4c0a-b7b9-8fe3fa6d320b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:50.839570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f92c9d78-7ecd-4c0a-b7b9-8fe3fa6d320b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:50.840093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f92c9d78-7ecd-4c0a-b7b9-8fe3fa6d320b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:50.840555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f92c9d78-7ecd-4c0a-b7b9-8fe3fa6d320b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:50.877993 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0479d1f2-c2b9-4f19-af26-601725673f7c tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.112660 Sep 06 11:09:50.885194 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2098/4200] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:50 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:51.456843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f92c9d78-7ecd-4c0a-b7b9-8fe3fa6d320b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:51.473808 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f92c9d78-7ecd-4c0a-b7b9-8fe3fa6d320b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1513 microversion: 2.1 time: 0.670396 Sep 06 11:09:51.474587 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2103/4201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:50 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1513 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:51.517458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a7f1616f-ffd6-4928-891f-6698cecdd287 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:51.534475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a7f1616f-ffd6-4928-891f-6698cecdd287 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: eb5bac93-3a50-4288-9228-007a15fe9bdd] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:51.547772 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-a7f1616f-ffd6-4928-891f-6698cecdd287 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] HTTP exception thrown: Instance eb5bac93-3a50-4288-9228-007a15fe9bdd could not be found. Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a7f1616f-ffd6-4928-891f-6698cecdd287 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Request method failure captured: Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/eb5bac93-3a50-4288-9228-007a15fe9bdd/action HTTP/1.1 Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 14 Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFypBCZVzhsRBhBANMStQFyeCLS5PmKt-tnLIYX5sT_ENc4vLLwScYTWL5yqaaxpUhllGbPc3oIWuuzLq-Hr-H-vcfxt82OKYl89zSQBoVSvyllXHebYOgIiQtfQzKHMF-bGKhrOYJft0jC5PHYUnd4l11fkckESPh53h8qp5BGDnUAg Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}] Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e45dfaf9fd949548bca37303a117bb1 Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: {"rescue": {}} Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance eb5bac93-3a50-4288-9228-007a15fe9bdd could not be found. Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'eb5bac93-3a50-4288-9228-007a15fe9bdd', 'body': {'rescue': {}}} Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5bac93-3a50-4288-9228-007a15fe9bdd could not be found. Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5bac93-3a50-4288-9228-007a15fe9bdd could not be found. Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:09:51.566324 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:51.574174 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:51.574174 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:51.574174 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:09:51.574174 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:09:51.574174 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5bac93-3a50-4288-9228-007a15fe9bdd could not be found. Sep 06 11:09:51.574174 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:09:51.586263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a7f1616f-ffd6-4928-891f-6698cecdd287 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Returning 404 to user: Instance eb5bac93-3a50-4288-9228-007a15fe9bdd could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:09:51.588540 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a7f1616f-ffd6-4928-891f-6698cecdd287 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers/eb5bac93-3a50-4288-9228-007a15fe9bdd/action" status: 404 len: 111 microversion: 2.1 time: 0.081043 Sep 06 11:09:51.592421 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2099/4202] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:09:51 2022] POST /compute/v2.1/servers/eb5bac93-3a50-4288-9228-007a15fe9bdd/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:09:51.603785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-95f2dc0d-9605-44d8-8739-2e5b73ebde7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:51.604627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-95f2dc0d-9605-44d8-8739-2e5b73ebde7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:51.620439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95f2dc0d-9605-44d8-8739-2e5b73ebde7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:51.622788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95f2dc0d-9605-44d8-8739-2e5b73ebde7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:51.625019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95f2dc0d-9605-44d8-8739-2e5b73ebde7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:51.627698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95f2dc0d-9605-44d8-8739-2e5b73ebde7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:51.628760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95f2dc0d-9605-44d8-8739-2e5b73ebde7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:51.629369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95f2dc0d-9605-44d8-8739-2e5b73ebde7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:51.739186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1a532e9d-82f0-4ef7-bffd-d0f969920423 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:51.739832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1a532e9d-82f0-4ef7-bffd-d0f969920423 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:51.771459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a532e9d-82f0-4ef7-bffd-d0f969920423 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:51.771459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a532e9d-82f0-4ef7-bffd-d0f969920423 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:51.771459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a532e9d-82f0-4ef7-bffd-d0f969920423 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:51.772398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a532e9d-82f0-4ef7-bffd-d0f969920423 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:51.773140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a532e9d-82f0-4ef7-bffd-d0f969920423 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:51.779468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a532e9d-82f0-4ef7-bffd-d0f969920423 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:51.952263 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-95f2dc0d-9605-44d8-8739-2e5b73ebde7f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/action" status: 202 len: 0 microversion: 2.1 time: 0.353755 Sep 06 11:09:51.971132 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2104/4203] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:09:51 2022] POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:09:51.971132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d1671bf3-8c1f-4622-9f09-c64caab5db19 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3423a60>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:52.018005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1a532e9d-82f0-4ef7-bffd-d0f969920423 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:52.038921 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1a532e9d-82f0-4ef7-bffd-d0f969920423 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1268 microversion: 2.1 time: 0.304886 Sep 06 11:09:52.042701 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2100/4204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:51 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1268 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:52.055504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7ddd9dd9-f062-4086-bd56-8e6304323d50 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:52.060415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7ddd9dd9-f062-4086-bd56-8e6304323d50 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:52.082986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ddd9dd9-f062-4086-bd56-8e6304323d50 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:52.083843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ddd9dd9-f062-4086-bd56-8e6304323d50 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:52.085044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ddd9dd9-f062-4086-bd56-8e6304323d50 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:52.091104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ddd9dd9-f062-4086-bd56-8e6304323d50 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:52.092216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ddd9dd9-f062-4086-bd56-8e6304323d50 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:52.094558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ddd9dd9-f062-4086-bd56-8e6304323d50 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:52.125064 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d1671bf3-8c1f-4622-9f09-c64caab5db19 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.170551 Sep 06 11:09:52.126822 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2105/4205] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:51 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:52.791444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7ddd9dd9-f062-4086-bd56-8e6304323d50 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:52.805979 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7ddd9dd9-f062-4086-bd56-8e6304323d50 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1518 microversion: 2.1 time: 0.761468 Sep 06 11:09:52.807411 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2101/4206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:52 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1518 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:53.091173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bd666176-adc5-4889-aee1-c047b48d3133 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:53.098334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bd666176-adc5-4889-aee1-c047b48d3133 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:53.134032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd666176-adc5-4889-aee1-c047b48d3133 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:53.136270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd666176-adc5-4889-aee1-c047b48d3133 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:53.138239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd666176-adc5-4889-aee1-c047b48d3133 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:53.141138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd666176-adc5-4889-aee1-c047b48d3133 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:53.142926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd666176-adc5-4889-aee1-c047b48d3133 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:53.144420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd666176-adc5-4889-aee1-c047b48d3133 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:53.144552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e5b161d0-cace-44fc-acf9-f327006de653 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f85209d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:53.277792 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e5b161d0-cace-44fc-acf9-f327006de653 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.135441 Sep 06 11:09:53.281221 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2102/4207] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:53 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:53.322336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bd666176-adc5-4889-aee1-c047b48d3133 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:53.334749 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bd666176-adc5-4889-aee1-c047b48d3133 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1274 microversion: 2.1 time: 0.253405 Sep 06 11:09:53.347037 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2106/4208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:53 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1274 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:53.833269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a340d743-bf14-42d4-8bfe-85e54dfd2859 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:53.834031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a340d743-bf14-42d4-8bfe-85e54dfd2859 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:53.856457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a340d743-bf14-42d4-8bfe-85e54dfd2859 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:53.862745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a340d743-bf14-42d4-8bfe-85e54dfd2859 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:53.866160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a340d743-bf14-42d4-8bfe-85e54dfd2859 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:53.870849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a340d743-bf14-42d4-8bfe-85e54dfd2859 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:53.873690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a340d743-bf14-42d4-8bfe-85e54dfd2859 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:53.875382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a340d743-bf14-42d4-8bfe-85e54dfd2859 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:54.297444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c7daec71-fafe-4c48-b13c-a83455dc3804 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f344c940>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:54.416121 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c7daec71-fafe-4c48-b13c-a83455dc3804 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.123393 Sep 06 11:09:54.418659 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2107/4209] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:54 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:54.431081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-020144c1-9afd-4bfd-bbca-4f125cf82cb9 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:54.437226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-020144c1-9afd-4bfd-bbca-4f125cf82cb9 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:54.452888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-020144c1-9afd-4bfd-bbca-4f125cf82cb9 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:54.457626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-020144c1-9afd-4bfd-bbca-4f125cf82cb9 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:54.458442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-020144c1-9afd-4bfd-bbca-4f125cf82cb9 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:54.459558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-020144c1-9afd-4bfd-bbca-4f125cf82cb9 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:54.460303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-020144c1-9afd-4bfd-bbca-4f125cf82cb9 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:54.467927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-020144c1-9afd-4bfd-bbca-4f125cf82cb9 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:54.917399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-020144c1-9afd-4bfd-bbca-4f125cf82cb9 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:54.928826 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-020144c1-9afd-4bfd-bbca-4f125cf82cb9 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1274 microversion: 2.1 time: 0.508582 Sep 06 11:09:54.929988 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2108/4210] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:54 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1274 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:55.184877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a340d743-bf14-42d4-8bfe-85e54dfd2859 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:55.202977 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a340d743-bf14-42d4-8bfe-85e54dfd2859 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1498 microversion: 2.1 time: 1.375283 Sep 06 11:09:55.203926 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2103/4211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:53 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1498 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:55.237453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-65a2b0ed-993f-4458-b2da-81af2870874c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:55.241764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-65a2b0ed-993f-4458-b2da-81af2870874c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:55.256016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65a2b0ed-993f-4458-b2da-81af2870874c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:55.257666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65a2b0ed-993f-4458-b2da-81af2870874c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:55.258577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65a2b0ed-993f-4458-b2da-81af2870874c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:55.259907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65a2b0ed-993f-4458-b2da-81af2870874c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:55.260869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65a2b0ed-993f-4458-b2da-81af2870874c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:55.261743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65a2b0ed-993f-4458-b2da-81af2870874c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:55.318758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-65a2b0ed-993f-4458-b2da-81af2870874c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lazy-loading 'flavor' on Instance uuid 97907bbb-c089-4899-8d70-8c012daf803b {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:09:55.361762 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-65a2b0ed-993f-4458-b2da-81af2870874c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] HTTP exception thrown: Cannot 'rescue' instance 97907bbb-c089-4899-8d70-8c012daf803b while it is in vm_state paused Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-65a2b0ed-993f-4458-b2da-81af2870874c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Request method failure captured: Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/action HTTP/1.1 Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 14 Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFypBCZVzhsRBhBANMStQFyeCLS5PmKt-tnLIYX5sT_ENc4vLLwScYTWL5yqaaxpUhllGbPc3oIWuuzLq-Hr-H-vcfxt82OKYl89zSQBoVSvyllXHebYOgIiQtfQzKHMF-bGKhrOYJft0jC5PHYUnd4l11fkckESPh53h8qp5BGDnUAg Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}] Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e45dfaf9fd949548bca37303a117bb1 Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: {"rescue": {}} Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: exception: Cannot 'rescue' instance 97907bbb-c089-4899-8d70-8c012daf803b while it is in vm_state paused Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '97907bbb-c089-4899-8d70-8c012daf803b', 'body': {'rescue': {}}} Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97907bbb-c089-4899-8d70-8c012daf803b in vm_state paused. Cannot rescue while the instance is in this state. Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 97907bbb-c089-4899-8d70-8c012daf803b while it is in vm_state paused Sep 06 11:09:55.365674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:55.373449 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:09:55.373449 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:55.373449 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:09:55.373449 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:09:55.373449 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:09:55.373449 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:09:55.373449 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:09:55.373449 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 97907bbb-c089-4899-8d70-8c012daf803b while it is in vm_state paused Sep 06 11:09:55.373449 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:09:55.373449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-65a2b0ed-993f-4458-b2da-81af2870874c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Returning 409 to user: Cannot 'rescue' instance 97907bbb-c089-4899-8d70-8c012daf803b while it is in vm_state paused {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:09:55.373449 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-65a2b0ed-993f-4458-b2da-81af2870874c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/action" status: 409 len: 144 microversion: 2.1 time: 0.142381 Sep 06 11:09:55.379148 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2109/4212] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:09:55 2022] POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/action => generated 144 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:09:55.390473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ce0b2e9-7483-4b6e-90fc-23cec1e5b3ac tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:55.391329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0ce0b2e9-7483-4b6e-90fc-23cec1e5b3ac tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:55.402946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ce0b2e9-7483-4b6e-90fc-23cec1e5b3ac tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:55.405932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ce0b2e9-7483-4b6e-90fc-23cec1e5b3ac tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:55.407283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ce0b2e9-7483-4b6e-90fc-23cec1e5b3ac tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:55.408900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ce0b2e9-7483-4b6e-90fc-23cec1e5b3ac tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:55.409951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ce0b2e9-7483-4b6e-90fc-23cec1e5b3ac tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:55.410909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ce0b2e9-7483-4b6e-90fc-23cec1e5b3ac tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:55.438572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-67f72e6e-b7ef-4cbd-bc2a-9622ef9494f4 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f3737e50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:55.522211 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-67f72e6e-b7ef-4cbd-bc2a-9622ef9494f4 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.090069 Sep 06 11:09:55.528543 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2110/4213] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:55 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:55.956392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8948ad35-68f8-4826-8fee-90f395674d93 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:55.957022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8948ad35-68f8-4826-8fee-90f395674d93 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:55.963344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8948ad35-68f8-4826-8fee-90f395674d93 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:55.964183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8948ad35-68f8-4826-8fee-90f395674d93 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:55.964511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8948ad35-68f8-4826-8fee-90f395674d93 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:55.965204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8948ad35-68f8-4826-8fee-90f395674d93 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:55.965673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8948ad35-68f8-4826-8fee-90f395674d93 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:55.966108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8948ad35-68f8-4826-8fee-90f395674d93 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:56.039335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8948ad35-68f8-4826-8fee-90f395674d93 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:56.059241 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8948ad35-68f8-4826-8fee-90f395674d93 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1274 microversion: 2.1 time: 0.106836 Sep 06 11:09:56.063403 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2111/4214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:55 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1274 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:56.210190 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0ce0b2e9-7483-4b6e-90fc-23cec1e5b3ac tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/action" status: 202 len: 0 microversion: 2.1 time: 0.828192 Sep 06 11:09:56.211449 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2104/4215] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:09:55 2022] POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:09:56.227599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fd772dc8-df9d-4af8-97c8-dcc2c16dbc65 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:56.228391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fd772dc8-df9d-4af8-97c8-dcc2c16dbc65 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:56.250394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd772dc8-df9d-4af8-97c8-dcc2c16dbc65 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:56.251229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd772dc8-df9d-4af8-97c8-dcc2c16dbc65 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:56.253203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd772dc8-df9d-4af8-97c8-dcc2c16dbc65 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:56.255171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd772dc8-df9d-4af8-97c8-dcc2c16dbc65 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:56.255888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd772dc8-df9d-4af8-97c8-dcc2c16dbc65 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:56.256566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd772dc8-df9d-4af8-97c8-dcc2c16dbc65 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:56.551806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ae88c5a1-d47c-4cf1-93ee-e6da4d7ad330 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f8a6a280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:56.644751 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ae88c5a1-d47c-4cf1-93ee-e6da4d7ad330 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.100868 Sep 06 11:09:56.646973 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2105/4216] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:56 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:57.081918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c6fdd98-3473-48d7-8628-784a6d6faf6d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:57.082668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3c6fdd98-3473-48d7-8628-784a6d6faf6d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:57.096767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c6fdd98-3473-48d7-8628-784a6d6faf6d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:57.103119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c6fdd98-3473-48d7-8628-784a6d6faf6d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:57.105260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c6fdd98-3473-48d7-8628-784a6d6faf6d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:57.110373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c6fdd98-3473-48d7-8628-784a6d6faf6d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:57.117412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c6fdd98-3473-48d7-8628-784a6d6faf6d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:57.120449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c6fdd98-3473-48d7-8628-784a6d6faf6d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:57.252011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fd772dc8-df9d-4af8-97c8-dcc2c16dbc65 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:57.268034 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fd772dc8-df9d-4af8-97c8-dcc2c16dbc65 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1505 microversion: 2.1 time: 1.052085 Sep 06 11:09:57.279246 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2112/4217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:56 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1505 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:57.653641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:57.666172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-08254877-d995-4252-a40e-35d8c779691f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f34c1310>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:57.739629 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-08254877-d995-4252-a40e-35d8c779691f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.081194 Sep 06 11:09:57.741103 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2113/4218] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:57 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:57.856221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c6fdd98-3473-48d7-8628-784a6d6faf6d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:57.870492 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3c6fdd98-3473-48d7-8628-784a6d6faf6d tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1316 microversion: 2.1 time: 0.792497 Sep 06 11:09:57.873651 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2106/4219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:57 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1316 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:58.305224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-161a2271-84cc-41e5-bb3d-0ef0571d00e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:58.316590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-161a2271-84cc-41e5-bb3d-0ef0571d00e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:58.350812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-161a2271-84cc-41e5-bb3d-0ef0571d00e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:58.350812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-161a2271-84cc-41e5-bb3d-0ef0571d00e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:58.357377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-161a2271-84cc-41e5-bb3d-0ef0571d00e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:58.361268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-161a2271-84cc-41e5-bb3d-0ef0571d00e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:58.362394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-161a2271-84cc-41e5-bb3d-0ef0571d00e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:58.363055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-161a2271-84cc-41e5-bb3d-0ef0571d00e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:58.758709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8b67ae13-d490-411f-a549-e94139405544 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f8a6ac10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:58.808290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-161a2271-84cc-41e5-bb3d-0ef0571d00e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:58.816786 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8b67ae13-d490-411f-a549-e94139405544 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1428 microversion: 2.1 time: 0.063835 Sep 06 11:09:58.818673 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-161a2271-84cc-41e5-bb3d-0ef0571d00e9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1513 microversion: 2.1 time: 0.523942 Sep 06 11:09:58.819315 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2114/4220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:58 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1513 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:58.835112 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2107/4221] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:58 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:09:58.900639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-18d3435f-2547-46cd-8c06-8b04beb5787c tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:58.901268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-18d3435f-2547-46cd-8c06-8b04beb5787c tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:09:58.916508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18d3435f-2547-46cd-8c06-8b04beb5787c tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:58.917281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18d3435f-2547-46cd-8c06-8b04beb5787c tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:58.932694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18d3435f-2547-46cd-8c06-8b04beb5787c tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:58.932694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18d3435f-2547-46cd-8c06-8b04beb5787c tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:58.932694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18d3435f-2547-46cd-8c06-8b04beb5787c tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:58.932694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18d3435f-2547-46cd-8c06-8b04beb5787c tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:59.350292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:59.555910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-18d3435f-2547-46cd-8c06-8b04beb5787c tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:09:59.608047 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-18d3435f-2547-46cd-8c06-8b04beb5787c tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1316 microversion: 2.1 time: 0.711169 Sep 06 11:09:59.618844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e30a4694-5fdb-4f7a-8f46-2e21945fd34b req-aa4621f9-9104-400b-acb5-68709b97908c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8acf98df-d71a-43a9-9c60-42ea9d2a2dd1", "tag": "7297e361-1732-4541-b853-81f43e7ac5fc"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:09:59.621140 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2115/4222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:09:58 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1316 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:59.652140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e30a4694-5fdb-4f7a-8f46-2e21945fd34b req-aa4621f9-9104-400b-acb5-68709b97908c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:09:59.652890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e30a4694-5fdb-4f7a-8f46-2e21945fd34b req-aa4621f9-9104-400b-acb5-68709b97908c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:09:59.653557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e30a4694-5fdb-4f7a-8f46-2e21945fd34b req-aa4621f9-9104-400b-acb5-68709b97908c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:09:59.686890 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e30a4694-5fdb-4f7a-8f46-2e21945fd34b req-aa4621f9-9104-400b-acb5-68709b97908c service nova] Creating event network-changed:7297e361-1732-4541-b853-81f43e7ac5fc for instance 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 on nch2-master-1 Sep 06 11:09:59.692766 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e30a4694-5fdb-4f7a-8f46-2e21945fd34b req-aa4621f9-9104-400b-acb5-68709b97908c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080303 Sep 06 11:09:59.694876 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2108/4223] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:09:59.843821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a38bd017-c93d-4049-bc12-02ab4b51f29f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f322f9d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:09:59.908367 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a38bd017-c93d-4049-bc12-02ab4b51f29f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1437 microversion: 2.1 time: 0.070271 Sep 06 11:09:59.926844 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2116/4224] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:59 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1437 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:09:59.938843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-38822696-4caf-4f59-9461-d1012f635c22 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f87f7820>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:00.029763 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-38822696-4caf-4f59-9461-d1012f635c22 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 200 len: 1437 microversion: 2.1 time: 0.107724 Sep 06 11:10:00.034559 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2109/4225] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:59 2022] GET /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 1437 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:00.047440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-44c822bc-f161-45c6-82e8-3df018cda88f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:00.055969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-44c822bc-f161-45c6-82e8-3df018cda88f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:00.060424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44c822bc-f161-45c6-82e8-3df018cda88f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:00.061045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44c822bc-f161-45c6-82e8-3df018cda88f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:00.061731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44c822bc-f161-45c6-82e8-3df018cda88f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:00.063089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44c822bc-f161-45c6-82e8-3df018cda88f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:00.063635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44c822bc-f161-45c6-82e8-3df018cda88f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:00.064257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44c822bc-f161-45c6-82e8-3df018cda88f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:00.450433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-44c822bc-f161-45c6-82e8-3df018cda88f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:00.482286 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-44c822bc-f161-45c6-82e8-3df018cda88f tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1467 microversion: 2.1 time: 0.439023 Sep 06 11:10:00.518293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-37345456-718d-48ca-9639-196e4212df6c tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90fd160ee0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:00.524641 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2117/4226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:00 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1467 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:00.646073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d08e2cb1-330b-49b2-a1bc-33d21bc38b80 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:00.650508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d08e2cb1-330b-49b2-a1bc-33d21bc38b80 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:00.680159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d08e2cb1-330b-49b2-a1bc-33d21bc38b80 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:00.680877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d08e2cb1-330b-49b2-a1bc-33d21bc38b80 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:00.685276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d08e2cb1-330b-49b2-a1bc-33d21bc38b80 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:00.687618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d08e2cb1-330b-49b2-a1bc-33d21bc38b80 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:00.688282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d08e2cb1-330b-49b2-a1bc-33d21bc38b80 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:00.688889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d08e2cb1-330b-49b2-a1bc-33d21bc38b80 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:00.704234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:01.038679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d08e2cb1-330b-49b2-a1bc-33d21bc38b80 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:01.049219 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d08e2cb1-330b-49b2-a1bc-33d21bc38b80 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1316 microversion: 2.1 time: 0.410748 Sep 06 11:10:01.061368 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2118/4227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:00 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:02.073459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9953498e-754a-4755-9c42-6b77d5c464ab tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:02.074168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9953498e-754a-4755-9c42-6b77d5c464ab tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:02.084410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9953498e-754a-4755-9c42-6b77d5c464ab tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:02.084918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9953498e-754a-4755-9c42-6b77d5c464ab tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:02.085382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9953498e-754a-4755-9c42-6b77d5c464ab tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:02.086098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9953498e-754a-4755-9c42-6b77d5c464ab tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:02.089763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9953498e-754a-4755-9c42-6b77d5c464ab tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:02.089763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9953498e-754a-4755-9c42-6b77d5c464ab tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:02.352529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9953498e-754a-4755-9c42-6b77d5c464ab tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:02.396899 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9953498e-754a-4755-9c42-6b77d5c464ab tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1316 microversion: 2.1 time: 0.327435 Sep 06 11:10:02.399143 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2119/4228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:02 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:02.421821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3f900ff6-e293-4b56-bb85-032b4c398126 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:02.429611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3f900ff6-e293-4b56-bb85-032b4c398126 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:02.444810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f900ff6-e293-4b56-bb85-032b4c398126 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:02.445708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f900ff6-e293-4b56-bb85-032b4c398126 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:02.446523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f900ff6-e293-4b56-bb85-032b4c398126 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:02.447616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f900ff6-e293-4b56-bb85-032b4c398126 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:02.448087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f900ff6-e293-4b56-bb85-032b4c398126 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:02.448528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f900ff6-e293-4b56-bb85-032b4c398126 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:02.470514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:02.479642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-3f900ff6-e293-4b56-bb85-032b4c398126 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lazy-loading 'flavor' on Instance uuid 97907bbb-c089-4899-8d70-8c012daf803b {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:10:02.799185 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-37345456-718d-48ca-9639-196e4212df6c tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "DELETE /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900" status: 204 len: 0 microversion: 2.1 time: 2.286467 Sep 06 11:10:02.800572 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2110/4229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:00 2022] DELETE /compute/v2.1/images/7d074c5c-9e30-4b22-82f9-2a4c01c9d900 => generated 0 bytes in 2288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:10:02.808643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b59bf376-be6c-49cf-8437-e51daa47da71 req-463721e7-a99c-410b-8026-876149496c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8762ab58-4c4e-4711-9e22-0a35fe149c05", "name": "network-vif-unplugged", "status": "completed", "tag": "655e13ee-c750-4d4e-a975-d750b1032e66"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:02.819000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b59bf376-be6c-49cf-8437-e51daa47da71 req-463721e7-a99c-410b-8026-876149496c50 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:02.820584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b59bf376-be6c-49cf-8437-e51daa47da71 req-463721e7-a99c-410b-8026-876149496c50 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:02.823171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b59bf376-be6c-49cf-8437-e51daa47da71 req-463721e7-a99c-410b-8026-876149496c50 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:02.838707 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b59bf376-be6c-49cf-8437-e51daa47da71 req-463721e7-a99c-410b-8026-876149496c50 service nova] Creating event network-vif-unplugged:655e13ee-c750-4d4e-a975-d750b1032e66 for instance 8762ab58-4c4e-4711-9e22-0a35fe149c05 on nch1-master-1 Sep 06 11:10:02.845108 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b59bf376-be6c-49cf-8437-e51daa47da71 req-463721e7-a99c-410b-8026-876149496c50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039966 Sep 06 11:10:02.847349 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2111/4230] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:02.854387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c44d62e-16b5-43a8-a329-49d0d56d76d3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '.version_select at 0x7f90f8d94c10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:02.898925 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-3c44d62e-16b5-43a8-a329-49d0d56d76d3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] HTTP exception thrown: Image not found. Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c44d62e-16b5-43a8-a329-49d0d56d76d3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Request method failure captured: Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 HTTP/1.1 Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyoqKcjLxHxUSZXcDUu0vw_xyPqyN7FJlKebgqxyWNs6pE8E1kaJyktQHlBXm_WzqgfytA1v7f3stYZOVul9hkcuOTaIh8NQH5EZqf5s3wzVchfbCJNtGBabI_G0860DV_NEMF05u5EOrKZjV4L7vTvj6RqobU8WwiXvTUuwVf1seDI Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 3298773c4bd9452c90a38334e7a0cdc1 Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ImagesOneServerTestJSON-1432909336 Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3298773c4bd9452c90a38334e7a0cdc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3298773c4bd9452c90a38334e7a0cdc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3298773c4bd9452c90a38334e7a0cdc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3298773c4bd9452c90a38334e7a0cdc1"}]}] Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ImagesOneServerTestJSON-1432909336 Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 3298773c4bd9452c90a38334e7a0cdc1 Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1432909336 Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ImagesOneServerTestJSON-1432909336-project Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: f160a950e90c445698d7f5ea36944398 Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ImagesOneServerTestJSON-1432909336-project Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: exception: Image not found. Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '5beb9ed4-96fd-478a-aa8f-9e870c6e6d14'} Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 to delete Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 could not be found. Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:02.901934 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c44d62e-16b5-43a8-a329-49d0d56d76d3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Returning 404 to user: Image not found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3c44d62e-16b5-43a8-a329-49d0d56d76d3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "DELETE /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14" status: 404 len: 62 microversion: 2.1 time: 0.053897 Sep 06 11:10:02.906979 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2112/4231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:02 2022] DELETE /compute/v2.1/images/5beb9ed4-96fd-478a-aa8f-9e870c6e6d14 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:10:02.927045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ec448137-4817-4f91-b9f1-fbe120256f40 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:02.927045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ec448137-4817-4f91-b9f1-fbe120256f40 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:02.927045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec448137-4817-4f91-b9f1-fbe120256f40 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:02.927045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec448137-4817-4f91-b9f1-fbe120256f40 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:02.927045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec448137-4817-4f91-b9f1-fbe120256f40 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:02.927045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec448137-4817-4f91-b9f1-fbe120256f40 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:02.927045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec448137-4817-4f91-b9f1-fbe120256f40 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:02.928792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec448137-4817-4f91-b9f1-fbe120256f40 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:02.966733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ec448137-4817-4f91-b9f1-fbe120256f40 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:10:02.988937 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3f900ff6-e293-4b56-bb85-032b4c398126 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/action" status: 200 len: 32 microversion: 2.1 time: 0.586930 Sep 06 11:10:03.015695 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2120/4232] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:10:02 2022] POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/action => generated 32 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:10:03.041343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3020babf-9795-4be3-aa93-680c704e7612 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:03.045436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3020babf-9795-4be3-aa93-680c704e7612 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:03.064072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3020babf-9795-4be3-aa93-680c704e7612 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:03.066716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3020babf-9795-4be3-aa93-680c704e7612 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:03.068248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3020babf-9795-4be3-aa93-680c704e7612 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:03.076252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3020babf-9795-4be3-aa93-680c704e7612 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:03.077440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3020babf-9795-4be3-aa93-680c704e7612 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:03.080029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3020babf-9795-4be3-aa93-680c704e7612 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:03.495087 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ec448137-4817-4f91-b9f1-fbe120256f40 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 204 len: 0 microversion: 2.1 time: 0.585556 Sep 06 11:10:03.496052 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2113/4233] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:10:02 2022] DELETE /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:10:03.512771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-82871de3-865c-4630-b835-27d0112862c6 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:03.513792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-82871de3-865c-4630-b835-27d0112862c6 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:03.526932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82871de3-865c-4630-b835-27d0112862c6 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:03.527997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82871de3-865c-4630-b835-27d0112862c6 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:03.530450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82871de3-865c-4630-b835-27d0112862c6 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:03.531624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82871de3-865c-4630-b835-27d0112862c6 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:03.532345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82871de3-865c-4630-b835-27d0112862c6 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:03.535964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-82871de3-865c-4630-b835-27d0112862c6 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:03.929588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3020babf-9795-4be3-aa93-680c704e7612 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:03.939003 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3020babf-9795-4be3-aa93-680c704e7612 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1519 microversion: 2.1 time: 0.921580 Sep 06 11:10:03.957799 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2121/4234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:03 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1519 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:03.971063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-092c3aa3-753f-41ca-ba46-8cb9db3b2bb5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:03.972918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-092c3aa3-753f-41ca-ba46-8cb9db3b2bb5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:03.984212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-092c3aa3-753f-41ca-ba46-8cb9db3b2bb5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:03.985549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-092c3aa3-753f-41ca-ba46-8cb9db3b2bb5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:03.986476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-092c3aa3-753f-41ca-ba46-8cb9db3b2bb5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:03.987494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-092c3aa3-753f-41ca-ba46-8cb9db3b2bb5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:03.987962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-092c3aa3-753f-41ca-ba46-8cb9db3b2bb5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:03.988577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-092c3aa3-753f-41ca-ba46-8cb9db3b2bb5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:04.483378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-82871de3-865c-4630-b835-27d0112862c6 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:04.496008 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-82871de3-865c-4630-b835-27d0112862c6 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1316 microversion: 2.1 time: 0.991998 Sep 06 11:10:04.496904 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2114/4235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:03 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1316 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:04.717085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-092c3aa3-753f-41ca-ba46-8cb9db3b2bb5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:04.752511 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-092c3aa3-753f-41ca-ba46-8cb9db3b2bb5 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1473 microversion: 2.1 time: 0.793654 Sep 06 11:10:04.753137 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2122/4236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:03 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1473 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:04.977304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d0db6806-5055-4d5e-ae29-e120428a713c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:04.978357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d0db6806-5055-4d5e-ae29-e120428a713c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:05.004560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0db6806-5055-4d5e-ae29-e120428a713c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:05.005335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0db6806-5055-4d5e-ae29-e120428a713c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:05.006427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0db6806-5055-4d5e-ae29-e120428a713c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:05.007618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0db6806-5055-4d5e-ae29-e120428a713c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:05.008104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0db6806-5055-4d5e-ae29-e120428a713c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:05.015520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0db6806-5055-4d5e-ae29-e120428a713c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:05.522249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0b9e38d3-30ef-46b9-b769-8379ce47fe4e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:05.527709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0b9e38d3-30ef-46b9-b769-8379ce47fe4e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:05.539496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b9e38d3-30ef-46b9-b769-8379ce47fe4e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:05.539917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b9e38d3-30ef-46b9-b769-8379ce47fe4e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:05.540360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b9e38d3-30ef-46b9-b769-8379ce47fe4e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:05.541303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b9e38d3-30ef-46b9-b769-8379ce47fe4e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:05.541779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b9e38d3-30ef-46b9-b769-8379ce47fe4e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:05.542223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b9e38d3-30ef-46b9-b769-8379ce47fe4e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:05.633906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d0db6806-5055-4d5e-ae29-e120428a713c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:05.659417 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d0db6806-5055-4d5e-ae29-e120428a713c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1519 microversion: 2.1 time: 0.676910 Sep 06 11:10:05.660099 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2115/4237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:04 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1519 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:05.777843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d4b1e19b-710c-4922-8c64-101721000444 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:05.778481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d4b1e19b-710c-4922-8c64-101721000444 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:05.787696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d4b1e19b-710c-4922-8c64-101721000444 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:05.791885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d4b1e19b-710c-4922-8c64-101721000444 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:05.806910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d4b1e19b-710c-4922-8c64-101721000444 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:05.813420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d4b1e19b-710c-4922-8c64-101721000444 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:05.813420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d4b1e19b-710c-4922-8c64-101721000444 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:05.813420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d4b1e19b-710c-4922-8c64-101721000444 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:06.052463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0b9e38d3-30ef-46b9-b769-8379ce47fe4e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:06.067426 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0b9e38d3-30ef-46b9-b769-8379ce47fe4e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1316 microversion: 2.1 time: 0.549119 Sep 06 11:10:06.069418 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2123/4238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:05 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1316 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:06.276230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d4b1e19b-710c-4922-8c64-101721000444 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:06.293391 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d4b1e19b-710c-4922-8c64-101721000444 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1473 microversion: 2.1 time: 0.519595 Sep 06 11:10:06.294748 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2116/4239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:05 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1473 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:06.686626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6d2554d6-37dc-4a74-9e03-bade923f2b8c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:06.687351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6d2554d6-37dc-4a74-9e03-bade923f2b8c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:06.695807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d2554d6-37dc-4a74-9e03-bade923f2b8c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:06.696649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d2554d6-37dc-4a74-9e03-bade923f2b8c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:06.697315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d2554d6-37dc-4a74-9e03-bade923f2b8c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:06.698328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d2554d6-37dc-4a74-9e03-bade923f2b8c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:06.699120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d2554d6-37dc-4a74-9e03-bade923f2b8c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:06.699850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d2554d6-37dc-4a74-9e03-bade923f2b8c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:07.097646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bccfb4e2-2d21-4515-8f2f-50d8732f31dc tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:07.099029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bccfb4e2-2d21-4515-8f2f-50d8732f31dc tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:07.112874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bccfb4e2-2d21-4515-8f2f-50d8732f31dc tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:07.115253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bccfb4e2-2d21-4515-8f2f-50d8732f31dc tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:07.117275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bccfb4e2-2d21-4515-8f2f-50d8732f31dc tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:07.118293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bccfb4e2-2d21-4515-8f2f-50d8732f31dc tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:07.120628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bccfb4e2-2d21-4515-8f2f-50d8732f31dc tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:07.124611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bccfb4e2-2d21-4515-8f2f-50d8732f31dc tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:07.372752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6d2554d6-37dc-4a74-9e03-bade923f2b8c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:07.389970 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6d2554d6-37dc-4a74-9e03-bade923f2b8c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1519 microversion: 2.1 time: 0.706404 Sep 06 11:10:07.392782 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2124/4240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:06 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1519 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:07.410635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a53ee10-8e0c-418b-92d5-a921e8ae7c06 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:07.414663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9a53ee10-8e0c-418b-92d5-a921e8ae7c06 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:07.438642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a53ee10-8e0c-418b-92d5-a921e8ae7c06 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:07.439341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a53ee10-8e0c-418b-92d5-a921e8ae7c06 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:07.442146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a53ee10-8e0c-418b-92d5-a921e8ae7c06 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:07.442893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a53ee10-8e0c-418b-92d5-a921e8ae7c06 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:07.443415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a53ee10-8e0c-418b-92d5-a921e8ae7c06 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:07.447265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a53ee10-8e0c-418b-92d5-a921e8ae7c06 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:07.545545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bccfb4e2-2d21-4515-8f2f-50d8732f31dc tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:07.564066 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bccfb4e2-2d21-4515-8f2f-50d8732f31dc tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1316 microversion: 2.1 time: 0.470752 Sep 06 11:10:07.565035 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2117/4241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:07 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:07.695621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9a53ee10-8e0c-418b-92d5-a921e8ae7c06 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:07.706412 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a53ee10-8e0c-418b-92d5-a921e8ae7c06 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1473 microversion: 2.1 time: 0.311391 Sep 06 11:10:07.707053 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2125/4242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:07 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1473 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:07.779889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-078bc035-c025-4bad-8c6a-c1fad227349f req-76ff93a3-b274-4ed4-8ee2-0249a76af41a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8762ab58-4c4e-4711-9e22-0a35fe149c05", "name": "network-vif-deleted", "tag": "655e13ee-c750-4d4e-a975-d750b1032e66"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:07.790722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-078bc035-c025-4bad-8c6a-c1fad227349f req-76ff93a3-b274-4ed4-8ee2-0249a76af41a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:07.791617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-078bc035-c025-4bad-8c6a-c1fad227349f req-76ff93a3-b274-4ed4-8ee2-0249a76af41a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:07.792409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-078bc035-c025-4bad-8c6a-c1fad227349f req-76ff93a3-b274-4ed4-8ee2-0249a76af41a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:07.806032 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-078bc035-c025-4bad-8c6a-c1fad227349f req-76ff93a3-b274-4ed4-8ee2-0249a76af41a service nova] Creating event network-vif-deleted:655e13ee-c750-4d4e-a975-d750b1032e66 for instance 8762ab58-4c4e-4711-9e22-0a35fe149c05 on nch1-master-1 Sep 06 11:10:07.811517 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-078bc035-c025-4bad-8c6a-c1fad227349f req-76ff93a3-b274-4ed4-8ee2-0249a76af41a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035253 Sep 06 11:10:07.812412 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2118/4243] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:08.422139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2a8d6185-9da5-4d78-b995-7ee93dd1534a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:08.424245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2a8d6185-9da5-4d78-b995-7ee93dd1534a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:08.448091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a8d6185-9da5-4d78-b995-7ee93dd1534a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:08.449162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a8d6185-9da5-4d78-b995-7ee93dd1534a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:08.450136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a8d6185-9da5-4d78-b995-7ee93dd1534a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:08.452412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a8d6185-9da5-4d78-b995-7ee93dd1534a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:08.453159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a8d6185-9da5-4d78-b995-7ee93dd1534a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:08.453865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a8d6185-9da5-4d78-b995-7ee93dd1534a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:08.597738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dcceac56-b146-46e6-a00a-8875c284750e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:08.599110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dcceac56-b146-46e6-a00a-8875c284750e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:08.627700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcceac56-b146-46e6-a00a-8875c284750e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:08.628612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcceac56-b146-46e6-a00a-8875c284750e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:08.643941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcceac56-b146-46e6-a00a-8875c284750e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:08.647869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcceac56-b146-46e6-a00a-8875c284750e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:08.647869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcceac56-b146-46e6-a00a-8875c284750e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:08.647869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcceac56-b146-46e6-a00a-8875c284750e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:08.996656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2a8d6185-9da5-4d78-b995-7ee93dd1534a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:09.006322 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2a8d6185-9da5-4d78-b995-7ee93dd1534a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1519 microversion: 2.1 time: 0.588994 Sep 06 11:10:09.014829 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2126/4244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:08 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1519 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:09.024467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:09.025314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:09.032444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:09.033271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:09.034164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:09.034925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:09.036440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:09.036895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:09.068591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dcceac56-b146-46e6-a00a-8875c284750e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:09.077912 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dcceac56-b146-46e6-a00a-8875c284750e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1316 microversion: 2.1 time: 0.492002 Sep 06 11:10:09.078851 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2119/4245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:08 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:09.097521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:09.099298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:09.100100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:09.100801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lazy-loading 'fault' on Instance uuid 8762ab58-4c4e-4711-9e22-0a35fe149c05 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:10:09.224563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f160a950e90c445698d7f5ea36944398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3298773c4bd9452c90a38334e7a0cdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:09.249787 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3472a65d-33bc-4035-9d70-9cce14288211 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 200 len: 1307 microversion: 2.1 time: 0.233548 Sep 06 11:10:09.258962 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2127/4246] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:09 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 1307 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:09.316329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-260e179b-0ac9-4a6c-acb7-cdb543b864b0 req-704fad67-a31d-4e7f-97ff-733b4fca57fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8acf98df-d71a-43a9-9c60-42ea9d2a2dd1", "name": "network-vif-plugged", "status": "completed", "tag": "7297e361-1732-4541-b853-81f43e7ac5fc"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:09.338725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-260e179b-0ac9-4a6c-acb7-cdb543b864b0 req-704fad67-a31d-4e7f-97ff-733b4fca57fd service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:09.341383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-260e179b-0ac9-4a6c-acb7-cdb543b864b0 req-704fad67-a31d-4e7f-97ff-733b4fca57fd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:09.343747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-260e179b-0ac9-4a6c-acb7-cdb543b864b0 req-704fad67-a31d-4e7f-97ff-733b4fca57fd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:09.367436 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-260e179b-0ac9-4a6c-acb7-cdb543b864b0 req-704fad67-a31d-4e7f-97ff-733b4fca57fd service nova] Creating event network-vif-plugged:7297e361-1732-4541-b853-81f43e7ac5fc for instance 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 on nch2-master-1 Sep 06 11:10:09.373528 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-260e179b-0ac9-4a6c-acb7-cdb543b864b0 req-704fad67-a31d-4e7f-97ff-733b4fca57fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065001 Sep 06 11:10:09.374842 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2120/4247] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:10.043838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b84aef5e-edab-4b07-806e-e7c8bf8a6aad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:10.045847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b84aef5e-edab-4b07-806e-e7c8bf8a6aad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:10.057582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b84aef5e-edab-4b07-806e-e7c8bf8a6aad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:10.058336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b84aef5e-edab-4b07-806e-e7c8bf8a6aad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:10.058972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b84aef5e-edab-4b07-806e-e7c8bf8a6aad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:10.060423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b84aef5e-edab-4b07-806e-e7c8bf8a6aad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:10.061265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b84aef5e-edab-4b07-806e-e7c8bf8a6aad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:10.061881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b84aef5e-edab-4b07-806e-e7c8bf8a6aad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:10.107845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ccff75ec-89e1-4ecb-9d99-85bbaa6827f5 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:10.109226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ccff75ec-89e1-4ecb-9d99-85bbaa6827f5 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:10.121712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccff75ec-89e1-4ecb-9d99-85bbaa6827f5 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:10.127125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccff75ec-89e1-4ecb-9d99-85bbaa6827f5 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:10.131676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccff75ec-89e1-4ecb-9d99-85bbaa6827f5 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:10.132236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccff75ec-89e1-4ecb-9d99-85bbaa6827f5 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:10.133419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccff75ec-89e1-4ecb-9d99-85bbaa6827f5 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:10.135361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ccff75ec-89e1-4ecb-9d99-85bbaa6827f5 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:10.472024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b84aef5e-edab-4b07-806e-e7c8bf8a6aad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:10.503130 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b84aef5e-edab-4b07-806e-e7c8bf8a6aad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1519 microversion: 2.1 time: 0.457392 Sep 06 11:10:10.503130 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2128/4248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:10 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1519 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:10.503130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c4d754f9-1d35-49ca-bad9-8e06e5791cf3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:10.503130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c4d754f9-1d35-49ca-bad9-8e06e5791cf3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] [instance: 8762ab58-4c4e-4711-9e22-0a35fe149c05] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:10.507731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4d754f9-1d35-49ca-bad9-8e06e5791cf3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:10.508325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4d754f9-1d35-49ca-bad9-8e06e5791cf3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:10.509557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4d754f9-1d35-49ca-bad9-8e06e5791cf3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:10.510686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4d754f9-1d35-49ca-bad9-8e06e5791cf3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:10.511411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4d754f9-1d35-49ca-bad9-8e06e5791cf3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:10.512092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4d754f9-1d35-49ca-bad9-8e06e5791cf3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:10.532513 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-c4d754f9-1d35-49ca-bad9-8e06e5791cf3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] HTTP exception thrown: Instance 8762ab58-4c4e-4711-9e22-0a35fe149c05 could not be found. Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c4d754f9-1d35-49ca-bad9-8e06e5791cf3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Request method failure captured: Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 HTTP/1.1 Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyoqKcjLxHxUSZXcDUu0vw_xyPqyN7FJlKebgqxyWNs6pE8E1kaJyktQHlBXm_WzqgfytA1v7f3stYZOVul9hkcuOTaIh8NQH5EZqf5s3wzVchfbCJNtGBabI_G0860DV_NEMF05u5EOrKZjV4L7vTvj6RqobU8WwiXvTUuwVf1seDI Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 3298773c4bd9452c90a38334e7a0cdc1 Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ImagesOneServerTestJSON-1432909336 Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3298773c4bd9452c90a38334e7a0cdc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3298773c4bd9452c90a38334e7a0cdc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3298773c4bd9452c90a38334e7a0cdc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3298773c4bd9452c90a38334e7a0cdc1"}]}] Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ImagesOneServerTestJSON-1432909336 Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 3298773c4bd9452c90a38334e7a0cdc1 Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1432909336 Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ImagesOneServerTestJSON-1432909336-project Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: f160a950e90c445698d7f5ea36944398 Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ImagesOneServerTestJSON-1432909336-project Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 8762ab58-4c4e-4711-9e22-0a35fe149c05 could not be found. Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '8762ab58-4c4e-4711-9e22-0a35fe149c05'} Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8762ab58-4c4e-4711-9e22-0a35fe149c05 could not be found. Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8762ab58-4c4e-4711-9e22-0a35fe149c05 could not be found. Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:10:10.534458 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:10:10.539238 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:10.539238 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:10:10.539238 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:10:10.539238 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:10:10.539238 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:10:10.539238 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8762ab58-4c4e-4711-9e22-0a35fe149c05 could not be found. Sep 06 11:10:10.539238 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:10:10.540754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c4d754f9-1d35-49ca-bad9-8e06e5791cf3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] Returning 404 to user: Instance 8762ab58-4c4e-4711-9e22-0a35fe149c05 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:10:10.541644 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c4d754f9-1d35-49ca-bad9-8e06e5791cf3 tempest-ImagesOneServerTestJSON-1432909336 tempest-ImagesOneServerTestJSON-1432909336-project] 10.222.0.20 "GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05" status: 404 len: 111 microversion: 2.1 time: 0.049763 Sep 06 11:10:10.556053 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2129/4249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:10 2022] GET /compute/v2.1/servers/8762ab58-4c4e-4711-9e22-0a35fe149c05 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:10:10.577209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ccff75ec-89e1-4ecb-9d99-85bbaa6827f5 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:10.579817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:10.586969 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ccff75ec-89e1-4ecb-9d99-85bbaa6827f5 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1316 microversion: 2.1 time: 0.486746 Sep 06 11:10:10.607357 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2121/4250] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:10 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1316 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:11.528119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb8f0dc9-d8c9-441e-8822-99f5e1c353c3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:11.528756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bb8f0dc9-d8c9-441e-8822-99f5e1c353c3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:11.540857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb8f0dc9-d8c9-441e-8822-99f5e1c353c3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:11.541114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb8f0dc9-d8c9-441e-8822-99f5e1c353c3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:11.546624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb8f0dc9-d8c9-441e-8822-99f5e1c353c3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:11.547672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb8f0dc9-d8c9-441e-8822-99f5e1c353c3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:11.549228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb8f0dc9-d8c9-441e-8822-99f5e1c353c3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:11.550772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb8f0dc9-d8c9-441e-8822-99f5e1c353c3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:11.614132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6d2793cf-f112-4118-9415-5dc31b129732 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:11.615962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6d2793cf-f112-4118-9415-5dc31b129732 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:11.627321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d2793cf-f112-4118-9415-5dc31b129732 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:11.627829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d2793cf-f112-4118-9415-5dc31b129732 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:11.628264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d2793cf-f112-4118-9415-5dc31b129732 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:11.628983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d2793cf-f112-4118-9415-5dc31b129732 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:11.629453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d2793cf-f112-4118-9415-5dc31b129732 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:11.629887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d2793cf-f112-4118-9415-5dc31b129732 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:12.137147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bb8f0dc9-d8c9-441e-8822-99f5e1c353c3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:12.166987 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bb8f0dc9-d8c9-441e-8822-99f5e1c353c3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1519 microversion: 2.1 time: 0.641956 Sep 06 11:10:12.169971 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2130/4251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:11 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1519 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:12.225384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6d2793cf-f112-4118-9415-5dc31b129732 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:12.243166 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6d2793cf-f112-4118-9415-5dc31b129732 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1504 microversion: 2.1 time: 0.623692 Sep 06 11:10:12.244641 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2122/4252] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:11 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1504 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:12.277012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eae22c55-ef8d-4d4a-994e-ad8474be8492 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:12.278141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eae22c55-ef8d-4d4a-994e-ad8474be8492 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:12.292373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eae22c55-ef8d-4d4a-994e-ad8474be8492 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:12.294426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eae22c55-ef8d-4d4a-994e-ad8474be8492 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:12.295838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eae22c55-ef8d-4d4a-994e-ad8474be8492 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:12.298799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eae22c55-ef8d-4d4a-994e-ad8474be8492 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:12.321335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eae22c55-ef8d-4d4a-994e-ad8474be8492 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:12.323275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eae22c55-ef8d-4d4a-994e-ad8474be8492 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:12.550000 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eae22c55-ef8d-4d4a-994e-ad8474be8492 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.279157 Sep 06 11:10:12.552274 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2131/4253] 10.222.0.20 () {58 vars in 1296 bytes} [Tue Sep 6 11:10:12 2022] DELETE /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1/os-server-password => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:10:12.567071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a9fc3e15-f14d-46f3-af18-7f1280671d9e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:12.567621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a9fc3e15-f14d-46f3-af18-7f1280671d9e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:12.581399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9fc3e15-f14d-46f3-af18-7f1280671d9e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:12.582542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9fc3e15-f14d-46f3-af18-7f1280671d9e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:12.587854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9fc3e15-f14d-46f3-af18-7f1280671d9e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:12.589141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9fc3e15-f14d-46f3-af18-7f1280671d9e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:12.589800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9fc3e15-f14d-46f3-af18-7f1280671d9e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:12.590418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9fc3e15-f14d-46f3-af18-7f1280671d9e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:12.688022 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a9fc3e15-f14d-46f3-af18-7f1280671d9e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.129092 Sep 06 11:10:12.691667 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2123/4254] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Sep 6 11:10:12 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1/os-server-password => generated 16 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:10:12.717814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-38d0cba2-7d7e-4c61-aa17-678d93ffb643 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:12.718366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-38d0cba2-7d7e-4c61-aa17-678d93ffb643 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:12.746908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38d0cba2-7d7e-4c61-aa17-678d93ffb643 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:12.747550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38d0cba2-7d7e-4c61-aa17-678d93ffb643 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:12.748195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38d0cba2-7d7e-4c61-aa17-678d93ffb643 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:12.749525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38d0cba2-7d7e-4c61-aa17-678d93ffb643 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:12.750919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38d0cba2-7d7e-4c61-aa17-678d93ffb643 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:12.768752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38d0cba2-7d7e-4c61-aa17-678d93ffb643 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:12.842339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-38d0cba2-7d7e-4c61-aa17-678d93ffb643 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:10:13.015114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:13.196762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a0b77923-0276-45e8-ac08-a6abcae34cb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:13.198350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a0b77923-0276-45e8-ac08-a6abcae34cb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:13.235270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0b77923-0276-45e8-ac08-a6abcae34cb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:13.235769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0b77923-0276-45e8-ac08-a6abcae34cb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:13.236212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0b77923-0276-45e8-ac08-a6abcae34cb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:13.237035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0b77923-0276-45e8-ac08-a6abcae34cb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:13.238294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0b77923-0276-45e8-ac08-a6abcae34cb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:13.238960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0b77923-0276-45e8-ac08-a6abcae34cb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:13.437594 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-38d0cba2-7d7e-4c61-aa17-678d93ffb643 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 204 len: 0 microversion: 2.1 time: 0.714077 Sep 06 11:10:13.437594 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2132/4255] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:10:12 2022] DELETE /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:10:13.444686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-206691cd-1239-4e9b-af82-a82398af3d1f tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:13.445564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-206691cd-1239-4e9b-af82-a82398af3d1f tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:13.482885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-206691cd-1239-4e9b-af82-a82398af3d1f tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:13.487569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-206691cd-1239-4e9b-af82-a82398af3d1f tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:13.488139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-206691cd-1239-4e9b-af82-a82398af3d1f tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:13.489310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-206691cd-1239-4e9b-af82-a82398af3d1f tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:13.491576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-206691cd-1239-4e9b-af82-a82398af3d1f tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:13.492120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-206691cd-1239-4e9b-af82-a82398af3d1f tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:13.504253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a0b77923-0276-45e8-ac08-a6abcae34cb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:13.515627 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a0b77923-0276-45e8-ac08-a6abcae34cb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1519 microversion: 2.1 time: 0.323898 Sep 06 11:10:13.516726 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2124/4256] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:13 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1519 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:13.733406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-206691cd-1239-4e9b-af82-a82398af3d1f tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:13.753703 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-206691cd-1239-4e9b-af82-a82398af3d1f tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1510 microversion: 2.1 time: 0.332521 Sep 06 11:10:13.759320 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2133/4257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:13 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:14.544857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a7ee8db4-c2a8-460d-bb80-0c85152cf202 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:14.549132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a7ee8db4-c2a8-460d-bb80-0c85152cf202 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:14.553945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7ee8db4-c2a8-460d-bb80-0c85152cf202 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:14.555816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7ee8db4-c2a8-460d-bb80-0c85152cf202 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:14.556446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7ee8db4-c2a8-460d-bb80-0c85152cf202 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:14.557314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7ee8db4-c2a8-460d-bb80-0c85152cf202 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:14.558948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7ee8db4-c2a8-460d-bb80-0c85152cf202 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:14.559409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7ee8db4-c2a8-460d-bb80-0c85152cf202 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:14.769627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a7ee8db4-c2a8-460d-bb80-0c85152cf202 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:14.779367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6125eb7b-c7b5-4ccc-be33-cfff2ee02b79 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:14.780905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6125eb7b-c7b5-4ccc-be33-cfff2ee02b79 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:14.793339 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a7ee8db4-c2a8-460d-bb80-0c85152cf202 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1519 microversion: 2.1 time: 0.252960 Sep 06 11:10:14.797117 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2125/4258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:14 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:14.799139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6125eb7b-c7b5-4ccc-be33-cfff2ee02b79 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:14.800074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6125eb7b-c7b5-4ccc-be33-cfff2ee02b79 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:14.804868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6125eb7b-c7b5-4ccc-be33-cfff2ee02b79 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:14.804868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6125eb7b-c7b5-4ccc-be33-cfff2ee02b79 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:14.804868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6125eb7b-c7b5-4ccc-be33-cfff2ee02b79 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:14.804868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6125eb7b-c7b5-4ccc-be33-cfff2ee02b79 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:15.217032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6125eb7b-c7b5-4ccc-be33-cfff2ee02b79 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:15.229946 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6125eb7b-c7b5-4ccc-be33-cfff2ee02b79 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1510 microversion: 2.1 time: 0.452072 Sep 06 11:10:15.247046 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2134/4259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:14 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1510 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:15.762734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1351372666", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "f9a43c01-1be3-41ae-81e7-70f1f7fe1682"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:15.831059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b2f8bca1-6d74-46d6-a45b-220d50ada2fc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:15.831747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b2f8bca1-6d74-46d6-a45b-220d50ada2fc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:15.836291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:15.854944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2f8bca1-6d74-46d6-a45b-220d50ada2fc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:15.855490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2f8bca1-6d74-46d6-a45b-220d50ada2fc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:15.855945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2f8bca1-6d74-46d6-a45b-220d50ada2fc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:15.856676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2f8bca1-6d74-46d6-a45b-220d50ada2fc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:15.857145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2f8bca1-6d74-46d6-a45b-220d50ada2fc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:15.857587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2f8bca1-6d74-46d6-a45b-220d50ada2fc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:15.903631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] validate_networks() for [('f9a43c01-1be3-41ae-81e7-70f1f7fe1682', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:10:17.369624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b2f8bca1-6d74-46d6-a45b-220d50ada2fc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:17.409552 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b2f8bca1-6d74-46d6-a45b-220d50ada2fc tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1519 microversion: 2.1 time: 1.585029 Sep 06 11:10:17.413059 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2135/4260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:15 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1519 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:17.423168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ebedded3-2b2d-4262-96cb-cc0833a7ec3e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:17.424904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ebedded3-2b2d-4262-96cb-cc0833a7ec3e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:17.450169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ebedded3-2b2d-4262-96cb-cc0833a7ec3e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:17.463826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ebedded3-2b2d-4262-96cb-cc0833a7ec3e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:17.477104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ebedded3-2b2d-4262-96cb-cc0833a7ec3e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:17.478095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ebedded3-2b2d-4262-96cb-cc0833a7ec3e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:17.481296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ebedded3-2b2d-4262-96cb-cc0833a7ec3e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:17.482186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ebedded3-2b2d-4262-96cb-cc0833a7ec3e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:17.728925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ebedded3-2b2d-4262-96cb-cc0833a7ec3e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:17.748463 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ebedded3-2b2d-4262-96cb-cc0833a7ec3e tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1301 microversion: 2.1 time: 0.334031 Sep 06 11:10:17.780373 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2136/4261] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:17 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1301 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:17.808498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-45dc9f89-099a-4d61-8238-99a6e4622e64 req-3dbd5072-b151-46ae-8f52-4f8796d1f532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8acf98df-d71a-43a9-9c60-42ea9d2a2dd1", "name": "network-vif-deleted", "tag": "7297e361-1732-4541-b853-81f43e7ac5fc"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:17.838528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-45dc9f89-099a-4d61-8238-99a6e4622e64 req-3dbd5072-b151-46ae-8f52-4f8796d1f532 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:17.839053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-45dc9f89-099a-4d61-8238-99a6e4622e64 req-3dbd5072-b151-46ae-8f52-4f8796d1f532 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:17.839480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-45dc9f89-099a-4d61-8238-99a6e4622e64 req-3dbd5072-b151-46ae-8f52-4f8796d1f532 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:17.989915 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-45dc9f89-099a-4d61-8238-99a6e4622e64 req-3dbd5072-b151-46ae-8f52-4f8796d1f532 service nova] Creating event network-vif-deleted:7297e361-1732-4541-b853-81f43e7ac5fc for instance 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 on nch2-master-1 Sep 06 11:10:18.028975 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-45dc9f89-099a-4d61-8238-99a6e4622e64 req-3dbd5072-b151-46ae-8f52-4f8796d1f532 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240942 Sep 06 11:10:18.031484 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2137/4262] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:18.057016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-69c638bc-569f-41ed-aa8e-e6e950dc78b4 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3230550>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:18.197516 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-69c638bc-569f-41ed-aa8e-e6e950dc78b4 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8154cd1a-1a43-4716-bf71-3afc7adf8146" status: 200 len: 661 microversion: 2.1 time: 0.156460 Sep 06 11:10:18.197516 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2138/4263] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:10:18 2022] GET /compute/v2.1/images/8154cd1a-1a43-4716-bf71-3afc7adf8146 => generated 661 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:18.221668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-31113390-ff58-4e7f-9779-9ecf4c3ce785 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3990dc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:18.409730 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-31113390-ff58-4e7f-9779-9ecf4c3ce785 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8154cd1a-1a43-4716-bf71-3afc7adf8146" status: 200 len: 661 microversion: 2.1 time: 0.201098 Sep 06 11:10:18.411261 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2139/4264] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:10:18 2022] GET /compute/v2.1/images/8154cd1a-1a43-4716-bf71-3afc7adf8146 => generated 661 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:18.444639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d48b5e23-8d97-4b07-a3e0-4dcdf7469b3c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:18.451077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d48b5e23-8d97-4b07-a3e0-4dcdf7469b3c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:18.488539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d48b5e23-8d97-4b07-a3e0-4dcdf7469b3c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:18.489645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d48b5e23-8d97-4b07-a3e0-4dcdf7469b3c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:18.494081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d48b5e23-8d97-4b07-a3e0-4dcdf7469b3c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:18.505048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d48b5e23-8d97-4b07-a3e0-4dcdf7469b3c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:18.506870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d48b5e23-8d97-4b07-a3e0-4dcdf7469b3c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:18.512229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d48b5e23-8d97-4b07-a3e0-4dcdf7469b3c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:18.636866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:10:18.637585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:10:18.638982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:10:18.639498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:10:18.646807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:10:18.646807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:18.691864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:18.692399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:18.699774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:18.700667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:18.701244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:18.701615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:18.765531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Getting quotas for project a2edd13a86624b4fbebab5f650bac271. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:10:18.780427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Getting quotas for user 3d84a0cde53b4c278fc96b6d7296d5e4 and project a2edd13a86624b4fbebab5f650bac271. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:10:18.814048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:10:18.824901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:10:18.952669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d48b5e23-8d97-4b07-a3e0-4dcdf7469b3c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:18.962480 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d48b5e23-8d97-4b07-a3e0-4dcdf7469b3c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1499 microversion: 2.1 time: 0.530772 Sep 06 11:10:18.991071 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2140/4265] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:18 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1499 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:19.006055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:19.009189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:19.028294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:19.031673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:19.032280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:19.033398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:19.034747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:19.037112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:19.054238 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f9c571f6-37ef-42f6-a8bc-515014b6fba5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.573821 Sep 06 11:10:19.057586 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2126/4266] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:10:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:10:19.083794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d7d68bd6-7254-496c-86ab-b9bea5ed53f0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:19.094550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d7d68bd6-7254-496c-86ab-b9bea5ed53f0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:19.125087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7d68bd6-7254-496c-86ab-b9bea5ed53f0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:19.128031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7d68bd6-7254-496c-86ab-b9bea5ed53f0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:19.130776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7d68bd6-7254-496c-86ab-b9bea5ed53f0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:19.131866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7d68bd6-7254-496c-86ab-b9bea5ed53f0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:19.132896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7d68bd6-7254-496c-86ab-b9bea5ed53f0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:19.133623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7d68bd6-7254-496c-86ab-b9bea5ed53f0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:19.152040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:19.152621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:19.153077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:19.153549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lazy-loading 'fault' on Instance uuid 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:10:19.206388 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-d7d68bd6-7254-496c-86ab-b9bea5ed53f0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] HTTP exception thrown: Cannot 'attach_volume' instance 97907bbb-c089-4899-8d70-8c012daf803b while it is in vm_state rescued Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d7d68bd6-7254-496c-86ab-b9bea5ed53f0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Request method failure captured: Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/os-volume_attachments HTTP/1.1 Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 74 Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFypBCZVzhsRBhBANMStQFyeCLS5PmKt-tnLIYX5sT_ENc4vLLwScYTWL5yqaaxpUhllGbPc3oIWuuzLq-Hr-H-vcfxt82OKYl89zSQBoVSvyllXHebYOgIiQtfQzKHMF-bGKhrOYJft0jC5PHYUnd4l11fkckESPh53h8qp5BGDnUAg Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}] Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e45dfaf9fd949548bca37303a117bb1 Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: {"volumeAttachment": {"volumeId": "1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2"}} Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: exception: Cannot 'attach_volume' instance 97907bbb-c089-4899-8d70-8c012daf803b while it is in vm_state rescued Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'server_id': '97907bbb-c089-4899-8d70-8c012daf803b', 'body': {'volumeAttachment': {'volumeId': '1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2'}}} Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97907bbb-c089-4899-8d70-8c012daf803b in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 06 11:10:19.208589 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 11:10:19.212877 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:10:19.212877 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:10:19.212877 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 97907bbb-c089-4899-8d70-8c012daf803b while it is in vm_state rescued Sep 06 11:10:19.212877 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:19.212877 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:10:19.212877 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:19.212877 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:19.212877 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:10:19.212877 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:10:19.212877 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:10:19.212877 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:10:19.212877 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 97907bbb-c089-4899-8d70-8c012daf803b while it is in vm_state rescued Sep 06 11:10:19.212877 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:19.215328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d7d68bd6-7254-496c-86ab-b9bea5ed53f0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Returning 409 to user: Cannot 'attach_volume' instance 97907bbb-c089-4899-8d70-8c012daf803b while it is in vm_state rescued {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:10:19.216316 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d7d68bd6-7254-496c-86ab-b9bea5ed53f0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.149883 Sep 06 11:10:19.226661 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2127/4267] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:10:19 2022] POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/os-volume_attachments => generated 152 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:10:19.233739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-df42e907-e184-4a83-ad99-985e2592d88e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:19.234566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-df42e907-e184-4a83-ad99-985e2592d88e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:19.292312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14cbba91d5874eb3992ff869ff32e98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca2ee6cad064b14bd68229c859db365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:19.309130 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bb745c31-fb53-4889-9720-acf4c766be18 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 200 len: 1306 microversion: 2.1 time: 0.309408 Sep 06 11:10:19.310337 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2141/4268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:18 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 1306 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:19.316234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-661ebc8a-707a-457c-aa47-d8f45e3845ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:19.321669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-661ebc8a-707a-457c-aa47-d8f45e3845ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:19.337027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-661ebc8a-707a-457c-aa47-d8f45e3845ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:19.337836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-661ebc8a-707a-457c-aa47-d8f45e3845ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:19.338986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-661ebc8a-707a-457c-aa47-d8f45e3845ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:19.340129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-661ebc8a-707a-457c-aa47-d8f45e3845ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:19.340910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-661ebc8a-707a-457c-aa47-d8f45e3845ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:19.341595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-661ebc8a-707a-457c-aa47-d8f45e3845ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:19.366628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-df42e907-e184-4a83-ad99-985e2592d88e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:19.377552 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-df42e907-e184-4a83-ad99-985e2592d88e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1228 microversion: 2.1 time: 0.149645 Sep 06 11:10:19.378157 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2128/4269] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:19 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1228 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:19.921040 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-661ebc8a-707a-457c-aa47-d8f45e3845ad tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/action" status: 202 len: 0 microversion: 2.1 time: 0.609122 Sep 06 11:10:19.928258 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2142/4270] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:10:19 2022] POST /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:10:19.952433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f8378bc9-2a2d-4bfe-9b2d-6c0efcc33c25 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:19.955601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f8378bc9-2a2d-4bfe-9b2d-6c0efcc33c25 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:20.001010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8378bc9-2a2d-4bfe-9b2d-6c0efcc33c25 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:20.005498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8378bc9-2a2d-4bfe-9b2d-6c0efcc33c25 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:20.006284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8378bc9-2a2d-4bfe-9b2d-6c0efcc33c25 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:20.009056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8378bc9-2a2d-4bfe-9b2d-6c0efcc33c25 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:20.009908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8378bc9-2a2d-4bfe-9b2d-6c0efcc33c25 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:20.010647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8378bc9-2a2d-4bfe-9b2d-6c0efcc33c25 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:20.325388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f8378bc9-2a2d-4bfe-9b2d-6c0efcc33c25 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:20.350974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5c1f18ff-10a3-4958-b36b-e116e3ef4f76 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:20.352724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5c1f18ff-10a3-4958-b36b-e116e3ef4f76 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] [instance: 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:20.357920 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f8378bc9-2a2d-4bfe-9b2d-6c0efcc33c25 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1507 microversion: 2.1 time: 0.429354 Sep 06 11:10:20.359517 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2129/4271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:19 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1507 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:20.389025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c1f18ff-10a3-4958-b36b-e116e3ef4f76 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:20.389542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c1f18ff-10a3-4958-b36b-e116e3ef4f76 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:20.390154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c1f18ff-10a3-4958-b36b-e116e3ef4f76 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:20.394284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c1f18ff-10a3-4958-b36b-e116e3ef4f76 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:20.395324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c1f18ff-10a3-4958-b36b-e116e3ef4f76 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:20.395592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c1f18ff-10a3-4958-b36b-e116e3ef4f76 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:20.407909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-85735f84-ca2b-419a-a64c-6e1abf17f378 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:20.408810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-85735f84-ca2b-419a-a64c-6e1abf17f378 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-5c1f18ff-10a3-4958-b36b-e116e3ef4f76 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] HTTP exception thrown: Instance 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 could not be found. Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5c1f18ff-10a3-4958-b36b-e116e3ef4f76 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Request method failure captured: Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 HTTP/1.1 Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyp40cWZg81WNLXCqfPHdIj8C032h4syHFfM2MZePC_7YYQj0LMAGoqO9eTehCuwEcX8BqlorlHl71HY0cCbTF_PnIO5XKDPIdshU3JxG7Rvw-qPc28P_lOlaABnp6ChQkntd_Q3S77YnjCC7eBLWvF-xTiODiLv0eYMx6VKp2yBqGw Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2ca2ee6cad064b14bd68229c859db365 Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerPasswordTestJSON-1962200280 Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ca2ee6cad064b14bd68229c859db365"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca2ee6cad064b14bd68229c859db365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ca2ee6cad064b14bd68229c859db365"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca2ee6cad064b14bd68229c859db365"}]}] Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerPasswordTestJSON-1962200280 Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2ca2ee6cad064b14bd68229c859db365 Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1962200280 Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerPasswordTestJSON-1962200280-project Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 14cbba91d5874eb3992ff869ff32e98a Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerPasswordTestJSON-1962200280-project Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 could not be found. Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '8acf98df-d71a-43a9-9c60-42ea9d2a2dd1'} Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 could not be found. Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:10:20.440649 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:10:20.444381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 could not be found. Sep 06 11:10:20.444381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:10:20.444381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:10:20.444381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:10:20.444381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:20.444381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:10:20.444381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:10:20.444381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:10:20.444381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:10:20.444381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 could not be found. Sep 06 11:10:20.444381 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:10:20.444381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5c1f18ff-10a3-4958-b36b-e116e3ef4f76 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] Returning 404 to user: Instance 8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:10:20.444381 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5c1f18ff-10a3-4958-b36b-e116e3ef4f76 tempest-ServerPasswordTestJSON-1962200280 tempest-ServerPasswordTestJSON-1962200280-project] 10.222.0.20 "GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1" status: 404 len: 111 microversion: 2.1 time: 0.095750 Sep 06 11:10:20.455577 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2143/4272] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:20 2022] GET /compute/v2.1/servers/8acf98df-d71a-43a9-9c60-42ea9d2a2dd1 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:10:20.606707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-85735f84-ca2b-419a-a64c-6e1abf17f378 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:20.616646 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-85735f84-ca2b-419a-a64c-6e1abf17f378 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1228 microversion: 2.1 time: 0.214911 Sep 06 11:10:20.619901 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2130/4273] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:20 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1228 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:20.820218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bfe536f4-a3e1-4684-b849-7d873622a73e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f32303a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:20.889561 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bfe536f4-a3e1-4684-b849-7d873622a73e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/7c0ef175-345e-4080-babe-664f868ae4fa" status: 200 len: 662 microversion: 2.1 time: 0.073730 Sep 06 11:10:20.890148 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2144/4274] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:10:20 2022] GET /compute/v2.1/images/7c0ef175-345e-4080-babe-664f868ae4fa => generated 662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:20.905685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2f31f92a-fafb-4c88-bed4-db7d21bd2557 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f8b449d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:21.081773 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2f31f92a-fafb-4c88-bed4-db7d21bd2557 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/7c0ef175-345e-4080-babe-664f868ae4fa" status: 200 len: 662 microversion: 2.1 time: 0.180546 Sep 06 11:10:21.082705 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2131/4275] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:10:20 2022] GET /compute/v2.1/images/7c0ef175-345e-4080-babe-664f868ae4fa => generated 662 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:21.383030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-79ec9db8-8cb8-4691-9198-36624eaa9f1e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:21.384404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-79ec9db8-8cb8-4691-9198-36624eaa9f1e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:21.398712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ec9db8-8cb8-4691-9198-36624eaa9f1e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:21.404316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ec9db8-8cb8-4691-9198-36624eaa9f1e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:21.413578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ec9db8-8cb8-4691-9198-36624eaa9f1e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:21.413578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ec9db8-8cb8-4691-9198-36624eaa9f1e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:21.413578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ec9db8-8cb8-4691-9198-36624eaa9f1e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:21.413578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79ec9db8-8cb8-4691-9198-36624eaa9f1e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:21.657679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5751f17f-8726-4d1b-9bf5-64e9e70898c5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:21.658631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5751f17f-8726-4d1b-9bf5-64e9e70898c5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:21.675791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5751f17f-8726-4d1b-9bf5-64e9e70898c5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:21.688718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5751f17f-8726-4d1b-9bf5-64e9e70898c5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:21.690302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5751f17f-8726-4d1b-9bf5-64e9e70898c5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:21.691312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5751f17f-8726-4d1b-9bf5-64e9e70898c5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:21.693684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5751f17f-8726-4d1b-9bf5-64e9e70898c5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:21.695399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5751f17f-8726-4d1b-9bf5-64e9e70898c5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:21.705885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-79ec9db8-8cb8-4691-9198-36624eaa9f1e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:21.730420 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-79ec9db8-8cb8-4691-9198-36624eaa9f1e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1507 microversion: 2.1 time: 0.349213 Sep 06 11:10:21.731720 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2145/4276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:21 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1507 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:21.884166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5751f17f-8726-4d1b-9bf5-64e9e70898c5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:21.895564 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5751f17f-8726-4d1b-9bf5-64e9e70898c5 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1224 microversion: 2.1 time: 0.242461 Sep 06 11:10:21.897624 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2132/4277] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:21 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1224 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:22.759119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-be5ac8b4-ea3e-4cf1-a882-1d117ad48fb3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:22.767293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-be5ac8b4-ea3e-4cf1-a882-1d117ad48fb3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:22.771158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be5ac8b4-ea3e-4cf1-a882-1d117ad48fb3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:22.772010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be5ac8b4-ea3e-4cf1-a882-1d117ad48fb3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:22.772827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be5ac8b4-ea3e-4cf1-a882-1d117ad48fb3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:22.773804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be5ac8b4-ea3e-4cf1-a882-1d117ad48fb3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:22.774538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be5ac8b4-ea3e-4cf1-a882-1d117ad48fb3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:22.775233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be5ac8b4-ea3e-4cf1-a882-1d117ad48fb3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:22.925329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-073342e6-ed4c-4861-b8e6-00cf2246dd0d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:22.925329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-073342e6-ed4c-4861-b8e6-00cf2246dd0d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:22.933569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-073342e6-ed4c-4861-b8e6-00cf2246dd0d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:22.934376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-073342e6-ed4c-4861-b8e6-00cf2246dd0d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:22.935082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-073342e6-ed4c-4861-b8e6-00cf2246dd0d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:22.936026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-073342e6-ed4c-4861-b8e6-00cf2246dd0d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:22.936739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-073342e6-ed4c-4861-b8e6-00cf2246dd0d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:22.937269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-073342e6-ed4c-4861-b8e6-00cf2246dd0d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:23.228529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-073342e6-ed4c-4861-b8e6-00cf2246dd0d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:23.243145 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-073342e6-ed4c-4861-b8e6-00cf2246dd0d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1280 microversion: 2.1 time: 0.322871 Sep 06 11:10:23.244395 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2133/4278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:22 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1280 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:23.453930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8a83a730-821c-4cdf-a20d-e8344a1e9722 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f873eee0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:23.542727 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8a83a730-821c-4cdf-a20d-e8344a1e9722 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/07368a45-efb8-4fd0-bfd1-97ce886862fa" status: 200 len: 660 microversion: 2.1 time: 0.092845 Sep 06 11:10:23.543879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-be5ac8b4-ea3e-4cf1-a882-1d117ad48fb3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:23.547387 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2134/4279] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:10:23 2022] GET /compute/v2.1/images/07368a45-efb8-4fd0-bfd1-97ce886862fa => generated 660 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:10:23.566062 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-be5ac8b4-ea3e-4cf1-a882-1d117ad48fb3 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1507 microversion: 2.1 time: 0.811058 Sep 06 11:10:23.566676 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2146/4280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:22 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1507 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:23.580643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93d44321-42de-4367-ba1b-46216091688f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f8a6a280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:23.643229 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-93d44321-42de-4367-ba1b-46216091688f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/07368a45-efb8-4fd0-bfd1-97ce886862fa" status: 200 len: 660 microversion: 2.1 time: 0.074175 Sep 06 11:10:23.646119 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2135/4281] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:10:23 2022] GET /compute/v2.1/images/07368a45-efb8-4fd0-bfd1-97ce886862fa => generated 660 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:23.721897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-489303545", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:23.783373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:10:24.271081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-140a1498-92c8-44f5-a4db-ae28b07035cc tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:24.276495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-140a1498-92c8-44f5-a4db-ae28b07035cc tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:24.308635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-140a1498-92c8-44f5-a4db-ae28b07035cc tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:24.318902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-140a1498-92c8-44f5-a4db-ae28b07035cc tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:24.322517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-140a1498-92c8-44f5-a4db-ae28b07035cc tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:24.335612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-140a1498-92c8-44f5-a4db-ae28b07035cc tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:24.337637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-140a1498-92c8-44f5-a4db-ae28b07035cc tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:24.338512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-140a1498-92c8-44f5-a4db-ae28b07035cc tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:24.500652 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-140a1498-92c8-44f5-a4db-ae28b07035cc tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:24.521955 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-140a1498-92c8-44f5-a4db-ae28b07035cc tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1288 microversion: 2.1 time: 0.257962 Sep 06 11:10:24.523398 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2136/4282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:24 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1288 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:24.555836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:10:24.556670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:10:24.559474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:10:24.559474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:10:24.561552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:10:24.574304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:24.575050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:24.575715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:24.576893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:24.578217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:24.578860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:24.592707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e528213-0ab7-45c0-87f2-c9e90fe0914e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:24.593676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e528213-0ab7-45c0-87f2-c9e90fe0914e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:24.615249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e528213-0ab7-45c0-87f2-c9e90fe0914e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:24.618702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e528213-0ab7-45c0-87f2-c9e90fe0914e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:24.622606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e528213-0ab7-45c0-87f2-c9e90fe0914e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:24.627036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e528213-0ab7-45c0-87f2-c9e90fe0914e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:24.630638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e528213-0ab7-45c0-87f2-c9e90fe0914e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:24.632190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e528213-0ab7-45c0-87f2-c9e90fe0914e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:24.660794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Getting quotas for project 515ab27962674e99a602451fb8f3da61. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:10:24.682425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Getting quotas for user 973422e272f6404f81fcf4702fcfb5c5 and project 515ab27962674e99a602451fb8f3da61. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:10:24.737573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:10:24.756757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:10:25.051651 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f1c12e07-b0fd-42b5-861a-c09e8600ea92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.334157 Sep 06 11:10:25.078711 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2147/4283] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:10:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:10:25.139350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7e528213-0ab7-45c0-87f2-c9e90fe0914e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:25.154134 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e528213-0ab7-45c0-87f2-c9e90fe0914e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1513 microversion: 2.1 time: 0.566284 Sep 06 11:10:25.162133 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2137/4284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:24 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1513 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:25.236822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1432406836", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:25.550618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:10:25.557042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-37dd4e52-0388-4e77-959c-f792f0a1ab16 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:25.557974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-37dd4e52-0388-4e77-959c-f792f0a1ab16 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:25.607274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-37dd4e52-0388-4e77-959c-f792f0a1ab16 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:25.609666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-37dd4e52-0388-4e77-959c-f792f0a1ab16 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:25.613575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-37dd4e52-0388-4e77-959c-f792f0a1ab16 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:25.616598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-37dd4e52-0388-4e77-959c-f792f0a1ab16 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:25.617142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-37dd4e52-0388-4e77-959c-f792f0a1ab16 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:25.617608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-37dd4e52-0388-4e77-959c-f792f0a1ab16 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:25.903534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-37dd4e52-0388-4e77-959c-f792f0a1ab16 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:25.917882 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-37dd4e52-0388-4e77-959c-f792f0a1ab16 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1286 microversion: 2.1 time: 0.364774 Sep 06 11:10:25.918476 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2138/4285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:25 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1286 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:26.290921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:10:26.294124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:10:26.295183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:10:26.297193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:10:26.298097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:10:26.313165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:26.313165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:26.314288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:26.315536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:26.316259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:26.317181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:26.347660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Getting quotas for project 515ab27962674e99a602451fb8f3da61. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:10:26.355840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Getting quotas for user 973422e272f6404f81fcf4702fcfb5c5 and project 515ab27962674e99a602451fb8f3da61. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:10:26.385461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:10:26.388443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:10:26.617331 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f0c147d1-cc39-47c1-ad92-4a4ecca0a220 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.388126 Sep 06 11:10:26.620384 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2148/4286] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:10:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:10:26.632785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-426a6f7e-5cee-47f7-9724-48aed6219650 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:26.633486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-426a6f7e-5cee-47f7-9724-48aed6219650 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:26.796006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-426a6f7e-5cee-47f7-9724-48aed6219650 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:26.806543 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-426a6f7e-5cee-47f7-9724-48aed6219650 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1218 microversion: 2.1 time: 0.178239 Sep 06 11:10:26.825698 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2139/4287] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:26 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1218 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:26.956000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9fb63ab3-46a4-4eb3-8547-e34e92cdbcc8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:26.957061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9fb63ab3-46a4-4eb3-8547-e34e92cdbcc8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:26.976933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fb63ab3-46a4-4eb3-8547-e34e92cdbcc8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:26.977921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fb63ab3-46a4-4eb3-8547-e34e92cdbcc8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:26.979253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fb63ab3-46a4-4eb3-8547-e34e92cdbcc8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:26.980460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fb63ab3-46a4-4eb3-8547-e34e92cdbcc8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:26.981829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fb63ab3-46a4-4eb3-8547-e34e92cdbcc8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:26.982557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9fb63ab3-46a4-4eb3-8547-e34e92cdbcc8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:27.149088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9fb63ab3-46a4-4eb3-8547-e34e92cdbcc8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:27.176517 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9fb63ab3-46a4-4eb3-8547-e34e92cdbcc8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1286 microversion: 2.1 time: 0.226096 Sep 06 11:10:27.180452 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2149/4288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:26 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1286 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:27.833163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-380ce58a-669c-4f48-a31d-156f46d8495f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:27.834681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-380ce58a-669c-4f48-a31d-156f46d8495f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:27.917787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-380ce58a-669c-4f48-a31d-156f46d8495f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:27.923129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-31d46116-9a9b-4737-b83f-dc3930b07008 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:27.925734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31d46116-9a9b-4737-b83f-dc3930b07008 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:27.926180 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-380ce58a-669c-4f48-a31d-156f46d8495f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1218 microversion: 2.1 time: 0.097379 Sep 06 11:10:27.927376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31d46116-9a9b-4737-b83f-dc3930b07008 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:27.927959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31d46116-9a9b-4737-b83f-dc3930b07008 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:27.928777 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2150/4289] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:27 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:27.936221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31d46116-9a9b-4737-b83f-dc3930b07008 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:27.940977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31d46116-9a9b-4737-b83f-dc3930b07008 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:27.940977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31d46116-9a9b-4737-b83f-dc3930b07008 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:27.970876 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-31d46116-9a9b-4737-b83f-dc3930b07008 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.175696 Sep 06 11:10:27.972032 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2140/4290] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Sep 6 11:10:27 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:28.148471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-794232227", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "f012b585-349a-47ae-a222-7c651513ce05"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:28.205875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-35301491-7fe9-449c-a6f1-9308d56dad10 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:28.206743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-35301491-7fe9-449c-a6f1-9308d56dad10 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:28.231678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] validate_networks() for [('f012b585-349a-47ae-a222-7c651513ce05', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:10:28.247711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35301491-7fe9-449c-a6f1-9308d56dad10 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:28.249857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35301491-7fe9-449c-a6f1-9308d56dad10 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:28.253042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35301491-7fe9-449c-a6f1-9308d56dad10 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:28.254484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35301491-7fe9-449c-a6f1-9308d56dad10 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:28.258292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35301491-7fe9-449c-a6f1-9308d56dad10 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:28.261840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-35301491-7fe9-449c-a6f1-9308d56dad10 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:29.208845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-35301491-7fe9-449c-a6f1-9308d56dad10 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:29.222238 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-35301491-7fe9-449c-a6f1-9308d56dad10 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1328 microversion: 2.1 time: 1.020715 Sep 06 11:10:29.243178 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2141/4291] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:28 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1328 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:29.256264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b793893b-f197-482e-bd72-7f909e3b01db tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'create', calling method: .version_select at 0x7f90f8a6aee0>, body: {"keypair": {"name": "tempest-keypair-1836875660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyz8u9eCBjeRY7FirdJw84OPnfBwaiFo8KlXdeXZtDWAFiqgR3cRjfsuQIMfu0pM/DBWliSVQnQ8XIPRSELGB2Brg4Sl7niDbPSKWtCGS4YXmjGnW7XQdeYACt2GSnnHA=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:29.278475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-b793893b-f197-482e-bd72-7f909e3b01db tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Getting quotas for project 887d04ff8eee40e59ec6dd248dd5b548. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:10:29.289251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-b793893b-f197-482e-bd72-7f909e3b01db tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Getting quotas for user 3e45dfaf9fd949548bca37303a117bb1 and project 887d04ff8eee40e59ec6dd248dd5b548. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:10:29.444206 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b793893b-f197-482e-bd72-7f909e3b01db tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.199715 Sep 06 11:10:29.451451 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2142/4292] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:10:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:29.458579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-63d9de01-11c0-4462-a9f5-f470356e3a1b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:29.462305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-63d9de01-11c0-4462-a9f5-f470356e3a1b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:29.491273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63d9de01-11c0-4462-a9f5-f470356e3a1b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:29.492091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63d9de01-11c0-4462-a9f5-f470356e3a1b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:29.492697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63d9de01-11c0-4462-a9f5-f470356e3a1b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:29.493615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63d9de01-11c0-4462-a9f5-f470356e3a1b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:29.495083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63d9de01-11c0-4462-a9f5-f470356e3a1b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:29.495765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63d9de01-11c0-4462-a9f5-f470356e3a1b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:29.696729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-63d9de01-11c0-4462-a9f5-f470356e3a1b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:29.708948 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-63d9de01-11c0-4462-a9f5-f470356e3a1b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1270 microversion: 2.1 time: 0.255956 Sep 06 11:10:29.712025 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2143/4293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:29 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1270 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:30.253384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-49ed7c67-43ad-4736-988a-183d6270ae40 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:30.254017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-49ed7c67-43ad-4736-988a-183d6270ae40 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:30.283471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49ed7c67-43ad-4736-988a-183d6270ae40 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:30.284172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49ed7c67-43ad-4736-988a-183d6270ae40 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:30.284978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49ed7c67-43ad-4736-988a-183d6270ae40 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:30.286254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49ed7c67-43ad-4736-988a-183d6270ae40 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:30.290724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49ed7c67-43ad-4736-988a-183d6270ae40 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:30.291430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49ed7c67-43ad-4736-988a-183d6270ae40 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:30.532857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:10:30.539749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:10:30.540466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:10:30.543558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:10:30.545584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:10:30.607908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:30.608974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:30.609627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:30.610816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:30.611533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:30.612137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:30.639663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Getting quotas for project 5da257e162aa4109a0bc914b2b4e13ed. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:10:30.671092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Getting quotas for user 094361c60a54434fb90e605c040800ac and project 5da257e162aa4109a0bc914b2b4e13ed. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:10:30.705897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:10:30.705897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:10:30.764815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-49ed7c67-43ad-4736-988a-183d6270ae40 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:30.780809 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-49ed7c67-43ad-4736-988a-183d6270ae40 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1328 microversion: 2.1 time: 0.536173 Sep 06 11:10:30.784914 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2144/4294] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:30 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1328 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:30.792091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a79a4c0d-b0fc-4ab9-a587-0f71ca38d97e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:30.806881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a79a4c0d-b0fc-4ab9-a587-0f71ca38d97e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:30.817917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a79a4c0d-b0fc-4ab9-a587-0f71ca38d97e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:30.827590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a79a4c0d-b0fc-4ab9-a587-0f71ca38d97e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:30.828126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a79a4c0d-b0fc-4ab9-a587-0f71ca38d97e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:30.828900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a79a4c0d-b0fc-4ab9-a587-0f71ca38d97e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:30.829613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a79a4c0d-b0fc-4ab9-a587-0f71ca38d97e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:30.844744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a79a4c0d-b0fc-4ab9-a587-0f71ca38d97e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:30.984949 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a78f8441-9d15-455c-86d6-36112856aa5d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.840655 Sep 06 11:10:30.991609 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2151/4295] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:10:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:10:31.007587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e5404e71-aab9-44fc-9f14-5e4d35a7f8ee tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:31.015545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e5404e71-aab9-44fc-9f14-5e4d35a7f8ee tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:31.303164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a79a4c0d-b0fc-4ab9-a587-0f71ca38d97e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:31.329294 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a79a4c0d-b0fc-4ab9-a587-0f71ca38d97e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1288 microversion: 2.1 time: 0.542828 Sep 06 11:10:31.330111 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2145/4296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:30 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1288 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:31.543065 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e5404e71-aab9-44fc-9f14-5e4d35a7f8ee tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1328 microversion: 2.1 time: 0.543984 Sep 06 11:10:31.544895 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2152/4297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:30 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1328 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:31.810069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca261f70-4220-40b4-ba23-4510b81ae1c8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:31.810696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca261f70-4220-40b4-ba23-4510b81ae1c8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:31.830436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca261f70-4220-40b4-ba23-4510b81ae1c8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:31.831073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca261f70-4220-40b4-ba23-4510b81ae1c8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:31.831442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca261f70-4220-40b4-ba23-4510b81ae1c8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:31.832154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca261f70-4220-40b4-ba23-4510b81ae1c8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:31.838262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca261f70-4220-40b4-ba23-4510b81ae1c8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:31.840149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca261f70-4220-40b4-ba23-4510b81ae1c8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:32.264385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ca261f70-4220-40b4-ba23-4510b81ae1c8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:32.276142 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ca261f70-4220-40b4-ba23-4510b81ae1c8 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1328 microversion: 2.1 time: 0.470237 Sep 06 11:10:32.277204 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2146/4298] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:31 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1328 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:32.354214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8aea84db-a740-430b-9a24-61ebf7115d8c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:32.355459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8aea84db-a740-430b-9a24-61ebf7115d8c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:32.371591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aea84db-a740-430b-9a24-61ebf7115d8c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:32.372098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aea84db-a740-430b-9a24-61ebf7115d8c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:32.372588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aea84db-a740-430b-9a24-61ebf7115d8c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:32.377845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aea84db-a740-430b-9a24-61ebf7115d8c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:32.378869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aea84db-a740-430b-9a24-61ebf7115d8c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:32.379525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aea84db-a740-430b-9a24-61ebf7115d8c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:32.588251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b06edc95-5b5d-46fd-bce6-cc97d5a344ca tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:32.588886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b06edc95-5b5d-46fd-bce6-cc97d5a344ca tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:32.707872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8aea84db-a740-430b-9a24-61ebf7115d8c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:32.759812 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8aea84db-a740-430b-9a24-61ebf7115d8c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1276 microversion: 2.1 time: 0.409733 Sep 06 11:10:32.761012 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2153/4299] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:32 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1276 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:32.789355 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b06edc95-5b5d-46fd-bce6-cc97d5a344ca tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1328 microversion: 2.1 time: 0.204929 Sep 06 11:10:32.805812 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2147/4300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:32 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1328 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:33.302961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-93252406-0ff0-41cc-80e2-4e22527a1527 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:33.303797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-93252406-0ff0-41cc-80e2-4e22527a1527 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:33.343216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93252406-0ff0-41cc-80e2-4e22527a1527 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:33.343216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93252406-0ff0-41cc-80e2-4e22527a1527 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:33.343216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93252406-0ff0-41cc-80e2-4e22527a1527 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:33.343216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93252406-0ff0-41cc-80e2-4e22527a1527 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:33.343216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93252406-0ff0-41cc-80e2-4e22527a1527 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:33.343216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93252406-0ff0-41cc-80e2-4e22527a1527 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:33.785956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f6d02b5d-54fc-476d-b788-4f6adba241f8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:33.791369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f6d02b5d-54fc-476d-b788-4f6adba241f8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:33.815992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6d02b5d-54fc-476d-b788-4f6adba241f8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:33.816726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6d02b5d-54fc-476d-b788-4f6adba241f8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:33.817421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6d02b5d-54fc-476d-b788-4f6adba241f8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:33.818375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6d02b5d-54fc-476d-b788-4f6adba241f8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:33.819162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6d02b5d-54fc-476d-b788-4f6adba241f8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:33.822510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6d02b5d-54fc-476d-b788-4f6adba241f8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:33.878092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:33.923377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-93252406-0ff0-41cc-80e2-4e22527a1527 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:33.935994 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-93252406-0ff0-41cc-80e2-4e22527a1527 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1328 microversion: 2.1 time: 0.639346 Sep 06 11:10:33.941845 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2154/4301] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:33 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1328 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:33.957829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-96f77b50-c1c2-401b-ae54-6f5ca72aefaa tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:33.958720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-96f77b50-c1c2-401b-ae54-6f5ca72aefaa tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:33.977542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96f77b50-c1c2-401b-ae54-6f5ca72aefaa tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:33.980388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96f77b50-c1c2-401b-ae54-6f5ca72aefaa tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:33.984692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f6d02b5d-54fc-476d-b788-4f6adba241f8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:33.995787 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f6d02b5d-54fc-476d-b788-4f6adba241f8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1276 microversion: 2.1 time: 0.215686 Sep 06 11:10:33.996659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96f77b50-c1c2-401b-ae54-6f5ca72aefaa tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:33.999286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96f77b50-c1c2-401b-ae54-6f5ca72aefaa tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:34.003390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96f77b50-c1c2-401b-ae54-6f5ca72aefaa tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:34.005085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96f77b50-c1c2-401b-ae54-6f5ca72aefaa tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:34.006021 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2148/4302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:33 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:34.190338 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-96f77b50-c1c2-401b-ae54-6f5ca72aefaa tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1337 microversion: 2.1 time: 0.249920 Sep 06 11:10:34.191800 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2155/4303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:33 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1337 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:34.216453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e89ee739-75de-4ecd-a963-dbe16f82f795 req-0db32aea-08d3-4d19-b68c-ea0cfc9c9720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2efebce8-1a38-448b-8fe9-72a033a000bb", "tag": "8199783c-e27d-432a-9c27-c4ed212223cd"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:34.227579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e89ee739-75de-4ecd-a963-dbe16f82f795 req-0db32aea-08d3-4d19-b68c-ea0cfc9c9720 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:34.228308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e89ee739-75de-4ecd-a963-dbe16f82f795 req-0db32aea-08d3-4d19-b68c-ea0cfc9c9720 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:34.228791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e89ee739-75de-4ecd-a963-dbe16f82f795 req-0db32aea-08d3-4d19-b68c-ea0cfc9c9720 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:34.242644 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e89ee739-75de-4ecd-a963-dbe16f82f795 req-0db32aea-08d3-4d19-b68c-ea0cfc9c9720 service nova] Creating event network-changed:8199783c-e27d-432a-9c27-c4ed212223cd for instance 2efebce8-1a38-448b-8fe9-72a033a000bb on nch2-master-1 Sep 06 11:10:34.249052 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e89ee739-75de-4ecd-a963-dbe16f82f795 req-0db32aea-08d3-4d19-b68c-ea0cfc9c9720 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043654 Sep 06 11:10:34.249927 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2149/4304] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:34.970919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b62b8742-19f5-4548-8a63-c688cb7c086a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:34.971490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b62b8742-19f5-4548-8a63-c688cb7c086a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:34.991189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b62b8742-19f5-4548-8a63-c688cb7c086a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:34.991189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b62b8742-19f5-4548-8a63-c688cb7c086a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:34.991189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b62b8742-19f5-4548-8a63-c688cb7c086a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:34.991189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b62b8742-19f5-4548-8a63-c688cb7c086a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:34.991498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b62b8742-19f5-4548-8a63-c688cb7c086a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:34.991809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b62b8742-19f5-4548-8a63-c688cb7c086a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:35.045631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dcddd6b6-bb98-4fcd-bdc5-db236f33b26c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:35.046389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dcddd6b6-bb98-4fcd-bdc5-db236f33b26c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:35.068253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcddd6b6-bb98-4fcd-bdc5-db236f33b26c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:35.068253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcddd6b6-bb98-4fcd-bdc5-db236f33b26c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:35.068253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcddd6b6-bb98-4fcd-bdc5-db236f33b26c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:35.068253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcddd6b6-bb98-4fcd-bdc5-db236f33b26c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:35.068253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcddd6b6-bb98-4fcd-bdc5-db236f33b26c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:35.068602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:35.070723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcddd6b6-bb98-4fcd-bdc5-db236f33b26c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:35.598427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dcddd6b6-bb98-4fcd-bdc5-db236f33b26c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:35.620815 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dcddd6b6-bb98-4fcd-bdc5-db236f33b26c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1276 microversion: 2.1 time: 0.584118 Sep 06 11:10:35.639520 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2150/4305] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:35 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1276 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:35.645335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a49f2d56-e9d8-4b31-a188-83e7e54d8c9d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:35.646856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a49f2d56-e9d8-4b31-a188-83e7e54d8c9d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:35.653351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a49f2d56-e9d8-4b31-a188-83e7e54d8c9d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:35.654269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a49f2d56-e9d8-4b31-a188-83e7e54d8c9d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:35.654941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a49f2d56-e9d8-4b31-a188-83e7e54d8c9d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:35.656517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a49f2d56-e9d8-4b31-a188-83e7e54d8c9d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:35.657821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a49f2d56-e9d8-4b31-a188-83e7e54d8c9d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:35.658545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a49f2d56-e9d8-4b31-a188-83e7e54d8c9d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:36.712002 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a49f2d56-e9d8-4b31-a188-83e7e54d8c9d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1423 microversion: 2.1 time: 1.070926 Sep 06 11:10:36.712657 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2151/4306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:35 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1423 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:36.732957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-231c4b11-61e8-4158-9509-cdda615e56d2 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:36.733592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-231c4b11-61e8-4158-9509-cdda615e56d2 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:36.763688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-231c4b11-61e8-4158-9509-cdda615e56d2 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:36.768946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-231c4b11-61e8-4158-9509-cdda615e56d2 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:36.769514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-231c4b11-61e8-4158-9509-cdda615e56d2 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:36.770319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-231c4b11-61e8-4158-9509-cdda615e56d2 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:36.773798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-231c4b11-61e8-4158-9509-cdda615e56d2 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:36.775793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-231c4b11-61e8-4158-9509-cdda615e56d2 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:37.364778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b62b8742-19f5-4548-8a63-c688cb7c086a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:37.374550 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b62b8742-19f5-4548-8a63-c688cb7c086a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1328 microversion: 2.1 time: 2.409068 Sep 06 11:10:37.376714 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2156/4307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:34 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1328 bytes in 2412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:37.396447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-b113ef05-7658-4caf-95ed-ad62ca782526 req-dd8de78c-a43e-4be8-a5f6-f3db4bd79a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d53b0f-bd9f-479e-948b-bbefbd0d8597", "tag": "56dd829f-74c4-4912-9aac-6b30a6e3cd3e"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:37.416786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b113ef05-7658-4caf-95ed-ad62ca782526 req-dd8de78c-a43e-4be8-a5f6-f3db4bd79a89 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:37.417322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b113ef05-7658-4caf-95ed-ad62ca782526 req-dd8de78c-a43e-4be8-a5f6-f3db4bd79a89 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:37.417852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b113ef05-7658-4caf-95ed-ad62ca782526 req-dd8de78c-a43e-4be8-a5f6-f3db4bd79a89 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:37.468633 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-b113ef05-7658-4caf-95ed-ad62ca782526 req-dd8de78c-a43e-4be8-a5f6-f3db4bd79a89 service nova] Creating event network-changed:56dd829f-74c4-4912-9aac-6b30a6e3cd3e for instance 77d53b0f-bd9f-479e-948b-bbefbd0d8597 on nch1-master-1 Sep 06 11:10:37.486228 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-b113ef05-7658-4caf-95ed-ad62ca782526 req-dd8de78c-a43e-4be8-a5f6-f3db4bd79a89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107265 Sep 06 11:10:37.489130 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2157/4308] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:37.656978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-231c4b11-61e8-4158-9509-cdda615e56d2 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:37.667283 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-231c4b11-61e8-4158-9509-cdda615e56d2 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1318 microversion: 2.1 time: 0.948691 Sep 06 11:10:37.668516 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2152/4309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:36 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1318 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:37.754880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fc265cb9-8529-4e09-b49d-9ad2ab9d93d0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:37.757681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fc265cb9-8529-4e09-b49d-9ad2ab9d93d0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:37.772771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc265cb9-8529-4e09-b49d-9ad2ab9d93d0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:37.773487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc265cb9-8529-4e09-b49d-9ad2ab9d93d0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:37.776604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc265cb9-8529-4e09-b49d-9ad2ab9d93d0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:37.782318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc265cb9-8529-4e09-b49d-9ad2ab9d93d0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:37.784759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc265cb9-8529-4e09-b49d-9ad2ab9d93d0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:37.789581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc265cb9-8529-4e09-b49d-9ad2ab9d93d0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:38.252841 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fc265cb9-8529-4e09-b49d-9ad2ab9d93d0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1463 microversion: 2.1 time: 0.504557 Sep 06 11:10:38.260577 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2158/4310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:37 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1463 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:38.404754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0338d493-5f29-4845-8aba-bf5e72d09e8a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:38.405389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0338d493-5f29-4845-8aba-bf5e72d09e8a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:38.420604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:38.424798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0338d493-5f29-4845-8aba-bf5e72d09e8a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:38.425297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0338d493-5f29-4845-8aba-bf5e72d09e8a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:38.425748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0338d493-5f29-4845-8aba-bf5e72d09e8a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:38.426786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0338d493-5f29-4845-8aba-bf5e72d09e8a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:38.427492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0338d493-5f29-4845-8aba-bf5e72d09e8a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:38.428092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0338d493-5f29-4845-8aba-bf5e72d09e8a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:38.616547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1289953454", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d95aa1af-6b57-409c-9474-d23f6e216956"}], "security_groups": [{"name": "tempest-securitygroup--1121842882"}], "key_name": "tempest-keypair-1836875660", "user_data": "}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:38.830415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0338d493-5f29-4845-8aba-bf5e72d09e8a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:38.845533 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0338d493-5f29-4845-8aba-bf5e72d09e8a tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1328 microversion: 2.1 time: 0.446198 Sep 06 11:10:38.846355 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2153/4311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:38 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1328 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:38.867898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5f135d51-ee37-487c-8f69-09dea95ac503 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:38.868522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5f135d51-ee37-487c-8f69-09dea95ac503 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:38.876834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f135d51-ee37-487c-8f69-09dea95ac503 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:38.877776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f135d51-ee37-487c-8f69-09dea95ac503 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:38.878361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f135d51-ee37-487c-8f69-09dea95ac503 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:38.879259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f135d51-ee37-487c-8f69-09dea95ac503 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:38.879719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f135d51-ee37-487c-8f69-09dea95ac503 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:38.880152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f135d51-ee37-487c-8f69-09dea95ac503 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:38.893203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] validate_networks() for [('d95aa1af-6b57-409c-9474-d23f6e216956', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:10:39.348524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5f135d51-ee37-487c-8f69-09dea95ac503 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:39.389573 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5f135d51-ee37-487c-8f69-09dea95ac503 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1318 microversion: 2.1 time: 0.510271 Sep 06 11:10:39.397801 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2154/4312] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:38 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:39.416588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-3e77faf1-27ae-47cd-9388-b0b72b89d707 req-806fb9b6-a4e5-4335-8185-b14f4b72c4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016c8ecc-3457-4204-ba5b-3e06970ac490", "tag": "0a339213-93da-46ad-badf-47ea616965d5"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:39.468940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3e77faf1-27ae-47cd-9388-b0b72b89d707 req-806fb9b6-a4e5-4335-8185-b14f4b72c4c9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:39.469825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3e77faf1-27ae-47cd-9388-b0b72b89d707 req-806fb9b6-a4e5-4335-8185-b14f4b72c4c9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:39.470563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3e77faf1-27ae-47cd-9388-b0b72b89d707 req-806fb9b6-a4e5-4335-8185-b14f4b72c4c9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:39.502720 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-3e77faf1-27ae-47cd-9388-b0b72b89d707 req-806fb9b6-a4e5-4335-8185-b14f4b72c4c9 service nova] Creating event network-changed:0a339213-93da-46ad-badf-47ea616965d5 for instance 016c8ecc-3457-4204-ba5b-3e06970ac490 on nch1-master-1 Sep 06 11:10:39.502720 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-3e77faf1-27ae-47cd-9388-b0b72b89d707 req-806fb9b6-a4e5-4335-8185-b14f4b72c4c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097419 Sep 06 11:10:39.502720 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2155/4313] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:39.530096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a2009628-4e25-457e-8df6-748c73ed29e8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:39.531989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a2009628-4e25-457e-8df6-748c73ed29e8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:39.553874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2009628-4e25-457e-8df6-748c73ed29e8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:39.556916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2009628-4e25-457e-8df6-748c73ed29e8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:39.557375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2009628-4e25-457e-8df6-748c73ed29e8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:39.558116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2009628-4e25-457e-8df6-748c73ed29e8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:39.558798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2009628-4e25-457e-8df6-748c73ed29e8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:39.559533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2009628-4e25-457e-8df6-748c73ed29e8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:40.147238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:10:40.149132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:10:40.149838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:10:40.150468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:10:40.151080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:10:40.168423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:40.170188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:40.171281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:40.172339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:40.173396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:40.175052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:40.200777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Getting quotas for project 887d04ff8eee40e59ec6dd248dd5b548. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:10:40.208532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:40.208689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Getting quotas for user 3e45dfaf9fd949548bca37303a117bb1 and project 887d04ff8eee40e59ec6dd248dd5b548. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:10:40.224587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:10:40.227201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:10:40.360941 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a2009628-4e25-457e-8df6-748c73ed29e8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1463 microversion: 2.1 time: 0.840995 Sep 06 11:10:40.362490 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2156/4314] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:39 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1463 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:40.369118 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bca04a72-d86e-4032-a317-c7ae87ce6c48 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.761962 Sep 06 11:10:40.372285 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2159/4315] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:10:38 2022] POST /compute/v2.1/servers => generated 409 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:10:40.385654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5743a495-4053-4680-9977-58a97f07cb3e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:40.386554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5743a495-4053-4680-9977-58a97f07cb3e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:40.394257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c40dd0fc-ae3b-4a1a-aa98-8ed967d7ccd1 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:40.398542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c40dd0fc-ae3b-4a1a-aa98-8ed967d7ccd1 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:40.424098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c40dd0fc-ae3b-4a1a-aa98-8ed967d7ccd1 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:40.429462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c40dd0fc-ae3b-4a1a-aa98-8ed967d7ccd1 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:40.429462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c40dd0fc-ae3b-4a1a-aa98-8ed967d7ccd1 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:40.429462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c40dd0fc-ae3b-4a1a-aa98-8ed967d7ccd1 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:40.429462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c40dd0fc-ae3b-4a1a-aa98-8ed967d7ccd1 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:40.429462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c40dd0fc-ae3b-4a1a-aa98-8ed967d7ccd1 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:40.625829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5743a495-4053-4680-9977-58a97f07cb3e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:40.637214 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5743a495-4053-4680-9977-58a97f07cb3e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1246 microversion: 2.1 time: 0.256320 Sep 06 11:10:40.652263 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2160/4316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:40 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1246 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:40.664249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cb0923e7-cb8e-4abc-a1ac-28dd4644fd2e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:40.665326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cb0923e7-cb8e-4abc-a1ac-28dd4644fd2e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:40.684891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb0923e7-cb8e-4abc-a1ac-28dd4644fd2e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:40.685493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb0923e7-cb8e-4abc-a1ac-28dd4644fd2e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:40.686023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb0923e7-cb8e-4abc-a1ac-28dd4644fd2e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:40.715570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb0923e7-cb8e-4abc-a1ac-28dd4644fd2e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:40.715976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb0923e7-cb8e-4abc-a1ac-28dd4644fd2e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:40.717949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb0923e7-cb8e-4abc-a1ac-28dd4644fd2e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:40.814441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c40dd0fc-ae3b-4a1a-aa98-8ed967d7ccd1 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:40.822841 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c40dd0fc-ae3b-4a1a-aa98-8ed967d7ccd1 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1328 microversion: 2.1 time: 0.439149 Sep 06 11:10:40.831441 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2157/4317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:40 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1328 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:41.313809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cb0923e7-cb8e-4abc-a1ac-28dd4644fd2e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:41.333986 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cb0923e7-cb8e-4abc-a1ac-28dd4644fd2e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1318 microversion: 2.1 time: 0.684007 Sep 06 11:10:41.348613 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2161/4318] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:40 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1318 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:41.387067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5fb7fe67-176a-4aa7-bda5-5790dec97a2e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:41.389384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5fb7fe67-176a-4aa7-bda5-5790dec97a2e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:41.411973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fb7fe67-176a-4aa7-bda5-5790dec97a2e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:41.412774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fb7fe67-176a-4aa7-bda5-5790dec97a2e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:41.413277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fb7fe67-176a-4aa7-bda5-5790dec97a2e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:41.414059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fb7fe67-176a-4aa7-bda5-5790dec97a2e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:41.414879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fb7fe67-176a-4aa7-bda5-5790dec97a2e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:41.415539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fb7fe67-176a-4aa7-bda5-5790dec97a2e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:41.614248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-ed6a0cf0-23f6-4fee-9eaf-dbb8e02d606e req-3f2f9693-929c-40e0-aa84-33e643ac2d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ea5bb59-464b-4701-8ead-642d813f9cc8", "tag": "3e3272e1-1043-4c9b-b236-a9be6435eaf6"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:41.631595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ed6a0cf0-23f6-4fee-9eaf-dbb8e02d606e req-3f2f9693-929c-40e0-aa84-33e643ac2d69 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:41.644650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ed6a0cf0-23f6-4fee-9eaf-dbb8e02d606e req-3f2f9693-929c-40e0-aa84-33e643ac2d69 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:41.646318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ed6a0cf0-23f6-4fee-9eaf-dbb8e02d606e req-3f2f9693-929c-40e0-aa84-33e643ac2d69 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:41.683871 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-ed6a0cf0-23f6-4fee-9eaf-dbb8e02d606e req-3f2f9693-929c-40e0-aa84-33e643ac2d69 service nova] Creating event network-changed:3e3272e1-1043-4c9b-b236-a9be6435eaf6 for instance 9ea5bb59-464b-4701-8ead-642d813f9cc8 on nch1-master-1 Sep 06 11:10:41.699134 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-ed6a0cf0-23f6-4fee-9eaf-dbb8e02d606e req-3f2f9693-929c-40e0-aa84-33e643ac2d69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090658 Sep 06 11:10:41.702765 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2162/4319] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:41.716805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1cc1d39a-1058-4c61-ad89-959ca3e7a1f4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:41.724607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1cc1d39a-1058-4c61-ad89-959ca3e7a1f4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:41.950387 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5fb7fe67-176a-4aa7-bda5-5790dec97a2e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1463 microversion: 2.1 time: 0.568477 Sep 06 11:10:41.957397 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2158/4320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:41 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1463 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:41.977595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fe2ffbc6-38ba-4db1-adfc-3cc86a967629 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:41.981864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fe2ffbc6-38ba-4db1-adfc-3cc86a967629 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:41.990589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1cc1d39a-1058-4c61-ad89-959ca3e7a1f4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:41.997470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe2ffbc6-38ba-4db1-adfc-3cc86a967629 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:41.997992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe2ffbc6-38ba-4db1-adfc-3cc86a967629 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:41.998598 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1cc1d39a-1058-4c61-ad89-959ca3e7a1f4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1246 microversion: 2.1 time: 0.294247 Sep 06 11:10:41.999270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe2ffbc6-38ba-4db1-adfc-3cc86a967629 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:42.003439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe2ffbc6-38ba-4db1-adfc-3cc86a967629 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:42.004230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe2ffbc6-38ba-4db1-adfc-3cc86a967629 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:42.004860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe2ffbc6-38ba-4db1-adfc-3cc86a967629 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:42.022233 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2163/4321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:41 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1246 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:42.371891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-12319d66-0f23-4958-bc85-f1fc4df78084 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:42.372544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-12319d66-0f23-4958-bc85-f1fc4df78084 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:42.385285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12319d66-0f23-4958-bc85-f1fc4df78084 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:42.388495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12319d66-0f23-4958-bc85-f1fc4df78084 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:42.389720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12319d66-0f23-4958-bc85-f1fc4df78084 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:42.393497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12319d66-0f23-4958-bc85-f1fc4df78084 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:42.410621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fe2ffbc6-38ba-4db1-adfc-3cc86a967629 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:42.419952 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fe2ffbc6-38ba-4db1-adfc-3cc86a967629 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1328 microversion: 2.1 time: 0.461019 Sep 06 11:10:42.420560 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2159/4322] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:41 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1328 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:42.422106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12319d66-0f23-4958-bc85-f1fc4df78084 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:42.424208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12319d66-0f23-4958-bc85-f1fc4df78084 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:42.694481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-12319d66-0f23-4958-bc85-f1fc4df78084 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:42.720242 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-12319d66-0f23-4958-bc85-f1fc4df78084 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1318 microversion: 2.1 time: 0.351734 Sep 06 11:10:42.742552 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2164/4323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:42 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:42.977187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=18 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:42.982171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-72763e71-b6ff-4dbf-8307-b7af0ffdcb7c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:42.983110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-72763e71-b6ff-4dbf-8307-b7af0ffdcb7c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:42.997095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72763e71-b6ff-4dbf-8307-b7af0ffdcb7c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:42.997978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72763e71-b6ff-4dbf-8307-b7af0ffdcb7c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:42.998634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72763e71-b6ff-4dbf-8307-b7af0ffdcb7c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:42.999762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72763e71-b6ff-4dbf-8307-b7af0ffdcb7c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:43.000964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72763e71-b6ff-4dbf-8307-b7af0ffdcb7c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:43.001730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72763e71-b6ff-4dbf-8307-b7af0ffdcb7c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:43.022799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8caac139-33c2-4a05-9811-4a6620416843 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:43.023700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8caac139-33c2-4a05-9811-4a6620416843 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:43.041581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8caac139-33c2-4a05-9811-4a6620416843 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:43.042375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8caac139-33c2-4a05-9811-4a6620416843 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:43.043098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8caac139-33c2-4a05-9811-4a6620416843 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:43.044697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8caac139-33c2-4a05-9811-4a6620416843 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:43.045373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8caac139-33c2-4a05-9811-4a6620416843 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:43.046017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8caac139-33c2-4a05-9811-4a6620416843 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:43.255970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8caac139-33c2-4a05-9811-4a6620416843 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:43.266393 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8caac139-33c2-4a05-9811-4a6620416843 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1242 microversion: 2.1 time: 0.248239 Sep 06 11:10:43.267378 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2165/4324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:43 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1242 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:43.408744 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-72763e71-b6ff-4dbf-8307-b7af0ffdcb7c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1463 microversion: 2.1 time: 0.433260 Sep 06 11:10:43.410808 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2160/4325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:42 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1463 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:43.444159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8e6a9de8-3e29-42ea-a1ea-cc97a180feaa tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:43.444915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8e6a9de8-3e29-42ea-a1ea-cc97a180feaa tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:43.453137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e6a9de8-3e29-42ea-a1ea-cc97a180feaa tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:43.455788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e6a9de8-3e29-42ea-a1ea-cc97a180feaa tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:43.455788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e6a9de8-3e29-42ea-a1ea-cc97a180feaa tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:43.455788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e6a9de8-3e29-42ea-a1ea-cc97a180feaa tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:43.455788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e6a9de8-3e29-42ea-a1ea-cc97a180feaa tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:43.457362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e6a9de8-3e29-42ea-a1ea-cc97a180feaa tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:43.752076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-098bca32-4912-4ff6-b553-6dfe5443967a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:43.753139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-098bca32-4912-4ff6-b553-6dfe5443967a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:43.760806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-098bca32-4912-4ff6-b553-6dfe5443967a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:43.761372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-098bca32-4912-4ff6-b553-6dfe5443967a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:43.761829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-098bca32-4912-4ff6-b553-6dfe5443967a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:43.762588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-098bca32-4912-4ff6-b553-6dfe5443967a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:43.763080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-098bca32-4912-4ff6-b553-6dfe5443967a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:43.767286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-098bca32-4912-4ff6-b553-6dfe5443967a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:43.767539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8e6a9de8-3e29-42ea-a1ea-cc97a180feaa tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:43.774177 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8e6a9de8-3e29-42ea-a1ea-cc97a180feaa tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1328 microversion: 2.1 time: 0.334891 Sep 06 11:10:43.774831 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2166/4326] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:43 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1328 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:43.917634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-098bca32-4912-4ff6-b553-6dfe5443967a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:43.926184 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-098bca32-4912-4ff6-b553-6dfe5443967a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1318 microversion: 2.1 time: 0.178410 Sep 06 11:10:43.926774 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2161/4327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:43 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:44.298179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3cfc40c7-fece-4623-94fd-f0df11249692 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:44.299248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3cfc40c7-fece-4623-94fd-f0df11249692 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:44.310404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cfc40c7-fece-4623-94fd-f0df11249692 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:44.311305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cfc40c7-fece-4623-94fd-f0df11249692 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:44.312381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cfc40c7-fece-4623-94fd-f0df11249692 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:44.314410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cfc40c7-fece-4623-94fd-f0df11249692 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:44.315163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cfc40c7-fece-4623-94fd-f0df11249692 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:44.316505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cfc40c7-fece-4623-94fd-f0df11249692 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:44.433465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b5bd57be-5de8-466c-ac7b-8f1314539db8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:44.434964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b5bd57be-5de8-466c-ac7b-8f1314539db8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:44.435748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3cfc40c7-fece-4623-94fd-f0df11249692 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:44.443782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5bd57be-5de8-466c-ac7b-8f1314539db8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:44.444838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5bd57be-5de8-466c-ac7b-8f1314539db8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:44.445487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5bd57be-5de8-466c-ac7b-8f1314539db8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:44.446408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5bd57be-5de8-466c-ac7b-8f1314539db8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:44.447480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5bd57be-5de8-466c-ac7b-8f1314539db8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:44.448102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5bd57be-5de8-466c-ac7b-8f1314539db8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:44.448691 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3cfc40c7-fece-4623-94fd-f0df11249692 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1306 microversion: 2.1 time: 0.158213 Sep 06 11:10:44.451372 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2167/4328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:44 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1306 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:44.802706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9d1e913c-a835-4db8-a240-8e7cb26b5908 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:44.803768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9d1e913c-a835-4db8-a240-8e7cb26b5908 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:44.827472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d1e913c-a835-4db8-a240-8e7cb26b5908 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:44.828374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d1e913c-a835-4db8-a240-8e7cb26b5908 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:44.829503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d1e913c-a835-4db8-a240-8e7cb26b5908 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:44.830920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d1e913c-a835-4db8-a240-8e7cb26b5908 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:44.831649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d1e913c-a835-4db8-a240-8e7cb26b5908 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:44.832288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d1e913c-a835-4db8-a240-8e7cb26b5908 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:45.170359 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b5bd57be-5de8-466c-ac7b-8f1314539db8 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1463 microversion: 2.1 time: 0.739988 Sep 06 11:10:45.174669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9d1e913c-a835-4db8-a240-8e7cb26b5908 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:45.183051 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9d1e913c-a835-4db8-a240-8e7cb26b5908 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1328 microversion: 2.1 time: 0.384501 Sep 06 11:10:45.188204 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2168/4329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:44 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1328 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:45.199154 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2162/4330] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:44 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1463 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:45.210636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c92b9a50-b473-404d-a5f7-290f6a01f72b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:45.213794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c92b9a50-b473-404d-a5f7-290f6a01f72b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:45.229711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c92b9a50-b473-404d-a5f7-290f6a01f72b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:45.230416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c92b9a50-b473-404d-a5f7-290f6a01f72b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:45.238268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c92b9a50-b473-404d-a5f7-290f6a01f72b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:45.238268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c92b9a50-b473-404d-a5f7-290f6a01f72b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:45.238268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c92b9a50-b473-404d-a5f7-290f6a01f72b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:45.238268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c92b9a50-b473-404d-a5f7-290f6a01f72b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:45.407961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-716cd516-f3a3-4623-8344-986d21f6fc9c req-196130e0-bcab-4742-b9c6-5768b72a632c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d53b0f-bd9f-479e-948b-bbefbd0d8597", "name": "network-vif-plugged", "status": "completed", "tag": "56dd829f-74c4-4912-9aac-6b30a6e3cd3e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:45.420105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:45.425446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c92b9a50-b473-404d-a5f7-290f6a01f72b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:45.429778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-716cd516-f3a3-4623-8344-986d21f6fc9c req-196130e0-bcab-4742-b9c6-5768b72a632c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:45.430284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-716cd516-f3a3-4623-8344-986d21f6fc9c req-196130e0-bcab-4742-b9c6-5768b72a632c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:45.431786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-716cd516-f3a3-4623-8344-986d21f6fc9c req-196130e0-bcab-4742-b9c6-5768b72a632c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:45.436701 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c92b9a50-b473-404d-a5f7-290f6a01f72b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1318 microversion: 2.1 time: 0.235860 Sep 06 11:10:45.436984 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2169/4331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:45 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:45.466104 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-716cd516-f3a3-4623-8344-986d21f6fc9c req-196130e0-bcab-4742-b9c6-5768b72a632c service nova] Creating event network-vif-plugged:56dd829f-74c4-4912-9aac-6b30a6e3cd3e for instance 77d53b0f-bd9f-479e-948b-bbefbd0d8597 on nch1-master-1 Sep 06 11:10:45.471440 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-716cd516-f3a3-4623-8344-986d21f6fc9c req-196130e0-bcab-4742-b9c6-5768b72a632c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068683 Sep 06 11:10:45.476968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-23e102d0-47ee-4b4d-8eac-e31ff2535754 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:45.477565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-23e102d0-47ee-4b4d-8eac-e31ff2535754 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:45.484372 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2163/4332] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:10:45.510806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23e102d0-47ee-4b4d-8eac-e31ff2535754 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:45.511383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23e102d0-47ee-4b4d-8eac-e31ff2535754 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:45.511879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23e102d0-47ee-4b4d-8eac-e31ff2535754 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:45.512640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23e102d0-47ee-4b4d-8eac-e31ff2535754 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:45.515705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23e102d0-47ee-4b4d-8eac-e31ff2535754 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:45.520693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23e102d0-47ee-4b4d-8eac-e31ff2535754 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:45.657597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-23e102d0-47ee-4b4d-8eac-e31ff2535754 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:45.671567 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-23e102d0-47ee-4b4d-8eac-e31ff2535754 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1304 microversion: 2.1 time: 0.198327 Sep 06 11:10:45.672190 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2170/4333] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:45 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1304 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:46.198047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f1ae65f6-2a82-4ca4-a328-2314a54d70a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:46.199194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f1ae65f6-2a82-4ca4-a328-2314a54d70a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:46.217597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-62da758d-e504-4928-bdfa-b2ca0a54df3d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:46.218688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-62da758d-e504-4928-bdfa-b2ca0a54df3d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:46.224685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1ae65f6-2a82-4ca4-a328-2314a54d70a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:46.226383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1ae65f6-2a82-4ca4-a328-2314a54d70a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:46.227531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1ae65f6-2a82-4ca4-a328-2314a54d70a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:46.229105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62da758d-e504-4928-bdfa-b2ca0a54df3d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:46.230158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1ae65f6-2a82-4ca4-a328-2314a54d70a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:46.230809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1ae65f6-2a82-4ca4-a328-2314a54d70a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:46.231470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62da758d-e504-4928-bdfa-b2ca0a54df3d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:46.232076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f1ae65f6-2a82-4ca4-a328-2314a54d70a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:46.232678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62da758d-e504-4928-bdfa-b2ca0a54df3d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:46.235628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62da758d-e504-4928-bdfa-b2ca0a54df3d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:46.236771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62da758d-e504-4928-bdfa-b2ca0a54df3d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:46.238681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62da758d-e504-4928-bdfa-b2ca0a54df3d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:46.529529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-62da758d-e504-4928-bdfa-b2ca0a54df3d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:46.544795 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-62da758d-e504-4928-bdfa-b2ca0a54df3d tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1328 microversion: 2.1 time: 0.336283 Sep 06 11:10:46.546152 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2171/4334] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:46 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1328 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:46.554100 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f1ae65f6-2a82-4ca4-a328-2314a54d70a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1463 microversion: 2.1 time: 0.357513 Sep 06 11:10:46.557069 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2164/4335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:46 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1463 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:46.582375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb75912d-7c90-4de0-b5b8-d6b1edacd307 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:46.583335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bb75912d-7c90-4de0-b5b8-d6b1edacd307 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:46.590125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb75912d-7c90-4de0-b5b8-d6b1edacd307 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:46.590989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb75912d-7c90-4de0-b5b8-d6b1edacd307 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:46.591698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb75912d-7c90-4de0-b5b8-d6b1edacd307 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:46.592572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb75912d-7c90-4de0-b5b8-d6b1edacd307 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:46.593184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb75912d-7c90-4de0-b5b8-d6b1edacd307 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:46.593766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb75912d-7c90-4de0-b5b8-d6b1edacd307 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:46.695677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6155d298-dfa7-438f-9038-fa3cbb50aed9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:46.696481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6155d298-dfa7-438f-9038-fa3cbb50aed9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:46.706366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6155d298-dfa7-438f-9038-fa3cbb50aed9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:46.709664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6155d298-dfa7-438f-9038-fa3cbb50aed9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:46.709664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6155d298-dfa7-438f-9038-fa3cbb50aed9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:46.711635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6155d298-dfa7-438f-9038-fa3cbb50aed9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:46.712407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6155d298-dfa7-438f-9038-fa3cbb50aed9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:46.713097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6155d298-dfa7-438f-9038-fa3cbb50aed9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:46.756512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bb75912d-7c90-4de0-b5b8-d6b1edacd307 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:46.768281 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bb75912d-7c90-4de0-b5b8-d6b1edacd307 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1318 microversion: 2.1 time: 0.207943 Sep 06 11:10:46.784961 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2172/4336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:46 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:46.993183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6155d298-dfa7-438f-9038-fa3cbb50aed9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:47.021317 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6155d298-dfa7-438f-9038-fa3cbb50aed9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1372 microversion: 2.1 time: 0.330760 Sep 06 11:10:47.023770 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2165/4337] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:46 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1372 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:47.516760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-0a5765bf-f568-469f-94d9-07933d90ff1a req-a7ab564a-37fc-406e-b3be-9b9a3672fd2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2efebce8-1a38-448b-8fe9-72a033a000bb", "name": "network-vif-plugged", "status": "completed", "tag": "8199783c-e27d-432a-9c27-c4ed212223cd"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:47.537530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0a5765bf-f568-469f-94d9-07933d90ff1a req-a7ab564a-37fc-406e-b3be-9b9a3672fd2a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:47.543838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0a5765bf-f568-469f-94d9-07933d90ff1a req-a7ab564a-37fc-406e-b3be-9b9a3672fd2a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:47.543838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0a5765bf-f568-469f-94d9-07933d90ff1a req-a7ab564a-37fc-406e-b3be-9b9a3672fd2a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:47.580785 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-0a5765bf-f568-469f-94d9-07933d90ff1a req-a7ab564a-37fc-406e-b3be-9b9a3672fd2a service nova] Creating event network-vif-plugged:8199783c-e27d-432a-9c27-c4ed212223cd for instance 2efebce8-1a38-448b-8fe9-72a033a000bb on nch2-master-1 Sep 06 11:10:47.584569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2ad96152-7bbb-423c-bb3c-9246359d08b4 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:47.587258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2ad96152-7bbb-423c-bb3c-9246359d08b4 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:47.602066 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-0a5765bf-f568-469f-94d9-07933d90ff1a req-a7ab564a-37fc-406e-b3be-9b9a3672fd2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089121 Sep 06 11:10:47.602997 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2173/4338] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:47.609295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-429bd573-68d4-4f5a-adaf-00c935bd72a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:47.610933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-429bd573-68d4-4f5a-adaf-00c935bd72a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:47.619195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad96152-7bbb-423c-bb3c-9246359d08b4 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:47.622486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad96152-7bbb-423c-bb3c-9246359d08b4 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:47.627718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad96152-7bbb-423c-bb3c-9246359d08b4 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:47.628095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-429bd573-68d4-4f5a-adaf-00c935bd72a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:47.628677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-429bd573-68d4-4f5a-adaf-00c935bd72a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:47.635887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-429bd573-68d4-4f5a-adaf-00c935bd72a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:47.641600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-429bd573-68d4-4f5a-adaf-00c935bd72a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:47.641600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-429bd573-68d4-4f5a-adaf-00c935bd72a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:47.641600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-429bd573-68d4-4f5a-adaf-00c935bd72a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:47.642122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad96152-7bbb-423c-bb3c-9246359d08b4 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:47.642122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad96152-7bbb-423c-bb3c-9246359d08b4 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:47.642122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ad96152-7bbb-423c-bb3c-9246359d08b4 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:48.213306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2ad96152-7bbb-423c-bb3c-9246359d08b4 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:48.230483 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2ad96152-7bbb-423c-bb3c-9246359d08b4 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1328 microversion: 2.1 time: 0.652218 Sep 06 11:10:48.245672 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-429bd573-68d4-4f5a-adaf-00c935bd72a4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1463 microversion: 2.1 time: 0.641073 Sep 06 11:10:48.246059 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2166/4339] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:47 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1328 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:48.255162 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2174/4340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:47 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1463 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:48.267639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ef6aa38-7e7d-460e-9d6d-ea9f7e30cd53 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:48.273538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6b43870b-b899-4431-aa99-ede1b7583d37 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:48.274569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ef6aa38-7e7d-460e-9d6d-ea9f7e30cd53 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:48.276161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6b43870b-b899-4431-aa99-ede1b7583d37 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:48.290131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ef6aa38-7e7d-460e-9d6d-ea9f7e30cd53 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:48.292185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ef6aa38-7e7d-460e-9d6d-ea9f7e30cd53 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:48.292185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ef6aa38-7e7d-460e-9d6d-ea9f7e30cd53 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:48.292185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ef6aa38-7e7d-460e-9d6d-ea9f7e30cd53 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:48.293421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ef6aa38-7e7d-460e-9d6d-ea9f7e30cd53 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:48.294267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ef6aa38-7e7d-460e-9d6d-ea9f7e30cd53 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:48.297105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b43870b-b899-4431-aa99-ede1b7583d37 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:48.300102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:48.301386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b43870b-b899-4431-aa99-ede1b7583d37 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:48.302617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b43870b-b899-4431-aa99-ede1b7583d37 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:48.306694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b43870b-b899-4431-aa99-ede1b7583d37 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:48.308374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b43870b-b899-4431-aa99-ede1b7583d37 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:48.310065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b43870b-b899-4431-aa99-ede1b7583d37 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:48.844581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ef6aa38-7e7d-460e-9d6d-ea9f7e30cd53 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:48.860786 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ef6aa38-7e7d-460e-9d6d-ea9f7e30cd53 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1318 microversion: 2.1 time: 0.610499 Sep 06 11:10:48.861694 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2167/4341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:48 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:48.878437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6b43870b-b899-4431-aa99-ede1b7583d37 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:48.902414 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6b43870b-b899-4431-aa99-ede1b7583d37 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1372 microversion: 2.1 time: 0.645554 Sep 06 11:10:48.907825 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2175/4342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:48 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1372 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:49.259982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a4b2e97c-e3c0-42b7-bcfc-d4f9ec43faf9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:49.260776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a4b2e97c-e3c0-42b7-bcfc-d4f9ec43faf9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:49.270078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4b2e97c-e3c0-42b7-bcfc-d4f9ec43faf9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:49.281599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4b2e97c-e3c0-42b7-bcfc-d4f9ec43faf9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:49.281599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4b2e97c-e3c0-42b7-bcfc-d4f9ec43faf9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:49.281599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4b2e97c-e3c0-42b7-bcfc-d4f9ec43faf9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:49.281599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4b2e97c-e3c0-42b7-bcfc-d4f9ec43faf9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:49.281599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4b2e97c-e3c0-42b7-bcfc-d4f9ec43faf9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:49.282598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-50c21d42-d0d6-4dce-880f-9aa2855d911f tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:49.282598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-50c21d42-d0d6-4dce-880f-9aa2855d911f tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:49.292557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50c21d42-d0d6-4dce-880f-9aa2855d911f tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:49.293342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50c21d42-d0d6-4dce-880f-9aa2855d911f tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:49.294355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50c21d42-d0d6-4dce-880f-9aa2855d911f tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:49.295338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50c21d42-d0d6-4dce-880f-9aa2855d911f tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:49.295959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50c21d42-d0d6-4dce-880f-9aa2855d911f tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:49.296748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50c21d42-d0d6-4dce-880f-9aa2855d911f tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:49.822235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a4b2e97c-e3c0-42b7-bcfc-d4f9ec43faf9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:49.870707 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a4b2e97c-e3c0-42b7-bcfc-d4f9ec43faf9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1328 microversion: 2.1 time: 0.613123 Sep 06 11:10:49.880351 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2168/4343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:49 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1328 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:49.891897 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-50c21d42-d0d6-4dce-880f-9aa2855d911f tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1463 microversion: 2.1 time: 0.614790 Sep 06 11:10:49.893999 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2176/4344] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:49 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1463 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:49.914528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6344f134-edb6-4486-96c9-22f26c001bcb req-962069f5-b151-4dba-a89d-ed826042fe29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016c8ecc-3457-4204-ba5b-3e06970ac490", "name": "network-vif-plugged", "status": "completed", "tag": "0a339213-93da-46ad-badf-47ea616965d5"}, {"server_uuid": "9ea5bb59-464b-4701-8ead-642d813f9cc8", "name": "network-vif-plugged", "status": "completed", "tag": "3e3272e1-1043-4c9b-b236-a9be6435eaf6"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:49.924668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-320f99ac-a327-4597-b7db-4bbc823b8549 req-a553a451-fb33-496c-8f3a-0b983c1fb1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa9fb77-6ffc-4a34-9db9-3ba749d98afc", "tag": "33293afd-e865-4886-9b9b-f1ae1fefac75"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:49.965624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6344f134-edb6-4486-96c9-22f26c001bcb req-962069f5-b151-4dba-a89d-ed826042fe29 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:49.966426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6344f134-edb6-4486-96c9-22f26c001bcb req-962069f5-b151-4dba-a89d-ed826042fe29 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:49.967682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-320f99ac-a327-4597-b7db-4bbc823b8549 req-a553a451-fb33-496c-8f3a-0b983c1fb1c9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:49.968330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6344f134-edb6-4486-96c9-22f26c001bcb req-962069f5-b151-4dba-a89d-ed826042fe29 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:49.971659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-320f99ac-a327-4597-b7db-4bbc823b8549 req-a553a451-fb33-496c-8f3a-0b983c1fb1c9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:49.972528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-320f99ac-a327-4597-b7db-4bbc823b8549 req-a553a451-fb33-496c-8f3a-0b983c1fb1c9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:50.000629 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-320f99ac-a327-4597-b7db-4bbc823b8549 req-a553a451-fb33-496c-8f3a-0b983c1fb1c9 service nova] Creating event network-changed:33293afd-e865-4886-9b9b-f1ae1fefac75 for instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc on nch2-master-1 Sep 06 11:10:50.002631 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6344f134-edb6-4486-96c9-22f26c001bcb req-962069f5-b151-4dba-a89d-ed826042fe29 service nova] Creating event network-vif-plugged:0a339213-93da-46ad-badf-47ea616965d5 for instance 016c8ecc-3457-4204-ba5b-3e06970ac490 on nch1-master-1 Sep 06 11:10:50.003334 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6344f134-edb6-4486-96c9-22f26c001bcb req-962069f5-b151-4dba-a89d-ed826042fe29 service nova] Creating event network-vif-plugged:3e3272e1-1043-4c9b-b236-a9be6435eaf6 for instance 9ea5bb59-464b-4701-8ead-642d813f9cc8 on nch1-master-1 Sep 06 11:10:50.014089 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-320f99ac-a327-4597-b7db-4bbc823b8549 req-a553a451-fb33-496c-8f3a-0b983c1fb1c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116235 Sep 06 11:10:50.014089 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2177/4345] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:50.018263 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6344f134-edb6-4486-96c9-22f26c001bcb req-962069f5-b151-4dba-a89d-ed826042fe29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.134758 Sep 06 11:10:50.021458 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2169/4346] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:50.028095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1bb45632-ac39-4e1a-bb4e-4293ff9d0fa0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:50.028903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1bb45632-ac39-4e1a-bb4e-4293ff9d0fa0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:50.046736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-23ae1632-0a20-4b69-be36-297031622fb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:50.054693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-23ae1632-0a20-4b69-be36-297031622fb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:50.083927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1bb45632-ac39-4e1a-bb4e-4293ff9d0fa0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:50.084799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1bb45632-ac39-4e1a-bb4e-4293ff9d0fa0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:50.085086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23ae1632-0a20-4b69-be36-297031622fb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:50.085818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23ae1632-0a20-4b69-be36-297031622fb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:50.088887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1bb45632-ac39-4e1a-bb4e-4293ff9d0fa0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:50.089724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1bb45632-ac39-4e1a-bb4e-4293ff9d0fa0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:50.090028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23ae1632-0a20-4b69-be36-297031622fb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:50.090555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1bb45632-ac39-4e1a-bb4e-4293ff9d0fa0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:50.091294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1bb45632-ac39-4e1a-bb4e-4293ff9d0fa0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:50.092256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23ae1632-0a20-4b69-be36-297031622fb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:50.096159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23ae1632-0a20-4b69-be36-297031622fb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:50.096836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23ae1632-0a20-4b69-be36-297031622fb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:50.102394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:50.195988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:50.566250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1bb45632-ac39-4e1a-bb4e-4293ff9d0fa0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:50.577999 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1bb45632-ac39-4e1a-bb4e-4293ff9d0fa0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1318 microversion: 2.1 time: 0.563713 Sep 06 11:10:50.579759 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2178/4347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:50 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:50.635893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-23ae1632-0a20-4b69-be36-297031622fb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:50.646763 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-23ae1632-0a20-4b69-be36-297031622fb6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1372 microversion: 2.1 time: 0.624000 Sep 06 11:10:50.647445 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2170/4348] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:50 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1372 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:50.914610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9082cba8-4207-4b9d-b4e0-06020038dd55 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:50.922659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c4333530-a874-440e-affd-427423db7b22 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:50.923317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c4333530-a874-440e-affd-427423db7b22 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:50.925389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9082cba8-4207-4b9d-b4e0-06020038dd55 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:50.940085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4333530-a874-440e-affd-427423db7b22 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:50.945794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4333530-a874-440e-affd-427423db7b22 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:50.947137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4333530-a874-440e-affd-427423db7b22 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:50.947604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4333530-a874-440e-affd-427423db7b22 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:50.950134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9082cba8-4207-4b9d-b4e0-06020038dd55 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:50.950611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9082cba8-4207-4b9d-b4e0-06020038dd55 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:50.952304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4333530-a874-440e-affd-427423db7b22 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:50.956002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9082cba8-4207-4b9d-b4e0-06020038dd55 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:50.956002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9082cba8-4207-4b9d-b4e0-06020038dd55 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:50.956002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9082cba8-4207-4b9d-b4e0-06020038dd55 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:50.956784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4333530-a874-440e-affd-427423db7b22 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:50.963519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9082cba8-4207-4b9d-b4e0-06020038dd55 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:51.562840 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c4333530-a874-440e-affd-427423db7b22 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1463 microversion: 2.1 time: 0.644748 Sep 06 11:10:51.563673 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2171/4349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:50 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1463 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:51.605985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0d1f9127-d514-409d-82e8-fd5b5adf7f8f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:51.606976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0d1f9127-d514-409d-82e8-fd5b5adf7f8f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:51.611664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9082cba8-4207-4b9d-b4e0-06020038dd55 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:51.619347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d1f9127-d514-409d-82e8-fd5b5adf7f8f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:51.620921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d1f9127-d514-409d-82e8-fd5b5adf7f8f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:51.621535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d1f9127-d514-409d-82e8-fd5b5adf7f8f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:51.625988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d1f9127-d514-409d-82e8-fd5b5adf7f8f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:51.627582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d1f9127-d514-409d-82e8-fd5b5adf7f8f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:51.628233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d1f9127-d514-409d-82e8-fd5b5adf7f8f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:51.633601 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9082cba8-4207-4b9d-b4e0-06020038dd55 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1529 microversion: 2.1 time: 0.732316 Sep 06 11:10:51.634927 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2179/4350] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:50 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1529 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:51.662407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c0fb59a6-6611-4cdf-adb5-40cf94106c44 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:51.675312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c0fb59a6-6611-4cdf-adb5-40cf94106c44 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:51.698153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0fb59a6-6611-4cdf-adb5-40cf94106c44 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:51.698406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0fb59a6-6611-4cdf-adb5-40cf94106c44 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:51.726903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0fb59a6-6611-4cdf-adb5-40cf94106c44 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:51.740174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0fb59a6-6611-4cdf-adb5-40cf94106c44 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:51.742891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0fb59a6-6611-4cdf-adb5-40cf94106c44 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:51.743665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0fb59a6-6611-4cdf-adb5-40cf94106c44 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:51.995500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=32 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:52.199292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c0fb59a6-6611-4cdf-adb5-40cf94106c44 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:52.215598 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c0fb59a6-6611-4cdf-adb5-40cf94106c44 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1529 microversion: 2.1 time: 0.556161 Sep 06 11:10:52.217220 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2180/4351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:51 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1529 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:52.233438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0d1f9127-d514-409d-82e8-fd5b5adf7f8f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:52.234096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fd3bfb68-78a6-4aa0-987c-6581dc2a56c2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:52.234982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fd3bfb68-78a6-4aa0-987c-6581dc2a56c2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:52.243600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd3bfb68-78a6-4aa0-987c-6581dc2a56c2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:52.246238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd3bfb68-78a6-4aa0-987c-6581dc2a56c2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:52.246943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd3bfb68-78a6-4aa0-987c-6581dc2a56c2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:52.247990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd3bfb68-78a6-4aa0-987c-6581dc2a56c2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:52.248626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd3bfb68-78a6-4aa0-987c-6581dc2a56c2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:52.249141 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0d1f9127-d514-409d-82e8-fd5b5adf7f8f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1318 microversion: 2.1 time: 0.648850 Sep 06 11:10:52.252171 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2172/4352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:51 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1318 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:52.267446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd3bfb68-78a6-4aa0-987c-6581dc2a56c2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:52.471312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fd3bfb68-78a6-4aa0-987c-6581dc2a56c2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:52.485791 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fd3bfb68-78a6-4aa0-987c-6581dc2a56c2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1372 microversion: 2.1 time: 0.263127 Sep 06 11:10:52.487226 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2181/4353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:52 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1372 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:52.597386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1c05021d-cb55-4fcd-87c3-fba5f3ac3a25 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:52.598427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1c05021d-cb55-4fcd-87c3-fba5f3ac3a25 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:52.617011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c05021d-cb55-4fcd-87c3-fba5f3ac3a25 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:52.619537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c05021d-cb55-4fcd-87c3-fba5f3ac3a25 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:52.620910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c05021d-cb55-4fcd-87c3-fba5f3ac3a25 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:52.625571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c05021d-cb55-4fcd-87c3-fba5f3ac3a25 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:52.626434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c05021d-cb55-4fcd-87c3-fba5f3ac3a25 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:52.628850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c05021d-cb55-4fcd-87c3-fba5f3ac3a25 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:52.705002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4e5d92bd-5491-4997-b2ab-553c92b18be9 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:52.705824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4e5d92bd-5491-4997-b2ab-553c92b18be9 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:52.719521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e5d92bd-5491-4997-b2ab-553c92b18be9 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:52.725004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e5d92bd-5491-4997-b2ab-553c92b18be9 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:52.732690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e5d92bd-5491-4997-b2ab-553c92b18be9 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:52.736939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e5d92bd-5491-4997-b2ab-553c92b18be9 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:52.737503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e5d92bd-5491-4997-b2ab-553c92b18be9 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:52.740974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e5d92bd-5491-4997-b2ab-553c92b18be9 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:52.781414 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-4e5d92bd-5491-4997-b2ab-553c92b18be9 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] HTTP exception thrown: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4e5d92bd-5491-4997-b2ab-553c92b18be9 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Request method failure captured: Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb HTTP/1.1 Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyqXhpiMbziljwVttfuETTTakAGNzOYVQhDkf54aFAqlUxMGMj0FXC65WA-vYJ01HMyixlFsrsGzROolzcgK7Pu53GcPWEGNGehahamAWQWvvS5FvE6oVIM9V3UvK9dwKzVDGJv1aUFUCEC6KXORfsHHuKuU-5DDEHjCmjgWaNPTcVc Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 6db29c866cb84356b44d74de4b38b859 Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-711876296 Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6db29c866cb84356b44d74de4b38b859"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6db29c866cb84356b44d74de4b38b859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6db29c866cb84356b44d74de4b38b859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6db29c866cb84356b44d74de4b38b859"}]}] Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-711876296 Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 6db29c866cb84356b44d74de4b38b859 Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-711876296 Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestMultiTenantJSON-711876296-project Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 27793466151d4470985c94b43658588c Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-711876296-project Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '2efebce8-1a38-448b-8fe9-72a033a000bb'} Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:10:52.783211 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:10:52.787958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:10:52.787958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:52.787958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:10:52.787958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:52.787958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:52.787958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:10:52.787958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:10:52.787958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:10:52.787958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:10:52.787958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:10:52.787958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:52.787958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4e5d92bd-5491-4997-b2ab-553c92b18be9 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Returning 404 to user: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:10:52.793168 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4e5d92bd-5491-4997-b2ab-553c92b18be9 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 404 len: 111 microversion: 2.1 time: 0.535108 Sep 06 11:10:52.793168 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2173/4354] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:10:52 2022] DELETE /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 111 bytes in 536 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:10:52.805187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-719ff296-e3f3-45ca-a280-8a0b66ad5520 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:52.806383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-719ff296-e3f3-45ca-a280-8a0b66ad5520 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:52.815073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-719ff296-e3f3-45ca-a280-8a0b66ad5520 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:52.816008 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-719ff296-e3f3-45ca-a280-8a0b66ad5520 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:52.816954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-719ff296-e3f3-45ca-a280-8a0b66ad5520 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:52.820462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-719ff296-e3f3-45ca-a280-8a0b66ad5520 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:52.821155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-719ff296-e3f3-45ca-a280-8a0b66ad5520 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:52.822581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-719ff296-e3f3-45ca-a280-8a0b66ad5520 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:52.997754 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1c05021d-cb55-4fcd-87c3-fba5f3ac3a25 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1649 microversion: 2.1 time: 0.408843 Sep 06 11:10:53.000640 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2182/4355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:52 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1649 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:53.102990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-719ff296-e3f3-45ca-a280-8a0b66ad5520 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:53.119999 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-719ff296-e3f3-45ca-a280-8a0b66ad5520 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1529 microversion: 2.1 time: 0.325016 Sep 06 11:10:53.129852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-2073276858", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:53.143811 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2174/4356] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:52 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1529 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:53.150814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8f04a9f9-46b4-4017-a761-0dfd789de94c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:53.151646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8f04a9f9-46b4-4017-a761-0dfd789de94c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:53.167858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f04a9f9-46b4-4017-a761-0dfd789de94c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:53.168546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f04a9f9-46b4-4017-a761-0dfd789de94c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:53.169163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f04a9f9-46b4-4017-a761-0dfd789de94c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:53.170062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f04a9f9-46b4-4017-a761-0dfd789de94c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:53.170530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f04a9f9-46b4-4017-a761-0dfd789de94c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:53.170967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f04a9f9-46b4-4017-a761-0dfd789de94c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:53.217959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] validate_networks() for [('2c1774da-ae6e-41ab-9030-18c5a6bd4120', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:10:53.529853 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8f04a9f9-46b4-4017-a761-0dfd789de94c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1649 microversion: 2.1 time: 0.390783 Sep 06 11:10:53.530344 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2175/4357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:53 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1649 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:53.553427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-832468dc-3ab6-41d2-83a1-c1b287c586f7 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Action: 'update', calling method: >, body: {"server": {"name": "2efebce8-1a38-448b-8fe9-72a033a000bb_new"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:53.559896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-832468dc-3ab6-41d2-83a1-c1b287c586f7 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:53.570437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-832468dc-3ab6-41d2-83a1-c1b287c586f7 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:53.571233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-832468dc-3ab6-41d2-83a1-c1b287c586f7 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:53.575323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-832468dc-3ab6-41d2-83a1-c1b287c586f7 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:53.581507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-832468dc-3ab6-41d2-83a1-c1b287c586f7 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:53.581507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-832468dc-3ab6-41d2-83a1-c1b287c586f7 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:53.581507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-832468dc-3ab6-41d2-83a1-c1b287c586f7 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:53.611079 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-832468dc-3ab6-41d2-83a1-c1b287c586f7 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] HTTP exception thrown: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-832468dc-3ab6-41d2-83a1-c1b287c586f7 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Request method failure captured: Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: request: PUT /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb HTTP/1.1 Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 64 Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyqXhpiMbziljwVttfuETTTakAGNzOYVQhDkf54aFAqlUxMGMj0FXC65WA-vYJ01HMyixlFsrsGzROolzcgK7Pu53GcPWEGNGehahamAWQWvvS5FvE6oVIM9V3UvK9dwKzVDGJv1aUFUCEC6KXORfsHHuKuU-5DDEHjCmjgWaNPTcVc Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 6db29c866cb84356b44d74de4b38b859 Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-711876296 Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6db29c866cb84356b44d74de4b38b859"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6db29c866cb84356b44d74de4b38b859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6db29c866cb84356b44d74de4b38b859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6db29c866cb84356b44d74de4b38b859"}]}] Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-711876296 Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 6db29c866cb84356b44d74de4b38b859 Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-711876296 Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestMultiTenantJSON-711876296-project Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 27793466151d4470985c94b43658588c Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-711876296-project Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "2efebce8-1a38-448b-8fe9-72a033a000bb_new"}} Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '2efebce8-1a38-448b-8fe9-72a033a000bb', 'body': {'server': {'name': '2efebce8-1a38-448b-8fe9-72a033a000bb_new'}}} Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:10:53.613084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:10:53.617719 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:10:53.624622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-832468dc-3ab6-41d2-83a1-c1b287c586f7 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] Returning 404 to user: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:10:53.626411 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-832468dc-3ab6-41d2-83a1-c1b287c586f7 tempest-ServersNegativeTestMultiTenantJSON-711876296 tempest-ServersNegativeTestMultiTenantJSON-711876296-project] 10.222.0.20 "PUT /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 404 len: 111 microversion: 2.1 time: 0.077108 Sep 06 11:10:53.632625 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2176/4358] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Sep 6 11:10:53 2022] PUT /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:10:53.640224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d993a58f-0c23-4a58-867d-ca9d81e67f9f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:53.644574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d993a58f-0c23-4a58-867d-ca9d81e67f9f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:53.650992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d993a58f-0c23-4a58-867d-ca9d81e67f9f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:53.651938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d993a58f-0c23-4a58-867d-ca9d81e67f9f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:53.652568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d993a58f-0c23-4a58-867d-ca9d81e67f9f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:53.655445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d993a58f-0c23-4a58-867d-ca9d81e67f9f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:53.656887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d993a58f-0c23-4a58-867d-ca9d81e67f9f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:53.657502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d993a58f-0c23-4a58-867d-ca9d81e67f9f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:53.929770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d993a58f-0c23-4a58-867d-ca9d81e67f9f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:53.965638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:10:53.968085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:10:53.970920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:10:53.971567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:10:53.977946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:10:54.003556 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d993a58f-0c23-4a58-867d-ca9d81e67f9f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1467 microversion: 2.1 time: 0.363632 Sep 06 11:10:54.004115 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2177/4359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:53 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1467 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:54.009702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-468400ab-3ca2-43ef-b544-7c90bc00ce12 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:54.011279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-468400ab-3ca2-43ef-b544-7c90bc00ce12 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:54.018724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-468400ab-3ca2-43ef-b544-7c90bc00ce12 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:54.025517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-468400ab-3ca2-43ef-b544-7c90bc00ce12 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:54.025628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:54.026064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-468400ab-3ca2-43ef-b544-7c90bc00ce12 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:54.026151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:54.026151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:54.026315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-468400ab-3ca2-43ef-b544-7c90bc00ce12 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:54.026315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-468400ab-3ca2-43ef-b544-7c90bc00ce12 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:54.026471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:54.026548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-468400ab-3ca2-43ef-b544-7c90bc00ce12 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:54.026627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:54.026627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:54.071551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Getting quotas for project 0444d17c98fd486faf23794180465b3d. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:10:54.077542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Getting quotas for user 7c58a8e8fcff4ca2afc6c54b9bc4e6e6 and project 0444d17c98fd486faf23794180465b3d. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:10:54.091634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:10:54.094262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:10:54.287167 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d4106bab-9476-498f-a3c7-d5869523045e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.278996 Sep 06 11:10:54.292238 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2183/4360] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:10:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:10:54.299029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e885ceb3-6f6a-491a-ad7f-d904ff525edb tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:54.299948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e885ceb3-6f6a-491a-ad7f-d904ff525edb tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:54.318721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e885ceb3-6f6a-491a-ad7f-d904ff525edb tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:54.320948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e885ceb3-6f6a-491a-ad7f-d904ff525edb tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:54.321751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e885ceb3-6f6a-491a-ad7f-d904ff525edb tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:54.322694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e885ceb3-6f6a-491a-ad7f-d904ff525edb tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:54.324996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e885ceb3-6f6a-491a-ad7f-d904ff525edb tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:54.325663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e885ceb3-6f6a-491a-ad7f-d904ff525edb tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:54.342397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-468400ab-3ca2-43ef-b544-7c90bc00ce12 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:54.355355 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-468400ab-3ca2-43ef-b544-7c90bc00ce12 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1372 microversion: 2.1 time: 0.349866 Sep 06 11:10:54.359627 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2178/4361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:54 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1372 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:54.377098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0fde532d-9693-41bf-87c0-a321c185bc3e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:54.378054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0fde532d-9693-41bf-87c0-a321c185bc3e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:54.386386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fde532d-9693-41bf-87c0-a321c185bc3e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:54.387519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fde532d-9693-41bf-87c0-a321c185bc3e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:54.388251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fde532d-9693-41bf-87c0-a321c185bc3e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:54.389365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fde532d-9693-41bf-87c0-a321c185bc3e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:54.390091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fde532d-9693-41bf-87c0-a321c185bc3e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:54.390801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fde532d-9693-41bf-87c0-a321c185bc3e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:54.433565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0fde532d-9693-41bf-87c0-a321c185bc3e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:10:54.685833 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e885ceb3-6f6a-491a-ad7f-d904ff525edb tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1649 microversion: 2.1 time: 0.395501 Sep 06 11:10:54.699641 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2184/4362] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:54 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1649 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:54.704575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7afc60a-394d-46ff-ab7e-5d86f7bce0aa tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:54.705504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d7afc60a-394d-46ff-ab7e-5d86f7bce0aa tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:54.715135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7afc60a-394d-46ff-ab7e-5d86f7bce0aa tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:54.716489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7afc60a-394d-46ff-ab7e-5d86f7bce0aa tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:54.716945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7afc60a-394d-46ff-ab7e-5d86f7bce0aa tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:54.720242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7afc60a-394d-46ff-ab7e-5d86f7bce0aa tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:54.720791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7afc60a-394d-46ff-ab7e-5d86f7bce0aa tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:54.721242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7afc60a-394d-46ff-ab7e-5d86f7bce0aa tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:54.799658 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0fde532d-9693-41bf-87c0-a321c185bc3e tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 204 len: 0 microversion: 2.1 time: 0.436861 Sep 06 11:10:54.800203 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2179/4363] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:10:54 2022] DELETE /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:10:54.809566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9211ead7-4553-4b69-b2ce-dfd2f8600fda tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:54.810278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9211ead7-4553-4b69-b2ce-dfd2f8600fda tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:54.934284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9211ead7-4553-4b69-b2ce-dfd2f8600fda tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:54.942510 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9211ead7-4553-4b69-b2ce-dfd2f8600fda tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1223 microversion: 2.1 time: 0.137561 Sep 06 11:10:54.955406 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2180/4364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:54 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1223 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:54.963440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60cc5dd9-eb95-44e3-9132-b991b545811b tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:54.964315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-60cc5dd9-eb95-44e3-9132-b991b545811b tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:54.971858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60cc5dd9-eb95-44e3-9132-b991b545811b tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:54.972864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60cc5dd9-eb95-44e3-9132-b991b545811b tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:54.973698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60cc5dd9-eb95-44e3-9132-b991b545811b tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:54.974959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60cc5dd9-eb95-44e3-9132-b991b545811b tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:54.975679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60cc5dd9-eb95-44e3-9132-b991b545811b tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:54.976390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60cc5dd9-eb95-44e3-9132-b991b545811b tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:55.089817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d7afc60a-394d-46ff-ab7e-5d86f7bce0aa tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:55.106250 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d7afc60a-394d-46ff-ab7e-5d86f7bce0aa tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597" status: 200 len: 1467 microversion: 2.1 time: 0.415223 Sep 06 11:10:55.106859 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2185/4365] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:54 2022] GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597 => generated 1467 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:55.149258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1233710219", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "f012b585-349a-47ae-a222-7c651513ce05"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:55.249424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] validate_networks() for [('f012b585-349a-47ae-a222-7c651513ce05', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:10:55.579247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-60cc5dd9-eb95-44e3-9132-b991b545811b tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:55.620938 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-60cc5dd9-eb95-44e3-9132-b991b545811b tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1535 microversion: 2.1 time: 0.664058 Sep 06 11:10:55.621977 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2181/4366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:54 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1535 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:55.642830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-67818313-7dc9-40fe-a5a8-cb892c4328d0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-249981884"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:55.663461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-67818313-7dc9-40fe-a5a8-cb892c4328d0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:55.686974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67818313-7dc9-40fe-a5a8-cb892c4328d0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:55.688462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67818313-7dc9-40fe-a5a8-cb892c4328d0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:55.692625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67818313-7dc9-40fe-a5a8-cb892c4328d0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:55.694215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67818313-7dc9-40fe-a5a8-cb892c4328d0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:55.695277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67818313-7dc9-40fe-a5a8-cb892c4328d0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:55.695786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67818313-7dc9-40fe-a5a8-cb892c4328d0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:56.375526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:10:56.376320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:10:56.376924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:10:56.378046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:10:56.379287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:10:56.391535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:56.392180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:56.392769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:56.395639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:56.396405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:56.397278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:56.429166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Getting quotas for project 5da257e162aa4109a0bc914b2b4e13ed. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:10:56.437076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Getting quotas for user 094361c60a54434fb90e605c040800ac and project 5da257e162aa4109a0bc914b2b4e13ed. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:10:56.459595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:10:56.462148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:10:56.642154 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-67818313-7dc9-40fe-a5a8-cb892c4328d0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "POST /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597/action" status: 202 len: 0 microversion: 2.1 time: 1.012175 Sep 06 11:10:56.644074 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2182/4367] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:10:55 2022] POST /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597/action => generated 0 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 06 11:10:56.652434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-91753a22-0bfb-4ece-8748-d4f96b596637 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:56.654818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-91753a22-0bfb-4ece-8748-d4f96b596637 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:56.674967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91753a22-0bfb-4ece-8748-d4f96b596637 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:56.675514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91753a22-0bfb-4ece-8748-d4f96b596637 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:56.675996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91753a22-0bfb-4ece-8748-d4f96b596637 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:56.676767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91753a22-0bfb-4ece-8748-d4f96b596637 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:56.678099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91753a22-0bfb-4ece-8748-d4f96b596637 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:56.678099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91753a22-0bfb-4ece-8748-d4f96b596637 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:56.728500 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a80241ec-f42a-4a42-b2a3-aae0d14def2d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.597239 Sep 06 11:10:56.733273 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2186/4368] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:10:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:10:56.755554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ad50e861-d7ca-466e-842c-2ada4eec35fd tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:56.757497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ad50e861-d7ca-466e-842c-2ada4eec35fd tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:56.790441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad50e861-d7ca-466e-842c-2ada4eec35fd tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:56.798991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad50e861-d7ca-466e-842c-2ada4eec35fd tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:56.799552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad50e861-d7ca-466e-842c-2ada4eec35fd tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:56.802475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad50e861-d7ca-466e-842c-2ada4eec35fd tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:56.805632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad50e861-d7ca-466e-842c-2ada4eec35fd tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:56.806584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad50e861-d7ca-466e-842c-2ada4eec35fd tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:57.063158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ad50e861-d7ca-466e-842c-2ada4eec35fd tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:57.077691 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ad50e861-d7ca-466e-842c-2ada4eec35fd tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1227 microversion: 2.1 time: 0.340799 Sep 06 11:10:57.083913 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2187/4369] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:56 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1227 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:57.116118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c09aa885-1bd6-44ee-8b63-bfc590f56222 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f34c1040>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:57.242680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-91753a22-0bfb-4ece-8748-d4f96b596637 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:57.255836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:57.311540 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c09aa885-1bd6-44ee-8b63-bfc590f56222 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.206445 Sep 06 11:10:57.314204 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2188/4370] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:10:57 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:57.322557 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-91753a22-0bfb-4ece-8748-d4f96b596637 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1372 microversion: 2.1 time: 0.672183 Sep 06 11:10:57.324082 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2183/4371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:56 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1372 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:57.326109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-edbfb3f7-e638-4ed2-a874-97c6cb15dc07 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:57.333271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-03e3f84b-10d1-47b5-9bbb-733028d4fcaa tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:57.334655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-edbfb3f7-e638-4ed2-a874-97c6cb15dc07 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:57.336506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-03e3f84b-10d1-47b5-9bbb-733028d4fcaa tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:57.344513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:57.391827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edbfb3f7-e638-4ed2-a874-97c6cb15dc07 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:57.400525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edbfb3f7-e638-4ed2-a874-97c6cb15dc07 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:57.401677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edbfb3f7-e638-4ed2-a874-97c6cb15dc07 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:57.403093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edbfb3f7-e638-4ed2-a874-97c6cb15dc07 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:57.413592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edbfb3f7-e638-4ed2-a874-97c6cb15dc07 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:57.414472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edbfb3f7-e638-4ed2-a874-97c6cb15dc07 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:57.459861 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-03e3f84b-10d1-47b5-9bbb-733028d4fcaa tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1329 microversion: 2.1 time: 0.133579 Sep 06 11:10:57.461491 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2184/4372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:57 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1329 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:57.692279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-edbfb3f7-e638-4ed2-a874-97c6cb15dc07 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:57.707780 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-edbfb3f7-e638-4ed2-a874-97c6cb15dc07 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1535 microversion: 2.1 time: 0.391516 Sep 06 11:10:57.709070 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2189/4373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:57 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1535 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:58.059490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-546e5308-bfff-4301-9218-dc3a7c735c48 req-b82f8ce7-d82d-4489-a574-2ff9f70dbafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa9fb77-6ffc-4a34-9db9-3ba749d98afc", "name": "network-vif-plugged", "status": "completed", "tag": "33293afd-e865-4886-9b9b-f1ae1fefac75"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:58.089907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-546e5308-bfff-4301-9218-dc3a7c735c48 req-b82f8ce7-d82d-4489-a574-2ff9f70dbafe service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:58.091127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-546e5308-bfff-4301-9218-dc3a7c735c48 req-b82f8ce7-d82d-4489-a574-2ff9f70dbafe service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:58.091811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-546e5308-bfff-4301-9218-dc3a7c735c48 req-b82f8ce7-d82d-4489-a574-2ff9f70dbafe service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:58.114569 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-546e5308-bfff-4301-9218-dc3a7c735c48 req-b82f8ce7-d82d-4489-a574-2ff9f70dbafe service nova] Creating event network-vif-plugged:33293afd-e865-4886-9b9b-f1ae1fefac75 for instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc on nch2-master-1 Sep 06 11:10:58.116324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b444b318-edbc-45eb-b8ea-d55f6f7df2d9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:58.118299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b444b318-edbc-45eb-b8ea-d55f6f7df2d9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:58.138476 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-546e5308-bfff-4301-9218-dc3a7c735c48 req-b82f8ce7-d82d-4489-a574-2ff9f70dbafe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.265363 Sep 06 11:10:58.141139 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2185/4374] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:58.145356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b444b318-edbc-45eb-b8ea-d55f6f7df2d9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:58.146408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b444b318-edbc-45eb-b8ea-d55f6f7df2d9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:58.147738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b444b318-edbc-45eb-b8ea-d55f6f7df2d9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:58.148505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b444b318-edbc-45eb-b8ea-d55f6f7df2d9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:58.149507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b444b318-edbc-45eb-b8ea-d55f6f7df2d9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:58.150737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b444b318-edbc-45eb-b8ea-d55f6f7df2d9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:58.261467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b444b318-edbc-45eb-b8ea-d55f6f7df2d9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:58.277933 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b444b318-edbc-45eb-b8ea-d55f6f7df2d9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1275 microversion: 2.1 time: 0.167253 Sep 06 11:10:58.282777 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2190/4375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:58 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:58.330906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-96bad1b8-c38b-4d68-ad40-70cabe82cb23 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f850af70>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:58.354565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-008f8fd2-2505-4de6-9321-e9caa1427f9a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:58.355387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-008f8fd2-2505-4de6-9321-e9caa1427f9a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:58.363794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-008f8fd2-2505-4de6-9321-e9caa1427f9a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:58.363794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-008f8fd2-2505-4de6-9321-e9caa1427f9a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:58.371085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-008f8fd2-2505-4de6-9321-e9caa1427f9a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:58.382983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-008f8fd2-2505-4de6-9321-e9caa1427f9a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:58.383560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-008f8fd2-2505-4de6-9321-e9caa1427f9a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:58.384018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-008f8fd2-2505-4de6-9321-e9caa1427f9a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:58.431232 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-96bad1b8-c38b-4d68-ad40-70cabe82cb23 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.104982 Sep 06 11:10:58.440004 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2186/4376] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:10:58 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:58.495932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6807ecca-3484-4e0b-93b0-c4fca2fff0c2 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:58.495932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6807ecca-3484-4e0b-93b0-c4fca2fff0c2 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:58.709454 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6807ecca-3484-4e0b-93b0-c4fca2fff0c2 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1329 microversion: 2.1 time: 0.221461 Sep 06 11:10:58.727768 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2187/4377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:58 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1329 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:58.742183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6b0a5f43-5711-4ae3-b03b-18e70de89e68 req-6f97f391-855c-4dd6-a085-e301aa47fdff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2efebce8-1a38-448b-8fe9-72a033a000bb", "name": "network-vif-deleted", "tag": "8199783c-e27d-432a-9c27-c4ed212223cd"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:10:58.757232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6b0a5f43-5711-4ae3-b03b-18e70de89e68 req-6f97f391-855c-4dd6-a085-e301aa47fdff service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:58.757232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6b0a5f43-5711-4ae3-b03b-18e70de89e68 req-6f97f391-855c-4dd6-a085-e301aa47fdff service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:58.757232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6b0a5f43-5711-4ae3-b03b-18e70de89e68 req-6f97f391-855c-4dd6-a085-e301aa47fdff service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:58.774595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-008f8fd2-2505-4de6-9321-e9caa1427f9a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:58.792755 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-008f8fd2-2505-4de6-9321-e9caa1427f9a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1372 microversion: 2.1 time: 0.442009 Sep 06 11:10:58.793364 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2191/4378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:58 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1372 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:10:58.801246 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6b0a5f43-5711-4ae3-b03b-18e70de89e68 req-6f97f391-855c-4dd6-a085-e301aa47fdff service nova] Creating event network-vif-deleted:8199783c-e27d-432a-9c27-c4ed212223cd for instance 2efebce8-1a38-448b-8fe9-72a033a000bb on nch2-master-1 Sep 06 11:10:58.803908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9f2b62c4-2886-406d-b446-0a248c6c1b38 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:58.804816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9f2b62c4-2886-406d-b446-0a248c6c1b38 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:58.820278 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6b0a5f43-5711-4ae3-b03b-18e70de89e68 req-6f97f391-855c-4dd6-a085-e301aa47fdff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089398 Sep 06 11:10:58.820788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f2b62c4-2886-406d-b446-0a248c6c1b38 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:58.821428 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2188/4379] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:10:58.821813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f2b62c4-2886-406d-b446-0a248c6c1b38 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:58.827721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f2b62c4-2886-406d-b446-0a248c6c1b38 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:58.830442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f2b62c4-2886-406d-b446-0a248c6c1b38 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:58.830442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f2b62c4-2886-406d-b446-0a248c6c1b38 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:58.830442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f2b62c4-2886-406d-b446-0a248c6c1b38 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:58.906812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9f2b62c4-2886-406d-b446-0a248c6c1b38 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:58.916853 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9f2b62c4-2886-406d-b446-0a248c6c1b38 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1313 microversion: 2.1 time: 0.122132 Sep 06 11:10:58.917454 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2192/4380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:58 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1313 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:59.325607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b7272c7c-1607-4cc1-bb2e-f5ddd5a4a43e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:59.328831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b7272c7c-1607-4cc1-bb2e-f5ddd5a4a43e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:59.344528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7272c7c-1607-4cc1-bb2e-f5ddd5a4a43e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:59.345425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7272c7c-1607-4cc1-bb2e-f5ddd5a4a43e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:59.346126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7272c7c-1607-4cc1-bb2e-f5ddd5a4a43e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:59.348366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7272c7c-1607-4cc1-bb2e-f5ddd5a4a43e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:59.349781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7272c7c-1607-4cc1-bb2e-f5ddd5a4a43e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:59.350453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7272c7c-1607-4cc1-bb2e-f5ddd5a4a43e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:59.447722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b7272c7c-1607-4cc1-bb2e-f5ddd5a4a43e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:10:59.450655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-919cf648-a17a-4507-97d5-12c49473518e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f38bbdc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:59.465851 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b7272c7c-1607-4cc1-bb2e-f5ddd5a4a43e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1283 microversion: 2.1 time: 0.159048 Sep 06 11:10:59.465851 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2189/4381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:59 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:59.566012 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-919cf648-a17a-4507-97d5-12c49473518e tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.121545 Sep 06 11:10:59.573013 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2193/4382] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:10:59 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:10:59.745614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e70b4eb5-878b-495b-b66b-ee8bae372f45 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:59.748328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e70b4eb5-878b-495b-b66b-ee8bae372f45 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:59.767737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e70b4eb5-878b-495b-b66b-ee8bae372f45 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:59.768952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e70b4eb5-878b-495b-b66b-ee8bae372f45 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:59.769977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e70b4eb5-878b-495b-b66b-ee8bae372f45 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:59.771432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e70b4eb5-878b-495b-b66b-ee8bae372f45 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:59.772422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e70b4eb5-878b-495b-b66b-ee8bae372f45 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:59.773373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e70b4eb5-878b-495b-b66b-ee8bae372f45 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:59.827204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-92be3983-c82d-4971-a04f-4a4b908640ce tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:10:59.832002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-92be3983-c82d-4971-a04f-4a4b908640ce tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:10:59.839858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92be3983-c82d-4971-a04f-4a4b908640ce tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:59.840674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92be3983-c82d-4971-a04f-4a4b908640ce tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:59.841343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92be3983-c82d-4971-a04f-4a4b908640ce tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:59.842270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92be3983-c82d-4971-a04f-4a4b908640ce tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:10:59.845892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92be3983-c82d-4971-a04f-4a4b908640ce tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:10:59.846551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92be3983-c82d-4971-a04f-4a4b908640ce tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:10:59.964501 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e70b4eb5-878b-495b-b66b-ee8bae372f45 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1346 microversion: 2.1 time: 0.225800 Sep 06 11:10:59.965794 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2190/4383] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:59 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1346 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:00.007673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:00.009619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:00.022620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:00.024277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:00.025542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:00.027280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:00.028484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:00.029616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:00.123245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:00.124390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:00.125319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:00.126260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lazy-loading 'fault' on Instance uuid 2efebce8-1a38-448b-8fe9-72a033a000bb {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:11:00.248115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:00.262430 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5d68b10e-983b-425c-ad75-2590d6114edb tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1318 microversion: 2.1 time: 0.279521 Sep 06 11:11:00.263133 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2191/4384] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:59 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:00.281334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-92be3983-c82d-4971-a04f-4a4b908640ce tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:00.307039 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-92be3983-c82d-4971-a04f-4a4b908640ce tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1372 microversion: 2.1 time: 0.488519 Sep 06 11:11:00.314356 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2194/4385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:10:59 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1372 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:00.508419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-451a4e93-5f94-4c34-8140-3a81585f408f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:00.509906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-451a4e93-5f94-4c34-8140-3a81585f408f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:00.529345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-451a4e93-5f94-4c34-8140-3a81585f408f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:00.530201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-451a4e93-5f94-4c34-8140-3a81585f408f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:00.530879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-451a4e93-5f94-4c34-8140-3a81585f408f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:00.532151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-451a4e93-5f94-4c34-8140-3a81585f408f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:00.532810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-451a4e93-5f94-4c34-8140-3a81585f408f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:00.533721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-451a4e93-5f94-4c34-8140-3a81585f408f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:00.602986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-002385c0-3069-4472-9527-18346454597f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f8adef70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:00.673648 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-002385c0-3069-4472-9527-18346454597f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.077245 Sep 06 11:11:00.675321 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2195/4386] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:00 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:00.795801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-451a4e93-5f94-4c34-8140-3a81585f408f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:00.805139 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-451a4e93-5f94-4c34-8140-3a81585f408f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1281 microversion: 2.1 time: 0.303456 Sep 06 11:11:00.822112 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2192/4387] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:00 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1281 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:01.016924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ddc50933-a300-494a-b895-22f15a4047ef tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:01.020249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ddc50933-a300-494a-b895-22f15a4047ef tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:01.033705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddc50933-a300-494a-b895-22f15a4047ef tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:01.034562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddc50933-a300-494a-b895-22f15a4047ef tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:01.036324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddc50933-a300-494a-b895-22f15a4047ef tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:01.037172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddc50933-a300-494a-b895-22f15a4047ef tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:01.037813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddc50933-a300-494a-b895-22f15a4047ef tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:01.038129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddc50933-a300-494a-b895-22f15a4047ef tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:01.305719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:01.307189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:01.316057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:01.317002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:01.317706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:01.318521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:01.320391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:01.321261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:01.370164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:01.371088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:01.371833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:01.372758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lazy-loading 'fault' on Instance uuid 2efebce8-1a38-448b-8fe9-72a033a000bb {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:11:01.403648 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ddc50933-a300-494a-b895-22f15a4047ef tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1416 microversion: 2.1 time: 0.391892 Sep 06 11:11:01.407830 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2196/4388] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:01 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1416 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:01.425305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-46cdb391-019e-4a93-a3e5-7f40917ad604 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:01.426312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-46cdb391-019e-4a93-a3e5-7f40917ad604 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:01.434470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46cdb391-019e-4a93-a3e5-7f40917ad604 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:01.435557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46cdb391-019e-4a93-a3e5-7f40917ad604 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:01.436251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46cdb391-019e-4a93-a3e5-7f40917ad604 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:01.439484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46cdb391-019e-4a93-a3e5-7f40917ad604 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:01.440347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46cdb391-019e-4a93-a3e5-7f40917ad604 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:01.441460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46cdb391-019e-4a93-a3e5-7f40917ad604 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:01.451749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d84a0cde53b4c278fc96b6d7296d5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2edd13a86624b4fbebab5f650bac271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:01.477463 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b819acba-6bc4-4fc7-82b7-d2742ce94ea9 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 200 len: 1318 microversion: 2.1 time: 0.178208 Sep 06 11:11:01.478497 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2193/4389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:01 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:01.658437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-46cdb391-019e-4a93-a3e5-7f40917ad604 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:01.666789 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-46cdb391-019e-4a93-a3e5-7f40917ad604 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1565 microversion: 2.1 time: 0.247973 Sep 06 11:11:01.679787 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2197/4390] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:01 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1565 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:01.694070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f7433ece-be17-4a91-95d4-4e20dc3886d3 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3e3cc10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:01.698653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c63f87ce-b236-4e9b-aef0-b4afa6b59fa1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:01.699490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c63f87ce-b236-4e9b-aef0-b4afa6b59fa1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:01.713520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c63f87ce-b236-4e9b-aef0-b4afa6b59fa1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:01.715713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c63f87ce-b236-4e9b-aef0-b4afa6b59fa1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:01.720244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c63f87ce-b236-4e9b-aef0-b4afa6b59fa1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:01.721192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c63f87ce-b236-4e9b-aef0-b4afa6b59fa1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:01.722127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c63f87ce-b236-4e9b-aef0-b4afa6b59fa1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:01.724145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c63f87ce-b236-4e9b-aef0-b4afa6b59fa1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:01.792503 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f7433ece-be17-4a91-95d4-4e20dc3886d3 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.102963 Sep 06 11:11:01.801525 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2194/4391] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:01 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:01.836827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6a242a1f-0fe5-4592-ac1c-f7b4a9948bf1 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:01.837789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6a242a1f-0fe5-4592-ac1c-f7b4a9948bf1 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:01.852796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a242a1f-0fe5-4592-ac1c-f7b4a9948bf1 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:01.853761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a242a1f-0fe5-4592-ac1c-f7b4a9948bf1 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:01.854433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a242a1f-0fe5-4592-ac1c-f7b4a9948bf1 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:01.855465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a242a1f-0fe5-4592-ac1c-f7b4a9948bf1 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:01.856137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a242a1f-0fe5-4592-ac1c-f7b4a9948bf1 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:01.856842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a242a1f-0fe5-4592-ac1c-f7b4a9948bf1 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:02.020374 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c63f87ce-b236-4e9b-aef0-b4afa6b59fa1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.326571 Sep 06 11:11:02.023405 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2198/4392] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:11:01 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-interface => generated 284 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:02.436861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4dbf3868-f4aa-4b86-8414-53e3206cb73e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:02.437613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4dbf3868-f4aa-4b86-8414-53e3206cb73e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:02.455057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4dbf3868-f4aa-4b86-8414-53e3206cb73e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:02.455578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4dbf3868-f4aa-4b86-8414-53e3206cb73e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:02.456084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4dbf3868-f4aa-4b86-8414-53e3206cb73e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:02.456830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4dbf3868-f4aa-4b86-8414-53e3206cb73e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:02.467693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4dbf3868-f4aa-4b86-8414-53e3206cb73e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:02.468663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4dbf3868-f4aa-4b86-8414-53e3206cb73e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:02.479692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6a242a1f-0fe5-4592-ac1c-f7b4a9948bf1 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:02.497305 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6a242a1f-0fe5-4592-ac1c-f7b4a9948bf1 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1323 microversion: 2.1 time: 0.664312 Sep 06 11:11:02.502343 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2195/4393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:01 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1323 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:02.518910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0098d1cd-82f4-45ab-87db-76be6fd97c83 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:02.521048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0098d1cd-82f4-45ab-87db-76be6fd97c83 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] [instance: 2efebce8-1a38-448b-8fe9-72a033a000bb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:02.539123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0098d1cd-82f4-45ab-87db-76be6fd97c83 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:02.539993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0098d1cd-82f4-45ab-87db-76be6fd97c83 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:02.543306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0098d1cd-82f4-45ab-87db-76be6fd97c83 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:02.543306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0098d1cd-82f4-45ab-87db-76be6fd97c83 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:02.543306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0098d1cd-82f4-45ab-87db-76be6fd97c83 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:02.543306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0098d1cd-82f4-45ab-87db-76be6fd97c83 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:02.551991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:02.568675 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-0098d1cd-82f4-45ab-87db-76be6fd97c83 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] HTTP exception thrown: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0098d1cd-82f4-45ab-87db-76be6fd97c83 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Request method failure captured: Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb HTTP/1.1 Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyqIr1CNsoyJCrYAPAjjszOlp4RjhF6INeN2BWSE3JLJUCnq5RWJ9eNXqvhbLUG90-LtjAfsN_shIipfbOjwle8hNKpdBd6sPvXTFF1S4ZVE8nmijsBUvGSYUaqF9L59XeVoeBJbnypjD-VZRGIFBH0RuXkRffphGSOZGJ7Arv3_-Og Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: a2edd13a86624b4fbebab5f650bac271 Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1297786606 Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2edd13a86624b4fbebab5f650bac271"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2edd13a86624b4fbebab5f650bac271"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2edd13a86624b4fbebab5f650bac271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2edd13a86624b4fbebab5f650bac271"}]}] Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1297786606 Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: a2edd13a86624b4fbebab5f650bac271 Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1297786606 Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1297786606-project Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3d84a0cde53b4c278fc96b6d7296d5e4 Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1297786606-project Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '2efebce8-1a38-448b-8fe9-72a033a000bb'} Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:11:02.571228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:02.574963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:11:02.574963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:02.574963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:11:02.574963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:11:02.574963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:11:02.574963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:11:02.574963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:11:02.574963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. Sep 06 11:11:02.574963 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:02.577763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0098d1cd-82f4-45ab-87db-76be6fd97c83 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] Returning 404 to user: Instance 2efebce8-1a38-448b-8fe9-72a033a000bb could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:11:02.578957 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0098d1cd-82f4-45ab-87db-76be6fd97c83 tempest-ServersNegativeTestMultiTenantJSON-1297786606 tempest-ServersNegativeTestMultiTenantJSON-1297786606-project] 10.222.0.20 "GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb" status: 404 len: 111 microversion: 2.1 time: 0.069726 Sep 06 11:11:02.580612 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2196/4394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:02 2022] GET /compute/v2.1/servers/2efebce8-1a38-448b-8fe9-72a033a000bb => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:11:02.731795 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4dbf3868-f4aa-4b86-8414-53e3206cb73e tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1434 microversion: 2.1 time: 0.302350 Sep 06 11:11:02.732673 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2199/4395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:02 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1434 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:02.810219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9c3b74d-2a5b-4c39-b184-1a9113aee055 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90fd0b95e0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:02.961710 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e9c3b74d-2a5b-4c39-b184-1a9113aee055 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.156440 Sep 06 11:11:02.962741 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2197/4396] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:02 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:03.391619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-e709c39a-3e6c-4364-bb3a-6c4a9138de2a req-24447f58-8be9-49ca-9950-45a08a34b9be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d53b0f-bd9f-479e-948b-bbefbd0d8597", "name": "network-vif-plugged", "status": "completed", "tag": "56dd829f-74c4-4912-9aac-6b30a6e3cd3e"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:03.415042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e709c39a-3e6c-4364-bb3a-6c4a9138de2a req-24447f58-8be9-49ca-9950-45a08a34b9be service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:03.415843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e709c39a-3e6c-4364-bb3a-6c4a9138de2a req-24447f58-8be9-49ca-9950-45a08a34b9be service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:03.421103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e709c39a-3e6c-4364-bb3a-6c4a9138de2a req-24447f58-8be9-49ca-9950-45a08a34b9be service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:03.436816 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-e709c39a-3e6c-4364-bb3a-6c4a9138de2a req-24447f58-8be9-49ca-9950-45a08a34b9be service nova] Creating event network-vif-plugged:56dd829f-74c4-4912-9aac-6b30a6e3cd3e for instance 77d53b0f-bd9f-479e-948b-bbefbd0d8597 on nch1-master-1 Sep 06 11:11:03.445401 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-e709c39a-3e6c-4364-bb3a-6c4a9138de2a req-24447f58-8be9-49ca-9950-45a08a34b9be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057037 Sep 06 11:11:03.455988 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2200/4397] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:03.538882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-19fd4c1f-dd01-4798-a91a-1c95c1c3dac0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:03.540145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-19fd4c1f-dd01-4798-a91a-1c95c1c3dac0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:03.564497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19fd4c1f-dd01-4798-a91a-1c95c1c3dac0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:03.570312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19fd4c1f-dd01-4798-a91a-1c95c1c3dac0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:03.571555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19fd4c1f-dd01-4798-a91a-1c95c1c3dac0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:03.576729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19fd4c1f-dd01-4798-a91a-1c95c1c3dac0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:03.578585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19fd4c1f-dd01-4798-a91a-1c95c1c3dac0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:03.579368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19fd4c1f-dd01-4798-a91a-1c95c1c3dac0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:03.762074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6c410abb-dc5d-4b69-8934-b7d478d86ab7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:03.763138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6c410abb-dc5d-4b69-8934-b7d478d86ab7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:03.770560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c410abb-dc5d-4b69-8934-b7d478d86ab7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:03.771356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c410abb-dc5d-4b69-8934-b7d478d86ab7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:03.771968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c410abb-dc5d-4b69-8934-b7d478d86ab7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:03.772892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c410abb-dc5d-4b69-8934-b7d478d86ab7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:03.773624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c410abb-dc5d-4b69-8934-b7d478d86ab7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:03.774222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c410abb-dc5d-4b69-8934-b7d478d86ab7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:04.522444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-19fd4c1f-dd01-4798-a91a-1c95c1c3dac0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:04.534671 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-19fd4c1f-dd01-4798-a91a-1c95c1c3dac0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1323 microversion: 2.1 time: 0.999468 Sep 06 11:11:04.540645 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2198/4398] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:03 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1323 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:04.542925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-26707192-2f54-4f1f-a07c-fcb335ba8b71 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f87f7b80>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:04.627694 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-26707192-2f54-4f1f-a07c-fcb335ba8b71 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.088418 Sep 06 11:11:04.642956 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2199/4399] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:04 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:04.732583 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6c410abb-dc5d-4b69-8934-b7d478d86ab7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1464 microversion: 2.1 time: 0.974431 Sep 06 11:11:04.746940 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2201/4400] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:03 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1464 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:05.266519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-32f7a8d9-11e3-4f36-9c5e-6bcac61abf35 req-8cb09e9f-30ff-4690-b51b-d508ef1dc8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa9fb77-6ffc-4a34-9db9-3ba749d98afc", "tag": "33293afd-e865-4886-9b9b-f1ae1fefac75"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:05.294861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-32f7a8d9-11e3-4f36-9c5e-6bcac61abf35 req-8cb09e9f-30ff-4690-b51b-d508ef1dc8c2 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:05.296129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-32f7a8d9-11e3-4f36-9c5e-6bcac61abf35 req-8cb09e9f-30ff-4690-b51b-d508ef1dc8c2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:05.297657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-32f7a8d9-11e3-4f36-9c5e-6bcac61abf35 req-8cb09e9f-30ff-4690-b51b-d508ef1dc8c2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:05.316587 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-32f7a8d9-11e3-4f36-9c5e-6bcac61abf35 req-8cb09e9f-30ff-4690-b51b-d508ef1dc8c2 service nova] Creating event network-changed:33293afd-e865-4886-9b9b-f1ae1fefac75 for instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc on nch2-master-1 Sep 06 11:11:05.325621 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-32f7a8d9-11e3-4f36-9c5e-6bcac61abf35 req-8cb09e9f-30ff-4690-b51b-d508ef1dc8c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063047 Sep 06 11:11:05.328328 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2200/4401] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:05.564697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c84c54c-fd2a-43fc-b3f2-c73234913f1e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:05.565559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4c84c54c-fd2a-43fc-b3f2-c73234913f1e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:05.579620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c84c54c-fd2a-43fc-b3f2-c73234913f1e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:05.585426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c84c54c-fd2a-43fc-b3f2-c73234913f1e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:05.587534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c84c54c-fd2a-43fc-b3f2-c73234913f1e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:05.587534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c84c54c-fd2a-43fc-b3f2-c73234913f1e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:05.588765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c84c54c-fd2a-43fc-b3f2-c73234913f1e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:05.589436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c84c54c-fd2a-43fc-b3f2-c73234913f1e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:05.650407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1b6656a2-2cee-4109-968e-4eba1deffa44 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f87f7b80>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:05.764028 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1b6656a2-2cee-4109-968e-4eba1deffa44 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.117738 Sep 06 11:11:05.765918 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2201/4402] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:05 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:05.776532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-54c05814-0dc7-435b-82ca-3f5e6c5866f0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:05.778478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-54c05814-0dc7-435b-82ca-3f5e6c5866f0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:05.795332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c05814-0dc7-435b-82ca-3f5e6c5866f0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:05.796048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c05814-0dc7-435b-82ca-3f5e6c5866f0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:05.796529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c05814-0dc7-435b-82ca-3f5e6c5866f0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:05.797301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c05814-0dc7-435b-82ca-3f5e6c5866f0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:05.802055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c05814-0dc7-435b-82ca-3f5e6c5866f0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:05.802911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54c05814-0dc7-435b-82ca-3f5e6c5866f0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:06.326074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4c84c54c-fd2a-43fc-b3f2-c73234913f1e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:06.341827 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4c84c54c-fd2a-43fc-b3f2-c73234913f1e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1323 microversion: 2.1 time: 0.781415 Sep 06 11:11:06.358103 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2202/4403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:05 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1323 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:06.415836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:06.452625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:06.474406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a607c7c1-c4cc-4f05-849d-21e586b9f3bd req-6e30c3e8-3716-4a4e-930b-66d242ab4c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76977a0f-f682-4968-96cf-58fff0c6625b", "tag": "c5a9fd30-3a11-467d-84cf-1398f51c8010"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:06.508312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a607c7c1-c4cc-4f05-849d-21e586b9f3bd req-6e30c3e8-3716-4a4e-930b-66d242ab4c18 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:06.509185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a607c7c1-c4cc-4f05-849d-21e586b9f3bd req-6e30c3e8-3716-4a4e-930b-66d242ab4c18 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:06.511482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a607c7c1-c4cc-4f05-849d-21e586b9f3bd req-6e30c3e8-3716-4a4e-930b-66d242ab4c18 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:06.561384 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a607c7c1-c4cc-4f05-849d-21e586b9f3bd req-6e30c3e8-3716-4a4e-930b-66d242ab4c18 service nova] Creating event network-changed:c5a9fd30-3a11-467d-84cf-1398f51c8010 for instance 76977a0f-f682-4968-96cf-58fff0c6625b on nch2-master-1 Sep 06 11:11:06.570330 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a607c7c1-c4cc-4f05-849d-21e586b9f3bd req-6e30c3e8-3716-4a4e-930b-66d242ab4c18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221584 Sep 06 11:11:06.571618 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2203/4404] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:06.645805 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-54c05814-0dc7-435b-82ca-3f5e6c5866f0 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1464 microversion: 2.1 time: 0.878527 Sep 06 11:11:06.646328 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2202/4405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:05 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1464 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:06.785493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-60d8c0eb-7179-4671-af24-2aeb609b5b84 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f31d58b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:06.880272 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-60d8c0eb-7179-4671-af24-2aeb609b5b84 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.100533 Sep 06 11:11:06.883081 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2204/4406] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:06 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:07.370192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-3316e137-fd59-4f5e-baec-9774f7abdff2 req-44f35a17-9d10-4c87-9ce4-b55c61fc606b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08ee18dc-4a4f-49b5-a4be-b15c275e33eb", "tag": "37685197-a7bd-4846-bc8e-04b59f5c612a"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:07.381293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-56541cd5-a8a7-4773-b801-41958f2fa8f7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:07.381293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-56541cd5-a8a7-4773-b801-41958f2fa8f7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:07.389367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56541cd5-a8a7-4773-b801-41958f2fa8f7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:07.390666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56541cd5-a8a7-4773-b801-41958f2fa8f7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:07.391387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56541cd5-a8a7-4773-b801-41958f2fa8f7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:07.392302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56541cd5-a8a7-4773-b801-41958f2fa8f7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:07.392939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56541cd5-a8a7-4773-b801-41958f2fa8f7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:07.394492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56541cd5-a8a7-4773-b801-41958f2fa8f7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:07.401933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3316e137-fd59-4f5e-baec-9774f7abdff2 req-44f35a17-9d10-4c87-9ce4-b55c61fc606b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:07.415811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3316e137-fd59-4f5e-baec-9774f7abdff2 req-44f35a17-9d10-4c87-9ce4-b55c61fc606b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:07.417371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3316e137-fd59-4f5e-baec-9774f7abdff2 req-44f35a17-9d10-4c87-9ce4-b55c61fc606b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:07.428781 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-3316e137-fd59-4f5e-baec-9774f7abdff2 req-44f35a17-9d10-4c87-9ce4-b55c61fc606b service nova] Creating event network-changed:37685197-a7bd-4846-bc8e-04b59f5c612a for instance 08ee18dc-4a4f-49b5-a4be-b15c275e33eb on nch2-master-1 Sep 06 11:11:07.471455 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-3316e137-fd59-4f5e-baec-9774f7abdff2 req-44f35a17-9d10-4c87-9ce4-b55c61fc606b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087648 Sep 06 11:11:07.476578 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2203/4407] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:11:07.676238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0d99801e-7789-4330-8306-297db9c99f9c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:07.677335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0d99801e-7789-4330-8306-297db9c99f9c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:07.692318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d99801e-7789-4330-8306-297db9c99f9c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:07.693536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d99801e-7789-4330-8306-297db9c99f9c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:07.694593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d99801e-7789-4330-8306-297db9c99f9c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:07.695654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d99801e-7789-4330-8306-297db9c99f9c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:07.698141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d99801e-7789-4330-8306-297db9c99f9c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:07.698931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d99801e-7789-4330-8306-297db9c99f9c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:08.142310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-56541cd5-a8a7-4773-b801-41958f2fa8f7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:08.151958 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-56541cd5-a8a7-4773-b801-41958f2fa8f7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1323 microversion: 2.1 time: 0.788373 Sep 06 11:11:08.167546 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2205/4408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:07 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1323 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:08.178943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f8694844-e3dc-4342-b42e-ead1cb03b968 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f31bcf70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:08.198222 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0d99801e-7789-4330-8306-297db9c99f9c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1464 microversion: 2.1 time: 0.527667 Sep 06 11:11:08.220230 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2204/4409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:07 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1464 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:08.241310 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f8694844-e3dc-4342-b42e-ead1cb03b968 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.072303 Sep 06 11:11:08.242036 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2206/4410] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:08 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:09.183561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a1d83a5f-fdce-48d2-b5bb-699aa15479eb tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:09.184185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a1d83a5f-fdce-48d2-b5bb-699aa15479eb tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:09.202273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:09.211443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d83a5f-fdce-48d2-b5bb-699aa15479eb tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:09.223321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d83a5f-fdce-48d2-b5bb-699aa15479eb tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:09.223321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d83a5f-fdce-48d2-b5bb-699aa15479eb tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:09.223321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d83a5f-fdce-48d2-b5bb-699aa15479eb tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:09.223321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d83a5f-fdce-48d2-b5bb-699aa15479eb tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:09.224415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d83a5f-fdce-48d2-b5bb-699aa15479eb tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:09.239243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-32c8bb0d-fe0e-47c2-8b9b-ba83c1dffb50 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:09.240672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-32c8bb0d-fe0e-47c2-8b9b-ba83c1dffb50 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:09.248299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32c8bb0d-fe0e-47c2-8b9b-ba83c1dffb50 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:09.252205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32c8bb0d-fe0e-47c2-8b9b-ba83c1dffb50 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:09.253008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32c8bb0d-fe0e-47c2-8b9b-ba83c1dffb50 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:09.254416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32c8bb0d-fe0e-47c2-8b9b-ba83c1dffb50 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:09.263591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32c8bb0d-fe0e-47c2-8b9b-ba83c1dffb50 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:09.263591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-32c8bb0d-fe0e-47c2-8b9b-ba83c1dffb50 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:09.769948 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-32c8bb0d-fe0e-47c2-8b9b-ba83c1dffb50 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1464 microversion: 2.1 time: 0.544694 Sep 06 11:11:09.787638 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2207/4411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:09 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1464 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:09.811363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f1facd34-3155-474b-9656-8fcfed3a05fb tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f8cbe940>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:09.916148 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f1facd34-3155-474b-9656-8fcfed3a05fb tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.136614 Sep 06 11:11:09.917352 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2208/4412] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:09 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:09.969654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a1d83a5f-fdce-48d2-b5bb-699aa15479eb tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:09.980171 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a1d83a5f-fdce-48d2-b5bb-699aa15479eb tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1323 microversion: 2.1 time: 0.800467 Sep 06 11:11:10.000497 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2205/4413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:09 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1323 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:10.800541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9ca89570-8305-428f-87d9-286f5ce5d356 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:10.801203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9ca89570-8305-428f-87d9-286f5ce5d356 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:10.815170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ca89570-8305-428f-87d9-286f5ce5d356 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:10.815677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ca89570-8305-428f-87d9-286f5ce5d356 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:10.816136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ca89570-8305-428f-87d9-286f5ce5d356 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:10.816861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ca89570-8305-428f-87d9-286f5ce5d356 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:10.817331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ca89570-8305-428f-87d9-286f5ce5d356 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:10.817778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ca89570-8305-428f-87d9-286f5ce5d356 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:10.938311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-238713eb-4210-4d10-8258-23d80a43735f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90fcfc05e0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:10.993811 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-238713eb-4210-4d10-8258-23d80a43735f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.064347 Sep 06 11:11:11.002914 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2206/4414] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:10 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:11.050260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e4e5237-814d-4e8f-a10e-c4954d70a25b tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:11.051936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e4e5237-814d-4e8f-a10e-c4954d70a25b tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:11.060446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e4e5237-814d-4e8f-a10e-c4954d70a25b tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:11.061524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e4e5237-814d-4e8f-a10e-c4954d70a25b tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:11.062170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e4e5237-814d-4e8f-a10e-c4954d70a25b tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:11.063161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e4e5237-814d-4e8f-a10e-c4954d70a25b tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:11.063823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e4e5237-814d-4e8f-a10e-c4954d70a25b tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:11.065003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e4e5237-814d-4e8f-a10e-c4954d70a25b tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:11.430863 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9ca89570-8305-428f-87d9-286f5ce5d356 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1464 microversion: 2.1 time: 0.640727 Sep 06 11:11:11.435328 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2209/4415] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:10 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1464 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:11.517245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7e4e5237-814d-4e8f-a10e-c4954d70a25b tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:11.532812 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e4e5237-814d-4e8f-a10e-c4954d70a25b tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1323 microversion: 2.1 time: 0.490712 Sep 06 11:11:11.533079 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2207/4416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:11 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1323 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:12.010998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0d49a034-13df-4f52-99f5-cb5c684e29a1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f31d59d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:12.074974 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0d49a034-13df-4f52-99f5-cb5c684e29a1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.068758 Sep 06 11:11:12.080509 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2210/4417] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:12 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:12.469025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6090768e-1df7-4a8d-bbda-f1b170e6d691 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:12.469821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6090768e-1df7-4a8d-bbda-f1b170e6d691 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:12.489675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6090768e-1df7-4a8d-bbda-f1b170e6d691 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:12.492929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6090768e-1df7-4a8d-bbda-f1b170e6d691 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:12.493609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6090768e-1df7-4a8d-bbda-f1b170e6d691 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:12.500066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6090768e-1df7-4a8d-bbda-f1b170e6d691 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:12.501108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6090768e-1df7-4a8d-bbda-f1b170e6d691 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:12.501735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6090768e-1df7-4a8d-bbda-f1b170e6d691 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:12.558021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b041aa39-6cef-4301-8e42-67d224c2e9db tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:12.558552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b041aa39-6cef-4301-8e42-67d224c2e9db tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:12.571357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b041aa39-6cef-4301-8e42-67d224c2e9db tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:12.572606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b041aa39-6cef-4301-8e42-67d224c2e9db tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:12.580160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b041aa39-6cef-4301-8e42-67d224c2e9db tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:12.581689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b041aa39-6cef-4301-8e42-67d224c2e9db tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:12.582402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b041aa39-6cef-4301-8e42-67d224c2e9db tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:12.583131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b041aa39-6cef-4301-8e42-67d224c2e9db tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:12.876562 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6090768e-1df7-4a8d-bbda-f1b170e6d691 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1464 microversion: 2.1 time: 0.421513 Sep 06 11:11:12.879599 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2208/4418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:12 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1464 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:13.011677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b041aa39-6cef-4301-8e42-67d224c2e9db tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:13.025995 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b041aa39-6cef-4301-8e42-67d224c2e9db tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1323 microversion: 2.1 time: 0.472181 Sep 06 11:11:13.028250 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2211/4419] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:12 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1323 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:13.094827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dfb8ee57-828c-4935-b94c-3cf88b9a86cd tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f8e0e670>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:13.190835 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dfb8ee57-828c-4935-b94c-3cf88b9a86cd tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.097157 Sep 06 11:11:13.191611 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2209/4420] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:13 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:13.904149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-563568ea-55e9-4c24-b7fe-692a74241d79 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:13.904910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-563568ea-55e9-4c24-b7fe-692a74241d79 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:13.919451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-563568ea-55e9-4c24-b7fe-692a74241d79 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:13.920052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-563568ea-55e9-4c24-b7fe-692a74241d79 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:13.921314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-563568ea-55e9-4c24-b7fe-692a74241d79 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:13.923541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-563568ea-55e9-4c24-b7fe-692a74241d79 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:13.930994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-563568ea-55e9-4c24-b7fe-692a74241d79 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:13.930994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-563568ea-55e9-4c24-b7fe-692a74241d79 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:14.053221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8c625cf4-348c-4c8b-913c-406cb914d3ee tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:14.055726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8c625cf4-348c-4c8b-913c-406cb914d3ee tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:14.070364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c625cf4-348c-4c8b-913c-406cb914d3ee tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:14.075768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c625cf4-348c-4c8b-913c-406cb914d3ee tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:14.076618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c625cf4-348c-4c8b-913c-406cb914d3ee tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:14.078033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c625cf4-348c-4c8b-913c-406cb914d3ee tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:14.082478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c625cf4-348c-4c8b-913c-406cb914d3ee tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:14.083419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c625cf4-348c-4c8b-913c-406cb914d3ee tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:14.416158 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-563568ea-55e9-4c24-b7fe-692a74241d79 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1464 microversion: 2.1 time: 0.516096 Sep 06 11:11:14.428969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8c625cf4-348c-4c8b-913c-406cb914d3ee tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:14.431704 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2212/4421] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:13 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1464 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:14.438919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9a9fdf2-bfa6-4e27-8025-dbcb72e85995 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f344cee0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:14.453891 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8c625cf4-348c-4c8b-913c-406cb914d3ee tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1323 microversion: 2.1 time: 0.404655 Sep 06 11:11:14.461818 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2210/4422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:14 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1323 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:14.503852 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d9a9fdf2-bfa6-4e27-8025-dbcb72e85995 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.070517 Sep 06 11:11:14.513163 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2213/4423] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:14 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:14.801769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-831c5b98-ea1a-462c-870a-7743ec8cd216 req-dcece129-6738-4350-a750-5d06e47889e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76977a0f-f682-4968-96cf-58fff0c6625b", "name": "network-vif-plugged", "status": "completed", "tag": "c5a9fd30-3a11-467d-84cf-1398f51c8010"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:14.826723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-831c5b98-ea1a-462c-870a-7743ec8cd216 req-dcece129-6738-4350-a750-5d06e47889e5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:14.828038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-831c5b98-ea1a-462c-870a-7743ec8cd216 req-dcece129-6738-4350-a750-5d06e47889e5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:14.828627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-831c5b98-ea1a-462c-870a-7743ec8cd216 req-dcece129-6738-4350-a750-5d06e47889e5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:14.857613 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-831c5b98-ea1a-462c-870a-7743ec8cd216 req-dcece129-6738-4350-a750-5d06e47889e5 service nova] Creating event network-vif-plugged:c5a9fd30-3a11-467d-84cf-1398f51c8010 for instance 76977a0f-f682-4968-96cf-58fff0c6625b on nch2-master-1 Sep 06 11:11:14.868107 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-831c5b98-ea1a-462c-870a-7743ec8cd216 req-dcece129-6738-4350-a750-5d06e47889e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069908 Sep 06 11:11:14.877185 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2211/4424] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:15.450700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cd807cc0-06b5-4153-b220-5f85b70ba9fd tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:15.452923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cd807cc0-06b5-4153-b220-5f85b70ba9fd tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:15.477162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd807cc0-06b5-4153-b220-5f85b70ba9fd tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:15.477162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd807cc0-06b5-4153-b220-5f85b70ba9fd tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:15.477162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd807cc0-06b5-4153-b220-5f85b70ba9fd tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:15.477162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd807cc0-06b5-4153-b220-5f85b70ba9fd tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:15.477162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd807cc0-06b5-4153-b220-5f85b70ba9fd tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:15.478181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd807cc0-06b5-4153-b220-5f85b70ba9fd tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:15.493516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0acdf6f8-9ef3-4800-8bf2-974f30f132c2 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:15.494865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0acdf6f8-9ef3-4800-8bf2-974f30f132c2 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:15.505813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:15.509055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0acdf6f8-9ef3-4800-8bf2-974f30f132c2 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:15.510082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0acdf6f8-9ef3-4800-8bf2-974f30f132c2 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:15.510770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0acdf6f8-9ef3-4800-8bf2-974f30f132c2 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:15.512183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0acdf6f8-9ef3-4800-8bf2-974f30f132c2 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:15.513004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0acdf6f8-9ef3-4800-8bf2-974f30f132c2 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:15.516661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0acdf6f8-9ef3-4800-8bf2-974f30f132c2 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:15.863657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0acdf6f8-9ef3-4800-8bf2-974f30f132c2 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:15.870234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:15.873573 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0acdf6f8-9ef3-4800-8bf2-974f30f132c2 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1323 microversion: 2.1 time: 0.389240 Sep 06 11:11:15.874738 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2212/4425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:15 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1323 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:15.894606 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cd807cc0-06b5-4153-b220-5f85b70ba9fd tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1464 microversion: 2.1 time: 0.453313 Sep 06 11:11:15.895577 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2214/4426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:15 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1464 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:15.901193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a63f387c-9725-4bb5-ac6a-7e59f3ce7ec1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f33a5af0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:15.994374 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a63f387c-9725-4bb5-ac6a-7e59f3ce7ec1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.103550 Sep 06 11:11:15.994961 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2213/4427] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:15 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:16.901351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f43cad0-dad6-4525-a50e-f01b56c25cf6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:16.902919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4f43cad0-dad6-4525-a50e-f01b56c25cf6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:16.920335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f43cad0-dad6-4525-a50e-f01b56c25cf6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:16.920939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f43cad0-dad6-4525-a50e-f01b56c25cf6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:16.921387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f43cad0-dad6-4525-a50e-f01b56c25cf6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:16.924680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f43cad0-dad6-4525-a50e-f01b56c25cf6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:16.925821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-877ac83a-f711-4f84-99ae-05ab4493b143 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:16.926505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-877ac83a-f711-4f84-99ae-05ab4493b143 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:16.926953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f43cad0-dad6-4525-a50e-f01b56c25cf6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:16.929059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f43cad0-dad6-4525-a50e-f01b56c25cf6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:16.956310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-877ac83a-f711-4f84-99ae-05ab4493b143 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:16.956827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-877ac83a-f711-4f84-99ae-05ab4493b143 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:16.957286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-877ac83a-f711-4f84-99ae-05ab4493b143 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:16.958040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-877ac83a-f711-4f84-99ae-05ab4493b143 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:16.958516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-877ac83a-f711-4f84-99ae-05ab4493b143 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:16.958960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-877ac83a-f711-4f84-99ae-05ab4493b143 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:17.440306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4f43cad0-dad6-4525-a50e-f01b56c25cf6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:17.452096 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4f43cad0-dad6-4525-a50e-f01b56c25cf6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1517 microversion: 2.1 time: 0.555590 Sep 06 11:11:17.452704 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2215/4428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:16 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1517 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:17.475645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bd004b18-2c06-44d3-b25c-5d2d6dad2c17 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f39fc790>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:17.531940 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bd004b18-2c06-44d3-b25c-5d2d6dad2c17 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.061988 Sep 06 11:11:17.532813 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2216/4429] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:17 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:17.540311 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-877ac83a-f711-4f84-99ae-05ab4493b143 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1464 microversion: 2.1 time: 0.614381 Sep 06 11:11:17.541580 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2214/4430] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:16 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1464 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:17.542345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-324e2be2-0e87-4024-81da-87a5d5d99938 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:17.544884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-324e2be2-0e87-4024-81da-87a5d5d99938 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:17.553111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-324e2be2-0e87-4024-81da-87a5d5d99938 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:17.553946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-324e2be2-0e87-4024-81da-87a5d5d99938 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:17.554742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-324e2be2-0e87-4024-81da-87a5d5d99938 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:17.555710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-324e2be2-0e87-4024-81da-87a5d5d99938 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:17.556394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-324e2be2-0e87-4024-81da-87a5d5d99938 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:17.557050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-324e2be2-0e87-4024-81da-87a5d5d99938 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:17.617204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-324e2be2-0e87-4024-81da-87a5d5d99938 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lazy-loading 'flavor' on Instance uuid 76977a0f-f682-4968-96cf-58fff0c6625b {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:11:17.769684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-337eadf1-b605-4545-8b2d-48e460e57fb6 req-1aa1249f-7071-4a4d-bb46-af9028c5c55c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ee18dc-4a4f-49b5-a4be-b15c275e33eb", "name": "network-vif-plugged", "status": "completed", "tag": "37685197-a7bd-4846-bc8e-04b59f5c612a"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:17.807797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-337eadf1-b605-4545-8b2d-48e460e57fb6 req-1aa1249f-7071-4a4d-bb46-af9028c5c55c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:17.809450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-337eadf1-b605-4545-8b2d-48e460e57fb6 req-1aa1249f-7071-4a4d-bb46-af9028c5c55c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:17.809450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-337eadf1-b605-4545-8b2d-48e460e57fb6 req-1aa1249f-7071-4a4d-bb46-af9028c5c55c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:17.835935 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-337eadf1-b605-4545-8b2d-48e460e57fb6 req-1aa1249f-7071-4a4d-bb46-af9028c5c55c service nova] Creating event network-vif-plugged:37685197-a7bd-4846-bc8e-04b59f5c612a for instance 08ee18dc-4a4f-49b5-a4be-b15c275e33eb on nch2-master-1 Sep 06 11:11:17.867116 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-337eadf1-b605-4545-8b2d-48e460e57fb6 req-1aa1249f-7071-4a4d-bb46-af9028c5c55c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105454 Sep 06 11:11:17.876666 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2215/4431] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:11:18.171184 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-324e2be2-0e87-4024-81da-87a5d5d99938 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "POST /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b/action" status: 200 len: 32 microversion: 2.1 time: 0.634921 Sep 06 11:11:18.172473 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2217/4432] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:11:17 2022] POST /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b/action => generated 32 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:11:18.185272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d1e55dcb-0f4e-4622-92c8-265cbd3717a0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:18.186680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d1e55dcb-0f4e-4622-92c8-265cbd3717a0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:18.200046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1e55dcb-0f4e-4622-92c8-265cbd3717a0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:18.200817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1e55dcb-0f4e-4622-92c8-265cbd3717a0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:18.201435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1e55dcb-0f4e-4622-92c8-265cbd3717a0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:18.209069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1e55dcb-0f4e-4622-92c8-265cbd3717a0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:18.209913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1e55dcb-0f4e-4622-92c8-265cbd3717a0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:18.210588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1e55dcb-0f4e-4622-92c8-265cbd3717a0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:18.548781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-349ea50c-641f-44b3-9a02-da47789a49ea tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f30ffa60>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:18.648387 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-349ea50c-641f-44b3-9a02-da47789a49ea tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.104016 Sep 06 11:11:18.650144 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2218/4433] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:18 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:18.655067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ef0bebd2-8660-4935-b833-fa4634927d56 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:18.656136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ef0bebd2-8660-4935-b833-fa4634927d56 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:18.665487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef0bebd2-8660-4935-b833-fa4634927d56 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:18.670421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef0bebd2-8660-4935-b833-fa4634927d56 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:18.670421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef0bebd2-8660-4935-b833-fa4634927d56 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:18.670421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef0bebd2-8660-4935-b833-fa4634927d56 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:18.670421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef0bebd2-8660-4935-b833-fa4634927d56 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:18.670421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef0bebd2-8660-4935-b833-fa4634927d56 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:19.056516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d1e55dcb-0f4e-4622-92c8-265cbd3717a0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:19.089775 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ef0bebd2-8660-4935-b833-fa4634927d56 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1464 microversion: 2.1 time: 0.437994 Sep 06 11:11:19.091003 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2219/4434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:18 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1464 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:19.105722 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d1e55dcb-0f4e-4622-92c8-265cbd3717a0 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.925183 Sep 06 11:11:19.114487 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2216/4435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:18 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:19.673536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5ca3e319-a451-41c8-88df-610bb82115ec tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f30ffee0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:19.794730 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5ca3e319-a451-41c8-88df-610bb82115ec tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.122713 Sep 06 11:11:19.799556 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2220/4436] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:19 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:20.116679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-104df2e6-3f99-4dd0-abb3-8a095e0771d5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:20.117303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-104df2e6-3f99-4dd0-abb3-8a095e0771d5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:20.131234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-104df2e6-3f99-4dd0-abb3-8a095e0771d5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:20.143922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f5086de-6118-4445-b326-8cb301312a57 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:20.143922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1f5086de-6118-4445-b326-8cb301312a57 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:20.146034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-104df2e6-3f99-4dd0-abb3-8a095e0771d5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:20.146756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-104df2e6-3f99-4dd0-abb3-8a095e0771d5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:20.147868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-104df2e6-3f99-4dd0-abb3-8a095e0771d5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:20.156260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-104df2e6-3f99-4dd0-abb3-8a095e0771d5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:20.157549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-104df2e6-3f99-4dd0-abb3-8a095e0771d5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:20.164854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f5086de-6118-4445-b326-8cb301312a57 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:20.165542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f5086de-6118-4445-b326-8cb301312a57 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:20.166214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f5086de-6118-4445-b326-8cb301312a57 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:20.167183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f5086de-6118-4445-b326-8cb301312a57 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:20.167653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f5086de-6118-4445-b326-8cb301312a57 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:20.168089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f5086de-6118-4445-b326-8cb301312a57 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:20.653078 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-104df2e6-3f99-4dd0-abb3-8a095e0771d5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1464 microversion: 2.1 time: 0.537544 Sep 06 11:11:20.655746 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2217/4437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:20 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1464 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:20.738096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1f5086de-6118-4445-b326-8cb301312a57 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:20.756273 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1f5086de-6118-4445-b326-8cb301312a57 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.622576 Sep 06 11:11:20.757394 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2221/4438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:20 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:20.824136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-004d2945-08c3-4273-9edc-6bc9ebdf0345 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90fcf5c8b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:20.917944 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-004d2945-08c3-4273-9edc-6bc9ebdf0345 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.098116 Sep 06 11:11:20.923280 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2218/4439] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:20 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:21.684352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fc5749ef-b94c-415c-85c8-86be3b1a2ec4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:21.686973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fc5749ef-b94c-415c-85c8-86be3b1a2ec4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:21.695200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc5749ef-b94c-415c-85c8-86be3b1a2ec4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:21.696058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc5749ef-b94c-415c-85c8-86be3b1a2ec4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:21.696682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc5749ef-b94c-415c-85c8-86be3b1a2ec4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:21.697575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc5749ef-b94c-415c-85c8-86be3b1a2ec4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:21.698220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc5749ef-b94c-415c-85c8-86be3b1a2ec4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:21.698815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc5749ef-b94c-415c-85c8-86be3b1a2ec4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:21.792460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-add3ad24-8192-41ec-9b6b-01f4d049c3bf tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:21.792460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-add3ad24-8192-41ec-9b6b-01f4d049c3bf tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:21.812985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-add3ad24-8192-41ec-9b6b-01f4d049c3bf tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:21.813889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-add3ad24-8192-41ec-9b6b-01f4d049c3bf tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:21.815041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-add3ad24-8192-41ec-9b6b-01f4d049c3bf tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:21.816417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-add3ad24-8192-41ec-9b6b-01f4d049c3bf tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:21.819096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-add3ad24-8192-41ec-9b6b-01f4d049c3bf tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:21.819096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-add3ad24-8192-41ec-9b6b-01f4d049c3bf tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:21.911689 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fc5749ef-b94c-415c-85c8-86be3b1a2ec4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1649 microversion: 2.1 time: 0.231873 Sep 06 11:11:21.941733 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2222/4440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:21 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1649 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:21.957224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bd73fb2b-c813-4419-a8e6-ee658e37a126 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f32303a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:22.090399 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bd73fb2b-c813-4419-a8e6-ee658e37a126 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1454 microversion: 2.1 time: 0.147367 Sep 06 11:11:22.091891 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2223/4441] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:21 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:22.112338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c528a97a-1565-4ed3-ab50-ed0098876d26 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:22.113180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c528a97a-1565-4ed3-ab50-ed0098876d26 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:22.129399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c528a97a-1565-4ed3-ab50-ed0098876d26 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:22.130219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c528a97a-1565-4ed3-ab50-ed0098876d26 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:22.130981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c528a97a-1565-4ed3-ab50-ed0098876d26 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:22.132622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c528a97a-1565-4ed3-ab50-ed0098876d26 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:22.134537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c528a97a-1565-4ed3-ab50-ed0098876d26 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:22.134537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c528a97a-1565-4ed3-ab50-ed0098876d26 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:22.145678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-add3ad24-8192-41ec-9b6b-01f4d049c3bf tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:22.181916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:22.194360 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-add3ad24-8192-41ec-9b6b-01f4d049c3bf tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.414425 Sep 06 11:11:22.196799 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2219/4442] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:21 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:22.372159 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c528a97a-1565-4ed3-ab50-ed0098876d26 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1649 microversion: 2.1 time: 0.276562 Sep 06 11:11:22.392030 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2224/4443] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:22 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1649 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:22.400789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-199698a7-7ab1-44f6-9237-fbc2a334fd38 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:22.401813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-199698a7-7ab1-44f6-9237-fbc2a334fd38 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:22.411371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-199698a7-7ab1-44f6-9237-fbc2a334fd38 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:22.438865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-199698a7-7ab1-44f6-9237-fbc2a334fd38 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:22.438865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-199698a7-7ab1-44f6-9237-fbc2a334fd38 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:22.438865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-199698a7-7ab1-44f6-9237-fbc2a334fd38 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:22.438865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-199698a7-7ab1-44f6-9237-fbc2a334fd38 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:22.438865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-199698a7-7ab1-44f6-9237-fbc2a334fd38 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:22.620580 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-199698a7-7ab1-44f6-9237-fbc2a334fd38 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1649 microversion: 2.1 time: 0.215894 Sep 06 11:11:22.620580 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2220/4444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:22 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1649 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:22.638509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a82d7ce7-cbc9-4809-9534-46e98e691f2a tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:22.639736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a82d7ce7-cbc9-4809-9534-46e98e691f2a tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:22.648937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a82d7ce7-cbc9-4809-9534-46e98e691f2a tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:22.648937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a82d7ce7-cbc9-4809-9534-46e98e691f2a tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:22.649106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a82d7ce7-cbc9-4809-9534-46e98e691f2a tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:22.662685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a82d7ce7-cbc9-4809-9534-46e98e691f2a tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:22.662685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a82d7ce7-cbc9-4809-9534-46e98e691f2a tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:22.662685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a82d7ce7-cbc9-4809-9534-46e98e691f2a tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:22.679966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a82d7ce7-cbc9-4809-9534-46e98e691f2a tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:11:23.021581 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a82d7ce7-cbc9-4809-9534-46e98e691f2a tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 204 len: 0 microversion: 2.1 time: 0.387501 Sep 06 11:11:23.023107 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2225/4445] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:11:22 2022] DELETE /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:11:23.031760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1de5c316-abf6-4e00-a4a4-fc134974838d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:23.032522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1de5c316-abf6-4e00-a4a4-fc134974838d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:23.040082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de5c316-abf6-4e00-a4a4-fc134974838d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:23.040592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de5c316-abf6-4e00-a4a4-fc134974838d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:23.041224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de5c316-abf6-4e00-a4a4-fc134974838d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:23.041963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de5c316-abf6-4e00-a4a4-fc134974838d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:23.042495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de5c316-abf6-4e00-a4a4-fc134974838d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:23.043139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1de5c316-abf6-4e00-a4a4-fc134974838d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:23.115366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-afc0d42a-cf35-4ea6-b3cd-56cd8f4d5bab tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3194670>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:23.182691 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-afc0d42a-cf35-4ea6-b3cd-56cd8f4d5bab tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1463 microversion: 2.1 time: 0.072267 Sep 06 11:11:23.183637 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2226/4446] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:23 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1463 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:23.200385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-edfca30b-4b09-4fa4-b675-56a1acf354b6 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f8ade430>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:23.265518 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1de5c316-abf6-4e00-a4a4-fc134974838d tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1655 microversion: 2.1 time: 0.237448 Sep 06 11:11:23.284944 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2221/4447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:23 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1655 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:23.292648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-91dc27a9-e7da-407e-b89f-d13af035d87d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:23.293170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-91dc27a9-e7da-407e-b89f-d13af035d87d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:23.301524 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-edfca30b-4b09-4fa4-b675-56a1acf354b6 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 200 len: 1463 microversion: 2.1 time: 0.106971 Sep 06 11:11:23.301780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91dc27a9-e7da-407e-b89f-d13af035d87d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:23.302221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91dc27a9-e7da-407e-b89f-d13af035d87d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:23.303087 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2227/4448] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:23 2022] GET /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 1463 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:23.304795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91dc27a9-e7da-407e-b89f-d13af035d87d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:23.305702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91dc27a9-e7da-407e-b89f-d13af035d87d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:23.306189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91dc27a9-e7da-407e-b89f-d13af035d87d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:23.306749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91dc27a9-e7da-407e-b89f-d13af035d87d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:23.322275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aa643540-0850-4bb2-996e-ea0194b39201 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:23.323368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aa643540-0850-4bb2-996e-ea0194b39201 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:23.336116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa643540-0850-4bb2-996e-ea0194b39201 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:23.336618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa643540-0850-4bb2-996e-ea0194b39201 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:23.341010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa643540-0850-4bb2-996e-ea0194b39201 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:23.341010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa643540-0850-4bb2-996e-ea0194b39201 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:23.344206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa643540-0850-4bb2-996e-ea0194b39201 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:23.344687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa643540-0850-4bb2-996e-ea0194b39201 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:23.772045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-91dc27a9-e7da-407e-b89f-d13af035d87d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:23.782170 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-91dc27a9-e7da-407e-b89f-d13af035d87d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.496826 Sep 06 11:11:23.799678 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2222/4449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:23 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:23.812532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aa643540-0850-4bb2-996e-ea0194b39201 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:23.822961 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aa643540-0850-4bb2-996e-ea0194b39201 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597" status: 200 len: 1480 microversion: 2.1 time: 0.506552 Sep 06 11:11:23.822961 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2228/4450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:23 2022] GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597 => generated 1480 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:24.294109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2eb3760c-0250-4672-b601-3511ea6b0061 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:24.294718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2eb3760c-0250-4672-b601-3511ea6b0061 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:24.309563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb3760c-0250-4672-b601-3511ea6b0061 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:24.309563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb3760c-0250-4672-b601-3511ea6b0061 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:24.309563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb3760c-0250-4672-b601-3511ea6b0061 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:24.310002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb3760c-0250-4672-b601-3511ea6b0061 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:24.310688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb3760c-0250-4672-b601-3511ea6b0061 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:24.311449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb3760c-0250-4672-b601-3511ea6b0061 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:24.476295 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2eb3760c-0250-4672-b601-3511ea6b0061 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1655 microversion: 2.1 time: 0.185840 Sep 06 11:11:24.482164 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2223/4451] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:24 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1655 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:24.811731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-efc9f472-0960-4631-99d4-7e77f7c754be tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:24.813635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-efc9f472-0960-4631-99d4-7e77f7c754be tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:24.825449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efc9f472-0960-4631-99d4-7e77f7c754be tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:24.826219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efc9f472-0960-4631-99d4-7e77f7c754be tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:24.827284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efc9f472-0960-4631-99d4-7e77f7c754be tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:24.828482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efc9f472-0960-4631-99d4-7e77f7c754be tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:24.829207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efc9f472-0960-4631-99d4-7e77f7c754be tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:24.829945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efc9f472-0960-4631-99d4-7e77f7c754be tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:24.846368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b64d7719-0879-48b1-9435-43de1fce048f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:24.847479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b64d7719-0879-48b1-9435-43de1fce048f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:24.857428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b64d7719-0879-48b1-9435-43de1fce048f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:24.858667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b64d7719-0879-48b1-9435-43de1fce048f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:24.859390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b64d7719-0879-48b1-9435-43de1fce048f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:24.860288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b64d7719-0879-48b1-9435-43de1fce048f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:24.860762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b64d7719-0879-48b1-9435-43de1fce048f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:24.861199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b64d7719-0879-48b1-9435-43de1fce048f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:25.095447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-efc9f472-0960-4631-99d4-7e77f7c754be tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:25.104168 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-efc9f472-0960-4631-99d4-7e77f7c754be tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.300146 Sep 06 11:11:25.119406 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2229/4452] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:24 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:25.119812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b64d7719-0879-48b1-9435-43de1fce048f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:25.119812 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b64d7719-0879-48b1-9435-43de1fce048f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597" status: 200 len: 1467 microversion: 2.1 time: 0.276937 Sep 06 11:11:25.120194 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2224/4453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:24 2022] GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597 => generated 1467 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:25.150050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0abd51c2-b219-46eb-8ad6-6bbb199796e7 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1206239024"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:25.153729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0abd51c2-b219-46eb-8ad6-6bbb199796e7 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:25.163378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0abd51c2-b219-46eb-8ad6-6bbb199796e7 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:25.164098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0abd51c2-b219-46eb-8ad6-6bbb199796e7 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:25.164649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0abd51c2-b219-46eb-8ad6-6bbb199796e7 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:25.165480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0abd51c2-b219-46eb-8ad6-6bbb199796e7 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:25.166078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0abd51c2-b219-46eb-8ad6-6bbb199796e7 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:25.166614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0abd51c2-b219-46eb-8ad6-6bbb199796e7 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:25.842806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-0675c53a-2412-403e-a4cf-730953bcc027 req-27651357-9745-44ec-9256-0046eeedaf4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ee18dc-4a4f-49b5-a4be-b15c275e33eb", "name": "network-vif-deleted", "tag": "37685197-a7bd-4846-bc8e-04b59f5c612a"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:25.856014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0675c53a-2412-403e-a4cf-730953bcc027 req-27651357-9745-44ec-9256-0046eeedaf4c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:25.856949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0675c53a-2412-403e-a4cf-730953bcc027 req-27651357-9745-44ec-9256-0046eeedaf4c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:25.858551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0675c53a-2412-403e-a4cf-730953bcc027 req-27651357-9745-44ec-9256-0046eeedaf4c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:25.876510 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-0675c53a-2412-403e-a4cf-730953bcc027 req-27651357-9745-44ec-9256-0046eeedaf4c service nova] Creating event network-vif-deleted:37685197-a7bd-4846-bc8e-04b59f5c612a for instance 08ee18dc-4a4f-49b5-a4be-b15c275e33eb on nch2-master-1 Sep 06 11:11:25.888380 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-0675c53a-2412-403e-a4cf-730953bcc027 req-27651357-9745-44ec-9256-0046eeedaf4c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.468866 Sep 06 11:11:25.890037 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2225/4454] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:25.902719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-edb17217-49ae-4112-a5f0-366fddd627e5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:25.905037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-edb17217-49ae-4112-a5f0-366fddd627e5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:25.914521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edb17217-49ae-4112-a5f0-366fddd627e5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:25.915545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edb17217-49ae-4112-a5f0-366fddd627e5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:25.916264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edb17217-49ae-4112-a5f0-366fddd627e5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:25.917385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edb17217-49ae-4112-a5f0-366fddd627e5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:25.918110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edb17217-49ae-4112-a5f0-366fddd627e5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:25.918637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edb17217-49ae-4112-a5f0-366fddd627e5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:26.031808 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-edb17217-49ae-4112-a5f0-366fddd627e5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1449 microversion: 2.1 time: 0.139347 Sep 06 11:11:26.033083 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2226/4455] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:25 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1449 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:26.069383 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0abd51c2-b219-46eb-8ad6-6bbb199796e7 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "POST /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490/action" status: 202 len: 0 microversion: 2.1 time: 0.922575 Sep 06 11:11:26.079728 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2230/4456] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:11:25 2022] POST /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490/action => generated 0 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 06 11:11:26.088456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9d04907a-6da8-475d-9d4f-f228d9931519 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3e9ec10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:26.135243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-35cb8ff3-7ca9-439d-8dd6-5bd2be0b5f37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:26.137106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-35cb8ff3-7ca9-439d-8dd6-5bd2be0b5f37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:26.147400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35cb8ff3-7ca9-439d-8dd6-5bd2be0b5f37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:26.148174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35cb8ff3-7ca9-439d-8dd6-5bd2be0b5f37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:26.156308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35cb8ff3-7ca9-439d-8dd6-5bd2be0b5f37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:26.156308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35cb8ff3-7ca9-439d-8dd6-5bd2be0b5f37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:26.156308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35cb8ff3-7ca9-439d-8dd6-5bd2be0b5f37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:26.157008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-35cb8ff3-7ca9-439d-8dd6-5bd2be0b5f37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:26.184218 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9d04907a-6da8-475d-9d4f-f228d9931519 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.102838 Sep 06 11:11:26.185321 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2227/4457] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:26 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:26.481444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-35cb8ff3-7ca9-439d-8dd6-5bd2be0b5f37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:26.492547 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-35cb8ff3-7ca9-439d-8dd6-5bd2be0b5f37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.364171 Sep 06 11:11:26.493435 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2231/4458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:26 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:27.070258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8f34ff5f-e830-4994-b3d5-9951e57023c5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:27.072427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8f34ff5f-e830-4994-b3d5-9951e57023c5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:27.084821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f34ff5f-e830-4994-b3d5-9951e57023c5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:27.089555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f34ff5f-e830-4994-b3d5-9951e57023c5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:27.089555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f34ff5f-e830-4994-b3d5-9951e57023c5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:27.089555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f34ff5f-e830-4994-b3d5-9951e57023c5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:27.089555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f34ff5f-e830-4994-b3d5-9951e57023c5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:27.089555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f34ff5f-e830-4994-b3d5-9951e57023c5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:27.138785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f34ff5f-e830-4994-b3d5-9951e57023c5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:27.139157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f34ff5f-e830-4994-b3d5-9951e57023c5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:27.139696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f34ff5f-e830-4994-b3d5-9951e57023c5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:27.140183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-8f34ff5f-e830-4994-b3d5-9951e57023c5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lazy-loading 'fault' on Instance uuid 08ee18dc-4a4f-49b5-a4be-b15c275e33eb {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:11:27.205633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eec12217-88a6-4cd6-bf81-8d14429d6c22 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f344cee0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:27.216980 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8f34ff5f-e830-4994-b3d5-9951e57023c5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 200 len: 1454 microversion: 2.1 time: 0.158803 Sep 06 11:11:27.228151 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2228/4459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:27 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:27.305025 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eec12217-88a6-4cd6-bf81-8d14429d6c22 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.102391 Sep 06 11:11:27.305958 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2232/4460] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:27 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:27.429267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-8f802cb9-405e-442e-8f03-317948c61d9e req-54742aa7-8710-4d89-88fb-79fedd9a0340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d53b0f-bd9f-479e-948b-bbefbd0d8597", "name": "network-vif-unplugged", "status": "completed", "tag": "56dd829f-74c4-4912-9aac-6b30a6e3cd3e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:27.447379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8f802cb9-405e-442e-8f03-317948c61d9e req-54742aa7-8710-4d89-88fb-79fedd9a0340 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:27.447379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8f802cb9-405e-442e-8f03-317948c61d9e req-54742aa7-8710-4d89-88fb-79fedd9a0340 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:27.447379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8f802cb9-405e-442e-8f03-317948c61d9e req-54742aa7-8710-4d89-88fb-79fedd9a0340 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:27.463218 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-8f802cb9-405e-442e-8f03-317948c61d9e req-54742aa7-8710-4d89-88fb-79fedd9a0340 service nova] Creating event network-vif-unplugged:56dd829f-74c4-4912-9aac-6b30a6e3cd3e for instance 77d53b0f-bd9f-479e-948b-bbefbd0d8597 on nch1-master-1 Sep 06 11:11:27.470774 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-8f802cb9-405e-442e-8f03-317948c61d9e req-54742aa7-8710-4d89-88fb-79fedd9a0340 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045846 Sep 06 11:11:27.471759 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2229/4461] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:27.518482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ca20f88d-9644-4f1c-b109-0965d7f0e839 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:27.519153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ca20f88d-9644-4f1c-b109-0965d7f0e839 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:27.526531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca20f88d-9644-4f1c-b109-0965d7f0e839 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:27.527059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca20f88d-9644-4f1c-b109-0965d7f0e839 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:27.527545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca20f88d-9644-4f1c-b109-0965d7f0e839 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:27.528258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca20f88d-9644-4f1c-b109-0965d7f0e839 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:27.528944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca20f88d-9644-4f1c-b109-0965d7f0e839 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:27.529935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca20f88d-9644-4f1c-b109-0965d7f0e839 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:27.698454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ca20f88d-9644-4f1c-b109-0965d7f0e839 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:27.707741 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ca20f88d-9644-4f1c-b109-0965d7f0e839 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.193537 Sep 06 11:11:27.708331 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2233/4462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:27 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:28.243797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5fb4c905-09a4-406d-8c3b-33e249690386 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:28.245362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5fb4c905-09a4-406d-8c3b-33e249690386 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 08ee18dc-4a4f-49b5-a4be-b15c275e33eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:28.254966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fb4c905-09a4-406d-8c3b-33e249690386 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:28.255523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fb4c905-09a4-406d-8c3b-33e249690386 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:28.255981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fb4c905-09a4-406d-8c3b-33e249690386 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:28.258941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fb4c905-09a4-406d-8c3b-33e249690386 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:28.258941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fb4c905-09a4-406d-8c3b-33e249690386 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:28.258941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fb4c905-09a4-406d-8c3b-33e249690386 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:28.274388 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-5fb4c905-09a4-406d-8c3b-33e249690386 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] HTTP exception thrown: Instance 08ee18dc-4a4f-49b5-a4be-b15c275e33eb could not be found. Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5fb4c905-09a4-406d-8c3b-33e249690386 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Request method failure captured: Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb HTTP/1.1 Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyqjLxPnWAHLpxjBWga0AVaeScSyZ1hAVklglBUuwyZ-v-GYukCcRS3VPsbU3tpaB8tujhOp-f99UHMJGlCaOBKl4GVw9RY0eNKI8LxcYosfQ6ixQhAPEyTtdWDEDyT_CoCjIdtQKRFf7kYvS-yP3bxSRMh64586550AW_XDRflULFg Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 5da257e162aa4109a0bc914b2b4e13ed Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestServerMultinode-743134686 Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5da257e162aa4109a0bc914b2b4e13ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5da257e162aa4109a0bc914b2b4e13ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5da257e162aa4109a0bc914b2b4e13ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5da257e162aa4109a0bc914b2b4e13ed"}]}] Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestServerMultinode-743134686 Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 5da257e162aa4109a0bc914b2b4e13ed Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestServerMultinode-743134686 Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestServerMultinode-743134686-project-admin Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 094361c60a54434fb90e605c040800ac Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestServerMultinode-743134686-project-admin Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 08ee18dc-4a4f-49b5-a4be-b15c275e33eb could not be found. Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '08ee18dc-4a4f-49b5-a4be-b15c275e33eb'} Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08ee18dc-4a4f-49b5-a4be-b15c275e33eb could not be found. Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08ee18dc-4a4f-49b5-a4be-b15c275e33eb could not be found. Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:11:28.276645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:28.284185 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:11:28.284185 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:11:28.284185 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:11:28.284185 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:11:28.284185 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:11:28.284185 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08ee18dc-4a4f-49b5-a4be-b15c275e33eb could not be found. Sep 06 11:11:28.284185 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:28.284185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5fb4c905-09a4-406d-8c3b-33e249690386 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Returning 404 to user: Instance 08ee18dc-4a4f-49b5-a4be-b15c275e33eb could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:11:28.284185 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5fb4c905-09a4-406d-8c3b-33e249690386 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb" status: 404 len: 111 microversion: 2.1 time: 0.039048 Sep 06 11:11:28.284185 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2230/4463] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:28 2022] GET /compute/v2.1/servers/08ee18dc-4a4f-49b5-a4be-b15c275e33eb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:11:28.291901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0cf7a7e7-15de-433a-8e20-8cc5c2275844 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:28.292471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0cf7a7e7-15de-433a-8e20-8cc5c2275844 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:28.300637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cf7a7e7-15de-433a-8e20-8cc5c2275844 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:28.304828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cf7a7e7-15de-433a-8e20-8cc5c2275844 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:28.304828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cf7a7e7-15de-433a-8e20-8cc5c2275844 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:28.304828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cf7a7e7-15de-433a-8e20-8cc5c2275844 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:28.304828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cf7a7e7-15de-433a-8e20-8cc5c2275844 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:28.304828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cf7a7e7-15de-433a-8e20-8cc5c2275844 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:28.333909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e2113bfb-d3e9-4903-a5aa-aef0bfe342fb tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f8767700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:28.340952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0cf7a7e7-15de-433a-8e20-8cc5c2275844 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:11:28.443083 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e2113bfb-d3e9-4903-a5aa-aef0bfe342fb tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.120077 Sep 06 11:11:28.450367 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2231/4464] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:28 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:28.734874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-96ff8442-59b1-4de8-873c-d9d72b582178 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:28.736217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-96ff8442-59b1-4de8-873c-d9d72b582178 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:28.747813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96ff8442-59b1-4de8-873c-d9d72b582178 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:28.748943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96ff8442-59b1-4de8-873c-d9d72b582178 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:28.750259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96ff8442-59b1-4de8-873c-d9d72b582178 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:28.751221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96ff8442-59b1-4de8-873c-d9d72b582178 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:28.752315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96ff8442-59b1-4de8-873c-d9d72b582178 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:28.753005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96ff8442-59b1-4de8-873c-d9d72b582178 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:28.845691 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0cf7a7e7-15de-433a-8e20-8cc5c2275844 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 204 len: 0 microversion: 2.1 time: 0.558589 Sep 06 11:11:28.845691 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2234/4465] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:11:28 2022] DELETE /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:11:28.859254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9894c506-dc43-4e47-9c75-5a9657972dd7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:28.859965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9894c506-dc43-4e47-9c75-5a9657972dd7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:28.868962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9894c506-dc43-4e47-9c75-5a9657972dd7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:28.869474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9894c506-dc43-4e47-9c75-5a9657972dd7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:28.869924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9894c506-dc43-4e47-9c75-5a9657972dd7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:28.870685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9894c506-dc43-4e47-9c75-5a9657972dd7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:28.871182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9894c506-dc43-4e47-9c75-5a9657972dd7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:28.871659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9894c506-dc43-4e47-9c75-5a9657972dd7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:28.941391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-96ff8442-59b1-4de8-873c-d9d72b582178 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:28.949850 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-96ff8442-59b1-4de8-873c-d9d72b582178 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.220366 Sep 06 11:11:28.950457 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2232/4466] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:28 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:29.048652 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9894c506-dc43-4e47-9c75-5a9657972dd7 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1655 microversion: 2.1 time: 0.196313 Sep 06 11:11:29.049623 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2235/4467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:28 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1655 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:29.465237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d94ad94b-82f6-4e53-a2a2-1e281de66d67 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f8544c10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:29.516673 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d94ad94b-82f6-4e53-a2a2-1e281de66d67 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.055300 Sep 06 11:11:29.517410 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2233/4468] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:29 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:29.975222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1a3849de-a114-4acd-baab-e4c92f47edc5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:29.975598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1a3849de-a114-4acd-baab-e4c92f47edc5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:29.978480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:29.983973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a3849de-a114-4acd-baab-e4c92f47edc5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:29.984466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a3849de-a114-4acd-baab-e4c92f47edc5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:29.985324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a3849de-a114-4acd-baab-e4c92f47edc5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:29.986054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a3849de-a114-4acd-baab-e4c92f47edc5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:29.986608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a3849de-a114-4acd-baab-e4c92f47edc5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:29.986952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a3849de-a114-4acd-baab-e4c92f47edc5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:30.073836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2e107d01-03f2-4828-9467-08054949328c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:30.074866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2e107d01-03f2-4828-9467-08054949328c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:30.085004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e107d01-03f2-4828-9467-08054949328c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:30.086050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e107d01-03f2-4828-9467-08054949328c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:30.092480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e107d01-03f2-4828-9467-08054949328c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:30.092480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e107d01-03f2-4828-9467-08054949328c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:30.092480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e107d01-03f2-4828-9467-08054949328c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:30.092480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e107d01-03f2-4828-9467-08054949328c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:30.185273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1a3849de-a114-4acd-baab-e4c92f47edc5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:30.193756 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1a3849de-a114-4acd-baab-e4c92f47edc5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.222992 Sep 06 11:11:30.195047 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2236/4469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:29 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:30.251774 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2e107d01-03f2-4828-9467-08054949328c tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1655 microversion: 2.1 time: 0.181272 Sep 06 11:11:30.252361 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2234/4470] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:30 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1655 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:30.532768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-13998d6b-b084-4773-92d3-854d11769255 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f39fc5e0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:30.597960 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-13998d6b-b084-4773-92d3-854d11769255 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.053385 Sep 06 11:11:30.597960 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2237/4471] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:30 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:31.222162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3bf385d1-6b47-40cb-a8db-5c9d4296ce73 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:31.223927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3bf385d1-6b47-40cb-a8db-5c9d4296ce73 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:31.234144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bf385d1-6b47-40cb-a8db-5c9d4296ce73 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:31.234959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bf385d1-6b47-40cb-a8db-5c9d4296ce73 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:31.236381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bf385d1-6b47-40cb-a8db-5c9d4296ce73 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:31.237896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bf385d1-6b47-40cb-a8db-5c9d4296ce73 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:31.238843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bf385d1-6b47-40cb-a8db-5c9d4296ce73 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:31.239513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3bf385d1-6b47-40cb-a8db-5c9d4296ce73 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:31.255188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-7e741379-7279-4061-98f8-d60f8441cdeb req-d0d2ad11-7f60-4e96-affe-0ab581e99eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea5bb59-464b-4701-8ead-642d813f9cc8", "name": "network-vif-deleted", "tag": "3e3272e1-1043-4c9b-b236-a9be6435eaf6"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:31.272920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7e741379-7279-4061-98f8-d60f8441cdeb req-d0d2ad11-7f60-4e96-affe-0ab581e99eea service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:31.273416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7e741379-7279-4061-98f8-d60f8441cdeb req-d0d2ad11-7f60-4e96-affe-0ab581e99eea service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:31.273857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7e741379-7279-4061-98f8-d60f8441cdeb req-d0d2ad11-7f60-4e96-affe-0ab581e99eea service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:31.286818 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-7e741379-7279-4061-98f8-d60f8441cdeb req-d0d2ad11-7f60-4e96-affe-0ab581e99eea service nova] Creating event network-vif-deleted:3e3272e1-1043-4c9b-b236-a9be6435eaf6 for instance 9ea5bb59-464b-4701-8ead-642d813f9cc8 on nch1-master-1 Sep 06 11:11:31.295746 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-7e741379-7279-4061-98f8-d60f8441cdeb req-d0d2ad11-7f60-4e96-affe-0ab581e99eea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040848 Sep 06 11:11:31.295746 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2238/4472] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:11:31.298448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f81854da-776c-44a6-b2c8-04adb7373b74 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:31.299192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f81854da-776c-44a6-b2c8-04adb7373b74 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:31.306169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f81854da-776c-44a6-b2c8-04adb7373b74 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:31.306910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f81854da-776c-44a6-b2c8-04adb7373b74 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:31.308109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f81854da-776c-44a6-b2c8-04adb7373b74 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:31.308235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f81854da-776c-44a6-b2c8-04adb7373b74 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:31.308618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f81854da-776c-44a6-b2c8-04adb7373b74 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:31.309058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f81854da-776c-44a6-b2c8-04adb7373b74 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:31.415431 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f81854da-776c-44a6-b2c8-04adb7373b74 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1613 microversion: 2.1 time: 0.121146 Sep 06 11:11:31.416133 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2239/4473] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:31 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1613 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:31.448434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3bf385d1-6b47-40cb-a8db-5c9d4296ce73 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:31.456345 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3bf385d1-6b47-40cb-a8db-5c9d4296ce73 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.241936 Sep 06 11:11:31.456934 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2235/4474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:31 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:31.598650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-200da46b-f29a-4c8a-b1e4-639c6b5433ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f31943a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:31.675660 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-200da46b-f29a-4c8a-b1e4-639c6b5433ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.078965 Sep 06 11:11:31.675660 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2240/4475] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:31 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:32.441413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8eb7e7ec-93f4-4793-9e20-ee6f2193a7a5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:32.442916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8eb7e7ec-93f4-4793-9e20-ee6f2193a7a5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:32.450214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eb7e7ec-93f4-4793-9e20-ee6f2193a7a5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:32.450712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eb7e7ec-93f4-4793-9e20-ee6f2193a7a5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:32.451384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eb7e7ec-93f4-4793-9e20-ee6f2193a7a5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:32.452157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eb7e7ec-93f4-4793-9e20-ee6f2193a7a5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:32.453113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eb7e7ec-93f4-4793-9e20-ee6f2193a7a5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:32.453548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eb7e7ec-93f4-4793-9e20-ee6f2193a7a5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:32.481827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76d48268-e50a-4132-9f1a-b8749aa26424 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:32.483314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-76d48268-e50a-4132-9f1a-b8749aa26424 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:32.491262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76d48268-e50a-4132-9f1a-b8749aa26424 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:32.491758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76d48268-e50a-4132-9f1a-b8749aa26424 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:32.492834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76d48268-e50a-4132-9f1a-b8749aa26424 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:32.493674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76d48268-e50a-4132-9f1a-b8749aa26424 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:32.494138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76d48268-e50a-4132-9f1a-b8749aa26424 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:32.494288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eb7e7ec-93f4-4793-9e20-ee6f2193a7a5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:32.494568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76d48268-e50a-4132-9f1a-b8749aa26424 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:32.494759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eb7e7ec-93f4-4793-9e20-ee6f2193a7a5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:32.495233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8eb7e7ec-93f4-4793-9e20-ee6f2193a7a5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:32.495697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-8eb7e7ec-93f4-4793-9e20-ee6f2193a7a5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lazy-loading 'fault' on Instance uuid 9ea5bb59-464b-4701-8ead-642d813f9cc8 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:11:32.499487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:32.552220 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8eb7e7ec-93f4-4793-9e20-ee6f2193a7a5 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 200 len: 1453 microversion: 2.1 time: 0.114829 Sep 06 11:11:32.569340 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2236/4476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:32 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:32.651489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-76d48268-e50a-4132-9f1a-b8749aa26424 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:32.659748 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-76d48268-e50a-4132-9f1a-b8749aa26424 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.181919 Sep 06 11:11:32.675643 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2241/4477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:32 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:32.694898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c6a0bb83-5415-4d98-bedd-d14ec3fc5931 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3757a60>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:32.761177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c6a0bb83-5415-4d98-bedd-d14ec3fc5931 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.070216 Sep 06 11:11:32.770674 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2237/4478] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:32 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:33.475297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-8e58f20c-e16e-4a18-9667-67a4de2e355b req-4b7d73f7-0af0-49d1-b88a-468ec9ff47ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016c8ecc-3457-4204-ba5b-3e06970ac490", "name": "network-vif-plugged", "status": "completed", "tag": "0a339213-93da-46ad-badf-47ea616965d5"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:33.508192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8e58f20c-e16e-4a18-9667-67a4de2e355b req-4b7d73f7-0af0-49d1-b88a-468ec9ff47ed service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:33.509574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8e58f20c-e16e-4a18-9667-67a4de2e355b req-4b7d73f7-0af0-49d1-b88a-468ec9ff47ed service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:33.510135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8e58f20c-e16e-4a18-9667-67a4de2e355b req-4b7d73f7-0af0-49d1-b88a-468ec9ff47ed service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:33.516045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:33.524414 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-8e58f20c-e16e-4a18-9667-67a4de2e355b req-4b7d73f7-0af0-49d1-b88a-468ec9ff47ed service nova] Creating event network-vif-plugged:0a339213-93da-46ad-badf-47ea616965d5 for instance 016c8ecc-3457-4204-ba5b-3e06970ac490 on nch1-master-1 Sep 06 11:11:33.529682 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-8e58f20c-e16e-4a18-9667-67a4de2e355b req-4b7d73f7-0af0-49d1-b88a-468ec9ff47ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060177 Sep 06 11:11:33.536130 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2242/4479] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:33.580848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b0bed95f-7a97-4f10-bc83-dc1d27f0bca4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:33.581771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b0bed95f-7a97-4f10-bc83-dc1d27f0bca4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] [instance: 9ea5bb59-464b-4701-8ead-642d813f9cc8] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:33.603999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0bed95f-7a97-4f10-bc83-dc1d27f0bca4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:33.605119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0bed95f-7a97-4f10-bc83-dc1d27f0bca4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:33.608335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0bed95f-7a97-4f10-bc83-dc1d27f0bca4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:33.610762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0bed95f-7a97-4f10-bc83-dc1d27f0bca4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:33.612165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0bed95f-7a97-4f10-bc83-dc1d27f0bca4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:33.614772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0bed95f-7a97-4f10-bc83-dc1d27f0bca4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:33.667422 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-b0bed95f-7a97-4f10-bc83-dc1d27f0bca4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] HTTP exception thrown: Instance 9ea5bb59-464b-4701-8ead-642d813f9cc8 could not be found. Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b0bed95f-7a97-4f10-bc83-dc1d27f0bca4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Request method failure captured: Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 HTTP/1.1 Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyqjLxPnWAHLpxjBWga0AVaeScSyZ1hAVklglBUuwyZ-v-GYukCcRS3VPsbU3tpaB8tujhOp-f99UHMJGlCaOBKl4GVw9RY0eNKI8LxcYosfQ6ixQhAPEyTtdWDEDyT_CoCjIdtQKRFf7kYvS-yP3bxSRMh64586550AW_XDRflULFg Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 5da257e162aa4109a0bc914b2b4e13ed Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestServerMultinode-743134686 Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5da257e162aa4109a0bc914b2b4e13ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5da257e162aa4109a0bc914b2b4e13ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5da257e162aa4109a0bc914b2b4e13ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5da257e162aa4109a0bc914b2b4e13ed"}]}] Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestServerMultinode-743134686 Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 5da257e162aa4109a0bc914b2b4e13ed Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestServerMultinode-743134686 Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestServerMultinode-743134686-project-admin Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 094361c60a54434fb90e605c040800ac Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestServerMultinode-743134686-project-admin Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 9ea5bb59-464b-4701-8ead-642d813f9cc8 could not be found. Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '9ea5bb59-464b-4701-8ead-642d813f9cc8'} Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ea5bb59-464b-4701-8ead-642d813f9cc8 could not be found. Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ea5bb59-464b-4701-8ead-642d813f9cc8 could not be found. Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:11:33.670905 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:33.675461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:11:33.675461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:11:33.675461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:11:33.675461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:11:33.675461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:11:33.675461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ea5bb59-464b-4701-8ead-642d813f9cc8 could not be found. Sep 06 11:11:33.675461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:11:33.677444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b0bed95f-7a97-4f10-bc83-dc1d27f0bca4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] Returning 404 to user: Instance 9ea5bb59-464b-4701-8ead-642d813f9cc8 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:11:33.678694 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b0bed95f-7a97-4f10-bc83-dc1d27f0bca4 tempest-TestServerMultinode-743134686 tempest-TestServerMultinode-743134686-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8" status: 404 len: 111 microversion: 2.1 time: 0.104188 Sep 06 11:11:33.683899 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2238/4480] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:33 2022] GET /compute/v2.1/servers/9ea5bb59-464b-4701-8ead-642d813f9cc8 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:11:33.710251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a852a900-e43b-44a7-aca1-2ea66c2107f6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:33.711053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a852a900-e43b-44a7-aca1-2ea66c2107f6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:33.722353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a852a900-e43b-44a7-aca1-2ea66c2107f6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:33.723337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a852a900-e43b-44a7-aca1-2ea66c2107f6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:33.723964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a852a900-e43b-44a7-aca1-2ea66c2107f6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:33.724869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a852a900-e43b-44a7-aca1-2ea66c2107f6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:33.725511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a852a900-e43b-44a7-aca1-2ea66c2107f6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:33.728593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a852a900-e43b-44a7-aca1-2ea66c2107f6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:33.778721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-65da9eff-a89c-40bc-a59e-731faa02eeb4 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3757a60>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:33.835363 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-65da9eff-a89c-40bc-a59e-731faa02eeb4 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.061387 Sep 06 11:11:33.845059 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2239/4481] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:33 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:34.016208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a852a900-e43b-44a7-aca1-2ea66c2107f6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:34.025445 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a852a900-e43b-44a7-aca1-2ea66c2107f6 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.333194 Sep 06 11:11:34.030487 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2243/4482] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:33 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:34.852507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d9dfcf5f-0f41-444c-b546-b95f9538cfad tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f36cda60>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:34.922525 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d9dfcf5f-0f41-444c-b546-b95f9538cfad tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.074772 Sep 06 11:11:34.923819 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2240/4483] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:34 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:35.056139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-be21b60e-8958-4a8e-a7ce-5a82ced14e7e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:35.056821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-be21b60e-8958-4a8e-a7ce-5a82ced14e7e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:35.076744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be21b60e-8958-4a8e-a7ce-5a82ced14e7e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:35.077693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be21b60e-8958-4a8e-a7ce-5a82ced14e7e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:35.078463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be21b60e-8958-4a8e-a7ce-5a82ced14e7e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:35.079422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be21b60e-8958-4a8e-a7ce-5a82ced14e7e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:35.081340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be21b60e-8958-4a8e-a7ce-5a82ced14e7e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:35.082009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be21b60e-8958-4a8e-a7ce-5a82ced14e7e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:35.312065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-be21b60e-8958-4a8e-a7ce-5a82ced14e7e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:35.321778 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-be21b60e-8958-4a8e-a7ce-5a82ced14e7e tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.270923 Sep 06 11:11:35.325318 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2244/4484] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:35 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:35.940943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-51dff9af-fd4c-4983-a6d3-aee8815c4084 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f36cd160>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:36.022306 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-51dff9af-fd4c-4983-a6d3-aee8815c4084 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.081441 Sep 06 11:11:36.022306 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2241/4485] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:35 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:36.353283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e84b3f4e-2005-456e-b3b6-45f383f49444 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:36.354812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e84b3f4e-2005-456e-b3b6-45f383f49444 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:36.369951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e84b3f4e-2005-456e-b3b6-45f383f49444 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:36.371082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e84b3f4e-2005-456e-b3b6-45f383f49444 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:36.371737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e84b3f4e-2005-456e-b3b6-45f383f49444 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:36.376100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e84b3f4e-2005-456e-b3b6-45f383f49444 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:36.376100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e84b3f4e-2005-456e-b3b6-45f383f49444 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:36.376100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e84b3f4e-2005-456e-b3b6-45f383f49444 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:36.754413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e84b3f4e-2005-456e-b3b6-45f383f49444 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:36.754413 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e84b3f4e-2005-456e-b3b6-45f383f49444 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.301570 Sep 06 11:11:36.754413 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2245/4486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:36 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:37.037919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6b57101a-4b06-418f-8fc1-e877a2d0dcfb tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f85448b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:37.117912 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6b57101a-4b06-418f-8fc1-e877a2d0dcfb tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.083959 Sep 06 11:11:37.119080 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2242/4487] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:37 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:37.674849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-88c22704-91fb-417a-bd3f-52e4f3c9ee1c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:37.675736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-88c22704-91fb-417a-bd3f-52e4f3c9ee1c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:37.695559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88c22704-91fb-417a-bd3f-52e4f3c9ee1c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:37.698700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88c22704-91fb-417a-bd3f-52e4f3c9ee1c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:37.699463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88c22704-91fb-417a-bd3f-52e4f3c9ee1c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:37.709821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a3210df-d0c2-4ecf-8e6c-945d63b3906c"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:37.712763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:37.717542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88c22704-91fb-417a-bd3f-52e4f3c9ee1c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:37.718532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88c22704-91fb-417a-bd3f-52e4f3c9ee1c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:37.720968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88c22704-91fb-417a-bd3f-52e4f3c9ee1c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:37.740128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:37.742955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:37.743608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:37.745037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:37.752470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:37.754122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:38.042589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-88c22704-91fb-417a-bd3f-52e4f3c9ee1c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:38.053731 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-88c22704-91fb-417a-bd3f-52e4f3c9ee1c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.383975 Sep 06 11:11:38.063193 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2246/4488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:37 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:38.140859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81444a68-c89e-4121-bd40-0970307fa7ff tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3148b80>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:38.264443 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-81444a68-c89e-4121-bd40-0970307fa7ff tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.127518 Sep 06 11:11:38.265310 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2247/4489] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:38 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:38.951621 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.245597 Sep 06 11:11:38.952897 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2243/4490] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:11:37 2022] POST /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-volume_attachments => generated 194 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:39.083431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-10df43f5-6828-48ea-9fdc-86f39e70f7b5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:39.084606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-10df43f5-6828-48ea-9fdc-86f39e70f7b5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:39.097896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10df43f5-6828-48ea-9fdc-86f39e70f7b5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:39.098543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10df43f5-6828-48ea-9fdc-86f39e70f7b5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:39.099002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10df43f5-6828-48ea-9fdc-86f39e70f7b5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:39.101300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10df43f5-6828-48ea-9fdc-86f39e70f7b5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:39.102492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10df43f5-6828-48ea-9fdc-86f39e70f7b5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:39.103984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10df43f5-6828-48ea-9fdc-86f39e70f7b5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:39.283044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e99f3c9a-1d49-43ea-a887-cb950329a9b0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f376b160>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:39.404934 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e99f3c9a-1d49-43ea-a887-cb950329a9b0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.117406 Sep 06 11:11:39.405603 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2244/4491] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:39 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:39.416930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-10df43f5-6828-48ea-9fdc-86f39e70f7b5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:39.429424 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-10df43f5-6828-48ea-9fdc-86f39e70f7b5 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.353731 Sep 06 11:11:39.430613 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2248/4492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:39 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:40.425163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0bf36764-ec9f-421a-8f15-18a7c198111f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90fcf5e430>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:40.455743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a217f622-9342-4128-8bf8-369cfe2a7c4a tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:40.457645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a217f622-9342-4128-8bf8-369cfe2a7c4a tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:40.475219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a217f622-9342-4128-8bf8-369cfe2a7c4a tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:40.478047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a217f622-9342-4128-8bf8-369cfe2a7c4a tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:40.479883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a217f622-9342-4128-8bf8-369cfe2a7c4a tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:40.481591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a217f622-9342-4128-8bf8-369cfe2a7c4a tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:40.486804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a217f622-9342-4128-8bf8-369cfe2a7c4a tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:40.487530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a217f622-9342-4128-8bf8-369cfe2a7c4a tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:40.562347 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0bf36764-ec9f-421a-8f15-18a7c198111f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.141967 Sep 06 11:11:40.576994 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2245/4493] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:40 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:40.817306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a217f622-9342-4128-8bf8-369cfe2a7c4a tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:40.854252 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a217f622-9342-4128-8bf8-369cfe2a7c4a tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.403471 Sep 06 11:11:40.855799 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2249/4494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:40 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:41.583297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fb7d1888-3dc8-4834-9757-0a7628ed5b85 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3733ca0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:41.664498 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fb7d1888-3dc8-4834-9757-0a7628ed5b85 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.086770 Sep 06 11:11:41.666310 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2246/4495] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:41 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:41.887568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2909ae7a-e64e-4522-bf85-0791594ec13c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:41.888506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2909ae7a-e64e-4522-bf85-0791594ec13c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:41.906622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2909ae7a-e64e-4522-bf85-0791594ec13c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:41.909740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2909ae7a-e64e-4522-bf85-0791594ec13c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:41.910503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2909ae7a-e64e-4522-bf85-0791594ec13c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:41.911530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2909ae7a-e64e-4522-bf85-0791594ec13c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:41.915982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2909ae7a-e64e-4522-bf85-0791594ec13c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:41.916692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2909ae7a-e64e-4522-bf85-0791594ec13c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:42.320673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2909ae7a-e64e-4522-bf85-0791594ec13c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:42.333279 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2909ae7a-e64e-4522-bf85-0791594ec13c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.451120 Sep 06 11:11:42.334113 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2250/4496] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:41 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:42.688438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cae3f86a-9693-4b6c-8892-cf1b7f7a09d8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f8597a60>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:42.787764 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cae3f86a-9693-4b6c-8892-cf1b7f7a09d8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.107761 Sep 06 11:11:42.791826 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2247/4497] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:42 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:43.367456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4676d076-2ae2-4f52-8fdb-f8b86ee200e7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:43.367456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4676d076-2ae2-4f52-8fdb-f8b86ee200e7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:43.384705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4676d076-2ae2-4f52-8fdb-f8b86ee200e7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:43.392616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4676d076-2ae2-4f52-8fdb-f8b86ee200e7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:43.393091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4676d076-2ae2-4f52-8fdb-f8b86ee200e7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:43.393844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4676d076-2ae2-4f52-8fdb-f8b86ee200e7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:43.394319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4676d076-2ae2-4f52-8fdb-f8b86ee200e7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:43.394751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4676d076-2ae2-4f52-8fdb-f8b86ee200e7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:43.686837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4676d076-2ae2-4f52-8fdb-f8b86ee200e7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:43.701970 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4676d076-2ae2-4f52-8fdb-f8b86ee200e7 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.347998 Sep 06 11:11:43.712137 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2251/4498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:43 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:43.805360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-806208b6-ffb5-4c37-8631-62640040e60f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f369b280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:43.896513 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-806208b6-ffb5-4c37-8631-62640040e60f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.095717 Sep 06 11:11:43.904292 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2248/4499] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:43 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:44.742451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3c9918d8-8e15-4d5c-84f2-73212bfaf552 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:44.743151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3c9918d8-8e15-4d5c-84f2-73212bfaf552 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:44.763552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c9918d8-8e15-4d5c-84f2-73212bfaf552 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:44.764069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c9918d8-8e15-4d5c-84f2-73212bfaf552 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:44.764551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c9918d8-8e15-4d5c-84f2-73212bfaf552 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:44.765545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c9918d8-8e15-4d5c-84f2-73212bfaf552 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:44.766305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c9918d8-8e15-4d5c-84f2-73212bfaf552 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:44.767405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c9918d8-8e15-4d5c-84f2-73212bfaf552 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:44.913630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ee617c6e-d6b0-497f-9c65-02a1ddd09f6a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f8e0ef70>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:44.988849 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ee617c6e-d6b0-497f-9c65-02a1ddd09f6a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.079326 Sep 06 11:11:44.990053 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2249/4500] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:44 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:45.205496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3c9918d8-8e15-4d5c-84f2-73212bfaf552 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:45.228894 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3c9918d8-8e15-4d5c-84f2-73212bfaf552 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.490819 Sep 06 11:11:45.230682 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2252/4501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:44 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:45.974732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8aec6d94-899c-44d1-982a-c565f140b925 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:45.977496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8aec6d94-899c-44d1-982a-c565f140b925 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:46.008543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3fe3b407-5b48-4f28-8e87-4509224f3345 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f344c8b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:46.010495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aec6d94-899c-44d1-982a-c565f140b925 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:46.011078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aec6d94-899c-44d1-982a-c565f140b925 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:46.011628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aec6d94-899c-44d1-982a-c565f140b925 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:46.012397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aec6d94-899c-44d1-982a-c565f140b925 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:46.012904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aec6d94-899c-44d1-982a-c565f140b925 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:46.013350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8aec6d94-899c-44d1-982a-c565f140b925 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:46.072385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-8aec6d94-899c-44d1-982a-c565f140b925 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lazy-loading 'flavor' on Instance uuid 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:11:46.100655 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3fe3b407-5b48-4f28-8e87-4509224f3345 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.098846 Sep 06 11:11:46.102705 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2253/4502] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:45 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:46.261636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5a4a5296-7cc7-40bd-9f37-c49dd6269576 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:46.262836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5a4a5296-7cc7-40bd-9f37-c49dd6269576 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:46.301963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a4a5296-7cc7-40bd-9f37-c49dd6269576 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:46.311830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a4a5296-7cc7-40bd-9f37-c49dd6269576 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:46.312444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a4a5296-7cc7-40bd-9f37-c49dd6269576 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:46.313945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a4a5296-7cc7-40bd-9f37-c49dd6269576 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:46.319276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a4a5296-7cc7-40bd-9f37-c49dd6269576 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:46.319276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a4a5296-7cc7-40bd-9f37-c49dd6269576 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:46.567117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5a4a5296-7cc7-40bd-9f37-c49dd6269576 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:46.580228 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5a4a5296-7cc7-40bd-9f37-c49dd6269576 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.326098 Sep 06 11:11:46.582228 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2254/4503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:46 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:46.874551 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8aec6d94-899c-44d1-982a-c565f140b925 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/action" status: 200 len: 32 microversion: 2.1 time: 0.903673 Sep 06 11:11:46.885047 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2250/4504] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:11:45 2022] POST /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/action => generated 32 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:11:46.891823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-738d1fc0-5b7b-4afe-9326-a7b3aefcd04c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:46.892571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-738d1fc0-5b7b-4afe-9326-a7b3aefcd04c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:46.911210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-738d1fc0-5b7b-4afe-9326-a7b3aefcd04c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:46.911708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-738d1fc0-5b7b-4afe-9326-a7b3aefcd04c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:46.912163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-738d1fc0-5b7b-4afe-9326-a7b3aefcd04c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:46.912886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-738d1fc0-5b7b-4afe-9326-a7b3aefcd04c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:46.927470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-738d1fc0-5b7b-4afe-9326-a7b3aefcd04c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:46.927470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-738d1fc0-5b7b-4afe-9326-a7b3aefcd04c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:47.120744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2deaabeb-c9a3-4dd3-b031-d826d5678211 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f36cb3a0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:47.200023 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2deaabeb-c9a3-4dd3-b031-d826d5678211 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.086010 Sep 06 11:11:47.205297 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2251/4505] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:47 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:47.370264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-738d1fc0-5b7b-4afe-9326-a7b3aefcd04c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:47.380655 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-738d1fc0-5b7b-4afe-9326-a7b3aefcd04c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1736 microversion: 2.1 time: 0.493842 Sep 06 11:11:47.386401 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2255/4506] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:46 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1736 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:47.576560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7f5f9516-7d45-4168-81c3-f410d54bec63 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:47.591777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7f5f9516-7d45-4168-81c3-f410d54bec63 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:47.621475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f5f9516-7d45-4168-81c3-f410d54bec63 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:47.623078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f5f9516-7d45-4168-81c3-f410d54bec63 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:47.624164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f5f9516-7d45-4168-81c3-f410d54bec63 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:47.626193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f5f9516-7d45-4168-81c3-f410d54bec63 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:47.627274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f5f9516-7d45-4168-81c3-f410d54bec63 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:47.635314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f5f9516-7d45-4168-81c3-f410d54bec63 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:47.639364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c2f38bab-1b50-4cf3-a775-963987836666 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:47.640796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c2f38bab-1b50-4cf3-a775-963987836666 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:47.657670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2f38bab-1b50-4cf3-a775-963987836666 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:47.658633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2f38bab-1b50-4cf3-a775-963987836666 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:47.659295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2f38bab-1b50-4cf3-a775-963987836666 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:47.677071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2f38bab-1b50-4cf3-a775-963987836666 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:47.677071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2f38bab-1b50-4cf3-a775-963987836666 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:47.677071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2f38bab-1b50-4cf3-a775-963987836666 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:48.047505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c2f38bab-1b50-4cf3-a775-963987836666 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:48.056186 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c2f38bab-1b50-4cf3-a775-963987836666 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1523 microversion: 2.1 time: 0.427466 Sep 06 11:11:48.056817 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2256/4507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:47 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:48.067962 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7f5f9516-7d45-4168-81c3-f410d54bec63 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "POST /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f/action" status: 200 len: 32505 microversion: 2.32 time: 0.503315 Sep 06 11:11:48.068798 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2252/4508] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:11:47 2022] POST /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f/action => generated 32505 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:11:48.082815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-664e8b24-ac55-45a4-b1eb-092baf9e54ed tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:48.083382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-664e8b24-ac55-45a4-b1eb-092baf9e54ed tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:48.095346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-664e8b24-ac55-45a4-b1eb-092baf9e54ed tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:48.096185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-664e8b24-ac55-45a4-b1eb-092baf9e54ed tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:48.096842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-664e8b24-ac55-45a4-b1eb-092baf9e54ed tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:48.097865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-664e8b24-ac55-45a4-b1eb-092baf9e54ed tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:48.098559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-664e8b24-ac55-45a4-b1eb-092baf9e54ed tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:48.099207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-664e8b24-ac55-45a4-b1eb-092baf9e54ed tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:48.128083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-664e8b24-ac55-45a4-b1eb-092baf9e54ed tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:11:48.217322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c29f87d3-1a70-4c31-ae11-699011d752f4 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f369bb80>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:48.332453 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c29f87d3-1a70-4c31-ae11-699011d752f4 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.120379 Sep 06 11:11:48.333536 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2253/4509] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:48 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:48.406500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-024b0c63-4a38-496d-b2c9-9fb936add073 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:48.407661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-024b0c63-4a38-496d-b2c9-9fb936add073 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:48.416262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=52 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:48.423931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-024b0c63-4a38-496d-b2c9-9fb936add073 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:48.425365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-024b0c63-4a38-496d-b2c9-9fb936add073 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:48.426440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-024b0c63-4a38-496d-b2c9-9fb936add073 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:48.431790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-024b0c63-4a38-496d-b2c9-9fb936add073 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:48.431790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-024b0c63-4a38-496d-b2c9-9fb936add073 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:48.431790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-024b0c63-4a38-496d-b2c9-9fb936add073 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:48.556748 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-664e8b24-ac55-45a4-b1eb-092baf9e54ed tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 204 len: 0 microversion: 2.32 time: 0.477460 Sep 06 11:11:48.558063 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2257/4510] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:11:48 2022] DELETE /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:11:48.571143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2aa67fe0-d417-4e06-9eb5-9991ea90dfae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:48.572230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2aa67fe0-d417-4e06-9eb5-9991ea90dfae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:48.586614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2aa67fe0-d417-4e06-9eb5-9991ea90dfae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:48.589083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2aa67fe0-d417-4e06-9eb5-9991ea90dfae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:48.592756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2aa67fe0-d417-4e06-9eb5-9991ea90dfae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:48.595687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2aa67fe0-d417-4e06-9eb5-9991ea90dfae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:48.598014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2aa67fe0-d417-4e06-9eb5-9991ea90dfae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:48.599127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2aa67fe0-d417-4e06-9eb5-9991ea90dfae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:48.785130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-024b0c63-4a38-496d-b2c9-9fb936add073 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:48.797002 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-024b0c63-4a38-496d-b2c9-9fb936add073 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1736 microversion: 2.1 time: 0.395033 Sep 06 11:11:48.820304 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2254/4511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:48 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1736 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:48.940339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2aa67fe0-d417-4e06-9eb5-9991ea90dfae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:48.962820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2aa67fe0-d417-4e06-9eb5-9991ea90dfae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:48.968376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2aa67fe0-d417-4e06-9eb5-9991ea90dfae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:48.975544 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2aa67fe0-d417-4e06-9eb5-9991ea90dfae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 2955 microversion: 2.32 time: 0.405136 Sep 06 11:11:48.979609 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2258/4512] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:11:48 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 2955 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:11:49.082520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3d1cac1c-aecb-405d-9cf5-8721ebf080e4 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:49.083221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3d1cac1c-aecb-405d-9cf5-8721ebf080e4 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:49.093996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d1cac1c-aecb-405d-9cf5-8721ebf080e4 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:49.096532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d1cac1c-aecb-405d-9cf5-8721ebf080e4 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:49.096532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d1cac1c-aecb-405d-9cf5-8721ebf080e4 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:49.096532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d1cac1c-aecb-405d-9cf5-8721ebf080e4 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:49.096532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d1cac1c-aecb-405d-9cf5-8721ebf080e4 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:49.097796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d1cac1c-aecb-405d-9cf5-8721ebf080e4 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:49.340208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3d1cac1c-aecb-405d-9cf5-8721ebf080e4 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:49.340208 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3d1cac1c-aecb-405d-9cf5-8721ebf080e4 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1503 microversion: 2.1 time: 0.249953 Sep 06 11:11:49.340208 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2255/4513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:49 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:49.350104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9782c49f-5cbc-42a9-9f35-60ae3fd8dfc7 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f30dab80>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:49.366708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cf3ebc4a-dcb4-4505-addf-4a1eb74e679c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Action: 'create', calling method: .version_select at 0x7f90f850a1f0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-162062870", "description": "tempest-description-899689522"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:49.404236 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9782c49f-5cbc-42a9-9f35-60ae3fd8dfc7 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1455 microversion: 2.1 time: 0.058359 Sep 06 11:11:49.404925 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2259/4514] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:49 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:49.827637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6d278f2c-f602-4f1a-87ed-ee28230e81a6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:49.828465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6d278f2c-f602-4f1a-87ed-ee28230e81a6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:49.836727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d278f2c-f602-4f1a-87ed-ee28230e81a6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:49.837104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d278f2c-f602-4f1a-87ed-ee28230e81a6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:49.837600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d278f2c-f602-4f1a-87ed-ee28230e81a6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:49.838204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d278f2c-f602-4f1a-87ed-ee28230e81a6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:49.838845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d278f2c-f602-4f1a-87ed-ee28230e81a6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:49.839480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d278f2c-f602-4f1a-87ed-ee28230e81a6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:49.849695 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cf3ebc4a-dcb4-4505-addf-4a1eb74e679c tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.487496 Sep 06 11:11:49.853348 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2256/4515] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Sep 6 11:11:49 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:49.871452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5805449e-d49b-4007-97cb-0a70ee655210 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-162062870"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:49.877030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5805449e-d49b-4007-97cb-0a70ee655210 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:49.884158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5805449e-d49b-4007-97cb-0a70ee655210 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:49.884868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5805449e-d49b-4007-97cb-0a70ee655210 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:49.885489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5805449e-d49b-4007-97cb-0a70ee655210 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:49.888124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5805449e-d49b-4007-97cb-0a70ee655210 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:49.888124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5805449e-d49b-4007-97cb-0a70ee655210 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:49.888124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5805449e-d49b-4007-97cb-0a70ee655210 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:50.090968 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.network.security_group_api [None req-5805449e-d49b-4007-97cb-0a70ee655210 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Adding security group 360941c6-f86e-4318-a06c-3daf905b2685 to port c5a9fd30-3a11-467d-84cf-1398f51c8010 Sep 06 11:11:50.096135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6d278f2c-f602-4f1a-87ed-ee28230e81a6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:50.102015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:50.120821 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6d278f2c-f602-4f1a-87ed-ee28230e81a6 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1736 microversion: 2.1 time: 0.287449 Sep 06 11:11:50.120821 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2260/4516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:49 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1736 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:50.120821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9ce87804-e1a0-4ea9-bbc8-c1e5a817adea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:50.120821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9ce87804-e1a0-4ea9-bbc8-c1e5a817adea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:50.126250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ce87804-e1a0-4ea9-bbc8-c1e5a817adea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:50.127138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ce87804-e1a0-4ea9-bbc8-c1e5a817adea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:50.127859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ce87804-e1a0-4ea9-bbc8-c1e5a817adea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:50.128585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ce87804-e1a0-4ea9-bbc8-c1e5a817adea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:50.129099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ce87804-e1a0-4ea9-bbc8-c1e5a817adea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:50.129534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ce87804-e1a0-4ea9-bbc8-c1e5a817adea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:50.852850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9ce87804-e1a0-4ea9-bbc8-c1e5a817adea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:50.862397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9ce87804-e1a0-4ea9-bbc8-c1e5a817adea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:50.864211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9ce87804-e1a0-4ea9-bbc8-c1e5a817adea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:50.865694 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9ce87804-e1a0-4ea9-bbc8-c1e5a817adea tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 2955 microversion: 2.32 time: 0.753065 Sep 06 11:11:50.866759 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2261/4517] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:11:50 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 2955 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:11:50.871505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0ee539d3-a0c8-4dfa-9425-1dba39938150 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f30dac10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:50.945486 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0ee539d3-a0c8-4dfa-9425-1dba39938150 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1464 microversion: 2.1 time: 0.077462 Sep 06 11:11:50.946071 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2262/4518] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:50 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1464 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:50.968462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4ea673bb-ac03-4416-a7b1-6b7cce5b017b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3148a60>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:51.025310 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4ea673bb-ac03-4416-a7b1-6b7cce5b017b tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 200 len: 1464 microversion: 2.1 time: 0.063804 Sep 06 11:11:51.025310 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2263/4519] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:50 2022] GET /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 1464 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:51.035697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2836385a-248c-4748-b99b-d02c265c2680 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:51.036407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2836385a-248c-4748-b99b-d02c265c2680 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:51.042793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2836385a-248c-4748-b99b-d02c265c2680 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:51.043413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2836385a-248c-4748-b99b-d02c265c2680 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:51.044473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2836385a-248c-4748-b99b-d02c265c2680 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:51.045266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2836385a-248c-4748-b99b-d02c265c2680 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:51.045633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2836385a-248c-4748-b99b-d02c265c2680 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:51.046069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2836385a-248c-4748-b99b-d02c265c2680 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:51.340429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2836385a-248c-4748-b99b-d02c265c2680 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:51.348951 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2836385a-248c-4748-b99b-d02c265c2680 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1467 microversion: 2.1 time: 0.316864 Sep 06 11:11:51.351376 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2264/4520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:51 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1467 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:11:51.385391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ff500539-ae55-4baf-b732-4afa26ee1eb4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:51.387189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ff500539-ae55-4baf-b732-4afa26ee1eb4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:51.398056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff500539-ae55-4baf-b732-4afa26ee1eb4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:51.398754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff500539-ae55-4baf-b732-4afa26ee1eb4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:51.399569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff500539-ae55-4baf-b732-4afa26ee1eb4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:51.400464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff500539-ae55-4baf-b732-4afa26ee1eb4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:51.401101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff500539-ae55-4baf-b732-4afa26ee1eb4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:51.401699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff500539-ae55-4baf-b732-4afa26ee1eb4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:51.411446 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5805449e-d49b-4007-97cb-0a70ee655210 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "POST /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b/action" status: 202 len: 0 microversion: 2.1 time: 1.549554 Sep 06 11:11:51.412153 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2257/4521] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:11:49 2022] POST /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b/action => generated 0 bytes in 1551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:11:51.420001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ec5fedda-43f9-4f94-805c-2f5e78dedf5f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1851761455"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:51.434929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ec5fedda-43f9-4f94-805c-2f5e78dedf5f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:51.450296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec5fedda-43f9-4f94-805c-2f5e78dedf5f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:51.451383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec5fedda-43f9-4f94-805c-2f5e78dedf5f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:51.454786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec5fedda-43f9-4f94-805c-2f5e78dedf5f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:51.454786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec5fedda-43f9-4f94-805c-2f5e78dedf5f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:51.454786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec5fedda-43f9-4f94-805c-2f5e78dedf5f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:51.454786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec5fedda-43f9-4f94-805c-2f5e78dedf5f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:51.863256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ff500539-ae55-4baf-b732-4afa26ee1eb4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:51.894423 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ff500539-ae55-4baf-b732-4afa26ee1eb4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1736 microversion: 2.1 time: 0.529579 Sep 06 11:11:51.900440 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2265/4522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:51 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1736 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:51.912530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d98fdb56-1bdc-4d41-8f8e-661970c3fc1f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-162062870"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:51.915663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d98fdb56-1bdc-4d41-8f8e-661970c3fc1f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:51.926792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d98fdb56-1bdc-4d41-8f8e-661970c3fc1f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:51.927420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d98fdb56-1bdc-4d41-8f8e-661970c3fc1f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:51.928298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d98fdb56-1bdc-4d41-8f8e-661970c3fc1f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:51.929234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d98fdb56-1bdc-4d41-8f8e-661970c3fc1f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:51.929706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d98fdb56-1bdc-4d41-8f8e-661970c3fc1f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:51.930206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d98fdb56-1bdc-4d41-8f8e-661970c3fc1f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:51.994606 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ec5fedda-43f9-4f94-805c-2f5e78dedf5f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "POST /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597/action" status: 202 len: 0 microversion: 2.1 time: 0.579850 Sep 06 11:11:51.994606 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2258/4523] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:11:51 2022] POST /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 06 11:11:52.000093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a381a567-a62d-48b3-928a-4a82c6dcbe61 req-51c06a77-3e90-48bd-9472-c67c6f59ff42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76977a0f-f682-4968-96cf-58fff0c6625b", "tag": "c5a9fd30-3a11-467d-84cf-1398f51c8010"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:52.012852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a381a567-a62d-48b3-928a-4a82c6dcbe61 req-51c06a77-3e90-48bd-9472-c67c6f59ff42 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:52.013560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a381a567-a62d-48b3-928a-4a82c6dcbe61 req-51c06a77-3e90-48bd-9472-c67c6f59ff42 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:52.016209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a381a567-a62d-48b3-928a-4a82c6dcbe61 req-51c06a77-3e90-48bd-9472-c67c6f59ff42 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:52.050334 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a381a567-a62d-48b3-928a-4a82c6dcbe61 req-51c06a77-3e90-48bd-9472-c67c6f59ff42 service nova] Creating event network-changed:c5a9fd30-3a11-467d-84cf-1398f51c8010 for instance 76977a0f-f682-4968-96cf-58fff0c6625b on nch2-master-1 Sep 06 11:11:52.060898 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a381a567-a62d-48b3-928a-4a82c6dcbe61 req-51c06a77-3e90-48bd-9472-c67c6f59ff42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065261 Sep 06 11:11:52.063193 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2259/4524] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:52.077091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-408a3aa5-4565-4271-9ae8-1061d9da762d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:52.078890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-408a3aa5-4565-4271-9ae8-1061d9da762d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:52.089670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-408a3aa5-4565-4271-9ae8-1061d9da762d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:52.090520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-408a3aa5-4565-4271-9ae8-1061d9da762d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:52.106525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-408a3aa5-4565-4271-9ae8-1061d9da762d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:52.107593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-408a3aa5-4565-4271-9ae8-1061d9da762d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:52.108336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-408a3aa5-4565-4271-9ae8-1061d9da762d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:52.108837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-408a3aa5-4565-4271-9ae8-1061d9da762d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:52.268229 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.network.security_group_api [None req-d98fdb56-1bdc-4d41-8f8e-661970c3fc1f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Removing security group 360941c6-f86e-4318-a06c-3daf905b2685 from port c5a9fd30-3a11-467d-84cf-1398f51c8010 Sep 06 11:11:52.567453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-408a3aa5-4565-4271-9ae8-1061d9da762d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:52.578684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-408a3aa5-4565-4271-9ae8-1061d9da762d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:52.583910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-408a3aa5-4565-4271-9ae8-1061d9da762d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:52.583910 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-408a3aa5-4565-4271-9ae8-1061d9da762d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 2934 microversion: 2.32 time: 0.517578 Sep 06 11:11:52.583910 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2260/4525] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:11:52 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 2934 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:11:52.600737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e4e13e76-5ae2-48a3-97d8-0ad40d7e0061 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90fcf5e8b0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:52.662511 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e4e13e76-5ae2-48a3-97d8-0ad40d7e0061 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.065525 Sep 06 11:11:52.663117 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2261/4526] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:52 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:52.926161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-67fbd4a2-f9cf-4cb3-8ff5-4be5896ce735 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:52.926786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-67fbd4a2-f9cf-4cb3-8ff5-4be5896ce735 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:52.933432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67fbd4a2-f9cf-4cb3-8ff5-4be5896ce735 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:52.933930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67fbd4a2-f9cf-4cb3-8ff5-4be5896ce735 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:52.934402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67fbd4a2-f9cf-4cb3-8ff5-4be5896ce735 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:52.935159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67fbd4a2-f9cf-4cb3-8ff5-4be5896ce735 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:52.935632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67fbd4a2-f9cf-4cb3-8ff5-4be5896ce735 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:52.936712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67fbd4a2-f9cf-4cb3-8ff5-4be5896ce735 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:53.144169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-67fbd4a2-f9cf-4cb3-8ff5-4be5896ce735 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:53.153856 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-67fbd4a2-f9cf-4cb3-8ff5-4be5896ce735 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1736 microversion: 2.1 time: 0.231146 Sep 06 11:11:53.154620 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2262/4527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:52 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:53.182802 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d98fdb56-1bdc-4d41-8f8e-661970c3fc1f tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "POST /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b/action" status: 202 len: 0 microversion: 2.1 time: 1.263044 Sep 06 11:11:53.182802 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2266/4528] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:11:51 2022] POST /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b/action => generated 0 bytes in 1265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:11:53.183358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c7c9647-806c-42a2-abaa-ae908e4b90af tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Action: 'create', calling method: .version_select at 0x7f90f85974c0>, body: {"pool": null} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:53.612637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5753977-a5b4-4d16-a4b5-b3c21a0dfb0e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:53.613374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a5753977-a5b4-4d16-a4b5-b3c21a0dfb0e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:53.624725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5753977-a5b4-4d16-a4b5-b3c21a0dfb0e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:53.625323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5753977-a5b4-4d16-a4b5-b3c21a0dfb0e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:53.625997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5753977-a5b4-4d16-a4b5-b3c21a0dfb0e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:53.626807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5753977-a5b4-4d16-a4b5-b3c21a0dfb0e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:53.631226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5753977-a5b4-4d16-a4b5-b3c21a0dfb0e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:53.632372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5753977-a5b4-4d16-a4b5-b3c21a0dfb0e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:53.992253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a5753977-a5b4-4d16-a4b5-b3c21a0dfb0e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:54.013725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a5753977-a5b4-4d16-a4b5-b3c21a0dfb0e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:54.015730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a5753977-a5b4-4d16-a4b5-b3c21a0dfb0e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:54.017548 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a5753977-a5b4-4d16-a4b5-b3c21a0dfb0e tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 2913 microversion: 2.32 time: 0.409979 Sep 06 11:11:54.018967 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2267/4529] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:11:53 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 2913 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:11:54.049017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-266c071b-bfc7-4c11-9185-1b92308e2db8 req-c39f908f-ea50-4c09-a58b-2c5148f74bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016c8ecc-3457-4204-ba5b-3e06970ac490", "name": "network-vif-unplugged", "status": "completed", "tag": "0a339213-93da-46ad-badf-47ea616965d5"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:54.068131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-266c071b-bfc7-4c11-9185-1b92308e2db8 req-c39f908f-ea50-4c09-a58b-2c5148f74bec service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:54.069305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-266c071b-bfc7-4c11-9185-1b92308e2db8 req-c39f908f-ea50-4c09-a58b-2c5148f74bec service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:54.069866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-266c071b-bfc7-4c11-9185-1b92308e2db8 req-c39f908f-ea50-4c09-a58b-2c5148f74bec service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:54.087667 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-266c071b-bfc7-4c11-9185-1b92308e2db8 req-c39f908f-ea50-4c09-a58b-2c5148f74bec service nova] Creating event network-vif-unplugged:0a339213-93da-46ad-badf-47ea616965d5 for instance 016c8ecc-3457-4204-ba5b-3e06970ac490 on nch1-master-1 Sep 06 11:11:54.093208 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-266c071b-bfc7-4c11-9185-1b92308e2db8 req-c39f908f-ea50-4c09-a58b-2c5148f74bec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059753 Sep 06 11:11:54.100002 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2268/4530] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:54.100002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1c58ba75-aac6-4178-b7b6-e0497de9299c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3126dc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:54.149246 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1c58ba75-aac6-4178-b7b6-e0497de9299c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.054201 Sep 06 11:11:54.150034 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2269/4531] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:54 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:54.156806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-21986881-1049-4c88-b743-87f155052d6b req-b9d2f6d3-1562-4604-a55d-1ed78e506613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76977a0f-f682-4968-96cf-58fff0c6625b", "tag": "c5a9fd30-3a11-467d-84cf-1398f51c8010"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:54.169738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-21986881-1049-4c88-b743-87f155052d6b req-b9d2f6d3-1562-4604-a55d-1ed78e506613 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:54.171043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-21986881-1049-4c88-b743-87f155052d6b req-b9d2f6d3-1562-4604-a55d-1ed78e506613 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:54.171718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-21986881-1049-4c88-b743-87f155052d6b req-b9d2f6d3-1562-4604-a55d-1ed78e506613 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:54.187748 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-21986881-1049-4c88-b743-87f155052d6b req-b9d2f6d3-1562-4604-a55d-1ed78e506613 service nova] Creating event network-changed:c5a9fd30-3a11-467d-84cf-1398f51c8010 for instance 76977a0f-f682-4968-96cf-58fff0c6625b on nch2-master-1 Sep 06 11:11:54.193846 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-21986881-1049-4c88-b743-87f155052d6b req-b9d2f6d3-1562-4604-a55d-1ed78e506613 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041842 Sep 06 11:11:54.196395 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2270/4532] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:54.202148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-44c26f6d-9fe3-4bea-9653-15c5e861585e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:54.203185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-44c26f6d-9fe3-4bea-9653-15c5e861585e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:54.211783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44c26f6d-9fe3-4bea-9653-15c5e861585e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:54.212541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44c26f6d-9fe3-4bea-9653-15c5e861585e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:54.213182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44c26f6d-9fe3-4bea-9653-15c5e861585e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:54.214497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44c26f6d-9fe3-4bea-9653-15c5e861585e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:54.215163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44c26f6d-9fe3-4bea-9653-15c5e861585e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:54.215935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44c26f6d-9fe3-4bea-9653-15c5e861585e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:54.658519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-44c26f6d-9fe3-4bea-9653-15c5e861585e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:54.681858 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-44c26f6d-9fe3-4bea-9653-15c5e861585e tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1736 microversion: 2.1 time: 0.469678 Sep 06 11:11:54.682796 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2271/4533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:54 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1736 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:55.055718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3af1cb7e-f366-4ba7-9528-04335fc6f266 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:55.057107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3af1cb7e-f366-4ba7-9528-04335fc6f266 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:55.068095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3af1cb7e-f366-4ba7-9528-04335fc6f266 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:55.068707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3af1cb7e-f366-4ba7-9528-04335fc6f266 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:55.069345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3af1cb7e-f366-4ba7-9528-04335fc6f266 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:55.070272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3af1cb7e-f366-4ba7-9528-04335fc6f266 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:55.071713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3af1cb7e-f366-4ba7-9528-04335fc6f266 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:55.072343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3af1cb7e-f366-4ba7-9528-04335fc6f266 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:55.598500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3af1cb7e-f366-4ba7-9528-04335fc6f266 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:55.616736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3af1cb7e-f366-4ba7-9528-04335fc6f266 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:55.620921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3af1cb7e-f366-4ba7-9528-04335fc6f266 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:55.623599 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3af1cb7e-f366-4ba7-9528-04335fc6f266 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 2866 microversion: 2.32 time: 0.571413 Sep 06 11:11:55.631311 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2272/4534] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:11:55 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 2866 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:11:55.658055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-28aca9cd-5caa-4952-b30a-31ea4c79ce40 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3194c10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:55.733884 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-28aca9cd-5caa-4952-b30a-31ea4c79ce40 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.100810 Sep 06 11:11:55.734745 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2273/4535] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:55 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:55.740621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-40f89d60-ec29-420d-947a-755a0bd03faf tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:55.741485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-40f89d60-ec29-420d-947a-755a0bd03faf tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:55.749886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40f89d60-ec29-420d-947a-755a0bd03faf tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:55.750407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40f89d60-ec29-420d-947a-755a0bd03faf tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:55.756056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40f89d60-ec29-420d-947a-755a0bd03faf tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:55.759976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40f89d60-ec29-420d-947a-755a0bd03faf tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:55.770101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40f89d60-ec29-420d-947a-755a0bd03faf tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:55.770590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40f89d60-ec29-420d-947a-755a0bd03faf tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:56.143569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-40f89d60-ec29-420d-947a-755a0bd03faf tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:56.157936 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-40f89d60-ec29-420d-947a-755a0bd03faf tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1736 microversion: 2.1 time: 0.420888 Sep 06 11:11:56.162689 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2274/4536] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:55 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1736 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:56.166997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a095a7cc-5878-4eb5-a92d-fe4a82ec609f req-8eba823a-319e-4151-9148-3b88050f7e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-unplugged", "status": "completed", "tag": "62e35ca1-7670-4e3b-9d70-d70c74fb7d76"}, {"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-unplugged", "status": "completed", "tag": "ec288bce-0ab7-40a2-81eb-874eab5b26e6"}, {"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-unplugged", "status": "completed", "tag": "53554e9a-68ab-46af-bf31-d81bb29cfac6"}, {"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-unplugged", "status": "completed", "tag": "8b3ac40a-47a0-4d01-ae00-cba282f046f8"}, {"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-unplugged", "status": "completed", "tag": "049445db-4d1a-414d-a121-813328072bfc"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:56.189993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a095a7cc-5878-4eb5-a92d-fe4a82ec609f req-8eba823a-319e-4151-9148-3b88050f7e77 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:56.190767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a095a7cc-5878-4eb5-a92d-fe4a82ec609f req-8eba823a-319e-4151-9148-3b88050f7e77 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:56.191482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a095a7cc-5878-4eb5-a92d-fe4a82ec609f req-8eba823a-319e-4151-9148-3b88050f7e77 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:56.207086 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a095a7cc-5878-4eb5-a92d-fe4a82ec609f req-8eba823a-319e-4151-9148-3b88050f7e77 service nova] Creating event network-vif-unplugged:62e35ca1-7670-4e3b-9d70-d70c74fb7d76 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:11:56.208289 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a095a7cc-5878-4eb5-a92d-fe4a82ec609f req-8eba823a-319e-4151-9148-3b88050f7e77 service nova] Creating event network-vif-unplugged:ec288bce-0ab7-40a2-81eb-874eab5b26e6 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:11:56.209118 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a095a7cc-5878-4eb5-a92d-fe4a82ec609f req-8eba823a-319e-4151-9148-3b88050f7e77 service nova] Creating event network-vif-unplugged:53554e9a-68ab-46af-bf31-d81bb29cfac6 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:11:56.210055 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a095a7cc-5878-4eb5-a92d-fe4a82ec609f req-8eba823a-319e-4151-9148-3b88050f7e77 service nova] Creating event network-vif-unplugged:8b3ac40a-47a0-4d01-ae00-cba282f046f8 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:11:56.210732 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a095a7cc-5878-4eb5-a92d-fe4a82ec609f req-8eba823a-319e-4151-9148-3b88050f7e77 service nova] Creating event network-vif-unplugged:049445db-4d1a-414d-a121-813328072bfc for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:11:56.218282 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a095a7cc-5878-4eb5-a92d-fe4a82ec609f req-8eba823a-319e-4151-9148-3b88050f7e77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.057890 Sep 06 11:11:56.219448 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2275/4537] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:56.277242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-4f1caedd-6c98-44f6-926f-27be82eb1dbe req-b1759966-c281-450a-8e75-8220c17bc38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-deleted", "tag": "62e35ca1-7670-4e3b-9d70-d70c74fb7d76"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:56.288700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4f1caedd-6c98-44f6-926f-27be82eb1dbe req-b1759966-c281-450a-8e75-8220c17bc38c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:56.289190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4f1caedd-6c98-44f6-926f-27be82eb1dbe req-b1759966-c281-450a-8e75-8220c17bc38c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:56.289787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4f1caedd-6c98-44f6-926f-27be82eb1dbe req-b1759966-c281-450a-8e75-8220c17bc38c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:56.303642 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-4f1caedd-6c98-44f6-926f-27be82eb1dbe req-b1759966-c281-450a-8e75-8220c17bc38c service nova] Creating event network-vif-deleted:62e35ca1-7670-4e3b-9d70-d70c74fb7d76 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:11:56.309265 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-4f1caedd-6c98-44f6-926f-27be82eb1dbe req-b1759966-c281-450a-8e75-8220c17bc38c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036456 Sep 06 11:11:56.309889 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2276/4538] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:11:56.655525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9846e4fb-fa0c-4e40-9d99-a54edcd5fcbf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:56.656239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9846e4fb-fa0c-4e40-9d99-a54edcd5fcbf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:56.663322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9846e4fb-fa0c-4e40-9d99-a54edcd5fcbf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:56.663830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9846e4fb-fa0c-4e40-9d99-a54edcd5fcbf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:56.664266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9846e4fb-fa0c-4e40-9d99-a54edcd5fcbf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:56.664984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9846e4fb-fa0c-4e40-9d99-a54edcd5fcbf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:56.665450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9846e4fb-fa0c-4e40-9d99-a54edcd5fcbf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:56.665883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9846e4fb-fa0c-4e40-9d99-a54edcd5fcbf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:57.125588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9846e4fb-fa0c-4e40-9d99-a54edcd5fcbf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:57.137849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9846e4fb-fa0c-4e40-9d99-a54edcd5fcbf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:57.139503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9846e4fb-fa0c-4e40-9d99-a54edcd5fcbf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:57.140924 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9846e4fb-fa0c-4e40-9d99-a54edcd5fcbf tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 2705 microversion: 2.32 time: 0.492072 Sep 06 11:11:57.142652 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2277/4539] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:11:56 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 2705 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:11:57.150569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d6e9a89c-b02e-4bce-ab74-1b8b42b2477c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f30cbee0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:57.216463 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d6e9a89c-b02e-4bce-ab74-1b8b42b2477c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.070406 Sep 06 11:11:57.218349 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2278/4540] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:57 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:57.222925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ce8889af-880c-4ee3-a824-6ba1956a0de9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:57.223971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ce8889af-880c-4ee3-a824-6ba1956a0de9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:57.231836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce8889af-880c-4ee3-a824-6ba1956a0de9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:57.232665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce8889af-880c-4ee3-a824-6ba1956a0de9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:57.233599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce8889af-880c-4ee3-a824-6ba1956a0de9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:57.234917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce8889af-880c-4ee3-a824-6ba1956a0de9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:57.235605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce8889af-880c-4ee3-a824-6ba1956a0de9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:57.237289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce8889af-880c-4ee3-a824-6ba1956a0de9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:57.430090 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c7c9647-806c-42a2-abaa-ae908e4b90af tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.256258 Sep 06 11:11:57.431937 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2263/4541] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Sep 6 11:11:53 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:57.445243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.42"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:57.452377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:57.504911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:57.513777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:57.515665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:57.517111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:57.518304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:57.520295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:57.634669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "refresh_cache-76977a0f-f682-4968-96cf-58fff0c6625b" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 11:11:57.644213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquired lock "refresh_cache-76977a0f-f682-4968-96cf-58fff0c6625b" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 11:11:57.836223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce8889af-880c-4ee3-a824-6ba1956a0de9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:57.846797 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ce8889af-880c-4ee3-a824-6ba1956a0de9 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1736 microversion: 2.1 time: 0.627853 Sep 06 11:11:57.853860 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2279/4542] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:57 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1736 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:58.175848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7d49689d-65ad-46ec-a949-247e01129068 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:58.176480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7d49689d-65ad-46ec-a949-247e01129068 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:58.192439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d49689d-65ad-46ec-a949-247e01129068 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:58.192944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d49689d-65ad-46ec-a949-247e01129068 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:58.193406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d49689d-65ad-46ec-a949-247e01129068 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:58.194126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d49689d-65ad-46ec-a949-247e01129068 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:58.194597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d49689d-65ad-46ec-a949-247e01129068 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:58.195059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d49689d-65ad-46ec-a949-247e01129068 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:59.194571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d49689d-65ad-46ec-a949-247e01129068 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:59.212038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d49689d-65ad-46ec-a949-247e01129068 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:59.213748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d49689d-65ad-46ec-a949-247e01129068 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:11:59.215953 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7d49689d-65ad-46ec-a949-247e01129068 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 2705 microversion: 2.32 time: 1.043404 Sep 06 11:11:59.227821 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2280/4543] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:11:58 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 2705 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:11:59.245944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-52d4e2be-74a8-4bd0-9ada-b6ad14437b4d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f30da5e0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:59.318966 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-52d4e2be-74a8-4bd0-9ada-b6ad14437b4d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.089654 Sep 06 11:11:59.320139 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2281/4544] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:59 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:11:59.327480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-ae7725c1-41da-4bba-8a64-f23ab64953a1 req-82acc936-e3cd-46b4-a172-89dd0c52cf6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d53b0f-bd9f-479e-948b-bbefbd0d8597", "name": "network-vif-plugged", "status": "completed", "tag": "56dd829f-74c4-4912-9aac-6b30a6e3cd3e"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:59.339262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ae7725c1-41da-4bba-8a64-f23ab64953a1 req-82acc936-e3cd-46b4-a172-89dd0c52cf6c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:59.340674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ae7725c1-41da-4bba-8a64-f23ab64953a1 req-82acc936-e3cd-46b4-a172-89dd0c52cf6c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:59.342181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ae7725c1-41da-4bba-8a64-f23ab64953a1 req-82acc936-e3cd-46b4-a172-89dd0c52cf6c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:59.356292 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-ae7725c1-41da-4bba-8a64-f23ab64953a1 req-82acc936-e3cd-46b4-a172-89dd0c52cf6c service nova] Creating event network-vif-plugged:56dd829f-74c4-4912-9aac-6b30a6e3cd3e for instance 77d53b0f-bd9f-479e-948b-bbefbd0d8597 on nch1-master-1 Sep 06 11:11:59.363194 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-ae7725c1-41da-4bba-8a64-f23ab64953a1 req-82acc936-e3cd-46b4-a172-89dd0c52cf6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041651 Sep 06 11:11:59.364624 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2282/4545] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:59.371540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-c8e5f4ec-5336-461f-afd9-1c57059c739f req-9fe29f04-eebc-4d5c-8e81-4aa403ef68ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-deleted", "tag": "53554e9a-68ab-46af-bf31-d81bb29cfac6"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:11:59.381510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c8e5f4ec-5336-461f-afd9-1c57059c739f req-9fe29f04-eebc-4d5c-8e81-4aa403ef68ed service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:59.382266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c8e5f4ec-5336-461f-afd9-1c57059c739f req-9fe29f04-eebc-4d5c-8e81-4aa403ef68ed service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:59.382721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c8e5f4ec-5336-461f-afd9-1c57059c739f req-9fe29f04-eebc-4d5c-8e81-4aa403ef68ed service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:59.397922 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-c8e5f4ec-5336-461f-afd9-1c57059c739f req-9fe29f04-eebc-4d5c-8e81-4aa403ef68ed service nova] Creating event network-vif-deleted:53554e9a-68ab-46af-bf31-d81bb29cfac6 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:11:59.409407 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-c8e5f4ec-5336-461f-afd9-1c57059c739f req-9fe29f04-eebc-4d5c-8e81-4aa403ef68ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042879 Sep 06 11:11:59.410704 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2283/4546] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:11:59.419067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-50aef76b-33f9-46fa-81b9-fe03f4be6f2c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:11:59.424442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-50aef76b-33f9-46fa-81b9-fe03f4be6f2c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:11:59.444348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50aef76b-33f9-46fa-81b9-fe03f4be6f2c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:59.452196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50aef76b-33f9-46fa-81b9-fe03f4be6f2c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:59.452930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50aef76b-33f9-46fa-81b9-fe03f4be6f2c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:11:59.454864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50aef76b-33f9-46fa-81b9-fe03f4be6f2c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:11:59.457124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50aef76b-33f9-46fa-81b9-fe03f4be6f2c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:11:59.462047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-50aef76b-33f9-46fa-81b9-fe03f4be6f2c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:00.104770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-50aef76b-33f9-46fa-81b9-fe03f4be6f2c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:00.118589 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-50aef76b-33f9-46fa-81b9-fe03f4be6f2c tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1736 microversion: 2.1 time: 0.706117 Sep 06 11:12:00.132143 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2284/4547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:11:59 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1736 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:00.253200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e0ae53cb-1156-4153-94c1-7e933912fdd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:00.253888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e0ae53cb-1156-4153-94c1-7e933912fdd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:00.262246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0ae53cb-1156-4153-94c1-7e933912fdd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:00.262743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0ae53cb-1156-4153-94c1-7e933912fdd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:00.263211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0ae53cb-1156-4153-94c1-7e933912fdd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:00.272942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0ae53cb-1156-4153-94c1-7e933912fdd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:00.272942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0ae53cb-1156-4153-94c1-7e933912fdd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:00.272942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0ae53cb-1156-4153-94c1-7e933912fdd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:00.662637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e0ae53cb-1156-4153-94c1-7e933912fdd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:00.680098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e0ae53cb-1156-4153-94c1-7e933912fdd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:00.683393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e0ae53cb-1156-4153-94c1-7e933912fdd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:00.684960 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e0ae53cb-1156-4153-94c1-7e933912fdd8 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 2372 microversion: 2.32 time: 0.435658 Sep 06 11:12:00.686286 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2285/4548] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:00 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 2372 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:00.691730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a87f453c-8bae-4255-931a-f5058fe654c5 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f30cb160>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:00.761475 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a87f453c-8bae-4255-931a-f5058fe654c5 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.073955 Sep 06 11:12:00.762107 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2286/4549] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:00 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:01.157492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d3f9c1b8-6c3c-43ec-9259-ff1ada56b660 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:01.158382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3f9c1b8-6c3c-43ec-9259-ff1ada56b660 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:01.172381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3f9c1b8-6c3c-43ec-9259-ff1ada56b660 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:01.175805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3f9c1b8-6c3c-43ec-9259-ff1ada56b660 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:01.177996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3f9c1b8-6c3c-43ec-9259-ff1ada56b660 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:01.179698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3f9c1b8-6c3c-43ec-9259-ff1ada56b660 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:01.180358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3f9c1b8-6c3c-43ec-9259-ff1ada56b660 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:01.180976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3f9c1b8-6c3c-43ec-9259-ff1ada56b660 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:01.919894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d3f9c1b8-6c3c-43ec-9259-ff1ada56b660 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:01.944070 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d3f9c1b8-6c3c-43ec-9259-ff1ada56b660 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1736 microversion: 2.1 time: 0.792509 Sep 06 11:12:01.944685 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2287/4550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:01 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1736 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:12:01.949585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-05d6e886-93cb-4c10-ba8a-f4b165ddc47f req-9328bf90-925e-49d8-8487-e767d801d149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-deleted", "tag": "049445db-4d1a-414d-a121-813328072bfc"}, {"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-deleted", "tag": "ec288bce-0ab7-40a2-81eb-874eab5b26e6"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:01.982124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:01.985734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-05d6e886-93cb-4c10-ba8a-f4b165ddc47f req-9328bf90-925e-49d8-8487-e767d801d149 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:01.986293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-05d6e886-93cb-4c10-ba8a-f4b165ddc47f req-9328bf90-925e-49d8-8487-e767d801d149 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:01.990065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-05d6e886-93cb-4c10-ba8a-f4b165ddc47f req-9328bf90-925e-49d8-8487-e767d801d149 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:02.014047 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-05d6e886-93cb-4c10-ba8a-f4b165ddc47f req-9328bf90-925e-49d8-8487-e767d801d149 service nova] Creating event network-vif-deleted:049445db-4d1a-414d-a121-813328072bfc for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:12:02.015322 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-05d6e886-93cb-4c10-ba8a-f4b165ddc47f req-9328bf90-925e-49d8-8487-e767d801d149 service nova] Creating event network-vif-deleted:ec288bce-0ab7-40a2-81eb-874eab5b26e6 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:12:02.037097 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-05d6e886-93cb-4c10-ba8a-f4b165ddc47f req-9328bf90-925e-49d8-8487-e767d801d149 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084910 Sep 06 11:12:02.038560 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2288/4551] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:02.047862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ea0c768e-2df1-4692-a63e-91a6a7ab141d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:02.049089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ea0c768e-2df1-4692-a63e-91a6a7ab141d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:02.057153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea0c768e-2df1-4692-a63e-91a6a7ab141d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:02.057938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea0c768e-2df1-4692-a63e-91a6a7ab141d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:02.058738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea0c768e-2df1-4692-a63e-91a6a7ab141d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:02.059861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea0c768e-2df1-4692-a63e-91a6a7ab141d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:02.060662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea0c768e-2df1-4692-a63e-91a6a7ab141d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:02.061343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea0c768e-2df1-4692-a63e-91a6a7ab141d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:02.329802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Building network info cache for instance {{(pid=140875) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 06 11:12:02.451583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:02.790832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ea0c768e-2df1-4692-a63e-91a6a7ab141d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:02.801663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ea0c768e-2df1-4692-a63e-91a6a7ab141d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:02.803492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ea0c768e-2df1-4692-a63e-91a6a7ab141d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:02.804795 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ea0c768e-2df1-4692-a63e-91a6a7ab141d tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 2325 microversion: 2.32 time: 0.763066 Sep 06 11:12:02.806493 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2289/4552] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:02 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 2325 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:02.817563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34a07d3c-d264-4c46-abba-26ff622b9239 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3194d30>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:03.492390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Updating instance_info_cache with network_info: [{"id": "c5a9fd30-3a11-467d-84cf-1398f51c8010", "address": "fa:16:3e:b1:b9:e2", "network": {"id": "2c1774da-ae6e-41ab-9030-18c5a6bd4120", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-472368625-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0444d17c98fd486faf23794180465b3d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc5a9fd30-3a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140875) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 06 11:12:03.500624 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-34a07d3c-d264-4c46-abba-26ff622b9239 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.692955 Sep 06 11:12:03.502433 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2290/4553] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:02 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:03.518844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6cc0f5fb-fbd1-43fc-bb35-e036af87cbd8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:03.519774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6cc0f5fb-fbd1-43fc-bb35-e036af87cbd8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:03.536068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cc0f5fb-fbd1-43fc-bb35-e036af87cbd8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:03.536068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cc0f5fb-fbd1-43fc-bb35-e036af87cbd8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:03.538724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cc0f5fb-fbd1-43fc-bb35-e036af87cbd8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:03.543807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cc0f5fb-fbd1-43fc-bb35-e036af87cbd8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:03.544469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cc0f5fb-fbd1-43fc-bb35-e036af87cbd8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:03.544935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cc0f5fb-fbd1-43fc-bb35-e036af87cbd8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:03.626850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Releasing lock "refresh_cache-76977a0f-f682-4968-96cf-58fff0c6625b" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 11:12:03.628728 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0a5dd32e-f88f-4e0d-82d0-8555d28bac87 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "POST /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b/action" status: 202 len: 0 microversion: 2.1 time: 6.187457 Sep 06 11:12:03.638086 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2264/4554] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:11:57 2022] POST /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b/action => generated 0 bytes in 6189 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 06 11:12:03.643802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.42"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:04.013741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6cc0f5fb-fbd1-43fc-bb35-e036af87cbd8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:04.025866 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6cc0f5fb-fbd1-43fc-bb35-e036af87cbd8 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1736 microversion: 2.1 time: 0.521755 Sep 06 11:12:04.032322 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2291/4555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:03 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1736 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:04.040701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b7d1b4c7-3c02-4305-b504-3323b3e75e18 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:04.043380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b7d1b4c7-3c02-4305-b504-3323b3e75e18 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:04.054665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:04.061937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:04.062640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:04.063406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:04.065770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:04.067180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:04.069405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:04.071028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7d1b4c7-3c02-4305-b504-3323b3e75e18 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:04.080705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7d1b4c7-3c02-4305-b504-3323b3e75e18 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:04.081283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7d1b4c7-3c02-4305-b504-3323b3e75e18 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:04.082064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7d1b4c7-3c02-4305-b504-3323b3e75e18 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:04.082586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7d1b4c7-3c02-4305-b504-3323b3e75e18 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:04.084804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b7d1b4c7-3c02-4305-b504-3323b3e75e18 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:04.087390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=6,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:04.350030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b7d1b4c7-3c02-4305-b504-3323b3e75e18 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:04.372971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b7d1b4c7-3c02-4305-b504-3323b3e75e18 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:04.375428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b7d1b4c7-3c02-4305-b504-3323b3e75e18 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:04.379664 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b7d1b4c7-3c02-4305-b504-3323b3e75e18 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1605 microversion: 2.32 time: 0.345836 Sep 06 11:12:04.383310 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2292/4556] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:04 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1605 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:04.393582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-35ae714e-5352-4240-9e74-7a33e3da8ef6 req-5a7e4c77-ed95-4dbf-a803-bee8353d1ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76977a0f-f682-4968-96cf-58fff0c6625b", "tag": "c5a9fd30-3a11-467d-84cf-1398f51c8010"}, {"server_uuid": "c3719a07-cdb1-4a88-a1b4-a0700aa08c4f", "name": "network-vif-deleted", "tag": "8b3ac40a-47a0-4d01-ae00-cba282f046f8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:04.413331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-35ae714e-5352-4240-9e74-7a33e3da8ef6 req-5a7e4c77-ed95-4dbf-a803-bee8353d1ebe service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:04.413823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-35ae714e-5352-4240-9e74-7a33e3da8ef6 req-5a7e4c77-ed95-4dbf-a803-bee8353d1ebe service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:04.414263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-35ae714e-5352-4240-9e74-7a33e3da8ef6 req-5a7e4c77-ed95-4dbf-a803-bee8353d1ebe service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:04.449431 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-35ae714e-5352-4240-9e74-7a33e3da8ef6 req-5a7e4c77-ed95-4dbf-a803-bee8353d1ebe service nova] Creating event network-changed:c5a9fd30-3a11-467d-84cf-1398f51c8010 for instance 76977a0f-f682-4968-96cf-58fff0c6625b on nch2-master-1 Sep 06 11:12:04.449837 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-35ae714e-5352-4240-9e74-7a33e3da8ef6 req-5a7e4c77-ed95-4dbf-a803-bee8353d1ebe service nova] Creating event network-vif-deleted:8b3ac40a-47a0-4d01-ae00-cba282f046f8 for instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f on nch2-master-1 Sep 06 11:12:04.456727 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-35ae714e-5352-4240-9e74-7a33e3da8ef6 req-5a7e4c77-ed95-4dbf-a803-bee8353d1ebe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.067827 Sep 06 11:12:04.464652 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2293/4557] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:04.525014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-273c83d0-8dbe-4a53-a5c4-40e54b1e2334 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f31934c0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:04.540026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "refresh_cache-76977a0f-f682-4968-96cf-58fff0c6625b" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 11:12:04.540842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquired lock "refresh_cache-76977a0f-f682-4968-96cf-58fff0c6625b" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 11:12:04.960674 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-273c83d0-8dbe-4a53-a5c4-40e54b1e2334 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.435565 Sep 06 11:12:04.960674 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2294/4558] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:04 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:12:05.056188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81fc0318-9540-4d10-a1fc-040649d7b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:05.058028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-81fc0318-9540-4d10-a1fc-040649d7b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:05.074233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81fc0318-9540-4d10-a1fc-040649d7b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:05.075515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81fc0318-9540-4d10-a1fc-040649d7b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:05.076788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81fc0318-9540-4d10-a1fc-040649d7b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:05.077733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81fc0318-9540-4d10-a1fc-040649d7b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:05.078385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81fc0318-9540-4d10-a1fc-040649d7b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:05.078991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81fc0318-9540-4d10-a1fc-040649d7b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:05.586517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-81fc0318-9540-4d10-a1fc-040649d7b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:05.610842 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-81fc0318-9540-4d10-a1fc-040649d7b3eb tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1736 microversion: 2.1 time: 0.558733 Sep 06 11:12:05.612144 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2295/4559] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:05 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1736 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:05.622200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:05.624083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:05.631960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:05.646354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:05.646354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:05.646354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:05.646354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:05.646354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:05.750675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:05.751944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:05.752887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:05.753753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lazy-loading 'fault' on Instance uuid c3719a07-cdb1-4a88-a1b4-a0700aa08c4f {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:12:05.952347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:05.977395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:05.987028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '176b78609fe64a958eb12cddae83c0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f753981cf9264d27b16090d7499bf372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:05.995881 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f532c0b6-1e48-4a72-9c51-1164b205cbee tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 200 len: 1610 microversion: 2.32 time: 0.379658 Sep 06 11:12:06.002750 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2296/4560] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:05 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 1610 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:06.005370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4812c8d2-4acf-4b01-a23f-3da205de8690 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f8ade700>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:06.089194 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4812c8d2-4acf-4b01-a23f-3da205de8690 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.090099 Sep 06 11:12:06.090184 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2297/4561] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:05 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:06.391621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Building network info cache for instance {{(pid=140875) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 06 11:12:06.503597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-db1c1ab8-5b8f-4130-850b-0eafe7242252 req-927521f8-df9f-4c4e-b067-aafe72721064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76977a0f-f682-4968-96cf-58fff0c6625b", "tag": "c5a9fd30-3a11-467d-84cf-1398f51c8010"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:06.591180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-db1c1ab8-5b8f-4130-850b-0eafe7242252 req-927521f8-df9f-4c4e-b067-aafe72721064 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:06.596705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-db1c1ab8-5b8f-4130-850b-0eafe7242252 req-927521f8-df9f-4c4e-b067-aafe72721064 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:06.597785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-db1c1ab8-5b8f-4130-850b-0eafe7242252 req-927521f8-df9f-4c4e-b067-aafe72721064 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:06.643857 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-db1c1ab8-5b8f-4130-850b-0eafe7242252 req-927521f8-df9f-4c4e-b067-aafe72721064 service nova] Creating event network-changed:c5a9fd30-3a11-467d-84cf-1398f51c8010 for instance 76977a0f-f682-4968-96cf-58fff0c6625b on nch2-master-1 Sep 06 11:12:06.660607 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-db1c1ab8-5b8f-4130-850b-0eafe7242252 req-927521f8-df9f-4c4e-b067-aafe72721064 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163908 Sep 06 11:12:06.665218 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2298/4562] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:12:06.677336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5374e83-0d46-4059-864d-814d1b0af9d7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:06.679420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a5374e83-0d46-4059-864d-814d1b0af9d7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:06.697201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5374e83-0d46-4059-864d-814d1b0af9d7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:06.698808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5374e83-0d46-4059-864d-814d1b0af9d7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:06.700489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5374e83-0d46-4059-864d-814d1b0af9d7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:06.705024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5374e83-0d46-4059-864d-814d1b0af9d7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:06.707991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5374e83-0d46-4059-864d-814d1b0af9d7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:06.711234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5374e83-0d46-4059-864d-814d1b0af9d7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:07.315518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a5374e83-0d46-4059-864d-814d1b0af9d7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:07.345949 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a5374e83-0d46-4059-864d-814d1b0af9d7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1736 microversion: 2.1 time: 0.673134 Sep 06 11:12:07.346761 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2299/4563] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:06 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1736 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:07.360590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cc727ee6-6ca5-4ee8-b26e-bcd048822160 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:07.362377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cc727ee6-6ca5-4ee8-b26e-bcd048822160 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] [instance: c3719a07-cdb1-4a88-a1b4-a0700aa08c4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:07.379709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc727ee6-6ca5-4ee8-b26e-bcd048822160 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:07.381138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc727ee6-6ca5-4ee8-b26e-bcd048822160 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:07.382982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc727ee6-6ca5-4ee8-b26e-bcd048822160 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:07.385332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc727ee6-6ca5-4ee8-b26e-bcd048822160 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:07.387869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc727ee6-6ca5-4ee8-b26e-bcd048822160 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:07.388733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc727ee6-6ca5-4ee8-b26e-bcd048822160 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-cc727ee6-6ca5-4ee8-b26e-bcd048822160 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] HTTP exception thrown: Instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f could not be found. Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cc727ee6-6ca5-4ee8-b26e-bcd048822160 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Request method failure captured: Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f HTTP/1.1 Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyjcc06Lp-GC2JK9CBZfPa6gnrgd00UGgjBfZbpgJrm-nOJWe6lDEQcfKAAAWzcoKzQo1pitwsG9d16kQCQ54pdgrPco_CGjhjMYdzRvBw2fcGab5OlqD4AvxXklNrNKUCfIJdcjrrBVm22_0feuoeDkONZejw7R1WhQCrDvTgFefjs Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Openstack-Nova-Api-Version: 2.32 Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f753981cf9264d27b16090d7499bf372 Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TaggedBootDevicesTest-1190023964 Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f753981cf9264d27b16090d7499bf372"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f753981cf9264d27b16090d7499bf372"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f753981cf9264d27b16090d7499bf372"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f753981cf9264d27b16090d7499bf372"}]}] Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TaggedBootDevicesTest-1190023964 Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f753981cf9264d27b16090d7499bf372 Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1190023964 Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TaggedBootDevicesTest-1190023964-project Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 176b78609fe64a958eb12cddae83c0b9 Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TaggedBootDevicesTest-1190023964-project Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f could not be found. Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'c3719a07-cdb1-4a88-a1b4-a0700aa08c4f'} Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f could not be found. Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:12:07.445556 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:12:07.450827 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f could not be found. Sep 06 11:12:07.450827 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:07.450827 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:07.450827 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:07.450827 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:07.450827 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:07.450827 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:07.450827 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:12:07.450827 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:12:07.450827 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f could not be found. Sep 06 11:12:07.450827 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:07.453923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cc727ee6-6ca5-4ee8-b26e-bcd048822160 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Returning 404 to user: Instance c3719a07-cdb1-4a88-a1b4-a0700aa08c4f could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:12:07.455428 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cc727ee6-6ca5-4ee8-b26e-bcd048822160 tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f" status: 404 len: 111 microversion: 2.32 time: 0.107021 Sep 06 11:12:07.456350 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2300/4564] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:07 2022] GET /compute/v2.1/servers/c3719a07-cdb1-4a88-a1b4-a0700aa08c4f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:12:07.461686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ff9adf15-66ca-41bf-9801-04ce02ea53d2 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f31934c0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:07.583373 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ff9adf15-66ca-41bf-9801-04ce02ea53d2 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.125411 Sep 06 11:12:07.584290 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2301/4565] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:07 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:07.608539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e18129f9-36e6-42e8-a4e1-32d6cf1b42ae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] Calling method '.version_select at 0x7f90f34c1ee0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:07.738841 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e18129f9-36e6-42e8-a4e1-32d6cf1b42ae tempest-TaggedBootDevicesTest-1190023964 tempest-TaggedBootDevicesTest-1190023964-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585845559" status: 204 len: 0 microversion: 2.32 time: 0.143006 Sep 06 11:12:07.740879 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2302/4566] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 11:12:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585845559 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:12:08.375353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c6df710c-53e1-425d-b9a2-7107d6ab890a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:08.376457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c6df710c-53e1-425d-b9a2-7107d6ab890a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:08.391587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6df710c-53e1-425d-b9a2-7107d6ab890a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:08.392456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6df710c-53e1-425d-b9a2-7107d6ab890a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:08.393764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6df710c-53e1-425d-b9a2-7107d6ab890a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:08.394786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6df710c-53e1-425d-b9a2-7107d6ab890a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:08.395529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6df710c-53e1-425d-b9a2-7107d6ab890a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:08.396243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6df710c-53e1-425d-b9a2-7107d6ab890a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:08.401042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Updating instance_info_cache with network_info: [{"id": "c5a9fd30-3a11-467d-84cf-1398f51c8010", "address": "fa:16:3e:b1:b9:e2", "network": {"id": "2c1774da-ae6e-41ab-9030-18c5a6bd4120", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-472368625-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0444d17c98fd486faf23794180465b3d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc5a9fd30-3a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140875) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 06 11:12:08.411881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Releasing lock "refresh_cache-76977a0f-f682-4968-96cf-58fff0c6625b" {{(pid=140875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 11:12:08.415464 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6c128f67-82e9-4b0e-b34e-ec201f05ca37 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "POST /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b/action" status: 202 len: 0 microversion: 2.1 time: 4.776034 Sep 06 11:12:08.416939 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2265/4567] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:12:03 2022] POST /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b/action => generated 0 bytes in 4778 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 06 11:12:08.439670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e52fe754-03bf-49fb-88ef-51c2bfe12e68 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '.version_select at 0x7f90fcf8c5e0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:08.936829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c6df710c-53e1-425d-b9a2-7107d6ab890a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:08.946015 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c6df710c-53e1-425d-b9a2-7107d6ab890a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1716 microversion: 2.1 time: 0.575969 Sep 06 11:12:08.958013 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2303/4568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:08 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1716 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:12:08.958013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a66a27fb-1034-4bb0-a8f7-5e5b11535b0d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3193af0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:09.020899 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a66a27fb-1034-4bb0-a8f7-5e5b11535b0d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.072411 Sep 06 11:12:09.021928 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2304/4569] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:08 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:09.323783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-588ad590-f1e4-4ac3-a9ae-fb05e2c04959 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:09.324957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-588ad590-f1e4-4ac3-a9ae-fb05e2c04959 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:09.341298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-588ad590-f1e4-4ac3-a9ae-fb05e2c04959 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:09.350091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-588ad590-f1e4-4ac3-a9ae-fb05e2c04959 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:09.350813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-588ad590-f1e4-4ac3-a9ae-fb05e2c04959 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:09.351693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-588ad590-f1e4-4ac3-a9ae-fb05e2c04959 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:09.352384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-588ad590-f1e4-4ac3-a9ae-fb05e2c04959 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:09.354456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-588ad590-f1e4-4ac3-a9ae-fb05e2c04959 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:09.577126 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-588ad590-f1e4-4ac3-a9ae-fb05e2c04959 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] HTTP exception thrown: Cannot 'detach_volume' instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc while it is in vm_state rescued Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-588ad590-f1e4-4ac3-a9ae-fb05e2c04959 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Request method failure captured: Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-volume_attachments/4a3210df-d0c2-4ecf-8e6c-945d63b3906c HTTP/1.1 Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFypBCZVzhsRBhBANMStQFyeCLS5PmKt-tnLIYX5sT_ENc4vLLwScYTWL5yqaaxpUhllGbPc3oIWuuzLq-Hr-H-vcfxt82OKYl89zSQBoVSvyllXHebYOgIiQtfQzKHMF-bGKhrOYJft0jC5PHYUnd4l11fkckESPh53h8qp5BGDnUAg Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}] Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e45dfaf9fd949548bca37303a117bb1 Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: exception: Cannot 'detach_volume' instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc while it is in vm_state rescued Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'server_id': '7aa9fb77-6ffc-4a34-9db9-3ba749d98afc', 'id': '4a3210df-d0c2-4ecf-8e6c-945d63b3906c'} Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc while it is in vm_state rescued Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:09.587358 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:09.592626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:09.592626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:09.592626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:12:09.592626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:12:09.592626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc while it is in vm_state rescued Sep 06 11:12:09.592626 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:09.592626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-588ad590-f1e4-4ac3-a9ae-fb05e2c04959 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Returning 409 to user: Cannot 'detach_volume' instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc while it is in vm_state rescued {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:12:09.592626 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-588ad590-f1e4-4ac3-a9ae-fb05e2c04959 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-volume_attachments/4a3210df-d0c2-4ecf-8e6c-945d63b3906c" status: 409 len: 152 microversion: 2.1 time: 0.269977 Sep 06 11:12:09.592626 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2305/4570] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 11:12:09 2022] DELETE /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-volume_attachments/4a3210df-d0c2-4ecf-8e6c-945d63b3906c => generated 152 bytes in 273 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 06 11:12:09.603846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c4a5fbfe-0138-4767-9d87-f38a76b82fc7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:09.604814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c4a5fbfe-0138-4767-9d87-f38a76b82fc7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:09.613446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4a5fbfe-0138-4767-9d87-f38a76b82fc7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:09.614578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4a5fbfe-0138-4767-9d87-f38a76b82fc7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:09.615088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4a5fbfe-0138-4767-9d87-f38a76b82fc7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:09.615844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4a5fbfe-0138-4767-9d87-f38a76b82fc7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:09.616323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4a5fbfe-0138-4767-9d87-f38a76b82fc7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:09.616769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4a5fbfe-0138-4767-9d87-f38a76b82fc7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:09.916036 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c4a5fbfe-0138-4767-9d87-f38a76b82fc7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/action" status: 202 len: 0 microversion: 2.1 time: 0.318790 Sep 06 11:12:09.917738 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2306/4571] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:12:09 2022] POST /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:12:09.937125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e868de2e-0940-40df-bdd2-26f8a2b048af tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:09.937867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e868de2e-0940-40df-bdd2-26f8a2b048af tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:09.956988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e868de2e-0940-40df-bdd2-26f8a2b048af tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:09.967146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e868de2e-0940-40df-bdd2-26f8a2b048af tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:09.967935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e868de2e-0940-40df-bdd2-26f8a2b048af tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:09.968915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e868de2e-0940-40df-bdd2-26f8a2b048af tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:09.972774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e868de2e-0940-40df-bdd2-26f8a2b048af tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:09.973352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e868de2e-0940-40df-bdd2-26f8a2b048af tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:10.560424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e868de2e-0940-40df-bdd2-26f8a2b048af tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:10.566923 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e52fe754-03bf-49fb-88ef-51c2bfe12e68 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/5b98f91d-318d-4d25-a6c0-7d0123805206" status: 202 len: 0 microversion: 2.1 time: 2.143210 Sep 06 11:12:10.566923 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2266/4572] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:12:08 2022] DELETE /compute/v2.1/os-floating-ips/5b98f91d-318d-4d25-a6c0-7d0123805206 => generated 0 bytes in 2145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:12:10.573846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-45723de5-2e74-4188-8b53-15c47b79175c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90fcf5c040>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:10.580983 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e868de2e-0940-40df-bdd2-26f8a2b048af tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1724 microversion: 2.1 time: 0.657507 Sep 06 11:12:10.596866 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2307/4573] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:09 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1724 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:10.619407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-65f718ff-17ff-409e-bf82-c42a5bf189bc tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '.version_select at 0x7f90f31bc5e0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:10.662115 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-45723de5-2e74-4188-8b53-15c47b79175c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.093103 Sep 06 11:12:10.663885 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2267/4574] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:10 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:11.355375 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-65f718ff-17ff-409e-bf82-c42a5bf189bc tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/360941c6-f86e-4318-a06c-3daf905b2685" status: 202 len: 0 microversion: 2.1 time: 0.754484 Sep 06 11:12:11.355375 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2308/4575] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 11:12:10 2022] DELETE /compute/v2.1/os-security-groups/360941c6-f86e-4318-a06c-3daf905b2685 => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:12:11.364451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3937d16e-a8fe-419a-95ae-6a822b3882a9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:11.365294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3937d16e-a8fe-419a-95ae-6a822b3882a9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:11.373401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3937d16e-a8fe-419a-95ae-6a822b3882a9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:11.374327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3937d16e-a8fe-419a-95ae-6a822b3882a9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:11.376257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3937d16e-a8fe-419a-95ae-6a822b3882a9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:11.377535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3937d16e-a8fe-419a-95ae-6a822b3882a9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:11.378632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3937d16e-a8fe-419a-95ae-6a822b3882a9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:11.379402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3937d16e-a8fe-419a-95ae-6a822b3882a9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:11.433505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3937d16e-a8fe-419a-95ae-6a822b3882a9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:12:11.604430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2bd1b629-0605-474a-9899-95093ce67ebd tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:11.606880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2bd1b629-0605-474a-9899-95093ce67ebd tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:11.621560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bd1b629-0605-474a-9899-95093ce67ebd tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:11.624127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bd1b629-0605-474a-9899-95093ce67ebd tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:11.624906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bd1b629-0605-474a-9899-95093ce67ebd tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:11.628666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bd1b629-0605-474a-9899-95093ce67ebd tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:11.629451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bd1b629-0605-474a-9899-95093ce67ebd tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:11.630247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bd1b629-0605-474a-9899-95093ce67ebd tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:11.849526 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3937d16e-a8fe-419a-95ae-6a822b3882a9 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 204 len: 0 microversion: 2.1 time: 0.491018 Sep 06 11:12:11.850321 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2268/4576] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:12:11 2022] DELETE /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:12:11.858150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e10e0022-91c0-43e4-9b4c-bdc5cdce0b92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90fcf8c700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:11.954641 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e10e0022-91c0-43e4-9b4c-bdc5cdce0b92 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.102963 Sep 06 11:12:11.959232 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2269/4577] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:11 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:11.969822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-46d198e6-76d2-44f0-8ec9-9996045d8b85 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:11.969822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-46d198e6-76d2-44f0-8ec9-9996045d8b85 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:11.976695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46d198e6-76d2-44f0-8ec9-9996045d8b85 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:11.977203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46d198e6-76d2-44f0-8ec9-9996045d8b85 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:11.978034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46d198e6-76d2-44f0-8ec9-9996045d8b85 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:11.978370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46d198e6-76d2-44f0-8ec9-9996045d8b85 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:11.978846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46d198e6-76d2-44f0-8ec9-9996045d8b85 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:11.982912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46d198e6-76d2-44f0-8ec9-9996045d8b85 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:12.153061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2bd1b629-0605-474a-9899-95093ce67ebd tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:12.153061 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2bd1b629-0605-474a-9899-95093ce67ebd tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1724 microversion: 2.1 time: 0.498513 Sep 06 11:12:12.153061 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2309/4578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:11 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1724 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:12.293297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-46d198e6-76d2-44f0-8ec9-9996045d8b85 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:12.306590 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-46d198e6-76d2-44f0-8ec9-9996045d8b85 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1509 microversion: 2.1 time: 0.345362 Sep 06 11:12:12.327308 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2270/4579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:11 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:12.971655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1b9a2696-ff0d-4a48-b479-1bcdddd0ff14 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3193c10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:13.031056 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1b9a2696-ff0d-4a48-b479-1bcdddd0ff14 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.064470 Sep 06 11:12:13.032090 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2310/4580] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:12 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:13.180057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4210f305-be1e-42e1-aad7-719facb3d0b1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:13.180686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4210f305-be1e-42e1-aad7-719facb3d0b1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:13.193830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4210f305-be1e-42e1-aad7-719facb3d0b1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:13.195735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4210f305-be1e-42e1-aad7-719facb3d0b1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:13.197857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4210f305-be1e-42e1-aad7-719facb3d0b1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:13.198842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4210f305-be1e-42e1-aad7-719facb3d0b1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:13.200609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4210f305-be1e-42e1-aad7-719facb3d0b1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:13.201293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4210f305-be1e-42e1-aad7-719facb3d0b1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:13.342743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e7119564-7d3c-4b4b-9c06-b09af0c81146 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:13.343717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e7119564-7d3c-4b4b-9c06-b09af0c81146 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:13.360772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7119564-7d3c-4b4b-9c06-b09af0c81146 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:13.361799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7119564-7d3c-4b4b-9c06-b09af0c81146 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:13.362444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7119564-7d3c-4b4b-9c06-b09af0c81146 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:13.363512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7119564-7d3c-4b4b-9c06-b09af0c81146 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:13.374501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7119564-7d3c-4b4b-9c06-b09af0c81146 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:13.375246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7119564-7d3c-4b4b-9c06-b09af0c81146 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:13.617337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4210f305-be1e-42e1-aad7-719facb3d0b1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:13.631866 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4210f305-be1e-42e1-aad7-719facb3d0b1 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1724 microversion: 2.1 time: 0.460874 Sep 06 11:12:13.635201 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2271/4581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:13 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1724 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:13.690582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e7119564-7d3c-4b4b-9c06-b09af0c81146 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:13.700932 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e7119564-7d3c-4b4b-9c06-b09af0c81146 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1509 microversion: 2.1 time: 0.362679 Sep 06 11:12:13.702211 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2311/4582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:13 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1509 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:12:14.047902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-85609d44-6049-4821-91cd-1ddcb2dafab5 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f36cb550>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:14.119845 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-85609d44-6049-4821-91cd-1ddcb2dafab5 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.075696 Sep 06 11:12:14.122664 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2272/4583] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:14 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:14.660502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a1f32ffc-0bc5-4a64-b90a-8616feea3852 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:14.661231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a1f32ffc-0bc5-4a64-b90a-8616feea3852 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:14.670199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1f32ffc-0bc5-4a64-b90a-8616feea3852 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:14.670726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1f32ffc-0bc5-4a64-b90a-8616feea3852 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:14.671256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1f32ffc-0bc5-4a64-b90a-8616feea3852 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:14.671987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1f32ffc-0bc5-4a64-b90a-8616feea3852 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:14.672481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1f32ffc-0bc5-4a64-b90a-8616feea3852 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:14.672987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1f32ffc-0bc5-4a64-b90a-8616feea3852 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:14.732450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1f2144dc-a5c0-4491-a915-355693840889 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:14.733808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1f2144dc-a5c0-4491-a915-355693840889 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:14.748839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f2144dc-a5c0-4491-a915-355693840889 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:14.749538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f2144dc-a5c0-4491-a915-355693840889 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:14.749925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f2144dc-a5c0-4491-a915-355693840889 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:14.750848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f2144dc-a5c0-4491-a915-355693840889 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:14.751350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f2144dc-a5c0-4491-a915-355693840889 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:14.752024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f2144dc-a5c0-4491-a915-355693840889 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:14.894324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a1f32ffc-0bc5-4a64-b90a-8616feea3852 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:14.903646 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a1f32ffc-0bc5-4a64-b90a-8616feea3852 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1724 microversion: 2.1 time: 0.247065 Sep 06 11:12:14.938525 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2312/4584] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:14 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:14.939409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1f2144dc-a5c0-4491-a915-355693840889 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:14.939409 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1f2144dc-a5c0-4491-a915-355693840889 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1509 microversion: 2.1 time: 0.205215 Sep 06 11:12:14.939409 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2273/4585] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:14 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:15.145881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eef96146-7710-4c27-8dc5-4824edb0a083 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3193280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:15.269266 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eef96146-7710-4c27-8dc5-4824edb0a083 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.133903 Sep 06 11:12:15.271413 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2313/4586] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:15 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:15.932540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9c809a9-0777-4c79-a5a1-7b28df79717b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:15.933819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c9c809a9-0777-4c79-a5a1-7b28df79717b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:15.958190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e9d0b5dc-4e49-45f2-83a9-f3a2e1cb1d8d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:15.958833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e9d0b5dc-4e49-45f2-83a9-f3a2e1cb1d8d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:15.965033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9c809a9-0777-4c79-a5a1-7b28df79717b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:15.968828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9c809a9-0777-4c79-a5a1-7b28df79717b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:15.970138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9c809a9-0777-4c79-a5a1-7b28df79717b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:15.978512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9d0b5dc-4e49-45f2-83a9-f3a2e1cb1d8d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:15.978797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9c809a9-0777-4c79-a5a1-7b28df79717b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:15.980800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9c809a9-0777-4c79-a5a1-7b28df79717b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:15.981552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9d0b5dc-4e49-45f2-83a9-f3a2e1cb1d8d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:15.982269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9c809a9-0777-4c79-a5a1-7b28df79717b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:15.984112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9d0b5dc-4e49-45f2-83a9-f3a2e1cb1d8d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:15.989319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9d0b5dc-4e49-45f2-83a9-f3a2e1cb1d8d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:15.990297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9d0b5dc-4e49-45f2-83a9-f3a2e1cb1d8d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:15.990962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9d0b5dc-4e49-45f2-83a9-f3a2e1cb1d8d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:16.089641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e9d0b5dc-4e49-45f2-83a9-f3a2e1cb1d8d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:16.097960 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e9d0b5dc-4e49-45f2-83a9-f3a2e1cb1d8d tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1467 microversion: 2.1 time: 0.145540 Sep 06 11:12:16.098543 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2314/4587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:15 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1467 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:16.103909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-e0e0d6be-ae72-487f-9f6a-c1f1c8450a07 req-9a90669a-fdb1-483e-a491-5bc4408002c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76977a0f-f682-4968-96cf-58fff0c6625b", "name": "network-vif-deleted", "tag": "c5a9fd30-3a11-467d-84cf-1398f51c8010"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:16.118234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e0e0d6be-ae72-487f-9f6a-c1f1c8450a07 req-9a90669a-fdb1-483e-a491-5bc4408002c5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:16.118837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e0e0d6be-ae72-487f-9f6a-c1f1c8450a07 req-9a90669a-fdb1-483e-a491-5bc4408002c5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:16.119310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e0e0d6be-ae72-487f-9f6a-c1f1c8450a07 req-9a90669a-fdb1-483e-a491-5bc4408002c5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:16.131989 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-e0e0d6be-ae72-487f-9f6a-c1f1c8450a07 req-9a90669a-fdb1-483e-a491-5bc4408002c5 service nova] Creating event network-vif-deleted:c5a9fd30-3a11-467d-84cf-1398f51c8010 for instance 76977a0f-f682-4968-96cf-58fff0c6625b on nch2-master-1 Sep 06 11:12:16.137437 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-e0e0d6be-ae72-487f-9f6a-c1f1c8450a07 req-9a90669a-fdb1-483e-a491-5bc4408002c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037549 Sep 06 11:12:16.138058 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2315/4588] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:16.168495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c9c809a9-0777-4c79-a5a1-7b28df79717b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:16.180086 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c9c809a9-0777-4c79-a5a1-7b28df79717b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1730 microversion: 2.1 time: 0.251657 Sep 06 11:12:16.184851 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2274/4589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:15 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1730 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:16.208217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbc47517-18cf-4f36-b716-372c0eb48491 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:16.219725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fbc47517-18cf-4f36-b716-372c0eb48491 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:16.224788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc47517-18cf-4f36-b716-372c0eb48491 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:16.224788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc47517-18cf-4f36-b716-372c0eb48491 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:16.224788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc47517-18cf-4f36-b716-372c0eb48491 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:16.224788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc47517-18cf-4f36-b716-372c0eb48491 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:16.226602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc47517-18cf-4f36-b716-372c0eb48491 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:16.227618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc47517-18cf-4f36-b716-372c0eb48491 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:16.265615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:16.288302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8f9d9c18-67f9-47da-8fb1-dcd4f4fdc73c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f8567790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:16.340056 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8f9d9c18-67f9-47da-8fb1-dcd4f4fdc73c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1455 microversion: 2.1 time: 0.055810 Sep 06 11:12:16.342912 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fbc47517-18cf-4f36-b716-372c0eb48491 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142532 Sep 06 11:12:16.344443 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2316/4590] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:12:16 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:12:16.351212 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2275/4591] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:16 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:12:17.125839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:17.127138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:17.134911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:17.135669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:17.136685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:17.137430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:17.137927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:17.138371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:17.176576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:17.176576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:17.176576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:17.176576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lazy-loading 'fault' on Instance uuid 76977a0f-f682-4968-96cf-58fff0c6625b {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:12:17.232618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0444d17c98fd486faf23794180465b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:17.256480 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7136ed89-ea76-48c4-8761-2cacd0a94c55 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 200 len: 1313 microversion: 2.1 time: 0.123941 Sep 06 11:12:17.256480 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2317/4592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:17 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 1313 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:17.360449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d4884eec-c25e-4225-bde7-1cae9b45d2a0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f36dd940>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:17.425437 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d4884eec-c25e-4225-bde7-1cae9b45d2a0 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1464 microversion: 2.1 time: 0.073007 Sep 06 11:12:17.426329 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2276/4593] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:17 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1464 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:17.443246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-000f133a-6092-4b5e-b454-b3b54451049d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3733dc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:17.519611 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-000f133a-6092-4b5e-b454-b3b54451049d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 200 len: 1464 microversion: 2.1 time: 0.082013 Sep 06 11:12:17.520418 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2318/4594] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:17 2022] GET /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 1464 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:17.538335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-58509deb-f6cb-43c9-9a4e-91c5e6da2604 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:17.539070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-58509deb-f6cb-43c9-9a4e-91c5e6da2604 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:17.548318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58509deb-f6cb-43c9-9a4e-91c5e6da2604 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:17.549262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58509deb-f6cb-43c9-9a4e-91c5e6da2604 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:17.550110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58509deb-f6cb-43c9-9a4e-91c5e6da2604 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:17.552625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58509deb-f6cb-43c9-9a4e-91c5e6da2604 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:17.553269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58509deb-f6cb-43c9-9a4e-91c5e6da2604 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:17.553728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58509deb-f6cb-43c9-9a4e-91c5e6da2604 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:17.837490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-58509deb-f6cb-43c9-9a4e-91c5e6da2604 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:17.847254 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-58509deb-f6cb-43c9-9a4e-91c5e6da2604 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597" status: 200 len: 1467 microversion: 2.1 time: 0.313393 Sep 06 11:12:17.848354 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2277/4595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:17 2022] GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597 => generated 1467 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:17.872293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-94cf66d2-c6ab-4050-984f-26af42873724 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3126820>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:18.019642 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-94cf66d2-c6ab-4050-984f-26af42873724 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images?changes-since=2022-09-06T11%3A10%3A21Z" status: 200 len: 2374 microversion: 2.1 time: 0.151264 Sep 06 11:12:18.022511 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2319/4596] 10.222.0.20 () {58 vars in 1199 bytes} [Tue Sep 6 11:12:17 2022] GET /compute/v2.1/images?changes-since=2022-09-06T11%3A10%3A21Z => generated 2374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:12:18.054630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bed567f3-6011-4648-80e1-2833728b15ee tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f83a7790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:18.135548 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bed567f3-6011-4648-80e1-2833728b15ee tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-130927385" status: 200 len: 484 microversion: 2.1 time: 0.089631 Sep 06 11:12:18.136803 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2278/4597] 10.222.0.20 () {58 vars in 1229 bytes} [Tue Sep 6 11:12:18 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-130927385 => generated 484 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:18.158007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c8b6efa7-ce58-4749-b427-49c03f0f3d55 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f31d51f0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:18.165346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-23d8c21e-e17a-4f5e-9dcd-d8a99abda551 req-87193952-d2d6-4dea-ba3b-d828cb72535c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa9fb77-6ffc-4a34-9db9-3ba749d98afc", "tag": "33293afd-e865-4886-9b9b-f1ae1fefac75"}, {"name": "network-changed", "server_uuid": "7aa9fb77-6ffc-4a34-9db9-3ba749d98afc", "tag": "33293afd-e865-4886-9b9b-f1ae1fefac75"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:18.181360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-23d8c21e-e17a-4f5e-9dcd-d8a99abda551 req-87193952-d2d6-4dea-ba3b-d828cb72535c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:18.181360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-23d8c21e-e17a-4f5e-9dcd-d8a99abda551 req-87193952-d2d6-4dea-ba3b-d828cb72535c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:18.181750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-23d8c21e-e17a-4f5e-9dcd-d8a99abda551 req-87193952-d2d6-4dea-ba3b-d828cb72535c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:18.195201 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-23d8c21e-e17a-4f5e-9dcd-d8a99abda551 req-87193952-d2d6-4dea-ba3b-d828cb72535c service nova] Creating event network-changed:33293afd-e865-4886-9b9b-f1ae1fefac75 for instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc on nch2-master-1 Sep 06 11:12:18.196104 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-23d8c21e-e17a-4f5e-9dcd-d8a99abda551 req-87193952-d2d6-4dea-ba3b-d828cb72535c service nova] Creating event network-changed:33293afd-e865-4886-9b9b-f1ae1fefac75 for instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc on nch2-master-1 Sep 06 11:12:18.204885 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-23d8c21e-e17a-4f5e-9dcd-d8a99abda551 req-87193952-d2d6-4dea-ba3b-d828cb72535c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044163 Sep 06 11:12:18.206046 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2279/4598] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:18.268195 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c8b6efa7-ce58-4749-b427-49c03f0f3d55 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images?server=77d53b0f-bd9f-479e-948b-bbefbd0d8597" status: 200 len: 957 microversion: 2.1 time: 0.121177 Sep 06 11:12:18.268795 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2320/4599] 10.222.0.20 () {58 vars in 1209 bytes} [Tue Sep 6 11:12:18 2022] GET /compute/v2.1/images?server=77d53b0f-bd9f-479e-948b-bbefbd0d8597 => generated 957 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:18.287350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24acdfd4-3975-40e4-b3ba-4fbf5e2a66f8 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:18.289468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-24acdfd4-3975-40e4-b3ba-4fbf5e2a66f8 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] [instance: 76977a0f-f682-4968-96cf-58fff0c6625b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:18.301826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bf933b14-bdfd-4aca-a122-2767f7967faa tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3820ca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:18.308052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24acdfd4-3975-40e4-b3ba-4fbf5e2a66f8 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:18.308641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24acdfd4-3975-40e4-b3ba-4fbf5e2a66f8 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:18.309090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24acdfd4-3975-40e4-b3ba-4fbf5e2a66f8 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:18.310478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24acdfd4-3975-40e4-b3ba-4fbf5e2a66f8 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:18.310955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24acdfd4-3975-40e4-b3ba-4fbf5e2a66f8 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:18.311430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24acdfd4-3975-40e4-b3ba-4fbf5e2a66f8 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:18.329936 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-24acdfd4-3975-40e4-b3ba-4fbf5e2a66f8 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] HTTP exception thrown: Instance 76977a0f-f682-4968-96cf-58fff0c6625b could not be found. Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24acdfd4-3975-40e4-b3ba-4fbf5e2a66f8 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Request method failure captured: Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b HTTP/1.1 Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyq8fpq4lllWOdRLsul-qh-TwHBiGJIuSl_Pjk2s8jrM2kd2ZeLnAXcQMfjIJl3JG5D4XvKWaIPmIBN0IxBIKHn8ONpsq5E1Laohal70XFb1tRXhWsxywZsLWW3Gsl53VQufnGugb2WTem5iRbxCQFXxy7FPhwrEwpM5YwMlWJtb-P0 Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0444d17c98fd486faf23794180465b3d Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1089806142 Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0444d17c98fd486faf23794180465b3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0444d17c98fd486faf23794180465b3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0444d17c98fd486faf23794180465b3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0444d17c98fd486faf23794180465b3d"}]}] Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1089806142 Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0444d17c98fd486faf23794180465b3d Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1089806142 Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerRescueTestJSONUnderV235-1089806142-project Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 7c58a8e8fcff4ca2afc6c54b9bc4e6e6 Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1089806142-project Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 76977a0f-f682-4968-96cf-58fff0c6625b could not be found. Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '76977a0f-f682-4968-96cf-58fff0c6625b'} Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76977a0f-f682-4968-96cf-58fff0c6625b could not be found. Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76977a0f-f682-4968-96cf-58fff0c6625b could not be found. Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:12:18.332235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:18.337847 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:12:18.337847 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:18.337847 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:18.337847 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:18.337847 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:12:18.337847 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:12:18.337847 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76977a0f-f682-4968-96cf-58fff0c6625b could not be found. Sep 06 11:12:18.337847 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:12:18.337847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24acdfd4-3975-40e4-b3ba-4fbf5e2a66f8 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] Returning 404 to user: Instance 76977a0f-f682-4968-96cf-58fff0c6625b could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:12:18.337847 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-24acdfd4-3975-40e4-b3ba-4fbf5e2a66f8 tempest-ServerRescueTestJSONUnderV235-1089806142 tempest-ServerRescueTestJSONUnderV235-1089806142-project] 10.222.0.20 "GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b" status: 404 len: 111 microversion: 2.1 time: 0.052176 Sep 06 11:12:18.337847 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2280/4600] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:18 2022] GET /compute/v2.1/servers/76977a0f-f682-4968-96cf-58fff0c6625b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:12:18.396193 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bf933b14-bdfd-4aca-a122-2767f7967faa tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 485 microversion: 2.1 time: 0.101343 Sep 06 11:12:18.397465 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2321/4601] 10.222.0.20 () {58 vars in 1317 bytes} [Tue Sep 6 11:12:18 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 485 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:18.412195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1b0965fd-ee42-4413-8b05-bfab66b34423 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90fd0b9ee0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:18.491093 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1b0965fd-ee42-4413-8b05-bfab66b34423 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 485 microversion: 2.1 time: 0.084495 Sep 06 11:12:18.492689 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2281/4602] 10.222.0.20 () {58 vars in 1303 bytes} [Tue Sep 6 11:12:18 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 485 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:18.506883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c676b7b7-02ba-488c-9337-76241336d5ec tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3820670>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:18.689334 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c676b7b7-02ba-488c-9337-76241336d5ec tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.183435 Sep 06 11:12:18.689989 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2322/4603] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 11:12:18 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:18.710467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-abaa0820-0fa6-4ab7-a615-ef5a8b9c9945 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f853fd30>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:18.809771 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-abaa0820-0fa6-4ab7-a615-ef5a8b9c9945 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.104979 Sep 06 11:12:18.827537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2841b40c-8e04-4c18-aade-0d1fd513c96f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3990e50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:18.834581 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2282/4604] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 11:12:18 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:18.894212 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2841b40c-8e04-4c18-aade-0d1fd513c96f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.071434 Sep 06 11:12:18.927761 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2323/4605] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 11:12:18 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:18.928404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-43141a52-b3e9-4129-87cd-d22f08c1eb2a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f8597dc0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:19.045358 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-43141a52-b3e9-4129-87cd-d22f08c1eb2a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/detail?changes-since=2022-09-06T11%3A10%3A15Z" status: 200 len: 6332 microversion: 2.1 time: 0.129306 Sep 06 11:12:19.063249 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2283/4606] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Sep 6 11:12:18 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-06T11%3A10%3A15Z => generated 6332 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:19.073760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe2602b0-390b-4149-a1c4-2bb12adc6f29 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3423f70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:19.129307 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe2602b0-390b-4149-a1c4-2bb12adc6f29 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-130927385" status: 200 len: 664 microversion: 2.1 time: 0.059860 Sep 06 11:12:19.130471 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2324/4607] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Sep 6 11:12:19 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-130927385 => generated 664 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:19.146988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1f9c5d64-3847-48ba-9821-83b8c9237011 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f36cd0d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:19.253565 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1f9c5d64-3847-48ba-9821-83b8c9237011 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1467 microversion: 2.1 time: 0.109285 Sep 06 11:12:19.264433 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2284/4608] 10.222.0.20 () {58 vars in 1338 bytes} [Tue Sep 6 11:12:19 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1467 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:19.273047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-11652467-d849-4bdf-89be-6a60f197a91f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3193c10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:19.350376 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-11652467-d849-4bdf-89be-6a60f197a91f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1467 microversion: 2.1 time: 0.084430 Sep 06 11:12:19.355347 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2325/4609] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Sep 6 11:12:19 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1467 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:12:19.374154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9adc60be-fbc8-4bd4-866a-bdd2057c2186 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f36cd280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:19.515304 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9adc60be-fbc8-4bd4-866a-bdd2057c2186 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.141148 Sep 06 11:12:19.515304 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2285/4610] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Sep 6 11:12:19 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:19.536341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a3e385f7-3f91-4130-8c35-b247b04e918a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f31d5f70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:19.636361 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a3e385f7-3f91-4130-8c35-b247b04e918a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.103077 Sep 06 11:12:19.637556 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2326/4611] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Sep 6 11:12:19 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:19.661182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8dfdccab-7d92-47f9-a269-953171bdedbc tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f369b310>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:19.747469 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8dfdccab-7d92-47f9-a269-953171bdedbc tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f" status: 200 len: 784 microversion: 2.1 time: 0.094460 Sep 06 11:12:19.748082 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2286/4612] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:19 2022] GET /compute/v2.1/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f => generated 784 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:19.770651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-db6ec820-0821-4662-aa25-ef69afe2cc9d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3990a60>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:19.851537 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-db6ec820-0821-4662-aa25-ef69afe2cc9d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.090720 Sep 06 11:12:19.852156 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2327/4613] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 11:12:19 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:19.871498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-83209c0b-035e-4f90-a4a4-34a9085ef485 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90fd0b9f70>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:21.591884 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-83209c0b-035e-4f90-a4a4-34a9085ef485 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "DELETE /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e" status: 204 len: 0 microversion: 2.1 time: 1.726732 Sep 06 11:12:21.593298 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2287/4614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:19 2022] DELETE /compute/v2.1/images/96b2c76a-b420-4b6c-adb1-87dbfb4ebb9e => generated 0 bytes in 1729 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:12:21.603160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-42deb740-439f-4d4a-8249-e1ee512c3604 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3724280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:21.758012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-afec990b-1787-47e8-9c66-a3288bed6d4c req-8d712937-0848-4ae8-bbc2-0376fe745298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d53b0f-bd9f-479e-948b-bbefbd0d8597", "name": "network-vif-unplugged", "status": "completed", "tag": "56dd829f-74c4-4912-9aac-6b30a6e3cd3e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:21.769639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:21.774461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-afec990b-1787-47e8-9c66-a3288bed6d4c req-8d712937-0848-4ae8-bbc2-0376fe745298 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:21.774461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-afec990b-1787-47e8-9c66-a3288bed6d4c req-8d712937-0848-4ae8-bbc2-0376fe745298 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:21.774461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-afec990b-1787-47e8-9c66-a3288bed6d4c req-8d712937-0848-4ae8-bbc2-0376fe745298 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:21.784771 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-afec990b-1787-47e8-9c66-a3288bed6d4c req-8d712937-0848-4ae8-bbc2-0376fe745298 service nova] Creating event network-vif-unplugged:56dd829f-74c4-4912-9aac-6b30a6e3cd3e for instance 77d53b0f-bd9f-479e-948b-bbefbd0d8597 on nch1-master-1 Sep 06 11:12:21.790467 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-afec990b-1787-47e8-9c66-a3288bed6d4c req-8d712937-0848-4ae8-bbc2-0376fe745298 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036571 Sep 06 11:12:21.791770 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2288/4615] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:12:23.574346 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-42deb740-439f-4d4a-8249-e1ee512c3604 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "DELETE /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee" status: 204 len: 0 microversion: 2.1 time: 1.975901 Sep 06 11:12:23.585650 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2328/4616] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:21 2022] DELETE /compute/v2.1/images/0660bfdc-d3d0-4334-bb8d-7164e3efa5ee => generated 0 bytes in 1978 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:12:23.585828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-abee4a6b-2c03-4504-be69-efe9eb9f4363 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90fd160670>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:25.491972 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-abee4a6b-2c03-4504-be69-efe9eb9f4363 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "DELETE /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c" status: 204 len: 0 microversion: 2.1 time: 1.909669 Sep 06 11:12:25.491972 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2289/4617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:23 2022] DELETE /compute/v2.1/images/8728aeef-ceb7-4980-bdab-e7ddb6aa580c => generated 0 bytes in 1912 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:12:25.502705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5684885b-52ea-4786-a866-9601ec004eee tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:25.503637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5684885b-52ea-4786-a866-9601ec004eee tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:25.511889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5684885b-52ea-4786-a866-9601ec004eee tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:25.513011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5684885b-52ea-4786-a866-9601ec004eee tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:25.513881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5684885b-52ea-4786-a866-9601ec004eee tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:25.514863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5684885b-52ea-4786-a866-9601ec004eee tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:25.515765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5684885b-52ea-4786-a866-9601ec004eee tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:25.516426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5684885b-52ea-4786-a866-9601ec004eee tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:25.556504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5684885b-52ea-4786-a866-9601ec004eee tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:12:26.119225 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5684885b-52ea-4786-a866-9601ec004eee tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "DELETE /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 204 len: 0 microversion: 2.1 time: 0.622975 Sep 06 11:12:26.120485 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2329/4618] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:12:25 2022] DELETE /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:12:26.129128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fad9b31c-1707-4e89-9d17-a7fee67fad07 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:26.130002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fad9b31c-1707-4e89-9d17-a7fee67fad07 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:26.138406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fad9b31c-1707-4e89-9d17-a7fee67fad07 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:26.139093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fad9b31c-1707-4e89-9d17-a7fee67fad07 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:26.139776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fad9b31c-1707-4e89-9d17-a7fee67fad07 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:26.140600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fad9b31c-1707-4e89-9d17-a7fee67fad07 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:26.141192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fad9b31c-1707-4e89-9d17-a7fee67fad07 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:26.141942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fad9b31c-1707-4e89-9d17-a7fee67fad07 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:26.204369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1533143833", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": "none"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:26.273954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:12:26.274459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:12:26.274951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:12:26.275398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:12:26.275816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:12:26.287836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:26.288629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:26.289090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:26.289864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:26.294118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:26.294118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:26.314869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Getting quotas for project 472edbb3f752428c8a88aeef89c83b8b. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:12:26.323808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Getting quotas for user 037c64b66ce04347aee1f3e434952dfa and project 472edbb3f752428c8a88aeef89c83b8b. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:12:26.340410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:12:26.344370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:12:26.357706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fad9b31c-1707-4e89-9d17-a7fee67fad07 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:26.368021 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fad9b31c-1707-4e89-9d17-a7fee67fad07 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1473 microversion: 2.1 time: 0.243031 Sep 06 11:12:26.368859 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2330/4619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:26 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1473 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:12:26.490736 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-03ddc3f5-401a-4c95-802b-7cb1f6b598d8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.455789 Sep 06 11:12:26.491877 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2290/4620] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 11:12:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 06 11:12:26.512601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-73638b0d-a900-4288-86cb-8bce4eb20a3c tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:26.513937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-73638b0d-a900-4288-86cb-8bce4eb20a3c tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:26.588161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-73638b0d-a900-4288-86cb-8bce4eb20a3c tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:26.599155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-73638b0d-a900-4288-86cb-8bce4eb20a3c tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:26.600730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-73638b0d-a900-4288-86cb-8bce4eb20a3c tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:26.601868 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-73638b0d-a900-4288-86cb-8bce4eb20a3c tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1278 microversion: 2.54 time: 0.093786 Sep 06 11:12:26.603375 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2331/4621] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:26 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:27.393280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6f7f987d-039f-46c0-942a-da78ae31b51d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:27.394921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6f7f987d-039f-46c0-942a-da78ae31b51d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:27.405035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f7f987d-039f-46c0-942a-da78ae31b51d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:27.406665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f7f987d-039f-46c0-942a-da78ae31b51d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:27.407147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f7f987d-039f-46c0-942a-da78ae31b51d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:27.407874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f7f987d-039f-46c0-942a-da78ae31b51d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:27.408501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f7f987d-039f-46c0-942a-da78ae31b51d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:27.408939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f7f987d-039f-46c0-942a-da78ae31b51d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:27.572687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6f7f987d-039f-46c0-942a-da78ae31b51d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:27.578169 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6f7f987d-039f-46c0-942a-da78ae31b51d tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1473 microversion: 2.1 time: 0.189271 Sep 06 11:12:27.578755 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2291/4622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:27 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1473 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:27.638633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f65a0ba4-0884-4e39-a831-cae5122d98c5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:27.639401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f65a0ba4-0884-4e39-a831-cae5122d98c5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:27.730498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f65a0ba4-0884-4e39-a831-cae5122d98c5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:27.754282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f65a0ba4-0884-4e39-a831-cae5122d98c5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:27.758095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f65a0ba4-0884-4e39-a831-cae5122d98c5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:27.763681 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f65a0ba4-0884-4e39-a831-cae5122d98c5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1278 microversion: 2.54 time: 0.130999 Sep 06 11:12:27.766635 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2332/4623] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:27 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1278 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:28.394324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a83dbd3a-8ca9-40c2-990b-adf3e6bf069e req-d84a4a7d-b08e-47f9-bcf6-f848ca2395b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016c8ecc-3457-4204-ba5b-3e06970ac490", "name": "network-vif-deleted", "tag": "0a339213-93da-46ad-badf-47ea616965d5"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:28.413119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a83dbd3a-8ca9-40c2-990b-adf3e6bf069e req-d84a4a7d-b08e-47f9-bcf6-f848ca2395b3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:28.414104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a83dbd3a-8ca9-40c2-990b-adf3e6bf069e req-d84a4a7d-b08e-47f9-bcf6-f848ca2395b3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:28.414636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a83dbd3a-8ca9-40c2-990b-adf3e6bf069e req-d84a4a7d-b08e-47f9-bcf6-f848ca2395b3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:28.428628 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a83dbd3a-8ca9-40c2-990b-adf3e6bf069e req-d84a4a7d-b08e-47f9-bcf6-f848ca2395b3 service nova] Creating event network-vif-deleted:0a339213-93da-46ad-badf-47ea616965d5 for instance 016c8ecc-3457-4204-ba5b-3e06970ac490 on nch1-master-1 Sep 06 11:12:28.434199 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a83dbd3a-8ca9-40c2-990b-adf3e6bf069e req-d84a4a7d-b08e-47f9-bcf6-f848ca2395b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045506 Sep 06 11:12:28.434993 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2292/4624] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:12:28.601288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2abe12b1-9272-4afb-a683-a6895788d9b1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:28.601887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2abe12b1-9272-4afb-a683-a6895788d9b1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:28.608624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2abe12b1-9272-4afb-a683-a6895788d9b1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:28.609378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2abe12b1-9272-4afb-a683-a6895788d9b1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:28.609833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2abe12b1-9272-4afb-a683-a6895788d9b1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:28.610558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2abe12b1-9272-4afb-a683-a6895788d9b1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:28.611045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2abe12b1-9272-4afb-a683-a6895788d9b1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:28.611489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2abe12b1-9272-4afb-a683-a6895788d9b1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:28.798836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-06011f44-829b-4e26-be60-ebe3687d8d69 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:28.800394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-06011f44-829b-4e26-be60-ebe3687d8d69 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:28.814631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06011f44-829b-4e26-be60-ebe3687d8d69 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:28.815463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06011f44-829b-4e26-be60-ebe3687d8d69 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:28.816228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06011f44-829b-4e26-be60-ebe3687d8d69 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:28.817370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06011f44-829b-4e26-be60-ebe3687d8d69 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:28.818949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06011f44-829b-4e26-be60-ebe3687d8d69 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:28.820112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06011f44-829b-4e26-be60-ebe3687d8d69 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:29.046592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-06011f44-829b-4e26-be60-ebe3687d8d69 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:29.048150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2abe12b1-9272-4afb-a683-a6895788d9b1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:29.057868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-06011f44-829b-4e26-be60-ebe3687d8d69 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:29.058247 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2abe12b1-9272-4afb-a683-a6895788d9b1 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 200 len: 1431 microversion: 2.1 time: 0.460885 Sep 06 11:12:29.059115 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2333/4625] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:28 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 1431 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:29.059639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-06011f44-829b-4e26-be60-ebe3687d8d69 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:29.060901 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-06011f44-829b-4e26-be60-ebe3687d8d69 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1274 microversion: 2.54 time: 0.269400 Sep 06 11:12:29.061474 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2293/4626] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:28 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1274 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:30.090880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-167a8bc1-6f5d-4299-a112-4e67d5a13d74 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:30.092073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-16edd636-6731-43c5-ba74-5fdd3490a94f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:30.093180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-167a8bc1-6f5d-4299-a112-4e67d5a13d74 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:30.094166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-16edd636-6731-43c5-ba74-5fdd3490a94f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 016c8ecc-3457-4204-ba5b-3e06970ac490] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:30.113419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-167a8bc1-6f5d-4299-a112-4e67d5a13d74 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:30.114432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16edd636-6731-43c5-ba74-5fdd3490a94f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:30.115266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16edd636-6731-43c5-ba74-5fdd3490a94f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:30.116023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16edd636-6731-43c5-ba74-5fdd3490a94f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:30.116947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16edd636-6731-43c5-ba74-5fdd3490a94f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:30.117420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16edd636-6731-43c5-ba74-5fdd3490a94f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:30.117869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16edd636-6731-43c5-ba74-5fdd3490a94f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:30.118570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-167a8bc1-6f5d-4299-a112-4e67d5a13d74 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:30.119072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-167a8bc1-6f5d-4299-a112-4e67d5a13d74 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:30.120391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-167a8bc1-6f5d-4299-a112-4e67d5a13d74 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:30.120914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-167a8bc1-6f5d-4299-a112-4e67d5a13d74 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:30.121351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-167a8bc1-6f5d-4299-a112-4e67d5a13d74 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:30.143740 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-16edd636-6731-43c5-ba74-5fdd3490a94f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] HTTP exception thrown: Instance 016c8ecc-3457-4204-ba5b-3e06970ac490 could not be found. Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-16edd636-6731-43c5-ba74-5fdd3490a94f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Request method failure captured: Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 HTTP/1.1 Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyqWDvg7T5KOcGu1uVl2Jy5thDsmB0_a-JkU33sFtnwly0TYzpjJysxkNJ-DGSVadhV54x_Bxvi3R8zn3nnQt1_al8Oz_n2Gz-m7esx-WmQEjVjgButBeEk3lPDxkNTgUFi2T2HTkXJcaYto-Kb3YdT8M4WH1kfahdnfCrm666g16RE Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 515ab27962674e99a602451fb8f3da61 Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ListImageFiltersTestJSON-1618887568 Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_515ab27962674e99a602451fb8f3da61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/515ab27962674e99a602451fb8f3da61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/515ab27962674e99a602451fb8f3da61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/515ab27962674e99a602451fb8f3da61"}]}] Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ListImageFiltersTestJSON-1618887568 Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 515ab27962674e99a602451fb8f3da61 Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1618887568 Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ListImageFiltersTestJSON-1618887568-project Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 973422e272f6404f81fcf4702fcfb5c5 Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ListImageFiltersTestJSON-1618887568-project Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 016c8ecc-3457-4204-ba5b-3e06970ac490 could not be found. Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '016c8ecc-3457-4204-ba5b-3e06970ac490'} Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016c8ecc-3457-4204-ba5b-3e06970ac490 could not be found. Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016c8ecc-3457-4204-ba5b-3e06970ac490 could not be found. Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:30.145764 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:30.150928 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:30.150928 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:30.150928 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:30.150928 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:12:30.150928 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:12:30.150928 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016c8ecc-3457-4204-ba5b-3e06970ac490 could not be found. Sep 06 11:12:30.150928 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:30.152795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-16edd636-6731-43c5-ba74-5fdd3490a94f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Returning 404 to user: Instance 016c8ecc-3457-4204-ba5b-3e06970ac490 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:12:30.153892 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-16edd636-6731-43c5-ba74-5fdd3490a94f tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490" status: 404 len: 111 microversion: 2.1 time: 0.075727 Sep 06 11:12:30.154660 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2334/4627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:30 2022] GET /compute/v2.1/servers/016c8ecc-3457-4204-ba5b-3e06970ac490 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:12:30.163470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7f32397-b2dd-471c-a604-45af75c88762 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:30.164283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d7f32397-b2dd-471c-a604-45af75c88762 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:30.180657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7f32397-b2dd-471c-a604-45af75c88762 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:30.181255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7f32397-b2dd-471c-a604-45af75c88762 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:30.181648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7f32397-b2dd-471c-a604-45af75c88762 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:30.182937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7f32397-b2dd-471c-a604-45af75c88762 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:30.183468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7f32397-b2dd-471c-a604-45af75c88762 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:30.183910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7f32397-b2dd-471c-a604-45af75c88762 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:30.211946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-167a8bc1-6f5d-4299-a112-4e67d5a13d74 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:30.228695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d7f32397-b2dd-471c-a604-45af75c88762 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:12:30.241973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-167a8bc1-6f5d-4299-a112-4e67d5a13d74 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:30.250669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-167a8bc1-6f5d-4299-a112-4e67d5a13d74 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:30.253368 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-167a8bc1-6f5d-4299-a112-4e67d5a13d74 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1338 microversion: 2.54 time: 0.167542 Sep 06 11:12:30.257263 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2294/4628] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:30 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1338 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:30.648963 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d7f32397-b2dd-471c-a604-45af75c88762 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597" status: 204 len: 0 microversion: 2.1 time: 0.489505 Sep 06 11:12:30.649561 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2335/4629] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:12:30 2022] DELETE /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:12:30.660121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6954e653-a52f-4b07-a811-d1173fc7a593 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:30.660755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6954e653-a52f-4b07-a811-d1173fc7a593 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:30.668340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6954e653-a52f-4b07-a811-d1173fc7a593 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:30.668832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6954e653-a52f-4b07-a811-d1173fc7a593 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:30.669479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6954e653-a52f-4b07-a811-d1173fc7a593 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:30.670357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6954e653-a52f-4b07-a811-d1173fc7a593 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:30.671001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6954e653-a52f-4b07-a811-d1173fc7a593 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:30.671751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6954e653-a52f-4b07-a811-d1173fc7a593 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:30.813093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6954e653-a52f-4b07-a811-d1173fc7a593 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:30.822086 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6954e653-a52f-4b07-a811-d1173fc7a593 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597" status: 200 len: 1473 microversion: 2.1 time: 0.167611 Sep 06 11:12:30.822688 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2295/4630] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:30 2022] GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597 => generated 1473 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:31.287450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eac53ac3-ba43-46d9-9075-903bdc810f0e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:31.288166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eac53ac3-ba43-46d9-9075-903bdc810f0e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:31.295167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eac53ac3-ba43-46d9-9075-903bdc810f0e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:31.295646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eac53ac3-ba43-46d9-9075-903bdc810f0e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:31.296082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eac53ac3-ba43-46d9-9075-903bdc810f0e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:31.296797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eac53ac3-ba43-46d9-9075-903bdc810f0e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:31.297252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eac53ac3-ba43-46d9-9075-903bdc810f0e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:31.297681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eac53ac3-ba43-46d9-9075-903bdc810f0e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:31.380985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eac53ac3-ba43-46d9-9075-903bdc810f0e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:31.390727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eac53ac3-ba43-46d9-9075-903bdc810f0e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:31.392274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eac53ac3-ba43-46d9-9075-903bdc810f0e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:31.393465 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eac53ac3-ba43-46d9-9075-903bdc810f0e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1336 microversion: 2.54 time: 0.110827 Sep 06 11:12:31.394028 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2336/4631] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:31 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:31.847350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c26205d-0974-4373-b116-cf8f61bea4d6 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:31.848157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c26205d-0974-4373-b116-cf8f61bea4d6 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:31.856234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c26205d-0974-4373-b116-cf8f61bea4d6 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:31.856728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c26205d-0974-4373-b116-cf8f61bea4d6 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:31.857384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c26205d-0974-4373-b116-cf8f61bea4d6 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:31.858712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c26205d-0974-4373-b116-cf8f61bea4d6 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:31.859477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c26205d-0974-4373-b116-cf8f61bea4d6 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:31.860192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c26205d-0974-4373-b116-cf8f61bea4d6 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:32.079296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2c26205d-0974-4373-b116-cf8f61bea4d6 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:32.091568 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c26205d-0974-4373-b116-cf8f61bea4d6 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597" status: 200 len: 1473 microversion: 2.1 time: 0.248355 Sep 06 11:12:32.092765 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2296/4632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:31 2022] GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597 => generated 1473 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:32.425122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2957d372-7c58-43b4-9a07-6cac565c9887 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:32.425861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2957d372-7c58-43b4-9a07-6cac565c9887 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:32.433536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2957d372-7c58-43b4-9a07-6cac565c9887 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:32.434112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2957d372-7c58-43b4-9a07-6cac565c9887 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:32.434601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2957d372-7c58-43b4-9a07-6cac565c9887 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:32.453952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2957d372-7c58-43b4-9a07-6cac565c9887 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:32.453952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2957d372-7c58-43b4-9a07-6cac565c9887 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:32.453952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2957d372-7c58-43b4-9a07-6cac565c9887 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:32.515147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2957d372-7c58-43b4-9a07-6cac565c9887 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:32.529323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2957d372-7c58-43b4-9a07-6cac565c9887 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:32.530975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2957d372-7c58-43b4-9a07-6cac565c9887 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:32.532306 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2957d372-7c58-43b4-9a07-6cac565c9887 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1336 microversion: 2.54 time: 0.111299 Sep 06 11:12:32.533324 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2337/4633] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:32 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:33.117100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-234671fa-261b-4907-9003-6acbf762891a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:33.118679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-234671fa-261b-4907-9003-6acbf762891a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:33.126115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-234671fa-261b-4907-9003-6acbf762891a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:33.126828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-234671fa-261b-4907-9003-6acbf762891a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:33.127316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-234671fa-261b-4907-9003-6acbf762891a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:33.128247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-234671fa-261b-4907-9003-6acbf762891a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:33.129059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-234671fa-261b-4907-9003-6acbf762891a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:33.129502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-234671fa-261b-4907-9003-6acbf762891a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:33.292916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-234671fa-261b-4907-9003-6acbf762891a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:33.295233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:33.319867 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-234671fa-261b-4907-9003-6acbf762891a tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597" status: 200 len: 1473 microversion: 2.1 time: 0.192271 Sep 06 11:12:33.319867 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2297/4634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:33 2022] GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597 => generated 1473 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:33.560509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bd03fc3d-ebb1-44f9-b8b4-84b0861e9907 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:33.562436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bd03fc3d-ebb1-44f9-b8b4-84b0861e9907 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:33.578146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:33.591146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd03fc3d-ebb1-44f9-b8b4-84b0861e9907 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:33.591660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd03fc3d-ebb1-44f9-b8b4-84b0861e9907 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:33.597031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd03fc3d-ebb1-44f9-b8b4-84b0861e9907 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:33.599202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd03fc3d-ebb1-44f9-b8b4-84b0861e9907 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:33.599872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd03fc3d-ebb1-44f9-b8b4-84b0861e9907 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:33.600357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd03fc3d-ebb1-44f9-b8b4-84b0861e9907 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:33.654457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-1321f08c-a0ab-49d4-ae73-1f6cd5140a47 req-2062b6c4-885b-469e-b3c1-e3644c0b87f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d53b0f-bd9f-479e-948b-bbefbd0d8597", "name": "network-vif-deleted", "tag": "56dd829f-74c4-4912-9aac-6b30a6e3cd3e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:33.673652 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1321f08c-a0ab-49d4-ae73-1f6cd5140a47 req-2062b6c4-885b-469e-b3c1-e3644c0b87f6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:33.674146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1321f08c-a0ab-49d4-ae73-1f6cd5140a47 req-2062b6c4-885b-469e-b3c1-e3644c0b87f6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:33.674771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1321f08c-a0ab-49d4-ae73-1f6cd5140a47 req-2062b6c4-885b-469e-b3c1-e3644c0b87f6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:33.694700 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-1321f08c-a0ab-49d4-ae73-1f6cd5140a47 req-2062b6c4-885b-469e-b3c1-e3644c0b87f6 service nova] Creating event network-vif-deleted:56dd829f-74c4-4912-9aac-6b30a6e3cd3e for instance 77d53b0f-bd9f-479e-948b-bbefbd0d8597 on nch1-master-1 Sep 06 11:12:33.700845 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-1321f08c-a0ab-49d4-ae73-1f6cd5140a47 req-2062b6c4-885b-469e-b3c1-e3644c0b87f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050028 Sep 06 11:12:33.702371 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2298/4635] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:33.744379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bd03fc3d-ebb1-44f9-b8b4-84b0861e9907 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:33.758413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bd03fc3d-ebb1-44f9-b8b4-84b0861e9907 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:33.764618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bd03fc3d-ebb1-44f9-b8b4-84b0861e9907 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:33.766648 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bd03fc3d-ebb1-44f9-b8b4-84b0861e9907 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1357 microversion: 2.54 time: 0.212572 Sep 06 11:12:33.767560 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2338/4636] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:33 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:33.798143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1f338943-7cbd-42fe-96b7-c4a0333afb08 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Action: 'create', calling method: .version_select at 0x7f90fcf5eb80>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-940001895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOr9Ddpq5GTYwcv68K8z+2dbGW+F7az3FCYZRYE3Hwa/s6Z3dnCWA+dtJWoESFlVlVC7T/+RPTRDupdfYyxBDwcluLpoZD6joiRNVy9+YdXJLR0WdmMMpaDqWxE5/RxylA=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:33.827621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-1f338943-7cbd-42fe-96b7-c4a0333afb08 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Getting quotas for project 472edbb3f752428c8a88aeef89c83b8b. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:12:33.834117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-1f338943-7cbd-42fe-96b7-c4a0333afb08 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Getting quotas for user 037c64b66ce04347aee1f3e434952dfa and project 472edbb3f752428c8a88aeef89c83b8b. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:12:34.016035 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1f338943-7cbd-42fe-96b7-c4a0333afb08 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.222626 Sep 06 11:12:34.018041 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2299/4637] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Sep 6 11:12:33 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 226 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 11:12:34.030954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-940001895", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:34.035338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:34.045732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:34.046622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:34.048275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:34.049338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:34.051684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:34.052154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:34.171997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:12:34.173432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:12:34.174176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:12:34.174814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:12:34.175668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:12:34.330436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:34.331222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:34.339256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:34.339749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:34.340197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:34.340905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:34.341370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:34.341809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:34.395156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:34.395860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:34.396466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:34.397262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lazy-loading 'fault' on Instance uuid 77d53b0f-bd9f-479e-948b-bbefbd0d8597 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:12:34.461762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973422e272f6404f81fcf4702fcfb5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab27962674e99a602451fb8f3da61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:34.470163 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e3692380-be4d-4731-86a4-3d35d55549ed tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597" status: 200 len: 1307 microversion: 2.1 time: 0.143759 Sep 06 11:12:34.470772 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2300/4638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:34 2022] GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597 => generated 1307 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:12:34.730180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:34.740353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:34.741187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:34.741806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:34.742761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:34.743545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:34.744145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:34.780057 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6fa4d83a-1466-493d-b657-94d23a4af4ba tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "POST /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739/action" status: 202 len: 1139 microversion: 2.54 time: 0.753876 Sep 06 11:12:34.786872 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2339/4639] 10.222.0.20 () {62 vars in 1320 bytes} [Tue Sep 6 11:12:34 2022] POST /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739/action => generated 1139 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 06 11:12:34.806834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f582c961-00a8-49d3-910d-a8e29c322879 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:34.811493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f582c961-00a8-49d3-910d-a8e29c322879 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:34.819374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f582c961-00a8-49d3-910d-a8e29c322879 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:34.820296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f582c961-00a8-49d3-910d-a8e29c322879 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:34.821223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f582c961-00a8-49d3-910d-a8e29c322879 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:34.823238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f582c961-00a8-49d3-910d-a8e29c322879 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:34.824309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f582c961-00a8-49d3-910d-a8e29c322879 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:34.825249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f582c961-00a8-49d3-910d-a8e29c322879 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:34.945530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f582c961-00a8-49d3-910d-a8e29c322879 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:34.956833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f582c961-00a8-49d3-910d-a8e29c322879 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:34.958422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f582c961-00a8-49d3-910d-a8e29c322879 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:34.959785 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f582c961-00a8-49d3-910d-a8e29c322879 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.161437 Sep 06 11:12:34.975273 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2301/4640] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:34 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:35.498555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-62032f70-7509-4a10-836b-4782a604be03 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:35.499265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-62032f70-7509-4a10-836b-4782a604be03 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] [instance: 77d53b0f-bd9f-479e-948b-bbefbd0d8597] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:35.509107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62032f70-7509-4a10-836b-4782a604be03 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:35.509610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62032f70-7509-4a10-836b-4782a604be03 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:35.510123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62032f70-7509-4a10-836b-4782a604be03 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:35.511172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62032f70-7509-4a10-836b-4782a604be03 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:35.511819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62032f70-7509-4a10-836b-4782a604be03 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:35.512348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62032f70-7509-4a10-836b-4782a604be03 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-62032f70-7509-4a10-836b-4782a604be03 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] HTTP exception thrown: Instance 77d53b0f-bd9f-479e-948b-bbefbd0d8597 could not be found. Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-62032f70-7509-4a10-836b-4782a604be03 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Request method failure captured: Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597 HTTP/1.1 Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyqWDvg7T5KOcGu1uVl2Jy5thDsmB0_a-JkU33sFtnwly0TYzpjJysxkNJ-DGSVadhV54x_Bxvi3R8zn3nnQt1_al8Oz_n2Gz-m7esx-WmQEjVjgButBeEk3lPDxkNTgUFi2T2HTkXJcaYto-Kb3YdT8M4WH1kfahdnfCrm666g16RE Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 515ab27962674e99a602451fb8f3da61 Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ListImageFiltersTestJSON-1618887568 Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_515ab27962674e99a602451fb8f3da61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/515ab27962674e99a602451fb8f3da61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/515ab27962674e99a602451fb8f3da61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/515ab27962674e99a602451fb8f3da61"}]}] Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ListImageFiltersTestJSON-1618887568 Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 515ab27962674e99a602451fb8f3da61 Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1618887568 Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ListImageFiltersTestJSON-1618887568-project Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 973422e272f6404f81fcf4702fcfb5c5 Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ListImageFiltersTestJSON-1618887568-project Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 77d53b0f-bd9f-479e-948b-bbefbd0d8597 could not be found. Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '77d53b0f-bd9f-479e-948b-bbefbd0d8597'} Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d53b0f-bd9f-479e-948b-bbefbd0d8597 could not be found. Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:12:35.549833 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d53b0f-bd9f-479e-948b-bbefbd0d8597 could not be found. Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d53b0f-bd9f-479e-948b-bbefbd0d8597 could not be found. Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-62032f70-7509-4a10-836b-4782a604be03 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Returning 404 to user: Instance 77d53b0f-bd9f-479e-948b-bbefbd0d8597 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-62032f70-7509-4a10-836b-4782a604be03 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597" status: 404 len: 111 microversion: 2.1 time: 0.055781 Sep 06 11:12:35.555338 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2340/4641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:35 2022] GET /compute/v2.1/servers/77d53b0f-bd9f-479e-948b-bbefbd0d8597 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:12:35.559162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3eb11419-e9e5-4c62-960a-8540c2e11d87 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f36cdee0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:35.987441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-51e69f01-2234-4272-9ad3-01904e7836fb tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:35.988239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-51e69f01-2234-4272-9ad3-01904e7836fb tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:35.996028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51e69f01-2234-4272-9ad3-01904e7836fb tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:35.996528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51e69f01-2234-4272-9ad3-01904e7836fb tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:35.997192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51e69f01-2234-4272-9ad3-01904e7836fb tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:35.997913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51e69f01-2234-4272-9ad3-01904e7836fb tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:35.998677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51e69f01-2234-4272-9ad3-01904e7836fb tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:35.999147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-51e69f01-2234-4272-9ad3-01904e7836fb tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:36.074927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-51e69f01-2234-4272-9ad3-01904e7836fb tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:36.078709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:36.084655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-51e69f01-2234-4272-9ad3-01904e7836fb tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:36.086156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-51e69f01-2234-4272-9ad3-01904e7836fb tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:36.087722 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-51e69f01-2234-4272-9ad3-01904e7836fb tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.105337 Sep 06 11:12:36.088956 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2341/4642] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:35 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:12:36.300508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:36.558512 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3eb11419-e9e5-4c62-960a-8540c2e11d87 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "DELETE /compute/v2.1/images/07368a45-efb8-4fd0-bfd1-97ce886862fa" status: 204 len: 0 microversion: 2.1 time: 1.001112 Sep 06 11:12:36.558512 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2302/4643] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:35 2022] DELETE /compute/v2.1/images/07368a45-efb8-4fd0-bfd1-97ce886862fa => generated 0 bytes in 1003 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:12:36.564286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7d9f553b-bd9f-4d05-a5b1-7473311501b8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f852c3a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:37.115236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2e20d9fa-535f-420e-9189-6e3d7f0eaba5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:37.116015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2e20d9fa-535f-420e-9189-6e3d7f0eaba5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:37.124442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e20d9fa-535f-420e-9189-6e3d7f0eaba5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:37.125206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e20d9fa-535f-420e-9189-6e3d7f0eaba5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:37.125780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e20d9fa-535f-420e-9189-6e3d7f0eaba5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:37.126672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e20d9fa-535f-420e-9189-6e3d7f0eaba5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:37.127440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e20d9fa-535f-420e-9189-6e3d7f0eaba5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:37.128719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e20d9fa-535f-420e-9189-6e3d7f0eaba5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:37.225283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2e20d9fa-535f-420e-9189-6e3d7f0eaba5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:37.244409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2e20d9fa-535f-420e-9189-6e3d7f0eaba5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:37.246034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2e20d9fa-535f-420e-9189-6e3d7f0eaba5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:37.247392 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2e20d9fa-535f-420e-9189-6e3d7f0eaba5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.137308 Sep 06 11:12:37.248061 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2303/4644] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:37 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:12:37.685740 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7d9f553b-bd9f-4d05-a5b1-7473311501b8 tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "DELETE /compute/v2.1/images/7c0ef175-345e-4080-babe-664f868ae4fa" status: 204 len: 0 microversion: 2.1 time: 1.125293 Sep 06 11:12:37.686388 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2342/4645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:36 2022] DELETE /compute/v2.1/images/7c0ef175-345e-4080-babe-664f868ae4fa => generated 0 bytes in 1127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:12:37.694810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-36d9da61-10f4-49ea-afa7-7913df86ed5c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] Calling method '.version_select at 0x7f90f3733790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:38.276140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f76e9056-0ef4-435d-b971-63d9e2af817b tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:38.276967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f76e9056-0ef4-435d-b971-63d9e2af817b tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:38.279143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:38.286391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f76e9056-0ef4-435d-b971-63d9e2af817b tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:38.286972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f76e9056-0ef4-435d-b971-63d9e2af817b tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:38.287553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f76e9056-0ef4-435d-b971-63d9e2af817b tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:38.288361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f76e9056-0ef4-435d-b971-63d9e2af817b tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:38.288936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f76e9056-0ef4-435d-b971-63d9e2af817b tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:38.289964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f76e9056-0ef4-435d-b971-63d9e2af817b tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:38.372741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f76e9056-0ef4-435d-b971-63d9e2af817b tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:38.389118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f76e9056-0ef4-435d-b971-63d9e2af817b tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:38.390973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f76e9056-0ef4-435d-b971-63d9e2af817b tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:38.392420 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f76e9056-0ef4-435d-b971-63d9e2af817b tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.122536 Sep 06 11:12:38.402592 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2343/4646] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:38 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:12:38.738922 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-36d9da61-10f4-49ea-afa7-7913df86ed5c tempest-ListImageFiltersTestJSON-1618887568 tempest-ListImageFiltersTestJSON-1618887568-project] 10.222.0.20 "DELETE /compute/v2.1/images/8154cd1a-1a43-4716-bf71-3afc7adf8146" status: 204 len: 0 microversion: 2.1 time: 1.048102 Sep 06 11:12:38.740612 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2304/4647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:37 2022] DELETE /compute/v2.1/images/8154cd1a-1a43-4716-bf71-3afc7adf8146 => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:12:39.422517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e316d03d-5568-4114-850f-8ec758de5bb6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:39.423280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e316d03d-5568-4114-850f-8ec758de5bb6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:39.442347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e316d03d-5568-4114-850f-8ec758de5bb6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:39.442993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e316d03d-5568-4114-850f-8ec758de5bb6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:39.445445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e316d03d-5568-4114-850f-8ec758de5bb6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:39.446310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e316d03d-5568-4114-850f-8ec758de5bb6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:39.448832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e316d03d-5568-4114-850f-8ec758de5bb6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:39.449548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e316d03d-5568-4114-850f-8ec758de5bb6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:39.539985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e316d03d-5568-4114-850f-8ec758de5bb6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:39.550364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e316d03d-5568-4114-850f-8ec758de5bb6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:39.551873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e316d03d-5568-4114-850f-8ec758de5bb6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:39.553265 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e316d03d-5568-4114-850f-8ec758de5bb6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.137751 Sep 06 11:12:39.554149 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2344/4648] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:39 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:40.583076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-90beb6a5-e61e-4b99-9aab-a746bb363365 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:40.583774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-90beb6a5-e61e-4b99-9aab-a746bb363365 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:40.591435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90beb6a5-e61e-4b99-9aab-a746bb363365 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:40.591952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90beb6a5-e61e-4b99-9aab-a746bb363365 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:40.592350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90beb6a5-e61e-4b99-9aab-a746bb363365 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:40.593041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90beb6a5-e61e-4b99-9aab-a746bb363365 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:40.593508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90beb6a5-e61e-4b99-9aab-a746bb363365 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:40.594244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90beb6a5-e61e-4b99-9aab-a746bb363365 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:40.663307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-90beb6a5-e61e-4b99-9aab-a746bb363365 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:40.678606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-90beb6a5-e61e-4b99-9aab-a746bb363365 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:40.678606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-90beb6a5-e61e-4b99-9aab-a746bb363365 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:40.678606 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-90beb6a5-e61e-4b99-9aab-a746bb363365 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.098610 Sep 06 11:12:40.714416 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2305/4649] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:40 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:41.710777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-081b447d-7533-41ea-a8ff-b747aa9e440d tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:41.712188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-081b447d-7533-41ea-a8ff-b747aa9e440d tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:41.722131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-081b447d-7533-41ea-a8ff-b747aa9e440d tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:41.726559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-081b447d-7533-41ea-a8ff-b747aa9e440d tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:41.726559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-081b447d-7533-41ea-a8ff-b747aa9e440d tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:41.726559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-081b447d-7533-41ea-a8ff-b747aa9e440d tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:41.726559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-081b447d-7533-41ea-a8ff-b747aa9e440d tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:41.726559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-081b447d-7533-41ea-a8ff-b747aa9e440d tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:41.895106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-081b447d-7533-41ea-a8ff-b747aa9e440d tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:41.922755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-081b447d-7533-41ea-a8ff-b747aa9e440d tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:41.925378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-081b447d-7533-41ea-a8ff-b747aa9e440d tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:41.927268 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-081b447d-7533-41ea-a8ff-b747aa9e440d tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.221071 Sep 06 11:12:41.945950 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2345/4650] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:41 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:42.954188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3f5732d1-873e-4dac-88fc-80eb874d08cf tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:42.954824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3f5732d1-873e-4dac-88fc-80eb874d08cf tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:42.967756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f5732d1-873e-4dac-88fc-80eb874d08cf tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:42.972049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f5732d1-873e-4dac-88fc-80eb874d08cf tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:42.972742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f5732d1-873e-4dac-88fc-80eb874d08cf tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:42.975042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f5732d1-873e-4dac-88fc-80eb874d08cf tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:42.975569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f5732d1-873e-4dac-88fc-80eb874d08cf tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:42.976314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f5732d1-873e-4dac-88fc-80eb874d08cf tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:43.119634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3f5732d1-873e-4dac-88fc-80eb874d08cf tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:43.119634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3f5732d1-873e-4dac-88fc-80eb874d08cf tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:43.119634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3f5732d1-873e-4dac-88fc-80eb874d08cf tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:43.119634 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3f5732d1-873e-4dac-88fc-80eb874d08cf tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.157145 Sep 06 11:12:43.119634 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2306/4651] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:42 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:44.145970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f4cd2353-53ff-44fd-8273-3dfb548bec45 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:44.148083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f4cd2353-53ff-44fd-8273-3dfb548bec45 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:44.157029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4cd2353-53ff-44fd-8273-3dfb548bec45 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:44.157561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4cd2353-53ff-44fd-8273-3dfb548bec45 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:44.158011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4cd2353-53ff-44fd-8273-3dfb548bec45 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:44.158770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4cd2353-53ff-44fd-8273-3dfb548bec45 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:44.159273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4cd2353-53ff-44fd-8273-3dfb548bec45 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:44.159710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f4cd2353-53ff-44fd-8273-3dfb548bec45 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:44.338776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f4cd2353-53ff-44fd-8273-3dfb548bec45 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:44.358693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f4cd2353-53ff-44fd-8273-3dfb548bec45 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:44.373714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f4cd2353-53ff-44fd-8273-3dfb548bec45 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:44.373714 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f4cd2353-53ff-44fd-8273-3dfb548bec45 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.221024 Sep 06 11:12:44.373714 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2346/4652] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:44 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:45.408229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c7d9c578-81b7-4b5d-b86c-4a29951af975 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:45.414500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c7d9c578-81b7-4b5d-b86c-4a29951af975 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:45.427263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=10 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:45.434120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7d9c578-81b7-4b5d-b86c-4a29951af975 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:45.435468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7d9c578-81b7-4b5d-b86c-4a29951af975 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:45.435930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7d9c578-81b7-4b5d-b86c-4a29951af975 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:45.439479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7d9c578-81b7-4b5d-b86c-4a29951af975 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:45.439974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7d9c578-81b7-4b5d-b86c-4a29951af975 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:45.440412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7d9c578-81b7-4b5d-b86c-4a29951af975 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:45.586515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c7d9c578-81b7-4b5d-b86c-4a29951af975 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:45.633351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c7d9c578-81b7-4b5d-b86c-4a29951af975 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:45.635966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c7d9c578-81b7-4b5d-b86c-4a29951af975 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:45.637610 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c7d9c578-81b7-4b5d-b86c-4a29951af975 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.235169 Sep 06 11:12:45.640071 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2307/4653] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:45 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:12:46.670375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-141773f7-a5d2-4bbe-b660-fc5454998dd9 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:46.670988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-141773f7-a5d2-4bbe-b660-fc5454998dd9 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:46.685488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-141773f7-a5d2-4bbe-b660-fc5454998dd9 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:46.688053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-141773f7-a5d2-4bbe-b660-fc5454998dd9 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:46.688513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-141773f7-a5d2-4bbe-b660-fc5454998dd9 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:46.689473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-141773f7-a5d2-4bbe-b660-fc5454998dd9 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:46.689900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-141773f7-a5d2-4bbe-b660-fc5454998dd9 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:46.690256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-141773f7-a5d2-4bbe-b660-fc5454998dd9 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:46.834586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-141773f7-a5d2-4bbe-b660-fc5454998dd9 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:46.847377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-141773f7-a5d2-4bbe-b660-fc5454998dd9 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:46.849202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-141773f7-a5d2-4bbe-b660-fc5454998dd9 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:46.850486 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-141773f7-a5d2-4bbe-b660-fc5454998dd9 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.184262 Sep 06 11:12:46.851114 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2347/4654] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:46 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:47.512072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-207cfdeb-4b1e-40ef-878a-098c7cf05047 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:47.513390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-207cfdeb-4b1e-40ef-878a-098c7cf05047 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:47.522291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-207cfdeb-4b1e-40ef-878a-098c7cf05047 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:47.522895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-207cfdeb-4b1e-40ef-878a-098c7cf05047 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:47.523723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-207cfdeb-4b1e-40ef-878a-098c7cf05047 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:47.524671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-207cfdeb-4b1e-40ef-878a-098c7cf05047 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:47.525328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-207cfdeb-4b1e-40ef-878a-098c7cf05047 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:47.526089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-207cfdeb-4b1e-40ef-878a-098c7cf05047 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:47.651654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-207cfdeb-4b1e-40ef-878a-098c7cf05047 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lazy-loading 'services' on Instance uuid 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:12:47.886274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9d4c5896-9d26-4a16-b6ba-67b4ac852483 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:47.886897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9d4c5896-9d26-4a16-b6ba-67b4ac852483 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:47.894528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d4c5896-9d26-4a16-b6ba-67b4ac852483 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:47.895328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d4c5896-9d26-4a16-b6ba-67b4ac852483 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:47.896016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d4c5896-9d26-4a16-b6ba-67b4ac852483 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:47.896764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d4c5896-9d26-4a16-b6ba-67b4ac852483 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:47.897244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d4c5896-9d26-4a16-b6ba-67b4ac852483 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:47.897738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9d4c5896-9d26-4a16-b6ba-67b4ac852483 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:47.965973 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-207cfdeb-4b1e-40ef-878a-098c7cf05047 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-volume_attachments/4a3210df-d0c2-4ecf-8e6c-945d63b3906c" status: 202 len: 0 microversion: 2.1 time: 0.458032 Sep 06 11:12:47.967800 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2308/4655] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 11:12:47 2022] DELETE /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-volume_attachments/4a3210df-d0c2-4ecf-8e6c-945d63b3906c => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:12:47.995996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b7ce4d75-2d8a-4b7c-b17c-e94a647d2ce0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:48.002751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9d4c5896-9d26-4a16-b6ba-67b4ac852483 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:48.004215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b7ce4d75-2d8a-4b7c-b17c-e94a647d2ce0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:48.016442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9d4c5896-9d26-4a16-b6ba-67b4ac852483 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:48.019518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9d4c5896-9d26-4a16-b6ba-67b4ac852483 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:48.022992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ce4d75-2d8a-4b7c-b17c-e94a647d2ce0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:48.022992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ce4d75-2d8a-4b7c-b17c-e94a647d2ce0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:48.022992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ce4d75-2d8a-4b7c-b17c-e94a647d2ce0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:48.023864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ce4d75-2d8a-4b7c-b17c-e94a647d2ce0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:48.024532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ce4d75-2d8a-4b7c-b17c-e94a647d2ce0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:48.025693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ce4d75-2d8a-4b7c-b17c-e94a647d2ce0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:48.026736 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9d4c5896-9d26-4a16-b6ba-67b4ac852483 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.153083 Sep 06 11:12:48.027996 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2348/4656] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:47 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:48.080732 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b7ce4d75-2d8a-4b7c-b17c-e94a647d2ce0 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108731 Sep 06 11:12:48.081354 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2309/4657] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:12:47 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:12:49.066583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-25c9dabc-995e-4783-b159-c42a353d9c5f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:49.066583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-25c9dabc-995e-4783-b159-c42a353d9c5f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:49.081320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25c9dabc-995e-4783-b159-c42a353d9c5f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:49.084683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25c9dabc-995e-4783-b159-c42a353d9c5f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:49.092222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25c9dabc-995e-4783-b159-c42a353d9c5f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:49.093454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25c9dabc-995e-4783-b159-c42a353d9c5f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:49.095321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25c9dabc-995e-4783-b159-c42a353d9c5f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:49.096999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25c9dabc-995e-4783-b159-c42a353d9c5f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:49.111861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4c18c7b7-fc7d-4602-a072-0f1c46b68eba tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:49.119589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4c18c7b7-fc7d-4602-a072-0f1c46b68eba tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:49.157779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c18c7b7-fc7d-4602-a072-0f1c46b68eba tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:49.162953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c18c7b7-fc7d-4602-a072-0f1c46b68eba tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:49.167768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c18c7b7-fc7d-4602-a072-0f1c46b68eba tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:49.171823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c18c7b7-fc7d-4602-a072-0f1c46b68eba tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:49.173909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c18c7b7-fc7d-4602-a072-0f1c46b68eba tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:49.206137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c18c7b7-fc7d-4602-a072-0f1c46b68eba tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:49.258379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-25c9dabc-995e-4783-b159-c42a353d9c5f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:49.284622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-25c9dabc-995e-4783-b159-c42a353d9c5f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:49.291438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-25c9dabc-995e-4783-b159-c42a353d9c5f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:49.297043 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-25c9dabc-995e-4783-b159-c42a353d9c5f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.244327 Sep 06 11:12:49.297801 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2349/4658] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:49 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:12:49.388625 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4c18c7b7-fc7d-4602-a072-0f1c46b68eba tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.296186 Sep 06 11:12:49.393094 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2310/4659] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:12:49 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc/os-volume_attachments => generated 25 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:12:49.516455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6f7d6b83-949a-4ed6-8dea-dd9cd38755e2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:49.519414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6f7d6b83-949a-4ed6-8dea-dd9cd38755e2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:49.527989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f7d6b83-949a-4ed6-8dea-dd9cd38755e2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:49.533816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f7d6b83-949a-4ed6-8dea-dd9cd38755e2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:49.533816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f7d6b83-949a-4ed6-8dea-dd9cd38755e2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:49.533816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f7d6b83-949a-4ed6-8dea-dd9cd38755e2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:49.533816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f7d6b83-949a-4ed6-8dea-dd9cd38755e2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:49.533816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f7d6b83-949a-4ed6-8dea-dd9cd38755e2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:49.595262 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-6f7d6b83-949a-4ed6-8dea-dd9cd38755e2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] HTTP exception thrown: Cannot 'reboot' instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 while it is in vm_state rescued Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6f7d6b83-949a-4ed6-8dea-dd9cd38755e2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Request method failure captured: Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3/action HTTP/1.1 Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 28 Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFypBCZVzhsRBhBANMStQFyeCLS5PmKt-tnLIYX5sT_ENc4vLLwScYTWL5yqaaxpUhllGbPc3oIWuuzLq-Hr-H-vcfxt82OKYl89zSQBoVSvyllXHebYOgIiQtfQzKHMF-bGKhrOYJft0jC5PHYUnd4l11fkckESPh53h8qp5BGDnUAg Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}] Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e45dfaf9fd949548bca37303a117bb1 Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: {"reboot": {"type": "HARD"}} Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: exception: Cannot 'reboot' instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 while it is in vm_state rescued Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '8ff803c3-3d0d-490a-b950-9bab6ccc1fc3', 'body': {'reboot': {'type': 'HARD'}}} Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:12:49.597796 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:12:49.608945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 while it is in vm_state rescued Sep 06 11:12:49.608945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:49.608945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:49.608945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:49.608945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:49.608945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:49.608945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:49.608945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:12:49.608945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:12:49.608945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 while it is in vm_state rescued Sep 06 11:12:49.608945 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:12:49.608945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6f7d6b83-949a-4ed6-8dea-dd9cd38755e2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Returning 409 to user: Cannot 'reboot' instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 while it is in vm_state rescued {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:12:49.615797 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6f7d6b83-949a-4ed6-8dea-dd9cd38755e2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3/action" status: 409 len: 145 microversion: 2.1 time: 0.105519 Sep 06 11:12:49.619756 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2350/4660] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:12:49 2022] POST /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3/action => generated 145 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 06 11:12:49.633469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-52295483-35f3-4797-b655-0712db0a8752 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:49.638962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-52295483-35f3-4797-b655-0712db0a8752 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:49.655631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52295483-35f3-4797-b655-0712db0a8752 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:49.656463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52295483-35f3-4797-b655-0712db0a8752 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:49.657047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52295483-35f3-4797-b655-0712db0a8752 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:49.657778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52295483-35f3-4797-b655-0712db0a8752 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:49.658274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52295483-35f3-4797-b655-0712db0a8752 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:49.658732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-52295483-35f3-4797-b655-0712db0a8752 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:49.688106 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-52295483-35f3-4797-b655-0712db0a8752 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] HTTP exception thrown: Cannot 'rebuild' instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 while it is in vm_state rescued Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-52295483-35f3-4797-b655-0712db0a8752 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Request method failure captured: Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3/action HTTP/1.1 Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 65 Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFypBCZVzhsRBhBANMStQFyeCLS5PmKt-tnLIYX5sT_ENc4vLLwScYTWL5yqaaxpUhllGbPc3oIWuuzLq-Hr-H-vcfxt82OKYl89zSQBoVSvyllXHebYOgIiQtfQzKHMF-bGKhrOYJft0jC5PHYUnd4l11fkckESPh53h8qp5BGDnUAg Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}] Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e45dfaf9fd949548bca37303a117bb1 Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: exception: Cannot 'rebuild' instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 while it is in vm_state rescued Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '8ff803c3-3d0d-490a-b950-9bab6ccc1fc3', 'body': {'rebuild': {'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f'}}} Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:12:49.690488 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 while it is in vm_state rescued Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 while it is in vm_state rescued Sep 06 11:12:49.697350 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:12:49.700708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-52295483-35f3-4797-b655-0712db0a8752 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Returning 409 to user: Cannot 'rebuild' instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 while it is in vm_state rescued {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:12:49.702000 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-52295483-35f3-4797-b655-0712db0a8752 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "POST /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3/action" status: 409 len: 146 microversion: 2.1 time: 0.074334 Sep 06 11:12:49.703296 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2311/4661] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:12:49 2022] POST /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3/action => generated 146 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:12:49.714016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c74a6c5a-2813-4055-8395-ece532e54e96 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:49.714966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c74a6c5a-2813-4055-8395-ece532e54e96 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:49.722979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c74a6c5a-2813-4055-8395-ece532e54e96 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:49.724023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c74a6c5a-2813-4055-8395-ece532e54e96 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:49.725053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c74a6c5a-2813-4055-8395-ece532e54e96 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:49.726685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c74a6c5a-2813-4055-8395-ece532e54e96 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:49.728032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c74a6c5a-2813-4055-8395-ece532e54e96 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:49.729392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c74a6c5a-2813-4055-8395-ece532e54e96 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:49.838386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c74a6c5a-2813-4055-8395-ece532e54e96 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:12:50.340928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-54586718-3ebe-41c4-8b47-6ce2566aa3fe tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:50.349939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-54586718-3ebe-41c4-8b47-6ce2566aa3fe tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:50.369730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54586718-3ebe-41c4-8b47-6ce2566aa3fe tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:50.370237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54586718-3ebe-41c4-8b47-6ce2566aa3fe tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:50.372510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54586718-3ebe-41c4-8b47-6ce2566aa3fe tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:50.372510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54586718-3ebe-41c4-8b47-6ce2566aa3fe tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:50.372510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54586718-3ebe-41c4-8b47-6ce2566aa3fe tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:50.372510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54586718-3ebe-41c4-8b47-6ce2566aa3fe tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:50.401462 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c74a6c5a-2813-4055-8395-ece532e54e96 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 204 len: 0 microversion: 2.1 time: 0.690684 Sep 06 11:12:50.406186 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2351/4662] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:12:49 2022] DELETE /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:12:50.419137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bc74d6fb-90ec-4bfb-9af3-07da52ba0f29 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:50.419872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bc74d6fb-90ec-4bfb-9af3-07da52ba0f29 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:50.434305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bc74d6fb-90ec-4bfb-9af3-07da52ba0f29 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:50.435262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bc74d6fb-90ec-4bfb-9af3-07da52ba0f29 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:50.436213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bc74d6fb-90ec-4bfb-9af3-07da52ba0f29 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:50.437167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bc74d6fb-90ec-4bfb-9af3-07da52ba0f29 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:50.437814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bc74d6fb-90ec-4bfb-9af3-07da52ba0f29 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:50.438707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bc74d6fb-90ec-4bfb-9af3-07da52ba0f29 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:50.467832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-54586718-3ebe-41c4-8b47-6ce2566aa3fe tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:50.479284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-54586718-3ebe-41c4-8b47-6ce2566aa3fe tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:50.480775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-54586718-3ebe-41c4-8b47-6ce2566aa3fe tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:50.483269 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-54586718-3ebe-41c4-8b47-6ce2566aa3fe tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.147261 Sep 06 11:12:50.486983 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2312/4663] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:50 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:50.795850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bc74d6fb-90ec-4bfb-9af3-07da52ba0f29 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:50.816314 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bc74d6fb-90ec-4bfb-9af3-07da52ba0f29 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1690 microversion: 2.1 time: 0.403904 Sep 06 11:12:50.818861 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2352/4664] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:50 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1690 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:12:51.518028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-49e2a590-ca22-473a-8424-ab5297b3c483 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Action: 'create', calling method: .version_select at 0x7f90f36cfd30>, body: {"keypair": {"name": "tempest-keypair-2066134474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4glluVbDjG1EAT0Wu6vE+chR2UGnJDylCiJhheJTpTXoFnnxJFnaVfMZs9RW3tnUse+Q4pzmZm5qmfJWju/TLIcuYsk5F/8gt9xVCpds6kBx1N06/9vMNieDcFfpmLGg=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:51.534154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fd6f4e33-0c29-493b-a35e-ded4b81f396f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:51.534739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-49e2a590-ca22-473a-8424-ab5297b3c483 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Getting quotas for project e0413c72e86542c3a7df65d5830ffc27. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:12:51.534846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fd6f4e33-0c29-493b-a35e-ded4b81f396f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:51.541433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-49e2a590-ca22-473a-8424-ab5297b3c483 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Getting quotas for user 387ee93c80cb40398df6fec3c902bed0 and project e0413c72e86542c3a7df65d5830ffc27. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:12:51.542436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd6f4e33-0c29-493b-a35e-ded4b81f396f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:51.542943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd6f4e33-0c29-493b-a35e-ded4b81f396f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:51.543427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd6f4e33-0c29-493b-a35e-ded4b81f396f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:51.544151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd6f4e33-0c29-493b-a35e-ded4b81f396f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:51.544620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd6f4e33-0c29-493b-a35e-ded4b81f396f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:51.545061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd6f4e33-0c29-493b-a35e-ded4b81f396f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:51.658755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fd6f4e33-0c29-493b-a35e-ded4b81f396f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:51.668190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fd6f4e33-0c29-493b-a35e-ded4b81f396f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:51.669978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fd6f4e33-0c29-493b-a35e-ded4b81f396f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:51.671247 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fd6f4e33-0c29-493b-a35e-ded4b81f396f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.141238 Sep 06 11:12:51.675913 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2353/4665] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:51 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:12:51.702305 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-49e2a590-ca22-473a-8424-ab5297b3c483 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.377671 Sep 06 11:12:51.702931 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2313/4666] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:12:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:51.849154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e6e2fd49-fc83-458e-8e69-c920c7bb9d09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:51.850046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e6e2fd49-fc83-458e-8e69-c920c7bb9d09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:51.866040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6e2fd49-fc83-458e-8e69-c920c7bb9d09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:51.869828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6e2fd49-fc83-458e-8e69-c920c7bb9d09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:51.870488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6e2fd49-fc83-458e-8e69-c920c7bb9d09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:51.871980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6e2fd49-fc83-458e-8e69-c920c7bb9d09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:51.874781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6e2fd49-fc83-458e-8e69-c920c7bb9d09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:51.875497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e6e2fd49-fc83-458e-8e69-c920c7bb9d09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:52.211221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e6e2fd49-fc83-458e-8e69-c920c7bb9d09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:52.220338 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e6e2fd49-fc83-458e-8e69-c920c7bb9d09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1690 microversion: 2.1 time: 0.378159 Sep 06 11:12:52.221280 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2354/4667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:51 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1690 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:52.706623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-54f2089b-0ab5-4474-bb93-0049a07d7acd tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:52.709086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-54f2089b-0ab5-4474-bb93-0049a07d7acd tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:52.721650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54f2089b-0ab5-4474-bb93-0049a07d7acd tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:52.723180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54f2089b-0ab5-4474-bb93-0049a07d7acd tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:52.724339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54f2089b-0ab5-4474-bb93-0049a07d7acd tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:52.725361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54f2089b-0ab5-4474-bb93-0049a07d7acd tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:52.726151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54f2089b-0ab5-4474-bb93-0049a07d7acd tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:52.727084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54f2089b-0ab5-4474-bb93-0049a07d7acd tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:52.843723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-54f2089b-0ab5-4474-bb93-0049a07d7acd tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:52.855289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-54f2089b-0ab5-4474-bb93-0049a07d7acd tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:52.874300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-54f2089b-0ab5-4474-bb93-0049a07d7acd tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:52.874300 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-54f2089b-0ab5-4474-bb93-0049a07d7acd tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.161530 Sep 06 11:12:52.874300 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2314/4668] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:52 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:53.244355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f6870512-8331-41fd-96b9-959e72cb01b7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:53.244916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f6870512-8331-41fd-96b9-959e72cb01b7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:53.252469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6870512-8331-41fd-96b9-959e72cb01b7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:53.256829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6870512-8331-41fd-96b9-959e72cb01b7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:53.256829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6870512-8331-41fd-96b9-959e72cb01b7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:53.256829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6870512-8331-41fd-96b9-959e72cb01b7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:53.256829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6870512-8331-41fd-96b9-959e72cb01b7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:53.256829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6870512-8331-41fd-96b9-959e72cb01b7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:53.457260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f6870512-8331-41fd-96b9-959e72cb01b7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:53.475523 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f6870512-8331-41fd-96b9-959e72cb01b7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1690 microversion: 2.1 time: 0.229164 Sep 06 11:12:53.475523 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2355/4669] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:53 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1690 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:53.891898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-644e2d84-ca68-4158-ab6f-5b218ad3b9ca tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:53.893326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-644e2d84-ca68-4158-ab6f-5b218ad3b9ca tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:53.902485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-644e2d84-ca68-4158-ab6f-5b218ad3b9ca tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:53.903443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-644e2d84-ca68-4158-ab6f-5b218ad3b9ca tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:53.904142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-644e2d84-ca68-4158-ab6f-5b218ad3b9ca tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:53.905144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-644e2d84-ca68-4158-ab6f-5b218ad3b9ca tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:53.905860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-644e2d84-ca68-4158-ab6f-5b218ad3b9ca tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:53.906622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-644e2d84-ca68-4158-ab6f-5b218ad3b9ca tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:54.126892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-644e2d84-ca68-4158-ab6f-5b218ad3b9ca tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:54.145519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-644e2d84-ca68-4158-ab6f-5b218ad3b9ca tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:54.150784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-644e2d84-ca68-4158-ab6f-5b218ad3b9ca tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:54.154651 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-644e2d84-ca68-4158-ab6f-5b218ad3b9ca tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.264459 Sep 06 11:12:54.155481 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2315/4670] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:53 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:54.495946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-69a9c1d0-217a-4175-b10e-d976da398ff2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:54.496612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-69a9c1d0-217a-4175-b10e-d976da398ff2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:54.503436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69a9c1d0-217a-4175-b10e-d976da398ff2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:54.503939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69a9c1d0-217a-4175-b10e-d976da398ff2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:54.505834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69a9c1d0-217a-4175-b10e-d976da398ff2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:54.505834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69a9c1d0-217a-4175-b10e-d976da398ff2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:54.506212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69a9c1d0-217a-4175-b10e-d976da398ff2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:54.507197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69a9c1d0-217a-4175-b10e-d976da398ff2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:55.005480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-69a9c1d0-217a-4175-b10e-d976da398ff2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:55.019139 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-69a9c1d0-217a-4175-b10e-d976da398ff2 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1690 microversion: 2.1 time: 0.527306 Sep 06 11:12:55.020923 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2356/4671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:54 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1690 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:55.208480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1702fafe-1b27-4391-91d6-17a7ea3a6e3e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:55.209806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1702fafe-1b27-4391-91d6-17a7ea3a6e3e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:55.212591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:55.217985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1702fafe-1b27-4391-91d6-17a7ea3a6e3e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:55.218493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1702fafe-1b27-4391-91d6-17a7ea3a6e3e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:55.219161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1702fafe-1b27-4391-91d6-17a7ea3a6e3e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:55.220318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1702fafe-1b27-4391-91d6-17a7ea3a6e3e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:55.220791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1702fafe-1b27-4391-91d6-17a7ea3a6e3e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:55.221398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1702fafe-1b27-4391-91d6-17a7ea3a6e3e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:55.471127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1702fafe-1b27-4391-91d6-17a7ea3a6e3e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:55.486849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1702fafe-1b27-4391-91d6-17a7ea3a6e3e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:55.488575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1702fafe-1b27-4391-91d6-17a7ea3a6e3e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:55.496630 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1702fafe-1b27-4391-91d6-17a7ea3a6e3e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.292485 Sep 06 11:12:55.497420 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2316/4672] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:55 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:12:56.046729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8012f5ac-6243-4d33-88b4-935a727c0653 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:56.047705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8012f5ac-6243-4d33-88b4-935a727c0653 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:56.072384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8012f5ac-6243-4d33-88b4-935a727c0653 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:56.074352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8012f5ac-6243-4d33-88b4-935a727c0653 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:56.078379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8012f5ac-6243-4d33-88b4-935a727c0653 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:56.091455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8012f5ac-6243-4d33-88b4-935a727c0653 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:56.092829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8012f5ac-6243-4d33-88b4-935a727c0653 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:56.093757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8012f5ac-6243-4d33-88b4-935a727c0653 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:56.253476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8012f5ac-6243-4d33-88b4-935a727c0653 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:56.272057 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8012f5ac-6243-4d33-88b4-935a727c0653 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1622 microversion: 2.1 time: 0.230066 Sep 06 11:12:56.273310 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2357/4673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:56 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1622 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:56.535788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f35ab319-8bf3-41ea-bf6a-4e6e692d1ad3 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:56.537017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f35ab319-8bf3-41ea-bf6a-4e6e692d1ad3 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:56.580091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f35ab319-8bf3-41ea-bf6a-4e6e692d1ad3 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:56.580956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f35ab319-8bf3-41ea-bf6a-4e6e692d1ad3 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:56.581748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f35ab319-8bf3-41ea-bf6a-4e6e692d1ad3 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:56.583098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f35ab319-8bf3-41ea-bf6a-4e6e692d1ad3 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:56.583981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f35ab319-8bf3-41ea-bf6a-4e6e692d1ad3 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:56.584795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f35ab319-8bf3-41ea-bf6a-4e6e692d1ad3 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:57.053517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f35ab319-8bf3-41ea-bf6a-4e6e692d1ad3 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:57.064646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f35ab319-8bf3-41ea-bf6a-4e6e692d1ad3 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:57.066581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f35ab319-8bf3-41ea-bf6a-4e6e692d1ad3 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:57.068174 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f35ab319-8bf3-41ea-bf6a-4e6e692d1ad3 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.547449 Sep 06 11:12:57.069089 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2317/4674] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:56 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:57.299149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbc51f60-e512-4518-824f-1b88ab96c666 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:57.307696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fbc51f60-e512-4518-824f-1b88ab96c666 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:57.317315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc51f60-e512-4518-824f-1b88ab96c666 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:57.322112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc51f60-e512-4518-824f-1b88ab96c666 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:57.322112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc51f60-e512-4518-824f-1b88ab96c666 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:57.322112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc51f60-e512-4518-824f-1b88ab96c666 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:57.322112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc51f60-e512-4518-824f-1b88ab96c666 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:57.322112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbc51f60-e512-4518-824f-1b88ab96c666 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:57.357793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:57.459739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-baf9cf01-4f90-4cda-9b92-a7231a6a3b3c req-56ec5489-fdba-4792-8de5-2c20a73801a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa9fb77-6ffc-4a34-9db9-3ba749d98afc", "name": "network-vif-deleted", "tag": "33293afd-e865-4886-9b9b-f1ae1fefac75"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:57.479502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-baf9cf01-4f90-4cda-9b92-a7231a6a3b3c req-56ec5489-fdba-4792-8de5-2c20a73801a6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:57.480006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-baf9cf01-4f90-4cda-9b92-a7231a6a3b3c req-56ec5489-fdba-4792-8de5-2c20a73801a6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:57.480474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-baf9cf01-4f90-4cda-9b92-a7231a6a3b3c req-56ec5489-fdba-4792-8de5-2c20a73801a6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:57.526312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fbc51f60-e512-4518-824f-1b88ab96c666 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:57.556317 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fbc51f60-e512-4518-824f-1b88ab96c666 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1622 microversion: 2.1 time: 0.260389 Sep 06 11:12:57.556905 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-baf9cf01-4f90-4cda-9b92-a7231a6a3b3c req-56ec5489-fdba-4792-8de5-2c20a73801a6 service nova] Creating event network-vif-deleted:33293afd-e865-4886-9b9b-f1ae1fefac75 for instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc on nch2-master-1 Sep 06 11:12:57.559174 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2358/4675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:57 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1622 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:12:57.564877 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-baf9cf01-4f90-4cda-9b92-a7231a6a3b3c req-56ec5489-fdba-4792-8de5-2c20a73801a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108841 Sep 06 11:12:57.566267 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2318/4676] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:12:58.110926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3c73c4f9-b026-4f61-b775-e565822480f5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:58.112562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3c73c4f9-b026-4f61-b775-e565822480f5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:58.142271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c73c4f9-b026-4f61-b775-e565822480f5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:58.143757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c73c4f9-b026-4f61-b775-e565822480f5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:58.151187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c73c4f9-b026-4f61-b775-e565822480f5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:58.156271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c73c4f9-b026-4f61-b775-e565822480f5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:58.158695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c73c4f9-b026-4f61-b775-e565822480f5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:58.169889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c73c4f9-b026-4f61-b775-e565822480f5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:58.600223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:58.601729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:58.634991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:58.636276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:58.638202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:58.640802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:58.642392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:58.645458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:58.664062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3c73c4f9-b026-4f61-b775-e565822480f5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:58.702222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:58.708546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3c73c4f9-b026-4f61-b775-e565822480f5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:58.712766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3c73c4f9-b026-4f61-b775-e565822480f5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:58.718422 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3c73c4f9-b026-4f61-b775-e565822480f5 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.621520 Sep 06 11:12:58.728051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:58.729377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:58.730447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:58.738026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lazy-loading 'fault' on Instance uuid 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:12:58.738285 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2359/4677] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:58 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:12:58.876162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:12:58.887727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "3bf9bb21-ba63-4722-a6eb-ec9a9cc857cb"}], "security_groups": [{"name": "tempest-securitygroup--1622076525"}], "key_name": "tempest-keypair-2066134474", "user_data": "}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:12:58.891411 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-85f93e28-674d-493c-9810-41798bdab947 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 200 len: 1336 microversion: 2.1 time: 0.302362 Sep 06 11:12:58.893051 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2319/4678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:12:58 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 1336 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:12:59.180163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] validate_networks() for [('3bf9bb21-ba63-4722-a6eb-ec9a9cc857cb', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:12:59.754568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-be8f7b0b-30ff-41f0-a71d-8ce1ab6d3169 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:12:59.755785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-be8f7b0b-30ff-41f0-a71d-8ce1ab6d3169 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:12:59.775557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be8f7b0b-30ff-41f0-a71d-8ce1ab6d3169 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:59.777200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be8f7b0b-30ff-41f0-a71d-8ce1ab6d3169 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:59.778223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be8f7b0b-30ff-41f0-a71d-8ce1ab6d3169 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:59.782157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be8f7b0b-30ff-41f0-a71d-8ce1ab6d3169 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:59.782157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be8f7b0b-30ff-41f0-a71d-8ce1ab6d3169 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:59.782157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be8f7b0b-30ff-41f0-a71d-8ce1ab6d3169 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:59.902271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:12:59.903359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:12:59.904054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:12:59.904641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:12:59.905296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:12:59.921503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:59.922271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:59.922731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:59.923561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:12:59.928975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:12:59.929458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:12:59.980668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Getting quotas for project e0413c72e86542c3a7df65d5830ffc27. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:12:59.991162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Getting quotas for user 387ee93c80cb40398df6fec3c902bed0 and project e0413c72e86542c3a7df65d5830ffc27. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:13:00.038125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:13:00.041420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:13:00.077925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-be8f7b0b-30ff-41f0-a71d-8ce1ab6d3169 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:00.087525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-be8f7b0b-30ff-41f0-a71d-8ce1ab6d3169 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:00.089205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-be8f7b0b-30ff-41f0-a71d-8ce1ab6d3169 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:00.090657 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-be8f7b0b-30ff-41f0-a71d-8ce1ab6d3169 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.340685 Sep 06 11:13:00.091680 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2320/4679] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:12:59 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:13:00.096517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-606109a8-80dc-447a-9b60-1cfecbbbe80b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:00.097098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-606109a8-80dc-447a-9b60-1cfecbbbe80b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:00.103703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-606109a8-80dc-447a-9b60-1cfecbbbe80b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:00.104521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-606109a8-80dc-447a-9b60-1cfecbbbe80b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:00.105172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-606109a8-80dc-447a-9b60-1cfecbbbe80b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:00.106105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-606109a8-80dc-447a-9b60-1cfecbbbe80b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:00.106771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-606109a8-80dc-447a-9b60-1cfecbbbe80b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:00.107426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-606109a8-80dc-447a-9b60-1cfecbbbe80b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:00.125044 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-606109a8-80dc-447a-9b60-1cfecbbbe80b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] HTTP exception thrown: Instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc could not be found. Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-606109a8-80dc-447a-9b60-1cfecbbbe80b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Request method failure captured: Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc HTTP/1.1 Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFypBCZVzhsRBhBANMStQFyeCLS5PmKt-tnLIYX5sT_ENc4vLLwScYTWL5yqaaxpUhllGbPc3oIWuuzLq-Hr-H-vcfxt82OKYl89zSQBoVSvyllXHebYOgIiQtfQzKHMF-bGKhrOYJft0jC5PHYUnd4l11fkckESPh53h8qp5BGDnUAg Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}] Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e45dfaf9fd949548bca37303a117bb1 Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc could not be found. Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '7aa9fb77-6ffc-4a34-9db9-3ba749d98afc'} Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc could not be found. Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc could not be found. Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:13:00.127229 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:13:00.131230 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:13:00.131230 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:00.131230 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:13:00.131230 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:13:00.131230 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:13:00.131230 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:13:00.131230 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc could not be found. Sep 06 11:13:00.131230 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:13:00.135887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-606109a8-80dc-447a-9b60-1cfecbbbe80b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Returning 404 to user: Instance 7aa9fb77-6ffc-4a34-9db9-3ba749d98afc could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:13:00.137039 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-606109a8-80dc-447a-9b60-1cfecbbbe80b tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc" status: 404 len: 111 microversion: 2.1 time: 0.044405 Sep 06 11:13:00.137797 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2321/4680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:00 2022] GET /compute/v2.1/servers/7aa9fb77-6ffc-4a34-9db9-3ba749d98afc => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:13:00.155502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5ff8f2e5-8513-483f-bc88-7aba788cf19d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '.version_select at 0x7f90f36de940>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:00.196779 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-02a4d3af-6087-4ce1-9511-ffe3ed2b398c tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.319438 Sep 06 11:13:00.204663 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2360/4681] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:12:58 2022] POST /compute/v2.1/servers => generated 409 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:13:00.232305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-11a2dbf3-58a5-4124-afc3-0563b9e3798f tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:00.232305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-11a2dbf3-58a5-4124-afc3-0563b9e3798f tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:00.305324 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5ff8f2e5-8513-483f-bc88-7aba788cf19d tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836875660" status: 202 len: 0 microversion: 2.1 time: 0.153944 Sep 06 11:13:00.306691 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2322/4682] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:13:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836875660 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:13:00.410287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-11a2dbf3-58a5-4124-afc3-0563b9e3798f tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:00.441482 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-11a2dbf3-58a5-4124-afc3-0563b9e3798f tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1226 microversion: 2.1 time: 0.221408 Sep 06 11:13:00.442321 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2361/4683] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:00 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1226 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:01.154057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-79e58306-553b-4a2e-bbc1-b78583d6e2a6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:01.157545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-79e58306-553b-4a2e-bbc1-b78583d6e2a6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:01.192017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79e58306-553b-4a2e-bbc1-b78583d6e2a6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:01.193380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79e58306-553b-4a2e-bbc1-b78583d6e2a6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:01.194424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79e58306-553b-4a2e-bbc1-b78583d6e2a6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:01.201578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79e58306-553b-4a2e-bbc1-b78583d6e2a6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:01.202872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79e58306-553b-4a2e-bbc1-b78583d6e2a6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:01.203967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79e58306-553b-4a2e-bbc1-b78583d6e2a6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:01.487188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6216d271-2a6d-4abc-a3a1-26df727dc5fc tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:01.488607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6216d271-2a6d-4abc-a3a1-26df727dc5fc tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:01.553018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:01.783297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-79e58306-553b-4a2e-bbc1-b78583d6e2a6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:01.783986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6216d271-2a6d-4abc-a3a1-26df727dc5fc tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:01.801666 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6216d271-2a6d-4abc-a3a1-26df727dc5fc tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1226 microversion: 2.1 time: 0.321474 Sep 06 11:13:01.801977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-79e58306-553b-4a2e-bbc1-b78583d6e2a6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:01.803583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-79e58306-553b-4a2e-bbc1-b78583d6e2a6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:01.804814 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-79e58306-553b-4a2e-bbc1-b78583d6e2a6 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1408 microversion: 2.54 time: 0.658618 Sep 06 11:13:01.805379 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2323/4684] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:01 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1408 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:01.824225 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2362/4685] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:01 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1226 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:02.847958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-034733b3-fe05-4046-9784-898cdce59f09 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:02.850199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-034733b3-fe05-4046-9784-898cdce59f09 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:02.852084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2bf3f6f1-508c-4680-9490-a4a60c25775f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:02.852793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2bf3f6f1-508c-4680-9490-a4a60c25775f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:02.878377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bf3f6f1-508c-4680-9490-a4a60c25775f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:02.878892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bf3f6f1-508c-4680-9490-a4a60c25775f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:02.879402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bf3f6f1-508c-4680-9490-a4a60c25775f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:02.881962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-034733b3-fe05-4046-9784-898cdce59f09 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:02.882375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-034733b3-fe05-4046-9784-898cdce59f09 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:02.882832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-034733b3-fe05-4046-9784-898cdce59f09 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:02.891520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-034733b3-fe05-4046-9784-898cdce59f09 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:02.892099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bf3f6f1-508c-4680-9490-a4a60c25775f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:02.892912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bf3f6f1-508c-4680-9490-a4a60c25775f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:02.893821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-034733b3-fe05-4046-9784-898cdce59f09 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:02.894229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-034733b3-fe05-4046-9784-898cdce59f09 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:02.897865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bf3f6f1-508c-4680-9490-a4a60c25775f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:03.107780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2bf3f6f1-508c-4680-9490-a4a60c25775f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:03.109013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-034733b3-fe05-4046-9784-898cdce59f09 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:03.120408 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-034733b3-fe05-4046-9784-898cdce59f09 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1222 microversion: 2.1 time: 0.297144 Sep 06 11:13:03.122155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2bf3f6f1-508c-4680-9490-a4a60c25775f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:03.124051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2bf3f6f1-508c-4680-9490-a4a60c25775f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:03.128894 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2bf3f6f1-508c-4680-9490-a4a60c25775f tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1414 microversion: 2.54 time: 0.290430 Sep 06 11:13:03.129503 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2363/4686] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:02 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1414 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:13:03.130417 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2324/4687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:02 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1222 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:04.163109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d16e8a91-be6a-4272-89bb-d55708472603 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:04.167602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d16e8a91-be6a-4272-89bb-d55708472603 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:04.168232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-46b5230c-8301-4384-ad20-3c09775a9f7d tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:04.169597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-46b5230c-8301-4384-ad20-3c09775a9f7d tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:04.186545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46b5230c-8301-4384-ad20-3c09775a9f7d tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:04.190806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46b5230c-8301-4384-ad20-3c09775a9f7d tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:04.191754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d16e8a91-be6a-4272-89bb-d55708472603 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:04.196957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46b5230c-8301-4384-ad20-3c09775a9f7d tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:04.197419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d16e8a91-be6a-4272-89bb-d55708472603 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:04.198725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46b5230c-8301-4384-ad20-3c09775a9f7d tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:04.199433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d16e8a91-be6a-4272-89bb-d55708472603 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:04.200671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d16e8a91-be6a-4272-89bb-d55708472603 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:04.201376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46b5230c-8301-4384-ad20-3c09775a9f7d tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:04.202930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d16e8a91-be6a-4272-89bb-d55708472603 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:04.203713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46b5230c-8301-4384-ad20-3c09775a9f7d tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:04.205688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d16e8a91-be6a-4272-89bb-d55708472603 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:04.392499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-46b5230c-8301-4384-ad20-3c09775a9f7d tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:04.394950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d16e8a91-be6a-4272-89bb-d55708472603 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:04.409919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d16e8a91-be6a-4272-89bb-d55708472603 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:04.420207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d16e8a91-be6a-4272-89bb-d55708472603 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:04.421809 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-46b5230c-8301-4384-ad20-3c09775a9f7d tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1286 microversion: 2.1 time: 0.267430 Sep 06 11:13:04.424141 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d16e8a91-be6a-4272-89bb-d55708472603 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1414 microversion: 2.54 time: 0.264983 Sep 06 11:13:04.430910 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2364/4688] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:04 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1414 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:13:04.447198 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2325/4689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:04 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1286 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:13:05.478967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-77c24928-6ffb-4f3a-b0a8-d59d02cb82e8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:05.480745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-77c24928-6ffb-4f3a-b0a8-d59d02cb82e8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:05.485735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e363f3ed-c036-4c55-85b0-dd0e785c08da tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:05.495442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e363f3ed-c036-4c55-85b0-dd0e785c08da tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:05.546223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e363f3ed-c036-4c55-85b0-dd0e785c08da tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:05.547969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e363f3ed-c036-4c55-85b0-dd0e785c08da tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:05.554688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e363f3ed-c036-4c55-85b0-dd0e785c08da tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:05.554688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e363f3ed-c036-4c55-85b0-dd0e785c08da tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:05.554688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e363f3ed-c036-4c55-85b0-dd0e785c08da tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:05.554688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e363f3ed-c036-4c55-85b0-dd0e785c08da tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:05.583442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77c24928-6ffb-4f3a-b0a8-d59d02cb82e8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:05.584986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77c24928-6ffb-4f3a-b0a8-d59d02cb82e8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:05.585719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77c24928-6ffb-4f3a-b0a8-d59d02cb82e8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:05.601598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77c24928-6ffb-4f3a-b0a8-d59d02cb82e8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:05.616412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77c24928-6ffb-4f3a-b0a8-d59d02cb82e8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:05.621656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77c24928-6ffb-4f3a-b0a8-d59d02cb82e8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:05.690020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e363f3ed-c036-4c55-85b0-dd0e785c08da tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:05.705206 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e363f3ed-c036-4c55-85b0-dd0e785c08da tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1284 microversion: 2.1 time: 0.240498 Sep 06 11:13:05.708267 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2326/4690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:05 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1284 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:05.810152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77c24928-6ffb-4f3a-b0a8-d59d02cb82e8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:05.827835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77c24928-6ffb-4f3a-b0a8-d59d02cb82e8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:05.832939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77c24928-6ffb-4f3a-b0a8-d59d02cb82e8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:05.834494 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-77c24928-6ffb-4f3a-b0a8-d59d02cb82e8 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1399 microversion: 2.54 time: 0.378723 Sep 06 11:13:05.838394 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2365/4691] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:05 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1399 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:05.873622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-68356cff-6a28-4d72-a2e4-42b28d8c5429 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '.version_select at 0x7f90f36b6c10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:06.037445 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-68356cff-6a28-4d72-a2e4-42b28d8c5429 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-940001895" status: 204 len: 0 microversion: 2.54 time: 0.168518 Sep 06 11:13:06.038134 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2327/4692] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Sep 6 11:13:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-940001895 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:13:06.068794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5a10532-c576-4faa-bc87-f9a35e1b116e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:06.070627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a5a10532-c576-4faa-bc87-f9a35e1b116e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:06.081665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5a10532-c576-4faa-bc87-f9a35e1b116e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:06.082167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5a10532-c576-4faa-bc87-f9a35e1b116e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:06.083164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5a10532-c576-4faa-bc87-f9a35e1b116e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:06.085077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5a10532-c576-4faa-bc87-f9a35e1b116e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:06.085946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5a10532-c576-4faa-bc87-f9a35e1b116e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:06.087186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5a10532-c576-4faa-bc87-f9a35e1b116e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:06.122091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a5a10532-c576-4faa-bc87-f9a35e1b116e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:13:06.626254 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a5a10532-c576-4faa-bc87-f9a35e1b116e tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 204 len: 0 microversion: 2.54 time: 0.567255 Sep 06 11:13:06.630541 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2366/4693] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:13:06 2022] DELETE /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:13:06.647867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-06c4b520-996a-49b6-abef-3ad095999064 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:06.652257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-06c4b520-996a-49b6-abef-3ad095999064 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:06.683857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06c4b520-996a-49b6-abef-3ad095999064 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:06.685649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06c4b520-996a-49b6-abef-3ad095999064 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:06.687667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06c4b520-996a-49b6-abef-3ad095999064 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:06.690536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06c4b520-996a-49b6-abef-3ad095999064 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:06.693181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06c4b520-996a-49b6-abef-3ad095999064 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:06.696486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-06c4b520-996a-49b6-abef-3ad095999064 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:06.736140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-070fe440-94c0-4033-a9b8-499857d41489 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:06.737300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-070fe440-94c0-4033-a9b8-499857d41489 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:06.757183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-070fe440-94c0-4033-a9b8-499857d41489 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:06.760341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-070fe440-94c0-4033-a9b8-499857d41489 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:06.763314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-070fe440-94c0-4033-a9b8-499857d41489 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:06.763314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-070fe440-94c0-4033-a9b8-499857d41489 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:06.763559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-070fe440-94c0-4033-a9b8-499857d41489 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:06.768641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-070fe440-94c0-4033-a9b8-499857d41489 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:06.958650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-06c4b520-996a-49b6-abef-3ad095999064 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:06.968868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-06c4b520-996a-49b6-abef-3ad095999064 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:06.973445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-06c4b520-996a-49b6-abef-3ad095999064 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:06.974780 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-06c4b520-996a-49b6-abef-3ad095999064 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1405 microversion: 2.54 time: 0.337070 Sep 06 11:13:07.000347 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2328/4694] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:06 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1405 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:07.159815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-070fe440-94c0-4033-a9b8-499857d41489 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:07.174600 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-070fe440-94c0-4033-a9b8-499857d41489 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1352 microversion: 2.1 time: 0.445215 Sep 06 11:13:07.187090 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2367/4695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:06 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1352 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:13:08.008130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d583f874-2b03-410c-8496-22f0194163e2 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:08.010067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d583f874-2b03-410c-8496-22f0194163e2 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:08.018586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d583f874-2b03-410c-8496-22f0194163e2 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:08.026322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d583f874-2b03-410c-8496-22f0194163e2 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:08.028238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d583f874-2b03-410c-8496-22f0194163e2 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:08.030233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d583f874-2b03-410c-8496-22f0194163e2 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:08.031940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d583f874-2b03-410c-8496-22f0194163e2 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:08.033200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d583f874-2b03-410c-8496-22f0194163e2 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:08.163857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d583f874-2b03-410c-8496-22f0194163e2 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:08.183922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d583f874-2b03-410c-8496-22f0194163e2 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:08.187646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d583f874-2b03-410c-8496-22f0194163e2 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:08.190565 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d583f874-2b03-410c-8496-22f0194163e2 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1405 microversion: 2.54 time: 0.186297 Sep 06 11:13:08.192919 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2329/4696] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:08 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:08.206173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d428cee3-8444-4575-aad3-59c3d1e23feb tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:08.206871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d428cee3-8444-4575-aad3-59c3d1e23feb tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:08.210089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:08.228131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d428cee3-8444-4575-aad3-59c3d1e23feb tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:08.230617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d428cee3-8444-4575-aad3-59c3d1e23feb tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:08.231354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d428cee3-8444-4575-aad3-59c3d1e23feb tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:08.232274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d428cee3-8444-4575-aad3-59c3d1e23feb tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:08.235854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d428cee3-8444-4575-aad3-59c3d1e23feb tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:08.238448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d428cee3-8444-4575-aad3-59c3d1e23feb tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:08.557287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d428cee3-8444-4575-aad3-59c3d1e23feb tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:08.577075 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d428cee3-8444-4575-aad3-59c3d1e23feb tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1352 microversion: 2.1 time: 0.374496 Sep 06 11:13:08.578832 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2368/4697] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:08 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1352 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:08.736727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-74acce88-279f-44cc-bed2-48abd3b86964 req-ab68b443-df90-4146-a4d9-71f6b0abae1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce8c0a7-8702-4362-8cd8-f22f61d9551e", "tag": "c990c201-d6ea-4a94-94e6-1857e9446755"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:08.777917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-74acce88-279f-44cc-bed2-48abd3b86964 req-ab68b443-df90-4146-a4d9-71f6b0abae1d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:08.780585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-74acce88-279f-44cc-bed2-48abd3b86964 req-ab68b443-df90-4146-a4d9-71f6b0abae1d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:08.781402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-74acce88-279f-44cc-bed2-48abd3b86964 req-ab68b443-df90-4146-a4d9-71f6b0abae1d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:08.802475 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-74acce88-279f-44cc-bed2-48abd3b86964 req-ab68b443-df90-4146-a4d9-71f6b0abae1d service nova] Creating event network-changed:c990c201-d6ea-4a94-94e6-1857e9446755 for instance bce8c0a7-8702-4362-8cd8-f22f61d9551e on nch1-master-1 Sep 06 11:13:08.810485 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-74acce88-279f-44cc-bed2-48abd3b86964 req-ab68b443-df90-4146-a4d9-71f6b0abae1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083650 Sep 06 11:13:08.810972 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2330/4698] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:13:09.226977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:09.229509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:09.246891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:09.247678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:09.248737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:09.249799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:09.252526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:09.253250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:09.332615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:09.336959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:09.337866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:09.338965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lazy-loading 'fault' on Instance uuid f199d2be-d73b-40b1-bfa9-1d6790a91739 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:13:09.480017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:09.492446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:09.494466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c64b66ce04347aee1f3e434952dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472edbb3f752428c8a88aeef89c83b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:09.498255 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0ab968af-b384-4a37-8867-9b7a6b7c0c80 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 200 len: 1410 microversion: 2.54 time: 0.275391 Sep 06 11:13:09.499390 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2369/4699] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:09 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 1410 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:09.601256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8cc17cf3-cb68-4ba2-8bfb-7d5534c611f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:09.602805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8cc17cf3-cb68-4ba2-8bfb-7d5534c611f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:09.639690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cc17cf3-cb68-4ba2-8bfb-7d5534c611f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:09.641033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cc17cf3-cb68-4ba2-8bfb-7d5534c611f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:09.641864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cc17cf3-cb68-4ba2-8bfb-7d5534c611f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:09.644686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cc17cf3-cb68-4ba2-8bfb-7d5534c611f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:09.657057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cc17cf3-cb68-4ba2-8bfb-7d5534c611f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:09.657057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cc17cf3-cb68-4ba2-8bfb-7d5534c611f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:10.218426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8cc17cf3-cb68-4ba2-8bfb-7d5534c611f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:10.241135 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8cc17cf3-cb68-4ba2-8bfb-7d5534c611f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1352 microversion: 2.1 time: 0.643845 Sep 06 11:13:10.246047 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2331/4700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:09 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1352 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:10.541143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a6fbcfd0-c5c1-499a-8393-ca3a6a932eb7 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:10.543937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a6fbcfd0-c5c1-499a-8393-ca3a6a932eb7 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] [instance: f199d2be-d73b-40b1-bfa9-1d6790a91739] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:10.548320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:10.561127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6fbcfd0-c5c1-499a-8393-ca3a6a932eb7 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:10.561627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6fbcfd0-c5c1-499a-8393-ca3a6a932eb7 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:10.565168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6fbcfd0-c5c1-499a-8393-ca3a6a932eb7 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:10.566913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6fbcfd0-c5c1-499a-8393-ca3a6a932eb7 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:10.568458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6fbcfd0-c5c1-499a-8393-ca3a6a932eb7 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:10.568938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6fbcfd0-c5c1-499a-8393-ca3a6a932eb7 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:10.599144 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-a6fbcfd0-c5c1-499a-8393-ca3a6a932eb7 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] HTTP exception thrown: Instance f199d2be-d73b-40b1-bfa9-1d6790a91739 could not be found. Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a6fbcfd0-c5c1-499a-8393-ca3a6a932eb7 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Request method failure captured: Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 HTTP/1.1 Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFysZEFda0A-UhLq3ePBklVSF7ZsFEEiJEFqgiFcy3_vW-m7ii3vXsPvUIBAcwIsdi_zWiVHhg9Za1IBc27izBs5SWzh9YOPfyhMtcn2cDm52pNg6X40FIh31LzhPbcc_EB98O5APl-2BN6Old_ohi9u_2j8FmkIn06hdYebHWbGgt-E Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Openstack-Nova-Api-Version: 2.54 Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 472edbb3f752428c8a88aeef89c83b8b Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerShowV254Test-753067486 Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_472edbb3f752428c8a88aeef89c83b8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472edbb3f752428c8a88aeef89c83b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/472edbb3f752428c8a88aeef89c83b8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472edbb3f752428c8a88aeef89c83b8b"}]}] Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerShowV254Test-753067486 Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 472edbb3f752428c8a88aeef89c83b8b Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerShowV254Test-753067486 Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerShowV254Test-753067486-project Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 037c64b66ce04347aee1f3e434952dfa Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerShowV254Test-753067486-project Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance f199d2be-d73b-40b1-bfa9-1d6790a91739 could not be found. Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'f199d2be-d73b-40b1-bfa9-1d6790a91739'} Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f199d2be-d73b-40b1-bfa9-1d6790a91739 could not be found. Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f199d2be-d73b-40b1-bfa9-1d6790a91739 could not be found. Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:13:10.600824 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:10.606169 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:10.606169 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:13:10.606169 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:13:10.606169 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:13:10.606169 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:13:10.606169 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f199d2be-d73b-40b1-bfa9-1d6790a91739 could not be found. Sep 06 11:13:10.606169 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:10.606169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a6fbcfd0-c5c1-499a-8393-ca3a6a932eb7 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] Returning 404 to user: Instance f199d2be-d73b-40b1-bfa9-1d6790a91739 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:13:10.606169 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a6fbcfd0-c5c1-499a-8393-ca3a6a932eb7 tempest-ServerShowV254Test-753067486 tempest-ServerShowV254Test-753067486-project] 10.222.0.20 "GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739" status: 404 len: 111 microversion: 2.54 time: 0.068285 Sep 06 11:13:10.607594 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2370/4701] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:10 2022] GET /compute/v2.1/servers/f199d2be-d73b-40b1-bfa9-1d6790a91739 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:13:11.272540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca9aab5b-2fec-42ff-bfc1-475b393bd7b7 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:11.274518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca9aab5b-2fec-42ff-bfc1-475b393bd7b7 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:11.283908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca9aab5b-2fec-42ff-bfc1-475b393bd7b7 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:11.284553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca9aab5b-2fec-42ff-bfc1-475b393bd7b7 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:11.287523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca9aab5b-2fec-42ff-bfc1-475b393bd7b7 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:11.288295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca9aab5b-2fec-42ff-bfc1-475b393bd7b7 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:11.290095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca9aab5b-2fec-42ff-bfc1-475b393bd7b7 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:11.291067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca9aab5b-2fec-42ff-bfc1-475b393bd7b7 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:11.537586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ca9aab5b-2fec-42ff-bfc1-475b393bd7b7 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:11.559717 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ca9aab5b-2fec-42ff-bfc1-475b393bd7b7 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1352 microversion: 2.1 time: 0.284442 Sep 06 11:13:11.559717 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2332/4702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:11 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1352 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:11.995327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ca76efc3-ac04-44d6-a424-77f813b0c228 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:11.995883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ca76efc3-ac04-44d6-a424-77f813b0c228 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:12.002857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=10 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:12.009213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca76efc3-ac04-44d6-a424-77f813b0c228 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:12.009944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca76efc3-ac04-44d6-a424-77f813b0c228 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:12.010561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca76efc3-ac04-44d6-a424-77f813b0c228 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:12.011799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca76efc3-ac04-44d6-a424-77f813b0c228 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:12.012437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca76efc3-ac04-44d6-a424-77f813b0c228 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:12.013044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca76efc3-ac04-44d6-a424-77f813b0c228 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:12.056057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ca76efc3-ac04-44d6-a424-77f813b0c228 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:13:12.549277 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ca76efc3-ac04-44d6-a424-77f813b0c228 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 204 len: 0 microversion: 2.1 time: 0.558705 Sep 06 11:13:12.550163 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2371/4703] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:13:11 2022] DELETE /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:13:12.566735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-266dbf95-0475-4c39-bf3d-2972df945b72 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:12.573276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-266dbf95-0475-4c39-bf3d-2972df945b72 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:12.582459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-87c8a070-93e8-4846-84d7-41c33f62a487 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:12.583463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-87c8a070-93e8-4846-84d7-41c33f62a487 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:12.603608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c8a070-93e8-4846-84d7-41c33f62a487 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:12.604299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c8a070-93e8-4846-84d7-41c33f62a487 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:12.605015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-266dbf95-0475-4c39-bf3d-2972df945b72 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:12.605586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c8a070-93e8-4846-84d7-41c33f62a487 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:12.606186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-266dbf95-0475-4c39-bf3d-2972df945b72 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:12.607064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c8a070-93e8-4846-84d7-41c33f62a487 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:12.607731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-266dbf95-0475-4c39-bf3d-2972df945b72 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:12.608425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c8a070-93e8-4846-84d7-41c33f62a487 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:12.609965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-266dbf95-0475-4c39-bf3d-2972df945b72 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:12.610524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87c8a070-93e8-4846-84d7-41c33f62a487 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:12.611190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-266dbf95-0475-4c39-bf3d-2972df945b72 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:12.612381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-266dbf95-0475-4c39-bf3d-2972df945b72 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:13.142171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-266dbf95-0475-4c39-bf3d-2972df945b72 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:13.144470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-87c8a070-93e8-4846-84d7-41c33f62a487 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:13.166938 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-266dbf95-0475-4c39-bf3d-2972df945b72 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1506 microversion: 2.1 time: 0.609592 Sep 06 11:13:13.170514 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-87c8a070-93e8-4846-84d7-41c33f62a487 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1352 microversion: 2.1 time: 0.587683 Sep 06 11:13:13.183986 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2333/4704] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:12 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1506 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:13:13.185112 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2372/4705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:12 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1352 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:14.201151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c8f25de1-e7ac-44f8-8032-0533f3fc2669 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:14.207899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cba5bc01-5e3f-445c-9301-1768c3808f09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:14.209709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c8f25de1-e7ac-44f8-8032-0533f3fc2669 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:14.210325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cba5bc01-5e3f-445c-9301-1768c3808f09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:14.230466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cba5bc01-5e3f-445c-9301-1768c3808f09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:14.231954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8f25de1-e7ac-44f8-8032-0533f3fc2669 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:14.234523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8f25de1-e7ac-44f8-8032-0533f3fc2669 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:14.235268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cba5bc01-5e3f-445c-9301-1768c3808f09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:14.235976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8f25de1-e7ac-44f8-8032-0533f3fc2669 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:14.236667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cba5bc01-5e3f-445c-9301-1768c3808f09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:14.238433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8f25de1-e7ac-44f8-8032-0533f3fc2669 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:14.242107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cba5bc01-5e3f-445c-9301-1768c3808f09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:14.242988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8f25de1-e7ac-44f8-8032-0533f3fc2669 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:14.243737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cba5bc01-5e3f-445c-9301-1768c3808f09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:14.244422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8f25de1-e7ac-44f8-8032-0533f3fc2669 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:14.245084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cba5bc01-5e3f-445c-9301-1768c3808f09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:14.581357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c8f25de1-e7ac-44f8-8032-0533f3fc2669 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:14.599806 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c8f25de1-e7ac-44f8-8032-0533f3fc2669 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1352 microversion: 2.1 time: 0.402765 Sep 06 11:13:14.600412 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2373/4706] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:14 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1352 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:14.619827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cba5bc01-5e3f-445c-9301-1768c3808f09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:14.644353 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cba5bc01-5e3f-445c-9301-1768c3808f09 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1506 microversion: 2.1 time: 0.440788 Sep 06 11:13:14.650199 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2334/4707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:14 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:15.065084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1973853987", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": "none"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:15.148002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:13:15.148002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:13:15.148002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:13:15.148002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:13:15.149461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:13:15.161916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:15.162529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:15.163166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:15.165082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:15.165897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:15.166700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:15.207852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Getting quotas for project 64ad0aa0c40a40d18f33ec559adac83f. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:13:15.220908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Getting quotas for user c73d9683f7f04bdeafa6d06ab565c800 and project 64ad0aa0c40a40d18f33ec559adac83f. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:13:15.254372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:13:15.258401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:13:15.624895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-71158e4b-ad6f-4812-8496-5a012bf7b893 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:15.625630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-71158e4b-ad6f-4812-8496-5a012bf7b893 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:15.634945 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-097105e8-33c7-4a2e-8000-6a4865caeb61 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.033354 Sep 06 11:13:15.638764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71158e4b-ad6f-4812-8496-5a012bf7b893 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:15.641031 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2374/4708] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 11:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 11:13:15.662401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71158e4b-ad6f-4812-8496-5a012bf7b893 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:15.663000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71158e4b-ad6f-4812-8496-5a012bf7b893 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:15.666870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71158e4b-ad6f-4812-8496-5a012bf7b893 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:15.672892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71158e4b-ad6f-4812-8496-5a012bf7b893 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:15.672892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71158e4b-ad6f-4812-8496-5a012bf7b893 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:15.687145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-91fee318-c070-46d2-ba98-d5713761149e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:15.692770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-91fee318-c070-46d2-ba98-d5713761149e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:15.893657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-91fee318-c070-46d2-ba98-d5713761149e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:15.965445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-91fee318-c070-46d2-ba98-d5713761149e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:15.975553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-91fee318-c070-46d2-ba98-d5713761149e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:15.984896 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-91fee318-c070-46d2-ba98-d5713761149e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1278 microversion: 2.57 time: 0.338296 Sep 06 11:13:15.986483 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2375/4709] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:15 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1278 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:16.011340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6c4990ed-8054-4559-a62c-b0fb084317b4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:16.011340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6c4990ed-8054-4559-a62c-b0fb084317b4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:16.011340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c4990ed-8054-4559-a62c-b0fb084317b4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:16.011340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c4990ed-8054-4559-a62c-b0fb084317b4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:16.011340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c4990ed-8054-4559-a62c-b0fb084317b4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:16.011340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c4990ed-8054-4559-a62c-b0fb084317b4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:16.011340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c4990ed-8054-4559-a62c-b0fb084317b4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:16.011340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c4990ed-8054-4559-a62c-b0fb084317b4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:16.106564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:16.308350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-71158e4b-ad6f-4812-8496-5a012bf7b893 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:16.330378 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-71158e4b-ad6f-4812-8496-5a012bf7b893 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1352 microversion: 2.1 time: 0.708371 Sep 06 11:13:16.343198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6c4990ed-8054-4559-a62c-b0fb084317b4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:16.345249 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2335/4710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:15 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1352 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:13:16.366058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-54a5a136-5b4c-4fa2-b440-b9759f19e553 req-8b4745a0-c942-4092-8483-0b0bf6edada5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff803c3-3d0d-490a-b950-9bab6ccc1fc3", "name": "network-vif-deleted", "tag": "60c8b190-e1bd-4d24-805b-0941dc9a3697"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:16.378588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-54a5a136-5b4c-4fa2-b440-b9759f19e553 req-8b4745a0-c942-4092-8483-0b0bf6edada5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:16.379472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-54a5a136-5b4c-4fa2-b440-b9759f19e553 req-8b4745a0-c942-4092-8483-0b0bf6edada5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:16.380357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-54a5a136-5b4c-4fa2-b440-b9759f19e553 req-8b4745a0-c942-4092-8483-0b0bf6edada5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:16.391062 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6c4990ed-8054-4559-a62c-b0fb084317b4 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1464 microversion: 2.1 time: 0.402386 Sep 06 11:13:16.402337 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2376/4711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:15 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1464 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:16.417240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-4ee68e9a-8a16-492a-b922-66fe459b97d7 req-fedf600c-b119-438d-9758-3e5f8eea1480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce8c0a7-8702-4362-8cd8-f22f61d9551e", "name": "network-vif-plugged", "status": "completed", "tag": "c990c201-d6ea-4a94-94e6-1857e9446755"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:16.420028 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-54a5a136-5b4c-4fa2-b440-b9759f19e553 req-8b4745a0-c942-4092-8483-0b0bf6edada5 service nova] Creating event network-vif-deleted:60c8b190-e1bd-4d24-805b-0941dc9a3697 for instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 on nch1-master-1 Sep 06 11:13:16.431184 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-54a5a136-5b4c-4fa2-b440-b9759f19e553 req-8b4745a0-c942-4092-8483-0b0bf6edada5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083902 Sep 06 11:13:16.432265 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2336/4712] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:13:16.442971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4ee68e9a-8a16-492a-b922-66fe459b97d7 req-fedf600c-b119-438d-9758-3e5f8eea1480 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:16.443995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4ee68e9a-8a16-492a-b922-66fe459b97d7 req-fedf600c-b119-438d-9758-3e5f8eea1480 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:16.444618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4ee68e9a-8a16-492a-b922-66fe459b97d7 req-fedf600c-b119-438d-9758-3e5f8eea1480 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:16.461938 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-4ee68e9a-8a16-492a-b922-66fe459b97d7 req-fedf600c-b119-438d-9758-3e5f8eea1480 service nova] Creating event network-vif-plugged:c990c201-d6ea-4a94-94e6-1857e9446755 for instance bce8c0a7-8702-4362-8cd8-f22f61d9551e on nch1-master-1 Sep 06 11:13:16.469113 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-4ee68e9a-8a16-492a-b922-66fe459b97d7 req-fedf600c-b119-438d-9758-3e5f8eea1480 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064704 Sep 06 11:13:16.475576 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2377/4713] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:13:17.015862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bb1cce1a-78b3-40cf-ba6a-a8667d62d921 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:17.016594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bb1cce1a-78b3-40cf-ba6a-a8667d62d921 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:17.097949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bb1cce1a-78b3-40cf-ba6a-a8667d62d921 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:17.108988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bb1cce1a-78b3-40cf-ba6a-a8667d62d921 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:17.108988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bb1cce1a-78b3-40cf-ba6a-a8667d62d921 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:17.109980 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bb1cce1a-78b3-40cf-ba6a-a8667d62d921 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1278 microversion: 2.57 time: 0.098420 Sep 06 11:13:17.130998 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2337/4714] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:17 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1278 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:17.345029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5b445823-bafc-4597-b2b7-834b01de4abe tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Action: 'create', calling method: .version_select at 0x7f90f31bcee0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1025210331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPz05HsxqQbOHwQn0yfFPyZPiDsFobUavaZwL4R0Ymz947s83+yz5X8Qg1db+KuJ6dQGcWUcJ6i5a3EGQczbl0F30uLKxKw7o/eGckcbxVYruqd+p+JsZh/y7OdAMajfA=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:17.366146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d6c14996-52af-4cf3-a980-c687f5af9d9b tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:17.367883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d6c14996-52af-4cf3-a980-c687f5af9d9b tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:17.372072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-5b445823-bafc-4597-b2b7-834b01de4abe tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Getting quotas for project deb7f753413a467fb1c86f7463b12563. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:13:17.374626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6c14996-52af-4cf3-a980-c687f5af9d9b tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:17.375378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6c14996-52af-4cf3-a980-c687f5af9d9b tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:17.376034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6c14996-52af-4cf3-a980-c687f5af9d9b tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:17.376994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6c14996-52af-4cf3-a980-c687f5af9d9b tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:17.377237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6c14996-52af-4cf3-a980-c687f5af9d9b tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:17.377681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6c14996-52af-4cf3-a980-c687f5af9d9b tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:17.382715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-5b445823-bafc-4597-b2b7-834b01de4abe tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Getting quotas for user 9d49264c495645f38d17ceb03a43195f and project deb7f753413a467fb1c86f7463b12563. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:13:17.502219 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5b445823-bafc-4597-b2b7-834b01de4abe tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.462918 Sep 06 11:13:17.504850 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2378/4715] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:13:17 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:13:17.517855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:17.518985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:17.527180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:17.531090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:17.531821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:17.532796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:17.533458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:17.534448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:17.589044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d6c14996-52af-4cf3-a980-c687f5af9d9b tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:17.609170 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d6c14996-52af-4cf3-a980-c687f5af9d9b tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1352 microversion: 2.1 time: 0.246977 Sep 06 11:13:17.609577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:17.613947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:17.613947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:17.613947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lazy-loading 'fault' on Instance uuid 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:13:17.619693 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2338/4716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:17 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1352 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:17.704623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:17.724326 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f2de9e29-4dd3-4204-b92a-19bf9c227b47 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1311 microversion: 2.1 time: 0.216306 Sep 06 11:13:17.725184 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2379/4717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:17 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1311 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:18.143532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3f67d46b-995b-4a22-92e6-9713b8187719 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:18.145865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3f67d46b-995b-4a22-92e6-9713b8187719 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:18.160553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f67d46b-995b-4a22-92e6-9713b8187719 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:18.160553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f67d46b-995b-4a22-92e6-9713b8187719 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:18.160553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f67d46b-995b-4a22-92e6-9713b8187719 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:18.160553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f67d46b-995b-4a22-92e6-9713b8187719 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:18.160553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f67d46b-995b-4a22-92e6-9713b8187719 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:18.160553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f67d46b-995b-4a22-92e6-9713b8187719 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:18.267497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3f67d46b-995b-4a22-92e6-9713b8187719 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:18.277218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3f67d46b-995b-4a22-92e6-9713b8187719 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:18.286684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3f67d46b-995b-4a22-92e6-9713b8187719 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:18.286684 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3f67d46b-995b-4a22-92e6-9713b8187719 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1282 microversion: 2.57 time: 0.144955 Sep 06 11:13:18.286684 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2339/4718] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:18 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1282 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:18.648696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-857e1e6f-e4be-42d4-a6ba-1ed8619ac0b6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:18.650124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-857e1e6f-e4be-42d4-a6ba-1ed8619ac0b6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:18.660215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-857e1e6f-e4be-42d4-a6ba-1ed8619ac0b6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:18.660721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-857e1e6f-e4be-42d4-a6ba-1ed8619ac0b6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:18.661177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-857e1e6f-e4be-42d4-a6ba-1ed8619ac0b6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:18.662809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-857e1e6f-e4be-42d4-a6ba-1ed8619ac0b6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:18.664038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-857e1e6f-e4be-42d4-a6ba-1ed8619ac0b6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:18.664625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-857e1e6f-e4be-42d4-a6ba-1ed8619ac0b6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:18.749388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:18.750282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:18.757268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:18.758610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:18.759356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:18.760293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:18.760976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:18.761567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:18.792935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:18.824265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:18.830442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:18.836679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:18.836679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lazy-loading 'fault' on Instance uuid 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:13:19.414155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:19.422015 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd989f71-42e2-4c4c-8659-a64d9956f0c5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 200 len: 1311 microversion: 2.1 time: 0.676513 Sep 06 11:13:19.422609 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2340/4719] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:18 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 1311 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:13:19.434877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c7b8b0b-0fb3-42cf-8809-f7be4dc5dea0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:19.437083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c7b8b0b-0fb3-42cf-8809-f7be4dc5dea0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:19.456011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c7b8b0b-0fb3-42cf-8809-f7be4dc5dea0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:19.456515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c7b8b0b-0fb3-42cf-8809-f7be4dc5dea0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:19.457292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c7b8b0b-0fb3-42cf-8809-f7be4dc5dea0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:19.460982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c7b8b0b-0fb3-42cf-8809-f7be4dc5dea0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:19.461718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c7b8b0b-0fb3-42cf-8809-f7be4dc5dea0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:19.462429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c7b8b0b-0fb3-42cf-8809-f7be4dc5dea0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:19.488539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-857e1e6f-e4be-42d4-a6ba-1ed8619ac0b6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:19.507490 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-857e1e6f-e4be-42d4-a6ba-1ed8619ac0b6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1352 microversion: 2.1 time: 0.871128 Sep 06 11:13:19.509639 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2380/4720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:18 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1352 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:19.642721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2c7b8b0b-0fb3-42cf-8809-f7be4dc5dea0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:19.657582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2c7b8b0b-0fb3-42cf-8809-f7be4dc5dea0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:19.659759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2c7b8b0b-0fb3-42cf-8809-f7be4dc5dea0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:19.661027 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c7b8b0b-0fb3-42cf-8809-f7be4dc5dea0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1330 microversion: 2.57 time: 0.234461 Sep 06 11:13:19.667845 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2341/4721] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:19 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1330 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:20.446359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ddf7fe62-e906-4bd2-b363-61517ea1d808 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:20.446975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ddf7fe62-e906-4bd2-b363-61517ea1d808 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:20.465864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddf7fe62-e906-4bd2-b363-61517ea1d808 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:20.469770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddf7fe62-e906-4bd2-b363-61517ea1d808 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:20.469770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddf7fe62-e906-4bd2-b363-61517ea1d808 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:20.477082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddf7fe62-e906-4bd2-b363-61517ea1d808 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:20.477804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddf7fe62-e906-4bd2-b363-61517ea1d808 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:20.478432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddf7fe62-e906-4bd2-b363-61517ea1d808 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:20.505981 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-ddf7fe62-e906-4bd2-b363-61517ea1d808 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] HTTP exception thrown: Instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 could not be found. Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ddf7fe62-e906-4bd2-b363-61517ea1d808 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Request method failure captured: Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 HTTP/1.1 Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFypBCZVzhsRBhBANMStQFyeCLS5PmKt-tnLIYX5sT_ENc4vLLwScYTWL5yqaaxpUhllGbPc3oIWuuzLq-Hr-H-vcfxt82OKYl89zSQBoVSvyllXHebYOgIiQtfQzKHMF-bGKhrOYJft0jC5PHYUnd4l11fkckESPh53h8qp5BGDnUAg Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}] Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e45dfaf9fd949548bca37303a117bb1 Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 could not be found. Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '8ff803c3-3d0d-490a-b950-9bab6ccc1fc3'} Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 could not be found. Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 could not be found. Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:20.508867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:13:20.513285 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:20.513285 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:20.513285 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:13:20.513285 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:13:20.513285 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:13:20.513285 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:13:20.513285 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 could not be found. Sep 06 11:13:20.513285 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:20.515249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ddf7fe62-e906-4bd2-b363-61517ea1d808 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Returning 404 to user: Instance 8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:13:20.517801 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ddf7fe62-e906-4bd2-b363-61517ea1d808 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3" status: 404 len: 111 microversion: 2.1 time: 0.074598 Sep 06 11:13:20.520007 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2381/4722] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:20 2022] GET /compute/v2.1/servers/8ff803c3-3d0d-490a-b950-9bab6ccc1fc3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:13:20.527838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f08da47a-48d2-4cf3-abd4-226f154d5fb5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:20.528365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f08da47a-48d2-4cf3-abd4-226f154d5fb5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:20.540624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f08da47a-48d2-4cf3-abd4-226f154d5fb5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:20.541130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f08da47a-48d2-4cf3-abd4-226f154d5fb5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:20.541614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f08da47a-48d2-4cf3-abd4-226f154d5fb5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:20.542293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f08da47a-48d2-4cf3-abd4-226f154d5fb5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:20.542762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f08da47a-48d2-4cf3-abd4-226f154d5fb5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:20.547699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f08da47a-48d2-4cf3-abd4-226f154d5fb5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:20.547873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a68bbbde-2c0c-460d-9dae-a41620bcadee tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:20.548350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a68bbbde-2c0c-460d-9dae-a41620bcadee tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:20.568615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a68bbbde-2c0c-460d-9dae-a41620bcadee tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:20.573466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a68bbbde-2c0c-460d-9dae-a41620bcadee tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:20.573966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a68bbbde-2c0c-460d-9dae-a41620bcadee tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:20.574734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a68bbbde-2c0c-460d-9dae-a41620bcadee tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:20.575738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a68bbbde-2c0c-460d-9dae-a41620bcadee tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:20.576200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a68bbbde-2c0c-460d-9dae-a41620bcadee tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:20.621199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f08da47a-48d2-4cf3-abd4-226f154d5fb5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:13:20.923637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a68bbbde-2c0c-460d-9dae-a41620bcadee tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:20.933933 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a68bbbde-2c0c-460d-9dae-a41620bcadee tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1542 microversion: 2.1 time: 0.397698 Sep 06 11:13:20.945829 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2382/4723] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:20 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1542 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:20.950036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ce905f07-e32f-4287-b34d-f1d945bfc928 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:20.950773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ce905f07-e32f-4287-b34d-f1d945bfc928 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:20.959255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce905f07-e32f-4287-b34d-f1d945bfc928 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:20.959689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce905f07-e32f-4287-b34d-f1d945bfc928 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:20.960147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce905f07-e32f-4287-b34d-f1d945bfc928 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:20.960938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce905f07-e32f-4287-b34d-f1d945bfc928 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:20.961411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce905f07-e32f-4287-b34d-f1d945bfc928 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:20.961855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce905f07-e32f-4287-b34d-f1d945bfc928 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:21.050725 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f08da47a-48d2-4cf3-abd4-226f154d5fb5 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "DELETE /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 204 len: 0 microversion: 2.1 time: 0.526184 Sep 06 11:13:21.055215 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2342/4724] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:13:20 2022] DELETE /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:13:21.063321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8ded0a70-9002-41d9-884b-97b21fb492f3 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:21.064141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8ded0a70-9002-41d9-884b-97b21fb492f3 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:21.072664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ded0a70-9002-41d9-884b-97b21fb492f3 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:21.073250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ded0a70-9002-41d9-884b-97b21fb492f3 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:21.073807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ded0a70-9002-41d9-884b-97b21fb492f3 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:21.075060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ded0a70-9002-41d9-884b-97b21fb492f3 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:21.076127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ded0a70-9002-41d9-884b-97b21fb492f3 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:21.079035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8ded0a70-9002-41d9-884b-97b21fb492f3 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:21.105773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce905f07-e32f-4287-b34d-f1d945bfc928 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:21.116757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce905f07-e32f-4287-b34d-f1d945bfc928 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:21.121271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce905f07-e32f-4287-b34d-f1d945bfc928 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:21.122947 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ce905f07-e32f-4287-b34d-f1d945bfc928 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1336 microversion: 2.57 time: 0.187437 Sep 06 11:13:21.124376 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2383/4725] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:20 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1336 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:21.129779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2f87fdfc-1f4e-4006-8cc9-4335235a282f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:21.131037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2f87fdfc-1f4e-4006-8cc9-4335235a282f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:21.138953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f87fdfc-1f4e-4006-8cc9-4335235a282f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:21.144448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f87fdfc-1f4e-4006-8cc9-4335235a282f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:21.144448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f87fdfc-1f4e-4006-8cc9-4335235a282f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:21.144448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f87fdfc-1f4e-4006-8cc9-4335235a282f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:21.144448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f87fdfc-1f4e-4006-8cc9-4335235a282f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:21.144448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f87fdfc-1f4e-4006-8cc9-4335235a282f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:21.300272 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8ded0a70-9002-41d9-884b-97b21fb492f3 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.244052 Sep 06 11:13:21.300881 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2343/4726] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:13:21 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e/os-interface => generated 284 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:13:21.775307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2f87fdfc-1f4e-4006-8cc9-4335235a282f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:21.790262 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2f87fdfc-1f4e-4006-8cc9-4335235a282f tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1519 microversion: 2.1 time: 0.661755 Sep 06 11:13:21.791226 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2384/4727] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:21 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1519 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:22.159908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bbb41cd6-16b0-4505-991b-001e1f247244 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:22.161232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bbb41cd6-16b0-4505-991b-001e1f247244 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:22.183888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bbb41cd6-16b0-4505-991b-001e1f247244 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:22.184767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bbb41cd6-16b0-4505-991b-001e1f247244 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:22.185680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bbb41cd6-16b0-4505-991b-001e1f247244 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:22.186730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bbb41cd6-16b0-4505-991b-001e1f247244 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:22.187488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bbb41cd6-16b0-4505-991b-001e1f247244 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:22.190495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bbb41cd6-16b0-4505-991b-001e1f247244 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:22.412776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bbb41cd6-16b0-4505-991b-001e1f247244 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:22.425545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bbb41cd6-16b0-4505-991b-001e1f247244 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:22.433651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bbb41cd6-16b0-4505-991b-001e1f247244 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:22.434979 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bbb41cd6-16b0-4505-991b-001e1f247244 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1336 microversion: 2.57 time: 0.281953 Sep 06 11:13:22.435619 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2344/4728] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:22 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1336 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:22.815562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-38a4a69d-0d51-488a-80ee-24ab031d00f7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:22.816223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-38a4a69d-0d51-488a-80ee-24ab031d00f7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:22.835852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38a4a69d-0d51-488a-80ee-24ab031d00f7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:22.836341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38a4a69d-0d51-488a-80ee-24ab031d00f7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:22.836751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38a4a69d-0d51-488a-80ee-24ab031d00f7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:22.837563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38a4a69d-0d51-488a-80ee-24ab031d00f7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:22.843623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38a4a69d-0d51-488a-80ee-24ab031d00f7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:22.844362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38a4a69d-0d51-488a-80ee-24ab031d00f7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:23.390776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-38a4a69d-0d51-488a-80ee-24ab031d00f7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:23.409352 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-38a4a69d-0d51-488a-80ee-24ab031d00f7 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1519 microversion: 2.1 time: 0.594441 Sep 06 11:13:23.410336 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2385/4729] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:22 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1519 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:23.471724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b7720218-704d-47cd-92bf-0956dc7ca94c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:23.472713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b7720218-704d-47cd-92bf-0956dc7ca94c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:23.486266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7720218-704d-47cd-92bf-0956dc7ca94c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:23.486777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7720218-704d-47cd-92bf-0956dc7ca94c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:23.487259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7720218-704d-47cd-92bf-0956dc7ca94c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:23.489380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7720218-704d-47cd-92bf-0956dc7ca94c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:23.490273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7720218-704d-47cd-92bf-0956dc7ca94c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:23.490906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7720218-704d-47cd-92bf-0956dc7ca94c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:23.662803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b7720218-704d-47cd-92bf-0956dc7ca94c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:23.689376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b7720218-704d-47cd-92bf-0956dc7ca94c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:23.692035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b7720218-704d-47cd-92bf-0956dc7ca94c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:23.698268 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b7720218-704d-47cd-92bf-0956dc7ca94c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1336 microversion: 2.57 time: 0.233145 Sep 06 11:13:23.704589 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2345/4730] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:23 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1336 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:13:23.753481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-7640af15-80db-433d-ab1a-6e386321b526 req-4b883018-0087-496f-84d0-1789e6de72dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce8c0a7-8702-4362-8cd8-f22f61d9551e", "tag": "c990c201-d6ea-4a94-94e6-1857e9446755"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:23.766289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7640af15-80db-433d-ab1a-6e386321b526 req-4b883018-0087-496f-84d0-1789e6de72dd service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:23.767696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7640af15-80db-433d-ab1a-6e386321b526 req-4b883018-0087-496f-84d0-1789e6de72dd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:23.768365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7640af15-80db-433d-ab1a-6e386321b526 req-4b883018-0087-496f-84d0-1789e6de72dd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:23.799791 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-7640af15-80db-433d-ab1a-6e386321b526 req-4b883018-0087-496f-84d0-1789e6de72dd service nova] Creating event network-changed:c990c201-d6ea-4a94-94e6-1857e9446755 for instance bce8c0a7-8702-4362-8cd8-f22f61d9551e on nch1-master-1 Sep 06 11:13:23.815028 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-7640af15-80db-433d-ab1a-6e386321b526 req-4b883018-0087-496f-84d0-1789e6de72dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065081 Sep 06 11:13:23.817598 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2386/4731] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:13:24.453278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a4b0210f-2384-44bf-8e1f-0470eba15c2a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:24.455243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a4b0210f-2384-44bf-8e1f-0470eba15c2a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:24.476743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4b0210f-2384-44bf-8e1f-0470eba15c2a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:24.478054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4b0210f-2384-44bf-8e1f-0470eba15c2a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:24.483264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4b0210f-2384-44bf-8e1f-0470eba15c2a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:24.484098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4b0210f-2384-44bf-8e1f-0470eba15c2a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:24.484589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4b0210f-2384-44bf-8e1f-0470eba15c2a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:24.485063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4b0210f-2384-44bf-8e1f-0470eba15c2a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:24.748051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d19b5498-f553-42ad-ad88-d69ba7bc3438 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:24.749624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d19b5498-f553-42ad-ad88-d69ba7bc3438 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:24.758128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a4b0210f-2384-44bf-8e1f-0470eba15c2a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:24.773519 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a4b0210f-2384-44bf-8e1f-0470eba15c2a tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1519 microversion: 2.1 time: 0.324613 Sep 06 11:13:24.776221 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2346/4732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:24 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1519 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:24.783529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d19b5498-f553-42ad-ad88-d69ba7bc3438 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:24.784604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d19b5498-f553-42ad-ad88-d69ba7bc3438 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:24.787695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d19b5498-f553-42ad-ad88-d69ba7bc3438 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:24.788548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d19b5498-f553-42ad-ad88-d69ba7bc3438 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:24.790451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d19b5498-f553-42ad-ad88-d69ba7bc3438 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:24.792656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d19b5498-f553-42ad-ad88-d69ba7bc3438 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:24.992905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d19b5498-f553-42ad-ad88-d69ba7bc3438 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:25.011690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d19b5498-f553-42ad-ad88-d69ba7bc3438 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:25.014035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d19b5498-f553-42ad-ad88-d69ba7bc3438 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:25.015994 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d19b5498-f553-42ad-ad88-d69ba7bc3438 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1336 microversion: 2.57 time: 0.284971 Sep 06 11:13:25.016947 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2387/4733] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:24 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1336 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:25.806964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dccdb290-0f23-4618-8a43-e8632090fd38 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:25.807822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dccdb290-0f23-4618-8a43-e8632090fd38 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:25.831281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dccdb290-0f23-4618-8a43-e8632090fd38 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:25.831839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dccdb290-0f23-4618-8a43-e8632090fd38 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:25.834484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dccdb290-0f23-4618-8a43-e8632090fd38 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:25.836751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dccdb290-0f23-4618-8a43-e8632090fd38 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:25.837687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9f0b0880-69e0-4f6e-a9c5-e11cede1c779 req-6cd92e4a-0c24-4b96-b89d-89525523c5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97907bbb-c089-4899-8d70-8c012daf803b", "name": "network-vif-deleted", "tag": "76edc669-c87b-4c08-923b-c5192a5d4d54"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:25.838331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dccdb290-0f23-4618-8a43-e8632090fd38 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:25.843630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:25.850829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dccdb290-0f23-4618-8a43-e8632090fd38 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:25.860497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9f0b0880-69e0-4f6e-a9c5-e11cede1c779 req-6cd92e4a-0c24-4b96-b89d-89525523c5c2 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:25.865304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9f0b0880-69e0-4f6e-a9c5-e11cede1c779 req-6cd92e4a-0c24-4b96-b89d-89525523c5c2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:25.872839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9f0b0880-69e0-4f6e-a9c5-e11cede1c779 req-6cd92e4a-0c24-4b96-b89d-89525523c5c2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:25.915987 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9f0b0880-69e0-4f6e-a9c5-e11cede1c779 req-6cd92e4a-0c24-4b96-b89d-89525523c5c2 service nova] Creating event network-vif-deleted:76edc669-c87b-4c08-923b-c5192a5d4d54 for instance 97907bbb-c089-4899-8d70-8c012daf803b on nch2-master-1 Sep 06 11:13:25.928964 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9f0b0880-69e0-4f6e-a9c5-e11cede1c779 req-6cd92e4a-0c24-4b96-b89d-89525523c5c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095323 Sep 06 11:13:25.931691 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2388/4734] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:13:26.050515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-146d74cf-e2d5-43b3-8d6c-89b416fbcf42 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:26.051247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-146d74cf-e2d5-43b3-8d6c-89b416fbcf42 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:26.078137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-146d74cf-e2d5-43b3-8d6c-89b416fbcf42 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:26.079827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-146d74cf-e2d5-43b3-8d6c-89b416fbcf42 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:26.080316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-146d74cf-e2d5-43b3-8d6c-89b416fbcf42 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:26.081093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-146d74cf-e2d5-43b3-8d6c-89b416fbcf42 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:26.081572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-146d74cf-e2d5-43b3-8d6c-89b416fbcf42 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:26.086544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dccdb290-0f23-4618-8a43-e8632090fd38 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:26.086716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-146d74cf-e2d5-43b3-8d6c-89b416fbcf42 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:26.172689 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dccdb290-0f23-4618-8a43-e8632090fd38 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1477 microversion: 2.1 time: 0.371003 Sep 06 11:13:26.180408 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2347/4735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:25 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1477 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:27.161883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-146d74cf-e2d5-43b3-8d6c-89b416fbcf42 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:27.192789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-146d74cf-e2d5-43b3-8d6c-89b416fbcf42 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:27.194957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-146d74cf-e2d5-43b3-8d6c-89b416fbcf42 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:27.205680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:27.207155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:27.215580 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-146d74cf-e2d5-43b3-8d6c-89b416fbcf42 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1357 microversion: 2.57 time: 1.169606 Sep 06 11:13:27.216783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:27.230342 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2389/4736] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:26 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1357 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:27.230530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:27.230530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:27.230530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:27.230530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:27.230530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:27.232195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:27.251482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:27.259122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:27.289397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:27.289536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:27.290070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:27.308067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:27.311571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:27.316955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:27.402061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:27.411099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:27.411856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:27.417918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lazy-loading 'fault' on Instance uuid 97907bbb-c089-4899-8d70-8c012daf803b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:13:27.455161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:27.578508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e45dfaf9fd949548bca37303a117bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887d04ff8eee40e59ec6dd248dd5b548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:27.590678 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-41466e1f-9700-4560-af0e-a494dbb4af46 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 200 len: 1310 microversion: 2.1 time: 0.389653 Sep 06 11:13:27.592792 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2348/4737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:27 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 1310 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:27.597842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:13:27.597842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:13:27.598179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:13:27.598608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:13:27.599042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:13:27.918624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:27.957236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:27.962709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:27.963313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:27.966973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:27.967584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:27.970162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:28.086610 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-842be347-73a6-4477-8610-3c17a6a812a5 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "POST /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1/action" status: 202 len: 1138 microversion: 2.57 time: 0.834163 Sep 06 11:13:28.087728 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2390/4738] 10.222.0.20 () {62 vars in 1320 bytes} [Tue Sep 6 11:13:27 2022] POST /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1/action => generated 1138 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 06 11:13:28.118803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a44f87bf-0e6b-4a71-ab8a-4e0747fde56b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:28.119766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a44f87bf-0e6b-4a71-ab8a-4e0747fde56b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:28.148442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a44f87bf-0e6b-4a71-ab8a-4e0747fde56b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:28.150565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a44f87bf-0e6b-4a71-ab8a-4e0747fde56b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:28.155164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a44f87bf-0e6b-4a71-ab8a-4e0747fde56b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:28.157798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a44f87bf-0e6b-4a71-ab8a-4e0747fde56b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:28.161399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a44f87bf-0e6b-4a71-ab8a-4e0747fde56b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:28.162914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a44f87bf-0e6b-4a71-ab8a-4e0747fde56b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:28.364051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a44f87bf-0e6b-4a71-ab8a-4e0747fde56b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:28.376417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a44f87bf-0e6b-4a71-ab8a-4e0747fde56b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:28.378738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a44f87bf-0e6b-4a71-ab8a-4e0747fde56b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:28.381129 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a44f87bf-0e6b-4a71-ab8a-4e0747fde56b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.271283 Sep 06 11:13:28.386588 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2349/4739] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:28 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:13:28.621258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6f9681d0-4b7b-4cc5-967b-13df25623b42 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:28.622665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6f9681d0-4b7b-4cc5-967b-13df25623b42 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] [instance: 97907bbb-c089-4899-8d70-8c012daf803b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:28.632912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f9681d0-4b7b-4cc5-967b-13df25623b42 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:28.634528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f9681d0-4b7b-4cc5-967b-13df25623b42 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:28.645886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f9681d0-4b7b-4cc5-967b-13df25623b42 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:28.648272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f9681d0-4b7b-4cc5-967b-13df25623b42 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:28.652189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f9681d0-4b7b-4cc5-967b-13df25623b42 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:28.654947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f9681d0-4b7b-4cc5-967b-13df25623b42 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:28.698660 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-6f9681d0-4b7b-4cc5-967b-13df25623b42 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] HTTP exception thrown: Instance 97907bbb-c089-4899-8d70-8c012daf803b could not be found. Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6f9681d0-4b7b-4cc5-967b-13df25623b42 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Request method failure captured: Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b HTTP/1.1 Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFypBCZVzhsRBhBANMStQFyeCLS5PmKt-tnLIYX5sT_ENc4vLLwScYTWL5yqaaxpUhllGbPc3oIWuuzLq-Hr-H-vcfxt82OKYl89zSQBoVSvyllXHebYOgIiQtfQzKHMF-bGKhrOYJft0jC5PHYUnd4l11fkckESPh53h8qp5BGDnUAg Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/887d04ff8eee40e59ec6dd248dd5b548"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/887d04ff8eee40e59ec6dd248dd5b548"}]}] Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 887d04ff8eee40e59ec6dd248dd5b548 Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-836817113 Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e45dfaf9fd949548bca37303a117bb1 Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-836817113-project Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 97907bbb-c089-4899-8d70-8c012daf803b could not be found. Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '97907bbb-c089-4899-8d70-8c012daf803b'} Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97907bbb-c089-4899-8d70-8c012daf803b could not be found. Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97907bbb-c089-4899-8d70-8c012daf803b could not be found. Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:28.700902 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:13:28.705880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:28.705880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:28.705880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:13:28.705880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:13:28.705880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:13:28.705880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:13:28.705880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97907bbb-c089-4899-8d70-8c012daf803b could not be found. Sep 06 11:13:28.705880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:28.705880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6f9681d0-4b7b-4cc5-967b-13df25623b42 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] Returning 404 to user: Instance 97907bbb-c089-4899-8d70-8c012daf803b could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:13:28.705880 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6f9681d0-4b7b-4cc5-967b-13df25623b42 tempest-ServerRescueNegativeTestJSON-836817113 tempest-ServerRescueNegativeTestJSON-836817113-project] 10.222.0.20 "GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b" status: 404 len: 111 microversion: 2.1 time: 0.087500 Sep 06 11:13:28.707560 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2391/4740] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:28 2022] GET /compute/v2.1/servers/97907bbb-c089-4899-8d70-8c012daf803b => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:13:29.428987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-272243a3-e241-4e8f-a9e6-915af916a869 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:29.429524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-272243a3-e241-4e8f-a9e6-915af916a869 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:29.436223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:29.437887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-272243a3-e241-4e8f-a9e6-915af916a869 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:29.438683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-272243a3-e241-4e8f-a9e6-915af916a869 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:29.439358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-272243a3-e241-4e8f-a9e6-915af916a869 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:29.440289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-272243a3-e241-4e8f-a9e6-915af916a869 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:29.441082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-272243a3-e241-4e8f-a9e6-915af916a869 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:29.441926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-272243a3-e241-4e8f-a9e6-915af916a869 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:29.565233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-272243a3-e241-4e8f-a9e6-915af916a869 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:29.578032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-272243a3-e241-4e8f-a9e6-915af916a869 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:29.579587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-272243a3-e241-4e8f-a9e6-915af916a869 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:29.580823 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-272243a3-e241-4e8f-a9e6-915af916a869 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.156198 Sep 06 11:13:29.582094 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2350/4741] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:29 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:13:30.612190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-17142436-4230-4f8b-b2a7-721fecb5e8b1 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:30.612786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-17142436-4230-4f8b-b2a7-721fecb5e8b1 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:30.625005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17142436-4230-4f8b-b2a7-721fecb5e8b1 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:30.630121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17142436-4230-4f8b-b2a7-721fecb5e8b1 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:30.630844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17142436-4230-4f8b-b2a7-721fecb5e8b1 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:30.632179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17142436-4230-4f8b-b2a7-721fecb5e8b1 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:30.633551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17142436-4230-4f8b-b2a7-721fecb5e8b1 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:30.634977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17142436-4230-4f8b-b2a7-721fecb5e8b1 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:30.838373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-17142436-4230-4f8b-b2a7-721fecb5e8b1 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:30.867738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-17142436-4230-4f8b-b2a7-721fecb5e8b1 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:30.878005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-17142436-4230-4f8b-b2a7-721fecb5e8b1 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:30.878005 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-17142436-4230-4f8b-b2a7-721fecb5e8b1 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.270256 Sep 06 11:13:30.881028 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2392/4742] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:30 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:31.910200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-727e87ee-c4ae-4c15-9db5-f38d8404f2b4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:31.911673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-727e87ee-c4ae-4c15-9db5-f38d8404f2b4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:31.924193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-727e87ee-c4ae-4c15-9db5-f38d8404f2b4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:31.925399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-727e87ee-c4ae-4c15-9db5-f38d8404f2b4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:31.926149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-727e87ee-c4ae-4c15-9db5-f38d8404f2b4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:31.929913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-727e87ee-c4ae-4c15-9db5-f38d8404f2b4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:31.930850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-727e87ee-c4ae-4c15-9db5-f38d8404f2b4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:31.931692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-727e87ee-c4ae-4c15-9db5-f38d8404f2b4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:32.047994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-727e87ee-c4ae-4c15-9db5-f38d8404f2b4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:32.069789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-727e87ee-c4ae-4c15-9db5-f38d8404f2b4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:32.073733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-727e87ee-c4ae-4c15-9db5-f38d8404f2b4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:32.076014 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-727e87ee-c4ae-4c15-9db5-f38d8404f2b4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.170416 Sep 06 11:13:32.088603 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2351/4743] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:31 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:32.394878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1892704078-access_point-2090435891", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "68d50852-e176-4ac7-ac9f-0fbf89f6fe73"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1025210331", "security_groups": [{"name": "tempest-secgroup_access--832634000"}, {"name": "tempest-secgroup_general--1147682121"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:32.613978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] validate_networks() for [('68d50852-e176-4ac7-ac9f-0fbf89f6fe73', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:13:33.112417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-86af19c9-06f0-4981-9aa8-605c7a645c75 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:33.114054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-86af19c9-06f0-4981-9aa8-605c7a645c75 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:33.127239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86af19c9-06f0-4981-9aa8-605c7a645c75 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:33.127239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86af19c9-06f0-4981-9aa8-605c7a645c75 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:33.127239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86af19c9-06f0-4981-9aa8-605c7a645c75 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:33.127239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86af19c9-06f0-4981-9aa8-605c7a645c75 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:33.127239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86af19c9-06f0-4981-9aa8-605c7a645c75 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:33.127239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86af19c9-06f0-4981-9aa8-605c7a645c75 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:33.173707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:13:33.174571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:13:33.175307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:13:33.175735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:13:33.176170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:13:33.195866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:33.196822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:33.197370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:33.198108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:33.198842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:33.199400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:33.248813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Getting quotas for project deb7f753413a467fb1c86f7463b12563. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:13:33.259556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Getting quotas for user 9d49264c495645f38d17ceb03a43195f and project deb7f753413a467fb1c86f7463b12563. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:13:33.264262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:33.271768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-86af19c9-06f0-4981-9aa8-605c7a645c75 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:33.284790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:13:33.288018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-86af19c9-06f0-4981-9aa8-605c7a645c75 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:33.289388 ncdv-master-1 devstack@n-api.service[140876]: WARNING nova.utils [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1892704078-access_point-2090435891 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1892704078-ac Sep 06 11:13:33.290507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:13:33.290651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-86af19c9-06f0-4981-9aa8-605c7a645c75 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:33.294543 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-86af19c9-06f0-4981-9aa8-605c7a645c75 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.188298 Sep 06 11:13:33.297511 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2352/4744] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:33 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:33.514499 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a86d47d7-dc63-453d-9dba-13c175285502 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.123656 Sep 06 11:13:33.515547 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2393/4745] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:13:32 2022] POST /compute/v2.1/servers => generated 457 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:13:33.529156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4da2ccb1-902a-4037-a5eb-1d364b0154a7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:33.532458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4da2ccb1-902a-4037-a5eb-1d364b0154a7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:33.600399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4da2ccb1-902a-4037-a5eb-1d364b0154a7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:33.610078 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4da2ccb1-902a-4037-a5eb-1d364b0154a7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1295 microversion: 2.1 time: 0.085578 Sep 06 11:13:33.610877 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2353/4746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:33 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:13:34.327277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2845ed2a-c947-4fc2-aad2-c46f940f8877 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:34.327924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2845ed2a-c947-4fc2-aad2-c46f940f8877 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:34.343068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2845ed2a-c947-4fc2-aad2-c46f940f8877 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:34.343591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2845ed2a-c947-4fc2-aad2-c46f940f8877 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:34.350569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2845ed2a-c947-4fc2-aad2-c46f940f8877 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:34.350932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2845ed2a-c947-4fc2-aad2-c46f940f8877 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:34.351500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2845ed2a-c947-4fc2-aad2-c46f940f8877 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:34.351962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2845ed2a-c947-4fc2-aad2-c46f940f8877 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:34.430510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2845ed2a-c947-4fc2-aad2-c46f940f8877 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:34.440034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2845ed2a-c947-4fc2-aad2-c46f940f8877 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:34.442712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2845ed2a-c947-4fc2-aad2-c46f940f8877 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:34.445648 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2845ed2a-c947-4fc2-aad2-c46f940f8877 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.121420 Sep 06 11:13:34.446782 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2394/4747] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:34 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:13:34.634636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c165024b-e76f-49ae-948e-6cf31a713333 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:34.637635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c165024b-e76f-49ae-948e-6cf31a713333 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:34.724256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c165024b-e76f-49ae-948e-6cf31a713333 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:34.736278 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c165024b-e76f-49ae-948e-6cf31a713333 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1295 microversion: 2.1 time: 0.105725 Sep 06 11:13:34.737414 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2354/4748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:34 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1295 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:35.476774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-89bbdb08-b0c4-4b54-ad95-9bb07fb6541d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:35.478496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-89bbdb08-b0c4-4b54-ad95-9bb07fb6541d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:35.487137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89bbdb08-b0c4-4b54-ad95-9bb07fb6541d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:35.487632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89bbdb08-b0c4-4b54-ad95-9bb07fb6541d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:35.488098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89bbdb08-b0c4-4b54-ad95-9bb07fb6541d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:35.488814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89bbdb08-b0c4-4b54-ad95-9bb07fb6541d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:35.489283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89bbdb08-b0c4-4b54-ad95-9bb07fb6541d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:35.490017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89bbdb08-b0c4-4b54-ad95-9bb07fb6541d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:35.534380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:35.625996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-89bbdb08-b0c4-4b54-ad95-9bb07fb6541d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:35.635524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-89bbdb08-b0c4-4b54-ad95-9bb07fb6541d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:35.637545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-89bbdb08-b0c4-4b54-ad95-9bb07fb6541d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:35.638832 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-89bbdb08-b0c4-4b54-ad95-9bb07fb6541d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.169983 Sep 06 11:13:35.639334 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2395/4749] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:35 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:35.762079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2ec9b334-b97f-4ee2-aa93-31b8e12f0631 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:35.762716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2ec9b334-b97f-4ee2-aa93-31b8e12f0631 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:35.776521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ec9b334-b97f-4ee2-aa93-31b8e12f0631 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:35.777065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ec9b334-b97f-4ee2-aa93-31b8e12f0631 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:35.777523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ec9b334-b97f-4ee2-aa93-31b8e12f0631 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:35.778306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ec9b334-b97f-4ee2-aa93-31b8e12f0631 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:35.778778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ec9b334-b97f-4ee2-aa93-31b8e12f0631 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:35.779243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ec9b334-b97f-4ee2-aa93-31b8e12f0631 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:35.882490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2ec9b334-b97f-4ee2-aa93-31b8e12f0631 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:35.919579 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2ec9b334-b97f-4ee2-aa93-31b8e12f0631 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1299 microversion: 2.1 time: 0.161148 Sep 06 11:13:35.930178 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2355/4750] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:35 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1299 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:36.672290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1e3aa8e5-cae4-47b5-958c-ebbd11be42b0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:36.673251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1e3aa8e5-cae4-47b5-958c-ebbd11be42b0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:36.698929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e3aa8e5-cae4-47b5-958c-ebbd11be42b0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:36.700549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e3aa8e5-cae4-47b5-958c-ebbd11be42b0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:36.701436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e3aa8e5-cae4-47b5-958c-ebbd11be42b0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:36.702879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e3aa8e5-cae4-47b5-958c-ebbd11be42b0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:36.703587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e3aa8e5-cae4-47b5-958c-ebbd11be42b0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:36.704435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e3aa8e5-cae4-47b5-958c-ebbd11be42b0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:36.821183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1e3aa8e5-cae4-47b5-958c-ebbd11be42b0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:36.858580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1e3aa8e5-cae4-47b5-958c-ebbd11be42b0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:36.862045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1e3aa8e5-cae4-47b5-958c-ebbd11be42b0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:36.884665 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1e3aa8e5-cae4-47b5-958c-ebbd11be42b0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.200510 Sep 06 11:13:36.887150 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2396/4751] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:36 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:36.947278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5d9a2820-83ae-4ce6-bfe6-1c878d82355f tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:36.948682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5d9a2820-83ae-4ce6-bfe6-1c878d82355f tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:36.962405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d9a2820-83ae-4ce6-bfe6-1c878d82355f tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:36.967464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d9a2820-83ae-4ce6-bfe6-1c878d82355f tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:36.967982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d9a2820-83ae-4ce6-bfe6-1c878d82355f tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:36.968764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d9a2820-83ae-4ce6-bfe6-1c878d82355f tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:36.969248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d9a2820-83ae-4ce6-bfe6-1c878d82355f tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:36.969709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d9a2820-83ae-4ce6-bfe6-1c878d82355f tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:37.104572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5d9a2820-83ae-4ce6-bfe6-1c878d82355f tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:37.130088 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5d9a2820-83ae-4ce6-bfe6-1c878d82355f tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1347 microversion: 2.1 time: 0.189828 Sep 06 11:13:37.150966 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2356/4752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:36 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1347 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:37.923618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dd306a7e-5cc9-4451-b844-9a782bb44b19 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:37.925759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dd306a7e-5cc9-4451-b844-9a782bb44b19 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:37.939493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd306a7e-5cc9-4451-b844-9a782bb44b19 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:37.942558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd306a7e-5cc9-4451-b844-9a782bb44b19 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:37.945617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd306a7e-5cc9-4451-b844-9a782bb44b19 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:37.946688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd306a7e-5cc9-4451-b844-9a782bb44b19 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:37.948853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd306a7e-5cc9-4451-b844-9a782bb44b19 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:37.949886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd306a7e-5cc9-4451-b844-9a782bb44b19 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:38.048977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dd306a7e-5cc9-4451-b844-9a782bb44b19 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:38.073911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dd306a7e-5cc9-4451-b844-9a782bb44b19 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:38.075816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dd306a7e-5cc9-4451-b844-9a782bb44b19 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:38.087740 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dd306a7e-5cc9-4451-b844-9a782bb44b19 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.167796 Sep 06 11:13:38.090705 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2397/4753] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:37 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:38.156259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-deefbdbf-21f5-452c-8651-a46a48bfd594 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:38.158125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-deefbdbf-21f5-452c-8651-a46a48bfd594 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:38.172891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-deefbdbf-21f5-452c-8651-a46a48bfd594 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:38.173941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-deefbdbf-21f5-452c-8651-a46a48bfd594 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:38.174620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-deefbdbf-21f5-452c-8651-a46a48bfd594 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:38.175628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-deefbdbf-21f5-452c-8651-a46a48bfd594 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:38.179332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-deefbdbf-21f5-452c-8651-a46a48bfd594 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:38.181864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-deefbdbf-21f5-452c-8651-a46a48bfd594 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:38.189620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:39.140410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-632fb198-6d03-4313-b1fc-44a773ccdda4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:39.148579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-632fb198-6d03-4313-b1fc-44a773ccdda4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:39.159898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-632fb198-6d03-4313-b1fc-44a773ccdda4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:39.160700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-632fb198-6d03-4313-b1fc-44a773ccdda4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:39.161400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-632fb198-6d03-4313-b1fc-44a773ccdda4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:39.162582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-632fb198-6d03-4313-b1fc-44a773ccdda4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:39.171087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-632fb198-6d03-4313-b1fc-44a773ccdda4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:39.171879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-632fb198-6d03-4313-b1fc-44a773ccdda4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:39.284020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-deefbdbf-21f5-452c-8651-a46a48bfd594 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:39.293980 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-deefbdbf-21f5-452c-8651-a46a48bfd594 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1353 microversion: 2.1 time: 1.142498 Sep 06 11:13:39.310007 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2357/4754] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:38 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1353 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:39.337258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-632fb198-6d03-4313-b1fc-44a773ccdda4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:39.346260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-632fb198-6d03-4313-b1fc-44a773ccdda4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:39.347786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-632fb198-6d03-4313-b1fc-44a773ccdda4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:39.353872 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-632fb198-6d03-4313-b1fc-44a773ccdda4 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.217951 Sep 06 11:13:39.358899 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2398/4755] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:39 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:40.329270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b018e83d-993e-4a44-a61f-ff7812c69cec tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:40.330859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b018e83d-993e-4a44-a61f-ff7812c69cec tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:40.347168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b018e83d-993e-4a44-a61f-ff7812c69cec tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:40.349474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b018e83d-993e-4a44-a61f-ff7812c69cec tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:40.351447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b018e83d-993e-4a44-a61f-ff7812c69cec tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:40.353889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b018e83d-993e-4a44-a61f-ff7812c69cec tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:40.354639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b018e83d-993e-4a44-a61f-ff7812c69cec tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:40.357127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b018e83d-993e-4a44-a61f-ff7812c69cec tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:40.390097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-04367bf8-e27c-4056-9b1a-2584ef632264 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:40.391668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-04367bf8-e27c-4056-9b1a-2584ef632264 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:40.421112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04367bf8-e27c-4056-9b1a-2584ef632264 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:40.431193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04367bf8-e27c-4056-9b1a-2584ef632264 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:40.437484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04367bf8-e27c-4056-9b1a-2584ef632264 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:40.437484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04367bf8-e27c-4056-9b1a-2584ef632264 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:40.437484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04367bf8-e27c-4056-9b1a-2584ef632264 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:40.437484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04367bf8-e27c-4056-9b1a-2584ef632264 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:40.612123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-04367bf8-e27c-4056-9b1a-2584ef632264 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:40.629985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-04367bf8-e27c-4056-9b1a-2584ef632264 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:40.636100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-04367bf8-e27c-4056-9b1a-2584ef632264 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:40.638794 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-04367bf8-e27c-4056-9b1a-2584ef632264 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.256205 Sep 06 11:13:40.641531 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2399/4756] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:40 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:40.699749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b018e83d-993e-4a44-a61f-ff7812c69cec tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:40.713593 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b018e83d-993e-4a44-a61f-ff7812c69cec tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1472 microversion: 2.1 time: 0.392007 Sep 06 11:13:40.714760 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2358/4757] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:40 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:41.669712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a79e83e6-a289-4305-9ba3-12254549785f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Action: 'create', calling method: .version_select at 0x7f90fd0b9f70>, body: {"keypair": {"name": "tempest-keypair-1869188513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqLeLw9zcTXDXdnU1o6XSB8QARFSjrioPrdX1RJ0O3683cb9PKTZIV8nPFdFz9CMdGVUvzF8A++wL/xK13m6oLB344dUfsBf8Rjq6VW039+A1R3D4gGhmfzraWfYoLBvA=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:41.670618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b855e3bf-7e2d-4fac-9fb6-32cb17847637 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:41.671520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b855e3bf-7e2d-4fac-9fb6-32cb17847637 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:41.704449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b855e3bf-7e2d-4fac-9fb6-32cb17847637 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:41.705846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b855e3bf-7e2d-4fac-9fb6-32cb17847637 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:41.711911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b855e3bf-7e2d-4fac-9fb6-32cb17847637 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:41.715668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-a79e83e6-a289-4305-9ba3-12254549785f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Getting quotas for project 30cea8e2c3b9438ea6a50fb852468a7b. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:13:41.721448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b855e3bf-7e2d-4fac-9fb6-32cb17847637 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:41.723732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-a79e83e6-a289-4305-9ba3-12254549785f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Getting quotas for user 36f490bcb6d643fa99b73ffa55d37c5e and project 30cea8e2c3b9438ea6a50fb852468a7b. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:13:41.731740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b855e3bf-7e2d-4fac-9fb6-32cb17847637 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:41.732800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b855e3bf-7e2d-4fac-9fb6-32cb17847637 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:41.857660 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a79e83e6-a289-4305-9ba3-12254549785f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.191931 Sep 06 11:13:41.861051 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2359/4758] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Sep 6 11:13:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 196 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 11:13:41.885891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b855e3bf-7e2d-4fac-9fb6-32cb17847637 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:41.889770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-380ab3f1-f11b-48d8-8a07-af08de02fe6c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:41.893257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-380ab3f1-f11b-48d8-8a07-af08de02fe6c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:41.900006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b855e3bf-7e2d-4fac-9fb6-32cb17847637 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:41.901638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b855e3bf-7e2d-4fac-9fb6-32cb17847637 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:41.909410 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b855e3bf-7e2d-4fac-9fb6-32cb17847637 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.243272 Sep 06 11:13:41.911296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-380ab3f1-f11b-48d8-8a07-af08de02fe6c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:41.912095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-380ab3f1-f11b-48d8-8a07-af08de02fe6c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:41.912495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-380ab3f1-f11b-48d8-8a07-af08de02fe6c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:41.913974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-380ab3f1-f11b-48d8-8a07-af08de02fe6c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:41.914447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-380ab3f1-f11b-48d8-8a07-af08de02fe6c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:41.914886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-380ab3f1-f11b-48d8-8a07-af08de02fe6c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:41.924701 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2400/4759] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:41 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:42.145440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-380ab3f1-f11b-48d8-8a07-af08de02fe6c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:42.155424 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-380ab3f1-f11b-48d8-8a07-af08de02fe6c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1472 microversion: 2.1 time: 0.282506 Sep 06 11:13:42.156828 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2360/4760] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:41 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1472 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:42.747226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-c5015465-41f0-4f77-9a31-5f3674623054 req-f081a589-ac34-4358-b2bd-b7a3da07d4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ddbde28-f59b-4bdd-82a7-6dfc37a97585", "tag": "fd0e55dc-cde7-4ba7-acda-9db7705724f6"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:42.759897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c5015465-41f0-4f77-9a31-5f3674623054 req-f081a589-ac34-4358-b2bd-b7a3da07d4ff service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:42.760389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c5015465-41f0-4f77-9a31-5f3674623054 req-f081a589-ac34-4358-b2bd-b7a3da07d4ff service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:42.760866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c5015465-41f0-4f77-9a31-5f3674623054 req-f081a589-ac34-4358-b2bd-b7a3da07d4ff service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:42.773399 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-c5015465-41f0-4f77-9a31-5f3674623054 req-f081a589-ac34-4358-b2bd-b7a3da07d4ff service nova] Creating event network-changed:fd0e55dc-cde7-4ba7-acda-9db7705724f6 for instance 3ddbde28-f59b-4bdd-82a7-6dfc37a97585 on nch1-master-1 Sep 06 11:13:42.782278 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-c5015465-41f0-4f77-9a31-5f3674623054 req-f081a589-ac34-4358-b2bd-b7a3da07d4ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039757 Sep 06 11:13:42.782911 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2401/4761] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:13:42.941204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-86fdba8f-5228-48f2-8336-460339095a03 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:42.941827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-86fdba8f-5228-48f2-8336-460339095a03 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:42.951207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86fdba8f-5228-48f2-8336-460339095a03 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:42.951999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86fdba8f-5228-48f2-8336-460339095a03 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:42.952441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86fdba8f-5228-48f2-8336-460339095a03 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:42.953462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86fdba8f-5228-48f2-8336-460339095a03 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:42.954133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86fdba8f-5228-48f2-8336-460339095a03 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:42.954568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86fdba8f-5228-48f2-8336-460339095a03 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:43.029757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-86fdba8f-5228-48f2-8336-460339095a03 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:43.042643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-86fdba8f-5228-48f2-8336-460339095a03 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:43.044396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-86fdba8f-5228-48f2-8336-460339095a03 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:43.045857 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-86fdba8f-5228-48f2-8336-460339095a03 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.112403 Sep 06 11:13:43.046913 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2361/4762] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:42 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:43.186106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8e598df0-de5b-436f-85b8-fe21494c4a90 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:43.186943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8e598df0-de5b-436f-85b8-fe21494c4a90 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:43.194193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e598df0-de5b-436f-85b8-fe21494c4a90 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:43.194786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e598df0-de5b-436f-85b8-fe21494c4a90 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:43.195367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e598df0-de5b-436f-85b8-fe21494c4a90 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:43.196264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e598df0-de5b-436f-85b8-fe21494c4a90 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:43.196807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e598df0-de5b-436f-85b8-fe21494c4a90 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:43.197318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e598df0-de5b-436f-85b8-fe21494c4a90 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:43.220936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:43.271548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:43.374282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8e598df0-de5b-436f-85b8-fe21494c4a90 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:43.383590 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8e598df0-de5b-436f-85b8-fe21494c4a90 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1472 microversion: 2.1 time: 0.202785 Sep 06 11:13:43.384461 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2402/4763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:43 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:44.074876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a9895c3a-50ce-4ce1-a85e-0575c065cecc tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:44.076210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a9895c3a-50ce-4ce1-a85e-0575c065cecc tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:44.084201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9895c3a-50ce-4ce1-a85e-0575c065cecc tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:44.084974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9895c3a-50ce-4ce1-a85e-0575c065cecc tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:44.085431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9895c3a-50ce-4ce1-a85e-0575c065cecc tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:44.086154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9895c3a-50ce-4ce1-a85e-0575c065cecc tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:44.086626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9895c3a-50ce-4ce1-a85e-0575c065cecc tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:44.087069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9895c3a-50ce-4ce1-a85e-0575c065cecc tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:44.224423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a9895c3a-50ce-4ce1-a85e-0575c065cecc tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:44.237303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a9895c3a-50ce-4ce1-a85e-0575c065cecc tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:44.240546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a9895c3a-50ce-4ce1-a85e-0575c065cecc tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:44.244106 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a9895c3a-50ce-4ce1-a85e-0575c065cecc tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.172918 Sep 06 11:13:44.245543 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2362/4764] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:44 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:13:44.408936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7103a3f5-f5a2-4c0e-818d-1b5f8fb30f06 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:44.409556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7103a3f5-f5a2-4c0e-818d-1b5f8fb30f06 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:44.419418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7103a3f5-f5a2-4c0e-818d-1b5f8fb30f06 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:44.420215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7103a3f5-f5a2-4c0e-818d-1b5f8fb30f06 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:44.421306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7103a3f5-f5a2-4c0e-818d-1b5f8fb30f06 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:44.422226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7103a3f5-f5a2-4c0e-818d-1b5f8fb30f06 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:44.422867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7103a3f5-f5a2-4c0e-818d-1b5f8fb30f06 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:44.423515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7103a3f5-f5a2-4c0e-818d-1b5f8fb30f06 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:44.729231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7103a3f5-f5a2-4c0e-818d-1b5f8fb30f06 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:44.741412 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7103a3f5-f5a2-4c0e-818d-1b5f8fb30f06 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1472 microversion: 2.1 time: 0.337211 Sep 06 11:13:44.743342 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2403/4765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:44 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1472 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:45.274761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff3fe6ec-f58e-4e93-9d57-791b42f8ba0b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:45.275675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff3fe6ec-f58e-4e93-9d57-791b42f8ba0b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:45.283058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff3fe6ec-f58e-4e93-9d57-791b42f8ba0b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:45.283563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff3fe6ec-f58e-4e93-9d57-791b42f8ba0b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:45.284013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff3fe6ec-f58e-4e93-9d57-791b42f8ba0b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:45.284736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff3fe6ec-f58e-4e93-9d57-791b42f8ba0b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:45.285200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff3fe6ec-f58e-4e93-9d57-791b42f8ba0b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:45.285635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff3fe6ec-f58e-4e93-9d57-791b42f8ba0b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:45.405705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff3fe6ec-f58e-4e93-9d57-791b42f8ba0b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:45.423962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff3fe6ec-f58e-4e93-9d57-791b42f8ba0b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:45.426752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff3fe6ec-f58e-4e93-9d57-791b42f8ba0b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:45.428906 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff3fe6ec-f58e-4e93-9d57-791b42f8ba0b tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.158406 Sep 06 11:13:45.429817 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2363/4766] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:45 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:45.766203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e44c4b56-2af0-4945-977d-6c02aeda69cb tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:45.771779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e44c4b56-2af0-4945-977d-6c02aeda69cb tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:45.780514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e44c4b56-2af0-4945-977d-6c02aeda69cb tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:45.781086 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e44c4b56-2af0-4945-977d-6c02aeda69cb tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:45.781608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e44c4b56-2af0-4945-977d-6c02aeda69cb tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:45.782361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e44c4b56-2af0-4945-977d-6c02aeda69cb tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:45.782835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e44c4b56-2af0-4945-977d-6c02aeda69cb tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:45.783480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e44c4b56-2af0-4945-977d-6c02aeda69cb tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:46.234730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1069506780", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "5b865aa1-5003-4f1a-b777-398828775917"}, {"port": "9cabd01e-ea05-40f4-aead-e049cadec515", "tag": "port-1"}, {"port": "e50e4dc4-e3ed-478b-8ee3-86ecdce0d790", "tag": "port-2"}, {"uuid": "dfb90e82-7bc6-48ec-95f0-5b836ffde530", "tag": "net-1"}, {"uuid": "dfb90e82-7bc6-48ec-95f0-5b836ffde530"}, {"uuid": "b4bf766c-b996-40cd-8a21-1693e1c8679f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b4bf766c-b996-40cd-8a21-1693e1c8679f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ddeb12fb-7b7d-4d13-87e2-c22de50bf482", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1cfc1bca-12f4-436b-8059-29691621750d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "94a3ca98-6ae6-4403-ac62-4a263bac123e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--766728109"}], "key_name": "tempest-keypair-1869188513", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:46.308922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e44c4b56-2af0-4945-977d-6c02aeda69cb tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:46.322012 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e44c4b56-2af0-4945-977d-6c02aeda69cb tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1472 microversion: 2.1 time: 0.560823 Sep 06 11:13:46.323234 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2404/4767] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:45 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1472 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:46.439948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] validate_networks() for [('5b865aa1-5003-4f1a-b777-398828775917', None, None, None, None, None), (None, None, '9cabd01e-ea05-40f4-aead-e049cadec515', None, None, None), (None, None, 'e50e4dc4-e3ed-478b-8ee3-86ecdce0d790', None, None, None), ('dfb90e82-7bc6-48ec-95f0-5b836ffde530', None, None, None, None, None), ('dfb90e82-7bc6-48ec-95f0-5b836ffde530', None, None, None, None, None), ('b4bf766c-b996-40cd-8a21-1693e1c8679f', '10.2.2.100', None, None, None, None), ('b4bf766c-b996-40cd-8a21-1693e1c8679f', '10.2.2.200', None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:13:46.467081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d487888f-bcee-410e-b840-f9a1fd3da413 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:46.467749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d487888f-bcee-410e-b840-f9a1fd3da413 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:46.483808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d487888f-bcee-410e-b840-f9a1fd3da413 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:46.484324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d487888f-bcee-410e-b840-f9a1fd3da413 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:46.484784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d487888f-bcee-410e-b840-f9a1fd3da413 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:46.485521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d487888f-bcee-410e-b840-f9a1fd3da413 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:46.485988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d487888f-bcee-410e-b840-f9a1fd3da413 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:46.508522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d487888f-bcee-410e-b840-f9a1fd3da413 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:46.658298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d487888f-bcee-410e-b840-f9a1fd3da413 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:46.689016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d487888f-bcee-410e-b840-f9a1fd3da413 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:46.690809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d487888f-bcee-410e-b840-f9a1fd3da413 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:46.692586 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d487888f-bcee-410e-b840-f9a1fd3da413 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.230269 Sep 06 11:13:46.695560 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2405/4768] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:46 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:47.345830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d621040e-8931-4c6f-abdd-52838561b33a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:47.346502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d621040e-8931-4c6f-abdd-52838561b33a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:47.354341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d621040e-8931-4c6f-abdd-52838561b33a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:47.354838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d621040e-8931-4c6f-abdd-52838561b33a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:47.355329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d621040e-8931-4c6f-abdd-52838561b33a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:47.356069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d621040e-8931-4c6f-abdd-52838561b33a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:47.356661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d621040e-8931-4c6f-abdd-52838561b33a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:47.357296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d621040e-8931-4c6f-abdd-52838561b33a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:47.867779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d621040e-8931-4c6f-abdd-52838561b33a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:47.882882 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d621040e-8931-4c6f-abdd-52838561b33a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1472 microversion: 2.1 time: 0.541086 Sep 06 11:13:47.883535 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2406/4769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:47 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1472 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:13:47.891049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7c0f3612-cb79-4fde-b38c-13735062892c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:47.891828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7c0f3612-cb79-4fde-b38c-13735062892c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:47.911474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c0f3612-cb79-4fde-b38c-13735062892c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:47.913249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c0f3612-cb79-4fde-b38c-13735062892c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:47.914940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c0f3612-cb79-4fde-b38c-13735062892c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:47.916159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c0f3612-cb79-4fde-b38c-13735062892c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:47.916830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c0f3612-cb79-4fde-b38c-13735062892c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:47.918111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c0f3612-cb79-4fde-b38c-13735062892c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:48.044837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7c0f3612-cb79-4fde-b38c-13735062892c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:48.068858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7c0f3612-cb79-4fde-b38c-13735062892c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:48.077997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7c0f3612-cb79-4fde-b38c-13735062892c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:48.084156 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7c0f3612-cb79-4fde-b38c-13735062892c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.199000 Sep 06 11:13:48.086722 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2407/4770] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:47 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:48.913536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a7fdd970-d06f-4f4f-aec0-dbfa9f18851a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:48.913536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a7fdd970-d06f-4f4f-aec0-dbfa9f18851a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:48.924796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7fdd970-d06f-4f4f-aec0-dbfa9f18851a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:48.926608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7fdd970-d06f-4f4f-aec0-dbfa9f18851a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:48.927629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7fdd970-d06f-4f4f-aec0-dbfa9f18851a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:48.928911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7fdd970-d06f-4f4f-aec0-dbfa9f18851a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:48.929491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7fdd970-d06f-4f4f-aec0-dbfa9f18851a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:48.930170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7fdd970-d06f-4f4f-aec0-dbfa9f18851a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:49.258306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a7fdd970-d06f-4f4f-aec0-dbfa9f18851a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:49.281422 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a7fdd970-d06f-4f4f-aec0-dbfa9f18851a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1472 microversion: 2.1 time: 0.377001 Sep 06 11:13:49.307515 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2408/4771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:48 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1472 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:13:49.329138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-188a3c64-98ae-40a5-b4ef-491f66fc990a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:49.330548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-188a3c64-98ae-40a5-b4ef-491f66fc990a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:49.342989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-188a3c64-98ae-40a5-b4ef-491f66fc990a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:49.345224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-188a3c64-98ae-40a5-b4ef-491f66fc990a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:49.346037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-188a3c64-98ae-40a5-b4ef-491f66fc990a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:49.348419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-188a3c64-98ae-40a5-b4ef-491f66fc990a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:49.349527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-188a3c64-98ae-40a5-b4ef-491f66fc990a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:49.350657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-188a3c64-98ae-40a5-b4ef-491f66fc990a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:49.487733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-188a3c64-98ae-40a5-b4ef-491f66fc990a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:49.502250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-188a3c64-98ae-40a5-b4ef-491f66fc990a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:49.502250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-188a3c64-98ae-40a5-b4ef-491f66fc990a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:49.502630 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-188a3c64-98ae-40a5-b4ef-491f66fc990a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.193041 Sep 06 11:13:49.503404 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2409/4772] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:49 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:50.206393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:13:50.208018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:13:50.209042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:13:50.210552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:13:50.211583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:13:50.239732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:50.241461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:50.241912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:50.243709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:50.244161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:50.244613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:50.286774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a6cad372-f1ce-446c-852e-9c8cec65dc4a req-26d3ab87-ec26-4b86-a2e3-ae5972b53d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ddbde28-f59b-4bdd-82a7-6dfc37a97585", "name": "network-vif-plugged", "status": "completed", "tag": "fd0e55dc-cde7-4ba7-acda-9db7705724f6"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:50.287910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Getting quotas for project 30cea8e2c3b9438ea6a50fb852468a7b. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:13:50.294232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Getting quotas for user 36f490bcb6d643fa99b73ffa55d37c5e and project 30cea8e2c3b9438ea6a50fb852468a7b. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:13:50.304333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a6cad372-f1ce-446c-852e-9c8cec65dc4a req-26d3ab87-ec26-4b86-a2e3-ae5972b53d9e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:50.307481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a6cad372-f1ce-446c-852e-9c8cec65dc4a req-26d3ab87-ec26-4b86-a2e3-ae5972b53d9e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:50.310662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a6cad372-f1ce-446c-852e-9c8cec65dc4a req-26d3ab87-ec26-4b86-a2e3-ae5972b53d9e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:50.326031 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a6cad372-f1ce-446c-852e-9c8cec65dc4a req-26d3ab87-ec26-4b86-a2e3-ae5972b53d9e service nova] Creating event network-vif-plugged:fd0e55dc-cde7-4ba7-acda-9db7705724f6 for instance 3ddbde28-f59b-4bdd-82a7-6dfc37a97585 on nch1-master-1 Sep 06 11:13:50.332262 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a6cad372-f1ce-446c-852e-9c8cec65dc4a req-26d3ab87-ec26-4b86-a2e3-ae5972b53d9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053305 Sep 06 11:13:50.338023 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2410/4773] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:13:50.345380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-17983efd-5684-4cfc-9ddc-1eddf53754fa tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:50.346410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-17983efd-5684-4cfc-9ddc-1eddf53754fa tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:50.355496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17983efd-5684-4cfc-9ddc-1eddf53754fa tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:50.356314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17983efd-5684-4cfc-9ddc-1eddf53754fa tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:50.356989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17983efd-5684-4cfc-9ddc-1eddf53754fa tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:50.358048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17983efd-5684-4cfc-9ddc-1eddf53754fa tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:50.358734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17983efd-5684-4cfc-9ddc-1eddf53754fa tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:50.359408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17983efd-5684-4cfc-9ddc-1eddf53754fa tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:50.582778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:13:50.588642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ddeb12fb-7b7d-4d13-87e2-c22de50bf482',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1cfc1bca-12f4-436b-8059-29691621750d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94a3ca98-6ae6-4403-ac62-4a263bac123e',volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:13:50.662217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-17983efd-5684-4cfc-9ddc-1eddf53754fa tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:50.672504 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-17983efd-5684-4cfc-9ddc-1eddf53754fa tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1472 microversion: 2.1 time: 0.332852 Sep 06 11:13:50.673165 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2411/4774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:50 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:50.682996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-17189b22-fb5a-4574-9ebe-9ec5f07550e2 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:50.683664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-17189b22-fb5a-4574-9ebe-9ec5f07550e2 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:50.695264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17189b22-fb5a-4574-9ebe-9ec5f07550e2 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:50.696663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17189b22-fb5a-4574-9ebe-9ec5f07550e2 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:50.697534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17189b22-fb5a-4574-9ebe-9ec5f07550e2 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:50.698436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17189b22-fb5a-4574-9ebe-9ec5f07550e2 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:50.698997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17189b22-fb5a-4574-9ebe-9ec5f07550e2 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:50.699481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17189b22-fb5a-4574-9ebe-9ec5f07550e2 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:50.792720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-17189b22-fb5a-4574-9ebe-9ec5f07550e2 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:50.804139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-17189b22-fb5a-4574-9ebe-9ec5f07550e2 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:50.805804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-17189b22-fb5a-4574-9ebe-9ec5f07550e2 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:50.807238 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-17189b22-fb5a-4574-9ebe-9ec5f07550e2 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.133060 Sep 06 11:13:50.807932 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2412/4775] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:50 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:51.702111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-54204784-a5dc-497f-91a7-afbfd020950d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:51.707087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-54204784-a5dc-497f-91a7-afbfd020950d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:51.737070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54204784-a5dc-497f-91a7-afbfd020950d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:51.737070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54204784-a5dc-497f-91a7-afbfd020950d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:51.737070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54204784-a5dc-497f-91a7-afbfd020950d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:51.737070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54204784-a5dc-497f-91a7-afbfd020950d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:51.737070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54204784-a5dc-497f-91a7-afbfd020950d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:51.737070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54204784-a5dc-497f-91a7-afbfd020950d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:51.769831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:52.018208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-54204784-a5dc-497f-91a7-afbfd020950d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:52.024181 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 5.789885 Sep 06 11:13:52.027076 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2364/4776] 10.222.0.20 () {62 vars in 1189 bytes} [Tue Sep 6 11:13:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 5797 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 06 11:13:52.035695 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-54204784-a5dc-497f-91a7-afbfd020950d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1472 microversion: 2.1 time: 0.342361 Sep 06 11:13:52.037161 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2413/4777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:51 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1472 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:52.046244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9585f7da-7f60-4d9c-9e8c-30079813c98d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:52.046807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9585f7da-7f60-4d9c-9e8c-30079813c98d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:52.049501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d2f55f32-23a1-4d07-8eeb-1b250f021dce tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:52.052746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d2f55f32-23a1-4d07-8eeb-1b250f021dce tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:52.071062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2f55f32-23a1-4d07-8eeb-1b250f021dce tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:52.071610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2f55f32-23a1-4d07-8eeb-1b250f021dce tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:52.074977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2f55f32-23a1-4d07-8eeb-1b250f021dce tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:52.075862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2f55f32-23a1-4d07-8eeb-1b250f021dce tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:52.076414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2f55f32-23a1-4d07-8eeb-1b250f021dce tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:52.076877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2f55f32-23a1-4d07-8eeb-1b250f021dce tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:52.113620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9585f7da-7f60-4d9c-9e8c-30079813c98d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:52.123541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9585f7da-7f60-4d9c-9e8c-30079813c98d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:52.132621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9585f7da-7f60-4d9c-9e8c-30079813c98d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:52.132621 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9585f7da-7f60-4d9c-9e8c-30079813c98d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1286 microversion: 2.42 time: 0.089360 Sep 06 11:13:52.132621 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2414/4778] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:52 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:52.253897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d2f55f32-23a1-4d07-8eeb-1b250f021dce tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:52.273016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d2f55f32-23a1-4d07-8eeb-1b250f021dce tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:52.278322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d2f55f32-23a1-4d07-8eeb-1b250f021dce tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:52.279651 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d2f55f32-23a1-4d07-8eeb-1b250f021dce tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.251235 Sep 06 11:13:52.286224 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2365/4779] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:52 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:52.605874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-759858836", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:52.683509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] validate_networks() for [('b9ea5ffd-3051-44b1-b178-c09345529f6f', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:13:53.064956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3cdee719-162f-48e4-b1f0-631f8213a92c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:53.066296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3cdee719-162f-48e4-b1f0-631f8213a92c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:53.074167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cdee719-162f-48e4-b1f0-631f8213a92c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:53.074759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cdee719-162f-48e4-b1f0-631f8213a92c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:53.075311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cdee719-162f-48e4-b1f0-631f8213a92c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:53.076090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cdee719-162f-48e4-b1f0-631f8213a92c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:53.076629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cdee719-162f-48e4-b1f0-631f8213a92c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:53.077270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cdee719-162f-48e4-b1f0-631f8213a92c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:53.319282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:13:53.319818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:13:53.320204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:13:53.320880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:13:53.321369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:13:53.332454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:53.333395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:53.333395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:53.334768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:53.335515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:53.341658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:53.362502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Getting quotas for project aad114c7a41a47e785fd117e1103f168. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:13:53.369655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Getting quotas for user 3e904f27c02248389ae9ca86cb95c54a and project aad114c7a41a47e785fd117e1103f168. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:13:53.386713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:13:53.389448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:13:53.396346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3cdee719-162f-48e4-b1f0-631f8213a92c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:53.410230 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3cdee719-162f-48e4-b1f0-631f8213a92c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1643 microversion: 2.1 time: 0.349319 Sep 06 11:13:53.412199 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2366/4780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:53 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1643 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:53.418570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-51a9c975-6fe8-45eb-8681-d4b79e4ee82e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:53.419961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-51a9c975-6fe8-45eb-8681-d4b79e4ee82e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:53.518213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-51a9c975-6fe8-45eb-8681-d4b79e4ee82e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:53.535299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-51a9c975-6fe8-45eb-8681-d4b79e4ee82e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:53.535299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-51a9c975-6fe8-45eb-8681-d4b79e4ee82e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:53.535299 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-51a9c975-6fe8-45eb-8681-d4b79e4ee82e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1286 microversion: 2.42 time: 0.121471 Sep 06 11:13:53.542711 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2367/4781] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:53 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:53.550128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-926a7dfa-751d-40c9-ae0e-53665124dfad tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:53.550635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-926a7dfa-751d-40c9-ae0e-53665124dfad tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:53.557375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-926a7dfa-751d-40c9-ae0e-53665124dfad tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:53.557870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-926a7dfa-751d-40c9-ae0e-53665124dfad tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:53.558315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-926a7dfa-751d-40c9-ae0e-53665124dfad tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:53.559158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-926a7dfa-751d-40c9-ae0e-53665124dfad tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:53.559629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-926a7dfa-751d-40c9-ae0e-53665124dfad tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:53.560062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-926a7dfa-751d-40c9-ae0e-53665124dfad tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:53.596042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-926a7dfa-751d-40c9-ae0e-53665124dfad tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:13:53.634062 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3f1253c5-f2a1-4347-a154-8ada633676b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.120960 Sep 06 11:13:53.635381 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2415/4782] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:13:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:13:53.643737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dd7f660b-c8e9-4996-bbc5-0f4edf6a5a3e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:53.644851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dd7f660b-c8e9-4996-bbc5-0f4edf6a5a3e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:53.661357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd7f660b-c8e9-4996-bbc5-0f4edf6a5a3e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:53.661357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd7f660b-c8e9-4996-bbc5-0f4edf6a5a3e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:53.661357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd7f660b-c8e9-4996-bbc5-0f4edf6a5a3e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:53.661357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd7f660b-c8e9-4996-bbc5-0f4edf6a5a3e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:53.661357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd7f660b-c8e9-4996-bbc5-0f4edf6a5a3e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:53.661357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd7f660b-c8e9-4996-bbc5-0f4edf6a5a3e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:53.782269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dd7f660b-c8e9-4996-bbc5-0f4edf6a5a3e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:53.799826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dd7f660b-c8e9-4996-bbc5-0f4edf6a5a3e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:53.803670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dd7f660b-c8e9-4996-bbc5-0f4edf6a5a3e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:53.806139 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dd7f660b-c8e9-4996-bbc5-0f4edf6a5a3e tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.168967 Sep 06 11:13:53.807590 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2416/4783] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:53 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:53.854884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-717136d3-2828-419d-b7c3-ae1391bce4cd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:53.856024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-717136d3-2828-419d-b7c3-ae1391bce4cd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:53.869637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-717136d3-2828-419d-b7c3-ae1391bce4cd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:53.869637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-717136d3-2828-419d-b7c3-ae1391bce4cd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:53.869637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-717136d3-2828-419d-b7c3-ae1391bce4cd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:53.870386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-717136d3-2828-419d-b7c3-ae1391bce4cd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:53.871697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-717136d3-2828-419d-b7c3-ae1391bce4cd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:53.873789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-717136d3-2828-419d-b7c3-ae1391bce4cd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:53.993637 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-926a7dfa-751d-40c9-ae0e-53665124dfad tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 204 len: 0 microversion: 2.1 time: 0.449075 Sep 06 11:13:53.994751 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2368/4784] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:13:53 2022] DELETE /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:13:54.009160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-73d6cf66-9be4-4842-9eca-2b53ee95be37 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:54.010702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-73d6cf66-9be4-4842-9eca-2b53ee95be37 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:54.097674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-73d6cf66-9be4-4842-9eca-2b53ee95be37 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:54.102384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-717136d3-2828-419d-b7c3-ae1391bce4cd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:54.106980 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-73d6cf66-9be4-4842-9eca-2b53ee95be37 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1216 microversion: 2.1 time: 0.105938 Sep 06 11:13:54.107643 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2369/4785] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:53 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1216 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:54.113144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7bc389bc-936e-41a1-bd34-4c5f6527d1d6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:54.114470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7bc389bc-936e-41a1-bd34-4c5f6527d1d6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:54.130556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bc389bc-936e-41a1-bd34-4c5f6527d1d6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:54.130556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bc389bc-936e-41a1-bd34-4c5f6527d1d6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:54.130556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bc389bc-936e-41a1-bd34-4c5f6527d1d6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:54.130556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bc389bc-936e-41a1-bd34-4c5f6527d1d6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:54.130556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bc389bc-936e-41a1-bd34-4c5f6527d1d6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:54.130556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bc389bc-936e-41a1-bd34-4c5f6527d1d6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:54.131884 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-717136d3-2828-419d-b7c3-ae1391bce4cd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1643 microversion: 2.1 time: 0.281290 Sep 06 11:13:54.131884 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2417/4786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:53 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1643 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:54.153436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5d0d632e-f199-4a99-b87b-a7989686707a tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:54.154069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5d0d632e-f199-4a99-b87b-a7989686707a tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:54.160851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d0d632e-f199-4a99-b87b-a7989686707a tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:54.161362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d0d632e-f199-4a99-b87b-a7989686707a tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:54.161841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d0d632e-f199-4a99-b87b-a7989686707a tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:54.162638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d0d632e-f199-4a99-b87b-a7989686707a tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:54.163136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d0d632e-f199-4a99-b87b-a7989686707a tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:54.163582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d0d632e-f199-4a99-b87b-a7989686707a tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:54.354180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7bc389bc-936e-41a1-bd34-4c5f6527d1d6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:54.371400 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7bc389bc-936e-41a1-bd34-4c5f6527d1d6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1667 microversion: 2.1 time: 0.261991 Sep 06 11:13:54.372664 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2370/4787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:54 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1667 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:54.568138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-69eed384-9384-48d6-9e8b-452a2cb33afb tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:54.569352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-69eed384-9384-48d6-9e8b-452a2cb33afb tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:54.579594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69eed384-9384-48d6-9e8b-452a2cb33afb tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:54.580148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69eed384-9384-48d6-9e8b-452a2cb33afb tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:54.580609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69eed384-9384-48d6-9e8b-452a2cb33afb tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:54.581364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69eed384-9384-48d6-9e8b-452a2cb33afb tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:54.581795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69eed384-9384-48d6-9e8b-452a2cb33afb tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:54.582230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69eed384-9384-48d6-9e8b-452a2cb33afb tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:54.651983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-69eed384-9384-48d6-9e8b-452a2cb33afb tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:54.662219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-69eed384-9384-48d6-9e8b-452a2cb33afb tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:54.664279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-69eed384-9384-48d6-9e8b-452a2cb33afb tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:54.665533 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-69eed384-9384-48d6-9e8b-452a2cb33afb tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1528 microversion: 2.42 time: 0.107009 Sep 06 11:13:54.666275 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2371/4788] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:54 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1528 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:13:54.770293 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5d0d632e-f199-4a99-b87b-a7989686707a tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1794 microversion: 2.1 time: 0.620551 Sep 06 11:13:54.771360 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2418/4789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:54 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1794 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:54.857467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b9e3ce6f-5e6c-4532-ae1e-bbad1dd9a865 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:54.857467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b9e3ce6f-5e6c-4532-ae1e-bbad1dd9a865 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:54.862399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9e3ce6f-5e6c-4532-ae1e-bbad1dd9a865 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:54.862894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9e3ce6f-5e6c-4532-ae1e-bbad1dd9a865 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:54.863364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9e3ce6f-5e6c-4532-ae1e-bbad1dd9a865 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:54.864072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9e3ce6f-5e6c-4532-ae1e-bbad1dd9a865 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:54.864727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9e3ce6f-5e6c-4532-ae1e-bbad1dd9a865 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:54.865738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9e3ce6f-5e6c-4532-ae1e-bbad1dd9a865 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:54.934478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b9e3ce6f-5e6c-4532-ae1e-bbad1dd9a865 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:54.943344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b9e3ce6f-5e6c-4532-ae1e-bbad1dd9a865 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:54.944846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b9e3ce6f-5e6c-4532-ae1e-bbad1dd9a865 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:54.946040 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b9e3ce6f-5e6c-4532-ae1e-bbad1dd9a865 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1366 microversion: 2.57 time: 0.095569 Sep 06 11:13:54.946609 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2372/4790] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:54 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:55.129753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-33b0522d-3943-4893-9352-600d45cc62af tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:55.130404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-33b0522d-3943-4893-9352-600d45cc62af tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:55.269084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-33b0522d-3943-4893-9352-600d45cc62af tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:55.282070 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-33b0522d-3943-4893-9352-600d45cc62af tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1216 microversion: 2.1 time: 0.156233 Sep 06 11:13:55.282741 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2419/4791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:55 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:55.398214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-28ed55ca-0882-407f-aa91-c06f877acd50 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:55.399035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-28ed55ca-0882-407f-aa91-c06f877acd50 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:55.406437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28ed55ca-0882-407f-aa91-c06f877acd50 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:55.407306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28ed55ca-0882-407f-aa91-c06f877acd50 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:55.407983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28ed55ca-0882-407f-aa91-c06f877acd50 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:55.408822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28ed55ca-0882-407f-aa91-c06f877acd50 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:55.409391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28ed55ca-0882-407f-aa91-c06f877acd50 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:55.409923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28ed55ca-0882-407f-aa91-c06f877acd50 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:55.672033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-28ed55ca-0882-407f-aa91-c06f877acd50 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:55.680805 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-28ed55ca-0882-407f-aa91-c06f877acd50 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1667 microversion: 2.1 time: 0.286877 Sep 06 11:13:55.681401 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2373/4792] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:55 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1667 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:55.696745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-538a0e5a-d24d-4599-b807-07ff2d2f4045 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:55.703594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-538a0e5a-d24d-4599-b807-07ff2d2f4045 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:55.712621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-538a0e5a-d24d-4599-b807-07ff2d2f4045 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:55.713428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-538a0e5a-d24d-4599-b807-07ff2d2f4045 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:55.715802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-538a0e5a-d24d-4599-b807-07ff2d2f4045 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:55.716777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-538a0e5a-d24d-4599-b807-07ff2d2f4045 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:55.717409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-538a0e5a-d24d-4599-b807-07ff2d2f4045 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:55.719305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-538a0e5a-d24d-4599-b807-07ff2d2f4045 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:55.882421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-538a0e5a-d24d-4599-b807-07ff2d2f4045 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:55.899145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-538a0e5a-d24d-4599-b807-07ff2d2f4045 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:55.900469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-538a0e5a-d24d-4599-b807-07ff2d2f4045 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:55.901645 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-538a0e5a-d24d-4599-b807-07ff2d2f4045 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1528 microversion: 2.42 time: 0.210452 Sep 06 11:13:55.904465 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2420/4793] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:55 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1528 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:55.977855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5285ebe9-84b9-4589-a320-483a42ac9657 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:55.979565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5285ebe9-84b9-4589-a320-483a42ac9657 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:55.992082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5285ebe9-84b9-4589-a320-483a42ac9657 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:56.004052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5285ebe9-84b9-4589-a320-483a42ac9657 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:56.004052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5285ebe9-84b9-4589-a320-483a42ac9657 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:56.004052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5285ebe9-84b9-4589-a320-483a42ac9657 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:56.005271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5285ebe9-84b9-4589-a320-483a42ac9657 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:56.005958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5285ebe9-84b9-4589-a320-483a42ac9657 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:56.106565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5285ebe9-84b9-4589-a320-483a42ac9657 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:56.115974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5285ebe9-84b9-4589-a320-483a42ac9657 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:56.118413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5285ebe9-84b9-4589-a320-483a42ac9657 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:56.120011 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5285ebe9-84b9-4589-a320-483a42ac9657 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1384 microversion: 2.57 time: 0.147366 Sep 06 11:13:56.121166 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2374/4794] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:55 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1384 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:56.319662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bd4a2526-c56c-4376-b71d-a96adb0754b9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:56.320956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bd4a2526-c56c-4376-b71d-a96adb0754b9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:56.332664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd4a2526-c56c-4376-b71d-a96adb0754b9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:56.333670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd4a2526-c56c-4376-b71d-a96adb0754b9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:56.335530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd4a2526-c56c-4376-b71d-a96adb0754b9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:56.336626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd4a2526-c56c-4376-b71d-a96adb0754b9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:56.337231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd4a2526-c56c-4376-b71d-a96adb0754b9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:56.337764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd4a2526-c56c-4376-b71d-a96adb0754b9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:56.419859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bd4a2526-c56c-4376-b71d-a96adb0754b9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:56.428320 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bd4a2526-c56c-4376-b71d-a96adb0754b9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1212 microversion: 2.1 time: 0.124192 Sep 06 11:13:56.429059 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2421/4795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:56 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1212 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:56.705333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d1f1cb86-70f2-4cc1-9607-e66a8462f194 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:56.706729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d1f1cb86-70f2-4cc1-9607-e66a8462f194 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:56.717098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1f1cb86-70f2-4cc1-9607-e66a8462f194 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:56.717701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1f1cb86-70f2-4cc1-9607-e66a8462f194 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:56.718223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1f1cb86-70f2-4cc1-9607-e66a8462f194 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:56.719035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1f1cb86-70f2-4cc1-9607-e66a8462f194 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:56.719729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1f1cb86-70f2-4cc1-9607-e66a8462f194 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:56.720407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1f1cb86-70f2-4cc1-9607-e66a8462f194 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:56.787682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d1f1cb86-70f2-4cc1-9607-e66a8462f194 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:56.790151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:56.796491 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d1f1cb86-70f2-4cc1-9607-e66a8462f194 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1599 microversion: 2.1 time: 0.095447 Sep 06 11:13:56.797084 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2375/4796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:56 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1599 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:56.931141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7b2a86b6-0ecc-44f6-84fb-79bc249555da tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:56.933871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7b2a86b6-0ecc-44f6-84fb-79bc249555da tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:56.939233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b2a86b6-0ecc-44f6-84fb-79bc249555da tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:56.939739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b2a86b6-0ecc-44f6-84fb-79bc249555da tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:56.940604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b2a86b6-0ecc-44f6-84fb-79bc249555da tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:56.941350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b2a86b6-0ecc-44f6-84fb-79bc249555da tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:56.941815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b2a86b6-0ecc-44f6-84fb-79bc249555da tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:56.942262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7b2a86b6-0ecc-44f6-84fb-79bc249555da tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:57.044526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7b2a86b6-0ecc-44f6-84fb-79bc249555da tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:57.054702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7b2a86b6-0ecc-44f6-84fb-79bc249555da tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:57.057005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7b2a86b6-0ecc-44f6-84fb-79bc249555da tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:57.058467 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7b2a86b6-0ecc-44f6-84fb-79bc249555da tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1576 microversion: 2.42 time: 0.131287 Sep 06 11:13:57.059538 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2422/4797] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:56 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1576 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:57.152831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-91925654-3b25-419c-94e1-4fcc21614c24 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:57.153808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-91925654-3b25-419c-94e1-4fcc21614c24 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:57.165383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91925654-3b25-419c-94e1-4fcc21614c24 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:57.167978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91925654-3b25-419c-94e1-4fcc21614c24 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:57.169583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91925654-3b25-419c-94e1-4fcc21614c24 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:57.170338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91925654-3b25-419c-94e1-4fcc21614c24 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:57.170877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91925654-3b25-419c-94e1-4fcc21614c24 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:57.171379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91925654-3b25-419c-94e1-4fcc21614c24 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:57.440410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9eb240b2-58f8-4d39-a1a7-0ff11f55e4e9 req-a2ca6659-2048-4465-a377-ae6093a34612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce8c0a7-8702-4362-8cd8-f22f61d9551e", "name": "network-vif-deleted", "tag": "c990c201-d6ea-4a94-94e6-1857e9446755"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:57.464645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9eb240b2-58f8-4d39-a1a7-0ff11f55e4e9 req-a2ca6659-2048-4465-a377-ae6093a34612 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:57.465935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9eb240b2-58f8-4d39-a1a7-0ff11f55e4e9 req-a2ca6659-2048-4465-a377-ae6093a34612 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:57.466613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9eb240b2-58f8-4d39-a1a7-0ff11f55e4e9 req-a2ca6659-2048-4465-a377-ae6093a34612 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:57.480829 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9eb240b2-58f8-4d39-a1a7-0ff11f55e4e9 req-a2ca6659-2048-4465-a377-ae6093a34612 service nova] Creating event network-vif-deleted:c990c201-d6ea-4a94-94e6-1857e9446755 for instance bce8c0a7-8702-4362-8cd8-f22f61d9551e on nch1-master-1 Sep 06 11:13:57.489851 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9eb240b2-58f8-4d39-a1a7-0ff11f55e4e9 req-a2ca6659-2048-4465-a377-ae6093a34612 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053063 Sep 06 11:13:57.493229 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2423/4798] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:13:57.504413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3c323f9f-963e-421a-879b-d350c8b4e340 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:57.507245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3c323f9f-963e-421a-879b-d350c8b4e340 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:57.530903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c323f9f-963e-421a-879b-d350c8b4e340 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:57.531676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c323f9f-963e-421a-879b-d350c8b4e340 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:57.532315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c323f9f-963e-421a-879b-d350c8b4e340 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:57.533612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c323f9f-963e-421a-879b-d350c8b4e340 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:57.534456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c323f9f-963e-421a-879b-d350c8b4e340 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:57.535102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c323f9f-963e-421a-879b-d350c8b4e340 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:57.843214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-91925654-3b25-419c-94e1-4fcc21614c24 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:57.848939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3c323f9f-963e-421a-879b-d350c8b4e340 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:57.859236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-91925654-3b25-419c-94e1-4fcc21614c24 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:57.861194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-91925654-3b25-419c-94e1-4fcc21614c24 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:57.862723 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-91925654-3b25-419c-94e1-4fcc21614c24 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1372 microversion: 2.57 time: 0.714007 Sep 06 11:13:57.864132 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2376/4799] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:57 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1372 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:57.870925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:57.871871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:57.872021 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3c323f9f-963e-421a-879b-d350c8b4e340 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1268 microversion: 2.1 time: 0.378577 Sep 06 11:13:57.881832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:57.882546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:57.887080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:57.887080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:57.887080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:57.887080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:57.898136 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2424/4800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:57 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1268 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:57.939586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:57.940082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:57.941064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:57.941780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lazy-loading 'fault' on Instance uuid bce8c0a7-8702-4362-8cd8-f22f61d9551e {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:13:57.994763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ee93c80cb40398df6fec3c902bed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0413c72e86542c3a7df65d5830ffc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:58.002613 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0cb06258-f4f3-4325-be34-027a089e5708 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 200 len: 1316 microversion: 2.1 time: 0.137044 Sep 06 11:13:58.004036 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2377/4801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:57 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 1316 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:13:58.087657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5b82d029-27c6-4610-ab18-161dd6f07527 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:58.088293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5b82d029-27c6-4610-ab18-161dd6f07527 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:58.105196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b82d029-27c6-4610-ab18-161dd6f07527 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:58.105476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b82d029-27c6-4610-ab18-161dd6f07527 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:58.115659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b82d029-27c6-4610-ab18-161dd6f07527 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:58.115659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b82d029-27c6-4610-ab18-161dd6f07527 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:58.115659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b82d029-27c6-4610-ab18-161dd6f07527 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:58.115659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b82d029-27c6-4610-ab18-161dd6f07527 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:58.257171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5b82d029-27c6-4610-ab18-161dd6f07527 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:58.288378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5b82d029-27c6-4610-ab18-161dd6f07527 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:58.293105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5b82d029-27c6-4610-ab18-161dd6f07527 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:58.294977 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5b82d029-27c6-4610-ab18-161dd6f07527 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1576 microversion: 2.42 time: 0.212424 Sep 06 11:13:58.300703 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2425/4802] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:58 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:58.901531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e495917e-36ca-4671-8ca7-d6868cc77b9a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:58.902578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c96b782d-9b06-4632-b67c-0efc980eed0b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:58.903259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c96b782d-9b06-4632-b67c-0efc980eed0b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:58.914815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e495917e-36ca-4671-8ca7-d6868cc77b9a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:58.919184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c96b782d-9b06-4632-b67c-0efc980eed0b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:58.919706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c96b782d-9b06-4632-b67c-0efc980eed0b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:58.922873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c96b782d-9b06-4632-b67c-0efc980eed0b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:58.926368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c96b782d-9b06-4632-b67c-0efc980eed0b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:58.926937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c96b782d-9b06-4632-b67c-0efc980eed0b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:58.927492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c96b782d-9b06-4632-b67c-0efc980eed0b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:58.929873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e495917e-36ca-4671-8ca7-d6868cc77b9a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:58.930916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e495917e-36ca-4671-8ca7-d6868cc77b9a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:58.931853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e495917e-36ca-4671-8ca7-d6868cc77b9a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:58.933564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e495917e-36ca-4671-8ca7-d6868cc77b9a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:58.934500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e495917e-36ca-4671-8ca7-d6868cc77b9a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:58.935486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e495917e-36ca-4671-8ca7-d6868cc77b9a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:59.205421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c96b782d-9b06-4632-b67c-0efc980eed0b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:59.215943 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c96b782d-9b06-4632-b67c-0efc980eed0b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1276 microversion: 2.1 time: 0.319894 Sep 06 11:13:59.221431 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2426/4803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:58 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1276 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:13:59.234228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f2b504b-acca-4bed-9ef2-bf9cd830e2f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:59.235284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7f2b504b-acca-4bed-9ef2-bf9cd830e2f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] [instance: bce8c0a7-8702-4362-8cd8-f22f61d9551e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:59.243584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e495917e-36ca-4671-8ca7-d6868cc77b9a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:59.266630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e495917e-36ca-4671-8ca7-d6868cc77b9a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:59.270155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f2b504b-acca-4bed-9ef2-bf9cd830e2f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:59.273308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e495917e-36ca-4671-8ca7-d6868cc77b9a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:59.273857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f2b504b-acca-4bed-9ef2-bf9cd830e2f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:59.274570 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e495917e-36ca-4671-8ca7-d6868cc77b9a tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1372 microversion: 2.57 time: 0.381925 Sep 06 11:13:59.276224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f2b504b-acca-4bed-9ef2-bf9cd830e2f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:59.279386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f2b504b-acca-4bed-9ef2-bf9cd830e2f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:59.280470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f2b504b-acca-4bed-9ef2-bf9cd830e2f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:59.282116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f2b504b-acca-4bed-9ef2-bf9cd830e2f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:59.296788 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2378/4804] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:58 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1372 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:59.302445 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-7f2b504b-acca-4bed-9ef2-bf9cd830e2f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] HTTP exception thrown: Instance bce8c0a7-8702-4362-8cd8-f22f61d9551e could not be found. Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f2b504b-acca-4bed-9ef2-bf9cd830e2f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Request method failure captured: Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e HTTP/1.1 Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyszCv5fqEUC-i9Sf_9GOHG8CqE4Ofx-7bfX8hRkSyMyi9qrytkdDLEdC2R-jHfrwZffqVPSvOOZ7-7wHiZEPjWq9u1tqFXwghQm0rR9ygqPSZxcEj-x0xiUVFn3UW9sneGzRSCPSFBoXS7q1T663p04dxcWDHmzwuxi9pMMCmEuT2s Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e0413c72e86542c3a7df65d5830ffc27 Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestFqdnHostnames-99449188 Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e0413c72e86542c3a7df65d5830ffc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0413c72e86542c3a7df65d5830ffc27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e0413c72e86542c3a7df65d5830ffc27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0413c72e86542c3a7df65d5830ffc27"}]}] Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestFqdnHostnames-99449188 Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e0413c72e86542c3a7df65d5830ffc27 Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-99449188 Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestFqdnHostnames-99449188-project Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 387ee93c80cb40398df6fec3c902bed0 Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestFqdnHostnames-99449188-project Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance bce8c0a7-8702-4362-8cd8-f22f61d9551e could not be found. Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'bce8c0a7-8702-4362-8cd8-f22f61d9551e'} Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce8c0a7-8702-4362-8cd8-f22f61d9551e could not be found. Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce8c0a7-8702-4362-8cd8-f22f61d9551e could not be found. Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:13:59.304257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:59.309313 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:13:59.309313 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:13:59.309313 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:13:59.309313 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:13:59.309313 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:13:59.309313 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce8c0a7-8702-4362-8cd8-f22f61d9551e could not be found. Sep 06 11:13:59.309313 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:13:59.309313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f2b504b-acca-4bed-9ef2-bf9cd830e2f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Returning 404 to user: Instance bce8c0a7-8702-4362-8cd8-f22f61d9551e could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:13:59.309313 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7f2b504b-acca-4bed-9ef2-bf9cd830e2f6 tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e" status: 404 len: 111 microversion: 2.1 time: 0.083928 Sep 06 11:13:59.310958 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2427/4805] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:13:59 2022] GET /compute/v2.1/servers/bce8c0a7-8702-4362-8cd8-f22f61d9551e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:13:59.321855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-152bddaf-b951-462d-8df7-8e495e3e6d9a tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] Calling method '.version_select at 0x7f90f36de670>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:59.336059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8097900e-603e-42b2-b3e7-d9f767d8256d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:13:59.338941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:59.339876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8097900e-603e-42b2-b3e7-d9f767d8256d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:13:59.349895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8097900e-603e-42b2-b3e7-d9f767d8256d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:59.353468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8097900e-603e-42b2-b3e7-d9f767d8256d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:59.354327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8097900e-603e-42b2-b3e7-d9f767d8256d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:59.356871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8097900e-603e-42b2-b3e7-d9f767d8256d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:59.357808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8097900e-603e-42b2-b3e7-d9f767d8256d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:59.362512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8097900e-603e-42b2-b3e7-d9f767d8256d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:59.455885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8097900e-603e-42b2-b3e7-d9f767d8256d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:59.477156 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-152bddaf-b951-462d-8df7-8e495e3e6d9a tempest-ServersTestFqdnHostnames-99449188 tempest-ServersTestFqdnHostnames-99449188-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066134474" status: 202 len: 0 microversion: 2.1 time: 0.164817 Sep 06 11:13:59.483151 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2379/4806] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:13:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066134474 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:13:59.486357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8097900e-603e-42b2-b3e7-d9f767d8256d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:59.488397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8097900e-603e-42b2-b3e7-d9f767d8256d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:13:59.490016 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8097900e-603e-42b2-b3e7-d9f767d8256d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1576 microversion: 2.42 time: 0.159504 Sep 06 11:13:59.491218 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2428/4807] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:13:59 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:13:59.609888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-7844e90c-d57e-4481-bc58-f36e755884c9 req-d9f9db82-61ff-4026-a430-c5c7e008458a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ddbde28-f59b-4bdd-82a7-6dfc37a97585", "tag": "fd0e55dc-cde7-4ba7-acda-9db7705724f6"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:13:59.628295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7844e90c-d57e-4481-bc58-f36e755884c9 req-d9f9db82-61ff-4026-a430-c5c7e008458a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:13:59.629083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7844e90c-d57e-4481-bc58-f36e755884c9 req-d9f9db82-61ff-4026-a430-c5c7e008458a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:13:59.629743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7844e90c-d57e-4481-bc58-f36e755884c9 req-d9f9db82-61ff-4026-a430-c5c7e008458a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:13:59.657386 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7844e90c-d57e-4481-bc58-f36e755884c9 req-d9f9db82-61ff-4026-a430-c5c7e008458a service nova] Creating event network-changed:fd0e55dc-cde7-4ba7-acda-9db7705724f6 for instance 3ddbde28-f59b-4bdd-82a7-6dfc37a97585 on nch1-master-1 Sep 06 11:13:59.669362 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-7844e90c-d57e-4481-bc58-f36e755884c9 req-d9f9db82-61ff-4026-a430-c5c7e008458a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069468 Sep 06 11:13:59.671613 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2380/4808] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:00.245953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-67dd83f1-0c0e-48e9-9c26-37c5dc49cfb0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:00.247434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-67dd83f1-0c0e-48e9-9c26-37c5dc49cfb0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:00.261486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67dd83f1-0c0e-48e9-9c26-37c5dc49cfb0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:00.265774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67dd83f1-0c0e-48e9-9c26-37c5dc49cfb0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:00.266452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67dd83f1-0c0e-48e9-9c26-37c5dc49cfb0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:00.267488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67dd83f1-0c0e-48e9-9c26-37c5dc49cfb0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:00.268190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67dd83f1-0c0e-48e9-9c26-37c5dc49cfb0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:00.268485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67dd83f1-0c0e-48e9-9c26-37c5dc49cfb0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:00.314643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ddc29971-febd-45c0-9d17-40cc7b5f147c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:00.315424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ddc29971-febd-45c0-9d17-40cc7b5f147c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:00.324329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:00.325959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ddc29971-febd-45c0-9d17-40cc7b5f147c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:00.326624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ddc29971-febd-45c0-9d17-40cc7b5f147c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:00.327297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ddc29971-febd-45c0-9d17-40cc7b5f147c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:00.328172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ddc29971-febd-45c0-9d17-40cc7b5f147c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:00.328939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ddc29971-febd-45c0-9d17-40cc7b5f147c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:00.333981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ddc29971-febd-45c0-9d17-40cc7b5f147c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:00.623102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ddc29971-febd-45c0-9d17-40cc7b5f147c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:00.633146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ddc29971-febd-45c0-9d17-40cc7b5f147c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:00.641754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ddc29971-febd-45c0-9d17-40cc7b5f147c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:00.653211 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ddc29971-febd-45c0-9d17-40cc7b5f147c tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1357 microversion: 2.57 time: 0.336990 Sep 06 11:14:00.654209 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2381/4809] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:00 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1357 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:00.669718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8bb27c45-b1ae-4ab5-a4a1-cdd73fa4c56b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:00.675369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8bb27c45-b1ae-4ab5-a4a1-cdd73fa4c56b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:00.702792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bb27c45-b1ae-4ab5-a4a1-cdd73fa4c56b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:00.703754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bb27c45-b1ae-4ab5-a4a1-cdd73fa4c56b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:00.705293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bb27c45-b1ae-4ab5-a4a1-cdd73fa4c56b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:00.706940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bb27c45-b1ae-4ab5-a4a1-cdd73fa4c56b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:00.709781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bb27c45-b1ae-4ab5-a4a1-cdd73fa4c56b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:00.710456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8bb27c45-b1ae-4ab5-a4a1-cdd73fa4c56b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:00.924681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8bb27c45-b1ae-4ab5-a4a1-cdd73fa4c56b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:00.942796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8bb27c45-b1ae-4ab5-a4a1-cdd73fa4c56b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:00.945254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8bb27c45-b1ae-4ab5-a4a1-cdd73fa4c56b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:00.949951 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8bb27c45-b1ae-4ab5-a4a1-cdd73fa4c56b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1594 microversion: 2.42 time: 0.294071 Sep 06 11:14:00.952670 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2382/4810] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:00 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1594 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:00.964062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d9271988-dcec-4c59-b809-dd1b20db279d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:00.980887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d9271988-dcec-4c59-b809-dd1b20db279d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:00.982287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-67dd83f1-0c0e-48e9-9c26-37c5dc49cfb0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:00.991394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9271988-dcec-4c59-b809-dd1b20db279d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:00.992629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9271988-dcec-4c59-b809-dd1b20db279d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:00.993275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9271988-dcec-4c59-b809-dd1b20db279d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:00.994237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9271988-dcec-4c59-b809-dd1b20db279d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:00.994943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9271988-dcec-4c59-b809-dd1b20db279d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:00.995633 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-67dd83f1-0c0e-48e9-9c26-37c5dc49cfb0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1316 microversion: 2.1 time: 0.754195 Sep 06 11:14:00.995935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9271988-dcec-4c59-b809-dd1b20db279d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:01.008684 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2429/4811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:00 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1316 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:01.056987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d9271988-dcec-4c59-b809-dd1b20db279d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:14:01.493853 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d9271988-dcec-4c59-b809-dd1b20db279d tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "DELETE /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 204 len: 0 microversion: 2.57 time: 0.535713 Sep 06 11:14:01.494770 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2383/4812] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:14:00 2022] DELETE /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:14:01.514627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f865e6c1-468f-4e31-8275-9f0dc3566ff0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:01.518662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f865e6c1-468f-4e31-8275-9f0dc3566ff0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:01.534404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f865e6c1-468f-4e31-8275-9f0dc3566ff0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:01.540206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f865e6c1-468f-4e31-8275-9f0dc3566ff0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:01.540206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f865e6c1-468f-4e31-8275-9f0dc3566ff0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:01.540206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f865e6c1-468f-4e31-8275-9f0dc3566ff0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:01.540206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f865e6c1-468f-4e31-8275-9f0dc3566ff0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:01.541087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f865e6c1-468f-4e31-8275-9f0dc3566ff0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:01.639266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f865e6c1-468f-4e31-8275-9f0dc3566ff0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:01.657008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f865e6c1-468f-4e31-8275-9f0dc3566ff0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:01.658988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f865e6c1-468f-4e31-8275-9f0dc3566ff0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:01.660914 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f865e6c1-468f-4e31-8275-9f0dc3566ff0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1363 microversion: 2.57 time: 0.158129 Sep 06 11:14:01.662860 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2430/4813] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:01 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:01.986954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b3dc50d9-b95f-4835-8c57-e60f427def96 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:01.987787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b3dc50d9-b95f-4835-8c57-e60f427def96 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:01.995739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3dc50d9-b95f-4835-8c57-e60f427def96 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:01.996152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3dc50d9-b95f-4835-8c57-e60f427def96 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:01.997245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3dc50d9-b95f-4835-8c57-e60f427def96 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:01.998417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3dc50d9-b95f-4835-8c57-e60f427def96 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:01.998899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3dc50d9-b95f-4835-8c57-e60f427def96 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:01.999366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3dc50d9-b95f-4835-8c57-e60f427def96 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:02.025470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e393e74-8ba0-46ec-9cb7-1ce00f564176 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:02.026120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4e393e74-8ba0-46ec-9cb7-1ce00f564176 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:02.030360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:02.038573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e393e74-8ba0-46ec-9cb7-1ce00f564176 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:02.039525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e393e74-8ba0-46ec-9cb7-1ce00f564176 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:02.040150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e393e74-8ba0-46ec-9cb7-1ce00f564176 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:02.041091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e393e74-8ba0-46ec-9cb7-1ce00f564176 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:02.041735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e393e74-8ba0-46ec-9cb7-1ce00f564176 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:02.042342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e393e74-8ba0-46ec-9cb7-1ce00f564176 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:02.115746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b3dc50d9-b95f-4835-8c57-e60f427def96 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:02.131905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b3dc50d9-b95f-4835-8c57-e60f427def96 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:02.133555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b3dc50d9-b95f-4835-8c57-e60f427def96 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:02.135307 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b3dc50d9-b95f-4835-8c57-e60f427def96 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1594 microversion: 2.42 time: 0.153159 Sep 06 11:14:02.136561 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2384/4814] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:01 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:02.406732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4e393e74-8ba0-46ec-9cb7-1ce00f564176 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:02.419567 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e393e74-8ba0-46ec-9cb7-1ce00f564176 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1316 microversion: 2.1 time: 0.399076 Sep 06 11:14:02.431866 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2431/4815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:02 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:14:02.691072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-60774200-7a13-4154-81c7-0d3f51439bf0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:02.691785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-60774200-7a13-4154-81c7-0d3f51439bf0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:02.700001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60774200-7a13-4154-81c7-0d3f51439bf0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:02.700891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60774200-7a13-4154-81c7-0d3f51439bf0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:02.701510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60774200-7a13-4154-81c7-0d3f51439bf0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:02.703286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60774200-7a13-4154-81c7-0d3f51439bf0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:02.710777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60774200-7a13-4154-81c7-0d3f51439bf0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:02.710777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-60774200-7a13-4154-81c7-0d3f51439bf0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:03.041446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-60774200-7a13-4154-81c7-0d3f51439bf0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:03.057901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-60774200-7a13-4154-81c7-0d3f51439bf0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:03.062811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-60774200-7a13-4154-81c7-0d3f51439bf0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:03.064883 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-60774200-7a13-4154-81c7-0d3f51439bf0 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1363 microversion: 2.57 time: 0.379070 Sep 06 11:14:03.068523 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2385/4816] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:02 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1363 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:03.183975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c7e6438e-27ef-4686-aef1-b99077e1e76e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:03.187197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c7e6438e-27ef-4686-aef1-b99077e1e76e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:03.202037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e6438e-27ef-4686-aef1-b99077e1e76e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:03.202871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e6438e-27ef-4686-aef1-b99077e1e76e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:03.203703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e6438e-27ef-4686-aef1-b99077e1e76e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:03.204896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e6438e-27ef-4686-aef1-b99077e1e76e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:03.205451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e6438e-27ef-4686-aef1-b99077e1e76e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:03.209067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7e6438e-27ef-4686-aef1-b99077e1e76e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:03.348371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:03.448496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-4acb8be3-4417-4133-bbe4-5e8b31f37570 req-35ee4672-d758-4c28-a528-4d2a247512fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4", "tag": "b74c1e61-74bb-4ccc-97ba-17f5f50a6d22"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:03.460583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4acb8be3-4417-4133-bbe4-5e8b31f37570 req-35ee4672-d758-4c28-a528-4d2a247512fb service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:03.461475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4acb8be3-4417-4133-bbe4-5e8b31f37570 req-35ee4672-d758-4c28-a528-4d2a247512fb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:03.462112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4acb8be3-4417-4133-bbe4-5e8b31f37570 req-35ee4672-d758-4c28-a528-4d2a247512fb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:03.486285 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-4acb8be3-4417-4133-bbe4-5e8b31f37570 req-35ee4672-d758-4c28-a528-4d2a247512fb service nova] Creating event network-changed:b74c1e61-74bb-4ccc-97ba-17f5f50a6d22 for instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 on nch2-master-1 Sep 06 11:14:03.498362 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-4acb8be3-4417-4133-bbe4-5e8b31f37570 req-35ee4672-d758-4c28-a528-4d2a247512fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048997 Sep 06 11:14:03.502179 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2386/4817] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:03.509047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a07997e0-4820-42aa-a07e-c0b049a4f202 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:03.509352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c7e6438e-27ef-4686-aef1-b99077e1e76e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:03.511445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a07997e0-4820-42aa-a07e-c0b049a4f202 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:03.519116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a07997e0-4820-42aa-a07e-c0b049a4f202 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:03.520388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a07997e0-4820-42aa-a07e-c0b049a4f202 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:03.521099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a07997e0-4820-42aa-a07e-c0b049a4f202 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:03.522036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a07997e0-4820-42aa-a07e-c0b049a4f202 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:03.523097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a07997e0-4820-42aa-a07e-c0b049a4f202 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:03.523496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c7e6438e-27ef-4686-aef1-b99077e1e76e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:03.524048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a07997e0-4820-42aa-a07e-c0b049a4f202 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:03.525062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c7e6438e-27ef-4686-aef1-b99077e1e76e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:03.526266 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c7e6438e-27ef-4686-aef1-b99077e1e76e tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1661 microversion: 2.42 time: 0.349733 Sep 06 11:14:03.526897 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2432/4818] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:03 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1661 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:03.854724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a07997e0-4820-42aa-a07e-c0b049a4f202 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:03.870406 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a07997e0-4820-42aa-a07e-c0b049a4f202 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1316 microversion: 2.1 time: 0.366233 Sep 06 11:14:03.871258 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2387/4819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:03 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:04.113386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:04.114270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:04.122429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:04.123221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:04.124096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:04.125008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:04.125650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:04.126246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:04.192342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:04.193031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:04.193287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:04.193963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lazy-loading 'fault' on Instance uuid 36988e91-ef9c-4e67-98f0-db2bc6e47df1 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:14:04.327304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:04.338923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:04.344367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:04.350052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73d9683f7f04bdeafa6d06ab565c800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ad0aa0c40a40d18f33ec559adac83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:04.352433 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-76ea942c-589f-4d95-bb9a-2623df43bcca tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 200 len: 1368 microversion: 2.57 time: 0.243087 Sep 06 11:14:04.353780 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2433/4820] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:04 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:04.566745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1bd74ddc-3ff8-4236-8c89-fbbcdc413c0f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:04.567401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1bd74ddc-3ff8-4236-8c89-fbbcdc413c0f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:04.570996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=18 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:04.581288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bd74ddc-3ff8-4236-8c89-fbbcdc413c0f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:04.581960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bd74ddc-3ff8-4236-8c89-fbbcdc413c0f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:04.582953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bd74ddc-3ff8-4236-8c89-fbbcdc413c0f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:04.584393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bd74ddc-3ff8-4236-8c89-fbbcdc413c0f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:04.585097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bd74ddc-3ff8-4236-8c89-fbbcdc413c0f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:04.585707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1bd74ddc-3ff8-4236-8c89-fbbcdc413c0f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:04.913891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-02132ec7-c050-4418-9d32-99fe6398c302 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:04.915739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-02132ec7-c050-4418-9d32-99fe6398c302 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:04.947400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02132ec7-c050-4418-9d32-99fe6398c302 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:04.948870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02132ec7-c050-4418-9d32-99fe6398c302 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:04.950580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02132ec7-c050-4418-9d32-99fe6398c302 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:04.952367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02132ec7-c050-4418-9d32-99fe6398c302 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:04.953583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02132ec7-c050-4418-9d32-99fe6398c302 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:04.954668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02132ec7-c050-4418-9d32-99fe6398c302 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:05.136192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1bd74ddc-3ff8-4236-8c89-fbbcdc413c0f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:05.151227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1bd74ddc-3ff8-4236-8c89-fbbcdc413c0f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:05.153569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1bd74ddc-3ff8-4236-8c89-fbbcdc413c0f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:05.155027 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1bd74ddc-3ff8-4236-8c89-fbbcdc413c0f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1707 microversion: 2.42 time: 0.592177 Sep 06 11:14:05.156304 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2388/4821] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:04 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1707 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:05.282494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=10 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:05.301257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-02132ec7-c050-4418-9d32-99fe6398c302 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:05.311820 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-02132ec7-c050-4418-9d32-99fe6398c302 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1316 microversion: 2.1 time: 0.408904 Sep 06 11:14:05.315633 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2434/4822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:04 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:05.388958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c3e448c-60eb-4c6b-aa04-31b0107b1963 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:05.390425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c3e448c-60eb-4c6b-aa04-31b0107b1963 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] [instance: 36988e91-ef9c-4e67-98f0-db2bc6e47df1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:05.415290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c3e448c-60eb-4c6b-aa04-31b0107b1963 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:05.418668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c3e448c-60eb-4c6b-aa04-31b0107b1963 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:05.418668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c3e448c-60eb-4c6b-aa04-31b0107b1963 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:05.418668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c3e448c-60eb-4c6b-aa04-31b0107b1963 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:05.418668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c3e448c-60eb-4c6b-aa04-31b0107b1963 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:05.420848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c3e448c-60eb-4c6b-aa04-31b0107b1963 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:05.447745 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-2c3e448c-60eb-4c6b-aa04-31b0107b1963 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] HTTP exception thrown: Instance 36988e91-ef9c-4e67-98f0-db2bc6e47df1 could not be found. Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c3e448c-60eb-4c6b-aa04-31b0107b1963 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Request method failure captured: Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 HTTP/1.1 Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytJI9KW8PfmGayoFs53l-JjCU99U5zo8zkD7jawJiflkJBmA7271qWLSdQxtT_GgjBP8asfWvT8C-dzoZLaIk9APw6cDu7NX3gLn3-bP7DlcEZw_M91mTDAdL-r7Bz03xOG4xqOdTxoeQK7LOGglvUnD2nx84bIWhzc6RWEeDTGOIw Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.57 Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 64ad0aa0c40a40d18f33ec559adac83f Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerShowV257Test-1164584640 Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_64ad0aa0c40a40d18f33ec559adac83f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64ad0aa0c40a40d18f33ec559adac83f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/64ad0aa0c40a40d18f33ec559adac83f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64ad0aa0c40a40d18f33ec559adac83f"}]}] Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerShowV257Test-1164584640 Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 64ad0aa0c40a40d18f33ec559adac83f Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerShowV257Test-1164584640 Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerShowV257Test-1164584640-project Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: c73d9683f7f04bdeafa6d06ab565c800 Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerShowV257Test-1164584640-project Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 36988e91-ef9c-4e67-98f0-db2bc6e47df1 could not be found. Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '36988e91-ef9c-4e67-98f0-db2bc6e47df1'} Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36988e91-ef9c-4e67-98f0-db2bc6e47df1 could not be found. Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36988e91-ef9c-4e67-98f0-db2bc6e47df1 could not be found. Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:05.450092 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:05.455439 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:05.455439 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:05.455439 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:05.455439 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:14:05.455439 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:14:05.455439 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36988e91-ef9c-4e67-98f0-db2bc6e47df1 could not be found. Sep 06 11:14:05.455439 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:05.459210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c3e448c-60eb-4c6b-aa04-31b0107b1963 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] Returning 404 to user: Instance 36988e91-ef9c-4e67-98f0-db2bc6e47df1 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:14:05.459210 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c3e448c-60eb-4c6b-aa04-31b0107b1963 tempest-ServerShowV257Test-1164584640 tempest-ServerShowV257Test-1164584640-project] 10.222.0.20 "GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1" status: 404 len: 111 microversion: 2.57 time: 0.081686 Sep 06 11:14:05.459210 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2389/4823] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:05 2022] GET /compute/v2.1/servers/36988e91-ef9c-4e67-98f0-db2bc6e47df1 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:14:06.185705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-828fd141-5d48-4a6a-9d12-a0816e3777bf tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:06.186659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-828fd141-5d48-4a6a-9d12-a0816e3777bf tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:06.196709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-828fd141-5d48-4a6a-9d12-a0816e3777bf tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:06.210148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-828fd141-5d48-4a6a-9d12-a0816e3777bf tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:06.210148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-828fd141-5d48-4a6a-9d12-a0816e3777bf tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:06.210148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-828fd141-5d48-4a6a-9d12-a0816e3777bf tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:06.210148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-828fd141-5d48-4a6a-9d12-a0816e3777bf tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:06.210148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-828fd141-5d48-4a6a-9d12-a0816e3777bf tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:06.335848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bb19ab51-2a7c-4e49-ac07-7fc005ca6155 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:06.337123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bb19ab51-2a7c-4e49-ac07-7fc005ca6155 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:06.345220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb19ab51-2a7c-4e49-ac07-7fc005ca6155 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:06.345977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb19ab51-2a7c-4e49-ac07-7fc005ca6155 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:06.346655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb19ab51-2a7c-4e49-ac07-7fc005ca6155 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:06.347593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb19ab51-2a7c-4e49-ac07-7fc005ca6155 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:06.348223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb19ab51-2a7c-4e49-ac07-7fc005ca6155 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:06.348975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb19ab51-2a7c-4e49-ac07-7fc005ca6155 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:06.483337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-828fd141-5d48-4a6a-9d12-a0816e3777bf tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:06.496662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-828fd141-5d48-4a6a-9d12-a0816e3777bf tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:06.498884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-828fd141-5d48-4a6a-9d12-a0816e3777bf tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:06.500705 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-828fd141-5d48-4a6a-9d12-a0816e3777bf tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1707 microversion: 2.42 time: 0.322066 Sep 06 11:14:06.502243 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2435/4824] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:06 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1707 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:06.613779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bb19ab51-2a7c-4e49-ac07-7fc005ca6155 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:06.623089 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bb19ab51-2a7c-4e49-ac07-7fc005ca6155 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1316 microversion: 2.1 time: 0.291026 Sep 06 11:14:06.624079 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2390/4825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:06 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:14:07.529520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e32f0687-cd82-4b1e-ac13-c298792e4fe8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:07.530204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e32f0687-cd82-4b1e-ac13-c298792e4fe8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:07.541677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e32f0687-cd82-4b1e-ac13-c298792e4fe8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:07.542259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e32f0687-cd82-4b1e-ac13-c298792e4fe8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:07.542623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e32f0687-cd82-4b1e-ac13-c298792e4fe8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:07.543372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e32f0687-cd82-4b1e-ac13-c298792e4fe8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:07.543838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e32f0687-cd82-4b1e-ac13-c298792e4fe8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:07.544322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e32f0687-cd82-4b1e-ac13-c298792e4fe8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:07.648830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-90195d06-5d11-486a-a7c0-b5a3455377ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:07.650047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-90195d06-5d11-486a-a7c0-b5a3455377ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:07.661076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90195d06-5d11-486a-a7c0-b5a3455377ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:07.661772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90195d06-5d11-486a-a7c0-b5a3455377ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:07.662381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90195d06-5d11-486a-a7c0-b5a3455377ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:07.663484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90195d06-5d11-486a-a7c0-b5a3455377ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:07.675421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90195d06-5d11-486a-a7c0-b5a3455377ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:07.676294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90195d06-5d11-486a-a7c0-b5a3455377ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:08.018657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e32f0687-cd82-4b1e-ac13-c298792e4fe8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:08.029995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e32f0687-cd82-4b1e-ac13-c298792e4fe8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:08.040591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e32f0687-cd82-4b1e-ac13-c298792e4fe8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:08.042829 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e32f0687-cd82-4b1e-ac13-c298792e4fe8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1753 microversion: 2.42 time: 0.517260 Sep 06 11:14:08.044982 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2436/4826] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:07 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1753 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:08.129340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-90195d06-5d11-486a-a7c0-b5a3455377ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:08.156299 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-90195d06-5d11-486a-a7c0-b5a3455377ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1316 microversion: 2.1 time: 0.512567 Sep 06 11:14:08.157120 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2391/4827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:07 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:09.074387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f0016c56-172a-4624-bb57-1ae35ad4d6bd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:09.076344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f0016c56-172a-4624-bb57-1ae35ad4d6bd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:09.084306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0016c56-172a-4624-bb57-1ae35ad4d6bd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:09.085041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0016c56-172a-4624-bb57-1ae35ad4d6bd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:09.095660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0016c56-172a-4624-bb57-1ae35ad4d6bd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:09.095660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0016c56-172a-4624-bb57-1ae35ad4d6bd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:09.095660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0016c56-172a-4624-bb57-1ae35ad4d6bd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:09.095660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0016c56-172a-4624-bb57-1ae35ad4d6bd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:09.343952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f0016c56-172a-4624-bb57-1ae35ad4d6bd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:09.364765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f0016c56-172a-4624-bb57-1ae35ad4d6bd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:09.365105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c57da958-96cc-456b-82fd-449e2588681c tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] Calling method '.version_select at 0x7f90f3518f70>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:09.367203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f0016c56-172a-4624-bb57-1ae35ad4d6bd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:09.368805 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f0016c56-172a-4624-bb57-1ae35ad4d6bd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1753 microversion: 2.42 time: 0.299199 Sep 06 11:14:09.369728 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2437/4828] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:09 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1753 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:09.379084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c7f26c03-03c4-473b-86d9-4d94d68ede75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:09.379084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c7f26c03-03c4-473b-86d9-4d94d68ede75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:09.401747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7f26c03-03c4-473b-86d9-4d94d68ede75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:09.402298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7f26c03-03c4-473b-86d9-4d94d68ede75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:09.402757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7f26c03-03c4-473b-86d9-4d94d68ede75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:09.403607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7f26c03-03c4-473b-86d9-4d94d68ede75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:09.404077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7f26c03-03c4-473b-86d9-4d94d68ede75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:09.404513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7f26c03-03c4-473b-86d9-4d94d68ede75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:09.468880 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c57da958-96cc-456b-82fd-449e2588681c tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/72339a3e36b948f7b3fb35d097cdc7b3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.331030 Sep 06 11:14:09.469971 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2392/4829] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 11:14:09 2022] GET /compute/v2.1/os-quota-sets/72339a3e36b948f7b3fb35d097cdc7b3/defaults => generated 371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:14:09.482323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0c67a8cd-9a0d-491f-a8f3-994d67b5c138 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] Calling method '.version_select at 0x7f90f35ddf70>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:09.600043 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0c67a8cd-9a0d-491f-a8f3-994d67b5c138 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/72339a3e36b948f7b3fb35d097cdc7b3" status: 200 len: 371 microversion: 2.1 time: 0.121774 Sep 06 11:14:09.602067 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2393/4830] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 11:14:09 2022] GET /compute/v2.1/os-quota-sets/72339a3e36b948f7b3fb35d097cdc7b3 => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:09.619316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c7f26c03-03c4-473b-86d9-4d94d68ede75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:09.631515 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c7f26c03-03c4-473b-86d9-4d94d68ede75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1316 microversion: 2.1 time: 0.259290 Sep 06 11:14:09.632446 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2438/4831] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:09 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:09.633498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e49b3682-b293-4890-99ef-481a451640cb tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] Calling method '.version_select at 0x7f90f3757700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:09.723638 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e49b3682-b293-4890-99ef-481a451640cb tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/72339a3e36b948f7b3fb35d097cdc7b3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.111018 Sep 06 11:14:09.724469 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2394/4832] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 11:14:09 2022] GET /compute/v2.1/os-quota-sets/72339a3e36b948f7b3fb35d097cdc7b3/defaults => generated 371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:09.741149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7e7fbe89-74ea-448b-9e7c-2e171b94a016 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] Calling method '.version_select at 0x7f90fd0961f0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:10.038811 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7e7fbe89-74ea-448b-9e7c-2e171b94a016 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/72339a3e36b948f7b3fb35d097cdc7b3" status: 200 len: 371 microversion: 2.1 time: 0.302349 Sep 06 11:14:10.045778 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2439/4833] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 11:14:09 2022] GET /compute/v2.1/os-quota-sets/72339a3e36b948f7b3fb35d097cdc7b3 => generated 371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:10.056781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0cf9a0b5-dd9e-4476-936b-37aec8eb2018 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] Calling method '.version_select at 0x7f90f35ddc10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:10.203219 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0cf9a0b5-dd9e-4476-936b-37aec8eb2018 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/72339a3e36b948f7b3fb35d097cdc7b3?user_id=2d25771bdd164eb6bdd83557dbf884ec" status: 200 len: 371 microversion: 2.1 time: 0.150964 Sep 06 11:14:10.203943 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2395/4834] 10.222.0.20 () {58 vars in 1323 bytes} [Tue Sep 6 11:14:10 2022] GET /compute/v2.1/os-quota-sets/72339a3e36b948f7b3fb35d097cdc7b3?user_id=2d25771bdd164eb6bdd83557dbf884ec => generated 371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:10.374017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-42e83929-089a-466f-a3d6-bcee191fb683 req-4aefc3ba-eb34-4d1a-a547-a7289c9eea3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4", "name": "network-vif-plugged", "status": "completed", "tag": "b74c1e61-74bb-4ccc-97ba-17f5f50a6d22"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:10.387604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-42e83929-089a-466f-a3d6-bcee191fb683 req-4aefc3ba-eb34-4d1a-a547-a7289c9eea3d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:10.388087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-42e83929-089a-466f-a3d6-bcee191fb683 req-4aefc3ba-eb34-4d1a-a547-a7289c9eea3d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:10.388731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-42e83929-089a-466f-a3d6-bcee191fb683 req-4aefc3ba-eb34-4d1a-a547-a7289c9eea3d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:10.397068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-df0ab574-80be-4ed8-bd43-aef16a96da31 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:10.397698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-df0ab574-80be-4ed8-bd43-aef16a96da31 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:10.405031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df0ab574-80be-4ed8-bd43-aef16a96da31 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:10.405905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df0ab574-80be-4ed8-bd43-aef16a96da31 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:10.406431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df0ab574-80be-4ed8-bd43-aef16a96da31 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:10.407278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df0ab574-80be-4ed8-bd43-aef16a96da31 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:10.407819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df0ab574-80be-4ed8-bd43-aef16a96da31 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:10.408372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df0ab574-80be-4ed8-bd43-aef16a96da31 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:10.409617 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-42e83929-089a-466f-a3d6-bcee191fb683 req-4aefc3ba-eb34-4d1a-a547-a7289c9eea3d service nova] Creating event network-vif-plugged:b74c1e61-74bb-4ccc-97ba-17f5f50a6d22 for instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 on nch2-master-1 Sep 06 11:14:10.415217 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-42e83929-089a-466f-a3d6-bcee191fb683 req-4aefc3ba-eb34-4d1a-a547-a7289c9eea3d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045896 Sep 06 11:14:10.416142 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2440/4835] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:10.632669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-df0ab574-80be-4ed8-bd43-aef16a96da31 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:10.643138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-df0ab574-80be-4ed8-bd43-aef16a96da31 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:10.645055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-df0ab574-80be-4ed8-bd43-aef16a96da31 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:10.646516 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-df0ab574-80be-4ed8-bd43-aef16a96da31 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1787 microversion: 2.42 time: 0.253421 Sep 06 11:14:10.647515 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2396/4836] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:10 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1787 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:10.664656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-96a097a8-5199-4d9e-aca9-946aac5aa5c8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:10.665573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-96a097a8-5199-4d9e-aca9-946aac5aa5c8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:10.676034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96a097a8-5199-4d9e-aca9-946aac5aa5c8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:10.677532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96a097a8-5199-4d9e-aca9-946aac5aa5c8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:10.678282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96a097a8-5199-4d9e-aca9-946aac5aa5c8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:10.681781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96a097a8-5199-4d9e-aca9-946aac5aa5c8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:10.681781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96a097a8-5199-4d9e-aca9-946aac5aa5c8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:10.681781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96a097a8-5199-4d9e-aca9-946aac5aa5c8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:10.922469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-96a097a8-5199-4d9e-aca9-946aac5aa5c8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:10.932086 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-96a097a8-5199-4d9e-aca9-946aac5aa5c8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1316 microversion: 2.1 time: 0.275473 Sep 06 11:14:10.933129 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2441/4837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:10 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:11.684117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-287e659c-6c1d-4fed-8c83-933ebe291b53 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:11.684887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-287e659c-6c1d-4fed-8c83-933ebe291b53 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:11.705683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-287e659c-6c1d-4fed-8c83-933ebe291b53 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:11.706297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-287e659c-6c1d-4fed-8c83-933ebe291b53 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:11.706969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-287e659c-6c1d-4fed-8c83-933ebe291b53 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:11.707742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-287e659c-6c1d-4fed-8c83-933ebe291b53 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:11.708983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-287e659c-6c1d-4fed-8c83-933ebe291b53 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:11.709589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-287e659c-6c1d-4fed-8c83-933ebe291b53 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:11.737412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:11.961177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9250b664-73dd-44d4-92e5-42f8875a3107 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:11.962337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9250b664-73dd-44d4-92e5-42f8875a3107 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:11.978688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9250b664-73dd-44d4-92e5-42f8875a3107 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:11.980340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9250b664-73dd-44d4-92e5-42f8875a3107 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:11.982562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9250b664-73dd-44d4-92e5-42f8875a3107 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:11.983568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9250b664-73dd-44d4-92e5-42f8875a3107 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:11.987549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9250b664-73dd-44d4-92e5-42f8875a3107 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:11.990909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9250b664-73dd-44d4-92e5-42f8875a3107 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:12.026250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-287e659c-6c1d-4fed-8c83-933ebe291b53 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:12.041924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-287e659c-6c1d-4fed-8c83-933ebe291b53 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:12.056386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-287e659c-6c1d-4fed-8c83-933ebe291b53 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:12.064948 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-287e659c-6c1d-4fed-8c83-933ebe291b53 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1833 microversion: 2.42 time: 0.385638 Sep 06 11:14:12.066211 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2397/4838] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:11 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1833 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:12.271734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9250b664-73dd-44d4-92e5-42f8875a3107 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:12.283028 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9250b664-73dd-44d4-92e5-42f8875a3107 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1316 microversion: 2.1 time: 0.329567 Sep 06 11:14:12.299581 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2442/4839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:11 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:14:13.095715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6613af46-3a8f-448c-8631-7b92f0ee1c43 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:13.097279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6613af46-3a8f-448c-8631-7b92f0ee1c43 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:13.107268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6613af46-3a8f-448c-8631-7b92f0ee1c43 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:13.108095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6613af46-3a8f-448c-8631-7b92f0ee1c43 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:13.108815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6613af46-3a8f-448c-8631-7b92f0ee1c43 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:13.109626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6613af46-3a8f-448c-8631-7b92f0ee1c43 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:13.110468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6613af46-3a8f-448c-8631-7b92f0ee1c43 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:13.111174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6613af46-3a8f-448c-8631-7b92f0ee1c43 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:13.416288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] Action: 'create', calling method: .version_select at 0x7f90fcf76d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-190050042", "metadata": {"Type": "work"}}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:13.420356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6613af46-3a8f-448c-8631-7b92f0ee1c43 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:13.433133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6613af46-3a8f-448c-8631-7b92f0ee1c43 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:13.435219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6613af46-3a8f-448c-8631-7b92f0ee1c43 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:13.436332 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6613af46-3a8f-448c-8631-7b92f0ee1c43 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1833 microversion: 2.42 time: 0.344526 Sep 06 11:14:13.437155 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2398/4840] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:13 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1833 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:13.463844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d0cfd435-b475-4f50-a15e-520bcea51144 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:13.464470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d0cfd435-b475-4f50-a15e-520bcea51144 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:13.471399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0cfd435-b475-4f50-a15e-520bcea51144 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:13.471903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0cfd435-b475-4f50-a15e-520bcea51144 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:13.472427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0cfd435-b475-4f50-a15e-520bcea51144 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:13.473196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0cfd435-b475-4f50-a15e-520bcea51144 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:13.473715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0cfd435-b475-4f50-a15e-520bcea51144 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:13.474187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0cfd435-b475-4f50-a15e-520bcea51144 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:13.643965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d0cfd435-b475-4f50-a15e-520bcea51144 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:13.652455 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d0cfd435-b475-4f50-a15e-520bcea51144 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.192721 Sep 06 11:14:13.653675 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2399/4841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:13 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:13.661969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9f93cc96-d391-45a8-91cf-ada73219de93 req-a398b2cf-f4ec-41e2-94e3-9b19f7b700d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "tag": "1918ef7a-2344-47ad-aa5c-49c938fd8469"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:13.681722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9f93cc96-d391-45a8-91cf-ada73219de93 req-a398b2cf-f4ec-41e2-94e3-9b19f7b700d3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:13.688413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9f93cc96-d391-45a8-91cf-ada73219de93 req-a398b2cf-f4ec-41e2-94e3-9b19f7b700d3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:13.688413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9f93cc96-d391-45a8-91cf-ada73219de93 req-a398b2cf-f4ec-41e2-94e3-9b19f7b700d3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:13.702602 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9f93cc96-d391-45a8-91cf-ada73219de93 req-a398b2cf-f4ec-41e2-94e3-9b19f7b700d3 service nova] Creating event network-changed:1918ef7a-2344-47ad-aa5c-49c938fd8469 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:14:13.710465 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9f93cc96-d391-45a8-91cf-ada73219de93 req-a398b2cf-f4ec-41e2-94e3-9b19f7b700d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054404 Sep 06 11:14:13.711140 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2400/4842] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:13.806579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-383920057", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:13.866644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] validate_networks() for [('b9ea5ffd-3051-44b1-b178-c09345529f6f', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:14:14.268386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:14:14.269021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:14:14.269346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:14:14.269769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:14:14.270197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:14:14.280256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:14.280757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:14.281207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:14.281952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:14.282421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:14.282878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:14.301774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Getting quotas for project aad114c7a41a47e785fd117e1103f168. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:14:14.307321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Getting quotas for user 3e904f27c02248389ae9ca86cb95c54a and project aad114c7a41a47e785fd117e1103f168. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:14:14.321267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:14:14.323791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:14:14.515872 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.306899 Sep 06 11:14:14.516954 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2443/4843] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 11:14:13 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1309 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 11:14:14.525336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8a452a56-b883-4094-9736-8e90d10f6a36 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:14.532725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8a452a56-b883-4094-9736-8e90d10f6a36 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:14.539370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a452a56-b883-4094-9736-8e90d10f6a36 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:14.540420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a452a56-b883-4094-9736-8e90d10f6a36 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:14.541022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a452a56-b883-4094-9736-8e90d10f6a36 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:14.541929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a452a56-b883-4094-9736-8e90d10f6a36 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:14.542711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a452a56-b883-4094-9736-8e90d10f6a36 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:14.543388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a452a56-b883-4094-9736-8e90d10f6a36 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:14.569136 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fb1a9c6b-f6b3-431e-99c8-4e9a346582d1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767880 Sep 06 11:14:14.570201 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2401/4844] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:14:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:14:14.575704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-98eaf9f4-5b23-46a2-a1dd-224bf7ad6c62 tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] Calling method '.version_select at 0x7f90f35e8790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:14.658270 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-98eaf9f4-5b23-46a2-a1dd-224bf7ad6c62 tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9" status: 200 len: 345 microversion: 2.1 time: 0.085849 Sep 06 11:14:14.666139 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2402/4845] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:14:14 2022] GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9 => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:14.673280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-48cc6e70-3849-40c8-ba45-80978cf6d5fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:14.674142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-48cc6e70-3849-40c8-ba45-80978cf6d5fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:14.813639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-48cc6e70-3849-40c8-ba45-80978cf6d5fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:14.841420 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-48cc6e70-3849-40c8-ba45-80978cf6d5fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1216 microversion: 2.1 time: 0.171666 Sep 06 11:14:14.844805 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2403/4846] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:14 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1216 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:14.866782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8a452a56-b883-4094-9736-8e90d10f6a36 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:14.887183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8a452a56-b883-4094-9736-8e90d10f6a36 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:14.888679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8a452a56-b883-4094-9736-8e90d10f6a36 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:14.908497 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8a452a56-b883-4094-9736-8e90d10f6a36 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1833 microversion: 2.42 time: 0.376783 Sep 06 11:14:14.908497 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2444/4847] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:14 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1833 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:15.674637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7bb4a25e-5e1c-4e7c-bd2e-8f796e70231b tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] Calling method '.version_select at 0x7f90f33553a0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:15.743915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-2ea78ac2-d83b-4b11-9cd7-96ffc8e82648 req-f5c46be1-f237-4526-960d-532bd8fa7aeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "tag": "9cabd01e-ea05-40f4-aead-e049cadec515"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:15.764344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2ea78ac2-d83b-4b11-9cd7-96ffc8e82648 req-f5c46be1-f237-4526-960d-532bd8fa7aeb service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:15.764834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2ea78ac2-d83b-4b11-9cd7-96ffc8e82648 req-f5c46be1-f237-4526-960d-532bd8fa7aeb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:15.766804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2ea78ac2-d83b-4b11-9cd7-96ffc8e82648 req-f5c46be1-f237-4526-960d-532bd8fa7aeb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:15.799782 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7bb4a25e-5e1c-4e7c-bd2e-8f796e70231b tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9" status: 200 len: 345 microversion: 2.1 time: 0.128950 Sep 06 11:14:15.806789 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-2ea78ac2-d83b-4b11-9cd7-96ffc8e82648 req-f5c46be1-f237-4526-960d-532bd8fa7aeb service nova] Creating event network-changed:9cabd01e-ea05-40f4-aead-e049cadec515 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:14:15.812871 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-2ea78ac2-d83b-4b11-9cd7-96ffc8e82648 req-f5c46be1-f237-4526-960d-532bd8fa7aeb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073322 Sep 06 11:14:15.814189 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2404/4849] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:14:15 2022] GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9 => generated 345 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:15.814331 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2445/4849] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:14:15.869759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b642b4d5-9fdf-43f2-b14d-3f54938b73cc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:15.871793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b642b4d5-9fdf-43f2-b14d-3f54938b73cc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:15.930300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4bd957b1-066c-4302-a41f-fb1845276323 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:15.931657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4bd957b1-066c-4302-a41f-fb1845276323 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:15.965065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bd957b1-066c-4302-a41f-fb1845276323 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:15.965065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bd957b1-066c-4302-a41f-fb1845276323 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:15.965065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bd957b1-066c-4302-a41f-fb1845276323 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:15.965065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bd957b1-066c-4302-a41f-fb1845276323 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:15.965065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bd957b1-066c-4302-a41f-fb1845276323 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:15.965065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bd957b1-066c-4302-a41f-fb1845276323 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:16.051651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b642b4d5-9fdf-43f2-b14d-3f54938b73cc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:16.051651 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b642b4d5-9fdf-43f2-b14d-3f54938b73cc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1216 microversion: 2.1 time: 0.145175 Sep 06 11:14:16.051651 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2405/4850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:15 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1216 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:16.242760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4bd957b1-066c-4302-a41f-fb1845276323 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:16.258703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4bd957b1-066c-4302-a41f-fb1845276323 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:16.267449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4bd957b1-066c-4302-a41f-fb1845276323 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:16.269448 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4bd957b1-066c-4302-a41f-fb1845276323 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1854 microversion: 2.42 time: 0.344574 Sep 06 11:14:16.287293 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2446/4851] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:15 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1854 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:16.817891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a2209fc8-6788-48ac-869c-55f2ffe5e818 tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] Calling method '.version_select at 0x7f90f3620dc0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:16.876565 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a2209fc8-6788-48ac-869c-55f2ffe5e818 tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9" status: 200 len: 346 microversion: 2.1 time: 0.063053 Sep 06 11:14:16.877148 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2406/4852] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:14:16 2022] GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9 => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:16.893655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f40587c4-76d8-4d25-95e3-05abfebcee1b tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] Calling method '.version_select at 0x7f90fcf768b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:16.976525 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f40587c4-76d8-4d25-95e3-05abfebcee1b tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9" status: 200 len: 346 microversion: 2.1 time: 0.086744 Sep 06 11:14:16.995590 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2447/4853] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:14:16 2022] GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9 => generated 346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:17.001800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] Calling method '.version_select at 0x7f90f35dd5e0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:17.075057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cd43a45f-be59-4c78-a2ad-1e632613b23d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:17.075736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cd43a45f-be59-4c78-a2ad-1e632613b23d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:17.088586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd43a45f-be59-4c78-a2ad-1e632613b23d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:17.089168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd43a45f-be59-4c78-a2ad-1e632613b23d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:17.089692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd43a45f-be59-4c78-a2ad-1e632613b23d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:17.090433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd43a45f-be59-4c78-a2ad-1e632613b23d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:17.096722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd43a45f-be59-4c78-a2ad-1e632613b23d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:17.096722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd43a45f-be59-4c78-a2ad-1e632613b23d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:17.178776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cd43a45f-be59-4c78-a2ad-1e632613b23d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:17.201844 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cd43a45f-be59-4c78-a2ad-1e632613b23d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1212 microversion: 2.1 time: 0.130839 Sep 06 11:14:17.203234 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2448/4854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:17 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1212 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:14:17.303676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-882f18e6-194e-472c-88c3-1193b7946e37 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:17.305881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-882f18e6-194e-472c-88c3-1193b7946e37 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:17.331692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-882f18e6-194e-472c-88c3-1193b7946e37 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:17.337875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-882f18e6-194e-472c-88c3-1193b7946e37 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:17.338960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-882f18e6-194e-472c-88c3-1193b7946e37 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:17.340273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-882f18e6-194e-472c-88c3-1193b7946e37 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:17.341069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-882f18e6-194e-472c-88c3-1193b7946e37 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:17.341360 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9" status: 202 len: 0 microversion: 2.1 time: 0.345854 Sep 06 11:14:17.341813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-882f18e6-194e-472c-88c3-1193b7946e37 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:17.343361 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2407/4855] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:14:16 2022] DELETE /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:14:17.379274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-def448ac-f0c2-4e14-afa7-1aced3942488 tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] Calling method '.version_select at 0x7f90fcfb8ca0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:17.522560 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-def448ac-f0c2-4e14-afa7-1aced3942488 tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9" status: 200 len: 345 microversion: 2.1 time: 0.152296 Sep 06 11:14:17.523192 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2408/4856] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:14:17 2022] GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9 => generated 345 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:17.695847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-882f18e6-194e-472c-88c3-1193b7946e37 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:17.717666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-882f18e6-194e-472c-88c3-1193b7946e37 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:17.719661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-882f18e6-194e-472c-88c3-1193b7946e37 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:17.720926 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-882f18e6-194e-472c-88c3-1193b7946e37 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.425711 Sep 06 11:14:17.746112 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2449/4857] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:17 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:18.183061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-2a33493e-e85d-41c8-8eac-a5d7d8956a14 req-580d746e-af06-4883-bcaa-475561a373d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "tag": "e50e4dc4-e3ed-478b-8ee3-86ecdce0d790"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:18.197899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2a33493e-e85d-41c8-8eac-a5d7d8956a14 req-580d746e-af06-4883-bcaa-475561a373d5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:18.198696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2a33493e-e85d-41c8-8eac-a5d7d8956a14 req-580d746e-af06-4883-bcaa-475561a373d5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:18.199710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2a33493e-e85d-41c8-8eac-a5d7d8956a14 req-580d746e-af06-4883-bcaa-475561a373d5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:18.213039 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-2a33493e-e85d-41c8-8eac-a5d7d8956a14 req-580d746e-af06-4883-bcaa-475561a373d5 service nova] Creating event network-changed:e50e4dc4-e3ed-478b-8ee3-86ecdce0d790 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:14:18.219310 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-2a33493e-e85d-41c8-8eac-a5d7d8956a14 req-580d746e-af06-4883-bcaa-475561a373d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042276 Sep 06 11:14:18.220337 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2409/4858] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:18.233633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8263dd66-d384-4230-99ea-508047552167 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:18.234872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8263dd66-d384-4230-99ea-508047552167 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:18.246531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8263dd66-d384-4230-99ea-508047552167 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:18.251800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8263dd66-d384-4230-99ea-508047552167 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:18.251800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8263dd66-d384-4230-99ea-508047552167 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:18.251800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8263dd66-d384-4230-99ea-508047552167 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:18.251800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8263dd66-d384-4230-99ea-508047552167 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:18.251800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8263dd66-d384-4230-99ea-508047552167 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:18.326045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8263dd66-d384-4230-99ea-508047552167 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:18.336647 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8263dd66-d384-4230-99ea-508047552167 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1276 microversion: 2.1 time: 0.107066 Sep 06 11:14:18.347221 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2450/4859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:18 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:18.538183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0c2893a1-a259-4fdb-8e52-ee953c53be57 tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] Calling method '.version_select at 0x7f90f368b790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:18.589968 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0c2893a1-a259-4fdb-8e52-ee953c53be57 tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9" status: 200 len: 345 microversion: 2.1 time: 0.056475 Sep 06 11:14:18.590715 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2410/4860] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:14:18 2022] GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:18.760643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7a4170c6-b7f2-4572-8849-a140618aa2e6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:18.761278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7a4170c6-b7f2-4572-8849-a140618aa2e6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:18.771652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a4170c6-b7f2-4572-8849-a140618aa2e6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:18.772147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a4170c6-b7f2-4572-8849-a140618aa2e6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:18.772623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a4170c6-b7f2-4572-8849-a140618aa2e6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:18.773456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a4170c6-b7f2-4572-8849-a140618aa2e6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:18.773916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a4170c6-b7f2-4572-8849-a140618aa2e6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:18.774351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a4170c6-b7f2-4572-8849-a140618aa2e6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:19.001749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7a4170c6-b7f2-4572-8849-a140618aa2e6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:19.012001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7a4170c6-b7f2-4572-8849-a140618aa2e6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:19.013477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7a4170c6-b7f2-4572-8849-a140618aa2e6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:19.014701 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7a4170c6-b7f2-4572-8849-a140618aa2e6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.258498 Sep 06 11:14:19.015513 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2451/4861] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:18 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:19.365963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6edd4c47-2fe5-4b2a-a9ab-71057ef9283b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:19.366728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6edd4c47-2fe5-4b2a-a9ab-71057ef9283b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:19.374258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6edd4c47-2fe5-4b2a-a9ab-71057ef9283b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:19.374759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6edd4c47-2fe5-4b2a-a9ab-71057ef9283b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:19.375249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6edd4c47-2fe5-4b2a-a9ab-71057ef9283b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:19.375978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6edd4c47-2fe5-4b2a-a9ab-71057ef9283b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:19.376451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6edd4c47-2fe5-4b2a-a9ab-71057ef9283b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:19.376889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6edd4c47-2fe5-4b2a-a9ab-71057ef9283b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:19.449427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6edd4c47-2fe5-4b2a-a9ab-71057ef9283b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:19.458317 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6edd4c47-2fe5-4b2a-a9ab-71057ef9283b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1274 microversion: 2.1 time: 0.096865 Sep 06 11:14:19.458929 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2411/4862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:19 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:19.605427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a72b484-508b-4383-bb57-47c9292d95c4 tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] Calling method '.version_select at 0x7f90fd10cd30>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:19.664895 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a72b484-508b-4383-bb57-47c9292d95c4 tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9" status: 200 len: 345 microversion: 2.1 time: 0.063968 Sep 06 11:14:19.665606 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2452/4863] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:14:19 2022] GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:20.041329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a5e37c9e-9bcf-4bcc-bce4-e7285ee4b3d5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:20.042079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a5e37c9e-9bcf-4bcc-bce4-e7285ee4b3d5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:20.057101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5e37c9e-9bcf-4bcc-bce4-e7285ee4b3d5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:20.057101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5e37c9e-9bcf-4bcc-bce4-e7285ee4b3d5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:20.057101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5e37c9e-9bcf-4bcc-bce4-e7285ee4b3d5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:20.057101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5e37c9e-9bcf-4bcc-bce4-e7285ee4b3d5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:20.057101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5e37c9e-9bcf-4bcc-bce4-e7285ee4b3d5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:20.058063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5e37c9e-9bcf-4bcc-bce4-e7285ee4b3d5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:20.484552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:20.497850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-66ff0727-a7cd-4c95-b374-f0538f3fea9a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:20.500724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-66ff0727-a7cd-4c95-b374-f0538f3fea9a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:20.527137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-66ff0727-a7cd-4c95-b374-f0538f3fea9a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:20.529216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-66ff0727-a7cd-4c95-b374-f0538f3fea9a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:20.531898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-66ff0727-a7cd-4c95-b374-f0538f3fea9a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:20.533081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-66ff0727-a7cd-4c95-b374-f0538f3fea9a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:20.539232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-66ff0727-a7cd-4c95-b374-f0538f3fea9a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:20.540130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-66ff0727-a7cd-4c95-b374-f0538f3fea9a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:20.771665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-66ff0727-a7cd-4c95-b374-f0538f3fea9a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:20.788544 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-66ff0727-a7cd-4c95-b374-f0538f3fea9a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1274 microversion: 2.1 time: 0.305603 Sep 06 11:14:20.791496 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2453/4864] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:20 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1274 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:20.800654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81605453-2bf8-4d6a-ad32-a99e142c61bd tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] Calling method '.version_select at 0x7f90f853cdc0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:20.968950 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-81605453-2bf8-4d6a-ad32-a99e142c61bd tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9" status: 200 len: 345 microversion: 2.1 time: 0.175810 Sep 06 11:14:20.969949 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2454/4865] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:14:20 2022] GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9 => generated 345 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:20.988275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a5e37c9e-9bcf-4bcc-bce4-e7285ee4b3d5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:21.005287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a5e37c9e-9bcf-4bcc-bce4-e7285ee4b3d5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:21.008769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a5e37c9e-9bcf-4bcc-bce4-e7285ee4b3d5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:21.010729 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a5e37c9e-9bcf-4bcc-bce4-e7285ee4b3d5 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.973245 Sep 06 11:14:21.011931 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2412/4866] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:20 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:21.105968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-ea251b22-c127-40ce-b5e2-4272eeacde57 req-4dea2bda-14b4-4230-bad8-c98eaaf3a879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "tag": "3e403f89-7cbd-47b7-8591-7aa0e6c26fba"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:21.127641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ea251b22-c127-40ce-b5e2-4272eeacde57 req-4dea2bda-14b4-4230-bad8-c98eaaf3a879 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:21.128400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ea251b22-c127-40ce-b5e2-4272eeacde57 req-4dea2bda-14b4-4230-bad8-c98eaaf3a879 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:21.132163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ea251b22-c127-40ce-b5e2-4272eeacde57 req-4dea2bda-14b4-4230-bad8-c98eaaf3a879 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:21.156445 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-ea251b22-c127-40ce-b5e2-4272eeacde57 req-4dea2bda-14b4-4230-bad8-c98eaaf3a879 service nova] Creating event network-changed:3e403f89-7cbd-47b7-8591-7aa0e6c26fba for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:14:21.169196 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-ea251b22-c127-40ce-b5e2-4272eeacde57 req-4dea2bda-14b4-4230-bad8-c98eaaf3a879 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066281 Sep 06 11:14:21.170289 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2455/4867] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:21.813831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b91fcb5f-809e-4b94-ae90-cbd1241a448c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:21.814977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b91fcb5f-809e-4b94-ae90-cbd1241a448c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:21.837519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b91fcb5f-809e-4b94-ae90-cbd1241a448c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:21.837519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b91fcb5f-809e-4b94-ae90-cbd1241a448c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:21.837519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b91fcb5f-809e-4b94-ae90-cbd1241a448c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:21.837519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b91fcb5f-809e-4b94-ae90-cbd1241a448c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:21.837519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b91fcb5f-809e-4b94-ae90-cbd1241a448c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:21.837519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b91fcb5f-809e-4b94-ae90-cbd1241a448c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:21.988399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fc3cf0c6-ec5f-4a08-bcca-966553733c8c tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] Calling method '.version_select at 0x7f90f39e0f70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:22.028836 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-fc3cf0c6-ec5f-4a08-bcca-966553733c8c tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] HTTP exception thrown: Volume 8abfe24d-11af-49da-a532-321675d143d9 could not be found. Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fc3cf0c6-ec5f-4a08-bcca-966553733c8c tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] Request method failure captured: Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9 HTTP/1.1 Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyuFNd4EhN_WIuDhfvbkint0rlDhpQxuDQTXJy7PyJf28XfqRer87Q3BEMn8FDsDOGAbGj4g50nbHyEyspPSv549ZXNSMFF3w63P_X1QQtv3fzA0oudNCErIHAsf3fCLDQRtyAmcSlp0Tq3pcZ7gxFWeZ-lHeE94cT3a0D3LhYbe174 Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 041b07c4e3dd4a88b18646126981b420 Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-VolumesGetTestJSON-714361466 Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_041b07c4e3dd4a88b18646126981b420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/041b07c4e3dd4a88b18646126981b420"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/041b07c4e3dd4a88b18646126981b420"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/041b07c4e3dd4a88b18646126981b420"}]}] Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-VolumesGetTestJSON-714361466 Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 041b07c4e3dd4a88b18646126981b420 Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-VolumesGetTestJSON-714361466 Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-VolumesGetTestJSON-714361466-project Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 8c33476cb26f4a2fb575cdcd03e97269 Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-VolumesGetTestJSON-714361466-project Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: exception: Volume 8abfe24d-11af-49da-a532-321675d143d9 could not be found. Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '8abfe24d-11af-49da-a532-321675d143d9'} Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8abfe24d-11af-49da-a532-321675d143d9 could not be found. (HTTP 404) (Request-ID: req-648e8db9-7ec4-451f-b2e5-7211185e3ca1) Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 11:14:22.033056 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8abfe24d-11af-49da-a532-321675d143d9 could not be found. Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8abfe24d-11af-49da-a532-321675d143d9 could not be found. Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8abfe24d-11af-49da-a532-321675d143d9 could not be found. Sep 06 11:14:22.038749 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:22.045292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fc3cf0c6-ec5f-4a08-bcca-966553733c8c tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] Returning 404 to user: Volume 8abfe24d-11af-49da-a532-321675d143d9 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:14:22.046425 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fc3cf0c6-ec5f-4a08-bcca-966553733c8c tempest-VolumesGetTestJSON-714361466 tempest-VolumesGetTestJSON-714361466-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9" status: 404 len: 109 microversion: 2.1 time: 0.064897 Sep 06 11:14:22.047339 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2456/4868] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:14:21 2022] GET /compute/v2.1/os-volumes/8abfe24d-11af-49da-a532-321675d143d9 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:14:22.081831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7a10b4e2-16df-4ee2-87a1-2923ce472189 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:22.085293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7a10b4e2-16df-4ee2-87a1-2923ce472189 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:22.102767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a10b4e2-16df-4ee2-87a1-2923ce472189 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:22.103797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a10b4e2-16df-4ee2-87a1-2923ce472189 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:22.106588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a10b4e2-16df-4ee2-87a1-2923ce472189 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:22.109374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a10b4e2-16df-4ee2-87a1-2923ce472189 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:22.110160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a10b4e2-16df-4ee2-87a1-2923ce472189 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:22.112542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a10b4e2-16df-4ee2-87a1-2923ce472189 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:22.307581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b91fcb5f-809e-4b94-ae90-cbd1241a448c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:22.335655 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b91fcb5f-809e-4b94-ae90-cbd1241a448c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1316 microversion: 2.1 time: 0.524351 Sep 06 11:14:22.337314 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2413/4869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:21 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:22.547936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7a10b4e2-16df-4ee2-87a1-2923ce472189 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:22.561349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7a10b4e2-16df-4ee2-87a1-2923ce472189 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:22.563610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7a10b4e2-16df-4ee2-87a1-2923ce472189 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:22.565081 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7a10b4e2-16df-4ee2-87a1-2923ce472189 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.516570 Sep 06 11:14:22.565847 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2457/4870] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:22 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:23.362177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a22931fb-8d4b-45b3-b6a6-d0805c402b1a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:23.363158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a22931fb-8d4b-45b3-b6a6-d0805c402b1a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:23.383156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a22931fb-8d4b-45b3-b6a6-d0805c402b1a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:23.385024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a22931fb-8d4b-45b3-b6a6-d0805c402b1a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:23.385751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a22931fb-8d4b-45b3-b6a6-d0805c402b1a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:23.386670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a22931fb-8d4b-45b3-b6a6-d0805c402b1a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:23.390835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a22931fb-8d4b-45b3-b6a6-d0805c402b1a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:23.391341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a22931fb-8d4b-45b3-b6a6-d0805c402b1a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:23.597221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bbe886d4-f947-41c6-a1c5-cb5fd56a3178 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:23.598583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bbe886d4-f947-41c6-a1c5-cb5fd56a3178 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:23.607520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bbe886d4-f947-41c6-a1c5-cb5fd56a3178 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:23.608191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bbe886d4-f947-41c6-a1c5-cb5fd56a3178 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:23.608707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bbe886d4-f947-41c6-a1c5-cb5fd56a3178 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:23.609613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bbe886d4-f947-41c6-a1c5-cb5fd56a3178 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:23.610090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bbe886d4-f947-41c6-a1c5-cb5fd56a3178 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:23.610527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bbe886d4-f947-41c6-a1c5-cb5fd56a3178 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:23.637206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:24.100320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a22931fb-8d4b-45b3-b6a6-d0805c402b1a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:24.114973 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a22931fb-8d4b-45b3-b6a6-d0805c402b1a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1316 microversion: 2.1 time: 0.756910 Sep 06 11:14:24.119000 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2414/4871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:23 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1316 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:24.297100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bbe886d4-f947-41c6-a1c5-cb5fd56a3178 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:24.310334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bbe886d4-f947-41c6-a1c5-cb5fd56a3178 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:24.313466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bbe886d4-f947-41c6-a1c5-cb5fd56a3178 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:24.314759 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bbe886d4-f947-41c6-a1c5-cb5fd56a3178 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.721714 Sep 06 11:14:24.315352 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2458/4872] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:23 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:24.482007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-c12c81d2-4f27-4a78-a0e1-c90edad68c52 req-b60d98fa-b8e0-42c3-b8d0-3bda0cfbdf13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "tag": "668f5dcf-b1c4-4540-a554-6a6dad1d4823"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:24.492071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:24.498390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c12c81d2-4f27-4a78-a0e1-c90edad68c52 req-b60d98fa-b8e0-42c3-b8d0-3bda0cfbdf13 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:24.499389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c12c81d2-4f27-4a78-a0e1-c90edad68c52 req-b60d98fa-b8e0-42c3-b8d0-3bda0cfbdf13 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:24.500043 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c12c81d2-4f27-4a78-a0e1-c90edad68c52 req-b60d98fa-b8e0-42c3-b8d0-3bda0cfbdf13 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:24.516765 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-c12c81d2-4f27-4a78-a0e1-c90edad68c52 req-b60d98fa-b8e0-42c3-b8d0-3bda0cfbdf13 service nova] Creating event network-changed:668f5dcf-b1c4-4540-a554-6a6dad1d4823 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:14:24.526680 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-c12c81d2-4f27-4a78-a0e1-c90edad68c52 req-b60d98fa-b8e0-42c3-b8d0-3bda0cfbdf13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049819 Sep 06 11:14:24.526680 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2415/4873] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:25.145715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34107ce0-f5a2-4e91-99ef-97e76c6e96a2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:25.146957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-34107ce0-f5a2-4e91-99ef-97e76c6e96a2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:25.157994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34107ce0-f5a2-4e91-99ef-97e76c6e96a2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:25.158554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34107ce0-f5a2-4e91-99ef-97e76c6e96a2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:25.159000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34107ce0-f5a2-4e91-99ef-97e76c6e96a2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:25.159767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34107ce0-f5a2-4e91-99ef-97e76c6e96a2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:25.160230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34107ce0-f5a2-4e91-99ef-97e76c6e96a2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:25.161207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34107ce0-f5a2-4e91-99ef-97e76c6e96a2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:25.345758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-34107ce0-f5a2-4e91-99ef-97e76c6e96a2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:25.351682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-42d02d60-f2e1-48d1-bff1-bdd55d409a79 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:25.352416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-42d02d60-f2e1-48d1-bff1-bdd55d409a79 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:25.360300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42d02d60-f2e1-48d1-bff1-bdd55d409a79 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:25.360817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42d02d60-f2e1-48d1-bff1-bdd55d409a79 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:25.375364 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-34107ce0-f5a2-4e91-99ef-97e76c6e96a2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1316 microversion: 2.1 time: 0.222785 Sep 06 11:14:25.376981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42d02d60-f2e1-48d1-bff1-bdd55d409a79 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:25.376981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42d02d60-f2e1-48d1-bff1-bdd55d409a79 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:25.376981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42d02d60-f2e1-48d1-bff1-bdd55d409a79 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:25.376981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42d02d60-f2e1-48d1-bff1-bdd55d409a79 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:25.377292 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2459/4874] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:25 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:25.635465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-42d02d60-f2e1-48d1-bff1-bdd55d409a79 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:25.650537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-42d02d60-f2e1-48d1-bff1-bdd55d409a79 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:25.653878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-42d02d60-f2e1-48d1-bff1-bdd55d409a79 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:25.657598 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-42d02d60-f2e1-48d1-bff1-bdd55d409a79 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.311677 Sep 06 11:14:25.661212 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2416/4875] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:25 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:26.389806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e322cef8-bd52-40c2-ad9d-8d6ead58cf91 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:26.391257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e322cef8-bd52-40c2-ad9d-8d6ead58cf91 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:26.398503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e322cef8-bd52-40c2-ad9d-8d6ead58cf91 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:26.399156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e322cef8-bd52-40c2-ad9d-8d6ead58cf91 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:26.399849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e322cef8-bd52-40c2-ad9d-8d6ead58cf91 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:26.400996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e322cef8-bd52-40c2-ad9d-8d6ead58cf91 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:26.401986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e322cef8-bd52-40c2-ad9d-8d6ead58cf91 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:26.402942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e322cef8-bd52-40c2-ad9d-8d6ead58cf91 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:26.555725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e322cef8-bd52-40c2-ad9d-8d6ead58cf91 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:26.563816 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e322cef8-bd52-40c2-ad9d-8d6ead58cf91 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1316 microversion: 2.1 time: 0.178006 Sep 06 11:14:26.578806 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2460/4876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:26 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:26.598401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-cb071d51-63f8-464d-acec-62a9eabe2858 req-5280a96a-5db6-4c7f-b0b6-5eb4e2104a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4d2b81-c9f2-479d-94c5-c637fe0e9360", "tag": "a7cddaca-ffbd-401e-b5dc-d705ed80ebb3"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:26.601621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=16 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:26.612129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-cb071d51-63f8-464d-acec-62a9eabe2858 req-5280a96a-5db6-4c7f-b0b6-5eb4e2104a80 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:26.612730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-cb071d51-63f8-464d-acec-62a9eabe2858 req-5280a96a-5db6-4c7f-b0b6-5eb4e2104a80 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:26.613244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-cb071d51-63f8-464d-acec-62a9eabe2858 req-5280a96a-5db6-4c7f-b0b6-5eb4e2104a80 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:26.625511 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-cb071d51-63f8-464d-acec-62a9eabe2858 req-5280a96a-5db6-4c7f-b0b6-5eb4e2104a80 service nova] Creating event network-changed:a7cddaca-ffbd-401e-b5dc-d705ed80ebb3 for instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 on nch1-master-1 Sep 06 11:14:26.630706 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-cb071d51-63f8-464d-acec-62a9eabe2858 req-5280a96a-5db6-4c7f-b0b6-5eb4e2104a80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039738 Sep 06 11:14:26.632025 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2417/4877] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:26.686038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0d0c82f5-2869-4c61-b14a-e359a404ed71 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:26.687026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0d0c82f5-2869-4c61-b14a-e359a404ed71 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:26.693699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d0c82f5-2869-4c61-b14a-e359a404ed71 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:26.694425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d0c82f5-2869-4c61-b14a-e359a404ed71 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:26.694967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d0c82f5-2869-4c61-b14a-e359a404ed71 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:26.695830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d0c82f5-2869-4c61-b14a-e359a404ed71 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:26.696419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d0c82f5-2869-4c61-b14a-e359a404ed71 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:26.696958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d0c82f5-2869-4c61-b14a-e359a404ed71 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:26.939663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0d0c82f5-2869-4c61-b14a-e359a404ed71 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:26.957070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0d0c82f5-2869-4c61-b14a-e359a404ed71 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:26.961471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0d0c82f5-2869-4c61-b14a-e359a404ed71 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:26.961471 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0d0c82f5-2869-4c61-b14a-e359a404ed71 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.278835 Sep 06 11:14:26.962428 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2461/4878] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:26 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:27.587164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1376822e-7c5f-4ca2-b716-b82c916a271c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:27.587801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1376822e-7c5f-4ca2-b716-b82c916a271c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:27.599963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1376822e-7c5f-4ca2-b716-b82c916a271c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:27.600808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1376822e-7c5f-4ca2-b716-b82c916a271c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:27.612775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1376822e-7c5f-4ca2-b716-b82c916a271c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:27.616730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1376822e-7c5f-4ca2-b716-b82c916a271c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:27.636077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1376822e-7c5f-4ca2-b716-b82c916a271c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:27.637319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1376822e-7c5f-4ca2-b716-b82c916a271c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:27.899819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-156b82e5-b0b8-4f57-9e7e-529ea908cb1f tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Action: 'create', calling method: .version_select at 0x7f90f8430790>, body: {"keypair": {"name": "tempest-keypair-2030923353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeSwV1g1zAypeoc9gvnIpDv90ots6spa6YvydeKASSqxaxDNX8hVU+HndnZCnbq17G6A1oBLIeT25ENXYnXSccikptzZinkXgNwqVIpZh8NBy+97IFyhkiRhs6x3fMhTg=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:27.928549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-156b82e5-b0b8-4f57-9e7e-529ea908cb1f tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Getting quotas for project 484053c22101496a920ce98bbc707f3d. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:14:27.939256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-156b82e5-b0b8-4f57-9e7e-529ea908cb1f tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Getting quotas for user a27aefd012a34168bf5e9e1b6d68195b and project 484053c22101496a920ce98bbc707f3d. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:14:27.995051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1376822e-7c5f-4ca2-b716-b82c916a271c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:28.003544 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1376822e-7c5f-4ca2-b716-b82c916a271c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1316 microversion: 2.1 time: 0.421170 Sep 06 11:14:28.021553 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2418/4879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:27 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:28.029343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-87214da8-31a5-4718-8dea-4d542f881256 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:28.030332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-87214da8-31a5-4718-8dea-4d542f881256 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:28.033303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:28.039145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87214da8-31a5-4718-8dea-4d542f881256 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:28.039737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87214da8-31a5-4718-8dea-4d542f881256 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:28.040385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87214da8-31a5-4718-8dea-4d542f881256 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:28.042249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87214da8-31a5-4718-8dea-4d542f881256 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:28.042910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87214da8-31a5-4718-8dea-4d542f881256 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:28.043559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87214da8-31a5-4718-8dea-4d542f881256 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:28.091530 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-156b82e5-b0b8-4f57-9e7e-529ea908cb1f tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.479587 Sep 06 11:14:28.092841 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2462/4880] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:14:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:28.408120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-87214da8-31a5-4718-8dea-4d542f881256 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:28.421595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-87214da8-31a5-4718-8dea-4d542f881256 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:28.423276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-87214da8-31a5-4718-8dea-4d542f881256 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:28.424819 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-87214da8-31a5-4718-8dea-4d542f881256 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.402202 Sep 06 11:14:28.425540 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2419/4881] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:28 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:28.689206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-ee13ff9d-769c-451f-84de-d6e13fc41371 req-4cb7d0f1-6f6e-4aad-9ff0-dd5321ed17a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "tag": "7632117e-275e-451b-973e-484d4cf38e3a"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:28.719417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ee13ff9d-769c-451f-84de-d6e13fc41371 req-4cb7d0f1-6f6e-4aad-9ff0-dd5321ed17a2 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:28.720851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ee13ff9d-769c-451f-84de-d6e13fc41371 req-4cb7d0f1-6f6e-4aad-9ff0-dd5321ed17a2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:28.722025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ee13ff9d-769c-451f-84de-d6e13fc41371 req-4cb7d0f1-6f6e-4aad-9ff0-dd5321ed17a2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:28.740006 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-ee13ff9d-769c-451f-84de-d6e13fc41371 req-4cb7d0f1-6f6e-4aad-9ff0-dd5321ed17a2 service nova] Creating event network-changed:7632117e-275e-451b-973e-484d4cf38e3a for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:14:28.748866 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-ee13ff9d-769c-451f-84de-d6e13fc41371 req-4cb7d0f1-6f6e-4aad-9ff0-dd5321ed17a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081173 Sep 06 11:14:28.750576 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2463/4882] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:29.027921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d182dccb-2f90-41fd-9f7a-7f5e5e897525 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:29.030072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d182dccb-2f90-41fd-9f7a-7f5e5e897525 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:29.043175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d182dccb-2f90-41fd-9f7a-7f5e5e897525 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:29.044100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d182dccb-2f90-41fd-9f7a-7f5e5e897525 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:29.044884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d182dccb-2f90-41fd-9f7a-7f5e5e897525 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:29.047591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d182dccb-2f90-41fd-9f7a-7f5e5e897525 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:29.049215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d182dccb-2f90-41fd-9f7a-7f5e5e897525 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:29.049949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d182dccb-2f90-41fd-9f7a-7f5e5e897525 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:29.169249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bffe0280-da24-4912-b9a2-a79923867a0b tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] Calling method '.version_select at 0x7f90f38bb550>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:29.263555 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bffe0280-da24-4912-b9a2-a79923867a0b tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/91c4e502-8673-46bd-8d12-3595c5eaddf7" status: 200 len: 343 microversion: 2.1 time: 0.097350 Sep 06 11:14:29.264496 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2464/4883] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:14:29 2022] GET /compute/v2.1/os-volumes/91c4e502-8673-46bd-8d12-3595c5eaddf7 => generated 343 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:14:29.340963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d182dccb-2f90-41fd-9f7a-7f5e5e897525 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:29.356609 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d182dccb-2f90-41fd-9f7a-7f5e5e897525 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1316 microversion: 2.1 time: 0.333839 Sep 06 11:14:29.358146 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2420/4884] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:29 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:29.453916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cab4a266-1ee7-4717-96d5-a8be70d36219 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:29.457026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cab4a266-1ee7-4717-96d5-a8be70d36219 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:29.487234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cab4a266-1ee7-4717-96d5-a8be70d36219 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:29.490015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cab4a266-1ee7-4717-96d5-a8be70d36219 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:29.492753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cab4a266-1ee7-4717-96d5-a8be70d36219 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:29.493613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cab4a266-1ee7-4717-96d5-a8be70d36219 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:29.494110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cab4a266-1ee7-4717-96d5-a8be70d36219 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:29.498181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cab4a266-1ee7-4717-96d5-a8be70d36219 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:30.017203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cab4a266-1ee7-4717-96d5-a8be70d36219 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:30.037403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cab4a266-1ee7-4717-96d5-a8be70d36219 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:30.039729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cab4a266-1ee7-4717-96d5-a8be70d36219 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:30.041278 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cab4a266-1ee7-4717-96d5-a8be70d36219 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.594374 Sep 06 11:14:30.056276 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2465/4885] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:29 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:30.385390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a347961-6359-4133-82fb-4a905b948730 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:30.386039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0a347961-6359-4133-82fb-4a905b948730 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:30.399677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a347961-6359-4133-82fb-4a905b948730 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:30.400592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a347961-6359-4133-82fb-4a905b948730 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:30.401352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a347961-6359-4133-82fb-4a905b948730 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:30.402159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a347961-6359-4133-82fb-4a905b948730 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:30.402551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a347961-6359-4133-82fb-4a905b948730 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:30.415647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a347961-6359-4133-82fb-4a905b948730 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:30.844184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-938574f4-0e83-4e2e-b63c-5312b7d88140 req-b7784c6b-6c5c-4f78-9209-63642589d6dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "tag": "721e119f-b9d6-46df-adc0-30d7ee803556"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:30.884328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-938574f4-0e83-4e2e-b63c-5312b7d88140 req-b7784c6b-6c5c-4f78-9209-63642589d6dc service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:30.885151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-938574f4-0e83-4e2e-b63c-5312b7d88140 req-b7784c6b-6c5c-4f78-9209-63642589d6dc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:30.885684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-938574f4-0e83-4e2e-b63c-5312b7d88140 req-b7784c6b-6c5c-4f78-9209-63642589d6dc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:30.914554 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-938574f4-0e83-4e2e-b63c-5312b7d88140 req-b7784c6b-6c5c-4f78-9209-63642589d6dc service nova] Creating event network-changed:721e119f-b9d6-46df-adc0-30d7ee803556 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:14:30.933504 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-938574f4-0e83-4e2e-b63c-5312b7d88140 req-b7784c6b-6c5c-4f78-9209-63642589d6dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094026 Sep 06 11:14:30.934799 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2466/4886] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:31.056247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0a347961-6359-4133-82fb-4a905b948730 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:31.066644 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0a347961-6359-4133-82fb-4a905b948730 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1316 microversion: 2.1 time: 0.685879 Sep 06 11:14:31.067281 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2421/4887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:30 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1316 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:31.088076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d1070b5b-0291-4a9d-b6af-eee8021c9d7c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:31.088814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d1070b5b-0291-4a9d-b6af-eee8021c9d7c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:31.107781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1070b5b-0291-4a9d-b6af-eee8021c9d7c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:31.114022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1070b5b-0291-4a9d-b6af-eee8021c9d7c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:31.114022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1070b5b-0291-4a9d-b6af-eee8021c9d7c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:31.114022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1070b5b-0291-4a9d-b6af-eee8021c9d7c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:31.114533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1070b5b-0291-4a9d-b6af-eee8021c9d7c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:31.114886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1070b5b-0291-4a9d-b6af-eee8021c9d7c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:31.482009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d1070b5b-0291-4a9d-b6af-eee8021c9d7c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:31.502913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d1070b5b-0291-4a9d-b6af-eee8021c9d7c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:31.506938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d1070b5b-0291-4a9d-b6af-eee8021c9d7c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:31.509863 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d1070b5b-0291-4a9d-b6af-eee8021c9d7c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.443187 Sep 06 11:14:31.511255 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2467/4888] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:31 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:32.095392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-335ef403-229a-4f17-a59d-1f1899f536ba tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:32.096160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-335ef403-229a-4f17-a59d-1f1899f536ba tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:32.107340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-335ef403-229a-4f17-a59d-1f1899f536ba tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:32.110222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-335ef403-229a-4f17-a59d-1f1899f536ba tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:32.110222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-335ef403-229a-4f17-a59d-1f1899f536ba tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:32.111371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-335ef403-229a-4f17-a59d-1f1899f536ba tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:32.112247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-335ef403-229a-4f17-a59d-1f1899f536ba tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:32.113025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-335ef403-229a-4f17-a59d-1f1899f536ba tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:32.319853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-33629c45-b519-414f-9f8d-269036ea64c6 req-ac35b3f8-fbd3-43e9-b7e1-770e557ab8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4d2b81-c9f2-479d-94c5-c637fe0e9360", "name": "network-vif-plugged", "status": "completed", "tag": "a7cddaca-ffbd-401e-b5dc-d705ed80ebb3"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:32.341362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-33629c45-b519-414f-9f8d-269036ea64c6 req-ac35b3f8-fbd3-43e9-b7e1-770e557ab8a5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:32.341900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-33629c45-b519-414f-9f8d-269036ea64c6 req-ac35b3f8-fbd3-43e9-b7e1-770e557ab8a5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:32.342353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-33629c45-b519-414f-9f8d-269036ea64c6 req-ac35b3f8-fbd3-43e9-b7e1-770e557ab8a5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:32.368208 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-33629c45-b519-414f-9f8d-269036ea64c6 req-ac35b3f8-fbd3-43e9-b7e1-770e557ab8a5 service nova] Creating event network-vif-plugged:a7cddaca-ffbd-401e-b5dc-d705ed80ebb3 for instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 on nch1-master-1 Sep 06 11:14:32.375220 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-33629c45-b519-414f-9f8d-269036ea64c6 req-ac35b3f8-fbd3-43e9-b7e1-770e557ab8a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059284 Sep 06 11:14:32.376566 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2468/4889] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:14:32.396376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8366d5f0-dc06-4ee7-b148-c02f3d55fbff tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] Calling method '.version_select at 0x7f90f85b80d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:32.462934 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8366d5f0-dc06-4ee7-b148-c02f3d55fbff tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/30935d4c-75ad-4523-8d7b-f3af40c1d91e" status: 200 len: 344 microversion: 2.1 time: 0.072021 Sep 06 11:14:32.473200 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2469/4890] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:14:32 2022] GET /compute/v2.1/os-volumes/30935d4c-75ad-4523-8d7b-f3af40c1d91e => generated 344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:14:32.548581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e3192306-9e95-4678-bb78-450ad8873bd7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:32.549385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e3192306-9e95-4678-bb78-450ad8873bd7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:32.555293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-335ef403-229a-4f17-a59d-1f1899f536ba tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:32.562642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3192306-9e95-4678-bb78-450ad8873bd7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:32.566351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3192306-9e95-4678-bb78-450ad8873bd7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:32.567717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3192306-9e95-4678-bb78-450ad8873bd7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:32.568709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3192306-9e95-4678-bb78-450ad8873bd7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:32.571568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3192306-9e95-4678-bb78-450ad8873bd7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:32.571568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e3192306-9e95-4678-bb78-450ad8873bd7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:32.574069 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-335ef403-229a-4f17-a59d-1f1899f536ba tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1316 microversion: 2.1 time: 0.484328 Sep 06 11:14:32.578966 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2422/4891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:32 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1316 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:32.838536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e3192306-9e95-4678-bb78-450ad8873bd7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:32.849508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e3192306-9e95-4678-bb78-450ad8873bd7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:32.851111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e3192306-9e95-4678-bb78-450ad8873bd7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:32.856668 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e3192306-9e95-4678-bb78-450ad8873bd7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.309903 Sep 06 11:14:32.856668 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2470/4892] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:32 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:33.614199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-42846e4f-4345-4277-a01f-1b66a11fff7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:33.615646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-42846e4f-4345-4277-a01f-1b66a11fff7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:33.636577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42846e4f-4345-4277-a01f-1b66a11fff7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:33.636577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42846e4f-4345-4277-a01f-1b66a11fff7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:33.636577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42846e4f-4345-4277-a01f-1b66a11fff7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:33.637011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42846e4f-4345-4277-a01f-1b66a11fff7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:33.637649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42846e4f-4345-4277-a01f-1b66a11fff7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:33.638268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42846e4f-4345-4277-a01f-1b66a11fff7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:33.887698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8f0e8141-e894-45b0-95ba-14e191fd6ac2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:33.888943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8f0e8141-e894-45b0-95ba-14e191fd6ac2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:33.903123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f0e8141-e894-45b0-95ba-14e191fd6ac2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:33.903923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f0e8141-e894-45b0-95ba-14e191fd6ac2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:33.907818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f0e8141-e894-45b0-95ba-14e191fd6ac2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:33.910797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f0e8141-e894-45b0-95ba-14e191fd6ac2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:33.913069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f0e8141-e894-45b0-95ba-14e191fd6ac2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:33.914114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f0e8141-e894-45b0-95ba-14e191fd6ac2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:34.570252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-42846e4f-4345-4277-a01f-1b66a11fff7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:34.583514 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-42846e4f-4345-4277-a01f-1b66a11fff7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1316 microversion: 2.1 time: 0.972629 Sep 06 11:14:34.591945 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2423/4893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:33 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1316 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:34.598617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-804811617", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c9399070-01d2-49e9-b96c-d11f798855b8"}], "security_groups": [{"name": "tempest-securitygroup--921178676"}], "key_name": "tempest-keypair-2030923353", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:34.632462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8f0e8141-e894-45b0-95ba-14e191fd6ac2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:34.650172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8f0e8141-e894-45b0-95ba-14e191fd6ac2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:34.651806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8f0e8141-e894-45b0-95ba-14e191fd6ac2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:34.653276 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8f0e8141-e894-45b0-95ba-14e191fd6ac2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.776831 Sep 06 11:14:34.654563 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2471/4894] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:33 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:34.853535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] validate_networks() for [('c9399070-01d2-49e9-b96c-d11f798855b8', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:14:35.408705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c5ce94ea-36d3-402e-bb35-766982a1402f tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] Calling method '.version_select at 0x7f90f38bbb80>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:35.480414 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c5ce94ea-36d3-402e-bb35-766982a1402f tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab" status: 200 len: 343 microversion: 2.1 time: 0.074209 Sep 06 11:14:35.496009 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2472/4895] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:14:35 2022] GET /compute/v2.1/os-volumes/7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab => generated 343 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:14:35.507942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-22d4b3cb-81ae-4672-a98d-b5473fe1c9de tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] Calling method '.version_select at 0x7f90fd10c790>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:35.718501 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-22d4b3cb-81ae-4672-a98d-b5473fe1c9de tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.217648 Sep 06 11:14:35.720048 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2473/4896] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Sep 6 11:14:35 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:35.725985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-320c0132-d060-4f7e-b113-a8cdb53f32fe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:35.726920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-320c0132-d060-4f7e-b113-a8cdb53f32fe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:35.733526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:35.737726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-320c0132-d060-4f7e-b113-a8cdb53f32fe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:35.738587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-320c0132-d060-4f7e-b113-a8cdb53f32fe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:35.739238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-320c0132-d060-4f7e-b113-a8cdb53f32fe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:35.740393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-320c0132-d060-4f7e-b113-a8cdb53f32fe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:35.741030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-320c0132-d060-4f7e-b113-a8cdb53f32fe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:35.741660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-320c0132-d060-4f7e-b113-a8cdb53f32fe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:35.957710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Getting quotas for project 484053c22101496a920ce98bbc707f3d. Resources: dict_keys(['metadata_items']) {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:14:35.964968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Getting quotas for user a27aefd012a34168bf5e9e1b6d68195b and project 484053c22101496a920ce98bbc707f3d. Resources: dict_keys(['metadata_items']) {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:14:35.983328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:14:35.983763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:14:35.984276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:14:35.984688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:14:35.985109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:14:35.995084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:35.995578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:35.996207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:35.997311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:35.998150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:35.999730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:36.030269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-320c0132-d060-4f7e-b113-a8cdb53f32fe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:36.039264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Getting quotas for project 484053c22101496a920ce98bbc707f3d. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:14:36.040059 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-320c0132-d060-4f7e-b113-a8cdb53f32fe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1503 microversion: 2.1 time: 0.317242 Sep 06 11:14:36.044397 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2474/4897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:35 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1503 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:36.052661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f38551a-117e-4ceb-a806-6d564a871139 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:36.053285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7f38551a-117e-4ceb-a806-6d564a871139 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:36.059848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f38551a-117e-4ceb-a806-6d564a871139 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:36.060540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f38551a-117e-4ceb-a806-6d564a871139 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:36.061573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f38551a-117e-4ceb-a806-6d564a871139 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:36.062728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f38551a-117e-4ceb-a806-6d564a871139 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:36.063384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f38551a-117e-4ceb-a806-6d564a871139 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:36.064048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f38551a-117e-4ceb-a806-6d564a871139 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:36.065356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Getting quotas for user a27aefd012a34168bf5e9e1b6d68195b and project 484053c22101496a920ce98bbc707f3d. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:14:36.100785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:14:36.105720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:14:36.351407 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-39e4f06d-d6b8-4fe5-9226-af4d6178a53a tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.761549 Sep 06 11:14:36.351407 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2424/4898] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:14:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:14:36.357202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b739e228-cd54-4be3-bf57-10ecc612115a tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] Calling method '.version_select at 0x7f90f3757820>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:36.462133 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b739e228-cd54-4be3-bf57-10ecc612115a tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.111914 Sep 06 11:14:36.463102 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2425/4899] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 11:14:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:36.468304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-81fc1625-3bcd-446d-8a96-fd0229df8ce0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:36.469029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-81fc1625-3bcd-446d-8a96-fd0229df8ce0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:36.477735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81fc1625-3bcd-446d-8a96-fd0229df8ce0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:36.478239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81fc1625-3bcd-446d-8a96-fd0229df8ce0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:36.478695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81fc1625-3bcd-446d-8a96-fd0229df8ce0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:36.479448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81fc1625-3bcd-446d-8a96-fd0229df8ce0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:36.480218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81fc1625-3bcd-446d-8a96-fd0229df8ce0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:36.480596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81fc1625-3bcd-446d-8a96-fd0229df8ce0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:36.522262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f38551a-117e-4ceb-a806-6d564a871139 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:36.541683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f38551a-117e-4ceb-a806-6d564a871139 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:36.545478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f38551a-117e-4ceb-a806-6d564a871139 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:36.555616 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7f38551a-117e-4ceb-a806-6d564a871139 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.509938 Sep 06 11:14:36.559997 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2475/4900] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:36 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:36.578689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-81fc1625-3bcd-446d-8a96-fd0229df8ce0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:14:36.580341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3644fea6-a82c-4db0-8564-ee10a53c41a3 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:36.583755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3644fea6-a82c-4db0-8564-ee10a53c41a3 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:36.630714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:36.720921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3644fea6-a82c-4db0-8564-ee10a53c41a3 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:36.733073 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3644fea6-a82c-4db0-8564-ee10a53c41a3 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1277 microversion: 2.1 time: 0.168846 Sep 06 11:14:36.734375 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2476/4901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:36 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:36.742638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-42c14bbc-e89d-43e1-a050-567263f20baa tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] Calling method '.version_select at 0x7f90fcf794c0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:36.849910 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-42c14bbc-e89d-43e1-a050-567263f20baa tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.112804 Sep 06 11:14:36.850523 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2477/4902] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Sep 6 11:14:36 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:36.864365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f875667d-bafa-4214-a2de-73459c9b1254 tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] Calling method '.version_select at 0x7f90f38208b0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:37.077334 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f875667d-bafa-4214-a2de-73459c9b1254 tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.216854 Sep 06 11:14:37.077958 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2478/4903] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Sep 6 11:14:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:14:37.085318 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-81fc1625-3bcd-446d-8a96-fd0229df8ce0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 204 len: 0 microversion: 2.1 time: 0.620201 Sep 06 11:14:37.087862 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2426/4904] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:14:36 2022] DELETE /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:14:37.108009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9f608ca3-3c02-4763-972b-5b833c1a41e7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:37.112522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9f608ca3-3c02-4763-972b-5b833c1a41e7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:37.125758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a90aa91f-24c1-46f3-909f-ce7b20419710 tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] Calling method '.version_select at 0x7f90f32c8f70>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:37.131732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f608ca3-3c02-4763-972b-5b833c1a41e7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:37.133594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f608ca3-3c02-4763-972b-5b833c1a41e7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:37.137213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f608ca3-3c02-4763-972b-5b833c1a41e7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:37.138113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f608ca3-3c02-4763-972b-5b833c1a41e7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:37.138694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f608ca3-3c02-4763-972b-5b833c1a41e7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:37.140747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f608ca3-3c02-4763-972b-5b833c1a41e7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:37.309931 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a90aa91f-24c1-46f3-909f-ce7b20419710 tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.199977 Sep 06 11:14:37.310619 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2427/4905] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Sep 6 11:14:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:37.326181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f5044c37-cf2c-4f26-93ba-e931b679476f tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] Calling method '.version_select at 0x7f90f32d50d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:37.472804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9f608ca3-3c02-4763-972b-5b833c1a41e7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:37.482841 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f5044c37-cf2c-4f26-93ba-e931b679476f tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.161265 Sep 06 11:14:37.484786 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2428/4906] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 11:14:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:37.491585 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9f608ca3-3c02-4763-972b-5b833c1a41e7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1509 microversion: 2.1 time: 0.397730 Sep 06 11:14:37.509945 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2479/4907] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:37 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1509 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:37.510171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-603640d6-574d-4124-8b4b-f5e2e41012eb tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] Calling method '.version_select at 0x7f90f32d5820>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:37.592974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-64add404-9676-454c-9e3f-9819752eed17 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:37.593647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-64add404-9676-454c-9e3f-9819752eed17 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:37.604981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64add404-9676-454c-9e3f-9819752eed17 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:37.605561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64add404-9676-454c-9e3f-9819752eed17 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:37.606294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64add404-9676-454c-9e3f-9819752eed17 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:37.607128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64add404-9676-454c-9e3f-9819752eed17 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:37.607658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64add404-9676-454c-9e3f-9819752eed17 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:37.608143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64add404-9676-454c-9e3f-9819752eed17 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:37.657740 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-603640d6-574d-4124-8b4b-f5e2e41012eb tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.152429 Sep 06 11:14:37.658527 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2429/4908] 10.222.0.20 () {58 vars in 1188 bytes} [Tue Sep 6 11:14:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:14:37.681151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-880c569d-603d-452a-adc8-5806cdda9d5b tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] Calling method '.version_select at 0x7f90f32c8280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:37.886758 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-880c569d-603d-452a-adc8-5806cdda9d5b tempest-VolumesTestJSON-1367246480 tempest-VolumesTestJSON-1367246480-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.202089 Sep 06 11:14:37.888457 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2430/4909] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 11:14:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:14:37.908097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e0f22aa6-e57f-4157-9b01-d16bda22d8a9 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:37.919935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e0f22aa6-e57f-4157-9b01-d16bda22d8a9 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:38.017856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e0f22aa6-e57f-4157-9b01-d16bda22d8a9 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:38.036272 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e0f22aa6-e57f-4157-9b01-d16bda22d8a9 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1277 microversion: 2.1 time: 0.146243 Sep 06 11:14:38.038618 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2431/4910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:37 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:38.054271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-64add404-9676-454c-9e3f-9819752eed17 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:38.065025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-64add404-9676-454c-9e3f-9819752eed17 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:38.067187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-64add404-9676-454c-9e3f-9819752eed17 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:38.068597 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-64add404-9676-454c-9e3f-9819752eed17 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.483090 Sep 06 11:14:38.069771 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2480/4911] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:37 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:38.520073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-002fa57e-169c-4381-802a-e31bbfc184fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:38.522139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-002fa57e-169c-4381-802a-e31bbfc184fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:38.532362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-002fa57e-169c-4381-802a-e31bbfc184fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:38.533145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-002fa57e-169c-4381-802a-e31bbfc184fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:38.533857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-002fa57e-169c-4381-802a-e31bbfc184fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:38.534822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-002fa57e-169c-4381-802a-e31bbfc184fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:38.535534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-002fa57e-169c-4381-802a-e31bbfc184fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:38.536172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-002fa57e-169c-4381-802a-e31bbfc184fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:38.894358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-002fa57e-169c-4381-802a-e31bbfc184fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:38.906414 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-002fa57e-169c-4381-802a-e31bbfc184fa tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1509 microversion: 2.1 time: 0.393020 Sep 06 11:14:38.908998 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2432/4912] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:38 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:39.063001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1fb38c21-b6ac-49ce-a550-77cdabb10ad6 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:39.065138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1fb38c21-b6ac-49ce-a550-77cdabb10ad6 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:39.082038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fb38c21-b6ac-49ce-a550-77cdabb10ad6 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:39.105669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fb38c21-b6ac-49ce-a550-77cdabb10ad6 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:39.105669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fb38c21-b6ac-49ce-a550-77cdabb10ad6 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:39.105669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fb38c21-b6ac-49ce-a550-77cdabb10ad6 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:39.105669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fb38c21-b6ac-49ce-a550-77cdabb10ad6 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:39.105669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fb38c21-b6ac-49ce-a550-77cdabb10ad6 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:39.106311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5d58e6ae-5844-4ac6-aa61-1cd7568a18fe tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:39.106311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5d58e6ae-5844-4ac6-aa61-1cd7568a18fe tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:39.130279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d58e6ae-5844-4ac6-aa61-1cd7568a18fe tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:39.132555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d58e6ae-5844-4ac6-aa61-1cd7568a18fe tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:39.133445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d58e6ae-5844-4ac6-aa61-1cd7568a18fe tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:39.134531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d58e6ae-5844-4ac6-aa61-1cd7568a18fe tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:39.135397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d58e6ae-5844-4ac6-aa61-1cd7568a18fe tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:39.136433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d58e6ae-5844-4ac6-aa61-1cd7568a18fe tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:39.262681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1fb38c21-b6ac-49ce-a550-77cdabb10ad6 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:39.280179 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1fb38c21-b6ac-49ce-a550-77cdabb10ad6 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1273 microversion: 2.1 time: 0.224210 Sep 06 11:14:39.281304 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2481/4913] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:39 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:39.474285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5d58e6ae-5844-4ac6-aa61-1cd7568a18fe tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:39.489991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5d58e6ae-5844-4ac6-aa61-1cd7568a18fe tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:39.491871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5d58e6ae-5844-4ac6-aa61-1cd7568a18fe tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:39.493089 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5d58e6ae-5844-4ac6-aa61-1cd7568a18fe tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.400897 Sep 06 11:14:39.493664 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2433/4914] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:39 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:39.952500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4999a8f6-3bf2-46db-97b9-672cf26ad820 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:39.953064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4999a8f6-3bf2-46db-97b9-672cf26ad820 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:39.964829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4999a8f6-3bf2-46db-97b9-672cf26ad820 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:39.965656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4999a8f6-3bf2-46db-97b9-672cf26ad820 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:39.966343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4999a8f6-3bf2-46db-97b9-672cf26ad820 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:39.972845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4999a8f6-3bf2-46db-97b9-672cf26ad820 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:39.973867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4999a8f6-3bf2-46db-97b9-672cf26ad820 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:39.974551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4999a8f6-3bf2-46db-97b9-672cf26ad820 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:40.310487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0305f3ad-e0a0-445e-a41b-8a138ee5581c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:40.310961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0305f3ad-e0a0-445e-a41b-8a138ee5581c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:40.322464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0305f3ad-e0a0-445e-a41b-8a138ee5581c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:40.322990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0305f3ad-e0a0-445e-a41b-8a138ee5581c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:40.328120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0305f3ad-e0a0-445e-a41b-8a138ee5581c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:40.332603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0305f3ad-e0a0-445e-a41b-8a138ee5581c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:40.332603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0305f3ad-e0a0-445e-a41b-8a138ee5581c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:40.332603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0305f3ad-e0a0-445e-a41b-8a138ee5581c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:40.573511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4999a8f6-3bf2-46db-97b9-672cf26ad820 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:40.583161 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4999a8f6-3bf2-46db-97b9-672cf26ad820 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1467 microversion: 2.1 time: 0.635465 Sep 06 11:14:40.583764 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2482/4915] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:39 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1467 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:40.588850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-6b0a93da-ac2c-41e5-8281-7374f32a2bac req-568a8fc0-5f8f-4b4e-8c6e-afea92004670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4d2b81-c9f2-479d-94c5-c637fe0e9360", "name": "network-vif-deleted", "tag": "a7cddaca-ffbd-401e-b5dc-d705ed80ebb3"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:40.602455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6b0a93da-ac2c-41e5-8281-7374f32a2bac req-568a8fc0-5f8f-4b4e-8c6e-afea92004670 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:40.603112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6b0a93da-ac2c-41e5-8281-7374f32a2bac req-568a8fc0-5f8f-4b4e-8c6e-afea92004670 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:40.603565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6b0a93da-ac2c-41e5-8281-7374f32a2bac req-568a8fc0-5f8f-4b4e-8c6e-afea92004670 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:40.620432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0305f3ad-e0a0-445e-a41b-8a138ee5581c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:40.652321 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0305f3ad-e0a0-445e-a41b-8a138ee5581c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1337 microversion: 2.1 time: 0.330585 Sep 06 11:14:40.652321 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2434/4916] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:40 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1337 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:14:40.654689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2924cda8-9a3d-446f-91ea-2cd0bf24cd0a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:40.655557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2924cda8-9a3d-446f-91ea-2cd0bf24cd0a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:40.657128 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-6b0a93da-ac2c-41e5-8281-7374f32a2bac req-568a8fc0-5f8f-4b4e-8c6e-afea92004670 service nova] Creating event network-vif-deleted:a7cddaca-ffbd-401e-b5dc-d705ed80ebb3 for instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 on nch1-master-1 Sep 06 11:14:40.668562 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-6b0a93da-ac2c-41e5-8281-7374f32a2bac req-568a8fc0-5f8f-4b4e-8c6e-afea92004670 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082862 Sep 06 11:14:40.669644 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2483/4917] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:40.679044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2924cda8-9a3d-446f-91ea-2cd0bf24cd0a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:40.679569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2924cda8-9a3d-446f-91ea-2cd0bf24cd0a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:40.682566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2924cda8-9a3d-446f-91ea-2cd0bf24cd0a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:40.682566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2924cda8-9a3d-446f-91ea-2cd0bf24cd0a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:40.682566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2924cda8-9a3d-446f-91ea-2cd0bf24cd0a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:40.689006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2924cda8-9a3d-446f-91ea-2cd0bf24cd0a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:41.238824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2924cda8-9a3d-446f-91ea-2cd0bf24cd0a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:41.257580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2924cda8-9a3d-446f-91ea-2cd0bf24cd0a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:41.260958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2924cda8-9a3d-446f-91ea-2cd0bf24cd0a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:41.275137 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2924cda8-9a3d-446f-91ea-2cd0bf24cd0a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.620001 Sep 06 11:14:41.280514 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2435/4918] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:40 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:41.609209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:41.610638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:41.618579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:41.619117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:41.619556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:41.620273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:41.622025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:41.622025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:41.660988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-85d12ef5-1c1f-4d12-83bc-7241198bbf7c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:41.662275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-85d12ef5-1c1f-4d12-83bc-7241198bbf7c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:41.665554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:41.666240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:41.666804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:41.667677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lazy-loading 'fault' on Instance uuid ac4d2b81-c9f2-479d-94c5-c637fe0e9360 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:14:41.680806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85d12ef5-1c1f-4d12-83bc-7241198bbf7c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:41.682678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85d12ef5-1c1f-4d12-83bc-7241198bbf7c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:41.683481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85d12ef5-1c1f-4d12-83bc-7241198bbf7c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:41.684256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85d12ef5-1c1f-4d12-83bc-7241198bbf7c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:41.684795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85d12ef5-1c1f-4d12-83bc-7241198bbf7c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:41.685514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85d12ef5-1c1f-4d12-83bc-7241198bbf7c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:41.748378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:41.762124 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-55f0fc56-ff84-4e08-9ac8-ebf03e8f1d20 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 200 len: 1306 microversion: 2.1 time: 0.158666 Sep 06 11:14:41.763687 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2484/4919] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:41 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 1306 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:41.821273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-85d12ef5-1c1f-4d12-83bc-7241198bbf7c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:41.833347 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-85d12ef5-1c1f-4d12-83bc-7241198bbf7c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1335 microversion: 2.1 time: 0.177945 Sep 06 11:14:41.835785 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2436/4920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:41 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1335 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:14:42.324503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f71d9cd4-d1cc-4bf3-abe3-41f9ca103568 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:42.340512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f71d9cd4-d1cc-4bf3-abe3-41f9ca103568 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:42.365442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f71d9cd4-d1cc-4bf3-abe3-41f9ca103568 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:42.368110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f71d9cd4-d1cc-4bf3-abe3-41f9ca103568 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:42.368110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f71d9cd4-d1cc-4bf3-abe3-41f9ca103568 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:42.368110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f71d9cd4-d1cc-4bf3-abe3-41f9ca103568 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:42.370548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f71d9cd4-d1cc-4bf3-abe3-41f9ca103568 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:42.372867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f71d9cd4-d1cc-4bf3-abe3-41f9ca103568 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:42.405394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:42.786753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-96e44b70-6aa9-41df-89bb-e0673c9aa063 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:42.788493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-96e44b70-6aa9-41df-89bb-e0673c9aa063 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:42.803327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96e44b70-6aa9-41df-89bb-e0673c9aa063 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:42.805664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96e44b70-6aa9-41df-89bb-e0673c9aa063 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:42.808722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96e44b70-6aa9-41df-89bb-e0673c9aa063 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:42.809715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96e44b70-6aa9-41df-89bb-e0673c9aa063 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:42.810430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96e44b70-6aa9-41df-89bb-e0673c9aa063 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:42.811110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96e44b70-6aa9-41df-89bb-e0673c9aa063 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:42.819443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f71d9cd4-d1cc-4bf3-abe3-41f9ca103568 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:42.856435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f71d9cd4-d1cc-4bf3-abe3-41f9ca103568 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:42.856435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f71d9cd4-d1cc-4bf3-abe3-41f9ca103568 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:42.863799 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-96e44b70-6aa9-41df-89bb-e0673c9aa063 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:14:42.867906 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f71d9cd4-d1cc-4bf3-abe3-41f9ca103568 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.563951 Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-96e44b70-6aa9-41df-89bb-e0673c9aa063 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 HTTP/1.1 Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'ac4d2b81-c9f2-479d-94c5-c637fe0e9360'} Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:42.869000 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:42.873325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:42.873325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:42.873325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:42.873325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:14:42.873325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:14:42.873325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:14:42.873325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:42.875425 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2485/4921] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:42 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:42.880228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-96e44b70-6aa9-41df-89bb-e0673c9aa063 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:14:42.881712 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-96e44b70-6aa9-41df-89bb-e0673c9aa063 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 404 len: 111 microversion: 2.1 time: 0.099992 Sep 06 11:14:42.890332 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2437/4922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:42 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:14:42.897072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-2109590568", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "718863d7-44a8-405b-bbe1-2723e54143ea"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1025210331", "security_groups": []}, "os:scheduler_hints": {"different_host": ["3ddbde28-f59b-4bdd-82a7-6dfc37a97585"]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:42.905090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6669dfc9-cd5a-4fc6-bd8a-c4ff05a63b18 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:42.906089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6669dfc9-cd5a-4fc6-bd8a-c4ff05a63b18 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:42.920671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6669dfc9-cd5a-4fc6-bd8a-c4ff05a63b18 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:42.923482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6669dfc9-cd5a-4fc6-bd8a-c4ff05a63b18 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:42.924300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6669dfc9-cd5a-4fc6-bd8a-c4ff05a63b18 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:42.925357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6669dfc9-cd5a-4fc6-bd8a-c4ff05a63b18 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:42.926845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6669dfc9-cd5a-4fc6-bd8a-c4ff05a63b18 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:42.928453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6669dfc9-cd5a-4fc6-bd8a-c4ff05a63b18 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:43.005287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] validate_networks() for [('718863d7-44a8-405b-bbe1-2723e54143ea', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:14:43.391165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6669dfc9-cd5a-4fc6-bd8a-c4ff05a63b18 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:43.406529 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6669dfc9-cd5a-4fc6-bd8a-c4ff05a63b18 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1402 microversion: 2.1 time: 0.512768 Sep 06 11:14:43.408903 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2438/4923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:42 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1402 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:43.417056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-29850821-84e3-4029-9e99-8f2f6928e259 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:43.418156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-29850821-84e3-4029-9e99-8f2f6928e259 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:43.426442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29850821-84e3-4029-9e99-8f2f6928e259 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:43.427275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29850821-84e3-4029-9e99-8f2f6928e259 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:43.427909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29850821-84e3-4029-9e99-8f2f6928e259 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:43.428824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29850821-84e3-4029-9e99-8f2f6928e259 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:43.429457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29850821-84e3-4029-9e99-8f2f6928e259 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:43.430130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29850821-84e3-4029-9e99-8f2f6928e259 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:43.684347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-29850821-84e3-4029-9e99-8f2f6928e259 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:43.726132 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-29850821-84e3-4029-9e99-8f2f6928e259 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.313698 Sep 06 11:14:43.726132 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2439/4924] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:43 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:43.873885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:14:43.876190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:14:43.876999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:14:43.877679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:14:43.878375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:14:43.896494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:43.898927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:43.901392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:43.902143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cad9a484-affe-4387-88d9-d8ce58c3daf6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:43.902775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cad9a484-affe-4387-88d9-d8ce58c3daf6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:43.907301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:43.908159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:43.908875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:43.928444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cad9a484-affe-4387-88d9-d8ce58c3daf6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:43.929034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cad9a484-affe-4387-88d9-d8ce58c3daf6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:43.929656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cad9a484-affe-4387-88d9-d8ce58c3daf6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:43.930490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cad9a484-affe-4387-88d9-d8ce58c3daf6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:43.931336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cad9a484-affe-4387-88d9-d8ce58c3daf6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:43.931962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cad9a484-affe-4387-88d9-d8ce58c3daf6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:43.968094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Getting quotas for project deb7f753413a467fb1c86f7463b12563. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:14:43.978630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Getting quotas for user 9d49264c495645f38d17ceb03a43195f and project deb7f753413a467fb1c86f7463b12563. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:14:43.997941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:14:44.001573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:14:44.219461 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b203982f-1c61-42ca-9607-ce22690fffcc tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.342277 Sep 06 11:14:44.230152 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2486/4925] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:14:42 2022] POST /compute/v2.1/servers => generated 361 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:14:44.244257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b0865a48-ebd4-4b4b-9151-aea37a9a2576 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b0865a48-ebd4-4b4b-9151-aea37a9a2576 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 163 Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": 12345, "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'networks': [{'uuid': 'b9ea5ffd-3051-44b1-b178-c09345529f6f'}]}}} Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 12345 Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:14:44.254521 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:14:44.262728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:14:44.262728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 06 11:14:44.262728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:44.262728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:44.262728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:44.262728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:44.262728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:44.262728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:44.262728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:14:44.262728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:14:44.262728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 06 11:14:44.262728 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:44.268462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b0865a48-ebd4-4b4b-9151-aea37a9a2576 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:14:44.270510 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b0865a48-ebd4-4b4b-9151-aea37a9a2576 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.032201 Sep 06 11:14:44.272232 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2487/4926] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:14:44 2022] POST /compute/v2.1/servers => generated 127 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:14:44.279910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d945a9f1-bca3-4259-a4a0-b7453a8c97ee tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:44.281622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d945a9f1-bca3-4259-a4a0-b7453a8c97ee tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:44.407329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d945a9f1-bca3-4259-a4a0-b7453a8c97ee tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:44.418625 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d945a9f1-bca3-4259-a4a0-b7453a8c97ee tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1242 microversion: 2.1 time: 0.142939 Sep 06 11:14:44.431658 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2488/4927] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:44 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:44.434017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cad9a484-affe-4387-88d9-d8ce58c3daf6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:44.445409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1b411404-6fcf-4c1d-a425-2a9d0ed5c09e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:44.447631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1b411404-6fcf-4c1d-a425-2a9d0ed5c09e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:44.461418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b411404-6fcf-4c1d-a425-2a9d0ed5c09e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:44.463358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b411404-6fcf-4c1d-a425-2a9d0ed5c09e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:44.463810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b411404-6fcf-4c1d-a425-2a9d0ed5c09e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:44.464641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b411404-6fcf-4c1d-a425-2a9d0ed5c09e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:44.466592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b411404-6fcf-4c1d-a425-2a9d0ed5c09e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:44.467122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b411404-6fcf-4c1d-a425-2a9d0ed5c09e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:44.470838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cad9a484-affe-4387-88d9-d8ce58c3daf6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:44.475996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cad9a484-affe-4387-88d9-d8ce58c3daf6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:44.482595 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cad9a484-affe-4387-88d9-d8ce58c3daf6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.584752 Sep 06 11:14:44.503552 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2440/4928] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:43 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:44.503552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6e4c390f-f988-41b3-9a36-4eefa186d880 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:44.503552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6e4c390f-f988-41b3-9a36-4eefa186d880 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:44.526105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e4c390f-f988-41b3-9a36-4eefa186d880 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:44.526105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e4c390f-f988-41b3-9a36-4eefa186d880 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:44.533957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e4c390f-f988-41b3-9a36-4eefa186d880 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:44.534859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e4c390f-f988-41b3-9a36-4eefa186d880 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:44.535381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e4c390f-f988-41b3-9a36-4eefa186d880 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:44.535842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e4c390f-f988-41b3-9a36-4eefa186d880 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:44.945331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6e4c390f-f988-41b3-9a36-4eefa186d880 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:44.959601 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6e4c390f-f988-41b3-9a36-4eefa186d880 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1402 microversion: 2.1 time: 0.468494 Sep 06 11:14:44.959977 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2441/4929] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:44 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1402 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:44.979495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1b411404-6fcf-4c1d-a425-2a9d0ed5c09e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:44.988571 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1b411404-6fcf-4c1d-a425-2a9d0ed5c09e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.555701 Sep 06 11:14:44.989161 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2489/4930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:44 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:45.016703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-829abb84-516a-4485-86ed-e6bee20f8973 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:45.017351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-829abb84-516a-4485-86ed-e6bee20f8973 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:45.043983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-1bad4492-43df-437b-96d6-523d48b61288 req-a0d36f82-8afe-4cad-a175-2af856a55df6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f2b78dd-5a82-441b-9a8c-ed1e9049e250", "tag": "ed0e7e9c-5a2d-405e-941e-e3ceaf03d879"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:45.056719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1bad4492-43df-437b-96d6-523d48b61288 req-a0d36f82-8afe-4cad-a175-2af856a55df6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:45.057122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1bad4492-43df-437b-96d6-523d48b61288 req-a0d36f82-8afe-4cad-a175-2af856a55df6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:45.057576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1bad4492-43df-437b-96d6-523d48b61288 req-a0d36f82-8afe-4cad-a175-2af856a55df6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:45.064734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-829abb84-516a-4485-86ed-e6bee20f8973 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:45.070547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-829abb84-516a-4485-86ed-e6bee20f8973 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:45.074593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-829abb84-516a-4485-86ed-e6bee20f8973 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:45.075505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-829abb84-516a-4485-86ed-e6bee20f8973 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:45.077421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-829abb84-516a-4485-86ed-e6bee20f8973 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:45.077927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-829abb84-516a-4485-86ed-e6bee20f8973 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:45.090560 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-1bad4492-43df-437b-96d6-523d48b61288 req-a0d36f82-8afe-4cad-a175-2af856a55df6 service nova] Creating event network-changed:ed0e7e9c-5a2d-405e-941e-e3ceaf03d879 for instance 6f2b78dd-5a82-441b-9a8c-ed1e9049e250 on nch1-master-1 Sep 06 11:14:45.098839 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-1bad4492-43df-437b-96d6-523d48b61288 req-a0d36f82-8afe-4cad-a175-2af856a55df6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058530 Sep 06 11:14:45.100000 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2490/4931] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:14:45.450264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6648ce40-9b84-4399-a0ca-e93bedaa0017 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:45.451303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6648ce40-9b84-4399-a0ca-e93bedaa0017 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:45.842317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-829abb84-516a-4485-86ed-e6bee20f8973 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:45.891409 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-829abb84-516a-4485-86ed-e6bee20f8973 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.878742 Sep 06 11:14:45.892036 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2442/4932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:45 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:45.901991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d3f12375-b905-4752-bb82-e18521c86a63 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:45.902748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d3f12375-b905-4752-bb82-e18521c86a63 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:45.941635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6648ce40-9b84-4399-a0ca-e93bedaa0017 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:45.950473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3f12375-b905-4752-bb82-e18521c86a63 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:45.952947 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6648ce40-9b84-4399-a0ca-e93bedaa0017 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1242 microversion: 2.1 time: 0.510827 Sep 06 11:14:45.953331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3f12375-b905-4752-bb82-e18521c86a63 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:45.956803 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2491/4933] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:45 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1242 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:14:45.964796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3f12375-b905-4752-bb82-e18521c86a63 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:45.976355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3f12375-b905-4752-bb82-e18521c86a63 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:45.978778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3f12375-b905-4752-bb82-e18521c86a63 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:45.979485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3f12375-b905-4752-bb82-e18521c86a63 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:45.982329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aedd1f89-0b4e-4800-b416-5b3c1044fe00 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:45.983029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aedd1f89-0b4e-4800-b416-5b3c1044fe00 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:45.999945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aedd1f89-0b4e-4800-b416-5b3c1044fe00 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:46.000458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aedd1f89-0b4e-4800-b416-5b3c1044fe00 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:46.003310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aedd1f89-0b4e-4800-b416-5b3c1044fe00 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:46.004075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aedd1f89-0b4e-4800-b416-5b3c1044fe00 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:46.004557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aedd1f89-0b4e-4800-b416-5b3c1044fe00 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:46.005001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aedd1f89-0b4e-4800-b416-5b3c1044fe00 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:46.047386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:46.618034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aedd1f89-0b4e-4800-b416-5b3c1044fe00 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:46.644239 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aedd1f89-0b4e-4800-b416-5b3c1044fe00 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1402 microversion: 2.1 time: 0.665504 Sep 06 11:14:46.648590 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2492/4934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:45 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1402 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:46.772006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d3f12375-b905-4752-bb82-e18521c86a63 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:46.787387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d3f12375-b905-4752-bb82-e18521c86a63 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:46.789140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d3f12375-b905-4752-bb82-e18521c86a63 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:46.790975 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d3f12375-b905-4752-bb82-e18521c86a63 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.897439 Sep 06 11:14:46.791653 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2443/4935] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:45 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:46.992543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bf7adf1c-d91d-47ee-aefa-5c5ccaf85086 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:46.994046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bf7adf1c-d91d-47ee-aefa-5c5ccaf85086 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:47.012305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf7adf1c-d91d-47ee-aefa-5c5ccaf85086 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:47.019691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf7adf1c-d91d-47ee-aefa-5c5ccaf85086 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:47.022979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf7adf1c-d91d-47ee-aefa-5c5ccaf85086 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:47.029529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf7adf1c-d91d-47ee-aefa-5c5ccaf85086 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:47.029529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf7adf1c-d91d-47ee-aefa-5c5ccaf85086 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:47.029529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf7adf1c-d91d-47ee-aefa-5c5ccaf85086 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:47.205419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bf7adf1c-d91d-47ee-aefa-5c5ccaf85086 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:47.215292 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bf7adf1c-d91d-47ee-aefa-5c5ccaf85086 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1294 microversion: 2.1 time: 0.234276 Sep 06 11:14:47.215680 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2493/4936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:46 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1294 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:47.670087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a7febd9e-ce56-4d77-b8b0-1ce34e2f10a2 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:47.670718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a7febd9e-ce56-4d77-b8b0-1ce34e2f10a2 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:47.684482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7febd9e-ce56-4d77-b8b0-1ce34e2f10a2 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:47.684991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7febd9e-ce56-4d77-b8b0-1ce34e2f10a2 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:47.685443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7febd9e-ce56-4d77-b8b0-1ce34e2f10a2 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:47.687165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7febd9e-ce56-4d77-b8b0-1ce34e2f10a2 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:47.689730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7febd9e-ce56-4d77-b8b0-1ce34e2f10a2 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:47.690220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a7febd9e-ce56-4d77-b8b0-1ce34e2f10a2 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:47.818322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d5a6aab1-4746-4a00-850a-9e1db2082970 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:47.818942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d5a6aab1-4746-4a00-850a-9e1db2082970 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:47.828536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5a6aab1-4746-4a00-850a-9e1db2082970 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:47.829044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5a6aab1-4746-4a00-850a-9e1db2082970 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:47.829510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5a6aab1-4746-4a00-850a-9e1db2082970 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:47.830190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5a6aab1-4746-4a00-850a-9e1db2082970 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:47.830835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5a6aab1-4746-4a00-850a-9e1db2082970 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:47.832084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5a6aab1-4746-4a00-850a-9e1db2082970 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:47.996013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a7febd9e-ce56-4d77-b8b0-1ce34e2f10a2 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:48.005563 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a7febd9e-ce56-4d77-b8b0-1ce34e2f10a2 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1402 microversion: 2.1 time: 0.339566 Sep 06 11:14:48.019979 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2444/4937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:47 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1402 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:48.064542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d5a6aab1-4746-4a00-850a-9e1db2082970 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:48.077181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d5a6aab1-4746-4a00-850a-9e1db2082970 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:48.078781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d5a6aab1-4746-4a00-850a-9e1db2082970 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:48.080049 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d5a6aab1-4746-4a00-850a-9e1db2082970 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.265741 Sep 06 11:14:48.080821 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2494/4938] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:47 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:48.241124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a53adb7a-a76c-47c7-b6ed-8ddb286a68e4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:48.241989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a53adb7a-a76c-47c7-b6ed-8ddb286a68e4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:48.243698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=12 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:48.248708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a53adb7a-a76c-47c7-b6ed-8ddb286a68e4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:48.249204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a53adb7a-a76c-47c7-b6ed-8ddb286a68e4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:48.249722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a53adb7a-a76c-47c7-b6ed-8ddb286a68e4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:48.250368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a53adb7a-a76c-47c7-b6ed-8ddb286a68e4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:48.250843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a53adb7a-a76c-47c7-b6ed-8ddb286a68e4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:48.251344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a53adb7a-a76c-47c7-b6ed-8ddb286a68e4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:48.321318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a53adb7a-a76c-47c7-b6ed-8ddb286a68e4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:48.333776 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a53adb7a-a76c-47c7-b6ed-8ddb286a68e4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1302 microversion: 2.1 time: 0.096656 Sep 06 11:14:48.334377 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2445/4939] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:48 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:49.030023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b996d1fe-3158-492b-96cc-a0697c9776bb tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:49.030655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b996d1fe-3158-492b-96cc-a0697c9776bb tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:49.041067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b996d1fe-3158-492b-96cc-a0697c9776bb tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:49.041578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b996d1fe-3158-492b-96cc-a0697c9776bb tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:49.042034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b996d1fe-3158-492b-96cc-a0697c9776bb tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:49.042773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b996d1fe-3158-492b-96cc-a0697c9776bb tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:49.043286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b996d1fe-3158-492b-96cc-a0697c9776bb tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:49.043727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b996d1fe-3158-492b-96cc-a0697c9776bb tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:49.108717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-68bfce69-5214-497e-acc1-aab1d96e8ed6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:49.109561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-68bfce69-5214-497e-acc1-aab1d96e8ed6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:49.139067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68bfce69-5214-497e-acc1-aab1d96e8ed6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:49.139990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68bfce69-5214-497e-acc1-aab1d96e8ed6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:49.140673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68bfce69-5214-497e-acc1-aab1d96e8ed6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:49.141716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68bfce69-5214-497e-acc1-aab1d96e8ed6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:49.142418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68bfce69-5214-497e-acc1-aab1d96e8ed6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:49.143144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68bfce69-5214-497e-acc1-aab1d96e8ed6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:49.356073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b996d1fe-3158-492b-96cc-a0697c9776bb tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:49.365085 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b996d1fe-3158-492b-96cc-a0697c9776bb tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1402 microversion: 2.1 time: 0.339108 Sep 06 11:14:49.365768 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2495/4940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:49 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1402 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:49.370745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cdb59045-0499-4fc8-ac98-2d70f604c816 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:49.371640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cdb59045-0499-4fc8-ac98-2d70f604c816 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:49.388361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cdb59045-0499-4fc8-ac98-2d70f604c816 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:49.389930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cdb59045-0499-4fc8-ac98-2d70f604c816 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:49.390681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cdb59045-0499-4fc8-ac98-2d70f604c816 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:49.392651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cdb59045-0499-4fc8-ac98-2d70f604c816 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:49.393568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cdb59045-0499-4fc8-ac98-2d70f604c816 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:49.394384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cdb59045-0499-4fc8-ac98-2d70f604c816 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:49.430120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-68bfce69-5214-497e-acc1-aab1d96e8ed6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:49.444570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-68bfce69-5214-497e-acc1-aab1d96e8ed6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:49.446504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-68bfce69-5214-497e-acc1-aab1d96e8ed6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:49.447973 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-68bfce69-5214-497e-acc1-aab1d96e8ed6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.343624 Sep 06 11:14:49.448534 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2446/4941] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:49 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:49.453614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aef25472-39c8-420f-a86c-0c5ce9ad8a1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-907738251", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "20ad1fa0-c584-4591-bb6f-e9158e7f61ee", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:49.547809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cdb59045-0499-4fc8-ac98-2d70f604c816 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:49.563977 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cdb59045-0499-4fc8-ac98-2d70f604c816 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1300 microversion: 2.1 time: 0.196903 Sep 06 11:14:49.568083 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2496/4942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:49 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1300 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:49.616224 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-aef25472-39c8-420f-a86c-0c5ce9ad8a1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Block Device 20ad1fa0-c584-4591-bb6f-e9158e7f61ee is not bootable. Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aef25472-39c8-420f-a86c-0c5ce9ad8a1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 357 Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-907738251", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "20ad1fa0-c584-4591-bb6f-e9158e7f61ee", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: exception: Block Device 20ad1fa0-c584-4591-bb6f-e9158e7f61ee is not bootable. Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-907738251', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '20ad1fa0-c584-4591-bb6f-e9158e7f61ee'}], 'networks': [{'uuid': 'b9ea5ffd-3051-44b1-b178-c09345529f6f'}]}}} Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 20ad1fa0-c584-4591-bb6f-e9158e7f61ee is not bootable. Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:49.629204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 20ad1fa0-c584-4591-bb6f-e9158e7f61ee is not bootable. Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 20ad1fa0-c584-4591-bb6f-e9158e7f61ee is not bootable. Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aef25472-39c8-420f-a86c-0c5ce9ad8a1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Block Device 20ad1fa0-c584-4591-bb6f-e9158e7f61ee is not bootable. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:14:49.634040 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aef25472-39c8-420f-a86c-0c5ce9ad8a1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.181442 Sep 06 11:14:49.637682 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2447/4943] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:14:49 2022] POST /compute/v2.1/servers => generated 110 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:14:49.640550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-075596ca-1094-48c9-87ca-ba09be0dcaae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:49.641089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-075596ca-1094-48c9-87ca-ba09be0dcaae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:49.649914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-075596ca-1094-48c9-87ca-ba09be0dcaae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:49.650661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-075596ca-1094-48c9-87ca-ba09be0dcaae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:49.651158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-075596ca-1094-48c9-87ca-ba09be0dcaae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:49.654038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-075596ca-1094-48c9-87ca-ba09be0dcaae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:49.654038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-075596ca-1094-48c9-87ca-ba09be0dcaae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:49.654038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-075596ca-1094-48c9-87ca-ba09be0dcaae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:49.851608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-075596ca-1094-48c9-87ca-ba09be0dcaae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:49.860567 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-075596ca-1094-48c9-87ca-ba09be0dcaae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.224051 Sep 06 11:14:49.881246 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2497/4944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:49 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:49.897995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7be28f1b-583e-42d9-82df-dc186ebde023 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:49.898640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7be28f1b-583e-42d9-82df-dc186ebde023 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:49.907275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7be28f1b-583e-42d9-82df-dc186ebde023 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:49.908020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7be28f1b-583e-42d9-82df-dc186ebde023 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:49.908654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7be28f1b-583e-42d9-82df-dc186ebde023 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:49.910173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7be28f1b-583e-42d9-82df-dc186ebde023 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:49.910639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7be28f1b-583e-42d9-82df-dc186ebde023 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:49.926881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7be28f1b-583e-42d9-82df-dc186ebde023 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:50.139159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7be28f1b-583e-42d9-82df-dc186ebde023 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:50.141770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:50.150060 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7be28f1b-583e-42d9-82df-dc186ebde023 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.259000 Sep 06 11:14:50.150729 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2448/4945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:49 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:50.391710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-029c66b9-f833-42ec-9704-074b2e890981 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:50.392315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-029c66b9-f833-42ec-9704-074b2e890981 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:50.400099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-029c66b9-f833-42ec-9704-074b2e890981 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:50.400591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-029c66b9-f833-42ec-9704-074b2e890981 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:50.401301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-029c66b9-f833-42ec-9704-074b2e890981 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:50.402276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-029c66b9-f833-42ec-9704-074b2e890981 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:50.402731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-029c66b9-f833-42ec-9704-074b2e890981 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:50.403194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-029c66b9-f833-42ec-9704-074b2e890981 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:50.475336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7279452a-2f54-4f74-8784-2b075f30cbd9 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:50.476268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7279452a-2f54-4f74-8784-2b075f30cbd9 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:50.484951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7279452a-2f54-4f74-8784-2b075f30cbd9 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:50.496012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7279452a-2f54-4f74-8784-2b075f30cbd9 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:50.496012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7279452a-2f54-4f74-8784-2b075f30cbd9 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:50.496012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7279452a-2f54-4f74-8784-2b075f30cbd9 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:50.496012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7279452a-2f54-4f74-8784-2b075f30cbd9 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:50.496012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7279452a-2f54-4f74-8784-2b075f30cbd9 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:50.647301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-029c66b9-f833-42ec-9704-074b2e890981 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:50.658464 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-029c66b9-f833-42ec-9704-074b2e890981 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1402 microversion: 2.1 time: 0.270885 Sep 06 11:14:50.674026 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2498/4946] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:50 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1402 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:50.685693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c2e5f9b-0776-4ba9-b845-180ce9a8cb5c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:50.685693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8c2e5f9b-0776-4ba9-b845-180ce9a8cb5c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:50.693146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c2e5f9b-0776-4ba9-b845-180ce9a8cb5c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:50.693919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c2e5f9b-0776-4ba9-b845-180ce9a8cb5c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:50.694538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c2e5f9b-0776-4ba9-b845-180ce9a8cb5c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:50.695487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c2e5f9b-0776-4ba9-b845-180ce9a8cb5c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:50.696127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c2e5f9b-0776-4ba9-b845-180ce9a8cb5c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:50.696734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c2e5f9b-0776-4ba9-b845-180ce9a8cb5c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:50.840775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8c2e5f9b-0776-4ba9-b845-180ce9a8cb5c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:50.859547 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8c2e5f9b-0776-4ba9-b845-180ce9a8cb5c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1300 microversion: 2.1 time: 0.183485 Sep 06 11:14:50.860790 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2499/4947] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:50 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1300 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:50.889364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7279452a-2f54-4f74-8784-2b075f30cbd9 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:50.909906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7279452a-2f54-4f74-8784-2b075f30cbd9 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:50.909906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7279452a-2f54-4f74-8784-2b075f30cbd9 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:50.909906 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7279452a-2f54-4f74-8784-2b075f30cbd9 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.434093 Sep 06 11:14:50.909906 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2449/4948] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:50 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:50.998780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a1892e89-178a-459b-b825-9effe2ae2b9b req-dbdaf445-a594-4c43-9844-579dc99a61a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f00cc0c-9676-4ac2-abf0-7c64929d6c20", "tag": "bb6a1ba7-3663-4600-9de7-a728f5f172b8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:51.020257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a1892e89-178a-459b-b825-9effe2ae2b9b req-dbdaf445-a594-4c43-9844-579dc99a61a8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:51.021474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a1892e89-178a-459b-b825-9effe2ae2b9b req-dbdaf445-a594-4c43-9844-579dc99a61a8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:51.029006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a1892e89-178a-459b-b825-9effe2ae2b9b req-dbdaf445-a594-4c43-9844-579dc99a61a8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:51.038972 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a1892e89-178a-459b-b825-9effe2ae2b9b req-dbdaf445-a594-4c43-9844-579dc99a61a8 service nova] Creating event network-changed:bb6a1ba7-3663-4600-9de7-a728f5f172b8 for instance 9f00cc0c-9676-4ac2-abf0-7c64929d6c20 on nch2-master-1 Sep 06 11:14:51.045778 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a1892e89-178a-459b-b825-9effe2ae2b9b req-dbdaf445-a594-4c43-9844-579dc99a61a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053722 Sep 06 11:14:51.047048 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2500/4949] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:51.686738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f2ecddba-f6d9-4108-8df9-b5ac80fecacd tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:51.697039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f2ecddba-f6d9-4108-8df9-b5ac80fecacd tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:51.697039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2ecddba-f6d9-4108-8df9-b5ac80fecacd tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:51.698094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2ecddba-f6d9-4108-8df9-b5ac80fecacd tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:51.698561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2ecddba-f6d9-4108-8df9-b5ac80fecacd tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:51.699579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2ecddba-f6d9-4108-8df9-b5ac80fecacd tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:51.700054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2ecddba-f6d9-4108-8df9-b5ac80fecacd tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:51.700695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2ecddba-f6d9-4108-8df9-b5ac80fecacd tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:51.856716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f2ecddba-f6d9-4108-8df9-b5ac80fecacd tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:51.867857 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f2ecddba-f6d9-4108-8df9-b5ac80fecacd tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1402 microversion: 2.1 time: 0.185211 Sep 06 11:14:51.868747 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2450/4950] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:51 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1402 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:51.894705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1161cbf1-841d-42f9-8369-6cd1348369a4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:51.896916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1161cbf1-841d-42f9-8369-6cd1348369a4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:51.910326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1161cbf1-841d-42f9-8369-6cd1348369a4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:51.911142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1161cbf1-841d-42f9-8369-6cd1348369a4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:51.911600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1161cbf1-841d-42f9-8369-6cd1348369a4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:51.914517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1161cbf1-841d-42f9-8369-6cd1348369a4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:51.915210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1161cbf1-841d-42f9-8369-6cd1348369a4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:51.915700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1161cbf1-841d-42f9-8369-6cd1348369a4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:51.932601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fb6e0ee8-344f-422f-ac71-c727924522e4 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:51.938239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb6e0ee8-344f-422f-ac71-c727924522e4 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:51.939329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb6e0ee8-344f-422f-ac71-c727924522e4 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:51.939829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb6e0ee8-344f-422f-ac71-c727924522e4 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:51.940855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb6e0ee8-344f-422f-ac71-c727924522e4 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:51.941771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb6e0ee8-344f-422f-ac71-c727924522e4 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:51.942258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb6e0ee8-344f-422f-ac71-c727924522e4 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:51.942679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb6e0ee8-344f-422f-ac71-c727924522e4 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:52.042356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1161cbf1-841d-42f9-8369-6cd1348369a4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:52.051449 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1161cbf1-841d-42f9-8369-6cd1348369a4 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1300 microversion: 2.1 time: 0.169806 Sep 06 11:14:52.052041 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2501/4951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:51 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1300 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:52.184988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb6e0ee8-344f-422f-ac71-c727924522e4 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:52.195074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb6e0ee8-344f-422f-ac71-c727924522e4 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:52.197305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb6e0ee8-344f-422f-ac71-c727924522e4 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:52.198816 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fb6e0ee8-344f-422f-ac71-c727924522e4 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.270172 Sep 06 11:14:52.202016 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2451/4952] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:51 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:52.416881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-96e7b02a-6dd7-41e6-b172-8317300a97f1 req-7775337b-85e5-4260-898a-0417290ba584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2b78dd-5a82-441b-9a8c-ed1e9049e250", "name": "network-vif-plugged", "status": "completed", "tag": "ed0e7e9c-5a2d-405e-941e-e3ceaf03d879"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:52.427622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-96e7b02a-6dd7-41e6-b172-8317300a97f1 req-7775337b-85e5-4260-898a-0417290ba584 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:52.430025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-96e7b02a-6dd7-41e6-b172-8317300a97f1 req-7775337b-85e5-4260-898a-0417290ba584 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:52.430025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-96e7b02a-6dd7-41e6-b172-8317300a97f1 req-7775337b-85e5-4260-898a-0417290ba584 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:52.441251 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-96e7b02a-6dd7-41e6-b172-8317300a97f1 req-7775337b-85e5-4260-898a-0417290ba584 service nova] Creating event network-vif-plugged:ed0e7e9c-5a2d-405e-941e-e3ceaf03d879 for instance 6f2b78dd-5a82-441b-9a8c-ed1e9049e250 on nch1-master-1 Sep 06 11:14:52.446564 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-96e7b02a-6dd7-41e6-b172-8317300a97f1 req-7775337b-85e5-4260-898a-0417290ba584 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033506 Sep 06 11:14:52.447699 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2502/4953] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:52.900483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e37c9a8d-ebf0-4f99-9994-f1f1b974c409 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:52.901185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e37c9a8d-ebf0-4f99-9994-f1f1b974c409 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:52.909481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e37c9a8d-ebf0-4f99-9994-f1f1b974c409 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:52.911266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e37c9a8d-ebf0-4f99-9994-f1f1b974c409 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:52.911266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e37c9a8d-ebf0-4f99-9994-f1f1b974c409 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:52.911488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e37c9a8d-ebf0-4f99-9994-f1f1b974c409 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:52.911822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e37c9a8d-ebf0-4f99-9994-f1f1b974c409 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:52.912261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e37c9a8d-ebf0-4f99-9994-f1f1b974c409 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:53.076522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3274148d-7bad-4d38-a8f2-85c1e3249ae8 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:53.077250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3274148d-7bad-4d38-a8f2-85c1e3249ae8 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:53.084429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3274148d-7bad-4d38-a8f2-85c1e3249ae8 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:53.084927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3274148d-7bad-4d38-a8f2-85c1e3249ae8 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:53.085378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3274148d-7bad-4d38-a8f2-85c1e3249ae8 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:53.086103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3274148d-7bad-4d38-a8f2-85c1e3249ae8 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:53.086570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3274148d-7bad-4d38-a8f2-85c1e3249ae8 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:53.087020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3274148d-7bad-4d38-a8f2-85c1e3249ae8 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:53.126147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e37c9a8d-ebf0-4f99-9994-f1f1b974c409 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:53.137063 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e37c9a8d-ebf0-4f99-9994-f1f1b974c409 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1402 microversion: 2.1 time: 0.240451 Sep 06 11:14:53.138100 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2452/4954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:52 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1402 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:53.184256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3274148d-7bad-4d38-a8f2-85c1e3249ae8 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:53.193234 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3274148d-7bad-4d38-a8f2-85c1e3249ae8 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1300 microversion: 2.1 time: 0.120938 Sep 06 11:14:53.207142 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2503/4955] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:53 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:14:53.230292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-398b74da-7036-4ff3-a857-15af819f2c4f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:53.232068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-398b74da-7036-4ff3-a857-15af819f2c4f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:53.240174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398b74da-7036-4ff3-a857-15af819f2c4f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:53.240683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398b74da-7036-4ff3-a857-15af819f2c4f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:53.241140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398b74da-7036-4ff3-a857-15af819f2c4f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:53.241871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398b74da-7036-4ff3-a857-15af819f2c4f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:53.242336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398b74da-7036-4ff3-a857-15af819f2c4f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:53.242969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398b74da-7036-4ff3-a857-15af819f2c4f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:53.428273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0f73eef4-827d-40c4-bad3-21a6a60cba71 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-42290940", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "destination_type": "local"}, {"source_type": "volume", "uuid": "f20851ed-938d-4b09-8c29-9352d026a512", "destination_type": "invalid"}], "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0f73eef4-827d-40c4-bad3-21a6a60cba71 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 493 Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-42290940", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "destination_type": "local"}, {"source_type": "volume", "uuid": "f20851ed-938d-4b09-8c29-9352d026a512", "destination_type": "invalid"}], "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-42290940', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'f20851ed-938d-4b09-8c29-9352d026a512', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'b9ea5ffd-3051-44b1-b178-c09345529f6f'}]}}} Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'invalid' Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:14:53.433232 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0f73eef4-827d-40c4-bad3-21a6a60cba71 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0f73eef4-827d-40c4-bad3-21a6a60cba71 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.012095 Sep 06 11:14:53.441619 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2504/4956] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:14:53 2022] POST /compute/v2.1/servers => generated 155 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 11:14:53.448575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-89ae0160-7c44-445b-9d52-185da2c11f2e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:53.449204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-89ae0160-7c44-445b-9d52-185da2c11f2e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:53.456513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89ae0160-7c44-445b-9d52-185da2c11f2e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:53.456688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-398b74da-7036-4ff3-a857-15af819f2c4f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:53.457012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89ae0160-7c44-445b-9d52-185da2c11f2e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:53.457462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89ae0160-7c44-445b-9d52-185da2c11f2e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:53.458182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89ae0160-7c44-445b-9d52-185da2c11f2e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:53.458654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89ae0160-7c44-445b-9d52-185da2c11f2e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:53.459167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89ae0160-7c44-445b-9d52-185da2c11f2e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:53.469092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-398b74da-7036-4ff3-a857-15af819f2c4f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:53.470606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-398b74da-7036-4ff3-a857-15af819f2c4f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:53.472633 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-398b74da-7036-4ff3-a857-15af819f2c4f tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.251589 Sep 06 11:14:53.487823 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2453/4957] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:53 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:53.601597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-89ae0160-7c44-445b-9d52-185da2c11f2e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:53.613345 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-89ae0160-7c44-445b-9d52-185da2c11f2e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.167741 Sep 06 11:14:53.613781 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2505/4958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:53 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:53.639294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c64ebc1b-e830-4f88-aab1-01a9e4ff19c5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:53.639294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c64ebc1b-e830-4f88-aab1-01a9e4ff19c5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:53.645848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c64ebc1b-e830-4f88-aab1-01a9e4ff19c5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:53.646359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c64ebc1b-e830-4f88-aab1-01a9e4ff19c5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:53.646811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c64ebc1b-e830-4f88-aab1-01a9e4ff19c5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:53.647573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c64ebc1b-e830-4f88-aab1-01a9e4ff19c5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:53.648040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c64ebc1b-e830-4f88-aab1-01a9e4ff19c5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:53.648722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c64ebc1b-e830-4f88-aab1-01a9e4ff19c5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:53.835625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c64ebc1b-e830-4f88-aab1-01a9e4ff19c5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:53.844562 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c64ebc1b-e830-4f88-aab1-01a9e4ff19c5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.211216 Sep 06 11:14:53.845847 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2454/4959] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:53 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:53.929717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cc534004-4239-4e75-862b-0144eb8b81f0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-787396972", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cc534004-4239-4e75-862b-0144eb8b81f0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 491 Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-787396972", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-787396972', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'b9ea5ffd-3051-44b1-b178-c09345529f6f'}]}}} Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.933919 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cc534004-4239-4e75-862b-0144eb8b81f0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:14:53.939095 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cc534004-4239-4e75-862b-0144eb8b81f0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.015697 Sep 06 11:14:53.942860 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2506/4960] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:14:53 2022] POST /compute/v2.1/servers => generated 624 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:14:53.948219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e3eb9e4c-42de-45f7-afff-80a8aad65f5c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:53.948860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e3eb9e4c-42de-45f7-afff-80a8aad65f5c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:53.960309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3eb9e4c-42de-45f7-afff-80a8aad65f5c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:53.960882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3eb9e4c-42de-45f7-afff-80a8aad65f5c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:53.961340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3eb9e4c-42de-45f7-afff-80a8aad65f5c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:53.962067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3eb9e4c-42de-45f7-afff-80a8aad65f5c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:53.962544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3eb9e4c-42de-45f7-afff-80a8aad65f5c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:53.962982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e3eb9e4c-42de-45f7-afff-80a8aad65f5c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:54.158297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:54.163387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a0c6134d-78b2-41a8-a1bd-395942abdbb8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:54.166924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a0c6134d-78b2-41a8-a1bd-395942abdbb8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:54.171548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0c6134d-78b2-41a8-a1bd-395942abdbb8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:54.171874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0c6134d-78b2-41a8-a1bd-395942abdbb8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:54.172321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0c6134d-78b2-41a8-a1bd-395942abdbb8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:54.173042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0c6134d-78b2-41a8-a1bd-395942abdbb8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:54.173497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0c6134d-78b2-41a8-a1bd-395942abdbb8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:54.173934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0c6134d-78b2-41a8-a1bd-395942abdbb8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:54.174590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e3eb9e4c-42de-45f7-afff-80a8aad65f5c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:54.183098 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e3eb9e4c-42de-45f7-afff-80a8aad65f5c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.239365 Sep 06 11:14:54.183880 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2455/4961] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:53 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:54.209178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1340c5e7-2fd7-43fd-8730-7c7e1a3e0d5a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:54.209923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1340c5e7-2fd7-43fd-8730-7c7e1a3e0d5a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:54.220375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1340c5e7-2fd7-43fd-8730-7c7e1a3e0d5a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:54.220895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1340c5e7-2fd7-43fd-8730-7c7e1a3e0d5a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:54.221421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1340c5e7-2fd7-43fd-8730-7c7e1a3e0d5a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:54.222159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1340c5e7-2fd7-43fd-8730-7c7e1a3e0d5a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:54.222630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1340c5e7-2fd7-43fd-8730-7c7e1a3e0d5a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:54.223101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1340c5e7-2fd7-43fd-8730-7c7e1a3e0d5a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:54.466554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a0c6134d-78b2-41a8-a1bd-395942abdbb8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:54.477650 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a0c6134d-78b2-41a8-a1bd-395942abdbb8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1589 microversion: 2.1 time: 0.320111 Sep 06 11:14:54.490178 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2507/4962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:54 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1589 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:14:54.501940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ec38f0e8-756b-45dd-9c5e-5d88dc22b197 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:54.503602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ec38f0e8-756b-45dd-9c5e-5d88dc22b197 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:54.511089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec38f0e8-756b-45dd-9c5e-5d88dc22b197 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:54.511725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec38f0e8-756b-45dd-9c5e-5d88dc22b197 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:54.512435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec38f0e8-756b-45dd-9c5e-5d88dc22b197 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:54.513275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec38f0e8-756b-45dd-9c5e-5d88dc22b197 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:54.513839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec38f0e8-756b-45dd-9c5e-5d88dc22b197 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:54.514381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec38f0e8-756b-45dd-9c5e-5d88dc22b197 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:54.596397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1340c5e7-2fd7-43fd-8730-7c7e1a3e0d5a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:54.608059 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1340c5e7-2fd7-43fd-8730-7c7e1a3e0d5a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.404099 Sep 06 11:14:54.651214 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2456/4963] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:54 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:14:54.656667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-66402e6f-6410-4ba6-9ee8-768e3b9b77c8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:54.657182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-66402e6f-6410-4ba6-9ee8-768e3b9b77c8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:54.664625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ec38f0e8-756b-45dd-9c5e-5d88dc22b197 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:54.664822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66402e6f-6410-4ba6-9ee8-768e3b9b77c8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:54.664822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66402e6f-6410-4ba6-9ee8-768e3b9b77c8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:54.665106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66402e6f-6410-4ba6-9ee8-768e3b9b77c8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:54.665738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66402e6f-6410-4ba6-9ee8-768e3b9b77c8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:54.666213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66402e6f-6410-4ba6-9ee8-768e3b9b77c8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:54.666654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66402e6f-6410-4ba6-9ee8-768e3b9b77c8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:54.672598 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ec38f0e8-756b-45dd-9c5e-5d88dc22b197 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1300 microversion: 2.1 time: 0.180507 Sep 06 11:14:54.678780 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2508/4964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:54 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1300 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:54.698367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4580f8dc-03fd-4d32-86a4-22294ead8357 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:54.699108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4580f8dc-03fd-4d32-86a4-22294ead8357 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:54.724161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4580f8dc-03fd-4d32-86a4-22294ead8357 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:54.725888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4580f8dc-03fd-4d32-86a4-22294ead8357 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:54.733467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4580f8dc-03fd-4d32-86a4-22294ead8357 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:54.735253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4580f8dc-03fd-4d32-86a4-22294ead8357 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:54.737683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4580f8dc-03fd-4d32-86a4-22294ead8357 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:54.740008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4580f8dc-03fd-4d32-86a4-22294ead8357 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:54.819640 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-66402e6f-6410-4ba6-9ee8-768e3b9b77c8 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.167056 Sep 06 11:14:54.827805 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2457/4965] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:14:54 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:54.833964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-57a8a33c-e604-4d32-ae8c-9984069bcacb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-57a8a33c-e604-4d32-ae8c-9984069bcacb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 416 Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'networks': [{'uuid': 'b9ea5ffd-3051-44b1-b178-c09345529f6f'}]}}} Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:54.840933 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-57a8a33c-e604-4d32-ae8c-9984069bcacb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:14:54.844977 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-57a8a33c-e604-4d32-ae8c-9984069bcacb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.013454 Sep 06 11:14:54.850343 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2458/4966] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:14:54 2022] POST /compute/v2.1/servers => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:14:54.860505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e09117a9-907a-464c-a303-c613d5c42793 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:54.872857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e09117a9-907a-464c-a303-c613d5c42793 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:54.872857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:54.872857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e09117a9-907a-464c-a303-c613d5c42793 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:54.876062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e09117a9-907a-464c-a303-c613d5c42793 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:54.876062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e09117a9-907a-464c-a303-c613d5c42793 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:54.876062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e09117a9-907a-464c-a303-c613d5c42793 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:54.876470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e09117a9-907a-464c-a303-c613d5c42793 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:54.878239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e09117a9-907a-464c-a303-c613d5c42793 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:55.442308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e09117a9-907a-464c-a303-c613d5c42793 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:55.454931 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e09117a9-907a-464c-a303-c613d5c42793 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.599343 Sep 06 11:14:55.477740 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2459/4967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:54 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:55.495112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5a2d2ae5-1d46-42d6-9b5b-a5558bfbaf53 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:55.495817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5a2d2ae5-1d46-42d6-9b5b-a5558bfbaf53 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:55.511310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a2d2ae5-1d46-42d6-9b5b-a5558bfbaf53 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:55.511824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a2d2ae5-1d46-42d6-9b5b-a5558bfbaf53 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:55.512270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a2d2ae5-1d46-42d6-9b5b-a5558bfbaf53 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:55.518018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a2d2ae5-1d46-42d6-9b5b-a5558bfbaf53 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:55.519257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a2d2ae5-1d46-42d6-9b5b-a5558bfbaf53 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:55.522287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a2d2ae5-1d46-42d6-9b5b-a5558bfbaf53 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:55.550425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4580f8dc-03fd-4d32-86a4-22294ead8357 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:55.562783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:55.570398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4580f8dc-03fd-4d32-86a4-22294ead8357 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:55.572347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4580f8dc-03fd-4d32-86a4-22294ead8357 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:55.574739 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4580f8dc-03fd-4d32-86a4-22294ead8357 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.894374 Sep 06 11:14:55.575427 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2509/4968] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:54 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:55.583211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-f8c859a2-a856-4214-bef5-d51e47d58aa3 req-f57043e4-4366-4226-a902-a2a445bec0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-plugged", "status": "completed", "tag": "721e119f-b9d6-46df-adc0-30d7ee803556"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:55.598752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f8c859a2-a856-4214-bef5-d51e47d58aa3 req-f57043e4-4366-4226-a902-a2a445bec0be service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:55.599548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f8c859a2-a856-4214-bef5-d51e47d58aa3 req-f57043e4-4366-4226-a902-a2a445bec0be service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:55.602487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f8c859a2-a856-4214-bef5-d51e47d58aa3 req-f57043e4-4366-4226-a902-a2a445bec0be service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:55.632192 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f8c859a2-a856-4214-bef5-d51e47d58aa3 req-f57043e4-4366-4226-a902-a2a445bec0be service nova] Creating event network-vif-plugged:721e119f-b9d6-46df-adc0-30d7ee803556 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:14:55.638326 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-f8c859a2-a856-4214-bef5-d51e47d58aa3 req-f57043e4-4366-4226-a902-a2a445bec0be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061552 Sep 06 11:14:55.639799 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2510/4969] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:55.707485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e0fb714-5ccf-4399-9da0-b5c044a79e8c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:55.709034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4e0fb714-5ccf-4399-9da0-b5c044a79e8c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:55.735583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e0fb714-5ccf-4399-9da0-b5c044a79e8c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:55.736246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e0fb714-5ccf-4399-9da0-b5c044a79e8c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:55.736869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e0fb714-5ccf-4399-9da0-b5c044a79e8c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:55.737857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e0fb714-5ccf-4399-9da0-b5c044a79e8c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:55.738482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e0fb714-5ccf-4399-9da0-b5c044a79e8c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:55.739111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e0fb714-5ccf-4399-9da0-b5c044a79e8c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:55.806670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5a2d2ae5-1d46-42d6-9b5b-a5558bfbaf53 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:55.825685 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5a2d2ae5-1d46-42d6-9b5b-a5558bfbaf53 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.334212 Sep 06 11:14:55.832808 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2460/4970] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:55 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:55.927679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4e0fb714-5ccf-4399-9da0-b5c044a79e8c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:55.938683 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e0fb714-5ccf-4399-9da0-b5c044a79e8c tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1300 microversion: 2.1 time: 0.239242 Sep 06 11:14:55.939979 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2511/4971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:55 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1300 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:14:55.954597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-710f4b31-5523-4afd-821d-fd49e3dd9895 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1333404496", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": -1, "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:55.982593 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-710f4b31-5523-4afd-821d-fd49e3dd9895 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Flavor -1 could not be found. Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-710f4b31-5523-4afd-821d-fd49e3dd9895 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 206 Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1333404496", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": -1, "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: exception: Flavor -1 could not be found. Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1333404496', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': -1, 'networks': [{'uuid': 'b9ea5ffd-3051-44b1-b178-c09345529f6f'}]}}} Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:55.984718 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 06 11:14:55.990610 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:14:55.994817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-710f4b31-5523-4afd-821d-fd49e3dd9895 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:14:55.996611 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-710f4b31-5523-4afd-821d-fd49e3dd9895 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.056379 Sep 06 11:14:55.997870 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2461/4972] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:14:55 2022] POST /compute/v2.1/servers => generated 73 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 06 11:14:56.020146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3fb042fa-549e-4f7e-b926-1807376edacf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:56.021260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3fb042fa-549e-4f7e-b926-1807376edacf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:56.031402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=16 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:56.033955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fb042fa-549e-4f7e-b926-1807376edacf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:56.034743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fb042fa-549e-4f7e-b926-1807376edacf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:56.036260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fb042fa-549e-4f7e-b926-1807376edacf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:56.037289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fb042fa-549e-4f7e-b926-1807376edacf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:56.037943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fb042fa-549e-4f7e-b926-1807376edacf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:56.038558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fb042fa-549e-4f7e-b926-1807376edacf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:56.399800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3fb042fa-549e-4f7e-b926-1807376edacf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:56.419093 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3fb042fa-549e-4f7e-b926-1807376edacf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.403687 Sep 06 11:14:56.420362 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2512/4973] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:56 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:56.445732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ffc30dd-5a2b-4a46-8e7d-0b62abddf8df tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:56.448350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ffc30dd-5a2b-4a46-8e7d-0b62abddf8df tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:56.456275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffc30dd-5a2b-4a46-8e7d-0b62abddf8df tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:56.457072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffc30dd-5a2b-4a46-8e7d-0b62abddf8df tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:56.457973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffc30dd-5a2b-4a46-8e7d-0b62abddf8df tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:56.459554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffc30dd-5a2b-4a46-8e7d-0b62abddf8df tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:56.460918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffc30dd-5a2b-4a46-8e7d-0b62abddf8df tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:56.462137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffc30dd-5a2b-4a46-8e7d-0b62abddf8df tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:56.610688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eeb7d49a-a69e-4a02-8229-612847d71286 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:56.610688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eeb7d49a-a69e-4a02-8229-612847d71286 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:56.619405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eeb7d49a-a69e-4a02-8229-612847d71286 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:56.620158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eeb7d49a-a69e-4a02-8229-612847d71286 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:56.620809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eeb7d49a-a69e-4a02-8229-612847d71286 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:56.621736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eeb7d49a-a69e-4a02-8229-612847d71286 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:56.622482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eeb7d49a-a69e-4a02-8229-612847d71286 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:56.623335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eeb7d49a-a69e-4a02-8229-612847d71286 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:56.826883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ffc30dd-5a2b-4a46-8e7d-0b62abddf8df tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:56.836363 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ffc30dd-5a2b-4a46-8e7d-0b62abddf8df tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.394792 Sep 06 11:14:56.837702 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2462/4974] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:56 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:56.849096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-024f8d63-7a59-49b6-a48c-013a8d932347 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:56.851135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-024f8d63-7a59-49b6-a48c-013a8d932347 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:56.860110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-024f8d63-7a59-49b6-a48c-013a8d932347 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:56.861101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-024f8d63-7a59-49b6-a48c-013a8d932347 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:56.861980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-024f8d63-7a59-49b6-a48c-013a8d932347 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:56.863077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-024f8d63-7a59-49b6-a48c-013a8d932347 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:56.872549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-024f8d63-7a59-49b6-a48c-013a8d932347 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:56.872549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-024f8d63-7a59-49b6-a48c-013a8d932347 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:56.916052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eeb7d49a-a69e-4a02-8229-612847d71286 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:56.932206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eeb7d49a-a69e-4a02-8229-612847d71286 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:56.934497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eeb7d49a-a69e-4a02-8229-612847d71286 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:56.947178 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eeb7d49a-a69e-4a02-8229-612847d71286 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.333888 Sep 06 11:14:56.968995 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2513/4975] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:56 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:56.985233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-e4fd910a-86eb-4c73-932e-a042123d24ea req-c60f70c4-b070-45b2-a657-dfd586abf622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f2b78dd-5a82-441b-9a8c-ed1e9049e250", "tag": "ed0e7e9c-5a2d-405e-941e-e3ceaf03d879"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:57.008716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e4fd910a-86eb-4c73-932e-a042123d24ea req-c60f70c4-b070-45b2-a657-dfd586abf622 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:57.009525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e4fd910a-86eb-4c73-932e-a042123d24ea req-c60f70c4-b070-45b2-a657-dfd586abf622 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:57.010376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e4fd910a-86eb-4c73-932e-a042123d24ea req-c60f70c4-b070-45b2-a657-dfd586abf622 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:57.025771 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-e4fd910a-86eb-4c73-932e-a042123d24ea req-c60f70c4-b070-45b2-a657-dfd586abf622 service nova] Creating event network-changed:ed0e7e9c-5a2d-405e-941e-e3ceaf03d879 for instance 6f2b78dd-5a82-441b-9a8c-ed1e9049e250 on nch1-master-1 Sep 06 11:14:57.034614 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-e4fd910a-86eb-4c73-932e-a042123d24ea req-c60f70c4-b070-45b2-a657-dfd586abf622 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061902 Sep 06 11:14:57.036018 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2514/4976] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:57.043415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b8bd102d-0b17-4c4a-a287-bb9cf9430b2b tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:57.061699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b8bd102d-0b17-4c4a-a287-bb9cf9430b2b tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:57.099930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8bd102d-0b17-4c4a-a287-bb9cf9430b2b tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:57.101074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8bd102d-0b17-4c4a-a287-bb9cf9430b2b tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:57.101560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8bd102d-0b17-4c4a-a287-bb9cf9430b2b tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:57.102563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8bd102d-0b17-4c4a-a287-bb9cf9430b2b tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:57.103234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8bd102d-0b17-4c4a-a287-bb9cf9430b2b tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:57.103681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b8bd102d-0b17-4c4a-a287-bb9cf9430b2b tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:57.362114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b8bd102d-0b17-4c4a-a287-bb9cf9430b2b tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:57.372437 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b8bd102d-0b17-4c4a-a287-bb9cf9430b2b tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1300 microversion: 2.1 time: 0.334880 Sep 06 11:14:57.383924 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2515/4977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:57 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1300 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:57.393940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5a430e1c-1a3f-460f-9d07-544beca253bf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-198171801", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5a430e1c-1a3f-460f-9d07-544beca253bf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 172 Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-198171801", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-198171801', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'b9ea5ffd-3051-44b1-b178-c09345529f6f'}]}}} Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi -1 Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:14:57.400775 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5a430e1c-1a3f-460f-9d07-544beca253bf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5a430e1c-1a3f-460f-9d07-544beca253bf tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.013090 Sep 06 11:14:57.410882 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2516/4978] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:14:57 2022] POST /compute/v2.1/servers => generated 145 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:14:57.418825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe66b6ff-ad3f-4c87-a896-f1cdad122967 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:57.418825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe66b6ff-ad3f-4c87-a896-f1cdad122967 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:57.419343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe66b6ff-ad3f-4c87-a896-f1cdad122967 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:57.419730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe66b6ff-ad3f-4c87-a896-f1cdad122967 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:57.420493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe66b6ff-ad3f-4c87-a896-f1cdad122967 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:57.421419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe66b6ff-ad3f-4c87-a896-f1cdad122967 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:57.422067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe66b6ff-ad3f-4c87-a896-f1cdad122967 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:57.422683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe66b6ff-ad3f-4c87-a896-f1cdad122967 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:57.538454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-024f8d63-7a59-49b6-a48c-013a8d932347 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:57.556680 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-024f8d63-7a59-49b6-a48c-013a8d932347 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1589 microversion: 2.1 time: 0.713778 Sep 06 11:14:57.557290 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2463/4979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:56 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1589 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:57.666849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-705b0082-bba6-4ec9-8b59-f48d8be9ea23 req-1897160c-9c2f-4dbe-a004-1f3daf646236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-plugged", "status": "completed", "tag": "9cabd01e-ea05-40f4-aead-e049cadec515"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:57.679111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-705b0082-bba6-4ec9-8b59-f48d8be9ea23 req-1897160c-9c2f-4dbe-a004-1f3daf646236 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:57.679685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-705b0082-bba6-4ec9-8b59-f48d8be9ea23 req-1897160c-9c2f-4dbe-a004-1f3daf646236 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:57.680130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-705b0082-bba6-4ec9-8b59-f48d8be9ea23 req-1897160c-9c2f-4dbe-a004-1f3daf646236 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:57.694636 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-705b0082-bba6-4ec9-8b59-f48d8be9ea23 req-1897160c-9c2f-4dbe-a004-1f3daf646236 service nova] Creating event network-vif-plugged:9cabd01e-ea05-40f4-aead-e049cadec515 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:14:57.701200 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-705b0082-bba6-4ec9-8b59-f48d8be9ea23 req-1897160c-9c2f-4dbe-a004-1f3daf646236 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041286 Sep 06 11:14:57.702223 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2464/4980] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:14:57.832337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe66b6ff-ad3f-4c87-a896-f1cdad122967 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:57.845858 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe66b6ff-ad3f-4c87-a896-f1cdad122967 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.438791 Sep 06 11:14:57.847703 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2517/4981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:57 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:57.890782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b2f87103-b12e-4c43-8673-e7bab380db72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:57.891549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b2f87103-b12e-4c43-8673-e7bab380db72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:57.900756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2f87103-b12e-4c43-8673-e7bab380db72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:57.905781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2f87103-b12e-4c43-8673-e7bab380db72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:57.905781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2f87103-b12e-4c43-8673-e7bab380db72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:57.905781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2f87103-b12e-4c43-8673-e7bab380db72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:57.905781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2f87103-b12e-4c43-8673-e7bab380db72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:57.905781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b2f87103-b12e-4c43-8673-e7bab380db72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:57.967936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-19ebf605-f703-43db-b218-8e81a5f7139d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:57.969129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-19ebf605-f703-43db-b218-8e81a5f7139d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:57.973234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:57.977501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19ebf605-f703-43db-b218-8e81a5f7139d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:57.978435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19ebf605-f703-43db-b218-8e81a5f7139d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:57.979312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19ebf605-f703-43db-b218-8e81a5f7139d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:57.980513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19ebf605-f703-43db-b218-8e81a5f7139d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:57.981436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19ebf605-f703-43db-b218-8e81a5f7139d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:57.982181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19ebf605-f703-43db-b218-8e81a5f7139d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:58.258067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b2f87103-b12e-4c43-8673-e7bab380db72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:58.271187 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b2f87103-b12e-4c43-8673-e7bab380db72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.385101 Sep 06 11:14:58.272334 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2465/4982] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:57 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:58.336162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19ebf605-f703-43db-b218-8e81a5f7139d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:58.350655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19ebf605-f703-43db-b218-8e81a5f7139d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:58.352578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19ebf605-f703-43db-b218-8e81a5f7139d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:58.354251 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-19ebf605-f703-43db-b218-8e81a5f7139d tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.390366 Sep 06 11:14:58.356010 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2518/4983] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:57 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:14:58.404124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7a16a6fb-0ddc-4c8e-a49c-47d597e78087 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:58.405021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7a16a6fb-0ddc-4c8e-a49c-47d597e78087 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:58.419398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a16a6fb-0ddc-4c8e-a49c-47d597e78087 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:58.422102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a16a6fb-0ddc-4c8e-a49c-47d597e78087 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:58.425265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a16a6fb-0ddc-4c8e-a49c-47d597e78087 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:58.427156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a16a6fb-0ddc-4c8e-a49c-47d597e78087 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:58.427849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a16a6fb-0ddc-4c8e-a49c-47d597e78087 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:58.428471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a16a6fb-0ddc-4c8e-a49c-47d597e78087 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:58.513588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4ffa514c-20ef-4e98-825c-e5075304fec0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-151453569", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:58.523567 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-4ffa514c-20ef-4e98-825c-e5075304fec0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4ffa514c-20ef-4e98-825c-e5075304fec0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 215 Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-151453569", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-151453569', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:58.526384 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:58.539958 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:58.539958 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:58.539958 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:58.539958 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:58.539958 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:14:58.539958 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:14:58.539958 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 06 11:14:58.539958 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:58.539958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4ffa514c-20ef-4e98-825c-e5075304fec0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:14:58.539958 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4ffa514c-20ef-4e98-825c-e5075304fec0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.031277 Sep 06 11:14:58.539958 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2519/4984] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:14:58 2022] POST /compute/v2.1/servers => generated 123 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:14:58.547819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f0fceaf1-a705-4742-99b1-6f3fb40700f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:58.548719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f0fceaf1-a705-4742-99b1-6f3fb40700f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:58.565715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0fceaf1-a705-4742-99b1-6f3fb40700f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:58.566610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0fceaf1-a705-4742-99b1-6f3fb40700f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:58.567744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0fceaf1-a705-4742-99b1-6f3fb40700f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:58.568495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0fceaf1-a705-4742-99b1-6f3fb40700f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:58.569059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0fceaf1-a705-4742-99b1-6f3fb40700f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:58.569496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0fceaf1-a705-4742-99b1-6f3fb40700f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:58.654967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7a16a6fb-0ddc-4c8e-a49c-47d597e78087 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:58.665294 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7a16a6fb-0ddc-4c8e-a49c-47d597e78087 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1300 microversion: 2.1 time: 0.266362 Sep 06 11:14:58.666745 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2466/4985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:58 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1300 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:58.794699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f0fceaf1-a705-4742-99b1-6f3fb40700f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:58.803958 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f0fceaf1-a705-4742-99b1-6f3fb40700f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.260218 Sep 06 11:14:58.804816 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2520/4986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:58 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:58.830471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fbf312ab-25ec-4545-841b-9bbf9b94ba29 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:58.830471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fbf312ab-25ec-4545-841b-9bbf9b94ba29 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:58.835971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbf312ab-25ec-4545-841b-9bbf9b94ba29 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:58.836466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbf312ab-25ec-4545-841b-9bbf9b94ba29 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:58.836907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbf312ab-25ec-4545-841b-9bbf9b94ba29 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:58.839813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbf312ab-25ec-4545-841b-9bbf9b94ba29 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:58.839813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbf312ab-25ec-4545-841b-9bbf9b94ba29 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:58.839813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbf312ab-25ec-4545-841b-9bbf9b94ba29 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:59.017535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fbf312ab-25ec-4545-841b-9bbf9b94ba29 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:59.036193 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fbf312ab-25ec-4545-841b-9bbf9b94ba29 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.208347 Sep 06 11:14:59.052206 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2467/4987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:58 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:14:59.197625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-de4565f9-441a-45cc-9b3d-b0d7e1198864 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-224919329", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "key_name": "tempest-key-594079517", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:59.277154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-de4565f9-441a-45cc-9b3d-b0d7e1198864 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] validate_networks() for [('b9ea5ffd-3051-44b1-b178-c09345529f6f', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:14:59.408756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-90708ffa-f6ce-4e91-8440-bf1e4fd0b5f1 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:59.410816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-90708ffa-f6ce-4e91-8440-bf1e4fd0b5f1 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:59.431135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90708ffa-f6ce-4e91-8440-bf1e4fd0b5f1 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:59.432961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90708ffa-f6ce-4e91-8440-bf1e4fd0b5f1 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:59.436366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90708ffa-f6ce-4e91-8440-bf1e4fd0b5f1 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:59.437383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90708ffa-f6ce-4e91-8440-bf1e4fd0b5f1 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:59.439081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90708ffa-f6ce-4e91-8440-bf1e4fd0b5f1 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:59.440514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90708ffa-f6ce-4e91-8440-bf1e4fd0b5f1 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:59.467444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:59.700072 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-de4565f9-441a-45cc-9b3d-b0d7e1198864 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Invalid key_name provided. Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-de4565f9-441a-45cc-9b3d-b0d7e1198864 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 245 Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-224919329", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "key_name": "tempest-key-594079517", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid key_name provided. Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-224919329', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'key_name': 'tempest-key-594079517', 'networks': [{'uuid': 'b9ea5ffd-3051-44b1-b178-c09345529f6f'}]}}} Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-594079517 not found for user 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:59.703781 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-de4565f9-441a-45cc-9b3d-b0d7e1198864 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Invalid key_name provided. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-de4565f9-441a-45cc-9b3d-b0d7e1198864 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.514587 Sep 06 11:14:59.714940 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2521/4988] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:14:59 2022] POST /compute/v2.1/servers => generated 70 bytes in 516 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 06 11:14:59.722709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5c680b5a-673e-47e3-be2a-439dac9c1c10 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:59.722709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5c680b5a-673e-47e3-be2a-439dac9c1c10 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:59.726216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c680b5a-673e-47e3-be2a-439dac9c1c10 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:59.726723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c680b5a-673e-47e3-be2a-439dac9c1c10 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:59.727197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c680b5a-673e-47e3-be2a-439dac9c1c10 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:59.728382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c680b5a-673e-47e3-be2a-439dac9c1c10 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:59.729142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c680b5a-673e-47e3-be2a-439dac9c1c10 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:59.729738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c680b5a-673e-47e3-be2a-439dac9c1c10 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:59.766921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-90708ffa-f6ce-4e91-8440-bf1e4fd0b5f1 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:59.788242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-90708ffa-f6ce-4e91-8440-bf1e4fd0b5f1 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:59.791153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-90708ffa-f6ce-4e91-8440-bf1e4fd0b5f1 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:59.793446 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-90708ffa-f6ce-4e91-8440-bf1e4fd0b5f1 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.402469 Sep 06 11:14:59.794588 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2468/4989] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:14:59 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:14:59.839186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-953fab5f-b50b-49d8-bd03-fd5465ed1d56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:14:59.839186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-953fab5f-b50b-49d8-bd03-fd5465ed1d56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:14:59.839186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-953fab5f-b50b-49d8-bd03-fd5465ed1d56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:59.839186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-953fab5f-b50b-49d8-bd03-fd5465ed1d56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:59.839186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-953fab5f-b50b-49d8-bd03-fd5465ed1d56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:59.839186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-953fab5f-b50b-49d8-bd03-fd5465ed1d56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:59.839186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-953fab5f-b50b-49d8-bd03-fd5465ed1d56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:59.839186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-953fab5f-b50b-49d8-bd03-fd5465ed1d56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:59.843500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5c680b5a-673e-47e3-be2a-439dac9c1c10 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:14:59.859608 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5c680b5a-673e-47e3-be2a-439dac9c1c10 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1300 microversion: 2.1 time: 0.144508 Sep 06 11:14:59.860561 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2522/4990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:59 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1300 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:14:59.887194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-f87e9f35-f535-4336-83ed-1efb33d4a6c5 req-fc8349d8-e941-4efe-9467-4a1ccb8679e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-plugged", "status": "completed", "tag": "e50e4dc4-e3ed-478b-8ee3-86ecdce0d790"}, {"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-plugged", "status": "completed", "tag": "3e403f89-7cbd-47b7-8591-7aa0e6c26fba"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:14:59.898116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f87e9f35-f535-4336-83ed-1efb33d4a6c5 req-fc8349d8-e941-4efe-9467-4a1ccb8679e7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:14:59.898695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f87e9f35-f535-4336-83ed-1efb33d4a6c5 req-fc8349d8-e941-4efe-9467-4a1ccb8679e7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:14:59.899185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f87e9f35-f535-4336-83ed-1efb33d4a6c5 req-fc8349d8-e941-4efe-9467-4a1ccb8679e7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:14:59.917825 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f87e9f35-f535-4336-83ed-1efb33d4a6c5 req-fc8349d8-e941-4efe-9467-4a1ccb8679e7 service nova] Creating event network-vif-plugged:e50e4dc4-e3ed-478b-8ee3-86ecdce0d790 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:14:59.918354 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f87e9f35-f535-4336-83ed-1efb33d4a6c5 req-fc8349d8-e941-4efe-9467-4a1ccb8679e7 service nova] Creating event network-vif-plugged:3e403f89-7cbd-47b7-8591-7aa0e6c26fba for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:14:59.926132 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-f87e9f35-f535-4336-83ed-1efb33d4a6c5 req-fc8349d8-e941-4efe-9467-4a1ccb8679e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056856 Sep 06 11:14:59.932158 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2523/4991] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:15:00.052442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-953fab5f-b50b-49d8-bd03-fd5465ed1d56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:00.055557 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-953fab5f-b50b-49d8-bd03-fd5465ed1d56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.258446 Sep 06 11:15:00.072939 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2469/4992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:14:59 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:00.083686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4550455b-83d7-4151-83db-4bf333692b3c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:00.084382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4550455b-83d7-4151-83db-4bf333692b3c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:00.093348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4550455b-83d7-4151-83db-4bf333692b3c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:00.094122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4550455b-83d7-4151-83db-4bf333692b3c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:00.101495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4550455b-83d7-4151-83db-4bf333692b3c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:00.101495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4550455b-83d7-4151-83db-4bf333692b3c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:00.101495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4550455b-83d7-4151-83db-4bf333692b3c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:00.101495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4550455b-83d7-4151-83db-4bf333692b3c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:00.279307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4550455b-83d7-4151-83db-4bf333692b3c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:00.293399 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4550455b-83d7-4151-83db-4bf333692b3c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.216335 Sep 06 11:15:00.294005 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2524/4993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:00 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:00.543639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6b0b18ee-03c8-442c-bd7e-4970e7c5d9f4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-7955797", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:00.744902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.security_group_api [None req-6b0b18ee-03c8-442c-bd7e-4970e7c5d9f4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Neutron security group does_not_exist not found {{(pid=140875) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 06 11:15:00.746203 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-6b0b18ee-03c8-442c-bd7e-4970e7c5d9f4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6b0b18ee-03c8-442c-bd7e-4970e7c5d9f4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 255 Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-7955797", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-7955797', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'b9ea5ffd-3051-44b1-b178-c09345529f6f'}]}}} Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 06 11:15:00.789931 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:00.813214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6b0b18ee-03c8-442c-bd7e-4970e7c5d9f4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:00.828172 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6b0b18ee-03c8-442c-bd7e-4970e7c5d9f4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.267502 Sep 06 11:15:00.828172 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2470/4994] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:15:00 2022] POST /compute/v2.1/servers => generated 106 bytes in 270 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:15:00.829256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d723be1c-1bf1-4ca4-a2d3-5fc604e82246 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:00.829256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d723be1c-1bf1-4ca4-a2d3-5fc604e82246 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:00.829256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d723be1c-1bf1-4ca4-a2d3-5fc604e82246 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:00.829256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d723be1c-1bf1-4ca4-a2d3-5fc604e82246 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:00.829256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d723be1c-1bf1-4ca4-a2d3-5fc604e82246 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:00.831333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d723be1c-1bf1-4ca4-a2d3-5fc604e82246 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:00.831333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d723be1c-1bf1-4ca4-a2d3-5fc604e82246 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:00.831333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d723be1c-1bf1-4ca4-a2d3-5fc604e82246 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:00.869738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-49e8c47a-8fda-4ff1-b8bf-d4ebdb45761b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:00.870761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-49e8c47a-8fda-4ff1-b8bf-d4ebdb45761b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:00.878972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e8c47a-8fda-4ff1-b8bf-d4ebdb45761b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:00.880331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e8c47a-8fda-4ff1-b8bf-d4ebdb45761b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:00.881645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e8c47a-8fda-4ff1-b8bf-d4ebdb45761b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:00.883089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e8c47a-8fda-4ff1-b8bf-d4ebdb45761b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:00.883954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e8c47a-8fda-4ff1-b8bf-d4ebdb45761b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:00.884605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-49e8c47a-8fda-4ff1-b8bf-d4ebdb45761b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:01.266317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d723be1c-1bf1-4ca4-a2d3-5fc604e82246 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:01.275276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-49e8c47a-8fda-4ff1-b8bf-d4ebdb45761b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:01.275811 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d723be1c-1bf1-4ca4-a2d3-5fc604e82246 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.463983 Sep 06 11:15:01.276690 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2525/4995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:00 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:01.282859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0790f707-54be-430f-b998-45c12b21e67d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:01.284418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0790f707-54be-430f-b998-45c12b21e67d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:01.291716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0790f707-54be-430f-b998-45c12b21e67d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:01.292452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0790f707-54be-430f-b998-45c12b21e67d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:01.294122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0790f707-54be-430f-b998-45c12b21e67d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:01.294240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-49e8c47a-8fda-4ff1-b8bf-d4ebdb45761b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:01.294377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0790f707-54be-430f-b998-45c12b21e67d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:01.294817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-49e8c47a-8fda-4ff1-b8bf-d4ebdb45761b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:01.295157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0790f707-54be-430f-b998-45c12b21e67d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:01.295833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0790f707-54be-430f-b998-45c12b21e67d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:01.296537 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-49e8c47a-8fda-4ff1-b8bf-d4ebdb45761b tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.434683 Sep 06 11:15:01.297118 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2471/4996] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:15:00 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:15:01.304940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9bede93a-24dd-4d3d-9c2d-79caccb582ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:01.305661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9bede93a-24dd-4d3d-9c2d-79caccb582ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:01.323925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bede93a-24dd-4d3d-9c2d-79caccb582ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:01.324537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bede93a-24dd-4d3d-9c2d-79caccb582ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:01.328842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bede93a-24dd-4d3d-9c2d-79caccb582ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:01.329568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bede93a-24dd-4d3d-9c2d-79caccb582ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:01.331947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bede93a-24dd-4d3d-9c2d-79caccb582ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:01.334631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bede93a-24dd-4d3d-9c2d-79caccb582ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:01.443045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0790f707-54be-430f-b998-45c12b21e67d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:01.452272 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0790f707-54be-430f-b998-45c12b21e67d tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1300 microversion: 2.1 time: 0.174272 Sep 06 11:15:01.452949 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2526/4997] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:01 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:01.599818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9bede93a-24dd-4d3d-9c2d-79caccb582ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:01.610174 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9bede93a-24dd-4d3d-9c2d-79caccb582ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.311917 Sep 06 11:15:01.611558 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2472/4998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:01 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:01.640830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8af3056d-72f7-4c6d-8361-dbbc416a80ef tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:01.641693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8af3056d-72f7-4c6d-8361-dbbc416a80ef tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: c8191695-bcdd-4590-8341-331f940aff86] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:01.649263 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-8af3056d-72f7-4c6d-8361-dbbc416a80ef tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance c8191695-bcdd-4590-8341-331f940aff86 could not be found. Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8af3056d-72f7-4c6d-8361-dbbc416a80ef tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/c8191695-bcdd-4590-8341-331f940aff86 HTTP/1.1 Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance c8191695-bcdd-4590-8341-331f940aff86 could not be found. Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'c8191695-bcdd-4590-8341-331f940aff86'} Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8191695-bcdd-4590-8341-331f940aff86 could not be found. Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8191695-bcdd-4590-8341-331f940aff86 could not be found. Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:01.660258 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:01.664840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:01.664840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:01.664840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:01.664840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:01.664840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:01.664840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:01.664840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8191695-bcdd-4590-8341-331f940aff86 could not be found. Sep 06 11:15:01.664840 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:01.667061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8af3056d-72f7-4c6d-8361-dbbc416a80ef tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance c8191695-bcdd-4590-8341-331f940aff86 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:01.668174 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8af3056d-72f7-4c6d-8361-dbbc416a80ef tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c8191695-bcdd-4590-8341-331f940aff86" status: 404 len: 111 microversion: 2.1 time: 0.031520 Sep 06 11:15:01.668965 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2527/4999] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:15:01 2022] DELETE /compute/v2.1/servers/c8191695-bcdd-4590-8341-331f940aff86 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:15:01.678705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-11a9d111-aac3-4d55-bd7c-f873e7692bee tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:01.679702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-11a9d111-aac3-4d55-bd7c-f873e7692bee tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:01.688542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11a9d111-aac3-4d55-bd7c-f873e7692bee tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:01.689422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11a9d111-aac3-4d55-bd7c-f873e7692bee tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:01.690142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11a9d111-aac3-4d55-bd7c-f873e7692bee tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:01.691124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11a9d111-aac3-4d55-bd7c-f873e7692bee tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:01.691781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11a9d111-aac3-4d55-bd7c-f873e7692bee tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:01.694515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11a9d111-aac3-4d55-bd7c-f873e7692bee tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:01.860250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-11a9d111-aac3-4d55-bd7c-f873e7692bee tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:01.869252 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-11a9d111-aac3-4d55-bd7c-f873e7692bee tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.195326 Sep 06 11:15:01.869865 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2473/5000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:01 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:01.894423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f654f27b-7e0f-43b4-ae63-fd1e90fd2067 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:01.895128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f654f27b-7e0f-43b4-ae63-fd1e90fd2067 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:01.904349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f654f27b-7e0f-43b4-ae63-fd1e90fd2067 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:01.904851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f654f27b-7e0f-43b4-ae63-fd1e90fd2067 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:01.905564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f654f27b-7e0f-43b4-ae63-fd1e90fd2067 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:01.906298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f654f27b-7e0f-43b4-ae63-fd1e90fd2067 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:01.906799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f654f27b-7e0f-43b4-ae63-fd1e90fd2067 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:01.907508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f654f27b-7e0f-43b4-ae63-fd1e90fd2067 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:02.052637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-72901e76-76a7-4c71-b8de-51d359168b3c req-0a001acc-0715-4fe4-b406-d2323ec0a711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-plugged", "status": "completed", "tag": "7632117e-275e-451b-973e-484d4cf38e3a"}, {"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-plugged", "status": "completed", "tag": "1918ef7a-2344-47ad-aa5c-49c938fd8469"}, {"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-plugged", "status": "completed", "tag": "668f5dcf-b1c4-4540-a554-6a6dad1d4823"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:02.064878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-72901e76-76a7-4c71-b8de-51d359168b3c req-0a001acc-0715-4fe4-b406-d2323ec0a711 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:02.065707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-72901e76-76a7-4c71-b8de-51d359168b3c req-0a001acc-0715-4fe4-b406-d2323ec0a711 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:02.066401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-72901e76-76a7-4c71-b8de-51d359168b3c req-0a001acc-0715-4fe4-b406-d2323ec0a711 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:02.077219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f654f27b-7e0f-43b4-ae63-fd1e90fd2067 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:02.079907 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-72901e76-76a7-4c71-b8de-51d359168b3c req-0a001acc-0715-4fe4-b406-d2323ec0a711 service nova] Creating event network-vif-plugged:7632117e-275e-451b-973e-484d4cf38e3a for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:15:02.081881 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-72901e76-76a7-4c71-b8de-51d359168b3c req-0a001acc-0715-4fe4-b406-d2323ec0a711 service nova] Creating event network-vif-plugged:1918ef7a-2344-47ad-aa5c-49c938fd8469 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:15:02.083217 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-72901e76-76a7-4c71-b8de-51d359168b3c req-0a001acc-0715-4fe4-b406-d2323ec0a711 service nova] Creating event network-vif-plugged:668f5dcf-b1c4-4540-a554-6a6dad1d4823 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:15:02.088010 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f654f27b-7e0f-43b4-ae63-fd1e90fd2067 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.198808 Sep 06 11:15:02.088962 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2528/5001] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:01 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:02.092470 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-72901e76-76a7-4c71-b8de-51d359168b3c req-0a001acc-0715-4fe4-b406-d2323ec0a711 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042760 Sep 06 11:15:02.093682 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2474/5002] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:15:02.114746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-83fd68e2-af3f-412f-a75d-d1fd840901db tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:02.115770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-83fd68e2-af3f-412f-a75d-d1fd840901db tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Failed to fetch instance by id 9223372036854775808 {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 06 11:15:02.116303 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-83fd68e2-af3f-412f-a75d-d1fd840901db tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-83fd68e2-af3f-412f-a75d-d1fd840901db tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 9223372036854775808 could not be found. Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '9223372036854775808'} Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:02.119447 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:02.131397 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:02.131397 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:02.131397 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:02.131397 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 06 11:15:02.131397 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:02.131397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-83fd68e2-af3f-412f-a75d-d1fd840901db tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:02.131397 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-83fd68e2-af3f-412f-a75d-d1fd840901db tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.012991 Sep 06 11:15:02.131397 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2529/5003] 10.222.0.20 () {58 vars in 1188 bytes} [Tue Sep 6 11:15:02 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:15:02.134054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a9451a5f-eee3-4d4e-8dcc-fc946103266e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:02.134796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a9451a5f-eee3-4d4e-8dcc-fc946103266e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:02.141836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9451a5f-eee3-4d4e-8dcc-fc946103266e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:02.142325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9451a5f-eee3-4d4e-8dcc-fc946103266e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:02.143475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9451a5f-eee3-4d4e-8dcc-fc946103266e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:02.144188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9451a5f-eee3-4d4e-8dcc-fc946103266e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:02.144650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9451a5f-eee3-4d4e-8dcc-fc946103266e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:02.145079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9451a5f-eee3-4d4e-8dcc-fc946103266e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:02.333336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a9451a5f-eee3-4d4e-8dcc-fc946103266e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:02.341912 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a9451a5f-eee3-4d4e-8dcc-fc946103266e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.212752 Sep 06 11:15:02.342507 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2475/5004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:02 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:02.357617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ffe5d9c3-81e6-4e39-b31f-331514cf7337 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:02.358390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ffe5d9c3-81e6-4e39-b31f-331514cf7337 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:02.370023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5acd46df-bf8a-4162-bb5f-0d5a4b7536ea tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:02.370949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5acd46df-bf8a-4162-bb5f-0d5a4b7536ea tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:02.374965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffe5d9c3-81e6-4e39-b31f-331514cf7337 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:02.376540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffe5d9c3-81e6-4e39-b31f-331514cf7337 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:02.377869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffe5d9c3-81e6-4e39-b31f-331514cf7337 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:02.378962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5acd46df-bf8a-4162-bb5f-0d5a4b7536ea tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:02.379526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5acd46df-bf8a-4162-bb5f-0d5a4b7536ea tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:02.379825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffe5d9c3-81e6-4e39-b31f-331514cf7337 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:02.381144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffe5d9c3-81e6-4e39-b31f-331514cf7337 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:02.381421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5acd46df-bf8a-4162-bb5f-0d5a4b7536ea tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:02.382184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5acd46df-bf8a-4162-bb5f-0d5a4b7536ea tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:02.382480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffe5d9c3-81e6-4e39-b31f-331514cf7337 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:02.382659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5acd46df-bf8a-4162-bb5f-0d5a4b7536ea tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:02.383364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5acd46df-bf8a-4162-bb5f-0d5a4b7536ea tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:02.686602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5acd46df-bf8a-4162-bb5f-0d5a4b7536ea tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:02.695449 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5acd46df-bf8a-4162-bb5f-0d5a4b7536ea tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.329426 Sep 06 11:15:02.696054 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2476/5005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:02 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:02.700901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-528bd32e-10b6-4901-a67f-d463587d7eb0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:02.701532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-528bd32e-10b6-4901-a67f-d463587d7eb0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:02.706038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ffe5d9c3-81e6-4e39-b31f-331514cf7337 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:02.708442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-528bd32e-10b6-4901-a67f-d463587d7eb0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:02.708941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-528bd32e-10b6-4901-a67f-d463587d7eb0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:02.709387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-528bd32e-10b6-4901-a67f-d463587d7eb0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:02.710109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-528bd32e-10b6-4901-a67f-d463587d7eb0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:02.710574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-528bd32e-10b6-4901-a67f-d463587d7eb0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:02.711044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-528bd32e-10b6-4901-a67f-d463587d7eb0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:02.720738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ffe5d9c3-81e6-4e39-b31f-331514cf7337 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:02.722313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ffe5d9c3-81e6-4e39-b31f-331514cf7337 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:02.723706 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ffe5d9c3-81e6-4e39-b31f-331514cf7337 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.385207 Sep 06 11:15:02.724299 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2530/5006] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:15:02 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:15:02.729211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9e6f2051-6fd4-4421-8cc5-85cd0e811fbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:02.730266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9e6f2051-6fd4-4421-8cc5-85cd0e811fbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Failed to fetch instance by id -1 {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 06 11:15:02.731609 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-9e6f2051-6fd4-4421-8cc5-85cd0e811fbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance -1 could not be found. Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9e6f2051-6fd4-4421-8cc5-85cd0e811fbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance -1 could not be found. Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '-1'} Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:02.733633 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:02.739054 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:02.739054 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:02.739054 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 06 11:15:02.739054 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:02.739054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9e6f2051-6fd4-4421-8cc5-85cd0e811fbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance -1 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:02.739054 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9e6f2051-6fd4-4421-8cc5-85cd0e811fbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.009833 Sep 06 11:15:02.739054 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2531/5007] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 11:15:02 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:15:02.745600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8cee17ea-72c0-4a1c-80b9-de5bfbfe7f50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:02.748434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8cee17ea-72c0-4a1c-80b9-de5bfbfe7f50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:02.755639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cee17ea-72c0-4a1c-80b9-de5bfbfe7f50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:02.756558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cee17ea-72c0-4a1c-80b9-de5bfbfe7f50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:02.757124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cee17ea-72c0-4a1c-80b9-de5bfbfe7f50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:02.757992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cee17ea-72c0-4a1c-80b9-de5bfbfe7f50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:02.758680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cee17ea-72c0-4a1c-80b9-de5bfbfe7f50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:02.759544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cee17ea-72c0-4a1c-80b9-de5bfbfe7f50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:02.884445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-528bd32e-10b6-4901-a67f-d463587d7eb0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:02.901665 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-528bd32e-10b6-4901-a67f-d463587d7eb0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1300 microversion: 2.1 time: 0.204479 Sep 06 11:15:02.903535 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2477/5008] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:02 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1300 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:03.061391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8cee17ea-72c0-4a1c-80b9-de5bfbfe7f50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:03.085180 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8cee17ea-72c0-4a1c-80b9-de5bfbfe7f50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.342836 Sep 06 11:15:03.086227 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2532/5009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:02 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:03.111771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-98539cde-ba67-44b3-977b-f2ce397f35a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:03.112418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-98539cde-ba67-44b3-977b-f2ce397f35a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:03.121099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98539cde-ba67-44b3-977b-f2ce397f35a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:03.124495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98539cde-ba67-44b3-977b-f2ce397f35a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:03.124495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98539cde-ba67-44b3-977b-f2ce397f35a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:03.124495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98539cde-ba67-44b3-977b-f2ce397f35a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:03.124495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98539cde-ba67-44b3-977b-f2ce397f35a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:03.124495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-98539cde-ba67-44b3-977b-f2ce397f35a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:03.668444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-98539cde-ba67-44b3-977b-f2ce397f35a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:03.679256 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-98539cde-ba67-44b3-977b-f2ce397f35a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.572047 Sep 06 11:15:03.680017 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2478/5010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:03 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:03.703709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-811476cd-5098-40dd-97fe-15758a84c0c6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:03.705000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-811476cd-5098-40dd-97fe-15758a84c0c6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 7b6f9dd6-1dc7-4f71-a2e9-3d18a5e564e9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:03.713085 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-811476cd-5098-40dd-97fe-15758a84c0c6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance 7b6f9dd6-1dc7-4f71-a2e9-3d18a5e564e9 could not be found. Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-811476cd-5098-40dd-97fe-15758a84c0c6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/7b6f9dd6-1dc7-4f71-a2e9-3d18a5e564e9/action HTTP/1.1 Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 19 Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: {"forceDelete": {}} Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 7b6f9dd6-1dc7-4f71-a2e9-3d18a5e564e9 could not be found. Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '7b6f9dd6-1dc7-4f71-a2e9-3d18a5e564e9', 'body': {'forceDelete': {}}} Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b6f9dd6-1dc7-4f71-a2e9-3d18a5e564e9 could not be found. Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b6f9dd6-1dc7-4f71-a2e9-3d18a5e564e9 could not be found. Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:03.719761 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:03.728957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:03.728957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:03.728957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b6f9dd6-1dc7-4f71-a2e9-3d18a5e564e9 could not be found. Sep 06 11:15:03.728957 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:03.728957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-811476cd-5098-40dd-97fe-15758a84c0c6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance 7b6f9dd6-1dc7-4f71-a2e9-3d18a5e564e9 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:03.728957 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-811476cd-5098-40dd-97fe-15758a84c0c6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/7b6f9dd6-1dc7-4f71-a2e9-3d18a5e564e9/action" status: 404 len: 111 microversion: 2.1 time: 0.022767 Sep 06 11:15:03.728957 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2533/5011] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:03 2022] POST /compute/v2.1/servers/7b6f9dd6-1dc7-4f71-a2e9-3d18a5e564e9/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:15:03.737908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-66c4e015-fb73-4afa-9ee7-12348c053ea7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:03.739211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-66c4e015-fb73-4afa-9ee7-12348c053ea7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:03.750145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66c4e015-fb73-4afa-9ee7-12348c053ea7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:03.750897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66c4e015-fb73-4afa-9ee7-12348c053ea7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:03.751629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66c4e015-fb73-4afa-9ee7-12348c053ea7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:03.753529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66c4e015-fb73-4afa-9ee7-12348c053ea7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:03.754276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66c4e015-fb73-4afa-9ee7-12348c053ea7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:03.754960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66c4e015-fb73-4afa-9ee7-12348c053ea7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:03.764376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f8e7e27-aa2a-4a48-ae41-cc751b1db3cd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:03.765390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1f8e7e27-aa2a-4a48-ae41-cc751b1db3cd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:03.792278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f8e7e27-aa2a-4a48-ae41-cc751b1db3cd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:03.800472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f8e7e27-aa2a-4a48-ae41-cc751b1db3cd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:03.805343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f8e7e27-aa2a-4a48-ae41-cc751b1db3cd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:03.805343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f8e7e27-aa2a-4a48-ae41-cc751b1db3cd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:03.805343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f8e7e27-aa2a-4a48-ae41-cc751b1db3cd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:03.805343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f8e7e27-aa2a-4a48-ae41-cc751b1db3cd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:04.331378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-66c4e015-fb73-4afa-9ee7-12348c053ea7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:04.344237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1f8e7e27-aa2a-4a48-ae41-cc751b1db3cd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:04.349459 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-66c4e015-fb73-4afa-9ee7-12348c053ea7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.618581 Sep 06 11:15:04.351370 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2479/5012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:03 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:04.365466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1f8e7e27-aa2a-4a48-ae41-cc751b1db3cd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:04.372377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1f8e7e27-aa2a-4a48-ae41-cc751b1db3cd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:04.374352 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1f8e7e27-aa2a-4a48-ae41-cc751b1db3cd tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1875 microversion: 2.42 time: 0.616951 Sep 06 11:15:04.376898 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2534/5013] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:15:03 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1875 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:15:04.381875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-26ceee66-7299-4c14-a8df-e430f29a49c1 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:04.383138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-304fbcef-7ccc-499d-9a90-a5ca58882cf3 req-6efd5edd-5e2b-4310-80ae-bbe72978ddb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f00cc0c-9676-4ac2-abf0-7c64929d6c20", "name": "network-vif-plugged", "status": "completed", "tag": "bb6a1ba7-3663-4600-9de7-a728f5f172b8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:04.383396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-26ceee66-7299-4c14-a8df-e430f29a49c1 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:04.397223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-304fbcef-7ccc-499d-9a90-a5ca58882cf3 req-6efd5edd-5e2b-4310-80ae-bbe72978ddb5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:04.397846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-304fbcef-7ccc-499d-9a90-a5ca58882cf3 req-6efd5edd-5e2b-4310-80ae-bbe72978ddb5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:04.398383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-304fbcef-7ccc-499d-9a90-a5ca58882cf3 req-6efd5edd-5e2b-4310-80ae-bbe72978ddb5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:04.398531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26ceee66-7299-4c14-a8df-e430f29a49c1 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:04.398999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26ceee66-7299-4c14-a8df-e430f29a49c1 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:04.399725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26ceee66-7299-4c14-a8df-e430f29a49c1 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:04.400989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26ceee66-7299-4c14-a8df-e430f29a49c1 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:04.401864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26ceee66-7299-4c14-a8df-e430f29a49c1 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:04.402645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26ceee66-7299-4c14-a8df-e430f29a49c1 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:04.417333 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-304fbcef-7ccc-499d-9a90-a5ca58882cf3 req-6efd5edd-5e2b-4310-80ae-bbe72978ddb5 service nova] Creating event network-vif-plugged:bb6a1ba7-3663-4600-9de7-a728f5f172b8 for instance 9f00cc0c-9676-4ac2-abf0-7c64929d6c20 on nch2-master-1 Sep 06 11:15:04.422933 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-304fbcef-7ccc-499d-9a90-a5ca58882cf3 req-6efd5edd-5e2b-4310-80ae-bbe72978ddb5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044315 Sep 06 11:15:04.423600 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2535/5014] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:15:04.430106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a6cbe205-0589-4799-b828-58aa08b69575 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:04.434822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a6cbe205-0589-4799-b828-58aa08b69575 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:04.437527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6cbe205-0589-4799-b828-58aa08b69575 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:04.438243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6cbe205-0589-4799-b828-58aa08b69575 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:04.438689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6cbe205-0589-4799-b828-58aa08b69575 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:04.439513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6cbe205-0589-4799-b828-58aa08b69575 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:04.439981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6cbe205-0589-4799-b828-58aa08b69575 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:04.440419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6cbe205-0589-4799-b828-58aa08b69575 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:04.446383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:04.550845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-26ceee66-7299-4c14-a8df-e430f29a49c1 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:04.561562 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-26ceee66-7299-4c14-a8df-e430f29a49c1 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1300 microversion: 2.1 time: 0.208403 Sep 06 11:15:04.562087 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2480/5015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:04 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:04.646832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a6cbe205-0589-4799-b828-58aa08b69575 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:04.656146 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a6cbe205-0589-4799-b828-58aa08b69575 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.230968 Sep 06 11:15:04.656953 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2536/5016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:04 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:04.679629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-46909147-99a0-4cc4-99ab-726e585701f9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:04.682187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-46909147-99a0-4cc4-99ab-726e585701f9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: f8a2316e-7851-422b-9670-c85ad3850cca] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:04.688708 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-46909147-99a0-4cc4-99ab-726e585701f9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance f8a2316e-7851-422b-9670-c85ad3850cca could not be found. Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-46909147-99a0-4cc4-99ab-726e585701f9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/f8a2316e-7851-422b-9670-c85ad3850cca/action HTTP/1.1 Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 39 Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: {"os-getConsoleOutput": {"length": 10}} Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance f8a2316e-7851-422b-9670-c85ad3850cca could not be found. Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'f8a2316e-7851-422b-9670-c85ad3850cca', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8a2316e-7851-422b-9670-c85ad3850cca could not be found. Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8a2316e-7851-422b-9670-c85ad3850cca could not be found. Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:04.696647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:04.703185 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:04.703185 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:04.703185 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:04.703185 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:04.703185 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8a2316e-7851-422b-9670-c85ad3850cca could not be found. Sep 06 11:15:04.703185 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:04.703185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-46909147-99a0-4cc4-99ab-726e585701f9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance f8a2316e-7851-422b-9670-c85ad3850cca could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:04.703185 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-46909147-99a0-4cc4-99ab-726e585701f9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/f8a2316e-7851-422b-9670-c85ad3850cca/action" status: 404 len: 111 microversion: 2.1 time: 0.023062 Sep 06 11:15:04.703185 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2481/5017] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:04 2022] POST /compute/v2.1/servers/f8a2316e-7851-422b-9670-c85ad3850cca/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:15:04.708562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3cf72897-a1ed-4803-89c7-bdc61f601c72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:04.709199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3cf72897-a1ed-4803-89c7-bdc61f601c72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:04.716746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cf72897-a1ed-4803-89c7-bdc61f601c72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:04.717248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cf72897-a1ed-4803-89c7-bdc61f601c72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:04.717731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cf72897-a1ed-4803-89c7-bdc61f601c72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:04.718520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cf72897-a1ed-4803-89c7-bdc61f601c72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:04.718981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cf72897-a1ed-4803-89c7-bdc61f601c72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:04.719457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cf72897-a1ed-4803-89c7-bdc61f601c72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:04.893435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3cf72897-a1ed-4803-89c7-bdc61f601c72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:04.905159 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3cf72897-a1ed-4803-89c7-bdc61f601c72 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.201251 Sep 06 11:15:04.906406 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2537/5018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:04 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:04.930856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4eb60d4f-602e-4822-8418-d07587ad8e70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:04.931640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4eb60d4f-602e-4822-8418-d07587ad8e70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:04.944350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4eb60d4f-602e-4822-8418-d07587ad8e70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:04.944896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4eb60d4f-602e-4822-8418-d07587ad8e70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:04.945442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4eb60d4f-602e-4822-8418-d07587ad8e70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:04.946248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4eb60d4f-602e-4822-8418-d07587ad8e70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:04.946751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4eb60d4f-602e-4822-8418-d07587ad8e70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:04.947247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4eb60d4f-602e-4822-8418-d07587ad8e70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:05.308552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4eb60d4f-602e-4822-8418-d07587ad8e70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:05.319464 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4eb60d4f-602e-4822-8418-d07587ad8e70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.392912 Sep 06 11:15:05.320418 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2482/5019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:04 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:05.343408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-516d2a15-20d4-4d7d-99cc-ff8352b5a35c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:05.344490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-516d2a15-20d4-4d7d-99cc-ff8352b5a35c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: b31351c0-05d8-4359-9527-b8a73007dde5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:05.352463 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-516d2a15-20d4-4d7d-99cc-ff8352b5a35c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance b31351c0-05d8-4359-9527-b8a73007dde5 could not be found. Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-516d2a15-20d4-4d7d-99cc-ff8352b5a35c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/b31351c0-05d8-4359-9527-b8a73007dde5 HTTP/1.1 Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance b31351c0-05d8-4359-9527-b8a73007dde5 could not be found. Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'b31351c0-05d8-4359-9527-b8a73007dde5'} Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b31351c0-05d8-4359-9527-b8a73007dde5 could not be found. Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b31351c0-05d8-4359-9527-b8a73007dde5 could not be found. Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:05.354339 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:05.361132 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:05.361132 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:05.361132 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:05.361132 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b31351c0-05d8-4359-9527-b8a73007dde5 could not be found. Sep 06 11:15:05.361132 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:05.361132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-516d2a15-20d4-4d7d-99cc-ff8352b5a35c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance b31351c0-05d8-4359-9527-b8a73007dde5 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:05.361132 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-516d2a15-20d4-4d7d-99cc-ff8352b5a35c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/b31351c0-05d8-4359-9527-b8a73007dde5" status: 404 len: 111 microversion: 2.1 time: 0.017877 Sep 06 11:15:05.361132 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2538/5020] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:05 2022] GET /compute/v2.1/servers/b31351c0-05d8-4359-9527-b8a73007dde5 => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:15:05.367324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b5f9f1b7-b645-4546-862b-b49fb67b4dd9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:05.367965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b5f9f1b7-b645-4546-862b-b49fb67b4dd9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:05.383655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5f9f1b7-b645-4546-862b-b49fb67b4dd9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:05.383655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5f9f1b7-b645-4546-862b-b49fb67b4dd9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:05.383655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5f9f1b7-b645-4546-862b-b49fb67b4dd9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:05.383655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5f9f1b7-b645-4546-862b-b49fb67b4dd9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:05.383655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5f9f1b7-b645-4546-862b-b49fb67b4dd9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:05.383655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5f9f1b7-b645-4546-862b-b49fb67b4dd9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:05.416045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8e82a987-f474-4c27-ab02-a7001489e3b8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:05.417134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8e82a987-f474-4c27-ab02-a7001489e3b8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:05.428549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e82a987-f474-4c27-ab02-a7001489e3b8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:05.429294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e82a987-f474-4c27-ab02-a7001489e3b8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:05.430042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e82a987-f474-4c27-ab02-a7001489e3b8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:05.430866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e82a987-f474-4c27-ab02-a7001489e3b8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:05.431433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e82a987-f474-4c27-ab02-a7001489e3b8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:05.431886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e82a987-f474-4c27-ab02-a7001489e3b8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:05.888749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b5f9f1b7-b645-4546-862b-b49fb67b4dd9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:05.900810 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b5f9f1b7-b645-4546-862b-b49fb67b4dd9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.537867 Sep 06 11:15:05.901526 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2483/5021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:05 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:05.914869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-129812b6-4294-4dd0-9ba3-ddab4f115cba tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:05.916611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-129812b6-4294-4dd0-9ba3-ddab4f115cba tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:05.935295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-129812b6-4294-4dd0-9ba3-ddab4f115cba tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:05.936053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-129812b6-4294-4dd0-9ba3-ddab4f115cba tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:05.936707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-129812b6-4294-4dd0-9ba3-ddab4f115cba tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:05.948352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-129812b6-4294-4dd0-9ba3-ddab4f115cba tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:05.949415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-129812b6-4294-4dd0-9ba3-ddab4f115cba tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:05.950238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-129812b6-4294-4dd0-9ba3-ddab4f115cba tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:05.996037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8e82a987-f474-4c27-ab02-a7001489e3b8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:06.012738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8e82a987-f474-4c27-ab02-a7001489e3b8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:06.014561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8e82a987-f474-4c27-ab02-a7001489e3b8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:06.016421 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8e82a987-f474-4c27-ab02-a7001489e3b8 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 2830 microversion: 2.42 time: 0.614055 Sep 06 11:15:06.018117 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2539/5022] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:15:05 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 2830 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:15:06.024008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9603a71d-f91a-4913-92e8-60071acd8ea8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:06.025805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9603a71d-f91a-4913-92e8-60071acd8ea8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:06.038840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9603a71d-f91a-4913-92e8-60071acd8ea8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.041479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9603a71d-f91a-4913-92e8-60071acd8ea8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.042935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9603a71d-f91a-4913-92e8-60071acd8ea8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:06.044809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9603a71d-f91a-4913-92e8-60071acd8ea8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.046104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9603a71d-f91a-4913-92e8-60071acd8ea8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.046903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9603a71d-f91a-4913-92e8-60071acd8ea8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:06.217213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-129812b6-4294-4dd0-9ba3-ddab4f115cba tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:06.228626 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-129812b6-4294-4dd0-9ba3-ddab4f115cba tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1473 microversion: 2.1 time: 0.325045 Sep 06 11:15:06.229268 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2484/5023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:05 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1473 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:06.234443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c2ef93c-dcde-4115-a394-b78e1604cfb7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:06.234946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9c2ef93c-dcde-4115-a394-b78e1604cfb7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:06.242643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c2ef93c-dcde-4115-a394-b78e1604cfb7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.243365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c2ef93c-dcde-4115-a394-b78e1604cfb7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.243824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c2ef93c-dcde-4115-a394-b78e1604cfb7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:06.245824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c2ef93c-dcde-4115-a394-b78e1604cfb7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.247865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c2ef93c-dcde-4115-a394-b78e1604cfb7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.248464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c2ef93c-dcde-4115-a394-b78e1604cfb7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:06.378780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9603a71d-f91a-4913-92e8-60071acd8ea8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:06.395420 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9603a71d-f91a-4913-92e8-60071acd8ea8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.375171 Sep 06 11:15:06.396319 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2540/5024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:06 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:06.403284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b9e26786-a087-4217-a931-d8ae9bbd79ed tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:06.403947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b9e26786-a087-4217-a931-d8ae9bbd79ed tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:06.412021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9e26786-a087-4217-a931-d8ae9bbd79ed tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.412705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9e26786-a087-4217-a931-d8ae9bbd79ed tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.413271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9e26786-a087-4217-a931-d8ae9bbd79ed tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:06.414023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9e26786-a087-4217-a931-d8ae9bbd79ed tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.414568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9e26786-a087-4217-a931-d8ae9bbd79ed tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.415066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b9e26786-a087-4217-a931-d8ae9bbd79ed tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:06.479927 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9c2ef93c-dcde-4115-a394-b78e1604cfb7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.249483 Sep 06 11:15:06.489051 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2485/5025] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Sep 6 11:15:06 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0/os-interface => generated 1830 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:15:06.560758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b9e26786-a087-4217-a931-d8ae9bbd79ed tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:06.567239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9d38da0-ea78-4efc-b287-b106cb620cef tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1588016466", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:06.569247 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b9e26786-a087-4217-a931-d8ae9bbd79ed tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1473 microversion: 2.1 time: 0.171224 Sep 06 11:15:06.570012 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2541/5026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:06 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1473 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9d38da0-ea78-4efc-b287-b106cb620cef tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 238 Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1588016466", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1588016466', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'b9ea5ffd-3051-44b1-b178-c09345529f6f'}]}}} Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:06.592284 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 06 11:15:06.608016 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:06.612932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-72550f6a-000f-4032-8736-12734256a318 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:06.612932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-72550f6a-000f-4032-8736-12734256a318 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:06.613811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e9d38da0-ea78-4efc-b287-b106cb620cef tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:06.613811 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e9d38da0-ea78-4efc-b287-b106cb620cef tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.038237 Sep 06 11:15:06.613811 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2486/5027] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:15:06 2022] POST /compute/v2.1/servers => generated 139 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 11:15:06.614233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72550f6a-000f-4032-8736-12734256a318 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.614233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72550f6a-000f-4032-8736-12734256a318 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.614233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72550f6a-000f-4032-8736-12734256a318 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:06.614233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72550f6a-000f-4032-8736-12734256a318 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.614233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72550f6a-000f-4032-8736-12734256a318 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.614233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72550f6a-000f-4032-8736-12734256a318 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:06.615785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2a70740b-9f70-405b-b0c5-5ffd4df85ab6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:06.616413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2a70740b-9f70-405b-b0c5-5ffd4df85ab6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:06.623925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a70740b-9f70-405b-b0c5-5ffd4df85ab6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.624424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a70740b-9f70-405b-b0c5-5ffd4df85ab6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.624872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a70740b-9f70-405b-b0c5-5ffd4df85ab6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:06.625591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a70740b-9f70-405b-b0c5-5ffd4df85ab6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.626054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a70740b-9f70-405b-b0c5-5ffd4df85ab6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.626493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a70740b-9f70-405b-b0c5-5ffd4df85ab6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:06.784529 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-72550f6a-000f-4032-8736-12734256a318 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1624 microversion: 2.1 time: 0.191465 Sep 06 11:15:06.791424 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2542/5028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:06 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1624 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:06.811582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a211fef1-9610-4ed8-b7c1-f8ca94b475e6 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:06.813159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a211fef1-9610-4ed8-b7c1-f8ca94b475e6 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:06.824647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a211fef1-9610-4ed8-b7c1-f8ca94b475e6 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.825342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a211fef1-9610-4ed8-b7c1-f8ca94b475e6 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.825939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a211fef1-9610-4ed8-b7c1-f8ca94b475e6 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:06.828522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a211fef1-9610-4ed8-b7c1-f8ca94b475e6 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.829268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a211fef1-9610-4ed8-b7c1-f8ca94b475e6 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.829845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a211fef1-9610-4ed8-b7c1-f8ca94b475e6 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:06.861136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2a70740b-9f70-405b-b0c5-5ffd4df85ab6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:06.870649 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2a70740b-9f70-405b-b0c5-5ffd4df85ab6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.262637 Sep 06 11:15:06.875113 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2487/5029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:06 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:06.896768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-53bb5a6c-d56c-4f9e-8844-220cc2345c14 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:06.897415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-53bb5a6c-d56c-4f9e-8844-220cc2345c14 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:06.907052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53bb5a6c-d56c-4f9e-8844-220cc2345c14 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.907948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53bb5a6c-d56c-4f9e-8844-220cc2345c14 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.909033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53bb5a6c-d56c-4f9e-8844-220cc2345c14 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:06.909756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53bb5a6c-d56c-4f9e-8844-220cc2345c14 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:06.910438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53bb5a6c-d56c-4f9e-8844-220cc2345c14 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:06.910878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53bb5a6c-d56c-4f9e-8844-220cc2345c14 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:07.100968 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a211fef1-9610-4ed8-b7c1-f8ca94b475e6 tempest-TestSecurityGroupsBasicOps-1316522405 tempest-TestSecurityGroupsBasicOps-1316522405-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1912 microversion: 2.1 time: 0.296503 Sep 06 11:15:07.101632 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2543/5030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:06 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1912 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:07.119926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-53bb5a6c-d56c-4f9e-8844-220cc2345c14 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:07.131389 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-53bb5a6c-d56c-4f9e-8844-220cc2345c14 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.238304 Sep 06 11:15:07.132271 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2488/5031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:06 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:07.244885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-394054ac-1b7b-4671-9559-d706fb5fbb86 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:07.245471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-394054ac-1b7b-4671-9559-d706fb5fbb86 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:07.259408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-394054ac-1b7b-4671-9559-d706fb5fbb86 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:07.260170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-394054ac-1b7b-4671-9559-d706fb5fbb86 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:07.260822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-394054ac-1b7b-4671-9559-d706fb5fbb86 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:07.264515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-394054ac-1b7b-4671-9559-d706fb5fbb86 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:07.265130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-394054ac-1b7b-4671-9559-d706fb5fbb86 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:07.265596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-394054ac-1b7b-4671-9559-d706fb5fbb86 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:07.309398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-394054ac-1b7b-4671-9559-d706fb5fbb86 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:15:07.327610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01857aa4-453a-4054-aeff-104c9b8a37e3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1624428660", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01857aa4-453a-4054-aeff-104c9b8a37e3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 235 Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1624428660", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1624428660', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'b9ea5ffd-3051-44b1-b178-c09345529f6f'}]}}} Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.332193 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01857aa4-453a-4054-aeff-104c9b8a37e3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-01857aa4-453a-4054-aeff-104c9b8a37e3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.010191 Sep 06 11:15:07.337651 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2489/5032] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:15:07 2022] POST /compute/v2.1/servers => generated 133 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:15:07.342891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8338e756-f428-4686-b1c0-bdc6cfd27347 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:07.343548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8338e756-f428-4686-b1c0-bdc6cfd27347 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:07.353713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8338e756-f428-4686-b1c0-bdc6cfd27347 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:07.354216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8338e756-f428-4686-b1c0-bdc6cfd27347 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:07.354768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8338e756-f428-4686-b1c0-bdc6cfd27347 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:07.356062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8338e756-f428-4686-b1c0-bdc6cfd27347 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:07.356718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8338e756-f428-4686-b1c0-bdc6cfd27347 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:07.357470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8338e756-f428-4686-b1c0-bdc6cfd27347 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:07.360966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:07.528568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8338e756-f428-4686-b1c0-bdc6cfd27347 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:07.538190 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8338e756-f428-4686-b1c0-bdc6cfd27347 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.199367 Sep 06 11:15:07.544029 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2490/5033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:07 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:07.562060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4f38baa6-6005-4b8a-adae-f712551e917d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:07.562712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4f38baa6-6005-4b8a-adae-f712551e917d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:07.570588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f38baa6-6005-4b8a-adae-f712551e917d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:07.571152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f38baa6-6005-4b8a-adae-f712551e917d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:07.571584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f38baa6-6005-4b8a-adae-f712551e917d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:07.572315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f38baa6-6005-4b8a-adae-f712551e917d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:07.572791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f38baa6-6005-4b8a-adae-f712551e917d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:07.573234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f38baa6-6005-4b8a-adae-f712551e917d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:07.733608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4f38baa6-6005-4b8a-adae-f712551e917d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:07.740870 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4f38baa6-6005-4b8a-adae-f712551e917d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.182734 Sep 06 11:15:07.741462 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2491/5034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:07 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:07.764989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d03f6503-9b63-4e47-aaa1-c894861c36f1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:07.765766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d03f6503-9b63-4e47-aaa1-c894861c36f1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: b4366762-a6c0-46b6-802f-f87c20983a94] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:07.772401 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-d03f6503-9b63-4e47-aaa1-c894861c36f1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance b4366762-a6c0-46b6-802f-f87c20983a94 could not be found. Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d03f6503-9b63-4e47-aaa1-c894861c36f1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/b4366762-a6c0-46b6-802f-f87c20983a94/action HTTP/1.1 Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 13 Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: {"pause": {}} Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance b4366762-a6c0-46b6-802f-f87c20983a94 could not be found. Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'b4366762-a6c0-46b6-802f-f87c20983a94', 'body': {'pause': {}}} Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4366762-a6c0-46b6-802f-f87c20983a94 could not be found. Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4366762-a6c0-46b6-802f-f87c20983a94 could not be found. Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:07.781015 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:07.786803 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:07.786803 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:07.786803 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4366762-a6c0-46b6-802f-f87c20983a94 could not be found. Sep 06 11:15:07.786803 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:07.786803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d03f6503-9b63-4e47-aaa1-c894861c36f1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance b4366762-a6c0-46b6-802f-f87c20983a94 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:07.786803 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d03f6503-9b63-4e47-aaa1-c894861c36f1 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/b4366762-a6c0-46b6-802f-f87c20983a94/action" status: 404 len: 111 microversion: 2.1 time: 0.022693 Sep 06 11:15:07.786803 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2492/5035] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:07 2022] POST /compute/v2.1/servers/b4366762-a6c0-46b6-802f-f87c20983a94/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:15:07.791693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b29d7c22-2368-40a9-b453-1b8ae0731877 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:07.792326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b29d7c22-2368-40a9-b453-1b8ae0731877 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:07.800163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b29d7c22-2368-40a9-b453-1b8ae0731877 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:07.800665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b29d7c22-2368-40a9-b453-1b8ae0731877 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:07.801120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b29d7c22-2368-40a9-b453-1b8ae0731877 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:07.801838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b29d7c22-2368-40a9-b453-1b8ae0731877 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:07.802309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b29d7c22-2368-40a9-b453-1b8ae0731877 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:07.802753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b29d7c22-2368-40a9-b453-1b8ae0731877 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:07.825558 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-394054ac-1b7b-4671-9559-d706fb5fbb86 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 204 len: 0 microversion: 2.1 time: 0.581799 Sep 06 11:15:07.825558 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2544/5036] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:15:07 2022] DELETE /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:15:07.831511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4363d5bb-0bf3-4803-b23c-f6e955fc4ddd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:07.832237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4363d5bb-0bf3-4803-b23c-f6e955fc4ddd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:07.839868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4363d5bb-0bf3-4803-b23c-f6e955fc4ddd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:07.840475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4363d5bb-0bf3-4803-b23c-f6e955fc4ddd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:07.840897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4363d5bb-0bf3-4803-b23c-f6e955fc4ddd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:07.841620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4363d5bb-0bf3-4803-b23c-f6e955fc4ddd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:07.842091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4363d5bb-0bf3-4803-b23c-f6e955fc4ddd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:07.842539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4363d5bb-0bf3-4803-b23c-f6e955fc4ddd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:07.985081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4363d5bb-0bf3-4803-b23c-f6e955fc4ddd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:07.995829 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4363d5bb-0bf3-4803-b23c-f6e955fc4ddd tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1479 microversion: 2.1 time: 0.168478 Sep 06 11:15:07.997265 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2545/5037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:07 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1479 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:08.015326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b29d7c22-2368-40a9-b453-1b8ae0731877 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:08.025441 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b29d7c22-2368-40a9-b453-1b8ae0731877 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.237312 Sep 06 11:15:08.027802 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2493/5038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:07 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:08.057473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5cda8d61-e6fb-4c30-b3c7-53b30080e1ac tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:08.058351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5cda8d61-e6fb-4c30-b3c7-53b30080e1ac tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:08.065903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5cda8d61-e6fb-4c30-b3c7-53b30080e1ac tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:08.066746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5cda8d61-e6fb-4c30-b3c7-53b30080e1ac tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:08.067310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5cda8d61-e6fb-4c30-b3c7-53b30080e1ac tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:08.068594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5cda8d61-e6fb-4c30-b3c7-53b30080e1ac tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:08.069246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5cda8d61-e6fb-4c30-b3c7-53b30080e1ac tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:08.069854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5cda8d61-e6fb-4c30-b3c7-53b30080e1ac tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:08.237692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5cda8d61-e6fb-4c30-b3c7-53b30080e1ac tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:08.245971 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5cda8d61-e6fb-4c30-b3c7-53b30080e1ac tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.195874 Sep 06 11:15:08.263664 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2546/5039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:08 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:08.269295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9e7ff9dd-e6fa-4fdd-b51f-fd722a1808f3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:08.270126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9e7ff9dd-e6fa-4fdd-b51f-fd722a1808f3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:08.277581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e7ff9dd-e6fa-4fdd-b51f-fd722a1808f3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:08.278456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e7ff9dd-e6fa-4fdd-b51f-fd722a1808f3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:08.279102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e7ff9dd-e6fa-4fdd-b51f-fd722a1808f3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:08.280031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e7ff9dd-e6fa-4fdd-b51f-fd722a1808f3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:08.280529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e7ff9dd-e6fa-4fdd-b51f-fd722a1808f3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:08.280912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e7ff9dd-e6fa-4fdd-b51f-fd722a1808f3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:08.581574 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9e7ff9dd-e6fa-4fdd-b51f-fd722a1808f3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action" status: 202 len: 0 microversion: 2.1 time: 0.314844 Sep 06 11:15:08.589066 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2494/5040] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:08 2022] POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:15:08.593075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fd882443-e52d-4369-9925-98407aadb435 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:08.595234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fd882443-e52d-4369-9925-98407aadb435 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:08.603751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd882443-e52d-4369-9925-98407aadb435 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:08.604462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd882443-e52d-4369-9925-98407aadb435 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:08.605083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd882443-e52d-4369-9925-98407aadb435 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:08.605959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd882443-e52d-4369-9925-98407aadb435 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:08.606644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd882443-e52d-4369-9925-98407aadb435 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:08.607294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd882443-e52d-4369-9925-98407aadb435 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:08.638730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ad706cb6-dcf8-47d7-bdef-78e44441eedd req-a5ea9a3d-8d58-4291-89f9-9b8275546e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "tag": "1918ef7a-2344-47ad-aa5c-49c938fd8469"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:08.651849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ad706cb6-dcf8-47d7-bdef-78e44441eedd req-a5ea9a3d-8d58-4291-89f9-9b8275546e5b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:08.652347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ad706cb6-dcf8-47d7-bdef-78e44441eedd req-a5ea9a3d-8d58-4291-89f9-9b8275546e5b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:08.652803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ad706cb6-dcf8-47d7-bdef-78e44441eedd req-a5ea9a3d-8d58-4291-89f9-9b8275546e5b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:08.666976 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ad706cb6-dcf8-47d7-bdef-78e44441eedd req-a5ea9a3d-8d58-4291-89f9-9b8275546e5b service nova] Creating event network-changed:1918ef7a-2344-47ad-aa5c-49c938fd8469 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:15:08.677389 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ad706cb6-dcf8-47d7-bdef-78e44441eedd req-a5ea9a3d-8d58-4291-89f9-9b8275546e5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039920 Sep 06 11:15:08.679185 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2495/5041] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:15:08.784875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fd882443-e52d-4369-9925-98407aadb435 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:08.795900 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fd882443-e52d-4369-9925-98407aadb435 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1508 microversion: 2.1 time: 0.206740 Sep 06 11:15:08.796709 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2547/5042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:08 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:09.029112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4d2a0f39-0457-418e-ac30-12f17d29e0e0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:09.030944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4d2a0f39-0457-418e-ac30-12f17d29e0e0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:09.047157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d2a0f39-0457-418e-ac30-12f17d29e0e0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:09.047157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d2a0f39-0457-418e-ac30-12f17d29e0e0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:09.047157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d2a0f39-0457-418e-ac30-12f17d29e0e0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:09.059382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d2a0f39-0457-418e-ac30-12f17d29e0e0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:09.060323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d2a0f39-0457-418e-ac30-12f17d29e0e0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:09.064829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d2a0f39-0457-418e-ac30-12f17d29e0e0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:09.242343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4d2a0f39-0457-418e-ac30-12f17d29e0e0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:09.254765 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4d2a0f39-0457-418e-ac30-12f17d29e0e0 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1479 microversion: 2.1 time: 0.235823 Sep 06 11:15:09.258026 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2496/5043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:09 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1479 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:09.828506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3539f8e9-6fe3-4688-b504-70911c28bc2b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:09.830697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3539f8e9-6fe3-4688-b504-70911c28bc2b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:09.838913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3539f8e9-6fe3-4688-b504-70911c28bc2b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:09.839839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3539f8e9-6fe3-4688-b504-70911c28bc2b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:09.840542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3539f8e9-6fe3-4688-b504-70911c28bc2b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:09.841581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3539f8e9-6fe3-4688-b504-70911c28bc2b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:09.842291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3539f8e9-6fe3-4688-b504-70911c28bc2b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:09.843051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3539f8e9-6fe3-4688-b504-70911c28bc2b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:10.064903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3539f8e9-6fe3-4688-b504-70911c28bc2b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:10.073974 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3539f8e9-6fe3-4688-b504-70911c28bc2b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1488 microversion: 2.1 time: 0.249421 Sep 06 11:15:10.094877 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2548/5044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:09 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1488 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:10.106314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b74f5cda-c69c-42e3-bac2-2e8a364b7e94 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:10.107168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b74f5cda-c69c-42e3-bac2-2e8a364b7e94 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:10.116820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b74f5cda-c69c-42e3-bac2-2e8a364b7e94 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:10.117383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b74f5cda-c69c-42e3-bac2-2e8a364b7e94 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:10.117833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b74f5cda-c69c-42e3-bac2-2e8a364b7e94 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:10.118691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b74f5cda-c69c-42e3-bac2-2e8a364b7e94 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:10.119246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b74f5cda-c69c-42e3-bac2-2e8a364b7e94 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:10.119680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b74f5cda-c69c-42e3-bac2-2e8a364b7e94 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:10.150754 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-b74f5cda-c69c-42e3-bac2-2e8a364b7e94 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Cannot 'pause' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state paused Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b74f5cda-c69c-42e3-bac2-2e8a364b7e94 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action HTTP/1.1 Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 13 Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: {"pause": {}} Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: exception: Cannot 'pause' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state paused Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4', 'body': {'pause': {}}} Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 in vm_state paused. Cannot pause while the instance is in this state. Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state paused Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:10.153602 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:10.158377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:10.158377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:10.158377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:10.158377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state paused Sep 06 11:15:10.158377 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:10.160395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b74f5cda-c69c-42e3-bac2-2e8a364b7e94 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 409 to user: Cannot 'pause' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state paused {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:10.167339 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b74f5cda-c69c-42e3-bac2-2e8a364b7e94 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action" status: 409 len: 143 microversion: 2.1 time: 0.062704 Sep 06 11:15:10.167339 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2497/5045] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:10 2022] POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action => generated 143 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 06 11:15:10.175858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-930d4af5-b0ce-4a31-9128-9d4d34201a88 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:10.176735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-930d4af5-b0ce-4a31-9128-9d4d34201a88 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:10.184299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-930d4af5-b0ce-4a31-9128-9d4d34201a88 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:10.185060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-930d4af5-b0ce-4a31-9128-9d4d34201a88 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:10.185701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-930d4af5-b0ce-4a31-9128-9d4d34201a88 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:10.186803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-930d4af5-b0ce-4a31-9128-9d4d34201a88 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:10.187803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-930d4af5-b0ce-4a31-9128-9d4d34201a88 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:10.188465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-930d4af5-b0ce-4a31-9128-9d4d34201a88 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:10.280787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-667954c6-62f4-4479-b78c-dadb30032c53 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:10.282975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-667954c6-62f4-4479-b78c-dadb30032c53 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:10.292130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-667954c6-62f4-4479-b78c-dadb30032c53 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:10.293064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-667954c6-62f4-4479-b78c-dadb30032c53 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:10.294712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-667954c6-62f4-4479-b78c-dadb30032c53 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:10.296229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-667954c6-62f4-4479-b78c-dadb30032c53 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:10.296931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-667954c6-62f4-4479-b78c-dadb30032c53 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:10.297700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-667954c6-62f4-4479-b78c-dadb30032c53 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:10.394723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-667954c6-62f4-4479-b78c-dadb30032c53 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:10.406075 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-667954c6-62f4-4479-b78c-dadb30032c53 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1479 microversion: 2.1 time: 0.129124 Sep 06 11:15:10.407458 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2498/5046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:10 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1479 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:10.492892 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-930d4af5-b0ce-4a31-9128-9d4d34201a88 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action" status: 202 len: 0 microversion: 2.1 time: 0.322477 Sep 06 11:15:10.494443 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2549/5047] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:10 2022] POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:15:10.510841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d610aa65-8971-4468-b3dc-65b55d263b90 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:10.513149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d610aa65-8971-4468-b3dc-65b55d263b90 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:10.535656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d610aa65-8971-4468-b3dc-65b55d263b90 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:10.536899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d610aa65-8971-4468-b3dc-65b55d263b90 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:10.538011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d610aa65-8971-4468-b3dc-65b55d263b90 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:10.540526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d610aa65-8971-4468-b3dc-65b55d263b90 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:10.548358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d610aa65-8971-4468-b3dc-65b55d263b90 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:10.548358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d610aa65-8971-4468-b3dc-65b55d263b90 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:10.703690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-83287948-320c-4883-8168-061699be5938 req-68268abf-1304-493f-89ea-2aa1917ca85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f00cc0c-9676-4ac2-abf0-7c64929d6c20", "name": "network-vif-deleted", "tag": "bb6a1ba7-3663-4600-9de7-a728f5f172b8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:10.780765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-83287948-320c-4883-8168-061699be5938 req-68268abf-1304-493f-89ea-2aa1917ca85a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:10.780765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-83287948-320c-4883-8168-061699be5938 req-68268abf-1304-493f-89ea-2aa1917ca85a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:10.794661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d610aa65-8971-4468-b3dc-65b55d263b90 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:10.803095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-83287948-320c-4883-8168-061699be5938 req-68268abf-1304-493f-89ea-2aa1917ca85a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:10.812085 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d610aa65-8971-4468-b3dc-65b55d263b90 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1495 microversion: 2.1 time: 0.309034 Sep 06 11:15:10.812707 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2499/5048] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:10 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1495 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:10.839868 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-83287948-320c-4883-8168-061699be5938 req-68268abf-1304-493f-89ea-2aa1917ca85a service nova] Creating event network-vif-deleted:bb6a1ba7-3663-4600-9de7-a728f5f172b8 for instance 9f00cc0c-9676-4ac2-abf0-7c64929d6c20 on nch2-master-1 Sep 06 11:15:10.849194 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-83287948-320c-4883-8168-061699be5938 req-68268abf-1304-493f-89ea-2aa1917ca85a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154564 Sep 06 11:15:10.851510 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2550/5049] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:15:11.431763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:11.432367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:11.440678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:11.441386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:11.441820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:11.442536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:11.443205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:11.443652 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:11.481886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:11.482385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:11.483765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:11.484359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lazy-loading 'fault' on Instance uuid 9f00cc0c-9676-4ac2-abf0-7c64929d6c20 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:15:11.549525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:11.559693 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f3190e96-9f57-436e-9a66-d303f5d9c64a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 200 len: 1332 microversion: 2.1 time: 0.131854 Sep 06 11:15:11.560284 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2500/5050] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:11 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 1332 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:11.840927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-80a79723-de89-4e74-9224-8703eff7ece9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:11.842523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-80a79723-de89-4e74-9224-8703eff7ece9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:11.850879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80a79723-de89-4e74-9224-8703eff7ece9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:11.851674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80a79723-de89-4e74-9224-8703eff7ece9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:11.852261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80a79723-de89-4e74-9224-8703eff7ece9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:11.856109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80a79723-de89-4e74-9224-8703eff7ece9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:11.856921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80a79723-de89-4e74-9224-8703eff7ece9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:11.861291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80a79723-de89-4e74-9224-8703eff7ece9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:12.057378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-80a79723-de89-4e74-9224-8703eff7ece9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:12.065839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:12.071780 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-80a79723-de89-4e74-9224-8703eff7ece9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.234957 Sep 06 11:15:12.072932 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2551/5051] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:11 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:12.115826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6d1f6e31-bdb8-44ee-8f24-ce3a2a9a7c15 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:12.116588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6d1f6e31-bdb8-44ee-8f24-ce3a2a9a7c15 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:12.124964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d1f6e31-bdb8-44ee-8f24-ce3a2a9a7c15 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:12.125470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d1f6e31-bdb8-44ee-8f24-ce3a2a9a7c15 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:12.126256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d1f6e31-bdb8-44ee-8f24-ce3a2a9a7c15 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:12.127560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d1f6e31-bdb8-44ee-8f24-ce3a2a9a7c15 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:12.128228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d1f6e31-bdb8-44ee-8f24-ce3a2a9a7c15 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:12.128956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d1f6e31-bdb8-44ee-8f24-ce3a2a9a7c15 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:12.328201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6d1f6e31-bdb8-44ee-8f24-ce3a2a9a7c15 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:12.337141 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6d1f6e31-bdb8-44ee-8f24-ce3a2a9a7c15 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.225336 Sep 06 11:15:12.351065 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2501/5052] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:12 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:12.364556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dab16ff0-b3ee-411b-b06d-1b00d85db818 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:12.366966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dab16ff0-b3ee-411b-b06d-1b00d85db818 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:12.373402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dab16ff0-b3ee-411b-b06d-1b00d85db818 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:12.373898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dab16ff0-b3ee-411b-b06d-1b00d85db818 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:12.374350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dab16ff0-b3ee-411b-b06d-1b00d85db818 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:12.375127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dab16ff0-b3ee-411b-b06d-1b00d85db818 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:12.375596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dab16ff0-b3ee-411b-b06d-1b00d85db818 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:12.376036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dab16ff0-b3ee-411b-b06d-1b00d85db818 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:12.392123 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-dab16ff0-b3ee-411b-b06d-1b00d85db818 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dab16ff0-b3ee-411b-b06d-1b00d85db818 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360/action HTTP/1.1 Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 28 Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: {"reboot": {"type": "SOFT"}} Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ac4d2b81-c9f2-479d-94c5-c637fe0e9360', 'body': {'reboot': {'type': 'SOFT'}}} Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:12.395502 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:12.400168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:15:12.400168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.400168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:12.400168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.400168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:12.400168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:12.400168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:12.400168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:12.400168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:12.400168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:15:12.400168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.402804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dab16ff0-b3ee-411b-b06d-1b00d85db818 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:12.403754 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dab16ff0-b3ee-411b-b06d-1b00d85db818 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360/action" status: 404 len: 111 microversion: 2.1 time: 0.044698 Sep 06 11:15:12.404680 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2552/5053] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:12 2022] POST /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:15:12.416562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93c8761c-c3af-4bca-af8c-0cf2db4e61b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:12.420355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-93c8761c-c3af-4bca-af8c-0cf2db4e61b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:12.430561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93c8761c-c3af-4bca-af8c-0cf2db4e61b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:12.431469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93c8761c-c3af-4bca-af8c-0cf2db4e61b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:12.432118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93c8761c-c3af-4bca-af8c-0cf2db4e61b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:12.433651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93c8761c-c3af-4bca-af8c-0cf2db4e61b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:12.434336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93c8761c-c3af-4bca-af8c-0cf2db4e61b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:12.435124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93c8761c-c3af-4bca-af8c-0cf2db4e61b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:12.583978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5343b5b2-694c-42d5-beac-7bd6b27ca3e3 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:12.584904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5343b5b2-694c-42d5-beac-7bd6b27ca3e3 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 9f00cc0c-9676-4ac2-abf0-7c64929d6c20] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:12.595699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5343b5b2-694c-42d5-beac-7bd6b27ca3e3 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:12.598959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5343b5b2-694c-42d5-beac-7bd6b27ca3e3 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:12.599819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5343b5b2-694c-42d5-beac-7bd6b27ca3e3 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:12.600841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5343b5b2-694c-42d5-beac-7bd6b27ca3e3 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:12.601985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5343b5b2-694c-42d5-beac-7bd6b27ca3e3 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:12.602668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5343b5b2-694c-42d5-beac-7bd6b27ca3e3 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:12.611722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-93c8761c-c3af-4bca-af8c-0cf2db4e61b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:12.621845 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-93c8761c-c3af-4bca-af8c-0cf2db4e61b3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.211874 Sep 06 11:15:12.622966 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2502/5054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:12 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:12.635511 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-5343b5b2-694c-42d5-beac-7bd6b27ca3e3 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] HTTP exception thrown: Instance 9f00cc0c-9676-4ac2-abf0-7c64929d6c20 could not be found. Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5343b5b2-694c-42d5-beac-7bd6b27ca3e3 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Request method failure captured: Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 HTTP/1.1 Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytJdPM-jh_Z-ePAmAMivQUyrcz5ESG5I6zcBNdDuV7OvyCuVdi4tI9c2CuOOCJxfN8Q5JZ2W9GTI0gWWhugye6p5fWdX-WAhKd9kCwSUzL5gcFsEF1VPQSfLOtmdaMYkHp9hp7I3L7HkYr-aHJthtrfRpgCuF4vwDgwuYT9uE7B6t0 Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: deb7f753413a467fb1c86f7463b12563 Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1892704078 Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_deb7f753413a467fb1c86f7463b12563"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/deb7f753413a467fb1c86f7463b12563"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/deb7f753413a467fb1c86f7463b12563"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/deb7f753413a467fb1c86f7463b12563"}]}] Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1892704078 Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: deb7f753413a467fb1c86f7463b12563 Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1892704078 Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TestSecurityGroupsBasicOps-1892704078-project Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 9d49264c495645f38d17ceb03a43195f Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1892704078-project Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 9f00cc0c-9676-4ac2-abf0-7c64929d6c20 could not be found. Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '9f00cc0c-9676-4ac2-abf0-7c64929d6c20'} Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f00cc0c-9676-4ac2-abf0-7c64929d6c20 could not be found. Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f00cc0c-9676-4ac2-abf0-7c64929d6c20 could not be found. Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.644106 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:12.648876 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.648876 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:12.648876 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:12.648876 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:12.648876 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:12.648876 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:12.648876 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f00cc0c-9676-4ac2-abf0-7c64929d6c20 could not be found. Sep 06 11:15:12.648876 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.648876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5343b5b2-694c-42d5-beac-7bd6b27ca3e3 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Returning 404 to user: Instance 9f00cc0c-9676-4ac2-abf0-7c64929d6c20 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:12.648876 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5343b5b2-694c-42d5-beac-7bd6b27ca3e3 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20" status: 404 len: 111 microversion: 2.1 time: 0.059474 Sep 06 11:15:12.650867 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2553/5055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:12 2022] GET /compute/v2.1/servers/9f00cc0c-9676-4ac2-abf0-7c64929d6c20 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:15:12.652679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56eda966-6981-4eb8-9cf0-f23a14fc6ef0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:12.653115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56eda966-6981-4eb8-9cf0-f23a14fc6ef0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:12.660634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56eda966-6981-4eb8-9cf0-f23a14fc6ef0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:12.661144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56eda966-6981-4eb8-9cf0-f23a14fc6ef0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:12.665654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56eda966-6981-4eb8-9cf0-f23a14fc6ef0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:12.665654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56eda966-6981-4eb8-9cf0-f23a14fc6ef0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:12.665654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56eda966-6981-4eb8-9cf0-f23a14fc6ef0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:12.665654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56eda966-6981-4eb8-9cf0-f23a14fc6ef0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:12.897202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-56eda966-6981-4eb8-9cf0-f23a14fc6ef0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:12.924545 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56eda966-6981-4eb8-9cf0-f23a14fc6ef0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.273782 Sep 06 11:15:12.934471 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2503/5056] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:12 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:12.949855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1ab1c0e9-3585-4f35-b9b9-d59d59706049 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:12.963691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1ab1c0e9-3585-4f35-b9b9-d59d59706049 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 85a90ec3-ef43-4cf1-9807-369676e89e97] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:12.969316 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-1ab1c0e9-3585-4f35-b9b9-d59d59706049 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance 85a90ec3-ef43-4cf1-9807-369676e89e97 could not be found. Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1ab1c0e9-3585-4f35-b9b9-d59d59706049 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/85a90ec3-ef43-4cf1-9807-369676e89e97/action HTTP/1.1 Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 28 Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: {"reboot": {"type": "SOFT"}} Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 85a90ec3-ef43-4cf1-9807-369676e89e97 could not be found. Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '85a90ec3-ef43-4cf1-9807-369676e89e97', 'body': {'reboot': {'type': 'SOFT'}}} Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a90ec3-ef43-4cf1-9807-369676e89e97 could not be found. Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a90ec3-ef43-4cf1-9807-369676e89e97 could not be found. Sep 06 11:15:12.971817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.978501 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:12.978501 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.978501 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:12.978501 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:12.978501 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:12.978501 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:12.978501 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:12.978501 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a90ec3-ef43-4cf1-9807-369676e89e97 could not be found. Sep 06 11:15:12.978501 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:12.980989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1ab1c0e9-3585-4f35-b9b9-d59d59706049 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance 85a90ec3-ef43-4cf1-9807-369676e89e97 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:12.982411 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1ab1c0e9-3585-4f35-b9b9-d59d59706049 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/85a90ec3-ef43-4cf1-9807-369676e89e97/action" status: 404 len: 111 microversion: 2.1 time: 0.036963 Sep 06 11:15:12.983796 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2554/5057] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:12 2022] POST /compute/v2.1/servers/85a90ec3-ef43-4cf1-9807-369676e89e97/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:15:13.002011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2d654999-4ba9-4f36-925e-c880e95a16cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:13.002011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2d654999-4ba9-4f36-925e-c880e95a16cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:13.002011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d654999-4ba9-4f36-925e-c880e95a16cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:13.002537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d654999-4ba9-4f36-925e-c880e95a16cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:13.002843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d654999-4ba9-4f36-925e-c880e95a16cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:13.003573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d654999-4ba9-4f36-925e-c880e95a16cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:13.004045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d654999-4ba9-4f36-925e-c880e95a16cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:13.004792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d654999-4ba9-4f36-925e-c880e95a16cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:13.199429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2d654999-4ba9-4f36-925e-c880e95a16cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:13.208669 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2d654999-4ba9-4f36-925e-c880e95a16cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.220064 Sep 06 11:15:13.209267 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2504/5058] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:12 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:13.243826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f6cdda28-8a95-40c6-9820-c65f2b16be2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:13.244533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f6cdda28-8a95-40c6-9820-c65f2b16be2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:13.250809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6cdda28-8a95-40c6-9820-c65f2b16be2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:13.251343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6cdda28-8a95-40c6-9820-c65f2b16be2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:13.252120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6cdda28-8a95-40c6-9820-c65f2b16be2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:13.253074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6cdda28-8a95-40c6-9820-c65f2b16be2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:13.253553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6cdda28-8a95-40c6-9820-c65f2b16be2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:13.254010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f6cdda28-8a95-40c6-9820-c65f2b16be2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:13.439697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f6cdda28-8a95-40c6-9820-c65f2b16be2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:13.447788 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f6cdda28-8a95-40c6-9820-c65f2b16be2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.208953 Sep 06 11:15:13.448793 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2555/5059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:13 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:13.471546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-391c9046-e3c7-44b2-9b05-c03960563b00 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:13.474764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-391c9046-e3c7-44b2-9b05-c03960563b00 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:13.482120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-391c9046-e3c7-44b2-9b05-c03960563b00 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:13.482620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-391c9046-e3c7-44b2-9b05-c03960563b00 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:13.483370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-391c9046-e3c7-44b2-9b05-c03960563b00 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:13.484261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-391c9046-e3c7-44b2-9b05-c03960563b00 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:13.484732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-391c9046-e3c7-44b2-9b05-c03960563b00 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:13.485160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-391c9046-e3c7-44b2-9b05-c03960563b00 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:13.500401 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-391c9046-e3c7-44b2-9b05-c03960563b00 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-391c9046-e3c7-44b2-9b05-c03960563b00 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360/action HTTP/1.1 Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 65 Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'ac4d2b81-c9f2-479d-94c5-c637fe0e9360', 'body': {'rebuild': {'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f'}}} Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 06 11:15:13.502705 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-391c9046-e3c7-44b2-9b05-c03960563b00 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-391c9046-e3c7-44b2-9b05-c03960563b00 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360/action" status: 404 len: 111 microversion: 2.1 time: 0.039793 Sep 06 11:15:13.511337 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2505/5060] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:13 2022] POST /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:15:13.520658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e74f5523-25a4-45bf-87b4-a0e156d47c81 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:13.521983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e74f5523-25a4-45bf-87b4-a0e156d47c81 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:13.540958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e74f5523-25a4-45bf-87b4-a0e156d47c81 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:13.541470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e74f5523-25a4-45bf-87b4-a0e156d47c81 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:13.541916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e74f5523-25a4-45bf-87b4-a0e156d47c81 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:13.542787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e74f5523-25a4-45bf-87b4-a0e156d47c81 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:13.543301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e74f5523-25a4-45bf-87b4-a0e156d47c81 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:13.543741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e74f5523-25a4-45bf-87b4-a0e156d47c81 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:13.769664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e74f5523-25a4-45bf-87b4-a0e156d47c81 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:13.777930 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e74f5523-25a4-45bf-87b4-a0e156d47c81 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.265674 Sep 06 11:15:13.779250 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2556/5061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:13 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:13.806187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-683b73a5-e267-4aee-b2b6-724dcbe060d6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:13.806958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-683b73a5-e267-4aee-b2b6-724dcbe060d6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:13.816883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-683b73a5-e267-4aee-b2b6-724dcbe060d6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:13.817442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-683b73a5-e267-4aee-b2b6-724dcbe060d6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:13.817879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-683b73a5-e267-4aee-b2b6-724dcbe060d6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:13.818620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-683b73a5-e267-4aee-b2b6-724dcbe060d6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:13.819123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-683b73a5-e267-4aee-b2b6-724dcbe060d6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:13.819863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-683b73a5-e267-4aee-b2b6-724dcbe060d6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:14.121644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-683b73a5-e267-4aee-b2b6-724dcbe060d6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:14.134686 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-683b73a5-e267-4aee-b2b6-724dcbe060d6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.332259 Sep 06 11:15:14.135653 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2506/5062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:13 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:14.159773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b8be2fa3-ff3d-429d-b8d8-5e306b161e0f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:14.169261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b8be2fa3-ff3d-429d-b8d8-5e306b161e0f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 6ea59505-786b-4bdb-8529-376fe0b4fec5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:14.177434 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-b8be2fa3-ff3d-429d-b8d8-5e306b161e0f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance 6ea59505-786b-4bdb-8529-376fe0b4fec5 could not be found. Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b8be2fa3-ff3d-429d-b8d8-5e306b161e0f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/6ea59505-786b-4bdb-8529-376fe0b4fec5/action HTTP/1.1 Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 65 Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 6ea59505-786b-4bdb-8529-376fe0b4fec5 could not be found. Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '6ea59505-786b-4bdb-8529-376fe0b4fec5', 'body': {'rebuild': {'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f'}}} Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea59505-786b-4bdb-8529-376fe0b4fec5 could not be found. Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 06 11:15:14.179512 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea59505-786b-4bdb-8529-376fe0b4fec5 could not be found. Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea59505-786b-4bdb-8529-376fe0b4fec5 could not be found. Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b8be2fa3-ff3d-429d-b8d8-5e306b161e0f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance 6ea59505-786b-4bdb-8529-376fe0b4fec5 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:14.186996 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b8be2fa3-ff3d-429d-b8d8-5e306b161e0f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/6ea59505-786b-4bdb-8529-376fe0b4fec5/action" status: 404 len: 111 microversion: 2.1 time: 0.026489 Sep 06 11:15:14.191651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3d41b0c2-c7b4-4493-932b-3945d28807f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:14.192265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3d41b0c2-c7b4-4493-932b-3945d28807f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:14.195522 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2557/5063] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:14 2022] POST /compute/v2.1/servers/6ea59505-786b-4bdb-8529-376fe0b4fec5/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:15:14.202229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d41b0c2-c7b4-4493-932b-3945d28807f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:14.202229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d41b0c2-c7b4-4493-932b-3945d28807f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:14.202229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d41b0c2-c7b4-4493-932b-3945d28807f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:14.202229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d41b0c2-c7b4-4493-932b-3945d28807f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:14.202229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d41b0c2-c7b4-4493-932b-3945d28807f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:14.202229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d41b0c2-c7b4-4493-932b-3945d28807f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:14.393567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3d41b0c2-c7b4-4493-932b-3945d28807f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:14.405543 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3d41b0c2-c7b4-4493-932b-3945d28807f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.218264 Sep 06 11:15:14.406682 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2507/5064] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:14 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:14.429835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-291ae4e5-96fe-44e7-b85f-ea33382fbcc4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:14.430448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-291ae4e5-96fe-44e7-b85f-ea33382fbcc4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:14.438586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-291ae4e5-96fe-44e7-b85f-ea33382fbcc4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:14.439420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-291ae4e5-96fe-44e7-b85f-ea33382fbcc4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:14.440065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-291ae4e5-96fe-44e7-b85f-ea33382fbcc4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:14.441024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-291ae4e5-96fe-44e7-b85f-ea33382fbcc4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:14.441684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-291ae4e5-96fe-44e7-b85f-ea33382fbcc4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:14.442308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-291ae4e5-96fe-44e7-b85f-ea33382fbcc4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:14.598579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-291ae4e5-96fe-44e7-b85f-ea33382fbcc4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:14.608765 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-291ae4e5-96fe-44e7-b85f-ea33382fbcc4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.182831 Sep 06 11:15:14.609863 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2558/5065] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:14 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:14.634736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0673803c-d205-451a-a458-255744ecf66a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:14.635601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0673803c-d205-451a-a458-255744ecf66a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 8cd93d24-aca7-4f6d-b9ba-f81ac97b7b97] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:14.648647 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-0673803c-d205-451a-a458-255744ecf66a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance 8cd93d24-aca7-4f6d-b9ba-f81ac97b7b97 could not be found. Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0673803c-d205-451a-a458-255744ecf66a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/8cd93d24-aca7-4f6d-b9ba-f81ac97b7b97/action HTTP/1.1 Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 15 Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: {"restore": {}} Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 8cd93d24-aca7-4f6d-b9ba-f81ac97b7b97 could not be found. Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '8cd93d24-aca7-4f6d-b9ba-f81ac97b7b97', 'body': {'restore': {}}} Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd93d24-aca7-4f6d-b9ba-f81ac97b7b97 could not be found. Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd93d24-aca7-4f6d-b9ba-f81ac97b7b97 could not be found. Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:14.650609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:14.658695 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:14.658695 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:14.658695 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd93d24-aca7-4f6d-b9ba-f81ac97b7b97 could not be found. Sep 06 11:15:14.658695 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:14.658695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0673803c-d205-451a-a458-255744ecf66a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance 8cd93d24-aca7-4f6d-b9ba-f81ac97b7b97 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:14.658695 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0673803c-d205-451a-a458-255744ecf66a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/8cd93d24-aca7-4f6d-b9ba-f81ac97b7b97/action" status: 404 len: 111 microversion: 2.1 time: 0.022046 Sep 06 11:15:14.658695 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2508/5066] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:14 2022] POST /compute/v2.1/servers/8cd93d24-aca7-4f6d-b9ba-f81ac97b7b97/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:15:14.665727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-82c74c93-e960-4b6c-85c7-df0e85a1ab3d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:14.666811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-82c74c93-e960-4b6c-85c7-df0e85a1ab3d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:14.674671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82c74c93-e960-4b6c-85c7-df0e85a1ab3d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:14.678574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82c74c93-e960-4b6c-85c7-df0e85a1ab3d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:14.678574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82c74c93-e960-4b6c-85c7-df0e85a1ab3d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:14.678574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82c74c93-e960-4b6c-85c7-df0e85a1ab3d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:14.678574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82c74c93-e960-4b6c-85c7-df0e85a1ab3d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:14.678574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82c74c93-e960-4b6c-85c7-df0e85a1ab3d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:14.873835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-82c74c93-e960-4b6c-85c7-df0e85a1ab3d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:14.896228 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-82c74c93-e960-4b6c-85c7-df0e85a1ab3d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.235275 Sep 06 11:15:14.897162 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2559/5067] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:14 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:14.922839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c84c423-aeef-4c19-b4e3-7347ee7b7de4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:14.923589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3c84c423-aeef-4c19-b4e3-7347ee7b7de4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:14.931337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c84c423-aeef-4c19-b4e3-7347ee7b7de4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:14.931888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c84c423-aeef-4c19-b4e3-7347ee7b7de4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:14.932298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c84c423-aeef-4c19-b4e3-7347ee7b7de4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:14.933026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c84c423-aeef-4c19-b4e3-7347ee7b7de4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:14.933498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c84c423-aeef-4c19-b4e3-7347ee7b7de4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:14.933928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c84c423-aeef-4c19-b4e3-7347ee7b7de4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:14.938751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:15.178656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c84c423-aeef-4c19-b4e3-7347ee7b7de4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:15.191549 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3c84c423-aeef-4c19-b4e3-7347ee7b7de4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.272575 Sep 06 11:15:15.203689 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2509/5068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:14 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:15.226094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c8e89841-04a8-4bfe-8e7c-ea65340d72a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:15.227567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c8e89841-04a8-4bfe-8e7c-ea65340d72a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:15.242574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8e89841-04a8-4bfe-8e7c-ea65340d72a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:15.243191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8e89841-04a8-4bfe-8e7c-ea65340d72a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:15.243915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8e89841-04a8-4bfe-8e7c-ea65340d72a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:15.245006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8e89841-04a8-4bfe-8e7c-ea65340d72a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:15.245712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8e89841-04a8-4bfe-8e7c-ea65340d72a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:15.246431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8e89841-04a8-4bfe-8e7c-ea65340d72a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:15.276355 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-c8e89841-04a8-4bfe-8e7c-ea65340d72a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Cannot 'restore' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c8e89841-04a8-4bfe-8e7c-ea65340d72a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action HTTP/1.1 Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 15 Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: {"restore": {}} Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: exception: Cannot 'restore' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4', 'body': {'restore': {}}} Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 in vm_state active. Cannot restore while the instance is in this state. Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:15.277841 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:15.286977 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:15.286977 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:15.286977 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:15.286977 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:15:15.286977 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:15.286977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c8e89841-04a8-4bfe-8e7c-ea65340d72a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 409 to user: Cannot 'restore' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:15.286977 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c8e89841-04a8-4bfe-8e7c-ea65340d72a8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action" status: 409 len: 145 microversion: 2.1 time: 0.058899 Sep 06 11:15:15.286977 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2560/5069] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:15 2022] POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action => generated 145 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:15:15.294976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-450a264b-88c5-43cd-bba3-7a1d4930bddc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:15.295891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-450a264b-88c5-43cd-bba3-7a1d4930bddc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:15.298378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:15.304928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-450a264b-88c5-43cd-bba3-7a1d4930bddc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:15.310945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-450a264b-88c5-43cd-bba3-7a1d4930bddc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:15.310945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-450a264b-88c5-43cd-bba3-7a1d4930bddc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:15.310945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-450a264b-88c5-43cd-bba3-7a1d4930bddc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:15.310945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-450a264b-88c5-43cd-bba3-7a1d4930bddc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:15.310945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-450a264b-88c5-43cd-bba3-7a1d4930bddc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:15.558760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-450a264b-88c5-43cd-bba3-7a1d4930bddc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:15.571150 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-450a264b-88c5-43cd-bba3-7a1d4930bddc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.281516 Sep 06 11:15:15.584682 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2510/5070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:15 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:15.596393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a07e8ff7-56e2-433b-a046-eea6ee742e6a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:15.597195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a07e8ff7-56e2-433b-a046-eea6ee742e6a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:15.632608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a07e8ff7-56e2-433b-a046-eea6ee742e6a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:15.634012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a07e8ff7-56e2-433b-a046-eea6ee742e6a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:15.636139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a07e8ff7-56e2-433b-a046-eea6ee742e6a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:15.638303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a07e8ff7-56e2-433b-a046-eea6ee742e6a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:15.639634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a07e8ff7-56e2-433b-a046-eea6ee742e6a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:15.642680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a07e8ff7-56e2-433b-a046-eea6ee742e6a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:15.990626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a07e8ff7-56e2-433b-a046-eea6ee742e6a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:16.021346 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a07e8ff7-56e2-433b-a046-eea6ee742e6a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.429516 Sep 06 11:15:16.022581 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2561/5071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:15 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:16.063681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3722b8b-f298-4ea9-9e94-b1d49449a4d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:16.065013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f3722b8b-f298-4ea9-9e94-b1d49449a4d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: bdbf45ea-10df-42ed-91e5-ef9c53e123af] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:16.095978 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-f3722b8b-f298-4ea9-9e94-b1d49449a4d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance bdbf45ea-10df-42ed-91e5-ef9c53e123af could not be found. Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3722b8b-f298-4ea9-9e94-b1d49449a4d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/bdbf45ea-10df-42ed-91e5-ef9c53e123af/action HTTP/1.1 Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 14 Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: {"resume": {}} Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance bdbf45ea-10df-42ed-91e5-ef9c53e123af could not be found. Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'bdbf45ea-10df-42ed-91e5-ef9c53e123af', 'body': {'resume': {}}} Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbf45ea-10df-42ed-91e5-ef9c53e123af could not be found. Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbf45ea-10df-42ed-91e5-ef9c53e123af could not be found. Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:16.104177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:16.109565 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:16.109565 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:16.109565 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbf45ea-10df-42ed-91e5-ef9c53e123af could not be found. Sep 06 11:15:16.109565 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:16.109565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3722b8b-f298-4ea9-9e94-b1d49449a4d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance bdbf45ea-10df-42ed-91e5-ef9c53e123af could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:16.109565 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f3722b8b-f298-4ea9-9e94-b1d49449a4d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/bdbf45ea-10df-42ed-91e5-ef9c53e123af/action" status: 404 len: 111 microversion: 2.1 time: 0.061522 Sep 06 11:15:16.109565 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2511/5072] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:16 2022] POST /compute/v2.1/servers/bdbf45ea-10df-42ed-91e5-ef9c53e123af/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:15:16.118461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8f9370ef-50d1-4dd3-9806-f69eb2967563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:16.119150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8f9370ef-50d1-4dd3-9806-f69eb2967563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:16.129975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f9370ef-50d1-4dd3-9806-f69eb2967563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:16.131820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f9370ef-50d1-4dd3-9806-f69eb2967563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:16.133696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f9370ef-50d1-4dd3-9806-f69eb2967563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:16.134722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f9370ef-50d1-4dd3-9806-f69eb2967563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:16.137763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f9370ef-50d1-4dd3-9806-f69eb2967563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:16.138514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f9370ef-50d1-4dd3-9806-f69eb2967563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:16.806102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8f9370ef-50d1-4dd3-9806-f69eb2967563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:16.818667 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8f9370ef-50d1-4dd3-9806-f69eb2967563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.705124 Sep 06 11:15:16.819859 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2562/5073] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:16 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:16.848453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c8a6b2ce-4dc2-4f63-b943-2cd0fe1c583d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:16.849478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c8a6b2ce-4dc2-4f63-b943-2cd0fe1c583d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:16.861522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8a6b2ce-4dc2-4f63-b943-2cd0fe1c583d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:16.862477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8a6b2ce-4dc2-4f63-b943-2cd0fe1c583d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:16.863091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8a6b2ce-4dc2-4f63-b943-2cd0fe1c583d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:16.864622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8a6b2ce-4dc2-4f63-b943-2cd0fe1c583d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:16.865371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8a6b2ce-4dc2-4f63-b943-2cd0fe1c583d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:16.867326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8a6b2ce-4dc2-4f63-b943-2cd0fe1c583d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:17.209820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c8a6b2ce-4dc2-4f63-b943-2cd0fe1c583d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:17.225547 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c8a6b2ce-4dc2-4f63-b943-2cd0fe1c583d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.382786 Sep 06 11:15:17.226144 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2512/5074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:16 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:17.248339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bcc947f3-5f9d-46eb-8554-476975396460 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:17.248905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bcc947f3-5f9d-46eb-8554-476975396460 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:17.256863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcc947f3-5f9d-46eb-8554-476975396460 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:17.263474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcc947f3-5f9d-46eb-8554-476975396460 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:17.263474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcc947f3-5f9d-46eb-8554-476975396460 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:17.263474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcc947f3-5f9d-46eb-8554-476975396460 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:17.263474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcc947f3-5f9d-46eb-8554-476975396460 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:17.263474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcc947f3-5f9d-46eb-8554-476975396460 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:17.287082 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-bcc947f3-5f9d-46eb-8554-476975396460 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Cannot 'resume' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bcc947f3-5f9d-46eb-8554-476975396460 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action HTTP/1.1 Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 14 Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: {"resume": {}} Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: exception: Cannot 'resume' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4', 'body': {'resume': {}}} Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 in vm_state active. Cannot resume while the instance is in this state. Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:17.289166 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:17.299315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:17.299315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:17.299315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:17.299315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:17.299315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:17.299315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:15:17.299315 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:17.299315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bcc947f3-5f9d-46eb-8554-476975396460 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 409 to user: Cannot 'resume' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:17.299315 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bcc947f3-5f9d-46eb-8554-476975396460 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action" status: 409 len: 144 microversion: 2.1 time: 0.046609 Sep 06 11:15:17.299315 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2563/5075] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:17 2022] POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action => generated 144 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:15:17.302177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7304e25e-b598-476a-91d6-a73e7e6438cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:17.302898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7304e25e-b598-476a-91d6-a73e7e6438cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:17.310188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7304e25e-b598-476a-91d6-a73e7e6438cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:17.310860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7304e25e-b598-476a-91d6-a73e7e6438cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:17.311431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7304e25e-b598-476a-91d6-a73e7e6438cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:17.312227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7304e25e-b598-476a-91d6-a73e7e6438cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:17.312690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7304e25e-b598-476a-91d6-a73e7e6438cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:17.313150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7304e25e-b598-476a-91d6-a73e7e6438cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:17.536747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7304e25e-b598-476a-91d6-a73e7e6438cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:17.547921 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7304e25e-b598-476a-91d6-a73e7e6438cd tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.251723 Sep 06 11:15:17.560197 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2513/5076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:17 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:17.577619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-59261d1a-91e4-490d-99c1-54e1a0d35f6d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:17.578715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-59261d1a-91e4-490d-99c1-54e1a0d35f6d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:17.589124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59261d1a-91e4-490d-99c1-54e1a0d35f6d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:17.589783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59261d1a-91e4-490d-99c1-54e1a0d35f6d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:17.590323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59261d1a-91e4-490d-99c1-54e1a0d35f6d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:17.591184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59261d1a-91e4-490d-99c1-54e1a0d35f6d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:17.591957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59261d1a-91e4-490d-99c1-54e1a0d35f6d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:17.600890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59261d1a-91e4-490d-99c1-54e1a0d35f6d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:17.993502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-59261d1a-91e4-490d-99c1-54e1a0d35f6d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:18.019621 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-59261d1a-91e4-490d-99c1-54e1a0d35f6d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.449052 Sep 06 11:15:18.037004 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2564/5077] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:17 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:18.275886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f1ae756a-5b6e-4009-a821-3e54b54e66ae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f1ae756a-5b6e-4009-a821-3e54b54e66ae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 160 Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": "", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "b9ea5ffd-3051-44b1-b178-c09345529f6f"}]}} Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'body': {'server': {'name': '', 'imageRef': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'flavorRef': '452', 'networks': [{'uuid': 'b9ea5ffd-3051-44b1-b178-c09345529f6f'}]}}} Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi '' Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:15:18.281024 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:15:18.287227 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:15:18.287227 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 06 11:15:18.287227 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:18.287227 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:18.287227 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:18.287227 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:18.287227 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:18.287227 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:18.287227 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:15:18.287227 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:15:18.287227 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 06 11:15:18.287227 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:18.289539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f1ae756a-5b6e-4009-a821-3e54b54e66ae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:18.292099 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f1ae756a-5b6e-4009-a821-3e54b54e66ae tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021203 Sep 06 11:15:18.293477 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2514/5078] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:15:18 2022] POST /compute/v2.1/servers => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:15:18.304979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f9552bce-155e-4bc7-9daa-5331bc5091ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:18.305607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f9552bce-155e-4bc7-9daa-5331bc5091ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:18.313417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9552bce-155e-4bc7-9daa-5331bc5091ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:18.314613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9552bce-155e-4bc7-9daa-5331bc5091ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:18.315382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9552bce-155e-4bc7-9daa-5331bc5091ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:18.316275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9552bce-155e-4bc7-9daa-5331bc5091ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:18.316702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9552bce-155e-4bc7-9daa-5331bc5091ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:18.317144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9552bce-155e-4bc7-9daa-5331bc5091ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:18.566983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f9552bce-155e-4bc7-9daa-5331bc5091ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:18.584551 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f9552bce-155e-4bc7-9daa-5331bc5091ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.284857 Sep 06 11:15:18.589903 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2565/5079] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:18 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:18.612144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-397cfa5f-87d4-4925-9920-1b64a64f2db3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:18.612952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-397cfa5f-87d4-4925-9920-1b64a64f2db3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:18.622186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-397cfa5f-87d4-4925-9920-1b64a64f2db3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:18.622704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-397cfa5f-87d4-4925-9920-1b64a64f2db3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:18.623220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-397cfa5f-87d4-4925-9920-1b64a64f2db3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:18.624509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-397cfa5f-87d4-4925-9920-1b64a64f2db3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:18.625002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-397cfa5f-87d4-4925-9920-1b64a64f2db3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:18.625691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-397cfa5f-87d4-4925-9920-1b64a64f2db3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:18.925132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-397cfa5f-87d4-4925-9920-1b64a64f2db3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:18.933945 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-397cfa5f-87d4-4925-9920-1b64a64f2db3 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.329824 Sep 06 11:15:18.934736 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2515/5080] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:18 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:18.964392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-35b38014-c4df-4a4a-8895-e409c7ff8255 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:18.964392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-35b38014-c4df-4a4a-8895-e409c7ff8255 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 80fa3eba-e719-4d1d-abd4-3439e25b3d33] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:18.971387 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-35b38014-c4df-4a4a-8895-e409c7ff8255 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance 80fa3eba-e719-4d1d-abd4-3439e25b3d33 could not be found. Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-35b38014-c4df-4a4a-8895-e409c7ff8255 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/80fa3eba-e719-4d1d-abd4-3439e25b3d33/action HTTP/1.1 Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 14 Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: {"shelve": {}} Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 80fa3eba-e719-4d1d-abd4-3439e25b3d33 could not be found. Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '80fa3eba-e719-4d1d-abd4-3439e25b3d33', 'body': {'shelve': {}}} Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80fa3eba-e719-4d1d-abd4-3439e25b3d33 could not be found. Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80fa3eba-e719-4d1d-abd4-3439e25b3d33 could not be found. Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:18.976946 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:18.981897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:18.981897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:18.981897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80fa3eba-e719-4d1d-abd4-3439e25b3d33 could not be found. Sep 06 11:15:18.981897 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:15:18.984331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-35b38014-c4df-4a4a-8895-e409c7ff8255 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance 80fa3eba-e719-4d1d-abd4-3439e25b3d33 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:18.997551 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-35b38014-c4df-4a4a-8895-e409c7ff8255 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/80fa3eba-e719-4d1d-abd4-3439e25b3d33/action" status: 404 len: 111 microversion: 2.1 time: 0.034877 Sep 06 11:15:18.997551 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2566/5081] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:18 2022] POST /compute/v2.1/servers/80fa3eba-e719-4d1d-abd4-3439e25b3d33/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:15:19.011932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cf6daced-f64f-4e7c-b4cb-01a0e3a7a619 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:19.012974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cf6daced-f64f-4e7c-b4cb-01a0e3a7a619 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:19.028049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf6daced-f64f-4e7c-b4cb-01a0e3a7a619 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:19.032063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf6daced-f64f-4e7c-b4cb-01a0e3a7a619 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:19.032063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf6daced-f64f-4e7c-b4cb-01a0e3a7a619 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:19.032063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf6daced-f64f-4e7c-b4cb-01a0e3a7a619 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:19.032063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf6daced-f64f-4e7c-b4cb-01a0e3a7a619 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:19.032063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf6daced-f64f-4e7c-b4cb-01a0e3a7a619 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:19.274649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cf6daced-f64f-4e7c-b4cb-01a0e3a7a619 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:19.288063 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cf6daced-f64f-4e7c-b4cb-01a0e3a7a619 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.286964 Sep 06 11:15:19.289182 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2516/5082] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:18 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:19.313262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5c95b2b3-525c-4493-92b2-cfe28ab1a7f7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:19.314414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5c95b2b3-525c-4493-92b2-cfe28ab1a7f7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:19.318104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:19.323163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c95b2b3-525c-4493-92b2-cfe28ab1a7f7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:19.323767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c95b2b3-525c-4493-92b2-cfe28ab1a7f7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:19.326347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c95b2b3-525c-4493-92b2-cfe28ab1a7f7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:19.327110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c95b2b3-525c-4493-92b2-cfe28ab1a7f7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:19.327580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c95b2b3-525c-4493-92b2-cfe28ab1a7f7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:19.328190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c95b2b3-525c-4493-92b2-cfe28ab1a7f7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:19.563225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5c95b2b3-525c-4493-92b2-cfe28ab1a7f7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:19.572088 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5c95b2b3-525c-4493-92b2-cfe28ab1a7f7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.262717 Sep 06 11:15:19.573500 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2567/5083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:19 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:19.595787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-597f3a3a-f7cc-4d30-8152-4e585629e174 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:19.596656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-597f3a3a-f7cc-4d30-8152-4e585629e174 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:19.604174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-597f3a3a-f7cc-4d30-8152-4e585629e174 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:19.604951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-597f3a3a-f7cc-4d30-8152-4e585629e174 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:19.613208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-597f3a3a-f7cc-4d30-8152-4e585629e174 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:19.613208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-597f3a3a-f7cc-4d30-8152-4e585629e174 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:19.613208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-597f3a3a-f7cc-4d30-8152-4e585629e174 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:19.613208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-597f3a3a-f7cc-4d30-8152-4e585629e174 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:19.659676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-597f3a3a-f7cc-4d30-8152-4e585629e174 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lazy-loading 'flavor' on Instance uuid 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:15:20.084614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba9b47c5-a28c-477a-a162-0559197ba981 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:20.087225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ba9b47c5-a28c-477a-a162-0559197ba981 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:20.101074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba9b47c5-a28c-477a-a162-0559197ba981 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:20.107573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba9b47c5-a28c-477a-a162-0559197ba981 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:20.108420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba9b47c5-a28c-477a-a162-0559197ba981 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:20.109415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba9b47c5-a28c-477a-a162-0559197ba981 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:20.110080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba9b47c5-a28c-477a-a162-0559197ba981 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:20.111517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba9b47c5-a28c-477a-a162-0559197ba981 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:20.156510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ba9b47c5-a28c-477a-a162-0559197ba981 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:15:20.489684 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-597f3a3a-f7cc-4d30-8152-4e585629e174 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action" status: 202 len: 0 microversion: 2.1 time: 0.897662 Sep 06 11:15:20.496917 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2517/5084] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:15:19 2022] POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action => generated 0 bytes in 906 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:15:20.503049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-3aadebf4-3592-40c0-909c-64bc0cf26328 req-e1198d31-895b-4087-88cf-68cd16a5d758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ddbde28-f59b-4bdd-82a7-6dfc37a97585", "tag": "fd0e55dc-cde7-4ba7-acda-9db7705724f6"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:20.519234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3aadebf4-3592-40c0-909c-64bc0cf26328 req-e1198d31-895b-4087-88cf-68cd16a5d758 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:20.519746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3aadebf4-3592-40c0-909c-64bc0cf26328 req-e1198d31-895b-4087-88cf-68cd16a5d758 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:20.521075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3aadebf4-3592-40c0-909c-64bc0cf26328 req-e1198d31-895b-4087-88cf-68cd16a5d758 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:20.537817 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-3aadebf4-3592-40c0-909c-64bc0cf26328 req-e1198d31-895b-4087-88cf-68cd16a5d758 service nova] Creating event network-changed:fd0e55dc-cde7-4ba7-acda-9db7705724f6 for instance 3ddbde28-f59b-4bdd-82a7-6dfc37a97585 on nch1-master-1 Sep 06 11:15:20.548792 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-3aadebf4-3592-40c0-909c-64bc0cf26328 req-e1198d31-895b-4087-88cf-68cd16a5d758 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048027 Sep 06 11:15:20.548792 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2518/5085] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:15:20.556561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f5ca84a8-29d7-4afd-ac9f-0e76331f6326 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:20.557307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f5ca84a8-29d7-4afd-ac9f-0e76331f6326 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:20.589152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5ca84a8-29d7-4afd-ac9f-0e76331f6326 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:20.590105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5ca84a8-29d7-4afd-ac9f-0e76331f6326 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:20.591062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5ca84a8-29d7-4afd-ac9f-0e76331f6326 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:20.592237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5ca84a8-29d7-4afd-ac9f-0e76331f6326 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:20.593199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5ca84a8-29d7-4afd-ac9f-0e76331f6326 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:20.593913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f5ca84a8-29d7-4afd-ac9f-0e76331f6326 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:20.756741 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ba9b47c5-a28c-477a-a162-0559197ba981 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 204 len: 0 microversion: 2.1 time: 0.669741 Sep 06 11:15:20.756741 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2568/5086] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:15:20 2022] DELETE /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:15:20.772993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8971d0aa-8bf2-48e3-b004-ab7a1db57b7a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:20.774905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8971d0aa-8bf2-48e3-b004-ab7a1db57b7a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:20.789267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8971d0aa-8bf2-48e3-b004-ab7a1db57b7a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:20.790003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8971d0aa-8bf2-48e3-b004-ab7a1db57b7a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:20.790625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8971d0aa-8bf2-48e3-b004-ab7a1db57b7a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:20.792012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8971d0aa-8bf2-48e3-b004-ab7a1db57b7a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:20.792637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8971d0aa-8bf2-48e3-b004-ab7a1db57b7a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:20.793202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8971d0aa-8bf2-48e3-b004-ab7a1db57b7a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:20.923445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f5ca84a8-29d7-4afd-ac9f-0e76331f6326 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:20.945090 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f5ca84a8-29d7-4afd-ac9f-0e76331f6326 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.394076 Sep 06 11:15:20.959317 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2519/5087] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:20 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:21.069420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8971d0aa-8bf2-48e3-b004-ab7a1db57b7a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:21.081698 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8971d0aa-8bf2-48e3-b004-ab7a1db57b7a tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1767 microversion: 2.1 time: 0.321360 Sep 06 11:15:21.082504 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2569/5088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:20 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1767 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:21.980360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fb5c96a6-ede3-4e47-8d11-8efaa8b097d2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:21.981287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb5c96a6-ede3-4e47-8d11-8efaa8b097d2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:21.990250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb5c96a6-ede3-4e47-8d11-8efaa8b097d2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:21.992256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb5c96a6-ede3-4e47-8d11-8efaa8b097d2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:21.994840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb5c96a6-ede3-4e47-8d11-8efaa8b097d2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:21.996206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb5c96a6-ede3-4e47-8d11-8efaa8b097d2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:21.997427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb5c96a6-ede3-4e47-8d11-8efaa8b097d2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:21.998124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb5c96a6-ede3-4e47-8d11-8efaa8b097d2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:22.106032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-62d45d7a-c4a1-4ad8-ab56-5b5c865fffd9 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:22.107479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-62d45d7a-c4a1-4ad8-ab56-5b5c865fffd9 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:22.116020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62d45d7a-c4a1-4ad8-ab56-5b5c865fffd9 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:22.116882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62d45d7a-c4a1-4ad8-ab56-5b5c865fffd9 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:22.117522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62d45d7a-c4a1-4ad8-ab56-5b5c865fffd9 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:22.118264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62d45d7a-c4a1-4ad8-ab56-5b5c865fffd9 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:22.118911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62d45d7a-c4a1-4ad8-ab56-5b5c865fffd9 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:22.119383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62d45d7a-c4a1-4ad8-ab56-5b5c865fffd9 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:22.536078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-62d45d7a-c4a1-4ad8-ab56-5b5c865fffd9 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:22.546740 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-62d45d7a-c4a1-4ad8-ab56-5b5c865fffd9 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1767 microversion: 2.1 time: 0.444782 Sep 06 11:15:22.551655 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2570/5089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:22 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1767 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:22.652708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb5c96a6-ede3-4e47-8d11-8efaa8b097d2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:22.665671 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fb5c96a6-ede3-4e47-8d11-8efaa8b097d2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.689078 Sep 06 11:15:22.666550 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2520/5090] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:21 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:23.344200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-7ecb7e11-c064-419b-b60f-93d776fadcec req-95173f45-ccfa-4f93-8d43-78ac9fb02bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ddbde28-f59b-4bdd-82a7-6dfc37a97585", "name": "network-vif-deleted", "tag": "fd0e55dc-cde7-4ba7-acda-9db7705724f6"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:23.361276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ecb7e11-c064-419b-b60f-93d776fadcec req-95173f45-ccfa-4f93-8d43-78ac9fb02bce service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:23.361959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ecb7e11-c064-419b-b60f-93d776fadcec req-95173f45-ccfa-4f93-8d43-78ac9fb02bce service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:23.362696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ecb7e11-c064-419b-b60f-93d776fadcec req-95173f45-ccfa-4f93-8d43-78ac9fb02bce service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:23.376311 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-7ecb7e11-c064-419b-b60f-93d776fadcec req-95173f45-ccfa-4f93-8d43-78ac9fb02bce service nova] Creating event network-vif-deleted:fd0e55dc-cde7-4ba7-acda-9db7705724f6 for instance 3ddbde28-f59b-4bdd-82a7-6dfc37a97585 on nch1-master-1 Sep 06 11:15:23.382135 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-7ecb7e11-c064-419b-b60f-93d776fadcec req-95173f45-ccfa-4f93-8d43-78ac9fb02bce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044017 Sep 06 11:15:23.383295 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2571/5091] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:15:23.573218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-84ac5d00-1296-49b5-8a05-0962de3c83c7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:23.573871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-84ac5d00-1296-49b5-8a05-0962de3c83c7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:23.584961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84ac5d00-1296-49b5-8a05-0962de3c83c7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:23.586366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84ac5d00-1296-49b5-8a05-0962de3c83c7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:23.586831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84ac5d00-1296-49b5-8a05-0962de3c83c7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:23.588134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84ac5d00-1296-49b5-8a05-0962de3c83c7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:23.588616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84ac5d00-1296-49b5-8a05-0962de3c83c7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:23.589058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-84ac5d00-1296-49b5-8a05-0962de3c83c7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:23.696326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-55b34dd9-203e-425f-bd66-03a9c4a61754 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:23.697236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-55b34dd9-203e-425f-bd66-03a9c4a61754 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:23.705489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55b34dd9-203e-425f-bd66-03a9c4a61754 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:23.729266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55b34dd9-203e-425f-bd66-03a9c4a61754 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:23.729266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55b34dd9-203e-425f-bd66-03a9c4a61754 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:23.729266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55b34dd9-203e-425f-bd66-03a9c4a61754 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:23.729266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55b34dd9-203e-425f-bd66-03a9c4a61754 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:23.729266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55b34dd9-203e-425f-bd66-03a9c4a61754 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:23.747307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:23.753283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-84ac5d00-1296-49b5-8a05-0962de3c83c7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49264c495645f38d17ceb03a43195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb7f753413a467fb1c86f7463b12563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:23.777860 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-84ac5d00-1296-49b5-8a05-0962de3c83c7 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 200 len: 1380 microversion: 2.1 time: 0.209320 Sep 06 11:15:23.781584 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2521/5092] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:23 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 1380 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:24.048817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-55b34dd9-203e-425f-bd66-03a9c4a61754 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:24.058074 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-55b34dd9-203e-425f-bd66-03a9c4a61754 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.366566 Sep 06 11:15:24.058980 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2572/5093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:23 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:24.809026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-336b35a2-0b06-4357-8fc4-8a40b15e8f34 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:24.810371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-336b35a2-0b06-4357-8fc4-8a40b15e8f34 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] [instance: 3ddbde28-f59b-4bdd-82a7-6dfc37a97585] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:24.824519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-336b35a2-0b06-4357-8fc4-8a40b15e8f34 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:24.825322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-336b35a2-0b06-4357-8fc4-8a40b15e8f34 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:24.825984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-336b35a2-0b06-4357-8fc4-8a40b15e8f34 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:24.827632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-336b35a2-0b06-4357-8fc4-8a40b15e8f34 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:24.828866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-336b35a2-0b06-4357-8fc4-8a40b15e8f34 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:24.830198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-336b35a2-0b06-4357-8fc4-8a40b15e8f34 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:24.850590 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-336b35a2-0b06-4357-8fc4-8a40b15e8f34 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] HTTP exception thrown: Instance 3ddbde28-f59b-4bdd-82a7-6dfc37a97585 could not be found. Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-336b35a2-0b06-4357-8fc4-8a40b15e8f34 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Request method failure captured: Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 HTTP/1.1 Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytJdPM-jh_Z-ePAmAMivQUyrcz5ESG5I6zcBNdDuV7OvyCuVdi4tI9c2CuOOCJxfN8Q5JZ2W9GTI0gWWhugye6p5fWdX-WAhKd9kCwSUzL5gcFsEF1VPQSfLOtmdaMYkHp9hp7I3L7HkYr-aHJthtrfRpgCuF4vwDgwuYT9uE7B6t0 Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: deb7f753413a467fb1c86f7463b12563 Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1892704078 Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_deb7f753413a467fb1c86f7463b12563"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/deb7f753413a467fb1c86f7463b12563"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/deb7f753413a467fb1c86f7463b12563"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/deb7f753413a467fb1c86f7463b12563"}]}] Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1892704078 Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: deb7f753413a467fb1c86f7463b12563 Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1892704078 Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestSecurityGroupsBasicOps-1892704078-project Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 9d49264c495645f38d17ceb03a43195f Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1892704078-project Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 3ddbde28-f59b-4bdd-82a7-6dfc37a97585 could not be found. Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '3ddbde28-f59b-4bdd-82a7-6dfc37a97585'} Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ddbde28-f59b-4bdd-82a7-6dfc37a97585 could not be found. Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ddbde28-f59b-4bdd-82a7-6dfc37a97585 could not be found. Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:24.852485 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:24.857094 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:24.857094 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:24.857094 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:24.857094 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:24.857094 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:24.857094 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:24.857094 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ddbde28-f59b-4bdd-82a7-6dfc37a97585 could not be found. Sep 06 11:15:24.857094 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:24.859570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-336b35a2-0b06-4357-8fc4-8a40b15e8f34 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Returning 404 to user: Instance 3ddbde28-f59b-4bdd-82a7-6dfc37a97585 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:24.860754 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-336b35a2-0b06-4357-8fc4-8a40b15e8f34 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585" status: 404 len: 111 microversion: 2.1 time: 0.057892 Sep 06 11:15:24.861640 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2522/5094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:24 2022] GET /compute/v2.1/servers/3ddbde28-f59b-4bdd-82a7-6dfc37a97585 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:15:25.087491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0c33950f-b5fd-431e-964b-539c59ad11cb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:25.088849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0c33950f-b5fd-431e-964b-539c59ad11cb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:25.097336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c33950f-b5fd-431e-964b-539c59ad11cb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:25.098121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c33950f-b5fd-431e-964b-539c59ad11cb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:25.098760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c33950f-b5fd-431e-964b-539c59ad11cb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:25.099716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c33950f-b5fd-431e-964b-539c59ad11cb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:25.100343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c33950f-b5fd-431e-964b-539c59ad11cb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:25.100958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c33950f-b5fd-431e-964b-539c59ad11cb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:25.643911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0c33950f-b5fd-431e-964b-539c59ad11cb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:25.657414 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0c33950f-b5fd-431e-964b-539c59ad11cb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.574067 Sep 06 11:15:25.663975 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2573/5095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:25 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:26.686557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-daf8977b-0a3b-4e68-a6a8-f5ecb85ac91e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:26.687254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-daf8977b-0a3b-4e68-a6a8-f5ecb85ac91e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:26.697722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-daf8977b-0a3b-4e68-a6a8-f5ecb85ac91e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:26.697978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-daf8977b-0a3b-4e68-a6a8-f5ecb85ac91e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:26.698231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-daf8977b-0a3b-4e68-a6a8-f5ecb85ac91e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:26.699246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-daf8977b-0a3b-4e68-a6a8-f5ecb85ac91e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:26.699720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-daf8977b-0a3b-4e68-a6a8-f5ecb85ac91e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:26.700161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-daf8977b-0a3b-4e68-a6a8-f5ecb85ac91e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:26.867120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-daf8977b-0a3b-4e68-a6a8-f5ecb85ac91e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:26.877000 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-daf8977b-0a3b-4e68-a6a8-f5ecb85ac91e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.193731 Sep 06 11:15:26.885099 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2523/5096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:26 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:27.912371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-73eda6c4-3b94-48fb-8ecf-64d60609bbb8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:27.914541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-73eda6c4-3b94-48fb-8ecf-64d60609bbb8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:27.936482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73eda6c4-3b94-48fb-8ecf-64d60609bbb8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:27.937832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73eda6c4-3b94-48fb-8ecf-64d60609bbb8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:27.938960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73eda6c4-3b94-48fb-8ecf-64d60609bbb8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:27.940264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73eda6c4-3b94-48fb-8ecf-64d60609bbb8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:27.941151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73eda6c4-3b94-48fb-8ecf-64d60609bbb8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:27.941848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73eda6c4-3b94-48fb-8ecf-64d60609bbb8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:28.166883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-73eda6c4-3b94-48fb-8ecf-64d60609bbb8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:28.176017 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-73eda6c4-3b94-48fb-8ecf-64d60609bbb8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.271303 Sep 06 11:15:28.177079 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2574/5097] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:27 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:29.199143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-674603aa-096a-4924-8fa6-12fdef03b21d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:29.199764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-674603aa-096a-4924-8fa6-12fdef03b21d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:29.206932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-674603aa-096a-4924-8fa6-12fdef03b21d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:29.207643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-674603aa-096a-4924-8fa6-12fdef03b21d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:29.208095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-674603aa-096a-4924-8fa6-12fdef03b21d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:29.208819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-674603aa-096a-4924-8fa6-12fdef03b21d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:29.209267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-674603aa-096a-4924-8fa6-12fdef03b21d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:29.209697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-674603aa-096a-4924-8fa6-12fdef03b21d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:29.383111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-674603aa-096a-4924-8fa6-12fdef03b21d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:29.399304 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-674603aa-096a-4924-8fa6-12fdef03b21d tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.199587 Sep 06 11:15:29.415149 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2524/5098] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:29 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:30.432695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4af2127e-499e-4320-9fa9-a66b84120c32 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:30.433350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4af2127e-499e-4320-9fa9-a66b84120c32 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:30.441846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4af2127e-499e-4320-9fa9-a66b84120c32 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:30.442351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4af2127e-499e-4320-9fa9-a66b84120c32 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:30.442806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4af2127e-499e-4320-9fa9-a66b84120c32 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:30.443560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4af2127e-499e-4320-9fa9-a66b84120c32 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:30.444073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4af2127e-499e-4320-9fa9-a66b84120c32 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:30.444680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4af2127e-499e-4320-9fa9-a66b84120c32 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:30.649342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4af2127e-499e-4320-9fa9-a66b84120c32 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:30.657955 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4af2127e-499e-4320-9fa9-a66b84120c32 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.229373 Sep 06 11:15:30.658909 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2575/5099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:30 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:30.763220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-95e97481-4a2c-41f9-b277-cc684dde670e tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:30.776772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-95e97481-4a2c-41f9-b277-cc684dde670e tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:30.778251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-95e97481-4a2c-41f9-b277-cc684dde670e tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Searching by: {'deleted': False, 'project_id': '484053c22101496a920ce98bbc707f3d'} {{(pid=140875) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:15:30.799931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95e97481-4a2c-41f9-b277-cc684dde670e tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:30.800496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95e97481-4a2c-41f9-b277-cc684dde670e tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:30.800956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95e97481-4a2c-41f9-b277-cc684dde670e tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:30.801730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95e97481-4a2c-41f9-b277-cc684dde670e tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:30.802212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95e97481-4a2c-41f9-b277-cc684dde670e tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:30.802673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95e97481-4a2c-41f9-b277-cc684dde670e tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:30.837581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.multi_cell_list [None req-95e97481-4a2c-41f9-b277-cc684dde670e tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140875) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:15:30.872867 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-95e97481-4a2c-41f9-b277-cc684dde670e tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.113782 Sep 06 11:15:30.873743 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2525/5100] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 11:15:30 2022] GET /compute/v2.1/servers => generated 339 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:15:30.893193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:30.897081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:30.898595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Searching by: {'deleted': False, 'project_id': '484053c22101496a920ce98bbc707f3d'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:15:30.910763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:30.912501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:30.914091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:30.914913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:30.915709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:30.916878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:30.972067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:15:31.023151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:31.030154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:31.030664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:31.031146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:31.210408 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5729744f-8519-436b-8b76-420cab564e63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.324968 Sep 06 11:15:31.211453 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2576/5101] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 11:15:30 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:31.241203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-887e2b65-678c-4652-84b3-176751655d4c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:31.258405 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-887e2b65-678c-4652-84b3-176751655d4c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021235 Sep 06 11:15:31.258405 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2526/5102] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 11:15:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:15:31.326091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d8684085-c6ac-45a2-865d-7477a120b078 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] Calling method '.version_select at 0x7f90fd121700>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:31.522718 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d8684085-c6ac-45a2-865d-7477a120b078 tempest-TestSecurityGroupsBasicOps-1892704078 tempest-TestSecurityGroupsBasicOps-1892704078-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1025210331" status: 202 len: 0 microversion: 2.1 time: 0.206692 Sep 06 11:15:31.523480 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2577/5103] 10.222.0.20 () {58 vars in 1278 bytes} [Tue Sep 6 11:15:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1025210331 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:15:31.597701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-657f0e18-a06b-4918-bc3e-8c00762b042c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:31.597701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-657f0e18-a06b-4918-bc3e-8c00762b042c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:31.622837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-657f0e18-a06b-4918-bc3e-8c00762b042c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:31.624696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-657f0e18-a06b-4918-bc3e-8c00762b042c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:31.627676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-657f0e18-a06b-4918-bc3e-8c00762b042c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:31.628719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-657f0e18-a06b-4918-bc3e-8c00762b042c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:31.630547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-657f0e18-a06b-4918-bc3e-8c00762b042c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:31.633645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-657f0e18-a06b-4918-bc3e-8c00762b042c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:31.673531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-657f0e18-a06b-4918-bc3e-8c00762b042c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:15:31.678345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:31.684498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0cbdb8f9-b918-4c72-a229-78022340a8a9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:31.685209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0cbdb8f9-b918-4c72-a229-78022340a8a9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:31.699291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cbdb8f9-b918-4c72-a229-78022340a8a9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:31.702981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cbdb8f9-b918-4c72-a229-78022340a8a9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:31.703695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cbdb8f9-b918-4c72-a229-78022340a8a9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:31.708012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cbdb8f9-b918-4c72-a229-78022340a8a9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:31.710491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cbdb8f9-b918-4c72-a229-78022340a8a9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:31.711323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0cbdb8f9-b918-4c72-a229-78022340a8a9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:31.908506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0cbdb8f9-b918-4c72-a229-78022340a8a9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:31.919884 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0cbdb8f9-b918-4c72-a229-78022340a8a9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.239735 Sep 06 11:15:31.920844 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2578/5104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:31 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:32.193032 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-657f0e18-a06b-4918-bc3e-8c00762b042c tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 204 len: 0 microversion: 2.1 time: 0.607815 Sep 06 11:15:32.194371 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2527/5105] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:15:31 2022] DELETE /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:15:32.207940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-17a738ef-c513-4da2-959f-e0680bd106ba tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:32.208507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-17a738ef-c513-4da2-959f-e0680bd106ba tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:32.215658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17a738ef-c513-4da2-959f-e0680bd106ba tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:32.216402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17a738ef-c513-4da2-959f-e0680bd106ba tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:32.217035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17a738ef-c513-4da2-959f-e0680bd106ba tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:32.217761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17a738ef-c513-4da2-959f-e0680bd106ba tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:32.218222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17a738ef-c513-4da2-959f-e0680bd106ba tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:32.218873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17a738ef-c513-4da2-959f-e0680bd106ba tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:32.509791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-17a738ef-c513-4da2-959f-e0680bd106ba tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:32.517323 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-17a738ef-c513-4da2-959f-e0680bd106ba tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1713 microversion: 2.1 time: 0.313371 Sep 06 11:15:32.518703 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2579/5106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:32 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1713 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:32.949115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-89406659-bcb3-4519-9661-b6834edc29c2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:32.949846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-89406659-bcb3-4519-9661-b6834edc29c2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:32.957778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89406659-bcb3-4519-9661-b6834edc29c2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:32.958267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89406659-bcb3-4519-9661-b6834edc29c2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:32.958710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89406659-bcb3-4519-9661-b6834edc29c2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:32.959453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89406659-bcb3-4519-9661-b6834edc29c2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:32.959912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89406659-bcb3-4519-9661-b6834edc29c2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:32.960413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89406659-bcb3-4519-9661-b6834edc29c2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:33.213662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-89406659-bcb3-4519-9661-b6834edc29c2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:33.223564 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-89406659-bcb3-4519-9661-b6834edc29c2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.279118 Sep 06 11:15:33.225477 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2528/5107] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:32 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:33.551921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-60dfaf3c-789a-4386-958d-1407227972a4 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:33.551921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-60dfaf3c-789a-4386-958d-1407227972a4 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:33.551921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-60dfaf3c-789a-4386-958d-1407227972a4 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:33.551921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-60dfaf3c-789a-4386-958d-1407227972a4 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:33.551921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-60dfaf3c-789a-4386-958d-1407227972a4 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:33.552815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-60dfaf3c-789a-4386-958d-1407227972a4 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:33.553082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-60dfaf3c-789a-4386-958d-1407227972a4 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:33.553666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-60dfaf3c-789a-4386-958d-1407227972a4 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:33.735448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-60dfaf3c-789a-4386-958d-1407227972a4 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:33.745162 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-60dfaf3c-789a-4386-958d-1407227972a4 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1713 microversion: 2.1 time: 0.207642 Sep 06 11:15:33.745841 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2580/5108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:33 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1713 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:34.250163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1b592dc6-587b-4390-b71b-f94f6e93d969 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:34.250989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1b592dc6-587b-4390-b71b-f94f6e93d969 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:34.259802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b592dc6-587b-4390-b71b-f94f6e93d969 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:34.260624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b592dc6-587b-4390-b71b-f94f6e93d969 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:34.261441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b592dc6-587b-4390-b71b-f94f6e93d969 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:34.262392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b592dc6-587b-4390-b71b-f94f6e93d969 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:34.263373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b592dc6-587b-4390-b71b-f94f6e93d969 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:34.264281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b592dc6-587b-4390-b71b-f94f6e93d969 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:34.496035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1b592dc6-587b-4390-b71b-f94f6e93d969 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:34.504813 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1b592dc6-587b-4390-b71b-f94f6e93d969 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.258906 Sep 06 11:15:34.505416 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2529/5109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:34 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:34.774385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f2601741-7c0b-49b8-a965-0f4f0f6de118 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:34.776761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f2601741-7c0b-49b8-a965-0f4f0f6de118 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:34.789209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2601741-7c0b-49b8-a965-0f4f0f6de118 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:34.790543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2601741-7c0b-49b8-a965-0f4f0f6de118 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:34.792146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2601741-7c0b-49b8-a965-0f4f0f6de118 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:34.793158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2601741-7c0b-49b8-a965-0f4f0f6de118 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:34.794024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2601741-7c0b-49b8-a965-0f4f0f6de118 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:34.794797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2601741-7c0b-49b8-a965-0f4f0f6de118 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:34.970623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f2601741-7c0b-49b8-a965-0f4f0f6de118 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:34.977463 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f2601741-7c0b-49b8-a965-0f4f0f6de118 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1713 microversion: 2.1 time: 0.208176 Sep 06 11:15:34.978594 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2581/5110] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:34 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1713 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:35.378490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f46e8972-c839-4c97-b49f-7458b2cbfa21 req-d24bda24-8793-415d-b392-0389fc1fc1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2b78dd-5a82-441b-9a8c-ed1e9049e250", "name": "network-vif-deleted", "tag": "ed0e7e9c-5a2d-405e-941e-e3ceaf03d879"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:35.437412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f46e8972-c839-4c97-b49f-7458b2cbfa21 req-d24bda24-8793-415d-b392-0389fc1fc1a2 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:35.437412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f46e8972-c839-4c97-b49f-7458b2cbfa21 req-d24bda24-8793-415d-b392-0389fc1fc1a2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:35.437412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f46e8972-c839-4c97-b49f-7458b2cbfa21 req-d24bda24-8793-415d-b392-0389fc1fc1a2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:35.464631 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f46e8972-c839-4c97-b49f-7458b2cbfa21 req-d24bda24-8793-415d-b392-0389fc1fc1a2 service nova] Creating event network-vif-deleted:ed0e7e9c-5a2d-405e-941e-e3ceaf03d879 for instance 6f2b78dd-5a82-441b-9a8c-ed1e9049e250 on nch1-master-1 Sep 06 11:15:35.471545 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f46e8972-c839-4c97-b49f-7458b2cbfa21 req-d24bda24-8793-415d-b392-0389fc1fc1a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097069 Sep 06 11:15:35.472549 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2530/5111] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:15:35.532059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a211b551-ec29-42c0-b203-5b42e441ee56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:35.533133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a211b551-ec29-42c0-b203-5b42e441ee56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:35.544273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a211b551-ec29-42c0-b203-5b42e441ee56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:35.545048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a211b551-ec29-42c0-b203-5b42e441ee56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:35.545729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a211b551-ec29-42c0-b203-5b42e441ee56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:35.549093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a211b551-ec29-42c0-b203-5b42e441ee56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:35.549806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a211b551-ec29-42c0-b203-5b42e441ee56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:35.550571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a211b551-ec29-42c0-b203-5b42e441ee56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:35.890163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a211b551-ec29-42c0-b203-5b42e441ee56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:35.920597 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a211b551-ec29-42c0-b203-5b42e441ee56 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.394304 Sep 06 11:15:35.933623 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2582/5112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:35 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:36.011399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:36.015259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:36.026446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:36.026949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:36.027619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:36.028352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:36.028850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:36.029285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:36.081533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:36.083442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:36.088372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:36.089421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lazy-loading 'fault' on Instance uuid 6f2b78dd-5a82-441b-9a8c-ed1e9049e250 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:15:36.178566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27aefd012a34168bf5e9e1b6d68195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484053c22101496a920ce98bbc707f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:36.212322 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-97beb795-f6ef-4de8-9a0b-6fae6f9c3d63 tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 200 len: 1367 microversion: 2.1 time: 0.201164 Sep 06 11:15:36.223413 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2531/5113] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:36 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:36.949438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-19cce987-f1e3-45a9-b059-dbcef87ee305 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:36.951381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-19cce987-f1e3-45a9-b059-dbcef87ee305 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:36.966240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19cce987-f1e3-45a9-b059-dbcef87ee305 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:36.967927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19cce987-f1e3-45a9-b059-dbcef87ee305 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:36.970217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19cce987-f1e3-45a9-b059-dbcef87ee305 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:36.971821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19cce987-f1e3-45a9-b059-dbcef87ee305 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:36.972784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19cce987-f1e3-45a9-b059-dbcef87ee305 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:36.974843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19cce987-f1e3-45a9-b059-dbcef87ee305 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:37.239563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5665d6dc-6451-48b9-86e2-7f03b529ff7d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:37.240968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5665d6dc-6451-48b9-86e2-7f03b529ff7d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] [instance: 6f2b78dd-5a82-441b-9a8c-ed1e9049e250] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:37.265149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5665d6dc-6451-48b9-86e2-7f03b529ff7d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:37.265649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5665d6dc-6451-48b9-86e2-7f03b529ff7d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:37.266884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5665d6dc-6451-48b9-86e2-7f03b529ff7d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:37.267666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5665d6dc-6451-48b9-86e2-7f03b529ff7d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:37.268160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5665d6dc-6451-48b9-86e2-7f03b529ff7d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:37.268612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5665d6dc-6451-48b9-86e2-7f03b529ff7d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:37.294842 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-5665d6dc-6451-48b9-86e2-7f03b529ff7d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] HTTP exception thrown: Instance 6f2b78dd-5a82-441b-9a8c-ed1e9049e250 could not be found. Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5665d6dc-6451-48b9-86e2-7f03b529ff7d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Request method failure captured: Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 HTTP/1.1 Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyuTv94CWPOAzUcjkj3g6K1MD4s4gtOJ-o5Nfr0catg1XxxtB60KFdbvzkB33AqYgGVnCme4Yg3Xz8EUdictsWglU2vq0hOl-9r1vhk_18sHsO4XmC7GCpH1kSBo3S_sV2oAzlxra4g6Ee8uXsYzWerB1e3p85u_8mB1ma62FQrUgpk Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 484053c22101496a920ce98bbc707f3d Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersTestManualDisk-442309324 Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_484053c22101496a920ce98bbc707f3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/484053c22101496a920ce98bbc707f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/484053c22101496a920ce98bbc707f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/484053c22101496a920ce98bbc707f3d"}]}] Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersTestManualDisk-442309324 Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 484053c22101496a920ce98bbc707f3d Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersTestManualDisk-442309324 Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersTestManualDisk-442309324-project Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a27aefd012a34168bf5e9e1b6d68195b Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersTestManualDisk-442309324-project Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 6f2b78dd-5a82-441b-9a8c-ed1e9049e250 could not be found. Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '6f2b78dd-5a82-441b-9a8c-ed1e9049e250'} Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f2b78dd-5a82-441b-9a8c-ed1e9049e250 could not be found. Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f2b78dd-5a82-441b-9a8c-ed1e9049e250 could not be found. Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:15:37.296708 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:37.315860 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:15:37.315860 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:15:37.315860 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:15:37.315860 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:15:37.315860 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:15:37.315860 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f2b78dd-5a82-441b-9a8c-ed1e9049e250 could not be found. Sep 06 11:15:37.315860 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:15:37.315860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5665d6dc-6451-48b9-86e2-7f03b529ff7d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Returning 404 to user: Instance 6f2b78dd-5a82-441b-9a8c-ed1e9049e250 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:15:37.315860 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5665d6dc-6451-48b9-86e2-7f03b529ff7d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250" status: 404 len: 111 microversion: 2.1 time: 0.068446 Sep 06 11:15:37.315860 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2532/5114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:37 2022] GET /compute/v2.1/servers/6f2b78dd-5a82-441b-9a8c-ed1e9049e250 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:15:37.329506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-70d9455e-0702-4585-a263-dfa7deb1157d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] Calling method '.version_select at 0x7f90f31f5310>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:37.371295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19cce987-f1e3-45a9-b059-dbcef87ee305 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:37.395474 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-19cce987-f1e3-45a9-b059-dbcef87ee305 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1530 microversion: 2.1 time: 0.451918 Sep 06 11:15:37.396077 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2583/5115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:36 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1530 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:37.459881 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-70d9455e-0702-4585-a263-dfa7deb1157d tempest-ServersTestManualDisk-442309324 tempest-ServersTestManualDisk-442309324-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030923353" status: 202 len: 0 microversion: 2.1 time: 0.137575 Sep 06 11:15:37.459881 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2533/5116] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:15:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030923353 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:15:38.430051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a8eeaa1e-4605-4067-88e8-c1c1f8c65563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:38.430690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a8eeaa1e-4605-4067-88e8-c1c1f8c65563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:38.438455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8eeaa1e-4605-4067-88e8-c1c1f8c65563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:38.439271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8eeaa1e-4605-4067-88e8-c1c1f8c65563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:38.439900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8eeaa1e-4605-4067-88e8-c1c1f8c65563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:38.441001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8eeaa1e-4605-4067-88e8-c1c1f8c65563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:38.441680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8eeaa1e-4605-4067-88e8-c1c1f8c65563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:38.442513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8eeaa1e-4605-4067-88e8-c1c1f8c65563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:38.853837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a8eeaa1e-4605-4067-88e8-c1c1f8c65563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:38.875317 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a8eeaa1e-4605-4067-88e8-c1c1f8c65563 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1530 microversion: 2.1 time: 0.444835 Sep 06 11:15:38.876634 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2584/5117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:38 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1530 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:39.902965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0253305a-5336-4be7-a000-cc05afaee14a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:39.905894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0253305a-5336-4be7-a000-cc05afaee14a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:39.927692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0253305a-5336-4be7-a000-cc05afaee14a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:39.936577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0253305a-5336-4be7-a000-cc05afaee14a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:39.936577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0253305a-5336-4be7-a000-cc05afaee14a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:39.936577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0253305a-5336-4be7-a000-cc05afaee14a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:39.936577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0253305a-5336-4be7-a000-cc05afaee14a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:39.936577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0253305a-5336-4be7-a000-cc05afaee14a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:40.212701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0253305a-5336-4be7-a000-cc05afaee14a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:40.221148 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0253305a-5336-4be7-a000-cc05afaee14a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1525 microversion: 2.1 time: 0.323031 Sep 06 11:15:40.221634 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2534/5118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:39 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1525 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:41.044149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-66ce4980-1971-48c4-b0a9-8ccf12c642f2 req-af59f22a-5165-47bc-ae6e-8c413fe1b382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4", "name": "network-vif-plugged", "status": "completed", "tag": "b74c1e61-74bb-4ccc-97ba-17f5f50a6d22"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:41.068969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:41.075841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:41.092672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-66ce4980-1971-48c4-b0a9-8ccf12c642f2 req-af59f22a-5165-47bc-ae6e-8c413fe1b382 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:41.096254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-66ce4980-1971-48c4-b0a9-8ccf12c642f2 req-af59f22a-5165-47bc-ae6e-8c413fe1b382 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:41.096966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-66ce4980-1971-48c4-b0a9-8ccf12c642f2 req-af59f22a-5165-47bc-ae6e-8c413fe1b382 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:41.149830 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-66ce4980-1971-48c4-b0a9-8ccf12c642f2 req-af59f22a-5165-47bc-ae6e-8c413fe1b382 service nova] Creating event network-vif-plugged:b74c1e61-74bb-4ccc-97ba-17f5f50a6d22 for instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 on nch2-master-1 Sep 06 11:15:41.163963 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-66ce4980-1971-48c4-b0a9-8ccf12c642f2 req-af59f22a-5165-47bc-ae6e-8c413fe1b382 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126158 Sep 06 11:15:41.166538 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2585/5119] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:15:41.259405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6114190e-ae4f-47df-85f7-8febf6e782e0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:41.264931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6114190e-ae4f-47df-85f7-8febf6e782e0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:41.310024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:41.331907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6114190e-ae4f-47df-85f7-8febf6e782e0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:41.335883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6114190e-ae4f-47df-85f7-8febf6e782e0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:41.337908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6114190e-ae4f-47df-85f7-8febf6e782e0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:41.343655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6114190e-ae4f-47df-85f7-8febf6e782e0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:41.346452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6114190e-ae4f-47df-85f7-8febf6e782e0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:41.349687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6114190e-ae4f-47df-85f7-8febf6e782e0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:42.062247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6114190e-ae4f-47df-85f7-8febf6e782e0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:42.077313 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6114190e-ae4f-47df-85f7-8febf6e782e0 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1525 microversion: 2.1 time: 0.830823 Sep 06 11:15:42.080042 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2535/5120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:41 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1525 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:43.105982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-629e30d7-338f-410b-b8d2-d7e9ceff2b18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:43.106890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-629e30d7-338f-410b-b8d2-d7e9ceff2b18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:43.131788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-629e30d7-338f-410b-b8d2-d7e9ceff2b18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:43.135406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-629e30d7-338f-410b-b8d2-d7e9ceff2b18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:43.136085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-629e30d7-338f-410b-b8d2-d7e9ceff2b18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:43.140301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-629e30d7-338f-410b-b8d2-d7e9ceff2b18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:43.140915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-629e30d7-338f-410b-b8d2-d7e9ceff2b18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:43.141469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-629e30d7-338f-410b-b8d2-d7e9ceff2b18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:43.687171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-629e30d7-338f-410b-b8d2-d7e9ceff2b18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:43.703639 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-629e30d7-338f-410b-b8d2-d7e9ceff2b18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1525 microversion: 2.1 time: 0.602478 Sep 06 11:15:43.710053 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2586/5121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:43 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1525 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:44.785056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f39d9575-0ca7-430d-a0fa-c2f4c9497cad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:44.788973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f39d9575-0ca7-430d-a0fa-c2f4c9497cad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:44.805662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f39d9575-0ca7-430d-a0fa-c2f4c9497cad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:44.806739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f39d9575-0ca7-430d-a0fa-c2f4c9497cad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:44.811480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f39d9575-0ca7-430d-a0fa-c2f4c9497cad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:44.813280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f39d9575-0ca7-430d-a0fa-c2f4c9497cad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:44.814336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f39d9575-0ca7-430d-a0fa-c2f4c9497cad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:44.818365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f39d9575-0ca7-430d-a0fa-c2f4c9497cad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:46.432181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f39d9575-0ca7-430d-a0fa-c2f4c9497cad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:46.458709 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f39d9575-0ca7-430d-a0fa-c2f4c9497cad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1525 microversion: 2.1 time: 1.693303 Sep 06 11:15:46.459605 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2536/5122] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:44 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1525 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:46.625247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-339891199", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "aae38061-bdb2-42ee-b09c-c0e4ef07dd2e"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:46.770297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] validate_networks() for [('aae38061-bdb2-42ee-b09c-c0e4ef07dd2e', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:15:47.496912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eea16ae7-adb1-4fa5-9f64-e382cb04454f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:47.497801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-eea16ae7-adb1-4fa5-9f64-e382cb04454f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:47.511835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:47.530271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eea16ae7-adb1-4fa5-9f64-e382cb04454f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:47.530776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eea16ae7-adb1-4fa5-9f64-e382cb04454f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:47.546415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eea16ae7-adb1-4fa5-9f64-e382cb04454f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:47.547815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eea16ae7-adb1-4fa5-9f64-e382cb04454f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:47.548307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eea16ae7-adb1-4fa5-9f64-e382cb04454f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:47.548754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eea16ae7-adb1-4fa5-9f64-e382cb04454f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:48.595393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-eea16ae7-adb1-4fa5-9f64-e382cb04454f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:48.644098 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-eea16ae7-adb1-4fa5-9f64-e382cb04454f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1525 microversion: 2.1 time: 1.156194 Sep 06 11:15:48.647475 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2537/5123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:47 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1525 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:48.766326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:15:48.768079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:15:48.768079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:15:48.768533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:15:48.769031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:15:48.782277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:48.782775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:48.783443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:48.784079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:48.784556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:48.784983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:48.813301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Getting quotas for project 208a457b167e497ab5fc0b63cee8b85c. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:15:48.821829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Getting quotas for user 7dec6a381d98493c9cef244f20002949 and project 208a457b167e497ab5fc0b63cee8b85c. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:15:48.842285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:15:48.845237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:15:49.088601 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5d94a1bf-2862-4cd5-be3c-37a3940c4609 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.748688 Sep 06 11:15:49.095559 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2587/5124] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:15:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:15:49.109498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-baaca716-6c38-459e-92b9-902264dd7341 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:49.111166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-baaca716-6c38-459e-92b9-902264dd7341 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:49.280108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-baaca716-6c38-459e-92b9-902264dd7341 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:49.289080 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-baaca716-6c38-459e-92b9-902264dd7341 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1214 microversion: 2.1 time: 0.184956 Sep 06 11:15:49.292937 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2538/5125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:49 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1214 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:49.679154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ecd52938-a1d1-403f-8ed8-8a01d297d080 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:49.680262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ecd52938-a1d1-403f-8ed8-8a01d297d080 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:49.702249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecd52938-a1d1-403f-8ed8-8a01d297d080 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:49.702805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecd52938-a1d1-403f-8ed8-8a01d297d080 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:49.703299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecd52938-a1d1-403f-8ed8-8a01d297d080 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:49.704265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecd52938-a1d1-403f-8ed8-8a01d297d080 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:49.704735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecd52938-a1d1-403f-8ed8-8a01d297d080 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:49.705171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecd52938-a1d1-403f-8ed8-8a01d297d080 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:50.318691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d95eb37a-7e03-40aa-a22f-b9c1fed459ef tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:50.319373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d95eb37a-7e03-40aa-a22f-b9c1fed459ef tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:50.908637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d95eb37a-7e03-40aa-a22f-b9c1fed459ef tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:50.933036 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d95eb37a-7e03-40aa-a22f-b9c1fed459ef tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1214 microversion: 2.1 time: 0.610556 Sep 06 11:15:50.933036 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2539/5126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:50 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1214 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:50.933231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ecd52938-a1d1-403f-8ed8-8a01d297d080 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:50.942380 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ecd52938-a1d1-403f-8ed8-8a01d297d080 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1525 microversion: 2.1 time: 1.267704 Sep 06 11:15:50.943001 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2588/5127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:49 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1525 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:51.950747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f9dbd6dd-47c9-44e7-9c5a-f9f86e2dde86 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:51.951432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f9dbd6dd-47c9-44e7-9c5a-f9f86e2dde86 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:51.969313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f916a8e5-9620-4437-b295-d56d8c729d28 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:51.969855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9dbd6dd-47c9-44e7-9c5a-f9f86e2dde86 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:51.969855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9dbd6dd-47c9-44e7-9c5a-f9f86e2dde86 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:51.970116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f916a8e5-9620-4437-b295-d56d8c729d28 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:51.970262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9dbd6dd-47c9-44e7-9c5a-f9f86e2dde86 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:51.970996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9dbd6dd-47c9-44e7-9c5a-f9f86e2dde86 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:51.971501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9dbd6dd-47c9-44e7-9c5a-f9f86e2dde86 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:51.971967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9dbd6dd-47c9-44e7-9c5a-f9f86e2dde86 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:51.981070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:51.988402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f916a8e5-9620-4437-b295-d56d8c729d28 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:51.989499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f916a8e5-9620-4437-b295-d56d8c729d28 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:51.990641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f916a8e5-9620-4437-b295-d56d8c729d28 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:51.992271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f916a8e5-9620-4437-b295-d56d8c729d28 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:51.993469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f916a8e5-9620-4437-b295-d56d8c729d28 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:51.995811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f916a8e5-9620-4437-b295-d56d8c729d28 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:52.354623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f9dbd6dd-47c9-44e7-9c5a-f9f86e2dde86 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:52.379922 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f9dbd6dd-47c9-44e7-9c5a-f9f86e2dde86 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1210 microversion: 2.1 time: 0.432974 Sep 06 11:15:52.381873 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2540/5128] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:51 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1210 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:52.514195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f916a8e5-9620-4437-b295-d56d8c729d28 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:52.536940 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f916a8e5-9620-4437-b295-d56d8c729d28 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1525 microversion: 2.1 time: 0.572678 Sep 06 11:15:52.538707 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2589/5129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:51 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1525 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:53.414462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a4e18424-bf20-4ac9-9fbd-ef2e11da2680 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:53.415783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a4e18424-bf20-4ac9-9fbd-ef2e11da2680 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:53.426006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4e18424-bf20-4ac9-9fbd-ef2e11da2680 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:53.426513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4e18424-bf20-4ac9-9fbd-ef2e11da2680 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:53.427474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4e18424-bf20-4ac9-9fbd-ef2e11da2680 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:53.428256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4e18424-bf20-4ac9-9fbd-ef2e11da2680 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:53.428730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4e18424-bf20-4ac9-9fbd-ef2e11da2680 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:53.429206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4e18424-bf20-4ac9-9fbd-ef2e11da2680 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:53.515070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a4e18424-bf20-4ac9-9fbd-ef2e11da2680 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:53.524772 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a4e18424-bf20-4ac9-9fbd-ef2e11da2680 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1274 microversion: 2.1 time: 0.115261 Sep 06 11:15:53.525233 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2541/5130] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:53 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1274 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:53.565436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-47cd4e66-2d80-4c73-bb3e-20b93f8161d4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:53.566297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-47cd4e66-2d80-4c73-bb3e-20b93f8161d4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:53.575890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47cd4e66-2d80-4c73-bb3e-20b93f8161d4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:53.576499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47cd4e66-2d80-4c73-bb3e-20b93f8161d4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:53.578229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47cd4e66-2d80-4c73-bb3e-20b93f8161d4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:53.578494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47cd4e66-2d80-4c73-bb3e-20b93f8161d4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:53.578848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47cd4e66-2d80-4c73-bb3e-20b93f8161d4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:53.579317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47cd4e66-2d80-4c73-bb3e-20b93f8161d4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:53.836513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-47cd4e66-2d80-4c73-bb3e-20b93f8161d4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:53.846502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:53.855618 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-47cd4e66-2d80-4c73-bb3e-20b93f8161d4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1525 microversion: 2.1 time: 0.295114 Sep 06 11:15:53.857097 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2590/5131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:53 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1525 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:54.560703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-94c6d653-a004-4690-92ca-86b3ddcf148d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:54.564693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-94c6d653-a004-4690-92ca-86b3ddcf148d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:54.608218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-94c6d653-a004-4690-92ca-86b3ddcf148d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:54.609243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-94c6d653-a004-4690-92ca-86b3ddcf148d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:54.610762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-94c6d653-a004-4690-92ca-86b3ddcf148d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:54.617245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-94c6d653-a004-4690-92ca-86b3ddcf148d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:54.617245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-94c6d653-a004-4690-92ca-86b3ddcf148d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:54.617245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-94c6d653-a004-4690-92ca-86b3ddcf148d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:54.796656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-94c6d653-a004-4690-92ca-86b3ddcf148d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:54.810235 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-94c6d653-a004-4690-92ca-86b3ddcf148d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1272 microversion: 2.1 time: 0.264366 Sep 06 11:15:54.817002 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2542/5132] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:54 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:54.882143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f3392d6-5ebd-4d15-9d02-aaa8e08f6e7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:54.886693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1f3392d6-5ebd-4d15-9d02-aaa8e08f6e7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:54.905494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f3392d6-5ebd-4d15-9d02-aaa8e08f6e7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:54.910887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f3392d6-5ebd-4d15-9d02-aaa8e08f6e7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:54.910887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f3392d6-5ebd-4d15-9d02-aaa8e08f6e7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:54.911799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f3392d6-5ebd-4d15-9d02-aaa8e08f6e7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:54.915301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f3392d6-5ebd-4d15-9d02-aaa8e08f6e7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:54.916813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f3392d6-5ebd-4d15-9d02-aaa8e08f6e7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:55.291276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1f3392d6-5ebd-4d15-9d02-aaa8e08f6e7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:55.304136 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1f3392d6-5ebd-4d15-9d02-aaa8e08f6e7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1525 microversion: 2.1 time: 0.426332 Sep 06 11:15:55.304749 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2591/5133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:54 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1525 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:55.848056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9d018b2e-4485-4989-99fd-6071a9cfcbe9 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:55.850088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9d018b2e-4485-4989-99fd-6071a9cfcbe9 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:55.862821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d018b2e-4485-4989-99fd-6071a9cfcbe9 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:55.863672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d018b2e-4485-4989-99fd-6071a9cfcbe9 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:55.864406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d018b2e-4485-4989-99fd-6071a9cfcbe9 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:55.865143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d018b2e-4485-4989-99fd-6071a9cfcbe9 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:55.865705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d018b2e-4485-4989-99fd-6071a9cfcbe9 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:55.866361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d018b2e-4485-4989-99fd-6071a9cfcbe9 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:56.260744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9d018b2e-4485-4989-99fd-6071a9cfcbe9 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:56.278553 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9d018b2e-4485-4989-99fd-6071a9cfcbe9 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1314 microversion: 2.1 time: 0.436344 Sep 06 11:15:56.281760 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2543/5134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:55 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:56.354045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-71e4c5c7-7402-4487-a23d-1e5846684b54 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:56.356626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-71e4c5c7-7402-4487-a23d-1e5846684b54 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:56.372864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71e4c5c7-7402-4487-a23d-1e5846684b54 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:56.375153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71e4c5c7-7402-4487-a23d-1e5846684b54 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:56.376164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71e4c5c7-7402-4487-a23d-1e5846684b54 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:56.377672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71e4c5c7-7402-4487-a23d-1e5846684b54 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:56.378639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71e4c5c7-7402-4487-a23d-1e5846684b54 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:56.379646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71e4c5c7-7402-4487-a23d-1e5846684b54 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:56.903562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-71e4c5c7-7402-4487-a23d-1e5846684b54 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:56.926008 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-71e4c5c7-7402-4487-a23d-1e5846684b54 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1525 microversion: 2.1 time: 0.581810 Sep 06 11:15:56.927966 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2592/5135] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:56 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1525 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:15:57.318712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-edd92562-6f89-4f30-82c8-fad74017eecf tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:57.320833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-edd92562-6f89-4f30-82c8-fad74017eecf tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:57.336648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edd92562-6f89-4f30-82c8-fad74017eecf tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:57.338887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edd92562-6f89-4f30-82c8-fad74017eecf tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:57.340909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edd92562-6f89-4f30-82c8-fad74017eecf tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:57.341920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edd92562-6f89-4f30-82c8-fad74017eecf tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:57.344048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edd92562-6f89-4f30-82c8-fad74017eecf tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:57.345941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edd92562-6f89-4f30-82c8-fad74017eecf tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:57.662352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-7810100a-0a97-435a-b2f6-4f30c6b50fd9 req-16a254e8-4f6e-48d1-b092-f411704567e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c30eb0-d18b-4c1a-91bf-e7d542040758", "tag": "39b64b09-4da2-4777-bd31-9811a1f26269"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:15:57.680723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7810100a-0a97-435a-b2f6-4f30c6b50fd9 req-16a254e8-4f6e-48d1-b092-f411704567e0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:57.692828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7810100a-0a97-435a-b2f6-4f30c6b50fd9 req-16a254e8-4f6e-48d1-b092-f411704567e0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:57.695248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7810100a-0a97-435a-b2f6-4f30c6b50fd9 req-16a254e8-4f6e-48d1-b092-f411704567e0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:57.730378 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-7810100a-0a97-435a-b2f6-4f30c6b50fd9 req-16a254e8-4f6e-48d1-b092-f411704567e0 service nova] Creating event network-changed:39b64b09-4da2-4777-bd31-9811a1f26269 for instance 71c30eb0-d18b-4c1a-91bf-e7d542040758 on nch1-master-1 Sep 06 11:15:57.744662 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-7810100a-0a97-435a-b2f6-4f30c6b50fd9 req-16a254e8-4f6e-48d1-b092-f411704567e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086006 Sep 06 11:15:57.745804 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2593/5136] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:15:57.818118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-edd92562-6f89-4f30-82c8-fad74017eecf tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:57.833610 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-edd92562-6f89-4f30-82c8-fad74017eecf tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1314 microversion: 2.1 time: 0.519857 Sep 06 11:15:57.834489 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2544/5137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:57 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:57.953376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-022a770f-88fb-4421-866f-7f241a218862 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:57.954357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-022a770f-88fb-4421-866f-7f241a218862 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:57.965549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-022a770f-88fb-4421-866f-7f241a218862 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:57.969276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-022a770f-88fb-4421-866f-7f241a218862 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:57.970190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-022a770f-88fb-4421-866f-7f241a218862 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:57.971586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-022a770f-88fb-4421-866f-7f241a218862 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:57.974223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-022a770f-88fb-4421-866f-7f241a218862 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:57.976643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-022a770f-88fb-4421-866f-7f241a218862 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:58.238164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-022a770f-88fb-4421-866f-7f241a218862 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:58.256689 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-022a770f-88fb-4421-866f-7f241a218862 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1525 microversion: 2.1 time: 0.308332 Sep 06 11:15:58.268849 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2594/5138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:57 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1525 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:58.870026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-22de6733-2c08-4fa2-bb63-8cbdab10ddf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:58.870929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-22de6733-2c08-4fa2-bb63-8cbdab10ddf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:58.888537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22de6733-2c08-4fa2-bb63-8cbdab10ddf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:58.889055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22de6733-2c08-4fa2-bb63-8cbdab10ddf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:58.889511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22de6733-2c08-4fa2-bb63-8cbdab10ddf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:58.891050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22de6733-2c08-4fa2-bb63-8cbdab10ddf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:58.900034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22de6733-2c08-4fa2-bb63-8cbdab10ddf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:58.900802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22de6733-2c08-4fa2-bb63-8cbdab10ddf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:59.179283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-22de6733-2c08-4fa2-bb63-8cbdab10ddf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:59.188996 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-22de6733-2c08-4fa2-bb63-8cbdab10ddf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1314 microversion: 2.1 time: 0.322932 Sep 06 11:15:59.189760 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2545/5139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:58 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:15:59.294401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a094843e-1a15-4a0c-b09f-f3fdfc383125 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:15:59.295392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a094843e-1a15-4a0c-b09f-f3fdfc383125 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:15:59.298194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:59.299113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:59.304842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a094843e-1a15-4a0c-b09f-f3fdfc383125 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:59.310708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a094843e-1a15-4a0c-b09f-f3fdfc383125 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:59.310708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a094843e-1a15-4a0c-b09f-f3fdfc383125 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:59.310708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a094843e-1a15-4a0c-b09f-f3fdfc383125 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:15:59.310708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a094843e-1a15-4a0c-b09f-f3fdfc383125 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:15:59.310708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a094843e-1a15-4a0c-b09f-f3fdfc383125 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:15:59.510685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a094843e-1a15-4a0c-b09f-f3fdfc383125 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:15:59.522398 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a094843e-1a15-4a0c-b09f-f3fdfc383125 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1525 microversion: 2.1 time: 0.231834 Sep 06 11:15:59.549086 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2595/5140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:15:59 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1525 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:00.214764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b6c9f29-1dc3-4066-8470-78733cdc6824 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:00.216197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2b6c9f29-1dc3-4066-8470-78733cdc6824 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:00.234679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b6c9f29-1dc3-4066-8470-78733cdc6824 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:00.236462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b6c9f29-1dc3-4066-8470-78733cdc6824 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:00.239342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b6c9f29-1dc3-4066-8470-78733cdc6824 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:00.239342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b6c9f29-1dc3-4066-8470-78733cdc6824 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:00.239342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b6c9f29-1dc3-4066-8470-78733cdc6824 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:00.239342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b6c9f29-1dc3-4066-8470-78733cdc6824 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:00.553816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-911fd7dd-cc3f-49e9-8046-dd9925223b59 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:00.554458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-911fd7dd-cc3f-49e9-8046-dd9925223b59 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:00.581057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-911fd7dd-cc3f-49e9-8046-dd9925223b59 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:00.636372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-911fd7dd-cc3f-49e9-8046-dd9925223b59 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:00.636372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-911fd7dd-cc3f-49e9-8046-dd9925223b59 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:00.636372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-911fd7dd-cc3f-49e9-8046-dd9925223b59 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:00.636372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-911fd7dd-cc3f-49e9-8046-dd9925223b59 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:00.636372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-911fd7dd-cc3f-49e9-8046-dd9925223b59 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:00.726482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2b6c9f29-1dc3-4066-8470-78733cdc6824 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:00.730665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:00.742359 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b6c9f29-1dc3-4066-8470-78733cdc6824 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1314 microversion: 2.1 time: 0.531635 Sep 06 11:16:00.742977 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2546/5141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:00 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:00.927599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-911fd7dd-cc3f-49e9-8046-dd9925223b59 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:00.939181 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-911fd7dd-cc3f-49e9-8046-dd9925223b59 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1525 microversion: 2.1 time: 0.389190 Sep 06 11:16:00.939789 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2596/5142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:00 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1525 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:01.766320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:01.771224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dc8fccef-261d-433c-8f6c-5395ca97c7ae tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:01.771856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dc8fccef-261d-433c-8f6c-5395ca97c7ae tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:01.784199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc8fccef-261d-433c-8f6c-5395ca97c7ae tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:01.785007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc8fccef-261d-433c-8f6c-5395ca97c7ae tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:01.787100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc8fccef-261d-433c-8f6c-5395ca97c7ae tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:01.788096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc8fccef-261d-433c-8f6c-5395ca97c7ae tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:01.788752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc8fccef-261d-433c-8f6c-5395ca97c7ae tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:01.789377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc8fccef-261d-433c-8f6c-5395ca97c7ae tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:01.975638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34131999-e38c-4937-a9fa-f37e0a557420 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:01.976919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-34131999-e38c-4937-a9fa-f37e0a557420 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:01.984132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34131999-e38c-4937-a9fa-f37e0a557420 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:01.984619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34131999-e38c-4937-a9fa-f37e0a557420 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:01.988099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34131999-e38c-4937-a9fa-f37e0a557420 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:01.993183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34131999-e38c-4937-a9fa-f37e0a557420 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:01.994116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34131999-e38c-4937-a9fa-f37e0a557420 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:01.994443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34131999-e38c-4937-a9fa-f37e0a557420 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:02.257462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dc8fccef-261d-433c-8f6c-5395ca97c7ae tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:02.267729 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dc8fccef-261d-433c-8f6c-5395ca97c7ae tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1314 microversion: 2.1 time: 0.502797 Sep 06 11:16:02.283497 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2547/5143] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:01 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:02.399896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-34131999-e38c-4937-a9fa-f37e0a557420 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:02.408450 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-34131999-e38c-4937-a9fa-f37e0a557420 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1507 microversion: 2.1 time: 0.436671 Sep 06 11:16:02.411957 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2597/5144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:01 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1507 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:02.827198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-967f4b2d-7713-47b1-9741-ea0bfd3d9536 req-ebbebf33-1560-4d3e-b610-000fee2aee64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c30eb0-d18b-4c1a-91bf-e7d542040758", "name": "network-vif-plugged", "status": "completed", "tag": "39b64b09-4da2-4777-bd31-9811a1f26269"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:02.838278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-967f4b2d-7713-47b1-9741-ea0bfd3d9536 req-ebbebf33-1560-4d3e-b610-000fee2aee64 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:02.838784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-967f4b2d-7713-47b1-9741-ea0bfd3d9536 req-ebbebf33-1560-4d3e-b610-000fee2aee64 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:02.839285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-967f4b2d-7713-47b1-9741-ea0bfd3d9536 req-ebbebf33-1560-4d3e-b610-000fee2aee64 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:02.852192 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-967f4b2d-7713-47b1-9741-ea0bfd3d9536 req-ebbebf33-1560-4d3e-b610-000fee2aee64 service nova] Creating event network-vif-plugged:39b64b09-4da2-4777-bd31-9811a1f26269 for instance 71c30eb0-d18b-4c1a-91bf-e7d542040758 on nch1-master-1 Sep 06 11:16:02.865004 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-967f4b2d-7713-47b1-9741-ea0bfd3d9536 req-ebbebf33-1560-4d3e-b610-000fee2aee64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205076 Sep 06 11:16:02.866333 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2548/5145] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:16:03.294070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eb1e6452-ed61-44b5-b9ab-e9a580feaaf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:03.295621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eb1e6452-ed61-44b5-b9ab-e9a580feaaf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:03.304825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb1e6452-ed61-44b5-b9ab-e9a580feaaf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:03.305449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb1e6452-ed61-44b5-b9ab-e9a580feaaf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:03.306014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb1e6452-ed61-44b5-b9ab-e9a580feaaf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:03.306878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb1e6452-ed61-44b5-b9ab-e9a580feaaf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:03.307602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb1e6452-ed61-44b5-b9ab-e9a580feaaf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:03.308152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb1e6452-ed61-44b5-b9ab-e9a580feaaf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:03.438433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5fe5cb35-06eb-48ca-8d63-93b41b419066 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:03.440654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5fe5cb35-06eb-48ca-8d63-93b41b419066 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:03.452557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fe5cb35-06eb-48ca-8d63-93b41b419066 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:03.453371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fe5cb35-06eb-48ca-8d63-93b41b419066 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:03.453999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fe5cb35-06eb-48ca-8d63-93b41b419066 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:03.455076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fe5cb35-06eb-48ca-8d63-93b41b419066 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:03.455785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fe5cb35-06eb-48ca-8d63-93b41b419066 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:03.456399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5fe5cb35-06eb-48ca-8d63-93b41b419066 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:03.842093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eb1e6452-ed61-44b5-b9ab-e9a580feaaf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:03.854760 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eb1e6452-ed61-44b5-b9ab-e9a580feaaf7 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1314 microversion: 2.1 time: 0.564900 Sep 06 11:16:03.855826 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2598/5146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:03 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:03.893896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5fe5cb35-06eb-48ca-8d63-93b41b419066 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:03.911546 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5fe5cb35-06eb-48ca-8d63-93b41b419066 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1507 microversion: 2.1 time: 0.479585 Sep 06 11:16:03.918919 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2549/5147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:03 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:04.909153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e692c95d-8db2-4f30-b5d8-068ff9f69b07 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:04.909967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-42ce5cc0-dcd2-4904-9532-05fd37e85e02 req-531e2a0b-f270-4867-b785-1f49d8faa82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4", "name": "network-vif-unplugged", "status": "completed", "tag": "b74c1e61-74bb-4ccc-97ba-17f5f50a6d22"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:04.912994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e692c95d-8db2-4f30-b5d8-068ff9f69b07 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:04.924534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e692c95d-8db2-4f30-b5d8-068ff9f69b07 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:04.925164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e692c95d-8db2-4f30-b5d8-068ff9f69b07 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:04.926010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e692c95d-8db2-4f30-b5d8-068ff9f69b07 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:04.926971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e692c95d-8db2-4f30-b5d8-068ff9f69b07 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:04.927979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e692c95d-8db2-4f30-b5d8-068ff9f69b07 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:04.928727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e692c95d-8db2-4f30-b5d8-068ff9f69b07 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:04.932032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-42ce5cc0-dcd2-4904-9532-05fd37e85e02 req-531e2a0b-f270-4867-b785-1f49d8faa82d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:04.932917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-42ce5cc0-dcd2-4904-9532-05fd37e85e02 req-531e2a0b-f270-4867-b785-1f49d8faa82d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:04.933711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-42ce5cc0-dcd2-4904-9532-05fd37e85e02 req-531e2a0b-f270-4867-b785-1f49d8faa82d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:04.975241 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-42ce5cc0-dcd2-4904-9532-05fd37e85e02 req-531e2a0b-f270-4867-b785-1f49d8faa82d service nova] Creating event network-vif-unplugged:b74c1e61-74bb-4ccc-97ba-17f5f50a6d22 for instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 on nch2-master-1 Sep 06 11:16:04.985312 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-42ce5cc0-dcd2-4904-9532-05fd37e85e02 req-531e2a0b-f270-4867-b785-1f49d8faa82d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091652 Sep 06 11:16:04.993893 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2550/5148] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:16:05.000247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d96189d5-1e32-4837-8190-02b2b0b73aa2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:05.009600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d96189d5-1e32-4837-8190-02b2b0b73aa2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:05.029584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d96189d5-1e32-4837-8190-02b2b0b73aa2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:05.030995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d96189d5-1e32-4837-8190-02b2b0b73aa2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:05.037120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d96189d5-1e32-4837-8190-02b2b0b73aa2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:05.038458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d96189d5-1e32-4837-8190-02b2b0b73aa2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:05.039463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d96189d5-1e32-4837-8190-02b2b0b73aa2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:05.040167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d96189d5-1e32-4837-8190-02b2b0b73aa2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:05.408614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e692c95d-8db2-4f30-b5d8-068ff9f69b07 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:05.420199 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e692c95d-8db2-4f30-b5d8-068ff9f69b07 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1501 microversion: 2.1 time: 0.532147 Sep 06 11:16:05.422134 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2599/5149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:04 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1501 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:05.460125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe0faad1-7fbc-4974-a5ba-343a0169b731 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:05.460969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe0faad1-7fbc-4974-a5ba-343a0169b731 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:05.473285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe0faad1-7fbc-4974-a5ba-343a0169b731 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:05.474221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe0faad1-7fbc-4974-a5ba-343a0169b731 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:05.474695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe0faad1-7fbc-4974-a5ba-343a0169b731 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:05.475797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe0faad1-7fbc-4974-a5ba-343a0169b731 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:05.476445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe0faad1-7fbc-4974-a5ba-343a0169b731 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:05.476895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe0faad1-7fbc-4974-a5ba-343a0169b731 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:05.550877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d96189d5-1e32-4837-8190-02b2b0b73aa2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:05.560106 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d96189d5-1e32-4837-8190-02b2b0b73aa2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1507 microversion: 2.1 time: 0.564691 Sep 06 11:16:05.571127 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2551/5150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:04 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1507 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:06.334221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe0faad1-7fbc-4974-a5ba-343a0169b731 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:06.349003 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe0faad1-7fbc-4974-a5ba-343a0169b731 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1501 microversion: 2.1 time: 0.907488 Sep 06 11:16:06.349540 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2600/5151] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:05 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1501 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:06.379295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4939b3bc-8087-4960-8e8c-c8d2d2fe63cb tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:06.380852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4939b3bc-8087-4960-8e8c-c8d2d2fe63cb tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:06.390096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4939b3bc-8087-4960-8e8c-c8d2d2fe63cb tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:06.390944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4939b3bc-8087-4960-8e8c-c8d2d2fe63cb tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:06.392649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4939b3bc-8087-4960-8e8c-c8d2d2fe63cb tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:06.396105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4939b3bc-8087-4960-8e8c-c8d2d2fe63cb tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:06.396957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4939b3bc-8087-4960-8e8c-c8d2d2fe63cb tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:06.397609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4939b3bc-8087-4960-8e8c-c8d2d2fe63cb tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:06.438451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-4939b3bc-8087-4960-8e8c-c8d2d2fe63cb tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lazy-loading 'flavor' on Instance uuid 71c30eb0-d18b-4c1a-91bf-e7d542040758 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:16:06.584867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb6ea86e-2134-4176-a1f1-748c799efbbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:06.585509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bb6ea86e-2134-4176-a1f1-748c799efbbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:06.594893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb6ea86e-2134-4176-a1f1-748c799efbbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:06.599124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb6ea86e-2134-4176-a1f1-748c799efbbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:06.599124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb6ea86e-2134-4176-a1f1-748c799efbbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:06.599124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb6ea86e-2134-4176-a1f1-748c799efbbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:06.599124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb6ea86e-2134-4176-a1f1-748c799efbbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:06.599124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb6ea86e-2134-4176-a1f1-748c799efbbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:06.936302 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4939b3bc-8087-4960-8e8c-c8d2d2fe63cb tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "POST /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758/action" status: 202 len: 0 microversion: 2.1 time: 0.559114 Sep 06 11:16:06.936302 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2552/5152] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:06 2022] POST /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:16:06.945772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bb6ea86e-2134-4176-a1f1-748c799efbbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:06.958580 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bb6ea86e-2134-4176-a1f1-748c799efbbe tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1450 microversion: 2.1 time: 0.378287 Sep 06 11:16:06.980561 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2601/5153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:06 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1450 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:06.991342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9bba914f-45f9-473f-9256-3b1654c2585f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:06.992384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9bba914f-45f9-473f-9256-3b1654c2585f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:07.000985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bba914f-45f9-473f-9256-3b1654c2585f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:07.001610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bba914f-45f9-473f-9256-3b1654c2585f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:07.002071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bba914f-45f9-473f-9256-3b1654c2585f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:07.002873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bba914f-45f9-473f-9256-3b1654c2585f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:07.003751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bba914f-45f9-473f-9256-3b1654c2585f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:07.003751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9bba914f-45f9-473f-9256-3b1654c2585f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:07.052196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1862145090", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "de2e39a0-65bc-4084-b13f-231911e7c37b"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:07.121517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] validate_networks() for [('de2e39a0-65bc-4084-b13f-231911e7c37b', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:16:07.335297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9bba914f-45f9-473f-9256-3b1654c2585f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:07.349260 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9bba914f-45f9-473f-9256-3b1654c2585f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1509 microversion: 2.1 time: 0.367266 Sep 06 11:16:07.349877 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2602/5154] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:06 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:07.371289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f97255a4-04e1-463f-8a31-d1e1f8b867f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:07.375773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f97255a4-04e1-463f-8a31-d1e1f8b867f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:07.395794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f97255a4-04e1-463f-8a31-d1e1f8b867f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:07.398579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f97255a4-04e1-463f-8a31-d1e1f8b867f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:07.399308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f97255a4-04e1-463f-8a31-d1e1f8b867f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:07.401988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f97255a4-04e1-463f-8a31-d1e1f8b867f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:07.404835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f97255a4-04e1-463f-8a31-d1e1f8b867f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:07.405564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f97255a4-04e1-463f-8a31-d1e1f8b867f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:07.782956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f97255a4-04e1-463f-8a31-d1e1f8b867f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:07.798241 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f97255a4-04e1-463f-8a31-d1e1f8b867f2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1450 microversion: 2.1 time: 0.447196 Sep 06 11:16:07.798882 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2603/5155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:07 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1450 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:07.873284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e565ccb9-09b3-4dca-bbd2-7056c4178d17 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:07.876532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e565ccb9-09b3-4dca-bbd2-7056c4178d17 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:07.885064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e565ccb9-09b3-4dca-bbd2-7056c4178d17 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:07.885867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e565ccb9-09b3-4dca-bbd2-7056c4178d17 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:07.886521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e565ccb9-09b3-4dca-bbd2-7056c4178d17 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:07.887462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e565ccb9-09b3-4dca-bbd2-7056c4178d17 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:07.888109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e565ccb9-09b3-4dca-bbd2-7056c4178d17 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:07.890591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e565ccb9-09b3-4dca-bbd2-7056c4178d17 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:07.956735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-e565ccb9-09b3-4dca-bbd2-7056c4178d17 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lazy-loading 'flavor' on Instance uuid 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:16:08.006517 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-e565ccb9-09b3-4dca-bbd2-7056c4178d17 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Cannot 'shelve' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state shelved_offloaded Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e565ccb9-09b3-4dca-bbd2-7056c4178d17 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action HTTP/1.1 Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 14 Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: {"shelve": {}} Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: exception: Cannot 'shelve' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state shelved_offloaded Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4', 'body': {'shelve': {}}} Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 11:16:08.009842 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state shelved_offloaded Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state shelved_offloaded Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e565ccb9-09b3-4dca-bbd2-7056c4178d17 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 409 to user: Cannot 'shelve' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state shelved_offloaded {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:08.015658 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e565ccb9-09b3-4dca-bbd2-7056c4178d17 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action" status: 409 len: 155 microversion: 2.1 time: 0.146236 Sep 06 11:16:08.016932 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2604/5156] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:07 2022] POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action => generated 155 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 06 11:16:08.029792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-24b16d91-716c-41e2-bf76-f53214058527 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:08.030439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-24b16d91-716c-41e2-bf76-f53214058527 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:08.060618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b16d91-716c-41e2-bf76-f53214058527 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:08.064169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b16d91-716c-41e2-bf76-f53214058527 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:08.066322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b16d91-716c-41e2-bf76-f53214058527 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:08.068847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b16d91-716c-41e2-bf76-f53214058527 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:08.069367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b16d91-716c-41e2-bf76-f53214058527 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:08.069822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b16d91-716c-41e2-bf76-f53214058527 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:08.153171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-24b16d91-716c-41e2-bf76-f53214058527 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140876) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 11:16:08.216153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:16:08.216757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:16:08.217180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:16:08.217728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:16:08.218155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:16:08.231144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:08.231653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:08.234924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:08.238899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:08.238899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:08.238899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:08.293741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Getting quotas for project a8f9e8b0567547a1a507d7a3535227c1. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:16:08.313800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Getting quotas for user c1bd5f8a50254c598ac51debcb68dd7f and project a8f9e8b0567547a1a507d7a3535227c1. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:16:08.331428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:16:08.334697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:16:08.580366 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f398deb4-e64f-44df-ae87-98393ae5fc0e tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.643244 Sep 06 11:16:08.591153 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2553/5157] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:16:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:16:08.606182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-087013da-0b84-427c-b54d-cee7f353b653 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:08.606182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-087013da-0b84-427c-b54d-cee7f353b653 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:08.623607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-087013da-0b84-427c-b54d-cee7f353b653 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:08.626247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-087013da-0b84-427c-b54d-cee7f353b653 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:08.628523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-087013da-0b84-427c-b54d-cee7f353b653 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:08.631899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-087013da-0b84-427c-b54d-cee7f353b653 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:08.634088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-087013da-0b84-427c-b54d-cee7f353b653 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:08.634942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-087013da-0b84-427c-b54d-cee7f353b653 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:08.660832 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-24b16d91-716c-41e2-bf76-f53214058527 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action" status: 202 len: 0 microversion: 2.1 time: 0.638080 Sep 06 11:16:08.664039 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2605/5158] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:08 2022] POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:16:08.686761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e38136f2-1fc5-4f80-b51c-19faa426abf9 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:08.689591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e38136f2-1fc5-4f80-b51c-19faa426abf9 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:08.858248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e38136f2-1fc5-4f80-b51c-19faa426abf9 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:08.870203 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e38136f2-1fc5-4f80-b51c-19faa426abf9 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1225 microversion: 2.1 time: 0.204214 Sep 06 11:16:08.870999 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2606/5159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:08 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1225 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:08.876752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8208bc0a-cd0e-4541-b050-fb033d44824b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:08.884378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8208bc0a-cd0e-4541-b050-fb033d44824b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:08.900424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8208bc0a-cd0e-4541-b050-fb033d44824b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:08.901198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8208bc0a-cd0e-4541-b050-fb033d44824b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:08.901910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8208bc0a-cd0e-4541-b050-fb033d44824b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:08.902905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8208bc0a-cd0e-4541-b050-fb033d44824b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:08.903711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8208bc0a-cd0e-4541-b050-fb033d44824b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:08.904353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8208bc0a-cd0e-4541-b050-fb033d44824b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:09.108374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-087013da-0b84-427c-b54d-cee7f353b653 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:09.121932 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-087013da-0b84-427c-b54d-cee7f353b653 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1492 microversion: 2.1 time: 0.527956 Sep 06 11:16:09.141627 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2554/5160] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:08 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1492 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:09.174620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-96962970-caab-4f4d-a776-7b100c02d6d6 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:09.175545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-96962970-caab-4f4d-a776-7b100c02d6d6 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:09.185208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96962970-caab-4f4d-a776-7b100c02d6d6 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:09.186673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96962970-caab-4f4d-a776-7b100c02d6d6 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:09.187975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96962970-caab-4f4d-a776-7b100c02d6d6 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:09.189339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96962970-caab-4f4d-a776-7b100c02d6d6 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:09.190150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96962970-caab-4f4d-a776-7b100c02d6d6 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:09.190971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96962970-caab-4f4d-a776-7b100c02d6d6 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:09.252114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8208bc0a-cd0e-4541-b050-fb033d44824b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:09.265068 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8208bc0a-cd0e-4541-b050-fb033d44824b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1458 microversion: 2.1 time: 0.392397 Sep 06 11:16:09.265674 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2607/5161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:08 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1458 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:09.520832 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-96962970-caab-4f4d-a776-7b100c02d6d6 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "POST /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758/action" status: 202 len: 0 microversion: 2.1 time: 0.351826 Sep 06 11:16:09.522091 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2555/5162] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:09 2022] POST /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:16:09.530934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ef9737d1-a99e-4937-889e-ab4fbf697f47 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:09.533137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ef9737d1-a99e-4937-889e-ab4fbf697f47 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:09.539989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef9737d1-a99e-4937-889e-ab4fbf697f47 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:09.540636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef9737d1-a99e-4937-889e-ab4fbf697f47 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:09.541163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef9737d1-a99e-4937-889e-ab4fbf697f47 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:09.541973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef9737d1-a99e-4937-889e-ab4fbf697f47 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:09.542521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef9737d1-a99e-4937-889e-ab4fbf697f47 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:09.543240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef9737d1-a99e-4937-889e-ab4fbf697f47 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:09.570327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:09.775135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ef9737d1-a99e-4937-889e-ab4fbf697f47 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:09.788983 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ef9737d1-a99e-4937-889e-ab4fbf697f47 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1498 microversion: 2.1 time: 0.262146 Sep 06 11:16:09.790781 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2608/5163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:09 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1498 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:09.897538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-25b67b75-15d5-43c3-8764-8aba2f277104 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:09.899100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-25b67b75-15d5-43c3-8764-8aba2f277104 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:09.962607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-25b67b75-15d5-43c3-8764-8aba2f277104 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:09.975516 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-25b67b75-15d5-43c3-8764-8aba2f277104 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1225 microversion: 2.1 time: 0.083372 Sep 06 11:16:09.976607 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2556/5164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:09 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:10.297072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4e1d3516-d3da-4299-88bd-4c52a3d81516 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:10.297804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4e1d3516-d3da-4299-88bd-4c52a3d81516 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:10.310504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e1d3516-d3da-4299-88bd-4c52a3d81516 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:10.311928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e1d3516-d3da-4299-88bd-4c52a3d81516 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:10.312572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e1d3516-d3da-4299-88bd-4c52a3d81516 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:10.314688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e1d3516-d3da-4299-88bd-4c52a3d81516 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:10.314688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e1d3516-d3da-4299-88bd-4c52a3d81516 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:10.314688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4e1d3516-d3da-4299-88bd-4c52a3d81516 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:10.509946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4e1d3516-d3da-4299-88bd-4c52a3d81516 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:10.519292 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4e1d3516-d3da-4299-88bd-4c52a3d81516 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1458 microversion: 2.1 time: 0.226528 Sep 06 11:16:10.536350 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2609/5165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:10 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1458 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:10.814201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-582c9498-0662-4ed9-b7e0-21c3649e4760 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:10.815064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-582c9498-0662-4ed9-b7e0-21c3649e4760 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:10.826398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-582c9498-0662-4ed9-b7e0-21c3649e4760 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:10.826951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-582c9498-0662-4ed9-b7e0-21c3649e4760 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:10.827722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-582c9498-0662-4ed9-b7e0-21c3649e4760 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:10.829978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-582c9498-0662-4ed9-b7e0-21c3649e4760 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:10.830756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-582c9498-0662-4ed9-b7e0-21c3649e4760 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:10.831546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-582c9498-0662-4ed9-b7e0-21c3649e4760 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:11.000898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c0ac0f86-7c70-4a58-bf80-92b0ff3d7225 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:11.002188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c0ac0f86-7c70-4a58-bf80-92b0ff3d7225 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:11.017340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0ac0f86-7c70-4a58-bf80-92b0ff3d7225 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:11.018476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0ac0f86-7c70-4a58-bf80-92b0ff3d7225 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:11.019413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0ac0f86-7c70-4a58-bf80-92b0ff3d7225 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:11.020584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0ac0f86-7c70-4a58-bf80-92b0ff3d7225 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:11.021070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0ac0f86-7c70-4a58-bf80-92b0ff3d7225 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:11.021503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0ac0f86-7c70-4a58-bf80-92b0ff3d7225 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:11.117589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-582c9498-0662-4ed9-b7e0-21c3649e4760 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:11.134999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c0ac0f86-7c70-4a58-bf80-92b0ff3d7225 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:11.145066 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-582c9498-0662-4ed9-b7e0-21c3649e4760 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1498 microversion: 2.1 time: 0.334817 Sep 06 11:16:11.149861 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c0ac0f86-7c70-4a58-bf80-92b0ff3d7225 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1229 microversion: 2.1 time: 0.153532 Sep 06 11:16:11.149861 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2610/5166] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:10 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1229 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:11.160290 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2557/5167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:10 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1498 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:11.546392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4ae53f50-bae8-4dbd-8f30-d77ef3d73eeb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:11.548793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4ae53f50-bae8-4dbd-8f30-d77ef3d73eeb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:11.563889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ae53f50-bae8-4dbd-8f30-d77ef3d73eeb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:11.564945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ae53f50-bae8-4dbd-8f30-d77ef3d73eeb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:11.565363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ae53f50-bae8-4dbd-8f30-d77ef3d73eeb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:11.566523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ae53f50-bae8-4dbd-8f30-d77ef3d73eeb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:11.567464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ae53f50-bae8-4dbd-8f30-d77ef3d73eeb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:11.568256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4ae53f50-bae8-4dbd-8f30-d77ef3d73eeb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:11.787303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4ae53f50-bae8-4dbd-8f30-d77ef3d73eeb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:11.799004 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4ae53f50-bae8-4dbd-8f30-d77ef3d73eeb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1460 microversion: 2.1 time: 0.259295 Sep 06 11:16:11.799659 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2611/5168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:11 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1460 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:12.173393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bf5dc725-69fd-4f97-8aaa-b494a251b1db tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:12.174052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bf5dc725-69fd-4f97-8aaa-b494a251b1db tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:12.187043 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf5dc725-69fd-4f97-8aaa-b494a251b1db tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:12.187920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf5dc725-69fd-4f97-8aaa-b494a251b1db tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:12.189147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf5dc725-69fd-4f97-8aaa-b494a251b1db tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:12.189981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf5dc725-69fd-4f97-8aaa-b494a251b1db tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:12.190534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf5dc725-69fd-4f97-8aaa-b494a251b1db tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:12.191207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf5dc725-69fd-4f97-8aaa-b494a251b1db tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:12.192045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b33786f8-e847-4a66-b536-86f4b329240c tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:12.192802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b33786f8-e847-4a66-b536-86f4b329240c tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:12.199910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b33786f8-e847-4a66-b536-86f4b329240c tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:12.200981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b33786f8-e847-4a66-b536-86f4b329240c tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:12.201712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b33786f8-e847-4a66-b536-86f4b329240c tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:12.202482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b33786f8-e847-4a66-b536-86f4b329240c tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:12.203144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b33786f8-e847-4a66-b536-86f4b329240c tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:12.203745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b33786f8-e847-4a66-b536-86f4b329240c tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:12.300230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bf5dc725-69fd-4f97-8aaa-b494a251b1db tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:12.309420 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bf5dc725-69fd-4f97-8aaa-b494a251b1db tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1277 microversion: 2.1 time: 0.139640 Sep 06 11:16:12.311764 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2558/5169] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:12 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:12.525891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b33786f8-e847-4a66-b536-86f4b329240c tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:12.550104 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b33786f8-e847-4a66-b536-86f4b329240c tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1498 microversion: 2.1 time: 0.361023 Sep 06 11:16:12.553216 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2612/5170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:12 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1498 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:12.830109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-11b357db-c1f1-4d25-906e-6e6976784fc8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:12.832278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-11b357db-c1f1-4d25-906e-6e6976784fc8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:12.844448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11b357db-c1f1-4d25-906e-6e6976784fc8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:12.845619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11b357db-c1f1-4d25-906e-6e6976784fc8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:12.846566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11b357db-c1f1-4d25-906e-6e6976784fc8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:12.849221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11b357db-c1f1-4d25-906e-6e6976784fc8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:12.850236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11b357db-c1f1-4d25-906e-6e6976784fc8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:12.851181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11b357db-c1f1-4d25-906e-6e6976784fc8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:13.175476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-11b357db-c1f1-4d25-906e-6e6976784fc8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:13.188628 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-11b357db-c1f1-4d25-906e-6e6976784fc8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.367570 Sep 06 11:16:13.198981 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2559/5171] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:12 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:13.332897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-375d7b6d-ccac-42df-91f4-1cc22b2fd947 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:13.333690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-375d7b6d-ccac-42df-91f4-1cc22b2fd947 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:13.343769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-375d7b6d-ccac-42df-91f4-1cc22b2fd947 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:13.344489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-375d7b6d-ccac-42df-91f4-1cc22b2fd947 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:13.345531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-375d7b6d-ccac-42df-91f4-1cc22b2fd947 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:13.346982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-375d7b6d-ccac-42df-91f4-1cc22b2fd947 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:13.347827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-375d7b6d-ccac-42df-91f4-1cc22b2fd947 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:13.349012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-375d7b6d-ccac-42df-91f4-1cc22b2fd947 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:13.463161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-375d7b6d-ccac-42df-91f4-1cc22b2fd947 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:13.473603 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-375d7b6d-ccac-42df-91f4-1cc22b2fd947 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1283 microversion: 2.1 time: 0.144238 Sep 06 11:16:13.491722 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2613/5172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:13 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1283 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:13.579105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1dae3fce-ff58-4dd2-834c-2a685f028092 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:13.580320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1dae3fce-ff58-4dd2-834c-2a685f028092 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:13.587769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dae3fce-ff58-4dd2-834c-2a685f028092 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:13.588598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dae3fce-ff58-4dd2-834c-2a685f028092 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:13.589527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dae3fce-ff58-4dd2-834c-2a685f028092 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:13.590677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dae3fce-ff58-4dd2-834c-2a685f028092 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:13.591353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dae3fce-ff58-4dd2-834c-2a685f028092 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:13.592464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dae3fce-ff58-4dd2-834c-2a685f028092 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:13.989292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1dae3fce-ff58-4dd2-834c-2a685f028092 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:14.008805 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1dae3fce-ff58-4dd2-834c-2a685f028092 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1501 microversion: 2.1 time: 0.433096 Sep 06 11:16:14.019513 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2560/5173] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:13 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1501 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:14.039953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3009c5c2-b005-47e4-9bb8-1d369dcbd633 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:14.040666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3009c5c2-b005-47e4-9bb8-1d369dcbd633 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:14.050682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3009c5c2-b005-47e4-9bb8-1d369dcbd633 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:14.051227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3009c5c2-b005-47e4-9bb8-1d369dcbd633 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:14.054008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3009c5c2-b005-47e4-9bb8-1d369dcbd633 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:14.054969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3009c5c2-b005-47e4-9bb8-1d369dcbd633 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:14.057974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3009c5c2-b005-47e4-9bb8-1d369dcbd633 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:14.058762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3009c5c2-b005-47e4-9bb8-1d369dcbd633 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:14.109547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-3009c5c2-b005-47e4-9bb8-1d369dcbd633 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lazy-loading 'flavor' on Instance uuid 71c30eb0-d18b-4c1a-91bf-e7d542040758 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:16:14.224731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c97699c-de3f-49b3-b6e2-e402766b0630 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:14.225367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1c97699c-de3f-49b3-b6e2-e402766b0630 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:14.235801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c97699c-de3f-49b3-b6e2-e402766b0630 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:14.236295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c97699c-de3f-49b3-b6e2-e402766b0630 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:14.237399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c97699c-de3f-49b3-b6e2-e402766b0630 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:14.238402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c97699c-de3f-49b3-b6e2-e402766b0630 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:14.239002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c97699c-de3f-49b3-b6e2-e402766b0630 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:14.239661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c97699c-de3f-49b3-b6e2-e402766b0630 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:14.538364 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3009c5c2-b005-47e4-9bb8-1d369dcbd633 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "POST /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758/action" status: 202 len: 0 microversion: 2.1 time: 0.502271 Sep 06 11:16:14.540036 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2614/5174] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:14 2022] POST /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:16:14.549241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34059bb9-cb0e-43cf-93fb-b1ea5f5c9c94 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:14.550299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-34059bb9-cb0e-43cf-93fb-b1ea5f5c9c94 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:14.558516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34059bb9-cb0e-43cf-93fb-b1ea5f5c9c94 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:14.559777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34059bb9-cb0e-43cf-93fb-b1ea5f5c9c94 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:14.560436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34059bb9-cb0e-43cf-93fb-b1ea5f5c9c94 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:14.561944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34059bb9-cb0e-43cf-93fb-b1ea5f5c9c94 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:14.564764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34059bb9-cb0e-43cf-93fb-b1ea5f5c9c94 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:14.565647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34059bb9-cb0e-43cf-93fb-b1ea5f5c9c94 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:15.171081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-34059bb9-cb0e-43cf-93fb-b1ea5f5c9c94 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:15.184696 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-34059bb9-cb0e-43cf-93fb-b1ea5f5c9c94 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1325 microversion: 2.1 time: 0.642657 Sep 06 11:16:15.206154 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2615/5175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:14 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1325 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:15.213797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8a8047a1-f515-446b-a27d-c505e54ca9fc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:15.214819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8a8047a1-f515-446b-a27d-c505e54ca9fc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:15.228558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a8047a1-f515-446b-a27d-c505e54ca9fc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:15.229791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a8047a1-f515-446b-a27d-c505e54ca9fc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:15.230466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a8047a1-f515-446b-a27d-c505e54ca9fc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:15.230833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1c97699c-de3f-49b3-b6e2-e402766b0630 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:15.234462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a8047a1-f515-446b-a27d-c505e54ca9fc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:15.235585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a8047a1-f515-446b-a27d-c505e54ca9fc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:15.236379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a8047a1-f515-446b-a27d-c505e54ca9fc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:15.267962 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1c97699c-de3f-49b3-b6e2-e402766b0630 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 1.047828 Sep 06 11:16:15.273279 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2561/5176] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:14 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:15.851195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8a8047a1-f515-446b-a27d-c505e54ca9fc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:15.878016 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8a8047a1-f515-446b-a27d-c505e54ca9fc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1492 microversion: 2.1 time: 0.669343 Sep 06 11:16:15.882430 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2616/5177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:15 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1492 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:15.909275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-73ccce08-7251-4864-867b-32f2cc879297 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:15.913149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-73ccce08-7251-4864-867b-32f2cc879297 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:15.949373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73ccce08-7251-4864-867b-32f2cc879297 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:15.950309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73ccce08-7251-4864-867b-32f2cc879297 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:15.951102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73ccce08-7251-4864-867b-32f2cc879297 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:15.952413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73ccce08-7251-4864-867b-32f2cc879297 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:15.953199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73ccce08-7251-4864-867b-32f2cc879297 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:15.953897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73ccce08-7251-4864-867b-32f2cc879297 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:16.218120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6ca85eb1-a156-4df3-9a0e-d17963b2a020 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:16.219216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6ca85eb1-a156-4df3-9a0e-d17963b2a020 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:16.276295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ca85eb1-a156-4df3-9a0e-d17963b2a020 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:16.279393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ca85eb1-a156-4df3-9a0e-d17963b2a020 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:16.280331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ca85eb1-a156-4df3-9a0e-d17963b2a020 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:16.283259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ca85eb1-a156-4df3-9a0e-d17963b2a020 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:16.286732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ca85eb1-a156-4df3-9a0e-d17963b2a020 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:16.288465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ca85eb1-a156-4df3-9a0e-d17963b2a020 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:16.323453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:16.474557 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-73ccce08-7251-4864-867b-32f2cc879297 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "POST /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758/action" status: 202 len: 0 microversion: 2.1 time: 0.572258 Sep 06 11:16:16.475989 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2562/5178] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:15 2022] POST /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:16:16.486416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7c8c9ac8-ddf1-4ed9-a2b3-59937fd2ec79 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:16.488655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7c8c9ac8-ddf1-4ed9-a2b3-59937fd2ec79 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:16.510466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c8c9ac8-ddf1-4ed9-a2b3-59937fd2ec79 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:16.511551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c8c9ac8-ddf1-4ed9-a2b3-59937fd2ec79 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:16.512217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c8c9ac8-ddf1-4ed9-a2b3-59937fd2ec79 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:16.513194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c8c9ac8-ddf1-4ed9-a2b3-59937fd2ec79 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:16.513892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c8c9ac8-ddf1-4ed9-a2b3-59937fd2ec79 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:16.514648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c8c9ac8-ddf1-4ed9-a2b3-59937fd2ec79 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:17.267993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6ca85eb1-a156-4df3-9a0e-d17963b2a020 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:17.287173 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6ca85eb1-a156-4df3-9a0e-d17963b2a020 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1325 microversion: 2.1 time: 1.072993 Sep 06 11:16:17.291595 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2617/5179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:16 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1325 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:17.301081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-74dae431-cdcd-42fb-8808-96a11715cdeb req-40119847-3a83-436f-b778-015b31f34479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae4e6be1-0579-48b9-936b-d8e859f6c41c", "tag": "7f11271c-9773-4c22-ba1b-370c4bebf6c5"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:17.328966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-74dae431-cdcd-42fb-8808-96a11715cdeb req-40119847-3a83-436f-b778-015b31f34479 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:17.329823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-74dae431-cdcd-42fb-8808-96a11715cdeb req-40119847-3a83-436f-b778-015b31f34479 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:17.330451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-74dae431-cdcd-42fb-8808-96a11715cdeb req-40119847-3a83-436f-b778-015b31f34479 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:17.343046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7c8c9ac8-ddf1-4ed9-a2b3-59937fd2ec79 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:17.351457 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-74dae431-cdcd-42fb-8808-96a11715cdeb req-40119847-3a83-436f-b778-015b31f34479 service nova] Creating event network-changed:7f11271c-9773-4c22-ba1b-370c4bebf6c5 for instance ae4e6be1-0579-48b9-936b-d8e859f6c41c on nch2-master-1 Sep 06 11:16:17.358324 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-74dae431-cdcd-42fb-8808-96a11715cdeb req-40119847-3a83-436f-b778-015b31f34479 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065204 Sep 06 11:16:17.363764 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7c8c9ac8-ddf1-4ed9-a2b3-59937fd2ec79 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.884830 Sep 06 11:16:17.365905 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2618/5180] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:16:17.371193 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2563/5181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:16 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:17.389463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-05531a85-515d-4fb7-8091-1ef81b4aeb84 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:17.391140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-05531a85-515d-4fb7-8091-1ef81b4aeb84 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:17.421710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05531a85-515d-4fb7-8091-1ef81b4aeb84 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:17.422517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05531a85-515d-4fb7-8091-1ef81b4aeb84 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:17.423799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05531a85-515d-4fb7-8091-1ef81b4aeb84 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:17.425647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05531a85-515d-4fb7-8091-1ef81b4aeb84 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:17.426342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05531a85-515d-4fb7-8091-1ef81b4aeb84 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:17.427212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05531a85-515d-4fb7-8091-1ef81b4aeb84 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:17.982063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-05531a85-515d-4fb7-8091-1ef81b4aeb84 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:17.988772 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-05531a85-515d-4fb7-8091-1ef81b4aeb84 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1498 microversion: 2.1 time: 0.621114 Sep 06 11:16:17.994469 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2619/5182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:17 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1498 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:18.313988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-89400682-a023-4b39-808f-e46ef1c83e1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:18.314685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-89400682-a023-4b39-808f-e46ef1c83e1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:18.324964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:18.326663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89400682-a023-4b39-808f-e46ef1c83e1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:18.327188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89400682-a023-4b39-808f-e46ef1c83e1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:18.327642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89400682-a023-4b39-808f-e46ef1c83e1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:18.343234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89400682-a023-4b39-808f-e46ef1c83e1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:18.345367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89400682-a023-4b39-808f-e46ef1c83e1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:18.345728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89400682-a023-4b39-808f-e46ef1c83e1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:18.393874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ecfd1b3f-d3ab-4407-9d24-7d49940a4c8c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:18.395670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ecfd1b3f-d3ab-4407-9d24-7d49940a4c8c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:18.414633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecfd1b3f-d3ab-4407-9d24-7d49940a4c8c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:18.416874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecfd1b3f-d3ab-4407-9d24-7d49940a4c8c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:18.417546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecfd1b3f-d3ab-4407-9d24-7d49940a4c8c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:18.424574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecfd1b3f-d3ab-4407-9d24-7d49940a4c8c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:18.424574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecfd1b3f-d3ab-4407-9d24-7d49940a4c8c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:18.424574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ecfd1b3f-d3ab-4407-9d24-7d49940a4c8c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:18.863869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:19.201968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-89400682-a023-4b39-808f-e46ef1c83e1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:19.205724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ecfd1b3f-d3ab-4407-9d24-7d49940a4c8c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:19.212223 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-89400682-a023-4b39-808f-e46ef1c83e1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1325 microversion: 2.1 time: 0.902253 Sep 06 11:16:19.215458 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2564/5183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:18 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1325 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:19.219096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-61c2adf9-c5e7-4c00-a598-46c16a86061f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:19.219732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-61c2adf9-c5e7-4c00-a598-46c16a86061f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:19.234704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:19.237810 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ecfd1b3f-d3ab-4407-9d24-7d49940a4c8c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.851245 Sep 06 11:16:19.238245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61c2adf9-c5e7-4c00-a598-46c16a86061f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:19.238832 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2620/5184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:18 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:19.252321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61c2adf9-c5e7-4c00-a598-46c16a86061f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:19.253702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61c2adf9-c5e7-4c00-a598-46c16a86061f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:19.266809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61c2adf9-c5e7-4c00-a598-46c16a86061f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:19.268616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61c2adf9-c5e7-4c00-a598-46c16a86061f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:19.269359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61c2adf9-c5e7-4c00-a598-46c16a86061f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:19.615041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-61c2adf9-c5e7-4c00-a598-46c16a86061f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:19.628638 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-61c2adf9-c5e7-4c00-a598-46c16a86061f tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1498 microversion: 2.1 time: 0.414016 Sep 06 11:16:19.629983 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2565/5185] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:19 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1498 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:20.246902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-52da9e32-a5f0-43f1-a093-4cf44cfd0601 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:20.247648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-52da9e32-a5f0-43f1-a093-4cf44cfd0601 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:20.263338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52da9e32-a5f0-43f1-a093-4cf44cfd0601 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:20.264429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52da9e32-a5f0-43f1-a093-4cf44cfd0601 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:20.265259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52da9e32-a5f0-43f1-a093-4cf44cfd0601 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:20.266281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52da9e32-a5f0-43f1-a093-4cf44cfd0601 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:20.269611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52da9e32-a5f0-43f1-a093-4cf44cfd0601 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:20.270453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52da9e32-a5f0-43f1-a093-4cf44cfd0601 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:20.286620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-253ad274-c677-4411-b5f3-60e38402b467 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:20.287285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-253ad274-c677-4411-b5f3-60e38402b467 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:20.289929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:20.303389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-253ad274-c677-4411-b5f3-60e38402b467 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:20.306030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-253ad274-c677-4411-b5f3-60e38402b467 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:20.306877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-253ad274-c677-4411-b5f3-60e38402b467 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:20.308046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-253ad274-c677-4411-b5f3-60e38402b467 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:20.309015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-253ad274-c677-4411-b5f3-60e38402b467 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:20.309628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-253ad274-c677-4411-b5f3-60e38402b467 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:20.933746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-52da9e32-a5f0-43f1-a093-4cf44cfd0601 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:20.958586 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-52da9e32-a5f0-43f1-a093-4cf44cfd0601 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1325 microversion: 2.1 time: 0.716790 Sep 06 11:16:20.972339 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2621/5186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:20 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1325 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:20.979883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b71ec1ef-3c97-4624-b441-2c0a274f81a5 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:20.997882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b71ec1ef-3c97-4624-b441-2c0a274f81a5 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:21.015679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b71ec1ef-3c97-4624-b441-2c0a274f81a5 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:21.019202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b71ec1ef-3c97-4624-b441-2c0a274f81a5 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:21.020425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b71ec1ef-3c97-4624-b441-2c0a274f81a5 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:21.025143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b71ec1ef-3c97-4624-b441-2c0a274f81a5 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:21.029996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b71ec1ef-3c97-4624-b441-2c0a274f81a5 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:21.029996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b71ec1ef-3c97-4624-b441-2c0a274f81a5 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:21.032219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-253ad274-c677-4411-b5f3-60e38402b467 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:21.083991 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-253ad274-c677-4411-b5f3-60e38402b467 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.796597 Sep 06 11:16:21.083991 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2566/5187] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:20 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:21.366729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b71ec1ef-3c97-4624-b441-2c0a274f81a5 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:21.402762 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b71ec1ef-3c97-4624-b441-2c0a274f81a5 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1501 microversion: 2.1 time: 0.428258 Sep 06 11:16:21.420345 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2622/5188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:20 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1501 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:21.436474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-398cbb29-cf00-4b15-bf19-0176f33c0a73 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:21.437701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-398cbb29-cf00-4b15-bf19-0176f33c0a73 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:21.454986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398cbb29-cf00-4b15-bf19-0176f33c0a73 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:21.458805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398cbb29-cf00-4b15-bf19-0176f33c0a73 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:21.458805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398cbb29-cf00-4b15-bf19-0176f33c0a73 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:21.458805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398cbb29-cf00-4b15-bf19-0176f33c0a73 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:21.458805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398cbb29-cf00-4b15-bf19-0176f33c0a73 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:21.458805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398cbb29-cf00-4b15-bf19-0176f33c0a73 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:21.513090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-398cbb29-cf00-4b15-bf19-0176f33c0a73 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:16:22.020982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7fe67002-d0a1-4533-a09a-63df21bfb60d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:22.024266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7fe67002-d0a1-4533-a09a-63df21bfb60d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:22.037598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fe67002-d0a1-4533-a09a-63df21bfb60d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:22.039978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fe67002-d0a1-4533-a09a-63df21bfb60d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:22.045834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fe67002-d0a1-4533-a09a-63df21bfb60d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:22.045834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fe67002-d0a1-4533-a09a-63df21bfb60d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:22.045834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fe67002-d0a1-4533-a09a-63df21bfb60d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:22.045834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7fe67002-d0a1-4533-a09a-63df21bfb60d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:22.086228 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-398cbb29-cf00-4b15-bf19-0176f33c0a73 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "DELETE /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 204 len: 0 microversion: 2.1 time: 0.654487 Sep 06 11:16:22.094029 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2567/5189] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:16:21 2022] DELETE /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:16:22.105390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-379d2bcf-8801-4abb-a126-70d1ce8279dc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:22.106787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-379d2bcf-8801-4abb-a126-70d1ce8279dc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:22.133910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-379d2bcf-8801-4abb-a126-70d1ce8279dc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:22.134520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-379d2bcf-8801-4abb-a126-70d1ce8279dc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:22.134998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-379d2bcf-8801-4abb-a126-70d1ce8279dc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:22.137333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-379d2bcf-8801-4abb-a126-70d1ce8279dc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:22.138111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-379d2bcf-8801-4abb-a126-70d1ce8279dc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:22.139643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-379d2bcf-8801-4abb-a126-70d1ce8279dc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:22.554358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7fe67002-d0a1-4533-a09a-63df21bfb60d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:22.562782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:22.573677 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7fe67002-d0a1-4533-a09a-63df21bfb60d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1325 microversion: 2.1 time: 0.557143 Sep 06 11:16:22.593226 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2623/5190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:22 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1325 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:22.599146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c6a1c14b-8969-4805-9185-4c2e870bce4f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:22.600147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c6a1c14b-8969-4805-9185-4c2e870bce4f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:22.609207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6a1c14b-8969-4805-9185-4c2e870bce4f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:22.610034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6a1c14b-8969-4805-9185-4c2e870bce4f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:22.610751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6a1c14b-8969-4805-9185-4c2e870bce4f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:22.612175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6a1c14b-8969-4805-9185-4c2e870bce4f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:22.613086 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6a1c14b-8969-4805-9185-4c2e870bce4f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:22.613839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c6a1c14b-8969-4805-9185-4c2e870bce4f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:22.666818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-379d2bcf-8801-4abb-a126-70d1ce8279dc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:22.692177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-379d2bcf-8801-4abb-a126-70d1ce8279dc tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1507 microversion: 2.1 time: 0.595482 Sep 06 11:16:22.694135 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2568/5191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:22 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1507 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:23.064224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c6a1c14b-8969-4805-9185-4c2e870bce4f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:23.084858 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c6a1c14b-8969-4805-9185-4c2e870bce4f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.489888 Sep 06 11:16:23.086055 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2624/5192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:22 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:23.266837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-7a8945a3-16ee-4baa-aa59-7af03af4d3fc req-168c35e7-dca2-4e2d-9863-ccf1719c5d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4e6be1-0579-48b9-936b-d8e859f6c41c", "name": "network-vif-plugged", "status": "completed", "tag": "7f11271c-9773-4c22-ba1b-370c4bebf6c5"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:23.288245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7a8945a3-16ee-4baa-aa59-7af03af4d3fc req-168c35e7-dca2-4e2d-9863-ccf1719c5d2f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:23.289140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7a8945a3-16ee-4baa-aa59-7af03af4d3fc req-168c35e7-dca2-4e2d-9863-ccf1719c5d2f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:23.291997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7a8945a3-16ee-4baa-aa59-7af03af4d3fc req-168c35e7-dca2-4e2d-9863-ccf1719c5d2f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:23.316263 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7a8945a3-16ee-4baa-aa59-7af03af4d3fc req-168c35e7-dca2-4e2d-9863-ccf1719c5d2f service nova] Creating event network-vif-plugged:7f11271c-9773-4c22-ba1b-370c4bebf6c5 for instance ae4e6be1-0579-48b9-936b-d8e859f6c41c on nch2-master-1 Sep 06 11:16:23.325481 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-7a8945a3-16ee-4baa-aa59-7af03af4d3fc req-168c35e7-dca2-4e2d-9863-ccf1719c5d2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066329 Sep 06 11:16:23.331756 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2569/5193] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:16:23.605223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d0b43d5d-109b-4889-8c8b-6fdd57707a4d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:23.609936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d0b43d5d-109b-4889-8c8b-6fdd57707a4d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:23.623444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0b43d5d-109b-4889-8c8b-6fdd57707a4d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:23.624756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0b43d5d-109b-4889-8c8b-6fdd57707a4d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:23.625778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0b43d5d-109b-4889-8c8b-6fdd57707a4d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:23.628516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0b43d5d-109b-4889-8c8b-6fdd57707a4d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:23.629877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0b43d5d-109b-4889-8c8b-6fdd57707a4d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:23.630820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d0b43d5d-109b-4889-8c8b-6fdd57707a4d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:23.720339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9e7a6f28-e8c1-4d1a-89dd-572839a0eb7d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:23.720945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9e7a6f28-e8c1-4d1a-89dd-572839a0eb7d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:23.738235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e7a6f28-e8c1-4d1a-89dd-572839a0eb7d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:23.738741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e7a6f28-e8c1-4d1a-89dd-572839a0eb7d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:23.739249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e7a6f28-e8c1-4d1a-89dd-572839a0eb7d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:23.740023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e7a6f28-e8c1-4d1a-89dd-572839a0eb7d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:23.740480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e7a6f28-e8c1-4d1a-89dd-572839a0eb7d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:23.740912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e7a6f28-e8c1-4d1a-89dd-572839a0eb7d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:24.166397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9e7a6f28-e8c1-4d1a-89dd-572839a0eb7d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:24.172810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d0b43d5d-109b-4889-8c8b-6fdd57707a4d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:24.188717 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d0b43d5d-109b-4889-8c8b-6fdd57707a4d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1325 microversion: 2.1 time: 0.592628 Sep 06 11:16:24.190403 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2625/5194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:23 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1325 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:24.190869 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9e7a6f28-e8c1-4d1a-89dd-572839a0eb7d tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1507 microversion: 2.1 time: 0.476535 Sep 06 11:16:24.191949 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2570/5195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:23 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1507 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:24.197034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-551462d8-7bfd-4c1c-81e0-00825ac87d2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:24.197878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-551462d8-7bfd-4c1c-81e0-00825ac87d2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:24.206883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-551462d8-7bfd-4c1c-81e0-00825ac87d2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:24.219481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-551462d8-7bfd-4c1c-81e0-00825ac87d2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:24.219481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-551462d8-7bfd-4c1c-81e0-00825ac87d2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:24.219481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-551462d8-7bfd-4c1c-81e0-00825ac87d2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:24.219481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-551462d8-7bfd-4c1c-81e0-00825ac87d2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:24.219481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-551462d8-7bfd-4c1c-81e0-00825ac87d2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:24.480974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-551462d8-7bfd-4c1c-81e0-00825ac87d2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:24.498828 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-551462d8-7bfd-4c1c-81e0-00825ac87d2c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.304718 Sep 06 11:16:24.500318 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2571/5196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:24 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:25.220638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7af9ebf0-e492-436b-bfc8-b8276b457136 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:25.222247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7af9ebf0-e492-436b-bfc8-b8276b457136 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:25.235148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0b40641c-94a9-4a09-adcb-ca38e29360ab tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:25.236082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:25.236374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0b40641c-94a9-4a09-adcb-ca38e29360ab tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:25.237644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7af9ebf0-e492-436b-bfc8-b8276b457136 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:25.238623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7af9ebf0-e492-436b-bfc8-b8276b457136 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:25.238954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7af9ebf0-e492-436b-bfc8-b8276b457136 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:25.241806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7af9ebf0-e492-436b-bfc8-b8276b457136 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:25.241806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7af9ebf0-e492-436b-bfc8-b8276b457136 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:25.241806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7af9ebf0-e492-436b-bfc8-b8276b457136 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:25.244674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b40641c-94a9-4a09-adcb-ca38e29360ab tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:25.245199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b40641c-94a9-4a09-adcb-ca38e29360ab tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:25.246356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b40641c-94a9-4a09-adcb-ca38e29360ab tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:25.247620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b40641c-94a9-4a09-adcb-ca38e29360ab tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:25.249287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b40641c-94a9-4a09-adcb-ca38e29360ab tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:25.250260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b40641c-94a9-4a09-adcb-ca38e29360ab tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:25.480876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7af9ebf0-e492-436b-bfc8-b8276b457136 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:25.484336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0b40641c-94a9-4a09-adcb-ca38e29360ab tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:25.502654 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7af9ebf0-e492-436b-bfc8-b8276b457136 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1325 microversion: 2.1 time: 0.288290 Sep 06 11:16:25.503301 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2626/5197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:25 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1325 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:25.507121 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0b40641c-94a9-4a09-adcb-ca38e29360ab tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1507 microversion: 2.1 time: 0.275710 Sep 06 11:16:25.507814 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2572/5198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:25 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:25.540752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a8c39f7c-58de-46fb-b71c-4f5abc68258c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:25.541803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a8c39f7c-58de-46fb-b71c-4f5abc68258c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:25.563649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8c39f7c-58de-46fb-b71c-4f5abc68258c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:25.570345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8c39f7c-58de-46fb-b71c-4f5abc68258c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:25.572135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8c39f7c-58de-46fb-b71c-4f5abc68258c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:25.573407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8c39f7c-58de-46fb-b71c-4f5abc68258c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:25.574099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8c39f7c-58de-46fb-b71c-4f5abc68258c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:25.574750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8c39f7c-58de-46fb-b71c-4f5abc68258c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:26.036928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a8c39f7c-58de-46fb-b71c-4f5abc68258c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:26.057862 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a8c39f7c-58de-46fb-b71c-4f5abc68258c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.523374 Sep 06 11:16:26.060202 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2627/5199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:25 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:26.208216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9b227edf-08cb-4f62-9205-3e2806e1936e req-87b0404d-a6ec-423f-ba09-54bb47a5b576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c30eb0-d18b-4c1a-91bf-e7d542040758", "name": "network-vif-deleted", "tag": "39b64b09-4da2-4777-bd31-9811a1f26269"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:26.238939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9b227edf-08cb-4f62-9205-3e2806e1936e req-87b0404d-a6ec-423f-ba09-54bb47a5b576 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:26.239816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9b227edf-08cb-4f62-9205-3e2806e1936e req-87b0404d-a6ec-423f-ba09-54bb47a5b576 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:26.240283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9b227edf-08cb-4f62-9205-3e2806e1936e req-87b0404d-a6ec-423f-ba09-54bb47a5b576 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:26.267283 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9b227edf-08cb-4f62-9205-3e2806e1936e req-87b0404d-a6ec-423f-ba09-54bb47a5b576 service nova] Creating event network-vif-deleted:39b64b09-4da2-4777-bd31-9811a1f26269 for instance 71c30eb0-d18b-4c1a-91bf-e7d542040758 on nch1-master-1 Sep 06 11:16:26.276497 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9b227edf-08cb-4f62-9205-3e2806e1936e req-87b0404d-a6ec-423f-ba09-54bb47a5b576 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311935 Sep 06 11:16:26.277450 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2573/5200] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:16:26.557346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-df66b53f-2160-41ce-926b-08531a18ad1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:26.562492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:26.570674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-df66b53f-2160-41ce-926b-08531a18ad1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:26.573353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:26.604946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df66b53f-2160-41ce-926b-08531a18ad1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:26.608058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:26.611808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df66b53f-2160-41ce-926b-08531a18ad1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:26.615232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:26.616288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df66b53f-2160-41ce-926b-08531a18ad1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:26.617148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:26.621393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df66b53f-2160-41ce-926b-08531a18ad1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:26.623449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:26.628025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df66b53f-2160-41ce-926b-08531a18ad1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:26.629043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df66b53f-2160-41ce-926b-08531a18ad1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:26.632131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:26.634180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:26.792583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:26.793305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:26.799798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:26.799798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lazy-loading 'fault' on Instance uuid 71c30eb0-d18b-4c1a-91bf-e7d542040758 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:16:26.938088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dec6a381d98493c9cef244f20002949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208a457b167e497ab5fc0b63cee8b85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:26.947258 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fa5f71cd-552d-4b8d-9a71-5edd90255c0b tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 200 len: 1304 microversion: 2.1 time: 0.418073 Sep 06 11:16:26.951775 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2574/5201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:26 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 1304 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:27.100318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bb83cfc9-19bb-425b-a6ea-17efd99eb0e6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:27.101797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bb83cfc9-19bb-425b-a6ea-17efd99eb0e6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:27.112768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb83cfc9-19bb-425b-a6ea-17efd99eb0e6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:27.114047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb83cfc9-19bb-425b-a6ea-17efd99eb0e6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:27.115287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb83cfc9-19bb-425b-a6ea-17efd99eb0e6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:27.116752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb83cfc9-19bb-425b-a6ea-17efd99eb0e6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:27.117550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb83cfc9-19bb-425b-a6ea-17efd99eb0e6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:27.118594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb83cfc9-19bb-425b-a6ea-17efd99eb0e6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:27.434860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-df66b53f-2160-41ce-926b-08531a18ad1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:27.461936 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-df66b53f-2160-41ce-926b-08531a18ad1d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1521 microversion: 2.1 time: 0.937314 Sep 06 11:16:27.465149 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2628/5202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:26 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1521 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:27.493336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9001dfde-9f16-47d1-b330-3a1f95ef1e08 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:27.494137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9001dfde-9f16-47d1-b330-3a1f95ef1e08 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:27.534177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9001dfde-9f16-47d1-b330-3a1f95ef1e08 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:27.535075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bb83cfc9-19bb-425b-a6ea-17efd99eb0e6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:27.537124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9001dfde-9f16-47d1-b330-3a1f95ef1e08 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:27.538388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9001dfde-9f16-47d1-b330-3a1f95ef1e08 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:27.539199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9001dfde-9f16-47d1-b330-3a1f95ef1e08 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:27.539679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9001dfde-9f16-47d1-b330-3a1f95ef1e08 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:27.542198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9001dfde-9f16-47d1-b330-3a1f95ef1e08 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:27.551047 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bb83cfc9-19bb-425b-a6ea-17efd99eb0e6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.455990 Sep 06 11:16:27.551714 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2575/5203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:27 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:27.652178 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-9001dfde-9f16-47d1-b330-3a1f95ef1e08 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] HTTP exception thrown: Action 999 not found Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9001dfde-9f16-47d1-b330-3a1f95ef1e08 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Request method failure captured: Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c/os-instance-actions/999 HTTP/1.1 Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyv223eA8X0fcJmGwanPMKMKPV7sBxeJRWMtDwWvx9PowkhscxdHAVj6eQaIxVr6FcfGsgu4wk239TiZQJuJeYhP7D_OtJW1M5cjzEW_HzzxM4xZgHA8IwxzKGAzQ8CKsCHs7sUDZ3vWTbglA447lUQ3KH0_XbM1jmflPfYKjW2eccg Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: a8f9e8b0567547a1a507d7a3535227c1 Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-904841816 Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a8f9e8b0567547a1a507d7a3535227c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8f9e8b0567547a1a507d7a3535227c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a8f9e8b0567547a1a507d7a3535227c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8f9e8b0567547a1a507d7a3535227c1"}]}] Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-904841816 Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: a8f9e8b0567547a1a507d7a3535227c1 Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-904841816 Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-InstanceActionsNegativeTestJSON-904841816-project Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: c1bd5f8a50254c598ac51debcb68dd7f Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-904841816-project Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: exception: Action 999 not found Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'server_id': 'ae4e6be1-0579-48b9-936b-d8e859f6c41c', 'id': '999'} Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 06 11:16:27.658538 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:27.663273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9001dfde-9f16-47d1-b330-3a1f95ef1e08 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Returning 404 to user: Action 999 not found {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:27.663273 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9001dfde-9f16-47d1-b330-3a1f95ef1e08 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.171982 Sep 06 11:16:27.663273 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2629/5204] 10.222.0.20 () {58 vars in 1308 bytes} [Tue Sep 6 11:16:27 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c/os-instance-actions/999 => generated 66 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:16:27.683949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-88258017-cdbe-4e0e-8919-ad8603e47311 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '.version_select at 0x7f90f36b6280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:27.686954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-88258017-cdbe-4e0e-8919-ad8603e47311 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: 5e44dda2-338f-4391-91aa-92225589754f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:27.698667 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-88258017-cdbe-4e0e-8919-ad8603e47311 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] HTTP exception thrown: Instance 5e44dda2-338f-4391-91aa-92225589754f could not be found. Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-88258017-cdbe-4e0e-8919-ad8603e47311 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Request method failure captured: Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/5e44dda2-338f-4391-91aa-92225589754f/os-instance-actions HTTP/1.1 Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyv223eA8X0fcJmGwanPMKMKPV7sBxeJRWMtDwWvx9PowkhscxdHAVj6eQaIxVr6FcfGsgu4wk239TiZQJuJeYhP7D_OtJW1M5cjzEW_HzzxM4xZgHA8IwxzKGAzQ8CKsCHs7sUDZ3vWTbglA447lUQ3KH0_XbM1jmflPfYKjW2eccg Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: a8f9e8b0567547a1a507d7a3535227c1 Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-904841816 Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a8f9e8b0567547a1a507d7a3535227c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8f9e8b0567547a1a507d7a3535227c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a8f9e8b0567547a1a507d7a3535227c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8f9e8b0567547a1a507d7a3535227c1"}]}] Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-904841816 Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: a8f9e8b0567547a1a507d7a3535227c1 Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-904841816 Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-InstanceActionsNegativeTestJSON-904841816-project Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: c1bd5f8a50254c598ac51debcb68dd7f Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-904841816-project Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 5e44dda2-338f-4391-91aa-92225589754f could not be found. Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'server_id': '5e44dda2-338f-4391-91aa-92225589754f'} Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e44dda2-338f-4391-91aa-92225589754f could not be found. Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:16:27.703901 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:16:27.712998 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e44dda2-338f-4391-91aa-92225589754f could not be found. Sep 06 11:16:27.712998 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:27.712998 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:27.712998 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:27.712998 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:27.712998 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:27.712998 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:27.712998 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:27.712998 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:27.712998 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e44dda2-338f-4391-91aa-92225589754f could not be found. Sep 06 11:16:27.712998 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:27.712998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-88258017-cdbe-4e0e-8919-ad8603e47311 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Returning 404 to user: Instance 5e44dda2-338f-4391-91aa-92225589754f could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:27.712998 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-88258017-cdbe-4e0e-8919-ad8603e47311 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/5e44dda2-338f-4391-91aa-92225589754f/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.037323 Sep 06 11:16:27.720397 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2576/5205] 10.222.0.20 () {58 vars in 1296 bytes} [Tue Sep 6 11:16:27 2022] GET /compute/v2.1/servers/5e44dda2-338f-4391-91aa-92225589754f/os-instance-actions => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:16:27.731116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-10195ae5-9960-4afb-8f0b-2ed434b08f3d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:27.733178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-10195ae5-9960-4afb-8f0b-2ed434b08f3d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:27.742157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10195ae5-9960-4afb-8f0b-2ed434b08f3d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:27.742668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10195ae5-9960-4afb-8f0b-2ed434b08f3d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:27.743147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10195ae5-9960-4afb-8f0b-2ed434b08f3d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:27.743884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10195ae5-9960-4afb-8f0b-2ed434b08f3d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:27.744713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10195ae5-9960-4afb-8f0b-2ed434b08f3d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:27.745386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10195ae5-9960-4afb-8f0b-2ed434b08f3d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:27.816685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-10195ae5-9960-4afb-8f0b-2ed434b08f3d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:16:27.993624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-735d30cf-749f-4935-9d56-06a9c44b2283 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:27.994672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-735d30cf-749f-4935-9d56-06a9c44b2283 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] [instance: 71c30eb0-d18b-4c1a-91bf-e7d542040758] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:28.008299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-735d30cf-749f-4935-9d56-06a9c44b2283 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:28.009325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-735d30cf-749f-4935-9d56-06a9c44b2283 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:28.010222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-735d30cf-749f-4935-9d56-06a9c44b2283 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:28.011959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-735d30cf-749f-4935-9d56-06a9c44b2283 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:28.012680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-735d30cf-749f-4935-9d56-06a9c44b2283 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:28.013420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-735d30cf-749f-4935-9d56-06a9c44b2283 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:28.040235 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-735d30cf-749f-4935-9d56-06a9c44b2283 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] HTTP exception thrown: Instance 71c30eb0-d18b-4c1a-91bf-e7d542040758 could not be found. Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-735d30cf-749f-4935-9d56-06a9c44b2283 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Request method failure captured: Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 HTTP/1.1 Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyvc9PQqtnFv62H5-4Wi4nnSR8K9ydeuzS0BwrhxJYVxsZLh3eJMZPdo42HjUHtvqUil9TRi5KKEsDi1Y8ImUNsFf93crCHQ_N9DPmBt4T4JOLLU5JNGxYXeks1HFyD3lF03sXIZvFvgScZ8PUTZo9nxSFdercFwMJHyJgE-OMyS6CA Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 208a457b167e497ab5fc0b63cee8b85c Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestServerAdvancedOps-1836632419 Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_208a457b167e497ab5fc0b63cee8b85c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208a457b167e497ab5fc0b63cee8b85c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/208a457b167e497ab5fc0b63cee8b85c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208a457b167e497ab5fc0b63cee8b85c"}]}] Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestServerAdvancedOps-1836632419 Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 208a457b167e497ab5fc0b63cee8b85c Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestServerAdvancedOps-1836632419 Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestServerAdvancedOps-1836632419-project Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 7dec6a381d98493c9cef244f20002949 Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestServerAdvancedOps-1836632419-project Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 71c30eb0-d18b-4c1a-91bf-e7d542040758 could not be found. Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '71c30eb0-d18b-4c1a-91bf-e7d542040758'} Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c30eb0-d18b-4c1a-91bf-e7d542040758 could not be found. Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c30eb0-d18b-4c1a-91bf-e7d542040758 could not be found. Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:28.042843 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:28.055220 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:28.055220 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:28.055220 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:28.055220 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:28.055220 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:28.055220 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c30eb0-d18b-4c1a-91bf-e7d542040758 could not be found. Sep 06 11:16:28.055220 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:28.055220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-735d30cf-749f-4935-9d56-06a9c44b2283 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] Returning 404 to user: Instance 71c30eb0-d18b-4c1a-91bf-e7d542040758 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:28.055220 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-735d30cf-749f-4935-9d56-06a9c44b2283 tempest-TestServerAdvancedOps-1836632419 tempest-TestServerAdvancedOps-1836632419-project] 10.222.0.20 "GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758" status: 404 len: 111 microversion: 2.1 time: 0.065263 Sep 06 11:16:28.055220 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2577/5206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:27 2022] GET /compute/v2.1/servers/71c30eb0-d18b-4c1a-91bf-e7d542040758 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:16:28.337503 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-10195ae5-9960-4afb-8f0b-2ed434b08f3d tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 204 len: 0 microversion: 2.1 time: 0.614465 Sep 06 11:16:28.338600 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2630/5207] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:16:27 2022] DELETE /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:16:28.350565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-64851b7f-1dfb-4006-a8a5-44f3f6606f54 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:28.351277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-64851b7f-1dfb-4006-a8a5-44f3f6606f54 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:28.368090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64851b7f-1dfb-4006-a8a5-44f3f6606f54 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:28.368918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64851b7f-1dfb-4006-a8a5-44f3f6606f54 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:28.369557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64851b7f-1dfb-4006-a8a5-44f3f6606f54 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:28.370618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64851b7f-1dfb-4006-a8a5-44f3f6606f54 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:28.371323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64851b7f-1dfb-4006-a8a5-44f3f6606f54 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:28.371968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-64851b7f-1dfb-4006-a8a5-44f3f6606f54 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:28.578806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c11cf39d-7729-4e7e-911f-66281a9cd509 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:28.580034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c11cf39d-7729-4e7e-911f-66281a9cd509 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:28.596135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c11cf39d-7729-4e7e-911f-66281a9cd509 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:28.596926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c11cf39d-7729-4e7e-911f-66281a9cd509 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:28.597587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c11cf39d-7729-4e7e-911f-66281a9cd509 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:28.598526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c11cf39d-7729-4e7e-911f-66281a9cd509 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:28.599354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c11cf39d-7729-4e7e-911f-66281a9cd509 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:28.600048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c11cf39d-7729-4e7e-911f-66281a9cd509 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:29.188490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-64851b7f-1dfb-4006-a8a5-44f3f6606f54 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:29.205625 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-64851b7f-1dfb-4006-a8a5-44f3f6606f54 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1527 microversion: 2.1 time: 0.859526 Sep 06 11:16:29.208225 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2578/5208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:28 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1527 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:29.230306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c11cf39d-7729-4e7e-911f-66281a9cd509 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:29.251284 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c11cf39d-7729-4e7e-911f-66281a9cd509 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.677882 Sep 06 11:16:29.252256 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2631/5209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:28 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:30.232261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0bb42070-9ba8-401e-b760-8f682488bde3 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:30.233772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0bb42070-9ba8-401e-b760-8f682488bde3 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:30.242799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bb42070-9ba8-401e-b760-8f682488bde3 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:30.243812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bb42070-9ba8-401e-b760-8f682488bde3 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:30.245284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bb42070-9ba8-401e-b760-8f682488bde3 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:30.246332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bb42070-9ba8-401e-b760-8f682488bde3 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:30.247826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bb42070-9ba8-401e-b760-8f682488bde3 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:30.248744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bb42070-9ba8-401e-b760-8f682488bde3 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:30.276671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e363a6f3-f002-4e53-9d6c-ce1cf19cf91a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:30.277301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e363a6f3-f002-4e53-9d6c-ce1cf19cf91a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:30.289667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e363a6f3-f002-4e53-9d6c-ce1cf19cf91a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:30.293736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e363a6f3-f002-4e53-9d6c-ce1cf19cf91a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:30.294423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e363a6f3-f002-4e53-9d6c-ce1cf19cf91a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:30.295388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e363a6f3-f002-4e53-9d6c-ce1cf19cf91a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:30.298688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e363a6f3-f002-4e53-9d6c-ce1cf19cf91a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:30.299361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e363a6f3-f002-4e53-9d6c-ce1cf19cf91a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:30.595830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0bb42070-9ba8-401e-b760-8f682488bde3 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:30.601355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e363a6f3-f002-4e53-9d6c-ce1cf19cf91a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:30.630667 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e363a6f3-f002-4e53-9d6c-ce1cf19cf91a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.357443 Sep 06 11:16:30.631100 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0bb42070-9ba8-401e-b760-8f682488bde3 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1527 microversion: 2.1 time: 0.404561 Sep 06 11:16:30.642459 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2579/5210] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:30 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1527 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:30.649399 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2632/5211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:30 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:31.657055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f15e9df4-24d6-4cec-a2d6-2241c4cececb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:31.657836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f15e9df4-24d6-4cec-a2d6-2241c4cececb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:31.665733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f15e9df4-24d6-4cec-a2d6-2241c4cececb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:31.666424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f15e9df4-24d6-4cec-a2d6-2241c4cececb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:31.667162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f15e9df4-24d6-4cec-a2d6-2241c4cececb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:31.668144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f15e9df4-24d6-4cec-a2d6-2241c4cececb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:31.668719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f15e9df4-24d6-4cec-a2d6-2241c4cececb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:31.669807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f15e9df4-24d6-4cec-a2d6-2241c4cececb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:31.671667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0659c298-0358-4fb7-b379-a8702e6833cb tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:31.672299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0659c298-0358-4fb7-b379-a8702e6833cb tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:31.679474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0659c298-0358-4fb7-b379-a8702e6833cb tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:31.679969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0659c298-0358-4fb7-b379-a8702e6833cb tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:31.680419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0659c298-0358-4fb7-b379-a8702e6833cb tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:31.681137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0659c298-0358-4fb7-b379-a8702e6833cb tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:31.681606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0659c298-0358-4fb7-b379-a8702e6833cb tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:31.682041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0659c298-0358-4fb7-b379-a8702e6833cb tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:31.687152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:31.967655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f15e9df4-24d6-4cec-a2d6-2241c4cececb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:31.976995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0659c298-0358-4fb7-b379-a8702e6833cb tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:31.993884 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f15e9df4-24d6-4cec-a2d6-2241c4cececb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.341567 Sep 06 11:16:32.003989 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0659c298-0358-4fb7-b379-a8702e6833cb tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1527 microversion: 2.1 time: 0.336336 Sep 06 11:16:32.005765 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2633/5212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:31 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1527 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:32.023398 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2580/5213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:31 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:32.034629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-f723fc3a-80b6-4a7d-9372-e5efb7bc8346 req-cec72d80-5010-470c-bc7e-e3526e10f9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4e6be1-0579-48b9-936b-d8e859f6c41c", "name": "network-vif-deleted", "tag": "7f11271c-9773-4c22-ba1b-370c4bebf6c5"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:32.061260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f723fc3a-80b6-4a7d-9372-e5efb7bc8346 req-cec72d80-5010-470c-bc7e-e3526e10f9f5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:32.062072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f723fc3a-80b6-4a7d-9372-e5efb7bc8346 req-cec72d80-5010-470c-bc7e-e3526e10f9f5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:32.062749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f723fc3a-80b6-4a7d-9372-e5efb7bc8346 req-cec72d80-5010-470c-bc7e-e3526e10f9f5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:32.093540 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f723fc3a-80b6-4a7d-9372-e5efb7bc8346 req-cec72d80-5010-470c-bc7e-e3526e10f9f5 service nova] Creating event network-vif-deleted:7f11271c-9773-4c22-ba1b-370c4bebf6c5 for instance ae4e6be1-0579-48b9-936b-d8e859f6c41c on nch2-master-1 Sep 06 11:16:32.104750 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-f723fc3a-80b6-4a7d-9372-e5efb7bc8346 req-cec72d80-5010-470c-bc7e-e3526e10f9f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079213 Sep 06 11:16:32.107477 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2634/5214] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:16:33.032079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:33.033518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:33.038476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fa417bff-b795-4124-b1c9-2c046ee3f1ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:33.039228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fa417bff-b795-4124-b1c9-2c046ee3f1ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:33.041895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:33.042602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:33.043270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:33.044770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:33.045410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:33.046011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:33.055099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa417bff-b795-4124-b1c9-2c046ee3f1ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:33.055099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa417bff-b795-4124-b1c9-2c046ee3f1ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:33.055339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa417bff-b795-4124-b1c9-2c046ee3f1ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:33.058136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa417bff-b795-4124-b1c9-2c046ee3f1ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:33.060199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa417bff-b795-4124-b1c9-2c046ee3f1ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:33.060693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa417bff-b795-4124-b1c9-2c046ee3f1ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:33.087079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:33.087921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:33.088541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:33.089186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lazy-loading 'fault' on Instance uuid ae4e6be1-0579-48b9-936b-d8e859f6c41c {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:16:33.161133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bd5f8a50254c598ac51debcb68dd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f9e8b0567547a1a507d7a3535227c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:33.175913 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-40a3b5ad-b6fb-4be8-82b9-2f7e27bb6627 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 200 len: 1315 microversion: 2.1 time: 0.146343 Sep 06 11:16:33.175913 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2581/5215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:33 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:33.317509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fa417bff-b795-4124-b1c9-2c046ee3f1ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:33.326849 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fa417bff-b795-4124-b1c9-2c046ee3f1ad tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.294733 Sep 06 11:16:33.327649 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2635/5216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:33 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:34.205867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-13f88a35-4f36-4bf1-ad7c-70d46c411051 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:34.207454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-13f88a35-4f36-4bf1-ad7c-70d46c411051 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] [instance: ae4e6be1-0579-48b9-936b-d8e859f6c41c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:34.218896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13f88a35-4f36-4bf1-ad7c-70d46c411051 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:34.219842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13f88a35-4f36-4bf1-ad7c-70d46c411051 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:34.220670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13f88a35-4f36-4bf1-ad7c-70d46c411051 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:34.222055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13f88a35-4f36-4bf1-ad7c-70d46c411051 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:34.222673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13f88a35-4f36-4bf1-ad7c-70d46c411051 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:34.223537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13f88a35-4f36-4bf1-ad7c-70d46c411051 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:34.239735 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-13f88a35-4f36-4bf1-ad7c-70d46c411051 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] HTTP exception thrown: Instance ae4e6be1-0579-48b9-936b-d8e859f6c41c could not be found. Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-13f88a35-4f36-4bf1-ad7c-70d46c411051 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Request method failure captured: Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c HTTP/1.1 Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyv223eA8X0fcJmGwanPMKMKPV7sBxeJRWMtDwWvx9PowkhscxdHAVj6eQaIxVr6FcfGsgu4wk239TiZQJuJeYhP7D_OtJW1M5cjzEW_HzzxM4xZgHA8IwxzKGAzQ8CKsCHs7sUDZ3vWTbglA447lUQ3KH0_XbM1jmflPfYKjW2eccg Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: a8f9e8b0567547a1a507d7a3535227c1 Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-904841816 Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a8f9e8b0567547a1a507d7a3535227c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8f9e8b0567547a1a507d7a3535227c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a8f9e8b0567547a1a507d7a3535227c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8f9e8b0567547a1a507d7a3535227c1"}]}] Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-904841816 Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: a8f9e8b0567547a1a507d7a3535227c1 Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-904841816 Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-InstanceActionsNegativeTestJSON-904841816-project Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: c1bd5f8a50254c598ac51debcb68dd7f Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-904841816-project Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance ae4e6be1-0579-48b9-936b-d8e859f6c41c could not be found. Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'ae4e6be1-0579-48b9-936b-d8e859f6c41c'} Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae4e6be1-0579-48b9-936b-d8e859f6c41c could not be found. Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae4e6be1-0579-48b9-936b-d8e859f6c41c could not be found. Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:34.241331 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:34.255592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:34.255592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:34.255592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:34.255592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:34.255592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:34.255592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:34.255592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae4e6be1-0579-48b9-936b-d8e859f6c41c could not be found. Sep 06 11:16:34.255592 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:34.255592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-13f88a35-4f36-4bf1-ad7c-70d46c411051 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] Returning 404 to user: Instance ae4e6be1-0579-48b9-936b-d8e859f6c41c could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:34.255592 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-13f88a35-4f36-4bf1-ad7c-70d46c411051 tempest-InstanceActionsNegativeTestJSON-904841816 tempest-InstanceActionsNegativeTestJSON-904841816-project] 10.222.0.20 "GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c" status: 404 len: 111 microversion: 2.1 time: 0.045668 Sep 06 11:16:34.255592 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2582/5217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:34 2022] GET /compute/v2.1/servers/ae4e6be1-0579-48b9-936b-d8e859f6c41c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:16:34.350274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c9b21e66-5553-4716-a1e2-f583827284d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:34.355465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c9b21e66-5553-4716-a1e2-f583827284d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:34.360175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9b21e66-5553-4716-a1e2-f583827284d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:34.360664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9b21e66-5553-4716-a1e2-f583827284d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:34.361291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9b21e66-5553-4716-a1e2-f583827284d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:34.362039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9b21e66-5553-4716-a1e2-f583827284d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:34.362499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9b21e66-5553-4716-a1e2-f583827284d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:34.362928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c9b21e66-5553-4716-a1e2-f583827284d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:34.591656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c9b21e66-5553-4716-a1e2-f583827284d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:34.608023 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c9b21e66-5553-4716-a1e2-f583827284d9 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.262013 Sep 06 11:16:34.631244 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2636/5218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:34 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:35.119430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b82d27b8-5c2d-4811-9391-dcfe2969e939 req-1839160d-3e4a-40b9-8aee-a22d3d7ef1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4", "name": "network-vif-plugged", "status": "completed", "tag": "b74c1e61-74bb-4ccc-97ba-17f5f50a6d22"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:35.135670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b82d27b8-5c2d-4811-9391-dcfe2969e939 req-1839160d-3e4a-40b9-8aee-a22d3d7ef1b6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:35.136173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b82d27b8-5c2d-4811-9391-dcfe2969e939 req-1839160d-3e4a-40b9-8aee-a22d3d7ef1b6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:35.136635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b82d27b8-5c2d-4811-9391-dcfe2969e939 req-1839160d-3e4a-40b9-8aee-a22d3d7ef1b6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:35.149758 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b82d27b8-5c2d-4811-9391-dcfe2969e939 req-1839160d-3e4a-40b9-8aee-a22d3d7ef1b6 service nova] Creating event network-vif-plugged:b74c1e61-74bb-4ccc-97ba-17f5f50a6d22 for instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 on nch2-master-1 Sep 06 11:16:35.155923 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b82d27b8-5c2d-4811-9391-dcfe2969e939 req-1839160d-3e4a-40b9-8aee-a22d3d7ef1b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041044 Sep 06 11:16:35.157743 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2583/5219] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:16:35.639260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3cd0e96e-9494-46e9-bd3d-717e1d0e45c4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:35.639972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3cd0e96e-9494-46e9-bd3d-717e1d0e45c4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:35.647726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cd0e96e-9494-46e9-bd3d-717e1d0e45c4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:35.648622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cd0e96e-9494-46e9-bd3d-717e1d0e45c4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:35.649334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cd0e96e-9494-46e9-bd3d-717e1d0e45c4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:35.650349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cd0e96e-9494-46e9-bd3d-717e1d0e45c4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:35.651195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cd0e96e-9494-46e9-bd3d-717e1d0e45c4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:35.651869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3cd0e96e-9494-46e9-bd3d-717e1d0e45c4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:36.343122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3cd0e96e-9494-46e9-bd3d-717e1d0e45c4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:36.354447 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3cd0e96e-9494-46e9-bd3d-717e1d0e45c4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.719149 Sep 06 11:16:36.356311 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2637/5220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:35 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:37.382088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c6634e0-c7ac-45e2-a35d-1c17bfffba99 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:37.383722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9c6634e0-c7ac-45e2-a35d-1c17bfffba99 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:37.393171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c6634e0-c7ac-45e2-a35d-1c17bfffba99 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:37.394002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c6634e0-c7ac-45e2-a35d-1c17bfffba99 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:37.394614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c6634e0-c7ac-45e2-a35d-1c17bfffba99 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:37.395614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c6634e0-c7ac-45e2-a35d-1c17bfffba99 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:37.396402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c6634e0-c7ac-45e2-a35d-1c17bfffba99 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:37.397052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c6634e0-c7ac-45e2-a35d-1c17bfffba99 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:37.627897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c6634e0-c7ac-45e2-a35d-1c17bfffba99 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:37.639504 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9c6634e0-c7ac-45e2-a35d-1c17bfffba99 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.262734 Sep 06 11:16:37.648346 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2584/5221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:37 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:38.662551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-576ae18b-a2dc-4509-8ffe-90e6429bc42e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:38.663842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-576ae18b-a2dc-4509-8ffe-90e6429bc42e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:38.673231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-576ae18b-a2dc-4509-8ffe-90e6429bc42e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:38.677422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-576ae18b-a2dc-4509-8ffe-90e6429bc42e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:38.677422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-576ae18b-a2dc-4509-8ffe-90e6429bc42e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:38.677422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-576ae18b-a2dc-4509-8ffe-90e6429bc42e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:38.677422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-576ae18b-a2dc-4509-8ffe-90e6429bc42e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:38.677422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-576ae18b-a2dc-4509-8ffe-90e6429bc42e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:39.012232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-576ae18b-a2dc-4509-8ffe-90e6429bc42e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:39.028928 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-576ae18b-a2dc-4509-8ffe-90e6429bc42e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1516 microversion: 2.1 time: 0.368312 Sep 06 11:16:39.034556 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2638/5222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:38 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1516 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:40.054855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93e67b15-6036-4441-912f-fa797e4d9f7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:40.055736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-93e67b15-6036-4441-912f-fa797e4d9f7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:40.065164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e67b15-6036-4441-912f-fa797e4d9f7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:40.065658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e67b15-6036-4441-912f-fa797e4d9f7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:40.066332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e67b15-6036-4441-912f-fa797e4d9f7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:40.067265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e67b15-6036-4441-912f-fa797e4d9f7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:40.067900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e67b15-6036-4441-912f-fa797e4d9f7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:40.068506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93e67b15-6036-4441-912f-fa797e4d9f7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:40.463451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-93e67b15-6036-4441-912f-fa797e4d9f7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:40.478727 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-93e67b15-6036-4441-912f-fa797e4d9f7e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.428032 Sep 06 11:16:40.479612 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2585/5223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:40 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:40.514568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3881d541-537e-4ae2-969f-27ce3e4fad5b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:40.516426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3881d541-537e-4ae2-969f-27ce3e4fad5b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:40.525209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3881d541-537e-4ae2-969f-27ce3e4fad5b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:40.526390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3881d541-537e-4ae2-969f-27ce3e4fad5b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:40.527214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3881d541-537e-4ae2-969f-27ce3e4fad5b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:40.528000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3881d541-537e-4ae2-969f-27ce3e4fad5b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:40.529176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3881d541-537e-4ae2-969f-27ce3e4fad5b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:40.529958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3881d541-537e-4ae2-969f-27ce3e4fad5b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:40.565049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:40.822875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3881d541-537e-4ae2-969f-27ce3e4fad5b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:40.832923 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3881d541-537e-4ae2-969f-27ce3e4fad5b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.330262 Sep 06 11:16:40.834174 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2639/5224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:40 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:40.865772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c4d3675-cc20-4899-b9a2-5a018d5bd256 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:40.866430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1c4d3675-cc20-4899-b9a2-5a018d5bd256 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:40.872974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c4d3675-cc20-4899-b9a2-5a018d5bd256 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:40.873489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c4d3675-cc20-4899-b9a2-5a018d5bd256 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:40.873929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c4d3675-cc20-4899-b9a2-5a018d5bd256 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:40.874637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c4d3675-cc20-4899-b9a2-5a018d5bd256 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:40.875122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c4d3675-cc20-4899-b9a2-5a018d5bd256 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:40.875556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c4d3675-cc20-4899-b9a2-5a018d5bd256 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:41.114091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1c4d3675-cc20-4899-b9a2-5a018d5bd256 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:41.128686 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1c4d3675-cc20-4899-b9a2-5a018d5bd256 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.264827 Sep 06 11:16:41.139896 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2586/5225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:40 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:41.154666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4ef9507d-7ce2-470b-9aa6-6110e27f5a2f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:41.166258 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-4ef9507d-7ce2-470b-9aa6-6110e27f5a2f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance fda14422-f4ff-472f-9ced-9bb725cb2c47 has no mapping to a cell. Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4ef9507d-7ce2-470b-9aa6-6110e27f5a2f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/fda14422-f4ff-472f-9ced-9bb725cb2c47/action HTTP/1.1 Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 15 Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: {"os-stop": {}} Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance fda14422-f4ff-472f-9ced-9bb725cb2c47 has no mapping to a cell. Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'fda14422-f4ff-472f-9ced-9bb725cb2c47', 'body': {'os-stop': {}}} Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance fda14422-f4ff-472f-9ced-9bb725cb2c47 has no mapping to a cell. Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:16:41.178250 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda14422-f4ff-472f-9ced-9bb725cb2c47 has no mapping to a cell. Sep 06 11:16:41.184910 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:41.184910 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:41.184910 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:41.184910 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:41.184910 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:41.184910 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:41.184910 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:41.184910 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:41.184910 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda14422-f4ff-472f-9ced-9bb725cb2c47 has no mapping to a cell. Sep 06 11:16:41.184910 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:41.189041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4ef9507d-7ce2-470b-9aa6-6110e27f5a2f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance fda14422-f4ff-472f-9ced-9bb725cb2c47 has no mapping to a cell. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:41.191789 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4ef9507d-7ce2-470b-9aa6-6110e27f5a2f tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/fda14422-f4ff-472f-9ced-9bb725cb2c47/action" status: 404 len: 117 microversion: 2.1 time: 0.041264 Sep 06 11:16:41.191789 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2640/5226] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:41 2022] POST /compute/v2.1/servers/fda14422-f4ff-472f-9ced-9bb725cb2c47/action => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:16:41.200700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2756a547-1110-42e8-9297-8d93dbd41c09 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:41.201592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2756a547-1110-42e8-9297-8d93dbd41c09 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:41.208931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2756a547-1110-42e8-9297-8d93dbd41c09 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:41.210815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2756a547-1110-42e8-9297-8d93dbd41c09 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:41.211976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2756a547-1110-42e8-9297-8d93dbd41c09 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:41.213586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2756a547-1110-42e8-9297-8d93dbd41c09 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:41.214792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2756a547-1110-42e8-9297-8d93dbd41c09 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:41.215909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2756a547-1110-42e8-9297-8d93dbd41c09 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:41.426063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2756a547-1110-42e8-9297-8d93dbd41c09 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:41.436425 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2756a547-1110-42e8-9297-8d93dbd41c09 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.240900 Sep 06 11:16:41.437331 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2587/5227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:41 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:41.462031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7576bd53-4ad9-47b2-8aaf-0c574c149039 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:41.462567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7576bd53-4ad9-47b2-8aaf-0c574c149039 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:41.476307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7576bd53-4ad9-47b2-8aaf-0c574c149039 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:41.476307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7576bd53-4ad9-47b2-8aaf-0c574c149039 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:41.476307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7576bd53-4ad9-47b2-8aaf-0c574c149039 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:41.476307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7576bd53-4ad9-47b2-8aaf-0c574c149039 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:41.476307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7576bd53-4ad9-47b2-8aaf-0c574c149039 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:41.476307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7576bd53-4ad9-47b2-8aaf-0c574c149039 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:41.690032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7576bd53-4ad9-47b2-8aaf-0c574c149039 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:41.702431 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7576bd53-4ad9-47b2-8aaf-0c574c149039 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.244395 Sep 06 11:16:41.703711 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2641/5228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:41 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:41.728103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1b3ed731-a64a-482b-b778-2964e0ce9e02 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:41.729068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1b3ed731-a64a-482b-b778-2964e0ce9e02 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 9d031b0a-c37d-4f0c-8735-41c2ce92ea4c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:41.736854 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-1b3ed731-a64a-482b-b778-2964e0ce9e02 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance 9d031b0a-c37d-4f0c-8735-41c2ce92ea4c could not be found. Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1b3ed731-a64a-482b-b778-2964e0ce9e02 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/9d031b0a-c37d-4f0c-8735-41c2ce92ea4c/action HTTP/1.1 Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 15 Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: {"suspend": {}} Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 9d031b0a-c37d-4f0c-8735-41c2ce92ea4c could not be found. Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '9d031b0a-c37d-4f0c-8735-41c2ce92ea4c', 'body': {'suspend': {}}} Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d031b0a-c37d-4f0c-8735-41c2ce92ea4c could not be found. Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d031b0a-c37d-4f0c-8735-41c2ce92ea4c could not be found. Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:41.738789 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:41.745066 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:41.745066 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:41.745066 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d031b0a-c37d-4f0c-8735-41c2ce92ea4c could not be found. Sep 06 11:16:41.745066 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:41.745066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1b3ed731-a64a-482b-b778-2964e0ce9e02 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance 9d031b0a-c37d-4f0c-8735-41c2ce92ea4c could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:41.745066 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1b3ed731-a64a-482b-b778-2964e0ce9e02 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/9d031b0a-c37d-4f0c-8735-41c2ce92ea4c/action" status: 404 len: 111 microversion: 2.1 time: 0.018740 Sep 06 11:16:41.751865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e007a121-9187-4ae8-a0f4-b3775e7c19ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:41.752711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e007a121-9187-4ae8-a0f4-b3775e7c19ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:41.754203 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2588/5229] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:41 2022] POST /compute/v2.1/servers/9d031b0a-c37d-4f0c-8735-41c2ce92ea4c/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:16:41.766266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e007a121-9187-4ae8-a0f4-b3775e7c19ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:41.767152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e007a121-9187-4ae8-a0f4-b3775e7c19ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:41.767853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e007a121-9187-4ae8-a0f4-b3775e7c19ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:41.768805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e007a121-9187-4ae8-a0f4-b3775e7c19ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:41.769473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e007a121-9187-4ae8-a0f4-b3775e7c19ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:41.770134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e007a121-9187-4ae8-a0f4-b3775e7c19ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:42.004755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e007a121-9187-4ae8-a0f4-b3775e7c19ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:42.018359 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e007a121-9187-4ae8-a0f4-b3775e7c19ed tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.271022 Sep 06 11:16:42.018949 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2642/5230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:41 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:42.043411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-36da6a23-9f6c-48a1-b8d4-b16b0c90dd70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:42.044831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-36da6a23-9f6c-48a1-b8d4-b16b0c90dd70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:42.054543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36da6a23-9f6c-48a1-b8d4-b16b0c90dd70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:42.055275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36da6a23-9f6c-48a1-b8d4-b16b0c90dd70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:42.056427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36da6a23-9f6c-48a1-b8d4-b16b0c90dd70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:42.057359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36da6a23-9f6c-48a1-b8d4-b16b0c90dd70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:42.058010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36da6a23-9f6c-48a1-b8d4-b16b0c90dd70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:42.058616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36da6a23-9f6c-48a1-b8d4-b16b0c90dd70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:42.428884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-36da6a23-9f6c-48a1-b8d4-b16b0c90dd70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:42.455527 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-36da6a23-9f6c-48a1-b8d4-b16b0c90dd70 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.415656 Sep 06 11:16:42.471468 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2589/5231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:42 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:42.494695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-827ce5fa-16dd-4637-990a-4ae13c83643e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:42.495447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-827ce5fa-16dd-4637-990a-4ae13c83643e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:42.506762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-827ce5fa-16dd-4637-990a-4ae13c83643e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:42.507517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-827ce5fa-16dd-4637-990a-4ae13c83643e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:42.508201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-827ce5fa-16dd-4637-990a-4ae13c83643e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:42.509238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-827ce5fa-16dd-4637-990a-4ae13c83643e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:42.509894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-827ce5fa-16dd-4637-990a-4ae13c83643e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:42.510557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-827ce5fa-16dd-4637-990a-4ae13c83643e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:42.540355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-827ce5fa-16dd-4637-990a-4ae13c83643e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lazy-loading 'flavor' on Instance uuid 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:16:42.946466 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-827ce5fa-16dd-4637-990a-4ae13c83643e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action" status: 202 len: 0 microversion: 2.1 time: 0.459279 Sep 06 11:16:42.957492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-540d9b9b-3f5c-4482-8bf5-9daf91460bb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:42.958133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-540d9b9b-3f5c-4482-8bf5-9daf91460bb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:42.963136 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2643/5232] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:42 2022] POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:16:42.968416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-540d9b9b-3f5c-4482-8bf5-9daf91460bb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:42.968938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-540d9b9b-3f5c-4482-8bf5-9daf91460bb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:42.969711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-540d9b9b-3f5c-4482-8bf5-9daf91460bb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:42.970470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-540d9b9b-3f5c-4482-8bf5-9daf91460bb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:42.970947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-540d9b9b-3f5c-4482-8bf5-9daf91460bb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:42.976725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-540d9b9b-3f5c-4482-8bf5-9daf91460bb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:43.233182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-540d9b9b-3f5c-4482-8bf5-9daf91460bb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:43.246691 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-540d9b9b-3f5c-4482-8bf5-9daf91460bb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1511 microversion: 2.1 time: 0.292495 Sep 06 11:16:43.249360 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2590/5233] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:42 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1511 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:43.488130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1499925987", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": "none"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:43.554250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:16:43.554684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:16:43.558395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:16:43.559061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:16:43.561341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:16:43.577429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:43.578186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:43.578841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:43.580863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:43.581643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:43.582091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:43.615576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Getting quotas for project ef884e8b4c124439bb5b14c191964b65. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:16:43.622911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Getting quotas for user c0e9a9114a614271846751aa8992858a and project ef884e8b4c124439bb5b14c191964b65. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:16:43.652304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:16:43.656246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:16:43.837970 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-64700622-4461-46b2-90da-ef4a3de372a8 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.540568 Sep 06 11:16:43.856617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-51023ec5-c13b-4019-a49e-4ef3741625f7 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:43.857993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-51023ec5-c13b-4019-a49e-4ef3741625f7 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:43.861824 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2644/5234] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 11:16:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 11:16:43.966188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-51023ec5-c13b-4019-a49e-4ef3741625f7 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:43.974708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-51023ec5-c13b-4019-a49e-4ef3741625f7 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:43.980507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-51023ec5-c13b-4019-a49e-4ef3741625f7 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:43.984947 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-51023ec5-c13b-4019-a49e-4ef3741625f7 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] 10.222.0.20 "GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b" status: 200 len: 1281 microversion: 2.47 time: 0.132796 Sep 06 11:16:43.994480 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2591/5235] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:16:43 2022] GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b => generated 1281 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:16:44.273395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-54ff29ba-2dbf-4914-b7f9-0487b4bc7e18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:44.274240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-54ff29ba-2dbf-4914-b7f9-0487b4bc7e18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:44.290342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54ff29ba-2dbf-4914-b7f9-0487b4bc7e18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:44.290742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54ff29ba-2dbf-4914-b7f9-0487b4bc7e18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:44.291443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54ff29ba-2dbf-4914-b7f9-0487b4bc7e18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:44.292388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54ff29ba-2dbf-4914-b7f9-0487b4bc7e18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:44.293026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54ff29ba-2dbf-4914-b7f9-0487b4bc7e18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:44.294103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54ff29ba-2dbf-4914-b7f9-0487b4bc7e18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:44.538542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-54ff29ba-2dbf-4914-b7f9-0487b4bc7e18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:44.584702 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-54ff29ba-2dbf-4914-b7f9-0487b4bc7e18 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1494 microversion: 2.1 time: 0.315670 Sep 06 11:16:44.586405 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2645/5236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:44 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1494 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:44.619261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-08afa4a8-a25a-465b-9eae-8ee7b6375fcb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:44.622036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-08afa4a8-a25a-465b-9eae-8ee7b6375fcb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:44.659311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08afa4a8-a25a-465b-9eae-8ee7b6375fcb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:44.659917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08afa4a8-a25a-465b-9eae-8ee7b6375fcb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:44.660393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08afa4a8-a25a-465b-9eae-8ee7b6375fcb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:44.661165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08afa4a8-a25a-465b-9eae-8ee7b6375fcb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:44.661645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08afa4a8-a25a-465b-9eae-8ee7b6375fcb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:44.662090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-08afa4a8-a25a-465b-9eae-8ee7b6375fcb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:44.751748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-08afa4a8-a25a-465b-9eae-8ee7b6375fcb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lazy-loading 'flavor' on Instance uuid 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:16:44.797230 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-08afa4a8-a25a-465b-9eae-8ee7b6375fcb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Cannot 'suspend' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state suspended Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-08afa4a8-a25a-465b-9eae-8ee7b6375fcb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action HTTP/1.1 Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 15 Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: {"suspend": {}} Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: exception: Cannot 'suspend' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state suspended Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4', 'body': {'suspend': {}}} Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 06 11:16:44.799578 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 11:16:44.806321 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:16:44.806321 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:16:44.806321 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state suspended Sep 06 11:16:44.806321 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:44.806321 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:44.806321 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:44.806321 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:44.806321 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:44.806321 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:44.806321 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:44.806321 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:44.806321 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state suspended Sep 06 11:16:44.806321 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:44.814963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-08afa4a8-a25a-465b-9eae-8ee7b6375fcb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 409 to user: Cannot 'suspend' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state suspended {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:44.824595 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-08afa4a8-a25a-465b-9eae-8ee7b6375fcb tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action" status: 409 len: 148 microversion: 2.1 time: 0.207355 Sep 06 11:16:44.825463 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2592/5237] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:44 2022] POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action => generated 148 bytes in 218 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:16:44.836334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b2389c0b-7edb-485d-adef-37e50ed88831 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:44.837277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b2389c0b-7edb-485d-adef-37e50ed88831 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:44.854537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2389c0b-7edb-485d-adef-37e50ed88831 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:44.855622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2389c0b-7edb-485d-adef-37e50ed88831 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:44.857053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2389c0b-7edb-485d-adef-37e50ed88831 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:44.858308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2389c0b-7edb-485d-adef-37e50ed88831 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:44.860062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2389c0b-7edb-485d-adef-37e50ed88831 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:44.860884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b2389c0b-7edb-485d-adef-37e50ed88831 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:45.015902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d2a2eed8-ce44-46ec-b448-05ad8a7724e1 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:45.017200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d2a2eed8-ce44-46ec-b448-05ad8a7724e1 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:45.112176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d2a2eed8-ce44-46ec-b448-05ad8a7724e1 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:45.123808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d2a2eed8-ce44-46ec-b448-05ad8a7724e1 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:45.126598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d2a2eed8-ce44-46ec-b448-05ad8a7724e1 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:45.127197 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d2a2eed8-ce44-46ec-b448-05ad8a7724e1 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] 10.222.0.20 "GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b" status: 200 len: 1281 microversion: 2.47 time: 0.115441 Sep 06 11:16:45.127803 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2593/5238] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:16:45 2022] GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b => generated 1281 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:16:45.203087 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b2389c0b-7edb-485d-adef-37e50ed88831 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action" status: 202 len: 0 microversion: 2.1 time: 0.372485 Sep 06 11:16:45.207940 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2646/5239] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:44 2022] POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:16:45.218808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-012d4217-ee06-4c72-96b2-5c630d40dd66 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:45.219840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-012d4217-ee06-4c72-96b2-5c630d40dd66 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:45.233301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012d4217-ee06-4c72-96b2-5c630d40dd66 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:45.234213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012d4217-ee06-4c72-96b2-5c630d40dd66 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:45.235379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012d4217-ee06-4c72-96b2-5c630d40dd66 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:45.236494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012d4217-ee06-4c72-96b2-5c630d40dd66 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:45.237344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012d4217-ee06-4c72-96b2-5c630d40dd66 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:45.238149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012d4217-ee06-4c72-96b2-5c630d40dd66 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:45.501193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-012d4217-ee06-4c72-96b2-5c630d40dd66 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:45.516437 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-012d4217-ee06-4c72-96b2-5c630d40dd66 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1500 microversion: 2.1 time: 0.305686 Sep 06 11:16:45.529034 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2594/5240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:45 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1500 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:46.155705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0521fa36-784e-4459-9f95-253221fe4681 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:46.156484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0521fa36-784e-4459-9f95-253221fe4681 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:46.163743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0521fa36-784e-4459-9f95-253221fe4681 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:46.164476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0521fa36-784e-4459-9f95-253221fe4681 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:46.165172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0521fa36-784e-4459-9f95-253221fe4681 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:46.166101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0521fa36-784e-4459-9f95-253221fe4681 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:46.166760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0521fa36-784e-4459-9f95-253221fe4681 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:46.167604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0521fa36-784e-4459-9f95-253221fe4681 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:46.286305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0521fa36-784e-4459-9f95-253221fe4681 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:46.296395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0521fa36-784e-4459-9f95-253221fe4681 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:46.298037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0521fa36-784e-4459-9f95-253221fe4681 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:46.300121 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0521fa36-784e-4459-9f95-253221fe4681 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] 10.222.0.20 "GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b" status: 200 len: 1285 microversion: 2.47 time: 0.150123 Sep 06 11:16:46.301498 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2647/5241] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:16:46 2022] GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b => generated 1285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:16:46.542552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-503d04fe-2ec0-4229-b001-e36757280964 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:46.543984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-503d04fe-2ec0-4229-b001-e36757280964 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:46.551630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-503d04fe-2ec0-4229-b001-e36757280964 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:46.552236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-503d04fe-2ec0-4229-b001-e36757280964 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:46.552698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-503d04fe-2ec0-4229-b001-e36757280964 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:46.553540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-503d04fe-2ec0-4229-b001-e36757280964 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:46.554101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-503d04fe-2ec0-4229-b001-e36757280964 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:46.554640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-503d04fe-2ec0-4229-b001-e36757280964 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:46.810431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-503d04fe-2ec0-4229-b001-e36757280964 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:46.826493 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-503d04fe-2ec0-4229-b001-e36757280964 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1500 microversion: 2.1 time: 0.290196 Sep 06 11:16:46.831325 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2595/5242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:46 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1500 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:47.331657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ac719952-1071-477a-933c-b1f4fdee80ee tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:47.332837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ac719952-1071-477a-933c-b1f4fdee80ee tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:47.348140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac719952-1071-477a-933c-b1f4fdee80ee tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:47.350707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac719952-1071-477a-933c-b1f4fdee80ee tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:47.350707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac719952-1071-477a-933c-b1f4fdee80ee tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:47.350707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac719952-1071-477a-933c-b1f4fdee80ee tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:47.351579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac719952-1071-477a-933c-b1f4fdee80ee tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:47.354928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac719952-1071-477a-933c-b1f4fdee80ee tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:47.862182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c820bd23-4b47-43e5-9e76-433a45614e25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:47.865036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c820bd23-4b47-43e5-9e76-433a45614e25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:47.892992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c820bd23-4b47-43e5-9e76-433a45614e25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:47.893742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c820bd23-4b47-43e5-9e76-433a45614e25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:47.894279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c820bd23-4b47-43e5-9e76-433a45614e25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:47.895369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c820bd23-4b47-43e5-9e76-433a45614e25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:47.900359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c820bd23-4b47-43e5-9e76-433a45614e25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:47.901515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c820bd23-4b47-43e5-9e76-433a45614e25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:47.936008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ac719952-1071-477a-933c-b1f4fdee80ee tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:47.955167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ac719952-1071-477a-933c-b1f4fdee80ee tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:47.978236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ac719952-1071-477a-933c-b1f4fdee80ee tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:47.991755 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ac719952-1071-477a-933c-b1f4fdee80ee tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] 10.222.0.20 "GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b" status: 200 len: 1341 microversion: 2.47 time: 0.655992 Sep 06 11:16:47.992821 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2648/5243] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:16:47 2022] GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b => generated 1341 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:16:48.430285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c820bd23-4b47-43e5-9e76-433a45614e25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:48.446681 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c820bd23-4b47-43e5-9e76-433a45614e25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.597888 Sep 06 11:16:48.459320 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2596/5244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:47 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:48.474545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-297802ec-b724-461c-a608-d4a96d71e16c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:48.475420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-297802ec-b724-461c-a608-d4a96d71e16c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:48.484059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-297802ec-b724-461c-a608-d4a96d71e16c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:48.484766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-297802ec-b724-461c-a608-d4a96d71e16c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:48.485267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-297802ec-b724-461c-a608-d4a96d71e16c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:48.486260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-297802ec-b724-461c-a608-d4a96d71e16c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:48.487182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-297802ec-b724-461c-a608-d4a96d71e16c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:48.487935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-297802ec-b724-461c-a608-d4a96d71e16c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:48.866867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-297802ec-b724-461c-a608-d4a96d71e16c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:48.876793 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-297802ec-b724-461c-a608-d4a96d71e16c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.407887 Sep 06 11:16:48.877888 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2649/5245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:48 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:48.902714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d4b77af7-ba1b-48eb-abe7-cb0082720956 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:48.904710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d4b77af7-ba1b-48eb-abe7-cb0082720956 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ea51c725-d3f6-4245-b5df-a78c2f9ec3b8] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:48.918351 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-d4b77af7-ba1b-48eb-abe7-cb0082720956 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance ea51c725-d3f6-4245-b5df-a78c2f9ec3b8 could not be found. Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d4b77af7-ba1b-48eb-abe7-cb0082720956 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/ea51c725-d3f6-4245-b5df-a78c2f9ec3b8/action HTTP/1.1 Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 15 Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: {"unpause": {}} Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance ea51c725-d3f6-4245-b5df-a78c2f9ec3b8 could not be found. Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'ea51c725-d3f6-4245-b5df-a78c2f9ec3b8', 'body': {'unpause': {}}} Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea51c725-d3f6-4245-b5df-a78c2f9ec3b8 could not be found. Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea51c725-d3f6-4245-b5df-a78c2f9ec3b8 could not be found. Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:48.921173 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:48.940583 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:48.940583 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:48.940583 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea51c725-d3f6-4245-b5df-a78c2f9ec3b8 could not be found. Sep 06 11:16:48.940583 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:48.940583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d4b77af7-ba1b-48eb-abe7-cb0082720956 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance ea51c725-d3f6-4245-b5df-a78c2f9ec3b8 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:48.940583 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d4b77af7-ba1b-48eb-abe7-cb0082720956 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/ea51c725-d3f6-4245-b5df-a78c2f9ec3b8/action" status: 404 len: 111 microversion: 2.1 time: 0.035884 Sep 06 11:16:48.940583 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2597/5246] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:48 2022] POST /compute/v2.1/servers/ea51c725-d3f6-4245-b5df-a78c2f9ec3b8/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:16:48.946150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-916ae0ed-0820-4885-994a-8cdd99e8eaf2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:48.947069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-916ae0ed-0820-4885-994a-8cdd99e8eaf2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:48.957061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-916ae0ed-0820-4885-994a-8cdd99e8eaf2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:48.957569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-916ae0ed-0820-4885-994a-8cdd99e8eaf2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:48.958016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-916ae0ed-0820-4885-994a-8cdd99e8eaf2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:48.958745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-916ae0ed-0820-4885-994a-8cdd99e8eaf2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:48.959272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-916ae0ed-0820-4885-994a-8cdd99e8eaf2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:48.959805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-916ae0ed-0820-4885-994a-8cdd99e8eaf2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:49.031906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-38d45f76-9d2a-4a49-9247-0b2667177a10 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:49.031906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-38d45f76-9d2a-4a49-9247-0b2667177a10 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:49.038766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38d45f76-9d2a-4a49-9247-0b2667177a10 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:49.040488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38d45f76-9d2a-4a49-9247-0b2667177a10 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:49.041156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38d45f76-9d2a-4a49-9247-0b2667177a10 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:49.041714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38d45f76-9d2a-4a49-9247-0b2667177a10 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:49.042173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38d45f76-9d2a-4a49-9247-0b2667177a10 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:49.042617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38d45f76-9d2a-4a49-9247-0b2667177a10 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:49.221159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-38d45f76-9d2a-4a49-9247-0b2667177a10 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:49.236634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-38d45f76-9d2a-4a49-9247-0b2667177a10 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:49.240447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-38d45f76-9d2a-4a49-9247-0b2667177a10 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:49.243373 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-38d45f76-9d2a-4a49-9247-0b2667177a10 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] 10.222.0.20 "GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b" status: 200 len: 1339 microversion: 2.47 time: 0.220038 Sep 06 11:16:49.246316 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2598/5247] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:16:49 2022] GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b => generated 1339 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:16:49.346151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-916ae0ed-0820-4885-994a-8cdd99e8eaf2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:49.355234 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-916ae0ed-0820-4885-994a-8cdd99e8eaf2 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.413254 Sep 06 11:16:49.364796 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2650/5248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:48 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:49.379887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b7243eab-d02b-4dc0-9fa4-67fc95356fb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:49.380789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b7243eab-d02b-4dc0-9fa4-67fc95356fb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:49.387090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7243eab-d02b-4dc0-9fa4-67fc95356fb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:49.387595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7243eab-d02b-4dc0-9fa4-67fc95356fb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:49.388038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7243eab-d02b-4dc0-9fa4-67fc95356fb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:49.388758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7243eab-d02b-4dc0-9fa4-67fc95356fb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:49.389219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7243eab-d02b-4dc0-9fa4-67fc95356fb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:49.389654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7243eab-d02b-4dc0-9fa4-67fc95356fb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:49.788115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b7243eab-d02b-4dc0-9fa4-67fc95356fb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:49.800605 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b7243eab-d02b-4dc0-9fa4-67fc95356fb6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.425010 Sep 06 11:16:49.801884 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2599/5249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:49 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:49.838757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e5278128-e333-42e4-81e7-6ca7a7091742 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:49.840728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e5278128-e333-42e4-81e7-6ca7a7091742 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:49.851394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5278128-e333-42e4-81e7-6ca7a7091742 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:49.852711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5278128-e333-42e4-81e7-6ca7a7091742 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:49.853529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5278128-e333-42e4-81e7-6ca7a7091742 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:49.854536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5278128-e333-42e4-81e7-6ca7a7091742 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:49.855037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5278128-e333-42e4-81e7-6ca7a7091742 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:49.860924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5278128-e333-42e4-81e7-6ca7a7091742 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:49.892916 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-e5278128-e333-42e4-81e7-6ca7a7091742 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Cannot 'unpause' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e5278128-e333-42e4-81e7-6ca7a7091742 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action HTTP/1.1 Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 15 Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: {"unpause": {}} Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: exception: Cannot 'unpause' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4', 'body': {'unpause': {}}} Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 in vm_state active. Cannot unpause while the instance is in this state. Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:49.894912 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:49.902811 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:49.902811 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:49.902811 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:49.902811 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:16:49.902811 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:49.902811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e5278128-e333-42e4-81e7-6ca7a7091742 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 409 to user: Cannot 'unpause' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:49.902811 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e5278128-e333-42e4-81e7-6ca7a7091742 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action" status: 409 len: 145 microversion: 2.1 time: 0.064030 Sep 06 11:16:49.902811 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2651/5250] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:49 2022] POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action => generated 145 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:16:49.913620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ea3997b-3ee5-416c-b2e1-a11fb5fa885c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:49.915214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ea3997b-3ee5-416c-b2e1-a11fb5fa885c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:49.923687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ea3997b-3ee5-416c-b2e1-a11fb5fa885c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:49.924547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ea3997b-3ee5-416c-b2e1-a11fb5fa885c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:49.925087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ea3997b-3ee5-416c-b2e1-a11fb5fa885c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:49.925887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ea3997b-3ee5-416c-b2e1-a11fb5fa885c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:49.926438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ea3997b-3ee5-416c-b2e1-a11fb5fa885c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:49.926896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ea3997b-3ee5-416c-b2e1-a11fb5fa885c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:50.192865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ea3997b-3ee5-416c-b2e1-a11fb5fa885c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:50.203485 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ea3997b-3ee5-416c-b2e1-a11fb5fa885c tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.299568 Sep 06 11:16:50.203485 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2600/5251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:49 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:50.229180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba3b7c7d-b537-4220-b07b-278afa1212ec tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:50.233746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ba3b7c7d-b537-4220-b07b-278afa1212ec tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:50.249349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba3b7c7d-b537-4220-b07b-278afa1212ec tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:50.255484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba3b7c7d-b537-4220-b07b-278afa1212ec tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:50.255484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba3b7c7d-b537-4220-b07b-278afa1212ec tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:50.255484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba3b7c7d-b537-4220-b07b-278afa1212ec tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:50.255484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba3b7c7d-b537-4220-b07b-278afa1212ec tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:50.255484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba3b7c7d-b537-4220-b07b-278afa1212ec tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:50.280661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ceabb937-bf5a-46cb-a43c-f5368a8b4b30 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:50.282447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ceabb937-bf5a-46cb-a43c-f5368a8b4b30 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:50.290069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ceabb937-bf5a-46cb-a43c-f5368a8b4b30 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:50.290902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ceabb937-bf5a-46cb-a43c-f5368a8b4b30 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:50.291584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ceabb937-bf5a-46cb-a43c-f5368a8b4b30 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:50.292757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ceabb937-bf5a-46cb-a43c-f5368a8b4b30 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:50.294021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ceabb937-bf5a-46cb-a43c-f5368a8b4b30 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:50.295090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ceabb937-bf5a-46cb-a43c-f5368a8b4b30 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:50.417035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ceabb937-bf5a-46cb-a43c-f5368a8b4b30 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:50.434448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ceabb937-bf5a-46cb-a43c-f5368a8b4b30 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:50.437165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ceabb937-bf5a-46cb-a43c-f5368a8b4b30 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:50.440325 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ceabb937-bf5a-46cb-a43c-f5368a8b4b30 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] 10.222.0.20 "GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b" status: 200 len: 1360 microversion: 2.47 time: 0.165018 Sep 06 11:16:50.441820 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2601/5252] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:16:50 2022] GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b => generated 1360 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:16:50.472551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e5a1702e-fe71-4c41-95e1-23be60ce9cfa tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1481027687"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:50.477247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e5a1702e-fe71-4c41-95e1-23be60ce9cfa tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:50.486575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:50.489106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5a1702e-fe71-4c41-95e1-23be60ce9cfa tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:50.489834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5a1702e-fe71-4c41-95e1-23be60ce9cfa tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:50.490512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5a1702e-fe71-4c41-95e1-23be60ce9cfa tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:50.491587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5a1702e-fe71-4c41-95e1-23be60ce9cfa tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:50.492236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5a1702e-fe71-4c41-95e1-23be60ce9cfa tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:50.492851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e5a1702e-fe71-4c41-95e1-23be60ce9cfa tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:50.496698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:50.564697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ba3b7c7d-b537-4220-b07b-278afa1212ec tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:50.578869 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ba3b7c7d-b537-4220-b07b-278afa1212ec tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.357114 Sep 06 11:16:50.580074 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2652/5253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:50 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:50.603933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-de82584b-c78b-4802-8a66-c0ebcb83554b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:50.605251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-de82584b-c78b-4802-8a66-c0ebcb83554b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 58fcca4b-5893-424d-879c-5d42e89446c6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:50.617258 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-de82584b-c78b-4802-8a66-c0ebcb83554b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance 58fcca4b-5893-424d-879c-5d42e89446c6 could not be found. Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-de82584b-c78b-4802-8a66-c0ebcb83554b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/58fcca4b-5893-424d-879c-5d42e89446c6/action HTTP/1.1 Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 18 Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: {"unshelve": null} Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 58fcca4b-5893-424d-879c-5d42e89446c6 could not be found. Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '58fcca4b-5893-424d-879c-5d42e89446c6', 'body': {'unshelve': None}} Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58fcca4b-5893-424d-879c-5d42e89446c6 could not be found. Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58fcca4b-5893-424d-879c-5d42e89446c6 could not be found. Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:50.619568 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:50.635591 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:50.635591 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:50.635591 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:50.635591 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:50.635591 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:50.635591 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:50.635591 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58fcca4b-5893-424d-879c-5d42e89446c6 could not be found. Sep 06 11:16:50.635591 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:50.635591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-de82584b-c78b-4802-8a66-c0ebcb83554b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance 58fcca4b-5893-424d-879c-5d42e89446c6 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:50.635591 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-de82584b-c78b-4802-8a66-c0ebcb83554b tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/58fcca4b-5893-424d-879c-5d42e89446c6/action" status: 404 len: 111 microversion: 2.1 time: 0.031343 Sep 06 11:16:50.638584 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2653/5254] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:50 2022] POST /compute/v2.1/servers/58fcca4b-5893-424d-879c-5d42e89446c6/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:16:50.644788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a6b855f-54b9-4fbd-8649-f79bd9b9cc1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:50.645929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9a6b855f-54b9-4fbd-8649-f79bd9b9cc1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:50.657895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a6b855f-54b9-4fbd-8649-f79bd9b9cc1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:50.658809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a6b855f-54b9-4fbd-8649-f79bd9b9cc1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:50.659607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a6b855f-54b9-4fbd-8649-f79bd9b9cc1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:50.660618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a6b855f-54b9-4fbd-8649-f79bd9b9cc1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:50.661151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a6b855f-54b9-4fbd-8649-f79bd9b9cc1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:50.661659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a6b855f-54b9-4fbd-8649-f79bd9b9cc1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:50.901265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9a6b855f-54b9-4fbd-8649-f79bd9b9cc1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:50.912335 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a6b855f-54b9-4fbd-8649-f79bd9b9cc1e tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.274380 Sep 06 11:16:50.913880 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2654/5255] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:50 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:50.940675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0d2744dd-9c59-47fb-a4f6-492e543735bc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:50.941510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0d2744dd-9c59-47fb-a4f6-492e543735bc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:50.946057 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e5a1702e-fe71-4c41-95e1-23be60ce9cfa tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] 10.222.0.20 "POST /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b/action" status: 202 len: 52 microversion: 2.47 time: 0.477153 Sep 06 11:16:50.948535 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2602/5256] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:16:50 2022] POST /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b/action => generated 52 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Sep 06 11:16:50.962814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d2744dd-9c59-47fb-a4f6-492e543735bc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:50.964223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a4ec438c-24f4-4fff-a444-c7cee06cfb56 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:50.965622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a4ec438c-24f4-4fff-a444-c7cee06cfb56 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:50.967814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d2744dd-9c59-47fb-a4f6-492e543735bc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:50.969891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d2744dd-9c59-47fb-a4f6-492e543735bc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:50.971924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d2744dd-9c59-47fb-a4f6-492e543735bc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:50.972926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d2744dd-9c59-47fb-a4f6-492e543735bc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:50.973853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d2744dd-9c59-47fb-a4f6-492e543735bc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:50.974252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4ec438c-24f4-4fff-a444-c7cee06cfb56 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:50.974936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4ec438c-24f4-4fff-a444-c7cee06cfb56 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:50.975686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4ec438c-24f4-4fff-a444-c7cee06cfb56 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:50.976640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4ec438c-24f4-4fff-a444-c7cee06cfb56 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:50.977280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4ec438c-24f4-4fff-a444-c7cee06cfb56 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:50.977891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4ec438c-24f4-4fff-a444-c7cee06cfb56 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:51.018590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a4ec438c-24f4-4fff-a444-c7cee06cfb56 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:16:51.258563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0d2744dd-9c59-47fb-a4f6-492e543735bc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:51.268361 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0d2744dd-9c59-47fb-a4f6-492e543735bc tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.332111 Sep 06 11:16:51.268953 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2655/5257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:50 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:51.299521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-92013b79-f915-4764-90af-0e076feb0a33 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:51.300938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-92013b79-f915-4764-90af-0e076feb0a33 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:51.308070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92013b79-f915-4764-90af-0e076feb0a33 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:51.309165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92013b79-f915-4764-90af-0e076feb0a33 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:51.309612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92013b79-f915-4764-90af-0e076feb0a33 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:51.310363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92013b79-f915-4764-90af-0e076feb0a33 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:51.310829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92013b79-f915-4764-90af-0e076feb0a33 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:51.311282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92013b79-f915-4764-90af-0e076feb0a33 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:51.334771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:51.569715 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a4ec438c-24f4-4fff-a444-c7cee06cfb56 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] 10.222.0.20 "DELETE /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b" status: 204 len: 0 microversion: 2.47 time: 0.610260 Sep 06 11:16:51.570561 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2603/5258] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:16:50 2022] DELETE /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:16:51.579499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4d763a3d-a617-4dd9-853c-61d6c59c0dcb tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:51.580547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4d763a3d-a617-4dd9-853c-61d6c59c0dcb tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:51.592840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d763a3d-a617-4dd9-853c-61d6c59c0dcb tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:51.593819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d763a3d-a617-4dd9-853c-61d6c59c0dcb tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:51.594532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d763a3d-a617-4dd9-853c-61d6c59c0dcb tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:51.595553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d763a3d-a617-4dd9-853c-61d6c59c0dcb tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:51.596272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d763a3d-a617-4dd9-853c-61d6c59c0dcb tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:51.596921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d763a3d-a617-4dd9-853c-61d6c59c0dcb tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:51.725039 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-92013b79-f915-4764-90af-0e076feb0a33 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Cannot 'unshelve' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-92013b79-f915-4764-90af-0e076feb0a33 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action HTTP/1.1 Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 18 Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: {"unshelve": null} Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: exception: Cannot 'unshelve' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4', 'body': {'unshelve': None}} Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 in vm_state active. Cannot unshelve while the instance is in this state. Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:16:51.729025 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-92013b79-f915-4764-90af-0e076feb0a33 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 409 to user: Cannot 'unshelve' instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 while it is in vm_state active {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-92013b79-f915-4764-90af-0e076feb0a33 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action" status: 409 len: 146 microversion: 2.1 time: 0.442749 Sep 06 11:16:51.739270 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2656/5259] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:16:51 2022] POST /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4/action => generated 146 bytes in 445 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:16:51.754772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d933069c-3e64-4b84-920d-d85ec2538fd8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:51.755852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d933069c-3e64-4b84-920d-d85ec2538fd8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:51.767164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d933069c-3e64-4b84-920d-d85ec2538fd8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:51.767678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d933069c-3e64-4b84-920d-d85ec2538fd8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:51.768127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d933069c-3e64-4b84-920d-d85ec2538fd8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:51.768882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d933069c-3e64-4b84-920d-d85ec2538fd8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:51.769863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d933069c-3e64-4b84-920d-d85ec2538fd8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:51.769863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d933069c-3e64-4b84-920d-d85ec2538fd8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:51.804335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4d763a3d-a617-4dd9-853c-61d6c59c0dcb tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:51.823262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4d763a3d-a617-4dd9-853c-61d6c59c0dcb tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:51.825534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4d763a3d-a617-4dd9-853c-61d6c59c0dcb tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:51.828213 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4d763a3d-a617-4dd9-853c-61d6c59c0dcb tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] 10.222.0.20 "GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b" status: 200 len: 1366 microversion: 2.47 time: 0.253058 Sep 06 11:16:51.840841 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2604/5260] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:16:51 2022] GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:16:52.057438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d933069c-3e64-4b84-920d-d85ec2538fd8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:52.065970 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d933069c-3e64-4b84-920d-d85ec2538fd8 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.325089 Sep 06 11:16:52.066886 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2657/5261] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:51 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:52.093450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3068ba89-6a73-4d13-b087-ee9cef1a9a7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:52.094872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3068ba89-6a73-4d13-b087-ee9cef1a9a7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:52.105040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3068ba89-6a73-4d13-b087-ee9cef1a9a7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:52.107833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3068ba89-6a73-4d13-b087-ee9cef1a9a7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:52.108628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3068ba89-6a73-4d13-b087-ee9cef1a9a7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:52.111502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3068ba89-6a73-4d13-b087-ee9cef1a9a7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:52.112337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3068ba89-6a73-4d13-b087-ee9cef1a9a7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:52.113660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3068ba89-6a73-4d13-b087-ee9cef1a9a7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:52.424243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3068ba89-6a73-4d13-b087-ee9cef1a9a7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:52.432478 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3068ba89-6a73-4d13-b087-ee9cef1a9a7a tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.343424 Sep 06 11:16:52.432984 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2605/5262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:52 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:52.455712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-07aa734c-24bf-4670-9379-cae30bdd58e5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1714402505_updated"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:52.461753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-07aa734c-24bf-4670-9379-cae30bdd58e5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 16c54299-85d4-4ea0-bc91-bc747328dddb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:52.471816 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-07aa734c-24bf-4670-9379-cae30bdd58e5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance 16c54299-85d4-4ea0-bc91-bc747328dddb could not be found. Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-07aa734c-24bf-4670-9379-cae30bdd58e5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: request: PUT /compute/v2.1/servers/16c54299-85d4-4ea0-bc91-bc747328dddb HTTP/1.1 Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 81 Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1714402505_updated"}} Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 16c54299-85d4-4ea0-bc91-bc747328dddb could not be found. Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '16c54299-85d4-4ea0-bc91-bc747328dddb', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1714402505_updated'}}} Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16c54299-85d4-4ea0-bc91-bc747328dddb could not be found. Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 06 11:16:52.481294 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16c54299-85d4-4ea0-bc91-bc747328dddb could not be found. Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16c54299-85d4-4ea0-bc91-bc747328dddb could not be found. Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-07aa734c-24bf-4670-9379-cae30bdd58e5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance 16c54299-85d4-4ea0-bc91-bc747328dddb could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:52.497195 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-07aa734c-24bf-4670-9379-cae30bdd58e5 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "PUT /compute/v2.1/servers/16c54299-85d4-4ea0-bc91-bc747328dddb" status: 404 len: 111 microversion: 2.1 time: 0.042427 Sep 06 11:16:52.498926 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2658/5263] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Sep 6 11:16:52 2022] PUT /compute/v2.1/servers/16c54299-85d4-4ea0-bc91-bc747328dddb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:16:52.504587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a442a01-365e-49be-a127-8563c7e4a4b6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:52.505825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0a442a01-365e-49be-a127-8563c7e4a4b6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:52.516736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a442a01-365e-49be-a127-8563c7e4a4b6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:52.517440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a442a01-365e-49be-a127-8563c7e4a4b6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:52.518978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a442a01-365e-49be-a127-8563c7e4a4b6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:52.520248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a442a01-365e-49be-a127-8563c7e4a4b6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:52.520991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a442a01-365e-49be-a127-8563c7e4a4b6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:52.521548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a442a01-365e-49be-a127-8563c7e4a4b6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:52.829694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0a442a01-365e-49be-a127-8563c7e4a4b6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:52.844653 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0a442a01-365e-49be-a127-8563c7e4a4b6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.344270 Sep 06 11:16:52.845455 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2606/5264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:52 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:52.869529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-209728f4-ea99-48b7-83dd-b467ef514c52 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:52.870438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-209728f4-ea99-48b7-83dd-b467ef514c52 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:52.871902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-94c2bcef-10f1-421f-8dd1-5ef43caa9e87 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:52.872690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-94c2bcef-10f1-421f-8dd1-5ef43caa9e87 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:52.881036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-209728f4-ea99-48b7-83dd-b467ef514c52 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:52.881808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-209728f4-ea99-48b7-83dd-b467ef514c52 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:52.882453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-209728f4-ea99-48b7-83dd-b467ef514c52 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:52.883382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-209728f4-ea99-48b7-83dd-b467ef514c52 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:52.884021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-209728f4-ea99-48b7-83dd-b467ef514c52 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:52.884757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-209728f4-ea99-48b7-83dd-b467ef514c52 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:52.906514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-94c2bcef-10f1-421f-8dd1-5ef43caa9e87 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:52.907486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-94c2bcef-10f1-421f-8dd1-5ef43caa9e87 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:52.908994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-94c2bcef-10f1-421f-8dd1-5ef43caa9e87 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:52.912364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-94c2bcef-10f1-421f-8dd1-5ef43caa9e87 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:52.912891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-94c2bcef-10f1-421f-8dd1-5ef43caa9e87 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:52.913362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-94c2bcef-10f1-421f-8dd1-5ef43caa9e87 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:53.008636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-209728f4-ea99-48b7-83dd-b467ef514c52 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:53.017252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-209728f4-ea99-48b7-83dd-b467ef514c52 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:53.018713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-209728f4-ea99-48b7-83dd-b467ef514c52 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:53.020013 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-209728f4-ea99-48b7-83dd-b467ef514c52 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] 10.222.0.20 "GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b" status: 200 len: 1366 microversion: 2.47 time: 0.157788 Sep 06 11:16:53.020590 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2659/5265] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:16:52 2022] GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:16:53.148738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-94c2bcef-10f1-421f-8dd1-5ef43caa9e87 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:53.166009 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-94c2bcef-10f1-421f-8dd1-5ef43caa9e87 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.298900 Sep 06 11:16:53.167129 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2607/5266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:52 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:53.197135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dcda614c-8b27-4735-92e7-0c135b3168b7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dcda614c-8b27-4735-92e7-0c135b3168b7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: request: PUT /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 HTTP/1.1 Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 280 Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.204311 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dcda614c-8b27-4735-92e7-0c135b3168b7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:53.213914 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dcda614c-8b27-4735-92e7-0c135b3168b7 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "PUT /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 400 len: 619 microversion: 2.1 time: 0.019373 Sep 06 11:16:53.219404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-63221901-4809-410d-bc5e-98326d71a799 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:53.220149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-63221901-4809-410d-bc5e-98326d71a799 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:53.224715 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2660/5267] 10.222.0.20 () {60 vars in 1257 bytes} [Tue Sep 6 11:16:53 2022] PUT /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:16:53.228481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63221901-4809-410d-bc5e-98326d71a799 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:53.229323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63221901-4809-410d-bc5e-98326d71a799 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:53.229888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63221901-4809-410d-bc5e-98326d71a799 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:53.233529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63221901-4809-410d-bc5e-98326d71a799 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:53.234193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63221901-4809-410d-bc5e-98326d71a799 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:53.234733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63221901-4809-410d-bc5e-98326d71a799 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:53.508566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-63221901-4809-410d-bc5e-98326d71a799 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:53.518925 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-63221901-4809-410d-bc5e-98326d71a799 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.307489 Sep 06 11:16:53.521179 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2608/5268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:53 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:16:53.548575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-06df0f2a-cf4d-4b13-8fae-832e15682c60 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:53.549200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-06df0f2a-cf4d-4b13-8fae-832e15682c60 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:53.562577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06df0f2a-cf4d-4b13-8fae-832e15682c60 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:53.563393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06df0f2a-cf4d-4b13-8fae-832e15682c60 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:53.564192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06df0f2a-cf4d-4b13-8fae-832e15682c60 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:53.565563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06df0f2a-cf4d-4b13-8fae-832e15682c60 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:53.566250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06df0f2a-cf4d-4b13-8fae-832e15682c60 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:53.566865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-06df0f2a-cf4d-4b13-8fae-832e15682c60 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:53.613131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:53.636665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:53.938623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-06df0f2a-cf4d-4b13-8fae-832e15682c60 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:53.949032 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-06df0f2a-cf4d-4b13-8fae-832e15682c60 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.404457 Sep 06 11:16:53.955433 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2661/5269] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:53 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:53.990579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-552d2cce-517f-46e0-a1e4-83659901aa48 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-552d2cce-517f-46e0-a1e4-83659901aa48 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: request: PUT /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 HTTP/1.1 Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 24 Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: {"server": {"name": ""}} Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4', 'body': {'server': {'name': ''}}} Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi '' Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:16:53.992729 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:16:53.998945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 06 11:16:53.998945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.998945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:53.998945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.998945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:53.998945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:53.998945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:53.998945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:16:53.998945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:16:53.998945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 06 11:16:53.998945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:53.998945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-552d2cce-517f-46e0-a1e4-83659901aa48 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:53.998945 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-552d2cce-517f-46e0-a1e4-83659901aa48 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "PUT /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 400 len: 108 microversion: 2.1 time: 0.022655 Sep 06 11:16:54.000268 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2609/5270] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Sep 6 11:16:53 2022] PUT /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:16:54.005527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c2aac0fc-c3a6-432b-9c3d-5817bbc84b63 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:54.006263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c2aac0fc-c3a6-432b-9c3d-5817bbc84b63 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:54.027118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2aac0fc-c3a6-432b-9c3d-5817bbc84b63 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:54.029253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2aac0fc-c3a6-432b-9c3d-5817bbc84b63 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:54.031216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2aac0fc-c3a6-432b-9c3d-5817bbc84b63 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:54.034323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2aac0fc-c3a6-432b-9c3d-5817bbc84b63 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:54.037103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2aac0fc-c3a6-432b-9c3d-5817bbc84b63 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:54.038626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2aac0fc-c3a6-432b-9c3d-5817bbc84b63 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:54.047380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:54.047380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:54.061304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:54.061818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:54.062264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:54.071393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:54.071922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:54.072387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:54.146806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:54.147346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:54.147802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:54.148272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lazy-loading 'fault' on Instance uuid 22ca94dc-e186-4ea3-8f9c-7df2c929091b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:16:54.362672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:54.373672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:54.375151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0e9a9114a614271846751aa8992858a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef884e8b4c124439bb5b14c191964b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:54.376375 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-74b0a7e6-e7c6-4feb-8950-906ec1035190 tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] 10.222.0.20 "GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b" status: 200 len: 1371 microversion: 2.47 time: 0.334301 Sep 06 11:16:54.376937 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2610/5271] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:16:54 2022] GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b => generated 1371 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:16:54.478761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c2aac0fc-c3a6-432b-9c3d-5817bbc84b63 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:16:54.492356 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c2aac0fc-c3a6-432b-9c3d-5817bbc84b63 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1503 microversion: 2.1 time: 0.491085 Sep 06 11:16:54.493557 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2662/5272] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:16:53 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1503 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:16:55.410057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-844b060a-a392-4fa4-94df-72d4395199af tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:16:55.410683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-844b060a-a392-4fa4-94df-72d4395199af tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] [instance: 22ca94dc-e186-4ea3-8f9c-7df2c929091b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:16:55.413861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:55.420241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-844b060a-a392-4fa4-94df-72d4395199af tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:55.423530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-844b060a-a392-4fa4-94df-72d4395199af tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:55.424165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-844b060a-a392-4fa4-94df-72d4395199af tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:55.425368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-844b060a-a392-4fa4-94df-72d4395199af tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:16:55.426079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-844b060a-a392-4fa4-94df-72d4395199af tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:16:55.426534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-844b060a-a392-4fa4-94df-72d4395199af tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:16:55.443827 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-844b060a-a392-4fa4-94df-72d4395199af tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] HTTP exception thrown: Instance 22ca94dc-e186-4ea3-8f9c-7df2c929091b could not be found. Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-844b060a-a392-4fa4-94df-72d4395199af tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Request method failure captured: Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b HTTP/1.1 Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFywbmlXFOIJWbgUsoY0nqr6tl4OtLANGwY4Ex1hbDEPmAOP4-2-LinInH7nBQ6VshYgb23DOMPswbpEfRDZmL--t6e3S_OqvnAmPQ4AaUni5dPHG0GlLcYDpDMnXi34iGDhj2c54VfKJ3JRfXmmjqY5tKNe-Hht4L8uY0qLBumIEXKE Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.47 Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ef884e8b4c124439bb5b14c191964b65 Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersAaction247Test-416188879 Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef884e8b4c124439bb5b14c191964b65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef884e8b4c124439bb5b14c191964b65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef884e8b4c124439bb5b14c191964b65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef884e8b4c124439bb5b14c191964b65"}]}] Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersAaction247Test-416188879 Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ef884e8b4c124439bb5b14c191964b65 Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersAaction247Test-416188879 Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersAaction247Test-416188879-project Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: c0e9a9114a614271846751aa8992858a Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersAaction247Test-416188879-project Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 22ca94dc-e186-4ea3-8f9c-7df2c929091b could not be found. Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '22ca94dc-e186-4ea3-8f9c-7df2c929091b'} Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ca94dc-e186-4ea3-8f9c-7df2c929091b could not be found. Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ca94dc-e186-4ea3-8f9c-7df2c929091b could not be found. Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:16:55.445465 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:55.452448 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:16:55.452448 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:16:55.452448 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:16:55.452448 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:16:55.452448 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:16:55.452448 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ca94dc-e186-4ea3-8f9c-7df2c929091b could not be found. Sep 06 11:16:55.452448 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:16:55.452448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-844b060a-a392-4fa4-94df-72d4395199af tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] Returning 404 to user: Instance 22ca94dc-e186-4ea3-8f9c-7df2c929091b could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:16:55.452448 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-844b060a-a392-4fa4-94df-72d4395199af tempest-ServersAaction247Test-416188879 tempest-ServersAaction247Test-416188879-project] 10.222.0.20 "GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b" status: 404 len: 111 microversion: 2.47 time: 0.041164 Sep 06 11:16:55.452448 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2611/5273] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:16:55 2022] GET /compute/v2.1/servers/22ca94dc-e186-4ea3-8f9c-7df2c929091b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:17:09.764933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:09.773861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=24 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:10.036898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-725738362", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "5373e044-443b-4854-8475-523684fd3ddd"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:17:10.163525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] validate_networks() for [('5373e044-443b-4854-8475-523684fd3ddd', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:17:11.220317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:17:11.221100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:17:11.221610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:17:11.222035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:17:11.222461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:17:11.239156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:11.245830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:11.246664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:11.248597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:11.249276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:11.253897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:11.298494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Getting quotas for project 2b869273c5a9475298fb6bffa028979d. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:17:11.306994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Getting quotas for user a382ba34c82b4c92985855461bf50fea and project 2b869273c5a9475298fb6bffa028979d. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:17:11.321642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:17:11.324109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:17:11.467810 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8d07a69e-cc3c-4b93-b15f-18d2d69b038a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.712248 Sep 06 11:17:11.475794 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2663/5274] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 11:17:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 11:17:11.485870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8b090fc0-9466-478e-ad9f-09e7d9f1e780 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:11.489407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8b090fc0-9466-478e-ad9f-09e7d9f1e780 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:11.499741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:11.506372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:11.697271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8b090fc0-9466-478e-ad9f-09e7d9f1e780 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:11.711348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8b090fc0-9466-478e-ad9f-09e7d9f1e780 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:11.718990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8b090fc0-9466-478e-ad9f-09e7d9f1e780 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:11.720374 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8b090fc0-9466-478e-ad9f-09e7d9f1e780 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1261 microversion: 2.26 time: 0.243694 Sep 06 11:17:11.738000 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2612/5275] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:11 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:12.747362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81721831-4736-4d7a-aca7-932a449c0c50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:12.748006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-81721831-4736-4d7a-aca7-932a449c0c50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:12.753370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24c99c1f-ed7c-48a3-a1d6-58c805cbe180 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:12.754066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-24c99c1f-ed7c-48a3-a1d6-58c805cbe180 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:12.762669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81721831-4736-4d7a-aca7-932a449c0c50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:12.763206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81721831-4736-4d7a-aca7-932a449c0c50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:12.763662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81721831-4736-4d7a-aca7-932a449c0c50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:12.764404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81721831-4736-4d7a-aca7-932a449c0c50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:12.771990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81721831-4736-4d7a-aca7-932a449c0c50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:12.772547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81721831-4736-4d7a-aca7-932a449c0c50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:12.812066 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-81721831-4736-4d7a-aca7-932a449c0c50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81721831-4736-4d7a-aca7-932a449c0c50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 HTTP/1.1 Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ac4d2b81-c9f2-479d-94c5-c637fe0e9360'} Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:17:12.813696 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81721831-4736-4d7a-aca7-932a449c0c50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-81721831-4736-4d7a-aca7-932a449c0c50 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 404 len: 111 microversion: 2.1 time: 0.084687 Sep 06 11:17:12.816674 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2664/5276] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:17:12 2022] DELETE /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:17:12.832503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-089fb66b-8db0-49c2-b358-ed1a67a4fa67 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:12.837854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-089fb66b-8db0-49c2-b358-ed1a67a4fa67 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: ac4d2b81-c9f2-479d-94c5-c637fe0e9360] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:12.843077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-089fb66b-8db0-49c2-b358-ed1a67a4fa67 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:12.843584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-089fb66b-8db0-49c2-b358-ed1a67a4fa67 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:12.844038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-089fb66b-8db0-49c2-b358-ed1a67a4fa67 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:12.844792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-089fb66b-8db0-49c2-b358-ed1a67a4fa67 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:12.852151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-089fb66b-8db0-49c2-b358-ed1a67a4fa67 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:12.852733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-089fb66b-8db0-49c2-b358-ed1a67a4fa67 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:12.871735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-24c99c1f-ed7c-48a3-a1d6-58c805cbe180 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:12.872532 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-089fb66b-8db0-49c2-b358-ed1a67a4fa67 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-089fb66b-8db0-49c2-b358-ed1a67a4fa67 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 HTTP/1.1 Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ac4d2b81-c9f2-479d-94c5-c637fe0e9360'} Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:17:12.874299 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:12.877867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:17:12.877867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:17:12.877867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:17:12.877867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:17:12.877867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:17:12.877867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. Sep 06 11:17:12.877867 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:12.879093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-089fb66b-8db0-49c2-b358-ed1a67a4fa67 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance ac4d2b81-c9f2-479d-94c5-c637fe0e9360 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:17:12.880391 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-089fb66b-8db0-49c2-b358-ed1a67a4fa67 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360" status: 404 len: 111 microversion: 2.1 time: 0.052042 Sep 06 11:17:12.881463 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2665/5277] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:17:12 2022] GET /compute/v2.1/servers/ac4d2b81-c9f2-479d-94c5-c637fe0e9360 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:17:12.890651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe2cc4fb-34cc-4208-9712-d1ef9cb13f75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:12.891220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe2cc4fb-34cc-4208-9712-d1ef9cb13f75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:12.892464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-24c99c1f-ed7c-48a3-a1d6-58c805cbe180 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:12.894289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-24c99c1f-ed7c-48a3-a1d6-58c805cbe180 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:12.895953 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-24c99c1f-ed7c-48a3-a1d6-58c805cbe180 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1261 microversion: 2.26 time: 0.148413 Sep 06 11:17:12.896714 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2613/5278] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:12 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:12.920758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe2cc4fb-34cc-4208-9712-d1ef9cb13f75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:12.921825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe2cc4fb-34cc-4208-9712-d1ef9cb13f75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:12.922404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe2cc4fb-34cc-4208-9712-d1ef9cb13f75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:12.923409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe2cc4fb-34cc-4208-9712-d1ef9cb13f75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:12.924045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe2cc4fb-34cc-4208-9712-d1ef9cb13f75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:12.924637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe2cc4fb-34cc-4208-9712-d1ef9cb13f75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:12.964620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe2cc4fb-34cc-4208-9712-d1ef9cb13f75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:17:13.430302 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe2cc4fb-34cc-4208-9712-d1ef9cb13f75 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 204 len: 0 microversion: 2.1 time: 0.543372 Sep 06 11:17:13.439704 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2666/5279] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:17:12 2022] DELETE /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:17:13.444141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-041a00d4-887f-474b-a71d-7c7b8837ca25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:13.444772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-041a00d4-887f-474b-a71d-7c7b8837ca25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:13.455716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041a00d4-887f-474b-a71d-7c7b8837ca25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:13.456227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041a00d4-887f-474b-a71d-7c7b8837ca25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:13.456676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041a00d4-887f-474b-a71d-7c7b8837ca25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:13.457408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041a00d4-887f-474b-a71d-7c7b8837ca25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:13.459992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041a00d4-887f-474b-a71d-7c7b8837ca25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:13.459992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-041a00d4-887f-474b-a71d-7c7b8837ca25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:13.740303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-041a00d4-887f-474b-a71d-7c7b8837ca25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:13.752055 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-041a00d4-887f-474b-a71d-7c7b8837ca25 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.311850 Sep 06 11:17:13.752673 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2614/5280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:17:13 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:17:13.938725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f274013-d818-4962-a8bf-9bb74a91f4bd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:13.939562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4f274013-d818-4962-a8bf-9bb74a91f4bd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:13.968315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f274013-d818-4962-a8bf-9bb74a91f4bd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:13.968838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f274013-d818-4962-a8bf-9bb74a91f4bd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:13.969300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f274013-d818-4962-a8bf-9bb74a91f4bd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:13.970143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f274013-d818-4962-a8bf-9bb74a91f4bd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:13.970545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f274013-d818-4962-a8bf-9bb74a91f4bd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:13.974202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f274013-d818-4962-a8bf-9bb74a91f4bd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:14.319233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4f274013-d818-4962-a8bf-9bb74a91f4bd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:14.337693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4f274013-d818-4962-a8bf-9bb74a91f4bd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:14.340061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4f274013-d818-4962-a8bf-9bb74a91f4bd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:14.347160 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4f274013-d818-4962-a8bf-9bb74a91f4bd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1257 microversion: 2.26 time: 0.424775 Sep 06 11:17:14.347969 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2667/5281] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:13 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1257 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:14.782911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bfca2dde-438d-4314-af3b-81f9a736a931 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:14.784516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bfca2dde-438d-4314-af3b-81f9a736a931 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:14.798235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bfca2dde-438d-4314-af3b-81f9a736a931 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:14.802803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bfca2dde-438d-4314-af3b-81f9a736a931 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:14.802803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bfca2dde-438d-4314-af3b-81f9a736a931 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:14.802803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bfca2dde-438d-4314-af3b-81f9a736a931 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:14.802803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bfca2dde-438d-4314-af3b-81f9a736a931 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:14.802803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bfca2dde-438d-4314-af3b-81f9a736a931 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:15.164531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bfca2dde-438d-4314-af3b-81f9a736a931 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:15.182440 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bfca2dde-438d-4314-af3b-81f9a736a931 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1509 microversion: 2.1 time: 0.409227 Sep 06 11:17:15.205565 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2615/5282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:17:14 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1509 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:17:15.381179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ffdb6af8-1c50-43da-b4f4-2f3144bc676d tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:15.382412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ffdb6af8-1c50-43da-b4f4-2f3144bc676d tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:15.390687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffdb6af8-1c50-43da-b4f4-2f3144bc676d tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:15.391444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffdb6af8-1c50-43da-b4f4-2f3144bc676d tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:15.392075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffdb6af8-1c50-43da-b4f4-2f3144bc676d tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:15.392953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffdb6af8-1c50-43da-b4f4-2f3144bc676d tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:15.393573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffdb6af8-1c50-43da-b4f4-2f3144bc676d tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:15.394162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ffdb6af8-1c50-43da-b4f4-2f3144bc676d tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:15.529893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ffdb6af8-1c50-43da-b4f4-2f3144bc676d tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:15.540628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ffdb6af8-1c50-43da-b4f4-2f3144bc676d tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:15.547419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ffdb6af8-1c50-43da-b4f4-2f3144bc676d tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:15.547419 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ffdb6af8-1c50-43da-b4f4-2f3144bc676d tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1331 microversion: 2.26 time: 0.168202 Sep 06 11:17:15.547419 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2668/5283] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:15 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1331 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:16.147740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a982f101-5822-4bc2-b0dc-4599cc047478 req-0f54e58a-9cee-4708-8d22-f24bf99a3af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4", "name": "network-vif-deleted", "tag": "b74c1e61-74bb-4ccc-97ba-17f5f50a6d22"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:17:16.179279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a982f101-5822-4bc2-b0dc-4599cc047478 req-0f54e58a-9cee-4708-8d22-f24bf99a3af0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:16.180216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a982f101-5822-4bc2-b0dc-4599cc047478 req-0f54e58a-9cee-4708-8d22-f24bf99a3af0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:16.180669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a982f101-5822-4bc2-b0dc-4599cc047478 req-0f54e58a-9cee-4708-8d22-f24bf99a3af0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:16.209105 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a982f101-5822-4bc2-b0dc-4599cc047478 req-0f54e58a-9cee-4708-8d22-f24bf99a3af0 service nova] Creating event network-vif-deleted:b74c1e61-74bb-4ccc-97ba-17f5f50a6d22 for instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 on nch2-master-1 Sep 06 11:17:16.212153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fcf5f5ab-29ff-4d66-b393-c60ea3dd40e4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:16.213208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fcf5f5ab-29ff-4d66-b393-c60ea3dd40e4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:16.227534 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a982f101-5822-4bc2-b0dc-4599cc047478 req-0f54e58a-9cee-4708-8d22-f24bf99a3af0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089997 Sep 06 11:17:16.230904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcf5f5ab-29ff-4d66-b393-c60ea3dd40e4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:16.231121 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2616/5284] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:17:16.235200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcf5f5ab-29ff-4d66-b393-c60ea3dd40e4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:16.236738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcf5f5ab-29ff-4d66-b393-c60ea3dd40e4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:16.240157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcf5f5ab-29ff-4d66-b393-c60ea3dd40e4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:16.242045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcf5f5ab-29ff-4d66-b393-c60ea3dd40e4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:16.243485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcf5f5ab-29ff-4d66-b393-c60ea3dd40e4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:16.466155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fcf5f5ab-29ff-4d66-b393-c60ea3dd40e4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e904f27c02248389ae9ca86cb95c54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad114c7a41a47e785fd117e1103f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:16.484299 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fcf5f5ab-29ff-4d66-b393-c60ea3dd40e4 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 200 len: 1467 microversion: 2.1 time: 0.277290 Sep 06 11:17:16.485310 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2669/5285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:17:16 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 1467 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:17:16.576346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1f528f35-3979-4d31-ade7-ae4363ef68c5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:16.577074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1f528f35-3979-4d31-ade7-ae4363ef68c5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:16.585043 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f528f35-3979-4d31-ade7-ae4363ef68c5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:16.585697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f528f35-3979-4d31-ade7-ae4363ef68c5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:16.586217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f528f35-3979-4d31-ade7-ae4363ef68c5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:16.587142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f528f35-3979-4d31-ade7-ae4363ef68c5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:16.587477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f528f35-3979-4d31-ade7-ae4363ef68c5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:16.588148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f528f35-3979-4d31-ade7-ae4363ef68c5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:16.689408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1f528f35-3979-4d31-ade7-ae4363ef68c5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:16.714564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1f528f35-3979-4d31-ade7-ae4363ef68c5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:16.717423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1f528f35-3979-4d31-ade7-ae4363ef68c5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:16.718697 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1f528f35-3979-4d31-ade7-ae4363ef68c5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1319 microversion: 2.26 time: 0.147372 Sep 06 11:17:16.731040 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2617/5286] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:16 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:17.511617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ee765404-9b34-404e-98b5-667b149540a6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:17.512694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ee765404-9b34-404e-98b5-667b149540a6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] [instance: 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:17.520868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee765404-9b34-404e-98b5-667b149540a6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:17.522514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee765404-9b34-404e-98b5-667b149540a6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:17.523221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee765404-9b34-404e-98b5-667b149540a6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:17.524624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee765404-9b34-404e-98b5-667b149540a6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:17.525194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee765404-9b34-404e-98b5-667b149540a6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:17.525996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee765404-9b34-404e-98b5-667b149540a6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:17.545308 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-ee765404-9b34-404e-98b5-667b149540a6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] HTTP exception thrown: Instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 could not be found. Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ee765404-9b34-404e-98b5-667b149540a6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Request method failure captured: Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 HTTP/1.1 Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytwKjRCNdoVweYiWMI1E-vY_7eZyQepnabNDbtBBIpblUgwS5-UGwgJZx1nBCRTmPGfC9ZNnuwcSJSQvEVIXTzN5oxIVuOb943NMUZ6dcviqwkIoejR0OORK6UqoWn7APvWRG1PPZALiLl_isXTTbT_QHslsJgVz4ksoNr9QX9Kfvw Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad114c7a41a47e785fd117e1103f168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad114c7a41a47e785fd117e1103f168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad114c7a41a47e785fd117e1103f168"}]}] Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aad114c7a41a47e785fd117e1103f168 Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1752823681 Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3e904f27c02248389ae9ca86cb95c54a Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-1752823681-project Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 could not be found. Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4'} Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 could not be found. Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 could not be found. Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:17:17.547309 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:17.550644 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:17:17.550644 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:17:17.550644 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:17:17.550644 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:17:17.550644 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:17:17.550644 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 could not be found. Sep 06 11:17:17.550644 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:17:17.552363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ee765404-9b34-404e-98b5-667b149540a6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] Returning 404 to user: Instance 0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:17:17.553273 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ee765404-9b34-404e-98b5-667b149540a6 tempest-ServersNegativeTestJSON-1752823681 tempest-ServersNegativeTestJSON-1752823681-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4" status: 404 len: 111 microversion: 2.1 time: 0.047094 Sep 06 11:17:17.557594 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2670/5287] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:17:17 2022] GET /compute/v2.1/servers/0c0a0d14-7654-4bd1-b40c-dc3d3f3641b4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:17:17.750464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ef810f51-fba0-4caa-96e3-ab68c7d46c91 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:17.751451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ef810f51-fba0-4caa-96e3-ab68c7d46c91 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:17.759708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef810f51-fba0-4caa-96e3-ab68c7d46c91 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:17.760208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef810f51-fba0-4caa-96e3-ab68c7d46c91 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:17.761541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef810f51-fba0-4caa-96e3-ab68c7d46c91 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:17.762450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef810f51-fba0-4caa-96e3-ab68c7d46c91 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:17.762950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef810f51-fba0-4caa-96e3-ab68c7d46c91 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:17.763556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef810f51-fba0-4caa-96e3-ab68c7d46c91 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:18.069535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ef810f51-fba0-4caa-96e3-ab68c7d46c91 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:18.088860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ef810f51-fba0-4caa-96e3-ab68c7d46c91 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:18.091140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ef810f51-fba0-4caa-96e3-ab68c7d46c91 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:18.092967 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ef810f51-fba0-4caa-96e3-ab68c7d46c91 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1361 microversion: 2.26 time: 0.346768 Sep 06 11:17:18.093897 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2618/5288] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:17 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1361 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:19.122415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0073aebe-40ca-46db-b23f-fb31d23f5898 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:19.123246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0073aebe-40ca-46db-b23f-fb31d23f5898 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:19.132425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0073aebe-40ca-46db-b23f-fb31d23f5898 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:19.133023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0073aebe-40ca-46db-b23f-fb31d23f5898 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:19.133635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0073aebe-40ca-46db-b23f-fb31d23f5898 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:19.134536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0073aebe-40ca-46db-b23f-fb31d23f5898 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:19.135145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0073aebe-40ca-46db-b23f-fb31d23f5898 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:19.136229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0073aebe-40ca-46db-b23f-fb31d23f5898 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:19.244115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-4ad33604-bdb7-441a-92a6-47836e71e8ed req-3bc6b726-c262-4143-b53a-c6510b299776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f846a8-0a19-4220-877f-f4cabcc19fcf", "tag": "6c6d7224-1466-44c6-a8f3-799492754af6"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:17:19.257418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4ad33604-bdb7-441a-92a6-47836e71e8ed req-3bc6b726-c262-4143-b53a-c6510b299776 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:19.258059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4ad33604-bdb7-441a-92a6-47836e71e8ed req-3bc6b726-c262-4143-b53a-c6510b299776 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:19.258617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4ad33604-bdb7-441a-92a6-47836e71e8ed req-3bc6b726-c262-4143-b53a-c6510b299776 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:19.280355 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-4ad33604-bdb7-441a-92a6-47836e71e8ed req-3bc6b726-c262-4143-b53a-c6510b299776 service nova] Creating event network-changed:6c6d7224-1466-44c6-a8f3-799492754af6 for instance 77f846a8-0a19-4220-877f-f4cabcc19fcf on nch1-master-1 Sep 06 11:17:19.287117 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-4ad33604-bdb7-441a-92a6-47836e71e8ed req-3bc6b726-c262-4143-b53a-c6510b299776 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048420 Sep 06 11:17:19.288004 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2619/5289] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:17:19.451948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0073aebe-40ca-46db-b23f-fb31d23f5898 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:19.469214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0073aebe-40ca-46db-b23f-fb31d23f5898 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:19.472735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0073aebe-40ca-46db-b23f-fb31d23f5898 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:19.480456 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0073aebe-40ca-46db-b23f-fb31d23f5898 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1361 microversion: 2.26 time: 0.357412 Sep 06 11:17:19.481240 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2671/5290] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:19 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1361 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:20.506755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cb8a3403-f6eb-41c0-8486-d5d951fac309 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:20.507513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cb8a3403-f6eb-41c0-8486-d5d951fac309 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:20.514922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb8a3403-f6eb-41c0-8486-d5d951fac309 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:20.515544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb8a3403-f6eb-41c0-8486-d5d951fac309 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:20.516098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb8a3403-f6eb-41c0-8486-d5d951fac309 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:20.516910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb8a3403-f6eb-41c0-8486-d5d951fac309 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:20.517444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb8a3403-f6eb-41c0-8486-d5d951fac309 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:20.517998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb8a3403-f6eb-41c0-8486-d5d951fac309 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:20.795672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cb8a3403-f6eb-41c0-8486-d5d951fac309 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:20.819899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cb8a3403-f6eb-41c0-8486-d5d951fac309 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:20.822547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cb8a3403-f6eb-41c0-8486-d5d951fac309 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:20.824719 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cb8a3403-f6eb-41c0-8486-d5d951fac309 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1361 microversion: 2.26 time: 0.323816 Sep 06 11:17:20.844025 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2620/5291] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:20 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1361 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:21.855197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5022e2f0-b62a-4492-b707-b724486ae286 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:21.856454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5022e2f0-b62a-4492-b707-b724486ae286 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:21.859645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:21.860503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:21.869545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5022e2f0-b62a-4492-b707-b724486ae286 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:21.870062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5022e2f0-b62a-4492-b707-b724486ae286 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:21.870517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5022e2f0-b62a-4492-b707-b724486ae286 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:21.871288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5022e2f0-b62a-4492-b707-b724486ae286 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:21.871762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5022e2f0-b62a-4492-b707-b724486ae286 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:21.872205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5022e2f0-b62a-4492-b707-b724486ae286 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:22.174595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5022e2f0-b62a-4492-b707-b724486ae286 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:22.208044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5022e2f0-b62a-4492-b707-b724486ae286 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:22.212177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5022e2f0-b62a-4492-b707-b724486ae286 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:22.213775 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5022e2f0-b62a-4492-b707-b724486ae286 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1361 microversion: 2.26 time: 0.362739 Sep 06 11:17:22.224336 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2672/5292] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:21 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1361 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:17:23.239828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-397ac773-8f8d-4708-aab8-13678c845103 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:23.240462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-397ac773-8f8d-4708-aab8-13678c845103 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:23.247504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:23.249586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-397ac773-8f8d-4708-aab8-13678c845103 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:23.250294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-397ac773-8f8d-4708-aab8-13678c845103 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:23.250958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-397ac773-8f8d-4708-aab8-13678c845103 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:23.251959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-397ac773-8f8d-4708-aab8-13678c845103 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:23.252647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-397ac773-8f8d-4708-aab8-13678c845103 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:23.253296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-397ac773-8f8d-4708-aab8-13678c845103 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:23.612889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-397ac773-8f8d-4708-aab8-13678c845103 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:23.622339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-397ac773-8f8d-4708-aab8-13678c845103 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:23.624301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-397ac773-8f8d-4708-aab8-13678c845103 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:23.627512 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-397ac773-8f8d-4708-aab8-13678c845103 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1361 microversion: 2.26 time: 0.389999 Sep 06 11:17:23.628501 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2621/5293] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:23 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1361 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:24.656348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a29936fe-53e9-48c1-9866-56b455606299 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:24.656979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a29936fe-53e9-48c1-9866-56b455606299 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:24.672645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a29936fe-53e9-48c1-9866-56b455606299 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:24.677051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a29936fe-53e9-48c1-9866-56b455606299 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:24.677051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a29936fe-53e9-48c1-9866-56b455606299 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:24.677051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a29936fe-53e9-48c1-9866-56b455606299 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:24.677051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a29936fe-53e9-48c1-9866-56b455606299 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:24.678403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a29936fe-53e9-48c1-9866-56b455606299 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:24.876944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a29936fe-53e9-48c1-9866-56b455606299 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:24.897235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a29936fe-53e9-48c1-9866-56b455606299 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:24.902753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a29936fe-53e9-48c1-9866-56b455606299 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:24.902753 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a29936fe-53e9-48c1-9866-56b455606299 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1361 microversion: 2.26 time: 0.250217 Sep 06 11:17:24.909157 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2673/5294] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:24 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:25.517154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b9dbc68d-c654-419d-81a3-e56c50821461 req-f428328e-4ea1-4167-b137-c72fb818ee92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f846a8-0a19-4220-877f-f4cabcc19fcf", "name": "network-vif-plugged", "status": "completed", "tag": "6c6d7224-1466-44c6-a8f3-799492754af6"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:17:25.533383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b9dbc68d-c654-419d-81a3-e56c50821461 req-f428328e-4ea1-4167-b137-c72fb818ee92 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:25.534101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b9dbc68d-c654-419d-81a3-e56c50821461 req-f428328e-4ea1-4167-b137-c72fb818ee92 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:25.534803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b9dbc68d-c654-419d-81a3-e56c50821461 req-f428328e-4ea1-4167-b137-c72fb818ee92 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:25.558930 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b9dbc68d-c654-419d-81a3-e56c50821461 req-f428328e-4ea1-4167-b137-c72fb818ee92 service nova] Creating event network-vif-plugged:6c6d7224-1466-44c6-a8f3-799492754af6 for instance 77f846a8-0a19-4220-877f-f4cabcc19fcf on nch1-master-1 Sep 06 11:17:25.565883 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b9dbc68d-c654-419d-81a3-e56c50821461 req-f428328e-4ea1-4167-b137-c72fb818ee92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052362 Sep 06 11:17:25.569790 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2622/5295] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:17:25.940365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b6242177-d290-41e5-a606-2c58da290af5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:25.943082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b6242177-d290-41e5-a606-2c58da290af5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:25.961599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6242177-d290-41e5-a606-2c58da290af5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:25.962688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6242177-d290-41e5-a606-2c58da290af5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:25.964356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6242177-d290-41e5-a606-2c58da290af5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:25.967210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6242177-d290-41e5-a606-2c58da290af5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:25.968721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6242177-d290-41e5-a606-2c58da290af5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:25.969680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6242177-d290-41e5-a606-2c58da290af5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:26.337154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b6242177-d290-41e5-a606-2c58da290af5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:26.347255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b6242177-d290-41e5-a606-2c58da290af5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:26.349073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b6242177-d290-41e5-a606-2c58da290af5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:26.350685 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b6242177-d290-41e5-a606-2c58da290af5 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1361 microversion: 2.26 time: 0.425676 Sep 06 11:17:26.351676 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2674/5296] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:25 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1361 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:27.383157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e4cf9823-fe51-44ba-aae8-30166d126142 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:27.383844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e4cf9823-fe51-44ba-aae8-30166d126142 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:27.403073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cf9823-fe51-44ba-aae8-30166d126142 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:27.406326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cf9823-fe51-44ba-aae8-30166d126142 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:27.407570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cf9823-fe51-44ba-aae8-30166d126142 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:27.408734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cf9823-fe51-44ba-aae8-30166d126142 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:27.411284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cf9823-fe51-44ba-aae8-30166d126142 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:27.411998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cf9823-fe51-44ba-aae8-30166d126142 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:27.774205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e4cf9823-fe51-44ba-aae8-30166d126142 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:27.789421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e4cf9823-fe51-44ba-aae8-30166d126142 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:27.793477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e4cf9823-fe51-44ba-aae8-30166d126142 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:27.796584 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e4cf9823-fe51-44ba-aae8-30166d126142 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1544 microversion: 2.26 time: 0.419261 Sep 06 11:17:27.799300 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2623/5297] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:27 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1544 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:27.828457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90f30f6820>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:27.853924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:27.855516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:27.856773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:27.858985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:27.876029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:27.897062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:27.897836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:27.900070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:27.910757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:27.911498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:27.957761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:27.958753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:27.959541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:27.978618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:27.980039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:27.980669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:28.131401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'flavor' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:28.173745 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3686d8e8-b0fa-458c-b917-a349bd4b2508 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-1856416706" status: 201 len: 0 microversion: 2.26 time: 0.349391 Sep 06 11:17:28.174637 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2675/5298] 10.222.0.20 () {62 vars in 1380 bytes} [Tue Sep 6 11:17:27 2022] PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-1856416706 => generated 0 bytes in 352 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 06 11:17:28.190316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-911ee523-828b-4994-9b1b-826f8723bb19 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90f36dd280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:28.201614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-911ee523-828b-4994-9b1b-826f8723bb19 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:28.202361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-911ee523-828b-4994-9b1b-826f8723bb19 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:28.203075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-911ee523-828b-4994-9b1b-826f8723bb19 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:28.231622 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-911ee523-828b-4994-9b1b-826f8723bb19 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-1856416706" status: 204 len: 0 microversion: 2.26 time: 0.047161 Sep 06 11:17:28.233163 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2624/5299] 10.222.0.20 () {60 vars in 1361 bytes} [Tue Sep 6 11:17:28 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-1856416706 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:17:28.243622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90f3871310>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:28.263800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:28.263800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:28.263800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:28.263800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:28.271789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:28.272357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:28.272919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:28.273898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:28.285373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:28.286574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:28.318731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:28.319559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:28.320267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:28.453709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'flavor' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:28.496665 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eb35801a-d9a1-43df-b447-d18b1f4fac79 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags" status: 204 len: 0 microversion: 2.26 time: 0.256051 Sep 06 11:17:28.498044 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2676/5300] 10.222.0.20 () {60 vars in 1295 bytes} [Tue Sep 6 11:17:28 2022] DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:17:28.511307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-91741df2-fa80-4ae2-bf55-17492d56f7b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90fcfb8670>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:28.550211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91741df2-fa80-4ae2-bf55-17492d56f7b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:28.562063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91741df2-fa80-4ae2-bf55-17492d56f7b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:28.566858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91741df2-fa80-4ae2-bf55-17492d56f7b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:28.584064 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-91741df2-fa80-4ae2-bf55-17492d56f7b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags" status: 200 len: 12 microversion: 2.26 time: 0.079657 Sep 06 11:17:28.586020 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2625/5301] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 6 11:17:28 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags => generated 12 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:17:28.600145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90f3312790>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:28.613655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:28.614374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:28.616368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:28.617035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:28.639610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:28.640223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:28.640698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:28.641448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:28.641902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:28.642340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:28.705723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:28.710454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:28.711258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:28.743246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:28.743749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:28.744828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:28.748966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:28.873389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'flavor' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:28.892263 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-354ba323-7310-4fe5-9379-003c1ab999b8 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-58471215" status: 201 len: 0 microversion: 2.26 time: 0.298886 Sep 06 11:17:28.893580 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2677/5302] 10.222.0.20 () {62 vars in 1374 bytes} [Tue Sep 6 11:17:28 2022] PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-58471215 => generated 0 bytes in 301 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Sep 06 11:17:28.907467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4b57130c-0c60-4d4f-a0b4-60e0a7c90ab2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90f36cc550>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:28.941752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b57130c-0c60-4d4f-a0b4-60e0a7c90ab2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:28.942363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b57130c-0c60-4d4f-a0b4-60e0a7c90ab2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:28.943030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b57130c-0c60-4d4f-a0b4-60e0a7c90ab2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:28.979258 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4b57130c-0c60-4d4f-a0b4-60e0a7c90ab2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags" status: 200 len: 34 microversion: 2.26 time: 0.079305 Sep 06 11:17:28.980143 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2626/5303] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 6 11:17:28 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags => generated 34 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:17:28.991382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90f3373f70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:29.000842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.001181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.001607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.015693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:29.037084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.038024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.038730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.040119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.041600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.042550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.116076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.116898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.118214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.230659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'flavor' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:29.263160 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8cc447b6-fc7d-49bc-a245-55f90dcfcbdb tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-58471215" status: 204 len: 0 microversion: 2.26 time: 0.275813 Sep 06 11:17:29.264772 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2678/5304] 10.222.0.20 () {60 vars in 1358 bytes} [Tue Sep 6 11:17:28 2022] DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-58471215 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 06 11:17:29.273683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c2ebae34-bc9f-4523-99ef-c59ef1ee1a68 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90f36cca60>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:29.288850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2ebae34-bc9f-4523-99ef-c59ef1ee1a68 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.289585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2ebae34-bc9f-4523-99ef-c59ef1ee1a68 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.294829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2ebae34-bc9f-4523-99ef-c59ef1ee1a68 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.312552 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c2ebae34-bc9f-4523-99ef-c59ef1ee1a68 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags" status: 200 len: 12 microversion: 2.26 time: 0.042948 Sep 06 11:17:29.316553 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2627/5305] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 6 11:17:29 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags => generated 12 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:17:29.332029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90fd131d30>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:29.360134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.361874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.364621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.365534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:29.386336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.387235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.397039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.398138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.398650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.399131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.446492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.447729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.448238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.460656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'flavor' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:29.480810 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a3a348e5-972d-4b62-9d6d-37273bad2916 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags" status: 204 len: 0 microversion: 2.26 time: 0.156736 Sep 06 11:17:29.481908 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2679/5306] 10.222.0.20 () {60 vars in 1295 bytes} [Tue Sep 6 11:17:29 2022] DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:17:29.495515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90f8f00e50>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:29.510939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.511804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.512380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.513091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:29.524750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.525936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.526898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.527595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.528382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.528907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.571091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.571762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.572782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.590239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.590997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.592085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.698757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'flavor' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:29.729560 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9211a061-2245-45db-893e-d6acac1ee88e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-377804711" status: 201 len: 0 microversion: 2.26 time: 0.239756 Sep 06 11:17:29.730922 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2628/5307] 10.222.0.20 () {62 vars in 1377 bytes} [Tue Sep 6 11:17:29 2022] PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-377804711 => generated 0 bytes in 242 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Sep 06 11:17:29.740857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90f349f4c0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:29.762077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.762581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.763821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.763821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:29.784650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.785116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.785574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.786307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.786776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.787321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.848615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.849421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.850029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.864273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:29.865204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:29.865814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:29.992822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'flavor' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:30.042022 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-299dcdfd-0219-4004-91e9-cf80996a80db tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-1082769491" status: 201 len: 0 microversion: 2.26 time: 0.297482 Sep 06 11:17:30.048580 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2680/5308] 10.222.0.20 () {62 vars in 1380 bytes} [Tue Sep 6 11:17:29 2022] PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-1082769491 => generated 0 bytes in 313 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 06 11:17:30.053665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90fcfb8670>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:30.069765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.072144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.078227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.078227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:30.084469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.085216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.085822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.086750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.087486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.096939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.124927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.126119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.127374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.254534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'flavor' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:30.294023 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-462204c6-6cb9-401a-94e1-305b55607d77 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags" status: 204 len: 0 microversion: 2.26 time: 0.242022 Sep 06 11:17:30.294919 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2629/5309] 10.222.0.20 () {60 vars in 1295 bytes} [Tue Sep 6 11:17:30 2022] DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:17:30.309493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-74976820-e3d7-4fd7-92d2-d016f312f95a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90fd131e50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:30.320537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74976820-e3d7-4fd7-92d2-d016f312f95a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.323708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74976820-e3d7-4fd7-92d2-d016f312f95a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.324753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74976820-e3d7-4fd7-92d2-d016f312f95a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.341380 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-74976820-e3d7-4fd7-92d2-d016f312f95a tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags" status: 200 len: 12 microversion: 2.26 time: 0.039629 Sep 06 11:17:30.343674 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2681/5310] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 6 11:17:30 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags => generated 12 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:17:30.355499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90f3733700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:30.365654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.366736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.366736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.367927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:30.382014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.382014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.382014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.382014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.382014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.382014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.424945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.425888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.426463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.440310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'flavor' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:30.457942 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-22e15a0a-28c4-4440-bd83-cf37a4d6776e tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags" status: 204 len: 0 microversion: 2.26 time: 0.107551 Sep 06 11:17:30.458860 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2630/5311] 10.222.0.20 () {60 vars in 1295 bytes} [Tue Sep 6 11:17:30 2022] DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:17:30.469361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90f347e550>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:30.480272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.481066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.481620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.482221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:30.488601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.489248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.489820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.490647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.491568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.492127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.520473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.521370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.522103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.544651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.551560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.551560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.657608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'flavor' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:30.700434 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0604332d-cf88-46c4-835d-aa393a846365 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-109092310" status: 201 len: 0 microversion: 2.26 time: 0.234372 Sep 06 11:17:30.700677 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2682/5312] 10.222.0.20 () {62 vars in 1377 bytes} [Tue Sep 6 11:17:30 2022] PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-109092310 => generated 0 bytes in 236 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 06 11:17:30.716045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90f31793a0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:30.735382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.736577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.737886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.738986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:30.750746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.752112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.752993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.754358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.755683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.758125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.826968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.828231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.829268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.834768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:30.851219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:30.852250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:30.853404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:30.987715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'flavor' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:31.010367 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-375d66ec-7c32-4580-9057-23fa2cbe1b07 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-26961113" status: 201 len: 0 microversion: 2.26 time: 0.301234 Sep 06 11:17:31.011757 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2631/5313] 10.222.0.20 () {62 vars in 1374 bytes} [Tue Sep 6 11:17:30 2022] PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags/tempest-tag-26961113 => generated 0 bytes in 304 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Sep 06 11:17:31.024577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Action: 'update_all', calling method: .version_select at 0x7f90f349f1f0>, body: {"tags": ["tempest-tag-1222667767", "tempest-tag-476190431"]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:17:31.036462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:31.037198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:31.037840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:31.038488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:31.048398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:31.049335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:31.049794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:31.050531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:31.051346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:31.052128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:31.083313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:31.084066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:31.084671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:31.179507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'flavor' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:31.204839 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eaaa781b-1675-4c4e-bf57-308f96f108f3 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags" status: 200 len: 61 microversion: 2.26 time: 0.187019 Sep 06 11:17:31.206414 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2683/5314] 10.222.0.20 () {62 vars in 1312 bytes} [Tue Sep 6 11:17:31 2022] PUT /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags => generated 61 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:17:31.222919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ac187842-6110-4b8e-b149-de7d5a2d77a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90fcf8c790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:31.238666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac187842-6110-4b8e-b149-de7d5a2d77a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:31.238666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac187842-6110-4b8e-b149-de7d5a2d77a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:31.242311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac187842-6110-4b8e-b149-de7d5a2d77a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:31.259068 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ac187842-6110-4b8e-b149-de7d5a2d77a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags" status: 200 len: 61 microversion: 2.26 time: 0.046182 Sep 06 11:17:31.263710 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2632/5315] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 6 11:17:31 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags => generated 61 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:17:31.279983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '.version_select at 0x7f90f92e4d30>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:31.289448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:31.292591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:31.292591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:31.292591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:31.310096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:31.310991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:31.312082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:31.314201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:31.315003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:31.315691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:31.362246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:31.362762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:31.363256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:31.476659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'flavor' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:31.521060 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-88134287-08ad-4368-9e64-5416fcf0164f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags" status: 204 len: 0 microversion: 2.26 time: 0.253543 Sep 06 11:17:31.528779 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2684/5316] 10.222.0.20 () {60 vars in 1295 bytes} [Tue Sep 6 11:17:31 2022] DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf/tags => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:17:31.545120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fa9a61a5-b9bf-4adb-8707-b871526133e2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:31.545729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fa9a61a5-b9bf-4adb-8707-b871526133e2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:31.562061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa9a61a5-b9bf-4adb-8707-b871526133e2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:31.562573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa9a61a5-b9bf-4adb-8707-b871526133e2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:31.567809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa9a61a5-b9bf-4adb-8707-b871526133e2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:31.568807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa9a61a5-b9bf-4adb-8707-b871526133e2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:31.569383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa9a61a5-b9bf-4adb-8707-b871526133e2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:31.570479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa9a61a5-b9bf-4adb-8707-b871526133e2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:31.614137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fa9a61a5-b9bf-4adb-8707-b871526133e2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:17:31.966124 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fa9a61a5-b9bf-4adb-8707-b871526133e2 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 204 len: 0 microversion: 2.26 time: 0.435742 Sep 06 11:17:31.967539 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2633/5317] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:17:31 2022] DELETE /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:17:31.981658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f3804297-c1bc-4e99-bcb9-005a2e04bf9f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:31.987217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f3804297-c1bc-4e99-bcb9-005a2e04bf9f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:32.018596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3804297-c1bc-4e99-bcb9-005a2e04bf9f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:32.018596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3804297-c1bc-4e99-bcb9-005a2e04bf9f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:32.018596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3804297-c1bc-4e99-bcb9-005a2e04bf9f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:32.018596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3804297-c1bc-4e99-bcb9-005a2e04bf9f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:32.018596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3804297-c1bc-4e99-bcb9-005a2e04bf9f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:32.018596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3804297-c1bc-4e99-bcb9-005a2e04bf9f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:32.224504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f3804297-c1bc-4e99-bcb9-005a2e04bf9f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:32.234320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f3804297-c1bc-4e99-bcb9-005a2e04bf9f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:32.235982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f3804297-c1bc-4e99-bcb9-005a2e04bf9f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:32.237456 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f3804297-c1bc-4e99-bcb9-005a2e04bf9f tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1550 microversion: 2.26 time: 0.264756 Sep 06 11:17:32.238039 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2685/5318] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:31 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1550 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:33.266348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fb66653d-6571-4ce6-aed0-f9c616f9f3f6 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:33.268469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb66653d-6571-4ce6-aed0-f9c616f9f3f6 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:33.285390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb66653d-6571-4ce6-aed0-f9c616f9f3f6 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:33.285917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb66653d-6571-4ce6-aed0-f9c616f9f3f6 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:33.286377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb66653d-6571-4ce6-aed0-f9c616f9f3f6 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:33.287680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb66653d-6571-4ce6-aed0-f9c616f9f3f6 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:33.288173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb66653d-6571-4ce6-aed0-f9c616f9f3f6 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:33.288615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb66653d-6571-4ce6-aed0-f9c616f9f3f6 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:33.515487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb66653d-6571-4ce6-aed0-f9c616f9f3f6 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:33.526919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb66653d-6571-4ce6-aed0-f9c616f9f3f6 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:33.528753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb66653d-6571-4ce6-aed0-f9c616f9f3f6 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:33.530178 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fb66653d-6571-4ce6-aed0-f9c616f9f3f6 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1550 microversion: 2.26 time: 0.268783 Sep 06 11:17:33.530834 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2634/5319] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:33 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1550 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:17:34.567160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbf3c54c-abcc-4b29-9481-c1e0725e95dd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:34.575331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fbf3c54c-abcc-4b29-9481-c1e0725e95dd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:34.598157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbf3c54c-abcc-4b29-9481-c1e0725e95dd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:34.598941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbf3c54c-abcc-4b29-9481-c1e0725e95dd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:34.599746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbf3c54c-abcc-4b29-9481-c1e0725e95dd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:34.601969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbf3c54c-abcc-4b29-9481-c1e0725e95dd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:34.602699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbf3c54c-abcc-4b29-9481-c1e0725e95dd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:34.604207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbf3c54c-abcc-4b29-9481-c1e0725e95dd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:34.761271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fbf3c54c-abcc-4b29-9481-c1e0725e95dd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:34.775377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:34.785062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fbf3c54c-abcc-4b29-9481-c1e0725e95dd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:34.787222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fbf3c54c-abcc-4b29-9481-c1e0725e95dd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:34.789083 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fbf3c54c-abcc-4b29-9481-c1e0725e95dd tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1508 microversion: 2.26 time: 0.234817 Sep 06 11:17:34.790406 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2686/5320] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:34 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:17:34.984804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-eab3e1b8-0710-4462-beaf-38456cdc1187 req-808f146f-4315-4042-9638-661ded7373c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f846a8-0a19-4220-877f-f4cabcc19fcf", "name": "network-vif-deleted", "tag": "6c6d7224-1466-44c6-a8f3-799492754af6"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:17:35.015120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-eab3e1b8-0710-4462-beaf-38456cdc1187 req-808f146f-4315-4042-9638-661ded7373c1 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:35.017831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-eab3e1b8-0710-4462-beaf-38456cdc1187 req-808f146f-4315-4042-9638-661ded7373c1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:35.018781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-eab3e1b8-0710-4462-beaf-38456cdc1187 req-808f146f-4315-4042-9638-661ded7373c1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:35.065652 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-eab3e1b8-0710-4462-beaf-38456cdc1187 req-808f146f-4315-4042-9638-661ded7373c1 service nova] Creating event network-vif-deleted:6c6d7224-1466-44c6-a8f3-799492754af6 for instance 77f846a8-0a19-4220-877f-f4cabcc19fcf on nch1-master-1 Sep 06 11:17:35.078014 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-eab3e1b8-0710-4462-beaf-38456cdc1187 req-808f146f-4315-4042-9638-661ded7373c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101192 Sep 06 11:17:35.078648 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2635/5321] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:17:35.818737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:35.819984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:35.836594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:35.837689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:35.848042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:35.851238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:35.851238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:35.851238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:35.937208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:35.937973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:35.938581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:35.939320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lazy-loading 'fault' on Instance uuid 77f846a8-0a19-4220-877f-f4cabcc19fcf {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:17:36.027354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:36.039245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:36.041825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a382ba34c82b4c92985855461bf50fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b869273c5a9475298fb6bffa028979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:17:36.043700 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 200 len: 1351 microversion: 2.26 time: 0.228975 Sep 06 11:17:36.044463 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2687/5322] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:35 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 1351 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:17:37.086160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3da3eecc-634c-436a-880c-d219c4a035e9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:37.088013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3da3eecc-634c-436a-880c-d219c4a035e9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] [instance: 77f846a8-0a19-4220-877f-f4cabcc19fcf] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:17:37.105748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3da3eecc-634c-436a-880c-d219c4a035e9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:37.106366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3da3eecc-634c-436a-880c-d219c4a035e9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:37.107064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3da3eecc-634c-436a-880c-d219c4a035e9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:37.108040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3da3eecc-634c-436a-880c-d219c4a035e9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:17:37.108595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3da3eecc-634c-436a-880c-d219c4a035e9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:17:37.109114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3da3eecc-634c-436a-880c-d219c4a035e9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:17:37.128726 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-3da3eecc-634c-436a-880c-d219c4a035e9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] HTTP exception thrown: Instance 77f846a8-0a19-4220-877f-f4cabcc19fcf could not be found. Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3da3eecc-634c-436a-880c-d219c4a035e9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Request method failure captured: Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf HTTP/1.1 Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyw1jxQQ_SU1SjWAEFGC0ova2a4_tLYh2uLlSCOAIIvBtHLfOy7P276dqcPWEEyzO4HZWSJM76zCmIGFDiugHuVxDyzclB2SVMbN226AqysF54qpvQSkx1Ik3KGKVGpRlqsn4MKJlZjXY9t1CdM3-L1BicqiO2T3TATkfDth6x9lWUM Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.26 Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 2b869273c5a9475298fb6bffa028979d Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerTagsTestJSON-1785901964 Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2b869273c5a9475298fb6bffa028979d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2b869273c5a9475298fb6bffa028979d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2b869273c5a9475298fb6bffa028979d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2b869273c5a9475298fb6bffa028979d"}]}] Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerTagsTestJSON-1785901964 Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 2b869273c5a9475298fb6bffa028979d Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerTagsTestJSON-1785901964 Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerTagsTestJSON-1785901964-project Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a382ba34c82b4c92985855461bf50fea Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerTagsTestJSON-1785901964-project Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 77f846a8-0a19-4220-877f-f4cabcc19fcf could not be found. Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '77f846a8-0a19-4220-877f-f4cabcc19fcf'} Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f846a8-0a19-4220-877f-f4cabcc19fcf could not be found. Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f846a8-0a19-4220-877f-f4cabcc19fcf could not be found. Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:17:37.131117 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:17:37.134643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:17:37.134643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:17:37.134643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:17:37.134643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:17:37.134643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:17:37.134643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f846a8-0a19-4220-877f-f4cabcc19fcf could not be found. Sep 06 11:17:37.134643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:17:37.137563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3da3eecc-634c-436a-880c-d219c4a035e9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Returning 404 to user: Instance 77f846a8-0a19-4220-877f-f4cabcc19fcf could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:17:37.138906 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3da3eecc-634c-436a-880c-d219c4a035e9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf" status: 404 len: 111 microversion: 2.26 time: 0.066479 Sep 06 11:17:37.139559 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2636/5323] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:17:37 2022] GET /compute/v2.1/servers/77f846a8-0a19-4220-877f-f4cabcc19fcf => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:17:39.918773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:39.919872 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-73285d50-d48b-4c2c-8495-a341b6d299a9 tempest-ServerTagsTestJSON-1785901964 tempest-ServerTagsTestJSON-1785901964-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001965 Sep 06 11:17:39.920553 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2688/5324] 10.222.0.20 () {56 vars in 886 bytes} [Tue Sep 6 11:17:39 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 06 11:17:52.832843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:53.043544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1ce9ebee-15b3-471e-8027-03f55553b616 tempest-ExtensionsTest-1875952624 tempest-ExtensionsTest-1875952624-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:53.045736 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1ce9ebee-15b3-471e-8027-03f55553b616 tempest-ExtensionsTest-1875952624 tempest-ExtensionsTest-1875952624-project] 10.222.0.20 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.220005 Sep 06 11:17:53.046779 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2637/5325] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Sep 6 11:17:52 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:17:53.062162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-297d444b-6c6d-4e47-9429-e2e09aa56cae tempest-ExtensionsTest-1875952624 tempest-ExtensionsTest-1875952624-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:17:53.069644 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-297d444b-6c6d-4e47-9429-e2e09aa56cae tempest-ExtensionsTest-1875952624 tempest-ExtensionsTest-1875952624-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.015651 Sep 06 11:17:53.075056 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2689/5326] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Sep 6 11:17:53 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:17:59.975405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1979721615", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "74ae681a-5964-499e-a86a-13cffa0cf1b0"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:00.070182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] validate_networks() for [('74ae681a-5964-499e-a86a-13cffa0cf1b0', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:18:00.713051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:18:00.713481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:18:00.713979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:18:00.714812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:18:00.715278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:18:00.731050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:00.731829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:00.732452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:00.733677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:00.734539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:00.735244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:00.761994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:18:00.784768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for user acce3e06ce4d40ba8db7988456cf8787 and project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:18:00.804561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:18:00.808725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:18:01.029577 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aae21f44-4ec8-444a-9280-84d922cfde72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.261526 Sep 06 11:18:01.038861 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2638/5327] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:17:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:18:01.042342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:01.089774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-95064d28-5e8c-4c0c-88a1-bc435a0fcaea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:01.090830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-95064d28-5e8c-4c0c-88a1-bc435a0fcaea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:01.233194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-95064d28-5e8c-4c0c-88a1-bc435a0fcaea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:01.260933 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-95064d28-5e8c-4c0c-88a1-bc435a0fcaea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1193 microversion: 2.1 time: 0.221658 Sep 06 11:18:01.268580 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2690/5328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:01 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1193 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:02.288838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c82f6d81-3a7c-4078-89f8-d4a4a730f942 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:02.290874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c82f6d81-3a7c-4078-89f8-d4a4a730f942 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:02.481784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c82f6d81-3a7c-4078-89f8-d4a4a730f942 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:02.505062 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c82f6d81-3a7c-4078-89f8-d4a4a730f942 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1193 microversion: 2.1 time: 0.219130 Sep 06 11:18:02.516349 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2639/5329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:02 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1193 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:03.540558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f770055c-90c1-49c0-ab50-36f5525a7176 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:03.541453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f770055c-90c1-49c0-ab50-36f5525a7176 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:03.571841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f770055c-90c1-49c0-ab50-36f5525a7176 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:03.572821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f770055c-90c1-49c0-ab50-36f5525a7176 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:03.573452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f770055c-90c1-49c0-ab50-36f5525a7176 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:03.574394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f770055c-90c1-49c0-ab50-36f5525a7176 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:03.576401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f770055c-90c1-49c0-ab50-36f5525a7176 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:03.577078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f770055c-90c1-49c0-ab50-36f5525a7176 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:03.790683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f770055c-90c1-49c0-ab50-36f5525a7176 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:03.801099 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f770055c-90c1-49c0-ab50-36f5525a7176 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1197 microversion: 2.1 time: 0.266611 Sep 06 11:18:03.803585 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2691/5330] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:03 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1197 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:04.832878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-acece6cd-8e95-4a04-8bf9-5fc94921bee3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:04.834726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-acece6cd-8e95-4a04-8bf9-5fc94921bee3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:04.854998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acece6cd-8e95-4a04-8bf9-5fc94921bee3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:04.859167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acece6cd-8e95-4a04-8bf9-5fc94921bee3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:04.861977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acece6cd-8e95-4a04-8bf9-5fc94921bee3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:04.861977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acece6cd-8e95-4a04-8bf9-5fc94921bee3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:04.861977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acece6cd-8e95-4a04-8bf9-5fc94921bee3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:04.861977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acece6cd-8e95-4a04-8bf9-5fc94921bee3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:05.157746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-acece6cd-8e95-4a04-8bf9-5fc94921bee3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:05.183226 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-acece6cd-8e95-4a04-8bf9-5fc94921bee3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1245 microversion: 2.1 time: 0.352253 Sep 06 11:18:05.184197 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2640/5331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:04 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1245 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:06.221221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3fcc187f-82ba-4691-b312-bba5fb15cc08 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:06.221221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3fcc187f-82ba-4691-b312-bba5fb15cc08 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:06.232558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fcc187f-82ba-4691-b312-bba5fb15cc08 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:06.233652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fcc187f-82ba-4691-b312-bba5fb15cc08 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:06.234047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fcc187f-82ba-4691-b312-bba5fb15cc08 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:06.235214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fcc187f-82ba-4691-b312-bba5fb15cc08 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:06.236987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fcc187f-82ba-4691-b312-bba5fb15cc08 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:06.237618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fcc187f-82ba-4691-b312-bba5fb15cc08 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:06.500198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3fcc187f-82ba-4691-b312-bba5fb15cc08 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:06.513271 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3fcc187f-82ba-4691-b312-bba5fb15cc08 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1251 microversion: 2.1 time: 0.298465 Sep 06 11:18:06.532010 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2692/5332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:06 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1251 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:07.545469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-587c488d-4068-4531-be0d-ccf242e71430 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:07.545945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-587c488d-4068-4531-be0d-ccf242e71430 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:07.562200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-587c488d-4068-4531-be0d-ccf242e71430 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:07.562805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-587c488d-4068-4531-be0d-ccf242e71430 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:07.567143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-587c488d-4068-4531-be0d-ccf242e71430 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:07.573138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-587c488d-4068-4531-be0d-ccf242e71430 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:07.573138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-587c488d-4068-4531-be0d-ccf242e71430 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:07.573138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-587c488d-4068-4531-be0d-ccf242e71430 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:07.713456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-587c488d-4068-4531-be0d-ccf242e71430 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:07.752604 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-587c488d-4068-4531-be0d-ccf242e71430 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1251 microversion: 2.1 time: 0.211557 Sep 06 11:18:07.778632 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2641/5333] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:07 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1251 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:08.786421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-428efc8d-7c76-4d32-87cc-69a2853f7453 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:08.787233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-428efc8d-7c76-4d32-87cc-69a2853f7453 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:08.821502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-428efc8d-7c76-4d32-87cc-69a2853f7453 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:08.822336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-428efc8d-7c76-4d32-87cc-69a2853f7453 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:08.823198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-428efc8d-7c76-4d32-87cc-69a2853f7453 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:08.824410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-428efc8d-7c76-4d32-87cc-69a2853f7453 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:08.825320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-428efc8d-7c76-4d32-87cc-69a2853f7453 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:08.827270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-428efc8d-7c76-4d32-87cc-69a2853f7453 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:09.150146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-428efc8d-7c76-4d32-87cc-69a2853f7453 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:09.178926 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-428efc8d-7c76-4d32-87cc-69a2853f7453 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1293 microversion: 2.1 time: 0.399545 Sep 06 11:18:09.180525 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2693/5334] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:08 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1293 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:10.206131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a0c71a27-ee01-4b70-9055-0fdd547d0559 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:10.209321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a0c71a27-ee01-4b70-9055-0fdd547d0559 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:10.231613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0c71a27-ee01-4b70-9055-0fdd547d0559 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:10.235216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0c71a27-ee01-4b70-9055-0fdd547d0559 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:10.236150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0c71a27-ee01-4b70-9055-0fdd547d0559 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:10.238970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0c71a27-ee01-4b70-9055-0fdd547d0559 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:10.239755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0c71a27-ee01-4b70-9055-0fdd547d0559 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:10.240684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0c71a27-ee01-4b70-9055-0fdd547d0559 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:10.747583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:11.331703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-de51dc99-5840-4fa1-9af9-09bfd737450e req-6299b02e-f3db-4334-bb73-46c1ab7fb394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8c82a0-4b88-44e4-8699-c08424dfea56", "tag": "ed301ee6-d65f-40a4-9f86-d755df5c1e48"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:11.336860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a0c71a27-ee01-4b70-9055-0fdd547d0559 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:11.350907 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a0c71a27-ee01-4b70-9055-0fdd547d0559 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1293 microversion: 2.1 time: 1.149842 Sep 06 11:18:11.360155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:11.360155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-de51dc99-5840-4fa1-9af9-09bfd737450e req-6299b02e-f3db-4334-bb73-46c1ab7fb394 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:11.360155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-de51dc99-5840-4fa1-9af9-09bfd737450e req-6299b02e-f3db-4334-bb73-46c1ab7fb394 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:11.360155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-de51dc99-5840-4fa1-9af9-09bfd737450e req-6299b02e-f3db-4334-bb73-46c1ab7fb394 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:11.360582 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2642/5335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:10 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1293 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:11.394314 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-de51dc99-5840-4fa1-9af9-09bfd737450e req-6299b02e-f3db-4334-bb73-46c1ab7fb394 service nova] Creating event network-changed:ed301ee6-d65f-40a4-9f86-d755df5c1e48 for instance 5d8c82a0-4b88-44e4-8699-c08424dfea56 on nch1-master-1 Sep 06 11:18:11.412141 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-de51dc99-5840-4fa1-9af9-09bfd737450e req-6299b02e-f3db-4334-bb73-46c1ab7fb394 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078257 Sep 06 11:18:11.412141 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2694/5336] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:18:12.389290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-80cf2ed4-495b-4615-8d22-f0a92b429afa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:12.390080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-80cf2ed4-495b-4615-8d22-f0a92b429afa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:12.407651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80cf2ed4-495b-4615-8d22-f0a92b429afa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:12.413484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80cf2ed4-495b-4615-8d22-f0a92b429afa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:12.414755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80cf2ed4-495b-4615-8d22-f0a92b429afa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:12.418246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80cf2ed4-495b-4615-8d22-f0a92b429afa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:12.422259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80cf2ed4-495b-4615-8d22-f0a92b429afa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:12.425573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80cf2ed4-495b-4615-8d22-f0a92b429afa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:12.467639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b3b8901f-ab92-4725-96ec-4209dc072d3d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Action: 'create', calling method: .version_select at 0x7f90fcf5c0d0>, body: {"keypair": {"name": "tempest-keypair-867190969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOheLQKe1Is8ns04I5rXPOfE2OYEQwqifa7PVp3AGRKHl+2KpqkGeBZLXxqGJuz3AdbSWRqCnV+ABFPYGmjPk4XLuIeyM55sC/pNQuT5QW5+03C8ZIsRM/LPYRIiXLw4qA=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:12.514542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:12.540268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-b3b8901f-ab92-4725-96ec-4209dc072d3d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Getting quotas for project 75b360e0ffe64c3bb5897486a18eda10. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:18:12.554094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-b3b8901f-ab92-4725-96ec-4209dc072d3d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Getting quotas for user 226a6d965ff14deebdead8370fc00d3e and project 75b360e0ffe64c3bb5897486a18eda10. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:18:12.703505 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b3b8901f-ab92-4725-96ec-4209dc072d3d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.381155 Sep 06 11:18:12.710305 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2643/5337] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Sep 6 11:18:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 383 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 11:18:12.865500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-80cf2ed4-495b-4615-8d22-f0a92b429afa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:12.886736 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-80cf2ed4-495b-4615-8d22-f0a92b429afa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1293 microversion: 2.1 time: 0.501663 Sep 06 11:18:12.887983 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2695/5338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:12 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1293 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:13.915779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e29f6904-8286-4988-a8ef-4f9d0223dfe1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:13.916469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e29f6904-8286-4988-a8ef-4f9d0223dfe1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:13.934106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e29f6904-8286-4988-a8ef-4f9d0223dfe1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:13.935218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e29f6904-8286-4988-a8ef-4f9d0223dfe1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:13.935295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e29f6904-8286-4988-a8ef-4f9d0223dfe1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:13.936007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e29f6904-8286-4988-a8ef-4f9d0223dfe1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:13.937953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e29f6904-8286-4988-a8ef-4f9d0223dfe1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:13.938453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e29f6904-8286-4988-a8ef-4f9d0223dfe1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:14.375869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e29f6904-8286-4988-a8ef-4f9d0223dfe1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:14.390840 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e29f6904-8286-4988-a8ef-4f9d0223dfe1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1293 microversion: 2.1 time: 0.479718 Sep 06 11:18:14.407205 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2644/5339] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:13 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1293 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:15.422880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2bd6dd20-3497-4e4d-b5f4-faedea54e49f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:15.427777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2bd6dd20-3497-4e4d-b5f4-faedea54e49f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:15.447546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bd6dd20-3497-4e4d-b5f4-faedea54e49f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:15.448263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bd6dd20-3497-4e4d-b5f4-faedea54e49f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:15.448894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bd6dd20-3497-4e4d-b5f4-faedea54e49f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:15.449844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bd6dd20-3497-4e4d-b5f4-faedea54e49f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:15.450735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bd6dd20-3497-4e4d-b5f4-faedea54e49f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:15.451401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2bd6dd20-3497-4e4d-b5f4-faedea54e49f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:15.645654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2bd6dd20-3497-4e4d-b5f4-faedea54e49f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:15.654136 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2bd6dd20-3497-4e4d-b5f4-faedea54e49f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1293 microversion: 2.1 time: 0.243887 Sep 06 11:18:15.654757 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2696/5340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:15 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1293 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:16.679572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f159c979-8e30-405c-8e12-ba63a1c3fa3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:16.680774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f159c979-8e30-405c-8e12-ba63a1c3fa3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:16.692633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f159c979-8e30-405c-8e12-ba63a1c3fa3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:16.693338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f159c979-8e30-405c-8e12-ba63a1c3fa3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:16.694010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f159c979-8e30-405c-8e12-ba63a1c3fa3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:16.695746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f159c979-8e30-405c-8e12-ba63a1c3fa3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:16.696398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f159c979-8e30-405c-8e12-ba63a1c3fa3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:16.697045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f159c979-8e30-405c-8e12-ba63a1c3fa3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:16.869234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f159c979-8e30-405c-8e12-ba63a1c3fa3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:16.884793 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f159c979-8e30-405c-8e12-ba63a1c3fa3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1293 microversion: 2.1 time: 0.204260 Sep 06 11:18:16.885725 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2645/5341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:16 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1293 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:18:17.608704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-69acda8f-fdd4-4643-b1cd-9264a4a64e8f req-8b72490b-cfce-4b9e-8815-bee5434ebd4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8c82a0-4b88-44e4-8699-c08424dfea56", "name": "network-vif-plugged", "status": "completed", "tag": "ed301ee6-d65f-40a4-9f86-d755df5c1e48"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:17.631173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-69acda8f-fdd4-4643-b1cd-9264a4a64e8f req-8b72490b-cfce-4b9e-8815-bee5434ebd4a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:17.631670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-69acda8f-fdd4-4643-b1cd-9264a4a64e8f req-8b72490b-cfce-4b9e-8815-bee5434ebd4a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:17.632200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-69acda8f-fdd4-4643-b1cd-9264a4a64e8f req-8b72490b-cfce-4b9e-8815-bee5434ebd4a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:17.646556 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-69acda8f-fdd4-4643-b1cd-9264a4a64e8f req-8b72490b-cfce-4b9e-8815-bee5434ebd4a service nova] Creating event network-vif-plugged:ed301ee6-d65f-40a4-9f86-d755df5c1e48 for instance 5d8c82a0-4b88-44e4-8699-c08424dfea56 on nch1-master-1 Sep 06 11:18:17.651704 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-69acda8f-fdd4-4643-b1cd-9264a4a64e8f req-8b72490b-cfce-4b9e-8815-bee5434ebd4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046621 Sep 06 11:18:17.652254 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2697/5342] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:18:17.910425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e52cb76-ed37-4064-a95f-1217be14b3c8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:17.911773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e52cb76-ed37-4064-a95f-1217be14b3c8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:17.928475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e52cb76-ed37-4064-a95f-1217be14b3c8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:17.929589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e52cb76-ed37-4064-a95f-1217be14b3c8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:17.930159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e52cb76-ed37-4064-a95f-1217be14b3c8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:17.931805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e52cb76-ed37-4064-a95f-1217be14b3c8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:17.932414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e52cb76-ed37-4064-a95f-1217be14b3c8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:17.933376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e52cb76-ed37-4064-a95f-1217be14b3c8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:18.048731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-8525216", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d03ef3dd-8a5a-4393-81b5-8dc14a53ca04"}], "security_groups": [{"name": "tempest-securitygroup--2028866508"}], "key_name": "tempest-keypair-867190969", "user_data": "}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:18.142996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7e52cb76-ed37-4064-a95f-1217be14b3c8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:18.159787 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e52cb76-ed37-4064-a95f-1217be14b3c8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1293 microversion: 2.1 time: 0.253458 Sep 06 11:18:18.160579 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2646/5343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:17 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1293 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:18.205597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] validate_networks() for [('d03ef3dd-8a5a-4393-81b5-8dc14a53ca04', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:18:18.756553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:18:18.757644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:18:18.758578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:18:18.759043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:18:18.759512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:18:18.770171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:18.770672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:18.771327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:18.772269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:18.773402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:18.774004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:18.800695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Getting quotas for project 75b360e0ffe64c3bb5897486a18eda10. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:18:18.807311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Getting quotas for user 226a6d965ff14deebdead8370fc00d3e and project 75b360e0ffe64c3bb5897486a18eda10. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:18:18.825648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:18:18.829765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:18:19.035345 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3a271adb-0863-458c-b574-771bf54624e9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.992266 Sep 06 11:18:19.036205 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2698/5344] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 11:18:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 06 11:18:19.049224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5a23267d-9c0f-4dcc-bb19-d4015e5154bf tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:19.050263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5a23267d-9c0f-4dcc-bb19-d4015e5154bf tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:19.135186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5a23267d-9c0f-4dcc-bb19-d4015e5154bf tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:19.155628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5a23267d-9c0f-4dcc-bb19-d4015e5154bf tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:19.160812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5a23267d-9c0f-4dcc-bb19-d4015e5154bf tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:19.164196 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5a23267d-9c0f-4dcc-bb19-d4015e5154bf tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1278 microversion: 2.20 time: 0.120267 Sep 06 11:18:19.165884 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2647/5345] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:18:19 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:18:19.191867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7afaecb4-5f00-4fa8-8e87-c3a2fd8a5955 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:19.196440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7afaecb4-5f00-4fa8-8e87-c3a2fd8a5955 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:19.220076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7afaecb4-5f00-4fa8-8e87-c3a2fd8a5955 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:19.223695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7afaecb4-5f00-4fa8-8e87-c3a2fd8a5955 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:19.225016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7afaecb4-5f00-4fa8-8e87-c3a2fd8a5955 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:19.228279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7afaecb4-5f00-4fa8-8e87-c3a2fd8a5955 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:19.229023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7afaecb4-5f00-4fa8-8e87-c3a2fd8a5955 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:19.231476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7afaecb4-5f00-4fa8-8e87-c3a2fd8a5955 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:19.507520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7afaecb4-5f00-4fa8-8e87-c3a2fd8a5955 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:19.519738 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7afaecb4-5f00-4fa8-8e87-c3a2fd8a5955 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1293 microversion: 2.1 time: 0.338625 Sep 06 11:18:19.520859 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2699/5346] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:19 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1293 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:20.220525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c2220ec-ce60-4ba6-91eb-3e404f5bf9b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:20.221211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9c2220ec-ce60-4ba6-91eb-3e404f5bf9b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:20.282488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c2220ec-ce60-4ba6-91eb-3e404f5bf9b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:20.294954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c2220ec-ce60-4ba6-91eb-3e404f5bf9b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:20.296666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c2220ec-ce60-4ba6-91eb-3e404f5bf9b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:20.297948 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9c2220ec-ce60-4ba6-91eb-3e404f5bf9b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1278 microversion: 2.20 time: 0.081366 Sep 06 11:18:20.298738 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2648/5347] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:18:20 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1278 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:18:20.546193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8aa8941d-33e4-4656-ad8b-ed8c9152b269 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:20.547803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8aa8941d-33e4-4656-ad8b-ed8c9152b269 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:20.561856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa8941d-33e4-4656-ad8b-ed8c9152b269 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:20.562711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa8941d-33e4-4656-ad8b-ed8c9152b269 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:20.563362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa8941d-33e4-4656-ad8b-ed8c9152b269 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:20.564304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa8941d-33e4-4656-ad8b-ed8c9152b269 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:20.565007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa8941d-33e4-4656-ad8b-ed8c9152b269 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:20.565676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8aa8941d-33e4-4656-ad8b-ed8c9152b269 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:21.288014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8aa8941d-33e4-4656-ad8b-ed8c9152b269 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:21.300738 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8aa8941d-33e4-4656-ad8b-ed8c9152b269 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1475 microversion: 2.1 time: 0.761193 Sep 06 11:18:21.307298 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2700/5348] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:20 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1475 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:21.338196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56430ccf-8e2e-44eb-b608-75b0e08665f5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:21.338880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56430ccf-8e2e-44eb-b608-75b0e08665f5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:21.353732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56430ccf-8e2e-44eb-b608-75b0e08665f5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:21.355355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56430ccf-8e2e-44eb-b608-75b0e08665f5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:21.356390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56430ccf-8e2e-44eb-b608-75b0e08665f5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:21.357586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56430ccf-8e2e-44eb-b608-75b0e08665f5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:21.358549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56430ccf-8e2e-44eb-b608-75b0e08665f5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:21.359183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56430ccf-8e2e-44eb-b608-75b0e08665f5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:21.422314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2100163208", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:21.466034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-56430ccf-8e2e-44eb-b608-75b0e08665f5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:21.484069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-56430ccf-8e2e-44eb-b608-75b0e08665f5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:21.494039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-56430ccf-8e2e-44eb-b608-75b0e08665f5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:21.497278 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56430ccf-8e2e-44eb-b608-75b0e08665f5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1274 microversion: 2.20 time: 0.174925 Sep 06 11:18:21.498552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] validate_networks() for [('74ae681a-5964-499e-a86a-13cffa0cf1b0', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:18:21.500470 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2649/5349] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:18:21 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1274 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:18:22.113629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:18:22.115667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:18:22.116515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:18:22.118650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:18:22.119132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:18:22.139985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:22.140814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:22.141406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:22.142623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:22.143510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:22.144254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:22.167238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:18:22.177404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for user acce3e06ce4d40ba8db7988456cf8787 and project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:18:22.199168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:18:22.202020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 445dc7ce-d25b-48b5-a66f-b4de93383178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:18:22.415408 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ace7023e-e729-4334-ad8f-124ee2951116 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997220 Sep 06 11:18:22.418423 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2701/5350] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:18:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:18:22.432078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c21a7edb-9d4a-443e-bafa-39be6c76e593 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:22.432750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c21a7edb-9d4a-443e-bafa-39be6c76e593 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 445dc7ce-d25b-48b5-a66f-b4de93383178] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:22.457771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c21a7edb-9d4a-443e-bafa-39be6c76e593 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 445dc7ce-d25b-48b5-a66f-b4de93383178] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:18:22.534001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-67faed2f-0f92-473c-a36b-2a837165583d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:22.539959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-67faed2f-0f92-473c-a36b-2a837165583d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:22.561763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67faed2f-0f92-473c-a36b-2a837165583d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:22.562353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67faed2f-0f92-473c-a36b-2a837165583d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:22.563618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67faed2f-0f92-473c-a36b-2a837165583d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:22.564417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67faed2f-0f92-473c-a36b-2a837165583d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:22.565673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67faed2f-0f92-473c-a36b-2a837165583d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:22.566196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67faed2f-0f92-473c-a36b-2a837165583d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:22.701578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-67faed2f-0f92-473c-a36b-2a837165583d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:22.713512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-67faed2f-0f92-473c-a36b-2a837165583d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:22.722515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-67faed2f-0f92-473c-a36b-2a837165583d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:22.726513 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-67faed2f-0f92-473c-a36b-2a837165583d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1338 microversion: 2.20 time: 0.199304 Sep 06 11:18:22.731714 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2702/5351] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:18:22 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1338 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:18:23.163740 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c21a7edb-9d4a-443e-bafa-39be6c76e593 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/445dc7ce-d25b-48b5-a66f-b4de93383178" status: 204 len: 0 microversion: 2.1 time: 0.736730 Sep 06 11:18:23.165081 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2650/5352] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:18:22 2022] DELETE /compute/v2.1/servers/445dc7ce-d25b-48b5-a66f-b4de93383178 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:18:23.173662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1799ed5e-7c87-41d1-8026-f938cb83439f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:23.174879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1799ed5e-7c87-41d1-8026-f938cb83439f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 445dc7ce-d25b-48b5-a66f-b4de93383178] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:23.197900 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-1799ed5e-7c87-41d1-8026-f938cb83439f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1799ed5e-7c87-41d1-8026-f938cb83439f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/445dc7ce-d25b-48b5-a66f-b4de93383178 HTTP/1.1 Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '445dc7ce-d25b-48b5-a66f-b4de93383178'} Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 445dc7ce-d25b-48b5-a66f-b4de93383178 Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:18:23.209121 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1799ed5e-7c87-41d1-8026-f938cb83439f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:18:23.217365 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1799ed5e-7c87-41d1-8026-f938cb83439f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/445dc7ce-d25b-48b5-a66f-b4de93383178" status: 404 len: 111 microversion: 2.1 time: 0.043108 Sep 06 11:18:23.227862 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2703/5353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:23 2022] GET /compute/v2.1/servers/445dc7ce-d25b-48b5-a66f-b4de93383178 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:18:23.299553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-237050283", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "74ae681a-5964-499e-a86a-13cffa0cf1b0"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:23.381205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] validate_networks() for [('74ae681a-5964-499e-a86a-13cffa0cf1b0', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:18:23.762766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fde50c13-cec5-4aef-85a5-9b6cb22fc664 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:23.763439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fde50c13-cec5-4aef-85a5-9b6cb22fc664 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:23.777415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fde50c13-cec5-4aef-85a5-9b6cb22fc664 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:23.778421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fde50c13-cec5-4aef-85a5-9b6cb22fc664 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:23.779279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fde50c13-cec5-4aef-85a5-9b6cb22fc664 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:23.780308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fde50c13-cec5-4aef-85a5-9b6cb22fc664 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:23.780958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fde50c13-cec5-4aef-85a5-9b6cb22fc664 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:23.781751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fde50c13-cec5-4aef-85a5-9b6cb22fc664 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:23.898717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fde50c13-cec5-4aef-85a5-9b6cb22fc664 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:23.917420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fde50c13-cec5-4aef-85a5-9b6cb22fc664 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:23.919208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fde50c13-cec5-4aef-85a5-9b6cb22fc664 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:23.920694 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fde50c13-cec5-4aef-85a5-9b6cb22fc664 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1336 microversion: 2.20 time: 0.162369 Sep 06 11:18:23.921268 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2704/5354] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:18:23 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1336 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:18:24.084306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:18:24.084820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:18:24.085318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:18:24.085750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:18:24.086231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:18:24.096005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:24.096504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:24.099381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:24.099381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:24.099381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:24.099381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:24.107158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=81,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:24.119383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:18:24.125137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for user acce3e06ce4d40ba8db7988456cf8787 and project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:18:24.138839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:18:24.141192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:18:24.326659 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ce50d05a-44b6-4611-97e3-2974fcbcd667 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031312 Sep 06 11:18:24.328237 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2651/5355] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:18:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:18:24.340887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-df4d4ba1-aa5a-4446-9781-26d8548f8d88 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:24.341565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-df4d4ba1-aa5a-4446-9781-26d8548f8d88 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:24.490554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-df4d4ba1-aa5a-4446-9781-26d8548f8d88 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:24.502127 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-df4d4ba1-aa5a-4446-9781-26d8548f8d88 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1220 microversion: 2.1 time: 0.166712 Sep 06 11:18:24.502921 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2705/5356] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:24 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1220 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:24.950588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f32efaf1-2e83-4895-8ee9-95e876a4d897 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:24.951508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f32efaf1-2e83-4895-8ee9-95e876a4d897 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:24.963421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f32efaf1-2e83-4895-8ee9-95e876a4d897 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:24.968515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f32efaf1-2e83-4895-8ee9-95e876a4d897 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:24.969295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f32efaf1-2e83-4895-8ee9-95e876a4d897 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:24.970322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f32efaf1-2e83-4895-8ee9-95e876a4d897 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:24.973353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f32efaf1-2e83-4895-8ee9-95e876a4d897 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:24.974030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f32efaf1-2e83-4895-8ee9-95e876a4d897 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:25.361810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f32efaf1-2e83-4895-8ee9-95e876a4d897 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:25.376843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f32efaf1-2e83-4895-8ee9-95e876a4d897 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:25.380354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f32efaf1-2e83-4895-8ee9-95e876a4d897 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:25.384171 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f32efaf1-2e83-4895-8ee9-95e876a4d897 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1404 microversion: 2.20 time: 0.439838 Sep 06 11:18:25.400044 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2652/5357] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:18:24 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:18:25.529158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3754fcb4-4142-4506-a7b9-02f0d7cb1c96 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:25.529947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3754fcb4-4142-4506-a7b9-02f0d7cb1c96 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:25.625407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3754fcb4-4142-4506-a7b9-02f0d7cb1c96 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:25.653894 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3754fcb4-4142-4506-a7b9-02f0d7cb1c96 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1220 microversion: 2.1 time: 0.128551 Sep 06 11:18:25.668947 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2706/5358] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:25 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:25.920578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f9a7cb56-bec5-46d1-a002-081f9e3f4f5a req-afba0537-49a6-4af1-a617-81c2ebdce147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72fceff4-8a80-43f9-88f2-fd73e1eed3e3", "tag": "921e3ee1-fb50-4f0c-80ae-7a517b1fdc23"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:25.951618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f9a7cb56-bec5-46d1-a002-081f9e3f4f5a req-afba0537-49a6-4af1-a617-81c2ebdce147 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:25.952444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f9a7cb56-bec5-46d1-a002-081f9e3f4f5a req-afba0537-49a6-4af1-a617-81c2ebdce147 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:25.953012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f9a7cb56-bec5-46d1-a002-081f9e3f4f5a req-afba0537-49a6-4af1-a617-81c2ebdce147 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:25.974795 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f9a7cb56-bec5-46d1-a002-081f9e3f4f5a req-afba0537-49a6-4af1-a617-81c2ebdce147 service nova] Creating event network-changed:921e3ee1-fb50-4f0c-80ae-7a517b1fdc23 for instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 on nch2-master-1 Sep 06 11:18:25.987887 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f9a7cb56-bec5-46d1-a002-081f9e3f4f5a req-afba0537-49a6-4af1-a617-81c2ebdce147 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085060 Sep 06 11:18:25.992245 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2653/5359] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:18:26.418636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-70c48ae0-86ce-4042-b408-6cf2f4e75813 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:26.422784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-70c48ae0-86ce-4042-b408-6cf2f4e75813 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:26.436878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70c48ae0-86ce-4042-b408-6cf2f4e75813 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:26.437982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70c48ae0-86ce-4042-b408-6cf2f4e75813 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:26.439054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70c48ae0-86ce-4042-b408-6cf2f4e75813 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:26.440479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70c48ae0-86ce-4042-b408-6cf2f4e75813 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:26.441273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70c48ae0-86ce-4042-b408-6cf2f4e75813 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:26.442592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70c48ae0-86ce-4042-b408-6cf2f4e75813 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:26.685077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-17eccd41-2d0b-4080-8a87-a060b7c919b0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:26.686546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-17eccd41-2d0b-4080-8a87-a060b7c919b0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:26.697516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17eccd41-2d0b-4080-8a87-a060b7c919b0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:26.700378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17eccd41-2d0b-4080-8a87-a060b7c919b0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:26.700378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17eccd41-2d0b-4080-8a87-a060b7c919b0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:26.700378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17eccd41-2d0b-4080-8a87-a060b7c919b0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:26.701175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17eccd41-2d0b-4080-8a87-a060b7c919b0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:26.701826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17eccd41-2d0b-4080-8a87-a060b7c919b0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:26.782771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-70c48ae0-86ce-4042-b408-6cf2f4e75813 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:26.803073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-70c48ae0-86ce-4042-b408-6cf2f4e75813 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:26.805546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-70c48ae0-86ce-4042-b408-6cf2f4e75813 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:26.807248 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-70c48ae0-86ce-4042-b408-6cf2f4e75813 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1404 microversion: 2.20 time: 0.394041 Sep 06 11:18:26.811072 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2707/5360] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:18:26 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1404 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:18:26.844409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-17eccd41-2d0b-4080-8a87-a060b7c919b0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:26.853708 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-17eccd41-2d0b-4080-8a87-a060b7c919b0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1216 microversion: 2.1 time: 0.175472 Sep 06 11:18:26.854326 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2654/5361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:26 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1216 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:18:27.834231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d49727d8-35bf-492b-8409-fa76c956119f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:27.835650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d49727d8-35bf-492b-8409-fa76c956119f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:27.843533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d49727d8-35bf-492b-8409-fa76c956119f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:27.844460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d49727d8-35bf-492b-8409-fa76c956119f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:27.845708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d49727d8-35bf-492b-8409-fa76c956119f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:27.846729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d49727d8-35bf-492b-8409-fa76c956119f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:27.847419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d49727d8-35bf-492b-8409-fa76c956119f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:27.848571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d49727d8-35bf-492b-8409-fa76c956119f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:27.877457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4af55f3e-4c2e-4cbc-8e79-98c5d07aec39 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:27.878867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4af55f3e-4c2e-4cbc-8e79-98c5d07aec39 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:27.888805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4af55f3e-4c2e-4cbc-8e79-98c5d07aec39 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:27.889415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4af55f3e-4c2e-4cbc-8e79-98c5d07aec39 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:27.890087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4af55f3e-4c2e-4cbc-8e79-98c5d07aec39 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:27.890907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4af55f3e-4c2e-4cbc-8e79-98c5d07aec39 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:27.891487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4af55f3e-4c2e-4cbc-8e79-98c5d07aec39 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:27.891986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4af55f3e-4c2e-4cbc-8e79-98c5d07aec39 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:28.074370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4af55f3e-4c2e-4cbc-8e79-98c5d07aec39 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:28.091652 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4af55f3e-4c2e-4cbc-8e79-98c5d07aec39 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1272 microversion: 2.1 time: 0.218089 Sep 06 11:18:28.092919 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2655/5362] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:27 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:28.755714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d49727d8-35bf-492b-8409-fa76c956119f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:28.790761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d49727d8-35bf-492b-8409-fa76c956119f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:28.800056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d49727d8-35bf-492b-8409-fa76c956119f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:28.801345 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d49727d8-35bf-492b-8409-fa76c956119f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1404 microversion: 2.20 time: 0.971533 Sep 06 11:18:28.801962 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2708/5363] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:18:27 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1404 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:18:29.117436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01172543-dce2-4241-9985-f0167e7b57b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:29.118637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-01172543-dce2-4241-9985-f0167e7b57b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:29.134359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01172543-dce2-4241-9985-f0167e7b57b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:29.135670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01172543-dce2-4241-9985-f0167e7b57b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:29.136478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01172543-dce2-4241-9985-f0167e7b57b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:29.137522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01172543-dce2-4241-9985-f0167e7b57b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:29.138471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01172543-dce2-4241-9985-f0167e7b57b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:29.139167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01172543-dce2-4241-9985-f0167e7b57b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:29.338126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-01172543-dce2-4241-9985-f0167e7b57b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:29.351367 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-01172543-dce2-4241-9985-f0167e7b57b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1278 microversion: 2.1 time: 0.237585 Sep 06 11:18:29.351888 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2656/5364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:29 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1278 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:29.831077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-72f88750-2a6b-4eff-8216-e4a059047c71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:29.832525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-72f88750-2a6b-4eff-8216-e4a059047c71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:29.847364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72f88750-2a6b-4eff-8216-e4a059047c71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:29.848081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72f88750-2a6b-4eff-8216-e4a059047c71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:29.849698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72f88750-2a6b-4eff-8216-e4a059047c71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:29.853056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72f88750-2a6b-4eff-8216-e4a059047c71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:29.853929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72f88750-2a6b-4eff-8216-e4a059047c71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:29.854715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72f88750-2a6b-4eff-8216-e4a059047c71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:30.039918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-72f88750-2a6b-4eff-8216-e4a059047c71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:30.051808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-72f88750-2a6b-4eff-8216-e4a059047c71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:30.054078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-72f88750-2a6b-4eff-8216-e4a059047c71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:30.055515 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-72f88750-2a6b-4eff-8216-e4a059047c71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1404 microversion: 2.20 time: 0.231388 Sep 06 11:18:30.056591 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2709/5365] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:18:29 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1404 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:18:30.386745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4b1bb247-1727-43ab-b3ec-7e2fca07603e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:30.387471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4b1bb247-1727-43ab-b3ec-7e2fca07603e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:30.397768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:30.406199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b1bb247-1727-43ab-b3ec-7e2fca07603e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:30.407159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b1bb247-1727-43ab-b3ec-7e2fca07603e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:30.407842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b1bb247-1727-43ab-b3ec-7e2fca07603e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:30.408828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b1bb247-1727-43ab-b3ec-7e2fca07603e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:30.409886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b1bb247-1727-43ab-b3ec-7e2fca07603e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:30.411602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b1bb247-1727-43ab-b3ec-7e2fca07603e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:30.686905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4b1bb247-1727-43ab-b3ec-7e2fca07603e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:30.704229 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4b1bb247-1727-43ab-b3ec-7e2fca07603e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1320 microversion: 2.1 time: 0.323063 Sep 06 11:18:30.721359 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2657/5366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:30 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1320 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:31.082757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-30ac9fb8-8cf2-4a50-96d0-bb9d65380c34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:31.083598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-30ac9fb8-8cf2-4a50-96d0-bb9d65380c34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:31.092474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30ac9fb8-8cf2-4a50-96d0-bb9d65380c34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:31.092965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30ac9fb8-8cf2-4a50-96d0-bb9d65380c34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:31.093474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30ac9fb8-8cf2-4a50-96d0-bb9d65380c34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:31.094198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30ac9fb8-8cf2-4a50-96d0-bb9d65380c34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:31.094663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30ac9fb8-8cf2-4a50-96d0-bb9d65380c34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:31.095142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30ac9fb8-8cf2-4a50-96d0-bb9d65380c34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:31.411347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-30ac9fb8-8cf2-4a50-96d0-bb9d65380c34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:31.422370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-30ac9fb8-8cf2-4a50-96d0-bb9d65380c34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:31.424463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-30ac9fb8-8cf2-4a50-96d0-bb9d65380c34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:31.426023 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-30ac9fb8-8cf2-4a50-96d0-bb9d65380c34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1404 microversion: 2.20 time: 0.347363 Sep 06 11:18:31.439163 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2710/5367] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:18:31 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1404 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:18:31.477802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-13a6e4b6-fb2d-4ea3-8978-1854c431ee92 req-16eef30d-c0ce-4d27-be60-34e127991344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4062f393-6e8e-4c9b-9203-c71da792eaf4", "tag": "e94c47d7-960d-4c1f-9a49-710408f160be"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:31.512745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-13a6e4b6-fb2d-4ea3-8978-1854c431ee92 req-16eef30d-c0ce-4d27-be60-34e127991344 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:31.513759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-13a6e4b6-fb2d-4ea3-8978-1854c431ee92 req-16eef30d-c0ce-4d27-be60-34e127991344 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:31.514989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-13a6e4b6-fb2d-4ea3-8978-1854c431ee92 req-16eef30d-c0ce-4d27-be60-34e127991344 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:31.531257 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-13a6e4b6-fb2d-4ea3-8978-1854c431ee92 req-16eef30d-c0ce-4d27-be60-34e127991344 service nova] Creating event network-changed:e94c47d7-960d-4c1f-9a49-710408f160be for instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 on nch1-master-1 Sep 06 11:18:31.536444 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-13a6e4b6-fb2d-4ea3-8978-1854c431ee92 req-16eef30d-c0ce-4d27-be60-34e127991344 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064402 Sep 06 11:18:31.537536 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2658/5368] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:18:31.711311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-7ce97c7f-68ad-4e86-9519-7b6d10e295a4 req-f9cd5249-d2d4-47f3-a283-da6a08ac6f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72fceff4-8a80-43f9-88f2-fd73e1eed3e3", "name": "network-vif-plugged", "status": "completed", "tag": "921e3ee1-fb50-4f0c-80ae-7a517b1fdc23"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:31.728905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-61112514-3e2b-4a5c-b0a1-339941034459 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:31.733065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-61112514-3e2b-4a5c-b0a1-339941034459 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:31.740674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ce97c7f-68ad-4e86-9519-7b6d10e295a4 req-f9cd5249-d2d4-47f3-a283-da6a08ac6f1c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:31.741440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ce97c7f-68ad-4e86-9519-7b6d10e295a4 req-f9cd5249-d2d4-47f3-a283-da6a08ac6f1c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:31.742232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ce97c7f-68ad-4e86-9519-7b6d10e295a4 req-f9cd5249-d2d4-47f3-a283-da6a08ac6f1c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:31.748447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61112514-3e2b-4a5c-b0a1-339941034459 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:31.750923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61112514-3e2b-4a5c-b0a1-339941034459 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:31.750923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61112514-3e2b-4a5c-b0a1-339941034459 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:31.751519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61112514-3e2b-4a5c-b0a1-339941034459 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:31.752406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61112514-3e2b-4a5c-b0a1-339941034459 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:31.753737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61112514-3e2b-4a5c-b0a1-339941034459 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:31.758327 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-7ce97c7f-68ad-4e86-9519-7b6d10e295a4 req-f9cd5249-d2d4-47f3-a283-da6a08ac6f1c service nova] Creating event network-vif-plugged:921e3ee1-fb50-4f0c-80ae-7a517b1fdc23 for instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 on nch2-master-1 Sep 06 11:18:31.765680 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-7ce97c7f-68ad-4e86-9519-7b6d10e295a4 req-f9cd5249-d2d4-47f3-a283-da6a08ac6f1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058397 Sep 06 11:18:31.766667 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2711/5369] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:18:32.039198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-61112514-3e2b-4a5c-b0a1-339941034459 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:32.049333 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-61112514-3e2b-4a5c-b0a1-339941034459 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1320 microversion: 2.1 time: 0.324912 Sep 06 11:18:32.050354 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2659/5370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:31 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1320 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:32.457806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f1ad0e59-7ff5-4067-86ff-b1285afc9d7a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:32.458559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f1ad0e59-7ff5-4067-86ff-b1285afc9d7a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:32.464223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:32.471713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1ad0e59-7ff5-4067-86ff-b1285afc9d7a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:32.472607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1ad0e59-7ff5-4067-86ff-b1285afc9d7a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:32.473263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1ad0e59-7ff5-4067-86ff-b1285afc9d7a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:32.474332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1ad0e59-7ff5-4067-86ff-b1285afc9d7a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:32.475552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1ad0e59-7ff5-4067-86ff-b1285afc9d7a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:32.476154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1ad0e59-7ff5-4067-86ff-b1285afc9d7a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:32.504226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:32.742950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f1ad0e59-7ff5-4067-86ff-b1285afc9d7a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:32.753833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f1ad0e59-7ff5-4067-86ff-b1285afc9d7a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:32.755953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f1ad0e59-7ff5-4067-86ff-b1285afc9d7a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:32.757040 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f1ad0e59-7ff5-4067-86ff-b1285afc9d7a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1404 microversion: 2.20 time: 0.306020 Sep 06 11:18:32.757638 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2712/5371] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:18:32 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1404 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:18:33.079067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6292fbe6-ffa7-4684-8eb3-5970843ec443 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:33.080918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6292fbe6-ffa7-4684-8eb3-5970843ec443 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:33.092327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6292fbe6-ffa7-4684-8eb3-5970843ec443 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:33.092921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6292fbe6-ffa7-4684-8eb3-5970843ec443 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:33.093436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6292fbe6-ffa7-4684-8eb3-5970843ec443 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:33.094407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6292fbe6-ffa7-4684-8eb3-5970843ec443 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:33.095164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6292fbe6-ffa7-4684-8eb3-5970843ec443 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:33.095824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6292fbe6-ffa7-4684-8eb3-5970843ec443 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:33.387644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6292fbe6-ffa7-4684-8eb3-5970843ec443 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:33.395577 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6292fbe6-ffa7-4684-8eb3-5970843ec443 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1320 microversion: 2.1 time: 0.321750 Sep 06 11:18:33.400728 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2660/5372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:33 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:18:33.783301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-90f0a35f-2621-444f-8507-6c08d73ab4d0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:33.783987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-90f0a35f-2621-444f-8507-6c08d73ab4d0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:33.792392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90f0a35f-2621-444f-8507-6c08d73ab4d0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:33.792889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90f0a35f-2621-444f-8507-6c08d73ab4d0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:33.793334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90f0a35f-2621-444f-8507-6c08d73ab4d0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:33.794246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90f0a35f-2621-444f-8507-6c08d73ab4d0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:33.794774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90f0a35f-2621-444f-8507-6c08d73ab4d0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:33.795233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90f0a35f-2621-444f-8507-6c08d73ab4d0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:34.054762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-90f0a35f-2621-444f-8507-6c08d73ab4d0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:34.062856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-90f0a35f-2621-444f-8507-6c08d73ab4d0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:34.065003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-90f0a35f-2621-444f-8507-6c08d73ab4d0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:34.083039 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-90f0a35f-2621-444f-8507-6c08d73ab4d0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1596 microversion: 2.20 time: 0.287862 Sep 06 11:18:34.083039 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2713/5373] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:18:33 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1596 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:18:34.094496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-464badc8-5813-47c3-8d77-559f38349604 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:34.094496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-464badc8-5813-47c3-8d77-559f38349604 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:34.104769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-464badc8-5813-47c3-8d77-559f38349604 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:34.105378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-464badc8-5813-47c3-8d77-559f38349604 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:34.105910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-464badc8-5813-47c3-8d77-559f38349604 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:34.106773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-464badc8-5813-47c3-8d77-559f38349604 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:34.107359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-464badc8-5813-47c3-8d77-559f38349604 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:34.107887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-464badc8-5813-47c3-8d77-559f38349604 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:34.108534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:34.133501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=16 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:34.426280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d5fab31f-d6cc-4edb-b5b8-6fb4d22f21b1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:34.426280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d5fab31f-d6cc-4edb-b5b8-6fb4d22f21b1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:34.436869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5fab31f-d6cc-4edb-b5b8-6fb4d22f21b1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:34.436869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5fab31f-d6cc-4edb-b5b8-6fb4d22f21b1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:34.436869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5fab31f-d6cc-4edb-b5b8-6fb4d22f21b1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:34.436869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5fab31f-d6cc-4edb-b5b8-6fb4d22f21b1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:34.436869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5fab31f-d6cc-4edb-b5b8-6fb4d22f21b1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:34.436869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5fab31f-d6cc-4edb-b5b8-6fb4d22f21b1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:34.602493 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-464badc8-5813-47c3-8d77-559f38349604 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.513484 Sep 06 11:18:34.604299 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2661/5374] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Sep 6 11:18:34 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/os-interface => generated 284 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:18:34.781570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d5fab31f-d6cc-4edb-b5b8-6fb4d22f21b1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:34.803753 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d5fab31f-d6cc-4edb-b5b8-6fb4d22f21b1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1320 microversion: 2.1 time: 0.387869 Sep 06 11:18:34.805609 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2714/5375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:34 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:18:35.100996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e910b003-5091-4463-9aed-5ae23035fb34 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:35.104146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e910b003-5091-4463-9aed-5ae23035fb34 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:35.121798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e910b003-5091-4463-9aed-5ae23035fb34 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:35.121798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e910b003-5091-4463-9aed-5ae23035fb34 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:35.121798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e910b003-5091-4463-9aed-5ae23035fb34 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:35.121798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e910b003-5091-4463-9aed-5ae23035fb34 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:35.121798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e910b003-5091-4463-9aed-5ae23035fb34 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:35.122263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e910b003-5091-4463-9aed-5ae23035fb34 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:35.234418 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e910b003-5091-4463-9aed-5ae23035fb34 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "POST /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0/action" status: 200 len: 32484 microversion: 2.42 time: 0.380062 Sep 06 11:18:35.235115 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2662/5376] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:18:34 2022] POST /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0/action => generated 32484 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:18:35.830181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f10119d-0639-47a5-9af8-1711b3d15e2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:35.831494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7f10119d-0639-47a5-9af8-1711b3d15e2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:35.837955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=16 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:35.840948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f10119d-0639-47a5-9af8-1711b3d15e2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:35.841608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f10119d-0639-47a5-9af8-1711b3d15e2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:35.842225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f10119d-0639-47a5-9af8-1711b3d15e2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:35.843312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f10119d-0639-47a5-9af8-1711b3d15e2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:35.843920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f10119d-0639-47a5-9af8-1711b3d15e2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:35.844572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f10119d-0639-47a5-9af8-1711b3d15e2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:36.145310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-fe64cdf2-25bd-4ea0-9de3-23d77ddd14d4 req-39ac9676-68a9-46e4-974c-0eb7a0532c26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72fceff4-8a80-43f9-88f2-fd73e1eed3e3", "tag": "921e3ee1-fb50-4f0c-80ae-7a517b1fdc23"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:36.167428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fe64cdf2-25bd-4ea0-9de3-23d77ddd14d4 req-39ac9676-68a9-46e4-974c-0eb7a0532c26 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:36.168070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fe64cdf2-25bd-4ea0-9de3-23d77ddd14d4 req-39ac9676-68a9-46e4-974c-0eb7a0532c26 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:36.168731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fe64cdf2-25bd-4ea0-9de3-23d77ddd14d4 req-39ac9676-68a9-46e4-974c-0eb7a0532c26 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:36.191992 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-fe64cdf2-25bd-4ea0-9de3-23d77ddd14d4 req-39ac9676-68a9-46e4-974c-0eb7a0532c26 service nova] Creating event network-changed:921e3ee1-fb50-4f0c-80ae-7a517b1fdc23 for instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 on nch2-master-1 Sep 06 11:18:36.198661 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-fe64cdf2-25bd-4ea0-9de3-23d77ddd14d4 req-39ac9676-68a9-46e4-974c-0eb7a0532c26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057455 Sep 06 11:18:36.199331 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2663/5377] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:18:36.306847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f10119d-0639-47a5-9af8-1711b3d15e2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:36.322521 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7f10119d-0639-47a5-9af8-1711b3d15e2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1320 microversion: 2.1 time: 0.494027 Sep 06 11:18:36.322521 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2715/5378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:35 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1320 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:37.345122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8f31e355-9ee7-4a35-80f6-8c077a3861b5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:37.347327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8f31e355-9ee7-4a35-80f6-8c077a3861b5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:37.353854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f31e355-9ee7-4a35-80f6-8c077a3861b5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:37.354725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f31e355-9ee7-4a35-80f6-8c077a3861b5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:37.355490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f31e355-9ee7-4a35-80f6-8c077a3861b5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:37.356435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f31e355-9ee7-4a35-80f6-8c077a3861b5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:37.357137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f31e355-9ee7-4a35-80f6-8c077a3861b5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:37.357807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f31e355-9ee7-4a35-80f6-8c077a3861b5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:37.509623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8f31e355-9ee7-4a35-80f6-8c077a3861b5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:37.518177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8f31e355-9ee7-4a35-80f6-8c077a3861b5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1320 microversion: 2.1 time: 0.177255 Sep 06 11:18:37.519094 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2664/5379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:37 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1320 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:38.355472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-de7ef4be-c0ac-4b46-8670-12d981d1ca1a req-3928df55-9b37-4bf5-93e5-ba0202525bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4062f393-6e8e-4c9b-9203-c71da792eaf4", "name": "network-vif-plugged", "status": "completed", "tag": "e94c47d7-960d-4c1f-9a49-710408f160be"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:38.377108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-de7ef4be-c0ac-4b46-8670-12d981d1ca1a req-3928df55-9b37-4bf5-93e5-ba0202525bd4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:38.385536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-de7ef4be-c0ac-4b46-8670-12d981d1ca1a req-3928df55-9b37-4bf5-93e5-ba0202525bd4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:38.385536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-de7ef4be-c0ac-4b46-8670-12d981d1ca1a req-3928df55-9b37-4bf5-93e5-ba0202525bd4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:38.438962 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-de7ef4be-c0ac-4b46-8670-12d981d1ca1a req-3928df55-9b37-4bf5-93e5-ba0202525bd4 service nova] Creating event network-vif-plugged:e94c47d7-960d-4c1f-9a49-710408f160be for instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 on nch1-master-1 Sep 06 11:18:38.440811 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-de7ef4be-c0ac-4b46-8670-12d981d1ca1a req-3928df55-9b37-4bf5-93e5-ba0202525bd4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090769 Sep 06 11:18:38.443286 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2716/5380] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:18:38.544361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c2542d36-2841-4e51-a575-685105646e17 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:38.545107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c2542d36-2841-4e51-a575-685105646e17 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:38.562059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2542d36-2841-4e51-a575-685105646e17 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:38.563192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2542d36-2841-4e51-a575-685105646e17 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:38.564126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2542d36-2841-4e51-a575-685105646e17 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:38.565586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2542d36-2841-4e51-a575-685105646e17 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:38.566764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2542d36-2841-4e51-a575-685105646e17 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:38.567739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2542d36-2841-4e51-a575-685105646e17 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:38.989925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c2542d36-2841-4e51-a575-685105646e17 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:38.998867 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c2542d36-2841-4e51-a575-685105646e17 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1320 microversion: 2.1 time: 0.460165 Sep 06 11:18:39.002184 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2665/5381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:38 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1320 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:18:40.028960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6d55ce4c-5255-4fbf-b569-6671dc040c2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:40.032253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6d55ce4c-5255-4fbf-b569-6671dc040c2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:40.032475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:40.049812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d55ce4c-5255-4fbf-b569-6671dc040c2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:40.050324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d55ce4c-5255-4fbf-b569-6671dc040c2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:40.050780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d55ce4c-5255-4fbf-b569-6671dc040c2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:40.054837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d55ce4c-5255-4fbf-b569-6671dc040c2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:40.055377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d55ce4c-5255-4fbf-b569-6671dc040c2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:40.055840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d55ce4c-5255-4fbf-b569-6671dc040c2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:40.305224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6d55ce4c-5255-4fbf-b569-6671dc040c2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:40.319432 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6d55ce4c-5255-4fbf-b569-6671dc040c2d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1320 microversion: 2.1 time: 0.294215 Sep 06 11:18:40.337128 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2717/5382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:40 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1320 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:41.356580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-405d5aef-f237-44fd-be64-49ef26d2f55b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:41.358600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-405d5aef-f237-44fd-be64-49ef26d2f55b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:41.374241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-405d5aef-f237-44fd-be64-49ef26d2f55b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:41.374999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-405d5aef-f237-44fd-be64-49ef26d2f55b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:41.375659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-405d5aef-f237-44fd-be64-49ef26d2f55b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:41.376569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-405d5aef-f237-44fd-be64-49ef26d2f55b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:41.378057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-405d5aef-f237-44fd-be64-49ef26d2f55b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:41.378864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-405d5aef-f237-44fd-be64-49ef26d2f55b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:41.647520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-405d5aef-f237-44fd-be64-49ef26d2f55b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:41.655595 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-405d5aef-f237-44fd-be64-49ef26d2f55b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1501 microversion: 2.1 time: 0.310880 Sep 06 11:18:41.656469 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2666/5383] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:41 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1501 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:41.680367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e7572e10-01c6-4712-aaae-53b5d9421a42 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:41.682357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e7572e10-01c6-4712-aaae-53b5d9421a42 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:41.692347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7572e10-01c6-4712-aaae-53b5d9421a42 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:41.692854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7572e10-01c6-4712-aaae-53b5d9421a42 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:41.693760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7572e10-01c6-4712-aaae-53b5d9421a42 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:41.694497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7572e10-01c6-4712-aaae-53b5d9421a42 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:41.695313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7572e10-01c6-4712-aaae-53b5d9421a42 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:41.695761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7572e10-01c6-4712-aaae-53b5d9421a42 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:41.952467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e7572e10-01c6-4712-aaae-53b5d9421a42 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:41.969426 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e7572e10-01c6-4712-aaae-53b5d9421a42 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1501 microversion: 2.1 time: 0.293106 Sep 06 11:18:41.970341 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2718/5384] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:41 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1501 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:41.993288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-48b42ec4-65b4-4c5b-a087-093f099be4a1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:41.994001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-48b42ec4-65b4-4c5b-a087-093f099be4a1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:42.001172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-48b42ec4-65b4-4c5b-a087-093f099be4a1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:42.001954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-48b42ec4-65b4-4c5b-a087-093f099be4a1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:42.002564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-48b42ec4-65b4-4c5b-a087-093f099be4a1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:42.006424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-48b42ec4-65b4-4c5b-a087-093f099be4a1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:42.007119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-48b42ec4-65b4-4c5b-a087-093f099be4a1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:42.007981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-48b42ec4-65b4-4c5b-a087-093f099be4a1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:42.048620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-48b42ec4-65b4-4c5b-a087-093f099be4a1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:18:42.489099 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-48b42ec4-65b4-4c5b-a087-093f099be4a1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 204 len: 0 microversion: 2.1 time: 0.499554 Sep 06 11:18:42.501569 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2667/5385] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:18:41 2022] DELETE /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:18:42.501741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dbcdb56b-7f13-44ca-9378-563d94fb68e8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:42.501741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dbcdb56b-7f13-44ca-9378-563d94fb68e8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:42.513121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbcdb56b-7f13-44ca-9378-563d94fb68e8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:42.519907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbcdb56b-7f13-44ca-9378-563d94fb68e8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:42.523782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbcdb56b-7f13-44ca-9378-563d94fb68e8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:42.524727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbcdb56b-7f13-44ca-9378-563d94fb68e8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:42.525285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbcdb56b-7f13-44ca-9378-563d94fb68e8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:42.525805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbcdb56b-7f13-44ca-9378-563d94fb68e8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:42.877415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dbcdb56b-7f13-44ca-9378-563d94fb68e8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:42.894551 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dbcdb56b-7f13-44ca-9378-563d94fb68e8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1507 microversion: 2.1 time: 0.395561 Sep 06 11:18:42.911093 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2719/5386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:42 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:43.924988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f581068c-df5f-434d-a4a1-e1ea6dcb6cc6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:43.925736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f581068c-df5f-434d-a4a1-e1ea6dcb6cc6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:43.947195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f581068c-df5f-434d-a4a1-e1ea6dcb6cc6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:43.951526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f581068c-df5f-434d-a4a1-e1ea6dcb6cc6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:43.951526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f581068c-df5f-434d-a4a1-e1ea6dcb6cc6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:43.955160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f581068c-df5f-434d-a4a1-e1ea6dcb6cc6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:43.955916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f581068c-df5f-434d-a4a1-e1ea6dcb6cc6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:43.956587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f581068c-df5f-434d-a4a1-e1ea6dcb6cc6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:44.916928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f581068c-df5f-434d-a4a1-e1ea6dcb6cc6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:44.927981 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f581068c-df5f-434d-a4a1-e1ea6dcb6cc6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1507 microversion: 2.1 time: 1.007140 Sep 06 11:18:44.936302 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2668/5387] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:43 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1507 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:45.955215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0f9d133c-3aea-4a7b-bdd6-5571fc36488d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:45.955215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0f9d133c-3aea-4a7b-bdd6-5571fc36488d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:45.967519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f9d133c-3aea-4a7b-bdd6-5571fc36488d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:45.967840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f9d133c-3aea-4a7b-bdd6-5571fc36488d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:45.968313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f9d133c-3aea-4a7b-bdd6-5571fc36488d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:45.969089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f9d133c-3aea-4a7b-bdd6-5571fc36488d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:45.969564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f9d133c-3aea-4a7b-bdd6-5571fc36488d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:45.970005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f9d133c-3aea-4a7b-bdd6-5571fc36488d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:46.110822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0f9d133c-3aea-4a7b-bdd6-5571fc36488d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:46.129857 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0f9d133c-3aea-4a7b-bdd6-5571fc36488d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1465 microversion: 2.1 time: 0.170547 Sep 06 11:18:46.138913 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2720/5388] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:45 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1465 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:46.348943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-98a2f5e7-4d22-4c77-8a18-617ccbb0a096 req-19a871ec-b490-498d-8ad8-d6b524c0b273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4062f393-6e8e-4c9b-9203-c71da792eaf4", "name": "network-vif-deleted", "tag": "e94c47d7-960d-4c1f-9a49-710408f160be"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:46.381672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-98a2f5e7-4d22-4c77-8a18-617ccbb0a096 req-19a871ec-b490-498d-8ad8-d6b524c0b273 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:46.389029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-98a2f5e7-4d22-4c77-8a18-617ccbb0a096 req-19a871ec-b490-498d-8ad8-d6b524c0b273 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:46.389735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-98a2f5e7-4d22-4c77-8a18-617ccbb0a096 req-19a871ec-b490-498d-8ad8-d6b524c0b273 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:46.422306 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-98a2f5e7-4d22-4c77-8a18-617ccbb0a096 req-19a871ec-b490-498d-8ad8-d6b524c0b273 service nova] Creating event network-vif-deleted:e94c47d7-960d-4c1f-9a49-710408f160be for instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 on nch1-master-1 Sep 06 11:18:46.446781 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-98a2f5e7-4d22-4c77-8a18-617ccbb0a096 req-19a871ec-b490-498d-8ad8-d6b524c0b273 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101743 Sep 06 11:18:46.447651 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2669/5389] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:18:47.176679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:47.177686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:47.193277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:47.193951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:47.194665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:47.195686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:47.201021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:47.201815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:47.270723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:47.274528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:47.274528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:47.274528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lazy-loading 'fault' on Instance uuid 4062f393-6e8e-4c9b-9203-c71da792eaf4 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:18:47.328576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:47.337842 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bcb718aa-363d-4997-aa22-4a2d1351d83d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 200 len: 1310 microversion: 2.1 time: 0.165576 Sep 06 11:18:47.352053 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2721/5390] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:47 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 1310 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:48.365630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c1cc4202-5a70-4eee-ba0c-84cbc95a86f9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:48.366579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c1cc4202-5a70-4eee-ba0c-84cbc95a86f9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:48.380823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1cc4202-5a70-4eee-ba0c-84cbc95a86f9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:48.383139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1cc4202-5a70-4eee-ba0c-84cbc95a86f9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:48.384936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1cc4202-5a70-4eee-ba0c-84cbc95a86f9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:48.387708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1cc4202-5a70-4eee-ba0c-84cbc95a86f9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:48.388495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1cc4202-5a70-4eee-ba0c-84cbc95a86f9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:48.390978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1cc4202-5a70-4eee-ba0c-84cbc95a86f9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:48.424138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:48.425644 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-c1cc4202-5a70-4eee-ba0c-84cbc95a86f9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c1cc4202-5a70-4eee-ba0c-84cbc95a86f9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 HTTP/1.1 Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '4062f393-6e8e-4c9b-9203-c71da792eaf4'} Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:18:48.430433 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:18:48.435114 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:18:48.435114 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:18:48.435114 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:18:48.435114 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:18:48.435114 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:18:48.435114 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:18:48.435114 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:18:48.436865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c1cc4202-5a70-4eee-ba0c-84cbc95a86f9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:18:48.439445 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c1cc4202-5a70-4eee-ba0c-84cbc95a86f9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 404 len: 111 microversion: 2.1 time: 0.080378 Sep 06 11:18:48.442119 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2670/5391] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:48 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:18:48.454638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ec19ae6b-3355-48dc-87d8-d647b2f4c643 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Action: 'create', calling method: .version_select at 0x7f90f316a310>, body: {"keypair": {"name": "tempest-key-798459394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIKDpVuBL8aCf7emrJUnwCPQXb89Sm4Ds+RpDprCcZsrGIf9cMHPpAQ7hu+UNBdHGzCnwFmTC8RMEbskZKJs0/N2GPg+aMsly9V1dj0dFugMGFjp/Jn2YyDBvO2PBheUg=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:48.490458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ec19ae6b-3355-48dc-87d8-d647b2f4c643 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:18:48.512454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ec19ae6b-3355-48dc-87d8-d647b2f4c643 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for user acce3e06ce4d40ba8db7988456cf8787 and project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:18:48.668603 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ec19ae6b-3355-48dc-87d8-d647b2f4c643 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.218030 Sep 06 11:18:48.670239 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2722/5392] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:18:48 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:18:48.681469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f5a4be9b-bb69-4577-a915-6d1c5cb7fd6f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '.version_select at 0x7f90fd160790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:48.687217 ncdv-master-1 devstack@n-api.service[140875]: WARNING oslo_db.sqlalchemy.utils [None req-f5a4be9b-bb69-4577-a915-6d1c5cb7fd6f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 06 11:18:48.705741 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f5a4be9b-bb69-4577-a915-6d1c5cb7fd6f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.028460 Sep 06 11:18:48.726364 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2671/5393] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 11:18:48 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:18:48.929465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1313173673", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "key_name": "tempest-key-798459394", "networks": [{"uuid": "74ae681a-5964-499e-a86a-13cffa0cf1b0"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:49.025211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] validate_networks() for [('74ae681a-5964-499e-a86a-13cffa0cf1b0', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:18:50.675536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:18:50.678101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:18:50.679648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:18:50.680437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:18:50.681876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:18:50.697526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:50.697808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:50.698572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:50.699940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:50.700813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:50.701554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:50.732198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:18:50.742926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for user acce3e06ce4d40ba8db7988456cf8787 and project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:18:50.761287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:18:50.764461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:18:50.856348 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-93f162e4-b8e0-438b-b987-d928b92ebb56 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.933989 Sep 06 11:18:50.857287 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2723/5394] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:18:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:18:50.871428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ed4c5a2c-239e-4666-b5f2-f44989b76404 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:50.873667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ed4c5a2c-239e-4666-b5f2-f44989b76404 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:50.981295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ed4c5a2c-239e-4666-b5f2-f44989b76404 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:50.991662 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ed4c5a2c-239e-4666-b5f2-f44989b76404 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1228 microversion: 2.1 time: 0.126758 Sep 06 11:18:50.992928 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2672/5395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:50 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1228 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:52.019464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-00c7f82b-a2b5-46d8-aaef-feb2c35aea72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:52.021779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-00c7f82b-a2b5-46d8-aaef-feb2c35aea72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:52.137654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-00c7f82b-a2b5-46d8-aaef-feb2c35aea72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:52.151342 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-00c7f82b-a2b5-46d8-aaef-feb2c35aea72 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1228 microversion: 2.1 time: 0.138411 Sep 06 11:18:52.156641 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2724/5396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:52 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1228 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:53.177107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f4cdc301-1557-4430-8f8f-28ff3896e26a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:53.177664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f4cdc301-1557-4430-8f8f-28ff3896e26a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:53.196349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4cdc301-1557-4430-8f8f-28ff3896e26a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:53.197130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4cdc301-1557-4430-8f8f-28ff3896e26a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:53.197824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4cdc301-1557-4430-8f8f-28ff3896e26a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:53.198950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4cdc301-1557-4430-8f8f-28ff3896e26a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:53.199712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4cdc301-1557-4430-8f8f-28ff3896e26a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:53.201406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4cdc301-1557-4430-8f8f-28ff3896e26a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:53.297704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f4cdc301-1557-4430-8f8f-28ff3896e26a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:53.309802 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f4cdc301-1557-4430-8f8f-28ff3896e26a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1280 microversion: 2.1 time: 0.136933 Sep 06 11:18:53.310396 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2673/5397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:53 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1280 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:54.336992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-75a72aeb-ddcf-42c0-a690-f633ddce68e7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:54.337746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-75a72aeb-ddcf-42c0-a690-f633ddce68e7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:54.356023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75a72aeb-ddcf-42c0-a690-f633ddce68e7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:54.357400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75a72aeb-ddcf-42c0-a690-f633ddce68e7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:54.364111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75a72aeb-ddcf-42c0-a690-f633ddce68e7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:54.365747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75a72aeb-ddcf-42c0-a690-f633ddce68e7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:54.371648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75a72aeb-ddcf-42c0-a690-f633ddce68e7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:54.372202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75a72aeb-ddcf-42c0-a690-f633ddce68e7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:54.525324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-75a72aeb-ddcf-42c0-a690-f633ddce68e7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:54.534322 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-75a72aeb-ddcf-42c0-a690-f633ddce68e7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1286 microversion: 2.1 time: 0.202493 Sep 06 11:18:54.542099 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2725/5398] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:54 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1286 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:55.564940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e38d036e-60e3-44f3-9963-cd74c38579a6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:55.566287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e38d036e-60e3-44f3-9963-cd74c38579a6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:55.576459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e38d036e-60e3-44f3-9963-cd74c38579a6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:55.577339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e38d036e-60e3-44f3-9963-cd74c38579a6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:55.578282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e38d036e-60e3-44f3-9963-cd74c38579a6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:55.579433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e38d036e-60e3-44f3-9963-cd74c38579a6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:55.582782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e38d036e-60e3-44f3-9963-cd74c38579a6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:55.582782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e38d036e-60e3-44f3-9963-cd74c38579a6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:55.973775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e38d036e-60e3-44f3-9963-cd74c38579a6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:55.989954 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e38d036e-60e3-44f3-9963-cd74c38579a6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1328 microversion: 2.1 time: 0.429987 Sep 06 11:18:55.990566 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2674/5399] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:55 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1328 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:56.545345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-2bc2b281-a025-4848-84f6-8a2db2109555 req-a9afe740-2acd-429f-bf21-15a7dfc7d32b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "517663b7-ab94-4393-9fb3-8b51c26159a1", "tag": "ec576c63-73ea-47a2-bc4a-6e0f1a93abf6"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:18:56.560049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2bc2b281-a025-4848-84f6-8a2db2109555 req-a9afe740-2acd-429f-bf21-15a7dfc7d32b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:56.560854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2bc2b281-a025-4848-84f6-8a2db2109555 req-a9afe740-2acd-429f-bf21-15a7dfc7d32b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:56.561627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2bc2b281-a025-4848-84f6-8a2db2109555 req-a9afe740-2acd-429f-bf21-15a7dfc7d32b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:56.578966 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-2bc2b281-a025-4848-84f6-8a2db2109555 req-a9afe740-2acd-429f-bf21-15a7dfc7d32b service nova] Creating event network-changed:ec576c63-73ea-47a2-bc4a-6e0f1a93abf6 for instance 517663b7-ab94-4393-9fb3-8b51c26159a1 on nch1-master-1 Sep 06 11:18:56.586833 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-2bc2b281-a025-4848-84f6-8a2db2109555 req-a9afe740-2acd-429f-bf21-15a7dfc7d32b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050248 Sep 06 11:18:56.589035 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2726/5400] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:18:57.014467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7a57ad8e-dd4c-47b8-ba24-6bc386f76764 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:57.015046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7a57ad8e-dd4c-47b8-ba24-6bc386f76764 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:57.023081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a57ad8e-dd4c-47b8-ba24-6bc386f76764 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:57.027414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a57ad8e-dd4c-47b8-ba24-6bc386f76764 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:57.027414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a57ad8e-dd4c-47b8-ba24-6bc386f76764 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:57.027414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a57ad8e-dd4c-47b8-ba24-6bc386f76764 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:57.027414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a57ad8e-dd4c-47b8-ba24-6bc386f76764 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:57.027414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a57ad8e-dd4c-47b8-ba24-6bc386f76764 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:57.318851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7a57ad8e-dd4c-47b8-ba24-6bc386f76764 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:57.339884 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7a57ad8e-dd4c-47b8-ba24-6bc386f76764 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1328 microversion: 2.1 time: 0.330108 Sep 06 11:18:57.340918 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2675/5401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:57 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1328 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:58.373244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-64500afa-232a-487c-bd62-ca2becb6e522 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:58.377056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-64500afa-232a-487c-bd62-ca2becb6e522 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:58.392037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64500afa-232a-487c-bd62-ca2becb6e522 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:58.393246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64500afa-232a-487c-bd62-ca2becb6e522 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:58.394295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64500afa-232a-487c-bd62-ca2becb6e522 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:58.396028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64500afa-232a-487c-bd62-ca2becb6e522 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:58.397112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64500afa-232a-487c-bd62-ca2becb6e522 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:58.398101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64500afa-232a-487c-bd62-ca2becb6e522 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:58.646431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-64500afa-232a-487c-bd62-ca2becb6e522 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:58.656050 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-64500afa-232a-487c-bd62-ca2becb6e522 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1328 microversion: 2.1 time: 0.295002 Sep 06 11:18:58.657024 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2727/5402] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:58 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1328 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:18:59.682314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9820511d-3431-4253-9536-d1e72eae5b1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:18:59.683795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9820511d-3431-4253-9536-d1e72eae5b1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:18:59.693320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9820511d-3431-4253-9536-d1e72eae5b1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:59.693897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9820511d-3431-4253-9536-d1e72eae5b1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:59.694600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9820511d-3431-4253-9536-d1e72eae5b1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:59.695193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9820511d-3431-4253-9536-d1e72eae5b1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:18:59.695685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9820511d-3431-4253-9536-d1e72eae5b1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:18:59.696299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9820511d-3431-4253-9536-d1e72eae5b1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:18:59.893590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9820511d-3431-4253-9536-d1e72eae5b1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:18:59.915969 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9820511d-3431-4253-9536-d1e72eae5b1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1328 microversion: 2.1 time: 0.239173 Sep 06 11:18:59.917443 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2676/5403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:18:59 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1328 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:00.942003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0758741f-8b17-436d-8fee-fe93b8fbae81 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:00.942848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0758741f-8b17-436d-8fee-fe93b8fbae81 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:00.952622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:00.956956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0758741f-8b17-436d-8fee-fe93b8fbae81 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:00.960789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0758741f-8b17-436d-8fee-fe93b8fbae81 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:00.960789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0758741f-8b17-436d-8fee-fe93b8fbae81 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:00.972879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0758741f-8b17-436d-8fee-fe93b8fbae81 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:00.973315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0758741f-8b17-436d-8fee-fe93b8fbae81 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:00.974482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0758741f-8b17-436d-8fee-fe93b8fbae81 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:01.225192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0758741f-8b17-436d-8fee-fe93b8fbae81 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:01.236590 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0758741f-8b17-436d-8fee-fe93b8fbae81 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1328 microversion: 2.1 time: 0.298666 Sep 06 11:19:01.238159 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2728/5404] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:00 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1328 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:02.262642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e23cf708-2ccd-4650-a9cb-c699bc800b16 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:02.263517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e23cf708-2ccd-4650-a9cb-c699bc800b16 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:02.266541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:02.278680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e23cf708-2ccd-4650-a9cb-c699bc800b16 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:02.279776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e23cf708-2ccd-4650-a9cb-c699bc800b16 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:02.280500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e23cf708-2ccd-4650-a9cb-c699bc800b16 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:02.281499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e23cf708-2ccd-4650-a9cb-c699bc800b16 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:02.282179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e23cf708-2ccd-4650-a9cb-c699bc800b16 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:02.282846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e23cf708-2ccd-4650-a9cb-c699bc800b16 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:02.517402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e23cf708-2ccd-4650-a9cb-c699bc800b16 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:02.529220 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e23cf708-2ccd-4650-a9cb-c699bc800b16 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1328 microversion: 2.1 time: 0.271041 Sep 06 11:19:02.530004 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2677/5405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:02 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1328 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:03.553110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ce4c8ea3-068f-424a-bee3-799ea620e847 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:03.554617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ce4c8ea3-068f-424a-bee3-799ea620e847 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:03.558066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:03.564313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce4c8ea3-068f-424a-bee3-799ea620e847 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:03.564822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce4c8ea3-068f-424a-bee3-799ea620e847 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:03.565268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce4c8ea3-068f-424a-bee3-799ea620e847 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:03.566056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce4c8ea3-068f-424a-bee3-799ea620e847 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:03.566699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce4c8ea3-068f-424a-bee3-799ea620e847 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:03.567203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce4c8ea3-068f-424a-bee3-799ea620e847 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:03.751785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce4c8ea3-068f-424a-bee3-799ea620e847 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:03.762256 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ce4c8ea3-068f-424a-bee3-799ea620e847 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1328 microversion: 2.1 time: 0.213164 Sep 06 11:19:03.764938 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2729/5406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:03 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1328 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:03.897285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-65472b6b-e0eb-4373-a4d3-a83a86094265 req-d7caf3b1-c6ca-483a-8a4a-456b41a77207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "517663b7-ab94-4393-9fb3-8b51c26159a1", "name": "network-vif-plugged", "status": "completed", "tag": "ec576c63-73ea-47a2-bc4a-6e0f1a93abf6"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:03.924811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-65472b6b-e0eb-4373-a4d3-a83a86094265 req-d7caf3b1-c6ca-483a-8a4a-456b41a77207 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:03.926620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-65472b6b-e0eb-4373-a4d3-a83a86094265 req-d7caf3b1-c6ca-483a-8a4a-456b41a77207 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:03.927228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-65472b6b-e0eb-4373-a4d3-a83a86094265 req-d7caf3b1-c6ca-483a-8a4a-456b41a77207 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:03.940653 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-65472b6b-e0eb-4373-a4d3-a83a86094265 req-d7caf3b1-c6ca-483a-8a4a-456b41a77207 service nova] Creating event network-vif-plugged:ec576c63-73ea-47a2-bc4a-6e0f1a93abf6 for instance 517663b7-ab94-4393-9fb3-8b51c26159a1 on nch1-master-1 Sep 06 11:19:03.946688 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-65472b6b-e0eb-4373-a4d3-a83a86094265 req-d7caf3b1-c6ca-483a-8a4a-456b41a77207 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056972 Sep 06 11:19:03.947557 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2678/5407] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:19:04.793422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-986b851c-7d75-4750-837d-9e1b81328d66 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:04.796318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-986b851c-7d75-4750-837d-9e1b81328d66 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:04.807935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-986b851c-7d75-4750-837d-9e1b81328d66 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:04.808683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-986b851c-7d75-4750-837d-9e1b81328d66 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:04.809275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-986b851c-7d75-4750-837d-9e1b81328d66 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:04.810372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-986b851c-7d75-4750-837d-9e1b81328d66 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:04.811253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-986b851c-7d75-4750-837d-9e1b81328d66 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:04.811842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-986b851c-7d75-4750-837d-9e1b81328d66 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:04.830928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=83 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:05.065546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-986b851c-7d75-4750-837d-9e1b81328d66 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:05.077170 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-986b851c-7d75-4750-837d-9e1b81328d66 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1328 microversion: 2.1 time: 0.287961 Sep 06 11:19:05.077170 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2730/5408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:04 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1328 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:06.103972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ef69630a-dc5f-4da6-a6c4-a764585313f2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:06.105385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ef69630a-dc5f-4da6-a6c4-a764585313f2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:06.108558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:06.114927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef69630a-dc5f-4da6-a6c4-a764585313f2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:06.115462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef69630a-dc5f-4da6-a6c4-a764585313f2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:06.115912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef69630a-dc5f-4da6-a6c4-a764585313f2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:06.116637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef69630a-dc5f-4da6-a6c4-a764585313f2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:06.117111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef69630a-dc5f-4da6-a6c4-a764585313f2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:06.117553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ef69630a-dc5f-4da6-a6c4-a764585313f2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:06.300986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ef69630a-dc5f-4da6-a6c4-a764585313f2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:06.314918 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ef69630a-dc5f-4da6-a6c4-a764585313f2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1509 microversion: 2.1 time: 0.216640 Sep 06 11:19:06.315891 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2679/5409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:06 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:06.341725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-13eb7ce1-211a-4ab9-b735-1bcaa25efcb8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:06.343547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-13eb7ce1-211a-4ab9-b735-1bcaa25efcb8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:06.352220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13eb7ce1-211a-4ab9-b735-1bcaa25efcb8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:06.352813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13eb7ce1-211a-4ab9-b735-1bcaa25efcb8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:06.353474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13eb7ce1-211a-4ab9-b735-1bcaa25efcb8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:06.354322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13eb7ce1-211a-4ab9-b735-1bcaa25efcb8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:06.354788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13eb7ce1-211a-4ab9-b735-1bcaa25efcb8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:06.355460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13eb7ce1-211a-4ab9-b735-1bcaa25efcb8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:06.519392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-13eb7ce1-211a-4ab9-b735-1bcaa25efcb8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:06.529382 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-13eb7ce1-211a-4ab9-b735-1bcaa25efcb8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1509 microversion: 2.1 time: 0.192738 Sep 06 11:19:06.530499 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2731/5410] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:06 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:06.555292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56382fa1-9fe4-4554-9ed1-64ed2d20428f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:06.556190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56382fa1-9fe4-4554-9ed1-64ed2d20428f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:06.563764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56382fa1-9fe4-4554-9ed1-64ed2d20428f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:06.564768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56382fa1-9fe4-4554-9ed1-64ed2d20428f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:06.569900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56382fa1-9fe4-4554-9ed1-64ed2d20428f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:06.569900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56382fa1-9fe4-4554-9ed1-64ed2d20428f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:06.569900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56382fa1-9fe4-4554-9ed1-64ed2d20428f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:06.569900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56382fa1-9fe4-4554-9ed1-64ed2d20428f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:06.606090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56382fa1-9fe4-4554-9ed1-64ed2d20428f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:19:07.126540 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56382fa1-9fe4-4554-9ed1-64ed2d20428f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 204 len: 0 microversion: 2.1 time: 0.577167 Sep 06 11:19:07.128458 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2680/5411] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:19:06 2022] DELETE /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:19:07.136252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e4c54b3b-695c-4efa-81a4-baa2a1c730df tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:07.137024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e4c54b3b-695c-4efa-81a4-baa2a1c730df tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:07.144223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4c54b3b-695c-4efa-81a4-baa2a1c730df tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:07.144869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4c54b3b-695c-4efa-81a4-baa2a1c730df tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:07.149138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4c54b3b-695c-4efa-81a4-baa2a1c730df tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:07.150876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4c54b3b-695c-4efa-81a4-baa2a1c730df tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:07.151580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4c54b3b-695c-4efa-81a4-baa2a1c730df tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:07.152112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4c54b3b-695c-4efa-81a4-baa2a1c730df tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:07.440202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e4c54b3b-695c-4efa-81a4-baa2a1c730df tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:07.448219 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e4c54b3b-695c-4efa-81a4-baa2a1c730df tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1515 microversion: 2.1 time: 0.316086 Sep 06 11:19:07.448820 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2732/5412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:07 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1515 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:08.472522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f8824360-08de-4ac4-b4ac-87d9e30a6e64 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:08.474594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f8824360-08de-4ac4-b4ac-87d9e30a6e64 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:08.488885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8824360-08de-4ac4-b4ac-87d9e30a6e64 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:08.489845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8824360-08de-4ac4-b4ac-87d9e30a6e64 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:08.490514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8824360-08de-4ac4-b4ac-87d9e30a6e64 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:08.491589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8824360-08de-4ac4-b4ac-87d9e30a6e64 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:08.492498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8824360-08de-4ac4-b4ac-87d9e30a6e64 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:08.493088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8824360-08de-4ac4-b4ac-87d9e30a6e64 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:08.779127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f8824360-08de-4ac4-b4ac-87d9e30a6e64 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:08.794088 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f8824360-08de-4ac4-b4ac-87d9e30a6e64 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1515 microversion: 2.1 time: 0.326332 Sep 06 11:19:08.797340 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2681/5413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:08 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1515 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:09.180001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-15f06f22-e497-4024-a031-bebbac5758fc req-4a2f6fe1-e530-46cd-a381-4c759e966b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "517663b7-ab94-4393-9fb3-8b51c26159a1", "name": "network-vif-deleted", "tag": "ec576c63-73ea-47a2-bc4a-6e0f1a93abf6"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:09.218027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-15f06f22-e497-4024-a031-bebbac5758fc req-4a2f6fe1-e530-46cd-a381-4c759e966b47 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:09.218822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-15f06f22-e497-4024-a031-bebbac5758fc req-4a2f6fe1-e530-46cd-a381-4c759e966b47 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:09.222280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-15f06f22-e497-4024-a031-bebbac5758fc req-4a2f6fe1-e530-46cd-a381-4c759e966b47 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:09.248929 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-15f06f22-e497-4024-a031-bebbac5758fc req-4a2f6fe1-e530-46cd-a381-4c759e966b47 service nova] Creating event network-vif-deleted:ec576c63-73ea-47a2-bc4a-6e0f1a93abf6 for instance 517663b7-ab94-4393-9fb3-8b51c26159a1 on nch1-master-1 Sep 06 11:19:09.257695 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-15f06f22-e497-4024-a031-bebbac5758fc req-4a2f6fe1-e530-46cd-a381-4c759e966b47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081964 Sep 06 11:19:09.262157 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2733/5414] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:19:09.824606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:09.825943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:09.851428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:09.851428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:09.854686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:09.855859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:09.857308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:09.858060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:09.898500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:09.899656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:09.900309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:09.900791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lazy-loading 'fault' on Instance uuid 517663b7-ab94-4393-9fb3-8b51c26159a1 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:19:09.978803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:09.987119 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ca7bd6e-740b-4088-a8d0-90b5b5ce264d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 200 len: 1318 microversion: 2.1 time: 0.170785 Sep 06 11:19:09.987724 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2682/5415] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:09 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:11.017834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81bd6f1b-73e5-44dc-a120-10f375e485f0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:11.018561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-81bd6f1b-73e5-44dc-a120-10f375e485f0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:11.029190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81bd6f1b-73e5-44dc-a120-10f375e485f0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:11.029190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81bd6f1b-73e5-44dc-a120-10f375e485f0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:11.029190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81bd6f1b-73e5-44dc-a120-10f375e485f0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:11.029190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81bd6f1b-73e5-44dc-a120-10f375e485f0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:11.029190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81bd6f1b-73e5-44dc-a120-10f375e485f0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:11.029190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-81bd6f1b-73e5-44dc-a120-10f375e485f0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:11.044409 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-81bd6f1b-73e5-44dc-a120-10f375e485f0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81bd6f1b-73e5-44dc-a120-10f375e485f0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 HTTP/1.1 Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '517663b7-ab94-4393-9fb3-8b51c26159a1'} Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:19:11.046235 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:19:11.061459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:19:11.061459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:19:11.061459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:19:11.061459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:19:11.061459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:19:11.061459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:19:11.061459 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:19:11.061459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-81bd6f1b-73e5-44dc-a120-10f375e485f0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:19:11.061459 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-81bd6f1b-73e5-44dc-a120-10f375e485f0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 404 len: 111 microversion: 2.1 time: 0.039477 Sep 06 11:19:11.061459 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2734/5416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:11 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:19:11.070186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-115590b0-6365-455f-8933-af30d91d75ce tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '.version_select at 0x7f90f3766310>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:11.151579 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-115590b0-6365-455f-8933-af30d91d75ce tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-key-798459394" status: 202 len: 0 microversion: 2.1 time: 0.087138 Sep 06 11:19:11.152451 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2683/5417] 10.222.0.20 () {58 vars in 1206 bytes} [Tue Sep 6 11:19:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-798459394 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:19:11.307119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1481555504", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "74ae681a-5964-499e-a86a-13cffa0cf1b0"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:11.384900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] validate_networks() for [('74ae681a-5964-499e-a86a-13cffa0cf1b0', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:19:11.653794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ae606f9-a3ab-474d-bf4f-504449572f37 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:11.654572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ae606f9-a3ab-474d-bf4f-504449572f37 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:11.662665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ae606f9-a3ab-474d-bf4f-504449572f37 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:11.663209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ae606f9-a3ab-474d-bf4f-504449572f37 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:11.665718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ae606f9-a3ab-474d-bf4f-504449572f37 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:11.665718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ae606f9-a3ab-474d-bf4f-504449572f37 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:11.665718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ae606f9-a3ab-474d-bf4f-504449572f37 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:11.665718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ae606f9-a3ab-474d-bf4f-504449572f37 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:11.694450 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ae606f9-a3ab-474d-bf4f-504449572f37 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/ips" status: 200 len: 151 microversion: 2.20 time: 0.044649 Sep 06 11:19:11.695087 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2684/5418] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Sep 6 11:19:11 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:19:12.011725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:19:12.012726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:19:12.013379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:19:12.014226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:19:12.015366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:19:12.026432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:12.032644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:12.032644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:12.032644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:12.032644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:12.032644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:12.050369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:19:12.063576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for user acce3e06ce4d40ba8db7988456cf8787 and project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:19:12.080478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:19:12.084095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:19:12.290661 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cb050fb3-13d5-4a79-9eea-4cd4a15fced6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996756 Sep 06 11:19:12.292022 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2735/5419] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:19:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:19:12.304845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-85c379bb-c244-446c-8bfa-019b5d3b2dcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:12.306639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-85c379bb-c244-446c-8bfa-019b5d3b2dcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:12.373341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-85c379bb-c244-446c-8bfa-019b5d3b2dcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:12.385898 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-85c379bb-c244-446c-8bfa-019b5d3b2dcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1209 microversion: 2.1 time: 0.085737 Sep 06 11:19:12.389056 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2685/5420] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:12 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:13.417396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-91c38112-5713-4bc3-885d-003d458c6fd5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:13.418124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-91c38112-5713-4bc3-885d-003d458c6fd5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:13.421516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:13.484582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-91c38112-5713-4bc3-885d-003d458c6fd5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:13.491511 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-91c38112-5713-4bc3-885d-003d458c6fd5 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1209 microversion: 2.1 time: 0.079241 Sep 06 11:19:13.492115 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2736/5421] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:13 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1209 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:14.516077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-476abd95-b216-4130-94bb-78a5afccbde3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:14.516988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-476abd95-b216-4130-94bb-78a5afccbde3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:14.525012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-476abd95-b216-4130-94bb-78a5afccbde3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:14.525603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-476abd95-b216-4130-94bb-78a5afccbde3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:14.526150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-476abd95-b216-4130-94bb-78a5afccbde3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:14.526974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-476abd95-b216-4130-94bb-78a5afccbde3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:14.527565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-476abd95-b216-4130-94bb-78a5afccbde3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:14.528070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-476abd95-b216-4130-94bb-78a5afccbde3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:14.601585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-476abd95-b216-4130-94bb-78a5afccbde3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:14.611047 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-476abd95-b216-4130-94bb-78a5afccbde3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1205 microversion: 2.1 time: 0.098972 Sep 06 11:19:14.611683 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2686/5422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:14 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1205 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:15.287520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f995fb9c-d935-401e-a1c2-33a2026d6002 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:15.288348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f995fb9c-d935-401e-a1c2-33a2026d6002 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:15.296867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f995fb9c-d935-401e-a1c2-33a2026d6002 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:15.298071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f995fb9c-d935-401e-a1c2-33a2026d6002 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:15.298560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f995fb9c-d935-401e-a1c2-33a2026d6002 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:15.299485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f995fb9c-d935-401e-a1c2-33a2026d6002 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:15.312078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f995fb9c-d935-401e-a1c2-33a2026d6002 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:15.312404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f995fb9c-d935-401e-a1c2-33a2026d6002 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:15.342195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-f995fb9c-d935-401e-a1c2-33a2026d6002 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lazy-loading 'flavor' on Instance uuid 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:19:15.636414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bb84bde2-282f-4cc7-918d-855e33665750 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:15.638962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bb84bde2-282f-4cc7-918d-855e33665750 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:15.646822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb84bde2-282f-4cc7-918d-855e33665750 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:15.649083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb84bde2-282f-4cc7-918d-855e33665750 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:15.649083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb84bde2-282f-4cc7-918d-855e33665750 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:15.649083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb84bde2-282f-4cc7-918d-855e33665750 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:15.649383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb84bde2-282f-4cc7-918d-855e33665750 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:15.649867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb84bde2-282f-4cc7-918d-855e33665750 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:15.775050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bb84bde2-282f-4cc7-918d-855e33665750 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:15.789395 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bb84bde2-282f-4cc7-918d-855e33665750 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1267 microversion: 2.1 time: 0.152183 Sep 06 11:19:15.800253 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2687/5423] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:15 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:19:15.884074 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f995fb9c-d935-401e-a1c2-33a2026d6002 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "POST /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/action" status: 202 len: 0 microversion: 2.20 time: 0.600994 Sep 06 11:19:15.887393 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2737/5424] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:19:15 2022] POST /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:19:15.896738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-33e3ed76-5ad2-4738-864b-7664d7f47447 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:15.897554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-33e3ed76-5ad2-4738-864b-7664d7f47447 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:15.913669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33e3ed76-5ad2-4738-864b-7664d7f47447 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:15.924249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33e3ed76-5ad2-4738-864b-7664d7f47447 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:15.924899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33e3ed76-5ad2-4738-864b-7664d7f47447 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:15.926567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33e3ed76-5ad2-4738-864b-7664d7f47447 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:15.927329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33e3ed76-5ad2-4738-864b-7664d7f47447 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:15.928092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33e3ed76-5ad2-4738-864b-7664d7f47447 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:16.562633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-33e3ed76-5ad2-4738-864b-7664d7f47447 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:16.583276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-33e3ed76-5ad2-4738-864b-7664d7f47447 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:16.589458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-33e3ed76-5ad2-4738-864b-7664d7f47447 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:16.592266 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-33e3ed76-5ad2-4738-864b-7664d7f47447 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1720 microversion: 2.20 time: 0.699581 Sep 06 11:19:16.608388 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2688/5425] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:15 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1720 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:16.819206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6e14d818-243c-43ca-8719-1e14f8815356 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:16.821266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6e14d818-243c-43ca-8719-1e14f8815356 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:16.845004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e14d818-243c-43ca-8719-1e14f8815356 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:16.846099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e14d818-243c-43ca-8719-1e14f8815356 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:16.846834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e14d818-243c-43ca-8719-1e14f8815356 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:16.848169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e14d818-243c-43ca-8719-1e14f8815356 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:16.848810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e14d818-243c-43ca-8719-1e14f8815356 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:16.849557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6e14d818-243c-43ca-8719-1e14f8815356 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:17.065167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6e14d818-243c-43ca-8719-1e14f8815356 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:17.080393 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6e14d818-243c-43ca-8719-1e14f8815356 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1309 microversion: 2.1 time: 0.269786 Sep 06 11:19:17.089239 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2738/5426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:16 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:17.623374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-974770a4-b5da-4756-9176-ef2a0dcbdd8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:17.624759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-974770a4-b5da-4756-9176-ef2a0dcbdd8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:17.633390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-974770a4-b5da-4756-9176-ef2a0dcbdd8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:17.634221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-974770a4-b5da-4756-9176-ef2a0dcbdd8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:17.634918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-974770a4-b5da-4756-9176-ef2a0dcbdd8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:17.636196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-974770a4-b5da-4756-9176-ef2a0dcbdd8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:17.636971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-974770a4-b5da-4756-9176-ef2a0dcbdd8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:17.637478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-974770a4-b5da-4756-9176-ef2a0dcbdd8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:17.820919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-974770a4-b5da-4756-9176-ef2a0dcbdd8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:17.844548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-974770a4-b5da-4756-9176-ef2a0dcbdd8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:17.851935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-974770a4-b5da-4756-9176-ef2a0dcbdd8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:17.855987 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-974770a4-b5da-4756-9176-ef2a0dcbdd8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1720 microversion: 2.20 time: 0.238518 Sep 06 11:19:17.868630 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2689/5427] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:17 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:18.109097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bf10a66e-b5ba-4a5f-9c73-9d151eba0655 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:18.110230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bf10a66e-b5ba-4a5f-9c73-9d151eba0655 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:18.119738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf10a66e-b5ba-4a5f-9c73-9d151eba0655 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:18.120240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf10a66e-b5ba-4a5f-9c73-9d151eba0655 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:18.122243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf10a66e-b5ba-4a5f-9c73-9d151eba0655 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:18.122243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf10a66e-b5ba-4a5f-9c73-9d151eba0655 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:18.122243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf10a66e-b5ba-4a5f-9c73-9d151eba0655 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:18.126200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf10a66e-b5ba-4a5f-9c73-9d151eba0655 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:18.393711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bf10a66e-b5ba-4a5f-9c73-9d151eba0655 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:18.402602 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bf10a66e-b5ba-4a5f-9c73-9d151eba0655 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1309 microversion: 2.1 time: 0.302491 Sep 06 11:19:18.403831 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2739/5428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:18 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1309 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:18.688436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ca240ab5-7bb8-454d-b85f-ad38e591c02a req-db312cfb-15e3-4201-8285-05ffdca9f5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "631cc084-8ba7-4eb4-b496-684698dded7e", "tag": "f0c8bf96-c715-4888-b2ec-9db93056e2fe"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:18.708743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ca240ab5-7bb8-454d-b85f-ad38e591c02a req-db312cfb-15e3-4201-8285-05ffdca9f5d4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:18.709552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ca240ab5-7bb8-454d-b85f-ad38e591c02a req-db312cfb-15e3-4201-8285-05ffdca9f5d4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:18.710166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ca240ab5-7bb8-454d-b85f-ad38e591c02a req-db312cfb-15e3-4201-8285-05ffdca9f5d4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:18.723799 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ca240ab5-7bb8-454d-b85f-ad38e591c02a req-db312cfb-15e3-4201-8285-05ffdca9f5d4 service nova] Creating event network-changed:f0c8bf96-c715-4888-b2ec-9db93056e2fe for instance 631cc084-8ba7-4eb4-b496-684698dded7e on nch1-master-1 Sep 06 11:19:18.730218 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ca240ab5-7bb8-454d-b85f-ad38e591c02a req-db312cfb-15e3-4201-8285-05ffdca9f5d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045652 Sep 06 11:19:18.731473 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2690/5429] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:19:18.896573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-72ee769d-ee8d-4a90-93e8-af5fabbb7467 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:18.897471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-72ee769d-ee8d-4a90-93e8-af5fabbb7467 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:18.904931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72ee769d-ee8d-4a90-93e8-af5fabbb7467 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:18.914246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72ee769d-ee8d-4a90-93e8-af5fabbb7467 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:18.914246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72ee769d-ee8d-4a90-93e8-af5fabbb7467 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:18.914246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72ee769d-ee8d-4a90-93e8-af5fabbb7467 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:18.914246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72ee769d-ee8d-4a90-93e8-af5fabbb7467 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:18.914246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72ee769d-ee8d-4a90-93e8-af5fabbb7467 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:19.073555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-72ee769d-ee8d-4a90-93e8-af5fabbb7467 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:19.084433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-72ee769d-ee8d-4a90-93e8-af5fabbb7467 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:19.086015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-72ee769d-ee8d-4a90-93e8-af5fabbb7467 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:19.087386 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-72ee769d-ee8d-4a90-93e8-af5fabbb7467 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1720 microversion: 2.20 time: 0.195758 Sep 06 11:19:19.088190 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2740/5430] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:18 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:19.428021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-38013abe-8166-4fe9-80f4-f4baa789be1b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:19.429051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-38013abe-8166-4fe9-80f4-f4baa789be1b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:19.436185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38013abe-8166-4fe9-80f4-f4baa789be1b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:19.437109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38013abe-8166-4fe9-80f4-f4baa789be1b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:19.437729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38013abe-8166-4fe9-80f4-f4baa789be1b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:19.438708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38013abe-8166-4fe9-80f4-f4baa789be1b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:19.439398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38013abe-8166-4fe9-80f4-f4baa789be1b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:19.439995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-38013abe-8166-4fe9-80f4-f4baa789be1b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:19.445642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:19.834567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-38013abe-8166-4fe9-80f4-f4baa789be1b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:19.851170 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-38013abe-8166-4fe9-80f4-f4baa789be1b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1309 microversion: 2.1 time: 0.423044 Sep 06 11:19:19.851170 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2691/5431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:19 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1309 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:20.116116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c7743cbd-5534-450b-ac6d-add9b76171f4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:20.118814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c7743cbd-5534-450b-ac6d-add9b76171f4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:20.129932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7743cbd-5534-450b-ac6d-add9b76171f4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:20.130645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7743cbd-5534-450b-ac6d-add9b76171f4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:20.131325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7743cbd-5534-450b-ac6d-add9b76171f4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:20.132269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7743cbd-5534-450b-ac6d-add9b76171f4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:20.132884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7743cbd-5534-450b-ac6d-add9b76171f4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:20.133564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c7743cbd-5534-450b-ac6d-add9b76171f4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:20.317973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c7743cbd-5534-450b-ac6d-add9b76171f4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:20.327506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c7743cbd-5534-450b-ac6d-add9b76171f4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:20.329036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c7743cbd-5534-450b-ac6d-add9b76171f4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:20.330230 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c7743cbd-5534-450b-ac6d-add9b76171f4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1720 microversion: 2.20 time: 0.219431 Sep 06 11:19:20.330805 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2741/5432] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:20 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:20.874845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-262736f0-4530-42d9-812e-f7c416da985d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:20.875489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-262736f0-4530-42d9-812e-f7c416da985d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:20.885242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-262736f0-4530-42d9-812e-f7c416da985d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:20.885769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-262736f0-4530-42d9-812e-f7c416da985d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:20.886219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-262736f0-4530-42d9-812e-f7c416da985d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:20.886937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-262736f0-4530-42d9-812e-f7c416da985d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:20.887424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-262736f0-4530-42d9-812e-f7c416da985d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:20.887888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-262736f0-4530-42d9-812e-f7c416da985d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:21.046158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-262736f0-4530-42d9-812e-f7c416da985d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:21.056167 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-262736f0-4530-42d9-812e-f7c416da985d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1309 microversion: 2.1 time: 0.185661 Sep 06 11:19:21.056795 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2692/5433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:20 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1309 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:19:21.361121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7d85f09e-5cdd-4a70-b9b0-8cd481190f4e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:21.362801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7d85f09e-5cdd-4a70-b9b0-8cd481190f4e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:21.374904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d85f09e-5cdd-4a70-b9b0-8cd481190f4e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:21.381345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d85f09e-5cdd-4a70-b9b0-8cd481190f4e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:21.381345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d85f09e-5cdd-4a70-b9b0-8cd481190f4e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:21.381345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d85f09e-5cdd-4a70-b9b0-8cd481190f4e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:21.381345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d85f09e-5cdd-4a70-b9b0-8cd481190f4e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:21.381345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d85f09e-5cdd-4a70-b9b0-8cd481190f4e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:21.625320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d85f09e-5cdd-4a70-b9b0-8cd481190f4e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:21.635770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d85f09e-5cdd-4a70-b9b0-8cd481190f4e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:21.642331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d85f09e-5cdd-4a70-b9b0-8cd481190f4e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:21.644004 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7d85f09e-5cdd-4a70-b9b0-8cd481190f4e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1720 microversion: 2.20 time: 0.290704 Sep 06 11:19:21.645648 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2742/5434] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:21 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1720 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:22.086817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e2afd8a5-2f69-4fdd-9fdd-f3d860e88589 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:22.087237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e2afd8a5-2f69-4fdd-9fdd-f3d860e88589 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:22.096737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2afd8a5-2f69-4fdd-9fdd-f3d860e88589 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:22.097515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2afd8a5-2f69-4fdd-9fdd-f3d860e88589 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:22.097678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2afd8a5-2f69-4fdd-9fdd-f3d860e88589 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:22.098666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2afd8a5-2f69-4fdd-9fdd-f3d860e88589 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:22.099746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2afd8a5-2f69-4fdd-9fdd-f3d860e88589 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:22.100347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2afd8a5-2f69-4fdd-9fdd-f3d860e88589 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:22.283334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e2afd8a5-2f69-4fdd-9fdd-f3d860e88589 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:22.292288 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e2afd8a5-2f69-4fdd-9fdd-f3d860e88589 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1309 microversion: 2.1 time: 0.214554 Sep 06 11:19:22.294569 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2693/5435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:22 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1309 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:22.671917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-19643360-2ed1-4ab8-a72f-eaa17840adfe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:22.672850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-19643360-2ed1-4ab8-a72f-eaa17840adfe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:22.675064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:22.681958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19643360-2ed1-4ab8-a72f-eaa17840adfe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:22.682536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19643360-2ed1-4ab8-a72f-eaa17840adfe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:22.683094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19643360-2ed1-4ab8-a72f-eaa17840adfe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:22.683915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19643360-2ed1-4ab8-a72f-eaa17840adfe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:22.684450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19643360-2ed1-4ab8-a72f-eaa17840adfe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:22.684889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19643360-2ed1-4ab8-a72f-eaa17840adfe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:22.842917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19643360-2ed1-4ab8-a72f-eaa17840adfe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:22.852732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19643360-2ed1-4ab8-a72f-eaa17840adfe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:22.854198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19643360-2ed1-4ab8-a72f-eaa17840adfe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:22.855555 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-19643360-2ed1-4ab8-a72f-eaa17840adfe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1720 microversion: 2.20 time: 0.188163 Sep 06 11:19:22.856203 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2743/5436] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:22 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:19:23.318110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fceb81e7-c17b-4d1a-b9f5-c80713fc9eea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:23.318933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fceb81e7-c17b-4d1a-b9f5-c80713fc9eea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:23.320698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:23.327344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fceb81e7-c17b-4d1a-b9f5-c80713fc9eea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:23.328576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fceb81e7-c17b-4d1a-b9f5-c80713fc9eea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:23.328576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fceb81e7-c17b-4d1a-b9f5-c80713fc9eea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:23.329075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fceb81e7-c17b-4d1a-b9f5-c80713fc9eea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:23.329543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fceb81e7-c17b-4d1a-b9f5-c80713fc9eea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:23.329982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fceb81e7-c17b-4d1a-b9f5-c80713fc9eea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:23.534092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fceb81e7-c17b-4d1a-b9f5-c80713fc9eea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:23.545798 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fceb81e7-c17b-4d1a-b9f5-c80713fc9eea tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1309 microversion: 2.1 time: 0.231693 Sep 06 11:19:23.546497 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2694/5437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:23 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1309 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:23.893013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-393a3149-a08f-4337-bfc8-0be6dc46ad45 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:23.895749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-393a3149-a08f-4337-bfc8-0be6dc46ad45 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:23.897850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:23.910913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-393a3149-a08f-4337-bfc8-0be6dc46ad45 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:23.911773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-393a3149-a08f-4337-bfc8-0be6dc46ad45 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:23.912421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-393a3149-a08f-4337-bfc8-0be6dc46ad45 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:23.914031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-393a3149-a08f-4337-bfc8-0be6dc46ad45 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:23.914714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-393a3149-a08f-4337-bfc8-0be6dc46ad45 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:23.915383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-393a3149-a08f-4337-bfc8-0be6dc46ad45 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:24.080482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-393a3149-a08f-4337-bfc8-0be6dc46ad45 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:24.091268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-393a3149-a08f-4337-bfc8-0be6dc46ad45 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:24.095921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-393a3149-a08f-4337-bfc8-0be6dc46ad45 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:24.095921 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-393a3149-a08f-4337-bfc8-0be6dc46ad45 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1720 microversion: 2.20 time: 0.208049 Sep 06 11:19:24.095921 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2744/5438] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:23 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:24.570865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-40f5baae-0076-4d30-8730-bf4e921f76d9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:24.571523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-40f5baae-0076-4d30-8730-bf4e921f76d9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:24.580119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40f5baae-0076-4d30-8730-bf4e921f76d9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:24.580629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40f5baae-0076-4d30-8730-bf4e921f76d9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:24.583281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40f5baae-0076-4d30-8730-bf4e921f76d9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:24.583281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40f5baae-0076-4d30-8730-bf4e921f76d9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:24.583281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40f5baae-0076-4d30-8730-bf4e921f76d9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:24.583281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40f5baae-0076-4d30-8730-bf4e921f76d9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:24.726718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-40f5baae-0076-4d30-8730-bf4e921f76d9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:24.735397 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-40f5baae-0076-4d30-8730-bf4e921f76d9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1309 microversion: 2.1 time: 0.169335 Sep 06 11:19:24.736006 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2695/5439] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:24 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1309 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:25.121134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-78191bd7-a816-40f8-ae3b-7c61348ef923 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:25.121835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-78191bd7-a816-40f8-ae3b-7c61348ef923 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:25.131451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-78191bd7-a816-40f8-ae3b-7c61348ef923 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:25.131951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-78191bd7-a816-40f8-ae3b-7c61348ef923 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:25.132398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-78191bd7-a816-40f8-ae3b-7c61348ef923 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:25.133121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-78191bd7-a816-40f8-ae3b-7c61348ef923 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:25.133583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-78191bd7-a816-40f8-ae3b-7c61348ef923 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:25.134016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-78191bd7-a816-40f8-ae3b-7c61348ef923 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:25.292246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-78191bd7-a816-40f8-ae3b-7c61348ef923 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:25.301713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-78191bd7-a816-40f8-ae3b-7c61348ef923 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:25.303546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-78191bd7-a816-40f8-ae3b-7c61348ef923 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:25.304801 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-78191bd7-a816-40f8-ae3b-7c61348ef923 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1720 microversion: 2.20 time: 0.188417 Sep 06 11:19:25.305379 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2745/5440] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:25 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:19:25.600701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-cdc627e0-10ab-4c27-accf-df127f7d8e35 req-ed3d6836-3c59-4533-ba1d-c931f3783c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "631cc084-8ba7-4eb4-b496-684698dded7e", "name": "network-vif-plugged", "status": "completed", "tag": "f0c8bf96-c715-4888-b2ec-9db93056e2fe"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:25.618627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-cdc627e0-10ab-4c27-accf-df127f7d8e35 req-ed3d6836-3c59-4533-ba1d-c931f3783c91 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:25.620890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-cdc627e0-10ab-4c27-accf-df127f7d8e35 req-ed3d6836-3c59-4533-ba1d-c931f3783c91 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:25.622061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-cdc627e0-10ab-4c27-accf-df127f7d8e35 req-ed3d6836-3c59-4533-ba1d-c931f3783c91 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:25.638051 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-cdc627e0-10ab-4c27-accf-df127f7d8e35 req-ed3d6836-3c59-4533-ba1d-c931f3783c91 service nova] Creating event network-vif-plugged:f0c8bf96-c715-4888-b2ec-9db93056e2fe for instance 631cc084-8ba7-4eb4-b496-684698dded7e on nch1-master-1 Sep 06 11:19:25.645347 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-cdc627e0-10ab-4c27-accf-df127f7d8e35 req-ed3d6836-3c59-4533-ba1d-c931f3783c91 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047732 Sep 06 11:19:25.646476 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2696/5441] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:19:25.760848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a10e8b2d-89fd-4042-b9ac-76ebe8bd00dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:25.761777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a10e8b2d-89fd-4042-b9ac-76ebe8bd00dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:25.771622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a10e8b2d-89fd-4042-b9ac-76ebe8bd00dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:25.772552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a10e8b2d-89fd-4042-b9ac-76ebe8bd00dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:25.773225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a10e8b2d-89fd-4042-b9ac-76ebe8bd00dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:25.774067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a10e8b2d-89fd-4042-b9ac-76ebe8bd00dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:25.784016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a10e8b2d-89fd-4042-b9ac-76ebe8bd00dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:25.787963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a10e8b2d-89fd-4042-b9ac-76ebe8bd00dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:25.933714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a10e8b2d-89fd-4042-b9ac-76ebe8bd00dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:25.945877 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a10e8b2d-89fd-4042-b9ac-76ebe8bd00dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1309 microversion: 2.1 time: 0.188594 Sep 06 11:19:25.959152 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2746/5442] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:25 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1309 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:26.330716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-89d650d9-56ab-476a-8b22-66078e727b57 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:26.331512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-89d650d9-56ab-476a-8b22-66078e727b57 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:26.337981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89d650d9-56ab-476a-8b22-66078e727b57 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:26.338479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89d650d9-56ab-476a-8b22-66078e727b57 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:26.338930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89d650d9-56ab-476a-8b22-66078e727b57 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:26.339674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89d650d9-56ab-476a-8b22-66078e727b57 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:26.340148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89d650d9-56ab-476a-8b22-66078e727b57 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:26.340587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89d650d9-56ab-476a-8b22-66078e727b57 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:26.483520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-89d650d9-56ab-476a-8b22-66078e727b57 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:26.499084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-89d650d9-56ab-476a-8b22-66078e727b57 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:26.500573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-89d650d9-56ab-476a-8b22-66078e727b57 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:26.502855 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-89d650d9-56ab-476a-8b22-66078e727b57 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1720 microversion: 2.20 time: 0.175603 Sep 06 11:19:26.502855 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2697/5443] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:26 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:26.974383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2a5f3336-8477-478a-b88f-45726ace582f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:26.975647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2a5f3336-8477-478a-b88f-45726ace582f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:26.984984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a5f3336-8477-478a-b88f-45726ace582f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:26.985489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a5f3336-8477-478a-b88f-45726ace582f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:26.985995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a5f3336-8477-478a-b88f-45726ace582f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:26.986851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a5f3336-8477-478a-b88f-45726ace582f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:26.987296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a5f3336-8477-478a-b88f-45726ace582f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:26.988565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a5f3336-8477-478a-b88f-45726ace582f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:27.189835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2a5f3336-8477-478a-b88f-45726ace582f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:27.195322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:27.202213 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2a5f3336-8477-478a-b88f-45726ace582f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1490 microversion: 2.1 time: 0.235793 Sep 06 11:19:27.203580 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2747/5444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:26 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1490 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:27.344467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1481555504", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "74ae681a-5964-499e-a86a-13cffa0cf1b0"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:27.411050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] validate_networks() for [('74ae681a-5964-499e-a86a-13cffa0cf1b0', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:19:27.528517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1658cd82-ed1e-4243-bb35-5785824718b7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:27.529390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1658cd82-ed1e-4243-bb35-5785824718b7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:27.537688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1658cd82-ed1e-4243-bb35-5785824718b7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:27.538195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1658cd82-ed1e-4243-bb35-5785824718b7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:27.538847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1658cd82-ed1e-4243-bb35-5785824718b7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:27.543198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1658cd82-ed1e-4243-bb35-5785824718b7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:27.543789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1658cd82-ed1e-4243-bb35-5785824718b7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:27.544244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1658cd82-ed1e-4243-bb35-5785824718b7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:27.731352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1658cd82-ed1e-4243-bb35-5785824718b7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:27.753942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1658cd82-ed1e-4243-bb35-5785824718b7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:27.753942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1658cd82-ed1e-4243-bb35-5785824718b7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:27.753942 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1658cd82-ed1e-4243-bb35-5785824718b7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1741 microversion: 2.20 time: 0.223192 Sep 06 11:19:27.753942 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2748/5445] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:27 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:19:28.101110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:19:28.101547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:19:28.102032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:19:28.102483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:19:28.102907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:19:28.113593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:28.114451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:28.114567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:28.115283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:28.115752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:28.116193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:28.136071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:19:28.143138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for user acce3e06ce4d40ba8db7988456cf8787 and project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:19:28.158900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:19:28.162251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:19:28.329542 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6d3026c1-86b5-4fe6-b0a5-6b174d04e4a8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989141 Sep 06 11:19:28.330352 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2698/5446] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:19:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:19:28.342143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f21538b3-62f6-47eb-9713-83091cc7fb0d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:28.342766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f21538b3-62f6-47eb-9713-83091cc7fb0d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:28.420042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f21538b3-62f6-47eb-9713-83091cc7fb0d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:28.427601 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f21538b3-62f6-47eb-9713-83091cc7fb0d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1209 microversion: 2.1 time: 0.089300 Sep 06 11:19:28.428208 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2749/5447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:28 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:28.779276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-be4fd571-5cc7-49df-b287-7359fe5d0d0c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:28.779901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-be4fd571-5cc7-49df-b287-7359fe5d0d0c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:28.786897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be4fd571-5cc7-49df-b287-7359fe5d0d0c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:28.787517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be4fd571-5cc7-49df-b287-7359fe5d0d0c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:28.788064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be4fd571-5cc7-49df-b287-7359fe5d0d0c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:28.789004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be4fd571-5cc7-49df-b287-7359fe5d0d0c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:28.789629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be4fd571-5cc7-49df-b287-7359fe5d0d0c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:28.790226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be4fd571-5cc7-49df-b287-7359fe5d0d0c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:28.962847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-be4fd571-5cc7-49df-b287-7359fe5d0d0c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:28.977531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-be4fd571-5cc7-49df-b287-7359fe5d0d0c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:28.979062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-be4fd571-5cc7-49df-b287-7359fe5d0d0c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:28.980286 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-be4fd571-5cc7-49df-b287-7359fe5d0d0c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1741 microversion: 2.20 time: 0.206122 Sep 06 11:19:28.980857 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2699/5448] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:28 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:29.450232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3524cd3b-3c36-4cfa-a21e-db5b68203c1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:29.450989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3524cd3b-3c36-4cfa-a21e-db5b68203c1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:29.460292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3524cd3b-3c36-4cfa-a21e-db5b68203c1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:29.460986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3524cd3b-3c36-4cfa-a21e-db5b68203c1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:29.461528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3524cd3b-3c36-4cfa-a21e-db5b68203c1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:29.462410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3524cd3b-3c36-4cfa-a21e-db5b68203c1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:29.463120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3524cd3b-3c36-4cfa-a21e-db5b68203c1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:29.464202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3524cd3b-3c36-4cfa-a21e-db5b68203c1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:29.548932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3524cd3b-3c36-4cfa-a21e-db5b68203c1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:29.557847 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3524cd3b-3c36-4cfa-a21e-db5b68203c1e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1213 microversion: 2.1 time: 0.111864 Sep 06 11:19:29.558652 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2750/5449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:29 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:30.009422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-04f174fa-7d4e-4979-b68c-c0ad5a6e74e6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:30.010133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-04f174fa-7d4e-4979-b68c-c0ad5a6e74e6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:30.017730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04f174fa-7d4e-4979-b68c-c0ad5a6e74e6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:30.018321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04f174fa-7d4e-4979-b68c-c0ad5a6e74e6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:30.018991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04f174fa-7d4e-4979-b68c-c0ad5a6e74e6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:30.020002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04f174fa-7d4e-4979-b68c-c0ad5a6e74e6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:30.020561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04f174fa-7d4e-4979-b68c-c0ad5a6e74e6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:30.021070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-04f174fa-7d4e-4979-b68c-c0ad5a6e74e6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:30.212045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-04f174fa-7d4e-4979-b68c-c0ad5a6e74e6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:30.224647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-04f174fa-7d4e-4979-b68c-c0ad5a6e74e6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:30.226526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-04f174fa-7d4e-4979-b68c-c0ad5a6e74e6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:30.227855 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-04f174fa-7d4e-4979-b68c-c0ad5a6e74e6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1736 microversion: 2.20 time: 0.225466 Sep 06 11:19:30.228430 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2700/5450] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:30 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:30.582967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3dbe9b25-1074-4dd8-a838-80bb545e6831 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:30.583654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3dbe9b25-1074-4dd8-a838-80bb545e6831 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:30.599331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3dbe9b25-1074-4dd8-a838-80bb545e6831 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:30.599331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3dbe9b25-1074-4dd8-a838-80bb545e6831 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:30.599331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3dbe9b25-1074-4dd8-a838-80bb545e6831 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:30.599331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3dbe9b25-1074-4dd8-a838-80bb545e6831 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:30.599331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3dbe9b25-1074-4dd8-a838-80bb545e6831 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:30.599331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3dbe9b25-1074-4dd8-a838-80bb545e6831 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:30.699063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3dbe9b25-1074-4dd8-a838-80bb545e6831 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:30.713042 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3dbe9b25-1074-4dd8-a838-80bb545e6831 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1261 microversion: 2.1 time: 0.134941 Sep 06 11:19:30.713820 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2751/5451] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:30 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1261 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:31.263602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9950f80-fc37-44b9-b5a0-c1c96e36df71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:31.267853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c9950f80-fc37-44b9-b5a0-c1c96e36df71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:31.288467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9950f80-fc37-44b9-b5a0-c1c96e36df71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:31.288978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9950f80-fc37-44b9-b5a0-c1c96e36df71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:31.289425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9950f80-fc37-44b9-b5a0-c1c96e36df71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:31.290181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9950f80-fc37-44b9-b5a0-c1c96e36df71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:31.295793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9950f80-fc37-44b9-b5a0-c1c96e36df71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:31.296262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9950f80-fc37-44b9-b5a0-c1c96e36df71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:31.616994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c9950f80-fc37-44b9-b5a0-c1c96e36df71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:31.634632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c9950f80-fc37-44b9-b5a0-c1c96e36df71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:31.639942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c9950f80-fc37-44b9-b5a0-c1c96e36df71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:31.643193 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c9950f80-fc37-44b9-b5a0-c1c96e36df71 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1736 microversion: 2.20 time: 0.390620 Sep 06 11:19:31.644399 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2701/5452] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:31 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1736 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:31.749990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a784dff0-6ba5-47f0-a1a0-1f8b141e79bc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:31.751191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a784dff0-6ba5-47f0-a1a0-1f8b141e79bc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:31.768938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a784dff0-6ba5-47f0-a1a0-1f8b141e79bc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:31.772480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a784dff0-6ba5-47f0-a1a0-1f8b141e79bc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:31.775798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a784dff0-6ba5-47f0-a1a0-1f8b141e79bc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:31.776785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a784dff0-6ba5-47f0-a1a0-1f8b141e79bc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:31.777460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a784dff0-6ba5-47f0-a1a0-1f8b141e79bc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:31.778140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a784dff0-6ba5-47f0-a1a0-1f8b141e79bc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:31.957029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a784dff0-6ba5-47f0-a1a0-1f8b141e79bc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:31.966382 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a784dff0-6ba5-47f0-a1a0-1f8b141e79bc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1279 microversion: 2.1 time: 0.225822 Sep 06 11:19:31.989422 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2752/5453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:31 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1279 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:32.037383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ca99e406-387f-4d86-afec-780102dff3b0 req-298ebf40-c799-4249-b300-dfa8e0b6a116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72fceff4-8a80-43f9-88f2-fd73e1eed3e3", "name": "network-vif-plugged", "status": "completed", "tag": "921e3ee1-fb50-4f0c-80ae-7a517b1fdc23"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:32.056318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ca99e406-387f-4d86-afec-780102dff3b0 req-298ebf40-c799-4249-b300-dfa8e0b6a116 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:32.059462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ca99e406-387f-4d86-afec-780102dff3b0 req-298ebf40-c799-4249-b300-dfa8e0b6a116 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:32.060235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ca99e406-387f-4d86-afec-780102dff3b0 req-298ebf40-c799-4249-b300-dfa8e0b6a116 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:32.079445 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ca99e406-387f-4d86-afec-780102dff3b0 req-298ebf40-c799-4249-b300-dfa8e0b6a116 service nova] Creating event network-vif-plugged:921e3ee1-fb50-4f0c-80ae-7a517b1fdc23 for instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 on nch2-master-1 Sep 06 11:19:32.091519 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ca99e406-387f-4d86-afec-780102dff3b0 req-298ebf40-c799-4249-b300-dfa8e0b6a116 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058752 Sep 06 11:19:32.107580 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2702/5454] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:19:32.676081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8679983d-e110-41f2-b937-aab9b7259420 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:32.676081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8679983d-e110-41f2-b937-aab9b7259420 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:32.683269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8679983d-e110-41f2-b937-aab9b7259420 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:32.684151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8679983d-e110-41f2-b937-aab9b7259420 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:32.684852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8679983d-e110-41f2-b937-aab9b7259420 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:32.685773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8679983d-e110-41f2-b937-aab9b7259420 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:32.686457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8679983d-e110-41f2-b937-aab9b7259420 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:32.687251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8679983d-e110-41f2-b937-aab9b7259420 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:33.001154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b94c9980-6620-43c6-9618-28ca6c29f4c6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:33.002719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b94c9980-6620-43c6-9618-28ca6c29f4c6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:33.022709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b94c9980-6620-43c6-9618-28ca6c29f4c6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:33.023652 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b94c9980-6620-43c6-9618-28ca6c29f4c6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:33.024334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b94c9980-6620-43c6-9618-28ca6c29f4c6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:33.026181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b94c9980-6620-43c6-9618-28ca6c29f4c6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:33.026956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b94c9980-6620-43c6-9618-28ca6c29f4c6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:33.028325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b94c9980-6620-43c6-9618-28ca6c29f4c6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:33.176304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8679983d-e110-41f2-b937-aab9b7259420 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:33.188558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8679983d-e110-41f2-b937-aab9b7259420 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:33.194404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8679983d-e110-41f2-b937-aab9b7259420 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:33.201965 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8679983d-e110-41f2-b937-aab9b7259420 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1736 microversion: 2.20 time: 0.531204 Sep 06 11:19:33.233258 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2753/5455] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:32 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1736 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:33.423079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b94c9980-6620-43c6-9618-28ca6c29f4c6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:33.432823 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b94c9980-6620-43c6-9618-28ca6c29f4c6 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1309 microversion: 2.1 time: 0.438425 Sep 06 11:19:33.434718 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2703/5456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:32 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1309 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:19:34.242772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6ab1a778-c1fb-48f6-bc9c-6043c90ecb35 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:34.244647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6ab1a778-c1fb-48f6-bc9c-6043c90ecb35 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:34.259073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ab1a778-c1fb-48f6-bc9c-6043c90ecb35 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:34.259869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ab1a778-c1fb-48f6-bc9c-6043c90ecb35 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:34.260563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ab1a778-c1fb-48f6-bc9c-6043c90ecb35 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:34.261512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ab1a778-c1fb-48f6-bc9c-6043c90ecb35 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:34.262192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ab1a778-c1fb-48f6-bc9c-6043c90ecb35 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:34.262778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ab1a778-c1fb-48f6-bc9c-6043c90ecb35 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:34.469818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-11420b1b-8847-4ce0-88c1-dcf3c4e521b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:34.472660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-11420b1b-8847-4ce0-88c1-dcf3c4e521b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:34.485849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6ab1a778-c1fb-48f6-bc9c-6043c90ecb35 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:34.486379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11420b1b-8847-4ce0-88c1-dcf3c4e521b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:34.487337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11420b1b-8847-4ce0-88c1-dcf3c4e521b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:34.488293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11420b1b-8847-4ce0-88c1-dcf3c4e521b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:34.493484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11420b1b-8847-4ce0-88c1-dcf3c4e521b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:34.494382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11420b1b-8847-4ce0-88c1-dcf3c4e521b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:34.497011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11420b1b-8847-4ce0-88c1-dcf3c4e521b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:34.503838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6ab1a778-c1fb-48f6-bc9c-6043c90ecb35 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:34.508344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6ab1a778-c1fb-48f6-bc9c-6043c90ecb35 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:34.511357 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6ab1a778-c1fb-48f6-bc9c-6043c90ecb35 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1736 microversion: 2.20 time: 0.274187 Sep 06 11:19:34.512501 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2754/5457] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:34 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1736 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:34.685267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a9080a4b-1a36-4a97-b142-c2bf0c54c94f req-219fc0af-9661-4e2c-bde3-464282d20257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9d7d8be-03de-4273-9886-bb005a0c02e5", "tag": "ded6ce7d-6c6b-4bf4-8eee-e55fdb10fe34"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:34.701532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a9080a4b-1a36-4a97-b142-c2bf0c54c94f req-219fc0af-9661-4e2c-bde3-464282d20257 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:34.702072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a9080a4b-1a36-4a97-b142-c2bf0c54c94f req-219fc0af-9661-4e2c-bde3-464282d20257 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:34.702577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a9080a4b-1a36-4a97-b142-c2bf0c54c94f req-219fc0af-9661-4e2c-bde3-464282d20257 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:34.720715 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a9080a4b-1a36-4a97-b142-c2bf0c54c94f req-219fc0af-9661-4e2c-bde3-464282d20257 service nova] Creating event network-changed:ded6ce7d-6c6b-4bf4-8eee-e55fdb10fe34 for instance a9d7d8be-03de-4273-9886-bb005a0c02e5 on nch2-master-1 Sep 06 11:19:34.727499 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a9080a4b-1a36-4a97-b142-c2bf0c54c94f req-219fc0af-9661-4e2c-bde3-464282d20257 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048104 Sep 06 11:19:34.728170 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2755/5458] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:19:34.742240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-11420b1b-8847-4ce0-88c1-dcf3c4e521b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:34.750551 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-11420b1b-8847-4ce0-88c1-dcf3c4e521b9 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1309 microversion: 2.1 time: 0.291724 Sep 06 11:19:34.751163 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2704/5459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:34 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1309 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:35.548641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9018deb-0b06-4ef3-92ef-2ab617488b02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:35.549505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d9018deb-0b06-4ef3-92ef-2ab617488b02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:35.564077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9018deb-0b06-4ef3-92ef-2ab617488b02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:35.565937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9018deb-0b06-4ef3-92ef-2ab617488b02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:35.567622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9018deb-0b06-4ef3-92ef-2ab617488b02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:35.576106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9018deb-0b06-4ef3-92ef-2ab617488b02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:35.576756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9018deb-0b06-4ef3-92ef-2ab617488b02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:35.577315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9018deb-0b06-4ef3-92ef-2ab617488b02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:35.780533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-45045a2a-e350-40d8-9245-4176b6805629 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:35.780533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-45045a2a-e350-40d8-9245-4176b6805629 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:35.789350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45045a2a-e350-40d8-9245-4176b6805629 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:35.789847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45045a2a-e350-40d8-9245-4176b6805629 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:35.798136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45045a2a-e350-40d8-9245-4176b6805629 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:35.803442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45045a2a-e350-40d8-9245-4176b6805629 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:35.803442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45045a2a-e350-40d8-9245-4176b6805629 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:35.803442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45045a2a-e350-40d8-9245-4176b6805629 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:35.819944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d9018deb-0b06-4ef3-92ef-2ab617488b02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:35.831814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d9018deb-0b06-4ef3-92ef-2ab617488b02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:35.834438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d9018deb-0b06-4ef3-92ef-2ab617488b02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:35.836933 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d9018deb-0b06-4ef3-92ef-2ab617488b02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1736 microversion: 2.20 time: 0.292560 Sep 06 11:19:35.837928 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2756/5460] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:35 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1736 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:36.384701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-45045a2a-e350-40d8-9245-4176b6805629 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:36.395214 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-45045a2a-e350-40d8-9245-4176b6805629 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1309 microversion: 2.1 time: 0.625069 Sep 06 11:19:36.399027 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2705/5461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:35 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1309 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:19:36.869886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2379d752-3cf4-4ffd-9450-32069e65ee77 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:36.875283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2379d752-3cf4-4ffd-9450-32069e65ee77 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:36.881142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2379d752-3cf4-4ffd-9450-32069e65ee77 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:36.881668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2379d752-3cf4-4ffd-9450-32069e65ee77 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:36.882125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2379d752-3cf4-4ffd-9450-32069e65ee77 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:36.882861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2379d752-3cf4-4ffd-9450-32069e65ee77 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:36.883361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2379d752-3cf4-4ffd-9450-32069e65ee77 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:36.883860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2379d752-3cf4-4ffd-9450-32069e65ee77 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:37.108003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2379d752-3cf4-4ffd-9450-32069e65ee77 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:37.120656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2379d752-3cf4-4ffd-9450-32069e65ee77 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:37.123040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2379d752-3cf4-4ffd-9450-32069e65ee77 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:37.124545 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2379d752-3cf4-4ffd-9450-32069e65ee77 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1736 microversion: 2.20 time: 0.260091 Sep 06 11:19:37.125581 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2757/5462] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:36 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1736 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:37.424259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56780930-124e-4c46-83cb-1f33f0db43fc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:37.425526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56780930-124e-4c46-83cb-1f33f0db43fc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:37.428520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:37.434197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56780930-124e-4c46-83cb-1f33f0db43fc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:37.436886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56780930-124e-4c46-83cb-1f33f0db43fc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:37.436886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56780930-124e-4c46-83cb-1f33f0db43fc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:37.436886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56780930-124e-4c46-83cb-1f33f0db43fc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:37.436886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56780930-124e-4c46-83cb-1f33f0db43fc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:37.437529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56780930-124e-4c46-83cb-1f33f0db43fc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:37.616689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-56780930-124e-4c46-83cb-1f33f0db43fc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:37.627738 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56780930-124e-4c46-83cb-1f33f0db43fc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1309 microversion: 2.1 time: 0.207577 Sep 06 11:19:37.628348 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2706/5463] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:37 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1309 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:38.163998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9af1c17f-d6d2-4fb5-a98a-46dce66ba319 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:38.164566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9af1c17f-d6d2-4fb5-a98a-46dce66ba319 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:38.174050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9af1c17f-d6d2-4fb5-a98a-46dce66ba319 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:38.175370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9af1c17f-d6d2-4fb5-a98a-46dce66ba319 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:38.176123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9af1c17f-d6d2-4fb5-a98a-46dce66ba319 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:38.177012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9af1c17f-d6d2-4fb5-a98a-46dce66ba319 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:38.177712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9af1c17f-d6d2-4fb5-a98a-46dce66ba319 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:38.178298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9af1c17f-d6d2-4fb5-a98a-46dce66ba319 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:38.361051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9af1c17f-d6d2-4fb5-a98a-46dce66ba319 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:38.380022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9af1c17f-d6d2-4fb5-a98a-46dce66ba319 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:38.400508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9af1c17f-d6d2-4fb5-a98a-46dce66ba319 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:38.400508 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9af1c17f-d6d2-4fb5-a98a-46dce66ba319 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1736 microversion: 2.20 time: 0.232252 Sep 06 11:19:38.400508 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2758/5464] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:38 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:38.655478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e6afd2f8-4d03-49f5-9e5a-efe49f5282b7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:38.656137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e6afd2f8-4d03-49f5-9e5a-efe49f5282b7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:38.658248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:38.659579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:38.769387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6afd2f8-4d03-49f5-9e5a-efe49f5282b7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:38.769387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6afd2f8-4d03-49f5-9e5a-efe49f5282b7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:38.769387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6afd2f8-4d03-49f5-9e5a-efe49f5282b7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:38.769387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6afd2f8-4d03-49f5-9e5a-efe49f5282b7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:38.769387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6afd2f8-4d03-49f5-9e5a-efe49f5282b7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:38.769387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6afd2f8-4d03-49f5-9e5a-efe49f5282b7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:38.817364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e6afd2f8-4d03-49f5-9e5a-efe49f5282b7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:38.825470 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e6afd2f8-4d03-49f5-9e5a-efe49f5282b7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1309 microversion: 2.1 time: 0.174436 Sep 06 11:19:38.826093 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2707/5465] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:38 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1309 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:19:39.428111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6cfafa8d-8a92-4289-a85d-e26bb1d6f119 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:39.429610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6cfafa8d-8a92-4289-a85d-e26bb1d6f119 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:39.438803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:39.441304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cfafa8d-8a92-4289-a85d-e26bb1d6f119 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:39.441864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cfafa8d-8a92-4289-a85d-e26bb1d6f119 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:39.442531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cfafa8d-8a92-4289-a85d-e26bb1d6f119 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:39.444163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cfafa8d-8a92-4289-a85d-e26bb1d6f119 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:39.444870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cfafa8d-8a92-4289-a85d-e26bb1d6f119 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:39.445386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cfafa8d-8a92-4289-a85d-e26bb1d6f119 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:39.651662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6cfafa8d-8a92-4289-a85d-e26bb1d6f119 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:39.667002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6cfafa8d-8a92-4289-a85d-e26bb1d6f119 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:39.668528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6cfafa8d-8a92-4289-a85d-e26bb1d6f119 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:39.670748 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6cfafa8d-8a92-4289-a85d-e26bb1d6f119 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1736 microversion: 2.20 time: 0.248313 Sep 06 11:19:39.672072 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2759/5466] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:39 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:39.850516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d81a3ce7-1ebc-4e24-8a25-6efbceba7d5e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:39.851194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d81a3ce7-1ebc-4e24-8a25-6efbceba7d5e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:39.866354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d81a3ce7-1ebc-4e24-8a25-6efbceba7d5e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:39.872633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d81a3ce7-1ebc-4e24-8a25-6efbceba7d5e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:39.873293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d81a3ce7-1ebc-4e24-8a25-6efbceba7d5e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:39.874239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d81a3ce7-1ebc-4e24-8a25-6efbceba7d5e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:39.875541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d81a3ce7-1ebc-4e24-8a25-6efbceba7d5e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:39.885839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d81a3ce7-1ebc-4e24-8a25-6efbceba7d5e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:40.134945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d81a3ce7-1ebc-4e24-8a25-6efbceba7d5e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:40.148404 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d81a3ce7-1ebc-4e24-8a25-6efbceba7d5e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1309 microversion: 2.1 time: 0.302275 Sep 06 11:19:40.149410 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2708/5467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:39 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1309 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:40.701644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0fabc498-2885-4577-abdd-6bf82d6b3d33 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:40.702272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0fabc498-2885-4577-abdd-6bf82d6b3d33 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:40.714479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fabc498-2885-4577-abdd-6bf82d6b3d33 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:40.715001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fabc498-2885-4577-abdd-6bf82d6b3d33 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:40.716126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fabc498-2885-4577-abdd-6bf82d6b3d33 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:40.717078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fabc498-2885-4577-abdd-6bf82d6b3d33 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:40.717712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fabc498-2885-4577-abdd-6bf82d6b3d33 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:40.718315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fabc498-2885-4577-abdd-6bf82d6b3d33 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:40.906555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0fabc498-2885-4577-abdd-6bf82d6b3d33 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:40.923040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0fabc498-2885-4577-abdd-6bf82d6b3d33 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:40.925226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0fabc498-2885-4577-abdd-6bf82d6b3d33 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:40.926334 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0fabc498-2885-4577-abdd-6bf82d6b3d33 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1736 microversion: 2.20 time: 0.229048 Sep 06 11:19:40.926907 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2760/5468] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:40 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:41.178546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0bb6e6f4-bd94-47a3-a4da-7856081f67de tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:41.179347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0bb6e6f4-bd94-47a3-a4da-7856081f67de tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:41.188973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bb6e6f4-bd94-47a3-a4da-7856081f67de tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:41.189509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bb6e6f4-bd94-47a3-a4da-7856081f67de tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:41.197060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bb6e6f4-bd94-47a3-a4da-7856081f67de tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:41.197060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bb6e6f4-bd94-47a3-a4da-7856081f67de tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:41.197060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bb6e6f4-bd94-47a3-a4da-7856081f67de tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:41.197060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bb6e6f4-bd94-47a3-a4da-7856081f67de tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:41.389733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0bb6e6f4-bd94-47a3-a4da-7856081f67de tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:41.393275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:41.402907 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0bb6e6f4-bd94-47a3-a4da-7856081f67de tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1309 microversion: 2.1 time: 0.228251 Sep 06 11:19:41.403622 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2709/5469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:41 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1309 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:41.955869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e406eca7-8d30-49c1-a133-763035a6dab9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:41.957312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e406eca7-8d30-49c1-a133-763035a6dab9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:41.968365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e406eca7-8d30-49c1-a133-763035a6dab9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:41.969436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e406eca7-8d30-49c1-a133-763035a6dab9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:41.971585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e406eca7-8d30-49c1-a133-763035a6dab9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:41.978880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e406eca7-8d30-49c1-a133-763035a6dab9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:41.978880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e406eca7-8d30-49c1-a133-763035a6dab9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:41.978880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e406eca7-8d30-49c1-a133-763035a6dab9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:42.142542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a2c35754-023f-426a-adb0-1b3b69648c25 req-6708a80a-32de-40c0-a644-9739dd815f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d7d8be-03de-4273-9886-bb005a0c02e5", "name": "network-vif-plugged", "status": "completed", "tag": "ded6ce7d-6c6b-4bf4-8eee-e55fdb10fe34"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:42.161289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a2c35754-023f-426a-adb0-1b3b69648c25 req-6708a80a-32de-40c0-a644-9739dd815f90 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:42.162013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a2c35754-023f-426a-adb0-1b3b69648c25 req-6708a80a-32de-40c0-a644-9739dd815f90 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:42.162504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a2c35754-023f-426a-adb0-1b3b69648c25 req-6708a80a-32de-40c0-a644-9739dd815f90 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:42.171605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e406eca7-8d30-49c1-a133-763035a6dab9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:42.180597 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a2c35754-023f-426a-adb0-1b3b69648c25 req-6708a80a-32de-40c0-a644-9739dd815f90 service nova] Creating event network-vif-plugged:ded6ce7d-6c6b-4bf4-8eee-e55fdb10fe34 for instance a9d7d8be-03de-4273-9886-bb005a0c02e5 on nch2-master-1 Sep 06 11:19:42.181119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e406eca7-8d30-49c1-a133-763035a6dab9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:42.182157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e406eca7-8d30-49c1-a133-763035a6dab9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:42.183376 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e406eca7-8d30-49c1-a133-763035a6dab9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1736 microversion: 2.20 time: 0.235388 Sep 06 11:19:42.183952 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2761/5470] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:41 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:42.188164 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a2c35754-023f-426a-adb0-1b3b69648c25 req-6708a80a-32de-40c0-a644-9739dd815f90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050689 Sep 06 11:19:42.188839 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2710/5471] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:19:42.430932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-be590015-500d-4647-a436-bd074e728722 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:42.431489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-be590015-500d-4647-a436-bd074e728722 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:42.437846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be590015-500d-4647-a436-bd074e728722 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:42.438338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be590015-500d-4647-a436-bd074e728722 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:42.438783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be590015-500d-4647-a436-bd074e728722 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:42.439516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be590015-500d-4647-a436-bd074e728722 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:42.440009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be590015-500d-4647-a436-bd074e728722 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:42.440446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be590015-500d-4647-a436-bd074e728722 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:42.636098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-be590015-500d-4647-a436-bd074e728722 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:42.645266 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-be590015-500d-4647-a436-bd074e728722 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1309 microversion: 2.1 time: 0.218824 Sep 06 11:19:42.659515 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2762/5472] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:42 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1309 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:43.215295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-19dc2501-04ca-4f65-91d1-7d21a0ff60fc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:43.216030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-19dc2501-04ca-4f65-91d1-7d21a0ff60fc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:43.222883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19dc2501-04ca-4f65-91d1-7d21a0ff60fc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:43.223438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19dc2501-04ca-4f65-91d1-7d21a0ff60fc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:43.223981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19dc2501-04ca-4f65-91d1-7d21a0ff60fc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:43.224782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19dc2501-04ca-4f65-91d1-7d21a0ff60fc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:43.225304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19dc2501-04ca-4f65-91d1-7d21a0ff60fc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:43.226116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-19dc2501-04ca-4f65-91d1-7d21a0ff60fc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:43.392842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-19dc2501-04ca-4f65-91d1-7d21a0ff60fc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:43.436444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-19dc2501-04ca-4f65-91d1-7d21a0ff60fc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:43.441880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-19dc2501-04ca-4f65-91d1-7d21a0ff60fc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:43.441880 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-19dc2501-04ca-4f65-91d1-7d21a0ff60fc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1736 microversion: 2.20 time: 0.230063 Sep 06 11:19:43.445205 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2711/5473] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:43 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:43.673814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b3cc8cf8-96b6-42d1-a885-2fa412bf6ddb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:43.675122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b3cc8cf8-96b6-42d1-a885-2fa412bf6ddb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:43.682147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3cc8cf8-96b6-42d1-a885-2fa412bf6ddb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:43.682970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3cc8cf8-96b6-42d1-a885-2fa412bf6ddb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:43.683660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3cc8cf8-96b6-42d1-a885-2fa412bf6ddb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:43.684577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3cc8cf8-96b6-42d1-a885-2fa412bf6ddb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:43.685045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3cc8cf8-96b6-42d1-a885-2fa412bf6ddb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:43.685663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3cc8cf8-96b6-42d1-a885-2fa412bf6ddb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:43.849744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b3cc8cf8-96b6-42d1-a885-2fa412bf6ddb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:43.864060 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b3cc8cf8-96b6-42d1-a885-2fa412bf6ddb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1309 microversion: 2.1 time: 0.193964 Sep 06 11:19:43.876147 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2763/5474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:43 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1309 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:44.478162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d82c4b90-04d7-42d2-9695-513b53c04788 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:44.479516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d82c4b90-04d7-42d2-9695-513b53c04788 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:44.487038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d82c4b90-04d7-42d2-9695-513b53c04788 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:44.488291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d82c4b90-04d7-42d2-9695-513b53c04788 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:44.488688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d82c4b90-04d7-42d2-9695-513b53c04788 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:44.489704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d82c4b90-04d7-42d2-9695-513b53c04788 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:44.490183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d82c4b90-04d7-42d2-9695-513b53c04788 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:44.490631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d82c4b90-04d7-42d2-9695-513b53c04788 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:44.671874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d82c4b90-04d7-42d2-9695-513b53c04788 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:44.681461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d82c4b90-04d7-42d2-9695-513b53c04788 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:44.682962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d82c4b90-04d7-42d2-9695-513b53c04788 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:44.685174 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d82c4b90-04d7-42d2-9695-513b53c04788 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1718 microversion: 2.20 time: 0.212156 Sep 06 11:19:44.685761 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2712/5475] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:44 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1718 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:44.889531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a4cb411b-c9b4-42fb-9c82-4d6cd73dc591 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:44.891601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a4cb411b-c9b4-42fb-9c82-4d6cd73dc591 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:44.900742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4cb411b-c9b4-42fb-9c82-4d6cd73dc591 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:44.901761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4cb411b-c9b4-42fb-9c82-4d6cd73dc591 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:44.902437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4cb411b-c9b4-42fb-9c82-4d6cd73dc591 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:44.903430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4cb411b-c9b4-42fb-9c82-4d6cd73dc591 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:44.904101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4cb411b-c9b4-42fb-9c82-4d6cd73dc591 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:44.904760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4cb411b-c9b4-42fb-9c82-4d6cd73dc591 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:45.093380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a4cb411b-c9b4-42fb-9c82-4d6cd73dc591 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:45.103121 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a4cb411b-c9b4-42fb-9c82-4d6cd73dc591 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1490 microversion: 2.1 time: 0.218076 Sep 06 11:19:45.104065 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2764/5476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:44 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1490 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:45.126522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3b207fa8-5000-4dbb-b444-2073341a342a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:45.127147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3b207fa8-5000-4dbb-b444-2073341a342a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:45.133740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b207fa8-5000-4dbb-b444-2073341a342a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:45.134236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b207fa8-5000-4dbb-b444-2073341a342a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:45.134698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b207fa8-5000-4dbb-b444-2073341a342a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:45.139452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b207fa8-5000-4dbb-b444-2073341a342a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:45.139452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b207fa8-5000-4dbb-b444-2073341a342a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:45.139452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b207fa8-5000-4dbb-b444-2073341a342a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:45.295136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3b207fa8-5000-4dbb-b444-2073341a342a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:45.304179 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3b207fa8-5000-4dbb-b444-2073341a342a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1490 microversion: 2.1 time: 0.181552 Sep 06 11:19:45.304784 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2713/5477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:45 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1490 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:45.326584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0dcdf15f-2ff7-4768-a3d0-0c1a60cad3c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:45.335808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0dcdf15f-2ff7-4768-a3d0-0c1a60cad3c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:45.335808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dcdf15f-2ff7-4768-a3d0-0c1a60cad3c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:45.335808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dcdf15f-2ff7-4768-a3d0-0c1a60cad3c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:45.335808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dcdf15f-2ff7-4768-a3d0-0c1a60cad3c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:45.335808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dcdf15f-2ff7-4768-a3d0-0c1a60cad3c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:45.335808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dcdf15f-2ff7-4768-a3d0-0c1a60cad3c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:45.336460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0dcdf15f-2ff7-4768-a3d0-0c1a60cad3c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:45.501275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0dcdf15f-2ff7-4768-a3d0-0c1a60cad3c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:45.509876 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0dcdf15f-2ff7-4768-a3d0-0c1a60cad3c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1490 microversion: 2.1 time: 0.187179 Sep 06 11:19:45.510463 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2765/5478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:45 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1490 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:45.534154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a120f311-2e41-4a81-8324-2fac41f1421a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:45.535339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a120f311-2e41-4a81-8324-2fac41f1421a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:45.542624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a120f311-2e41-4a81-8324-2fac41f1421a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:45.543066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a120f311-2e41-4a81-8324-2fac41f1421a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:45.543518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a120f311-2e41-4a81-8324-2fac41f1421a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:45.544274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a120f311-2e41-4a81-8324-2fac41f1421a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:45.544740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a120f311-2e41-4a81-8324-2fac41f1421a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:45.545177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a120f311-2e41-4a81-8324-2fac41f1421a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:45.572517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a120f311-2e41-4a81-8324-2fac41f1421a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:19:45.715269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3d0e9497-3741-434b-9779-3f29c1bd6671 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:45.715899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3d0e9497-3741-434b-9779-3f29c1bd6671 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:45.718430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=64 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:45.724138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d0e9497-3741-434b-9779-3f29c1bd6671 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:45.724639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d0e9497-3741-434b-9779-3f29c1bd6671 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:45.725119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d0e9497-3741-434b-9779-3f29c1bd6671 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:45.725835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d0e9497-3741-434b-9779-3f29c1bd6671 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:45.726302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d0e9497-3741-434b-9779-3f29c1bd6671 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:45.726737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d0e9497-3741-434b-9779-3f29c1bd6671 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:45.732388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:45.878751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3d0e9497-3741-434b-9779-3f29c1bd6671 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:45.888933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3d0e9497-3741-434b-9779-3f29c1bd6671 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:45.890465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3d0e9497-3741-434b-9779-3f29c1bd6671 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:45.891724 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3d0e9497-3741-434b-9779-3f29c1bd6671 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1718 microversion: 2.20 time: 0.180429 Sep 06 11:19:45.892471 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2766/5479] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:45 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1718 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:19:45.897393 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a120f311-2e41-4a81-8324-2fac41f1421a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 204 len: 0 microversion: 2.1 time: 0.367390 Sep 06 11:19:45.898144 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2714/5480] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:19:45 2022] DELETE /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:19:45.914124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c20ffbcd-29ca-4b32-a258-b5756ceb4512 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:45.915161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c20ffbcd-29ca-4b32-a258-b5756ceb4512 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:45.922983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c20ffbcd-29ca-4b32-a258-b5756ceb4512 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:45.925223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c20ffbcd-29ca-4b32-a258-b5756ceb4512 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:45.925686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c20ffbcd-29ca-4b32-a258-b5756ceb4512 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:45.927096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c20ffbcd-29ca-4b32-a258-b5756ceb4512 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:45.927096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c20ffbcd-29ca-4b32-a258-b5756ceb4512 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:45.927546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c20ffbcd-29ca-4b32-a258-b5756ceb4512 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:46.068381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c20ffbcd-29ca-4b32-a258-b5756ceb4512 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:46.089286 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c20ffbcd-29ca-4b32-a258-b5756ceb4512 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1496 microversion: 2.1 time: 0.180789 Sep 06 11:19:46.092388 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2767/5481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:45 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1496 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:46.926435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-23befae5-17ba-4e78-b92c-43312fca9659 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:46.926435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-23befae5-17ba-4e78-b92c-43312fca9659 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:46.932076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23befae5-17ba-4e78-b92c-43312fca9659 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:46.932572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23befae5-17ba-4e78-b92c-43312fca9659 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:46.933125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23befae5-17ba-4e78-b92c-43312fca9659 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:46.933739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23befae5-17ba-4e78-b92c-43312fca9659 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:46.934194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23befae5-17ba-4e78-b92c-43312fca9659 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:46.934809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-23befae5-17ba-4e78-b92c-43312fca9659 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:47.085996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-23befae5-17ba-4e78-b92c-43312fca9659 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:47.101423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-23befae5-17ba-4e78-b92c-43312fca9659 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:47.102938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-23befae5-17ba-4e78-b92c-43312fca9659 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:47.109068 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-23befae5-17ba-4e78-b92c-43312fca9659 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1718 microversion: 2.20 time: 0.186128 Sep 06 11:19:47.109068 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2715/5482] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:46 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1718 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:47.124549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d24aa26d-9505-4ca5-96a9-9b1a7f543e7c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:47.125230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d24aa26d-9505-4ca5-96a9-9b1a7f543e7c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:47.133726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d24aa26d-9505-4ca5-96a9-9b1a7f543e7c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:47.134082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d24aa26d-9505-4ca5-96a9-9b1a7f543e7c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:47.134616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d24aa26d-9505-4ca5-96a9-9b1a7f543e7c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:47.135277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d24aa26d-9505-4ca5-96a9-9b1a7f543e7c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:47.135737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d24aa26d-9505-4ca5-96a9-9b1a7f543e7c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:47.136165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d24aa26d-9505-4ca5-96a9-9b1a7f543e7c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:47.285608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d24aa26d-9505-4ca5-96a9-9b1a7f543e7c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:47.301841 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d24aa26d-9505-4ca5-96a9-9b1a7f543e7c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1496 microversion: 2.1 time: 0.181572 Sep 06 11:19:47.304556 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2768/5483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:47 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1496 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:47.796915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-c1ac441d-2c0e-4055-b8d9-01cb67902e12 req-1defdc4b-5507-4633-aedc-23ed4f86e6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72fceff4-8a80-43f9-88f2-fd73e1eed3e3", "name": "network-vif-unplugged", "status": "completed", "tag": "921e3ee1-fb50-4f0c-80ae-7a517b1fdc23"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:47.808655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c1ac441d-2c0e-4055-b8d9-01cb67902e12 req-1defdc4b-5507-4633-aedc-23ed4f86e6f2 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:47.809153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c1ac441d-2c0e-4055-b8d9-01cb67902e12 req-1defdc4b-5507-4633-aedc-23ed4f86e6f2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:47.809597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c1ac441d-2c0e-4055-b8d9-01cb67902e12 req-1defdc4b-5507-4633-aedc-23ed4f86e6f2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:47.824550 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-c1ac441d-2c0e-4055-b8d9-01cb67902e12 req-1defdc4b-5507-4633-aedc-23ed4f86e6f2 service nova] Creating event network-vif-unplugged:921e3ee1-fb50-4f0c-80ae-7a517b1fdc23 for instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 on nch2-master-1 Sep 06 11:19:47.829723 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-c1ac441d-2c0e-4055-b8d9-01cb67902e12 req-1defdc4b-5507-4633-aedc-23ed4f86e6f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036476 Sep 06 11:19:47.830486 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2716/5484] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:19:48.135370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ce38c50d-b9c8-4faf-9c42-5b55d69e0af3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:48.135370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ce38c50d-b9c8-4faf-9c42-5b55d69e0af3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:48.144313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce38c50d-b9c8-4faf-9c42-5b55d69e0af3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:48.145087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce38c50d-b9c8-4faf-9c42-5b55d69e0af3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:48.145551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce38c50d-b9c8-4faf-9c42-5b55d69e0af3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:48.146480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce38c50d-b9c8-4faf-9c42-5b55d69e0af3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:48.146943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce38c50d-b9c8-4faf-9c42-5b55d69e0af3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:48.147593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce38c50d-b9c8-4faf-9c42-5b55d69e0af3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:48.324276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce38c50d-b9c8-4faf-9c42-5b55d69e0af3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:48.327409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fe8ca627-7850-4fe5-bb0a-dd1f0253d92b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:48.328834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fe8ca627-7850-4fe5-bb0a-dd1f0253d92b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:48.337572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce38c50d-b9c8-4faf-9c42-5b55d69e0af3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:48.339432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce38c50d-b9c8-4faf-9c42-5b55d69e0af3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:48.349483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8ca627-7850-4fe5-bb0a-dd1f0253d92b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:48.352722 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ce38c50d-b9c8-4faf-9c42-5b55d69e0af3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1721 microversion: 2.20 time: 0.218594 Sep 06 11:19:48.352836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8ca627-7850-4fe5-bb0a-dd1f0253d92b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:48.352918 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2769/5485] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:48 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:48.359803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8ca627-7850-4fe5-bb0a-dd1f0253d92b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:48.375081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8ca627-7850-4fe5-bb0a-dd1f0253d92b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:48.387799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8ca627-7850-4fe5-bb0a-dd1f0253d92b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:48.387799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8ca627-7850-4fe5-bb0a-dd1f0253d92b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:48.389181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b6cb0a1e-5350-457e-b08e-eea8b992795d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a65b0ac0-1d9b-4861-a8d7-894c6b3e5846"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:48.391697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b6cb0a1e-5350-457e-b08e-eea8b992795d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:48.421887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6cb0a1e-5350-457e-b08e-eea8b992795d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:48.421887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6cb0a1e-5350-457e-b08e-eea8b992795d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:48.421887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6cb0a1e-5350-457e-b08e-eea8b992795d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:48.421887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6cb0a1e-5350-457e-b08e-eea8b992795d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:48.421887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6cb0a1e-5350-457e-b08e-eea8b992795d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:48.421887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6cb0a1e-5350-457e-b08e-eea8b992795d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:48.575285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fe8ca627-7850-4fe5-bb0a-dd1f0253d92b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:48.586862 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fe8ca627-7850-4fe5-bb0a-dd1f0253d92b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1496 microversion: 2.1 time: 0.264404 Sep 06 11:19:48.588149 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2717/5486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:48 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1496 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:48.948580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b17528eb-5336-4ea4-bd2f-99e79184e6ac req-01d737ba-e14e-4083-90d4-e2da8af06e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d7d8be-03de-4273-9886-bb005a0c02e5", "name": "network-vif-deleted", "tag": "ded6ce7d-6c6b-4bf4-8eee-e55fdb10fe34"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:48.978179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b17528eb-5336-4ea4-bd2f-99e79184e6ac req-01d737ba-e14e-4083-90d4-e2da8af06e6a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:48.979574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b17528eb-5336-4ea4-bd2f-99e79184e6ac req-01d737ba-e14e-4083-90d4-e2da8af06e6a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:48.984569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b17528eb-5336-4ea4-bd2f-99e79184e6ac req-01d737ba-e14e-4083-90d4-e2da8af06e6a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:49.002661 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b17528eb-5336-4ea4-bd2f-99e79184e6ac req-01d737ba-e14e-4083-90d4-e2da8af06e6a service nova] Creating event network-vif-deleted:ded6ce7d-6c6b-4bf4-8eee-e55fdb10fe34 for instance a9d7d8be-03de-4273-9886-bb005a0c02e5 on nch2-master-1 Sep 06 11:19:49.011822 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b17528eb-5336-4ea4-bd2f-99e79184e6ac req-01d737ba-e14e-4083-90d4-e2da8af06e6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073839 Sep 06 11:19:49.013093 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2718/5487] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:19:49.613184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:49.614152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:49.623258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:49.623762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:49.624214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:49.624942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:49.625417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:49.626172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:49.668290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:49.668800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:49.669255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:49.669823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lazy-loading 'fault' on Instance uuid a9d7d8be-03de-4273-9886-bb005a0c02e5 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:19:49.727941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:49.750743 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-141e5193-fd56-4130-933a-fa0226c13f18 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 200 len: 1299 microversion: 2.1 time: 0.142496 Sep 06 11:19:49.751790 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2719/5488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:49 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 1299 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:19:49.863405 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b6cb0a1e-5350-457e-b08e-eea8b992795d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "POST /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.477284 Sep 06 11:19:49.864679 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2770/5489] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Sep 6 11:19:48 2022] POST /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/os-volume_attachments => generated 188 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:19:50.039864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-659d4668-bf08-4079-af6c-29e1252aa8fa tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:50.039864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-659d4668-bf08-4079-af6c-29e1252aa8fa tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:50.045132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-659d4668-bf08-4079-af6c-29e1252aa8fa tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:50.045633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-659d4668-bf08-4079-af6c-29e1252aa8fa tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:50.046074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-659d4668-bf08-4079-af6c-29e1252aa8fa tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:50.046785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-659d4668-bf08-4079-af6c-29e1252aa8fa tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:50.047575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-659d4668-bf08-4079-af6c-29e1252aa8fa tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:50.047686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-659d4668-bf08-4079-af6c-29e1252aa8fa tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:50.108362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-659d4668-bf08-4079-af6c-29e1252aa8fa tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140875) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 11:19:50.499780 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-659d4668-bf08-4079-af6c-29e1252aa8fa tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "POST /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/action" status: 202 len: 0 microversion: 2.20 time: 0.467070 Sep 06 11:19:50.500869 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2720/5490] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:19:50 2022] POST /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:19:50.510066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f5310ec-94e7-4ccd-8bd2-4195513b20ed tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:50.510690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4f5310ec-94e7-4ccd-8bd2-4195513b20ed tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:50.518458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f5310ec-94e7-4ccd-8bd2-4195513b20ed tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:50.519493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f5310ec-94e7-4ccd-8bd2-4195513b20ed tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:50.520125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f5310ec-94e7-4ccd-8bd2-4195513b20ed tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:50.520860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f5310ec-94e7-4ccd-8bd2-4195513b20ed tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:50.521327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f5310ec-94e7-4ccd-8bd2-4195513b20ed tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:50.521757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f5310ec-94e7-4ccd-8bd2-4195513b20ed tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:50.681624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4f5310ec-94e7-4ccd-8bd2-4195513b20ed tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:50.692548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4f5310ec-94e7-4ccd-8bd2-4195513b20ed tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:50.694631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4f5310ec-94e7-4ccd-8bd2-4195513b20ed tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:50.696672 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4f5310ec-94e7-4ccd-8bd2-4195513b20ed tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1747 microversion: 2.20 time: 0.190915 Sep 06 11:19:50.697256 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2771/5491] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:50 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1747 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:50.783498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aaeecdc2-6d46-4d0d-b256-218b9df9c32f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:50.784207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aaeecdc2-6d46-4d0d-b256-218b9df9c32f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:50.791702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aaeecdc2-6d46-4d0d-b256-218b9df9c32f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:50.792332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aaeecdc2-6d46-4d0d-b256-218b9df9c32f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:50.794083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aaeecdc2-6d46-4d0d-b256-218b9df9c32f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:50.794083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aaeecdc2-6d46-4d0d-b256-218b9df9c32f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:50.794083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aaeecdc2-6d46-4d0d-b256-218b9df9c32f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:50.794507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aaeecdc2-6d46-4d0d-b256-218b9df9c32f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:50.811067 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-aaeecdc2-6d46-4d0d-b256-218b9df9c32f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aaeecdc2-6d46-4d0d-b256-218b9df9c32f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 HTTP/1.1 Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'a9d7d8be-03de-4273-9886-bb005a0c02e5'} Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:19:50.812766 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:19:50.819604 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:19:50.819604 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:19:50.819604 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:19:50.819604 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:19:50.819604 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:19:50.819604 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:19:50.819604 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:19:50.819604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aaeecdc2-6d46-4d0d-b256-218b9df9c32f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:19:50.819604 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aaeecdc2-6d46-4d0d-b256-218b9df9c32f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 404 len: 111 microversion: 2.1 time: 0.035677 Sep 06 11:19:50.819604 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2721/5492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:50 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:19:50.824390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a00cb3c-f810-4f1e-afe1-fac9b461dcad tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:50.825495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9a00cb3c-f810-4f1e-afe1-fac9b461dcad tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:50.831772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a00cb3c-f810-4f1e-afe1-fac9b461dcad tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:50.832268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a00cb3c-f810-4f1e-afe1-fac9b461dcad tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:50.832720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a00cb3c-f810-4f1e-afe1-fac9b461dcad tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:50.833420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a00cb3c-f810-4f1e-afe1-fac9b461dcad tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:50.833887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a00cb3c-f810-4f1e-afe1-fac9b461dcad tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:50.837735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a00cb3c-f810-4f1e-afe1-fac9b461dcad tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:50.860331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9a00cb3c-f810-4f1e-afe1-fac9b461dcad tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:19:51.244847 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a00cb3c-f810-4f1e-afe1-fac9b461dcad tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 204 len: 0 microversion: 2.1 time: 0.424428 Sep 06 11:19:51.245670 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2772/5493] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:19:50 2022] DELETE /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:19:51.255579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e21779e3-afd3-4a8b-9e72-2ebf24530f1f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:51.256205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e21779e3-afd3-4a8b-9e72-2ebf24530f1f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:51.262670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e21779e3-afd3-4a8b-9e72-2ebf24530f1f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:51.266059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e21779e3-afd3-4a8b-9e72-2ebf24530f1f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:51.266059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e21779e3-afd3-4a8b-9e72-2ebf24530f1f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:51.266059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e21779e3-afd3-4a8b-9e72-2ebf24530f1f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:51.266059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e21779e3-afd3-4a8b-9e72-2ebf24530f1f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:51.266059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e21779e3-afd3-4a8b-9e72-2ebf24530f1f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:51.452014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e21779e3-afd3-4a8b-9e72-2ebf24530f1f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:51.463381 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e21779e3-afd3-4a8b-9e72-2ebf24530f1f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1496 microversion: 2.1 time: 0.212460 Sep 06 11:19:51.464419 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2722/5494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:51 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1496 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:51.726988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e873f9db-f3e9-4c7b-bb29-d3aae8466ff3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:51.728897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e873f9db-f3e9-4c7b-bb29-d3aae8466ff3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:51.743247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e873f9db-f3e9-4c7b-bb29-d3aae8466ff3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:51.743753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e873f9db-f3e9-4c7b-bb29-d3aae8466ff3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:51.744204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e873f9db-f3e9-4c7b-bb29-d3aae8466ff3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:51.744938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e873f9db-f3e9-4c7b-bb29-d3aae8466ff3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:51.745610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e873f9db-f3e9-4c7b-bb29-d3aae8466ff3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:51.746294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e873f9db-f3e9-4c7b-bb29-d3aae8466ff3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:51.971978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e873f9db-f3e9-4c7b-bb29-d3aae8466ff3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:51.981484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e873f9db-f3e9-4c7b-bb29-d3aae8466ff3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:51.982837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e873f9db-f3e9-4c7b-bb29-d3aae8466ff3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:51.984167 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e873f9db-f3e9-4c7b-bb29-d3aae8466ff3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1747 microversion: 2.20 time: 0.265655 Sep 06 11:19:51.984745 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2773/5495] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:51 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1747 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:52.496300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd896a16-770b-464a-9e4a-e950ccab0015 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:52.497014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fd896a16-770b-464a-9e4a-e950ccab0015 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:52.509445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd896a16-770b-464a-9e4a-e950ccab0015 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:52.510453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd896a16-770b-464a-9e4a-e950ccab0015 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:52.512253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd896a16-770b-464a-9e4a-e950ccab0015 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:52.513441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd896a16-770b-464a-9e4a-e950ccab0015 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:52.514877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd896a16-770b-464a-9e4a-e950ccab0015 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:52.515800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd896a16-770b-464a-9e4a-e950ccab0015 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:52.697578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fd896a16-770b-464a-9e4a-e950ccab0015 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:52.706130 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd896a16-770b-464a-9e4a-e950ccab0015 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1496 microversion: 2.1 time: 0.214723 Sep 06 11:19:52.706811 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2723/5496] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:52 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1496 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:53.015940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dbbfa871-a9f3-4cd3-8a96-f3db4b00dbd2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:53.017214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dbbfa871-a9f3-4cd3-8a96-f3db4b00dbd2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:53.037829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbbfa871-a9f3-4cd3-8a96-f3db4b00dbd2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:53.038317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbbfa871-a9f3-4cd3-8a96-f3db4b00dbd2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:53.038872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbbfa871-a9f3-4cd3-8a96-f3db4b00dbd2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:53.039634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbbfa871-a9f3-4cd3-8a96-f3db4b00dbd2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:53.040095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbbfa871-a9f3-4cd3-8a96-f3db4b00dbd2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:53.040526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbbfa871-a9f3-4cd3-8a96-f3db4b00dbd2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:53.213516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dbbfa871-a9f3-4cd3-8a96-f3db4b00dbd2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:53.225920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dbbfa871-a9f3-4cd3-8a96-f3db4b00dbd2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:53.227725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dbbfa871-a9f3-4cd3-8a96-f3db4b00dbd2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:53.229777 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dbbfa871-a9f3-4cd3-8a96-f3db4b00dbd2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1749 microversion: 2.20 time: 0.221354 Sep 06 11:19:53.231134 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2774/5497] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:53 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1749 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:53.491282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-257d9ec1-f905-4d19-9212-ec90932a7ce2 req-72e27914-305d-45a6-8330-edd0be4ebb6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "631cc084-8ba7-4eb4-b496-684698dded7e", "name": "network-vif-deleted", "tag": "f0c8bf96-c715-4888-b2ec-9db93056e2fe"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:53.505391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-257d9ec1-f905-4d19-9212-ec90932a7ce2 req-72e27914-305d-45a6-8330-edd0be4ebb6a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:53.509864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-257d9ec1-f905-4d19-9212-ec90932a7ce2 req-72e27914-305d-45a6-8330-edd0be4ebb6a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:53.509864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-257d9ec1-f905-4d19-9212-ec90932a7ce2 req-72e27914-305d-45a6-8330-edd0be4ebb6a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:53.524009 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-257d9ec1-f905-4d19-9212-ec90932a7ce2 req-72e27914-305d-45a6-8330-edd0be4ebb6a service nova] Creating event network-vif-deleted:f0c8bf96-c715-4888-b2ec-9db93056e2fe for instance 631cc084-8ba7-4eb4-b496-684698dded7e on nch1-master-1 Sep 06 11:19:53.531622 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-257d9ec1-f905-4d19-9212-ec90932a7ce2 req-72e27914-305d-45a6-8330-edd0be4ebb6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045185 Sep 06 11:19:53.533229 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2724/5498] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:19:53.732314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4bc26108-d79d-4cff-9281-af5966eec044 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:53.733155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4bc26108-d79d-4cff-9281-af5966eec044 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:53.740008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bc26108-d79d-4cff-9281-af5966eec044 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:53.740746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bc26108-d79d-4cff-9281-af5966eec044 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:53.741355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bc26108-d79d-4cff-9281-af5966eec044 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:53.742240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bc26108-d79d-4cff-9281-af5966eec044 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:53.744870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bc26108-d79d-4cff-9281-af5966eec044 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:53.744870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bc26108-d79d-4cff-9281-af5966eec044 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:53.885739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4bc26108-d79d-4cff-9281-af5966eec044 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:53.895694 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4bc26108-d79d-4cff-9281-af5966eec044 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 200 len: 1294 microversion: 2.1 time: 0.167337 Sep 06 11:19:53.907540 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2775/5499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:53 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 1294 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:54.257207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ee569c38-85b1-4975-9078-e4494a00c197 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:54.257967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ee569c38-85b1-4975-9078-e4494a00c197 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:54.266188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee569c38-85b1-4975-9078-e4494a00c197 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:54.266696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee569c38-85b1-4975-9078-e4494a00c197 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:54.267182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee569c38-85b1-4975-9078-e4494a00c197 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:54.268129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee569c38-85b1-4975-9078-e4494a00c197 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:54.268765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee569c38-85b1-4975-9078-e4494a00c197 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:54.269367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ee569c38-85b1-4975-9078-e4494a00c197 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:54.544938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ee569c38-85b1-4975-9078-e4494a00c197 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:54.568899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ee569c38-85b1-4975-9078-e4494a00c197 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:54.571695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ee569c38-85b1-4975-9078-e4494a00c197 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:54.573157 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ee569c38-85b1-4975-9078-e4494a00c197 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1749 microversion: 2.20 time: 0.321255 Sep 06 11:19:54.573977 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2725/5500] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:54 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1749 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:54.924784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5c0bcbe-2197-493e-91bc-0e8bcc4e8c9b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:54.925661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a5c0bcbe-2197-493e-91bc-0e8bcc4e8c9b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:54.937934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5c0bcbe-2197-493e-91bc-0e8bcc4e8c9b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:54.938457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5c0bcbe-2197-493e-91bc-0e8bcc4e8c9b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:54.938913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5c0bcbe-2197-493e-91bc-0e8bcc4e8c9b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:54.944003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5c0bcbe-2197-493e-91bc-0e8bcc4e8c9b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:54.946495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5c0bcbe-2197-493e-91bc-0e8bcc4e8c9b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:54.947005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5c0bcbe-2197-493e-91bc-0e8bcc4e8c9b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:54.965904 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-a5c0bcbe-2197-493e-91bc-0e8bcc4e8c9b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5c0bcbe-2197-493e-91bc-0e8bcc4e8c9b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e HTTP/1.1 Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '631cc084-8ba7-4eb4-b496-684698dded7e'} Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:19:54.967654 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:19:54.975542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:19:54.975542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:19:54.975542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:19:54.975542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:19:54.975542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:19:54.975542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:19:54.975542 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:19:54.975542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5c0bcbe-2197-493e-91bc-0e8bcc4e8c9b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:19:54.975542 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a5c0bcbe-2197-493e-91bc-0e8bcc4e8c9b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 404 len: 111 microversion: 2.1 time: 0.050269 Sep 06 11:19:54.975542 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2776/5501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:54 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:19:55.078298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1549985577", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "74ae681a-5964-499e-a86a-13cffa0cf1b0"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:19:55.141778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] validate_networks() for [('74ae681a-5964-499e-a86a-13cffa0cf1b0', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:19:55.601528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1d5c678d-21a1-4f94-9db5-2e3041c01d7d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:55.603503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1d5c678d-21a1-4f94-9db5-2e3041c01d7d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:55.618381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d5c678d-21a1-4f94-9db5-2e3041c01d7d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:55.619319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d5c678d-21a1-4f94-9db5-2e3041c01d7d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:55.619946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d5c678d-21a1-4f94-9db5-2e3041c01d7d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:55.622994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d5c678d-21a1-4f94-9db5-2e3041c01d7d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:55.622994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d5c678d-21a1-4f94-9db5-2e3041c01d7d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:55.622994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d5c678d-21a1-4f94-9db5-2e3041c01d7d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:55.639456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:19:55.640027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:19:55.640520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:19:55.641354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:19:55.642385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:19:55.656115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:55.657307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:55.657963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:55.658958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:55.659621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:55.660259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:55.682306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:19:55.691076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for user acce3e06ce4d40ba8db7988456cf8787 and project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:19:55.711402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:19:55.714377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:19:55.827984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d5c678d-21a1-4f94-9db5-2e3041c01d7d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:55.845922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d5c678d-21a1-4f94-9db5-2e3041c01d7d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:55.850656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d5c678d-21a1-4f94-9db5-2e3041c01d7d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:55.853602 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1d5c678d-21a1-4f94-9db5-2e3041c01d7d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.256106 Sep 06 11:19:55.854739 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2777/5502] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:55 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:55.892159 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6471d2da-acb8-4eaf-9cc9-a6ff224848c0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813992 Sep 06 11:19:55.895079 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2726/5503] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:19:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:19:55.920673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e017653e-544f-4807-9c63-c2119e536c3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:55.928105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e017653e-544f-4807-9c63-c2119e536c3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:56.032858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e017653e-544f-4807-9c63-c2119e536c3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:56.045277 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e017653e-544f-4807-9c63-c2119e536c3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1209 microversion: 2.1 time: 0.139437 Sep 06 11:19:56.046591 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2778/5504] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:55 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1209 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:56.881939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6536d429-8eed-48ef-87c9-d1ebb9235c39 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:56.886830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6536d429-8eed-48ef-87c9-d1ebb9235c39 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:56.895341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6536d429-8eed-48ef-87c9-d1ebb9235c39 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:56.896181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6536d429-8eed-48ef-87c9-d1ebb9235c39 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:56.896860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6536d429-8eed-48ef-87c9-d1ebb9235c39 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:56.897887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6536d429-8eed-48ef-87c9-d1ebb9235c39 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:56.898585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6536d429-8eed-48ef-87c9-d1ebb9235c39 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:56.899334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6536d429-8eed-48ef-87c9-d1ebb9235c39 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:56.919699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:57.070667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5d5d7357-6403-44c6-9aaa-fde8680a1c9e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:57.071448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5d5d7357-6403-44c6-9aaa-fde8680a1c9e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:57.075227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6536d429-8eed-48ef-87c9-d1ebb9235c39 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:57.079602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d5d7357-6403-44c6-9aaa-fde8680a1c9e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:57.080130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d5d7357-6403-44c6-9aaa-fde8680a1c9e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:57.080631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d5d7357-6403-44c6-9aaa-fde8680a1c9e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:57.081355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d5d7357-6403-44c6-9aaa-fde8680a1c9e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:57.082575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d5d7357-6403-44c6-9aaa-fde8680a1c9e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:57.083054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d5d7357-6403-44c6-9aaa-fde8680a1c9e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:57.085149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6536d429-8eed-48ef-87c9-d1ebb9235c39 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:57.086621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6536d429-8eed-48ef-87c9-d1ebb9235c39 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:57.087853 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6536d429-8eed-48ef-87c9-d1ebb9235c39 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.211804 Sep 06 11:19:57.088436 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2727/5505] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:56 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:19:57.148593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5d5d7357-6403-44c6-9aaa-fde8680a1c9e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:57.156598 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5d5d7357-6403-44c6-9aaa-fde8680a1c9e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1213 microversion: 2.1 time: 0.090176 Sep 06 11:19:57.157343 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2779/5506] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:57 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:19:58.116911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd767597-d4b7-4a73-817a-dba95868c125 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:58.118293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fd767597-d4b7-4a73-817a-dba95868c125 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:58.126209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd767597-d4b7-4a73-817a-dba95868c125 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:58.127113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd767597-d4b7-4a73-817a-dba95868c125 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:58.127989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd767597-d4b7-4a73-817a-dba95868c125 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:58.129496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd767597-d4b7-4a73-817a-dba95868c125 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:58.130289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd767597-d4b7-4a73-817a-dba95868c125 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:58.130912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd767597-d4b7-4a73-817a-dba95868c125 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:58.181384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9cde67d4-e8bf-4359-9c8e-23e9d4ef18ca tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:58.182033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9cde67d4-e8bf-4359-9c8e-23e9d4ef18ca tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:58.201147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cde67d4-e8bf-4359-9c8e-23e9d4ef18ca tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:58.201967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cde67d4-e8bf-4359-9c8e-23e9d4ef18ca tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:58.202562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cde67d4-e8bf-4359-9c8e-23e9d4ef18ca tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:58.204049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cde67d4-e8bf-4359-9c8e-23e9d4ef18ca tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:58.204682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cde67d4-e8bf-4359-9c8e-23e9d4ef18ca tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:58.206010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cde67d4-e8bf-4359-9c8e-23e9d4ef18ca tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:58.260287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:58.432939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9cde67d4-e8bf-4359-9c8e-23e9d4ef18ca tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:58.449456 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9cde67d4-e8bf-4359-9c8e-23e9d4ef18ca tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1261 microversion: 2.1 time: 0.272154 Sep 06 11:19:58.451132 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2780/5507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:58 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1261 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:19:58.507516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fd767597-d4b7-4a73-817a-dba95868c125 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:58.528047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fd767597-d4b7-4a73-817a-dba95868c125 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:58.530333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fd767597-d4b7-4a73-817a-dba95868c125 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:58.532044 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd767597-d4b7-4a73-817a-dba95868c125 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.421523 Sep 06 11:19:58.533136 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2728/5508] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:58 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:19:59.481868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-94cfc77d-dd83-49cf-bc2b-fe46bf8d9a8d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:59.487782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-94cfc77d-dd83-49cf-bc2b-fe46bf8d9a8d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:59.507849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94cfc77d-dd83-49cf-bc2b-fe46bf8d9a8d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:59.508597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94cfc77d-dd83-49cf-bc2b-fe46bf8d9a8d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:59.509790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94cfc77d-dd83-49cf-bc2b-fe46bf8d9a8d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:59.511059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94cfc77d-dd83-49cf-bc2b-fe46bf8d9a8d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:59.516048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94cfc77d-dd83-49cf-bc2b-fe46bf8d9a8d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:59.516048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94cfc77d-dd83-49cf-bc2b-fe46bf8d9a8d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:59.568761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cc620d42-33d9-4e68-841e-5f2525a3f1c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:19:59.569522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cc620d42-33d9-4e68-841e-5f2525a3f1c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:19:59.588945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc620d42-33d9-4e68-841e-5f2525a3f1c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:59.589554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc620d42-33d9-4e68-841e-5f2525a3f1c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:59.590103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc620d42-33d9-4e68-841e-5f2525a3f1c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:59.590908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc620d42-33d9-4e68-841e-5f2525a3f1c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:19:59.591645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc620d42-33d9-4e68-841e-5f2525a3f1c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:19:59.592169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc620d42-33d9-4e68-841e-5f2525a3f1c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:19:59.618297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-94cfc77d-dd83-49cf-bc2b-fe46bf8d9a8d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:59.631493 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-94cfc77d-dd83-49cf-bc2b-fe46bf8d9a8d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1267 microversion: 2.1 time: 0.158423 Sep 06 11:19:59.632087 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2781/5509] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:19:59 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:19:59.800633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cc620d42-33d9-4e68-841e-5f2525a3f1c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:59.812217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cc620d42-33d9-4e68-841e-5f2525a3f1c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:59.815494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cc620d42-33d9-4e68-841e-5f2525a3f1c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:19:59.817328 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cc620d42-33d9-4e68-841e-5f2525a3f1c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.254049 Sep 06 11:19:59.823450 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2729/5510] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:19:59 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:20:00.667321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-42fdab2e-e989-456b-a87b-1a26bfabb69a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:00.668666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-42fdab2e-e989-456b-a87b-1a26bfabb69a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:00.676864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42fdab2e-e989-456b-a87b-1a26bfabb69a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:00.677632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42fdab2e-e989-456b-a87b-1a26bfabb69a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:00.681798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42fdab2e-e989-456b-a87b-1a26bfabb69a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:00.683132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42fdab2e-e989-456b-a87b-1a26bfabb69a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:00.684056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42fdab2e-e989-456b-a87b-1a26bfabb69a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:00.684682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42fdab2e-e989-456b-a87b-1a26bfabb69a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:00.844760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-05a34ec8-ddf8-4ce7-8bd6-d9f254438202 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:00.845385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-05a34ec8-ddf8-4ce7-8bd6-d9f254438202 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:00.858210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05a34ec8-ddf8-4ce7-8bd6-d9f254438202 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:00.862011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05a34ec8-ddf8-4ce7-8bd6-d9f254438202 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:00.863390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05a34ec8-ddf8-4ce7-8bd6-d9f254438202 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:00.864516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05a34ec8-ddf8-4ce7-8bd6-d9f254438202 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:00.867358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05a34ec8-ddf8-4ce7-8bd6-d9f254438202 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:00.872164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05a34ec8-ddf8-4ce7-8bd6-d9f254438202 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:01.080116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-42fdab2e-e989-456b-a87b-1a26bfabb69a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:01.093340 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-42fdab2e-e989-456b-a87b-1a26bfabb69a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1309 microversion: 2.1 time: 0.437926 Sep 06 11:20:01.094125 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2782/5511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:00 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1309 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:01.214553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-05a34ec8-ddf8-4ce7-8bd6-d9f254438202 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:01.229034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-05a34ec8-ddf8-4ce7-8bd6-d9f254438202 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:01.230662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-05a34ec8-ddf8-4ce7-8bd6-d9f254438202 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:01.232935 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-05a34ec8-ddf8-4ce7-8bd6-d9f254438202 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.391204 Sep 06 11:20:01.235084 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2730/5512] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:00 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:20:02.121679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0022cb3f-43a8-4e86-85e9-641eaeaac555 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:02.123430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0022cb3f-43a8-4e86-85e9-641eaeaac555 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:02.133421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0022cb3f-43a8-4e86-85e9-641eaeaac555 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:02.134319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0022cb3f-43a8-4e86-85e9-641eaeaac555 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:02.135003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0022cb3f-43a8-4e86-85e9-641eaeaac555 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:02.136274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0022cb3f-43a8-4e86-85e9-641eaeaac555 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:02.137011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0022cb3f-43a8-4e86-85e9-641eaeaac555 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:02.137940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0022cb3f-43a8-4e86-85e9-641eaeaac555 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:02.168024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-36b266d2-7824-41ee-944f-6fdb0e8460b5 req-09c59740-8ee6-4328-a7aa-d90e635b7197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257d9d0f-050a-4894-89ce-2d78dc8abebc", "tag": "387e33f3-5712-488b-af9a-66957c1fe401"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:02.183309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-36b266d2-7824-41ee-944f-6fdb0e8460b5 req-09c59740-8ee6-4328-a7aa-d90e635b7197 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:02.184965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-36b266d2-7824-41ee-944f-6fdb0e8460b5 req-09c59740-8ee6-4328-a7aa-d90e635b7197 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:02.185823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-36b266d2-7824-41ee-944f-6fdb0e8460b5 req-09c59740-8ee6-4328-a7aa-d90e635b7197 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:02.204476 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-36b266d2-7824-41ee-944f-6fdb0e8460b5 req-09c59740-8ee6-4328-a7aa-d90e635b7197 service nova] Creating event network-changed:387e33f3-5712-488b-af9a-66957c1fe401 for instance 257d9d0f-050a-4894-89ce-2d78dc8abebc on nch1-master-1 Sep 06 11:20:02.215214 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-36b266d2-7824-41ee-944f-6fdb0e8460b5 req-09c59740-8ee6-4328-a7aa-d90e635b7197 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050064 Sep 06 11:20:02.216513 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2731/5513] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:20:02.276021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b3be4af0-5151-4842-a748-8e1b683cfefd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:02.277084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b3be4af0-5151-4842-a748-8e1b683cfefd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:02.303999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3be4af0-5151-4842-a748-8e1b683cfefd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:02.305007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3be4af0-5151-4842-a748-8e1b683cfefd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:02.308096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3be4af0-5151-4842-a748-8e1b683cfefd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:02.309114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3be4af0-5151-4842-a748-8e1b683cfefd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:02.310262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3be4af0-5151-4842-a748-8e1b683cfefd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:02.312252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b3be4af0-5151-4842-a748-8e1b683cfefd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:02.397870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0022cb3f-43a8-4e86-85e9-641eaeaac555 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:02.406216 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0022cb3f-43a8-4e86-85e9-641eaeaac555 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1309 microversion: 2.1 time: 0.289476 Sep 06 11:20:02.431559 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2783/5514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:02 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1309 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:02.566911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b3be4af0-5151-4842-a748-8e1b683cfefd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:02.604727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b3be4af0-5151-4842-a748-8e1b683cfefd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:02.606570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b3be4af0-5151-4842-a748-8e1b683cfefd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:02.607449 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b3be4af0-5151-4842-a748-8e1b683cfefd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.337400 Sep 06 11:20:02.608023 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2732/5515] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:02 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:20:03.435269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a6037e58-3c1e-47f6-b65d-1bee708a2c37 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:03.437921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a6037e58-3c1e-47f6-b65d-1bee708a2c37 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:03.447328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6037e58-3c1e-47f6-b65d-1bee708a2c37 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:03.448582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6037e58-3c1e-47f6-b65d-1bee708a2c37 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:03.449326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6037e58-3c1e-47f6-b65d-1bee708a2c37 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:03.450722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6037e58-3c1e-47f6-b65d-1bee708a2c37 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:03.451603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6037e58-3c1e-47f6-b65d-1bee708a2c37 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:03.452275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6037e58-3c1e-47f6-b65d-1bee708a2c37 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:03.653141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a1e6ee5e-b7a1-4632-bc39-691e83f9783f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:03.654361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a1e6ee5e-b7a1-4632-bc39-691e83f9783f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:03.662424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1e6ee5e-b7a1-4632-bc39-691e83f9783f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:03.662925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1e6ee5e-b7a1-4632-bc39-691e83f9783f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:03.663404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1e6ee5e-b7a1-4632-bc39-691e83f9783f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:03.664125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1e6ee5e-b7a1-4632-bc39-691e83f9783f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:03.664591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1e6ee5e-b7a1-4632-bc39-691e83f9783f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:03.665028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1e6ee5e-b7a1-4632-bc39-691e83f9783f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:03.666140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a6037e58-3c1e-47f6-b65d-1bee708a2c37 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:03.687153 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a6037e58-3c1e-47f6-b65d-1bee708a2c37 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1309 microversion: 2.1 time: 0.255197 Sep 06 11:20:03.700389 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2784/5516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:03 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1309 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:03.909324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a1e6ee5e-b7a1-4632-bc39-691e83f9783f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:03.926053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a1e6ee5e-b7a1-4632-bc39-691e83f9783f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:03.927611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a1e6ee5e-b7a1-4632-bc39-691e83f9783f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:03.929362 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a1e6ee5e-b7a1-4632-bc39-691e83f9783f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.287570 Sep 06 11:20:03.930590 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2733/5517] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:03 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:20:04.728405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f3681463-1766-4a05-beb5-0eb9ab53defd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:04.729766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f3681463-1766-4a05-beb5-0eb9ab53defd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:04.749477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3681463-1766-4a05-beb5-0eb9ab53defd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:04.751495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3681463-1766-4a05-beb5-0eb9ab53defd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:04.752821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3681463-1766-4a05-beb5-0eb9ab53defd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:04.753867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3681463-1766-4a05-beb5-0eb9ab53defd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:04.755526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3681463-1766-4a05-beb5-0eb9ab53defd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:04.756257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3681463-1766-4a05-beb5-0eb9ab53defd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:04.966321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c7ab76e4-7ae4-46cf-82a4-b153cfbd0140 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:04.969515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c7ab76e4-7ae4-46cf-82a4-b153cfbd0140 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:04.979350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7ab76e4-7ae4-46cf-82a4-b153cfbd0140 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:04.980225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7ab76e4-7ae4-46cf-82a4-b153cfbd0140 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:04.980957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7ab76e4-7ae4-46cf-82a4-b153cfbd0140 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:04.981943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7ab76e4-7ae4-46cf-82a4-b153cfbd0140 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:04.982699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7ab76e4-7ae4-46cf-82a4-b153cfbd0140 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:04.983393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7ab76e4-7ae4-46cf-82a4-b153cfbd0140 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:05.447885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f3681463-1766-4a05-beb5-0eb9ab53defd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:05.471844 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f3681463-1766-4a05-beb5-0eb9ab53defd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1309 microversion: 2.1 time: 0.744045 Sep 06 11:20:05.475777 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2785/5518] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:04 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1309 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:05.492591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c7ab76e4-7ae4-46cf-82a4-b153cfbd0140 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:05.506946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c7ab76e4-7ae4-46cf-82a4-b153cfbd0140 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:05.509507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c7ab76e4-7ae4-46cf-82a4-b153cfbd0140 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:05.523556 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c7ab76e4-7ae4-46cf-82a4-b153cfbd0140 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.566590 Sep 06 11:20:05.526235 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2734/5519] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:04 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:20:06.500527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7efb0dc6-39cc-4402-987b-75ec71d5892b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:06.501246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7efb0dc6-39cc-4402-987b-75ec71d5892b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:06.505165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:06.511340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7efb0dc6-39cc-4402-987b-75ec71d5892b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:06.511340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7efb0dc6-39cc-4402-987b-75ec71d5892b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:06.519211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7efb0dc6-39cc-4402-987b-75ec71d5892b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:06.519211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7efb0dc6-39cc-4402-987b-75ec71d5892b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:06.519211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7efb0dc6-39cc-4402-987b-75ec71d5892b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:06.519211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7efb0dc6-39cc-4402-987b-75ec71d5892b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:06.563704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c49e96c-1abf-497a-8c22-9a93f2753e96 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:06.565092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9c49e96c-1abf-497a-8c22-9a93f2753e96 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:06.574201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:06.574201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:06.574990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c49e96c-1abf-497a-8c22-9a93f2753e96 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:06.576269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c49e96c-1abf-497a-8c22-9a93f2753e96 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:06.576852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c49e96c-1abf-497a-8c22-9a93f2753e96 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:06.577736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c49e96c-1abf-497a-8c22-9a93f2753e96 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:06.578302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c49e96c-1abf-497a-8c22-9a93f2753e96 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:06.578941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c49e96c-1abf-497a-8c22-9a93f2753e96 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:06.733723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7efb0dc6-39cc-4402-987b-75ec71d5892b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:06.753531 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7efb0dc6-39cc-4402-987b-75ec71d5892b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1309 microversion: 2.1 time: 0.253270 Sep 06 11:20:06.753531 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2786/5520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:06 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1309 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:06.793721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c49e96c-1abf-497a-8c22-9a93f2753e96 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:06.818589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c49e96c-1abf-497a-8c22-9a93f2753e96 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:06.821133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c49e96c-1abf-497a-8c22-9a93f2753e96 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:06.822477 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9c49e96c-1abf-497a-8c22-9a93f2753e96 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.270298 Sep 06 11:20:06.823086 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2735/5521] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:06 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:20:07.776572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-24619b5c-fa65-4014-b06d-5d0bf1aab5d0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:07.778227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-24619b5c-fa65-4014-b06d-5d0bf1aab5d0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:07.785942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24619b5c-fa65-4014-b06d-5d0bf1aab5d0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:07.786427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24619b5c-fa65-4014-b06d-5d0bf1aab5d0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:07.787089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24619b5c-fa65-4014-b06d-5d0bf1aab5d0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:07.788026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24619b5c-fa65-4014-b06d-5d0bf1aab5d0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:07.788488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24619b5c-fa65-4014-b06d-5d0bf1aab5d0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:07.788914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24619b5c-fa65-4014-b06d-5d0bf1aab5d0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:07.843117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-5816b907-6036-4160-a385-a2cf30379e24 req-628b3e8b-5837-4c9c-b564-3f28de652fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257d9d0f-050a-4894-89ce-2d78dc8abebc", "name": "network-vif-plugged", "status": "completed", "tag": "387e33f3-5712-488b-af9a-66957c1fe401"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:07.859937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5816b907-6036-4160-a385-a2cf30379e24 req-628b3e8b-5837-4c9c-b564-3f28de652fe6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:07.860502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5816b907-6036-4160-a385-a2cf30379e24 req-628b3e8b-5837-4c9c-b564-3f28de652fe6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:07.861019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5816b907-6036-4160-a385-a2cf30379e24 req-628b3e8b-5837-4c9c-b564-3f28de652fe6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:07.877777 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5816b907-6036-4160-a385-a2cf30379e24 req-628b3e8b-5837-4c9c-b564-3f28de652fe6 service nova] Creating event network-vif-plugged:387e33f3-5712-488b-af9a-66957c1fe401 for instance 257d9d0f-050a-4894-89ce-2d78dc8abebc on nch1-master-1 Sep 06 11:20:07.884030 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-5816b907-6036-4160-a385-a2cf30379e24 req-628b3e8b-5837-4c9c-b564-3f28de652fe6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060747 Sep 06 11:20:07.889408 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2736/5522] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:20:07.897146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8f909d17-9c88-4ca5-8828-5e92d8e74649 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:07.898093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8f909d17-9c88-4ca5-8828-5e92d8e74649 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:07.906328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f909d17-9c88-4ca5-8828-5e92d8e74649 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:07.907266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f909d17-9c88-4ca5-8828-5e92d8e74649 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:07.907867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f909d17-9c88-4ca5-8828-5e92d8e74649 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:07.912112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f909d17-9c88-4ca5-8828-5e92d8e74649 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:07.912723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f909d17-9c88-4ca5-8828-5e92d8e74649 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:07.913314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f909d17-9c88-4ca5-8828-5e92d8e74649 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:07.985898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-24619b5c-fa65-4014-b06d-5d0bf1aab5d0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:07.999995 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-24619b5c-fa65-4014-b06d-5d0bf1aab5d0 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1309 microversion: 2.1 time: 0.228221 Sep 06 11:20:08.005943 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2787/5523] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:07 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1309 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:08.153310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8f909d17-9c88-4ca5-8828-5e92d8e74649 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:08.161609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8f909d17-9c88-4ca5-8828-5e92d8e74649 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:08.162234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8f909d17-9c88-4ca5-8828-5e92d8e74649 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:08.163496 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8f909d17-9c88-4ca5-8828-5e92d8e74649 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.272346 Sep 06 11:20:08.164094 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2737/5524] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:07 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:20:09.030194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3bb633dd-bad7-42fc-99be-a45f83103912 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:09.030787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3bb633dd-bad7-42fc-99be-a45f83103912 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:09.038301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bb633dd-bad7-42fc-99be-a45f83103912 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:09.038810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bb633dd-bad7-42fc-99be-a45f83103912 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:09.039287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bb633dd-bad7-42fc-99be-a45f83103912 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:09.040008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bb633dd-bad7-42fc-99be-a45f83103912 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:09.040472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bb633dd-bad7-42fc-99be-a45f83103912 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:09.040948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bb633dd-bad7-42fc-99be-a45f83103912 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:09.179444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3bb633dd-bad7-42fc-99be-a45f83103912 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:09.189806 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3bb633dd-bad7-42fc-99be-a45f83103912 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1309 microversion: 2.1 time: 0.163109 Sep 06 11:20:09.190010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-af2135ee-4617-4dc5-8448-2162bf3ef9d8 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:09.199911 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2788/5525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:09 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1309 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:09.200051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-af2135ee-4617-4dc5-8448-2162bf3ef9d8 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:09.200051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af2135ee-4617-4dc5-8448-2162bf3ef9d8 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:09.200051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af2135ee-4617-4dc5-8448-2162bf3ef9d8 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:09.200051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af2135ee-4617-4dc5-8448-2162bf3ef9d8 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:09.200051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af2135ee-4617-4dc5-8448-2162bf3ef9d8 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:09.200462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af2135ee-4617-4dc5-8448-2162bf3ef9d8 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:09.201152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af2135ee-4617-4dc5-8448-2162bf3ef9d8 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:09.361354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af2135ee-4617-4dc5-8448-2162bf3ef9d8 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:09.371659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af2135ee-4617-4dc5-8448-2162bf3ef9d8 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:09.374374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af2135ee-4617-4dc5-8448-2162bf3ef9d8 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:09.374880 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-af2135ee-4617-4dc5-8448-2162bf3ef9d8 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.189543 Sep 06 11:20:09.375482 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2738/5526] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:09 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:20:10.214018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ae5fb947-cf7e-4bd2-bf89-79a4d1f9c196 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:10.214686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ae5fb947-cf7e-4bd2-bf89-79a4d1f9c196 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:10.222593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae5fb947-cf7e-4bd2-bf89-79a4d1f9c196 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:10.223117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae5fb947-cf7e-4bd2-bf89-79a4d1f9c196 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:10.223559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae5fb947-cf7e-4bd2-bf89-79a4d1f9c196 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:10.224378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae5fb947-cf7e-4bd2-bf89-79a4d1f9c196 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:10.224841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae5fb947-cf7e-4bd2-bf89-79a4d1f9c196 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:10.225271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae5fb947-cf7e-4bd2-bf89-79a4d1f9c196 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:10.373461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ae5fb947-cf7e-4bd2-bf89-79a4d1f9c196 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:10.384829 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ae5fb947-cf7e-4bd2-bf89-79a4d1f9c196 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1491 microversion: 2.1 time: 0.172296 Sep 06 11:20:10.384829 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2789/5527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:10 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1491 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:10.402302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a8fb5408-8e5d-40f3-829a-b6cab3ca3c08 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:10.403059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a8fb5408-8e5d-40f3-829a-b6cab3ca3c08 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:10.405171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-829ec49a-9612-45c6-9330-09025408ce02 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:10.410504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-829ec49a-9612-45c6-9330-09025408ce02 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:10.411729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8fb5408-8e5d-40f3-829a-b6cab3ca3c08 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:10.415746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8fb5408-8e5d-40f3-829a-b6cab3ca3c08 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:10.415746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8fb5408-8e5d-40f3-829a-b6cab3ca3c08 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:10.415746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8fb5408-8e5d-40f3-829a-b6cab3ca3c08 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:10.415746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8fb5408-8e5d-40f3-829a-b6cab3ca3c08 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:10.415746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8fb5408-8e5d-40f3-829a-b6cab3ca3c08 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:10.416316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-829ec49a-9612-45c6-9330-09025408ce02 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:10.416316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-829ec49a-9612-45c6-9330-09025408ce02 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:10.416316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-829ec49a-9612-45c6-9330-09025408ce02 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:10.416662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-829ec49a-9612-45c6-9330-09025408ce02 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:10.418913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-829ec49a-9612-45c6-9330-09025408ce02 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:10.418913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-829ec49a-9612-45c6-9330-09025408ce02 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:10.560020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a8fb5408-8e5d-40f3-829a-b6cab3ca3c08 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:10.570153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a8fb5408-8e5d-40f3-829a-b6cab3ca3c08 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:10.571657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a8fb5408-8e5d-40f3-829a-b6cab3ca3c08 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:10.573009 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a8fb5408-8e5d-40f3-829a-b6cab3ca3c08 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.174968 Sep 06 11:20:10.573592 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2739/5528] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:10 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:20:10.609416 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-829ec49a-9612-45c6-9330-09025408ce02 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "PUT /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1086 microversion: 2.1 time: 0.208170 Sep 06 11:20:10.610308 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2790/5529] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Sep 6 11:20:10 2022] PUT /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1086 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:20:10.630126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c1ebf0fb-01db-4f22-a4e4-77f2afdaa3cf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:10.631720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c1ebf0fb-01db-4f22-a4e4-77f2afdaa3cf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:10.637833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1ebf0fb-01db-4f22-a4e4-77f2afdaa3cf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:10.638394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1ebf0fb-01db-4f22-a4e4-77f2afdaa3cf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:10.638842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1ebf0fb-01db-4f22-a4e4-77f2afdaa3cf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:10.639629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1ebf0fb-01db-4f22-a4e4-77f2afdaa3cf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:10.640103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1ebf0fb-01db-4f22-a4e4-77f2afdaa3cf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:10.640690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1ebf0fb-01db-4f22-a4e4-77f2afdaa3cf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:10.853074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c1ebf0fb-01db-4f22-a4e4-77f2afdaa3cf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:10.863882 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c1ebf0fb-01db-4f22-a4e4-77f2afdaa3cf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1512 microversion: 2.1 time: 0.237029 Sep 06 11:20:10.863882 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2740/5530] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:10 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:10.884921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e55e6174-bc25-4dbf-9c1f-ee5f92b41f5f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:10.885639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e55e6174-bc25-4dbf-9c1f-ee5f92b41f5f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:10.892156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e55e6174-bc25-4dbf-9c1f-ee5f92b41f5f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:10.897095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e55e6174-bc25-4dbf-9c1f-ee5f92b41f5f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:10.897095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e55e6174-bc25-4dbf-9c1f-ee5f92b41f5f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:10.897095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e55e6174-bc25-4dbf-9c1f-ee5f92b41f5f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:10.897095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e55e6174-bc25-4dbf-9c1f-ee5f92b41f5f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:10.897095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e55e6174-bc25-4dbf-9c1f-ee5f92b41f5f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:11.050471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e55e6174-bc25-4dbf-9c1f-ee5f92b41f5f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:11.058649 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e55e6174-bc25-4dbf-9c1f-ee5f92b41f5f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1512 microversion: 2.1 time: 0.177671 Sep 06 11:20:11.059291 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2791/5531] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:10 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:11.081427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f101c46e-1b12-44e1-a811-a2597e8733c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:11.082074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f101c46e-1b12-44e1-a811-a2597e8733c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:11.088274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f101c46e-1b12-44e1-a811-a2597e8733c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:11.096271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f101c46e-1b12-44e1-a811-a2597e8733c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:11.096271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f101c46e-1b12-44e1-a811-a2597e8733c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:11.096271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f101c46e-1b12-44e1-a811-a2597e8733c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:11.096271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f101c46e-1b12-44e1-a811-a2597e8733c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:11.096271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f101c46e-1b12-44e1-a811-a2597e8733c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:11.117984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f101c46e-1b12-44e1-a811-a2597e8733c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:20:11.601553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1d9a11ca-259f-455b-b5b4-cb9d2c73b99f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:11.602236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1d9a11ca-259f-455b-b5b4-cb9d2c73b99f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:11.612126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d9a11ca-259f-455b-b5b4-cb9d2c73b99f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:11.612627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d9a11ca-259f-455b-b5b4-cb9d2c73b99f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:11.613102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d9a11ca-259f-455b-b5b4-cb9d2c73b99f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:11.613834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d9a11ca-259f-455b-b5b4-cb9d2c73b99f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:11.614266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d9a11ca-259f-455b-b5b4-cb9d2c73b99f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:11.614722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d9a11ca-259f-455b-b5b4-cb9d2c73b99f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:11.778949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d9a11ca-259f-455b-b5b4-cb9d2c73b99f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:11.781123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:11.790724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d9a11ca-259f-455b-b5b4-cb9d2c73b99f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:11.794161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d9a11ca-259f-455b-b5b4-cb9d2c73b99f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:11.796546 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1d9a11ca-259f-455b-b5b4-cb9d2c73b99f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.200512 Sep 06 11:20:11.797673 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2792/5532] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:11 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:20:11.936807 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f101c46e-1b12-44e1-a811-a2597e8733c1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 204 len: 0 microversion: 2.1 time: 0.858947 Sep 06 11:20:11.937535 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2741/5533] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:20:11 2022] DELETE /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 0 bytes in 861 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:20:11.945920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-021470f3-3b52-408a-92f6-c0581e474902 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:11.946554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-021470f3-3b52-408a-92f6-c0581e474902 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:11.953402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-021470f3-3b52-408a-92f6-c0581e474902 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:11.953903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-021470f3-3b52-408a-92f6-c0581e474902 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:11.954351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-021470f3-3b52-408a-92f6-c0581e474902 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:11.955631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-021470f3-3b52-408a-92f6-c0581e474902 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:11.956099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-021470f3-3b52-408a-92f6-c0581e474902 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:11.956535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-021470f3-3b52-408a-92f6-c0581e474902 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:12.130681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-021470f3-3b52-408a-92f6-c0581e474902 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:12.139139 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-021470f3-3b52-408a-92f6-c0581e474902 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1518 microversion: 2.1 time: 0.197117 Sep 06 11:20:12.151771 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2793/5534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:11 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1518 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:12.825087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9122db87-bf73-4038-a76a-8438b22beffe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:12.825924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9122db87-bf73-4038-a76a-8438b22beffe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:12.834746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9122db87-bf73-4038-a76a-8438b22beffe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:12.835294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9122db87-bf73-4038-a76a-8438b22beffe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:12.835754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9122db87-bf73-4038-a76a-8438b22beffe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:12.836469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9122db87-bf73-4038-a76a-8438b22beffe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:12.837151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9122db87-bf73-4038-a76a-8438b22beffe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:12.837671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9122db87-bf73-4038-a76a-8438b22beffe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:12.978480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9122db87-bf73-4038-a76a-8438b22beffe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:12.989527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9122db87-bf73-4038-a76a-8438b22beffe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:12.991060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9122db87-bf73-4038-a76a-8438b22beffe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:12.992314 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9122db87-bf73-4038-a76a-8438b22beffe tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.171583 Sep 06 11:20:12.992915 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2742/5535] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:12 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:20:13.163632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3daf505a-fb53-4eba-a123-40ac0e6ab22f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:13.164256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3daf505a-fb53-4eba-a123-40ac0e6ab22f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:13.173288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3daf505a-fb53-4eba-a123-40ac0e6ab22f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:13.173288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3daf505a-fb53-4eba-a123-40ac0e6ab22f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:13.173288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3daf505a-fb53-4eba-a123-40ac0e6ab22f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:13.173288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3daf505a-fb53-4eba-a123-40ac0e6ab22f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:13.173288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3daf505a-fb53-4eba-a123-40ac0e6ab22f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:13.181769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3daf505a-fb53-4eba-a123-40ac0e6ab22f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:13.319589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3daf505a-fb53-4eba-a123-40ac0e6ab22f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:13.328356 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3daf505a-fb53-4eba-a123-40ac0e6ab22f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1518 microversion: 2.1 time: 0.168599 Sep 06 11:20:13.329039 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2794/5536] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:13 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:13.803316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-c5bc416d-5a7e-435e-a091-abef11810b83 req-6c3e9cbe-ad51-4d01-83bb-d55b35ce53ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257d9d0f-050a-4894-89ce-2d78dc8abebc", "name": "network-vif-deleted", "tag": "387e33f3-5712-488b-af9a-66957c1fe401"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:13.820924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c5bc416d-5a7e-435e-a091-abef11810b83 req-6c3e9cbe-ad51-4d01-83bb-d55b35ce53ae service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:13.821709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c5bc416d-5a7e-435e-a091-abef11810b83 req-6c3e9cbe-ad51-4d01-83bb-d55b35ce53ae service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:13.822359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c5bc416d-5a7e-435e-a091-abef11810b83 req-6c3e9cbe-ad51-4d01-83bb-d55b35ce53ae service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:13.840228 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-c5bc416d-5a7e-435e-a091-abef11810b83 req-6c3e9cbe-ad51-4d01-83bb-d55b35ce53ae service nova] Creating event network-vif-deleted:387e33f3-5712-488b-af9a-66957c1fe401 for instance 257d9d0f-050a-4894-89ce-2d78dc8abebc on nch1-master-1 Sep 06 11:20:13.848518 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-c5bc416d-5a7e-435e-a091-abef11810b83 req-6c3e9cbe-ad51-4d01-83bb-d55b35ce53ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049694 Sep 06 11:20:13.849974 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2743/5537] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:20:14.028457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-97029975-e5ca-484d-9771-538a97810234 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:14.029476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-97029975-e5ca-484d-9771-538a97810234 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:14.051868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97029975-e5ca-484d-9771-538a97810234 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:14.053232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97029975-e5ca-484d-9771-538a97810234 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:14.053984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97029975-e5ca-484d-9771-538a97810234 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:14.054792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97029975-e5ca-484d-9771-538a97810234 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:14.055524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97029975-e5ca-484d-9771-538a97810234 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:14.056025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97029975-e5ca-484d-9771-538a97810234 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:14.134750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6af15a38-e0ce-4be6-a432-63e291d310d6 req-7935bb43-e7a6-4ed9-91a5-38941f70ef8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72fceff4-8a80-43f9-88f2-fd73e1eed3e3", "name": "network-vif-plugged", "status": "completed", "tag": "921e3ee1-fb50-4f0c-80ae-7a517b1fdc23"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:14.148117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6af15a38-e0ce-4be6-a432-63e291d310d6 req-7935bb43-e7a6-4ed9-91a5-38941f70ef8d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:14.148650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6af15a38-e0ce-4be6-a432-63e291d310d6 req-7935bb43-e7a6-4ed9-91a5-38941f70ef8d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:14.149300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6af15a38-e0ce-4be6-a432-63e291d310d6 req-7935bb43-e7a6-4ed9-91a5-38941f70ef8d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:14.171282 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6af15a38-e0ce-4be6-a432-63e291d310d6 req-7935bb43-e7a6-4ed9-91a5-38941f70ef8d service nova] Creating event network-vif-plugged:921e3ee1-fb50-4f0c-80ae-7a517b1fdc23 for instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 on nch2-master-1 Sep 06 11:20:14.178849 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6af15a38-e0ce-4be6-a432-63e291d310d6 req-7935bb43-e7a6-4ed9-91a5-38941f70ef8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048750 Sep 06 11:20:14.179945 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2744/5538] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:20:14.230552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-97029975-e5ca-484d-9771-538a97810234 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:14.246714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-97029975-e5ca-484d-9771-538a97810234 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:14.248323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-97029975-e5ca-484d-9771-538a97810234 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:14.249539 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-97029975-e5ca-484d-9771-538a97810234 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.226435 Sep 06 11:20:14.250183 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2795/5539] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:14 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:20:14.353309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:14.354193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:14.363267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:14.363759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:14.364200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:14.364910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:14.365408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:14.365846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:14.369531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:14.402888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:14.403421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:14.403870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:14.404332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lazy-loading 'fault' on Instance uuid 257d9d0f-050a-4894-89ce-2d78dc8abebc {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:20:14.467078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:14.476407 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a275d383-25c2-4bd9-b6eb-5ef3092aeda1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 200 len: 1320 microversion: 2.1 time: 0.127388 Sep 06 11:20:14.477353 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2745/5540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:14 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 1320 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:15.278304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-637f3758-04a7-4bf2-afbc-f1f5f8427852 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:15.278950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-637f3758-04a7-4bf2-afbc-f1f5f8427852 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:15.286074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-637f3758-04a7-4bf2-afbc-f1f5f8427852 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:15.286564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-637f3758-04a7-4bf2-afbc-f1f5f8427852 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:15.287029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-637f3758-04a7-4bf2-afbc-f1f5f8427852 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:15.287740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-637f3758-04a7-4bf2-afbc-f1f5f8427852 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:15.288199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-637f3758-04a7-4bf2-afbc-f1f5f8427852 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:15.288627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-637f3758-04a7-4bf2-afbc-f1f5f8427852 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:15.291294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:15.430076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-637f3758-04a7-4bf2-afbc-f1f5f8427852 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:15.439027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-637f3758-04a7-4bf2-afbc-f1f5f8427852 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:15.441095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-637f3758-04a7-4bf2-afbc-f1f5f8427852 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:15.442280 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-637f3758-04a7-4bf2-afbc-f1f5f8427852 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.168209 Sep 06 11:20:15.442870 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2796/5541] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:15 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:20:15.500572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8406a0b2-f0f6-4c10-ab63-c3d883f8f976 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:15.501252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8406a0b2-f0f6-4c10-ab63-c3d883f8f976 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:15.509873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8406a0b2-f0f6-4c10-ab63-c3d883f8f976 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:15.510373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8406a0b2-f0f6-4c10-ab63-c3d883f8f976 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:15.510826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8406a0b2-f0f6-4c10-ab63-c3d883f8f976 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:15.511609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8406a0b2-f0f6-4c10-ab63-c3d883f8f976 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:15.512074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8406a0b2-f0f6-4c10-ab63-c3d883f8f976 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:15.512512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8406a0b2-f0f6-4c10-ab63-c3d883f8f976 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:15.526510 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-8406a0b2-f0f6-4c10-ab63-c3d883f8f976 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8406a0b2-f0f6-4c10-ab63-c3d883f8f976 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc HTTP/1.1 Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '257d9d0f-050a-4894-89ce-2d78dc8abebc'} Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:20:15.528235 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:20:15.532918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:20:15.532918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:20:15.532918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:20:15.532918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:20:15.532918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:20:15.532918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:20:15.532918 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:20:15.532918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8406a0b2-f0f6-4c10-ab63-c3d883f8f976 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:20:15.532918 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8406a0b2-f0f6-4c10-ab63-c3d883f8f976 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 404 len: 111 microversion: 2.1 time: 0.033217 Sep 06 11:20:15.532918 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2746/5542] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:15 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:20:15.726766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-687678458", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "74ae681a-5964-499e-a86a-13cffa0cf1b0"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:15.786022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] validate_networks() for [('74ae681a-5964-499e-a86a-13cffa0cf1b0', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:20:16.213874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:20:16.214811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:20:16.215512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:20:16.215935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:20:16.216392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:20:16.218393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:16.227415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:16.228010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:16.228479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:16.229228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:16.229699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:16.230200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:16.258160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:20:16.264971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Getting quotas for user acce3e06ce4d40ba8db7988456cf8787 and project f2390b2ea3104bdab3ecdcae0dc415b7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:20:16.279527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:20:16.281974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:20:16.438094 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a4d94e27-6c7a-4331-bca0-aa189db0ae22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714891 Sep 06 11:20:16.439398 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2797/5543] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:20:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:20:16.451208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4c64d627-cdc5-482f-a101-455ee631787c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:16.451845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4c64d627-cdc5-482f-a101-455ee631787c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:16.468033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4fb7d1d8-09c7-422a-aa07-e3934ced3b0d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:16.468657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4fb7d1d8-09c7-422a-aa07-e3934ced3b0d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:16.477295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fb7d1d8-09c7-422a-aa07-e3934ced3b0d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:16.478032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fb7d1d8-09c7-422a-aa07-e3934ced3b0d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:16.478674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fb7d1d8-09c7-422a-aa07-e3934ced3b0d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:16.479458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fb7d1d8-09c7-422a-aa07-e3934ced3b0d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:16.479962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fb7d1d8-09c7-422a-aa07-e3934ced3b0d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:16.480409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4fb7d1d8-09c7-422a-aa07-e3934ced3b0d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:16.545800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4c64d627-cdc5-482f-a101-455ee631787c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:16.560834 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4c64d627-cdc5-482f-a101-455ee631787c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1208 microversion: 2.1 time: 0.113627 Sep 06 11:20:16.562271 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2747/5544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:16 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1208 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:16.687974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4fb7d1d8-09c7-422a-aa07-e3934ced3b0d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:16.701453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4fb7d1d8-09c7-422a-aa07-e3934ced3b0d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:16.703628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4fb7d1d8-09c7-422a-aa07-e3934ced3b0d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:16.705836 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4fb7d1d8-09c7-422a-aa07-e3934ced3b0d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.241791 Sep 06 11:20:16.706973 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2798/5545] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:16 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:20:17.585588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5254cbbd-2730-443c-b35c-74176ce12a09 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:17.586270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5254cbbd-2730-443c-b35c-74176ce12a09 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:17.594025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5254cbbd-2730-443c-b35c-74176ce12a09 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:17.594523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5254cbbd-2730-443c-b35c-74176ce12a09 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:17.599253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5254cbbd-2730-443c-b35c-74176ce12a09 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:17.599253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5254cbbd-2730-443c-b35c-74176ce12a09 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:17.599253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5254cbbd-2730-443c-b35c-74176ce12a09 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:17.599253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5254cbbd-2730-443c-b35c-74176ce12a09 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:17.675432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5254cbbd-2730-443c-b35c-74176ce12a09 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:17.684053 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5254cbbd-2730-443c-b35c-74176ce12a09 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1212 microversion: 2.1 time: 0.102855 Sep 06 11:20:17.686564 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2748/5546] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:17 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1212 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:17.734379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3baaae4e-5878-467d-91f3-96e3a098ac83 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:17.739331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3baaae4e-5878-467d-91f3-96e3a098ac83 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:17.747796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3baaae4e-5878-467d-91f3-96e3a098ac83 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:17.751960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3baaae4e-5878-467d-91f3-96e3a098ac83 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:17.751960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3baaae4e-5878-467d-91f3-96e3a098ac83 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:17.751960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3baaae4e-5878-467d-91f3-96e3a098ac83 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:17.751960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3baaae4e-5878-467d-91f3-96e3a098ac83 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:17.751960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3baaae4e-5878-467d-91f3-96e3a098ac83 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:17.927697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3baaae4e-5878-467d-91f3-96e3a098ac83 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:17.937325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3baaae4e-5878-467d-91f3-96e3a098ac83 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:17.938831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3baaae4e-5878-467d-91f3-96e3a098ac83 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:17.940320 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3baaae4e-5878-467d-91f3-96e3a098ac83 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1805 microversion: 2.20 time: 0.210379 Sep 06 11:20:17.940886 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2799/5547] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:17 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1805 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:20:18.724942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b65f24f0-6b8e-4544-aa03-b3f6403d6156 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:18.725493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b65f24f0-6b8e-4544-aa03-b3f6403d6156 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:18.733216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b65f24f0-6b8e-4544-aa03-b3f6403d6156 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:18.733720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b65f24f0-6b8e-4544-aa03-b3f6403d6156 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:18.734166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b65f24f0-6b8e-4544-aa03-b3f6403d6156 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:18.735131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b65f24f0-6b8e-4544-aa03-b3f6403d6156 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:18.735597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b65f24f0-6b8e-4544-aa03-b3f6403d6156 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:18.736595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b65f24f0-6b8e-4544-aa03-b3f6403d6156 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:18.808645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b65f24f0-6b8e-4544-aa03-b3f6403d6156 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:18.817141 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b65f24f0-6b8e-4544-aa03-b3f6403d6156 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1268 microversion: 2.1 time: 0.103966 Sep 06 11:20:18.828937 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2749/5548] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:18 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1268 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:18.971532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-de030048-9d43-4dda-8eac-d013e090e8da tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:18.972562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-de030048-9d43-4dda-8eac-d013e090e8da tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:18.978871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de030048-9d43-4dda-8eac-d013e090e8da tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:18.979323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de030048-9d43-4dda-8eac-d013e090e8da tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:18.979943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de030048-9d43-4dda-8eac-d013e090e8da tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:18.980645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de030048-9d43-4dda-8eac-d013e090e8da tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:18.981104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de030048-9d43-4dda-8eac-d013e090e8da tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:18.981665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de030048-9d43-4dda-8eac-d013e090e8da tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:19.155197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-de030048-9d43-4dda-8eac-d013e090e8da tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:19.165699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-de030048-9d43-4dda-8eac-d013e090e8da tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:19.167321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-de030048-9d43-4dda-8eac-d013e090e8da tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:19.168718 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-de030048-9d43-4dda-8eac-d013e090e8da tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1792 microversion: 2.20 time: 0.202842 Sep 06 11:20:19.169633 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2800/5549] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:18 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1792 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:20:19.848441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-16ab006c-41f9-49a9-82c6-2d1a8d31924d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:19.848441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-16ab006c-41f9-49a9-82c6-2d1a8d31924d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:19.855371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-16ab006c-41f9-49a9-82c6-2d1a8d31924d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:19.855904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-16ab006c-41f9-49a9-82c6-2d1a8d31924d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:19.856892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-16ab006c-41f9-49a9-82c6-2d1a8d31924d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:19.857637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-16ab006c-41f9-49a9-82c6-2d1a8d31924d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:19.858104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-16ab006c-41f9-49a9-82c6-2d1a8d31924d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:19.858572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-16ab006c-41f9-49a9-82c6-2d1a8d31924d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:20.031869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-16ab006c-41f9-49a9-82c6-2d1a8d31924d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:20.042725 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-16ab006c-41f9-49a9-82c6-2d1a8d31924d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1308 microversion: 2.1 time: 0.201950 Sep 06 11:20:20.043872 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2750/5550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:19 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1308 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:20.653043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-3eab75f8-eee9-46e1-aaca-8c886ccc6189 req-b5675772-f08c-4613-8cf0-6d69590ccc60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd97411-39ce-447c-ae34-39bb9e617364", "tag": "8fd7f589-8c4b-464e-8414-75a9d25fac62"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:20.664447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3eab75f8-eee9-46e1-aaca-8c886ccc6189 req-b5675772-f08c-4613-8cf0-6d69590ccc60 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:20.664955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3eab75f8-eee9-46e1-aaca-8c886ccc6189 req-b5675772-f08c-4613-8cf0-6d69590ccc60 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:20.665390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3eab75f8-eee9-46e1-aaca-8c886ccc6189 req-b5675772-f08c-4613-8cf0-6d69590ccc60 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:20.677592 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-3eab75f8-eee9-46e1-aaca-8c886ccc6189 req-b5675772-f08c-4613-8cf0-6d69590ccc60 service nova] Creating event network-changed:8fd7f589-8c4b-464e-8414-75a9d25fac62 for instance 4cd97411-39ce-447c-ae34-39bb9e617364 on nch1-master-1 Sep 06 11:20:20.683544 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-3eab75f8-eee9-46e1-aaca-8c886ccc6189 req-b5675772-f08c-4613-8cf0-6d69590ccc60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034972 Sep 06 11:20:20.685822 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2801/5551] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:20:21.070747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a83e3335-1a61-4707-860f-e1c40bc05c00 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:21.071533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a83e3335-1a61-4707-860f-e1c40bc05c00 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:21.079503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a83e3335-1a61-4707-860f-e1c40bc05c00 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:21.080706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a83e3335-1a61-4707-860f-e1c40bc05c00 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:21.081193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a83e3335-1a61-4707-860f-e1c40bc05c00 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:21.081912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a83e3335-1a61-4707-860f-e1c40bc05c00 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:21.082414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a83e3335-1a61-4707-860f-e1c40bc05c00 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:21.083100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a83e3335-1a61-4707-860f-e1c40bc05c00 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:21.231648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a83e3335-1a61-4707-860f-e1c40bc05c00 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:21.240125 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a83e3335-1a61-4707-860f-e1c40bc05c00 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1308 microversion: 2.1 time: 0.173405 Sep 06 11:20:21.240739 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2751/5552] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:21 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:22.268874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-553bcb8a-acdd-4257-8bdb-d83a744287bb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:22.270061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-553bcb8a-acdd-4257-8bdb-d83a744287bb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:22.281266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-553bcb8a-acdd-4257-8bdb-d83a744287bb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:22.282321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-553bcb8a-acdd-4257-8bdb-d83a744287bb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:22.282848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-553bcb8a-acdd-4257-8bdb-d83a744287bb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:22.284374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-553bcb8a-acdd-4257-8bdb-d83a744287bb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:22.284916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-553bcb8a-acdd-4257-8bdb-d83a744287bb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:22.285500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-553bcb8a-acdd-4257-8bdb-d83a744287bb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:22.429194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-553bcb8a-acdd-4257-8bdb-d83a744287bb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:22.437207 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-553bcb8a-acdd-4257-8bdb-d83a744287bb tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1308 microversion: 2.1 time: 0.175696 Sep 06 11:20:22.437849 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2802/5553] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:22 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:20:23.462155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7f52eefc-c49b-4028-b974-07c755249d3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:23.462778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7f52eefc-c49b-4028-b974-07c755249d3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:23.470211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f52eefc-c49b-4028-b974-07c755249d3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:23.471246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f52eefc-c49b-4028-b974-07c755249d3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:23.471705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f52eefc-c49b-4028-b974-07c755249d3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:23.472423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f52eefc-c49b-4028-b974-07c755249d3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:23.472891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f52eefc-c49b-4028-b974-07c755249d3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:23.473327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f52eefc-c49b-4028-b974-07c755249d3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:23.894317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7f52eefc-c49b-4028-b974-07c755249d3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:23.902494 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7f52eefc-c49b-4028-b974-07c755249d3f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1308 microversion: 2.1 time: 0.444951 Sep 06 11:20:23.903099 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2752/5554] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:23 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:24.926390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-015088a6-65b9-4a5c-b667-11d24f3b6410 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:24.927031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-015088a6-65b9-4a5c-b667-11d24f3b6410 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:24.933979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-015088a6-65b9-4a5c-b667-11d24f3b6410 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:24.934466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-015088a6-65b9-4a5c-b667-11d24f3b6410 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:24.934910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-015088a6-65b9-4a5c-b667-11d24f3b6410 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:24.935649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-015088a6-65b9-4a5c-b667-11d24f3b6410 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:24.936112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-015088a6-65b9-4a5c-b667-11d24f3b6410 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:24.936546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-015088a6-65b9-4a5c-b667-11d24f3b6410 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:25.125773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-015088a6-65b9-4a5c-b667-11d24f3b6410 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:25.133796 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-015088a6-65b9-4a5c-b667-11d24f3b6410 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1308 microversion: 2.1 time: 0.211931 Sep 06 11:20:25.134400 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2803/5555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:24 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1308 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:25.794349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-45b798a6-552c-49c0-90ec-96c75f271cb2 req-5fc0da2b-cdad-4eef-ad8d-ab4d70da415b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd97411-39ce-447c-ae34-39bb9e617364", "name": "network-vif-plugged", "status": "completed", "tag": "8fd7f589-8c4b-464e-8414-75a9d25fac62"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:25.804686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-45b798a6-552c-49c0-90ec-96c75f271cb2 req-5fc0da2b-cdad-4eef-ad8d-ab4d70da415b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:25.805178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-45b798a6-552c-49c0-90ec-96c75f271cb2 req-5fc0da2b-cdad-4eef-ad8d-ab4d70da415b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:25.805640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-45b798a6-552c-49c0-90ec-96c75f271cb2 req-5fc0da2b-cdad-4eef-ad8d-ab4d70da415b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:25.817335 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-45b798a6-552c-49c0-90ec-96c75f271cb2 req-5fc0da2b-cdad-4eef-ad8d-ab4d70da415b service nova] Creating event network-vif-plugged:8fd7f589-8c4b-464e-8414-75a9d25fac62 for instance 4cd97411-39ce-447c-ae34-39bb9e617364 on nch1-master-1 Sep 06 11:20:25.822354 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-45b798a6-552c-49c0-90ec-96c75f271cb2 req-5fc0da2b-cdad-4eef-ad8d-ab4d70da415b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031879 Sep 06 11:20:25.822998 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2753/5556] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:20:26.157793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5fb91e3d-e6a5-4d37-ae9a-9f3f44ff8ae2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:26.158332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5fb91e3d-e6a5-4d37-ae9a-9f3f44ff8ae2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:26.165459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fb91e3d-e6a5-4d37-ae9a-9f3f44ff8ae2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:26.165942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fb91e3d-e6a5-4d37-ae9a-9f3f44ff8ae2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:26.166385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fb91e3d-e6a5-4d37-ae9a-9f3f44ff8ae2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:26.167102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fb91e3d-e6a5-4d37-ae9a-9f3f44ff8ae2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:26.167560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fb91e3d-e6a5-4d37-ae9a-9f3f44ff8ae2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:26.168053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fb91e3d-e6a5-4d37-ae9a-9f3f44ff8ae2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:26.246330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:26.272178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:26.299290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5fb91e3d-e6a5-4d37-ae9a-9f3f44ff8ae2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:26.306955 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5fb91e3d-e6a5-4d37-ae9a-9f3f44ff8ae2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1308 microversion: 2.1 time: 0.153152 Sep 06 11:20:26.307550 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2804/5557] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:26 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1308 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:27.327217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:27.333422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b4b294c5-b455-408e-9431-3f5af6275e32 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:27.334125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b4b294c5-b455-408e-9431-3f5af6275e32 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:27.340501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4b294c5-b455-408e-9431-3f5af6275e32 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:27.340983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4b294c5-b455-408e-9431-3f5af6275e32 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:27.341420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4b294c5-b455-408e-9431-3f5af6275e32 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:27.342116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4b294c5-b455-408e-9431-3f5af6275e32 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:27.342573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4b294c5-b455-408e-9431-3f5af6275e32 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:27.343030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b4b294c5-b455-408e-9431-3f5af6275e32 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:27.474427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b4b294c5-b455-408e-9431-3f5af6275e32 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:27.482446 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b4b294c5-b455-408e-9431-3f5af6275e32 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1489 microversion: 2.1 time: 0.156223 Sep 06 11:20:27.483036 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2754/5558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:27 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1489 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:27.505678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c2056b23-79b3-4b2a-bd5f-4158ee723380 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-679967089"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:27.508159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c2056b23-79b3-4b2a-bd5f-4158ee723380 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:27.515989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2056b23-79b3-4b2a-bd5f-4158ee723380 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:27.516474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2056b23-79b3-4b2a-bd5f-4158ee723380 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:27.516913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2056b23-79b3-4b2a-bd5f-4158ee723380 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:27.517689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2056b23-79b3-4b2a-bd5f-4158ee723380 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:27.518149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2056b23-79b3-4b2a-bd5f-4158ee723380 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:27.518711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2056b23-79b3-4b2a-bd5f-4158ee723380 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:27.661139 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c2056b23-79b3-4b2a-bd5f-4158ee723380 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "PUT /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1074 microversion: 2.1 time: 0.160074 Sep 06 11:20:27.661823 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2805/5559] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Sep 6 11:20:27 2022] PUT /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1074 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:27.680706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4a7110e6-7180-43a4-9ec7-8eed4eb7a3a7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:27.681328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4a7110e6-7180-43a4-9ec7-8eed4eb7a3a7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:27.687795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a7110e6-7180-43a4-9ec7-8eed4eb7a3a7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:27.688287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a7110e6-7180-43a4-9ec7-8eed4eb7a3a7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:27.688730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a7110e6-7180-43a4-9ec7-8eed4eb7a3a7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:27.690241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a7110e6-7180-43a4-9ec7-8eed4eb7a3a7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:27.690704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a7110e6-7180-43a4-9ec7-8eed4eb7a3a7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:27.691184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a7110e6-7180-43a4-9ec7-8eed4eb7a3a7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:27.832288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4a7110e6-7180-43a4-9ec7-8eed4eb7a3a7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:27.841120 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4a7110e6-7180-43a4-9ec7-8eed4eb7a3a7 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1500 microversion: 2.1 time: 0.164517 Sep 06 11:20:27.841718 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2755/5560] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:27 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1500 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:27.864117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c0ce4b04-a567-4bac-b4ae-e23e806aa2dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:27.864736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c0ce4b04-a567-4bac-b4ae-e23e806aa2dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:27.870984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0ce4b04-a567-4bac-b4ae-e23e806aa2dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:27.871531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0ce4b04-a567-4bac-b4ae-e23e806aa2dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:27.871979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0ce4b04-a567-4bac-b4ae-e23e806aa2dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:27.872687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0ce4b04-a567-4bac-b4ae-e23e806aa2dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:27.873231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0ce4b04-a567-4bac-b4ae-e23e806aa2dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:27.873668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c0ce4b04-a567-4bac-b4ae-e23e806aa2dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:28.025664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c0ce4b04-a567-4bac-b4ae-e23e806aa2dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:28.034159 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c0ce4b04-a567-4bac-b4ae-e23e806aa2dd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1500 microversion: 2.1 time: 0.174454 Sep 06 11:20:28.034666 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2806/5561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:27 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1500 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:28.056759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0b21e2d1-8929-4945-9efc-762c48743fd3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:28.062838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b21e2d1-8929-4945-9efc-762c48743fd3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:28.063360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b21e2d1-8929-4945-9efc-762c48743fd3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:28.063801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0b21e2d1-8929-4945-9efc-762c48743fd3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:28.086271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0b21e2d1-8929-4945-9efc-762c48743fd3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Going to try to stop instance {{(pid=140875) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 11:20:28.316840 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0b21e2d1-8929-4945-9efc-762c48743fd3 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "POST /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364/action" status: 202 len: 0 microversion: 2.1 time: 0.263815 Sep 06 11:20:28.317398 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2756/5562] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:20:28 2022] POST /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:20:28.325743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8848bde8-7e1e-46bd-a4c7-04029caf4516 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:28.326369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8848bde8-7e1e-46bd-a4c7-04029caf4516 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:28.332945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8848bde8-7e1e-46bd-a4c7-04029caf4516 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:28.333439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8848bde8-7e1e-46bd-a4c7-04029caf4516 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:28.333891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8848bde8-7e1e-46bd-a4c7-04029caf4516 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:28.334609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8848bde8-7e1e-46bd-a4c7-04029caf4516 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:28.335092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8848bde8-7e1e-46bd-a4c7-04029caf4516 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:28.335531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8848bde8-7e1e-46bd-a4c7-04029caf4516 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:28.472547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8848bde8-7e1e-46bd-a4c7-04029caf4516 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:28.480440 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8848bde8-7e1e-46bd-a4c7-04029caf4516 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.158609 Sep 06 11:20:28.481014 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2807/5563] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:28 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:29.508341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e7ff196d-4b32-4161-9767-a91b627bf769 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:29.509154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e7ff196d-4b32-4161-9767-a91b627bf769 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:29.516730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7ff196d-4b32-4161-9767-a91b627bf769 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:29.517501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7ff196d-4b32-4161-9767-a91b627bf769 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:29.518585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7ff196d-4b32-4161-9767-a91b627bf769 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:29.519537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7ff196d-4b32-4161-9767-a91b627bf769 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:29.520006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7ff196d-4b32-4161-9767-a91b627bf769 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:29.520453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7ff196d-4b32-4161-9767-a91b627bf769 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:29.656742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e7ff196d-4b32-4161-9767-a91b627bf769 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:29.664946 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e7ff196d-4b32-4161-9767-a91b627bf769 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.164317 Sep 06 11:20:29.665528 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2757/5564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:29 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:30.689260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dffee9bb-5bff-4789-a84e-e67b21d9888f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:30.690653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dffee9bb-5bff-4789-a84e-e67b21d9888f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:30.698774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dffee9bb-5bff-4789-a84e-e67b21d9888f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:30.699289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dffee9bb-5bff-4789-a84e-e67b21d9888f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:30.699735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dffee9bb-5bff-4789-a84e-e67b21d9888f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:30.700438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dffee9bb-5bff-4789-a84e-e67b21d9888f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:30.700899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dffee9bb-5bff-4789-a84e-e67b21d9888f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:30.701328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dffee9bb-5bff-4789-a84e-e67b21d9888f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:30.847230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dffee9bb-5bff-4789-a84e-e67b21d9888f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:30.855591 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dffee9bb-5bff-4789-a84e-e67b21d9888f tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.170322 Sep 06 11:20:30.856171 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2808/5565] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:30 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:31.881450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-45ce47fc-03b3-49f5-9e94-52778cb1c996 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:31.882520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-45ce47fc-03b3-49f5-9e94-52778cb1c996 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:31.891717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45ce47fc-03b3-49f5-9e94-52778cb1c996 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:31.892400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45ce47fc-03b3-49f5-9e94-52778cb1c996 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:31.893609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45ce47fc-03b3-49f5-9e94-52778cb1c996 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:31.894711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45ce47fc-03b3-49f5-9e94-52778cb1c996 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:31.895457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45ce47fc-03b3-49f5-9e94-52778cb1c996 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:31.896135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45ce47fc-03b3-49f5-9e94-52778cb1c996 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:32.037080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-45ce47fc-03b3-49f5-9e94-52778cb1c996 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:32.045040 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-45ce47fc-03b3-49f5-9e94-52778cb1c996 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.168811 Sep 06 11:20:32.045826 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2758/5566] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:31 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:33.068996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-38117e33-c13c-4858-be10-6f6321e096fa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:33.069610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-38117e33-c13c-4858-be10-6f6321e096fa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:33.076894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38117e33-c13c-4858-be10-6f6321e096fa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:33.077437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38117e33-c13c-4858-be10-6f6321e096fa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:33.077880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38117e33-c13c-4858-be10-6f6321e096fa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:33.078574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38117e33-c13c-4858-be10-6f6321e096fa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:33.079056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38117e33-c13c-4858-be10-6f6321e096fa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:33.079491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38117e33-c13c-4858-be10-6f6321e096fa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:33.233519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-38117e33-c13c-4858-be10-6f6321e096fa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:33.241356 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-38117e33-c13c-4858-be10-6f6321e096fa tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.176923 Sep 06 11:20:33.241926 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2809/5567] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:33 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:34.265111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8899c64d-a9c9-41cc-a473-1a7ac6a969ab tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:34.265835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8899c64d-a9c9-41cc-a473-1a7ac6a969ab tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:34.273935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8899c64d-a9c9-41cc-a473-1a7ac6a969ab tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:34.274447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8899c64d-a9c9-41cc-a473-1a7ac6a969ab tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:34.274887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8899c64d-a9c9-41cc-a473-1a7ac6a969ab tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:34.275641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8899c64d-a9c9-41cc-a473-1a7ac6a969ab tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:34.276102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8899c64d-a9c9-41cc-a473-1a7ac6a969ab tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:34.276532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8899c64d-a9c9-41cc-a473-1a7ac6a969ab tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:34.412790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8899c64d-a9c9-41cc-a473-1a7ac6a969ab tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:34.420677 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8899c64d-a9c9-41cc-a473-1a7ac6a969ab tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.159650 Sep 06 11:20:34.421253 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2759/5568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:34 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:35.444694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-db3fe71b-2920-4f05-a053-cd7cfa304941 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:35.445308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-db3fe71b-2920-4f05-a053-cd7cfa304941 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:35.453651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db3fe71b-2920-4f05-a053-cd7cfa304941 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:35.454146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db3fe71b-2920-4f05-a053-cd7cfa304941 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:35.456047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db3fe71b-2920-4f05-a053-cd7cfa304941 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:35.456047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db3fe71b-2920-4f05-a053-cd7cfa304941 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:35.456047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db3fe71b-2920-4f05-a053-cd7cfa304941 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:35.456375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db3fe71b-2920-4f05-a053-cd7cfa304941 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:35.600843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-db3fe71b-2920-4f05-a053-cd7cfa304941 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:35.609397 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-db3fe71b-2920-4f05-a053-cd7cfa304941 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.168900 Sep 06 11:20:35.609979 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2810/5569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:35 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:36.635058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f14f4c83-7568-4eac-961d-42e5e18cb413 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:36.635767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f14f4c83-7568-4eac-961d-42e5e18cb413 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:36.643320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f14f4c83-7568-4eac-961d-42e5e18cb413 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:36.650146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f14f4c83-7568-4eac-961d-42e5e18cb413 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:36.650146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f14f4c83-7568-4eac-961d-42e5e18cb413 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:36.650146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f14f4c83-7568-4eac-961d-42e5e18cb413 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:36.650146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f14f4c83-7568-4eac-961d-42e5e18cb413 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:36.650146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f14f4c83-7568-4eac-961d-42e5e18cb413 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:36.817616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f14f4c83-7568-4eac-961d-42e5e18cb413 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:36.828034 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f14f4c83-7568-4eac-961d-42e5e18cb413 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.195561 Sep 06 11:20:36.828034 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2760/5570] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:36 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:37.849882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-70804706-df2e-4242-9b8f-3a18542df37d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:37.850497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-70804706-df2e-4242-9b8f-3a18542df37d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:37.858813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70804706-df2e-4242-9b8f-3a18542df37d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:37.859353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70804706-df2e-4242-9b8f-3a18542df37d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:37.859847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70804706-df2e-4242-9b8f-3a18542df37d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:37.860608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70804706-df2e-4242-9b8f-3a18542df37d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:37.861223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70804706-df2e-4242-9b8f-3a18542df37d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:37.861654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70804706-df2e-4242-9b8f-3a18542df37d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:38.006545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-70804706-df2e-4242-9b8f-3a18542df37d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:38.014951 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-70804706-df2e-4242-9b8f-3a18542df37d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.168538 Sep 06 11:20:38.015246 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2811/5571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:37 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:39.042347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bf8b71d7-8fba-4b5b-a21b-5eb7a4463c77 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:39.043082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bf8b71d7-8fba-4b5b-a21b-5eb7a4463c77 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:39.050662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf8b71d7-8fba-4b5b-a21b-5eb7a4463c77 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:39.051303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf8b71d7-8fba-4b5b-a21b-5eb7a4463c77 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:39.051861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf8b71d7-8fba-4b5b-a21b-5eb7a4463c77 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:39.052656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf8b71d7-8fba-4b5b-a21b-5eb7a4463c77 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:39.053195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf8b71d7-8fba-4b5b-a21b-5eb7a4463c77 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:39.053724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf8b71d7-8fba-4b5b-a21b-5eb7a4463c77 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:39.202178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bf8b71d7-8fba-4b5b-a21b-5eb7a4463c77 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:39.210776 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bf8b71d7-8fba-4b5b-a21b-5eb7a4463c77 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.172397 Sep 06 11:20:39.211454 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2761/5572] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:39 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:40.234351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7e3efc5b-fa33-4b17-a9d2-128381085e22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:40.235115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7e3efc5b-fa33-4b17-a9d2-128381085e22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:40.243607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e3efc5b-fa33-4b17-a9d2-128381085e22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:40.243607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e3efc5b-fa33-4b17-a9d2-128381085e22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:40.244310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e3efc5b-fa33-4b17-a9d2-128381085e22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:40.245255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e3efc5b-fa33-4b17-a9d2-128381085e22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:40.245724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e3efc5b-fa33-4b17-a9d2-128381085e22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:40.246342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e3efc5b-fa33-4b17-a9d2-128381085e22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:40.400364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7e3efc5b-fa33-4b17-a9d2-128381085e22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:40.411895 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7e3efc5b-fa33-4b17-a9d2-128381085e22 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.180735 Sep 06 11:20:40.413073 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2812/5573] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:40 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:41.436540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a66a6cc4-ecf1-4bde-a69e-d4bc40e91212 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:41.437165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a66a6cc4-ecf1-4bde-a69e-d4bc40e91212 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:41.444288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a66a6cc4-ecf1-4bde-a69e-d4bc40e91212 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:41.444811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a66a6cc4-ecf1-4bde-a69e-d4bc40e91212 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:41.450028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a66a6cc4-ecf1-4bde-a69e-d4bc40e91212 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:41.450028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a66a6cc4-ecf1-4bde-a69e-d4bc40e91212 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:41.450028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a66a6cc4-ecf1-4bde-a69e-d4bc40e91212 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:41.450028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a66a6cc4-ecf1-4bde-a69e-d4bc40e91212 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:41.588380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a66a6cc4-ecf1-4bde-a69e-d4bc40e91212 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:41.590847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:41.597151 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a66a6cc4-ecf1-4bde-a69e-d4bc40e91212 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.164667 Sep 06 11:20:41.598058 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2762/5574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:41 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:42.621741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0f884014-4c3b-4172-b97d-1cd50ee42721 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:42.622268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0f884014-4c3b-4172-b97d-1cd50ee42721 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:42.629053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f884014-4c3b-4172-b97d-1cd50ee42721 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:42.629537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f884014-4c3b-4172-b97d-1cd50ee42721 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:42.629975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f884014-4c3b-4172-b97d-1cd50ee42721 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:42.630675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f884014-4c3b-4172-b97d-1cd50ee42721 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:42.631434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f884014-4c3b-4172-b97d-1cd50ee42721 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:42.631860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f884014-4c3b-4172-b97d-1cd50ee42721 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:42.647695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:42.773318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0f884014-4c3b-4172-b97d-1cd50ee42721 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:42.781835 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0f884014-4c3b-4172-b97d-1cd50ee42721 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.164186 Sep 06 11:20:42.782423 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2813/5575] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:42 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:43.806357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-575e1c2d-f6ad-42e9-bc08-dee8ea662706 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:43.807136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-575e1c2d-f6ad-42e9-bc08-dee8ea662706 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:43.810252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:43.815515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-575e1c2d-f6ad-42e9-bc08-dee8ea662706 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:43.816016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-575e1c2d-f6ad-42e9-bc08-dee8ea662706 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:43.816462 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-575e1c2d-f6ad-42e9-bc08-dee8ea662706 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:43.817173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-575e1c2d-f6ad-42e9-bc08-dee8ea662706 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:43.817632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-575e1c2d-f6ad-42e9-bc08-dee8ea662706 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:43.818688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-575e1c2d-f6ad-42e9-bc08-dee8ea662706 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:43.960762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-575e1c2d-f6ad-42e9-bc08-dee8ea662706 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:43.969351 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-575e1c2d-f6ad-42e9-bc08-dee8ea662706 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.167464 Sep 06 11:20:43.969942 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2763/5576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:43 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:44.993382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9b5223e9-34bd-4720-9c43-30a965c6d5f8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:44.994178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9b5223e9-34bd-4720-9c43-30a965c6d5f8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:45.002812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b5223e9-34bd-4720-9c43-30a965c6d5f8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:45.003496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b5223e9-34bd-4720-9c43-30a965c6d5f8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:45.003999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b5223e9-34bd-4720-9c43-30a965c6d5f8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:45.004758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b5223e9-34bd-4720-9c43-30a965c6d5f8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:45.005265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b5223e9-34bd-4720-9c43-30a965c6d5f8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:45.006634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9b5223e9-34bd-4720-9c43-30a965c6d5f8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:45.141945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9b5223e9-34bd-4720-9c43-30a965c6d5f8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:45.150126 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9b5223e9-34bd-4720-9c43-30a965c6d5f8 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.161408 Sep 06 11:20:45.152296 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2814/5577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:44 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:46.174511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-26d276dd-56c2-4f48-bde3-a17a2a0bf020 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:46.175549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-26d276dd-56c2-4f48-bde3-a17a2a0bf020 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:46.183201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26d276dd-56c2-4f48-bde3-a17a2a0bf020 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:46.183699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26d276dd-56c2-4f48-bde3-a17a2a0bf020 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:46.184147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26d276dd-56c2-4f48-bde3-a17a2a0bf020 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:46.184873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26d276dd-56c2-4f48-bde3-a17a2a0bf020 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:46.185331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26d276dd-56c2-4f48-bde3-a17a2a0bf020 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:46.185852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26d276dd-56c2-4f48-bde3-a17a2a0bf020 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:46.321838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-26d276dd-56c2-4f48-bde3-a17a2a0bf020 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:46.330735 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-26d276dd-56c2-4f48-bde3-a17a2a0bf020 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.160996 Sep 06 11:20:46.331348 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2764/5578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:46 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:47.355966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fcd861f1-c107-489e-a395-970ca4ef4af1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:47.356524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fcd861f1-c107-489e-a395-970ca4ef4af1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:47.363826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcd861f1-c107-489e-a395-970ca4ef4af1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:47.364306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcd861f1-c107-489e-a395-970ca4ef4af1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:47.364744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcd861f1-c107-489e-a395-970ca4ef4af1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:47.365457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcd861f1-c107-489e-a395-970ca4ef4af1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:47.365910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcd861f1-c107-489e-a395-970ca4ef4af1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:47.366337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fcd861f1-c107-489e-a395-970ca4ef4af1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:47.523894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fcd861f1-c107-489e-a395-970ca4ef4af1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:47.532817 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fcd861f1-c107-489e-a395-970ca4ef4af1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.180819 Sep 06 11:20:47.539678 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2815/5579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:47 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:48.558208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-486406e2-b41e-4d6f-a0bd-1e01db870189 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:48.558835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-486406e2-b41e-4d6f-a0bd-1e01db870189 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:48.566725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-486406e2-b41e-4d6f-a0bd-1e01db870189 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:48.567281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-486406e2-b41e-4d6f-a0bd-1e01db870189 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:48.567803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-486406e2-b41e-4d6f-a0bd-1e01db870189 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:48.569057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-486406e2-b41e-4d6f-a0bd-1e01db870189 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:48.569525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-486406e2-b41e-4d6f-a0bd-1e01db870189 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:48.569964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-486406e2-b41e-4d6f-a0bd-1e01db870189 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:48.722165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-486406e2-b41e-4d6f-a0bd-1e01db870189 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:48.731362 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-486406e2-b41e-4d6f-a0bd-1e01db870189 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.177611 Sep 06 11:20:48.732458 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2765/5580] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:48 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:49.042739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5b9e28ba-6192-490a-9580-c6ac4eca0710 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:49.043306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5b9e28ba-6192-490a-9580-c6ac4eca0710 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:49.046139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:49.051123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b9e28ba-6192-490a-9580-c6ac4eca0710 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:49.051612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b9e28ba-6192-490a-9580-c6ac4eca0710 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:49.052058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b9e28ba-6192-490a-9580-c6ac4eca0710 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:49.053269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b9e28ba-6192-490a-9580-c6ac4eca0710 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:49.053740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b9e28ba-6192-490a-9580-c6ac4eca0710 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:49.054171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b9e28ba-6192-490a-9580-c6ac4eca0710 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:49.086536 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5b9e28ba-6192-490a-9580-c6ac4eca0710 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/os-volume_attachments/a65b0ac0-1d9b-4861-a8d7-894c6b3e5846" status: 200 len: 194 microversion: 2.20 time: 0.047990 Sep 06 11:20:49.087175 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2816/5581] 10.222.0.20 () {60 vars in 1454 bytes} [Tue Sep 6 11:20:49 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/os-volume_attachments/a65b0ac0-1d9b-4861-a8d7-894c6b3e5846 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:20:49.160642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e915af4e-205c-46bb-afa9-f797bbcbacec tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:49.161369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e915af4e-205c-46bb-afa9-f797bbcbacec tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:49.168231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e915af4e-205c-46bb-afa9-f797bbcbacec tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:49.168790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e915af4e-205c-46bb-afa9-f797bbcbacec tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:49.175287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e915af4e-205c-46bb-afa9-f797bbcbacec tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:49.175287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e915af4e-205c-46bb-afa9-f797bbcbacec tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:49.175287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e915af4e-205c-46bb-afa9-f797bbcbacec tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:49.175287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e915af4e-205c-46bb-afa9-f797bbcbacec tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:49.276523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-e915af4e-205c-46bb-afa9-f797bbcbacec tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lazy-loading 'services' on Instance uuid 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:20:49.565903 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e915af4e-205c-46bb-afa9-f797bbcbacec tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "DELETE /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/os-volume_attachments/a65b0ac0-1d9b-4861-a8d7-894c6b3e5846" status: 202 len: 0 microversion: 2.20 time: 0.409242 Sep 06 11:20:49.567104 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2766/5582] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Sep 6 11:20:49 2022] DELETE /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/os-volume_attachments/a65b0ac0-1d9b-4861-a8d7-894c6b3e5846 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:20:49.587356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a367502a-6fd6-4b22-b47b-9b681aeb0a23 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:49.592551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a367502a-6fd6-4b22-b47b-9b681aeb0a23 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:49.606238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a367502a-6fd6-4b22-b47b-9b681aeb0a23 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:49.606959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a367502a-6fd6-4b22-b47b-9b681aeb0a23 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:49.607783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a367502a-6fd6-4b22-b47b-9b681aeb0a23 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:49.608669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a367502a-6fd6-4b22-b47b-9b681aeb0a23 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:49.609992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a367502a-6fd6-4b22-b47b-9b681aeb0a23 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:49.610734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a367502a-6fd6-4b22-b47b-9b681aeb0a23 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:49.648591 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a367502a-6fd6-4b22-b47b-9b681aeb0a23 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077130 Sep 06 11:20:49.649142 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2817/5583] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 6 11:20:49 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:20:49.757024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5075ec70-ba4b-466b-a867-33eeec0f8922 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:49.763675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5075ec70-ba4b-466b-a867-33eeec0f8922 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:49.772541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5075ec70-ba4b-466b-a867-33eeec0f8922 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:49.773350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5075ec70-ba4b-466b-a867-33eeec0f8922 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:49.773833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5075ec70-ba4b-466b-a867-33eeec0f8922 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:49.774827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5075ec70-ba4b-466b-a867-33eeec0f8922 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:49.775455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5075ec70-ba4b-466b-a867-33eeec0f8922 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:49.775899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5075ec70-ba4b-466b-a867-33eeec0f8922 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:49.977547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5075ec70-ba4b-466b-a867-33eeec0f8922 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:49.985649 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5075ec70-ba4b-466b-a867-33eeec0f8922 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.233123 Sep 06 11:20:49.989195 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2767/5584] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:49 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:50.663614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-958f75f8-c30f-4895-9bb5-b207302800f7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:50.665757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-958f75f8-c30f-4895-9bb5-b207302800f7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:50.678075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-958f75f8-c30f-4895-9bb5-b207302800f7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:50.679559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-958f75f8-c30f-4895-9bb5-b207302800f7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:50.680011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-958f75f8-c30f-4895-9bb5-b207302800f7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:50.683981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-958f75f8-c30f-4895-9bb5-b207302800f7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:50.683981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-958f75f8-c30f-4895-9bb5-b207302800f7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:50.683981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-958f75f8-c30f-4895-9bb5-b207302800f7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:50.741710 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-958f75f8-c30f-4895-9bb5-b207302800f7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.083597 Sep 06 11:20:50.741969 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2818/5585] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 6 11:20:50 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:50.816170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-73e9eb04-5fd2-4498-b526-a1b0d1cc1b4b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:50.816677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-73e9eb04-5fd2-4498-b526-a1b0d1cc1b4b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:50.823480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73e9eb04-5fd2-4498-b526-a1b0d1cc1b4b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:50.823967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73e9eb04-5fd2-4498-b526-a1b0d1cc1b4b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:50.824412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73e9eb04-5fd2-4498-b526-a1b0d1cc1b4b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:50.825122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73e9eb04-5fd2-4498-b526-a1b0d1cc1b4b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:50.825627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73e9eb04-5fd2-4498-b526-a1b0d1cc1b4b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:50.826002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73e9eb04-5fd2-4498-b526-a1b0d1cc1b4b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:50.855953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-73e9eb04-5fd2-4498-b526-a1b0d1cc1b4b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:20:50.921019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-217108794", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "35b1fe2b-0b98-4165-b4f3-7a816ddf41e6"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:50.978780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] validate_networks() for [('35b1fe2b-0b98-4165-b4f3-7a816ddf41e6', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:20:51.149799 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-73e9eb04-5fd2-4498-b526-a1b0d1cc1b4b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "DELETE /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 204 len: 0 microversion: 2.20 time: 0.337408 Sep 06 11:20:51.150492 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2819/5586] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:20:50 2022] DELETE /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 06 11:20:51.156236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5bb3557f-e201-4aff-ae15-fd5a1c8be509 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:51.156941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5bb3557f-e201-4aff-ae15-fd5a1c8be509 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:51.163575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bb3557f-e201-4aff-ae15-fd5a1c8be509 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:51.164073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bb3557f-e201-4aff-ae15-fd5a1c8be509 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:51.164536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bb3557f-e201-4aff-ae15-fd5a1c8be509 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:51.165251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bb3557f-e201-4aff-ae15-fd5a1c8be509 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:51.165712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bb3557f-e201-4aff-ae15-fd5a1c8be509 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:51.166169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bb3557f-e201-4aff-ae15-fd5a1c8be509 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:51.538894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5bb3557f-e201-4aff-ae15-fd5a1c8be509 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:51.546851 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5bb3557f-e201-4aff-ae15-fd5a1c8be509 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.394979 Sep 06 11:20:51.547451 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2820/5587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:51 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:51.551963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e9854b69-285d-46f8-8288-67283d035a9d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:51.553256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e9854b69-285d-46f8-8288-67283d035a9d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:51.559515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9854b69-285d-46f8-8288-67283d035a9d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:51.560004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9854b69-285d-46f8-8288-67283d035a9d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:51.560453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9854b69-285d-46f8-8288-67283d035a9d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:51.561157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9854b69-285d-46f8-8288-67283d035a9d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:51.561617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9854b69-285d-46f8-8288-67283d035a9d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:51.562049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9854b69-285d-46f8-8288-67283d035a9d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:51.688027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:20:51.688464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:20:51.688976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:20:51.689657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:20:51.690085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:20:51.699330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:51.699984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:51.700425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:51.701172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:51.701636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:51.702073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:51.716065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e9854b69-285d-46f8-8288-67283d035a9d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:51.720374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Getting quotas for project 303bd7f016fc4fe4a418a5452c85f74d. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:20:51.725280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e9854b69-285d-46f8-8288-67283d035a9d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:51.726758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e9854b69-285d-46f8-8288-67283d035a9d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:51.727239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Getting quotas for user 236b8011d72b482eb6a61f27130aeb84 and project 303bd7f016fc4fe4a418a5452c85f74d. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:20:51.727985 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e9854b69-285d-46f8-8288-67283d035a9d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1720 microversion: 2.20 time: 0.179600 Sep 06 11:20:51.728549 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2821/5588] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:51 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:20:51.740276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:20:51.747157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:20:51.905540 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b84a8bff-732c-46a9-b27b-524171dfcdd8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.120509 Sep 06 11:20:51.906518 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2768/5589] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:20:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:20:51.918693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e0b02b30-017b-4a38-b820-1354c2f607fd tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:51.919340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e0b02b30-017b-4a38-b820-1354c2f607fd tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:51.973381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e0b02b30-017b-4a38-b820-1354c2f607fd tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:51.981179 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e0b02b30-017b-4a38-b820-1354c2f607fd tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1213 microversion: 2.1 time: 0.066458 Sep 06 11:20:51.981760 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2822/5590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:51 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:20:52.575895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bc97be68-cd17-42dc-baf5-50705da9d2bf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:52.575895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bc97be68-cd17-42dc-baf5-50705da9d2bf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:52.579519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc97be68-cd17-42dc-baf5-50705da9d2bf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:52.580032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc97be68-cd17-42dc-baf5-50705da9d2bf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:52.580487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc97be68-cd17-42dc-baf5-50705da9d2bf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:52.581212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc97be68-cd17-42dc-baf5-50705da9d2bf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:52.581684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc97be68-cd17-42dc-baf5-50705da9d2bf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:52.582130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc97be68-cd17-42dc-baf5-50705da9d2bf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:52.721236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bc97be68-cd17-42dc-baf5-50705da9d2bf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:52.730059 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bc97be68-cd17-42dc-baf5-50705da9d2bf tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.163596 Sep 06 11:20:52.738973 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2769/5591] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:52 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:20:52.765930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-18cb0f53-20e6-4967-acdf-d309e44c7b51 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:52.766735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-18cb0f53-20e6-4967-acdf-d309e44c7b51 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:52.775239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18cb0f53-20e6-4967-acdf-d309e44c7b51 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:52.775733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18cb0f53-20e6-4967-acdf-d309e44c7b51 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:52.776181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18cb0f53-20e6-4967-acdf-d309e44c7b51 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:52.776896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18cb0f53-20e6-4967-acdf-d309e44c7b51 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:52.777360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18cb0f53-20e6-4967-acdf-d309e44c7b51 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:52.777794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18cb0f53-20e6-4967-acdf-d309e44c7b51 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:52.939793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-18cb0f53-20e6-4967-acdf-d309e44c7b51 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:52.948842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-18cb0f53-20e6-4967-acdf-d309e44c7b51 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:52.950388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-18cb0f53-20e6-4967-acdf-d309e44c7b51 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:52.951602 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-18cb0f53-20e6-4967-acdf-d309e44c7b51 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1720 microversion: 2.20 time: 0.194824 Sep 06 11:20:52.952232 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2823/5592] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:52 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:20:53.004740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4d1b1c30-047b-4175-b7f8-fa76152f0621 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:53.005362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4d1b1c30-047b-4175-b7f8-fa76152f0621 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:53.063711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4d1b1c30-047b-4175-b7f8-fa76152f0621 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:53.072719 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4d1b1c30-047b-4175-b7f8-fa76152f0621 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1213 microversion: 2.1 time: 0.071835 Sep 06 11:20:53.073314 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2770/5593] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:52 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:53.721927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-c2a4e937-28b7-483d-854d-6369ff863c4a req-fe0ca525-c400-4d3e-b8ca-73f9b383b77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72fceff4-8a80-43f9-88f2-fd73e1eed3e3", "name": "network-vif-deleted", "tag": "921e3ee1-fb50-4f0c-80ae-7a517b1fdc23"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:53.735813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c2a4e937-28b7-483d-854d-6369ff863c4a req-fe0ca525-c400-4d3e-b8ca-73f9b383b77d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:53.736313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c2a4e937-28b7-483d-854d-6369ff863c4a req-fe0ca525-c400-4d3e-b8ca-73f9b383b77d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:53.736956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c2a4e937-28b7-483d-854d-6369ff863c4a req-fe0ca525-c400-4d3e-b8ca-73f9b383b77d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:53.765029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-87f23c51-ed3f-4721-8a72-6db94b5b9504 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:53.765675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-87f23c51-ed3f-4721-8a72-6db94b5b9504 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:53.765872 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-c2a4e937-28b7-483d-854d-6369ff863c4a req-fe0ca525-c400-4d3e-b8ca-73f9b383b77d service nova] Creating event network-vif-deleted:921e3ee1-fb50-4f0c-80ae-7a517b1fdc23 for instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 on nch2-master-1 Sep 06 11:20:53.772796 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-c2a4e937-28b7-483d-854d-6369ff863c4a req-fe0ca525-c400-4d3e-b8ca-73f9b383b77d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058824 Sep 06 11:20:53.773595 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2824/5594] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:20:53.795736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87f23c51-ed3f-4721-8a72-6db94b5b9504 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:53.796515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87f23c51-ed3f-4721-8a72-6db94b5b9504 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:53.797222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87f23c51-ed3f-4721-8a72-6db94b5b9504 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:53.798595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87f23c51-ed3f-4721-8a72-6db94b5b9504 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:53.799270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87f23c51-ed3f-4721-8a72-6db94b5b9504 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:53.799879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87f23c51-ed3f-4721-8a72-6db94b5b9504 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:53.979686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-43c61ad4-c686-4bf0-b0a6-ec31da6e1e02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:53.980774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-43c61ad4-c686-4bf0-b0a6-ec31da6e1e02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:53.988567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43c61ad4-c686-4bf0-b0a6-ec31da6e1e02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:53.989542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43c61ad4-c686-4bf0-b0a6-ec31da6e1e02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:53.990795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43c61ad4-c686-4bf0-b0a6-ec31da6e1e02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:53.992089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43c61ad4-c686-4bf0-b0a6-ec31da6e1e02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:53.992774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43c61ad4-c686-4bf0-b0a6-ec31da6e1e02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:53.993427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-43c61ad4-c686-4bf0-b0a6-ec31da6e1e02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:54.001427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-87f23c51-ed3f-4721-8a72-6db94b5b9504 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:54.015772 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-87f23c51-ed3f-4721-8a72-6db94b5b9504 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1510 microversion: 2.1 time: 0.265634 Sep 06 11:20:54.016391 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2771/5595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:53 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:54.110054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-43c61ad4-c686-4bf0-b0a6-ec31da6e1e02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:54.111621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f8947214-570a-4ef1-8a41-d794176027c8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:54.113538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f8947214-570a-4ef1-8a41-d794176027c8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:54.125051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-43c61ad4-c686-4bf0-b0a6-ec31da6e1e02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:54.127522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8947214-570a-4ef1-8a41-d794176027c8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:54.128375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-43c61ad4-c686-4bf0-b0a6-ec31da6e1e02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:54.128560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8947214-570a-4ef1-8a41-d794176027c8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:54.130295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8947214-570a-4ef1-8a41-d794176027c8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:54.130635 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-43c61ad4-c686-4bf0-b0a6-ec31da6e1e02 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 200 len: 1652 microversion: 2.20 time: 0.156479 Sep 06 11:20:54.132608 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2825/5596] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:53 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 1652 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:20:54.141111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8947214-570a-4ef1-8a41-d794176027c8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:54.142171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8947214-570a-4ef1-8a41-d794176027c8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:54.143028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8947214-570a-4ef1-8a41-d794176027c8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:54.253808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f8947214-570a-4ef1-8a41-d794176027c8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:54.260804 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f8947214-570a-4ef1-8a41-d794176027c8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1265 microversion: 2.1 time: 0.158120 Sep 06 11:20:54.261398 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2772/5597] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:54 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:55.040017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-92e550b6-94eb-489b-9227-f618685c5004 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:55.040738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-92e550b6-94eb-489b-9227-f618685c5004 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:55.048014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92e550b6-94eb-489b-9227-f618685c5004 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:55.048611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92e550b6-94eb-489b-9227-f618685c5004 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:55.049063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92e550b6-94eb-489b-9227-f618685c5004 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:55.049775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92e550b6-94eb-489b-9227-f618685c5004 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:55.050241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92e550b6-94eb-489b-9227-f618685c5004 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:55.050678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92e550b6-94eb-489b-9227-f618685c5004 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:55.180804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2eb61702-793e-4710-8d5b-a284f8243a78 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:55.180804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2eb61702-793e-4710-8d5b-a284f8243a78 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:55.189252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb61702-793e-4710-8d5b-a284f8243a78 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:55.190059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb61702-793e-4710-8d5b-a284f8243a78 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:55.190511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb61702-793e-4710-8d5b-a284f8243a78 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:55.191623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb61702-793e-4710-8d5b-a284f8243a78 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:55.192090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb61702-793e-4710-8d5b-a284f8243a78 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:55.192699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2eb61702-793e-4710-8d5b-a284f8243a78 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:55.211166 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-2eb61702-793e-4710-8d5b-a284f8243a78 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] HTTP exception thrown: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2eb61702-793e-4710-8d5b-a284f8243a78 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Request method failure captured: Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 HTTP/1.1 Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyx0ep2jwyMGFHZWia3KaoEmlk5l2jVQYTPyexJM7THFWCZi2a1_Q4vAu7rLGs0sa0YDIbPopi4HHUNe6_9xKgcOwAeda5IRW56kmHaO8_GJsn9808ZfUBMwRB9kHC6siz340BgPued6Hzxlm6DA4V2cJh2Lwl31fFPlMdzXqd5qY_M Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 75b360e0ffe64c3bb5897486a18eda10 Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75b360e0ffe64c3bb5897486a18eda10"}]}] Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 75b360e0ffe64c3bb5897486a18eda10 Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeShelveTestJSON-1383535698-project Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 226a6d965ff14deebdead8370fc00d3e Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1383535698-project Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '72fceff4-8a80-43f9-88f2-fd73e1eed3e3'} Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:20:55.214461 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:20:55.219250 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:20:55.219250 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:20:55.219250 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:20:55.219250 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:20:55.219250 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:20:55.219250 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:20:55.219250 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:20:55.219250 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:20:55.219250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2eb61702-793e-4710-8d5b-a284f8243a78 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Returning 404 to user: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:20:55.219904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-92e550b6-94eb-489b-9227-f618685c5004 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:55.220009 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2eb61702-793e-4710-8d5b-a284f8243a78 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 404 len: 111 microversion: 2.20 time: 0.040583 Sep 06 11:20:55.220009 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2773/5598] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:20:55 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 06 11:20:55.227261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c6ba1b9-e6d7-4a97-b1cc-eac8d21131ac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '.version_select at 0x7f90f8b76c10>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:55.229608 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-92e550b6-94eb-489b-9227-f618685c5004 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1487 microversion: 2.1 time: 0.193320 Sep 06 11:20:55.231948 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2826/5599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:55 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1487 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:55.260828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ddab2ad8-81ee-4720-981b-c2b4cb56896b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1350591477"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:55.263559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ddab2ad8-81ee-4720-981b-c2b4cb56896b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:55.270043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad8-81ee-4720-981b-c2b4cb56896b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:55.270614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad8-81ee-4720-981b-c2b4cb56896b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:55.271124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad8-81ee-4720-981b-c2b4cb56896b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:55.272067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad8-81ee-4720-981b-c2b4cb56896b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:55.272533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad8-81ee-4720-981b-c2b4cb56896b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:55.273008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad8-81ee-4720-981b-c2b4cb56896b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:55.379189 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9c6ba1b9-e6d7-4a97-b1cc-eac8d21131ac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-867190969" status: 204 len: 0 microversion: 2.20 time: 0.156932 Sep 06 11:20:55.379809 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2774/5600] 10.222.0.20 () {60 vars in 1259 bytes} [Tue Sep 6 11:20:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-867190969 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 06 11:20:55.385081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-796170fd-a436-49ba-b341-38b1406d41f3 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:55.385738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-796170fd-a436-49ba-b341-38b1406d41f3 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:55.393393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-796170fd-a436-49ba-b341-38b1406d41f3 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:55.397142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-796170fd-a436-49ba-b341-38b1406d41f3 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:55.397142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-796170fd-a436-49ba-b341-38b1406d41f3 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:55.397142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-796170fd-a436-49ba-b341-38b1406d41f3 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:55.397142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-796170fd-a436-49ba-b341-38b1406d41f3 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:55.397142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-796170fd-a436-49ba-b341-38b1406d41f3 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:55.442874 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ddab2ad8-81ee-4720-981b-c2b4cb56896b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "PUT /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1061 microversion: 2.1 time: 0.177529 Sep 06 11:20:55.442874 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2827/5601] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Sep 6 11:20:55 2022] PUT /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1061 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:20:55.453561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f435ef3-5ed0-4d15-8f08-edb0380ebe52 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:55.454333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1f435ef3-5ed0-4d15-8f08-edb0380ebe52 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:55.461326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f435ef3-5ed0-4d15-8f08-edb0380ebe52 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:55.461951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f435ef3-5ed0-4d15-8f08-edb0380ebe52 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:55.462465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f435ef3-5ed0-4d15-8f08-edb0380ebe52 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:55.463276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f435ef3-5ed0-4d15-8f08-edb0380ebe52 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:55.463971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f435ef3-5ed0-4d15-8f08-edb0380ebe52 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:55.464513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f435ef3-5ed0-4d15-8f08-edb0380ebe52 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:55.467784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-796170fd-a436-49ba-b341-38b1406d41f3 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:55.480564 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-796170fd-a436-49ba-b341-38b1406d41f3 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1271 microversion: 2.1 time: 0.099619 Sep 06 11:20:55.481243 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2775/5602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:55 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:55.643391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1f435ef3-5ed0-4d15-8f08-edb0380ebe52 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:55.657372 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1f435ef3-5ed0-4d15-8f08-edb0380ebe52 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1488 microversion: 2.1 time: 0.207618 Sep 06 11:20:55.657965 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2828/5603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:55 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1488 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:20:55.681966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fa9e2164-11eb-4991-936e-4ef51d81356a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:55.683031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fa9e2164-11eb-4991-936e-4ef51d81356a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:55.703510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa9e2164-11eb-4991-936e-4ef51d81356a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:55.704437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa9e2164-11eb-4991-936e-4ef51d81356a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:55.706875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa9e2164-11eb-4991-936e-4ef51d81356a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:55.708454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa9e2164-11eb-4991-936e-4ef51d81356a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:55.711101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa9e2164-11eb-4991-936e-4ef51d81356a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:55.712978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa9e2164-11eb-4991-936e-4ef51d81356a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:55.985526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fa9e2164-11eb-4991-936e-4ef51d81356a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:55.998147 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fa9e2164-11eb-4991-936e-4ef51d81356a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1488 microversion: 2.1 time: 0.320474 Sep 06 11:20:55.998852 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2776/5604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:55 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1488 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:20:56.024711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e0db480e-c592-4e43-8dac-db36d9d7a482 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:56.025459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e0db480e-c592-4e43-8dac-db36d9d7a482 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:56.033779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0db480e-c592-4e43-8dac-db36d9d7a482 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:56.034449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0db480e-c592-4e43-8dac-db36d9d7a482 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:56.035076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0db480e-c592-4e43-8dac-db36d9d7a482 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:56.036038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0db480e-c592-4e43-8dac-db36d9d7a482 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:56.036659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0db480e-c592-4e43-8dac-db36d9d7a482 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:56.037315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0db480e-c592-4e43-8dac-db36d9d7a482 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:56.062163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:56.069805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e0db480e-c592-4e43-8dac-db36d9d7a482 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:20:56.496581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff75b76a-cc9c-4088-9743-1ca40d9e9746 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Action: 'create', calling method: .version_select at 0x7f90f8a7ce50>, body: {"keypair": {"name": "tempest-keypair-188969257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBBiC8hkiGZv2it5FPG3QgI+X1rLgtE/SkNKotgF/w8Sfjql9z7cmG+sQ2utm6hnzZnOcYpuTe9SEesPxEAd9BeqpsYk3pU3J1EZagUFMnIylfrspZo9wATNI97UyL+aQ=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:56.514015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ff75b76a-cc9c-4088-9743-1ca40d9e9746 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Getting quotas for project 75b360e0ffe64c3bb5897486a18eda10. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:20:56.520270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ff75b76a-cc9c-4088-9743-1ca40d9e9746 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Getting quotas for user 226a6d965ff14deebdead8370fc00d3e and project 75b360e0ffe64c3bb5897486a18eda10. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:20:56.527482 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e0db480e-c592-4e43-8dac-db36d9d7a482 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 204 len: 0 microversion: 2.1 time: 0.506881 Sep 06 11:20:56.528474 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2829/5605] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:20:56 2022] DELETE /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:20:56.535294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-97f3abc2-5472-43c8-8f50-45eb03345312 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:56.536216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-97f3abc2-5472-43c8-8f50-45eb03345312 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:56.544658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97f3abc2-5472-43c8-8f50-45eb03345312 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:56.545167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97f3abc2-5472-43c8-8f50-45eb03345312 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:56.545624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97f3abc2-5472-43c8-8f50-45eb03345312 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:56.546403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97f3abc2-5472-43c8-8f50-45eb03345312 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:56.546880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97f3abc2-5472-43c8-8f50-45eb03345312 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:56.547379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97f3abc2-5472-43c8-8f50-45eb03345312 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:56.666212 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff75b76a-cc9c-4088-9743-1ca40d9e9746 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.173476 Sep 06 11:20:56.667028 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2777/5606] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Sep 6 11:20:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 06 11:20:56.672944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6e4b8bd4-9df4-4f9d-a025-f79bc9104bcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:56.673962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6e4b8bd4-9df4-4f9d-a025-f79bc9104bcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:56.681339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e4b8bd4-9df4-4f9d-a025-f79bc9104bcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:56.682184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e4b8bd4-9df4-4f9d-a025-f79bc9104bcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:56.682739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e4b8bd4-9df4-4f9d-a025-f79bc9104bcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:56.683636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e4b8bd4-9df4-4f9d-a025-f79bc9104bcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:56.684115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e4b8bd4-9df4-4f9d-a025-f79bc9104bcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:56.684557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e4b8bd4-9df4-4f9d-a025-f79bc9104bcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:56.727545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-97f3abc2-5472-43c8-8f50-45eb03345312 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:56.738327 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-97f3abc2-5472-43c8-8f50-45eb03345312 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1313 microversion: 2.1 time: 0.206939 Sep 06 11:20:56.738327 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2830/5607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:56 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:56.854142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6e4b8bd4-9df4-4f9d-a025-f79bc9104bcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:56.863164 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6e4b8bd4-9df4-4f9d-a025-f79bc9104bcd tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1494 microversion: 2.1 time: 0.194477 Sep 06 11:20:56.863895 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2778/5608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:56 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1494 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:57.298340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-78d0ce47-b1a5-4af4-9700-f1b418aa6376 req-4c3e37ac-8126-42c7-b233-3e6a2028659c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb1ab51-5c16-42a8-b04f-b3b203315f77", "tag": "56d53d94-6ba1-4e50-8ab9-659bc04c8412"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:57.309838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-78d0ce47-b1a5-4af4-9700-f1b418aa6376 req-4c3e37ac-8126-42c7-b233-3e6a2028659c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:57.310435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-78d0ce47-b1a5-4af4-9700-f1b418aa6376 req-4c3e37ac-8126-42c7-b233-3e6a2028659c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:57.310939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-78d0ce47-b1a5-4af4-9700-f1b418aa6376 req-4c3e37ac-8126-42c7-b233-3e6a2028659c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:57.323855 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-78d0ce47-b1a5-4af4-9700-f1b418aa6376 req-4c3e37ac-8126-42c7-b233-3e6a2028659c service nova] Creating event network-changed:56d53d94-6ba1-4e50-8ab9-659bc04c8412 for instance edb1ab51-5c16-42a8-b04f-b3b203315f77 on nch1-master-1 Sep 06 11:20:57.329174 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-78d0ce47-b1a5-4af4-9700-f1b418aa6376 req-4c3e37ac-8126-42c7-b233-3e6a2028659c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035123 Sep 06 11:20:57.329834 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2831/5609] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:20:57.764814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-10abb3a2-e20a-4d67-bbc3-391757607a54 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:57.766217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-10abb3a2-e20a-4d67-bbc3-391757607a54 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:57.775900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10abb3a2-e20a-4d67-bbc3-391757607a54 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:57.776459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10abb3a2-e20a-4d67-bbc3-391757607a54 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:57.777413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10abb3a2-e20a-4d67-bbc3-391757607a54 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:57.777606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10abb3a2-e20a-4d67-bbc3-391757607a54 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:57.778242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10abb3a2-e20a-4d67-bbc3-391757607a54 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:57.778678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10abb3a2-e20a-4d67-bbc3-391757607a54 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:57.894066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-df0d5902-c27e-40f0-a7c8-17181b00b45a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:57.894776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-df0d5902-c27e-40f0-a7c8-17181b00b45a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:57.926562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df0d5902-c27e-40f0-a7c8-17181b00b45a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:57.926562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df0d5902-c27e-40f0-a7c8-17181b00b45a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:57.926562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df0d5902-c27e-40f0-a7c8-17181b00b45a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:57.926940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df0d5902-c27e-40f0-a7c8-17181b00b45a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:57.928659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df0d5902-c27e-40f0-a7c8-17181b00b45a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:57.931159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df0d5902-c27e-40f0-a7c8-17181b00b45a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:57.963377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-10abb3a2-e20a-4d67-bbc3-391757607a54 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:57.979946 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-10abb3a2-e20a-4d67-bbc3-391757607a54 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1313 microversion: 2.1 time: 0.221061 Sep 06 11:20:57.981090 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2779/5610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:57 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:58.128220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-df0d5902-c27e-40f0-a7c8-17181b00b45a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:58.138524 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-df0d5902-c27e-40f0-a7c8-17181b00b45a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1494 microversion: 2.1 time: 0.249197 Sep 06 11:20:58.139432 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2832/5611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:57 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1494 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:59.010795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4ca05b61-766f-4691-bfab-b8c82fa3d74a tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:59.011456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4ca05b61-766f-4691-bfab-b8c82fa3d74a tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:59.018525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ca05b61-766f-4691-bfab-b8c82fa3d74a tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:59.019042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ca05b61-766f-4691-bfab-b8c82fa3d74a tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:59.019575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ca05b61-766f-4691-bfab-b8c82fa3d74a tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:59.020289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ca05b61-766f-4691-bfab-b8c82fa3d74a tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:59.021092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ca05b61-766f-4691-bfab-b8c82fa3d74a tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:59.022101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ca05b61-766f-4691-bfab-b8c82fa3d74a tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:59.170312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-be749cc1-b729-4303-8911-2463ed2c6f44 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:20:59.171153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-be749cc1-b729-4303-8911-2463ed2c6f44 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:20:59.181593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be749cc1-b729-4303-8911-2463ed2c6f44 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:59.182427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be749cc1-b729-4303-8911-2463ed2c6f44 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:59.183247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be749cc1-b729-4303-8911-2463ed2c6f44 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:59.184073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be749cc1-b729-4303-8911-2463ed2c6f44 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:59.184707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be749cc1-b729-4303-8911-2463ed2c6f44 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:59.185325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-be749cc1-b729-4303-8911-2463ed2c6f44 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:59.249793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4ca05b61-766f-4691-bfab-b8c82fa3d74a tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:59.259291 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4ca05b61-766f-4691-bfab-b8c82fa3d74a tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1313 microversion: 2.1 time: 0.252562 Sep 06 11:20:59.259896 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2780/5612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:59 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:59.269288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-be749cc1-b729-4303-8911-2463ed2c6f44 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:20:59.281584 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-be749cc1-b729-4303-8911-2463ed2c6f44 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1292 microversion: 2.1 time: 0.118025 Sep 06 11:20:59.282461 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2833/5613] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:20:59 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1292 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:20:59.349405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-1d8775bf-3399-49c0-bd0b-05db2dd0906d req-1e0b51ec-0743-425b-98bb-8908619023c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd97411-39ce-447c-ae34-39bb9e617364", "name": "network-vif-deleted", "tag": "8fd7f589-8c4b-464e-8414-75a9d25fac62"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:59.360513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1d8775bf-3399-49c0-bd0b-05db2dd0906d req-1e0b51ec-0743-425b-98bb-8908619023c4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:20:59.361058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1d8775bf-3399-49c0-bd0b-05db2dd0906d req-1e0b51ec-0743-425b-98bb-8908619023c4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:20:59.361540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1d8775bf-3399-49c0-bd0b-05db2dd0906d req-1e0b51ec-0743-425b-98bb-8908619023c4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:20:59.375037 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-1d8775bf-3399-49c0-bd0b-05db2dd0906d req-1e0b51ec-0743-425b-98bb-8908619023c4 service nova] Creating event network-vif-deleted:8fd7f589-8c4b-464e-8414-75a9d25fac62 for instance 4cd97411-39ce-447c-ae34-39bb9e617364 on nch1-master-1 Sep 06 11:20:59.381200 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-1d8775bf-3399-49c0-bd0b-05db2dd0906d req-1e0b51ec-0743-425b-98bb-8908619023c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035378 Sep 06 11:20:59.382272 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2781/5614] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:20:59.518039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1220178556", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d03ef3dd-8a5a-4393-81b5-8dc14a53ca04"}], "security_groups": [{"name": "tempest-securitygroup--1724816245"}], "key_name": "tempest-keypair-188969257", "user_data": "}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:20:59.639349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] validate_networks() for [('d03ef3dd-8a5a-4393-81b5-8dc14a53ca04', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:21:00.053961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:21:00.053961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:21:00.054343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:21:00.054768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:21:00.055266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:21:00.064429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:00.064920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:00.065364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:00.066102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:00.066819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:00.066999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:00.084979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Getting quotas for project 75b360e0ffe64c3bb5897486a18eda10. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:21:00.090246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Getting quotas for user 226a6d965ff14deebdead8370fc00d3e and project 75b360e0ffe64c3bb5897486a18eda10. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:21:00.103353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:21:00.105852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:21:00.239590 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e9504631-582d-4854-8c4d-369587c98a34 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.725771 Sep 06 11:21:00.241054 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2834/5615] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 11:20:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 11:21:00.261353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-689f9a91-0fd1-4534-bc97-73d7e225bd21 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:00.262081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-689f9a91-0fd1-4534-bc97-73d7e225bd21 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:00.283278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-42693c7d-62db-473e-9e14-e58bfe932492 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:00.288953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-42693c7d-62db-473e-9e14-e58bfe932492 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:00.304960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42693c7d-62db-473e-9e14-e58bfe932492 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:00.305535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42693c7d-62db-473e-9e14-e58bfe932492 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:00.311417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42693c7d-62db-473e-9e14-e58bfe932492 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:00.313526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42693c7d-62db-473e-9e14-e58bfe932492 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:00.318070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42693c7d-62db-473e-9e14-e58bfe932492 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:00.318070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42693c7d-62db-473e-9e14-e58bfe932492 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:00.342897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-689f9a91-0fd1-4534-bc97-73d7e225bd21 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:00.347684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-689f9a91-0fd1-4534-bc97-73d7e225bd21 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:00.350481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-689f9a91-0fd1-4534-bc97-73d7e225bd21 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:00.351722 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-689f9a91-0fd1-4534-bc97-73d7e225bd21 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1281 microversion: 2.20 time: 0.102592 Sep 06 11:21:00.359890 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2782/5616] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:00 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1281 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:21:00.359890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:00.359890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:00.366276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:00.366784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:00.367270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:00.368188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:00.368659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:00.369121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:00.410251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:00.410761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:00.411489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:00.413364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lazy-loading 'fault' on Instance uuid 4cd97411-39ce-447c-ae34-39bb9e617364 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:21:00.478542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:00.488855 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8e6bf739-9620-4404-bf69-bc091c7b2c62 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 200 len: 1310 microversion: 2.1 time: 0.135032 Sep 06 11:21:00.489663 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2783/5617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:00 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 1310 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:00.510765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-42693c7d-62db-473e-9e14-e58bfe932492 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:00.518666 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-42693c7d-62db-473e-9e14-e58bfe932492 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1313 microversion: 2.1 time: 0.239654 Sep 06 11:21:00.519278 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2835/5618] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:00 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:01.384546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4c4ff361-16b6-4437-8a63-9bd026358534 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:01.385197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4c4ff361-16b6-4437-8a63-9bd026358534 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:01.392249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c4ff361-16b6-4437-8a63-9bd026358534 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.392746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c4ff361-16b6-4437-8a63-9bd026358534 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.393197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c4ff361-16b6-4437-8a63-9bd026358534 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.393906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c4ff361-16b6-4437-8a63-9bd026358534 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.394373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c4ff361-16b6-4437-8a63-9bd026358534 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.394808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c4ff361-16b6-4437-8a63-9bd026358534 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.411488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:01.460021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4c4ff361-16b6-4437-8a63-9bd026358534 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:01.468429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4c4ff361-16b6-4437-8a63-9bd026358534 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:01.469910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4c4ff361-16b6-4437-8a63-9bd026358534 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:01.471052 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4c4ff361-16b6-4437-8a63-9bd026358534 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1285 microversion: 2.20 time: 0.091301 Sep 06 11:21:01.471617 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2784/5619] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:01 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:21:01.513666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-528eb243-a97f-4f8e-b41d-3e43841f6266 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:01.514344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-528eb243-a97f-4f8e-b41d-3e43841f6266 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:01.522053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-528eb243-a97f-4f8e-b41d-3e43841f6266 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.522682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-528eb243-a97f-4f8e-b41d-3e43841f6266 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.523367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-528eb243-a97f-4f8e-b41d-3e43841f6266 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.524301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-528eb243-a97f-4f8e-b41d-3e43841f6266 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.524981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-528eb243-a97f-4f8e-b41d-3e43841f6266 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.525559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-528eb243-a97f-4f8e-b41d-3e43841f6266 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.541330 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-528eb243-a97f-4f8e-b41d-3e43841f6266 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.541567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4cd600d4-aafc-4b9d-a728-0a9537e701f8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:01.542201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4cd600d4-aafc-4b9d-a728-0a9537e701f8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-528eb243-a97f-4f8e-b41d-3e43841f6266 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 HTTP/1.1 Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '4cd97411-39ce-447c-ae34-39bb9e617364'} Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.542991 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.547825 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.547825 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.547825 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.547825 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:01.547825 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:01.547825 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.547825 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.547825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-528eb243-a97f-4f8e-b41d-3e43841f6266 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:01.547825 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-528eb243-a97f-4f8e-b41d-3e43841f6266 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 404 len: 111 microversion: 2.1 time: 0.035094 Sep 06 11:21:01.547825 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2836/5620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:01 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:21:01.556400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4cd600d4-aafc-4b9d-a728-0a9537e701f8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.556400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4cd600d4-aafc-4b9d-a728-0a9537e701f8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.556400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4cd600d4-aafc-4b9d-a728-0a9537e701f8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.556400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4cd600d4-aafc-4b9d-a728-0a9537e701f8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.556400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4cd600d4-aafc-4b9d-a728-0a9537e701f8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.556400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4cd600d4-aafc-4b9d-a728-0a9537e701f8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.565795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3d643f01-6723-406b-af38-85d60cd50602 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:01.566324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3d643f01-6723-406b-af38-85d60cd50602 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:01.575353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d643f01-6723-406b-af38-85d60cd50602 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.576488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d643f01-6723-406b-af38-85d60cd50602 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.577049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d643f01-6723-406b-af38-85d60cd50602 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.577994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d643f01-6723-406b-af38-85d60cd50602 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.578714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d643f01-6723-406b-af38-85d60cd50602 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.579513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d643f01-6723-406b-af38-85d60cd50602 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.599102 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-3d643f01-6723-406b-af38-85d60cd50602 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3d643f01-6723-406b-af38-85d60cd50602 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 HTTP/1.1 Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '4cd97411-39ce-447c-ae34-39bb9e617364'} Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:01.600906 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.606100 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.606100 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.606100 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.606100 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.606100 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.606100 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.606100 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:01.606100 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:01.606100 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.606100 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.607715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3d643f01-6723-406b-af38-85d60cd50602 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:01.608642 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3d643f01-6723-406b-af38-85d60cd50602 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 404 len: 111 microversion: 2.1 time: 0.046920 Sep 06 11:21:01.612270 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2837/5621] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:21:01 2022] DELETE /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:21:01.618021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-71a46607-f967-4be4-9c29-5155c3205845 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:01.618638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-71a46607-f967-4be4-9c29-5155c3205845 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4cd97411-39ce-447c-ae34-39bb9e617364] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:01.627334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71a46607-f967-4be4-9c29-5155c3205845 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.627887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71a46607-f967-4be4-9c29-5155c3205845 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.628335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71a46607-f967-4be4-9c29-5155c3205845 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.629076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71a46607-f967-4be4-9c29-5155c3205845 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.629569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71a46607-f967-4be4-9c29-5155c3205845 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.630007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71a46607-f967-4be4-9c29-5155c3205845 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.653402 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-71a46607-f967-4be4-9c29-5155c3205845 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-71a46607-f967-4be4-9c29-5155c3205845 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 HTTP/1.1 Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '4cd97411-39ce-447c-ae34-39bb9e617364'} Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.655661 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.659620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.659620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.659620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.659620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:01.659620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:01.659620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. Sep 06 11:21:01.659620 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.659620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-71a46607-f967-4be4-9c29-5155c3205845 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 4cd97411-39ce-447c-ae34-39bb9e617364 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:01.659620 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-71a46607-f967-4be4-9c29-5155c3205845 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364" status: 404 len: 111 microversion: 2.1 time: 0.043522 Sep 06 11:21:01.659620 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2838/5622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:01 2022] GET /compute/v2.1/servers/4cd97411-39ce-447c-ae34-39bb9e617364 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:21:01.666223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2df48eea-dc26-4150-8634-f27984e41d8c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:01.666878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2df48eea-dc26-4150-8634-f27984e41d8c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:01.673554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2df48eea-dc26-4150-8634-f27984e41d8c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.674062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2df48eea-dc26-4150-8634-f27984e41d8c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.674497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2df48eea-dc26-4150-8634-f27984e41d8c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.675458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2df48eea-dc26-4150-8634-f27984e41d8c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.675928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2df48eea-dc26-4150-8634-f27984e41d8c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.676361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2df48eea-dc26-4150-8634-f27984e41d8c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.700250 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-2df48eea-dc26-4150-8634-f27984e41d8c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2df48eea-dc26-4150-8634-f27984e41d8c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc HTTP/1.1 Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '257d9d0f-050a-4894-89ce-2d78dc8abebc'} Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:01.704018 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:21:01.708738 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.708738 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.708738 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.708738 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.708738 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.708738 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.708738 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:01.708738 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:01.708738 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:21:01.708738 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.708738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2df48eea-dc26-4150-8634-f27984e41d8c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:01.708738 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2df48eea-dc26-4150-8634-f27984e41d8c tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 404 len: 111 microversion: 2.1 time: 0.041627 Sep 06 11:21:01.708738 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2839/5623] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:21:01 2022] DELETE /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:21:01.710391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:01.715606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e28c90ba-a9ff-4d52-a139-7ae05f591716 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:01.716235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e28c90ba-a9ff-4d52-a139-7ae05f591716 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 257d9d0f-050a-4894-89ce-2d78dc8abebc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:01.722535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e28c90ba-a9ff-4d52-a139-7ae05f591716 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.723056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e28c90ba-a9ff-4d52-a139-7ae05f591716 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.723514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e28c90ba-a9ff-4d52-a139-7ae05f591716 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.724229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e28c90ba-a9ff-4d52-a139-7ae05f591716 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.724726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e28c90ba-a9ff-4d52-a139-7ae05f591716 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.725186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e28c90ba-a9ff-4d52-a139-7ae05f591716 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.731886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4cd600d4-aafc-4b9d-a728-0a9537e701f8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:01.740890 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-e28c90ba-a9ff-4d52-a139-7ae05f591716 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:21:01.741752 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4cd600d4-aafc-4b9d-a728-0a9537e701f8 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1313 microversion: 2.1 time: 0.204107 Sep 06 11:21:01.742338 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2785/5624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:01 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e28c90ba-a9ff-4d52-a139-7ae05f591716 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc HTTP/1.1 Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '257d9d0f-050a-4894-89ce-2d78dc8abebc'} Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.744286 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.749272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.749272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.749272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.749272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:01.749272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:01.749272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. Sep 06 11:21:01.749272 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.749272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e28c90ba-a9ff-4d52-a139-7ae05f591716 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 257d9d0f-050a-4894-89ce-2d78dc8abebc could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:01.749272 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e28c90ba-a9ff-4d52-a139-7ae05f591716 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc" status: 404 len: 111 microversion: 2.1 time: 0.032417 Sep 06 11:21:01.749272 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2840/5625] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:01 2022] GET /compute/v2.1/servers/257d9d0f-050a-4894-89ce-2d78dc8abebc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:21:01.761493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5ec8f4ff-c931-4cc8-822e-2f327349c6b2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:01.762126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5ec8f4ff-c931-4cc8-822e-2f327349c6b2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:01.769854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ec8f4ff-c931-4cc8-822e-2f327349c6b2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.770361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ec8f4ff-c931-4cc8-822e-2f327349c6b2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.770814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ec8f4ff-c931-4cc8-822e-2f327349c6b2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.771641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ec8f4ff-c931-4cc8-822e-2f327349c6b2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.772102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ec8f4ff-c931-4cc8-822e-2f327349c6b2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.772701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ec8f4ff-c931-4cc8-822e-2f327349c6b2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.792470 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-5ec8f4ff-c931-4cc8-822e-2f327349c6b2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5ec8f4ff-c931-4cc8-822e-2f327349c6b2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 HTTP/1.1 Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'a9d7d8be-03de-4273-9886-bb005a0c02e5'} Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:01.794663 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:21:01.799116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.799116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.799116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.799116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.799116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.799116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.799116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:01.799116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:01.799116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:21:01.799116 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.799116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5ec8f4ff-c931-4cc8-822e-2f327349c6b2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:01.799116 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5ec8f4ff-c931-4cc8-822e-2f327349c6b2 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 404 len: 111 microversion: 2.1 time: 0.043406 Sep 06 11:21:01.799116 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2786/5626] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:21:01 2022] DELETE /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:21:01.806356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba3ca26a-412e-49ae-ab8f-09cf6e7a33f4 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:01.806980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ba3ca26a-412e-49ae-ab8f-09cf6e7a33f4 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: a9d7d8be-03de-4273-9886-bb005a0c02e5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:01.813630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba3ca26a-412e-49ae-ab8f-09cf6e7a33f4 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.814131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba3ca26a-412e-49ae-ab8f-09cf6e7a33f4 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.814583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba3ca26a-412e-49ae-ab8f-09cf6e7a33f4 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.815330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba3ca26a-412e-49ae-ab8f-09cf6e7a33f4 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.815791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba3ca26a-412e-49ae-ab8f-09cf6e7a33f4 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.816244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba3ca26a-412e-49ae-ab8f-09cf6e7a33f4 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.831271 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-ba3ca26a-412e-49ae-ab8f-09cf6e7a33f4 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba3ca26a-412e-49ae-ab8f-09cf6e7a33f4 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 HTTP/1.1 Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'a9d7d8be-03de-4273-9886-bb005a0c02e5'} Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.832753 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.837817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.837817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.837817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.837817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:01.837817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:01.837817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. Sep 06 11:21:01.837817 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.837817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba3ca26a-412e-49ae-ab8f-09cf6e7a33f4 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance a9d7d8be-03de-4273-9886-bb005a0c02e5 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:01.837817 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ba3ca26a-412e-49ae-ab8f-09cf6e7a33f4 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5" status: 404 len: 111 microversion: 2.1 time: 0.032456 Sep 06 11:21:01.837817 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2841/5627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:01 2022] GET /compute/v2.1/servers/a9d7d8be-03de-4273-9886-bb005a0c02e5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:21:01.848056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0421e2ae-da92-4e46-a747-7445c3a24b3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:01.851165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0421e2ae-da92-4e46-a747-7445c3a24b3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:01.855532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0421e2ae-da92-4e46-a747-7445c3a24b3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.856130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0421e2ae-da92-4e46-a747-7445c3a24b3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.856698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0421e2ae-da92-4e46-a747-7445c3a24b3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.857521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0421e2ae-da92-4e46-a747-7445c3a24b3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.858094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0421e2ae-da92-4e46-a747-7445c3a24b3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.858637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0421e2ae-da92-4e46-a747-7445c3a24b3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.883713 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-0421e2ae-da92-4e46-a747-7445c3a24b3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0421e2ae-da92-4e46-a747-7445c3a24b3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e HTTP/1.1 Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '631cc084-8ba7-4eb4-b496-684698dded7e'} Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:01.886740 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:21:01.892141 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.892141 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.892141 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.892141 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.892141 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.892141 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.892141 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:01.892141 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:01.892141 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:21:01.892141 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.892974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0421e2ae-da92-4e46-a747-7445c3a24b3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:01.893364 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0421e2ae-da92-4e46-a747-7445c3a24b3a tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 404 len: 111 microversion: 2.1 time: 0.049650 Sep 06 11:21:01.897357 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2787/5628] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:21:01 2022] DELETE /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:21:01.902592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b0b35f87-4c83-4633-b747-58fc48323965 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:01.903252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b0b35f87-4c83-4633-b747-58fc48323965 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 631cc084-8ba7-4eb4-b496-684698dded7e] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:01.909552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0b35f87-4c83-4633-b747-58fc48323965 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.910073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0b35f87-4c83-4633-b747-58fc48323965 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.910511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0b35f87-4c83-4633-b747-58fc48323965 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.911731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0b35f87-4c83-4633-b747-58fc48323965 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.911731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0b35f87-4c83-4633-b747-58fc48323965 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.912724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b0b35f87-4c83-4633-b747-58fc48323965 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.930321 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-b0b35f87-4c83-4633-b747-58fc48323965 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b0b35f87-4c83-4633-b747-58fc48323965 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e HTTP/1.1 Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '631cc084-8ba7-4eb4-b496-684698dded7e'} Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.934850 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.942495 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.942495 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.942495 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.942495 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:01.942495 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:01.942495 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. Sep 06 11:21:01.942495 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.942495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b0b35f87-4c83-4633-b747-58fc48323965 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 631cc084-8ba7-4eb4-b496-684698dded7e could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:01.942495 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b0b35f87-4c83-4633-b747-58fc48323965 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e" status: 404 len: 111 microversion: 2.1 time: 0.038084 Sep 06 11:21:01.942495 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2842/5629] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:01 2022] GET /compute/v2.1/servers/631cc084-8ba7-4eb4-b496-684698dded7e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:21:01.949572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b31cb507-6769-45f8-9a15-1e0d4f181267 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:01.951224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b31cb507-6769-45f8-9a15-1e0d4f181267 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:01.960714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b31cb507-6769-45f8-9a15-1e0d4f181267 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.961385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b31cb507-6769-45f8-9a15-1e0d4f181267 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.961978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b31cb507-6769-45f8-9a15-1e0d4f181267 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.963172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b31cb507-6769-45f8-9a15-1e0d4f181267 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:01.963741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b31cb507-6769-45f8-9a15-1e0d4f181267 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:01.964312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b31cb507-6769-45f8-9a15-1e0d4f181267 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:01.980693 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-b31cb507-6769-45f8-9a15-1e0d4f181267 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b31cb507-6769-45f8-9a15-1e0d4f181267 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 HTTP/1.1 Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '517663b7-ab94-4393-9fb3-8b51c26159a1'} Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:01.982460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:21:01.987351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.987351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:01.987351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.987351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:01.987351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:01.987351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:01.987351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:01.987351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:01.987351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:21:01.987351 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:01.987351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b31cb507-6769-45f8-9a15-1e0d4f181267 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:01.987351 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b31cb507-6769-45f8-9a15-1e0d4f181267 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 404 len: 111 microversion: 2.1 time: 0.042133 Sep 06 11:21:01.988056 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2788/5630] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:21:01 2022] DELETE /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:21:01.997840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a1aadae3-7950-4aa7-a0d2-c1a1c1ad883b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:01.999188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a1aadae3-7950-4aa7-a0d2-c1a1c1ad883b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 517663b7-ab94-4393-9fb3-8b51c26159a1] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:02.006434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1aadae3-7950-4aa7-a0d2-c1a1c1ad883b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.007264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1aadae3-7950-4aa7-a0d2-c1a1c1ad883b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.007778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1aadae3-7950-4aa7-a0d2-c1a1c1ad883b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.009426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1aadae3-7950-4aa7-a0d2-c1a1c1ad883b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.010035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1aadae3-7950-4aa7-a0d2-c1a1c1ad883b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.010610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1aadae3-7950-4aa7-a0d2-c1a1c1ad883b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.030778 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-a1aadae3-7950-4aa7-a0d2-c1a1c1ad883b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a1aadae3-7950-4aa7-a0d2-c1a1c1ad883b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 HTTP/1.1 Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '517663b7-ab94-4393-9fb3-8b51c26159a1'} Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:02.032552 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.037884 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.037884 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:02.037884 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:02.037884 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:02.037884 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:02.037884 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. Sep 06 11:21:02.037884 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.037884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a1aadae3-7950-4aa7-a0d2-c1a1c1ad883b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 517663b7-ab94-4393-9fb3-8b51c26159a1 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:02.039242 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a1aadae3-7950-4aa7-a0d2-c1a1c1ad883b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1" status: 404 len: 111 microversion: 2.1 time: 0.046324 Sep 06 11:21:02.047073 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2843/5631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:01 2022] GET /compute/v2.1/servers/517663b7-ab94-4393-9fb3-8b51c26159a1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:21:02.048658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3e9670f-baa9-468f-b0b0-bf22723b7026 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:02.049299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f3e9670f-baa9-468f-b0b0-bf22723b7026 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:02.056201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3e9670f-baa9-468f-b0b0-bf22723b7026 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.056702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3e9670f-baa9-468f-b0b0-bf22723b7026 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.057153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3e9670f-baa9-468f-b0b0-bf22723b7026 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.058198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3e9670f-baa9-468f-b0b0-bf22723b7026 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.058909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3e9670f-baa9-468f-b0b0-bf22723b7026 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.059398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3e9670f-baa9-468f-b0b0-bf22723b7026 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.076436 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-f3e9670f-baa9-468f-b0b0-bf22723b7026 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3e9670f-baa9-468f-b0b0-bf22723b7026 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 HTTP/1.1 Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '4062f393-6e8e-4c9b-9203-c71da792eaf4'} Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:02.078029 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:21:02.086764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.086764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:02.086764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.086764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.086764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:02.086764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:02.086764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:02.086764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:02.086764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:21:02.086764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.086764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3e9670f-baa9-468f-b0b0-bf22723b7026 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:02.086764 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f3e9670f-baa9-468f-b0b0-bf22723b7026 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 404 len: 111 microversion: 2.1 time: 0.034996 Sep 06 11:21:02.086764 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2789/5632] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:21:02 2022] DELETE /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:21:02.091072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed8a0439-9a3e-4ed9-a923-b92af3b571f1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:02.091808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ed8a0439-9a3e-4ed9-a923-b92af3b571f1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 4062f393-6e8e-4c9b-9203-c71da792eaf4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:02.099088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed8a0439-9a3e-4ed9-a923-b92af3b571f1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.100363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed8a0439-9a3e-4ed9-a923-b92af3b571f1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.100972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed8a0439-9a3e-4ed9-a923-b92af3b571f1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.101886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed8a0439-9a3e-4ed9-a923-b92af3b571f1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.102563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed8a0439-9a3e-4ed9-a923-b92af3b571f1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.102976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed8a0439-9a3e-4ed9-a923-b92af3b571f1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.121661 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-ed8a0439-9a3e-4ed9-a923-b92af3b571f1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed8a0439-9a3e-4ed9-a923-b92af3b571f1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 HTTP/1.1 Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '4062f393-6e8e-4c9b-9203-c71da792eaf4'} Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:02.123319 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.129021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.129021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:02.129021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:02.129021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:02.129021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:02.129021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. Sep 06 11:21:02.129021 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.129021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed8a0439-9a3e-4ed9-a923-b92af3b571f1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 4062f393-6e8e-4c9b-9203-c71da792eaf4 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:02.129021 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ed8a0439-9a3e-4ed9-a923-b92af3b571f1 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4" status: 404 len: 111 microversion: 2.1 time: 0.038312 Sep 06 11:21:02.129021 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2844/5633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:02 2022] GET /compute/v2.1/servers/4062f393-6e8e-4c9b-9203-c71da792eaf4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:21:02.133917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c00855e0-f5fb-475f-becf-7c36003e1f5b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:02.134720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c00855e0-f5fb-475f-becf-7c36003e1f5b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 445dc7ce-d25b-48b5-a66f-b4de93383178] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:02.140285 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-c00855e0-f5fb-475f-becf-7c36003e1f5b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c00855e0-f5fb-475f-becf-7c36003e1f5b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/445dc7ce-d25b-48b5-a66f-b4de93383178 HTTP/1.1 Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '445dc7ce-d25b-48b5-a66f-b4de93383178'} Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:02.141944 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.147572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.147572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:02.147572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:02.147572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:02.147572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:02.147572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:21:02.147572 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.147572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c00855e0-f5fb-475f-becf-7c36003e1f5b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:02.147572 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c00855e0-f5fb-475f-becf-7c36003e1f5b tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/445dc7ce-d25b-48b5-a66f-b4de93383178" status: 404 len: 111 microversion: 2.1 time: 0.013649 Sep 06 11:21:02.147572 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2790/5634] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:21:02 2022] DELETE /compute/v2.1/servers/445dc7ce-d25b-48b5-a66f-b4de93383178 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:21:02.152132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a6c0bcb6-153d-4102-8f8a-8017ca04f571 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:02.152704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a6c0bcb6-153d-4102-8f8a-8017ca04f571 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 445dc7ce-d25b-48b5-a66f-b4de93383178] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:02.159074 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-a6c0bcb6-153d-4102-8f8a-8017ca04f571 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a6c0bcb6-153d-4102-8f8a-8017ca04f571 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/445dc7ce-d25b-48b5-a66f-b4de93383178 HTTP/1.1 Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '445dc7ce-d25b-48b5-a66f-b4de93383178'} Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:02.160692 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:02.166519 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:02.166519 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:02.166519 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:02.166519 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. Sep 06 11:21:02.166519 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:02.166519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a6c0bcb6-153d-4102-8f8a-8017ca04f571 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 445dc7ce-d25b-48b5-a66f-b4de93383178 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:02.166519 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a6c0bcb6-153d-4102-8f8a-8017ca04f571 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/445dc7ce-d25b-48b5-a66f-b4de93383178" status: 404 len: 111 microversion: 2.1 time: 0.013948 Sep 06 11:21:02.166519 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2845/5635] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:02 2022] GET /compute/v2.1/servers/445dc7ce-d25b-48b5-a66f-b4de93383178 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:21:02.173395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ab9b958-5ce7-402a-bccf-71b71fe9e2cc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:02.173972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0ab9b958-5ce7-402a-bccf-71b71fe9e2cc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:02.181675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ab9b958-5ce7-402a-bccf-71b71fe9e2cc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.182277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ab9b958-5ce7-402a-bccf-71b71fe9e2cc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.182718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ab9b958-5ce7-402a-bccf-71b71fe9e2cc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.183484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ab9b958-5ce7-402a-bccf-71b71fe9e2cc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.183954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ab9b958-5ce7-402a-bccf-71b71fe9e2cc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.186809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ab9b958-5ce7-402a-bccf-71b71fe9e2cc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.213973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0ab9b958-5ce7-402a-bccf-71b71fe9e2cc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:21:02.502493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e8d6b09e-abab-4bda-9fd0-edc5315760e2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:02.503247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e8d6b09e-abab-4bda-9fd0-edc5315760e2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:02.512316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8d6b09e-abab-4bda-9fd0-edc5315760e2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.512845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8d6b09e-abab-4bda-9fd0-edc5315760e2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.513263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8d6b09e-abab-4bda-9fd0-edc5315760e2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.514164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8d6b09e-abab-4bda-9fd0-edc5315760e2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.515261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8d6b09e-abab-4bda-9fd0-edc5315760e2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.515867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8d6b09e-abab-4bda-9fd0-edc5315760e2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.597881 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0ab9b958-5ce7-402a-bccf-71b71fe9e2cc tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 204 len: 0 microversion: 2.1 time: 0.427632 Sep 06 11:21:02.598349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e8d6b09e-abab-4bda-9fd0-edc5315760e2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:02.609941 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2791/5636] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:21:02 2022] DELETE /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:21:02.610316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e8d6b09e-abab-4bda-9fd0-edc5315760e2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:02.611994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e8d6b09e-abab-4bda-9fd0-edc5315760e2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:02.613703 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e8d6b09e-abab-4bda-9fd0-edc5315760e2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1333 microversion: 2.20 time: 0.117588 Sep 06 11:21:02.614268 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2846/5637] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:02 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1333 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:21:02.621506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f64c10e9-0c32-4ddc-a4ff-d91ef5d1979d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:02.622646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f64c10e9-0c32-4ddc-a4ff-d91ef5d1979d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:02.632673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f64c10e9-0c32-4ddc-a4ff-d91ef5d1979d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.633430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f64c10e9-0c32-4ddc-a4ff-d91ef5d1979d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.634128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f64c10e9-0c32-4ddc-a4ff-d91ef5d1979d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.635280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f64c10e9-0c32-4ddc-a4ff-d91ef5d1979d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.636012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f64c10e9-0c32-4ddc-a4ff-d91ef5d1979d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.636715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f64c10e9-0c32-4ddc-a4ff-d91ef5d1979d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.767046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-162773e4-8995-468f-a198-83ae60326983 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:02.767815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-162773e4-8995-468f-a198-83ae60326983 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:02.775095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-162773e4-8995-468f-a198-83ae60326983 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.775610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-162773e4-8995-468f-a198-83ae60326983 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.776069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-162773e4-8995-468f-a198-83ae60326983 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.777043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-162773e4-8995-468f-a198-83ae60326983 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:02.777688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-162773e4-8995-468f-a198-83ae60326983 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:02.778125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-162773e4-8995-468f-a198-83ae60326983 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:02.783386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f64c10e9-0c32-4ddc-a4ff-d91ef5d1979d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:02.795847 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f64c10e9-0c32-4ddc-a4ff-d91ef5d1979d tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1481 microversion: 2.1 time: 0.185661 Sep 06 11:21:02.796438 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2792/5638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:02 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1481 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:02.941987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-162773e4-8995-468f-a198-83ae60326983 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:02.954371 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-162773e4-8995-468f-a198-83ae60326983 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1313 microversion: 2.1 time: 0.192182 Sep 06 11:21:02.955184 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2847/5639] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:02 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:21:03.640821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-18772e8f-a82b-4dcc-9eae-475c195a3c30 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:03.641439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-18772e8f-a82b-4dcc-9eae-475c195a3c30 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:03.649318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18772e8f-a82b-4dcc-9eae-475c195a3c30 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:03.649976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18772e8f-a82b-4dcc-9eae-475c195a3c30 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:03.650652 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18772e8f-a82b-4dcc-9eae-475c195a3c30 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:03.651424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18772e8f-a82b-4dcc-9eae-475c195a3c30 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:03.651920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18772e8f-a82b-4dcc-9eae-475c195a3c30 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:03.652367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18772e8f-a82b-4dcc-9eae-475c195a3c30 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:03.820145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a77f4b13-9770-4c05-b270-ff4cba0c7d25 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:03.821411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a77f4b13-9770-4c05-b270-ff4cba0c7d25 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:03.846205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a77f4b13-9770-4c05-b270-ff4cba0c7d25 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:03.846205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a77f4b13-9770-4c05-b270-ff4cba0c7d25 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:03.846205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a77f4b13-9770-4c05-b270-ff4cba0c7d25 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:03.846205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a77f4b13-9770-4c05-b270-ff4cba0c7d25 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:03.846205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a77f4b13-9770-4c05-b270-ff4cba0c7d25 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:03.846205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a77f4b13-9770-4c05-b270-ff4cba0c7d25 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:03.963670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-18772e8f-a82b-4dcc-9eae-475c195a3c30 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:03.986092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-18772e8f-a82b-4dcc-9eae-475c195a3c30 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:03.987834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-18772e8f-a82b-4dcc-9eae-475c195a3c30 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:03.989278 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-18772e8f-a82b-4dcc-9eae-475c195a3c30 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1407 microversion: 2.20 time: 0.352477 Sep 06 11:21:03.990104 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2793/5640] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:03 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:21:04.009010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1cd8276f-b452-489c-8650-b5da9caae8db tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:04.009714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1cd8276f-b452-489c-8650-b5da9caae8db tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:04.020266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:04.020266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cd8276f-b452-489c-8650-b5da9caae8db tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:04.020266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cd8276f-b452-489c-8650-b5da9caae8db tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:04.020266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cd8276f-b452-489c-8650-b5da9caae8db tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:04.020266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cd8276f-b452-489c-8650-b5da9caae8db tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:04.020266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cd8276f-b452-489c-8650-b5da9caae8db tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:04.020961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cd8276f-b452-489c-8650-b5da9caae8db tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:04.070971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a77f4b13-9770-4c05-b270-ff4cba0c7d25 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:04.081863 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a77f4b13-9770-4c05-b270-ff4cba0c7d25 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1481 microversion: 2.1 time: 0.265883 Sep 06 11:21:04.082689 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2848/5641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:03 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1481 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:21:04.521512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-6be30352-9508-435d-a20a-5d79e7115ef0 req-3029fa6b-bb11-4d48-b6fc-39860c58571d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb1ab51-5c16-42a8-b04f-b3b203315f77", "name": "network-vif-plugged", "status": "completed", "tag": "56d53d94-6ba1-4e50-8ab9-659bc04c8412"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:04.525825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1cd8276f-b452-489c-8650-b5da9caae8db tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:04.534370 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1cd8276f-b452-489c-8650-b5da9caae8db tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1313 microversion: 2.1 time: 0.542183 Sep 06 11:21:04.534971 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2794/5642] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:03 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:04.536995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6be30352-9508-435d-a20a-5d79e7115ef0 req-3029fa6b-bb11-4d48-b6fc-39860c58571d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:04.537680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6be30352-9508-435d-a20a-5d79e7115ef0 req-3029fa6b-bb11-4d48-b6fc-39860c58571d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:04.538279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6be30352-9508-435d-a20a-5d79e7115ef0 req-3029fa6b-bb11-4d48-b6fc-39860c58571d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:04.551732 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-6be30352-9508-435d-a20a-5d79e7115ef0 req-3029fa6b-bb11-4d48-b6fc-39860c58571d service nova] Creating event network-vif-plugged:56d53d94-6ba1-4e50-8ab9-659bc04c8412 for instance edb1ab51-5c16-42a8-b04f-b3b203315f77 on nch1-master-1 Sep 06 11:21:04.557995 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-6be30352-9508-435d-a20a-5d79e7115ef0 req-3029fa6b-bb11-4d48-b6fc-39860c58571d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.360703 Sep 06 11:21:04.558702 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2849/5643] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:21:05.025337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-526bf1c5-5939-4f35-b5a1-5847c7265652 req-2cdbb826-d651-4331-a7f6-d697e9f9077e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8c82a0-4b88-44e4-8699-c08424dfea56", "name": "network-vif-deleted", "tag": "ed301ee6-d65f-40a4-9f86-d755df5c1e48"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:05.030326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-452cb463-a666-4c06-9472-fa8b20f2d286 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:05.031695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-452cb463-a666-4c06-9472-fa8b20f2d286 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:05.040401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-452cb463-a666-4c06-9472-fa8b20f2d286 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:05.040660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-452cb463-a666-4c06-9472-fa8b20f2d286 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:05.041312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-452cb463-a666-4c06-9472-fa8b20f2d286 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:05.042140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-452cb463-a666-4c06-9472-fa8b20f2d286 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:05.042485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-452cb463-a666-4c06-9472-fa8b20f2d286 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:05.042915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-452cb463-a666-4c06-9472-fa8b20f2d286 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:05.051176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-526bf1c5-5939-4f35-b5a1-5847c7265652 req-2cdbb826-d651-4331-a7f6-d697e9f9077e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:05.051943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-526bf1c5-5939-4f35-b5a1-5847c7265652 req-2cdbb826-d651-4331-a7f6-d697e9f9077e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:05.053181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-526bf1c5-5939-4f35-b5a1-5847c7265652 req-2cdbb826-d651-4331-a7f6-d697e9f9077e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:05.068944 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-526bf1c5-5939-4f35-b5a1-5847c7265652 req-2cdbb826-d651-4331-a7f6-d697e9f9077e service nova] Creating event network-vif-deleted:ed301ee6-d65f-40a4-9f86-d755df5c1e48 for instance 5d8c82a0-4b88-44e4-8699-c08424dfea56 on nch1-master-1 Sep 06 11:21:05.074361 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-526bf1c5-5939-4f35-b5a1-5847c7265652 req-2cdbb826-d651-4331-a7f6-d697e9f9077e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053259 Sep 06 11:21:05.075116 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2795/5644] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:21:05.117905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-68742526-2d0c-44b8-8d8a-77383062668e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:05.119066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-68742526-2d0c-44b8-8d8a-77383062668e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:05.125759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68742526-2d0c-44b8-8d8a-77383062668e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:05.126498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68742526-2d0c-44b8-8d8a-77383062668e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:05.127183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68742526-2d0c-44b8-8d8a-77383062668e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:05.127918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68742526-2d0c-44b8-8d8a-77383062668e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:05.128405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68742526-2d0c-44b8-8d8a-77383062668e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:05.129049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68742526-2d0c-44b8-8d8a-77383062668e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:05.234642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-68742526-2d0c-44b8-8d8a-77383062668e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:05.234760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-452cb463-a666-4c06-9472-fa8b20f2d286 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:05.242946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-452cb463-a666-4c06-9472-fa8b20f2d286 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:05.249737 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-68742526-2d0c-44b8-8d8a-77383062668e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1439 microversion: 2.1 time: 0.136637 Sep 06 11:21:05.250468 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2796/5645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:05 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1439 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:05.255198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-452cb463-a666-4c06-9472-fa8b20f2d286 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:05.255198 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-452cb463-a666-4c06-9472-fa8b20f2d286 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1407 microversion: 2.20 time: 0.230944 Sep 06 11:21:05.267213 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2850/5646] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:05 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:21:05.558328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1258d1fa-b628-4d5c-9f8b-64429d6289b2 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:05.558804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1258d1fa-b628-4d5c-9f8b-64429d6289b2 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:05.565304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1258d1fa-b628-4d5c-9f8b-64429d6289b2 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:05.566141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1258d1fa-b628-4d5c-9f8b-64429d6289b2 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:05.566588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1258d1fa-b628-4d5c-9f8b-64429d6289b2 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:05.567335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1258d1fa-b628-4d5c-9f8b-64429d6289b2 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:05.567792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1258d1fa-b628-4d5c-9f8b-64429d6289b2 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:05.568476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1258d1fa-b628-4d5c-9f8b-64429d6289b2 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:05.723560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1258d1fa-b628-4d5c-9f8b-64429d6289b2 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:05.751047 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1258d1fa-b628-4d5c-9f8b-64429d6289b2 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1313 microversion: 2.1 time: 0.191447 Sep 06 11:21:05.752202 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2797/5647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:05 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:06.274013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:06.274898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:06.277801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:06.281454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cfe30542-dea2-4e3e-9835-bc9135b50093 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:06.282629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cfe30542-dea2-4e3e-9835-bc9135b50093 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:06.283866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:06.284368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:06.284878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:06.285588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:06.286259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:06.286693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:06.290423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfe30542-dea2-4e3e-9835-bc9135b50093 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:06.290918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfe30542-dea2-4e3e-9835-bc9135b50093 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:06.291597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfe30542-dea2-4e3e-9835-bc9135b50093 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:06.292317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfe30542-dea2-4e3e-9835-bc9135b50093 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:06.292788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfe30542-dea2-4e3e-9835-bc9135b50093 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:06.293241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cfe30542-dea2-4e3e-9835-bc9135b50093 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:06.327612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:06.328100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:06.328726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:06.329221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lazy-loading 'fault' on Instance uuid 5d8c82a0-4b88-44e4-8699-c08424dfea56 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:21:06.397830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce3e06ce4d40ba8db7988456cf8787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:06.413656 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2cfd0985-c251-43a3-8c86-68ee315cf97e tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 200 len: 1283 microversion: 2.1 time: 0.143149 Sep 06 11:21:06.414913 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2851/5648] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:06 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 1283 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:06.503590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cfe30542-dea2-4e3e-9835-bc9135b50093 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:06.512614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cfe30542-dea2-4e3e-9835-bc9135b50093 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:06.525675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cfe30542-dea2-4e3e-9835-bc9135b50093 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:06.525675 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cfe30542-dea2-4e3e-9835-bc9135b50093 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1407 microversion: 2.20 time: 0.238413 Sep 06 11:21:06.525675 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2798/5649] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:06 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:21:06.776409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-07760750-007a-403c-a457-fa33e26e4a1f tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:06.777035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-07760750-007a-403c-a457-fa33e26e4a1f tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:06.783824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07760750-007a-403c-a457-fa33e26e4a1f tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:06.784329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07760750-007a-403c-a457-fa33e26e4a1f tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:06.784780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07760750-007a-403c-a457-fa33e26e4a1f tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:06.785485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07760750-007a-403c-a457-fa33e26e4a1f tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:06.785965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07760750-007a-403c-a457-fa33e26e4a1f tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:06.786394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07760750-007a-403c-a457-fa33e26e4a1f tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:06.926009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-07760750-007a-403c-a457-fa33e26e4a1f tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:06.933907 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-07760750-007a-403c-a457-fa33e26e4a1f tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1497 microversion: 2.1 time: 0.161448 Sep 06 11:21:06.934489 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2852/5650] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:06 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:07.095178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-fd7e8e08-4f60-4590-aeda-46db4c66e960 req-0363b5d0-bb54-44dc-a5d1-83ff59adc943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc42cdc-6687-4ecd-b60a-ea23f69f50b2", "tag": "09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:07.107876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fd7e8e08-4f60-4590-aeda-46db4c66e960 req-0363b5d0-bb54-44dc-a5d1-83ff59adc943 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:07.111272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fd7e8e08-4f60-4590-aeda-46db4c66e960 req-0363b5d0-bb54-44dc-a5d1-83ff59adc943 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:07.111272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fd7e8e08-4f60-4590-aeda-46db4c66e960 req-0363b5d0-bb54-44dc-a5d1-83ff59adc943 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:07.121060 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-fd7e8e08-4f60-4590-aeda-46db4c66e960 req-0363b5d0-bb54-44dc-a5d1-83ff59adc943 service nova] Creating event network-changed:09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17 for instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 on nch2-master-1 Sep 06 11:21:07.126227 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-fd7e8e08-4f60-4590-aeda-46db4c66e960 req-0363b5d0-bb54-44dc-a5d1-83ff59adc943 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035374 Sep 06 11:21:07.126829 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2799/5651] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:21:07.455643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb86e51f-0e67-42e9-9330-a5054dd5fa91 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:07.455643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bb86e51f-0e67-42e9-9330-a5054dd5fa91 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] [instance: 5d8c82a0-4b88-44e4-8699-c08424dfea56] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:07.461609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb86e51f-0e67-42e9-9330-a5054dd5fa91 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:07.462101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb86e51f-0e67-42e9-9330-a5054dd5fa91 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:07.462542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb86e51f-0e67-42e9-9330-a5054dd5fa91 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:07.463291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb86e51f-0e67-42e9-9330-a5054dd5fa91 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:07.463752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb86e51f-0e67-42e9-9330-a5054dd5fa91 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:07.464178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb86e51f-0e67-42e9-9330-a5054dd5fa91 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:07.478937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:07.480350 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-bb86e51f-0e67-42e9-9330-a5054dd5fa91 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] HTTP exception thrown: Instance 5d8c82a0-4b88-44e4-8699-c08424dfea56 could not be found. Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb86e51f-0e67-42e9-9330-a5054dd5fa91 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Request method failure captured: Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 HTTP/1.1 Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyxntydi9vXJQ8_LQV6dpTrZe-nzre3yq4VDmvP-zgzioi6vN09UwsE6WMIxt6oAnavc_-ulxGteVnS2b_Pu1aIGIrVkaCDcikMN-fp0qXisgH7k-JP-A90suGCidtv6mNC6TxN8Dl6QJvFmyop9zv8opNYcs3-eKyltvfzLVxIV_dA Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2390b2ea3104bdab3ecdcae0dc415b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2390b2ea3104bdab3ecdcae0dc415b7"}]}] Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersTestJSON-1488299699 Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f2390b2ea3104bdab3ecdcae0dc415b7 Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersTestJSON-1488299699 Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: acce3e06ce4d40ba8db7988456cf8787 Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersTestJSON-1488299699-project Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 5d8c82a0-4b88-44e4-8699-c08424dfea56 could not be found. Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '5d8c82a0-4b88-44e4-8699-c08424dfea56'} Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8c82a0-4b88-44e4-8699-c08424dfea56 could not be found. Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8c82a0-4b88-44e4-8699-c08424dfea56 could not be found. Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:07.482029 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:07.485844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:07.485844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:07.485844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:07.485844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:07.485844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:07.485844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8c82a0-4b88-44e4-8699-c08424dfea56 could not be found. Sep 06 11:21:07.485844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:21:07.485844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb86e51f-0e67-42e9-9330-a5054dd5fa91 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] Returning 404 to user: Instance 5d8c82a0-4b88-44e4-8699-c08424dfea56 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:07.485844 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bb86e51f-0e67-42e9-9330-a5054dd5fa91 tempest-ServersTestJSON-1488299699 tempest-ServersTestJSON-1488299699-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56" status: 404 len: 111 microversion: 2.1 time: 0.035184 Sep 06 11:21:07.485844 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2853/5652] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:07 2022] GET /compute/v2.1/servers/5d8c82a0-4b88-44e4-8699-c08424dfea56 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:21:07.542615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c31d9ef-e732-4a41-8581-9ad0b9ad1441 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:07.543480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9c31d9ef-e732-4a41-8581-9ad0b9ad1441 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:07.557060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c31d9ef-e732-4a41-8581-9ad0b9ad1441 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:07.562159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c31d9ef-e732-4a41-8581-9ad0b9ad1441 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:07.562159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c31d9ef-e732-4a41-8581-9ad0b9ad1441 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:07.562159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c31d9ef-e732-4a41-8581-9ad0b9ad1441 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:07.562159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c31d9ef-e732-4a41-8581-9ad0b9ad1441 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:07.562159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c31d9ef-e732-4a41-8581-9ad0b9ad1441 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:07.789416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c31d9ef-e732-4a41-8581-9ad0b9ad1441 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:07.798519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c31d9ef-e732-4a41-8581-9ad0b9ad1441 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:07.800661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c31d9ef-e732-4a41-8581-9ad0b9ad1441 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:07.802070 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9c31d9ef-e732-4a41-8581-9ad0b9ad1441 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1407 microversion: 2.20 time: 0.264615 Sep 06 11:21:07.803423 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2800/5653] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:07 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:21:08.829741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8f6573a4-6c0e-41c7-9dd9-77bb65681e20 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:08.830651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8f6573a4-6c0e-41c7-9dd9-77bb65681e20 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:08.837721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f6573a4-6c0e-41c7-9dd9-77bb65681e20 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:08.838339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f6573a4-6c0e-41c7-9dd9-77bb65681e20 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:08.838808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f6573a4-6c0e-41c7-9dd9-77bb65681e20 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:08.839561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f6573a4-6c0e-41c7-9dd9-77bb65681e20 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:08.840027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f6573a4-6c0e-41c7-9dd9-77bb65681e20 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:08.840460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f6573a4-6c0e-41c7-9dd9-77bb65681e20 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:09.052926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8f6573a4-6c0e-41c7-9dd9-77bb65681e20 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:09.061894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8f6573a4-6c0e-41c7-9dd9-77bb65681e20 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:09.063474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8f6573a4-6c0e-41c7-9dd9-77bb65681e20 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:09.064670 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8f6573a4-6c0e-41c7-9dd9-77bb65681e20 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1407 microversion: 2.20 time: 0.239720 Sep 06 11:21:09.065648 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2854/5654] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:08 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:21:10.090001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f66ab7fe-ac49-40c8-a7de-a3d5ac07ef01 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:10.090631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f66ab7fe-ac49-40c8-a7de-a3d5ac07ef01 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:10.098081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f66ab7fe-ac49-40c8-a7de-a3d5ac07ef01 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:10.098583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f66ab7fe-ac49-40c8-a7de-a3d5ac07ef01 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:10.099059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f66ab7fe-ac49-40c8-a7de-a3d5ac07ef01 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:10.100300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f66ab7fe-ac49-40c8-a7de-a3d5ac07ef01 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:10.100820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f66ab7fe-ac49-40c8-a7de-a3d5ac07ef01 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:10.101259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f66ab7fe-ac49-40c8-a7de-a3d5ac07ef01 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:10.344121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=14 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:10.530547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f66ab7fe-ac49-40c8-a7de-a3d5ac07ef01 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:10.541476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f66ab7fe-ac49-40c8-a7de-a3d5ac07ef01 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:10.544018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f66ab7fe-ac49-40c8-a7de-a3d5ac07ef01 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:10.545841 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f66ab7fe-ac49-40c8-a7de-a3d5ac07ef01 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1407 microversion: 2.20 time: 0.459979 Sep 06 11:21:10.546610 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2801/5655] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:10 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1407 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:21:11.588566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-927b0408-3ff1-4bfd-8026-e2d586f8da8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:11.590057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-927b0408-3ff1-4bfd-8026-e2d586f8da8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:11.593914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:11.595479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:11.603465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-927b0408-3ff1-4bfd-8026-e2d586f8da8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:11.604344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-927b0408-3ff1-4bfd-8026-e2d586f8da8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:11.605273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-927b0408-3ff1-4bfd-8026-e2d586f8da8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:11.606817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-927b0408-3ff1-4bfd-8026-e2d586f8da8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:11.607694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-927b0408-3ff1-4bfd-8026-e2d586f8da8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:11.608418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-927b0408-3ff1-4bfd-8026-e2d586f8da8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:11.762247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-927b0408-3ff1-4bfd-8026-e2d586f8da8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:11.799777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-927b0408-3ff1-4bfd-8026-e2d586f8da8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:11.799777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-927b0408-3ff1-4bfd-8026-e2d586f8da8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:11.804017 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-927b0408-3ff1-4bfd-8026-e2d586f8da8d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1407 microversion: 2.20 time: 0.220295 Sep 06 11:21:11.806659 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2855/5656] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:11 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:21:12.410817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-bfe4b85f-76b5-46f8-86f3-ffdf7f93d6a8 req-df5b057f-f58b-461e-b469-31d1e1016a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc42cdc-6687-4ecd-b60a-ea23f69f50b2", "name": "network-vif-plugged", "status": "completed", "tag": "09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:12.422876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bfe4b85f-76b5-46f8-86f3-ffdf7f93d6a8 req-df5b057f-f58b-461e-b469-31d1e1016a66 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:12.423402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bfe4b85f-76b5-46f8-86f3-ffdf7f93d6a8 req-df5b057f-f58b-461e-b469-31d1e1016a66 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:12.423933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bfe4b85f-76b5-46f8-86f3-ffdf7f93d6a8 req-df5b057f-f58b-461e-b469-31d1e1016a66 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:12.437036 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-bfe4b85f-76b5-46f8-86f3-ffdf7f93d6a8 req-df5b057f-f58b-461e-b469-31d1e1016a66 service nova] Creating event network-vif-plugged:09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17 for instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 on nch2-master-1 Sep 06 11:21:12.442336 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-bfe4b85f-76b5-46f8-86f3-ffdf7f93d6a8 req-df5b057f-f58b-461e-b469-31d1e1016a66 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035868 Sep 06 11:21:12.442966 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2802/5657] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:21:12.832416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-22ff1e79-8457-4f7b-879b-7491c0f9ee90 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:12.834371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-22ff1e79-8457-4f7b-879b-7491c0f9ee90 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:12.843919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22ff1e79-8457-4f7b-879b-7491c0f9ee90 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:12.844430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22ff1e79-8457-4f7b-879b-7491c0f9ee90 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:12.845334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22ff1e79-8457-4f7b-879b-7491c0f9ee90 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:12.846046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22ff1e79-8457-4f7b-879b-7491c0f9ee90 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:12.846812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22ff1e79-8457-4f7b-879b-7491c0f9ee90 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:12.847438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22ff1e79-8457-4f7b-879b-7491c0f9ee90 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:13.047764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-22ff1e79-8457-4f7b-879b-7491c0f9ee90 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:13.059972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-22ff1e79-8457-4f7b-879b-7491c0f9ee90 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:13.061858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-22ff1e79-8457-4f7b-879b-7491c0f9ee90 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:13.063596 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-22ff1e79-8457-4f7b-879b-7491c0f9ee90 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1407 microversion: 2.20 time: 0.235328 Sep 06 11:21:13.066676 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2856/5658] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:12 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:21:14.090482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-939fa6c2-3b7f-44fd-a14f-d4dfd8043766 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:14.091267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-939fa6c2-3b7f-44fd-a14f-d4dfd8043766 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:14.103557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-939fa6c2-3b7f-44fd-a14f-d4dfd8043766 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:14.106319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-939fa6c2-3b7f-44fd-a14f-d4dfd8043766 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:14.106319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-939fa6c2-3b7f-44fd-a14f-d4dfd8043766 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:14.106319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-939fa6c2-3b7f-44fd-a14f-d4dfd8043766 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:14.106319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-939fa6c2-3b7f-44fd-a14f-d4dfd8043766 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:14.107048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-939fa6c2-3b7f-44fd-a14f-d4dfd8043766 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:14.187316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d3d894fe-5573-43e1-be1c-f322a9c84ee6 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:14.188206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3d894fe-5573-43e1-be1c-f322a9c84ee6 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:14.211099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d894fe-5573-43e1-be1c-f322a9c84ee6 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:14.216033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d894fe-5573-43e1-be1c-f322a9c84ee6 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:14.216033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d894fe-5573-43e1-be1c-f322a9c84ee6 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:14.216033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d894fe-5573-43e1-be1c-f322a9c84ee6 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:14.219767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d894fe-5573-43e1-be1c-f322a9c84ee6 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:14.220856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d894fe-5573-43e1-be1c-f322a9c84ee6 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:14.281191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3d894fe-5573-43e1-be1c-f322a9c84ee6 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:21:14.351495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-939fa6c2-3b7f-44fd-a14f-d4dfd8043766 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:14.362048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-939fa6c2-3b7f-44fd-a14f-d4dfd8043766 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:14.363755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-939fa6c2-3b7f-44fd-a14f-d4dfd8043766 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:14.365098 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-939fa6c2-3b7f-44fd-a14f-d4dfd8043766 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1600 microversion: 2.20 time: 0.278865 Sep 06 11:21:14.365668 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2803/5659] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:14 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1600 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:21:14.397893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24ef03c4-0ab5-429d-9c0f-17bb5d929a0f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:14.398404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-24ef03c4-0ab5-429d-9c0f-17bb5d929a0f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:14.405329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24ef03c4-0ab5-429d-9c0f-17bb5d929a0f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:14.408530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24ef03c4-0ab5-429d-9c0f-17bb5d929a0f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:14.408530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24ef03c4-0ab5-429d-9c0f-17bb5d929a0f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:14.408530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24ef03c4-0ab5-429d-9c0f-17bb5d929a0f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:14.408530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24ef03c4-0ab5-429d-9c0f-17bb5d929a0f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:14.408530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24ef03c4-0ab5-429d-9c0f-17bb5d929a0f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:14.517781 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-24ef03c4-0ab5-429d-9c0f-17bb5d929a0f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.126853 Sep 06 11:21:14.518595 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2804/5660] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Sep 6 11:21:14 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:21:14.632300 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d3d894fe-5573-43e1-be1c-f322a9c84ee6 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "DELETE /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 204 len: 0 microversion: 2.1 time: 0.454031 Sep 06 11:21:14.633934 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2857/5661] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:21:14 2022] DELETE /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:21:14.645499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-43563806-7282-4e0d-9f8f-6ee67ca2cf3b tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:14.646122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-43563806-7282-4e0d-9f8f-6ee67ca2cf3b tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:14.654293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43563806-7282-4e0d-9f8f-6ee67ca2cf3b tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:14.655048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43563806-7282-4e0d-9f8f-6ee67ca2cf3b tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:14.657228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43563806-7282-4e0d-9f8f-6ee67ca2cf3b tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:14.657228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43563806-7282-4e0d-9f8f-6ee67ca2cf3b tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:14.657228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43563806-7282-4e0d-9f8f-6ee67ca2cf3b tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:14.657228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43563806-7282-4e0d-9f8f-6ee67ca2cf3b tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:14.675750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:14.897588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-43563806-7282-4e0d-9f8f-6ee67ca2cf3b tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:14.913141 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-43563806-7282-4e0d-9f8f-6ee67ca2cf3b tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1503 microversion: 2.1 time: 0.271757 Sep 06 11:21:14.913931 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2805/5662] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:14 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:15.938250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-905fea3b-6a93-4cf1-9dfc-3927f5917404 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:15.938962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-905fea3b-6a93-4cf1-9dfc-3927f5917404 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:15.961819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-905fea3b-6a93-4cf1-9dfc-3927f5917404 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:15.962327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-905fea3b-6a93-4cf1-9dfc-3927f5917404 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:15.962995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-905fea3b-6a93-4cf1-9dfc-3927f5917404 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:15.963711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-905fea3b-6a93-4cf1-9dfc-3927f5917404 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:15.964171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-905fea3b-6a93-4cf1-9dfc-3927f5917404 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:15.964604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-905fea3b-6a93-4cf1-9dfc-3927f5917404 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:16.218792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-905fea3b-6a93-4cf1-9dfc-3927f5917404 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:16.229116 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-905fea3b-6a93-4cf1-9dfc-3927f5917404 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1503 microversion: 2.1 time: 0.294836 Sep 06 11:21:16.245762 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2858/5663] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:15 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:16.285965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-0549a047-31e7-446f-b418-a4a2255f3ce9 req-34647894-3fac-479e-97a9-9fcb0fa786bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc42cdc-6687-4ecd-b60a-ea23f69f50b2", "tag": "09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:16.297147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0549a047-31e7-446f-b418-a4a2255f3ce9 req-34647894-3fac-479e-97a9-9fcb0fa786bf service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:16.297646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0549a047-31e7-446f-b418-a4a2255f3ce9 req-34647894-3fac-479e-97a9-9fcb0fa786bf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:16.298085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0549a047-31e7-446f-b418-a4a2255f3ce9 req-34647894-3fac-479e-97a9-9fcb0fa786bf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:16.311446 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-0549a047-31e7-446f-b418-a4a2255f3ce9 req-34647894-3fac-479e-97a9-9fcb0fa786bf service nova] Creating event network-changed:09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17 for instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 on nch2-master-1 Sep 06 11:21:16.323194 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-0549a047-31e7-446f-b418-a4a2255f3ce9 req-34647894-3fac-479e-97a9-9fcb0fa786bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355112 Sep 06 11:21:16.325173 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2806/5664] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:21:17.262841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2ed7d529-18e0-4f60-b472-1da49fb5ade4 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:17.264348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2ed7d529-18e0-4f60-b472-1da49fb5ade4 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:17.272677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ed7d529-18e0-4f60-b472-1da49fb5ade4 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:17.275488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ed7d529-18e0-4f60-b472-1da49fb5ade4 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:17.275488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ed7d529-18e0-4f60-b472-1da49fb5ade4 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:17.275488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ed7d529-18e0-4f60-b472-1da49fb5ade4 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:17.275488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ed7d529-18e0-4f60-b472-1da49fb5ade4 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:17.276386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ed7d529-18e0-4f60-b472-1da49fb5ade4 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:17.371572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2ed7d529-18e0-4f60-b472-1da49fb5ade4 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:17.384171 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2ed7d529-18e0-4f60-b472-1da49fb5ade4 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1461 microversion: 2.1 time: 0.125611 Sep 06 11:21:17.384954 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2859/5665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:17 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1461 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:17.424301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b01fafcb-87e5-4508-a0dc-e42c6a49af12 req-f55962b5-cd63-455e-85d6-6f1d1fba5b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb1ab51-5c16-42a8-b04f-b3b203315f77", "name": "network-vif-deleted", "tag": "56d53d94-6ba1-4e50-8ab9-659bc04c8412"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:17.437648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b01fafcb-87e5-4508-a0dc-e42c6a49af12 req-f55962b5-cd63-455e-85d6-6f1d1fba5b8d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:17.438494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b01fafcb-87e5-4508-a0dc-e42c6a49af12 req-f55962b5-cd63-455e-85d6-6f1d1fba5b8d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:17.439296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b01fafcb-87e5-4508-a0dc-e42c6a49af12 req-f55962b5-cd63-455e-85d6-6f1d1fba5b8d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:17.485675 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b01fafcb-87e5-4508-a0dc-e42c6a49af12 req-f55962b5-cd63-455e-85d6-6f1d1fba5b8d service nova] Creating event network-vif-deleted:56d53d94-6ba1-4e50-8ab9-659bc04c8412 for instance edb1ab51-5c16-42a8-b04f-b3b203315f77 on nch1-master-1 Sep 06 11:21:17.499741 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b01fafcb-87e5-4508-a0dc-e42c6a49af12 req-f55962b5-cd63-455e-85d6-6f1d1fba5b8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080409 Sep 06 11:21:17.502419 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2807/5666] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:21:18.408852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:18.409291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:18.425528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:18.426029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:18.426691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:18.428185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:18.428861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:18.429300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:18.478129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:18.478918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:18.479407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:18.479879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lazy-loading 'fault' on Instance uuid edb1ab51-5c16-42a8-b04f-b3b203315f77 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:21:18.525889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236b8011d72b482eb6a61f27130aeb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303bd7f016fc4fe4a418a5452c85f74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:18.535095 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e5a86112-6364-4a18-ad52-a08102b3ddd7 tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 200 len: 1303 microversion: 2.1 time: 0.129815 Sep 06 11:21:18.538195 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2860/5667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:18 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:19.567824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a18f0dbe-ac99-4f30-825e-4d6f83413a1e tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:19.569329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a18f0dbe-ac99-4f30-825e-4d6f83413a1e tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] [instance: edb1ab51-5c16-42a8-b04f-b3b203315f77] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:19.576664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a18f0dbe-ac99-4f30-825e-4d6f83413a1e tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:19.577153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a18f0dbe-ac99-4f30-825e-4d6f83413a1e tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:19.577596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a18f0dbe-ac99-4f30-825e-4d6f83413a1e tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:19.578298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a18f0dbe-ac99-4f30-825e-4d6f83413a1e tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:19.578807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a18f0dbe-ac99-4f30-825e-4d6f83413a1e tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:19.579267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a18f0dbe-ac99-4f30-825e-4d6f83413a1e tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:19.597571 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-a18f0dbe-ac99-4f30-825e-4d6f83413a1e tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] HTTP exception thrown: Instance edb1ab51-5c16-42a8-b04f-b3b203315f77 could not be found. Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a18f0dbe-ac99-4f30-825e-4d6f83413a1e tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Request method failure captured: Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 HTTP/1.1 Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy0QBpe6Z2NTagbeQCr8YtiuD-YRjVo-DbSDi3FvUCcGpHEiMAjw1dWOwXVdgab83eyxwp_sV3rCds6KOzZHbI2vU2HJlRvuz3wDa3lpOPXXtxKN7BybPo0brTd4_X-rZnqCebTUM40KJAvabzK8iGDQ3NWxmn7NYSY_rWJaqs-0CKY Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 303bd7f016fc4fe4a418a5452c85f74d Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-VolumesActionsTest-1756987803 Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_303bd7f016fc4fe4a418a5452c85f74d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/303bd7f016fc4fe4a418a5452c85f74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/303bd7f016fc4fe4a418a5452c85f74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/303bd7f016fc4fe4a418a5452c85f74d"}]}] Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-VolumesActionsTest-1756987803 Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 303bd7f016fc4fe4a418a5452c85f74d Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-VolumesActionsTest-1756987803 Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-VolumesActionsTest-1756987803-project Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 236b8011d72b482eb6a61f27130aeb84 Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-VolumesActionsTest-1756987803-project Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance edb1ab51-5c16-42a8-b04f-b3b203315f77 could not be found. Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'edb1ab51-5c16-42a8-b04f-b3b203315f77'} Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edb1ab51-5c16-42a8-b04f-b3b203315f77 could not be found. Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edb1ab51-5c16-42a8-b04f-b3b203315f77 could not be found. Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:21:19.599449 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:19.607251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:21:19.607251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:21:19.607251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:21:19.607251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:21:19.607251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:21:19.607251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edb1ab51-5c16-42a8-b04f-b3b203315f77 could not be found. Sep 06 11:21:19.607251 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:21:19.607251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a18f0dbe-ac99-4f30-825e-4d6f83413a1e tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] Returning 404 to user: Instance edb1ab51-5c16-42a8-b04f-b3b203315f77 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:21:19.607251 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a18f0dbe-ac99-4f30-825e-4d6f83413a1e tempest-VolumesActionsTest-1756987803 tempest-VolumesActionsTest-1756987803-project] 10.222.0.20 "GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77" status: 404 len: 111 microversion: 2.1 time: 0.037798 Sep 06 11:21:19.607251 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2808/5668] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:19 2022] GET /compute/v2.1/servers/edb1ab51-5c16-42a8-b04f-b3b203315f77 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:21:22.149420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-07c6ef34-ca86-47f5-8ff4-017481b1e1aa tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Action: 'create', calling method: .version_select at 0x7f90f3218a60>, body: {"keypair": {"name": "tempest-keypair-410084559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzVCLPR3PKxlNkO1qJ4Yf6FiCZN//Am+pTgiO4uAT93+MI3DP/LVSB/bHQ1E4rt/7rDD4JID1iC+iqKEOKmZ/Yq/tmQHvXhGVNMGN0GA6o0iTWy7NjKPhwV4z8oAb8rfQ=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:22.167874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-07c6ef34-ca86-47f5-8ff4-017481b1e1aa tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Getting quotas for project b56b93d575b74ba584c4bd399dfe2a6c. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:21:22.174625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-07c6ef34-ca86-47f5-8ff4-017481b1e1aa tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Getting quotas for user 4251298aaf4e4207bdcab24fbdf30728 and project b56b93d575b74ba584c4bd399dfe2a6c. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:21:22.294198 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-07c6ef34-ca86-47f5-8ff4-017481b1e1aa tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.217163 Sep 06 11:21:22.294809 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2861/5669] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:21:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:21:25.002196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-374940922", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d04a3e29-5263-4e2d-a049-aab206fdcdf3"}], "security_groups": [{"name": "tempest-securitygroup--89380335"}], "key_name": "tempest-keypair-410084559", "user_data": "}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:25.148396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] validate_networks() for [('d04a3e29-5263-4e2d-a049-aab206fdcdf3', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:21:25.804975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:21:25.805401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:21:25.805887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:21:25.806307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:21:25.806729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:21:25.816455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:25.816975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:25.817424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:25.818178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:25.818645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:25.819108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:25.838070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Getting quotas for project b56b93d575b74ba584c4bd399dfe2a6c. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:21:25.844337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Getting quotas for user 4251298aaf4e4207bdcab24fbdf30728 and project b56b93d575b74ba584c4bd399dfe2a6c. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:21:25.858907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:21:25.861316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:21:26.021189 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1b260cab-8a29-4d6a-a388-c886d038b190 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.023047 Sep 06 11:21:26.030581 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2809/5670] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:21:24 2022] POST /compute/v2.1/servers => generated 400 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:21:26.047454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-567c5750-8a77-4568-a7a2-794967433ee5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:26.048449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-567c5750-8a77-4568-a7a2-794967433ee5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:26.116462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-567c5750-8a77-4568-a7a2-794967433ee5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:26.126720 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-567c5750-8a77-4568-a7a2-794967433ee5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1236 microversion: 2.1 time: 0.086742 Sep 06 11:21:26.128117 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2862/5671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:26 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:27.151826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3429e643-2661-49fe-abfc-69dacd2114a9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:27.152526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3429e643-2661-49fe-abfc-69dacd2114a9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:27.210412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3429e643-2661-49fe-abfc-69dacd2114a9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:27.217660 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3429e643-2661-49fe-abfc-69dacd2114a9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1236 microversion: 2.1 time: 0.069830 Sep 06 11:21:27.218224 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2810/5672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:27 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:21:28.241209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-77e45af5-069d-4d05-a37d-8de6471f73f8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:28.241832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-77e45af5-069d-4d05-a37d-8de6471f73f8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:28.252713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77e45af5-069d-4d05-a37d-8de6471f73f8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:28.253220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77e45af5-069d-4d05-a37d-8de6471f73f8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:28.253675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77e45af5-069d-4d05-a37d-8de6471f73f8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:28.254432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77e45af5-069d-4d05-a37d-8de6471f73f8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:28.254903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77e45af5-069d-4d05-a37d-8de6471f73f8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:28.255397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77e45af5-069d-4d05-a37d-8de6471f73f8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:28.334733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77e45af5-069d-4d05-a37d-8de6471f73f8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:28.345104 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-77e45af5-069d-4d05-a37d-8de6471f73f8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1288 microversion: 2.1 time: 0.108317 Sep 06 11:21:28.345846 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2863/5673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:28 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1288 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:29.381359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-652d8227-2c53-4679-828c-cdac5838e108 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:29.382272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-652d8227-2c53-4679-828c-cdac5838e108 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:29.390708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-652d8227-2c53-4679-828c-cdac5838e108 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:29.391372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-652d8227-2c53-4679-828c-cdac5838e108 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:29.391825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-652d8227-2c53-4679-828c-cdac5838e108 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:29.392551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-652d8227-2c53-4679-828c-cdac5838e108 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:29.398177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-652d8227-2c53-4679-828c-cdac5838e108 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:29.398177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-652d8227-2c53-4679-828c-cdac5838e108 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:29.459284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-652d8227-2c53-4679-828c-cdac5838e108 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:29.467454 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-652d8227-2c53-4679-828c-cdac5838e108 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1294 microversion: 2.1 time: 0.093611 Sep 06 11:21:29.468038 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2811/5674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:29 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:30.494386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ee7e4413-b23a-4f12-983a-818a261374c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:30.495970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ee7e4413-b23a-4f12-983a-818a261374c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:30.507404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee7e4413-b23a-4f12-983a-818a261374c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:30.508119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee7e4413-b23a-4f12-983a-818a261374c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:30.509013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee7e4413-b23a-4f12-983a-818a261374c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:30.509936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee7e4413-b23a-4f12-983a-818a261374c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:30.510591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee7e4413-b23a-4f12-983a-818a261374c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:30.511258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ee7e4413-b23a-4f12-983a-818a261374c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:30.671835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ee7e4413-b23a-4f12-983a-818a261374c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:30.684457 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ee7e4413-b23a-4f12-983a-818a261374c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1360 microversion: 2.1 time: 0.196006 Sep 06 11:21:30.685067 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2864/5675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:30 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1360 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:21:30.850442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6171ff41-6930-4950-b1a7-468648b472c5 req-772c1c56-a899-4c5b-a145-0d2634d35fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f263e1-7ed7-4e44-a150-57400223dbb6", "tag": "f5241706-75c9-4160-aa4f-04f22ce374fd"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:30.860330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6171ff41-6930-4950-b1a7-468648b472c5 req-772c1c56-a899-4c5b-a145-0d2634d35fcb service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:30.860829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6171ff41-6930-4950-b1a7-468648b472c5 req-772c1c56-a899-4c5b-a145-0d2634d35fcb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:30.871362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6171ff41-6930-4950-b1a7-468648b472c5 req-772c1c56-a899-4c5b-a145-0d2634d35fcb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:30.872956 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6171ff41-6930-4950-b1a7-468648b472c5 req-772c1c56-a899-4c5b-a145-0d2634d35fcb service nova] Creating event network-changed:f5241706-75c9-4160-aa4f-04f22ce374fd for instance 14f263e1-7ed7-4e44-a150-57400223dbb6 on nch1-master-1 Sep 06 11:21:30.878214 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6171ff41-6930-4950-b1a7-468648b472c5 req-772c1c56-a899-4c5b-a145-0d2634d35fcb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128854 Sep 06 11:21:30.879409 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2812/5676] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:21:31.709509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0fa81e66-de20-44d5-9686-945efd29c21c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:31.713955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0fa81e66-de20-44d5-9686-945efd29c21c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:31.717382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fa81e66-de20-44d5-9686-945efd29c21c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:31.717890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fa81e66-de20-44d5-9686-945efd29c21c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:31.718336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fa81e66-de20-44d5-9686-945efd29c21c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:31.719080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fa81e66-de20-44d5-9686-945efd29c21c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:31.719552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fa81e66-de20-44d5-9686-945efd29c21c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:31.719987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fa81e66-de20-44d5-9686-945efd29c21c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:31.889060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0fa81e66-de20-44d5-9686-945efd29c21c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:31.918125 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0fa81e66-de20-44d5-9686-945efd29c21c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1360 microversion: 2.1 time: 0.212553 Sep 06 11:21:31.918735 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2865/5677] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:31 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1360 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:32.942687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c20cfeae-8061-4cfa-8c76-80b8721d4b13 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:32.943832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c20cfeae-8061-4cfa-8c76-80b8721d4b13 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:32.950339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c20cfeae-8061-4cfa-8c76-80b8721d4b13 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:32.950835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c20cfeae-8061-4cfa-8c76-80b8721d4b13 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:32.951303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c20cfeae-8061-4cfa-8c76-80b8721d4b13 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:32.952017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c20cfeae-8061-4cfa-8c76-80b8721d4b13 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:32.952481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c20cfeae-8061-4cfa-8c76-80b8721d4b13 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:32.952922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c20cfeae-8061-4cfa-8c76-80b8721d4b13 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:33.093669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c20cfeae-8061-4cfa-8c76-80b8721d4b13 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:33.102146 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c20cfeae-8061-4cfa-8c76-80b8721d4b13 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1360 microversion: 2.1 time: 0.164668 Sep 06 11:21:33.102724 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2813/5678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:32 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:34.128278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7c054e0e-2087-4ceb-a622-bbe3425f159f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:34.129469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7c054e0e-2087-4ceb-a622-bbe3425f159f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:34.137685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c054e0e-2087-4ceb-a622-bbe3425f159f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:34.138181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c054e0e-2087-4ceb-a622-bbe3425f159f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:34.138832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c054e0e-2087-4ceb-a622-bbe3425f159f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:34.140278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c054e0e-2087-4ceb-a622-bbe3425f159f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:34.140749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c054e0e-2087-4ceb-a622-bbe3425f159f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:34.141177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c054e0e-2087-4ceb-a622-bbe3425f159f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:34.288859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7c054e0e-2087-4ceb-a622-bbe3425f159f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:34.297377 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7c054e0e-2087-4ceb-a622-bbe3425f159f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1360 microversion: 2.1 time: 0.176084 Sep 06 11:21:34.304391 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2866/5679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:34 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1360 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:35.324666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aa904001-dff1-4e8b-944d-669a581adf1f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:35.325356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aa904001-dff1-4e8b-944d-669a581adf1f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:35.332765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa904001-dff1-4e8b-944d-669a581adf1f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:35.333254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa904001-dff1-4e8b-944d-669a581adf1f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:35.333704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa904001-dff1-4e8b-944d-669a581adf1f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:35.334413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa904001-dff1-4e8b-944d-669a581adf1f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:35.334875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa904001-dff1-4e8b-944d-669a581adf1f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:35.335446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa904001-dff1-4e8b-944d-669a581adf1f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:35.494794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aa904001-dff1-4e8b-944d-669a581adf1f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:35.503060 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aa904001-dff1-4e8b-944d-669a581adf1f tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1360 microversion: 2.1 time: 0.182989 Sep 06 11:21:35.503665 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2814/5680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:35 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1360 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:36.220709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-32ea3859-6566-4313-9d83-5ca7d078496b req-9b9f62bc-5880-436b-8f35-a25b2ee04eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f263e1-7ed7-4e44-a150-57400223dbb6", "name": "network-vif-plugged", "status": "completed", "tag": "f5241706-75c9-4160-aa4f-04f22ce374fd"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:36.227749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:36.233567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-32ea3859-6566-4313-9d83-5ca7d078496b req-9b9f62bc-5880-436b-8f35-a25b2ee04eae service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:36.234057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-32ea3859-6566-4313-9d83-5ca7d078496b req-9b9f62bc-5880-436b-8f35-a25b2ee04eae service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:36.234500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-32ea3859-6566-4313-9d83-5ca7d078496b req-9b9f62bc-5880-436b-8f35-a25b2ee04eae service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:36.248777 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-32ea3859-6566-4313-9d83-5ca7d078496b req-9b9f62bc-5880-436b-8f35-a25b2ee04eae service nova] Creating event network-vif-plugged:f5241706-75c9-4160-aa4f-04f22ce374fd for instance 14f263e1-7ed7-4e44-a150-57400223dbb6 on nch1-master-1 Sep 06 11:21:36.254136 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-32ea3859-6566-4313-9d83-5ca7d078496b req-9b9f62bc-5880-436b-8f35-a25b2ee04eae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037532 Sep 06 11:21:36.254789 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2867/5681] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:21:36.528005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8264680d-52a2-4ccf-87b3-819cfcbac4be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:36.528625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8264680d-52a2-4ccf-87b3-819cfcbac4be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:36.530744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:36.532309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:36.537201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8264680d-52a2-4ccf-87b3-819cfcbac4be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:36.540602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8264680d-52a2-4ccf-87b3-819cfcbac4be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:36.540602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8264680d-52a2-4ccf-87b3-819cfcbac4be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:36.540602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8264680d-52a2-4ccf-87b3-819cfcbac4be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:36.540602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8264680d-52a2-4ccf-87b3-819cfcbac4be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:36.540602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8264680d-52a2-4ccf-87b3-819cfcbac4be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:36.684859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8264680d-52a2-4ccf-87b3-819cfcbac4be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:36.693603 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8264680d-52a2-4ccf-87b3-819cfcbac4be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1360 microversion: 2.1 time: 0.169250 Sep 06 11:21:36.694222 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2815/5682] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:36 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1360 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:37.719859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-806472fe-6a3c-4872-9800-a56597f081c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:37.720606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-806472fe-6a3c-4872-9800-a56597f081c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:37.727593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-806472fe-6a3c-4872-9800-a56597f081c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:37.728079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-806472fe-6a3c-4872-9800-a56597f081c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:37.730974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-806472fe-6a3c-4872-9800-a56597f081c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:37.730974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-806472fe-6a3c-4872-9800-a56597f081c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:37.730974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-806472fe-6a3c-4872-9800-a56597f081c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:37.730974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-806472fe-6a3c-4872-9800-a56597f081c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:37.885722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-806472fe-6a3c-4872-9800-a56597f081c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:37.894005 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-806472fe-6a3c-4872-9800-a56597f081c3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1546 microversion: 2.1 time: 0.180029 Sep 06 11:21:37.895413 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2868/5683] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:21:37 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1546 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:21:37.929794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4b2d439c-5cda-4878-991f-a9d93a6ab0cd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:37.929794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4b2d439c-5cda-4878-991f-a9d93a6ab0cd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:37.929794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:37.933018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b2d439c-5cda-4878-991f-a9d93a6ab0cd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:37.933513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b2d439c-5cda-4878-991f-a9d93a6ab0cd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:37.933958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b2d439c-5cda-4878-991f-a9d93a6ab0cd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:37.934663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b2d439c-5cda-4878-991f-a9d93a6ab0cd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:37.935164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b2d439c-5cda-4878-991f-a9d93a6ab0cd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:37.935599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b2d439c-5cda-4878-991f-a9d93a6ab0cd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:38.022163 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4b2d439c-5cda-4878-991f-a9d93a6ab0cd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102404 Sep 06 11:21:38.022799 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2816/5684] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:21:37 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:21:39.108518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-3484e311-9fcb-4e2b-82b8-3da99445b670 req-8b00865b-625d-4ff4-9e8f-0445b681e044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f263e1-7ed7-4e44-a150-57400223dbb6", "tag": "f5241706-75c9-4160-aa4f-04f22ce374fd"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:39.114604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:39.121098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3484e311-9fcb-4e2b-82b8-3da99445b670 req-8b00865b-625d-4ff4-9e8f-0445b681e044 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:39.121687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3484e311-9fcb-4e2b-82b8-3da99445b670 req-8b00865b-625d-4ff4-9e8f-0445b681e044 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:39.122200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3484e311-9fcb-4e2b-82b8-3da99445b670 req-8b00865b-625d-4ff4-9e8f-0445b681e044 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:39.125238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:39.139119 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-3484e311-9fcb-4e2b-82b8-3da99445b670 req-8b00865b-625d-4ff4-9e8f-0445b681e044 service nova] Creating event network-changed:f5241706-75c9-4160-aa4f-04f22ce374fd for instance 14f263e1-7ed7-4e44-a150-57400223dbb6 on nch1-master-1 Sep 06 11:21:39.144968 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-3484e311-9fcb-4e2b-82b8-3da99445b670 req-8b00865b-625d-4ff4-9e8f-0445b681e044 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040169 Sep 06 11:21:39.145895 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2869/5685] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:21:52.585762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:52.586589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=41 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:52.590654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9768ab74-f2fe-4a33-b1f4-9e79ace44d7c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:52.591422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9768ab74-f2fe-4a33-b1f4-9e79ace44d7c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:52.597243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9768ab74-f2fe-4a33-b1f4-9e79ace44d7c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:52.597735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9768ab74-f2fe-4a33-b1f4-9e79ace44d7c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:52.598182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9768ab74-f2fe-4a33-b1f4-9e79ace44d7c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:52.598892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9768ab74-f2fe-4a33-b1f4-9e79ace44d7c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:52.599363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9768ab74-f2fe-4a33-b1f4-9e79ace44d7c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:52.599794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9768ab74-f2fe-4a33-b1f4-9e79ace44d7c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:52.628116 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9768ab74-f2fe-4a33-b1f4-9e79ace44d7c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/ips" status: 200 len: 153 microversion: 2.20 time: 0.044173 Sep 06 11:21:52.628844 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2817/5686] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Sep 6 11:21:52 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/ips => generated 153 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:21:53.487630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d1f804b1-8d60-42d4-b877-b197743b7038 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:53.490149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d1f804b1-8d60-42d4-b877-b197743b7038 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:53.497496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1f804b1-8d60-42d4-b877-b197743b7038 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:53.498041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1f804b1-8d60-42d4-b877-b197743b7038 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:53.498484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1f804b1-8d60-42d4-b877-b197743b7038 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:53.499210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1f804b1-8d60-42d4-b877-b197743b7038 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:53.499667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1f804b1-8d60-42d4-b877-b197743b7038 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:53.500092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d1f804b1-8d60-42d4-b877-b197743b7038 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:53.567472 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d1f804b1-8d60-42d4-b877-b197743b7038 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "POST /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0/action" status: 200 len: 32484 microversion: 2.42 time: 0.085856 Sep 06 11:21:53.575234 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2870/5687] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:21:53 2022] POST /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0/action => generated 32484 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:21:53.583072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:53.583643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:53.592423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:53.593006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:53.593504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:53.594223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:53.594698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:53.595163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:53.621373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:21:53.933435 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 204 len: 0 microversion: 2.42 time: 0.355472 Sep 06 11:21:53.934030 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2818/5688] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:21:53 2022] DELETE /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 06 11:21:53.948162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e147591e-be75-4b62-8cde-94b3e326bc2c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:53.948883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e147591e-be75-4b62-8cde-94b3e326bc2c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:53.964008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e147591e-be75-4b62-8cde-94b3e326bc2c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:53.967349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e147591e-be75-4b62-8cde-94b3e326bc2c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:53.967349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e147591e-be75-4b62-8cde-94b3e326bc2c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:53.967349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e147591e-be75-4b62-8cde-94b3e326bc2c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:53.967349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e147591e-be75-4b62-8cde-94b3e326bc2c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:53.967349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e147591e-be75-4b62-8cde-94b3e326bc2c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:54.162650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e147591e-be75-4b62-8cde-94b3e326bc2c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:54.172851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e147591e-be75-4b62-8cde-94b3e326bc2c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:54.174300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e147591e-be75-4b62-8cde-94b3e326bc2c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:54.175599 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e147591e-be75-4b62-8cde-94b3e326bc2c tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 2954 microversion: 2.42 time: 0.234953 Sep 06 11:21:54.176166 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2871/5689] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:53 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 2954 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:21:55.205145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-44ab719c-2289-4e1c-b299-adf8ab6935c2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:55.205859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-44ab719c-2289-4e1c-b299-adf8ab6935c2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:55.213180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44ab719c-2289-4e1c-b299-adf8ab6935c2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:55.214930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44ab719c-2289-4e1c-b299-adf8ab6935c2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:55.214930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44ab719c-2289-4e1c-b299-adf8ab6935c2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:55.214930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44ab719c-2289-4e1c-b299-adf8ab6935c2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:55.215302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44ab719c-2289-4e1c-b299-adf8ab6935c2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:55.215740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44ab719c-2289-4e1c-b299-adf8ab6935c2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:55.405399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-44ab719c-2289-4e1c-b299-adf8ab6935c2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:55.413464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-44ab719c-2289-4e1c-b299-adf8ab6935c2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:55.414921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-44ab719c-2289-4e1c-b299-adf8ab6935c2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:55.416216 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-44ab719c-2289-4e1c-b299-adf8ab6935c2 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 2954 microversion: 2.42 time: 0.216204 Sep 06 11:21:55.416776 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2819/5690] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:55 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 2954 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:21:56.445636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-23c7ddde-c684-4e7b-81f7-58c3e4a0994a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:56.446288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-23c7ddde-c684-4e7b-81f7-58c3e4a0994a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:56.453642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23c7ddde-c684-4e7b-81f7-58c3e4a0994a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:56.454180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23c7ddde-c684-4e7b-81f7-58c3e4a0994a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:56.454633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23c7ddde-c684-4e7b-81f7-58c3e4a0994a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:56.455378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23c7ddde-c684-4e7b-81f7-58c3e4a0994a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:56.456124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23c7ddde-c684-4e7b-81f7-58c3e4a0994a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:56.456634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23c7ddde-c684-4e7b-81f7-58c3e4a0994a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:56.633099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-23c7ddde-c684-4e7b-81f7-58c3e4a0994a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:56.647737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-23c7ddde-c684-4e7b-81f7-58c3e4a0994a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:56.649500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-23c7ddde-c684-4e7b-81f7-58c3e4a0994a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:56.650927 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-23c7ddde-c684-4e7b-81f7-58c3e4a0994a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 2912 microversion: 2.42 time: 0.209451 Sep 06 11:21:56.651667 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2872/5691] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:56 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 2912 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:21:57.061492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-50ff104c-abdc-4011-8130-f29a3e2670c1 req-0d4a0963-17e8-4a95-abe9-ba0afa12d644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-deleted", "tag": "7632117e-275e-451b-973e-484d4cf38e3a"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:57.072580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-50ff104c-abdc-4011-8130-f29a3e2670c1 req-0d4a0963-17e8-4a95-abe9-ba0afa12d644 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:57.073063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-50ff104c-abdc-4011-8130-f29a3e2670c1 req-0d4a0963-17e8-4a95-abe9-ba0afa12d644 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:57.073504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-50ff104c-abdc-4011-8130-f29a3e2670c1 req-0d4a0963-17e8-4a95-abe9-ba0afa12d644 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:57.086047 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-50ff104c-abdc-4011-8130-f29a3e2670c1 req-0d4a0963-17e8-4a95-abe9-ba0afa12d644 service nova] Creating event network-vif-deleted:7632117e-275e-451b-973e-484d4cf38e3a for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:21:57.092438 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-50ff104c-abdc-4011-8130-f29a3e2670c1 req-0d4a0963-17e8-4a95-abe9-ba0afa12d644 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034599 Sep 06 11:21:57.096434 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2820/5692] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:21:57.680988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d201820f-ac4e-41d4-886e-9179d4f60f05 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:57.681612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d201820f-ac4e-41d4-886e-9179d4f60f05 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:57.689788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d201820f-ac4e-41d4-886e-9179d4f60f05 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:57.694635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d201820f-ac4e-41d4-886e-9179d4f60f05 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:57.694635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d201820f-ac4e-41d4-886e-9179d4f60f05 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:57.694635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d201820f-ac4e-41d4-886e-9179d4f60f05 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:57.694635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d201820f-ac4e-41d4-886e-9179d4f60f05 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:57.694635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d201820f-ac4e-41d4-886e-9179d4f60f05 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:57.850000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d201820f-ac4e-41d4-886e-9179d4f60f05 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:57.860608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d201820f-ac4e-41d4-886e-9179d4f60f05 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:57.862159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d201820f-ac4e-41d4-886e-9179d4f60f05 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:57.863485 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d201820f-ac4e-41d4-886e-9179d4f60f05 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 2706 microversion: 2.42 time: 0.186568 Sep 06 11:21:57.864063 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2873/5693] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:57 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 2706 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:21:57.988589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a9bd38ab-e6e0-4985-8ba5-961f96d54732 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:57.989163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a9bd38ab-e6e0-4985-8ba5-961f96d54732 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:57.999765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9bd38ab-e6e0-4985-8ba5-961f96d54732 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:58.000298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9bd38ab-e6e0-4985-8ba5-961f96d54732 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:58.000742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9bd38ab-e6e0-4985-8ba5-961f96d54732 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:58.001458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9bd38ab-e6e0-4985-8ba5-961f96d54732 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:58.001948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9bd38ab-e6e0-4985-8ba5-961f96d54732 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:58.002383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9bd38ab-e6e0-4985-8ba5-961f96d54732 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:58.040064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-a9bd38ab-e6e0-4985-8ba5-961f96d54732 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lazy-loading 'flavor' on Instance uuid 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:21:58.692217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-0fe18300-b755-4aff-83bc-58bd26c7a5f7 req-baa40405-a649-4bb5-b39d-e9a6114c52c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-unplugged", "status": "completed", "tag": "668f5dcf-b1c4-4540-a554-6a6dad1d4823"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:58.702290 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a9bd38ab-e6e0-4985-8ba5-961f96d54732 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "POST /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/action" status: 202 len: 0 microversion: 2.20 time: 0.721127 Sep 06 11:21:58.706272 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2821/5694] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:21:57 2022] POST /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/action => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:21:58.722335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-939e0123-5465-4651-9c8a-0d7367a54a89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:58.724600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-939e0123-5465-4651-9c8a-0d7367a54a89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:58.729089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0fe18300-b755-4aff-83bc-58bd26c7a5f7 req-baa40405-a649-4bb5-b39d-e9a6114c52c1 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:58.733999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0fe18300-b755-4aff-83bc-58bd26c7a5f7 req-baa40405-a649-4bb5-b39d-e9a6114c52c1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:58.733999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0fe18300-b755-4aff-83bc-58bd26c7a5f7 req-baa40405-a649-4bb5-b39d-e9a6114c52c1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:58.737968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-939e0123-5465-4651-9c8a-0d7367a54a89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:58.749524 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-0fe18300-b755-4aff-83bc-58bd26c7a5f7 req-baa40405-a649-4bb5-b39d-e9a6114c52c1 service nova] Creating event network-vif-unplugged:668f5dcf-b1c4-4540-a554-6a6dad1d4823 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:21:58.749894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-939e0123-5465-4651-9c8a-0d7367a54a89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:58.751222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-939e0123-5465-4651-9c8a-0d7367a54a89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:58.752276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-939e0123-5465-4651-9c8a-0d7367a54a89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:58.752912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-939e0123-5465-4651-9c8a-0d7367a54a89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:58.753674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-939e0123-5465-4651-9c8a-0d7367a54a89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:58.772325 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-0fe18300-b755-4aff-83bc-58bd26c7a5f7 req-baa40405-a649-4bb5-b39d-e9a6114c52c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087951 Sep 06 11:21:58.772965 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2874/5695] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:21:58.909564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a34fdbf-4d34-4fb1-883d-64b6362132c6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:21:58.911264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9a34fdbf-4d34-4fb1-883d-64b6362132c6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:21:58.930934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a34fdbf-4d34-4fb1-883d-64b6362132c6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:58.932650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a34fdbf-4d34-4fb1-883d-64b6362132c6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:58.933116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a34fdbf-4d34-4fb1-883d-64b6362132c6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:58.934990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a34fdbf-4d34-4fb1-883d-64b6362132c6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:58.938225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a34fdbf-4d34-4fb1-883d-64b6362132c6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:58.939593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a34fdbf-4d34-4fb1-883d-64b6362132c6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:59.002270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-939e0123-5465-4651-9c8a-0d7367a54a89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:59.039436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-939e0123-5465-4651-9c8a-0d7367a54a89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:59.041309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-939e0123-5465-4651-9c8a-0d7367a54a89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:59.044988 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-939e0123-5465-4651-9c8a-0d7367a54a89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1725 microversion: 2.20 time: 0.333706 Sep 06 11:21:59.048345 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2822/5696] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:58 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1725 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:21:59.123811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-62177c9b-c28e-4d5e-82c5-30ae8b8c62aa req-a4f0ff3a-85aa-4331-a8b4-69071910e9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-deleted", "tag": "1918ef7a-2344-47ad-aa5c-49c938fd8469"}, {"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-deleted", "tag": "721e119f-b9d6-46df-adc0-30d7ee803556"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:21:59.142954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-62177c9b-c28e-4d5e-82c5-30ae8b8c62aa req-a4f0ff3a-85aa-4331-a8b4-69071910e9c0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:21:59.143490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-62177c9b-c28e-4d5e-82c5-30ae8b8c62aa req-a4f0ff3a-85aa-4331-a8b4-69071910e9c0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:21:59.143929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-62177c9b-c28e-4d5e-82c5-30ae8b8c62aa req-a4f0ff3a-85aa-4331-a8b4-69071910e9c0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:21:59.161920 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-62177c9b-c28e-4d5e-82c5-30ae8b8c62aa req-a4f0ff3a-85aa-4331-a8b4-69071910e9c0 service nova] Creating event network-vif-deleted:1918ef7a-2344-47ad-aa5c-49c938fd8469 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:21:59.162764 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-62177c9b-c28e-4d5e-82c5-30ae8b8c62aa req-a4f0ff3a-85aa-4331-a8b4-69071910e9c0 service nova] Creating event network-vif-deleted:721e119f-b9d6-46df-adc0-30d7ee803556 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:21:59.172884 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-62177c9b-c28e-4d5e-82c5-30ae8b8c62aa req-a4f0ff3a-85aa-4331-a8b4-69071910e9c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049571 Sep 06 11:21:59.174543 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2823/5697] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:21:59.253657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9a34fdbf-4d34-4fb1-883d-64b6362132c6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:59.264048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9a34fdbf-4d34-4fb1-883d-64b6362132c6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:59.265518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9a34fdbf-4d34-4fb1-883d-64b6362132c6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:21:59.266981 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a34fdbf-4d34-4fb1-883d-64b6362132c6 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 2660 microversion: 2.42 time: 0.377895 Sep 06 11:21:59.282095 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2875/5698] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:21:58 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 2660 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:00.079066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-afb55045-4473-4670-9bb3-2db1179b1c5c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:00.079789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-afb55045-4473-4670-9bb3-2db1179b1c5c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:00.087191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afb55045-4473-4670-9bb3-2db1179b1c5c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:00.087687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afb55045-4473-4670-9bb3-2db1179b1c5c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:00.088327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afb55045-4473-4670-9bb3-2db1179b1c5c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:00.089046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afb55045-4473-4670-9bb3-2db1179b1c5c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:00.089590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afb55045-4473-4670-9bb3-2db1179b1c5c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:00.090168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-afb55045-4473-4670-9bb3-2db1179b1c5c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:00.227622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-afb55045-4473-4670-9bb3-2db1179b1c5c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:00.236713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-afb55045-4473-4670-9bb3-2db1179b1c5c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:00.238340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-afb55045-4473-4670-9bb3-2db1179b1c5c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:00.239593 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-afb55045-4473-4670-9bb3-2db1179b1c5c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1725 microversion: 2.20 time: 0.165685 Sep 06 11:22:00.240165 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2824/5699] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:00 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:00.298854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4141d590-4914-4d2d-8c6d-5ead05fd4bec tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:00.299519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4141d590-4914-4d2d-8c6d-5ead05fd4bec tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:00.307119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4141d590-4914-4d2d-8c6d-5ead05fd4bec tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:00.307613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4141d590-4914-4d2d-8c6d-5ead05fd4bec tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:00.308055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4141d590-4914-4d2d-8c6d-5ead05fd4bec tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:00.308766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4141d590-4914-4d2d-8c6d-5ead05fd4bec tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:00.309224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4141d590-4914-4d2d-8c6d-5ead05fd4bec tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:00.309653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4141d590-4914-4d2d-8c6d-5ead05fd4bec tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:00.381443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4141d590-4914-4d2d-8c6d-5ead05fd4bec tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:00.393331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4141d590-4914-4d2d-8c6d-5ead05fd4bec tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:00.393870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4141d590-4914-4d2d-8c6d-5ead05fd4bec tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:00.395112 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4141d590-4914-4d2d-8c6d-5ead05fd4bec tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1605 microversion: 2.42 time: 0.101057 Sep 06 11:22:00.396008 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2876/5700] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:00 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1605 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:00.787405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-bc8aac94-8efa-462b-84b3-d2fedc532f2a req-bd77965a-95b5-4aa3-af0b-5654626214a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-unplugged", "status": "completed", "tag": "3e403f89-7cbd-47b7-8591-7aa0e6c26fba"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:00.800254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bc8aac94-8efa-462b-84b3-d2fedc532f2a req-bd77965a-95b5-4aa3-af0b-5654626214a5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:00.800948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bc8aac94-8efa-462b-84b3-d2fedc532f2a req-bd77965a-95b5-4aa3-af0b-5654626214a5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:00.801405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bc8aac94-8efa-462b-84b3-d2fedc532f2a req-bd77965a-95b5-4aa3-af0b-5654626214a5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:00.816049 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-bc8aac94-8efa-462b-84b3-d2fedc532f2a req-bd77965a-95b5-4aa3-af0b-5654626214a5 service nova] Creating event network-vif-unplugged:3e403f89-7cbd-47b7-8591-7aa0e6c26fba for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:22:00.821838 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-bc8aac94-8efa-462b-84b3-d2fedc532f2a req-bd77965a-95b5-4aa3-af0b-5654626214a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038139 Sep 06 11:22:00.822793 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2825/5701] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:22:01.196661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-d49f9a62-f8e6-49f0-9f87-d5aa1d24e507 req-16b8279c-e569-4487-80a8-bb03d4ca736c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-deleted", "tag": "668f5dcf-b1c4-4540-a554-6a6dad1d4823"}, {"server_uuid": "6629eb8e-d139-4e58-b2e1-dbf619f076b0", "name": "network-vif-deleted", "tag": "3e403f89-7cbd-47b7-8591-7aa0e6c26fba"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:01.206359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d49f9a62-f8e6-49f0-9f87-d5aa1d24e507 req-16b8279c-e569-4487-80a8-bb03d4ca736c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:01.206841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d49f9a62-f8e6-49f0-9f87-d5aa1d24e507 req-16b8279c-e569-4487-80a8-bb03d4ca736c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:01.207302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d49f9a62-f8e6-49f0-9f87-d5aa1d24e507 req-16b8279c-e569-4487-80a8-bb03d4ca736c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:01.221923 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d49f9a62-f8e6-49f0-9f87-d5aa1d24e507 req-16b8279c-e569-4487-80a8-bb03d4ca736c service nova] Creating event network-vif-deleted:668f5dcf-b1c4-4540-a554-6a6dad1d4823 for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:22:01.222456 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d49f9a62-f8e6-49f0-9f87-d5aa1d24e507 req-16b8279c-e569-4487-80a8-bb03d4ca736c service nova] Creating event network-vif-deleted:3e403f89-7cbd-47b7-8591-7aa0e6c26fba for instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 on nch2-master-1 Sep 06 11:22:01.227351 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-d49f9a62-f8e6-49f0-9f87-d5aa1d24e507 req-16b8279c-e569-4487-80a8-bb03d4ca736c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034389 Sep 06 11:22:01.227948 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2877/5702] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:22:01.267964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a9f6f89c-427f-4b8f-b1ec-4aa655aad5b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:01.268676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a9f6f89c-427f-4b8f-b1ec-4aa655aad5b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:01.275187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9f6f89c-427f-4b8f-b1ec-4aa655aad5b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:01.275681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9f6f89c-427f-4b8f-b1ec-4aa655aad5b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:01.276132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9f6f89c-427f-4b8f-b1ec-4aa655aad5b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:01.276837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9f6f89c-427f-4b8f-b1ec-4aa655aad5b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:01.277304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9f6f89c-427f-4b8f-b1ec-4aa655aad5b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:01.277741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a9f6f89c-427f-4b8f-b1ec-4aa655aad5b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:01.424316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:01.425246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:01.429397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a9f6f89c-427f-4b8f-b1ec-4aa655aad5b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:01.433499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:01.434077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:01.434594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:01.435420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:01.435952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:01.436455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:01.438300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a9f6f89c-427f-4b8f-b1ec-4aa655aad5b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:01.439807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a9f6f89c-427f-4b8f-b1ec-4aa655aad5b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:01.445887 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a9f6f89c-427f-4b8f-b1ec-4aa655aad5b2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1725 microversion: 2.20 time: 0.178687 Sep 06 11:22:01.445887 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2826/5703] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:01 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:01.471286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:01.471774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:01.472212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:01.472662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lazy-loading 'fault' on Instance uuid 6629eb8e-d139-4e58-b2e1-dbf619f076b0 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:22:01.513433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:01.523866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:01.525413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36f490bcb6d643fa99b73ffa55d37c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cea8e2c3b9438ea6a50fb852468a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:01.526595 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-697a67f0-dab2-4a60-8876-95e835426618 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 200 len: 1610 microversion: 2.42 time: 0.107744 Sep 06 11:22:01.527182 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2878/5704] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:01 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 1610 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:02.466039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-44ea777d-24d2-4cd8-b3d4-ee3bbcee21e7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:02.466588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-44ea777d-24d2-4cd8-b3d4-ee3bbcee21e7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:02.473990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44ea777d-24d2-4cd8-b3d4-ee3bbcee21e7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:02.474475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44ea777d-24d2-4cd8-b3d4-ee3bbcee21e7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:02.474919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44ea777d-24d2-4cd8-b3d4-ee3bbcee21e7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:02.475709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44ea777d-24d2-4cd8-b3d4-ee3bbcee21e7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:02.476168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44ea777d-24d2-4cd8-b3d4-ee3bbcee21e7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:02.476599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-44ea777d-24d2-4cd8-b3d4-ee3bbcee21e7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:02.555404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-25085ee7-0451-45b4-9588-d1c0cac8a43a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:02.555796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-25085ee7-0451-45b4-9588-d1c0cac8a43a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] [instance: 6629eb8e-d139-4e58-b2e1-dbf619f076b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:02.562605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25085ee7-0451-45b4-9588-d1c0cac8a43a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:02.563197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25085ee7-0451-45b4-9588-d1c0cac8a43a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:02.563642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25085ee7-0451-45b4-9588-d1c0cac8a43a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:02.564341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25085ee7-0451-45b4-9588-d1c0cac8a43a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:02.564809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25085ee7-0451-45b4-9588-d1c0cac8a43a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:02.565239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25085ee7-0451-45b4-9588-d1c0cac8a43a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:02.579596 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-25085ee7-0451-45b4-9588-d1c0cac8a43a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] HTTP exception thrown: Instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 could not be found. Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-25085ee7-0451-45b4-9588-d1c0cac8a43a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Request method failure captured: Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 HTTP/1.1 Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFytA8Gz3HpkpUXKkaKAXdpM5M9KhSHVkTuCJ2HtUr9D3gb8R_MuNqsJsPhDMZi559hSt8aEbeIHFk7-mGi1d6RfW6kSFX_MYWbSXlRhmQWpA-rLZjx6T6gQG2BfqDsVp4WQqhEhjtJgQhd0VKK8fw1S969v54juRZfheHgAYIGnSGiU Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Openstack-Nova-Api-Version: 2.42 Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 30cea8e2c3b9438ea6a50fb852468a7b Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-571015205 Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_30cea8e2c3b9438ea6a50fb852468a7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/30cea8e2c3b9438ea6a50fb852468a7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/30cea8e2c3b9438ea6a50fb852468a7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/30cea8e2c3b9438ea6a50fb852468a7b"}]}] Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TaggedBootDevicesTest_v242-571015205 Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 30cea8e2c3b9438ea6a50fb852468a7b Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-571015205 Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TaggedBootDevicesTest_v242-571015205-project Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 36f490bcb6d643fa99b73ffa55d37c5e Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TaggedBootDevicesTest_v242-571015205-project Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 could not be found. Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '6629eb8e-d139-4e58-b2e1-dbf619f076b0'} Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 could not be found. Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 could not be found. Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:22:02.581279 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:22:02.587803 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:22:02.587803 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:22:02.587803 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:22:02.587803 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:22:02.587803 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:22:02.587803 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:22:02.587803 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 could not be found. Sep 06 11:22:02.587803 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:22:02.587803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-25085ee7-0451-45b4-9588-d1c0cac8a43a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Returning 404 to user: Instance 6629eb8e-d139-4e58-b2e1-dbf619f076b0 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:22:02.587803 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-25085ee7-0451-45b4-9588-d1c0cac8a43a tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0" status: 404 len: 111 microversion: 2.42 time: 0.031556 Sep 06 11:22:02.587803 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2879/5705] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:02 2022] GET /compute/v2.1/servers/6629eb8e-d139-4e58-b2e1-dbf619f076b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 06 11:22:02.591956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3520c485-dbb1-4ff3-9e57-d42b2a2ea5a7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] Calling method '.version_select at 0x7f90f306a1f0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:02.611986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-44ea777d-24d2-4cd8-b3d4-ee3bbcee21e7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:02.620343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-44ea777d-24d2-4cd8-b3d4-ee3bbcee21e7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:02.621803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-44ea777d-24d2-4cd8-b3d4-ee3bbcee21e7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:02.622964 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-44ea777d-24d2-4cd8-b3d4-ee3bbcee21e7 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1725 microversion: 2.20 time: 0.161147 Sep 06 11:22:02.623559 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2827/5706] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:02 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:02.682263 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3520c485-dbb1-4ff3-9e57-d42b2a2ea5a7 tempest-TaggedBootDevicesTest_v242-571015205 tempest-TaggedBootDevicesTest_v242-571015205-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869188513" status: 204 len: 0 microversion: 2.42 time: 0.093927 Sep 06 11:22:02.682958 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2880/5707] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 11:22:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869188513 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:22:03.648511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-95489fc2-7a35-4ff9-a88d-5e51df0e9da5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:03.649247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-95489fc2-7a35-4ff9-a88d-5e51df0e9da5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:03.656813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95489fc2-7a35-4ff9-a88d-5e51df0e9da5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:03.657374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95489fc2-7a35-4ff9-a88d-5e51df0e9da5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:03.657883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95489fc2-7a35-4ff9-a88d-5e51df0e9da5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:03.658651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95489fc2-7a35-4ff9-a88d-5e51df0e9da5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:03.659337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95489fc2-7a35-4ff9-a88d-5e51df0e9da5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:03.659842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95489fc2-7a35-4ff9-a88d-5e51df0e9da5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:03.796098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-95489fc2-7a35-4ff9-a88d-5e51df0e9da5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:03.804840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-95489fc2-7a35-4ff9-a88d-5e51df0e9da5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:03.806299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-95489fc2-7a35-4ff9-a88d-5e51df0e9da5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:03.807591 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-95489fc2-7a35-4ff9-a88d-5e51df0e9da5 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1725 microversion: 2.20 time: 0.163142 Sep 06 11:22:03.808162 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2828/5708] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:03 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:04.837184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bf72c632-0848-436c-87e5-ae100cd9c8cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:04.837733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bf72c632-0848-436c-87e5-ae100cd9c8cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:04.845595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf72c632-0848-436c-87e5-ae100cd9c8cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:04.846092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf72c632-0848-436c-87e5-ae100cd9c8cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:04.846542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf72c632-0848-436c-87e5-ae100cd9c8cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:04.847486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf72c632-0848-436c-87e5-ae100cd9c8cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:04.847955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf72c632-0848-436c-87e5-ae100cd9c8cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:04.848391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf72c632-0848-436c-87e5-ae100cd9c8cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:05.072135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bf72c632-0848-436c-87e5-ae100cd9c8cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:05.081695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bf72c632-0848-436c-87e5-ae100cd9c8cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:05.083193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bf72c632-0848-436c-87e5-ae100cd9c8cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:05.085844 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bf72c632-0848-436c-87e5-ae100cd9c8cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1725 microversion: 2.20 time: 0.255133 Sep 06 11:22:05.085844 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2881/5709] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:04 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:06.112927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-007da975-6502-411f-b1de-6c0226e92c53 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:06.112927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-007da975-6502-411f-b1de-6c0226e92c53 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:06.122355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-007da975-6502-411f-b1de-6c0226e92c53 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:06.122863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-007da975-6502-411f-b1de-6c0226e92c53 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:06.123340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-007da975-6502-411f-b1de-6c0226e92c53 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:06.124061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-007da975-6502-411f-b1de-6c0226e92c53 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:06.124527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-007da975-6502-411f-b1de-6c0226e92c53 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:06.124964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-007da975-6502-411f-b1de-6c0226e92c53 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:06.372707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-007da975-6502-411f-b1de-6c0226e92c53 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:06.384225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-007da975-6502-411f-b1de-6c0226e92c53 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:06.386102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-007da975-6502-411f-b1de-6c0226e92c53 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:06.387572 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-007da975-6502-411f-b1de-6c0226e92c53 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1725 microversion: 2.20 time: 0.281074 Sep 06 11:22:06.388140 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2829/5710] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:06 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1725 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:07.419688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b93dd336-27ea-4fa9-9455-a97938012b4f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:07.419688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b93dd336-27ea-4fa9-9455-a97938012b4f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:07.423910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b93dd336-27ea-4fa9-9455-a97938012b4f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:07.424392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b93dd336-27ea-4fa9-9455-a97938012b4f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:07.424894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b93dd336-27ea-4fa9-9455-a97938012b4f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:07.425597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b93dd336-27ea-4fa9-9455-a97938012b4f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:07.426057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b93dd336-27ea-4fa9-9455-a97938012b4f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:07.426483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b93dd336-27ea-4fa9-9455-a97938012b4f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:07.590659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b93dd336-27ea-4fa9-9455-a97938012b4f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:07.600654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b93dd336-27ea-4fa9-9455-a97938012b4f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:07.601546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b93dd336-27ea-4fa9-9455-a97938012b4f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:07.602836 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b93dd336-27ea-4fa9-9455-a97938012b4f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1725 microversion: 2.20 time: 0.190875 Sep 06 11:22:07.603822 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2882/5711] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:07 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:08.629095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c4347e16-bf4b-49ee-8730-4b664fd35778 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:08.629635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c4347e16-bf4b-49ee-8730-4b664fd35778 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:08.636952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4347e16-bf4b-49ee-8730-4b664fd35778 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:08.637448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4347e16-bf4b-49ee-8730-4b664fd35778 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:08.637899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4347e16-bf4b-49ee-8730-4b664fd35778 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:08.638607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4347e16-bf4b-49ee-8730-4b664fd35778 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:08.639112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4347e16-bf4b-49ee-8730-4b664fd35778 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:08.639556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c4347e16-bf4b-49ee-8730-4b664fd35778 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:08.783796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c4347e16-bf4b-49ee-8730-4b664fd35778 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:08.792196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c4347e16-bf4b-49ee-8730-4b664fd35778 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:08.793663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c4347e16-bf4b-49ee-8730-4b664fd35778 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:08.794842 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c4347e16-bf4b-49ee-8730-4b664fd35778 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1725 microversion: 2.20 time: 0.169864 Sep 06 11:22:08.795453 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2830/5712] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:08 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:09.824224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f604f621-e0cd-49e2-ad8d-8fe75d76bfcc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:09.824860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f604f621-e0cd-49e2-ad8d-8fe75d76bfcc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:09.831877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f604f621-e0cd-49e2-ad8d-8fe75d76bfcc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:09.832363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f604f621-e0cd-49e2-ad8d-8fe75d76bfcc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:09.832812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f604f621-e0cd-49e2-ad8d-8fe75d76bfcc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:09.833552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f604f621-e0cd-49e2-ad8d-8fe75d76bfcc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:09.834013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f604f621-e0cd-49e2-ad8d-8fe75d76bfcc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:09.834445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f604f621-e0cd-49e2-ad8d-8fe75d76bfcc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:09.982298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f604f621-e0cd-49e2-ad8d-8fe75d76bfcc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:09.991036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f604f621-e0cd-49e2-ad8d-8fe75d76bfcc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:09.992739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f604f621-e0cd-49e2-ad8d-8fe75d76bfcc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:09.994087 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f604f621-e0cd-49e2-ad8d-8fe75d76bfcc tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1746 microversion: 2.20 time: 0.173906 Sep 06 11:22:09.994742 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2883/5713] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:09 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1746 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:11.038789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-10ae26d5-f90d-4b3e-9680-3bcdb09a4f0b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:11.039437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-10ae26d5-f90d-4b3e-9680-3bcdb09a4f0b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:11.046434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ae26d5-f90d-4b3e-9680-3bcdb09a4f0b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:11.050891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ae26d5-f90d-4b3e-9680-3bcdb09a4f0b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:11.050891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ae26d5-f90d-4b3e-9680-3bcdb09a4f0b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:11.050891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ae26d5-f90d-4b3e-9680-3bcdb09a4f0b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:11.050891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ae26d5-f90d-4b3e-9680-3bcdb09a4f0b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:11.050891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10ae26d5-f90d-4b3e-9680-3bcdb09a4f0b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:11.185258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-10ae26d5-f90d-4b3e-9680-3bcdb09a4f0b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:11.197648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-10ae26d5-f90d-4b3e-9680-3bcdb09a4f0b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:11.200200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-10ae26d5-f90d-4b3e-9680-3bcdb09a4f0b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:11.210687 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-10ae26d5-f90d-4b3e-9680-3bcdb09a4f0b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1746 microversion: 2.20 time: 0.166930 Sep 06 11:22:11.210687 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2831/5714] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:11 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:12.231701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dade21d8-66a1-45fc-a3a5-bad823c387d3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:12.231701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dade21d8-66a1-45fc-a3a5-bad823c387d3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:12.238918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dade21d8-66a1-45fc-a3a5-bad823c387d3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:12.239538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dade21d8-66a1-45fc-a3a5-bad823c387d3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:12.240178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dade21d8-66a1-45fc-a3a5-bad823c387d3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:12.240942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dade21d8-66a1-45fc-a3a5-bad823c387d3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:12.241406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dade21d8-66a1-45fc-a3a5-bad823c387d3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:12.241883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dade21d8-66a1-45fc-a3a5-bad823c387d3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:12.398965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dade21d8-66a1-45fc-a3a5-bad823c387d3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:12.417228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dade21d8-66a1-45fc-a3a5-bad823c387d3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:12.417228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dade21d8-66a1-45fc-a3a5-bad823c387d3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:12.417228 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dade21d8-66a1-45fc-a3a5-bad823c387d3 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1741 microversion: 2.20 time: 0.188670 Sep 06 11:22:12.418827 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2884/5715] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:12 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:13.441120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a29cf05c-ad6d-48a5-9a45-0a02cbe72416 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:13.441775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a29cf05c-ad6d-48a5-9a45-0a02cbe72416 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:13.450571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a29cf05c-ad6d-48a5-9a45-0a02cbe72416 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:13.451594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a29cf05c-ad6d-48a5-9a45-0a02cbe72416 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:13.452054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a29cf05c-ad6d-48a5-9a45-0a02cbe72416 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:13.452817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a29cf05c-ad6d-48a5-9a45-0a02cbe72416 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:13.453292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a29cf05c-ad6d-48a5-9a45-0a02cbe72416 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:13.453732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a29cf05c-ad6d-48a5-9a45-0a02cbe72416 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:13.458957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:13.747321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a29cf05c-ad6d-48a5-9a45-0a02cbe72416 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:13.763345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a29cf05c-ad6d-48a5-9a45-0a02cbe72416 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:13.766290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a29cf05c-ad6d-48a5-9a45-0a02cbe72416 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:13.769547 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a29cf05c-ad6d-48a5-9a45-0a02cbe72416 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1741 microversion: 2.20 time: 0.333170 Sep 06 11:22:13.772239 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2832/5716] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:13 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1741 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:14.020495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-69639012-6fcc-4e54-b2d1-091b07351edf tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:14.022730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-69639012-6fcc-4e54-b2d1-091b07351edf tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:14.057626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69639012-6fcc-4e54-b2d1-091b07351edf tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:14.059258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69639012-6fcc-4e54-b2d1-091b07351edf tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:14.060267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69639012-6fcc-4e54-b2d1-091b07351edf tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:14.061639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69639012-6fcc-4e54-b2d1-091b07351edf tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:14.062219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69639012-6fcc-4e54-b2d1-091b07351edf tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:14.062686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69639012-6fcc-4e54-b2d1-091b07351edf tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:14.130400 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-69639012-6fcc-4e54-b2d1-091b07351edf tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/ips" status: 200 len: 146 microversion: 2.1 time: 0.126550 Sep 06 11:22:14.140256 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2885/5717] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:22:14 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/ips => generated 146 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:22:14.702205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-d24146ca-626e-4a23-aa8b-ca7882401432 req-e095acc4-437f-4e2b-b751-b493a4774f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc42cdc-6687-4ecd-b60a-ea23f69f50b2", "name": "network-vif-plugged", "status": "completed", "tag": "09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:14.733709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d24146ca-626e-4a23-aa8b-ca7882401432 req-e095acc4-437f-4e2b-b751-b493a4774f3f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:14.734671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d24146ca-626e-4a23-aa8b-ca7882401432 req-e095acc4-437f-4e2b-b751-b493a4774f3f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:14.735446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d24146ca-626e-4a23-aa8b-ca7882401432 req-e095acc4-437f-4e2b-b751-b493a4774f3f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:14.753207 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-d24146ca-626e-4a23-aa8b-ca7882401432 req-e095acc4-437f-4e2b-b751-b493a4774f3f service nova] Creating event network-vif-plugged:09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17 for instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 on nch2-master-1 Sep 06 11:22:14.764993 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-d24146ca-626e-4a23-aa8b-ca7882401432 req-e095acc4-437f-4e2b-b751-b493a4774f3f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072890 Sep 06 11:22:14.767724 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2833/5718] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:22:14.801360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3bedd089-fdb6-4a92-9c8f-b6d9000e56d4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:14.801897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3bedd089-fdb6-4a92-9c8f-b6d9000e56d4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:14.815971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bedd089-fdb6-4a92-9c8f-b6d9000e56d4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:14.817397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bedd089-fdb6-4a92-9c8f-b6d9000e56d4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:14.818156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bedd089-fdb6-4a92-9c8f-b6d9000e56d4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:14.819381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bedd089-fdb6-4a92-9c8f-b6d9000e56d4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:14.820466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bedd089-fdb6-4a92-9c8f-b6d9000e56d4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:14.821275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3bedd089-fdb6-4a92-9c8f-b6d9000e56d4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:15.432951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3bedd089-fdb6-4a92-9c8f-b6d9000e56d4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:15.442141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3bedd089-fdb6-4a92-9c8f-b6d9000e56d4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:15.443657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3bedd089-fdb6-4a92-9c8f-b6d9000e56d4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:15.444838 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3bedd089-fdb6-4a92-9c8f-b6d9000e56d4 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1741 microversion: 2.20 time: 0.647613 Sep 06 11:22:15.445421 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2886/5719] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:14 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1741 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:16.484606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-88bf76a3-61dc-4ed7-a26d-4ffcb14a6278 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:16.489061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-88bf76a3-61dc-4ed7-a26d-4ffcb14a6278 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:16.507047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88bf76a3-61dc-4ed7-a26d-4ffcb14a6278 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:16.507711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88bf76a3-61dc-4ed7-a26d-4ffcb14a6278 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:16.508276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88bf76a3-61dc-4ed7-a26d-4ffcb14a6278 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:16.509133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88bf76a3-61dc-4ed7-a26d-4ffcb14a6278 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:16.509836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88bf76a3-61dc-4ed7-a26d-4ffcb14a6278 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:16.510734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88bf76a3-61dc-4ed7-a26d-4ffcb14a6278 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:16.710804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-88bf76a3-61dc-4ed7-a26d-4ffcb14a6278 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:16.722807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-88bf76a3-61dc-4ed7-a26d-4ffcb14a6278 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:16.724435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-88bf76a3-61dc-4ed7-a26d-4ffcb14a6278 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:16.725874 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-88bf76a3-61dc-4ed7-a26d-4ffcb14a6278 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1741 microversion: 2.20 time: 0.252288 Sep 06 11:22:16.726747 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2834/5720] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:16 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1741 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:17.758338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6a5a3a94-6113-4b8a-8dc7-7361502250cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:17.759077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6a5a3a94-6113-4b8a-8dc7-7361502250cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:17.768058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a5a3a94-6113-4b8a-8dc7-7361502250cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:17.769025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a5a3a94-6113-4b8a-8dc7-7361502250cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:17.769874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a5a3a94-6113-4b8a-8dc7-7361502250cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:17.771933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a5a3a94-6113-4b8a-8dc7-7361502250cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:17.772619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a5a3a94-6113-4b8a-8dc7-7361502250cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:17.773228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6a5a3a94-6113-4b8a-8dc7-7361502250cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:18.034979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6a5a3a94-6113-4b8a-8dc7-7361502250cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:18.053288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6a5a3a94-6113-4b8a-8dc7-7361502250cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:18.055665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6a5a3a94-6113-4b8a-8dc7-7361502250cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:18.057196 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6a5a3a94-6113-4b8a-8dc7-7361502250cd tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1741 microversion: 2.20 time: 0.308773 Sep 06 11:22:18.058260 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2887/5721] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:17 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1741 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:22:18.105498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac10c607-f660-481b-b7e3-d3696df6c680"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:18.107930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:18.122156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:18.127859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:18.128335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:18.129116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:18.129581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:18.130024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:19.071373 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "POST /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.968982 Sep 06 11:22:19.072409 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2835/5722] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:22:18 2022] POST /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/os-volume_attachments => generated 194 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:22:19.088589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6c56f8fb-73ac-4bfe-a95e-d12db9ff7436 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:19.090010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6c56f8fb-73ac-4bfe-a95e-d12db9ff7436 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:19.099448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c56f8fb-73ac-4bfe-a95e-d12db9ff7436 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:19.112338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c56f8fb-73ac-4bfe-a95e-d12db9ff7436 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:19.112338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c56f8fb-73ac-4bfe-a95e-d12db9ff7436 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:19.112338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c56f8fb-73ac-4bfe-a95e-d12db9ff7436 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:19.112338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c56f8fb-73ac-4bfe-a95e-d12db9ff7436 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:19.112338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c56f8fb-73ac-4bfe-a95e-d12db9ff7436 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:19.322858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6c56f8fb-73ac-4bfe-a95e-d12db9ff7436 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:19.338766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6c56f8fb-73ac-4bfe-a95e-d12db9ff7436 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:19.340929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6c56f8fb-73ac-4bfe-a95e-d12db9ff7436 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:19.343723 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6c56f8fb-73ac-4bfe-a95e-d12db9ff7436 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1741 microversion: 2.20 time: 0.259022 Sep 06 11:22:19.346715 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2888/5723] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:19 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1741 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:22:20.381146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-10fec462-fe0d-4c9d-b25b-3e3ff099770f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:20.382149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-10fec462-fe0d-4c9d-b25b-3e3ff099770f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:20.390542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10fec462-fe0d-4c9d-b25b-3e3ff099770f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:20.392222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10fec462-fe0d-4c9d-b25b-3e3ff099770f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:20.393245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10fec462-fe0d-4c9d-b25b-3e3ff099770f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:20.394697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10fec462-fe0d-4c9d-b25b-3e3ff099770f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:20.395260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10fec462-fe0d-4c9d-b25b-3e3ff099770f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:20.395893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10fec462-fe0d-4c9d-b25b-3e3ff099770f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:20.586301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-10fec462-fe0d-4c9d-b25b-3e3ff099770f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:20.598220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-10fec462-fe0d-4c9d-b25b-3e3ff099770f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:20.601206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-10fec462-fe0d-4c9d-b25b-3e3ff099770f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:20.602644 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-10fec462-fe0d-4c9d-b25b-3e3ff099770f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1741 microversion: 2.20 time: 0.228416 Sep 06 11:22:20.603386 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2836/5724] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:20 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1741 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:21.636745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d776ef36-07ef-43a1-8aa1-77dd8605fc3c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:21.638154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d776ef36-07ef-43a1-8aa1-77dd8605fc3c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:21.648566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d776ef36-07ef-43a1-8aa1-77dd8605fc3c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:21.649067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d776ef36-07ef-43a1-8aa1-77dd8605fc3c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:21.649709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d776ef36-07ef-43a1-8aa1-77dd8605fc3c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:21.650452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d776ef36-07ef-43a1-8aa1-77dd8605fc3c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:21.651412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d776ef36-07ef-43a1-8aa1-77dd8605fc3c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:21.651534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d776ef36-07ef-43a1-8aa1-77dd8605fc3c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:21.837001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d776ef36-07ef-43a1-8aa1-77dd8605fc3c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:21.840999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:21.851911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d776ef36-07ef-43a1-8aa1-77dd8605fc3c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:21.853548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d776ef36-07ef-43a1-8aa1-77dd8605fc3c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:21.854853 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d776ef36-07ef-43a1-8aa1-77dd8605fc3c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1741 microversion: 2.20 time: 0.222944 Sep 06 11:22:21.872401 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2889/5725] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:21 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1741 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:22.896900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e0c97844-a91d-4236-8c9f-7184c8cbf097 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:22.896900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e0c97844-a91d-4236-8c9f-7184c8cbf097 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:22.916399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0c97844-a91d-4236-8c9f-7184c8cbf097 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:22.918730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0c97844-a91d-4236-8c9f-7184c8cbf097 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:22.919532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0c97844-a91d-4236-8c9f-7184c8cbf097 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:22.920769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0c97844-a91d-4236-8c9f-7184c8cbf097 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:22.921532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0c97844-a91d-4236-8c9f-7184c8cbf097 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:22.925397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e0c97844-a91d-4236-8c9f-7184c8cbf097 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:23.131060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e0c97844-a91d-4236-8c9f-7184c8cbf097 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:23.141936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e0c97844-a91d-4236-8c9f-7184c8cbf097 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:23.144826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e0c97844-a91d-4236-8c9f-7184c8cbf097 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:23.147438 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e0c97844-a91d-4236-8c9f-7184c8cbf097 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1741 microversion: 2.20 time: 0.261862 Sep 06 11:22:23.147438 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2837/5726] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:22 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1741 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:24.176015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eae0ee63-5847-4066-b644-a58577f1eed6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:24.176812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eae0ee63-5847-4066-b644-a58577f1eed6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:24.179967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:24.185380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eae0ee63-5847-4066-b644-a58577f1eed6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:24.185891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eae0ee63-5847-4066-b644-a58577f1eed6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:24.186347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eae0ee63-5847-4066-b644-a58577f1eed6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:24.187111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eae0ee63-5847-4066-b644-a58577f1eed6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:24.187586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eae0ee63-5847-4066-b644-a58577f1eed6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:24.188028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eae0ee63-5847-4066-b644-a58577f1eed6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:24.350116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eae0ee63-5847-4066-b644-a58577f1eed6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:24.360225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eae0ee63-5847-4066-b644-a58577f1eed6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:24.361849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eae0ee63-5847-4066-b644-a58577f1eed6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:24.363044 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eae0ee63-5847-4066-b644-a58577f1eed6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1741 microversion: 2.20 time: 0.191566 Sep 06 11:22:24.363597 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2890/5727] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:24 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1741 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:24.666790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-76d0bc90-d0a1-42b5-8d58-259fc936bee6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:24.669432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:24.674361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76d0bc90-d0a1-42b5-8d58-259fc936bee6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:24.680049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76d0bc90-d0a1-42b5-8d58-259fc936bee6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:24.680049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76d0bc90-d0a1-42b5-8d58-259fc936bee6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:24.699346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-76d0bc90-d0a1-42b5-8d58-259fc936bee6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Going to try to stop instance {{(pid=140875) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 11:22:24.853989 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-76d0bc90-d0a1-42b5-8d58-259fc936bee6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "POST /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/action" status: 202 len: 0 microversion: 2.1 time: 0.190960 Sep 06 11:22:24.854812 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2838/5728] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:22:24 2022] POST /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:22:24.866923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bcd0d5b8-96fe-4c1f-b0b9-72f738264b04 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:24.867725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bcd0d5b8-96fe-4c1f-b0b9-72f738264b04 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:24.887731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd0d5b8-96fe-4c1f-b0b9-72f738264b04 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:24.888794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd0d5b8-96fe-4c1f-b0b9-72f738264b04 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:24.889752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd0d5b8-96fe-4c1f-b0b9-72f738264b04 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:24.890717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd0d5b8-96fe-4c1f-b0b9-72f738264b04 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:24.892152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd0d5b8-96fe-4c1f-b0b9-72f738264b04 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:24.893967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bcd0d5b8-96fe-4c1f-b0b9-72f738264b04 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:25.079480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bcd0d5b8-96fe-4c1f-b0b9-72f738264b04 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:25.090210 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bcd0d5b8-96fe-4c1f-b0b9-72f738264b04 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1721 microversion: 2.1 time: 0.227856 Sep 06 11:22:25.091169 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2891/5729] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:24 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:25.395599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b76503a6-4056-4cd6-8755-781af87441ce tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:25.396404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b76503a6-4056-4cd6-8755-781af87441ce tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:25.404521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b76503a6-4056-4cd6-8755-781af87441ce tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:25.405102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b76503a6-4056-4cd6-8755-781af87441ce tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:25.405554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b76503a6-4056-4cd6-8755-781af87441ce tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:25.406439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b76503a6-4056-4cd6-8755-781af87441ce tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:25.406974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b76503a6-4056-4cd6-8755-781af87441ce tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:25.407562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b76503a6-4056-4cd6-8755-781af87441ce tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:25.560322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b76503a6-4056-4cd6-8755-781af87441ce tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:25.570219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b76503a6-4056-4cd6-8755-781af87441ce tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:25.572523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b76503a6-4056-4cd6-8755-781af87441ce tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:25.577569 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b76503a6-4056-4cd6-8755-781af87441ce tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1741 microversion: 2.20 time: 0.184049 Sep 06 11:22:25.577569 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2839/5730] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:25 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:26.117009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2f9c9d38-f1ad-46bb-909d-a4c4efc044b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:26.117736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2f9c9d38-f1ad-46bb-909d-a4c4efc044b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:26.125458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f9c9d38-f1ad-46bb-909d-a4c4efc044b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:26.126065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f9c9d38-f1ad-46bb-909d-a4c4efc044b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:26.126514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f9c9d38-f1ad-46bb-909d-a4c4efc044b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:26.127255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f9c9d38-f1ad-46bb-909d-a4c4efc044b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:26.127725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f9c9d38-f1ad-46bb-909d-a4c4efc044b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:26.128161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2f9c9d38-f1ad-46bb-909d-a4c4efc044b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:26.277822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2f9c9d38-f1ad-46bb-909d-a4c4efc044b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:26.288225 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2f9c9d38-f1ad-46bb-909d-a4c4efc044b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1721 microversion: 2.1 time: 0.176491 Sep 06 11:22:26.288806 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2892/5731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:26 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:22:26.603694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9d2b22cf-f37b-4248-8d98-ea18ca450e6e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:26.604384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9d2b22cf-f37b-4248-8d98-ea18ca450e6e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:26.612437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d2b22cf-f37b-4248-8d98-ea18ca450e6e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:26.612944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d2b22cf-f37b-4248-8d98-ea18ca450e6e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:26.614321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d2b22cf-f37b-4248-8d98-ea18ca450e6e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:26.619550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d2b22cf-f37b-4248-8d98-ea18ca450e6e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:26.619550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d2b22cf-f37b-4248-8d98-ea18ca450e6e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:26.619550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9d2b22cf-f37b-4248-8d98-ea18ca450e6e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:26.759868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9d2b22cf-f37b-4248-8d98-ea18ca450e6e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:26.770369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9d2b22cf-f37b-4248-8d98-ea18ca450e6e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:26.772185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9d2b22cf-f37b-4248-8d98-ea18ca450e6e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:26.773578 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9d2b22cf-f37b-4248-8d98-ea18ca450e6e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1723 microversion: 2.20 time: 0.174437 Sep 06 11:22:26.776943 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2840/5732] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:26 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:27.314709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-85a177fc-4e5c-4626-a187-57e6a9a27283 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:27.315504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-85a177fc-4e5c-4626-a187-57e6a9a27283 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:27.323239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85a177fc-4e5c-4626-a187-57e6a9a27283 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:27.323783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85a177fc-4e5c-4626-a187-57e6a9a27283 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:27.324358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85a177fc-4e5c-4626-a187-57e6a9a27283 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:27.325098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85a177fc-4e5c-4626-a187-57e6a9a27283 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:27.325591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85a177fc-4e5c-4626-a187-57e6a9a27283 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:27.326033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85a177fc-4e5c-4626-a187-57e6a9a27283 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:27.467314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-85a177fc-4e5c-4626-a187-57e6a9a27283 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:27.476281 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-85a177fc-4e5c-4626-a187-57e6a9a27283 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1721 microversion: 2.1 time: 0.166757 Sep 06 11:22:27.476955 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2893/5733] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:27 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:27.804949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ed6204f1-95ac-48e2-9b60-9068eee62f49 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:27.805712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ed6204f1-95ac-48e2-9b60-9068eee62f49 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:27.813715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed6204f1-95ac-48e2-9b60-9068eee62f49 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:27.814445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed6204f1-95ac-48e2-9b60-9068eee62f49 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:27.814841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed6204f1-95ac-48e2-9b60-9068eee62f49 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:27.815594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed6204f1-95ac-48e2-9b60-9068eee62f49 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:27.816078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed6204f1-95ac-48e2-9b60-9068eee62f49 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:27.816539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed6204f1-95ac-48e2-9b60-9068eee62f49 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:27.969476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ed6204f1-95ac-48e2-9b60-9068eee62f49 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:27.980073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ed6204f1-95ac-48e2-9b60-9068eee62f49 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:27.981646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ed6204f1-95ac-48e2-9b60-9068eee62f49 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:27.982945 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ed6204f1-95ac-48e2-9b60-9068eee62f49 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1723 microversion: 2.20 time: 0.183085 Sep 06 11:22:27.984261 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2841/5734] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:27 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:28.044142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1112825839", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:28.098527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:22:28.500189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4075b74c-b1a9-4e8b-8ede-2a25a5cca421 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:28.500816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4075b74c-b1a9-4e8b-8ede-2a25a5cca421 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:28.507181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4075b74c-b1a9-4e8b-8ede-2a25a5cca421 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:28.507966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4075b74c-b1a9-4e8b-8ede-2a25a5cca421 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:28.508656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4075b74c-b1a9-4e8b-8ede-2a25a5cca421 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:28.509584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4075b74c-b1a9-4e8b-8ede-2a25a5cca421 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:28.510227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4075b74c-b1a9-4e8b-8ede-2a25a5cca421 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:28.510829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4075b74c-b1a9-4e8b-8ede-2a25a5cca421 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:28.706467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:22:28.708130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:22:28.708758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:22:28.709066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:22:28.709498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:22:28.719937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:28.720340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:28.721008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:28.721770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:28.722241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:28.722675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:28.743520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Getting quotas for project c68eec8502e9451b946462adfcc17014. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:22:28.748661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4075b74c-b1a9-4e8b-8ede-2a25a5cca421 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:28.751144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Getting quotas for user fe7a44f0f8804ece9c80fe34486865a3 and project c68eec8502e9451b946462adfcc17014. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:22:28.766813 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4075b74c-b1a9-4e8b-8ede-2a25a5cca421 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1721 microversion: 2.1 time: 0.270584 Sep 06 11:22:28.767338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:22:28.768203 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2842/5735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:28 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:22:28.770844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:22:28.944900 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4d41ae6e-3898-4fd6-bb64-fbad7d08d5b3 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903510 Sep 06 11:22:28.945949 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2894/5736] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:22:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:22:28.958307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-16f5bee7-a154-4754-9135-1ee62b8ba8ed tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:28.959711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-16f5bee7-a154-4754-9135-1ee62b8ba8ed tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:29.010620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d429c9fb-7ecb-4c7a-a2e4-fa7cade7fcf0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:29.011645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d429c9fb-7ecb-4c7a-a2e4-fa7cade7fcf0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:29.018645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d429c9fb-7ecb-4c7a-a2e4-fa7cade7fcf0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:29.023924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-16f5bee7-a154-4754-9135-1ee62b8ba8ed tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:29.027072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d429c9fb-7ecb-4c7a-a2e4-fa7cade7fcf0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:29.027677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d429c9fb-7ecb-4c7a-a2e4-fa7cade7fcf0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:29.030300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d429c9fb-7ecb-4c7a-a2e4-fa7cade7fcf0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:29.030921 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-16f5bee7-a154-4754-9135-1ee62b8ba8ed tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1215 microversion: 2.1 time: 0.077499 Sep 06 11:22:29.031499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d429c9fb-7ecb-4c7a-a2e4-fa7cade7fcf0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:29.032089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d429c9fb-7ecb-4c7a-a2e4-fa7cade7fcf0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:29.044305 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2843/5737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:28 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:29.229550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d429c9fb-7ecb-4c7a-a2e4-fa7cade7fcf0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:29.238864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d429c9fb-7ecb-4c7a-a2e4-fa7cade7fcf0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:29.240523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d429c9fb-7ecb-4c7a-a2e4-fa7cade7fcf0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:29.241714 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d429c9fb-7ecb-4c7a-a2e4-fa7cade7fcf0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1723 microversion: 2.20 time: 0.235508 Sep 06 11:22:29.242276 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2895/5738] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:29 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:29.796120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8cbbec0a-b9dc-4439-b47e-dbd88463e489 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:29.796743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8cbbec0a-b9dc-4439-b47e-dbd88463e489 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:29.804492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cbbec0a-b9dc-4439-b47e-dbd88463e489 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:29.804992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cbbec0a-b9dc-4439-b47e-dbd88463e489 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:29.805587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cbbec0a-b9dc-4439-b47e-dbd88463e489 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:29.806298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cbbec0a-b9dc-4439-b47e-dbd88463e489 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:29.806760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cbbec0a-b9dc-4439-b47e-dbd88463e489 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:29.807301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cbbec0a-b9dc-4439-b47e-dbd88463e489 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:30.039646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8cbbec0a-b9dc-4439-b47e-dbd88463e489 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:30.052706 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8cbbec0a-b9dc-4439-b47e-dbd88463e489 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1721 microversion: 2.1 time: 0.262624 Sep 06 11:22:30.062368 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2844/5739] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:29 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:30.063119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ce7f54c5-2ab0-4b5b-aa87-7d4dd40bd42d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:30.063119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ce7f54c5-2ab0-4b5b-aa87-7d4dd40bd42d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:30.186241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce7f54c5-2ab0-4b5b-aa87-7d4dd40bd42d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:30.199151 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ce7f54c5-2ab0-4b5b-aa87-7d4dd40bd42d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1215 microversion: 2.1 time: 0.146944 Sep 06 11:22:30.208064 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2896/5740] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:30 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:30.278472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-50524415-5969-48ce-aa61-25a842fa9c64 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:30.279350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-50524415-5969-48ce-aa61-25a842fa9c64 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:30.285720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-50524415-5969-48ce-aa61-25a842fa9c64 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:30.286238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-50524415-5969-48ce-aa61-25a842fa9c64 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:30.289823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-50524415-5969-48ce-aa61-25a842fa9c64 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:30.289823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-50524415-5969-48ce-aa61-25a842fa9c64 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:30.289823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-50524415-5969-48ce-aa61-25a842fa9c64 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:30.289823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-50524415-5969-48ce-aa61-25a842fa9c64 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:30.438889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-50524415-5969-48ce-aa61-25a842fa9c64 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:30.448528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-50524415-5969-48ce-aa61-25a842fa9c64 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:30.450138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-50524415-5969-48ce-aa61-25a842fa9c64 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:30.451498 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-50524415-5969-48ce-aa61-25a842fa9c64 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1666 microversion: 2.20 time: 0.181004 Sep 06 11:22:30.452169 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2845/5741] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:30 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1666 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:30.478277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f815de0-c358-49a3-b579-48ef541851c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c89d61e-6273-422f-9812-cb4473f63060"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:30.480512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4f815de0-c358-49a3-b579-48ef541851c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:30.493158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f815de0-c358-49a3-b579-48ef541851c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:30.493158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f815de0-c358-49a3-b579-48ef541851c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:30.493158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f815de0-c358-49a3-b579-48ef541851c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:30.493158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f815de0-c358-49a3-b579-48ef541851c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:30.493158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f815de0-c358-49a3-b579-48ef541851c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:30.493158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f815de0-c358-49a3-b579-48ef541851c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:30.628179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-4aeaffa8-f295-461c-9a85-993b9f5c59b7 req-dbc14e98-48cc-4a83-bc6c-84346ac8aa05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc42cdc-6687-4ecd-b60a-ea23f69f50b2", "name": "network-vif-unplugged", "status": "completed", "tag": "09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:30.639277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4aeaffa8-f295-461c-9a85-993b9f5c59b7 req-dbc14e98-48cc-4a83-bc6c-84346ac8aa05 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:30.639846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4aeaffa8-f295-461c-9a85-993b9f5c59b7 req-dbc14e98-48cc-4a83-bc6c-84346ac8aa05 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:30.640295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4aeaffa8-f295-461c-9a85-993b9f5c59b7 req-dbc14e98-48cc-4a83-bc6c-84346ac8aa05 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:30.652811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.compute.server_external_events [req-4aeaffa8-f295-461c-9a85-993b9f5c59b7 req-dbc14e98-48cc-4a83-bc6c-84346ac8aa05 service nova] Unable to find a host for instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2. Dropping event network-vif-unplugged {{(pid=140875) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 06 11:22:30.653727 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-4aeaffa8-f295-461c-9a85-993b9f5c59b7 req-dbc14e98-48cc-4a83-bc6c-84346ac8aa05 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030270 Sep 06 11:22:30.654348 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2846/5742] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 06 11:22:31.079109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9f9ee781-44a0-43f9-8ee4-e20f4daaecc8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:31.080471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9f9ee781-44a0-43f9-8ee4-e20f4daaecc8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:31.088085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f9ee781-44a0-43f9-8ee4-e20f4daaecc8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:31.088585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f9ee781-44a0-43f9-8ee4-e20f4daaecc8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:31.089717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f9ee781-44a0-43f9-8ee4-e20f4daaecc8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:31.089717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f9ee781-44a0-43f9-8ee4-e20f4daaecc8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:31.090215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f9ee781-44a0-43f9-8ee4-e20f4daaecc8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:31.090654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f9ee781-44a0-43f9-8ee4-e20f4daaecc8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:31.327337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9f9ee781-44a0-43f9-8ee4-e20f4daaecc8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:31.338813 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9f9ee781-44a0-43f9-8ee4-e20f4daaecc8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1721 microversion: 2.1 time: 0.262854 Sep 06 11:22:31.344458 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2847/5743] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:31 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:22:31.354319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c7c1b770-6102-4e08-956c-5dc2354c893d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:31.354319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c7c1b770-6102-4e08-956c-5dc2354c893d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:31.374333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c1b770-6102-4e08-956c-5dc2354c893d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:31.375044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c1b770-6102-4e08-956c-5dc2354c893d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:31.375614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c1b770-6102-4e08-956c-5dc2354c893d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:31.376678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c1b770-6102-4e08-956c-5dc2354c893d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:31.378693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c1b770-6102-4e08-956c-5dc2354c893d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:31.379284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7c1b770-6102-4e08-956c-5dc2354c893d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:31.468460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c7c1b770-6102-4e08-956c-5dc2354c893d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:31.475984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:31.480885 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c7c1b770-6102-4e08-956c-5dc2354c893d tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1267 microversion: 2.1 time: 0.135261 Sep 06 11:22:31.481481 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2848/5744] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:31 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:31.876404 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4f815de0-c358-49a3-b579-48ef541851c6 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "POST /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.402807 Sep 06 11:22:31.883708 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2897/5745] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Sep 6 11:22:30 2022] POST /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/os-volume_attachments => generated 188 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:22:32.067510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5a03ae56-3356-4fec-ae33-88af3389cf2d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:32.068565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5a03ae56-3356-4fec-ae33-88af3389cf2d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:32.076599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a03ae56-3356-4fec-ae33-88af3389cf2d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:32.077398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a03ae56-3356-4fec-ae33-88af3389cf2d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:32.078368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a03ae56-3356-4fec-ae33-88af3389cf2d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:32.079383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a03ae56-3356-4fec-ae33-88af3389cf2d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:32.080518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a03ae56-3356-4fec-ae33-88af3389cf2d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:32.081183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a03ae56-3356-4fec-ae33-88af3389cf2d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:32.377487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5f2cd9ec-90d8-4ba8-ad2e-3e60cdefff42 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:32.378523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5f2cd9ec-90d8-4ba8-ad2e-3e60cdefff42 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:32.386640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f2cd9ec-90d8-4ba8-ad2e-3e60cdefff42 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:32.387332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f2cd9ec-90d8-4ba8-ad2e-3e60cdefff42 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:32.387928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f2cd9ec-90d8-4ba8-ad2e-3e60cdefff42 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:32.388737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f2cd9ec-90d8-4ba8-ad2e-3e60cdefff42 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:32.389309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f2cd9ec-90d8-4ba8-ad2e-3e60cdefff42 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:32.389831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f2cd9ec-90d8-4ba8-ad2e-3e60cdefff42 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:32.675686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5f2cd9ec-90d8-4ba8-ad2e-3e60cdefff42 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:32.685461 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5f2cd9ec-90d8-4ba8-ad2e-3e60cdefff42 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1721 microversion: 2.1 time: 0.312655 Sep 06 11:22:32.686119 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2898/5746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:32 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:22:32.691675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1832acf9-2c9f-43d6-a775-01637cd4db19 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:32.692652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1832acf9-2c9f-43d6-a775-01637cd4db19 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:32.699507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1832acf9-2c9f-43d6-a775-01637cd4db19 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:32.700176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1832acf9-2c9f-43d6-a775-01637cd4db19 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:32.700664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1832acf9-2c9f-43d6-a775-01637cd4db19 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:32.701495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1832acf9-2c9f-43d6-a775-01637cd4db19 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:32.702011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1832acf9-2c9f-43d6-a775-01637cd4db19 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:32.702561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1832acf9-2c9f-43d6-a775-01637cd4db19 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:32.767623 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5a03ae56-3356-4fec-ae33-88af3389cf2d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/os-volume_attachments/8c89d61e-6273-422f-9812-cb4473f63060" status: 202 len: 0 microversion: 2.20 time: 0.704963 Sep 06 11:22:32.768697 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2849/5747] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Sep 6 11:22:32 2022] DELETE /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/os-volume_attachments/8c89d61e-6273-422f-9812-cb4473f63060 => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:22:32.787885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1832acf9-2c9f-43d6-a775-01637cd4db19 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:32.801160 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1832acf9-2c9f-43d6-a775-01637cd4db19 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1273 microversion: 2.1 time: 0.113589 Sep 06 11:22:32.802027 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2899/5748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:32 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:32.865576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e4c05ec9-0954-4fd5-944a-140b07673cb1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:32.866277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e4c05ec9-0954-4fd5-944a-140b07673cb1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:32.872675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4c05ec9-0954-4fd5-944a-140b07673cb1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:32.873428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4c05ec9-0954-4fd5-944a-140b07673cb1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:32.874193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4c05ec9-0954-4fd5-944a-140b07673cb1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:32.875089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4c05ec9-0954-4fd5-944a-140b07673cb1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:32.875552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4c05ec9-0954-4fd5-944a-140b07673cb1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:32.876540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4c05ec9-0954-4fd5-944a-140b07673cb1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:32.923197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e4c05ec9-0954-4fd5-944a-140b07673cb1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140875) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 11:22:33.350744 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e4c05ec9-0954-4fd5-944a-140b07673cb1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "POST /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/action" status: 202 len: 0 microversion: 2.20 time: 0.489190 Sep 06 11:22:33.352057 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2850/5749] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 11:22:32 2022] POST /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:22:33.366415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-31302a5f-be43-41c7-aea1-8a58917d9bac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:33.367080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-31302a5f-be43-41c7-aea1-8a58917d9bac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:33.394039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31302a5f-be43-41c7-aea1-8a58917d9bac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:33.395509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31302a5f-be43-41c7-aea1-8a58917d9bac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:33.397434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31302a5f-be43-41c7-aea1-8a58917d9bac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:33.398191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31302a5f-be43-41c7-aea1-8a58917d9bac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:33.398975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31302a5f-be43-41c7-aea1-8a58917d9bac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:33.400911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31302a5f-be43-41c7-aea1-8a58917d9bac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:33.642544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-31302a5f-be43-41c7-aea1-8a58917d9bac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:33.653966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-31302a5f-be43-41c7-aea1-8a58917d9bac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:33.656003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-31302a5f-be43-41c7-aea1-8a58917d9bac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:33.657695 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-31302a5f-be43-41c7-aea1-8a58917d9bac tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1674 microversion: 2.20 time: 0.301064 Sep 06 11:22:33.658266 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2900/5750] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:33 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1674 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:33.711693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7154e3b6-65d3-478c-9dd8-d7ad4a882db6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:33.712302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7154e3b6-65d3-478c-9dd8-d7ad4a882db6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:33.718781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7154e3b6-65d3-478c-9dd8-d7ad4a882db6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:33.719565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7154e3b6-65d3-478c-9dd8-d7ad4a882db6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:33.720173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7154e3b6-65d3-478c-9dd8-d7ad4a882db6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:33.721059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7154e3b6-65d3-478c-9dd8-d7ad4a882db6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:33.721694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7154e3b6-65d3-478c-9dd8-d7ad4a882db6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:33.722322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7154e3b6-65d3-478c-9dd8-d7ad4a882db6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:33.831523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dd4d66f3-bcd0-4169-962d-6895d16776d4 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:33.832431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dd4d66f3-bcd0-4169-962d-6895d16776d4 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:33.845035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd4d66f3-bcd0-4169-962d-6895d16776d4 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:33.845555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd4d66f3-bcd0-4169-962d-6895d16776d4 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:33.846014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd4d66f3-bcd0-4169-962d-6895d16776d4 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:33.846752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd4d66f3-bcd0-4169-962d-6895d16776d4 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:33.848039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd4d66f3-bcd0-4169-962d-6895d16776d4 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:33.848499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dd4d66f3-bcd0-4169-962d-6895d16776d4 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:34.072106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7154e3b6-65d3-478c-9dd8-d7ad4a882db6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:34.083825 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7154e3b6-65d3-478c-9dd8-d7ad4a882db6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1721 microversion: 2.1 time: 0.376118 Sep 06 11:22:34.085400 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2851/5751] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:33 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1721 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:34.225457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dd4d66f3-bcd0-4169-962d-6895d16776d4 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:34.236687 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dd4d66f3-bcd0-4169-962d-6895d16776d4 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1315 microversion: 2.1 time: 0.414408 Sep 06 11:22:34.252765 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2901/5752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:33 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:34.599948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-d498d94d-299c-46a4-bf96-7339009cb143 req-7543860c-6380-4e17-bb5b-4396b5541cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e19f90-eba9-4318-8eda-a3b51b1e1cef", "tag": "00139708-f8a1-455a-8fb6-cb7682ec9b7b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:34.625244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d498d94d-299c-46a4-bf96-7339009cb143 req-7543860c-6380-4e17-bb5b-4396b5541cc7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:34.625855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d498d94d-299c-46a4-bf96-7339009cb143 req-7543860c-6380-4e17-bb5b-4396b5541cc7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:34.626403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d498d94d-299c-46a4-bf96-7339009cb143 req-7543860c-6380-4e17-bb5b-4396b5541cc7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:34.641177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-d498d94d-299c-46a4-bf96-7339009cb143 req-7543860c-6380-4e17-bb5b-4396b5541cc7 service nova] Creating event network-changed:00139708-f8a1-455a-8fb6-cb7682ec9b7b for instance c1e19f90-eba9-4318-8eda-a3b51b1e1cef on nch2-master-1 Sep 06 11:22:34.653874 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-d498d94d-299c-46a4-bf96-7339009cb143 req-7543860c-6380-4e17-bb5b-4396b5541cc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058232 Sep 06 11:22:34.654848 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2852/5753] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:22:34.688231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c48a5233-7ce4-4293-aef9-4357f30a7b3b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:34.692275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c48a5233-7ce4-4293-aef9-4357f30a7b3b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:34.709221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c48a5233-7ce4-4293-aef9-4357f30a7b3b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:34.711386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c48a5233-7ce4-4293-aef9-4357f30a7b3b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:34.712177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c48a5233-7ce4-4293-aef9-4357f30a7b3b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:34.713556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c48a5233-7ce4-4293-aef9-4357f30a7b3b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:34.714160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c48a5233-7ce4-4293-aef9-4357f30a7b3b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:34.714702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c48a5233-7ce4-4293-aef9-4357f30a7b3b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:34.909691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c48a5233-7ce4-4293-aef9-4357f30a7b3b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:34.926377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c48a5233-7ce4-4293-aef9-4357f30a7b3b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:34.928886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c48a5233-7ce4-4293-aef9-4357f30a7b3b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:34.930356 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c48a5233-7ce4-4293-aef9-4357f30a7b3b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1674 microversion: 2.20 time: 0.248560 Sep 06 11:22:34.931732 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2902/5754] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:34 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1674 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:35.111641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a835eb1b-e971-4cb6-8df1-9abd5cdaae02 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:35.112629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a835eb1b-e971-4cb6-8df1-9abd5cdaae02 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:35.119841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a835eb1b-e971-4cb6-8df1-9abd5cdaae02 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:35.120585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a835eb1b-e971-4cb6-8df1-9abd5cdaae02 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:35.121200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a835eb1b-e971-4cb6-8df1-9abd5cdaae02 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:35.122092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a835eb1b-e971-4cb6-8df1-9abd5cdaae02 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:35.122726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a835eb1b-e971-4cb6-8df1-9abd5cdaae02 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:35.125860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a835eb1b-e971-4cb6-8df1-9abd5cdaae02 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:35.263640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9eec2c46-3390-4a79-963c-e3c928073309 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:35.272555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9eec2c46-3390-4a79-963c-e3c928073309 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:35.282673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a835eb1b-e971-4cb6-8df1-9abd5cdaae02 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:35.291061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eec2c46-3390-4a79-963c-e3c928073309 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:35.295182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eec2c46-3390-4a79-963c-e3c928073309 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:35.295182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eec2c46-3390-4a79-963c-e3c928073309 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:35.295501 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a835eb1b-e971-4cb6-8df1-9abd5cdaae02 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1721 microversion: 2.1 time: 0.188901 Sep 06 11:22:35.295910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eec2c46-3390-4a79-963c-e3c928073309 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:35.296137 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2853/5755] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:35 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:35.296660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eec2c46-3390-4a79-963c-e3c928073309 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:35.297191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9eec2c46-3390-4a79-963c-e3c928073309 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:35.478518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9eec2c46-3390-4a79-963c-e3c928073309 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:35.498869 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9eec2c46-3390-4a79-963c-e3c928073309 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1315 microversion: 2.1 time: 0.240651 Sep 06 11:22:35.500339 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2903/5756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:35 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:22:35.966098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bf2ff574-1573-4953-84e4-9cc7703c0dee tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:35.970668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bf2ff574-1573-4953-84e4-9cc7703c0dee tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:35.985792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf2ff574-1573-4953-84e4-9cc7703c0dee tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:35.986302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf2ff574-1573-4953-84e4-9cc7703c0dee tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:35.986746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf2ff574-1573-4953-84e4-9cc7703c0dee tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:35.989076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf2ff574-1573-4953-84e4-9cc7703c0dee tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:35.989545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf2ff574-1573-4953-84e4-9cc7703c0dee tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:35.989993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf2ff574-1573-4953-84e4-9cc7703c0dee tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:36.212967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bf2ff574-1573-4953-84e4-9cc7703c0dee tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:36.223590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bf2ff574-1573-4953-84e4-9cc7703c0dee tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:36.225350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bf2ff574-1573-4953-84e4-9cc7703c0dee tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:36.226672 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bf2ff574-1573-4953-84e4-9cc7703c0dee tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.270702 Sep 06 11:22:36.227510 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2854/5757] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:35 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:22:36.330459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f3a64cd0-58d4-4fb9-b4a1-d96d524dd37c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:36.330459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f3a64cd0-58d4-4fb9-b4a1-d96d524dd37c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:36.335788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3a64cd0-58d4-4fb9-b4a1-d96d524dd37c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:36.336430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3a64cd0-58d4-4fb9-b4a1-d96d524dd37c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:36.336985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3a64cd0-58d4-4fb9-b4a1-d96d524dd37c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:36.338054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3a64cd0-58d4-4fb9-b4a1-d96d524dd37c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:36.338634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3a64cd0-58d4-4fb9-b4a1-d96d524dd37c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:36.339232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3a64cd0-58d4-4fb9-b4a1-d96d524dd37c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:36.536172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-db036e9b-97c3-4c3e-94f5-72a651b46eec tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:36.536806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-db036e9b-97c3-4c3e-94f5-72a651b46eec tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:36.543896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db036e9b-97c3-4c3e-94f5-72a651b46eec tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:36.544660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db036e9b-97c3-4c3e-94f5-72a651b46eec tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:36.545292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db036e9b-97c3-4c3e-94f5-72a651b46eec tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:36.546291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db036e9b-97c3-4c3e-94f5-72a651b46eec tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:36.546767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db036e9b-97c3-4c3e-94f5-72a651b46eec tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:36.547329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db036e9b-97c3-4c3e-94f5-72a651b46eec tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:36.965959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f3a64cd0-58d4-4fb9-b4a1-d96d524dd37c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:36.980568 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f3a64cd0-58d4-4fb9-b4a1-d96d524dd37c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1721 microversion: 2.1 time: 0.660344 Sep 06 11:22:36.995555 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2904/5758] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:36 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1721 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:37.019837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-db036e9b-97c3-4c3e-94f5-72a651b46eec tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:37.027829 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-db036e9b-97c3-4c3e-94f5-72a651b46eec tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1315 microversion: 2.1 time: 0.508434 Sep 06 11:22:37.043943 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2855/5759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:36 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:37.259739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d73daa8f-004b-4c05-8fcc-7387c82f8339 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:37.260381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d73daa8f-004b-4c05-8fcc-7387c82f8339 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:37.272351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d73daa8f-004b-4c05-8fcc-7387c82f8339 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:37.273080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d73daa8f-004b-4c05-8fcc-7387c82f8339 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:37.273600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d73daa8f-004b-4c05-8fcc-7387c82f8339 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:37.274406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d73daa8f-004b-4c05-8fcc-7387c82f8339 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:37.274895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d73daa8f-004b-4c05-8fcc-7387c82f8339 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:37.275375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d73daa8f-004b-4c05-8fcc-7387c82f8339 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:37.295264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:37.490602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d73daa8f-004b-4c05-8fcc-7387c82f8339 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:37.502849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d73daa8f-004b-4c05-8fcc-7387c82f8339 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:37.505156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d73daa8f-004b-4c05-8fcc-7387c82f8339 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:37.506673 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d73daa8f-004b-4c05-8fcc-7387c82f8339 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.251988 Sep 06 11:22:37.507847 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2905/5760] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:37 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:22:38.000099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-340ce3b6-e0a5-4176-8953-ece062cbb43b req-d0029245-d2d7-41d8-8100-ad23ae237791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc42cdc-6687-4ecd-b60a-ea23f69f50b2", "tag": "09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:38.014620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-210ad5b5-0d09-40de-a509-20e3834aa471 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:38.022572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-210ad5b5-0d09-40de-a509-20e3834aa471 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:38.035970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-340ce3b6-e0a5-4176-8953-ece062cbb43b req-d0029245-d2d7-41d8-8100-ad23ae237791 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:38.036476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-210ad5b5-0d09-40de-a509-20e3834aa471 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:38.036476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-210ad5b5-0d09-40de-a509-20e3834aa471 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:38.037059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-210ad5b5-0d09-40de-a509-20e3834aa471 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:38.037525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-340ce3b6-e0a5-4176-8953-ece062cbb43b req-d0029245-d2d7-41d8-8100-ad23ae237791 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:38.037983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-210ad5b5-0d09-40de-a509-20e3834aa471 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:38.038523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-340ce3b6-e0a5-4176-8953-ece062cbb43b req-d0029245-d2d7-41d8-8100-ad23ae237791 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:38.038664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-210ad5b5-0d09-40de-a509-20e3834aa471 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:38.039216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-210ad5b5-0d09-40de-a509-20e3834aa471 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:38.074721 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-340ce3b6-e0a5-4176-8953-ece062cbb43b req-d0029245-d2d7-41d8-8100-ad23ae237791 service nova] Creating event network-changed:09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17 for instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 on nch1-master-1 Sep 06 11:22:38.091267 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-340ce3b6-e0a5-4176-8953-ece062cbb43b req-d0029245-d2d7-41d8-8100-ad23ae237791 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093774 Sep 06 11:22:38.093039 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2856/5761] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:22:38.105083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fe03ae7f-b795-446c-927b-0c2e862b3314 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:38.107900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fe03ae7f-b795-446c-927b-0c2e862b3314 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:38.118143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe03ae7f-b795-446c-927b-0c2e862b3314 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:38.118700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe03ae7f-b795-446c-927b-0c2e862b3314 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:38.119232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe03ae7f-b795-446c-927b-0c2e862b3314 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:38.120866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe03ae7f-b795-446c-927b-0c2e862b3314 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:38.121518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe03ae7f-b795-446c-927b-0c2e862b3314 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:38.122449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe03ae7f-b795-446c-927b-0c2e862b3314 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:38.406912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-210ad5b5-0d09-40de-a509-20e3834aa471 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:38.407204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fe03ae7f-b795-446c-927b-0c2e862b3314 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:38.415771 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fe03ae7f-b795-446c-927b-0c2e862b3314 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1315 microversion: 2.1 time: 0.318733 Sep 06 11:22:38.416761 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2857/5762] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:38 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:38.437842 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-210ad5b5-0d09-40de-a509-20e3834aa471 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1721 microversion: 2.1 time: 0.428749 Sep 06 11:22:38.439832 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2906/5763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:38 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1721 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:22:38.535832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d630d5f4-1c7c-4eab-95e6-f94c5da688b1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:38.536388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d630d5f4-1c7c-4eab-95e6-f94c5da688b1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:38.544844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d630d5f4-1c7c-4eab-95e6-f94c5da688b1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:38.551353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d630d5f4-1c7c-4eab-95e6-f94c5da688b1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:38.552038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d630d5f4-1c7c-4eab-95e6-f94c5da688b1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:38.552790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d630d5f4-1c7c-4eab-95e6-f94c5da688b1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:38.553254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d630d5f4-1c7c-4eab-95e6-f94c5da688b1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:38.553829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d630d5f4-1c7c-4eab-95e6-f94c5da688b1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:38.757867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d630d5f4-1c7c-4eab-95e6-f94c5da688b1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:38.773865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d630d5f4-1c7c-4eab-95e6-f94c5da688b1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:38.775640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d630d5f4-1c7c-4eab-95e6-f94c5da688b1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:38.776949 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d630d5f4-1c7c-4eab-95e6-f94c5da688b1 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.246732 Sep 06 11:22:38.777607 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2858/5764] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:38 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:39.444313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-22817b83-e7bb-4c4b-b7d7-f8505388496b tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:39.444952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-22817b83-e7bb-4c4b-b7d7-f8505388496b tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:39.448275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:39.452473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22817b83-e7bb-4c4b-b7d7-f8505388496b tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:39.453156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22817b83-e7bb-4c4b-b7d7-f8505388496b tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:39.453619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22817b83-e7bb-4c4b-b7d7-f8505388496b tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:39.454449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22817b83-e7bb-4c4b-b7d7-f8505388496b tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:39.454925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22817b83-e7bb-4c4b-b7d7-f8505388496b tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:39.455562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22817b83-e7bb-4c4b-b7d7-f8505388496b tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:39.465547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-facb16c1-3840-4285-991f-00b6f09558b6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:39.466751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-facb16c1-3840-4285-991f-00b6f09558b6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:39.477995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:39.481613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-facb16c1-3840-4285-991f-00b6f09558b6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:39.482127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-facb16c1-3840-4285-991f-00b6f09558b6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:39.482583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-facb16c1-3840-4285-991f-00b6f09558b6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:39.483389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-facb16c1-3840-4285-991f-00b6f09558b6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:39.483861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-facb16c1-3840-4285-991f-00b6f09558b6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:39.489047 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-facb16c1-3840-4285-991f-00b6f09558b6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:39.682103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-22817b83-e7bb-4c4b-b7d7-f8505388496b tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:39.694060 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-22817b83-e7bb-4c4b-b7d7-f8505388496b tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1315 microversion: 2.1 time: 0.257265 Sep 06 11:22:39.700923 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2907/5765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:39 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:39.765109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-facb16c1-3840-4285-991f-00b6f09558b6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:39.777252 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-facb16c1-3840-4285-991f-00b6f09558b6 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1721 microversion: 2.1 time: 0.317004 Sep 06 11:22:39.777252 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2859/5766] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:39 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1721 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:39.804279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-09f4a1d6-efac-4a31-b4e2-79f0a10cf57c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:39.804913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-09f4a1d6-efac-4a31-b4e2-79f0a10cf57c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:39.815178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09f4a1d6-efac-4a31-b4e2-79f0a10cf57c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:39.815688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09f4a1d6-efac-4a31-b4e2-79f0a10cf57c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:39.816689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09f4a1d6-efac-4a31-b4e2-79f0a10cf57c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:39.819892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09f4a1d6-efac-4a31-b4e2-79f0a10cf57c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:39.823111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09f4a1d6-efac-4a31-b4e2-79f0a10cf57c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:39.823896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09f4a1d6-efac-4a31-b4e2-79f0a10cf57c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:40.066799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-09f4a1d6-efac-4a31-b4e2-79f0a10cf57c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:40.079349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-09f4a1d6-efac-4a31-b4e2-79f0a10cf57c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:40.080914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-09f4a1d6-efac-4a31-b4e2-79f0a10cf57c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:40.085777 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-09f4a1d6-efac-4a31-b4e2-79f0a10cf57c tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.282222 Sep 06 11:22:40.101536 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2908/5767] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:39 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:40.726582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a1c1a66a-dc1c-4a5e-a67b-53f059ceba38 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:40.728352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a1c1a66a-dc1c-4a5e-a67b-53f059ceba38 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:40.737854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1c1a66a-dc1c-4a5e-a67b-53f059ceba38 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:40.739509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1c1a66a-dc1c-4a5e-a67b-53f059ceba38 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:40.744358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1c1a66a-dc1c-4a5e-a67b-53f059ceba38 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:40.748735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1c1a66a-dc1c-4a5e-a67b-53f059ceba38 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:40.762721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1c1a66a-dc1c-4a5e-a67b-53f059ceba38 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:40.763849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1c1a66a-dc1c-4a5e-a67b-53f059ceba38 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:40.796919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:40.803537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-991ccd3a-d673-49e9-bbf0-83dde4ce2e92 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:40.804404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-991ccd3a-d673-49e9-bbf0-83dde4ce2e92 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:40.857626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-991ccd3a-d673-49e9-bbf0-83dde4ce2e92 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:40.857626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-991ccd3a-d673-49e9-bbf0-83dde4ce2e92 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:40.857626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-991ccd3a-d673-49e9-bbf0-83dde4ce2e92 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:40.857626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-991ccd3a-d673-49e9-bbf0-83dde4ce2e92 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:40.857626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-991ccd3a-d673-49e9-bbf0-83dde4ce2e92 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:40.857626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-991ccd3a-d673-49e9-bbf0-83dde4ce2e92 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:41.107494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a1c1a66a-dc1c-4a5e-a67b-53f059ceba38 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:41.116968 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a1c1a66a-dc1c-4a5e-a67b-53f059ceba38 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1315 microversion: 2.1 time: 0.395950 Sep 06 11:22:41.122059 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2860/5768] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:40 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:41.127750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-00037701-723f-4f6c-b747-4f51deaa215f req-56125b69-d7ad-4833-9785-194b16c64f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e19f90-eba9-4318-8eda-a3b51b1e1cef", "name": "network-vif-plugged", "status": "completed", "tag": "00139708-f8a1-455a-8fb6-cb7682ec9b7b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:41.157230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-991ccd3a-d673-49e9-bbf0-83dde4ce2e92 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:41.160003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-00037701-723f-4f6c-b747-4f51deaa215f req-56125b69-d7ad-4833-9785-194b16c64f88 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:41.160528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-00037701-723f-4f6c-b747-4f51deaa215f req-56125b69-d7ad-4833-9785-194b16c64f88 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:41.160960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-00037701-723f-4f6c-b747-4f51deaa215f req-56125b69-d7ad-4833-9785-194b16c64f88 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:41.172641 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-991ccd3a-d673-49e9-bbf0-83dde4ce2e92 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1721 microversion: 2.1 time: 0.376194 Sep 06 11:22:41.175200 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2909/5769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:40 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1721 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:41.194208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-03f95ed2-90f9-4285-b205-d1d1cd8f5851 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:41.195191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-03f95ed2-90f9-4285-b205-d1d1cd8f5851 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:41.209711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03f95ed2-90f9-4285-b205-d1d1cd8f5851 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:41.211249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03f95ed2-90f9-4285-b205-d1d1cd8f5851 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:41.212665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03f95ed2-90f9-4285-b205-d1d1cd8f5851 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:41.215431 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-00037701-723f-4f6c-b747-4f51deaa215f req-56125b69-d7ad-4833-9785-194b16c64f88 service nova] Creating event network-vif-plugged:00139708-f8a1-455a-8fb6-cb7682ec9b7b for instance c1e19f90-eba9-4318-8eda-a3b51b1e1cef on nch2-master-1 Sep 06 11:22:41.216946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03f95ed2-90f9-4285-b205-d1d1cd8f5851 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:41.220090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03f95ed2-90f9-4285-b205-d1d1cd8f5851 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:41.220985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03f95ed2-90f9-4285-b205-d1d1cd8f5851 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:41.224463 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-00037701-723f-4f6c-b747-4f51deaa215f req-56125b69-d7ad-4833-9785-194b16c64f88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098234 Sep 06 11:22:41.224995 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2861/5770] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:22:41.471754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-03f95ed2-90f9-4285-b205-d1d1cd8f5851 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:41.484830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-03f95ed2-90f9-4285-b205-d1d1cd8f5851 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:41.485957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-03f95ed2-90f9-4285-b205-d1d1cd8f5851 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:41.487413 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-03f95ed2-90f9-4285-b205-d1d1cd8f5851 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.310697 Sep 06 11:22:41.488559 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2910/5771] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:41 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:42.150393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-25a020c9-a234-47f2-a124-daaa102a734a tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:42.153334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-25a020c9-a234-47f2-a124-daaa102a734a tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:42.163611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25a020c9-a234-47f2-a124-daaa102a734a tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:42.164341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25a020c9-a234-47f2-a124-daaa102a734a tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:42.164935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25a020c9-a234-47f2-a124-daaa102a734a tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:42.165956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25a020c9-a234-47f2-a124-daaa102a734a tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:42.166518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25a020c9-a234-47f2-a124-daaa102a734a tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:42.167098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25a020c9-a234-47f2-a124-daaa102a734a tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:42.212067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9722e0ec-527f-4950-89e2-801d70eaa3b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:42.218805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9722e0ec-527f-4950-89e2-801d70eaa3b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:42.234722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9722e0ec-527f-4950-89e2-801d70eaa3b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:42.235567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9722e0ec-527f-4950-89e2-801d70eaa3b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:42.236450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9722e0ec-527f-4950-89e2-801d70eaa3b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:42.238128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9722e0ec-527f-4950-89e2-801d70eaa3b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:42.239806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9722e0ec-527f-4950-89e2-801d70eaa3b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:42.242141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9722e0ec-527f-4950-89e2-801d70eaa3b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:42.516730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-25a020c9-a234-47f2-a124-daaa102a734a tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:42.533342 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-25a020c9-a234-47f2-a124-daaa102a734a tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1315 microversion: 2.1 time: 0.387576 Sep 06 11:22:42.534163 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2862/5772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:42 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:42.546921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fe953c8e-4994-45ea-b5f9-d151c1910283 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:42.547679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fe953c8e-4994-45ea-b5f9-d151c1910283 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:42.565589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9722e0ec-527f-4950-89e2-801d70eaa3b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:42.571965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe953c8e-4994-45ea-b5f9-d151c1910283 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:42.572630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe953c8e-4994-45ea-b5f9-d151c1910283 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:42.573514 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9722e0ec-527f-4950-89e2-801d70eaa3b9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1698 microversion: 2.1 time: 0.367669 Sep 06 11:22:42.573649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe953c8e-4994-45ea-b5f9-d151c1910283 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:42.574109 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2911/5773] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:42 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1698 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:42.574926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe953c8e-4994-45ea-b5f9-d151c1910283 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:42.575816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe953c8e-4994-45ea-b5f9-d151c1910283 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:42.576480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe953c8e-4994-45ea-b5f9-d151c1910283 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:42.611106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0d7b219d-0dc7-4891-8cc7-e167e03a7b55 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:42.637116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d7b219d-0dc7-4891-8cc7-e167e03a7b55 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:42.637663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d7b219d-0dc7-4891-8cc7-e167e03a7b55 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:42.638129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d7b219d-0dc7-4891-8cc7-e167e03a7b55 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:42.679878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0d7b219d-0dc7-4891-8cc7-e167e03a7b55 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Going to try to start instance {{(pid=140876) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 11:22:42.965678 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0d7b219d-0dc7-4891-8cc7-e167e03a7b55 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "POST /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/action" status: 202 len: 0 microversion: 2.1 time: 0.356057 Sep 06 11:22:42.966399 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2912/5774] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:22:42 2022] POST /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:22:42.975313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-068efe02-b91f-49be-9094-10060edd7beb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:42.976513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-068efe02-b91f-49be-9094-10060edd7beb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:42.983447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-068efe02-b91f-49be-9094-10060edd7beb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:42.996339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-068efe02-b91f-49be-9094-10060edd7beb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:42.996339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-068efe02-b91f-49be-9094-10060edd7beb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:42.996339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-068efe02-b91f-49be-9094-10060edd7beb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:42.996339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-068efe02-b91f-49be-9094-10060edd7beb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:42.996339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-068efe02-b91f-49be-9094-10060edd7beb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:43.049162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fe953c8e-4994-45ea-b5f9-d151c1910283 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:43.060624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fe953c8e-4994-45ea-b5f9-d151c1910283 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:43.062126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fe953c8e-4994-45ea-b5f9-d151c1910283 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:43.083342 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fe953c8e-4994-45ea-b5f9-d151c1910283 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.542910 Sep 06 11:22:43.095167 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2863/5775] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:42 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:43.332542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-068efe02-b91f-49be-9094-10060edd7beb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:43.342186 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-068efe02-b91f-49be-9094-10060edd7beb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1707 microversion: 2.1 time: 0.371098 Sep 06 11:22:43.343342 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2913/5776] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:42 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1707 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:43.560946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7c1b2b70-7576-4712-8850-762ac43a0a58 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:43.562300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7c1b2b70-7576-4712-8850-762ac43a0a58 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:43.582963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c1b2b70-7576-4712-8850-762ac43a0a58 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:43.582963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c1b2b70-7576-4712-8850-762ac43a0a58 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:43.582963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c1b2b70-7576-4712-8850-762ac43a0a58 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:43.582963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c1b2b70-7576-4712-8850-762ac43a0a58 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:43.586295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c1b2b70-7576-4712-8850-762ac43a0a58 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:43.587450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c1b2b70-7576-4712-8850-762ac43a0a58 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:43.596514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:44.120223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9e8c5841-e4bb-4c44-994a-a6038f47dd6b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:44.121357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9e8c5841-e4bb-4c44-994a-a6038f47dd6b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:44.137701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e8c5841-e4bb-4c44-994a-a6038f47dd6b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:44.138568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e8c5841-e4bb-4c44-994a-a6038f47dd6b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:44.139331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e8c5841-e4bb-4c44-994a-a6038f47dd6b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:44.146224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e8c5841-e4bb-4c44-994a-a6038f47dd6b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:44.146734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e8c5841-e4bb-4c44-994a-a6038f47dd6b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:44.147221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e8c5841-e4bb-4c44-994a-a6038f47dd6b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:44.243330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7c1b2b70-7576-4712-8850-762ac43a0a58 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:44.277039 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7c1b2b70-7576-4712-8850-762ac43a0a58 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1464 microversion: 2.1 time: 0.723302 Sep 06 11:22:44.300122 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2864/5777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:43 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1464 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:44.368799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-443e68a6-1bc2-4232-9c26-16a281bde6f0 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:44.369552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-443e68a6-1bc2-4232-9c26-16a281bde6f0 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:44.405467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-443e68a6-1bc2-4232-9c26-16a281bde6f0 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:44.407219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-443e68a6-1bc2-4232-9c26-16a281bde6f0 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:44.413133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-443e68a6-1bc2-4232-9c26-16a281bde6f0 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:44.417065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-443e68a6-1bc2-4232-9c26-16a281bde6f0 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:44.418048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-443e68a6-1bc2-4232-9c26-16a281bde6f0 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:44.418773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-443e68a6-1bc2-4232-9c26-16a281bde6f0 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:45.103522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9e8c5841-e4bb-4c44-994a-a6038f47dd6b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:45.121400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9e8c5841-e4bb-4c44-994a-a6038f47dd6b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:45.122928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9e8c5841-e4bb-4c44-994a-a6038f47dd6b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:45.129750 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9e8c5841-e4bb-4c44-994a-a6038f47dd6b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 1.013742 Sep 06 11:22:45.134877 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2914/5778] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:44 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:45.155380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ad2821fa-0b96-4e8e-9188-4a3122877158 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:45.155997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ad2821fa-0b96-4e8e-9188-4a3122877158 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:45.174603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad2821fa-0b96-4e8e-9188-4a3122877158 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:45.182211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad2821fa-0b96-4e8e-9188-4a3122877158 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:45.183300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad2821fa-0b96-4e8e-9188-4a3122877158 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:45.186099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad2821fa-0b96-4e8e-9188-4a3122877158 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:45.187600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad2821fa-0b96-4e8e-9188-4a3122877158 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:45.189238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ad2821fa-0b96-4e8e-9188-4a3122877158 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:45.266999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ad2821fa-0b96-4e8e-9188-4a3122877158 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:22:45.382970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-443e68a6-1bc2-4232-9c26-16a281bde6f0 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:45.405865 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-443e68a6-1bc2-4232-9c26-16a281bde6f0 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1707 microversion: 2.1 time: 1.043834 Sep 06 11:22:45.406469 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2865/5779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:44 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1707 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:22:45.757453 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ad2821fa-0b96-4e8e-9188-4a3122877158 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 204 len: 0 microversion: 2.1 time: 0.620249 Sep 06 11:22:45.758286 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2915/5780] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:22:45 2022] DELETE /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 0 bytes in 623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:22:45.768199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c8c41ca-b07a-40c9-80d5-8169b4db2e65 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:45.769292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9c8c41ca-b07a-40c9-80d5-8169b4db2e65 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:45.781211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c8c41ca-b07a-40c9-80d5-8169b4db2e65 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:45.787261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c8c41ca-b07a-40c9-80d5-8169b4db2e65 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:45.788193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c8c41ca-b07a-40c9-80d5-8169b4db2e65 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:45.788979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c8c41ca-b07a-40c9-80d5-8169b4db2e65 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:45.789603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c8c41ca-b07a-40c9-80d5-8169b4db2e65 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:45.790064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c8c41ca-b07a-40c9-80d5-8169b4db2e65 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:46.125314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9c8c41ca-b07a-40c9-80d5-8169b4db2e65 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:46.139837 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9c8c41ca-b07a-40c9-80d5-8169b4db2e65 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1470 microversion: 2.1 time: 0.375972 Sep 06 11:22:46.141370 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2866/5781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:45 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1470 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:46.173527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ae80199d-789d-42af-9fc6-c621ef2b4b89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:46.177104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ae80199d-789d-42af-9fc6-c621ef2b4b89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:46.191998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae80199d-789d-42af-9fc6-c621ef2b4b89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:46.192787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae80199d-789d-42af-9fc6-c621ef2b4b89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:46.196578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae80199d-789d-42af-9fc6-c621ef2b4b89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:46.199235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae80199d-789d-42af-9fc6-c621ef2b4b89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:46.200315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae80199d-789d-42af-9fc6-c621ef2b4b89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:46.202601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae80199d-789d-42af-9fc6-c621ef2b4b89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:46.432369 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3b4f12cb-82e5-43d3-8221-40c5c42671ae tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:46.433654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3b4f12cb-82e5-43d3-8221-40c5c42671ae tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:46.448711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b4f12cb-82e5-43d3-8221-40c5c42671ae tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:46.449660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b4f12cb-82e5-43d3-8221-40c5c42671ae tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:46.450448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b4f12cb-82e5-43d3-8221-40c5c42671ae tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:46.451509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b4f12cb-82e5-43d3-8221-40c5c42671ae tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:46.452153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b4f12cb-82e5-43d3-8221-40c5c42671ae tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:46.452763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b4f12cb-82e5-43d3-8221-40c5c42671ae tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:46.694703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ae80199d-789d-42af-9fc6-c621ef2b4b89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:46.712696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ae80199d-789d-42af-9fc6-c621ef2b4b89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:46.718609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ae80199d-789d-42af-9fc6-c621ef2b4b89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:46.719908 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ae80199d-789d-42af-9fc6-c621ef2b4b89 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.551383 Sep 06 11:22:46.720490 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2916/5782] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:46 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:46.929613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3b4f12cb-82e5-43d3-8221-40c5c42671ae tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:46.953936 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3b4f12cb-82e5-43d3-8221-40c5c42671ae tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1711 microversion: 2.1 time: 0.526876 Sep 06 11:22:46.954549 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2867/5783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:46 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1711 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:47.174233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7205d3ef-27a7-49c9-a009-7480e783915c tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:47.174865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7205d3ef-27a7-49c9-a009-7480e783915c tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:47.199347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205d3ef-27a7-49c9-a009-7480e783915c tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:47.199347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205d3ef-27a7-49c9-a009-7480e783915c tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:47.199347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205d3ef-27a7-49c9-a009-7480e783915c tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:47.199347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205d3ef-27a7-49c9-a009-7480e783915c tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:47.199347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205d3ef-27a7-49c9-a009-7480e783915c tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:47.199347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205d3ef-27a7-49c9-a009-7480e783915c tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:47.673584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7205d3ef-27a7-49c9-a009-7480e783915c tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:47.704954 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7205d3ef-27a7-49c9-a009-7480e783915c tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1470 microversion: 2.1 time: 0.534450 Sep 06 11:22:47.706570 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2917/5784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:47 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1470 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:47.750083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-29e4e2f0-70ae-48be-835a-e0735bacf4a2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:47.750704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-29e4e2f0-70ae-48be-835a-e0735bacf4a2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:47.765588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29e4e2f0-70ae-48be-835a-e0735bacf4a2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:47.766867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29e4e2f0-70ae-48be-835a-e0735bacf4a2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:47.770041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29e4e2f0-70ae-48be-835a-e0735bacf4a2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:47.779913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29e4e2f0-70ae-48be-835a-e0735bacf4a2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:47.780735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29e4e2f0-70ae-48be-835a-e0735bacf4a2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:47.781933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29e4e2f0-70ae-48be-835a-e0735bacf4a2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:48.316610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-29e4e2f0-70ae-48be-835a-e0735bacf4a2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:48.340537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-29e4e2f0-70ae-48be-835a-e0735bacf4a2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:48.340537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-29e4e2f0-70ae-48be-835a-e0735bacf4a2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:48.340537 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-29e4e2f0-70ae-48be-835a-e0735bacf4a2 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.591483 Sep 06 11:22:48.340537 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2868/5785] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:47 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:48.656332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-e9dafe04-7011-45c6-9bac-762686b235ed req-b08c7bf8-8dc6-494b-a7a6-82446370d733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e19f90-eba9-4318-8eda-a3b51b1e1cef", "name": "network-vif-deleted", "tag": "00139708-f8a1-455a-8fb6-cb7682ec9b7b"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:48.686744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e9dafe04-7011-45c6-9bac-762686b235ed req-b08c7bf8-8dc6-494b-a7a6-82446370d733 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:48.694653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e9dafe04-7011-45c6-9bac-762686b235ed req-b08c7bf8-8dc6-494b-a7a6-82446370d733 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:48.706432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-e9dafe04-7011-45c6-9bac-762686b235ed req-b08c7bf8-8dc6-494b-a7a6-82446370d733 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:48.735707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c15faaca-6e87-4d3a-88f4-0a8b5f9f89d0 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:48.736768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c15faaca-6e87-4d3a-88f4-0a8b5f9f89d0 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:48.754799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c15faaca-6e87-4d3a-88f4-0a8b5f9f89d0 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:48.759392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c15faaca-6e87-4d3a-88f4-0a8b5f9f89d0 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:48.762478 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-e9dafe04-7011-45c6-9bac-762686b235ed req-b08c7bf8-8dc6-494b-a7a6-82446370d733 service nova] Creating event network-vif-deleted:00139708-f8a1-455a-8fb6-cb7682ec9b7b for instance c1e19f90-eba9-4318-8eda-a3b51b1e1cef on nch2-master-1 Sep 06 11:22:48.763250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c15faaca-6e87-4d3a-88f4-0a8b5f9f89d0 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:48.765019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c15faaca-6e87-4d3a-88f4-0a8b5f9f89d0 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:48.766113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c15faaca-6e87-4d3a-88f4-0a8b5f9f89d0 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:48.767461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c15faaca-6e87-4d3a-88f4-0a8b5f9f89d0 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:48.797617 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-e9dafe04-7011-45c6-9bac-762686b235ed req-b08c7bf8-8dc6-494b-a7a6-82446370d733 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140569 Sep 06 11:22:48.805859 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2918/5786] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:22:49.111292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c15faaca-6e87-4d3a-88f4-0a8b5f9f89d0 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7a44f0f8804ece9c80fe34486865a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68eec8502e9451b946462adfcc17014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:49.137252 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c15faaca-6e87-4d3a-88f4-0a8b5f9f89d0 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 200 len: 1428 microversion: 2.1 time: 0.395929 Sep 06 11:22:49.139549 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2869/5787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:48 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 1428 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:49.372698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-82516f79-a7db-4396-8b75-284d9e1c030a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:49.374106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-82516f79-a7db-4396-8b75-284d9e1c030a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:49.403794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82516f79-a7db-4396-8b75-284d9e1c030a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:49.404939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82516f79-a7db-4396-8b75-284d9e1c030a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:49.406109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82516f79-a7db-4396-8b75-284d9e1c030a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:49.407909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82516f79-a7db-4396-8b75-284d9e1c030a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:49.409660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82516f79-a7db-4396-8b75-284d9e1c030a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:49.412001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82516f79-a7db-4396-8b75-284d9e1c030a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:49.776228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-82516f79-a7db-4396-8b75-284d9e1c030a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:49.787484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-82516f79-a7db-4396-8b75-284d9e1c030a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:49.788981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-82516f79-a7db-4396-8b75-284d9e1c030a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:49.797048 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-82516f79-a7db-4396-8b75-284d9e1c030a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.433485 Sep 06 11:22:49.812153 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2919/5788] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:49 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:50.187727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ec657ff2-9060-42d5-855b-7c381b215e18 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:50.188419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ec657ff2-9060-42d5-855b-7c381b215e18 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] [instance: c1e19f90-eba9-4318-8eda-a3b51b1e1cef] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:50.203097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec657ff2-9060-42d5-855b-7c381b215e18 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:50.213876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec657ff2-9060-42d5-855b-7c381b215e18 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:50.214354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec657ff2-9060-42d5-855b-7c381b215e18 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:50.215154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec657ff2-9060-42d5-855b-7c381b215e18 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:50.219242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec657ff2-9060-42d5-855b-7c381b215e18 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:50.219707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec657ff2-9060-42d5-855b-7c381b215e18 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:50.257492 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-ec657ff2-9060-42d5-855b-7c381b215e18 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] HTTP exception thrown: Instance c1e19f90-eba9-4318-8eda-a3b51b1e1cef could not be found. Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ec657ff2-9060-42d5-855b-7c381b215e18 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Request method failure captured: Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef HTTP/1.1 Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy1uD4oFkCiuGxymWG-6Scu91VEpxLNzH3_1qggzsOjuY5R3mouHlVbxHsJi4VhGUs9fPke_8cVtf1Z3EeSp1FF06dP5Z6nZ1bYx-Eo7Gmi5OOg3-HkLC3Pit2OBvSUcI0VJ1dhOwduwZzbpp0jL4TJ72S65Q4PhxMDmTbVuCGxJiX8 Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: c68eec8502e9451b946462adfcc17014 Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-VolumesNegativeTest-1672570915 Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c68eec8502e9451b946462adfcc17014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c68eec8502e9451b946462adfcc17014"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c68eec8502e9451b946462adfcc17014"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c68eec8502e9451b946462adfcc17014"}]}] Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-VolumesNegativeTest-1672570915 Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: c68eec8502e9451b946462adfcc17014 Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-VolumesNegativeTest-1672570915 Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-VolumesNegativeTest-1672570915-project Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: fe7a44f0f8804ece9c80fe34486865a3 Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-VolumesNegativeTest-1672570915-project Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance c1e19f90-eba9-4318-8eda-a3b51b1e1cef could not be found. Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'c1e19f90-eba9-4318-8eda-a3b51b1e1cef'} Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e19f90-eba9-4318-8eda-a3b51b1e1cef could not be found. Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e19f90-eba9-4318-8eda-a3b51b1e1cef could not be found. Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:22:50.259279 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:22:50.264177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:22:50.264177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:22:50.264177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:22:50.264177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:22:50.264177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:22:50.264177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e19f90-eba9-4318-8eda-a3b51b1e1cef could not be found. Sep 06 11:22:50.264177 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:22:50.267817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ec657ff2-9060-42d5-855b-7c381b215e18 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] Returning 404 to user: Instance c1e19f90-eba9-4318-8eda-a3b51b1e1cef could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:22:50.275987 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ec657ff2-9060-42d5-855b-7c381b215e18 tempest-VolumesNegativeTest-1672570915 tempest-VolumesNegativeTest-1672570915-project] 10.222.0.20 "GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef" status: 404 len: 111 microversion: 2.1 time: 0.108573 Sep 06 11:22:50.275987 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2870/5789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:50 2022] GET /compute/v2.1/servers/c1e19f90-eba9-4318-8eda-a3b51b1e1cef => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:22:50.827915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c8dd3a33-c6a5-4c25-b73d-d78064f4aa7b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:50.828532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c8dd3a33-c6a5-4c25-b73d-d78064f4aa7b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:50.855092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8dd3a33-c6a5-4c25-b73d-d78064f4aa7b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:50.855092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8dd3a33-c6a5-4c25-b73d-d78064f4aa7b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:50.855092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8dd3a33-c6a5-4c25-b73d-d78064f4aa7b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:50.855092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8dd3a33-c6a5-4c25-b73d-d78064f4aa7b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:50.855092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8dd3a33-c6a5-4c25-b73d-d78064f4aa7b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:50.855092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8dd3a33-c6a5-4c25-b73d-d78064f4aa7b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:50.947923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:51.470452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c8dd3a33-c6a5-4c25-b73d-d78064f4aa7b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:51.494452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c8dd3a33-c6a5-4c25-b73d-d78064f4aa7b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:51.497240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c8dd3a33-c6a5-4c25-b73d-d78064f4aa7b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:51.498519 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c8dd3a33-c6a5-4c25-b73d-d78064f4aa7b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.674714 Sep 06 11:22:51.525270 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2920/5790] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:50 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:52.530827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-55e44400-61bd-4445-a408-e5d943def248 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:52.531480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-55e44400-61bd-4445-a408-e5d943def248 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:52.547633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55e44400-61bd-4445-a408-e5d943def248 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:52.548137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55e44400-61bd-4445-a408-e5d943def248 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:52.548592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55e44400-61bd-4445-a408-e5d943def248 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:52.549313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55e44400-61bd-4445-a408-e5d943def248 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:52.556417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55e44400-61bd-4445-a408-e5d943def248 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:52.557015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-55e44400-61bd-4445-a408-e5d943def248 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:52.841937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-55e44400-61bd-4445-a408-e5d943def248 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:52.851927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-55e44400-61bd-4445-a408-e5d943def248 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:52.860841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-55e44400-61bd-4445-a408-e5d943def248 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:52.863472 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-55e44400-61bd-4445-a408-e5d943def248 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.338261 Sep 06 11:22:52.864656 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2871/5791] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:52 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:53.890624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-55e76b0a-e63f-4713-92a4-ba9fd4614839 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:53.891387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-55e76b0a-e63f-4713-92a4-ba9fd4614839 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:53.906732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55e76b0a-e63f-4713-92a4-ba9fd4614839 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:53.907320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55e76b0a-e63f-4713-92a4-ba9fd4614839 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:53.907788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55e76b0a-e63f-4713-92a4-ba9fd4614839 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:53.910508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55e76b0a-e63f-4713-92a4-ba9fd4614839 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:53.911106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55e76b0a-e63f-4713-92a4-ba9fd4614839 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:53.911566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55e76b0a-e63f-4713-92a4-ba9fd4614839 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:54.275997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-55e76b0a-e63f-4713-92a4-ba9fd4614839 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:54.293632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-55e76b0a-e63f-4713-92a4-ba9fd4614839 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:54.298780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-55e76b0a-e63f-4713-92a4-ba9fd4614839 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:54.303113 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-55e76b0a-e63f-4713-92a4-ba9fd4614839 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.418983 Sep 06 11:22:54.306415 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2921/5792] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:53 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:54.927175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1893826089", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "7081b525-8154-489c-8896-6badfae625c9"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:54.940748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:55.000063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] validate_networks() for [('7081b525-8154-489c-8896-6badfae625c9', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:22:55.335307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3194c61e-61c0-4e61-9989-7bf90e832e1b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:55.336241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3194c61e-61c0-4e61-9989-7bf90e832e1b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:55.339616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:55.354700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3194c61e-61c0-4e61-9989-7bf90e832e1b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:55.357062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3194c61e-61c0-4e61-9989-7bf90e832e1b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:55.358847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3194c61e-61c0-4e61-9989-7bf90e832e1b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:55.361058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3194c61e-61c0-4e61-9989-7bf90e832e1b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:55.362136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3194c61e-61c0-4e61-9989-7bf90e832e1b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:55.364940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3194c61e-61c0-4e61-9989-7bf90e832e1b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:56.112032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:22:56.113496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:22:56.114492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:22:56.115171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:22:56.115827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:22:56.116474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3194c61e-61c0-4e61-9989-7bf90e832e1b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:56.127712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3194c61e-61c0-4e61-9989-7bf90e832e1b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:56.129578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3194c61e-61c0-4e61-9989-7bf90e832e1b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:56.130015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:56.130950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:56.131481 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3194c61e-61c0-4e61-9989-7bf90e832e1b tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.801418 Sep 06 11:22:56.132675 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2922/5793] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:55 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:56.152493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:56.157365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:56.157365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:56.157365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:56.179222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Getting quotas for project f18c44a020d9419886827314045b3200. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:22:56.186970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Getting quotas for user 3732e9811bcf44749081ff7049a2c0df and project f18c44a020d9419886827314045b3200. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:22:56.204007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Going to run 2 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:22:56.207671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 08611ef9-0d74-4137-bc03-7d9af8649474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:22:56.369670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=08611ef9-0d74-4137-bc03-7d9af8649474,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:22:56.634006 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aa4e6065-93bc-4cc9-855e-502b0d298beb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.920812 Sep 06 11:22:56.635389 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2872/5794] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:22:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:22:56.649422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2d869d29-0189-4497-8401-529128dd18b1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:56.668475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2d869d29-0189-4497-8401-529128dd18b1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:56.674023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2d869d29-0189-4497-8401-529128dd18b1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Searching by: {'deleted': False, 'project_id': 'f18c44a020d9419886827314045b3200'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:22:56.716473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d869d29-0189-4497-8401-529128dd18b1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:56.717480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d869d29-0189-4497-8401-529128dd18b1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:56.718150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d869d29-0189-4497-8401-529128dd18b1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:56.719281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d869d29-0189-4497-8401-529128dd18b1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:56.719993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d869d29-0189-4497-8401-529128dd18b1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:56.720780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2d869d29-0189-4497-8401-529128dd18b1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:56.796166 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2d869d29-0189-4497-8401-529128dd18b1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.152984 Sep 06 11:22:56.805381 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2923/5795] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 11:22:56 2022] GET /compute/v2.1/servers => generated 677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:22:56.811482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-83aa3d44-84ae-47d9-8323-b671a903085c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:56.816320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-83aa3d44-84ae-47d9-8323-b671a903085c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:56.962721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-83aa3d44-84ae-47d9-8323-b671a903085c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:56.971726 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-83aa3d44-84ae-47d9-8323-b671a903085c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1220 microversion: 2.1 time: 0.161972 Sep 06 11:22:56.972874 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2873/5796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:56 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1220 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:22:57.041251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-d2383411-ac0b-4877-a6c7-049177db021e req-285f5794-27b3-4d99-bc1e-90fdb975671f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc42cdc-6687-4ecd-b60a-ea23f69f50b2", "name": "network-vif-plugged", "status": "completed", "tag": "09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:22:57.071504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d2383411-ac0b-4877-a6c7-049177db021e req-285f5794-27b3-4d99-bc1e-90fdb975671f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:57.072245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d2383411-ac0b-4877-a6c7-049177db021e req-285f5794-27b3-4d99-bc1e-90fdb975671f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:57.073376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d2383411-ac0b-4877-a6c7-049177db021e req-285f5794-27b3-4d99-bc1e-90fdb975671f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:57.096759 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d2383411-ac0b-4877-a6c7-049177db021e req-285f5794-27b3-4d99-bc1e-90fdb975671f service nova] Creating event network-vif-plugged:09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17 for instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 on nch1-master-1 Sep 06 11:22:57.104365 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-d2383411-ac0b-4877-a6c7-049177db021e req-285f5794-27b3-4d99-bc1e-90fdb975671f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067043 Sep 06 11:22:57.105340 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2924/5797] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:22:57.170360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f7042eb0-8f83-429d-816b-69e8e6591f67 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:57.170360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f7042eb0-8f83-429d-816b-69e8e6591f67 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:57.175902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7042eb0-8f83-429d-816b-69e8e6591f67 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:57.183867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7042eb0-8f83-429d-816b-69e8e6591f67 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:57.184467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7042eb0-8f83-429d-816b-69e8e6591f67 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:57.185934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7042eb0-8f83-429d-816b-69e8e6591f67 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:57.187904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7042eb0-8f83-429d-816b-69e8e6591f67 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:57.199648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f7042eb0-8f83-429d-816b-69e8e6591f67 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:57.399632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f7042eb0-8f83-429d-816b-69e8e6591f67 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:57.415321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f7042eb0-8f83-429d-816b-69e8e6591f67 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:57.417570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f7042eb0-8f83-429d-816b-69e8e6591f67 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:57.418978 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f7042eb0-8f83-429d-816b-69e8e6591f67 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.264719 Sep 06 11:22:57.419605 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2874/5798] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:57 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:58.002467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b9fcdf4d-c931-41b1-a66d-9651f9b80918 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:58.004777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b9fcdf4d-c931-41b1-a66d-9651f9b80918 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:58.150540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b9fcdf4d-c931-41b1-a66d-9651f9b80918 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:58.164657 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b9fcdf4d-c931-41b1-a66d-9651f9b80918 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1220 microversion: 2.1 time: 0.173444 Sep 06 11:22:58.165679 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2925/5799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:57 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1220 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:58.454534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4d97b028-386e-4ae2-bc47-785087846773 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:58.456085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4d97b028-386e-4ae2-bc47-785087846773 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:58.473781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d97b028-386e-4ae2-bc47-785087846773 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:58.475704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d97b028-386e-4ae2-bc47-785087846773 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:58.476191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d97b028-386e-4ae2-bc47-785087846773 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:58.476946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d97b028-386e-4ae2-bc47-785087846773 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:58.477415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d97b028-386e-4ae2-bc47-785087846773 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:58.478048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d97b028-386e-4ae2-bc47-785087846773 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:58.767536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4d97b028-386e-4ae2-bc47-785087846773 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:58.813272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4d97b028-386e-4ae2-bc47-785087846773 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:58.816459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4d97b028-386e-4ae2-bc47-785087846773 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:58.818521 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4d97b028-386e-4ae2-bc47-785087846773 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.369476 Sep 06 11:22:58.820386 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2875/5800] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:58 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:22:59.189540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-551c07d5-c162-4cee-8c76-d3d1122513c9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:59.190242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-551c07d5-c162-4cee-8c76-d3d1122513c9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:59.294320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-551c07d5-c162-4cee-8c76-d3d1122513c9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:22:59.304300 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-551c07d5-c162-4cee-8c76-d3d1122513c9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1220 microversion: 2.1 time: 0.118994 Sep 06 11:22:59.319046 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2926/5801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:22:59 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1220 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:22:59.848960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6e9b0c80-dcb3-455b-a57d-cb107bb2906a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:22:59.849693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6e9b0c80-dcb3-455b-a57d-cb107bb2906a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:22:59.863248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e9b0c80-dcb3-455b-a57d-cb107bb2906a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:59.869582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e9b0c80-dcb3-455b-a57d-cb107bb2906a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:59.870123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e9b0c80-dcb3-455b-a57d-cb107bb2906a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:22:59.874502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e9b0c80-dcb3-455b-a57d-cb107bb2906a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:22:59.875562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e9b0c80-dcb3-455b-a57d-cb107bb2906a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:22:59.876024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e9b0c80-dcb3-455b-a57d-cb107bb2906a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:00.087786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6e9b0c80-dcb3-455b-a57d-cb107bb2906a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:00.098118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6e9b0c80-dcb3-455b-a57d-cb107bb2906a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:00.099961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6e9b0c80-dcb3-455b-a57d-cb107bb2906a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:00.101177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6e9b0c80-dcb3-455b-a57d-cb107bb2906a tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.257056 Sep 06 11:23:00.101744 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2876/5802] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:22:59 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:23:00.332306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dc4695a1-d463-448e-9174-7f515a3129c6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:00.333036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dc4695a1-d463-448e-9174-7f515a3129c6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:00.343218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc4695a1-d463-448e-9174-7f515a3129c6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:00.343730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc4695a1-d463-448e-9174-7f515a3129c6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:00.344183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc4695a1-d463-448e-9174-7f515a3129c6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:00.344900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc4695a1-d463-448e-9174-7f515a3129c6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:00.345372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc4695a1-d463-448e-9174-7f515a3129c6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:00.345814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc4695a1-d463-448e-9174-7f515a3129c6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:00.426295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dc4695a1-d463-448e-9174-7f515a3129c6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:00.434445 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dc4695a1-d463-448e-9174-7f515a3129c6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1224 microversion: 2.1 time: 0.107128 Sep 06 11:23:00.435219 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2927/5803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:00 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:01.131659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ca86da8e-41fb-4ad5-82f1-c859e751e64d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:01.134602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ca86da8e-41fb-4ad5-82f1-c859e751e64d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:01.151461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca86da8e-41fb-4ad5-82f1-c859e751e64d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:01.156152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca86da8e-41fb-4ad5-82f1-c859e751e64d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:01.156982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca86da8e-41fb-4ad5-82f1-c859e751e64d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:01.158376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca86da8e-41fb-4ad5-82f1-c859e751e64d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:01.159059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca86da8e-41fb-4ad5-82f1-c859e751e64d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:01.159887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ca86da8e-41fb-4ad5-82f1-c859e751e64d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:01.330265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ca86da8e-41fb-4ad5-82f1-c859e751e64d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:01.351067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ca86da8e-41fb-4ad5-82f1-c859e751e64d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:01.355432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ca86da8e-41fb-4ad5-82f1-c859e751e64d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:01.357686 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ca86da8e-41fb-4ad5-82f1-c859e751e64d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1732 microversion: 2.20 time: 0.230550 Sep 06 11:23:01.358992 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2877/5804] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:23:01 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1732 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:23:01.459780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-58e10183-d998-4a62-9efa-2e1a707aaf22 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:01.460411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-58e10183-d998-4a62-9efa-2e1a707aaf22 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:01.474249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e10183-d998-4a62-9efa-2e1a707aaf22 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:01.475095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e10183-d998-4a62-9efa-2e1a707aaf22 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:01.475716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e10183-d998-4a62-9efa-2e1a707aaf22 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:01.476788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e10183-d998-4a62-9efa-2e1a707aaf22 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:01.477270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e10183-d998-4a62-9efa-2e1a707aaf22 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:01.477880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e10183-d998-4a62-9efa-2e1a707aaf22 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:01.614378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-58e10183-d998-4a62-9efa-2e1a707aaf22 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:01.629823 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-58e10183-d998-4a62-9efa-2e1a707aaf22 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1272 microversion: 2.1 time: 0.176110 Sep 06 11:23:01.630924 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2928/5805] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:01 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:02.409041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-620d35ae-67ef-4d60-8bb1-13b421c12b56 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:02.411060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-620d35ae-67ef-4d60-8bb1-13b421c12b56 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:02.465756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-620d35ae-67ef-4d60-8bb1-13b421c12b56 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:02.466821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-620d35ae-67ef-4d60-8bb1-13b421c12b56 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:02.468174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-620d35ae-67ef-4d60-8bb1-13b421c12b56 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:02.471425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-620d35ae-67ef-4d60-8bb1-13b421c12b56 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:02.474912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-620d35ae-67ef-4d60-8bb1-13b421c12b56 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:02.475831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-620d35ae-67ef-4d60-8bb1-13b421c12b56 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:02.664559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed5c7bb1-86c9-4223-836d-de29795136c1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:02.665984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ed5c7bb1-86c9-4223-836d-de29795136c1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:02.686776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed5c7bb1-86c9-4223-836d-de29795136c1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:02.687765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed5c7bb1-86c9-4223-836d-de29795136c1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:02.694531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed5c7bb1-86c9-4223-836d-de29795136c1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:02.700319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed5c7bb1-86c9-4223-836d-de29795136c1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:02.700319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed5c7bb1-86c9-4223-836d-de29795136c1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:02.700319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed5c7bb1-86c9-4223-836d-de29795136c1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:02.711397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-620d35ae-67ef-4d60-8bb1-13b421c12b56 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:02.723917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-620d35ae-67ef-4d60-8bb1-13b421c12b56 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:02.727432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-620d35ae-67ef-4d60-8bb1-13b421c12b56 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:02.740535 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-620d35ae-67ef-4d60-8bb1-13b421c12b56 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1719 microversion: 2.20 time: 0.342883 Sep 06 11:23:02.741819 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2878/5806] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:23:02 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1719 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:23:02.835975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ed5c7bb1-86c9-4223-836d-de29795136c1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:02.850901 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ed5c7bb1-86c9-4223-836d-de29795136c1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1278 microversion: 2.1 time: 0.194627 Sep 06 11:23:02.863293 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2929/5807] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:02 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:03.875820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f71e1d6c-ac01-4792-9798-4102fb91b104 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:03.876804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f71e1d6c-ac01-4792-9798-4102fb91b104 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:03.888117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f71e1d6c-ac01-4792-9798-4102fb91b104 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:03.888632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f71e1d6c-ac01-4792-9798-4102fb91b104 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:03.890071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f71e1d6c-ac01-4792-9798-4102fb91b104 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:03.906624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f71e1d6c-ac01-4792-9798-4102fb91b104 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:03.907978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f71e1d6c-ac01-4792-9798-4102fb91b104 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:03.910643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f71e1d6c-ac01-4792-9798-4102fb91b104 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:04.090341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f71e1d6c-ac01-4792-9798-4102fb91b104 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:04.127408 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f71e1d6c-ac01-4792-9798-4102fb91b104 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1278 microversion: 2.1 time: 0.245408 Sep 06 11:23:04.130774 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2930/5808] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:03 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1278 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:23:04.195824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aeec7856-05dc-4440-b2ae-5db06ac1c1ac tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-195989839", "availability_zone": "foo_zone"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:04.207691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.aggregate [None req-aeec7856-05dc-4440-b2ae-5db06ac1c1ac tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Generated uuid 909a9de1-f886-4cc3-9a1c-10a93301d331 for aggregate {{(pid=140875) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 06 11:23:04.350744 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aeec7856-05dc-4440-b2ae-5db06ac1c1ac tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.519303 Sep 06 11:23:04.353568 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2879/5809] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Sep 6 11:23:03 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:04.364774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e8f92930-832f-48dd-b1b2-7e555dcaf8e8 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:04.554371 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e8f92930-832f-48dd-b1b2-7e555dcaf8e8 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.193585 Sep 06 11:23:04.556680 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2931/5810] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Sep 6 11:23:04 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:23:04.567821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a3ca91c4-35d3-43d7-ac38-92eebfb7a1f2 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:04.578203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3ca91c4-35d3-43d7-ac38-92eebfb7a1f2 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:04.578985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3ca91c4-35d3-43d7-ac38-92eebfb7a1f2 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:04.579517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3ca91c4-35d3-43d7-ac38-92eebfb7a1f2 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:04.580212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3ca91c4-35d3-43d7-ac38-92eebfb7a1f2 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:04.580678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3ca91c4-35d3-43d7-ac38-92eebfb7a1f2 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:04.581112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3ca91c4-35d3-43d7-ac38-92eebfb7a1f2 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:04.619671 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a3ca91c4-35d3-43d7-ac38-92eebfb7a1f2 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055644 Sep 06 11:23:04.628232 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2880/5811] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Sep 6 11:23:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:04.642171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb1de99d-5f8b-4c4e-93c1-0ec8c1af329f tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:04.660346 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bb1de99d-5f8b-4c4e-93c1-0ec8c1af329f tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.030579 Sep 06 11:23:04.660949 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2932/5812] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 11:23:04 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:04.672922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-710bab3a-0969-4f9b-8b1d-bdf151c363c8 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:04.690844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-710bab3a-0969-4f9b-8b1d-bdf151c363c8 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:04.691712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-710bab3a-0969-4f9b-8b1d-bdf151c363c8 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:04.692163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-710bab3a-0969-4f9b-8b1d-bdf151c363c8 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:05.037957 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-710bab3a-0969-4f9b-8b1d-bdf151c363c8 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.364160 Sep 06 11:23:05.037957 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2881/5813] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Sep 6 11:23:04 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:05.045530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c38d9063-f10c-4655-98cc-97e103ce6cc9 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:05.061069 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c38d9063-f10c-4655-98cc-97e103ce6cc9 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.013433 Sep 06 11:23:05.061069 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2933/5814] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 11:23:05 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:05.071724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3db135c0-17b2-4907-a485-72ff15822841 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1583169498", "availability_zone": "foo_zone"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:05.155129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e1138461-bde4-4767-a46e-6c5afdb56dc6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:05.156082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e1138461-bde4-4767-a46e-6c5afdb56dc6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:05.163255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1138461-bde4-4767-a46e-6c5afdb56dc6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:05.163998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1138461-bde4-4767-a46e-6c5afdb56dc6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:05.164441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1138461-bde4-4767-a46e-6c5afdb56dc6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:05.165703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1138461-bde4-4767-a46e-6c5afdb56dc6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:05.166551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1138461-bde4-4767-a46e-6c5afdb56dc6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:05.167255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1138461-bde4-4767-a46e-6c5afdb56dc6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:05.246500 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3db135c0-17b2-4907-a485-72ff15822841 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.177130 Sep 06 11:23:05.247617 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2882/5815] 10.222.0.20 () {60 vars in 1173 bytes} [Tue Sep 6 11:23:05 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:05.266891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2ce5de1f-3540-427a-adca-e0563e33b5a2 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:05.365904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e1138461-bde4-4767-a46e-6c5afdb56dc6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:05.375981 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e1138461-bde4-4767-a46e-6c5afdb56dc6 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1324 microversion: 2.1 time: 0.224783 Sep 06 11:23:05.382253 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2934/5816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:05 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1324 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:23:05.444294 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2ce5de1f-3540-427a-adca-e0563e33b5a2 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.180928 Sep 06 11:23:05.457239 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2883/5817] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Sep 6 11:23:05 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:23:05.459913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ceab7e5f-6565-4c90-9359-c7d60ab62bd0 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:05.510499 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ceab7e5f-6565-4c90-9359-c7d60ab62bd0 tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.049347 Sep 06 11:23:05.519671 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2935/5818] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 11:23:05 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:05.544452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fdfea74e-42b6-47a3-a2b6-4421dcbdd22d tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:05.571181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fdfea74e-42b6-47a3-a2b6-4421dcbdd22d tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:05.572209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fdfea74e-42b6-47a3-a2b6-4421dcbdd22d tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:05.573094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fdfea74e-42b6-47a3-a2b6-4421dcbdd22d tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:05.997314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-79bf7a3e-842f-4d40-8b25-49e4e8cbbd17 req-78b4338e-00bf-4da9-a593-608311376a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08611ef9-0d74-4137-bc03-7d9af8649474", "tag": "ec33e1e4-666a-4107-b679-7c8b453c5144"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:06.030727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-79bf7a3e-842f-4d40-8b25-49e4e8cbbd17 req-78b4338e-00bf-4da9-a593-608311376a6d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:06.034364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-79bf7a3e-842f-4d40-8b25-49e4e8cbbd17 req-78b4338e-00bf-4da9-a593-608311376a6d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:06.037807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-79bf7a3e-842f-4d40-8b25-49e4e8cbbd17 req-78b4338e-00bf-4da9-a593-608311376a6d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:06.043058 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fdfea74e-42b6-47a3-a2b6-4421dcbdd22d tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.521895 Sep 06 11:23:06.053561 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2884/5819] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Sep 6 11:23:05 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:23:06.059856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-20e61e7b-9cd1-4aff-9a89-4103b2770c6d tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:06.062127 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-79bf7a3e-842f-4d40-8b25-49e4e8cbbd17 req-78b4338e-00bf-4da9-a593-608311376a6d service nova] Creating event network-changed:ec33e1e4-666a-4107-b679-7c8b453c5144 for instance 08611ef9-0d74-4137-bc03-7d9af8649474 on nch2-master-1 Sep 06 11:23:06.071511 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-79bf7a3e-842f-4d40-8b25-49e4e8cbbd17 req-78b4338e-00bf-4da9-a593-608311376a6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075819 Sep 06 11:23:06.072506 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2936/5820] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:23:06.167306 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-20e61e7b-9cd1-4aff-9a89-4103b2770c6d tempest-TestAggregatesBasicOps-2068385772 tempest-TestAggregatesBasicOps-2068385772-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.111994 Sep 06 11:23:06.173848 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2885/5821] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 11:23:06 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 06 11:23:06.411406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8cd15fc4-0968-4852-8332-8223a4a2d7ef tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:06.412137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8cd15fc4-0968-4852-8332-8223a4a2d7ef tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:06.419246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cd15fc4-0968-4852-8332-8223a4a2d7ef tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:06.420015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cd15fc4-0968-4852-8332-8223a4a2d7ef tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:06.420838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cd15fc4-0968-4852-8332-8223a4a2d7ef tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:06.421739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cd15fc4-0968-4852-8332-8223a4a2d7ef tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:06.422383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cd15fc4-0968-4852-8332-8223a4a2d7ef tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:06.422975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8cd15fc4-0968-4852-8332-8223a4a2d7ef tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:06.766162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:06.890396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8cd15fc4-0968-4852-8332-8223a4a2d7ef tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:06.913444 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8cd15fc4-0968-4852-8332-8223a4a2d7ef tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1320 microversion: 2.1 time: 0.506751 Sep 06 11:23:06.920181 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2937/5822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:06 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1320 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:07.954581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fe5f65d0-e83b-434d-9acf-e5cc655bb0c0 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:07.955303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fe5f65d0-e83b-434d-9acf-e5cc655bb0c0 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:07.958797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:07.965169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe5f65d0-e83b-434d-9acf-e5cc655bb0c0 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:07.965694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe5f65d0-e83b-434d-9acf-e5cc655bb0c0 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:07.966340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe5f65d0-e83b-434d-9acf-e5cc655bb0c0 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:07.967320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe5f65d0-e83b-434d-9acf-e5cc655bb0c0 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:07.967956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe5f65d0-e83b-434d-9acf-e5cc655bb0c0 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:07.968550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe5f65d0-e83b-434d-9acf-e5cc655bb0c0 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:08.111598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-6b47c218-171b-40f8-9d6f-08041929cb57 req-0f28f076-b760-405c-823b-529e68d3bc5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78641485-41a6-4dfd-9fec-a5a717ab31e0", "tag": "4fecdf5d-e781-4e6c-a59f-95687c16706e"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:08.124721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6b47c218-171b-40f8-9d6f-08041929cb57 req-0f28f076-b760-405c-823b-529e68d3bc5c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:08.125535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6b47c218-171b-40f8-9d6f-08041929cb57 req-0f28f076-b760-405c-823b-529e68d3bc5c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:08.126144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6b47c218-171b-40f8-9d6f-08041929cb57 req-0f28f076-b760-405c-823b-529e68d3bc5c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:08.144634 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-6b47c218-171b-40f8-9d6f-08041929cb57 req-0f28f076-b760-405c-823b-529e68d3bc5c service nova] Creating event network-changed:4fecdf5d-e781-4e6c-a59f-95687c16706e for instance 78641485-41a6-4dfd-9fec-a5a717ab31e0 on nch1-master-1 Sep 06 11:23:08.150359 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-6b47c218-171b-40f8-9d6f-08041929cb57 req-0f28f076-b760-405c-823b-529e68d3bc5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062349 Sep 06 11:23:08.151156 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2938/5823] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:08.450554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fe5f65d0-e83b-434d-9acf-e5cc655bb0c0 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:08.460014 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fe5f65d0-e83b-434d-9acf-e5cc655bb0c0 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1320 microversion: 2.1 time: 0.509963 Sep 06 11:23:08.464054 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2886/5824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:07 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1320 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:09.492842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f33eb12b-3cfd-4ce3-8542-8c44f051687d tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:09.502722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f33eb12b-3cfd-4ce3-8542-8c44f051687d tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:09.510176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:09.533804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f33eb12b-3cfd-4ce3-8542-8c44f051687d tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:09.538042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f33eb12b-3cfd-4ce3-8542-8c44f051687d tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:09.539362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f33eb12b-3cfd-4ce3-8542-8c44f051687d tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:09.542667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f33eb12b-3cfd-4ce3-8542-8c44f051687d tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:09.545752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f33eb12b-3cfd-4ce3-8542-8c44f051687d tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:09.549496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f33eb12b-3cfd-4ce3-8542-8c44f051687d tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:10.229650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f33eb12b-3cfd-4ce3-8542-8c44f051687d tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:10.283780 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f33eb12b-3cfd-4ce3-8542-8c44f051687d tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1320 microversion: 2.1 time: 0.789028 Sep 06 11:23:10.283780 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2939/5825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:09 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1320 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:11.323524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0f7418d1-6b20-4450-9fb4-3c4679212d7b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:11.326338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0f7418d1-6b20-4450-9fb4-3c4679212d7b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:11.353145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f7418d1-6b20-4450-9fb4-3c4679212d7b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:11.353607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f7418d1-6b20-4450-9fb4-3c4679212d7b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:11.354468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f7418d1-6b20-4450-9fb4-3c4679212d7b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:11.356773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f7418d1-6b20-4450-9fb4-3c4679212d7b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:11.357847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f7418d1-6b20-4450-9fb4-3c4679212d7b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:11.358604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0f7418d1-6b20-4450-9fb4-3c4679212d7b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:11.694190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0f7418d1-6b20-4450-9fb4-3c4679212d7b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:11.709360 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0f7418d1-6b20-4450-9fb4-3c4679212d7b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1320 microversion: 2.1 time: 0.398265 Sep 06 11:23:11.727587 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2887/5826] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:11 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1320 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:12.737004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a3382f56-e2bb-413f-8542-b86f2e563716 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:12.741375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a3382f56-e2bb-413f-8542-b86f2e563716 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:12.749807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3382f56-e2bb-413f-8542-b86f2e563716 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:12.751099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3382f56-e2bb-413f-8542-b86f2e563716 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:12.751843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3382f56-e2bb-413f-8542-b86f2e563716 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:12.753049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3382f56-e2bb-413f-8542-b86f2e563716 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:12.753878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3382f56-e2bb-413f-8542-b86f2e563716 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:12.754841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3382f56-e2bb-413f-8542-b86f2e563716 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:12.968952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a3382f56-e2bb-413f-8542-b86f2e563716 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:12.978717 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a3382f56-e2bb-413f-8542-b86f2e563716 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1320 microversion: 2.1 time: 0.249142 Sep 06 11:23:12.979817 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2940/5827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:12 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1320 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:13.465824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-02b2e6fa-0052-4465-b384-1b7c2550b7c1 req-37b2ab86-0c48-4bb2-9136-9dc8fd4863b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78641485-41a6-4dfd-9fec-a5a717ab31e0", "name": "network-vif-plugged", "status": "completed", "tag": "4fecdf5d-e781-4e6c-a59f-95687c16706e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:13.484432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-02b2e6fa-0052-4465-b384-1b7c2550b7c1 req-37b2ab86-0c48-4bb2-9136-9dc8fd4863b9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:13.484770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-02b2e6fa-0052-4465-b384-1b7c2550b7c1 req-37b2ab86-0c48-4bb2-9136-9dc8fd4863b9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:13.485591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-02b2e6fa-0052-4465-b384-1b7c2550b7c1 req-37b2ab86-0c48-4bb2-9136-9dc8fd4863b9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:13.503272 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-02b2e6fa-0052-4465-b384-1b7c2550b7c1 req-37b2ab86-0c48-4bb2-9136-9dc8fd4863b9 service nova] Creating event network-vif-plugged:4fecdf5d-e781-4e6c-a59f-95687c16706e for instance 78641485-41a6-4dfd-9fec-a5a717ab31e0 on nch1-master-1 Sep 06 11:23:13.509002 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-02b2e6fa-0052-4465-b384-1b7c2550b7c1 req-37b2ab86-0c48-4bb2-9136-9dc8fd4863b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053485 Sep 06 11:23:13.509980 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2888/5828] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:14.009498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5b9b6030-8c1a-4cb7-bac5-9658cb4d3a68 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:14.009498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5b9b6030-8c1a-4cb7-bac5-9658cb4d3a68 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:14.011813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b9b6030-8c1a-4cb7-bac5-9658cb4d3a68 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:14.012683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b9b6030-8c1a-4cb7-bac5-9658cb4d3a68 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:14.013735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b9b6030-8c1a-4cb7-bac5-9658cb4d3a68 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:14.014718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b9b6030-8c1a-4cb7-bac5-9658cb4d3a68 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:14.015392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b9b6030-8c1a-4cb7-bac5-9658cb4d3a68 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:14.015996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b9b6030-8c1a-4cb7-bac5-9658cb4d3a68 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:14.181620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5b9b6030-8c1a-4cb7-bac5-9658cb4d3a68 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:14.190115 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5b9b6030-8c1a-4cb7-bac5-9658cb4d3a68 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1320 microversion: 2.1 time: 0.191869 Sep 06 11:23:14.191508 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2941/5829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:13 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1320 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:15.213138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:15.218675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-22574165-6d36-4962-adf3-4b6ce6c9d691 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:15.219687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-22574165-6d36-4962-adf3-4b6ce6c9d691 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:15.229237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22574165-6d36-4962-adf3-4b6ce6c9d691 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:15.230249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22574165-6d36-4962-adf3-4b6ce6c9d691 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:15.230874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22574165-6d36-4962-adf3-4b6ce6c9d691 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:15.231845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22574165-6d36-4962-adf3-4b6ce6c9d691 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:15.233330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22574165-6d36-4962-adf3-4b6ce6c9d691 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:15.237014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-22574165-6d36-4962-adf3-4b6ce6c9d691 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:15.242452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:15.456152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-22574165-6d36-4962-adf3-4b6ce6c9d691 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:15.472563 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-22574165-6d36-4962-adf3-4b6ce6c9d691 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1320 microversion: 2.1 time: 0.256514 Sep 06 11:23:15.472563 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2889/5830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:15 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1320 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:15.540637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-f703b50f-61a3-46a3-96f9-bfce81b7b749 req-fdd9d4d1-a1c1-4b64-91e4-5ec5b2460f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08611ef9-0d74-4137-bc03-7d9af8649474", "name": "network-vif-plugged", "status": "completed", "tag": "ec33e1e4-666a-4107-b679-7c8b453c5144"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:15.571172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f703b50f-61a3-46a3-96f9-bfce81b7b749 req-fdd9d4d1-a1c1-4b64-91e4-5ec5b2460f8e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:15.572403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f703b50f-61a3-46a3-96f9-bfce81b7b749 req-fdd9d4d1-a1c1-4b64-91e4-5ec5b2460f8e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:15.573619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f703b50f-61a3-46a3-96f9-bfce81b7b749 req-fdd9d4d1-a1c1-4b64-91e4-5ec5b2460f8e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:15.598493 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f703b50f-61a3-46a3-96f9-bfce81b7b749 req-fdd9d4d1-a1c1-4b64-91e4-5ec5b2460f8e service nova] Creating event network-vif-plugged:ec33e1e4-666a-4107-b679-7c8b453c5144 for instance 08611ef9-0d74-4137-bc03-7d9af8649474 on nch2-master-1 Sep 06 11:23:15.609449 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-f703b50f-61a3-46a3-96f9-bfce81b7b749 req-fdd9d4d1-a1c1-4b64-91e4-5ec5b2460f8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076539 Sep 06 11:23:15.611163 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2942/5831] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:16.512431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e601c91e-15b8-4651-a44f-efb952c70864 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:16.513784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e601c91e-15b8-4651-a44f-efb952c70864 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:16.527241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e601c91e-15b8-4651-a44f-efb952c70864 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:16.528376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e601c91e-15b8-4651-a44f-efb952c70864 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:16.529183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e601c91e-15b8-4651-a44f-efb952c70864 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:16.531238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e601c91e-15b8-4651-a44f-efb952c70864 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:16.533154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e601c91e-15b8-4651-a44f-efb952c70864 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:16.534212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e601c91e-15b8-4651-a44f-efb952c70864 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:16.846828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e601c91e-15b8-4651-a44f-efb952c70864 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:16.855140 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e601c91e-15b8-4651-a44f-efb952c70864 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 200 len: 1506 microversion: 2.1 time: 0.349695 Sep 06 11:23:16.856265 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2890/5832] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:16 2022] GET /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:16.895814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e55d5edc-410d-42df-a282-cd73cf2925d2 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:16.897168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e55d5edc-410d-42df-a282-cd73cf2925d2 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 08611ef9-0d74-4137-bc03-7d9af8649474] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:16.913879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e55d5edc-410d-42df-a282-cd73cf2925d2 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:16.914387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e55d5edc-410d-42df-a282-cd73cf2925d2 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:16.914835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e55d5edc-410d-42df-a282-cd73cf2925d2 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:16.918363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e55d5edc-410d-42df-a282-cd73cf2925d2 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:16.918363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e55d5edc-410d-42df-a282-cd73cf2925d2 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:16.918363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e55d5edc-410d-42df-a282-cd73cf2925d2 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:17.158584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e55d5edc-410d-42df-a282-cd73cf2925d2 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:17.171437 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e55d5edc-410d-42df-a282-cd73cf2925d2 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/08611ef9-0d74-4137-bc03-7d9af8649474" status: 200 len: 1320 microversion: 2.1 time: 0.294517 Sep 06 11:23:17.172387 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2943/5833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:16 2022] GET /compute/v2.1/servers/08611ef9-0d74-4137-bc03-7d9af8649474 => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:18.199806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f25b4e4f-6f04-4312-84bb-7e4a079b45f7 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:18.200720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f25b4e4f-6f04-4312-84bb-7e4a079b45f7 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 08611ef9-0d74-4137-bc03-7d9af8649474] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:18.214320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f25b4e4f-6f04-4312-84bb-7e4a079b45f7 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:18.217671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f25b4e4f-6f04-4312-84bb-7e4a079b45f7 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:18.217671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f25b4e4f-6f04-4312-84bb-7e4a079b45f7 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:18.217671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f25b4e4f-6f04-4312-84bb-7e4a079b45f7 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:18.218311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f25b4e4f-6f04-4312-84bb-7e4a079b45f7 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:18.219077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f25b4e4f-6f04-4312-84bb-7e4a079b45f7 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:18.570664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f25b4e4f-6f04-4312-84bb-7e4a079b45f7 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:18.582621 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f25b4e4f-6f04-4312-84bb-7e4a079b45f7 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/08611ef9-0d74-4137-bc03-7d9af8649474" status: 200 len: 1507 microversion: 2.1 time: 0.389695 Sep 06 11:23:18.599781 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2891/5834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:18 2022] GET /compute/v2.1/servers/08611ef9-0d74-4137-bc03-7d9af8649474 => generated 1507 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:18.610339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5c187c3-375f-4ed0-84cc-8f97fc007e4a tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:18.612415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a5c187c3-375f-4ed0-84cc-8f97fc007e4a tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 08611ef9-0d74-4137-bc03-7d9af8649474] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:18.626459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5c187c3-375f-4ed0-84cc-8f97fc007e4a tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:18.633442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5c187c3-375f-4ed0-84cc-8f97fc007e4a tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:18.636776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5c187c3-375f-4ed0-84cc-8f97fc007e4a tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:18.642360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5c187c3-375f-4ed0-84cc-8f97fc007e4a tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:18.642360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5c187c3-375f-4ed0-84cc-8f97fc007e4a tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:18.642360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5c187c3-375f-4ed0-84cc-8f97fc007e4a tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:18.682648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a5c187c3-375f-4ed0-84cc-8f97fc007e4a tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 08611ef9-0d74-4137-bc03-7d9af8649474] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:23:18.804950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:18.907188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-25fa4b41-488e-482f-81c5-8125215cf0f1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:18.907836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-25fa4b41-488e-482f-81c5-8125215cf0f1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:18.915461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25fa4b41-488e-482f-81c5-8125215cf0f1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:18.916251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25fa4b41-488e-482f-81c5-8125215cf0f1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:18.916945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25fa4b41-488e-482f-81c5-8125215cf0f1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:18.917915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25fa4b41-488e-482f-81c5-8125215cf0f1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:18.918507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25fa4b41-488e-482f-81c5-8125215cf0f1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:18.919037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25fa4b41-488e-482f-81c5-8125215cf0f1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:19.010738 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a5c187c3-375f-4ed0-84cc-8f97fc007e4a tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "DELETE /compute/v2.1/servers/08611ef9-0d74-4137-bc03-7d9af8649474" status: 204 len: 0 microversion: 2.1 time: 0.405042 Sep 06 11:23:19.011880 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2944/5835] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:23:18 2022] DELETE /compute/v2.1/servers/08611ef9-0d74-4137-bc03-7d9af8649474 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:23:19.026095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-771e196e-6a70-48f9-8fef-56a347e75e9b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:19.027277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-771e196e-6a70-48f9-8fef-56a347e75e9b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:19.042260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-771e196e-6a70-48f9-8fef-56a347e75e9b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:19.043386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-771e196e-6a70-48f9-8fef-56a347e75e9b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:19.044654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-771e196e-6a70-48f9-8fef-56a347e75e9b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:19.046592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-771e196e-6a70-48f9-8fef-56a347e75e9b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:19.047486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-771e196e-6a70-48f9-8fef-56a347e75e9b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:19.048535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-771e196e-6a70-48f9-8fef-56a347e75e9b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:19.053927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-25fa4b41-488e-482f-81c5-8125215cf0f1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lazy-loading 'services' on Instance uuid 14f263e1-7ed7-4e44-a150-57400223dbb6 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:23:19.126907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-771e196e-6a70-48f9-8fef-56a347e75e9b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 78641485-41a6-4dfd-9fec-a5a717ab31e0] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:23:19.360792 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-25fa4b41-488e-482f-81c5-8125215cf0f1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/os-volume_attachments/ac10c607-f660-481b-b7e3-d3696df6c680" status: 202 len: 0 microversion: 2.1 time: 0.456982 Sep 06 11:23:19.365229 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2892/5836] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 11:23:18 2022] DELETE /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/os-volume_attachments/ac10c607-f660-481b-b7e3-d3696df6c680 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:23:19.473904 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-771e196e-6a70-48f9-8fef-56a347e75e9b tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "DELETE /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0" status: 204 len: 0 microversion: 2.1 time: 0.455057 Sep 06 11:23:19.477700 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2945/5837] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:23:19 2022] DELETE /compute/v2.1/servers/78641485-41a6-4dfd-9fec-a5a717ab31e0 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:23:19.746168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-219265134", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "7081b525-8154-489c-8896-6badfae625c9"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:19.776092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=10,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:19.836854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] validate_networks() for [('7081b525-8154-489c-8896-6badfae625c9', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:23:20.631670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:23:20.633285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:23:20.634354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:23:20.635464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:23:20.636249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:23:20.652799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:20.653983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:20.654925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:20.656362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:20.657339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:20.658370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:20.697176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Getting quotas for project f18c44a020d9419886827314045b3200. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:23:20.710499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Getting quotas for user 3732e9811bcf44749081ff7049a2c0df and project f18c44a020d9419886827314045b3200. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:23:20.749487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Going to run 2 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:23:20.770785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 5e864933-832c-4089-b29e-c5ce83a2c005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:23:21.006591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=5e864933-832c-4089-b29e-c5ce83a2c005,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:23:21.265779 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-92626782-6b2a-4e27-b68d-b68d5f7ae248 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.528604 Sep 06 11:23:21.266930 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2893/5838] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:23:19 2022] POST /compute/v2.1/servers => generated 32 bytes in 1532 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 06 11:23:21.283997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9782a77f-db23-42b3-8dd9-1e75cbc946fe tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:21.309667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9782a77f-db23-42b3-8dd9-1e75cbc946fe tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:21.314707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9782a77f-db23-42b3-8dd9-1e75cbc946fe tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Searching by: {'deleted': False, 'project_id': 'f18c44a020d9419886827314045b3200'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:23:21.379417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9782a77f-db23-42b3-8dd9-1e75cbc946fe tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:21.383276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9782a77f-db23-42b3-8dd9-1e75cbc946fe tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:21.384335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9782a77f-db23-42b3-8dd9-1e75cbc946fe tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:21.385776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9782a77f-db23-42b3-8dd9-1e75cbc946fe tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:21.386732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9782a77f-db23-42b3-8dd9-1e75cbc946fe tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:21.387607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9782a77f-db23-42b3-8dd9-1e75cbc946fe tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:21.474542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-9782a77f-db23-42b3-8dd9-1e75cbc946fe tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:23:21.517117 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9782a77f-db23-42b3-8dd9-1e75cbc946fe tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.244725 Sep 06 11:23:21.520895 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2946/5839] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 11:23:21 2022] GET /compute/v2.1/servers => generated 1335 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:21.532353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1907db42-3832-4311-a3e7-24f7171da0ad tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:21.533392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1907db42-3832-4311-a3e7-24f7171da0ad tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:21.755542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1907db42-3832-4311-a3e7-24f7171da0ad tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:21.786445 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1907db42-3832-4311-a3e7-24f7171da0ad tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 200 len: 1217 microversion: 2.1 time: 0.257887 Sep 06 11:23:21.789130 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2894/5840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:21 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 1217 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:22.817409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d36c5e24-8dba-432e-8051-10f8f7c700d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:22.819455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d36c5e24-8dba-432e-8051-10f8f7c700d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:22.897436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bec91947-bf1a-4a78-9573-4eac1cff0037 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:22.939358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bec91947-bf1a-4a78-9573-4eac1cff0037 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:22.940140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bec91947-bf1a-4a78-9573-4eac1cff0037 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:22.940951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bec91947-bf1a-4a78-9573-4eac1cff0037 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:23.025885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bec91947-bf1a-4a78-9573-4eac1cff0037 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Going to try to stop instance {{(pid=140875) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 11:23:23.052017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d36c5e24-8dba-432e-8051-10f8f7c700d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:23.071476 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d36c5e24-8dba-432e-8051-10f8f7c700d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 200 len: 1217 microversion: 2.1 time: 0.260906 Sep 06 11:23:23.073033 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2947/5841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:22 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 1217 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:23.088686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-76ac8350-68ff-4eab-80e1-d6244f4ff34d req-ea205c20-7903-46b8-a0a2-7ee54fe704cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08611ef9-0d74-4137-bc03-7d9af8649474", "name": "network-vif-deleted", "tag": "ec33e1e4-666a-4107-b679-7c8b453c5144"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:23.146171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-76ac8350-68ff-4eab-80e1-d6244f4ff34d req-ea205c20-7903-46b8-a0a2-7ee54fe704cc service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:23.146981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-76ac8350-68ff-4eab-80e1-d6244f4ff34d req-ea205c20-7903-46b8-a0a2-7ee54fe704cc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:23.147669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-76ac8350-68ff-4eab-80e1-d6244f4ff34d req-ea205c20-7903-46b8-a0a2-7ee54fe704cc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:23.166842 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-76ac8350-68ff-4eab-80e1-d6244f4ff34d req-ea205c20-7903-46b8-a0a2-7ee54fe704cc service nova] Creating event network-vif-deleted:ec33e1e4-666a-4107-b679-7c8b453c5144 for instance 08611ef9-0d74-4137-bc03-7d9af8649474 on nch2-master-1 Sep 06 11:23:23.179432 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-76ac8350-68ff-4eab-80e1-d6244f4ff34d req-ea205c20-7903-46b8-a0a2-7ee54fe704cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095050 Sep 06 11:23:23.182265 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2948/5842] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:23.409493 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bec91947-bf1a-4a78-9573-4eac1cff0037 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "POST /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/action" status: 202 len: 0 microversion: 2.1 time: 0.520902 Sep 06 11:23:23.412723 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2895/5843] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:23:22 2022] POST /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:23:23.422166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5166094b-b696-4b71-b60d-8f6571ff6bfc tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:23.423199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5166094b-b696-4b71-b60d-8f6571ff6bfc tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:23.430620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5166094b-b696-4b71-b60d-8f6571ff6bfc tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:23.431502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5166094b-b696-4b71-b60d-8f6571ff6bfc tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:23.432156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5166094b-b696-4b71-b60d-8f6571ff6bfc tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:23.433092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5166094b-b696-4b71-b60d-8f6571ff6bfc tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:23.433808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5166094b-b696-4b71-b60d-8f6571ff6bfc tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:23.435068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5166094b-b696-4b71-b60d-8f6571ff6bfc tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:23.798696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5166094b-b696-4b71-b60d-8f6571ff6bfc tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:23.831921 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5166094b-b696-4b71-b60d-8f6571ff6bfc tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1675 microversion: 2.1 time: 0.414634 Sep 06 11:23:23.833583 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2949/5844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:23 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1675 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:24.103356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ad722cee-8cf9-4a0f-a885-9545d5a49e5c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:24.104073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ad722cee-8cf9-4a0f-a885-9545d5a49e5c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:24.126142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad722cee-8cf9-4a0f-a885-9545d5a49e5c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:24.127807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad722cee-8cf9-4a0f-a885-9545d5a49e5c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:24.127807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad722cee-8cf9-4a0f-a885-9545d5a49e5c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:24.128012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad722cee-8cf9-4a0f-a885-9545d5a49e5c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:24.128435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad722cee-8cf9-4a0f-a885-9545d5a49e5c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:24.128880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad722cee-8cf9-4a0f-a885-9545d5a49e5c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:24.253739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ad722cee-8cf9-4a0f-a885-9545d5a49e5c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:24.264772 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ad722cee-8cf9-4a0f-a885-9545d5a49e5c tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 200 len: 1221 microversion: 2.1 time: 0.167923 Sep 06 11:23:24.265954 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2896/5845] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:24 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 1221 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:24.856463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7d242956-e1fa-4ffa-9665-00cb974404d8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:24.857832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7d242956-e1fa-4ffa-9665-00cb974404d8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:24.865988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d242956-e1fa-4ffa-9665-00cb974404d8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:24.866913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d242956-e1fa-4ffa-9665-00cb974404d8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:24.867551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d242956-e1fa-4ffa-9665-00cb974404d8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:24.868555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d242956-e1fa-4ffa-9665-00cb974404d8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:24.869467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d242956-e1fa-4ffa-9665-00cb974404d8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:24.870267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7d242956-e1fa-4ffa-9665-00cb974404d8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:25.071735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7d242956-e1fa-4ffa-9665-00cb974404d8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:25.084717 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7d242956-e1fa-4ffa-9665-00cb974404d8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1675 microversion: 2.1 time: 0.232997 Sep 06 11:23:25.100601 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2950/5846] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:24 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1675 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:25.229903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9c08a291-953f-4313-838e-06ccdfeade18 req-b7e8135e-d42d-4692-941f-643066262049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78641485-41a6-4dfd-9fec-a5a717ab31e0", "name": "network-vif-deleted", "tag": "4fecdf5d-e781-4e6c-a59f-95687c16706e"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:25.244416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9c08a291-953f-4313-838e-06ccdfeade18 req-b7e8135e-d42d-4692-941f-643066262049 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:25.245289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9c08a291-953f-4313-838e-06ccdfeade18 req-b7e8135e-d42d-4692-941f-643066262049 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:25.245809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9c08a291-953f-4313-838e-06ccdfeade18 req-b7e8135e-d42d-4692-941f-643066262049 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:25.260895 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9c08a291-953f-4313-838e-06ccdfeade18 req-b7e8135e-d42d-4692-941f-643066262049 service nova] Creating event network-vif-deleted:4fecdf5d-e781-4e6c-a59f-95687c16706e for instance 78641485-41a6-4dfd-9fec-a5a717ab31e0 on nch1-master-1 Sep 06 11:23:25.271368 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9c08a291-953f-4313-838e-06ccdfeade18 req-b7e8135e-d42d-4692-941f-643066262049 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045667 Sep 06 11:23:25.272886 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2897/5847] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:25.291046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7a51d636-586f-4792-a59c-cbd301995784 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:25.296607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7a51d636-586f-4792-a59c-cbd301995784 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:25.304869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a51d636-586f-4792-a59c-cbd301995784 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:25.305520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a51d636-586f-4792-a59c-cbd301995784 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:25.306273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a51d636-586f-4792-a59c-cbd301995784 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:25.307092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a51d636-586f-4792-a59c-cbd301995784 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:25.307644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a51d636-586f-4792-a59c-cbd301995784 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:25.308198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a51d636-586f-4792-a59c-cbd301995784 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:25.462664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7a51d636-586f-4792-a59c-cbd301995784 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:25.475782 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7a51d636-586f-4792-a59c-cbd301995784 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 200 len: 1269 microversion: 2.1 time: 0.188924 Sep 06 11:23:25.479719 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2951/5848] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:25 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:26.123501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bb5f2864-7504-40b7-bcf1-a4d0ee78860e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:26.124318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bb5f2864-7504-40b7-bcf1-a4d0ee78860e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:26.135697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb5f2864-7504-40b7-bcf1-a4d0ee78860e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:26.137071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb5f2864-7504-40b7-bcf1-a4d0ee78860e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:26.137966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb5f2864-7504-40b7-bcf1-a4d0ee78860e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:26.139812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb5f2864-7504-40b7-bcf1-a4d0ee78860e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:26.153533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb5f2864-7504-40b7-bcf1-a4d0ee78860e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:26.153533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb5f2864-7504-40b7-bcf1-a4d0ee78860e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:26.369748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bb5f2864-7504-40b7-bcf1-a4d0ee78860e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:26.395467 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bb5f2864-7504-40b7-bcf1-a4d0ee78860e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1675 microversion: 2.1 time: 0.264408 Sep 06 11:23:26.395467 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2898/5849] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:26 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1675 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:26.506213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5d672a56-ddf4-4972-8ef2-2a6708267031 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:26.523789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5d672a56-ddf4-4972-8ef2-2a6708267031 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:26.530435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:26.540473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d672a56-ddf4-4972-8ef2-2a6708267031 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:26.541360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d672a56-ddf4-4972-8ef2-2a6708267031 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:26.542153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d672a56-ddf4-4972-8ef2-2a6708267031 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:26.543526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d672a56-ddf4-4972-8ef2-2a6708267031 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:26.544470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d672a56-ddf4-4972-8ef2-2a6708267031 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:26.545441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d672a56-ddf4-4972-8ef2-2a6708267031 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:26.645053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5d672a56-ddf4-4972-8ef2-2a6708267031 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:26.655267 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5d672a56-ddf4-4972-8ef2-2a6708267031 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 200 len: 1275 microversion: 2.1 time: 0.157649 Sep 06 11:23:26.671735 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2952/5850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:26 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:27.418107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5e38660c-1d14-44ea-92f7-0bf83e11684e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:27.425571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5e38660c-1d14-44ea-92f7-0bf83e11684e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:27.429771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e38660c-1d14-44ea-92f7-0bf83e11684e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:27.430364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e38660c-1d14-44ea-92f7-0bf83e11684e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:27.430920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e38660c-1d14-44ea-92f7-0bf83e11684e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:27.431954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e38660c-1d14-44ea-92f7-0bf83e11684e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:27.432439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e38660c-1d14-44ea-92f7-0bf83e11684e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:27.432888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5e38660c-1d14-44ea-92f7-0bf83e11684e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:27.646406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5e38660c-1d14-44ea-92f7-0bf83e11684e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:27.658724 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5e38660c-1d14-44ea-92f7-0bf83e11684e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1675 microversion: 2.1 time: 0.245106 Sep 06 11:23:27.659416 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2899/5851] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:27 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1675 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:27.683157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1dd47eb5-84ee-4c63-8924-1cf97ccd00d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:27.687369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1dd47eb5-84ee-4c63-8924-1cf97ccd00d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:27.695986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dd47eb5-84ee-4c63-8924-1cf97ccd00d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:27.696714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dd47eb5-84ee-4c63-8924-1cf97ccd00d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:27.697506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dd47eb5-84ee-4c63-8924-1cf97ccd00d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:27.698606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dd47eb5-84ee-4c63-8924-1cf97ccd00d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:27.699376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dd47eb5-84ee-4c63-8924-1cf97ccd00d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:27.700015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1dd47eb5-84ee-4c63-8924-1cf97ccd00d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:27.792531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1dd47eb5-84ee-4c63-8924-1cf97ccd00d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:27.802655 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1dd47eb5-84ee-4c63-8924-1cf97ccd00d4 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 200 len: 1275 microversion: 2.1 time: 0.124350 Sep 06 11:23:27.803815 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2953/5852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:27 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:28.683536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-731f2866-2f08-42ae-8aa0-1d3d85cfef62 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:28.684008 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-731f2866-2f08-42ae-8aa0-1d3d85cfef62 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:28.693781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-731f2866-2f08-42ae-8aa0-1d3d85cfef62 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:28.701607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-731f2866-2f08-42ae-8aa0-1d3d85cfef62 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:28.701607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-731f2866-2f08-42ae-8aa0-1d3d85cfef62 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:28.701607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-731f2866-2f08-42ae-8aa0-1d3d85cfef62 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:28.701607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-731f2866-2f08-42ae-8aa0-1d3d85cfef62 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:28.701607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-731f2866-2f08-42ae-8aa0-1d3d85cfef62 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:28.826130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3e5ffd82-ec42-4f18-82c4-c7d1d38a31e8 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:28.831990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3e5ffd82-ec42-4f18-82c4-c7d1d38a31e8 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:28.842816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e5ffd82-ec42-4f18-82c4-c7d1d38a31e8 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:28.843830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e5ffd82-ec42-4f18-82c4-c7d1d38a31e8 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:28.846303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e5ffd82-ec42-4f18-82c4-c7d1d38a31e8 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:28.849140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e5ffd82-ec42-4f18-82c4-c7d1d38a31e8 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:28.849835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e5ffd82-ec42-4f18-82c4-c7d1d38a31e8 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:28.852381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e5ffd82-ec42-4f18-82c4-c7d1d38a31e8 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:28.970353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-731f2866-2f08-42ae-8aa0-1d3d85cfef62 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:28.984087 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-731f2866-2f08-42ae-8aa0-1d3d85cfef62 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1675 microversion: 2.1 time: 0.304051 Sep 06 11:23:28.984910 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2900/5853] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:28 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1675 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:23:29.091716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3e5ffd82-ec42-4f18-82c4-c7d1d38a31e8 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:29.105509 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3e5ffd82-ec42-4f18-82c4-c7d1d38a31e8 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 200 len: 1317 microversion: 2.1 time: 0.283507 Sep 06 11:23:29.106115 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2954/5854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:28 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:23:29.332349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a81bcd80-da96-4b42-ab9b-4704e583551d req-0d3a22cb-b04f-4fda-9db7-84e68ae9a5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e864933-832c-4089-b29e-c5ce83a2c005", "tag": "b7e2c7d9-f276-4c72-b6b5-0d6c2b3ea46a"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:29.346195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a81bcd80-da96-4b42-ab9b-4704e583551d req-0d3a22cb-b04f-4fda-9db7-84e68ae9a5e4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:29.347559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a81bcd80-da96-4b42-ab9b-4704e583551d req-0d3a22cb-b04f-4fda-9db7-84e68ae9a5e4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:29.348263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a81bcd80-da96-4b42-ab9b-4704e583551d req-0d3a22cb-b04f-4fda-9db7-84e68ae9a5e4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:29.362209 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a81bcd80-da96-4b42-ab9b-4704e583551d req-0d3a22cb-b04f-4fda-9db7-84e68ae9a5e4 service nova] Creating event network-changed:b7e2c7d9-f276-4c72-b6b5-0d6c2b3ea46a for instance 5e864933-832c-4089-b29e-c5ce83a2c005 on nch2-master-1 Sep 06 11:23:29.367881 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a81bcd80-da96-4b42-ab9b-4704e583551d req-0d3a22cb-b04f-4fda-9db7-84e68ae9a5e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046601 Sep 06 11:23:29.371436 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2901/5855] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:23:30.011741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bec20458-af9c-4f3e-9db4-5df170c10393 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:30.013013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bec20458-af9c-4f3e-9db4-5df170c10393 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:30.021606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bec20458-af9c-4f3e-9db4-5df170c10393 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:30.024790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bec20458-af9c-4f3e-9db4-5df170c10393 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:30.025506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bec20458-af9c-4f3e-9db4-5df170c10393 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:30.028049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bec20458-af9c-4f3e-9db4-5df170c10393 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:30.029079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bec20458-af9c-4f3e-9db4-5df170c10393 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:30.031592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bec20458-af9c-4f3e-9db4-5df170c10393 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:30.132108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-20b65d22-5125-48e0-8c95-4b1766e301f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:30.133554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-20b65d22-5125-48e0-8c95-4b1766e301f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:30.142331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20b65d22-5125-48e0-8c95-4b1766e301f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:30.143423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20b65d22-5125-48e0-8c95-4b1766e301f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:30.147865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20b65d22-5125-48e0-8c95-4b1766e301f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:30.147865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20b65d22-5125-48e0-8c95-4b1766e301f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:30.147865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20b65d22-5125-48e0-8c95-4b1766e301f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:30.147865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20b65d22-5125-48e0-8c95-4b1766e301f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:30.259314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bec20458-af9c-4f3e-9db4-5df170c10393 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:30.291308 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bec20458-af9c-4f3e-9db4-5df170c10393 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1675 microversion: 2.1 time: 0.280560 Sep 06 11:23:30.292482 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2955/5856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:30 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1675 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:30.372749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-20b65d22-5125-48e0-8c95-4b1766e301f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:30.384871 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-20b65d22-5125-48e0-8c95-4b1766e301f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 200 len: 1317 microversion: 2.1 time: 0.258655 Sep 06 11:23:30.386459 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2902/5857] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:30 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:31.316238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-42008ef1-7619-4960-82b9-d1c4168f4a18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:31.317404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-42008ef1-7619-4960-82b9-d1c4168f4a18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:31.325553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42008ef1-7619-4960-82b9-d1c4168f4a18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:31.329913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42008ef1-7619-4960-82b9-d1c4168f4a18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:31.329913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42008ef1-7619-4960-82b9-d1c4168f4a18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:31.329913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42008ef1-7619-4960-82b9-d1c4168f4a18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:31.329913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42008ef1-7619-4960-82b9-d1c4168f4a18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:31.329913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42008ef1-7619-4960-82b9-d1c4168f4a18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:31.396159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ebe75e32-eb5b-4486-a612-10a78cff9dae req-eb8d790b-f3fc-41e3-90e3-498447561916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af8a67a-5ba2-4638-a5d6-2590bd931000", "tag": "59b6ff01-b4fa-4320-995a-76014ccf8fc6"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:31.410263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:31.417254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ebe75e32-eb5b-4486-a612-10a78cff9dae req-eb8d790b-f3fc-41e3-90e3-498447561916 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:31.422355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ebe75e32-eb5b-4486-a612-10a78cff9dae req-eb8d790b-f3fc-41e3-90e3-498447561916 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:31.422355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ebe75e32-eb5b-4486-a612-10a78cff9dae req-eb8d790b-f3fc-41e3-90e3-498447561916 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:31.436656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:31.440121 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ebe75e32-eb5b-4486-a612-10a78cff9dae req-eb8d790b-f3fc-41e3-90e3-498447561916 service nova] Creating event network-changed:59b6ff01-b4fa-4320-995a-76014ccf8fc6 for instance 1af8a67a-5ba2-4638-a5d6-2590bd931000 on nch1-master-1 Sep 06 11:23:31.446956 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ebe75e32-eb5b-4486-a612-10a78cff9dae req-eb8d790b-f3fc-41e3-90e3-498447561916 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058684 Sep 06 11:23:31.451212 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2903/5858] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:23:31.457377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e7e8a1d7-1452-4f3f-a820-479d00178308 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:31.458903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e7e8a1d7-1452-4f3f-a820-479d00178308 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:31.466834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7e8a1d7-1452-4f3f-a820-479d00178308 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:31.467634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7e8a1d7-1452-4f3f-a820-479d00178308 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:31.468219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7e8a1d7-1452-4f3f-a820-479d00178308 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:31.472893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7e8a1d7-1452-4f3f-a820-479d00178308 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:31.472893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7e8a1d7-1452-4f3f-a820-479d00178308 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:31.473510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e7e8a1d7-1452-4f3f-a820-479d00178308 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:31.495947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-42008ef1-7619-4960-82b9-d1c4168f4a18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:31.504766 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-42008ef1-7619-4960-82b9-d1c4168f4a18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1675 microversion: 2.1 time: 0.193064 Sep 06 11:23:31.505395 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2956/5859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:31 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1675 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:23:31.634206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e7e8a1d7-1452-4f3f-a820-479d00178308 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:31.642968 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e7e8a1d7-1452-4f3f-a820-479d00178308 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 200 len: 1317 microversion: 2.1 time: 0.193172 Sep 06 11:23:31.643612 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2904/5860] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:31 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:32.535682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-051b74a5-7d5c-4667-b8ae-74d080fba214 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:32.537784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-051b74a5-7d5c-4667-b8ae-74d080fba214 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:32.549159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-051b74a5-7d5c-4667-b8ae-74d080fba214 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:32.550073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-051b74a5-7d5c-4667-b8ae-74d080fba214 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:32.551173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-051b74a5-7d5c-4667-b8ae-74d080fba214 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:32.552544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-051b74a5-7d5c-4667-b8ae-74d080fba214 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:32.553427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-051b74a5-7d5c-4667-b8ae-74d080fba214 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:32.554110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-051b74a5-7d5c-4667-b8ae-74d080fba214 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:32.689250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5330cea7-0b8c-4a58-b16f-4cdd7bc1b29e tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:32.691309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5330cea7-0b8c-4a58-b16f-4cdd7bc1b29e tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:32.701886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:32.715714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5330cea7-0b8c-4a58-b16f-4cdd7bc1b29e tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:32.716951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5330cea7-0b8c-4a58-b16f-4cdd7bc1b29e tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:32.718535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5330cea7-0b8c-4a58-b16f-4cdd7bc1b29e tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:32.720029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5330cea7-0b8c-4a58-b16f-4cdd7bc1b29e tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:32.721081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5330cea7-0b8c-4a58-b16f-4cdd7bc1b29e tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:32.722167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5330cea7-0b8c-4a58-b16f-4cdd7bc1b29e tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:32.993389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-051b74a5-7d5c-4667-b8ae-74d080fba214 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:33.010431 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-051b74a5-7d5c-4667-b8ae-74d080fba214 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1675 microversion: 2.1 time: 0.482584 Sep 06 11:23:33.013235 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2957/5861] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:32 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1675 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:23:33.032015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5330cea7-0b8c-4a58-b16f-4cdd7bc1b29e tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:33.041459 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5330cea7-0b8c-4a58-b16f-4cdd7bc1b29e tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 200 len: 1317 microversion: 2.1 time: 0.362554 Sep 06 11:23:33.041966 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2905/5862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:32 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:34.043355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a108418f-fa55-4e2f-ade9-e2e52f6c8eb5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:34.044453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a108418f-fa55-4e2f-ade9-e2e52f6c8eb5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:34.047440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:34.055988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a108418f-fa55-4e2f-ade9-e2e52f6c8eb5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:34.063958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a108418f-fa55-4e2f-ade9-e2e52f6c8eb5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:34.065101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a108418f-fa55-4e2f-ade9-e2e52f6c8eb5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:34.066999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a108418f-fa55-4e2f-ade9-e2e52f6c8eb5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:34.067295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-16565cd6-17ad-4d95-8725-468ddf1487de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:34.068360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-16565cd6-17ad-4d95-8725-468ddf1487de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:34.073749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a108418f-fa55-4e2f-ade9-e2e52f6c8eb5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:34.073749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a108418f-fa55-4e2f-ade9-e2e52f6c8eb5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:34.081261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-16565cd6-17ad-4d95-8725-468ddf1487de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:34.082099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-16565cd6-17ad-4d95-8725-468ddf1487de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:34.083200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-16565cd6-17ad-4d95-8725-468ddf1487de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:34.084267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-16565cd6-17ad-4d95-8725-468ddf1487de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:34.085063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-16565cd6-17ad-4d95-8725-468ddf1487de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:34.085955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-16565cd6-17ad-4d95-8725-468ddf1487de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:34.320193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a108418f-fa55-4e2f-ade9-e2e52f6c8eb5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:34.325471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-16565cd6-17ad-4d95-8725-468ddf1487de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:34.334249 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a108418f-fa55-4e2f-ade9-e2e52f6c8eb5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1652 microversion: 2.1 time: 0.296354 Sep 06 11:23:34.335383 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2958/5863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:34 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1652 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:34.341397 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-16565cd6-17ad-4d95-8725-468ddf1487de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 200 len: 1317 microversion: 2.1 time: 0.279759 Sep 06 11:23:34.342559 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2906/5864] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:34 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:23:34.373140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c4f10598-5900-4e86-961c-c8e953695685 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:34.379537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4f10598-5900-4e86-961c-c8e953695685 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:34.380033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4f10598-5900-4e86-961c-c8e953695685 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:34.380477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4f10598-5900-4e86-961c-c8e953695685 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:34.404259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c4f10598-5900-4e86-961c-c8e953695685 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Going to try to start instance {{(pid=140876) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 11:23:34.502706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:34.568510 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c4f10598-5900-4e86-961c-c8e953695685 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "POST /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/action" status: 202 len: 0 microversion: 2.1 time: 0.198994 Sep 06 11:23:34.569307 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2959/5865] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:23:34 2022] POST /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:23:34.582323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-980cbf8a-ec81-4405-aca4-c354ad908775 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:34.584500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-980cbf8a-ec81-4405-aca4-c354ad908775 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:34.591735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-980cbf8a-ec81-4405-aca4-c354ad908775 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:34.592386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-980cbf8a-ec81-4405-aca4-c354ad908775 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:34.593015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-980cbf8a-ec81-4405-aca4-c354ad908775 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:34.593906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-980cbf8a-ec81-4405-aca4-c354ad908775 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:34.594717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-980cbf8a-ec81-4405-aca4-c354ad908775 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:34.595599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-980cbf8a-ec81-4405-aca4-c354ad908775 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:34.732889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-672493f4-639a-4a24-a66b-7fcfcd98b422 req-5c43899e-2d34-46d1-b054-7cd828891f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8a67a-5ba2-4638-a5d6-2590bd931000", "name": "network-vif-plugged", "status": "completed", "tag": "59b6ff01-b4fa-4320-995a-76014ccf8fc6"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:34.782242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-672493f4-639a-4a24-a66b-7fcfcd98b422 req-5c43899e-2d34-46d1-b054-7cd828891f59 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:34.787270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-672493f4-639a-4a24-a66b-7fcfcd98b422 req-5c43899e-2d34-46d1-b054-7cd828891f59 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:34.787927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-672493f4-639a-4a24-a66b-7fcfcd98b422 req-5c43899e-2d34-46d1-b054-7cd828891f59 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:34.823043 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-672493f4-639a-4a24-a66b-7fcfcd98b422 req-5c43899e-2d34-46d1-b054-7cd828891f59 service nova] Creating event network-vif-plugged:59b6ff01-b4fa-4320-995a-76014ccf8fc6 for instance 1af8a67a-5ba2-4638-a5d6-2590bd931000 on nch1-master-1 Sep 06 11:23:34.837120 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-672493f4-639a-4a24-a66b-7fcfcd98b422 req-5c43899e-2d34-46d1-b054-7cd828891f59 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110768 Sep 06 11:23:34.838689 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2960/5866] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:23:34.854990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-980cbf8a-ec81-4405-aca4-c354ad908775 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:34.861082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:34.863519 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-980cbf8a-ec81-4405-aca4-c354ad908775 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1661 microversion: 2.1 time: 0.287853 Sep 06 11:23:34.864106 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2907/5867] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:34 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1661 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:35.370420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dab07a3e-a701-4f65-8a3c-71b1052fdc3f tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:35.371826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dab07a3e-a701-4f65-8a3c-71b1052fdc3f tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:35.380409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dab07a3e-a701-4f65-8a3c-71b1052fdc3f tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:35.381182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dab07a3e-a701-4f65-8a3c-71b1052fdc3f tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:35.381795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dab07a3e-a701-4f65-8a3c-71b1052fdc3f tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:35.382691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dab07a3e-a701-4f65-8a3c-71b1052fdc3f tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:35.383349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dab07a3e-a701-4f65-8a3c-71b1052fdc3f tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:35.383949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dab07a3e-a701-4f65-8a3c-71b1052fdc3f tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:35.574298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dab07a3e-a701-4f65-8a3c-71b1052fdc3f tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:35.589191 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dab07a3e-a701-4f65-8a3c-71b1052fdc3f tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 200 len: 1317 microversion: 2.1 time: 0.222909 Sep 06 11:23:35.590397 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2961/5868] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:35 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:35.854530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1a0ac089-0b26-4978-bf20-20c18f360542 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:35.861422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1a0ac089-0b26-4978-bf20-20c18f360542 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:35.874247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a0ac089-0b26-4978-bf20-20c18f360542 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:35.874877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a0ac089-0b26-4978-bf20-20c18f360542 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:35.875480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a0ac089-0b26-4978-bf20-20c18f360542 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:35.876305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a0ac089-0b26-4978-bf20-20c18f360542 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:35.879287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a0ac089-0b26-4978-bf20-20c18f360542 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:35.880280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a0ac089-0b26-4978-bf20-20c18f360542 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:35.894326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-441a0640-8719-41b9-a231-27223ff62d21 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:35.895857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-441a0640-8719-41b9-a231-27223ff62d21 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:35.907876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-441a0640-8719-41b9-a231-27223ff62d21 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:35.910254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-441a0640-8719-41b9-a231-27223ff62d21 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:35.911312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-441a0640-8719-41b9-a231-27223ff62d21 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:35.912928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-441a0640-8719-41b9-a231-27223ff62d21 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:35.913956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-441a0640-8719-41b9-a231-27223ff62d21 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:35.914892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-441a0640-8719-41b9-a231-27223ff62d21 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:35.925362 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1a0ac089-0b26-4978-bf20-20c18f360542 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.080383 Sep 06 11:23:35.926201 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2908/5869] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 6 11:23:35 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:36.036948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-10bcd642-12f2-4a8c-a1ae-5d90e7fd7ce0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:36.037758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-10bcd642-12f2-4a8c-a1ae-5d90e7fd7ce0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:36.044023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10bcd642-12f2-4a8c-a1ae-5d90e7fd7ce0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:36.044889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10bcd642-12f2-4a8c-a1ae-5d90e7fd7ce0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:36.045335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10bcd642-12f2-4a8c-a1ae-5d90e7fd7ce0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:36.046278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10bcd642-12f2-4a8c-a1ae-5d90e7fd7ce0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:36.046910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10bcd642-12f2-4a8c-a1ae-5d90e7fd7ce0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:36.047547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10bcd642-12f2-4a8c-a1ae-5d90e7fd7ce0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:36.077410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-10bcd642-12f2-4a8c-a1ae-5d90e7fd7ce0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:23:36.383660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-441a0640-8719-41b9-a231-27223ff62d21 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:36.392596 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-441a0640-8719-41b9-a231-27223ff62d21 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1661 microversion: 2.1 time: 0.506433 Sep 06 11:23:36.393199 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2962/5870] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:35 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1661 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:36.394200 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-10bcd642-12f2-4a8c-a1ae-5d90e7fd7ce0 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 204 len: 0 microversion: 2.20 time: 0.360122 Sep 06 11:23:36.395245 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2909/5871] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:23:36 2022] DELETE /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 06 11:23:36.410677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3706558d-42c7-4d01-86e8-76958924365e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:36.411682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3706558d-42c7-4d01-86e8-76958924365e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:36.421877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3706558d-42c7-4d01-86e8-76958924365e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:36.422693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3706558d-42c7-4d01-86e8-76958924365e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:36.423456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3706558d-42c7-4d01-86e8-76958924365e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:36.424673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3706558d-42c7-4d01-86e8-76958924365e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:36.425971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3706558d-42c7-4d01-86e8-76958924365e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:36.426668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3706558d-42c7-4d01-86e8-76958924365e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:36.595742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3706558d-42c7-4d01-86e8-76958924365e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:36.604753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3706558d-42c7-4d01-86e8-76958924365e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:36.606293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3706558d-42c7-4d01-86e8-76958924365e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:36.609431 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3706558d-42c7-4d01-86e8-76958924365e tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1725 microversion: 2.20 time: 0.205842 Sep 06 11:23:36.610024 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2963/5872] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:23:36 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:23:36.615962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c1ac815-4b2d-4f12-8d0c-b27599705713 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:36.618923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1c1ac815-4b2d-4f12-8d0c-b27599705713 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:36.623172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c1ac815-4b2d-4f12-8d0c-b27599705713 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:36.624128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c1ac815-4b2d-4f12-8d0c-b27599705713 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:36.624580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c1ac815-4b2d-4f12-8d0c-b27599705713 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:36.625299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c1ac815-4b2d-4f12-8d0c-b27599705713 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:36.625765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c1ac815-4b2d-4f12-8d0c-b27599705713 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:36.626203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c1ac815-4b2d-4f12-8d0c-b27599705713 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:36.794678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1c1ac815-4b2d-4f12-8d0c-b27599705713 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:36.808001 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1c1ac815-4b2d-4f12-8d0c-b27599705713 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 200 len: 1503 microversion: 2.1 time: 0.197299 Sep 06 11:23:36.815050 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2910/5873] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:36 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:36.831720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-90a7b43e-4814-45bd-9e54-be2865a782d9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:36.836108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-90a7b43e-4814-45bd-9e54-be2865a782d9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 5e864933-832c-4089-b29e-c5ce83a2c005] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:36.839166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90a7b43e-4814-45bd-9e54-be2865a782d9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:36.839666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90a7b43e-4814-45bd-9e54-be2865a782d9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:36.840113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90a7b43e-4814-45bd-9e54-be2865a782d9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:36.840876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90a7b43e-4814-45bd-9e54-be2865a782d9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:36.841341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90a7b43e-4814-45bd-9e54-be2865a782d9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:36.841778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90a7b43e-4814-45bd-9e54-be2865a782d9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:36.908511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-2635e11f-0793-4efb-8492-083dde719008 req-559f0dc8-2b59-4326-9251-700d69c94563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e864933-832c-4089-b29e-c5ce83a2c005", "name": "network-vif-plugged", "status": "completed", "tag": "b7e2c7d9-f276-4c72-b6b5-0d6c2b3ea46a"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:36.926145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2635e11f-0793-4efb-8492-083dde719008 req-559f0dc8-2b59-4326-9251-700d69c94563 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:36.926736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2635e11f-0793-4efb-8492-083dde719008 req-559f0dc8-2b59-4326-9251-700d69c94563 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:36.927453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2635e11f-0793-4efb-8492-083dde719008 req-559f0dc8-2b59-4326-9251-700d69c94563 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:36.953146 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-2635e11f-0793-4efb-8492-083dde719008 req-559f0dc8-2b59-4326-9251-700d69c94563 service nova] Creating event network-vif-plugged:b7e2c7d9-f276-4c72-b6b5-0d6c2b3ea46a for instance 5e864933-832c-4089-b29e-c5ce83a2c005 on nch2-master-1 Sep 06 11:23:36.962262 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-2635e11f-0793-4efb-8492-083dde719008 req-559f0dc8-2b59-4326-9251-700d69c94563 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065117 Sep 06 11:23:36.963464 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2911/5874] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:37.008960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-90a7b43e-4814-45bd-9e54-be2865a782d9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:37.021494 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-90a7b43e-4814-45bd-9e54-be2865a782d9 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005" status: 200 len: 1317 microversion: 2.1 time: 0.194132 Sep 06 11:23:37.022428 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2964/5875] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:36 2022] GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:37.418491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d417e6f0-3ae6-4c5b-baae-3731d743a9a4 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:37.419232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d417e6f0-3ae6-4c5b-baae-3731d743a9a4 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:37.425533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d417e6f0-3ae6-4c5b-baae-3731d743a9a4 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:37.426023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d417e6f0-3ae6-4c5b-baae-3731d743a9a4 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:37.426470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d417e6f0-3ae6-4c5b-baae-3731d743a9a4 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:37.427245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d417e6f0-3ae6-4c5b-baae-3731d743a9a4 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:37.427711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d417e6f0-3ae6-4c5b-baae-3731d743a9a4 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:37.428152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d417e6f0-3ae6-4c5b-baae-3731d743a9a4 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:37.576372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d417e6f0-3ae6-4c5b-baae-3731d743a9a4 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:37.585179 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d417e6f0-3ae6-4c5b-baae-3731d743a9a4 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1665 microversion: 2.1 time: 0.170951 Sep 06 11:23:37.585774 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2912/5876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:37 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1665 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:37.638455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-75caeee4-e79c-42b5-8235-8582dab0006d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:37.639396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-75caeee4-e79c-42b5-8235-8582dab0006d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:37.647237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75caeee4-e79c-42b5-8235-8582dab0006d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:37.647739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75caeee4-e79c-42b5-8235-8582dab0006d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:37.648191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75caeee4-e79c-42b5-8235-8582dab0006d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:37.648908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75caeee4-e79c-42b5-8235-8582dab0006d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:37.649373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75caeee4-e79c-42b5-8235-8582dab0006d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:37.649814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-75caeee4-e79c-42b5-8235-8582dab0006d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:37.793731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-75caeee4-e79c-42b5-8235-8582dab0006d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:37.802695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-75caeee4-e79c-42b5-8235-8582dab0006d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:37.804319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-75caeee4-e79c-42b5-8235-8582dab0006d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:37.805609 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-75caeee4-e79c-42b5-8235-8582dab0006d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1725 microversion: 2.20 time: 0.171837 Sep 06 11:23:37.806286 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2965/5877] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:23:37 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:23:38.053469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-919871f1-ffbd-4f1d-807e-ec10291d8ecb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:38.054100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-919871f1-ffbd-4f1d-807e-ec10291d8ecb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 5e864933-832c-4089-b29e-c5ce83a2c005] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:38.061987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-919871f1-ffbd-4f1d-807e-ec10291d8ecb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:38.062484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-919871f1-ffbd-4f1d-807e-ec10291d8ecb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:38.062936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-919871f1-ffbd-4f1d-807e-ec10291d8ecb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:38.063703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-919871f1-ffbd-4f1d-807e-ec10291d8ecb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:38.064170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-919871f1-ffbd-4f1d-807e-ec10291d8ecb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:38.064604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-919871f1-ffbd-4f1d-807e-ec10291d8ecb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:38.263173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-919871f1-ffbd-4f1d-807e-ec10291d8ecb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:38.277797 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-919871f1-ffbd-4f1d-807e-ec10291d8ecb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005" status: 200 len: 1317 microversion: 2.1 time: 0.228213 Sep 06 11:23:38.278814 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2913/5878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:38 2022] GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:38.798024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-cdc9cf0e-49bf-429e-ad0e-12da27879fac req-6d88757a-58d9-4acc-a60e-82729f9e2dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc42cdc-6687-4ecd-b60a-ea23f69f50b2", "name": "network-vif-deleted", "tag": "09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:38.810014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cdc9cf0e-49bf-429e-ad0e-12da27879fac req-6d88757a-58d9-4acc-a60e-82729f9e2dc3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:38.814305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cdc9cf0e-49bf-429e-ad0e-12da27879fac req-6d88757a-58d9-4acc-a60e-82729f9e2dc3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:38.814305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cdc9cf0e-49bf-429e-ad0e-12da27879fac req-6d88757a-58d9-4acc-a60e-82729f9e2dc3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:38.833366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e7967d0-73da-42c1-bd08-af0e2d1ef485 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:38.834179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3e7967d0-73da-42c1-bd08-af0e2d1ef485 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:38.839232 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-cdc9cf0e-49bf-429e-ad0e-12da27879fac req-6d88757a-58d9-4acc-a60e-82729f9e2dc3 service nova] Creating event network-vif-deleted:09aa4a3b-dd8c-44a3-a8cb-8b665af0ef17 for instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 on nch1-master-1 Sep 06 11:23:38.843156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e7967d0-73da-42c1-bd08-af0e2d1ef485 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:38.843691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e7967d0-73da-42c1-bd08-af0e2d1ef485 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:38.844175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e7967d0-73da-42c1-bd08-af0e2d1ef485 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:38.844872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e7967d0-73da-42c1-bd08-af0e2d1ef485 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:38.845363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e7967d0-73da-42c1-bd08-af0e2d1ef485 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:38.846625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e7967d0-73da-42c1-bd08-af0e2d1ef485 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:38.848544 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-cdc9cf0e-49bf-429e-ad0e-12da27879fac req-6d88757a-58d9-4acc-a60e-82729f9e2dc3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053922 Sep 06 11:23:38.854407 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2966/5879] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:23:38.928658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3e7967d0-73da-42c1-bd08-af0e2d1ef485 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:38.938754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3e7967d0-73da-42c1-bd08-af0e2d1ef485 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:38.940444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3e7967d0-73da-42c1-bd08-af0e2d1ef485 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:38.943300 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3e7967d0-73da-42c1-bd08-af0e2d1ef485 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1657 microversion: 2.20 time: 0.114521 Sep 06 11:23:38.944062 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2914/5880] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:23:38 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1657 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:23:39.305964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6da4eab8-7211-4f67-9943-fb058a7aa3de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:39.306688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6da4eab8-7211-4f67-9943-fb058a7aa3de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 5e864933-832c-4089-b29e-c5ce83a2c005] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:39.321227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6da4eab8-7211-4f67-9943-fb058a7aa3de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:39.321990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6da4eab8-7211-4f67-9943-fb058a7aa3de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:39.322777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6da4eab8-7211-4f67-9943-fb058a7aa3de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:39.324459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6da4eab8-7211-4f67-9943-fb058a7aa3de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:39.325224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6da4eab8-7211-4f67-9943-fb058a7aa3de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:39.325937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6da4eab8-7211-4f67-9943-fb058a7aa3de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:39.505354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6da4eab8-7211-4f67-9943-fb058a7aa3de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:39.514574 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6da4eab8-7211-4f67-9943-fb058a7aa3de tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005" status: 200 len: 1503 microversion: 2.1 time: 0.213031 Sep 06 11:23:39.515637 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2967/5881] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:39 2022] GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005 => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:23:39.554406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ae705c2f-90cf-45fe-b604-9b37da26d236 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:39.555611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ae705c2f-90cf-45fe-b604-9b37da26d236 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 5e864933-832c-4089-b29e-c5ce83a2c005] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:39.568693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae705c2f-90cf-45fe-b604-9b37da26d236 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:39.569332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae705c2f-90cf-45fe-b604-9b37da26d236 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:39.569894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae705c2f-90cf-45fe-b604-9b37da26d236 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:39.570754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae705c2f-90cf-45fe-b604-9b37da26d236 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:39.571362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae705c2f-90cf-45fe-b604-9b37da26d236 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:39.572798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ae705c2f-90cf-45fe-b604-9b37da26d236 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:39.607922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ae705c2f-90cf-45fe-b604-9b37da26d236 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 5e864933-832c-4089-b29e-c5ce83a2c005] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:23:39.970011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:39.970640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:39.978378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:39.978876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:39.979439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:39.980166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:39.980637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:39.981135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:40.015445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:40.015939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:40.016385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:40.016846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lazy-loading 'fault' on Instance uuid 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:23:40.057585 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ae705c2f-90cf-45fe-b604-9b37da26d236 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005" status: 204 len: 0 microversion: 2.1 time: 0.510674 Sep 06 11:23:40.058204 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2915/5882] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:23:39 2022] DELETE /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:23:40.068367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2691f7cc-99be-4241-bce3-5a7ad4568e42 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:40.068992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2691f7cc-99be-4241-bce3-5a7ad4568e42 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:40.082197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2691f7cc-99be-4241-bce3-5a7ad4568e42 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:40.086264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:40.086429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2691f7cc-99be-4241-bce3-5a7ad4568e42 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:40.086429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2691f7cc-99be-4241-bce3-5a7ad4568e42 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:40.086429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2691f7cc-99be-4241-bce3-5a7ad4568e42 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:40.086429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2691f7cc-99be-4241-bce3-5a7ad4568e42 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:40.086429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2691f7cc-99be-4241-bce3-5a7ad4568e42 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:40.092287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:40.094936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226a6d965ff14deebdead8370fc00d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b360e0ffe64c3bb5897486a18eda10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:40.097764 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fb5cab8c-d0fb-4db5-9a4e-c4ea6c73303d tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 200 len: 1371 microversion: 2.20 time: 0.130824 Sep 06 11:23:40.098695 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2968/5883] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:23:39 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 1371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:23:40.120579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2691f7cc-99be-4241-bce3-5a7ad4568e42 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:23:40.392246 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2691f7cc-99be-4241-bce3-5a7ad4568e42 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 204 len: 0 microversion: 2.1 time: 0.328693 Sep 06 11:23:40.393042 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2916/5884] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:23:40 2022] DELETE /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:23:40.403295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-93270f06-c617-4957-9091-0ab4de2356f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:40.403932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-93270f06-c617-4957-9091-0ab4de2356f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 5e864933-832c-4089-b29e-c5ce83a2c005] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:40.412981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93270f06-c617-4957-9091-0ab4de2356f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:40.413559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93270f06-c617-4957-9091-0ab4de2356f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:40.414057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93270f06-c617-4957-9091-0ab4de2356f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:40.414842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93270f06-c617-4957-9091-0ab4de2356f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:40.415531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93270f06-c617-4957-9091-0ab4de2356f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:40.423854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93270f06-c617-4957-9091-0ab4de2356f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:40.582677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-93270f06-c617-4957-9091-0ab4de2356f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:40.590788 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-93270f06-c617-4957-9091-0ab4de2356f1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005" status: 200 len: 1509 microversion: 2.1 time: 0.191891 Sep 06 11:23:40.591462 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2969/5885] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:40 2022] GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005 => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:41.124867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-decd5035-7500-4a28-818a-a39f0bcc7c99 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:41.125635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-decd5035-7500-4a28-818a-a39f0bcc7c99 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:41.134571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-decd5035-7500-4a28-818a-a39f0bcc7c99 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:41.135124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-decd5035-7500-4a28-818a-a39f0bcc7c99 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:41.135590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-decd5035-7500-4a28-818a-a39f0bcc7c99 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:41.136329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-decd5035-7500-4a28-818a-a39f0bcc7c99 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:41.136802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-decd5035-7500-4a28-818a-a39f0bcc7c99 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:41.137306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-decd5035-7500-4a28-818a-a39f0bcc7c99 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-decd5035-7500-4a28-818a-a39f0bcc7c99 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] HTTP exception thrown: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-decd5035-7500-4a28-818a-a39f0bcc7c99 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Request method failure captured: Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 HTTP/1.1 Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyx0ep2jwyMGFHZWia3KaoEmlk5l2jVQYTPyexJM7THFWCZi2a1_Q4vAu7rLGs0sa0YDIbPopi4HHUNe6_9xKgcOwAeda5IRW56kmHaO8_GJsn9808ZfUBMwRB9kHC6siz340BgPued6Hzxlm6DA4V2cJh2Lwl31fFPlMdzXqd5qY_M Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 75b360e0ffe64c3bb5897486a18eda10 Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75b360e0ffe64c3bb5897486a18eda10"}]}] Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 75b360e0ffe64c3bb5897486a18eda10 Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeShelveTestJSON-1383535698-project Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 226a6d965ff14deebdead8370fc00d3e Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1383535698-project Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '9cc42cdc-6687-4ecd-b60a-ea23f69f50b2'} Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:23:41.155457 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-decd5035-7500-4a28-818a-a39f0bcc7c99 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Returning 404 to user: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-decd5035-7500-4a28-818a-a39f0bcc7c99 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 404 len: 111 microversion: 2.20 time: 0.036776 Sep 06 11:23:41.160301 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2917/5886] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:23:41 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:23:41.166574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9ea0b4e3-f3e6-4ad5-9df6-c95e74613257 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '.version_select at 0x7f90f8be49d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:41.261460 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9ea0b4e3-f3e6-4ad5-9df6-c95e74613257 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-188969257" status: 204 len: 0 microversion: 2.20 time: 0.098773 Sep 06 11:23:41.262064 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2970/5887] 10.222.0.20 () {60 vars in 1259 bytes} [Tue Sep 6 11:23:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-188969257 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 11:23:41.627029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a5ba0eff-88db-493b-b838-3d49b776a583 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:41.632694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a5ba0eff-88db-493b-b838-3d49b776a583 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 5e864933-832c-4089-b29e-c5ce83a2c005] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:41.647996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5ba0eff-88db-493b-b838-3d49b776a583 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:41.649250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5ba0eff-88db-493b-b838-3d49b776a583 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:41.650029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5ba0eff-88db-493b-b838-3d49b776a583 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:41.651383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5ba0eff-88db-493b-b838-3d49b776a583 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:41.652433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5ba0eff-88db-493b-b838-3d49b776a583 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:41.653236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a5ba0eff-88db-493b-b838-3d49b776a583 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:41.969199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a5ba0eff-88db-493b-b838-3d49b776a583 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:41.981813 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a5ba0eff-88db-493b-b838-3d49b776a583 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005" status: 200 len: 1509 microversion: 2.1 time: 0.361884 Sep 06 11:23:41.995497 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2918/5888] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:41 2022] GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005 => generated 1509 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:42.779086 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-0721a317-4c8f-4eb7-9693-9a239b7afcbc req-601040c7-50de-42d1-a153-37ccfd0ba961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e864933-832c-4089-b29e-c5ce83a2c005", "name": "network-vif-deleted", "tag": "b7e2c7d9-f276-4c72-b6b5-0d6c2b3ea46a"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:42.790452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0721a317-4c8f-4eb7-9693-9a239b7afcbc req-601040c7-50de-42d1-a153-37ccfd0ba961 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:42.790951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0721a317-4c8f-4eb7-9693-9a239b7afcbc req-601040c7-50de-42d1-a153-37ccfd0ba961 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:42.791677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0721a317-4c8f-4eb7-9693-9a239b7afcbc req-601040c7-50de-42d1-a153-37ccfd0ba961 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:42.803740 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-0721a317-4c8f-4eb7-9693-9a239b7afcbc req-601040c7-50de-42d1-a153-37ccfd0ba961 service nova] Creating event network-vif-deleted:b7e2c7d9-f276-4c72-b6b5-0d6c2b3ea46a for instance 5e864933-832c-4089-b29e-c5ce83a2c005 on nch2-master-1 Sep 06 11:23:42.808794 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-0721a317-4c8f-4eb7-9693-9a239b7afcbc req-601040c7-50de-42d1-a153-37ccfd0ba961 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034584 Sep 06 11:23:42.809430 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2971/5889] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:43.012601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-595c5631-20f4-4f8b-827e-dcc0afe0ebe1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:43.013883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-595c5631-20f4-4f8b-827e-dcc0afe0ebe1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 5e864933-832c-4089-b29e-c5ce83a2c005] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:43.022596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-595c5631-20f4-4f8b-827e-dcc0afe0ebe1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:43.023466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-595c5631-20f4-4f8b-827e-dcc0afe0ebe1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:43.024288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-595c5631-20f4-4f8b-827e-dcc0afe0ebe1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:43.028825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-595c5631-20f4-4f8b-827e-dcc0afe0ebe1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:43.029022 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-595c5631-20f4-4f8b-827e-dcc0afe0ebe1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:43.029844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-595c5631-20f4-4f8b-827e-dcc0afe0ebe1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:43.114750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-595c5631-20f4-4f8b-827e-dcc0afe0ebe1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3732e9811bcf44749081ff7049a2c0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18c44a020d9419886827314045b3200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:23:43.122884 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-595c5631-20f4-4f8b-827e-dcc0afe0ebe1 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005" status: 200 len: 1302 microversion: 2.1 time: 0.117981 Sep 06 11:23:43.127367 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2919/5890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:43 2022] GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005 => generated 1302 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:23:44.147712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f1fd4dd-0cd1-4f19-a1fa-9c090459c6bb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:44.148441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1f1fd4dd-0cd1-4f19-a1fa-9c090459c6bb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 5e864933-832c-4089-b29e-c5ce83a2c005] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:44.157649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f1fd4dd-0cd1-4f19-a1fa-9c090459c6bb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:44.158065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f1fd4dd-0cd1-4f19-a1fa-9c090459c6bb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:44.158897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f1fd4dd-0cd1-4f19-a1fa-9c090459c6bb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:44.159741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f1fd4dd-0cd1-4f19-a1fa-9c090459c6bb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:44.160301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f1fd4dd-0cd1-4f19-a1fa-9c090459c6bb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:44.161147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1f1fd4dd-0cd1-4f19-a1fa-9c090459c6bb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:44.178015 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-1f1fd4dd-0cd1-4f19-a1fa-9c090459c6bb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] HTTP exception thrown: Instance 5e864933-832c-4089-b29e-c5ce83a2c005 could not be found. Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f1fd4dd-0cd1-4f19-a1fa-9c090459c6bb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Request method failure captured: Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005 HTTP/1.1 Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy2OIg_Qe6Cblcc_NzX7S2oild3nP7YfrRFYY8jj_qb90Tv0WDgtcOayvwsaVpvDIpoIn4vf2UumCiYeRIoM_Y6A2DFwx6_G05DuQZZprE08A6dWOmW_15DYHPSRotEsbQYRds_bS4tLvL506Vaz_nYDwNVyXDVmIQ9FP_b0bzO3_1I Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: f18c44a020d9419886827314045b3200 Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-MultipleCreateTestJSON-205779794 Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f18c44a020d9419886827314045b3200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f18c44a020d9419886827314045b3200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f18c44a020d9419886827314045b3200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f18c44a020d9419886827314045b3200"}]}] Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-MultipleCreateTestJSON-205779794 Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: f18c44a020d9419886827314045b3200 Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-MultipleCreateTestJSON-205779794 Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-MultipleCreateTestJSON-205779794-project Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3732e9811bcf44749081ff7049a2c0df Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-MultipleCreateTestJSON-205779794-project Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 5e864933-832c-4089-b29e-c5ce83a2c005 could not be found. Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '5e864933-832c-4089-b29e-c5ce83a2c005'} Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e864933-832c-4089-b29e-c5ce83a2c005 could not be found. Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e864933-832c-4089-b29e-c5ce83a2c005 could not be found. Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:23:44.179857 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:23:44.184002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:44.184002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:23:44.184002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:23:44.184002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:23:44.184002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:23:44.184002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e864933-832c-4089-b29e-c5ce83a2c005 could not be found. Sep 06 11:23:44.184002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:23:44.185423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f1fd4dd-0cd1-4f19-a1fa-9c090459c6bb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Returning 404 to user: Instance 5e864933-832c-4089-b29e-c5ce83a2c005 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:23:44.186385 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1f1fd4dd-0cd1-4f19-a1fa-9c090459c6bb tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005" status: 404 len: 111 microversion: 2.1 time: 0.043948 Sep 06 11:23:44.187151 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2972/5891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:44 2022] GET /compute/v2.1/servers/5e864933-832c-4089-b29e-c5ce83a2c005 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:23:44.197760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b128e69-7369-4ded-8f12-8fb992885437 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:44.203240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2b128e69-7369-4ded-8f12-8fb992885437 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] [instance: 1af8a67a-5ba2-4638-a5d6-2590bd931000] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:44.205300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b128e69-7369-4ded-8f12-8fb992885437 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:44.205822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b128e69-7369-4ded-8f12-8fb992885437 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:44.206299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b128e69-7369-4ded-8f12-8fb992885437 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:44.207003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b128e69-7369-4ded-8f12-8fb992885437 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:44.207618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b128e69-7369-4ded-8f12-8fb992885437 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:44.208055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b128e69-7369-4ded-8f12-8fb992885437 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:44.221599 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-2b128e69-7369-4ded-8f12-8fb992885437 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] HTTP exception thrown: Instance 1af8a67a-5ba2-4638-a5d6-2590bd931000 could not be found. Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b128e69-7369-4ded-8f12-8fb992885437 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Request method failure captured: Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 HTTP/1.1 Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy2OIg_Qe6Cblcc_NzX7S2oild3nP7YfrRFYY8jj_qb90Tv0WDgtcOayvwsaVpvDIpoIn4vf2UumCiYeRIoM_Y6A2DFwx6_G05DuQZZprE08A6dWOmW_15DYHPSRotEsbQYRds_bS4tLvL506Vaz_nYDwNVyXDVmIQ9FP_b0bzO3_1I Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: f18c44a020d9419886827314045b3200 Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-MultipleCreateTestJSON-205779794 Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f18c44a020d9419886827314045b3200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f18c44a020d9419886827314045b3200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f18c44a020d9419886827314045b3200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f18c44a020d9419886827314045b3200"}]}] Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-MultipleCreateTestJSON-205779794 Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: f18c44a020d9419886827314045b3200 Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-MultipleCreateTestJSON-205779794 Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-MultipleCreateTestJSON-205779794-project Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3732e9811bcf44749081ff7049a2c0df Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-MultipleCreateTestJSON-205779794-project Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 1af8a67a-5ba2-4638-a5d6-2590bd931000 could not be found. Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '1af8a67a-5ba2-4638-a5d6-2590bd931000'} Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af8a67a-5ba2-4638-a5d6-2590bd931000 could not be found. Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af8a67a-5ba2-4638-a5d6-2590bd931000 could not be found. Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:23:44.223228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:44.232325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:44.232325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:23:44.232325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:23:44.232325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:23:44.232325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:23:44.232325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af8a67a-5ba2-4638-a5d6-2590bd931000 could not be found. Sep 06 11:23:44.232325 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:44.232325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b128e69-7369-4ded-8f12-8fb992885437 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] Returning 404 to user: Instance 1af8a67a-5ba2-4638-a5d6-2590bd931000 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:23:44.232325 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b128e69-7369-4ded-8f12-8fb992885437 tempest-MultipleCreateTestJSON-205779794 tempest-MultipleCreateTestJSON-205779794-project] 10.222.0.20 "GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000" status: 404 len: 111 microversion: 2.1 time: 0.031329 Sep 06 11:23:44.232325 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2920/5892] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:23:44 2022] GET /compute/v2.1/servers/1af8a67a-5ba2-4638-a5d6-2590bd931000 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:23:44.825106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-7f360161-d322-4968-803e-de5ac5e80452 req-747f5808-5e7a-497d-a90b-d3011c9c7c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8a67a-5ba2-4638-a5d6-2590bd931000", "name": "network-vif-deleted", "tag": "59b6ff01-b4fa-4320-995a-76014ccf8fc6"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:44.837212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7f360161-d322-4968-803e-de5ac5e80452 req-747f5808-5e7a-497d-a90b-d3011c9c7c30 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:44.837717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7f360161-d322-4968-803e-de5ac5e80452 req-747f5808-5e7a-497d-a90b-d3011c9c7c30 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:44.842785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7f360161-d322-4968-803e-de5ac5e80452 req-747f5808-5e7a-497d-a90b-d3011c9c7c30 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:44.853286 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-7f360161-d322-4968-803e-de5ac5e80452 req-747f5808-5e7a-497d-a90b-d3011c9c7c30 service nova] Creating event network-vif-deleted:59b6ff01-b4fa-4320-995a-76014ccf8fc6 for instance 1af8a67a-5ba2-4638-a5d6-2590bd931000 on nch1-master-1 Sep 06 11:23:44.858763 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-7f360161-d322-4968-803e-de5ac5e80452 req-747f5808-5e7a-497d-a90b-d3011c9c7c30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037596 Sep 06 11:23:44.859432 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2973/5893] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:23:53.244413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ac5f6964-a7be-44d1-907f-dcd1b6f9eaea tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:53.244943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ac5f6964-a7be-44d1-907f-dcd1b6f9eaea tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:53.264937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:53.267794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac5f6964-a7be-44d1-907f-dcd1b6f9eaea tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:53.268605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac5f6964-a7be-44d1-907f-dcd1b6f9eaea tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:53.269164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac5f6964-a7be-44d1-907f-dcd1b6f9eaea tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:53.270429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac5f6964-a7be-44d1-907f-dcd1b6f9eaea tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:53.272888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac5f6964-a7be-44d1-907f-dcd1b6f9eaea tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:53.273381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac5f6964-a7be-44d1-907f-dcd1b6f9eaea tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:53.292946 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-ac5f6964-a7be-44d1-907f-dcd1b6f9eaea tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] HTTP exception thrown: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ac5f6964-a7be-44d1-907f-dcd1b6f9eaea tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Request method failure captured: Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 HTTP/1.1 Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyx0ep2jwyMGFHZWia3KaoEmlk5l2jVQYTPyexJM7THFWCZi2a1_Q4vAu7rLGs0sa0YDIbPopi4HHUNe6_9xKgcOwAeda5IRW56kmHaO8_GJsn9808ZfUBMwRB9kHC6siz340BgPued6Hzxlm6DA4V2cJh2Lwl31fFPlMdzXqd5qY_M Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 75b360e0ffe64c3bb5897486a18eda10 Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75b360e0ffe64c3bb5897486a18eda10"}]}] Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 75b360e0ffe64c3bb5897486a18eda10 Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeShelveTestJSON-1383535698-project Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 226a6d965ff14deebdead8370fc00d3e Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1383535698-project Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '9cc42cdc-6687-4ecd-b60a-ea23f69f50b2'} Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:23:53.303744 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ac5f6964-a7be-44d1-907f-dcd1b6f9eaea tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Returning 404 to user: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ac5f6964-a7be-44d1-907f-dcd1b6f9eaea tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 404 len: 111 microversion: 2.20 time: 0.060222 Sep 06 11:23:53.308654 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2921/5894] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:23:53 2022] DELETE /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:23:53.333872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e8f8fdb5-d9e8-4617-880a-0bbdbafbf847 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:23:53.336587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e8f8fdb5-d9e8-4617-880a-0bbdbafbf847 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:23:53.348378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8f8fdb5-d9e8-4617-880a-0bbdbafbf847 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:53.348899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8f8fdb5-d9e8-4617-880a-0bbdbafbf847 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:53.349416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8f8fdb5-d9e8-4617-880a-0bbdbafbf847 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:53.350170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8f8fdb5-d9e8-4617-880a-0bbdbafbf847 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:23:53.350644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8f8fdb5-d9e8-4617-880a-0bbdbafbf847 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:23:53.351135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e8f8fdb5-d9e8-4617-880a-0bbdbafbf847 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:23:53.367977 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-e8f8fdb5-d9e8-4617-880a-0bbdbafbf847 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] HTTP exception thrown: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e8f8fdb5-d9e8-4617-880a-0bbdbafbf847 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Request method failure captured: Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 HTTP/1.1 Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyx0ep2jwyMGFHZWia3KaoEmlk5l2jVQYTPyexJM7THFWCZi2a1_Q4vAu7rLGs0sa0YDIbPopi4HHUNe6_9xKgcOwAeda5IRW56kmHaO8_GJsn9808ZfUBMwRB9kHC6siz340BgPued6Hzxlm6DA4V2cJh2Lwl31fFPlMdzXqd5qY_M Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 75b360e0ffe64c3bb5897486a18eda10 Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75b360e0ffe64c3bb5897486a18eda10"}]}] Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 75b360e0ffe64c3bb5897486a18eda10 Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachVolumeShelveTestJSON-1383535698-project Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 226a6d965ff14deebdead8370fc00d3e Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1383535698-project Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '9cc42cdc-6687-4ecd-b60a-ea23f69f50b2'} Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:23:53.369985 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:23:53.374674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:23:53.374674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:23:53.374674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:23:53.374674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:23:53.374674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:23:53.374674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:23:53.374674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. Sep 06 11:23:53.374674 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:23:53.376234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e8f8fdb5-d9e8-4617-880a-0bbdbafbf847 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Returning 404 to user: Instance 9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:23:53.377219 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e8f8fdb5-d9e8-4617-880a-0bbdbafbf847 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2" status: 404 len: 111 microversion: 2.20 time: 0.068518 Sep 06 11:23:53.378034 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2974/5895] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:23:53 2022] GET /compute/v2.1/servers/9cc42cdc-6687-4ecd-b60a-ea23f69f50b2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:23:57.560171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-82053194-ad99-4e16-b490-91f8ce1e8300 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Action: 'create', calling method: .version_select at 0x7f90f3518820>, body: {"keypair": {"name": "tempest-keypair-242823716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4sZcDx+ik7oX+2VHeV4PN5eOE8XBGj0Vz+SAdmihBF99n45eTS1ZS/VVm5ljSeU475yvsDOr20RmHob1W6wxvuq1V7VkshimA7M3moAPSs1dCzF6JddKM76FmY7947pA=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:23:57.577766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-82053194-ad99-4e16-b490-91f8ce1e8300 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:23:57.583000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-82053194-ad99-4e16-b490-91f8ce1e8300 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for user 5458eb197e36456fb7785c8625ed3140 and project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:23:57.691708 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-82053194-ad99-4e16-b490-91f8ce1e8300 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.272715 Sep 06 11:23:57.692285 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2922/5896] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:23:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:24:00.350913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1044534463", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5afb62db-b7e6-4507-bc2c-7aab6bc880b4"}], "security_groups": [{"name": "tempest-securitygroup--1703886619"}], "key_name": "tempest-keypair-242823716", "user_data": "}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:24:00.361680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:00.476852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] validate_networks() for [('5afb62db-b7e6-4507-bc2c-7aab6bc880b4', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:24:00.958519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:24:00.958969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:24:00.959549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:24:00.960071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:24:00.960557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:24:00.970415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:00.970914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:00.971924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:00.973492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:00.973967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:00.974582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:01.001737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:24:01.007558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for user 5458eb197e36456fb7785c8625ed3140 and project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:24:01.021680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:24:01.024924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:24:01.150780 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8e37922d-952c-4278-a866-2f9c5f9e76b3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.804298 Sep 06 11:24:01.151911 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2975/5897] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:24:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:24:01.181528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-29a58710-d233-4b81-af07-430d12d7790e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:01.182223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-29a58710-d233-4b81-af07-430d12d7790e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:01.241977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-29a58710-d233-4b81-af07-430d12d7790e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:01.249987 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-29a58710-d233-4b81-af07-430d12d7790e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1241 microversion: 2.1 time: 0.090855 Sep 06 11:24:01.250583 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2923/5898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:01 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:02.273035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5b6148fa-f5b9-4cd1-af7e-ebee67a39291 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:02.273665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5b6148fa-f5b9-4cd1-af7e-ebee67a39291 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:02.281939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b6148fa-f5b9-4cd1-af7e-ebee67a39291 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:02.282430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b6148fa-f5b9-4cd1-af7e-ebee67a39291 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:02.282878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b6148fa-f5b9-4cd1-af7e-ebee67a39291 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:02.283623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b6148fa-f5b9-4cd1-af7e-ebee67a39291 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:02.284091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b6148fa-f5b9-4cd1-af7e-ebee67a39291 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:02.285020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b6148fa-f5b9-4cd1-af7e-ebee67a39291 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:02.347810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5b6148fa-f5b9-4cd1-af7e-ebee67a39291 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:02.355944 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5b6148fa-f5b9-4cd1-af7e-ebee67a39291 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1245 microversion: 2.1 time: 0.086909 Sep 06 11:24:02.356517 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2976/5899] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:02 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:03.380571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ce84fa40-0720-470e-8e16-8d5defc0e52f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:03.381199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ce84fa40-0720-470e-8e16-8d5defc0e52f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:03.384781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:03.390075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce84fa40-0720-470e-8e16-8d5defc0e52f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:03.395177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce84fa40-0720-470e-8e16-8d5defc0e52f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:03.395177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce84fa40-0720-470e-8e16-8d5defc0e52f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:03.395177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce84fa40-0720-470e-8e16-8d5defc0e52f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:03.395177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce84fa40-0720-470e-8e16-8d5defc0e52f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:03.395177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce84fa40-0720-470e-8e16-8d5defc0e52f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:03.458976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ce84fa40-0720-470e-8e16-8d5defc0e52f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:03.467653 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ce84fa40-0720-470e-8e16-8d5defc0e52f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1293 microversion: 2.1 time: 0.090382 Sep 06 11:24:03.467653 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2924/5900] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:03 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:04.492852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-db680d20-706e-4077-be5f-fcc74b2a1dc4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:04.494419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-db680d20-706e-4077-be5f-fcc74b2a1dc4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:04.501661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db680d20-706e-4077-be5f-fcc74b2a1dc4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:04.502169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db680d20-706e-4077-be5f-fcc74b2a1dc4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:04.502622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db680d20-706e-4077-be5f-fcc74b2a1dc4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:04.503991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db680d20-706e-4077-be5f-fcc74b2a1dc4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:04.510340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db680d20-706e-4077-be5f-fcc74b2a1dc4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:04.511261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db680d20-706e-4077-be5f-fcc74b2a1dc4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:04.676531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-db680d20-706e-4077-be5f-fcc74b2a1dc4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:04.685385 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-db680d20-706e-4077-be5f-fcc74b2a1dc4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1367 microversion: 2.1 time: 0.196659 Sep 06 11:24:04.685976 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2977/5901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:04 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:05.501723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-1b3184ba-5052-4170-8e9f-7bf323f6dc9d req-175ce9c2-ea19-4ead-8d3e-bfba986a91bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134fca7e-4cf9-4d85-a8b4-4f0b134e679c", "tag": "d2b8a411-ba5d-4c70-b518-4c22267202e8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:24:05.515126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1b3184ba-5052-4170-8e9f-7bf323f6dc9d req-175ce9c2-ea19-4ead-8d3e-bfba986a91bd service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:05.515906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1b3184ba-5052-4170-8e9f-7bf323f6dc9d req-175ce9c2-ea19-4ead-8d3e-bfba986a91bd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:05.516353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1b3184ba-5052-4170-8e9f-7bf323f6dc9d req-175ce9c2-ea19-4ead-8d3e-bfba986a91bd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:05.528061 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-1b3184ba-5052-4170-8e9f-7bf323f6dc9d req-175ce9c2-ea19-4ead-8d3e-bfba986a91bd service nova] Creating event network-changed:d2b8a411-ba5d-4c70-b518-4c22267202e8 for instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c on nch2-master-1 Sep 06 11:24:05.533133 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-1b3184ba-5052-4170-8e9f-7bf323f6dc9d req-175ce9c2-ea19-4ead-8d3e-bfba986a91bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042089 Sep 06 11:24:05.533790 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2925/5902] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:24:05.710993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-281c9f3f-0204-4720-9555-b5fc728b8290 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:05.711932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-281c9f3f-0204-4720-9555-b5fc728b8290 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:05.719359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-281c9f3f-0204-4720-9555-b5fc728b8290 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:05.719953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-281c9f3f-0204-4720-9555-b5fc728b8290 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:05.720406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-281c9f3f-0204-4720-9555-b5fc728b8290 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:05.721348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-281c9f3f-0204-4720-9555-b5fc728b8290 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:05.721820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-281c9f3f-0204-4720-9555-b5fc728b8290 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:05.722259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-281c9f3f-0204-4720-9555-b5fc728b8290 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:05.727430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=77 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:05.858824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-281c9f3f-0204-4720-9555-b5fc728b8290 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:05.867003 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-281c9f3f-0204-4720-9555-b5fc728b8290 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1367 microversion: 2.1 time: 0.160875 Sep 06 11:24:05.867600 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2978/5903] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:05 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:06.894721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-26492452-df55-44fc-bfbd-9cd5c682968d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:06.896123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-26492452-df55-44fc-bfbd-9cd5c682968d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:06.903605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26492452-df55-44fc-bfbd-9cd5c682968d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:06.904249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26492452-df55-44fc-bfbd-9cd5c682968d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:06.904702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26492452-df55-44fc-bfbd-9cd5c682968d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:06.905413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26492452-df55-44fc-bfbd-9cd5c682968d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:06.905893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26492452-df55-44fc-bfbd-9cd5c682968d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:06.906297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26492452-df55-44fc-bfbd-9cd5c682968d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:07.048280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-26492452-df55-44fc-bfbd-9cd5c682968d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:07.052646 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-26492452-df55-44fc-bfbd-9cd5c682968d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1367 microversion: 2.1 time: 0.162635 Sep 06 11:24:07.053230 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2926/5904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:06 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:07.498479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-775f991d-a005-4ed8-9363-f1f6e3b4e3c9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:07.499000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-775f991d-a005-4ed8-9363-f1f6e3b4e3c9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:07.507691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-775f991d-a005-4ed8-9363-f1f6e3b4e3c9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:07.508194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-775f991d-a005-4ed8-9363-f1f6e3b4e3c9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:07.508637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-775f991d-a005-4ed8-9363-f1f6e3b4e3c9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:07.509374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-775f991d-a005-4ed8-9363-f1f6e3b4e3c9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:07.509839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-775f991d-a005-4ed8-9363-f1f6e3b4e3c9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:07.510274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-775f991d-a005-4ed8-9363-f1f6e3b4e3c9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:07.528087 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-775f991d-a005-4ed8-9363-f1f6e3b4e3c9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] HTTP exception thrown: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-775f991d-a005-4ed8-9363-f1f6e3b4e3c9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Request method failure captured: Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 HTTP/1.1 Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFyx0ep2jwyMGFHZWia3KaoEmlk5l2jVQYTPyexJM7THFWCZi2a1_Q4vAu7rLGs0sa0YDIbPopi4HHUNe6_9xKgcOwAeda5IRW56kmHaO8_GJsn9808ZfUBMwRB9kHC6siz340BgPued6Hzxlm6DA4V2cJh2Lwl31fFPlMdzXqd5qY_M Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 75b360e0ffe64c3bb5897486a18eda10 Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75b360e0ffe64c3bb5897486a18eda10"}]}] Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 75b360e0ffe64c3bb5897486a18eda10 Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachVolumeShelveTestJSON-1383535698-project Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 226a6d965ff14deebdead8370fc00d3e Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1383535698-project Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '72fceff4-8a80-43f9-88f2-fd73e1eed3e3'} Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:24:07.529669 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-775f991d-a005-4ed8-9363-f1f6e3b4e3c9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Returning 404 to user: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-775f991d-a005-4ed8-9363-f1f6e3b4e3c9 tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "DELETE /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 404 len: 111 microversion: 2.20 time: 0.037056 Sep 06 11:24:07.534984 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2979/5905] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 11:24:07 2022] DELETE /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:24:07.540092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fba1cf33-2305-46be-b51f-cc1eef28e68f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:07.543857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fba1cf33-2305-46be-b51f-cc1eef28e68f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] [instance: 72fceff4-8a80-43f9-88f2-fd73e1eed3e3] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:07.547077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fba1cf33-2305-46be-b51f-cc1eef28e68f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:07.547567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fba1cf33-2305-46be-b51f-cc1eef28e68f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:07.548018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fba1cf33-2305-46be-b51f-cc1eef28e68f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:07.548720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fba1cf33-2305-46be-b51f-cc1eef28e68f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:07.549266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fba1cf33-2305-46be-b51f-cc1eef28e68f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:07.549625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fba1cf33-2305-46be-b51f-cc1eef28e68f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:07.565624 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-fba1cf33-2305-46be-b51f-cc1eef28e68f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] HTTP exception thrown: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fba1cf33-2305-46be-b51f-cc1eef28e68f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Request method failure captured: Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 HTTP/1.1 Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFyx0ep2jwyMGFHZWia3KaoEmlk5l2jVQYTPyexJM7THFWCZi2a1_Q4vAu7rLGs0sa0YDIbPopi4HHUNe6_9xKgcOwAeda5IRW56kmHaO8_GJsn9808ZfUBMwRB9kHC6siz340BgPued6Hzxlm6DA4V2cJh2Lwl31fFPlMdzXqd5qY_M Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 75b360e0ffe64c3bb5897486a18eda10 Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/75b360e0ffe64c3bb5897486a18eda10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75b360e0ffe64c3bb5897486a18eda10"}]}] Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 75b360e0ffe64c3bb5897486a18eda10 Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1383535698 Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeShelveTestJSON-1383535698-project Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 226a6d965ff14deebdead8370fc00d3e Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1383535698-project Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '72fceff4-8a80-43f9-88f2-fd73e1eed3e3'} Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:24:07.568084 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:24:07.573645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:24:07.573645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:24:07.573645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:24:07.573645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:24:07.573645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:24:07.573645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:24:07.573645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. Sep 06 11:24:07.573645 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:24:07.573645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fba1cf33-2305-46be-b51f-cc1eef28e68f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] Returning 404 to user: Instance 72fceff4-8a80-43f9-88f2-fd73e1eed3e3 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:24:07.573645 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fba1cf33-2305-46be-b51f-cc1eef28e68f tempest-AttachVolumeShelveTestJSON-1383535698 tempest-AttachVolumeShelveTestJSON-1383535698-project] 10.222.0.20 "GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3" status: 404 len: 111 microversion: 2.20 time: 0.033147 Sep 06 11:24:07.573645 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2927/5906] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 11:24:07 2022] GET /compute/v2.1/servers/72fceff4-8a80-43f9-88f2-fd73e1eed3e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 06 11:24:08.076693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b6c05db0-e4ea-4159-b654-338247af5795 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:08.077393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b6c05db0-e4ea-4159-b654-338247af5795 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:08.086093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6c05db0-e4ea-4159-b654-338247af5795 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:08.086588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6c05db0-e4ea-4159-b654-338247af5795 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:08.087053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6c05db0-e4ea-4159-b654-338247af5795 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:08.087825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6c05db0-e4ea-4159-b654-338247af5795 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:08.088313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6c05db0-e4ea-4159-b654-338247af5795 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:08.088746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6c05db0-e4ea-4159-b654-338247af5795 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:08.240698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b6c05db0-e4ea-4159-b654-338247af5795 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:08.248994 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b6c05db0-e4ea-4159-b654-338247af5795 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1367 microversion: 2.1 time: 0.176608 Sep 06 11:24:08.249601 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2980/5907] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:08 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:09.273289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e111e961-aa12-46f0-b010-96f3e5c46533 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:09.273908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e111e961-aa12-46f0-b010-96f3e5c46533 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:09.281487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e111e961-aa12-46f0-b010-96f3e5c46533 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:09.281974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e111e961-aa12-46f0-b010-96f3e5c46533 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:09.282414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e111e961-aa12-46f0-b010-96f3e5c46533 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:09.283263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e111e961-aa12-46f0-b010-96f3e5c46533 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:09.283724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e111e961-aa12-46f0-b010-96f3e5c46533 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:09.284155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e111e961-aa12-46f0-b010-96f3e5c46533 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:09.436906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e111e961-aa12-46f0-b010-96f3e5c46533 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:09.448173 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e111e961-aa12-46f0-b010-96f3e5c46533 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1367 microversion: 2.1 time: 0.179053 Sep 06 11:24:09.451824 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2928/5908] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:09 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:09.655805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-113fc43d-8b7f-481a-8de2-a72860e76fc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:09.658290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-113fc43d-8b7f-481a-8de2-a72860e76fc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:09.665216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-113fc43d-8b7f-481a-8de2-a72860e76fc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:09.665840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-113fc43d-8b7f-481a-8de2-a72860e76fc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:09.666367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-113fc43d-8b7f-481a-8de2-a72860e76fc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:09.667188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-113fc43d-8b7f-481a-8de2-a72860e76fc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:09.667724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-113fc43d-8b7f-481a-8de2-a72860e76fc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:09.668254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-113fc43d-8b7f-481a-8de2-a72860e76fc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:09.716580 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-113fc43d-8b7f-481a-8de2-a72860e76fc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065502 Sep 06 11:24:09.722819 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2981/5909] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:24:09 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:24:09.794104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-11afd2af-2960-4388-8661-4f20f9f6b0e2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:09.796058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-11afd2af-2960-4388-8661-4f20f9f6b0e2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:09.804307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11afd2af-2960-4388-8661-4f20f9f6b0e2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:09.804861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11afd2af-2960-4388-8661-4f20f9f6b0e2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:09.805314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11afd2af-2960-4388-8661-4f20f9f6b0e2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:09.806103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11afd2af-2960-4388-8661-4f20f9f6b0e2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:09.806508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11afd2af-2960-4388-8661-4f20f9f6b0e2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:09.806945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11afd2af-2960-4388-8661-4f20f9f6b0e2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:09.836534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-11afd2af-2960-4388-8661-4f20f9f6b0e2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:24:10.267170 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-11afd2af-2960-4388-8661-4f20f9f6b0e2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 204 len: 0 microversion: 2.1 time: 0.477941 Sep 06 11:24:10.275486 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2929/5910] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:24:09 2022] DELETE /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:24:10.277274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-24b8f6fb-b7dc-4db0-9245-cf16aaee9125 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:10.278115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-24b8f6fb-b7dc-4db0-9245-cf16aaee9125 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:10.284614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b8f6fb-b7dc-4db0-9245-cf16aaee9125 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:10.285096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b8f6fb-b7dc-4db0-9245-cf16aaee9125 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:10.285542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b8f6fb-b7dc-4db0-9245-cf16aaee9125 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:10.286923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b8f6fb-b7dc-4db0-9245-cf16aaee9125 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:10.287602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b8f6fb-b7dc-4db0-9245-cf16aaee9125 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:10.288039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b8f6fb-b7dc-4db0-9245-cf16aaee9125 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:10.440629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-24b8f6fb-b7dc-4db0-9245-cf16aaee9125 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:10.448924 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-24b8f6fb-b7dc-4db0-9245-cf16aaee9125 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1671 microversion: 2.1 time: 0.175853 Sep 06 11:24:10.449518 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2982/5911] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:10 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1671 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:10.474794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c8caadf6-6c8e-43c3-b736-0f5f328c0f10 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:10.475536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c8caadf6-6c8e-43c3-b736-0f5f328c0f10 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:10.482958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8caadf6-6c8e-43c3-b736-0f5f328c0f10 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:10.483478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8caadf6-6c8e-43c3-b736-0f5f328c0f10 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:10.483927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8caadf6-6c8e-43c3-b736-0f5f328c0f10 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:10.484634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8caadf6-6c8e-43c3-b736-0f5f328c0f10 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:10.485099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8caadf6-6c8e-43c3-b736-0f5f328c0f10 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:10.485537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c8caadf6-6c8e-43c3-b736-0f5f328c0f10 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:10.675755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c8caadf6-6c8e-43c3-b736-0f5f328c0f10 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:10.689231 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c8caadf6-6c8e-43c3-b736-0f5f328c0f10 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1367 microversion: 2.1 time: 0.214243 Sep 06 11:24:10.690012 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2930/5912] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:10 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:24:11.330238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-ee11c8ac-fb2d-4910-8c62-20dc57c8717c req-a07a33a1-6c2b-4abb-9125-4d06b703f44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134fca7e-4cf9-4d85-a8b4-4f0b134e679c", "name": "network-vif-plugged", "status": "completed", "tag": "d2b8a411-ba5d-4c70-b518-4c22267202e8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:24:11.338035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:11.338927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:11.347775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ee11c8ac-fb2d-4910-8c62-20dc57c8717c req-a07a33a1-6c2b-4abb-9125-4d06b703f44a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:11.353521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ee11c8ac-fb2d-4910-8c62-20dc57c8717c req-a07a33a1-6c2b-4abb-9125-4d06b703f44a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:11.353521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ee11c8ac-fb2d-4910-8c62-20dc57c8717c req-a07a33a1-6c2b-4abb-9125-4d06b703f44a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:11.365985 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-ee11c8ac-fb2d-4910-8c62-20dc57c8717c req-a07a33a1-6c2b-4abb-9125-4d06b703f44a service nova] Creating event network-vif-plugged:d2b8a411-ba5d-4c70-b518-4c22267202e8 for instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c on nch2-master-1 Sep 06 11:24:11.372106 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-ee11c8ac-fb2d-4910-8c62-20dc57c8717c req-a07a33a1-6c2b-4abb-9125-4d06b703f44a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045734 Sep 06 11:24:11.372721 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2983/5913] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:24:11.475276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0d4371b0-7fc9-42b5-a41b-149de8433970 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:11.475810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0d4371b0-7fc9-42b5-a41b-149de8433970 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:11.480526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:11.485927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d4371b0-7fc9-42b5-a41b-149de8433970 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:11.486426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d4371b0-7fc9-42b5-a41b-149de8433970 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:11.487105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d4371b0-7fc9-42b5-a41b-149de8433970 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:11.487824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d4371b0-7fc9-42b5-a41b-149de8433970 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:11.488287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d4371b0-7fc9-42b5-a41b-149de8433970 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:11.488776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d4371b0-7fc9-42b5-a41b-149de8433970 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:11.715848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fd832a15-293e-4da5-9303-d20f8af3cb7a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:11.716577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fd832a15-293e-4da5-9303-d20f8af3cb7a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:11.724336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd832a15-293e-4da5-9303-d20f8af3cb7a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:11.725128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd832a15-293e-4da5-9303-d20f8af3cb7a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:11.725827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd832a15-293e-4da5-9303-d20f8af3cb7a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:11.726495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd832a15-293e-4da5-9303-d20f8af3cb7a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:11.726972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd832a15-293e-4da5-9303-d20f8af3cb7a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:11.727435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fd832a15-293e-4da5-9303-d20f8af3cb7a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:11.823521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0d4371b0-7fc9-42b5-a41b-149de8433970 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:11.833659 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0d4371b0-7fc9-42b5-a41b-149de8433970 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1671 microversion: 2.1 time: 0.362901 Sep 06 11:24:11.834394 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2931/5914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:11 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1671 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:11.940088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fd832a15-293e-4da5-9303-d20f8af3cb7a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:11.949699 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fd832a15-293e-4da5-9303-d20f8af3cb7a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1367 microversion: 2.1 time: 0.237750 Sep 06 11:24:11.951136 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2984/5915] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:11 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:24:12.862505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-21abc29a-72b2-45a5-8aaa-92069962bac2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:12.863536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-21abc29a-72b2-45a5-8aaa-92069962bac2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:12.871522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21abc29a-72b2-45a5-8aaa-92069962bac2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:12.872015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21abc29a-72b2-45a5-8aaa-92069962bac2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:12.872458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21abc29a-72b2-45a5-8aaa-92069962bac2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:12.873342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21abc29a-72b2-45a5-8aaa-92069962bac2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:12.873953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21abc29a-72b2-45a5-8aaa-92069962bac2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:12.874394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21abc29a-72b2-45a5-8aaa-92069962bac2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:12.945661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-21abc29a-72b2-45a5-8aaa-92069962bac2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:12.965219 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-21abc29a-72b2-45a5-8aaa-92069962bac2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1605 microversion: 2.1 time: 0.107074 Sep 06 11:24:12.965835 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2932/5916] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:12 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1605 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:12.978509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a2eecf59-0627-4f5f-9439-494dc16fad4b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:12.979250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a2eecf59-0627-4f5f-9439-494dc16fad4b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:13.007611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2eecf59-0627-4f5f-9439-494dc16fad4b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:13.008172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2eecf59-0627-4f5f-9439-494dc16fad4b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:13.008779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2eecf59-0627-4f5f-9439-494dc16fad4b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:13.009601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2eecf59-0627-4f5f-9439-494dc16fad4b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:13.010112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2eecf59-0627-4f5f-9439-494dc16fad4b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:13.010550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a2eecf59-0627-4f5f-9439-494dc16fad4b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:13.183741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-0c247e80-eaca-418c-85f6-cd9f82c4aca7 req-6d40fdee-1421-490d-a250-14e2b4e146ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f263e1-7ed7-4e44-a150-57400223dbb6", "name": "network-vif-deleted", "tag": "f5241706-75c9-4160-aa4f-04f22ce374fd"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:24:13.194788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a2eecf59-0627-4f5f-9439-494dc16fad4b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:13.205413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0c247e80-eaca-418c-85f6-cd9f82c4aca7 req-6d40fdee-1421-490d-a250-14e2b4e146ee service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:13.205793 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a2eecf59-0627-4f5f-9439-494dc16fad4b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1558 microversion: 2.1 time: 0.231909 Sep 06 11:24:13.205961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0c247e80-eaca-418c-85f6-cd9f82c4aca7 req-6d40fdee-1421-490d-a250-14e2b4e146ee service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:13.206354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0c247e80-eaca-418c-85f6-cd9f82c4aca7 req-6d40fdee-1421-490d-a250-14e2b4e146ee service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:13.207194 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2985/5917] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:12 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:24:13.232892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5b0ca1dc-163b-435c-b331-a3d7d44c9836 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:13.233742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5b0ca1dc-163b-435c-b331-a3d7d44c9836 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:13.237937 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-0c247e80-eaca-418c-85f6-cd9f82c4aca7 req-6d40fdee-1421-490d-a250-14e2b4e146ee service nova] Creating event network-vif-deleted:f5241706-75c9-4160-aa4f-04f22ce374fd for instance 14f263e1-7ed7-4e44-a150-57400223dbb6 on nch1-master-1 Sep 06 11:24:13.242399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b0ca1dc-163b-435c-b331-a3d7d44c9836 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:13.243250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b0ca1dc-163b-435c-b331-a3d7d44c9836 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:13.249468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b0ca1dc-163b-435c-b331-a3d7d44c9836 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:13.249468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b0ca1dc-163b-435c-b331-a3d7d44c9836 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:13.249468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b0ca1dc-163b-435c-b331-a3d7d44c9836 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:13.249468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b0ca1dc-163b-435c-b331-a3d7d44c9836 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:13.250714 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-0c247e80-eaca-418c-85f6-cd9f82c4aca7 req-6d40fdee-1421-490d-a250-14e2b4e146ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067010 Sep 06 11:24:13.252498 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2933/5918] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:24:13.338013 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5b0ca1dc-163b-435c-b331-a3d7d44c9836 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109414 Sep 06 11:24:13.352396 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2986/5919] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:24:13 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:24:13.996154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:13.999628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:14.004211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:14.005049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:14.005676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:14.006594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:14.007352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:14.007943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:14.053445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:14.053949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:14.054548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:14.057076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lazy-loading 'fault' on Instance uuid 14f263e1-7ed7-4e44-a150-57400223dbb6 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:24:14.115616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:14.126870 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f40fb12b-a59c-4927-ad6e-333e8e128f10 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 200 len: 1326 microversion: 2.1 time: 0.136622 Sep 06 11:24:14.139506 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2934/5920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:13 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:15.157400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-57144d99-6ffc-45d7-bb3b-7f71aff46b0b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:15.158073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-57144d99-6ffc-45d7-bb3b-7f71aff46b0b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:15.164893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57144d99-6ffc-45d7-bb3b-7f71aff46b0b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:15.165624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57144d99-6ffc-45d7-bb3b-7f71aff46b0b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:15.166266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57144d99-6ffc-45d7-bb3b-7f71aff46b0b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:15.172878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57144d99-6ffc-45d7-bb3b-7f71aff46b0b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:15.172878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57144d99-6ffc-45d7-bb3b-7f71aff46b0b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:15.172878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57144d99-6ffc-45d7-bb3b-7f71aff46b0b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:15.187197 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-57144d99-6ffc-45d7-bb3b-7f71aff46b0b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] HTTP exception thrown: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-57144d99-6ffc-45d7-bb3b-7f71aff46b0b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Request method failure captured: Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 HTTP/1.1 Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy0xyiEKQa481N9ROBQez8BpZ98pUMOsyzswsldcyhKRHmr7IOe5BfulqyVhHe_-uFHEn8gPr9-BZZTbkegww9nluViMr3KA1B4BNcbq6UO8Qk4MniUHswQjFkGMkbBsaC6Ne1HuT6lpaAOx8bJZVlqujBD052tobt6PuhpGCABI-AA Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: b56b93d575b74ba584c4bd399dfe2a6c Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56b93d575b74ba584c4bd399dfe2a6c"}]}] Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: b56b93d575b74ba584c4bd399dfe2a6c Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachVolumeTestJSON-896955129-project Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 4251298aaf4e4207bdcab24fbdf30728 Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachVolumeTestJSON-896955129-project Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '14f263e1-7ed7-4e44-a150-57400223dbb6'} Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:24:15.188676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:24:15.194240 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:24:15.194240 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:24:15.194240 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:24:15.194240 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:24:15.194240 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:24:15.194240 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:24:15.194240 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:24:15.194240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-57144d99-6ffc-45d7-bb3b-7f71aff46b0b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Returning 404 to user: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:24:15.194240 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-57144d99-6ffc-45d7-bb3b-7f71aff46b0b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 404 len: 111 microversion: 2.1 time: 0.037843 Sep 06 11:24:15.195885 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2987/5921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:15 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:24:15.200322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-af98c959-05c5-400c-a059-1f6377acc933 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '.version_select at 0x7f90fcf5e160>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:15.262955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9c7508b6-6106-40e1-9caa-3c1b8b152bd5 req-600dc9f4-2d9e-43d5-b341-4d67f70fe389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134fca7e-4cf9-4d85-a8b4-4f0b134e679c", "tag": "d2b8a411-ba5d-4c70-b518-4c22267202e8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:24:15.273944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9c7508b6-6106-40e1-9caa-3c1b8b152bd5 req-600dc9f4-2d9e-43d5-b341-4d67f70fe389 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:15.274438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9c7508b6-6106-40e1-9caa-3c1b8b152bd5 req-600dc9f4-2d9e-43d5-b341-4d67f70fe389 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:15.274889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9c7508b6-6106-40e1-9caa-3c1b8b152bd5 req-600dc9f4-2d9e-43d5-b341-4d67f70fe389 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:15.285585 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-af98c959-05c5-400c-a059-1f6377acc933 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-410084559" status: 202 len: 0 microversion: 2.1 time: 0.089445 Sep 06 11:24:15.286243 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2935/5922] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 11:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-410084559 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:24:15.287568 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9c7508b6-6106-40e1-9caa-3c1b8b152bd5 req-600dc9f4-2d9e-43d5-b341-4d67f70fe389 service nova] Creating event network-changed:d2b8a411-ba5d-4c70-b518-4c22267202e8 for instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c on nch2-master-1 Sep 06 11:24:15.293251 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9c7508b6-6106-40e1-9caa-3c1b8b152bd5 req-600dc9f4-2d9e-43d5-b341-4d67f70fe389 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033998 Sep 06 11:24:15.294546 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2988/5923] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:24:16.405632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-63754f6d-4ce8-4457-b0a1-79712c1b20af tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Action: 'create', calling method: .version_select at 0x7f90f33fe310>, body: {"keypair": {"name": "tempest-keypair-2103114491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHraf4f3bjMRbttJlPqab56iVZWhAZJjv7tYn7Yxm4tr77M11OmOI6GGmR2/sZgpAtSaorK0EINm51+11YMQpyUoKwZaXnvjUkTk8a7D8JdtjTdJ2BtBK8emfxIP3wGqng=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:24:16.423384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-63754f6d-4ce8-4457-b0a1-79712c1b20af tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Getting quotas for project b56b93d575b74ba584c4bd399dfe2a6c. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:24:16.430055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-63754f6d-4ce8-4457-b0a1-79712c1b20af tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Getting quotas for user 4251298aaf4e4207bdcab24fbdf30728 and project b56b93d575b74ba584c4bd399dfe2a6c. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:24:16.582368 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-63754f6d-4ce8-4457-b0a1-79712c1b20af tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.180511 Sep 06 11:24:16.582985 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2936/5924] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:24:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:24:19.092288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1628461872", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d04a3e29-5263-4e2d-a049-aab206fdcdf3"}], "security_groups": [{"name": "tempest-securitygroup--1381226468"}], "key_name": "tempest-keypair-2103114491", "user_data": "}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:24:19.198593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] validate_networks() for [('d04a3e29-5263-4e2d-a049-aab206fdcdf3', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:24:19.811431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:24:19.811431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:24:19.812113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:24:19.812539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:24:19.813017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:24:19.823315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:19.823810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:19.824262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:19.825001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:19.825464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:19.825901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:19.844336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Getting quotas for project b56b93d575b74ba584c4bd399dfe2a6c. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:24:19.850670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Getting quotas for user 4251298aaf4e4207bdcab24fbdf30728 and project b56b93d575b74ba584c4bd399dfe2a6c. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:24:19.864145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:24:19.867145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:24:20.307295 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f1672151-823b-4bc0-92c5-26cb9d92ed64 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.220580 Sep 06 11:24:20.317255 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2989/5925] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:24:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:24:20.330221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff77d773-b91d-4e43-9ea3-925a3fdfeef1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:20.331791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff77d773-b91d-4e43-9ea3-925a3fdfeef1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:20.410891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff77d773-b91d-4e43-9ea3-925a3fdfeef1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:20.420999 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff77d773-b91d-4e43-9ea3-925a3fdfeef1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1238 microversion: 2.1 time: 0.094179 Sep 06 11:24:20.427097 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2937/5926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:20 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1238 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:21.448500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9dae8540-e270-4b71-942c-f0ad03ae7ba8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:21.449133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9dae8540-e270-4b71-942c-f0ad03ae7ba8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:21.455973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9dae8540-e270-4b71-942c-f0ad03ae7ba8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:21.456483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9dae8540-e270-4b71-942c-f0ad03ae7ba8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:21.456913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9dae8540-e270-4b71-942c-f0ad03ae7ba8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:21.458323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9dae8540-e270-4b71-942c-f0ad03ae7ba8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:21.458323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9dae8540-e270-4b71-942c-f0ad03ae7ba8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:21.458980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9dae8540-e270-4b71-942c-f0ad03ae7ba8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:21.528804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9dae8540-e270-4b71-942c-f0ad03ae7ba8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:21.536016 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9dae8540-e270-4b71-942c-f0ad03ae7ba8 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1242 microversion: 2.1 time: 0.093296 Sep 06 11:24:21.537121 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2990/5927] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:21 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:22.558763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0a4d0f8c-9b09-445d-bcff-dac156a0cff9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:22.559436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0a4d0f8c-9b09-445d-bcff-dac156a0cff9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:22.566638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a4d0f8c-9b09-445d-bcff-dac156a0cff9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:22.567227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a4d0f8c-9b09-445d-bcff-dac156a0cff9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:22.567699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a4d0f8c-9b09-445d-bcff-dac156a0cff9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:22.568315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a4d0f8c-9b09-445d-bcff-dac156a0cff9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:22.569289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a4d0f8c-9b09-445d-bcff-dac156a0cff9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:22.569726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0a4d0f8c-9b09-445d-bcff-dac156a0cff9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:22.638331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0a4d0f8c-9b09-445d-bcff-dac156a0cff9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:22.652321 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0a4d0f8c-9b09-445d-bcff-dac156a0cff9 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1290 microversion: 2.1 time: 0.097372 Sep 06 11:24:22.652956 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2938/5928] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:22 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1290 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:23.693663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3ac33f5f-ef8e-4769-9c1a-3f916e357ef5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:23.693663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3ac33f5f-ef8e-4769-9c1a-3f916e357ef5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:23.693663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ac33f5f-ef8e-4769-9c1a-3f916e357ef5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:23.693663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ac33f5f-ef8e-4769-9c1a-3f916e357ef5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:23.693663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ac33f5f-ef8e-4769-9c1a-3f916e357ef5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:23.693663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ac33f5f-ef8e-4769-9c1a-3f916e357ef5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:23.693663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ac33f5f-ef8e-4769-9c1a-3f916e357ef5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:23.693663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ac33f5f-ef8e-4769-9c1a-3f916e357ef5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:23.851301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3ac33f5f-ef8e-4769-9c1a-3f916e357ef5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:23.862778 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3ac33f5f-ef8e-4769-9c1a-3f916e357ef5 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1364 microversion: 2.1 time: 0.190824 Sep 06 11:24:23.863433 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2991/5929] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:23 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:24.679453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6ac93b11-4828-4d85-a1d8-49386a4cbe7e req-beceaf73-2803-4ccf-a559-4b7b723f0636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70", "tag": "d6d0f7ff-2bd9-44c0-9c33-7606b836ffa8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:24:24.689940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6ac93b11-4828-4d85-a1d8-49386a4cbe7e req-beceaf73-2803-4ccf-a559-4b7b723f0636 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:24.692463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6ac93b11-4828-4d85-a1d8-49386a4cbe7e req-beceaf73-2803-4ccf-a559-4b7b723f0636 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:24.692463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6ac93b11-4828-4d85-a1d8-49386a4cbe7e req-beceaf73-2803-4ccf-a559-4b7b723f0636 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:24.703320 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6ac93b11-4828-4d85-a1d8-49386a4cbe7e req-beceaf73-2803-4ccf-a559-4b7b723f0636 service nova] Creating event network-changed:d6d0f7ff-2bd9-44c0-9c33-7606b836ffa8 for instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 on nch1-master-1 Sep 06 11:24:24.713306 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6ac93b11-4828-4d85-a1d8-49386a4cbe7e req-beceaf73-2803-4ccf-a559-4b7b723f0636 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037951 Sep 06 11:24:24.714223 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2939/5930] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:24:24.890690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e4897708-16a5-4a42-b489-c1799d238832 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:24.891853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e4897708-16a5-4a42-b489-c1799d238832 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:24.904248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4897708-16a5-4a42-b489-c1799d238832 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:24.905414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4897708-16a5-4a42-b489-c1799d238832 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:24.906209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4897708-16a5-4a42-b489-c1799d238832 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:24.907757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4897708-16a5-4a42-b489-c1799d238832 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:24.908814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4897708-16a5-4a42-b489-c1799d238832 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:24.909957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4897708-16a5-4a42-b489-c1799d238832 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:25.055075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e4897708-16a5-4a42-b489-c1799d238832 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:25.066847 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e4897708-16a5-4a42-b489-c1799d238832 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1364 microversion: 2.1 time: 0.182372 Sep 06 11:24:25.079546 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2992/5931] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:24 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:26.094720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0bdfd323-af48-47ef-a02d-609fcf8de030 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:26.095825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0bdfd323-af48-47ef-a02d-609fcf8de030 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:26.105717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bdfd323-af48-47ef-a02d-609fcf8de030 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:26.106447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bdfd323-af48-47ef-a02d-609fcf8de030 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:26.107137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bdfd323-af48-47ef-a02d-609fcf8de030 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:26.108194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bdfd323-af48-47ef-a02d-609fcf8de030 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:26.108897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bdfd323-af48-47ef-a02d-609fcf8de030 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:26.109591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bdfd323-af48-47ef-a02d-609fcf8de030 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:26.257562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0bdfd323-af48-47ef-a02d-609fcf8de030 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:26.269679 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0bdfd323-af48-47ef-a02d-609fcf8de030 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1364 microversion: 2.1 time: 0.183306 Sep 06 11:24:26.270311 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2940/5932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:26 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:27.295124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b897db0a-c752-4741-82d0-fe3764085b78 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:27.295851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b897db0a-c752-4741-82d0-fe3764085b78 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:27.303620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b897db0a-c752-4741-82d0-fe3764085b78 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:27.304211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b897db0a-c752-4741-82d0-fe3764085b78 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:27.304791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b897db0a-c752-4741-82d0-fe3764085b78 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:27.305569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b897db0a-c752-4741-82d0-fe3764085b78 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:27.306106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b897db0a-c752-4741-82d0-fe3764085b78 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:27.306615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b897db0a-c752-4741-82d0-fe3764085b78 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:27.439596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b897db0a-c752-4741-82d0-fe3764085b78 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:27.447593 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b897db0a-c752-4741-82d0-fe3764085b78 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1364 microversion: 2.1 time: 0.157068 Sep 06 11:24:27.448180 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2993/5933] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:27 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:28.471627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-86b94420-83ba-4f01-a305-605cec0ecbc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:28.473185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-86b94420-83ba-4f01-a305-605cec0ecbc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:28.478017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:28.496993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86b94420-83ba-4f01-a305-605cec0ecbc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:28.496993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86b94420-83ba-4f01-a305-605cec0ecbc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:28.496993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86b94420-83ba-4f01-a305-605cec0ecbc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:28.496993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86b94420-83ba-4f01-a305-605cec0ecbc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:28.496993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86b94420-83ba-4f01-a305-605cec0ecbc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:28.496993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86b94420-83ba-4f01-a305-605cec0ecbc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:28.646657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-86b94420-83ba-4f01-a305-605cec0ecbc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:28.655796 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-86b94420-83ba-4f01-a305-605cec0ecbc3 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1364 microversion: 2.1 time: 0.188702 Sep 06 11:24:28.667044 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2941/5934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:28 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:28.791842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-16025c67-7529-4007-bc70-8ef60e915b67 req-6fe6fa82-ca0a-4c51-bce4-28176a1e6cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70", "name": "network-vif-plugged", "status": "completed", "tag": "d6d0f7ff-2bd9-44c0-9c33-7606b836ffa8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:24:28.802899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-16025c67-7529-4007-bc70-8ef60e915b67 req-6fe6fa82-ca0a-4c51-bce4-28176a1e6cc2 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:28.805690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-16025c67-7529-4007-bc70-8ef60e915b67 req-6fe6fa82-ca0a-4c51-bce4-28176a1e6cc2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:28.805690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-16025c67-7529-4007-bc70-8ef60e915b67 req-6fe6fa82-ca0a-4c51-bce4-28176a1e6cc2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:28.816137 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-16025c67-7529-4007-bc70-8ef60e915b67 req-6fe6fa82-ca0a-4c51-bce4-28176a1e6cc2 service nova] Creating event network-vif-plugged:d6d0f7ff-2bd9-44c0-9c33-7606b836ffa8 for instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 on nch1-master-1 Sep 06 11:24:28.821128 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-16025c67-7529-4007-bc70-8ef60e915b67 req-6fe6fa82-ca0a-4c51-bce4-28176a1e6cc2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033577 Sep 06 11:24:28.821736 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2994/5935] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:24:29.680686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e15b1239-8c46-41a4-88ba-c63f1ceb3e8e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:29.681239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e15b1239-8c46-41a4-88ba-c63f1ceb3e8e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:29.689695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e15b1239-8c46-41a4-88ba-c63f1ceb3e8e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:29.690215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e15b1239-8c46-41a4-88ba-c63f1ceb3e8e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:29.690658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e15b1239-8c46-41a4-88ba-c63f1ceb3e8e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:29.691401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e15b1239-8c46-41a4-88ba-c63f1ceb3e8e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:29.691959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e15b1239-8c46-41a4-88ba-c63f1ceb3e8e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:29.695450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e15b1239-8c46-41a4-88ba-c63f1ceb3e8e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:29.833023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e15b1239-8c46-41a4-88ba-c63f1ceb3e8e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:29.841178 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e15b1239-8c46-41a4-88ba-c63f1ceb3e8e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1364 microversion: 2.1 time: 0.165405 Sep 06 11:24:29.855349 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2942/5936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:29 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:30.866125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-503bcf94-5154-4928-9489-bbc24625b425 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:30.866834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-503bcf94-5154-4928-9489-bbc24625b425 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:30.869887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:30.870606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:30.871295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:30.876443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-503bcf94-5154-4928-9489-bbc24625b425 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:30.880756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-503bcf94-5154-4928-9489-bbc24625b425 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:30.880756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-503bcf94-5154-4928-9489-bbc24625b425 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:30.880756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-503bcf94-5154-4928-9489-bbc24625b425 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:30.880756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-503bcf94-5154-4928-9489-bbc24625b425 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:30.880756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-503bcf94-5154-4928-9489-bbc24625b425 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:31.026196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-503bcf94-5154-4928-9489-bbc24625b425 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:24:31.034235 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-503bcf94-5154-4928-9489-bbc24625b425 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1551 microversion: 2.1 time: 0.172790 Sep 06 11:24:31.034984 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2995/5937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:24:30 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1551 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:31.057576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9158d63e-f09a-4cf9-ac8e-850a51e2cb4e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:31.058704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9158d63e-f09a-4cf9-ac8e-850a51e2cb4e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:31.060816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:31.066841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9158d63e-f09a-4cf9-ac8e-850a51e2cb4e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:31.067376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9158d63e-f09a-4cf9-ac8e-850a51e2cb4e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:31.067823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9158d63e-f09a-4cf9-ac8e-850a51e2cb4e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:31.068540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9158d63e-f09a-4cf9-ac8e-850a51e2cb4e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:31.069009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9158d63e-f09a-4cf9-ac8e-850a51e2cb4e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:31.070001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9158d63e-f09a-4cf9-ac8e-850a51e2cb4e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:31.163934 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9158d63e-f09a-4cf9-ac8e-850a51e2cb4e tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110718 Sep 06 11:24:31.164593 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2943/5938] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:24:31 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:24:32.546777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-fcbac51d-156f-4360-9fe6-402ab207f67d req-89d59021-c470-482b-a305-7e753ec3e670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70", "tag": "d6d0f7ff-2bd9-44c0-9c33-7606b836ffa8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:24:32.561548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-fcbac51d-156f-4360-9fe6-402ab207f67d req-89d59021-c470-482b-a305-7e753ec3e670 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:32.562514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-fcbac51d-156f-4360-9fe6-402ab207f67d req-89d59021-c470-482b-a305-7e753ec3e670 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:32.563218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-fcbac51d-156f-4360-9fe6-402ab207f67d req-89d59021-c470-482b-a305-7e753ec3e670 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:32.579468 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-fcbac51d-156f-4360-9fe6-402ab207f67d req-89d59021-c470-482b-a305-7e753ec3e670 service nova] Creating event network-changed:d6d0f7ff-2bd9-44c0-9c33-7606b836ffa8 for instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 on nch1-master-1 Sep 06 11:24:32.586198 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-fcbac51d-156f-4360-9fe6-402ab207f67d req-89d59021-c470-482b-a305-7e753ec3e670 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043793 Sep 06 11:24:32.588001 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2996/5939] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:24:49.889219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fba37821-aaf2-4a3c-942f-979703830288 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:24:49.890276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fba37821-aaf2-4a3c-942f-979703830288 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:49.900251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=5 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:49.901612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:49.905133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fba37821-aaf2-4a3c-942f-979703830288 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:49.905783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fba37821-aaf2-4a3c-942f-979703830288 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:49.906311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fba37821-aaf2-4a3c-942f-979703830288 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:49.907165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fba37821-aaf2-4a3c-942f-979703830288 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:49.907788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fba37821-aaf2-4a3c-942f-979703830288 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:49.908068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fba37821-aaf2-4a3c-942f-979703830288 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:49.938103 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fba37821-aaf2-4a3c-942f-979703830288 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/ips" status: 200 len: 150 microversion: 2.1 time: 0.056099 Sep 06 11:24:49.938709 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2944/5940] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:24:49 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:24:53.924499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=83 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:53.929584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-41dc1167-ea38-404d-b595-4c789cd74a76 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "553c3814-3972-4737-be00-ff7beaefc711"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:24:53.932268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-41dc1167-ea38-404d-b595-4c789cd74a76 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:24:53.938828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41dc1167-ea38-404d-b595-4c789cd74a76 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:53.939344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41dc1167-ea38-404d-b595-4c789cd74a76 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:53.939789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41dc1167-ea38-404d-b595-4c789cd74a76 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:53.940490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41dc1167-ea38-404d-b595-4c789cd74a76 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:24:53.940953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41dc1167-ea38-404d-b595-4c789cd74a76 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:24:53.941385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41dc1167-ea38-404d-b595-4c789cd74a76 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:24:54.888296 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-41dc1167-ea38-404d-b595-4c789cd74a76 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "POST /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.965605 Sep 06 11:24:54.888931 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2997/5941] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:24:53 2022] POST /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/os-volume_attachments => generated 194 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:00.360998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ab9a9f9b-121f-46ee-99e9-1a77a0d4b381 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Action: 'create', calling method: .version_select at 0x7f90fd181160>, body: {"keypair": {"name": "tempest-keypair-1285749969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXyu0YDJkJLVGpp/x7fs+HDC4/0R0ZkkhcIzr7ull810xwGD1tTRpFp/Ahz6kud0fbRPUXH4BmVsJB30HnZ/TZkUjrjxGhQzurB6ew70SR6lYwyunwPnXNnkraixAVChQ=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:00.378372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ab9a9f9b-121f-46ee-99e9-1a77a0d4b381 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:25:00.383915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ab9a9f9b-121f-46ee-99e9-1a77a0d4b381 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for user 5458eb197e36456fb7785c8625ed3140 and project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:25:00.491132 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ab9a9f9b-121f-46ee-99e9-1a77a0d4b381 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135441 Sep 06 11:25:00.491742 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2945/5942] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:25:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:02.235735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a4c6f3f8-58a7-47b8-b72a-03a491aa9222 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:02.240697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a4c6f3f8-58a7-47b8-b72a-03a491aa9222 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:02.248863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4c6f3f8-58a7-47b8-b72a-03a491aa9222 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:02.249497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4c6f3f8-58a7-47b8-b72a-03a491aa9222 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:02.249925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4c6f3f8-58a7-47b8-b72a-03a491aa9222 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:02.250784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4c6f3f8-58a7-47b8-b72a-03a491aa9222 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:02.250784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4c6f3f8-58a7-47b8-b72a-03a491aa9222 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:02.250784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4c6f3f8-58a7-47b8-b72a-03a491aa9222 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:02.290343 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a4c6f3f8-58a7-47b8-b72a-03a491aa9222 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/ips" status: 200 len: 147 microversion: 2.1 time: 0.062482 Sep 06 11:25:02.291071 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2998/5943] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:25:02 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/ips => generated 147 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:03.032727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-926914005", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5afb62db-b7e6-4507-bc2c-7aab6bc880b4"}], "security_groups": [{"name": "tempest-securitygroup--1557773202"}], "key_name": "tempest-keypair-1285749969", "user_data": "}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:03.151371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] validate_networks() for [('5afb62db-b7e6-4507-bc2c-7aab6bc880b4', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:25:03.735399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:25:03.736040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:25:03.736762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:25:03.737378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:25:03.738930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:25:03.749559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:03.754350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:03.754350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:03.754350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:03.754350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:03.754350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:03.772641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:25:03.779337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for user 5458eb197e36456fb7785c8625ed3140 and project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:25:03.794365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:25:03.796798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:25:03.957122 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-db22975a-5a62-4a33-b766-58b663dd5bec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.929373 Sep 06 11:25:03.958122 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2946/5944] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:25:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:25:03.969727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34e93d56-b134-4112-b503-8fc9831099ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:03.970361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-34e93d56-b134-4112-b503-8fc9831099ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:04.035716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-34e93d56-b134-4112-b503-8fc9831099ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:04.039910 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-34e93d56-b134-4112-b503-8fc9831099ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1241 microversion: 2.1 time: 0.074177 Sep 06 11:25:04.056192 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 2999/5945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:03 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:05.066521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cabef115-d667-4e61-b93d-ceb31ab1bd0a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:05.067267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cabef115-d667-4e61-b93d-ceb31ab1bd0a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:05.144743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cabef115-d667-4e61-b93d-ceb31ab1bd0a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:05.152263 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cabef115-d667-4e61-b93d-ceb31ab1bd0a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1241 microversion: 2.1 time: 0.091757 Sep 06 11:25:05.152910 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2947/5946] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:05 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:06.176449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed04ead2-1b9b-460e-838d-26f2d775072b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:06.177102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ed04ead2-1b9b-460e-838d-26f2d775072b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:06.185019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed04ead2-1b9b-460e-838d-26f2d775072b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:06.185519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed04ead2-1b9b-460e-838d-26f2d775072b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:06.185978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed04ead2-1b9b-460e-838d-26f2d775072b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:06.186336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13b827d7-c255-46e0-b141-540d01cae8f0"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:06.186826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed04ead2-1b9b-460e-838d-26f2d775072b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:06.187516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed04ead2-1b9b-460e-838d-26f2d775072b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:06.187960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed04ead2-1b9b-460e-838d-26f2d775072b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:06.188846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:06.196140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:06.196805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:06.197253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:06.197966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:06.198426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:06.198865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:06.276474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ed04ead2-1b9b-460e-838d-26f2d775072b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:06.288469 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ed04ead2-1b9b-460e-838d-26f2d775072b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1293 microversion: 2.1 time: 0.116271 Sep 06 11:25:06.295048 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3000/5947] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:06 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1293 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:07.314913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-07b5816f-5e0f-445b-b808-d2c2fb69e480 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:07.316008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-07b5816f-5e0f-445b-b808-d2c2fb69e480 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:07.323358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07b5816f-5e0f-445b-b808-d2c2fb69e480 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:07.324143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07b5816f-5e0f-445b-b808-d2c2fb69e480 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:07.324790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07b5816f-5e0f-445b-b808-d2c2fb69e480 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:07.325542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07b5816f-5e0f-445b-b808-d2c2fb69e480 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:07.326010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07b5816f-5e0f-445b-b808-d2c2fb69e480 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:07.326445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07b5816f-5e0f-445b-b808-d2c2fb69e480 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:07.345653 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "POST /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.163042 Sep 06 11:25:07.363577 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2948/5948] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:25:06 2022] POST /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments => generated 194 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:25:07.404410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-07b5816f-5e0f-445b-b808-d2c2fb69e480 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:07.415783 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-07b5816f-5e0f-445b-b808-d2c2fb69e480 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1299 microversion: 2.1 time: 0.106479 Sep 06 11:25:07.416575 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3001/5949] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:07 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:25:08.445034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7bf04e51-dbba-4f2f-9f1d-56acd1f064d6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:08.445742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7bf04e51-dbba-4f2f-9f1d-56acd1f064d6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:08.453236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bf04e51-dbba-4f2f-9f1d-56acd1f064d6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:08.453888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bf04e51-dbba-4f2f-9f1d-56acd1f064d6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:08.454182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bf04e51-dbba-4f2f-9f1d-56acd1f064d6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:08.454897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bf04e51-dbba-4f2f-9f1d-56acd1f064d6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:08.455556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bf04e51-dbba-4f2f-9f1d-56acd1f064d6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:08.456219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bf04e51-dbba-4f2f-9f1d-56acd1f064d6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:08.525978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-d0239580-1dc0-4e50-a940-57f89bed9091 req-4374e076-a5a4-473c-ac36-fe0a21294a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75f326f-ee21-49de-90a3-0d332f54bff7", "tag": "229db41e-f786-49c5-b647-7173d9d194ad"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:08.541936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d0239580-1dc0-4e50-a940-57f89bed9091 req-4374e076-a5a4-473c-ac36-fe0a21294a47 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:08.542361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d0239580-1dc0-4e50-a940-57f89bed9091 req-4374e076-a5a4-473c-ac36-fe0a21294a47 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:08.542814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d0239580-1dc0-4e50-a940-57f89bed9091 req-4374e076-a5a4-473c-ac36-fe0a21294a47 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:08.556783 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d0239580-1dc0-4e50-a940-57f89bed9091 req-4374e076-a5a4-473c-ac36-fe0a21294a47 service nova] Creating event network-changed:229db41e-f786-49c5-b647-7173d9d194ad for instance d75f326f-ee21-49de-90a3-0d332f54bff7 on nch1-master-1 Sep 06 11:25:08.562911 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-d0239580-1dc0-4e50-a940-57f89bed9091 req-4374e076-a5a4-473c-ac36-fe0a21294a47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040023 Sep 06 11:25:08.562911 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3002/5950] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:08.639630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7bf04e51-dbba-4f2f-9f1d-56acd1f064d6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:08.649532 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7bf04e51-dbba-4f2f-9f1d-56acd1f064d6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1367 microversion: 2.1 time: 0.211304 Sep 06 11:25:08.650130 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2949/5951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:08 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:09.674918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-25a13624-ca43-4495-8191-29de0cdaa626 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:09.675708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-25a13624-ca43-4495-8191-29de0cdaa626 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:09.684164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25a13624-ca43-4495-8191-29de0cdaa626 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:09.684661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25a13624-ca43-4495-8191-29de0cdaa626 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:09.685116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25a13624-ca43-4495-8191-29de0cdaa626 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:09.685862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25a13624-ca43-4495-8191-29de0cdaa626 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:09.686326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25a13624-ca43-4495-8191-29de0cdaa626 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:09.686811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-25a13624-ca43-4495-8191-29de0cdaa626 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:09.858944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-25a13624-ca43-4495-8191-29de0cdaa626 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:09.871431 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-25a13624-ca43-4495-8191-29de0cdaa626 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1367 microversion: 2.1 time: 0.200611 Sep 06 11:25:09.890223 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3003/5952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:09 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:10.895842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93825c3b-ac90-471c-878b-1c7dcef50f7b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:10.896405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-93825c3b-ac90-471c-878b-1c7dcef50f7b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:10.904708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93825c3b-ac90-471c-878b-1c7dcef50f7b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:10.905208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93825c3b-ac90-471c-878b-1c7dcef50f7b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:10.905659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93825c3b-ac90-471c-878b-1c7dcef50f7b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:10.906378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93825c3b-ac90-471c-878b-1c7dcef50f7b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:10.906859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93825c3b-ac90-471c-878b-1c7dcef50f7b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:10.907334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93825c3b-ac90-471c-878b-1c7dcef50f7b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:11.054261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-93825c3b-ac90-471c-878b-1c7dcef50f7b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:11.062208 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-93825c3b-ac90-471c-878b-1c7dcef50f7b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1367 microversion: 2.1 time: 0.171507 Sep 06 11:25:11.062815 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2950/5953] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:10 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:12.085284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a201d972-21d0-462e-851c-423ebf66f5e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:12.085916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a201d972-21d0-462e-851c-423ebf66f5e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:12.092673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a201d972-21d0-462e-851c-423ebf66f5e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:12.093174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a201d972-21d0-462e-851c-423ebf66f5e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:12.093628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a201d972-21d0-462e-851c-423ebf66f5e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:12.094348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a201d972-21d0-462e-851c-423ebf66f5e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:12.094865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a201d972-21d0-462e-851c-423ebf66f5e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:12.095334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a201d972-21d0-462e-851c-423ebf66f5e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:12.245955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a201d972-21d0-462e-851c-423ebf66f5e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:12.254198 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a201d972-21d0-462e-851c-423ebf66f5e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1367 microversion: 2.1 time: 0.172891 Sep 06 11:25:12.254795 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3004/5954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:12 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:12.848191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-505062ac-f329-4d81-84b3-f2e566f3abff tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:12.850567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-505062ac-f329-4d81-84b3-f2e566f3abff tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:12.857660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-505062ac-f329-4d81-84b3-f2e566f3abff tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:12.858161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-505062ac-f329-4d81-84b3-f2e566f3abff tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:12.861532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-505062ac-f329-4d81-84b3-f2e566f3abff tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:12.861532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-505062ac-f329-4d81-84b3-f2e566f3abff tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:12.861532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-505062ac-f329-4d81-84b3-f2e566f3abff tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:12.861532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-505062ac-f329-4d81-84b3-f2e566f3abff tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:12.893718 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-505062ac-f329-4d81-84b3-f2e566f3abff tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049738 Sep 06 11:25:12.894307 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2951/5955] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:25:12 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:12.906481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ca67de28-7ff2-4717-9271-cb2f2eb5c3ba tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:12.906992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ca67de28-7ff2-4717-9271-cb2f2eb5c3ba tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:12.913797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca67de28-7ff2-4717-9271-cb2f2eb5c3ba tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:12.914448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca67de28-7ff2-4717-9271-cb2f2eb5c3ba tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:12.914959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca67de28-7ff2-4717-9271-cb2f2eb5c3ba tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:12.915803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca67de28-7ff2-4717-9271-cb2f2eb5c3ba tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:12.916257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca67de28-7ff2-4717-9271-cb2f2eb5c3ba tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:12.916691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ca67de28-7ff2-4717-9271-cb2f2eb5c3ba tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:12.948789 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ca67de28-7ff2-4717-9271-cb2f2eb5c3ba tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments/13b827d7-c255-46e0-b141-540d01cae8f0" status: 200 len: 194 microversion: 2.1 time: 0.046796 Sep 06 11:25:12.949408 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3005/5956] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Sep 6 11:25:12 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments/13b827d7-c255-46e0-b141-540d01cae8f0 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:13.276982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aecc0ca2-1f35-49f0-9429-84bba80f6cf7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:13.277799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aecc0ca2-1f35-49f0-9429-84bba80f6cf7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:13.284012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aecc0ca2-1f35-49f0-9429-84bba80f6cf7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:13.284576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aecc0ca2-1f35-49f0-9429-84bba80f6cf7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:13.285091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aecc0ca2-1f35-49f0-9429-84bba80f6cf7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:13.286486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aecc0ca2-1f35-49f0-9429-84bba80f6cf7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:13.287063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aecc0ca2-1f35-49f0-9429-84bba80f6cf7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:13.287833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aecc0ca2-1f35-49f0-9429-84bba80f6cf7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:13.459591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aecc0ca2-1f35-49f0-9429-84bba80f6cf7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:13.467718 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aecc0ca2-1f35-49f0-9429-84bba80f6cf7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1367 microversion: 2.1 time: 0.194690 Sep 06 11:25:13.468304 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2952/5957] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:13 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:14.491979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5d37324d-bf4d-48b9-a653-57d750aac079 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:14.495772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5d37324d-bf4d-48b9-a653-57d750aac079 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:14.510496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:14.516462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d37324d-bf4d-48b9-a653-57d750aac079 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:14.517346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d37324d-bf4d-48b9-a653-57d750aac079 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:14.517807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d37324d-bf4d-48b9-a653-57d750aac079 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:14.518541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d37324d-bf4d-48b9-a653-57d750aac079 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:14.519098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d37324d-bf4d-48b9-a653-57d750aac079 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:14.519556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5d37324d-bf4d-48b9-a653-57d750aac079 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:14.678950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5d37324d-bf4d-48b9-a653-57d750aac079 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:14.687704 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5d37324d-bf4d-48b9-a653-57d750aac079 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1367 microversion: 2.1 time: 0.199699 Sep 06 11:25:14.699147 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3006/5958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:14 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:14.736840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-de302df9-d809-464f-80f4-25b02f53eb51 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fea7ae22-657e-44ae-b515-35c7f52c5d73"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:14.739341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-de302df9-d809-464f-80f4-25b02f53eb51 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:14.741771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:14.749979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de302df9-d809-464f-80f4-25b02f53eb51 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:14.752030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de302df9-d809-464f-80f4-25b02f53eb51 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:14.752155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de302df9-d809-464f-80f4-25b02f53eb51 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:14.753082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de302df9-d809-464f-80f4-25b02f53eb51 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:14.755210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de302df9-d809-464f-80f4-25b02f53eb51 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:14.755758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-de302df9-d809-464f-80f4-25b02f53eb51 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:15.105109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-f97c6ddf-ef98-46b1-80d1-c0e3a21921cd req-597721c5-490b-4878-bc8c-c00fbcfae83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75f326f-ee21-49de-90a3-0d332f54bff7", "name": "network-vif-plugged", "status": "completed", "tag": "229db41e-f786-49c5-b647-7173d9d194ad"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:15.126383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f97c6ddf-ef98-46b1-80d1-c0e3a21921cd req-597721c5-490b-4878-bc8c-c00fbcfae83c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:15.127180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f97c6ddf-ef98-46b1-80d1-c0e3a21921cd req-597721c5-490b-4878-bc8c-c00fbcfae83c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:15.127742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f97c6ddf-ef98-46b1-80d1-c0e3a21921cd req-597721c5-490b-4878-bc8c-c00fbcfae83c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:15.144605 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f97c6ddf-ef98-46b1-80d1-c0e3a21921cd req-597721c5-490b-4878-bc8c-c00fbcfae83c service nova] Creating event network-vif-plugged:229db41e-f786-49c5-b647-7173d9d194ad for instance d75f326f-ee21-49de-90a3-0d332f54bff7 on nch1-master-1 Sep 06 11:25:15.148893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=12 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:15.153187 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-f97c6ddf-ef98-46b1-80d1-c0e3a21921cd req-597721c5-490b-4878-bc8c-c00fbcfae83c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055685 Sep 06 11:25:15.155402 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3007/5959] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:15.659955 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-de302df9-d809-464f-80f4-25b02f53eb51 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "POST /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.933235 Sep 06 11:25:15.661417 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2953/5960] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:25:14 2022] POST /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments => generated 194 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:15.715428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6ce8af99-590f-402c-a9ff-71b18e855384 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:15.716358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6ce8af99-590f-402c-a9ff-71b18e855384 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:15.723913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce8af99-590f-402c-a9ff-71b18e855384 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:15.724408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce8af99-590f-402c-a9ff-71b18e855384 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:15.724899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce8af99-590f-402c-a9ff-71b18e855384 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:15.725610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce8af99-590f-402c-a9ff-71b18e855384 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:15.726066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce8af99-590f-402c-a9ff-71b18e855384 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:15.726557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ce8af99-590f-402c-a9ff-71b18e855384 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:15.870163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6ce8af99-590f-402c-a9ff-71b18e855384 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:15.877439 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6ce8af99-590f-402c-a9ff-71b18e855384 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1367 microversion: 2.1 time: 0.168938 Sep 06 11:25:15.878223 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3008/5961] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:15 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:25:16.904257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e59f157e-8518-4fde-90a7-753e1e6efc31 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:16.905181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e59f157e-8518-4fde-90a7-753e1e6efc31 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:16.917992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e59f157e-8518-4fde-90a7-753e1e6efc31 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:16.919111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e59f157e-8518-4fde-90a7-753e1e6efc31 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:16.919679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e59f157e-8518-4fde-90a7-753e1e6efc31 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:16.920508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e59f157e-8518-4fde-90a7-753e1e6efc31 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:16.921372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e59f157e-8518-4fde-90a7-753e1e6efc31 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:16.921835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e59f157e-8518-4fde-90a7-753e1e6efc31 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:17.062897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e59f157e-8518-4fde-90a7-753e1e6efc31 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:17.078275 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e59f157e-8518-4fde-90a7-753e1e6efc31 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1557 microversion: 2.1 time: 0.178211 Sep 06 11:25:17.079308 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2954/5962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:16 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1557 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:17.101562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0461da0f-9fb6-4042-a1c6-6d5b3a181522 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:17.102106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0461da0f-9fb6-4042-a1c6-6d5b3a181522 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:17.110208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0461da0f-9fb6-4042-a1c6-6d5b3a181522 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:17.117917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0461da0f-9fb6-4042-a1c6-6d5b3a181522 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:17.117917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0461da0f-9fb6-4042-a1c6-6d5b3a181522 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:17.117917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0461da0f-9fb6-4042-a1c6-6d5b3a181522 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:17.117917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0461da0f-9fb6-4042-a1c6-6d5b3a181522 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:17.117917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0461da0f-9fb6-4042-a1c6-6d5b3a181522 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:17.211576 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0461da0f-9fb6-4042-a1c6-6d5b3a181522 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114006 Sep 06 11:25:17.212374 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3009/5963] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:25:17 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:18.559498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-227f2bd7-2ed9-4d10-863b-c98dabe769ee req-eac05150-5f5a-4ad9-9eff-0181ca736e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75f326f-ee21-49de-90a3-0d332f54bff7", "tag": "229db41e-f786-49c5-b647-7173d9d194ad"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:18.579734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-227f2bd7-2ed9-4d10-863b-c98dabe769ee req-eac05150-5f5a-4ad9-9eff-0181ca736e15 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:18.580495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-227f2bd7-2ed9-4d10-863b-c98dabe769ee req-eac05150-5f5a-4ad9-9eff-0181ca736e15 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:18.580937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-227f2bd7-2ed9-4d10-863b-c98dabe769ee req-eac05150-5f5a-4ad9-9eff-0181ca736e15 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:18.595088 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-227f2bd7-2ed9-4d10-863b-c98dabe769ee req-eac05150-5f5a-4ad9-9eff-0181ca736e15 service nova] Creating event network-changed:229db41e-f786-49c5-b647-7173d9d194ad for instance d75f326f-ee21-49de-90a3-0d332f54bff7 on nch1-master-1 Sep 06 11:25:18.601241 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-227f2bd7-2ed9-4d10-863b-c98dabe769ee req-eac05150-5f5a-4ad9-9eff-0181ca736e15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045202 Sep 06 11:25:18.603802 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2955/5964] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:19.116638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c1d7c444-c43c-4084-adaa-8804e53f686a tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Action: 'create', calling method: .version_select at 0x7f90f8678940>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-386827205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNu5lUzlaDYlmPjhT9ET7GQ2HKAQW9yQ8jaov5hmGldRd/GEdH+WborvhnGQkn7ogLPJKrsT5RMvEzvzyIOPS53kI0jwXHK5F7WbDrOPnNEBclAHnBxg++ETVfW+9qTM4g=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:19.157382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-c1d7c444-c43c-4084-adaa-8804e53f686a tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Getting quotas for project 9d6767d15bea403e985c76bf6f2f0905. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:25:19.168683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-c1d7c444-c43c-4084-adaa-8804e53f686a tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Getting quotas for user d1ac283e33a040a5ae2b6c85610c16db and project 9d6767d15bea403e985c76bf6f2f0905. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:25:19.292167 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c1d7c444-c43c-4084-adaa-8804e53f686a tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.184200 Sep 06 11:25:19.295570 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3010/5965] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:25:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:20.155400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5aad8254-fe64-44bd-b07f-3204c291fc4c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:20.157874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5aad8254-fe64-44bd-b07f-3204c291fc4c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:20.169062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aad8254-fe64-44bd-b07f-3204c291fc4c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:20.169504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aad8254-fe64-44bd-b07f-3204c291fc4c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:20.169991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aad8254-fe64-44bd-b07f-3204c291fc4c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:20.170716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aad8254-fe64-44bd-b07f-3204c291fc4c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:20.171292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aad8254-fe64-44bd-b07f-3204c291fc4c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:20.171734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5aad8254-fe64-44bd-b07f-3204c291fc4c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:20.210473 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5aad8254-fe64-44bd-b07f-3204c291fc4c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062134 Sep 06 11:25:20.211212 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2956/5966] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:25:20 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments => generated 371 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:20.351367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cc853d20-d0bb-4506-98d7-51ecffdd6053 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:20.351918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cc853d20-d0bb-4506-98d7-51ecffdd6053 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:20.359105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc853d20-d0bb-4506-98d7-51ecffdd6053 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:20.359603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc853d20-d0bb-4506-98d7-51ecffdd6053 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:20.360048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc853d20-d0bb-4506-98d7-51ecffdd6053 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:20.360763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc853d20-d0bb-4506-98d7-51ecffdd6053 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:20.361226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc853d20-d0bb-4506-98d7-51ecffdd6053 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:20.361692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cc853d20-d0bb-4506-98d7-51ecffdd6053 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:20.395927 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cc853d20-d0bb-4506-98d7-51ecffdd6053 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments/13b827d7-c255-46e0-b141-540d01cae8f0" status: 200 len: 194 microversion: 2.1 time: 0.048869 Sep 06 11:25:20.396534 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3011/5967] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Sep 6 11:25:20 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments/13b827d7-c255-46e0-b141-540d01cae8f0 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:20.407241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8029e2bb-5a52-441c-b324-3aeba01a55be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:20.407746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8029e2bb-5a52-441c-b324-3aeba01a55be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:20.416740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8029e2bb-5a52-441c-b324-3aeba01a55be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:20.417245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8029e2bb-5a52-441c-b324-3aeba01a55be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:20.417696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8029e2bb-5a52-441c-b324-3aeba01a55be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:20.418587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8029e2bb-5a52-441c-b324-3aeba01a55be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:20.419001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8029e2bb-5a52-441c-b324-3aeba01a55be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:20.425479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8029e2bb-5a52-441c-b324-3aeba01a55be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:20.577638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-8029e2bb-5a52-441c-b324-3aeba01a55be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lazy-loading 'services' on Instance uuid a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:25:20.964856 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8029e2bb-5a52-441c-b324-3aeba01a55be tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments/13b827d7-c255-46e0-b141-540d01cae8f0" status: 202 len: 0 microversion: 2.1 time: 0.561384 Sep 06 11:25:20.970117 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2957/5968] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 11:25:20 2022] DELETE /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments/13b827d7-c255-46e0-b141-540d01cae8f0 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:25:22.133945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-381fb95a-2105-4d3f-8a5e-53a8ea429375 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:22.134547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-381fb95a-2105-4d3f-8a5e-53a8ea429375 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:22.141793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-381fb95a-2105-4d3f-8a5e-53a8ea429375 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:22.142635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-381fb95a-2105-4d3f-8a5e-53a8ea429375 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:22.143207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-381fb95a-2105-4d3f-8a5e-53a8ea429375 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:22.144082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-381fb95a-2105-4d3f-8a5e-53a8ea429375 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:22.144624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-381fb95a-2105-4d3f-8a5e-53a8ea429375 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:22.145609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-381fb95a-2105-4d3f-8a5e-53a8ea429375 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:22.178214 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-381fb95a-2105-4d3f-8a5e-53a8ea429375 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments/fea7ae22-657e-44ae-b515-35c7f52c5d73" status: 200 len: 194 microversion: 2.1 time: 0.049034 Sep 06 11:25:22.183200 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3012/5969] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Sep 6 11:25:22 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments/fea7ae22-657e-44ae-b515-35c7f52c5d73 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:22.192002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-71274757-b98a-439c-80a8-f24791429cbb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:22.192611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-71274757-b98a-439c-80a8-f24791429cbb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:22.199231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71274757-b98a-439c-80a8-f24791429cbb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:22.199722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71274757-b98a-439c-80a8-f24791429cbb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:22.200169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71274757-b98a-439c-80a8-f24791429cbb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:22.200895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71274757-b98a-439c-80a8-f24791429cbb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:22.201571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71274757-b98a-439c-80a8-f24791429cbb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:22.206554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71274757-b98a-439c-80a8-f24791429cbb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:22.295578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-71274757-b98a-439c-80a8-f24791429cbb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lazy-loading 'services' on Instance uuid a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:25:22.619492 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-71274757-b98a-439c-80a8-f24791429cbb tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments/fea7ae22-657e-44ae-b515-35c7f52c5d73" status: 202 len: 0 microversion: 2.1 time: 0.433286 Sep 06 11:25:22.620109 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2958/5970] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 11:25:22 2022] DELETE /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments/fea7ae22-657e-44ae-b515-35c7f52c5d73 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:25:23.010371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-523081897", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4f9029e9-670e-487d-b4bf-6eb74e504b25", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-386827205", "security_groups": [{"name": "tempest-secgroup-smoke-354871689"}], "networks": [{"uuid": "d66b7cf2-e13c-4f07-b6f9-7a2e81f5b2fe"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:23.162574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] validate_networks() for [('d66b7cf2-e13c-4f07-b6f9-7a2e81f5b2fe', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:25:23.820291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-929eb1ea-2a02-41c5-b621-2f15b6d5d042 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:23.823041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-929eb1ea-2a02-41c5-b621-2f15b6d5d042 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:23.830492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-929eb1ea-2a02-41c5-b621-2f15b6d5d042 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:23.831118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-929eb1ea-2a02-41c5-b621-2f15b6d5d042 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:23.831687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-929eb1ea-2a02-41c5-b621-2f15b6d5d042 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:23.832991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-929eb1ea-2a02-41c5-b621-2f15b6d5d042 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:23.833545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-929eb1ea-2a02-41c5-b621-2f15b6d5d042 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:23.834021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-929eb1ea-2a02-41c5-b621-2f15b6d5d042 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:23.869775 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-929eb1ea-2a02-41c5-b621-2f15b6d5d042 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055653 Sep 06 11:25:23.870937 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2959/5971] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:25:23 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:25:24.004875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd8a001f-6383-412b-a6f5-fcbf7a01c358 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:24.007118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fd8a001f-6383-412b-a6f5-fcbf7a01c358 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:24.013404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd8a001f-6383-412b-a6f5-fcbf7a01c358 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:24.014933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd8a001f-6383-412b-a6f5-fcbf7a01c358 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:24.014933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd8a001f-6383-412b-a6f5-fcbf7a01c358 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:24.015217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd8a001f-6383-412b-a6f5-fcbf7a01c358 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:24.015538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd8a001f-6383-412b-a6f5-fcbf7a01c358 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:24.015975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd8a001f-6383-412b-a6f5-fcbf7a01c358 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:24.020869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:24.054021 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd8a001f-6383-412b-a6f5-fcbf7a01c358 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053674 Sep 06 11:25:24.054897 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2960/5972] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:25:23 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 11:25:24.076757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:25:24.077305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:25:24.078143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:25:24.078630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:25:24.079164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:25:24.081351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:24.090749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:24.101700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:24.101700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:24.101700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:24.101700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:24.101700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:24.104286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:24.115923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Getting quotas for project 9d6767d15bea403e985c76bf6f2f0905. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:25:24.124420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Getting quotas for user d1ac283e33a040a5ae2b6c85610c16db and project 9d6767d15bea403e985c76bf6f2f0905. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:25:24.124624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6d06db23-194e-44a2-b630-a170942ede74 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:24.124624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6d06db23-194e-44a2-b630-a170942ede74 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:24.129654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d06db23-194e-44a2-b630-a170942ede74 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:24.130148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d06db23-194e-44a2-b630-a170942ede74 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:24.130588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d06db23-194e-44a2-b630-a170942ede74 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:24.131310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d06db23-194e-44a2-b630-a170942ede74 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:24.131775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d06db23-194e-44a2-b630-a170942ede74 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:24.132204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6d06db23-194e-44a2-b630-a170942ede74 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:24.163175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6d06db23-194e-44a2-b630-a170942ede74 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:25:24.192243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:25:24.195364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f9029e9-670e-487d-b4bf-6eb74e504b25',volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:25:24.446295 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6d06db23-194e-44a2-b630-a170942ede74 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 204 len: 0 microversion: 2.1 time: 0.326904 Sep 06 11:25:24.447377 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2961/5973] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:25:24 2022] DELETE /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:25:24.458674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-61e9f9bf-1268-4af9-bf3a-d14fba98d73c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:24.459929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-61e9f9bf-1268-4af9-bf3a-d14fba98d73c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:24.465969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61e9f9bf-1268-4af9-bf3a-d14fba98d73c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:24.466668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61e9f9bf-1268-4af9-bf3a-d14fba98d73c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:24.467114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61e9f9bf-1268-4af9-bf3a-d14fba98d73c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:24.467894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61e9f9bf-1268-4af9-bf3a-d14fba98d73c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:24.468435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61e9f9bf-1268-4af9-bf3a-d14fba98d73c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:24.468866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-61e9f9bf-1268-4af9-bf3a-d14fba98d73c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:24.717901 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.712017 Sep 06 11:25:24.718580 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3013/5974] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:25:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:25:24.731747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3b710841-61f9-4092-84c8-56e00978b894 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:24.732380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3b710841-61f9-4092-84c8-56e00978b894 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:24.822569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3b710841-61f9-4092-84c8-56e00978b894 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:24.836628 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3b710841-61f9-4092-84c8-56e00978b894 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1097 microversion: 2.1 time: 0.109135 Sep 06 11:25:24.841479 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3014/5975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:24 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1097 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:25:24.920780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-61e9f9bf-1268-4af9-bf3a-d14fba98d73c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:24.934048 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-61e9f9bf-1268-4af9-bf3a-d14fba98d73c tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1676 microversion: 2.1 time: 0.476068 Sep 06 11:25:24.934048 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2962/5976] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:24 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1676 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:25:25.886718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f4d0230-241f-4bf3-9e33-8ca82c82ed49 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:25.893768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4f4d0230-241f-4bf3-9e33-8ca82c82ed49 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:25.985338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e828c8e3-801d-4c96-bc82-64c44aa40af1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:25.986175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e828c8e3-801d-4c96-bc82-64c44aa40af1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:26.024779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e828c8e3-801d-4c96-bc82-64c44aa40af1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:26.025331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e828c8e3-801d-4c96-bc82-64c44aa40af1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:26.025796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e828c8e3-801d-4c96-bc82-64c44aa40af1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:26.027087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e828c8e3-801d-4c96-bc82-64c44aa40af1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:26.027567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e828c8e3-801d-4c96-bc82-64c44aa40af1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:26.028223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e828c8e3-801d-4c96-bc82-64c44aa40af1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:26.048676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4f4d0230-241f-4bf3-9e33-8ca82c82ed49 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:26.057137 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4f4d0230-241f-4bf3-9e33-8ca82c82ed49 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1097 microversion: 2.1 time: 0.174791 Sep 06 11:25:26.057715 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3015/5977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:25 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1097 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:26.210493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e828c8e3-801d-4c96-bc82-64c44aa40af1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:26.220672 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e828c8e3-801d-4c96-bc82-64c44aa40af1 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1676 microversion: 2.1 time: 0.251822 Sep 06 11:25:26.246055 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2963/5978] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:25 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1676 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:27.091510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2dc0f072-13b5-47d2-8712-d7a5754e805e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:27.092415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2dc0f072-13b5-47d2-8712-d7a5754e805e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:27.100046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dc0f072-13b5-47d2-8712-d7a5754e805e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:27.100647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dc0f072-13b5-47d2-8712-d7a5754e805e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:27.101206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dc0f072-13b5-47d2-8712-d7a5754e805e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:27.102026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dc0f072-13b5-47d2-8712-d7a5754e805e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:27.102516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dc0f072-13b5-47d2-8712-d7a5754e805e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:27.102954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dc0f072-13b5-47d2-8712-d7a5754e805e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:27.173347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2dc0f072-13b5-47d2-8712-d7a5754e805e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:27.182729 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2dc0f072-13b5-47d2-8712-d7a5754e805e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1195 microversion: 2.1 time: 0.095598 Sep 06 11:25:27.183523 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3016/5979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:27 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1195 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:27.251892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-63613864-7408-4f07-8c1d-6fa9ad9e13d2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:27.252522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-63613864-7408-4f07-8c1d-6fa9ad9e13d2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:27.261013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63613864-7408-4f07-8c1d-6fa9ad9e13d2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:27.261511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63613864-7408-4f07-8c1d-6fa9ad9e13d2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:27.262228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63613864-7408-4f07-8c1d-6fa9ad9e13d2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:27.262947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63613864-7408-4f07-8c1d-6fa9ad9e13d2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:27.263609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63613864-7408-4f07-8c1d-6fa9ad9e13d2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:27.264273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63613864-7408-4f07-8c1d-6fa9ad9e13d2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:27.343323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-63613864-7408-4f07-8c1d-6fa9ad9e13d2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:27.356031 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-63613864-7408-4f07-8c1d-6fa9ad9e13d2 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1608 microversion: 2.1 time: 0.108112 Sep 06 11:25:27.357022 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2964/5980] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:27 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1608 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:28.157819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-b5298c67-05f1-40c9-a249-b26fe4908097 req-35b1d7be-a592-4acf-93a1-582851fa5c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70", "name": "network-vif-deleted", "tag": "d6d0f7ff-2bd9-44c0-9c33-7606b836ffa8"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:28.173861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b5298c67-05f1-40c9-a249-b26fe4908097 req-35b1d7be-a592-4acf-93a1-582851fa5c11 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:28.175602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b5298c67-05f1-40c9-a249-b26fe4908097 req-35b1d7be-a592-4acf-93a1-582851fa5c11 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:28.176340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b5298c67-05f1-40c9-a249-b26fe4908097 req-35b1d7be-a592-4acf-93a1-582851fa5c11 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:28.192388 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-b5298c67-05f1-40c9-a249-b26fe4908097 req-35b1d7be-a592-4acf-93a1-582851fa5c11 service nova] Creating event network-vif-deleted:d6d0f7ff-2bd9-44c0-9c33-7606b836ffa8 for instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 on nch1-master-1 Sep 06 11:25:28.200623 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-b5298c67-05f1-40c9-a249-b26fe4908097 req-35b1d7be-a592-4acf-93a1-582851fa5c11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048121 Sep 06 11:25:28.202139 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3017/5981] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:25:28.218757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6668dd72-2c34-497e-969b-a79ce1e520d1 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:28.221151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6668dd72-2c34-497e-969b-a79ce1e520d1 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:28.242218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6668dd72-2c34-497e-969b-a79ce1e520d1 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:28.243464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6668dd72-2c34-497e-969b-a79ce1e520d1 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:28.244481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6668dd72-2c34-497e-969b-a79ce1e520d1 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:28.245955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6668dd72-2c34-497e-969b-a79ce1e520d1 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:28.252876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6668dd72-2c34-497e-969b-a79ce1e520d1 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:28.252876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6668dd72-2c34-497e-969b-a79ce1e520d1 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:28.371259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6668dd72-2c34-497e-969b-a79ce1e520d1 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:28.383770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-08d643fb-0097-4f4b-9b1f-bb9ad575f5df tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:28.385828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-08d643fb-0097-4f4b-9b1f-bb9ad575f5df tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:28.394994 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6668dd72-2c34-497e-969b-a79ce1e520d1 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1213 microversion: 2.1 time: 0.185446 Sep 06 11:25:28.400701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08d643fb-0097-4f4b-9b1f-bb9ad575f5df tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:28.415034 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2965/5982] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:28 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1213 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:28.433966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08d643fb-0097-4f4b-9b1f-bb9ad575f5df tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:28.433966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08d643fb-0097-4f4b-9b1f-bb9ad575f5df tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:28.433966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08d643fb-0097-4f4b-9b1f-bb9ad575f5df tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:28.433966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08d643fb-0097-4f4b-9b1f-bb9ad575f5df tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:28.433966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-08d643fb-0097-4f4b-9b1f-bb9ad575f5df tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:28.515173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-08d643fb-0097-4f4b-9b1f-bb9ad575f5df tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251298aaf4e4207bdcab24fbdf30728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56b93d575b74ba584c4bd399dfe2a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:28.526534 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-08d643fb-0097-4f4b-9b1f-bb9ad575f5df tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 200 len: 1323 microversion: 2.1 time: 0.147673 Sep 06 11:25:28.538418 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3018/5983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:28 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 1323 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:29.433929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a731a731-723c-469f-ae32-9f43d47f03c6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:29.435526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a731a731-723c-469f-ae32-9f43d47f03c6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:29.447486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a731a731-723c-469f-ae32-9f43d47f03c6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:29.448277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a731a731-723c-469f-ae32-9f43d47f03c6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:29.449353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a731a731-723c-469f-ae32-9f43d47f03c6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:29.450694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a731a731-723c-469f-ae32-9f43d47f03c6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:29.451456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a731a731-723c-469f-ae32-9f43d47f03c6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:29.452116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a731a731-723c-469f-ae32-9f43d47f03c6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:29.568055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c66d72fa-5cbe-4b31-a7a1-0c4f0a042572 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:29.568055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c66d72fa-5cbe-4b31-a7a1-0c4f0a042572 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:29.573845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c66d72fa-5cbe-4b31-a7a1-0c4f0a042572 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:29.574665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c66d72fa-5cbe-4b31-a7a1-0c4f0a042572 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:29.575326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c66d72fa-5cbe-4b31-a7a1-0c4f0a042572 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:29.576084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c66d72fa-5cbe-4b31-a7a1-0c4f0a042572 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:29.576916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c66d72fa-5cbe-4b31-a7a1-0c4f0a042572 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:29.577684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c66d72fa-5cbe-4b31-a7a1-0c4f0a042572 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:29.605546 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-c66d72fa-5cbe-4b31-a7a1-0c4f0a042572 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] HTTP exception thrown: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c66d72fa-5cbe-4b31-a7a1-0c4f0a042572 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Request method failure captured: Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 HTTP/1.1 Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy0xyiEKQa481N9ROBQez8BpZ98pUMOsyzswsldcyhKRHmr7IOe5BfulqyVhHe_-uFHEn8gPr9-BZZTbkegww9nluViMr3KA1B4BNcbq6UO8Qk4MniUHswQjFkGMkbBsaC6Ne1HuT6lpaAOx8bJZVlqujBD052tobt6PuhpGCABI-AA Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: b56b93d575b74ba584c4bd399dfe2a6c Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56b93d575b74ba584c4bd399dfe2a6c"}]}] Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: b56b93d575b74ba584c4bd399dfe2a6c Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachVolumeTestJSON-896955129-project Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 4251298aaf4e4207bdcab24fbdf30728 Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachVolumeTestJSON-896955129-project Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70'} Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:25:29.607780 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:29.617124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:29.617124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:25:29.617124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:25:29.617124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:25:29.617124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:25:29.617124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:29.617124 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:29.617124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c66d72fa-5cbe-4b31-a7a1-0c4f0a042572 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Returning 404 to user: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:25:29.617124 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c66d72fa-5cbe-4b31-a7a1-0c4f0a042572 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 404 len: 111 microversion: 2.1 time: 0.051032 Sep 06 11:25:29.617124 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3019/5984] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:29 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:25:29.622139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-307c6bb1-902e-477a-99d2-ab4acc074131 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '.version_select at 0x7f90f8927280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:29.696909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a731a731-723c-469f-ae32-9f43d47f03c6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:29.706708 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a731a731-723c-469f-ae32-9f43d47f03c6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1280 microversion: 2.1 time: 0.278850 Sep 06 11:25:29.708475 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2966/5985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:29 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1280 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:29.739715 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-307c6bb1-902e-477a-99d2-ab4acc074131 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103114491" status: 202 len: 0 microversion: 2.1 time: 0.121012 Sep 06 11:25:29.739715 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3020/5986] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:25:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103114491 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:25:30.742009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cbd011ff-86b1-4186-931a-9f108cb344d2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:30.743289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cbd011ff-86b1-4186-931a-9f108cb344d2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:30.747878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:30.751698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbd011ff-86b1-4186-931a-9f108cb344d2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:30.757592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbd011ff-86b1-4186-931a-9f108cb344d2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:30.757592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbd011ff-86b1-4186-931a-9f108cb344d2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:30.757592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbd011ff-86b1-4186-931a-9f108cb344d2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:30.757592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbd011ff-86b1-4186-931a-9f108cb344d2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:30.757592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cbd011ff-86b1-4186-931a-9f108cb344d2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:31.007347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cbd011ff-86b1-4186-931a-9f108cb344d2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:31.019932 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cbd011ff-86b1-4186-931a-9f108cb344d2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1268 microversion: 2.1 time: 0.280477 Sep 06 11:25:31.031371 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2967/5987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:30 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1268 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:25:31.694152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-8563c4da-54c3-46e4-94c7-8c6c414b2ecf req-7d7d0cd2-d422-468d-95a3-2c1464b15af6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14eeb47f-c7af-4444-9575-1fcf05e45702", "tag": "acdecfc7-4cdc-45b9-b89d-fce38bedfda5"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:31.706142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8563c4da-54c3-46e4-94c7-8c6c414b2ecf req-7d7d0cd2-d422-468d-95a3-2c1464b15af6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:31.706675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8563c4da-54c3-46e4-94c7-8c6c414b2ecf req-7d7d0cd2-d422-468d-95a3-2c1464b15af6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:31.707262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8563c4da-54c3-46e4-94c7-8c6c414b2ecf req-7d7d0cd2-d422-468d-95a3-2c1464b15af6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:31.719404 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-8563c4da-54c3-46e4-94c7-8c6c414b2ecf req-7d7d0cd2-d422-468d-95a3-2c1464b15af6 service nova] Creating event network-changed:acdecfc7-4cdc-45b9-b89d-fce38bedfda5 for instance 14eeb47f-c7af-4444-9575-1fcf05e45702 on nch2-master-1 Sep 06 11:25:31.724750 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-8563c4da-54c3-46e4-94c7-8c6c414b2ecf req-7d7d0cd2-d422-468d-95a3-2c1464b15af6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036358 Sep 06 11:25:31.725391 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3021/5988] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:32.043134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eec726a9-1d77-481c-ae5b-d2835b9ec214 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:32.044434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-eec726a9-1d77-481c-ae5b-d2835b9ec214 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:32.052800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eec726a9-1d77-481c-ae5b-d2835b9ec214 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:32.053310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eec726a9-1d77-481c-ae5b-d2835b9ec214 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:32.053831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eec726a9-1d77-481c-ae5b-d2835b9ec214 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:32.060791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eec726a9-1d77-481c-ae5b-d2835b9ec214 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:32.060791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eec726a9-1d77-481c-ae5b-d2835b9ec214 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:32.060791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eec726a9-1d77-481c-ae5b-d2835b9ec214 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:32.209830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-eec726a9-1d77-481c-ae5b-d2835b9ec214 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:32.218382 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-eec726a9-1d77-481c-ae5b-d2835b9ec214 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1268 microversion: 2.1 time: 0.179568 Sep 06 11:25:32.219337 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2968/5989] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:32 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:25:33.243983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f730f68f-5748-47e9-bb40-ab154007bb5e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:33.245352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f730f68f-5748-47e9-bb40-ab154007bb5e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:33.252359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f730f68f-5748-47e9-bb40-ab154007bb5e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:33.253342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f730f68f-5748-47e9-bb40-ab154007bb5e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:33.253541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f730f68f-5748-47e9-bb40-ab154007bb5e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:33.254232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f730f68f-5748-47e9-bb40-ab154007bb5e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:33.254710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f730f68f-5748-47e9-bb40-ab154007bb5e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:33.255183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f730f68f-5748-47e9-bb40-ab154007bb5e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:33.474062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f730f68f-5748-47e9-bb40-ab154007bb5e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:33.482374 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f730f68f-5748-47e9-bb40-ab154007bb5e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1268 microversion: 2.1 time: 0.243807 Sep 06 11:25:33.486587 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3022/5990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:33 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1268 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:34.508056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0bdcae34-a6af-48ca-897e-24c959d009a7 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:34.508837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0bdcae34-a6af-48ca-897e-24c959d009a7 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:34.516913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bdcae34-a6af-48ca-897e-24c959d009a7 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:34.517547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bdcae34-a6af-48ca-897e-24c959d009a7 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:34.518350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bdcae34-a6af-48ca-897e-24c959d009a7 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:34.519243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bdcae34-a6af-48ca-897e-24c959d009a7 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:34.519902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bdcae34-a6af-48ca-897e-24c959d009a7 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:34.520463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0bdcae34-a6af-48ca-897e-24c959d009a7 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:34.735647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0bdcae34-a6af-48ca-897e-24c959d009a7 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:34.745802 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0bdcae34-a6af-48ca-897e-24c959d009a7 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1268 microversion: 2.1 time: 0.243762 Sep 06 11:25:34.752865 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2969/5991] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:34 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1268 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:35.779774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-20241b04-3ce2-404f-a0b0-c6a9a594c69e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:35.782011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-20241b04-3ce2-404f-a0b0-c6a9a594c69e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:35.799066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:35.805058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20241b04-3ce2-404f-a0b0-c6a9a594c69e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:35.805941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20241b04-3ce2-404f-a0b0-c6a9a594c69e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:35.806544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20241b04-3ce2-404f-a0b0-c6a9a594c69e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:35.807801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20241b04-3ce2-404f-a0b0-c6a9a594c69e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:35.808488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20241b04-3ce2-404f-a0b0-c6a9a594c69e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:35.809149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20241b04-3ce2-404f-a0b0-c6a9a594c69e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:36.053830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=14 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:36.148773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-20241b04-3ce2-404f-a0b0-c6a9a594c69e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:36.158484 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-20241b04-3ce2-404f-a0b0-c6a9a594c69e tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1268 microversion: 2.1 time: 0.388824 Sep 06 11:25:36.159441 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3023/5992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:35 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1268 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:37.204615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9554c5ac-4e97-475f-84f8-89422ef56644 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:37.207180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9554c5ac-4e97-475f-84f8-89422ef56644 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:37.220057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9554c5ac-4e97-475f-84f8-89422ef56644 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:37.220855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9554c5ac-4e97-475f-84f8-89422ef56644 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:37.221655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9554c5ac-4e97-475f-84f8-89422ef56644 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:37.223485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9554c5ac-4e97-475f-84f8-89422ef56644 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:37.224315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9554c5ac-4e97-475f-84f8-89422ef56644 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:37.225098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9554c5ac-4e97-475f-84f8-89422ef56644 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:37.498683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9554c5ac-4e97-475f-84f8-89422ef56644 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:37.510272 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9554c5ac-4e97-475f-84f8-89422ef56644 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1268 microversion: 2.1 time: 0.316150 Sep 06 11:25:37.510874 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2970/5993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:37 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1268 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:25:38.534790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f12c95ae-da2d-4c6f-8b1d-f12615ce35a6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:38.535876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f12c95ae-da2d-4c6f-8b1d-f12615ce35a6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:38.543638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12c95ae-da2d-4c6f-8b1d-f12615ce35a6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:38.544287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12c95ae-da2d-4c6f-8b1d-f12615ce35a6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:38.544833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12c95ae-da2d-4c6f-8b1d-f12615ce35a6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:38.545704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12c95ae-da2d-4c6f-8b1d-f12615ce35a6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:38.546257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12c95ae-da2d-4c6f-8b1d-f12615ce35a6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:38.546764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12c95ae-da2d-4c6f-8b1d-f12615ce35a6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:38.764143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f12c95ae-da2d-4c6f-8b1d-f12615ce35a6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:38.773427 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f12c95ae-da2d-4c6f-8b1d-f12615ce35a6 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1268 microversion: 2.1 time: 0.243205 Sep 06 11:25:38.774207 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3024/5994] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:38 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1268 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:39.609729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-294884e8-8bd5-4dfc-972b-49f030a18e03 req-f9c618ce-c3bf-4cdb-bef4-10b38c8f62a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14eeb47f-c7af-4444-9575-1fcf05e45702", "name": "network-vif-plugged", "status": "completed", "tag": "acdecfc7-4cdc-45b9-b89d-fce38bedfda5"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:39.624757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-294884e8-8bd5-4dfc-972b-49f030a18e03 req-f9c618ce-c3bf-4cdb-bef4-10b38c8f62a3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:39.625314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-294884e8-8bd5-4dfc-972b-49f030a18e03 req-f9c618ce-c3bf-4cdb-bef4-10b38c8f62a3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:39.625889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-294884e8-8bd5-4dfc-972b-49f030a18e03 req-f9c618ce-c3bf-4cdb-bef4-10b38c8f62a3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:39.641314 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-294884e8-8bd5-4dfc-972b-49f030a18e03 req-f9c618ce-c3bf-4cdb-bef4-10b38c8f62a3 service nova] Creating event network-vif-plugged:acdecfc7-4cdc-45b9-b89d-fce38bedfda5 for instance 14eeb47f-c7af-4444-9575-1fcf05e45702 on nch2-master-1 Sep 06 11:25:39.644919 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-294884e8-8bd5-4dfc-972b-49f030a18e03 req-f9c618ce-c3bf-4cdb-bef4-10b38c8f62a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041859 Sep 06 11:25:39.645761 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2971/5995] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:25:39.798106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ccad8c2a-0a0e-44dc-b39a-24ee18c325ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:39.799660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ccad8c2a-0a0e-44dc-b39a-24ee18c325ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:39.818219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccad8c2a-0a0e-44dc-b39a-24ee18c325ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:39.820173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccad8c2a-0a0e-44dc-b39a-24ee18c325ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:39.822580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccad8c2a-0a0e-44dc-b39a-24ee18c325ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:39.824156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccad8c2a-0a0e-44dc-b39a-24ee18c325ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:39.825435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccad8c2a-0a0e-44dc-b39a-24ee18c325ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:39.826607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccad8c2a-0a0e-44dc-b39a-24ee18c325ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:39.968580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-437805a3-0cfc-4bcb-88f4-43127f2014fd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:39.969665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-437805a3-0cfc-4bcb-88f4-43127f2014fd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:39.986579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-437805a3-0cfc-4bcb-88f4-43127f2014fd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:39.987513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-437805a3-0cfc-4bcb-88f4-43127f2014fd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:39.988433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-437805a3-0cfc-4bcb-88f4-43127f2014fd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:39.993472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-437805a3-0cfc-4bcb-88f4-43127f2014fd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:39.994541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-437805a3-0cfc-4bcb-88f4-43127f2014fd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:39.995214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-437805a3-0cfc-4bcb-88f4-43127f2014fd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:40.017462 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-437805a3-0cfc-4bcb-88f4-43127f2014fd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] HTTP exception thrown: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-437805a3-0cfc-4bcb-88f4-43127f2014fd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Request method failure captured: Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 HTTP/1.1 Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy0xyiEKQa481N9ROBQez8BpZ98pUMOsyzswsldcyhKRHmr7IOe5BfulqyVhHe_-uFHEn8gPr9-BZZTbkegww9nluViMr3KA1B4BNcbq6UO8Qk4MniUHswQjFkGMkbBsaC6Ne1HuT6lpaAOx8bJZVlqujBD052tobt6PuhpGCABI-AA Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: b56b93d575b74ba584c4bd399dfe2a6c Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56b93d575b74ba584c4bd399dfe2a6c"}]}] Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: b56b93d575b74ba584c4bd399dfe2a6c Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeTestJSON-896955129-project Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 4251298aaf4e4207bdcab24fbdf30728 Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeTestJSON-896955129-project Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70'} Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:25:40.020192 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-437805a3-0cfc-4bcb-88f4-43127f2014fd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Returning 404 to user: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-437805a3-0cfc-4bcb-88f4-43127f2014fd tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 404 len: 111 microversion: 2.1 time: 0.061505 Sep 06 11:25:40.025521 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2972/5996] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:25:39 2022] DELETE /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:25:40.032547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d2feb306-5934-40d8-98fd-29030a23d488 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:40.033178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d2feb306-5934-40d8-98fd-29030a23d488 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:40.041015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2feb306-5934-40d8-98fd-29030a23d488 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:40.041554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2feb306-5934-40d8-98fd-29030a23d488 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:40.042864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2feb306-5934-40d8-98fd-29030a23d488 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:40.043685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2feb306-5934-40d8-98fd-29030a23d488 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:40.044119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2feb306-5934-40d8-98fd-29030a23d488 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:40.044564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2feb306-5934-40d8-98fd-29030a23d488 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:40.063312 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-d2feb306-5934-40d8-98fd-29030a23d488 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] HTTP exception thrown: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d2feb306-5934-40d8-98fd-29030a23d488 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Request method failure captured: Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 HTTP/1.1 Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy0xyiEKQa481N9ROBQez8BpZ98pUMOsyzswsldcyhKRHmr7IOe5BfulqyVhHe_-uFHEn8gPr9-BZZTbkegww9nluViMr3KA1B4BNcbq6UO8Qk4MniUHswQjFkGMkbBsaC6Ne1HuT6lpaAOx8bJZVlqujBD052tobt6PuhpGCABI-AA Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: b56b93d575b74ba584c4bd399dfe2a6c Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56b93d575b74ba584c4bd399dfe2a6c"}]}] Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: b56b93d575b74ba584c4bd399dfe2a6c Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeTestJSON-896955129-project Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 4251298aaf4e4207bdcab24fbdf30728 Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeTestJSON-896955129-project Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70'} Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:25:40.065019 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:40.073808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:40.073808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:25:40.073808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:25:40.073808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:25:40.073808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:25:40.073808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. Sep 06 11:25:40.073808 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:40.073808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d2feb306-5934-40d8-98fd-29030a23d488 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Returning 404 to user: Instance a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:25:40.073808 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d2feb306-5934-40d8-98fd-29030a23d488 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70" status: 404 len: 111 microversion: 2.1 time: 0.038092 Sep 06 11:25:40.073808 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2973/5997] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:40 2022] GET /compute/v2.1/servers/a1cb53f5-71fc-4dad-9b5c-9e1b121f7e70 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:25:40.130670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ccad8c2a-0a0e-44dc-b39a-24ee18c325ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:40.138932 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ccad8c2a-0a0e-44dc-b39a-24ee18c325ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1268 microversion: 2.1 time: 0.344892 Sep 06 11:25:40.148235 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3025/5998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:39 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1268 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:41.163441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-43c608f1-255e-4b88-b75f-7c274fc8b8e0 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:41.164320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-43c608f1-255e-4b88-b75f-7c274fc8b8e0 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:41.173289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43c608f1-255e-4b88-b75f-7c274fc8b8e0 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:41.173968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43c608f1-255e-4b88-b75f-7c274fc8b8e0 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:41.174684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43c608f1-255e-4b88-b75f-7c274fc8b8e0 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:41.176268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43c608f1-255e-4b88-b75f-7c274fc8b8e0 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:41.176740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43c608f1-255e-4b88-b75f-7c274fc8b8e0 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:41.177315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-43c608f1-255e-4b88-b75f-7c274fc8b8e0 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:41.610952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-43c608f1-255e-4b88-b75f-7c274fc8b8e0 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:41.619432 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-43c608f1-255e-4b88-b75f-7c274fc8b8e0 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1268 microversion: 2.1 time: 0.460874 Sep 06 11:25:41.623675 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2974/5999] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:41 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1268 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:42.643896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0d9d23c4-e8d9-40a3-8dad-c2a0d66a15eb tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:42.645356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0d9d23c4-e8d9-40a3-8dad-c2a0d66a15eb tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:42.652255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9d23c4-e8d9-40a3-8dad-c2a0d66a15eb tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:42.654451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9d23c4-e8d9-40a3-8dad-c2a0d66a15eb tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:42.654451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9d23c4-e8d9-40a3-8dad-c2a0d66a15eb tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:42.654451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9d23c4-e8d9-40a3-8dad-c2a0d66a15eb tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:42.654451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9d23c4-e8d9-40a3-8dad-c2a0d66a15eb tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:42.655247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0d9d23c4-e8d9-40a3-8dad-c2a0d66a15eb tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:42.799604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0d9d23c4-e8d9-40a3-8dad-c2a0d66a15eb tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:42.808700 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0d9d23c4-e8d9-40a3-8dad-c2a0d66a15eb tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1457 microversion: 2.1 time: 0.169212 Sep 06 11:25:42.809302 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3026/6000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:42 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1457 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:42.832869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d1c49901-df42-4cc3-9011-77eca01cbbb4 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:42.833471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d1c49901-df42-4cc3-9011-77eca01cbbb4 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:42.840548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1c49901-df42-4cc3-9011-77eca01cbbb4 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:42.841049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1c49901-df42-4cc3-9011-77eca01cbbb4 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:42.843631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1c49901-df42-4cc3-9011-77eca01cbbb4 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:42.843631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1c49901-df42-4cc3-9011-77eca01cbbb4 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:42.843631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1c49901-df42-4cc3-9011-77eca01cbbb4 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:42.843631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1c49901-df42-4cc3-9011-77eca01cbbb4 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:42.998943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d1c49901-df42-4cc3-9011-77eca01cbbb4 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:43.008615 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d1c49901-df42-4cc3-9011-77eca01cbbb4 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1457 microversion: 2.1 time: 0.180070 Sep 06 11:25:43.009348 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2975/6001] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:42 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1457 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:44.675607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b543053a-3062-4704-bb61-6a97dff60d15 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:44.676344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b543053a-3062-4704-bb61-6a97dff60d15 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:44.686100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b543053a-3062-4704-bb61-6a97dff60d15 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:44.686524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b543053a-3062-4704-bb61-6a97dff60d15 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:44.686991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b543053a-3062-4704-bb61-6a97dff60d15 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:44.687730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b543053a-3062-4704-bb61-6a97dff60d15 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:44.688187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b543053a-3062-4704-bb61-6a97dff60d15 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:44.688621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b543053a-3062-4704-bb61-6a97dff60d15 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:44.704614 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-b543053a-3062-4704-bb61-6a97dff60d15 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] HTTP exception thrown: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b543053a-3062-4704-bb61-6a97dff60d15 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Request method failure captured: Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 HTTP/1.1 Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy0xyiEKQa481N9ROBQez8BpZ98pUMOsyzswsldcyhKRHmr7IOe5BfulqyVhHe_-uFHEn8gPr9-BZZTbkegww9nluViMr3KA1B4BNcbq6UO8Qk4MniUHswQjFkGMkbBsaC6Ne1HuT6lpaAOx8bJZVlqujBD052tobt6PuhpGCABI-AA Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: b56b93d575b74ba584c4bd399dfe2a6c Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56b93d575b74ba584c4bd399dfe2a6c"}]}] Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: b56b93d575b74ba584c4bd399dfe2a6c Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachVolumeTestJSON-896955129-project Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 4251298aaf4e4207bdcab24fbdf30728 Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachVolumeTestJSON-896955129-project Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '14f263e1-7ed7-4e44-a150-57400223dbb6'} Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:25:44.706436 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b543053a-3062-4704-bb61-6a97dff60d15 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Returning 404 to user: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b543053a-3062-4704-bb61-6a97dff60d15 tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 404 len: 111 microversion: 2.1 time: 0.041498 Sep 06 11:25:44.712691 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3027/6002] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:25:44 2022] DELETE /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:25:44.722008 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4c32c806-a96e-4b3d-8f0d-200f9f0ebb9b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:44.723529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4c32c806-a96e-4b3d-8f0d-200f9f0ebb9b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] [instance: 14f263e1-7ed7-4e44-a150-57400223dbb6] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:44.733409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c32c806-a96e-4b3d-8f0d-200f9f0ebb9b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:44.733921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c32c806-a96e-4b3d-8f0d-200f9f0ebb9b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:44.734375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c32c806-a96e-4b3d-8f0d-200f9f0ebb9b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:44.735160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c32c806-a96e-4b3d-8f0d-200f9f0ebb9b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:44.735635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c32c806-a96e-4b3d-8f0d-200f9f0ebb9b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:44.736081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c32c806-a96e-4b3d-8f0d-200f9f0ebb9b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:44.751612 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-4c32c806-a96e-4b3d-8f0d-200f9f0ebb9b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] HTTP exception thrown: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4c32c806-a96e-4b3d-8f0d-200f9f0ebb9b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Request method failure captured: Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 HTTP/1.1 Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy0xyiEKQa481N9ROBQez8BpZ98pUMOsyzswsldcyhKRHmr7IOe5BfulqyVhHe_-uFHEn8gPr9-BZZTbkegww9nluViMr3KA1B4BNcbq6UO8Qk4MniUHswQjFkGMkbBsaC6Ne1HuT6lpaAOx8bJZVlqujBD052tobt6PuhpGCABI-AA Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: b56b93d575b74ba584c4bd399dfe2a6c Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b56b93d575b74ba584c4bd399dfe2a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56b93d575b74ba584c4bd399dfe2a6c"}]}] Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: b56b93d575b74ba584c4bd399dfe2a6c Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-896955129 Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeTestJSON-896955129-project Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 4251298aaf4e4207bdcab24fbdf30728 Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeTestJSON-896955129-project Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '14f263e1-7ed7-4e44-a150-57400223dbb6'} Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:25:44.753204 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:44.758483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:44.758483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:25:44.758483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:25:44.758483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:25:44.758483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:25:44.758483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. Sep 06 11:25:44.758483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:25:44.758483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4c32c806-a96e-4b3d-8f0d-200f9f0ebb9b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] Returning 404 to user: Instance 14f263e1-7ed7-4e44-a150-57400223dbb6 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:25:44.758483 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4c32c806-a96e-4b3d-8f0d-200f9f0ebb9b tempest-AttachVolumeTestJSON-896955129 tempest-AttachVolumeTestJSON-896955129-project] 10.222.0.20 "GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6" status: 404 len: 111 microversion: 2.1 time: 0.039705 Sep 06 11:25:44.758483 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2976/6003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:44 2022] GET /compute/v2.1/servers/14f263e1-7ed7-4e44-a150-57400223dbb6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:25:45.555591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-0c61e8c1-7b17-41ab-97ee-3e1a6e0984a7 req-1703fb35-128c-460e-8933-911f2e894b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14eeb47f-c7af-4444-9575-1fcf05e45702", "tag": "acdecfc7-4cdc-45b9-b89d-fce38bedfda5"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:45.566465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0c61e8c1-7b17-41ab-97ee-3e1a6e0984a7 req-1703fb35-128c-460e-8933-911f2e894b8d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:45.567443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0c61e8c1-7b17-41ab-97ee-3e1a6e0984a7 req-1703fb35-128c-460e-8933-911f2e894b8d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:45.568897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0c61e8c1-7b17-41ab-97ee-3e1a6e0984a7 req-1703fb35-128c-460e-8933-911f2e894b8d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:45.583925 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-0c61e8c1-7b17-41ab-97ee-3e1a6e0984a7 req-1703fb35-128c-460e-8933-911f2e894b8d service nova] Creating event network-changed:acdecfc7-4cdc-45b9-b89d-fce38bedfda5 for instance 14eeb47f-c7af-4444-9575-1fcf05e45702 on nch2-master-1 Sep 06 11:25:45.591377 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-0c61e8c1-7b17-41ab-97ee-3e1a6e0984a7 req-1703fb35-128c-460e-8933-911f2e894b8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040759 Sep 06 11:25:45.592634 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3028/6004] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:47.658984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-aa478db0-4c9d-4ed9-bb39-80a9e8d21589 req-2424a8fa-5f29-4fdf-b61d-8948decda071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14eeb47f-c7af-4444-9575-1fcf05e45702", "tag": "acdecfc7-4cdc-45b9-b89d-fce38bedfda5"}, {"name": "network-changed", "server_uuid": "14eeb47f-c7af-4444-9575-1fcf05e45702", "tag": "acdecfc7-4cdc-45b9-b89d-fce38bedfda5"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:47.678061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-aa478db0-4c9d-4ed9-bb39-80a9e8d21589 req-2424a8fa-5f29-4fdf-b61d-8948decda071 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:47.678946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-aa478db0-4c9d-4ed9-bb39-80a9e8d21589 req-2424a8fa-5f29-4fdf-b61d-8948decda071 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:47.679640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-aa478db0-4c9d-4ed9-bb39-80a9e8d21589 req-2424a8fa-5f29-4fdf-b61d-8948decda071 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:47.696629 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-aa478db0-4c9d-4ed9-bb39-80a9e8d21589 req-2424a8fa-5f29-4fdf-b61d-8948decda071 service nova] Creating event network-changed:acdecfc7-4cdc-45b9-b89d-fce38bedfda5 for instance 14eeb47f-c7af-4444-9575-1fcf05e45702 on nch2-master-1 Sep 06 11:25:47.698344 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-aa478db0-4c9d-4ed9-bb39-80a9e8d21589 req-2424a8fa-5f29-4fdf-b61d-8948decda071 service nova] Creating event network-changed:acdecfc7-4cdc-45b9-b89d-fce38bedfda5 for instance 14eeb47f-c7af-4444-9575-1fcf05e45702 on nch2-master-1 Sep 06 11:25:47.710273 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-aa478db0-4c9d-4ed9-bb39-80a9e8d21589 req-2424a8fa-5f29-4fdf-b61d-8948decda071 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.073947 Sep 06 11:25:47.711758 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2977/6005] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:51.231743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-696b73d6-fa65-46b9-a066-c8ebfd505c46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169-project-admin] Calling method '.version_select at 0x7f90f8ab6e50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:51.233611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-696b73d6-fa65-46b9-a066-c8ebfd505c46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:51.234135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-696b73d6-fa65-46b9-a066-c8ebfd505c46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:51.234590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-696b73d6-fa65-46b9-a066-c8ebfd505c46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:51.252874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-696b73d6-fa65-46b9-a066-c8ebfd505c46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:51.253869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-696b73d6-fa65-46b9-a066-c8ebfd505c46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:51.254498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-696b73d6-fa65-46b9-a066-c8ebfd505c46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:51.265619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-696b73d6-fa65-46b9-a066-c8ebfd505c46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:51.266114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-696b73d6-fa65-46b9-a066-c8ebfd505c46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:51.266600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-696b73d6-fa65-46b9-a066-c8ebfd505c46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:51.274020 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-696b73d6-fa65-46b9-a066-c8ebfd505c46 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169 tempest-PortsAdminExtendedAttrsIpV6TestJSON-109103169-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.234259 Sep 06 11:25:51.274698 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3029/6006] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 11:25:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:55.077087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-29209ba6-b732-433b-8c0d-50c70f82aa12 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:55.077663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-29209ba6-b732-433b-8c0d-50c70f82aa12 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:55.084150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29209ba6-b732-433b-8c0d-50c70f82aa12 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:55.084667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29209ba6-b732-433b-8c0d-50c70f82aa12 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:55.085119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29209ba6-b732-433b-8c0d-50c70f82aa12 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:55.085842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29209ba6-b732-433b-8c0d-50c70f82aa12 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:55.086300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29209ba6-b732-433b-8c0d-50c70f82aa12 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:55.086742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29209ba6-b732-433b-8c0d-50c70f82aa12 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:55.089552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:55.111948 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-29209ba6-b732-433b-8c0d-50c70f82aa12 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7/ips" status: 200 len: 150 microversion: 2.1 time: 0.040508 Sep 06 11:25:55.112535 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2978/6007] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:25:55 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:55.125826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-daa5a5e9-3e58-4457-9c36-68193c95cd8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "553c3814-3972-4737-be00-ff7beaefc711"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:55.129043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-daa5a5e9-3e58-4457-9c36-68193c95cd8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:55.132430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:55.137526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daa5a5e9-3e58-4457-9c36-68193c95cd8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:55.138132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daa5a5e9-3e58-4457-9c36-68193c95cd8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:55.138734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daa5a5e9-3e58-4457-9c36-68193c95cd8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:55.139582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daa5a5e9-3e58-4457-9c36-68193c95cd8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:55.140154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daa5a5e9-3e58-4457-9c36-68193c95cd8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:55.140692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daa5a5e9-3e58-4457-9c36-68193c95cd8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:55.143661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=60 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:55.237924 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-daa5a5e9-3e58-4457-9c36-68193c95cd8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Invalid volume: volume 553c3814-3972-4737-be00-ff7beaefc711 is already attached to instances: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-daa5a5e9-3e58-4457-9c36-68193c95cd8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7/os-volume_attachments HTTP/1.1 Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 74 Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: {"volumeAttachment": {"volumeId": "553c3814-3972-4737-be00-ff7beaefc711"}} Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid volume: volume 553c3814-3972-4737-be00-ff7beaefc711 is already attached to instances: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'server_id': 'd75f326f-ee21-49de-90a3-0d332f54bff7', 'body': {'volumeAttachment': {'volumeId': '553c3814-3972-4737-be00-ff7beaefc711'}}} Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 553c3814-3972-4737-be00-ff7beaefc711 is already attached to instances: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:25:55.239768 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 553c3814-3972-4737-be00-ff7beaefc711 is already attached to instances: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 553c3814-3972-4737-be00-ff7beaefc711 is already attached to instances: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-daa5a5e9-3e58-4457-9c36-68193c95cd8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 400 to user: Invalid volume: volume 553c3814-3972-4737-be00-ff7beaefc711 is already attached to instances: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-daa5a5e9-3e58-4457-9c36-68193c95cd8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "POST /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119627 Sep 06 11:25:55.248949 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3030/6008] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:25:55 2022] POST /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:25:55.250412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ade899ca-6ae7-4d5d-8f52-da29b0e3c856 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:55.250933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ade899ca-6ae7-4d5d-8f52-da29b0e3c856 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:55.257114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ade899ca-6ae7-4d5d-8f52-da29b0e3c856 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:55.257614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ade899ca-6ae7-4d5d-8f52-da29b0e3c856 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:55.258062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ade899ca-6ae7-4d5d-8f52-da29b0e3c856 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:55.258773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ade899ca-6ae7-4d5d-8f52-da29b0e3c856 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:55.259265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ade899ca-6ae7-4d5d-8f52-da29b0e3c856 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:55.259708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ade899ca-6ae7-4d5d-8f52-da29b0e3c856 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:55.286511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ade899ca-6ae7-4d5d-8f52-da29b0e3c856 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:25:55.856799 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ade899ca-6ae7-4d5d-8f52-da29b0e3c856 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 204 len: 0 microversion: 2.1 time: 0.610022 Sep 06 11:25:55.857795 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2979/6009] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:25:55 2022] DELETE /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:25:55.867364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bddc5794-b722-4b22-affc-39eed7144aac tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:55.868268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bddc5794-b722-4b22-affc-39eed7144aac tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:55.874855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bddc5794-b722-4b22-affc-39eed7144aac tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:55.875408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bddc5794-b722-4b22-affc-39eed7144aac tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:55.875863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bddc5794-b722-4b22-affc-39eed7144aac tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:55.876580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bddc5794-b722-4b22-affc-39eed7144aac tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:55.877050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bddc5794-b722-4b22-affc-39eed7144aac tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:55.877495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bddc5794-b722-4b22-affc-39eed7144aac tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:56.053703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bddc5794-b722-4b22-affc-39eed7144aac tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:56.062029 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bddc5794-b722-4b22-affc-39eed7144aac tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1682 microversion: 2.1 time: 0.199673 Sep 06 11:25:56.062918 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3031/6010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:55 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:57.087312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9425325b-b1af-4d0b-b4d0-533187c98e20 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:57.087975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9425325b-b1af-4d0b-b4d0-533187c98e20 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:57.095214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9425325b-b1af-4d0b-b4d0-533187c98e20 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:57.095706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9425325b-b1af-4d0b-b4d0-533187c98e20 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:57.096156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9425325b-b1af-4d0b-b4d0-533187c98e20 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:57.096864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9425325b-b1af-4d0b-b4d0-533187c98e20 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:57.097331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9425325b-b1af-4d0b-b4d0-533187c98e20 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:57.098316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9425325b-b1af-4d0b-b4d0-533187c98e20 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:57.254326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9425325b-b1af-4d0b-b4d0-533187c98e20 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:57.263028 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9425325b-b1af-4d0b-b4d0-533187c98e20 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1682 microversion: 2.1 time: 0.180591 Sep 06 11:25:57.264384 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2980/6011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:57 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:58.287789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5ec4085-3cb4-4186-bc2b-181715b35a3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:58.288544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a5ec4085-3cb4-4186-bc2b-181715b35a3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:58.297296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5ec4085-3cb4-4186-bc2b-181715b35a3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:58.297916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5ec4085-3cb4-4186-bc2b-181715b35a3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:58.298526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5ec4085-3cb4-4186-bc2b-181715b35a3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:58.299346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5ec4085-3cb4-4186-bc2b-181715b35a3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:58.299912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5ec4085-3cb4-4186-bc2b-181715b35a3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:58.300571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5ec4085-3cb4-4186-bc2b-181715b35a3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:58.374219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a5ec4085-3cb4-4186-bc2b-181715b35a3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:58.380991 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a5ec4085-3cb4-4186-bc2b-181715b35a3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1614 microversion: 2.1 time: 0.096899 Sep 06 11:25:58.387842 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3032/6012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:58 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:25:58.545260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-4a81ebb0-cd10-495b-b2b5-1b47686870c4 req-e27df053-287d-42c3-8224-beebfdb823f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75f326f-ee21-49de-90a3-0d332f54bff7", "name": "network-vif-deleted", "tag": "229db41e-f786-49c5-b647-7173d9d194ad"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:25:58.574219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4a81ebb0-cd10-495b-b2b5-1b47686870c4 req-e27df053-287d-42c3-8224-beebfdb823f5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:58.575637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4a81ebb0-cd10-495b-b2b5-1b47686870c4 req-e27df053-287d-42c3-8224-beebfdb823f5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:58.576186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4a81ebb0-cd10-495b-b2b5-1b47686870c4 req-e27df053-287d-42c3-8224-beebfdb823f5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:58.590451 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-4a81ebb0-cd10-495b-b2b5-1b47686870c4 req-e27df053-287d-42c3-8224-beebfdb823f5 service nova] Creating event network-vif-deleted:229db41e-f786-49c5-b647-7173d9d194ad for instance d75f326f-ee21-49de-90a3-0d332f54bff7 on nch1-master-1 Sep 06 11:25:58.599145 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-4a81ebb0-cd10-495b-b2b5-1b47686870c4 req-e27df053-287d-42c3-8224-beebfdb823f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056505 Sep 06 11:25:58.600115 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2981/6013] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:25:59.404772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:25:59.405417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:25:59.420301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:59.420301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:59.420301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:59.420301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:59.420301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:59.420301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:59.462022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:25:59.462439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:25:59.463205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:25:59.463633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lazy-loading 'fault' on Instance uuid d75f326f-ee21-49de-90a3-0d332f54bff7 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:25:59.516356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:25:59.527686 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cacf7dd2-6b50-41bb-8d22-10de686fc224 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 200 len: 1331 microversion: 2.1 time: 0.126599 Sep 06 11:25:59.528751 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3033/6014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:25:59 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 1331 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:26:00.556405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-10d2c3ec-6c16-4ef5-b1d0-b00ae7082a4a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:00.557695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-10d2c3ec-6c16-4ef5-b1d0-b00ae7082a4a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:00.567949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10d2c3ec-6c16-4ef5-b1d0-b00ae7082a4a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:00.568446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10d2c3ec-6c16-4ef5-b1d0-b00ae7082a4a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:00.568966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10d2c3ec-6c16-4ef5-b1d0-b00ae7082a4a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:00.569692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10d2c3ec-6c16-4ef5-b1d0-b00ae7082a4a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:00.570158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10d2c3ec-6c16-4ef5-b1d0-b00ae7082a4a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:00.570592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-10d2c3ec-6c16-4ef5-b1d0-b00ae7082a4a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:00.588048 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-10d2c3ec-6c16-4ef5-b1d0-b00ae7082a4a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-10d2c3ec-6c16-4ef5-b1d0-b00ae7082a4a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 HTTP/1.1 Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'd75f326f-ee21-49de-90a3-0d332f54bff7'} Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:26:00.590774 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:26:00.598844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:26:00.598844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:26:00.598844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:26:00.598844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:26:00.598844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:26:00.598844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:26:00.598844 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:26:00.598844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-10d2c3ec-6c16-4ef5-b1d0-b00ae7082a4a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 404 to user: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:26:00.598844 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-10d2c3ec-6c16-4ef5-b1d0-b00ae7082a4a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 404 len: 111 microversion: 2.1 time: 0.042615 Sep 06 11:26:00.604777 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2982/6015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:00 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:26:00.616198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-712e1ea9-4fc1-4046-a73f-f75eec921748 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '.version_select at 0x7f90f315f280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:00.709859 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-712e1ea9-4fc1-4046-a73f-f75eec921748 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285749969" status: 202 len: 0 microversion: 2.1 time: 0.101682 Sep 06 11:26:00.712286 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3034/6016] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:26:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285749969 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:26:01.764227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9911185c-ea00-4541-9764-b3f7d66cbb40 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:01.764838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9911185c-ea00-4541-9764-b3f7d66cbb40 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:01.773311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9911185c-ea00-4541-9764-b3f7d66cbb40 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:01.774062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9911185c-ea00-4541-9764-b3f7d66cbb40 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:01.776599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9911185c-ea00-4541-9764-b3f7d66cbb40 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:01.776599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9911185c-ea00-4541-9764-b3f7d66cbb40 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:01.776599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9911185c-ea00-4541-9764-b3f7d66cbb40 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:01.776599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9911185c-ea00-4541-9764-b3f7d66cbb40 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:01.919768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-9911185c-ea00-4541-9764-b3f7d66cbb40 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lazy-loading 'services' on Instance uuid 134fca7e-4cf9-4d85-a8b4-4f0b134e679c {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:26:02.216802 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9911185c-ea00-4541-9764-b3f7d66cbb40 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/os-volume_attachments/553c3814-3972-4737-be00-ff7beaefc711" status: 202 len: 0 microversion: 2.1 time: 0.456234 Sep 06 11:26:02.217557 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2983/6017] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 11:26:01 2022] DELETE /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/os-volume_attachments/553c3814-3972-4737-be00-ff7beaefc711 => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:26:02.235317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-960a3939-a75c-4144-9850-76064b72ec7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:02.237605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-960a3939-a75c-4144-9850-76064b72ec7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:02.253604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-960a3939-a75c-4144-9850-76064b72ec7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:02.254142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-960a3939-a75c-4144-9850-76064b72ec7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:02.254653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-960a3939-a75c-4144-9850-76064b72ec7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:02.255654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-960a3939-a75c-4144-9850-76064b72ec7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:02.256288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-960a3939-a75c-4144-9850-76064b72ec7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:02.257000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-960a3939-a75c-4144-9850-76064b72ec7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:02.292583 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-960a3939-a75c-4144-9850-76064b72ec7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061625 Sep 06 11:26:02.293525 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3035/6018] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:26:02 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:26:03.311395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-21a78572-6aa6-42c8-b260-f84063395c3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:03.314713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-21a78572-6aa6-42c8-b260-f84063395c3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:03.316118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:03.324198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21a78572-6aa6-42c8-b260-f84063395c3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:03.324710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21a78572-6aa6-42c8-b260-f84063395c3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:03.325157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21a78572-6aa6-42c8-b260-f84063395c3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:03.326100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21a78572-6aa6-42c8-b260-f84063395c3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:03.326577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21a78572-6aa6-42c8-b260-f84063395c3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:03.327350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21a78572-6aa6-42c8-b260-f84063395c3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:03.361485 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-21a78572-6aa6-42c8-b260-f84063395c3c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058003 Sep 06 11:26:03.374224 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2984/6019] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:26:03 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:26:04.385540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c22982c7-06f1-4798-a1c0-bafea9ab106b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:04.388512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c22982c7-06f1-4798-a1c0-bafea9ab106b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:04.395960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c22982c7-06f1-4798-a1c0-bafea9ab106b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:04.396455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c22982c7-06f1-4798-a1c0-bafea9ab106b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:04.396905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c22982c7-06f1-4798-a1c0-bafea9ab106b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:04.397621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c22982c7-06f1-4798-a1c0-bafea9ab106b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:04.398088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c22982c7-06f1-4798-a1c0-bafea9ab106b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:04.398523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c22982c7-06f1-4798-a1c0-bafea9ab106b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:04.439573 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c22982c7-06f1-4798-a1c0-bafea9ab106b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056294 Sep 06 11:26:04.439573 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3036/6020] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:26:04 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:26:04.507609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b34ac769-10bd-46f7-b005-26c483f4d305 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:04.508178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b34ac769-10bd-46f7-b005-26c483f4d305 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:04.515424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b34ac769-10bd-46f7-b005-26c483f4d305 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:04.515930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b34ac769-10bd-46f7-b005-26c483f4d305 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:04.516385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b34ac769-10bd-46f7-b005-26c483f4d305 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:04.517099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b34ac769-10bd-46f7-b005-26c483f4d305 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:04.517563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b34ac769-10bd-46f7-b005-26c483f4d305 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:04.517999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b34ac769-10bd-46f7-b005-26c483f4d305 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:04.544828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b34ac769-10bd-46f7-b005-26c483f4d305 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:26:04.824830 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b34ac769-10bd-46f7-b005-26c483f4d305 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 204 len: 0 microversion: 2.1 time: 0.321884 Sep 06 11:26:04.825428 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2985/6021] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:26:04 2022] DELETE /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:26:04.839747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-744f865e-9757-4a14-b4ee-3ec046cd78e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:04.840375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-744f865e-9757-4a14-b4ee-3ec046cd78e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:04.848211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-744f865e-9757-4a14-b4ee-3ec046cd78e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:04.848842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-744f865e-9757-4a14-b4ee-3ec046cd78e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:04.849296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-744f865e-9757-4a14-b4ee-3ec046cd78e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:04.850239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-744f865e-9757-4a14-b4ee-3ec046cd78e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:04.850783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-744f865e-9757-4a14-b4ee-3ec046cd78e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:04.851330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-744f865e-9757-4a14-b4ee-3ec046cd78e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:05.010917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-744f865e-9757-4a14-b4ee-3ec046cd78e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:05.024464 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-744f865e-9757-4a14-b4ee-3ec046cd78e3 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1682 microversion: 2.1 time: 0.184704 Sep 06 11:26:05.024464 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3037/6022] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:04 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:26:06.049414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e48c75c1-b5d4-45d3-a9fe-b54b8ce6f04d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:06.050119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e48c75c1-b5d4-45d3-a9fe-b54b8ce6f04d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:06.060993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e48c75c1-b5d4-45d3-a9fe-b54b8ce6f04d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:06.061800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e48c75c1-b5d4-45d3-a9fe-b54b8ce6f04d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:06.062518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e48c75c1-b5d4-45d3-a9fe-b54b8ce6f04d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:06.063616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e48c75c1-b5d4-45d3-a9fe-b54b8ce6f04d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:06.064319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e48c75c1-b5d4-45d3-a9fe-b54b8ce6f04d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:06.064886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e48c75c1-b5d4-45d3-a9fe-b54b8ce6f04d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:06.289458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e48c75c1-b5d4-45d3-a9fe-b54b8ce6f04d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:06.298641 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e48c75c1-b5d4-45d3-a9fe-b54b8ce6f04d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1682 microversion: 2.1 time: 0.253420 Sep 06 11:26:06.299411 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2986/6023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:06 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:26:07.322902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1b4a0896-3cda-444f-bcb7-8748e3fed44d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:07.324226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1b4a0896-3cda-444f-bcb7-8748e3fed44d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:07.331557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b4a0896-3cda-444f-bcb7-8748e3fed44d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:07.332510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b4a0896-3cda-444f-bcb7-8748e3fed44d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:07.333426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b4a0896-3cda-444f-bcb7-8748e3fed44d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:07.334556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b4a0896-3cda-444f-bcb7-8748e3fed44d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:07.335306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b4a0896-3cda-444f-bcb7-8748e3fed44d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:07.335931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b4a0896-3cda-444f-bcb7-8748e3fed44d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:07.554325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1b4a0896-3cda-444f-bcb7-8748e3fed44d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:07.568770 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1b4a0896-3cda-444f-bcb7-8748e3fed44d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1682 microversion: 2.1 time: 0.249915 Sep 06 11:26:07.569730 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3038/6024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:07 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1682 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:26:08.093862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-c3ff61ea-b5fb-406f-a3ca-47c33e535a3d req-5d6173be-f44f-4517-8ef2-e1cdb5c19341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134fca7e-4cf9-4d85-a8b4-4f0b134e679c", "name": "network-vif-deleted", "tag": "d2b8a411-ba5d-4c70-b518-4c22267202e8"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:26:08.131419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c3ff61ea-b5fb-406f-a3ca-47c33e535a3d req-5d6173be-f44f-4517-8ef2-e1cdb5c19341 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:08.132765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c3ff61ea-b5fb-406f-a3ca-47c33e535a3d req-5d6173be-f44f-4517-8ef2-e1cdb5c19341 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:08.133760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c3ff61ea-b5fb-406f-a3ca-47c33e535a3d req-5d6173be-f44f-4517-8ef2-e1cdb5c19341 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:08.164251 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-c3ff61ea-b5fb-406f-a3ca-47c33e535a3d req-5d6173be-f44f-4517-8ef2-e1cdb5c19341 service nova] Creating event network-vif-deleted:d2b8a411-ba5d-4c70-b518-4c22267202e8 for instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c on nch2-master-1 Sep 06 11:26:08.185869 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-c3ff61ea-b5fb-406f-a3ca-47c33e535a3d req-5d6173be-f44f-4517-8ef2-e1cdb5c19341 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095464 Sep 06 11:26:08.186878 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2987/6025] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:26:08.593961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:08.594623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:08.602736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:08.603558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:08.603994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:08.604888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:08.605205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:08.605901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:08.641247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:08.642060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:08.642713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:08.643602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lazy-loading 'fault' on Instance uuid 134fca7e-4cf9-4d85-a8b4-4f0b134e679c {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:26:08.718448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:08.729214 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e5af72fe-1a88-4ad8-b19c-fa88edfc9d96 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 200 len: 1331 microversion: 2.1 time: 0.139253 Sep 06 11:26:08.730296 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3039/6026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:08 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:26:09.754692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7d208227-d261-4d1a-a8db-4e420a9ecebd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:09.755437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7d208227-d261-4d1a-a8db-4e420a9ecebd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:09.761855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d208227-d261-4d1a-a8db-4e420a9ecebd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:09.762357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d208227-d261-4d1a-a8db-4e420a9ecebd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:09.762808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d208227-d261-4d1a-a8db-4e420a9ecebd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:09.763568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d208227-d261-4d1a-a8db-4e420a9ecebd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:09.764754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d208227-d261-4d1a-a8db-4e420a9ecebd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:09.764754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7d208227-d261-4d1a-a8db-4e420a9ecebd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:09.779442 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-7d208227-d261-4d1a-a8db-4e420a9ecebd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7d208227-d261-4d1a-a8db-4e420a9ecebd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c HTTP/1.1 Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '134fca7e-4cf9-4d85-a8b4-4f0b134e679c'} Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:26:09.781224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:26:09.786990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:26:09.786990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:26:09.786990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:26:09.786990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:26:09.786990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:26:09.786990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:26:09.786990 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:26:09.786990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7d208227-d261-4d1a-a8db-4e420a9ecebd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 404 to user: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:26:09.786990 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7d208227-d261-4d1a-a8db-4e420a9ecebd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 404 len: 111 microversion: 2.1 time: 0.033256 Sep 06 11:26:09.786990 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2988/6027] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:09 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:26:09.792926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9d809788-ddaf-4bfc-8666-bcd1ead08bf6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '.version_select at 0x7f90f8ce79d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:09.943557 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9d809788-ddaf-4bfc-8666-bcd1ead08bf6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-242823716" status: 202 len: 0 microversion: 2.1 time: 0.154550 Sep 06 11:26:09.944198 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3040/6028] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 11:26:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-242823716 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:26:11.369158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-05dd7af4-bba2-449e-9da7-cbe6feae004e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Action: 'create', calling method: .version_select at 0x7f90f33c9700>, body: {"keypair": {"name": "tempest-keypair-971956540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8cvffOdGVAjA0jbBMIzmYhNXHHMgqC9YKVXxUNNcACFt5NWRa/X+EzUyDG7LLpp1g/nV/YhORK+YNpFP6hyEhKFh7bHsq6EHRvwD0c+1r5btkoWHia8zBcKF7g47T9/Q=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:26:11.391387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-05dd7af4-bba2-449e-9da7-cbe6feae004e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:26:11.395619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-05dd7af4-bba2-449e-9da7-cbe6feae004e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for user 5458eb197e36456fb7785c8625ed3140 and project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:26:11.508617 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-05dd7af4-bba2-449e-9da7-cbe6feae004e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.144938 Sep 06 11:26:11.509411 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2989/6029] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:26:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:26:14.529099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1413922058", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5afb62db-b7e6-4507-bc2c-7aab6bc880b4"}], "security_groups": [{"name": "tempest-securitygroup--540876183"}], "key_name": "tempest-keypair-971956540", "user_data": "}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:26:14.672856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] validate_networks() for [('5afb62db-b7e6-4507-bc2c-7aab6bc880b4', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:26:15.098955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:26:15.099421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:26:15.099907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:26:15.100440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:26:15.100912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:26:15.110568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:15.114122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:15.114122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:15.114122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:15.114122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:15.114122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:15.131583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:26:15.137138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for user 5458eb197e36456fb7785c8625ed3140 and project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:26:15.151303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:26:15.153944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:26:15.275931 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-017cf2fe-65cc-4bb2-b5cd-e3c996638344 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.744222 Sep 06 11:26:15.277325 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3041/6030] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:26:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:26:15.289680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a0b188bb-73fd-449e-8f20-acc9ee8b1904 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:15.290402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a0b188bb-73fd-449e-8f20-acc9ee8b1904 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:15.381326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a0b188bb-73fd-449e-8f20-acc9ee8b1904 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:15.393613 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a0b188bb-73fd-449e-8f20-acc9ee8b1904 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1241 microversion: 2.1 time: 0.108389 Sep 06 11:26:15.395039 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2990/6031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:15 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:26:16.419588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8247ab8e-cef3-4f66-a8e9-9ab66b04740e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:16.421233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8247ab8e-cef3-4f66-a8e9-9ab66b04740e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:16.511462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8247ab8e-cef3-4f66-a8e9-9ab66b04740e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:16.525330 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8247ab8e-cef3-4f66-a8e9-9ab66b04740e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1241 microversion: 2.1 time: 0.110686 Sep 06 11:26:16.529895 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3042/6032] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:16 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:26:17.554842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dd0d747f-4fa3-4be6-adba-ed89a907bf8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:17.555730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dd0d747f-4fa3-4be6-adba-ed89a907bf8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:17.563862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd0d747f-4fa3-4be6-adba-ed89a907bf8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:17.564619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd0d747f-4fa3-4be6-adba-ed89a907bf8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:17.565280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd0d747f-4fa3-4be6-adba-ed89a907bf8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:17.566005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd0d747f-4fa3-4be6-adba-ed89a907bf8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:17.566644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd0d747f-4fa3-4be6-adba-ed89a907bf8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:17.567823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd0d747f-4fa3-4be6-adba-ed89a907bf8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:17.657996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dd0d747f-4fa3-4be6-adba-ed89a907bf8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:17.667580 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dd0d747f-4fa3-4be6-adba-ed89a907bf8d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1301 microversion: 2.1 time: 0.117413 Sep 06 11:26:17.668271 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2991/6033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:17 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1301 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:26:18.693368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5eaec0eb-1d1e-4e5c-af38-11e08c47a564 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:18.695208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5eaec0eb-1d1e-4e5c-af38-11e08c47a564 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:18.706444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5eaec0eb-1d1e-4e5c-af38-11e08c47a564 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:18.707551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5eaec0eb-1d1e-4e5c-af38-11e08c47a564 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:18.708008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5eaec0eb-1d1e-4e5c-af38-11e08c47a564 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:18.708749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5eaec0eb-1d1e-4e5c-af38-11e08c47a564 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:18.709222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5eaec0eb-1d1e-4e5c-af38-11e08c47a564 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:18.709851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5eaec0eb-1d1e-4e5c-af38-11e08c47a564 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:18.950729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5eaec0eb-1d1e-4e5c-af38-11e08c47a564 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:18.960716 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5eaec0eb-1d1e-4e5c-af38-11e08c47a564 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1366 microversion: 2.1 time: 0.272648 Sep 06 11:26:18.962077 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3043/6034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:18 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:26:19.833215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-fcd96596-703b-42ec-8aa6-03e5b93a8d82 req-135ce3d9-13e1-4089-ae2a-639f6c7dd09b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b2ee3b-ca28-4bf7-9135-238f13282019", "tag": "694aed09-1a15-481f-b6ec-cc841084a6c2"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:26:19.843981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fcd96596-703b-42ec-8aa6-03e5b93a8d82 req-135ce3d9-13e1-4089-ae2a-639f6c7dd09b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:19.844460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fcd96596-703b-42ec-8aa6-03e5b93a8d82 req-135ce3d9-13e1-4089-ae2a-639f6c7dd09b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:19.844900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fcd96596-703b-42ec-8aa6-03e5b93a8d82 req-135ce3d9-13e1-4089-ae2a-639f6c7dd09b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:19.856154 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-fcd96596-703b-42ec-8aa6-03e5b93a8d82 req-135ce3d9-13e1-4089-ae2a-639f6c7dd09b service nova] Creating event network-changed:694aed09-1a15-481f-b6ec-cc841084a6c2 for instance c4b2ee3b-ca28-4bf7-9135-238f13282019 on nch1-master-1 Sep 06 11:26:19.861405 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-fcd96596-703b-42ec-8aa6-03e5b93a8d82 req-135ce3d9-13e1-4089-ae2a-639f6c7dd09b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033003 Sep 06 11:26:19.862012 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2992/6035] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:26:19.986320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b26b8a38-444e-4aba-a195-86a1a6a46489 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:19.987085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b26b8a38-444e-4aba-a195-86a1a6a46489 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:19.996263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b26b8a38-444e-4aba-a195-86a1a6a46489 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:19.996855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b26b8a38-444e-4aba-a195-86a1a6a46489 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:19.997567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b26b8a38-444e-4aba-a195-86a1a6a46489 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:19.998379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b26b8a38-444e-4aba-a195-86a1a6a46489 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:19.999103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b26b8a38-444e-4aba-a195-86a1a6a46489 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:19.999716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b26b8a38-444e-4aba-a195-86a1a6a46489 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:20.245964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b26b8a38-444e-4aba-a195-86a1a6a46489 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:20.256123 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b26b8a38-444e-4aba-a195-86a1a6a46489 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1366 microversion: 2.1 time: 0.273811 Sep 06 11:26:20.260691 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3044/6036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:19 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:26:21.283282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-986c2e44-60af-4230-a9f0-5418f9917228 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:21.284089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-986c2e44-60af-4230-a9f0-5418f9917228 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:21.293918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-986c2e44-60af-4230-a9f0-5418f9917228 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:21.294423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-986c2e44-60af-4230-a9f0-5418f9917228 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:21.296349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-986c2e44-60af-4230-a9f0-5418f9917228 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:21.297804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-986c2e44-60af-4230-a9f0-5418f9917228 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:21.298559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-986c2e44-60af-4230-a9f0-5418f9917228 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:21.299035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-986c2e44-60af-4230-a9f0-5418f9917228 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:21.505756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-986c2e44-60af-4230-a9f0-5418f9917228 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:21.521375 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-986c2e44-60af-4230-a9f0-5418f9917228 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1366 microversion: 2.1 time: 0.243386 Sep 06 11:26:21.523182 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2993/6037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:21 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:26:22.550113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aec4d0b8-0699-4bbf-802f-02a2f5821322 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:22.551758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aec4d0b8-0699-4bbf-802f-02a2f5821322 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:22.560166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aec4d0b8-0699-4bbf-802f-02a2f5821322 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:22.560901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aec4d0b8-0699-4bbf-802f-02a2f5821322 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:22.561552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aec4d0b8-0699-4bbf-802f-02a2f5821322 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:22.562327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aec4d0b8-0699-4bbf-802f-02a2f5821322 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:22.566789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aec4d0b8-0699-4bbf-802f-02a2f5821322 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:22.566789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aec4d0b8-0699-4bbf-802f-02a2f5821322 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:22.746937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aec4d0b8-0699-4bbf-802f-02a2f5821322 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:22.760919 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aec4d0b8-0699-4bbf-802f-02a2f5821322 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1366 microversion: 2.1 time: 0.217279 Sep 06 11:26:22.761782 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3045/6038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:22 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:26:23.790112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-12d5014a-d6f4-487f-b3ce-30de259a4a9d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:23.790986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-12d5014a-d6f4-487f-b3ce-30de259a4a9d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:23.798899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12d5014a-d6f4-487f-b3ce-30de259a4a9d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:23.799778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12d5014a-d6f4-487f-b3ce-30de259a4a9d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:23.800277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12d5014a-d6f4-487f-b3ce-30de259a4a9d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:23.801912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12d5014a-d6f4-487f-b3ce-30de259a4a9d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:23.802729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12d5014a-d6f4-487f-b3ce-30de259a4a9d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:23.803281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12d5014a-d6f4-487f-b3ce-30de259a4a9d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:23.968747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-12d5014a-d6f4-487f-b3ce-30de259a4a9d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:23.987449 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-12d5014a-d6f4-487f-b3ce-30de259a4a9d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1366 microversion: 2.1 time: 0.201463 Sep 06 11:26:23.988125 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2994/6039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:23 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:26:25.012462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5d7b704-630c-411e-999b-2c30ef713ba4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:25.013820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a5d7b704-630c-411e-999b-2c30ef713ba4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:25.024038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5d7b704-630c-411e-999b-2c30ef713ba4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:25.025732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5d7b704-630c-411e-999b-2c30ef713ba4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:25.026384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5d7b704-630c-411e-999b-2c30ef713ba4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:25.027323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5d7b704-630c-411e-999b-2c30ef713ba4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:25.027965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5d7b704-630c-411e-999b-2c30ef713ba4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:25.028620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5d7b704-630c-411e-999b-2c30ef713ba4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:25.120128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:25.243512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a5d7b704-630c-411e-999b-2c30ef713ba4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:25.251603 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a5d7b704-630c-411e-999b-2c30ef713ba4 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1366 microversion: 2.1 time: 0.243888 Sep 06 11:26:25.252403 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3046/6040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:25 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:26:25.392673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:25.594436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e4614ea0-8c77-4cfb-b65a-43ac0f5f5ebe req-ce91e231-7628-45ca-95b3-233c6e3a709d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b2ee3b-ca28-4bf7-9135-238f13282019", "name": "network-vif-plugged", "status": "completed", "tag": "694aed09-1a15-481f-b6ec-cc841084a6c2"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:26:25.605611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e4614ea0-8c77-4cfb-b65a-43ac0f5f5ebe req-ce91e231-7628-45ca-95b3-233c6e3a709d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:25.606099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e4614ea0-8c77-4cfb-b65a-43ac0f5f5ebe req-ce91e231-7628-45ca-95b3-233c6e3a709d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:25.606808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e4614ea0-8c77-4cfb-b65a-43ac0f5f5ebe req-ce91e231-7628-45ca-95b3-233c6e3a709d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:25.625282 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e4614ea0-8c77-4cfb-b65a-43ac0f5f5ebe req-ce91e231-7628-45ca-95b3-233c6e3a709d service nova] Creating event network-vif-plugged:694aed09-1a15-481f-b6ec-cc841084a6c2 for instance c4b2ee3b-ca28-4bf7-9135-238f13282019 on nch1-master-1 Sep 06 11:26:25.633441 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e4614ea0-8c77-4cfb-b65a-43ac0f5f5ebe req-ce91e231-7628-45ca-95b3-233c6e3a709d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251872 Sep 06 11:26:25.634616 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2995/6041] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:26:26.276317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-57fb218c-fe59-405e-9a63-db7a9ab6592f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:26.277661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-57fb218c-fe59-405e-9a63-db7a9ab6592f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:26.288322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57fb218c-fe59-405e-9a63-db7a9ab6592f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:26.289269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57fb218c-fe59-405e-9a63-db7a9ab6592f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:26.289952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57fb218c-fe59-405e-9a63-db7a9ab6592f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:26.291419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57fb218c-fe59-405e-9a63-db7a9ab6592f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:26.292260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57fb218c-fe59-405e-9a63-db7a9ab6592f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:26.293200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57fb218c-fe59-405e-9a63-db7a9ab6592f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:26.298486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=84 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:26.483443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-57fb218c-fe59-405e-9a63-db7a9ab6592f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:26.493263 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-57fb218c-fe59-405e-9a63-db7a9ab6592f tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1366 microversion: 2.1 time: 0.220912 Sep 06 11:26:26.494316 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3047/6042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:26 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:26:27.518072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-372ea6c2-7682-4319-adbd-f4433e6fe52a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:27.519700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-372ea6c2-7682-4319-adbd-f4433e6fe52a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:27.531321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372ea6c2-7682-4319-adbd-f4433e6fe52a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:27.532287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372ea6c2-7682-4319-adbd-f4433e6fe52a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:27.532718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372ea6c2-7682-4319-adbd-f4433e6fe52a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:27.533436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372ea6c2-7682-4319-adbd-f4433e6fe52a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:27.534753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372ea6c2-7682-4319-adbd-f4433e6fe52a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:27.535880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372ea6c2-7682-4319-adbd-f4433e6fe52a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:27.582231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:27.742563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-372ea6c2-7682-4319-adbd-f4433e6fe52a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:26:27.751328 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-372ea6c2-7682-4319-adbd-f4433e6fe52a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1556 microversion: 2.1 time: 0.238330 Sep 06 11:26:27.752118 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2996/6043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:26:27 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1556 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:26:27.774530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-45db5400-f809-4d57-87e7-9d28c573a9d5 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:26:27.775234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-45db5400-f809-4d57-87e7-9d28c573a9d5 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:26:27.777827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:27.784201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-45db5400-f809-4d57-87e7-9d28c573a9d5 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:27.785325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-45db5400-f809-4d57-87e7-9d28c573a9d5 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:27.785962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-45db5400-f809-4d57-87e7-9d28c573a9d5 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:27.787704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-45db5400-f809-4d57-87e7-9d28c573a9d5 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:27.788173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-45db5400-f809-4d57-87e7-9d28c573a9d5 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:27.788626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-45db5400-f809-4d57-87e7-9d28c573a9d5 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:27.924335 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-45db5400-f809-4d57-87e7-9d28c573a9d5 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.152019 Sep 06 11:26:27.924335 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3048/6044] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:26:27 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:26:29.588495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-4191a9d9-05b1-478c-afcc-871df16bae55 req-6c1a78ba-5059-408f-afd0-82a0ef4ef0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b2ee3b-ca28-4bf7-9135-238f13282019", "tag": "694aed09-1a15-481f-b6ec-cc841084a6c2"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:26:29.599605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4191a9d9-05b1-478c-afcc-871df16bae55 req-6c1a78ba-5059-408f-afd0-82a0ef4ef0ff service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:26:29.600208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4191a9d9-05b1-478c-afcc-871df16bae55 req-6c1a78ba-5059-408f-afd0-82a0ef4ef0ff service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:26:29.600852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4191a9d9-05b1-478c-afcc-871df16bae55 req-6c1a78ba-5059-408f-afd0-82a0ef4ef0ff service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:26:29.613584 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-4191a9d9-05b1-478c-afcc-871df16bae55 req-6c1a78ba-5059-408f-afd0-82a0ef4ef0ff service nova] Creating event network-changed:694aed09-1a15-481f-b6ec-cc841084a6c2 for instance c4b2ee3b-ca28-4bf7-9135-238f13282019 on nch1-master-1 Sep 06 11:26:29.626450 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-4191a9d9-05b1-478c-afcc-871df16bae55 req-6c1a78ba-5059-408f-afd0-82a0ef4ef0ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244695 Sep 06 11:26:29.627889 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2997/6045] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:27:03.460764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:03.461547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=9 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:03.466071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-47c1d9da-55a5-4851-a9fb-2baab9d7d9ce tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:03.466612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-47c1d9da-55a5-4851-a9fb-2baab9d7d9ce tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:03.473197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47c1d9da-55a5-4851-a9fb-2baab9d7d9ce tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:03.473696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47c1d9da-55a5-4851-a9fb-2baab9d7d9ce tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:03.474148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47c1d9da-55a5-4851-a9fb-2baab9d7d9ce tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:03.474973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47c1d9da-55a5-4851-a9fb-2baab9d7d9ce tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:03.475463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47c1d9da-55a5-4851-a9fb-2baab9d7d9ce tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:03.475899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-47c1d9da-55a5-4851-a9fb-2baab9d7d9ce tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:03.503518 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-47c1d9da-55a5-4851-a9fb-2baab9d7d9ce tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/ips" status: 200 len: 150 microversion: 2.1 time: 0.043656 Sep 06 11:27:03.504455 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3049/6046] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:27:03 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:27:06.409360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-67b8992c-16bb-4548-add6-bfaaef3637fe tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7802977-f4fe-4eec-a9a4-6c7e555ce808"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:27:06.412189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-67b8992c-16bb-4548-add6-bfaaef3637fe tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:06.416055 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:06.431094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67b8992c-16bb-4548-add6-bfaaef3637fe tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:06.431603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67b8992c-16bb-4548-add6-bfaaef3637fe tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:06.432273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67b8992c-16bb-4548-add6-bfaaef3637fe tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:06.433001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67b8992c-16bb-4548-add6-bfaaef3637fe tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:06.433699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67b8992c-16bb-4548-add6-bfaaef3637fe tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:06.434101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67b8992c-16bb-4548-add6-bfaaef3637fe tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:07.507971 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-67b8992c-16bb-4548-add6-bfaaef3637fe tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "POST /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.104916 Sep 06 11:27:07.515455 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2998/6047] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:27:06 2022] POST /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/os-volume_attachments => generated 194 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:27:12.036244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5a6b127a-7767-42f3-86fd-533490f7e63e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7802977-f4fe-4eec-a9a4-6c7e555ce808"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:27:12.042993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5a6b127a-7767-42f3-86fd-533490f7e63e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:12.052265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a6b127a-7767-42f3-86fd-533490f7e63e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:12.052915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a6b127a-7767-42f3-86fd-533490f7e63e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:12.053775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a6b127a-7767-42f3-86fd-533490f7e63e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:12.055366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a6b127a-7767-42f3-86fd-533490f7e63e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:12.056784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a6b127a-7767-42f3-86fd-533490f7e63e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:12.057216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a6b127a-7767-42f3-86fd-533490f7e63e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:12.178404 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-5a6b127a-7767-42f3-86fd-533490f7e63e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Invalid volume: volume e7802977-f4fe-4eec-a9a4-6c7e555ce808 is already attached to instances: c4b2ee3b-ca28-4bf7-9135-238f13282019 Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5a6b127a-7767-42f3-86fd-533490f7e63e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/os-volume_attachments HTTP/1.1 Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 74 Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: {"volumeAttachment": {"volumeId": "e7802977-f4fe-4eec-a9a4-6c7e555ce808"}} Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: exception: Invalid volume: volume e7802977-f4fe-4eec-a9a4-6c7e555ce808 is already attached to instances: c4b2ee3b-ca28-4bf7-9135-238f13282019 Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'server_id': 'c4b2ee3b-ca28-4bf7-9135-238f13282019', 'body': {'volumeAttachment': {'volumeId': 'e7802977-f4fe-4eec-a9a4-6c7e555ce808'}}} Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e7802977-f4fe-4eec-a9a4-6c7e555ce808 is already attached to instances: c4b2ee3b-ca28-4bf7-9135-238f13282019 Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:27:12.180634 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e7802977-f4fe-4eec-a9a4-6c7e555ce808 is already attached to instances: c4b2ee3b-ca28-4bf7-9135-238f13282019 Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e7802977-f4fe-4eec-a9a4-6c7e555ce808 is already attached to instances: c4b2ee3b-ca28-4bf7-9135-238f13282019 Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5a6b127a-7767-42f3-86fd-533490f7e63e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 400 to user: Invalid volume: volume e7802977-f4fe-4eec-a9a4-6c7e555ce808 is already attached to instances: c4b2ee3b-ca28-4bf7-9135-238f13282019 {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5a6b127a-7767-42f3-86fd-533490f7e63e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "POST /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.152058 Sep 06 11:27:12.185792 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3050/6048] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:27:12 2022] POST /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/os-volume_attachments => generated 174 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:27:12.295913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dd95e972-34c6-443e-b379-d1e895918148 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:12.296512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dd95e972-34c6-443e-b379-d1e895918148 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:12.302877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd95e972-34c6-443e-b379-d1e895918148 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:12.303422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd95e972-34c6-443e-b379-d1e895918148 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:12.303867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd95e972-34c6-443e-b379-d1e895918148 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:12.304573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd95e972-34c6-443e-b379-d1e895918148 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:12.305035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd95e972-34c6-443e-b379-d1e895918148 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:12.305465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd95e972-34c6-443e-b379-d1e895918148 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:12.450996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-dd95e972-34c6-443e-b379-d1e895918148 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lazy-loading 'services' on Instance uuid c4b2ee3b-ca28-4bf7-9135-238f13282019 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:27:12.700809 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dd95e972-34c6-443e-b379-d1e895918148 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/os-volume_attachments/e7802977-f4fe-4eec-a9a4-6c7e555ce808" status: 202 len: 0 microversion: 2.1 time: 0.406332 Sep 06 11:27:12.707991 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 2999/6049] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 11:27:12 2022] DELETE /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/os-volume_attachments/e7802977-f4fe-4eec-a9a4-6c7e555ce808 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:27:12.721085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a12aab62-5b1b-4c60-a78c-622d9c4532b7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:12.724331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a12aab62-5b1b-4c60-a78c-622d9c4532b7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:12.740621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12aab62-5b1b-4c60-a78c-622d9c4532b7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:12.741317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12aab62-5b1b-4c60-a78c-622d9c4532b7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:12.742302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12aab62-5b1b-4c60-a78c-622d9c4532b7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:12.743262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12aab62-5b1b-4c60-a78c-622d9c4532b7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:12.743910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12aab62-5b1b-4c60-a78c-622d9c4532b7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:12.744524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12aab62-5b1b-4c60-a78c-622d9c4532b7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:12.788903 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a12aab62-5b1b-4c60-a78c-622d9c4532b7 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081644 Sep 06 11:27:12.789928 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3051/6050] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:27:12 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:27:13.805545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0d6c5aaf-541a-4260-96ef-e6e0587694f8 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:13.809140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0d6c5aaf-541a-4260-96ef-e6e0587694f8 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:13.816347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d6c5aaf-541a-4260-96ef-e6e0587694f8 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:13.817180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d6c5aaf-541a-4260-96ef-e6e0587694f8 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:13.817725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d6c5aaf-541a-4260-96ef-e6e0587694f8 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:13.818552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d6c5aaf-541a-4260-96ef-e6e0587694f8 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:13.819234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d6c5aaf-541a-4260-96ef-e6e0587694f8 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:13.819822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0d6c5aaf-541a-4260-96ef-e6e0587694f8 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:13.864235 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0d6c5aaf-541a-4260-96ef-e6e0587694f8 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066044 Sep 06 11:27:13.864838 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3000/6051] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:27:13 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:27:13.970250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0589b346-fab3-4af1-8e0f-3bb3ba10c4cc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:13.972465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0589b346-fab3-4af1-8e0f-3bb3ba10c4cc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:13.983963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0589b346-fab3-4af1-8e0f-3bb3ba10c4cc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:13.984490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0589b346-fab3-4af1-8e0f-3bb3ba10c4cc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:13.984955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0589b346-fab3-4af1-8e0f-3bb3ba10c4cc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:13.985709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0589b346-fab3-4af1-8e0f-3bb3ba10c4cc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:13.986189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0589b346-fab3-4af1-8e0f-3bb3ba10c4cc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:13.986664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0589b346-fab3-4af1-8e0f-3bb3ba10c4cc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:14.040112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0589b346-fab3-4af1-8e0f-3bb3ba10c4cc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:27:14.382039 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0589b346-fab3-4af1-8e0f-3bb3ba10c4cc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 204 len: 0 microversion: 2.1 time: 0.415854 Sep 06 11:27:14.382683 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3052/6052] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:27:13 2022] DELETE /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:27:14.391328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6ddb0021-d403-4a39-b267-7e4ee352df07 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:14.391957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6ddb0021-d403-4a39-b267-7e4ee352df07 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:14.399376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ddb0021-d403-4a39-b267-7e4ee352df07 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:14.399871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ddb0021-d403-4a39-b267-7e4ee352df07 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:14.400378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ddb0021-d403-4a39-b267-7e4ee352df07 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:14.401092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ddb0021-d403-4a39-b267-7e4ee352df07 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:14.401550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ddb0021-d403-4a39-b267-7e4ee352df07 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:14.401983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6ddb0021-d403-4a39-b267-7e4ee352df07 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:14.672377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6ddb0021-d403-4a39-b267-7e4ee352df07 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:14.686706 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6ddb0021-d403-4a39-b267-7e4ee352df07 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1681 microversion: 2.1 time: 0.299441 Sep 06 11:27:14.692855 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3001/6053] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:14 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1681 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:15.712373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-96cccf90-9e4c-4648-bbfd-0b2b2f4ed418 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:15.713096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-96cccf90-9e4c-4648-bbfd-0b2b2f4ed418 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:15.720002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96cccf90-9e4c-4648-bbfd-0b2b2f4ed418 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:15.720499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96cccf90-9e4c-4648-bbfd-0b2b2f4ed418 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:15.720957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96cccf90-9e4c-4648-bbfd-0b2b2f4ed418 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:15.721662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96cccf90-9e4c-4648-bbfd-0b2b2f4ed418 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:15.722133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96cccf90-9e4c-4648-bbfd-0b2b2f4ed418 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:15.722572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96cccf90-9e4c-4648-bbfd-0b2b2f4ed418 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:16.001731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-96cccf90-9e4c-4648-bbfd-0b2b2f4ed418 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:16.014572 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-96cccf90-9e4c-4648-bbfd-0b2b2f4ed418 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1681 microversion: 2.1 time: 0.306525 Sep 06 11:27:16.024094 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3053/6054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:15 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1681 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:17.054597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c423e551-9276-4c49-b82c-ae959fdb422b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:17.055272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c423e551-9276-4c49-b82c-ae959fdb422b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:17.062561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c423e551-9276-4c49-b82c-ae959fdb422b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:17.063103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c423e551-9276-4c49-b82c-ae959fdb422b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:17.063558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c423e551-9276-4c49-b82c-ae959fdb422b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:17.064279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c423e551-9276-4c49-b82c-ae959fdb422b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:17.065481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c423e551-9276-4c49-b82c-ae959fdb422b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:17.065937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c423e551-9276-4c49-b82c-ae959fdb422b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:17.164166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c423e551-9276-4c49-b82c-ae959fdb422b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:17.185985 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c423e551-9276-4c49-b82c-ae959fdb422b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1614 microversion: 2.1 time: 0.135298 Sep 06 11:27:17.191247 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3002/6055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:17 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1614 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:17.611235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-1a4c87ac-0000-4751-a527-242954147a1c req-bc6969d6-162d-4b39-aed1-3991d434df5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b2ee3b-ca28-4bf7-9135-238f13282019", "name": "network-vif-deleted", "tag": "694aed09-1a15-481f-b6ec-cc841084a6c2"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:27:17.633210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1a4c87ac-0000-4751-a527-242954147a1c req-bc6969d6-162d-4b39-aed1-3991d434df5a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:17.634061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1a4c87ac-0000-4751-a527-242954147a1c req-bc6969d6-162d-4b39-aed1-3991d434df5a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:17.634692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1a4c87ac-0000-4751-a527-242954147a1c req-bc6969d6-162d-4b39-aed1-3991d434df5a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:17.649156 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-1a4c87ac-0000-4751-a527-242954147a1c req-bc6969d6-162d-4b39-aed1-3991d434df5a service nova] Creating event network-vif-deleted:694aed09-1a15-481f-b6ec-cc841084a6c2 for instance c4b2ee3b-ca28-4bf7-9135-238f13282019 on nch1-master-1 Sep 06 11:27:17.664924 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-1a4c87ac-0000-4751-a527-242954147a1c req-bc6969d6-162d-4b39-aed1-3991d434df5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383610 Sep 06 11:27:17.665577 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3054/6056] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:27:18.217194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:18.218628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:18.234745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:18.235887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:18.236971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:18.238352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:18.239238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:18.239928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:18.292760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:18.293633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:18.294267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:18.294919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lazy-loading 'fault' on Instance uuid c4b2ee3b-ca28-4bf7-9135-238f13282019 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:27:18.400277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:18.417606 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2f627795-2634-48a6-ad03-2eb6669ff243 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 200 len: 1331 microversion: 2.1 time: 0.206711 Sep 06 11:27:18.431524 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3003/6057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:18 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 1331 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:19.444455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e31f47a3-440a-4acd-8ab3-dd4bb8edb0bb tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:19.445871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e31f47a3-440a-4acd-8ab3-dd4bb8edb0bb tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:19.453760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e31f47a3-440a-4acd-8ab3-dd4bb8edb0bb tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:19.454552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e31f47a3-440a-4acd-8ab3-dd4bb8edb0bb tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:19.454996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e31f47a3-440a-4acd-8ab3-dd4bb8edb0bb tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:19.456308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e31f47a3-440a-4acd-8ab3-dd4bb8edb0bb tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:19.456965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e31f47a3-440a-4acd-8ab3-dd4bb8edb0bb tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:19.457406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e31f47a3-440a-4acd-8ab3-dd4bb8edb0bb tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:19.482914 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-e31f47a3-440a-4acd-8ab3-dd4bb8edb0bb tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e31f47a3-440a-4acd-8ab3-dd4bb8edb0bb tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 HTTP/1.1 Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'c4b2ee3b-ca28-4bf7-9135-238f13282019'} Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:27:19.485355 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:27:19.491002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:27:19.491002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:27:19.491002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:27:19.491002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:27:19.491002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:27:19.491002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:27:19.491002 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:27:19.493806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e31f47a3-440a-4acd-8ab3-dd4bb8edb0bb tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 404 to user: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:27:19.495674 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e31f47a3-440a-4acd-8ab3-dd4bb8edb0bb tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 404 len: 111 microversion: 2.1 time: 0.055870 Sep 06 11:27:19.503600 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3055/6058] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:19 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:27:19.509366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5ad561f4-bea6-4ddc-aaab-76835aa7e2c2 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '.version_select at 0x7f90f32b4040>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:19.605877 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5ad561f4-bea6-4ddc-aaab-76835aa7e2c2 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-971956540" status: 202 len: 0 microversion: 2.1 time: 0.100629 Sep 06 11:27:19.606487 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3004/6059] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 11:27:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-971956540 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:27:20.760281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9fb74051-4fa7-408c-aa0c-d39bbdd3ef5b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Action: 'create', calling method: .version_select at 0x7f90f349fe50>, body: {"keypair": {"name": "tempest-keypair-1587685519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJun4yGrn0beg5PUpj8XiRuYv+IDmd0hmIpqnNoK76OyLwJVVc8Mvh5rhWPTayeXW40j+QLZoqoeJrgtQuUeMudWNDDLagSS+9NOl2oN2bsvE73YhEO1GYUYbeh9tJpL/w=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:27:20.791970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-9fb74051-4fa7-408c-aa0c-d39bbdd3ef5b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:27:20.798674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-9fb74051-4fa7-408c-aa0c-d39bbdd3ef5b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for user 5458eb197e36456fb7785c8625ed3140 and project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:27:20.920810 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9fb74051-4fa7-408c-aa0c-d39bbdd3ef5b tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.164398 Sep 06 11:27:20.921699 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3056/6060] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:27:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:27:24.665950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1215009770", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5afb62db-b7e6-4507-bc2c-7aab6bc880b4"}], "security_groups": [{"name": "tempest-securitygroup--1119263058"}], "key_name": "tempest-keypair-1587685519", "user_data": "}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:27:24.787576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] validate_networks() for [('5afb62db-b7e6-4507-bc2c-7aab6bc880b4', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:27:25.306786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:27:25.308246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:27:25.310954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:27:25.313286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:27:25.315168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:27:25.330755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:25.331318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:25.331769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:25.332889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:25.333848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:25.334475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:25.355359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:27:25.361423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Getting quotas for user 5458eb197e36456fb7785c8625ed3140 and project 2f6a64ebac2146b9a92c0ed0ac76a5fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:27:25.376151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:27:25.378638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:27:25.514647 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-663eb79d-edac-4b9d-ace5-e2862ae5a049 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.854157 Sep 06 11:27:25.515536 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3005/6061] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:27:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:27:25.527588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2274031c-ec56-4033-a15d-187303b6423a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:25.528931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2274031c-ec56-4033-a15d-187303b6423a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:25.596995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2274031c-ec56-4033-a15d-187303b6423a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:25.604793 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2274031c-ec56-4033-a15d-187303b6423a tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1242 microversion: 2.1 time: 0.081123 Sep 06 11:27:25.606110 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3057/6062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:25 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:26.637584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-69f27fe4-fbb9-434a-842e-2735142593a9 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:26.640299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-69f27fe4-fbb9-434a-842e-2735142593a9 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:26.700201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-69f27fe4-fbb9-434a-842e-2735142593a9 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:26.707890 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-69f27fe4-fbb9-434a-842e-2735142593a9 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1242 microversion: 2.1 time: 0.075913 Sep 06 11:27:26.709306 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3006/6063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:26 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:27.731565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1aea77b0-7f23-42e0-be9a-c11655f1e754 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:27.732197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1aea77b0-7f23-42e0-be9a-c11655f1e754 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:27.740165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1aea77b0-7f23-42e0-be9a-c11655f1e754 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:27.740708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1aea77b0-7f23-42e0-be9a-c11655f1e754 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:27.741315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1aea77b0-7f23-42e0-be9a-c11655f1e754 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:27.742049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1aea77b0-7f23-42e0-be9a-c11655f1e754 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:27.742520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1aea77b0-7f23-42e0-be9a-c11655f1e754 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:27.742964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1aea77b0-7f23-42e0-be9a-c11655f1e754 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:27.843400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1aea77b0-7f23-42e0-be9a-c11655f1e754 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:27.859544 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1aea77b0-7f23-42e0-be9a-c11655f1e754 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1294 microversion: 2.1 time: 0.124972 Sep 06 11:27:27.859544 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3058/6064] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:27 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1294 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:28.877990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-75f41914-0d6d-42e5-87aa-21fa2cacc18d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:28.878619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-75f41914-0d6d-42e5-87aa-21fa2cacc18d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:28.886087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75f41914-0d6d-42e5-87aa-21fa2cacc18d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:28.886637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75f41914-0d6d-42e5-87aa-21fa2cacc18d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:28.887120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75f41914-0d6d-42e5-87aa-21fa2cacc18d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:28.887840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75f41914-0d6d-42e5-87aa-21fa2cacc18d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:28.888300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75f41914-0d6d-42e5-87aa-21fa2cacc18d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:28.888727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75f41914-0d6d-42e5-87aa-21fa2cacc18d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:28.961639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-75f41914-0d6d-42e5-87aa-21fa2cacc18d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:28.971076 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-75f41914-0d6d-42e5-87aa-21fa2cacc18d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1300 microversion: 2.1 time: 0.097779 Sep 06 11:27:28.973434 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3007/6065] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:28 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:29.996068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d8e9943b-d813-4852-8b32-9743e8c66cef tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:29.999409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d8e9943b-d813-4852-8b32-9743e8c66cef tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:30.010117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8e9943b-d813-4852-8b32-9743e8c66cef tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:30.011192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8e9943b-d813-4852-8b32-9743e8c66cef tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:30.011697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8e9943b-d813-4852-8b32-9743e8c66cef tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:30.012847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8e9943b-d813-4852-8b32-9743e8c66cef tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:30.013053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8e9943b-d813-4852-8b32-9743e8c66cef tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:30.013527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8e9943b-d813-4852-8b32-9743e8c66cef tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:30.221059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d8e9943b-d813-4852-8b32-9743e8c66cef tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:30.229326 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d8e9943b-d813-4852-8b32-9743e8c66cef tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1368 microversion: 2.1 time: 0.239268 Sep 06 11:27:30.229897 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3059/6066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:29 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:30.300088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-640b2163-5c35-4738-a959-8fcc3b00c130 req-1b9c23a3-4974-418f-9392-e867f9364fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab450374-f0b1-4da7-8f06-fd9a26e932d7", "tag": "d30aad6c-e469-4a54-a44e-eed3c26ba720"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:27:30.311692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-640b2163-5c35-4738-a959-8fcc3b00c130 req-1b9c23a3-4974-418f-9392-e867f9364fb7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:30.318978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-640b2163-5c35-4738-a959-8fcc3b00c130 req-1b9c23a3-4974-418f-9392-e867f9364fb7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:30.318978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-640b2163-5c35-4738-a959-8fcc3b00c130 req-1b9c23a3-4974-418f-9392-e867f9364fb7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:30.325417 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-640b2163-5c35-4738-a959-8fcc3b00c130 req-1b9c23a3-4974-418f-9392-e867f9364fb7 service nova] Creating event network-changed:d30aad6c-e469-4a54-a44e-eed3c26ba720 for instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 on nch1-master-1 Sep 06 11:27:30.331983 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-640b2163-5c35-4738-a959-8fcc3b00c130 req-1b9c23a3-4974-418f-9392-e867f9364fb7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037373 Sep 06 11:27:30.333438 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3008/6067] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:27:31.254273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7abab210-ab0f-4e7a-abe9-731349288d18 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:31.254899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7abab210-ab0f-4e7a-abe9-731349288d18 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:31.262194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7abab210-ab0f-4e7a-abe9-731349288d18 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:31.263218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7abab210-ab0f-4e7a-abe9-731349288d18 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:31.263853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7abab210-ab0f-4e7a-abe9-731349288d18 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:31.264737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7abab210-ab0f-4e7a-abe9-731349288d18 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:31.265577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7abab210-ab0f-4e7a-abe9-731349288d18 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:31.266409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7abab210-ab0f-4e7a-abe9-731349288d18 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:31.527848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7abab210-ab0f-4e7a-abe9-731349288d18 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:31.537738 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7abab210-ab0f-4e7a-abe9-731349288d18 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1368 microversion: 2.1 time: 0.288280 Sep 06 11:27:31.538821 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3060/6068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:31 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:32.562667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93351d2d-7de8-470c-b6a9-aa3ef33fb017 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:32.563874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-93351d2d-7de8-470c-b6a9-aa3ef33fb017 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:32.571622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93351d2d-7de8-470c-b6a9-aa3ef33fb017 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:32.572039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93351d2d-7de8-470c-b6a9-aa3ef33fb017 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:32.572482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93351d2d-7de8-470c-b6a9-aa3ef33fb017 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:32.573234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93351d2d-7de8-470c-b6a9-aa3ef33fb017 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:32.573839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93351d2d-7de8-470c-b6a9-aa3ef33fb017 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:32.574317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93351d2d-7de8-470c-b6a9-aa3ef33fb017 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:32.800375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-93351d2d-7de8-470c-b6a9-aa3ef33fb017 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:32.808546 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-93351d2d-7de8-470c-b6a9-aa3ef33fb017 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1368 microversion: 2.1 time: 0.250130 Sep 06 11:27:32.809467 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3009/6069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:32 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:33.835876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b225c845-8269-43d4-85f8-7cbcb5cac373 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:33.842175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b225c845-8269-43d4-85f8-7cbcb5cac373 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:33.845331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b225c845-8269-43d4-85f8-7cbcb5cac373 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:33.845331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b225c845-8269-43d4-85f8-7cbcb5cac373 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:33.845331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b225c845-8269-43d4-85f8-7cbcb5cac373 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:33.846471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b225c845-8269-43d4-85f8-7cbcb5cac373 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:33.846942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b225c845-8269-43d4-85f8-7cbcb5cac373 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:33.847407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b225c845-8269-43d4-85f8-7cbcb5cac373 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:34.155227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b225c845-8269-43d4-85f8-7cbcb5cac373 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:34.170618 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b225c845-8269-43d4-85f8-7cbcb5cac373 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1368 microversion: 2.1 time: 0.341150 Sep 06 11:27:34.188641 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3061/6070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:33 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1368 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:35.206613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-68b35f66-efcd-4af6-8b63-b9e8eac8e350 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:35.207415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-68b35f66-efcd-4af6-8b63-b9e8eac8e350 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:35.215782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68b35f66-efcd-4af6-8b63-b9e8eac8e350 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:35.216444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68b35f66-efcd-4af6-8b63-b9e8eac8e350 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:35.217178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68b35f66-efcd-4af6-8b63-b9e8eac8e350 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:35.217983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68b35f66-efcd-4af6-8b63-b9e8eac8e350 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:35.219065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68b35f66-efcd-4af6-8b63-b9e8eac8e350 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:35.219513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68b35f66-efcd-4af6-8b63-b9e8eac8e350 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:35.343231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:35.503800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-68b35f66-efcd-4af6-8b63-b9e8eac8e350 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:35.510969 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-68b35f66-efcd-4af6-8b63-b9e8eac8e350 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1368 microversion: 2.1 time: 0.308959 Sep 06 11:27:35.511598 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3010/6071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:35 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1368 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:35.701648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-c9fed2eb-8f52-4240-9d1a-5749310338f0 req-40048837-6189-4af5-b97e-4cef5d11509a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab450374-f0b1-4da7-8f06-fd9a26e932d7", "name": "network-vif-plugged", "status": "completed", "tag": "d30aad6c-e469-4a54-a44e-eed3c26ba720"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:27:35.712104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:35.716369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c9fed2eb-8f52-4240-9d1a-5749310338f0 req-40048837-6189-4af5-b97e-4cef5d11509a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:35.716917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c9fed2eb-8f52-4240-9d1a-5749310338f0 req-40048837-6189-4af5-b97e-4cef5d11509a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:35.717455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c9fed2eb-8f52-4240-9d1a-5749310338f0 req-40048837-6189-4af5-b97e-4cef5d11509a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:35.729762 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-c9fed2eb-8f52-4240-9d1a-5749310338f0 req-40048837-6189-4af5-b97e-4cef5d11509a service nova] Creating event network-vif-plugged:d30aad6c-e469-4a54-a44e-eed3c26ba720 for instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 on nch1-master-1 Sep 06 11:27:35.735789 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-c9fed2eb-8f52-4240-9d1a-5749310338f0 req-40048837-6189-4af5-b97e-4cef5d11509a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040136 Sep 06 11:27:35.737046 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3062/6072] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:27:36.537594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c29302f2-4345-4a80-8185-37112b5f9fdd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:36.538828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c29302f2-4345-4a80-8185-37112b5f9fdd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:36.552904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c29302f2-4345-4a80-8185-37112b5f9fdd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:36.553766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c29302f2-4345-4a80-8185-37112b5f9fdd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:36.554619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c29302f2-4345-4a80-8185-37112b5f9fdd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:36.555893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c29302f2-4345-4a80-8185-37112b5f9fdd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:36.556696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c29302f2-4345-4a80-8185-37112b5f9fdd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:36.557509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c29302f2-4345-4a80-8185-37112b5f9fdd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:36.704159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:36.715382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c29302f2-4345-4a80-8185-37112b5f9fdd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:36.716484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:36.723757 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c29302f2-4345-4a80-8185-37112b5f9fdd tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1368 microversion: 2.1 time: 0.192148 Sep 06 11:27:36.724965 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3011/6073] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:36 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:37.749752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eaba3a91-52ef-40ce-a67a-e187124b5b7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:37.751111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eaba3a91-52ef-40ce-a67a-e187124b5b7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:37.760561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaba3a91-52ef-40ce-a67a-e187124b5b7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:37.761208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaba3a91-52ef-40ce-a67a-e187124b5b7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:37.761695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaba3a91-52ef-40ce-a67a-e187124b5b7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:37.762492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaba3a91-52ef-40ce-a67a-e187124b5b7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:37.763198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaba3a91-52ef-40ce-a67a-e187124b5b7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:37.763807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eaba3a91-52ef-40ce-a67a-e187124b5b7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:38.037867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eaba3a91-52ef-40ce-a67a-e187124b5b7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:38.046207 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eaba3a91-52ef-40ce-a67a-e187124b5b7e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1558 microversion: 2.1 time: 0.302285 Sep 06 11:27:38.046886 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3063/6074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:37 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1558 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:38.077550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bdc4c51d-5f44-4636-862c-54c33675971d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:38.078136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bdc4c51d-5f44-4636-862c-54c33675971d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:38.081884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:38.088560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdc4c51d-5f44-4636-862c-54c33675971d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:38.089075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdc4c51d-5f44-4636-862c-54c33675971d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:38.089591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdc4c51d-5f44-4636-862c-54c33675971d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:38.090304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdc4c51d-5f44-4636-862c-54c33675971d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:38.090768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdc4c51d-5f44-4636-862c-54c33675971d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:38.091325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdc4c51d-5f44-4636-862c-54c33675971d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:38.176832 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bdc4c51d-5f44-4636-862c-54c33675971d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103730 Sep 06 11:27:38.177730 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3012/6075] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:27:38 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:27:39.466863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a7bf9551-009c-448d-a91a-6316de0ddb7d req-16aece53-430e-4fcf-a400-67615432e9ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab450374-f0b1-4da7-8f06-fd9a26e932d7", "tag": "d30aad6c-e469-4a54-a44e-eed3c26ba720"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:27:39.478398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a7bf9551-009c-448d-a91a-6316de0ddb7d req-16aece53-430e-4fcf-a400-67615432e9ef service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:39.478923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a7bf9551-009c-448d-a91a-6316de0ddb7d req-16aece53-430e-4fcf-a400-67615432e9ef service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:39.479404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a7bf9551-009c-448d-a91a-6316de0ddb7d req-16aece53-430e-4fcf-a400-67615432e9ef service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:39.491764 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a7bf9551-009c-448d-a91a-6316de0ddb7d req-16aece53-430e-4fcf-a400-67615432e9ef service nova] Creating event network-changed:d30aad6c-e469-4a54-a44e-eed3c26ba720 for instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 on nch1-master-1 Sep 06 11:27:39.497384 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a7bf9551-009c-448d-a91a-6316de0ddb7d req-16aece53-430e-4fcf-a400-67615432e9ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034330 Sep 06 11:27:39.498408 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3064/6076] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:27:49.161753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2e8a7727-bdb9-4d4c-8b27-82f3cffabd2d tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:49.162374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2e8a7727-bdb9-4d4c-8b27-82f3cffabd2d tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:49.164837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-0f6cd67d-a7e2-4ea3-b6ef-f268986ca544 req-49f7094f-2243-4580-8b31-ce37b5c8f9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14eeb47f-c7af-4444-9575-1fcf05e45702", "tag": "acdecfc7-4cdc-45b9-b89d-fce38bedfda5"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:27:49.170065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:49.170610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e8a7727-bdb9-4d4c-8b27-82f3cffabd2d tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:49.171342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e8a7727-bdb9-4d4c-8b27-82f3cffabd2d tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:49.171792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e8a7727-bdb9-4d4c-8b27-82f3cffabd2d tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:49.172696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e8a7727-bdb9-4d4c-8b27-82f3cffabd2d tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:49.173354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e8a7727-bdb9-4d4c-8b27-82f3cffabd2d tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:49.173965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e8a7727-bdb9-4d4c-8b27-82f3cffabd2d tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:49.177212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0f6cd67d-a7e2-4ea3-b6ef-f268986ca544 req-49f7094f-2243-4580-8b31-ce37b5c8f9d6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:49.177694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0f6cd67d-a7e2-4ea3-b6ef-f268986ca544 req-49f7094f-2243-4580-8b31-ce37b5c8f9d6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:49.179831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0f6cd67d-a7e2-4ea3-b6ef-f268986ca544 req-49f7094f-2243-4580-8b31-ce37b5c8f9d6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:49.184625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:49.192788 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-0f6cd67d-a7e2-4ea3-b6ef-f268986ca544 req-49f7094f-2243-4580-8b31-ce37b5c8f9d6 service nova] Creating event network-changed:acdecfc7-4cdc-45b9-b89d-fce38bedfda5 for instance 14eeb47f-c7af-4444-9575-1fcf05e45702 on nch2-master-1 Sep 06 11:27:49.202629 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-0f6cd67d-a7e2-4ea3-b6ef-f268986ca544 req-49f7094f-2243-4580-8b31-ce37b5c8f9d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041461 Sep 06 11:27:49.203657 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3065/6077] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:27:49.221044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2e8a7727-bdb9-4d4c-8b27-82f3cffabd2d tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:27:49.588483 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2e8a7727-bdb9-4d4c-8b27-82f3cffabd2d tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 204 len: 0 microversion: 2.1 time: 0.432186 Sep 06 11:27:49.590325 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3013/6078] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:27:49 2022] DELETE /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:27:49.602809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a9c1c8cb-46ab-42bd-a08f-a9cb4f9b78ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:49.603982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a9c1c8cb-46ab-42bd-a08f-a9cb4f9b78ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:49.614111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a9c1c8cb-46ab-42bd-a08f-a9cb4f9b78ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:49.614619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a9c1c8cb-46ab-42bd-a08f-a9cb4f9b78ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:49.615175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a9c1c8cb-46ab-42bd-a08f-a9cb4f9b78ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:49.616670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a9c1c8cb-46ab-42bd-a08f-a9cb4f9b78ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:49.617568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a9c1c8cb-46ab-42bd-a08f-a9cb4f9b78ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:49.618187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a9c1c8cb-46ab-42bd-a08f-a9cb4f9b78ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:49.810303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a9c1c8cb-46ab-42bd-a08f-a9cb4f9b78ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:49.822154 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a9c1c8cb-46ab-42bd-a08f-a9cb4f9b78ed tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1582 microversion: 2.1 time: 0.226655 Sep 06 11:27:49.822757 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3066/6079] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:49 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1582 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:50.848082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c5f08861-3e48-487e-bb6f-7c77b3dec174 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:50.848800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c5f08861-3e48-487e-bb6f-7c77b3dec174 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:50.857218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f08861-3e48-487e-bb6f-7c77b3dec174 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:50.857814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f08861-3e48-487e-bb6f-7c77b3dec174 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:50.858414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f08861-3e48-487e-bb6f-7c77b3dec174 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:50.859245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f08861-3e48-487e-bb6f-7c77b3dec174 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:50.859723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f08861-3e48-487e-bb6f-7c77b3dec174 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:50.860171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f08861-3e48-487e-bb6f-7c77b3dec174 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:51.015726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c5f08861-3e48-487e-bb6f-7c77b3dec174 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:51.024285 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c5f08861-3e48-487e-bb6f-7c77b3dec174 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1582 microversion: 2.1 time: 0.180496 Sep 06 11:27:51.024878 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3014/6080] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:50 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1582 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:52.012582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-ade39f3f-f4af-458b-8baa-10a590bb18c1 req-844a132c-5ebb-4c9b-aa68-7e06fc017c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14eeb47f-c7af-4444-9575-1fcf05e45702", "name": "network-vif-deleted", "tag": "acdecfc7-4cdc-45b9-b89d-fce38bedfda5"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:27:52.026171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ade39f3f-f4af-458b-8baa-10a590bb18c1 req-844a132c-5ebb-4c9b-aa68-7e06fc017c8c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:52.026971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ade39f3f-f4af-458b-8baa-10a590bb18c1 req-844a132c-5ebb-4c9b-aa68-7e06fc017c8c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:52.027629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ade39f3f-f4af-458b-8baa-10a590bb18c1 req-844a132c-5ebb-4c9b-aa68-7e06fc017c8c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:52.040513 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-ade39f3f-f4af-458b-8baa-10a590bb18c1 req-844a132c-5ebb-4c9b-aa68-7e06fc017c8c service nova] Creating event network-vif-deleted:acdecfc7-4cdc-45b9-b89d-fce38bedfda5 for instance 14eeb47f-c7af-4444-9575-1fcf05e45702 on nch2-master-1 Sep 06 11:27:52.047857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-288e9f57-11e7-48e8-9c4d-7c56a0161fa2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:52.054896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-288e9f57-11e7-48e8-9c4d-7c56a0161fa2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:52.057386 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-ade39f3f-f4af-458b-8baa-10a590bb18c1 req-844a132c-5ebb-4c9b-aa68-7e06fc017c8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049407 Sep 06 11:27:52.058013 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3067/6081] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:27:52.062979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-288e9f57-11e7-48e8-9c4d-7c56a0161fa2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:52.063773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-288e9f57-11e7-48e8-9c4d-7c56a0161fa2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:52.064524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-288e9f57-11e7-48e8-9c4d-7c56a0161fa2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:52.065600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-288e9f57-11e7-48e8-9c4d-7c56a0161fa2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:52.066550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-288e9f57-11e7-48e8-9c4d-7c56a0161fa2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:52.066733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-288e9f57-11e7-48e8-9c4d-7c56a0161fa2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:52.140063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-288e9f57-11e7-48e8-9c4d-7c56a0161fa2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:52.149008 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-288e9f57-11e7-48e8-9c4d-7c56a0161fa2 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1396 microversion: 2.1 time: 0.104911 Sep 06 11:27:52.149878 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3015/6082] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:52 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1396 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:27:53.178405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:53.179186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:53.187244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:53.188044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:53.188501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:53.189229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:53.189701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:53.190137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:53.228352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:53.228820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:53.229252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:53.229719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lazy-loading 'fault' on Instance uuid 14eeb47f-c7af-4444-9575-1fcf05e45702 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:27:53.274258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac283e33a040a5ae2b6c85610c16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6767d15bea403e985c76bf6f2f0905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:27:53.283201 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2cdb5f98-6a4c-4c76-ad44-2de7d2b0cd2c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 200 len: 1187 microversion: 2.1 time: 0.111712 Sep 06 11:27:53.289607 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3068/6083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:53 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 1187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:27:54.309846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-91d19ab6-3b66-4c05-82e6-b59600241249 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:54.310430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-91d19ab6-3b66-4c05-82e6-b59600241249 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] [instance: 14eeb47f-c7af-4444-9575-1fcf05e45702] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:27:54.317581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91d19ab6-3b66-4c05-82e6-b59600241249 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:54.318128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91d19ab6-3b66-4c05-82e6-b59600241249 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:54.318576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91d19ab6-3b66-4c05-82e6-b59600241249 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:54.319352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91d19ab6-3b66-4c05-82e6-b59600241249 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:27:54.319820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91d19ab6-3b66-4c05-82e6-b59600241249 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:27:54.320258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91d19ab6-3b66-4c05-82e6-b59600241249 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:27:54.337962 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-91d19ab6-3b66-4c05-82e6-b59600241249 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] HTTP exception thrown: Instance 14eeb47f-c7af-4444-9575-1fcf05e45702 could not be found. Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-91d19ab6-3b66-4c05-82e6-b59600241249 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Request method failure captured: Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 HTTP/1.1 Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy2k6ZdMNpP0lnCUaqSXZYIeR5a_o3sM4ATdd5YMM3DpJ2pkn9rr7i-kcWm6AdcfqfN_SKerEbEj7Xc6I9IAi7pkp-M5rHjaH9kh7ejIVKjq44jrDgXov2ZCupWzJVPf9mw1MHJgKJtlGTBaVB4K7OJ3hKBDGazcYtJB1g2daSN8-T4 Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 9d6767d15bea403e985c76bf6f2f0905 Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestVolumeBackupRestore-739971810 Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d6767d15bea403e985c76bf6f2f0905"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d6767d15bea403e985c76bf6f2f0905"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d6767d15bea403e985c76bf6f2f0905"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d6767d15bea403e985c76bf6f2f0905"}]}] Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestVolumeBackupRestore-739971810 Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 9d6767d15bea403e985c76bf6f2f0905 Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestVolumeBackupRestore-739971810 Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestVolumeBackupRestore-739971810-project Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: d1ac283e33a040a5ae2b6c85610c16db Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestVolumeBackupRestore-739971810-project Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 14eeb47f-c7af-4444-9575-1fcf05e45702 could not be found. Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '14eeb47f-c7af-4444-9575-1fcf05e45702'} Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14eeb47f-c7af-4444-9575-1fcf05e45702 could not be found. Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14eeb47f-c7af-4444-9575-1fcf05e45702 could not be found. Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:27:54.341869 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:27:54.347971 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:27:54.347971 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:27:54.347971 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:27:54.347971 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:27:54.347971 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:27:54.347971 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14eeb47f-c7af-4444-9575-1fcf05e45702 could not be found. Sep 06 11:27:54.347971 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:27:54.347971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-91d19ab6-3b66-4c05-82e6-b59600241249 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Returning 404 to user: Instance 14eeb47f-c7af-4444-9575-1fcf05e45702 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:27:54.347971 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-91d19ab6-3b66-4c05-82e6-b59600241249 tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702" status: 404 len: 111 microversion: 2.1 time: 0.035364 Sep 06 11:27:54.347971 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3016/6084] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:27:54 2022] GET /compute/v2.1/servers/14eeb47f-c7af-4444-9575-1fcf05e45702 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:27:54.615408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9561300b-e48a-45ac-9135-f82c3e12224c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] Calling method '.version_select at 0x7f90f8a2a280>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:27:54.766041 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9561300b-e48a-45ac-9135-f82c3e12224c tempest-TestVolumeBackupRestore-739971810 tempest-TestVolumeBackupRestore-739971810-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-386827205" status: 202 len: 0 microversion: 2.1 time: 0.154802 Sep 06 11:27:54.766672 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3069/6085] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:27:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-386827205 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:28:09.912515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6980c976-46a0-4100-8866-41dba7ffc4bc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:09.912961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6980c976-46a0-4100-8866-41dba7ffc4bc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:09.916722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:09.917397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:09.921185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6980c976-46a0-4100-8866-41dba7ffc4bc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:09.921688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6980c976-46a0-4100-8866-41dba7ffc4bc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:09.922142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6980c976-46a0-4100-8866-41dba7ffc4bc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:09.922864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6980c976-46a0-4100-8866-41dba7ffc4bc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:09.923364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6980c976-46a0-4100-8866-41dba7ffc4bc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:09.923806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6980c976-46a0-4100-8866-41dba7ffc4bc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:09.949544 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6980c976-46a0-4100-8866-41dba7ffc4bc tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7/ips" status: 200 len: 149 microversion: 2.1 time: 0.041835 Sep 06 11:28:09.950144 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3017/6086] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:28:09 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:28:13.066854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=17 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:13.068900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:13.075226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "814c275c-3233-4ce6-b5b6-ce70b2c9cef6"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:28:13.084662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:13.084662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:13.092883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:13.094395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:13.096630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:13.097263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:13.101676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:13.901677 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "POST /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.836485 Sep 06 11:28:13.904494 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3070/6087] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:28:13 2022] POST /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:28:21.716768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-47610b80-ffca-4d97-96ca-c7750d0df21c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:21.718024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-47610b80-ffca-4d97-96ca-c7750d0df21c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:21.728516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47610b80-ffca-4d97-96ca-c7750d0df21c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:21.734665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47610b80-ffca-4d97-96ca-c7750d0df21c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:21.734665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47610b80-ffca-4d97-96ca-c7750d0df21c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:21.734665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47610b80-ffca-4d97-96ca-c7750d0df21c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:21.734665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47610b80-ffca-4d97-96ca-c7750d0df21c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:21.734665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47610b80-ffca-4d97-96ca-c7750d0df21c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:21.848801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-47610b80-ffca-4d97-96ca-c7750d0df21c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lazy-loading 'services' on Instance uuid ab450374-f0b1-4da7-8f06-fd9a26e932d7 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:28:22.140526 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-47610b80-ffca-4d97-96ca-c7750d0df21c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7/os-volume_attachments/814c275c-3233-4ce6-b5b6-ce70b2c9cef6" status: 202 len: 0 microversion: 2.1 time: 0.429928 Sep 06 11:28:22.141673 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3018/6088] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 11:28:21 2022] DELETE /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7/os-volume_attachments/814c275c-3233-4ce6-b5b6-ce70b2c9cef6 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:28:22.157118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a73c1e3f-3c77-4f35-b7b3-40bed5c3ad0d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:22.160237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a73c1e3f-3c77-4f35-b7b3-40bed5c3ad0d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:22.168096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a73c1e3f-3c77-4f35-b7b3-40bed5c3ad0d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:22.168826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a73c1e3f-3c77-4f35-b7b3-40bed5c3ad0d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:22.169466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a73c1e3f-3c77-4f35-b7b3-40bed5c3ad0d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:22.170364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a73c1e3f-3c77-4f35-b7b3-40bed5c3ad0d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:22.171043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a73c1e3f-3c77-4f35-b7b3-40bed5c3ad0d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:22.171892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a73c1e3f-3c77-4f35-b7b3-40bed5c3ad0d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:22.224323 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a73c1e3f-3c77-4f35-b7b3-40bed5c3ad0d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077244 Sep 06 11:28:22.225147 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3071/6089] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:28:22 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:28:23.238904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-20982dbe-d1d9-4e19-baa5-93c6a6e01c14 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:23.241364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-20982dbe-d1d9-4e19-baa5-93c6a6e01c14 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:23.249029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20982dbe-d1d9-4e19-baa5-93c6a6e01c14 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:23.249743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20982dbe-d1d9-4e19-baa5-93c6a6e01c14 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:23.250365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20982dbe-d1d9-4e19-baa5-93c6a6e01c14 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:23.251211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20982dbe-d1d9-4e19-baa5-93c6a6e01c14 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:23.251901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20982dbe-d1d9-4e19-baa5-93c6a6e01c14 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:23.252342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-20982dbe-d1d9-4e19-baa5-93c6a6e01c14 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:23.286308 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-20982dbe-d1d9-4e19-baa5-93c6a6e01c14 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053058 Sep 06 11:28:23.286896 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3019/6090] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:28:23 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:28:23.363129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1a0798f9-4859-40ae-9aa4-92a2b3df1f72 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:23.364237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1a0798f9-4859-40ae-9aa4-92a2b3df1f72 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:23.371516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a0798f9-4859-40ae-9aa4-92a2b3df1f72 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:23.372009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a0798f9-4859-40ae-9aa4-92a2b3df1f72 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:23.372461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a0798f9-4859-40ae-9aa4-92a2b3df1f72 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:23.373203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a0798f9-4859-40ae-9aa4-92a2b3df1f72 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:23.373648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a0798f9-4859-40ae-9aa4-92a2b3df1f72 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:23.374149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a0798f9-4859-40ae-9aa4-92a2b3df1f72 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:23.403838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1a0798f9-4859-40ae-9aa4-92a2b3df1f72 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:28:23.820149 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1a0798f9-4859-40ae-9aa4-92a2b3df1f72 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 204 len: 0 microversion: 2.1 time: 0.460786 Sep 06 11:28:23.820874 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3072/6091] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:28:23 2022] DELETE /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:28:23.829394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b15d331a-b277-4efb-ba37-441aa155d676 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:23.830045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b15d331a-b277-4efb-ba37-441aa155d676 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:23.836299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b15d331a-b277-4efb-ba37-441aa155d676 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:23.836797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b15d331a-b277-4efb-ba37-441aa155d676 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:23.837242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b15d331a-b277-4efb-ba37-441aa155d676 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:23.837955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b15d331a-b277-4efb-ba37-441aa155d676 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:23.838418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b15d331a-b277-4efb-ba37-441aa155d676 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:23.838856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b15d331a-b277-4efb-ba37-441aa155d676 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:24.022242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b15d331a-b277-4efb-ba37-441aa155d676 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:28:24.031043 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b15d331a-b277-4efb-ba37-441aa155d676 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1682 microversion: 2.1 time: 0.205576 Sep 06 11:28:24.031627 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3020/6092] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:28:23 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:28:25.057313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bb42e5b8-1429-4985-8295-313005819378 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:25.058409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bb42e5b8-1429-4985-8295-313005819378 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:25.067985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb42e5b8-1429-4985-8295-313005819378 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:25.072566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb42e5b8-1429-4985-8295-313005819378 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:25.072566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb42e5b8-1429-4985-8295-313005819378 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:25.072566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb42e5b8-1429-4985-8295-313005819378 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:25.072566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb42e5b8-1429-4985-8295-313005819378 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:25.072566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bb42e5b8-1429-4985-8295-313005819378 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:25.782189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bb42e5b8-1429-4985-8295-313005819378 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:28:25.792924 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bb42e5b8-1429-4985-8295-313005819378 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1682 microversion: 2.1 time: 0.740895 Sep 06 11:28:25.793527 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3073/6093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:28:25 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1682 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:28:26.635535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-8f68c369-c8a2-409f-946a-e3abdd595e0d req-6d296bb0-b0eb-4bed-bd28-bf267b64dac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab450374-f0b1-4da7-8f06-fd9a26e932d7", "name": "network-vif-deleted", "tag": "d30aad6c-e469-4a54-a44e-eed3c26ba720"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:28:26.661276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8f68c369-c8a2-409f-946a-e3abdd595e0d req-6d296bb0-b0eb-4bed-bd28-bf267b64dac9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:26.661889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8f68c369-c8a2-409f-946a-e3abdd595e0d req-6d296bb0-b0eb-4bed-bd28-bf267b64dac9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:26.665405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8f68c369-c8a2-409f-946a-e3abdd595e0d req-6d296bb0-b0eb-4bed-bd28-bf267b64dac9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:26.687536 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-8f68c369-c8a2-409f-946a-e3abdd595e0d req-6d296bb0-b0eb-4bed-bd28-bf267b64dac9 service nova] Creating event network-vif-deleted:d30aad6c-e469-4a54-a44e-eed3c26ba720 for instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 on nch1-master-1 Sep 06 11:28:26.697759 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-8f68c369-c8a2-409f-946a-e3abdd595e0d req-6d296bb0-b0eb-4bed-bd28-bf267b64dac9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066203 Sep 06 11:28:26.700642 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3021/6094] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:28:26.817465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cb003e27-4034-4fc3-8301-18916b3fe13d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:26.819003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cb003e27-4034-4fc3-8301-18916b3fe13d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:26.832169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb003e27-4034-4fc3-8301-18916b3fe13d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:26.833934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb003e27-4034-4fc3-8301-18916b3fe13d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:26.834580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb003e27-4034-4fc3-8301-18916b3fe13d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:26.835570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb003e27-4034-4fc3-8301-18916b3fe13d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:26.836221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb003e27-4034-4fc3-8301-18916b3fe13d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:26.836861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cb003e27-4034-4fc3-8301-18916b3fe13d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:26.977165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cb003e27-4034-4fc3-8301-18916b3fe13d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458eb197e36456fb7785c8625ed3140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:28:26.987002 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cb003e27-4034-4fc3-8301-18916b3fe13d tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 200 len: 1327 microversion: 2.1 time: 0.173552 Sep 06 11:28:27.002663 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3074/6095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:28:26 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 1327 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:28:28.011869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-29c88c3a-04f7-4be0-a316-45cbfc987363 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:28.012864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-29c88c3a-04f7-4be0-a316-45cbfc987363 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:28.019845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29c88c3a-04f7-4be0-a316-45cbfc987363 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:28.020345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29c88c3a-04f7-4be0-a316-45cbfc987363 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:28.020996 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29c88c3a-04f7-4be0-a316-45cbfc987363 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:28.021712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29c88c3a-04f7-4be0-a316-45cbfc987363 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:28.022794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29c88c3a-04f7-4be0-a316-45cbfc987363 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:28.023259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-29c88c3a-04f7-4be0-a316-45cbfc987363 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:28.039734 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-29c88c3a-04f7-4be0-a316-45cbfc987363 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-29c88c3a-04f7-4be0-a316-45cbfc987363 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 HTTP/1.1 Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'ab450374-f0b1-4da7-8f06-fd9a26e932d7'} Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:28.041444 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:28.047286 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:28.047286 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:28.047286 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:28.047286 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:28:28.047286 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:28:28.047286 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:28.047286 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:28.050108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-29c88c3a-04f7-4be0-a316-45cbfc987363 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 404 to user: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:28:28.050997 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-29c88c3a-04f7-4be0-a316-45cbfc987363 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 404 len: 111 microversion: 2.1 time: 0.044763 Sep 06 11:28:28.065602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bd07ac92-0dda-447d-881c-cc601254df4c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '.version_select at 0x7f90f3871c10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:28.066168 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3022/6096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:28:28 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:28:28.229289 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bd07ac92-0dda-447d-881c-cc601254df4c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587685519" status: 202 len: 0 microversion: 2.1 time: 0.172677 Sep 06 11:28:28.229998 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3075/6097] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:28:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587685519 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:28:34.851877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d0e35adf-76ce-4843-bc72-d9524b7be3ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:34.852391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d0e35adf-76ce-4843-bc72-d9524b7be3ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:34.859789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0e35adf-76ce-4843-bc72-d9524b7be3ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:34.860291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0e35adf-76ce-4843-bc72-d9524b7be3ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:34.860737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0e35adf-76ce-4843-bc72-d9524b7be3ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:34.861457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0e35adf-76ce-4843-bc72-d9524b7be3ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:34.861948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0e35adf-76ce-4843-bc72-d9524b7be3ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:34.862483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0e35adf-76ce-4843-bc72-d9524b7be3ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:34.878937 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-d0e35adf-76ce-4843-bc72-d9524b7be3ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d0e35adf-76ce-4843-bc72-d9524b7be3ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 HTTP/1.1 Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'ab450374-f0b1-4da7-8f06-fd9a26e932d7'} Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:28:34.880560 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d0e35adf-76ce-4843-bc72-d9524b7be3ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 404 to user: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d0e35adf-76ce-4843-bc72-d9524b7be3ec tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 404 len: 111 microversion: 2.1 time: 0.034003 Sep 06 11:28:34.889550 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3023/6098] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:28:34 2022] DELETE /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:28:34.898347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-33819aa5-7844-4c48-a6af-9d1f6390574e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:34.898945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-33819aa5-7844-4c48-a6af-9d1f6390574e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: ab450374-f0b1-4da7-8f06-fd9a26e932d7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:34.912674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33819aa5-7844-4c48-a6af-9d1f6390574e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:34.913175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33819aa5-7844-4c48-a6af-9d1f6390574e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:34.913616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33819aa5-7844-4c48-a6af-9d1f6390574e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:34.914335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33819aa5-7844-4c48-a6af-9d1f6390574e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:34.914808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33819aa5-7844-4c48-a6af-9d1f6390574e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:34.915259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33819aa5-7844-4c48-a6af-9d1f6390574e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:34.933131 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-33819aa5-7844-4c48-a6af-9d1f6390574e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-33819aa5-7844-4c48-a6af-9d1f6390574e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 HTTP/1.1 Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ab450374-f0b1-4da7-8f06-fd9a26e932d7'} Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:34.934844 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:34.945065 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:34.945065 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:34.945065 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:34.945065 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:28:34.945065 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:28:34.945065 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. Sep 06 11:28:34.945065 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:34.945065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-33819aa5-7844-4c48-a6af-9d1f6390574e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 404 to user: Instance ab450374-f0b1-4da7-8f06-fd9a26e932d7 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:28:34.945065 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-33819aa5-7844-4c48-a6af-9d1f6390574e tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7" status: 404 len: 111 microversion: 2.1 time: 0.044316 Sep 06 11:28:34.945065 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3076/6099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:28:34 2022] GET /compute/v2.1/servers/ab450374-f0b1-4da7-8f06-fd9a26e932d7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:28:42.663420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9d8a2cb-8278-46a9-b606-71a2cc86e942 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:42.663971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c9d8a2cb-8278-46a9-b606-71a2cc86e942 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:42.670948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9d8a2cb-8278-46a9-b606-71a2cc86e942 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:42.671484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9d8a2cb-8278-46a9-b606-71a2cc86e942 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:42.671910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9d8a2cb-8278-46a9-b606-71a2cc86e942 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:42.672607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9d8a2cb-8278-46a9-b606-71a2cc86e942 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:42.673064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9d8a2cb-8278-46a9-b606-71a2cc86e942 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:42.673499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c9d8a2cb-8278-46a9-b606-71a2cc86e942 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:42.687661 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-c9d8a2cb-8278-46a9-b606-71a2cc86e942 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9d8a2cb-8278-46a9-b606-71a2cc86e942 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 HTTP/1.1 Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'c4b2ee3b-ca28-4bf7-9135-238f13282019'} Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:28:42.689218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c9d8a2cb-8278-46a9-b606-71a2cc86e942 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 404 to user: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c9d8a2cb-8278-46a9-b606-71a2cc86e942 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 404 len: 111 microversion: 2.1 time: 0.031819 Sep 06 11:28:42.695208 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3024/6100] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:28:42 2022] DELETE /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:28:42.700924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9ebe990-7125-4899-946e-9c1cc3024b17 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:42.701571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d9ebe990-7125-4899-946e-9c1cc3024b17 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: c4b2ee3b-ca28-4bf7-9135-238f13282019] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:42.708692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9ebe990-7125-4899-946e-9c1cc3024b17 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:42.709215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9ebe990-7125-4899-946e-9c1cc3024b17 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:42.709666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9ebe990-7125-4899-946e-9c1cc3024b17 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:42.710373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9ebe990-7125-4899-946e-9c1cc3024b17 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:42.710841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9ebe990-7125-4899-946e-9c1cc3024b17 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:42.711314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9ebe990-7125-4899-946e-9c1cc3024b17 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:42.727734 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-d9ebe990-7125-4899-946e-9c1cc3024b17 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9ebe990-7125-4899-946e-9c1cc3024b17 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 HTTP/1.1 Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'c4b2ee3b-ca28-4bf7-9135-238f13282019'} Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:42.729554 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.734790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:42.734790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:42.734790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:42.734790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:28:42.734790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:28:42.734790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. Sep 06 11:28:42.734790 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.734790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9ebe990-7125-4899-946e-9c1cc3024b17 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 404 to user: Instance c4b2ee3b-ca28-4bf7-9135-238f13282019 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:28:42.734790 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d9ebe990-7125-4899-946e-9c1cc3024b17 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019" status: 404 len: 111 microversion: 2.1 time: 0.034284 Sep 06 11:28:42.734790 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3077/6101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:28:42 2022] GET /compute/v2.1/servers/c4b2ee3b-ca28-4bf7-9135-238f13282019 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:28:42.740495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2fb59be2-91fb-4069-8e9b-e7f383a036f6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:42.741046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2fb59be2-91fb-4069-8e9b-e7f383a036f6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:42.747359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2fb59be2-91fb-4069-8e9b-e7f383a036f6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:42.747848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2fb59be2-91fb-4069-8e9b-e7f383a036f6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:42.748293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2fb59be2-91fb-4069-8e9b-e7f383a036f6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:42.748999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2fb59be2-91fb-4069-8e9b-e7f383a036f6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:42.749474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2fb59be2-91fb-4069-8e9b-e7f383a036f6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:42.749905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2fb59be2-91fb-4069-8e9b-e7f383a036f6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:42.764555 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-2fb59be2-91fb-4069-8e9b-e7f383a036f6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2fb59be2-91fb-4069-8e9b-e7f383a036f6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 HTTP/1.1 Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'd75f326f-ee21-49de-90a3-0d332f54bff7'} Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:28:42.766120 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2fb59be2-91fb-4069-8e9b-e7f383a036f6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 404 to user: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2fb59be2-91fb-4069-8e9b-e7f383a036f6 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 404 len: 111 microversion: 2.1 time: 0.031627 Sep 06 11:28:42.771541 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3025/6102] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:28:42 2022] DELETE /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:28:42.776529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e27d8741-7806-4fe1-9e07-cb7e6d6f308c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:42.777226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e27d8741-7806-4fe1-9e07-cb7e6d6f308c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: d75f326f-ee21-49de-90a3-0d332f54bff7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:42.784234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27d8741-7806-4fe1-9e07-cb7e6d6f308c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:42.784721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27d8741-7806-4fe1-9e07-cb7e6d6f308c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:42.785167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27d8741-7806-4fe1-9e07-cb7e6d6f308c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:42.785862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27d8741-7806-4fe1-9e07-cb7e6d6f308c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:42.786321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27d8741-7806-4fe1-9e07-cb7e6d6f308c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:42.786752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e27d8741-7806-4fe1-9e07-cb7e6d6f308c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:42.802983 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-e27d8741-7806-4fe1-9e07-cb7e6d6f308c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e27d8741-7806-4fe1-9e07-cb7e6d6f308c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 HTTP/1.1 Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'd75f326f-ee21-49de-90a3-0d332f54bff7'} Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:42.804578 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.810214 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:42.810214 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:42.810214 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:42.810214 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:28:42.810214 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:28:42.810214 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. Sep 06 11:28:42.810214 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:42.810214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e27d8741-7806-4fe1-9e07-cb7e6d6f308c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 404 to user: Instance d75f326f-ee21-49de-90a3-0d332f54bff7 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:28:42.810214 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e27d8741-7806-4fe1-9e07-cb7e6d6f308c tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7" status: 404 len: 111 microversion: 2.1 time: 0.033797 Sep 06 11:28:42.810214 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3078/6103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:28:42 2022] GET /compute/v2.1/servers/d75f326f-ee21-49de-90a3-0d332f54bff7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:28:50.472272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c8ed864-a92b-4b7b-9260-89352db69768 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:50.477013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3c8ed864-a92b-4b7b-9260-89352db69768 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:50.479969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c8ed864-a92b-4b7b-9260-89352db69768 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:50.480461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c8ed864-a92b-4b7b-9260-89352db69768 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:50.480911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c8ed864-a92b-4b7b-9260-89352db69768 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:50.481644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c8ed864-a92b-4b7b-9260-89352db69768 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:50.482110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c8ed864-a92b-4b7b-9260-89352db69768 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:50.482544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c8ed864-a92b-4b7b-9260-89352db69768 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:50.497841 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-3c8ed864-a92b-4b7b-9260-89352db69768 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c8ed864-a92b-4b7b-9260-89352db69768 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c HTTP/1.1 Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '134fca7e-4cf9-4d85-a8b4-4f0b134e679c'} Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:28:50.499601 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c8ed864-a92b-4b7b-9260-89352db69768 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 404 to user: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3c8ed864-a92b-4b7b-9260-89352db69768 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 404 len: 111 microversion: 2.1 time: 0.032918 Sep 06 11:28:50.504870 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3026/6104] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:28:50 2022] DELETE /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:28:50.511518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c36e23c-5a49-4dd6-ae31-90939c116b95 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:50.512172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4c36e23c-5a49-4dd6-ae31-90939c116b95 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] [instance: 134fca7e-4cf9-4d85-a8b4-4f0b134e679c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:28:50.515419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:50.521733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c36e23c-5a49-4dd6-ae31-90939c116b95 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:50.522793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c36e23c-5a49-4dd6-ae31-90939c116b95 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:50.529184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c36e23c-5a49-4dd6-ae31-90939c116b95 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:50.529184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c36e23c-5a49-4dd6-ae31-90939c116b95 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:28:50.529184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c36e23c-5a49-4dd6-ae31-90939c116b95 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:28:50.529184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c36e23c-5a49-4dd6-ae31-90939c116b95 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:28:50.531878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:50.541889 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-4c36e23c-5a49-4dd6-ae31-90939c116b95 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] HTTP exception thrown: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c36e23c-5a49-4dd6-ae31-90939c116b95 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Request method failure captured: Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c HTTP/1.1 Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy3NS6thrt3b2eaTSpltzNCm9xzEtQN67abMKYaC4hAdeEzcN_oRONKDNFEN3XY0Vw54a0VqY3npil91jCxK_eXl0v4Ya0Z6v6yVZDzZF8poJfhDU3rTdrl_FGESXBrvHi7MEJu2drTDFaVReOqGUcmVIfSbE11Q-2xGUCSVQmyg4gg Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f6a64ebac2146b9a92c0ed0ac76a5fb"}]}] Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 2f6a64ebac2146b9a92c0ed0ac76a5fb Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-423464195 Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 5458eb197e36456fb7785c8625ed3140 Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-AttachVolumeNegativeTest-423464195-project Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '134fca7e-4cf9-4d85-a8b4-4f0b134e679c'} Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:28:50.543508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:50.552909 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:28:50.552909 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:28:50.552909 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:28:50.552909 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:28:50.552909 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:28:50.552909 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. Sep 06 11:28:50.552909 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:28:50.552909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c36e23c-5a49-4dd6-ae31-90939c116b95 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] Returning 404 to user: Instance 134fca7e-4cf9-4d85-a8b4-4f0b134e679c could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:28:50.552909 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4c36e23c-5a49-4dd6-ae31-90939c116b95 tempest-AttachVolumeNegativeTest-423464195 tempest-AttachVolumeNegativeTest-423464195-project] 10.222.0.20 "GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c" status: 404 len: 111 microversion: 2.1 time: 0.037602 Sep 06 11:28:50.552909 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3079/6105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:28:50 2022] GET /compute/v2.1/servers/134fca7e-4cf9-4d85-a8b4-4f0b134e679c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:28:56.810472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ab340b86-4a20-4f49-9c11-aae0206a9b94 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Action: 'create', calling method: .version_select at 0x7f90f33a5b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1347928193"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:28:57.622953 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ab340b86-4a20-4f49-9c11-aae0206a9b94 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.956984 Sep 06 11:28:57.623761 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3027/6106] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Sep 6 11:28:56 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 958 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 11:28:57.637432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-94f863c0-6f54-4978-b9b2-8ae801e85ab4 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f8654b80>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:57.646433 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:28:57.646592 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 11:28:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 (ip 10.222.0.20) !!! Sep 06 11:28:57.692852 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-94f863c0-6f54-4978-b9b2-8ae801e85ab4 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 200 len: 338 microversion: 2.1 time: 0.059662 Sep 06 11:28:57.693523 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3080/6107] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:28:57 2022] GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 338 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:28:58.709948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-88744df9-700f-4647-b5ad-1e77a3d36735 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90fcf5ed30>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:58.761165 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-88744df9-700f-4647-b5ad-1e77a3d36735 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 200 len: 338 microversion: 2.1 time: 0.057630 Sep 06 11:28:58.761774 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3028/6108] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:28:58 2022] GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 338 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:28:59.777938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8690133d-798f-47a3-a237-b2116fa6b8c4 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f8796820>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:28:59.841340 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8690133d-798f-47a3-a237-b2116fa6b8c4 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 200 len: 339 microversion: 2.1 time: 0.068923 Sep 06 11:28:59.841921 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3081/6109] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:28:59 2022] GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 339 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:28:59.856124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c506290-71d9-40eb-b317-5d0d120511aa tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Action: 'create', calling method: .version_select at 0x7f90f33a5940>, body: {"snapshot": {"volume_id": "b54a911f-e276-4a81-b4b7-cbdafe431637", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1040649855"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:29:00.434009 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1c506290-71d9-40eb-b317-5d0d120511aa tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.582807 Sep 06 11:29:00.434596 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3029/6110] 10.222.0.20 () {60 vars in 1162 bytes} [Tue Sep 6 11:28:59 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:29:00.445902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8f2a9001-2b5e-4896-9bab-153ad786f29c tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f8647790>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:00.478018 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8f2a9001-2b5e-4896-9bab-153ad786f29c tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd" status: 200 len: 287 microversion: 2.1 time: 0.036284 Sep 06 11:29:00.478627 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3082/6111] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:29:00 2022] GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:00.486793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=20 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:00.490900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dba43122-761e-4673-9b42-58bbdf8f534f tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f3287a60>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:00.499397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:00.524177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dba43122-761e-4673-9b42-58bbdf8f534f tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.038239 Sep 06 11:29:00.524804 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3030/6112] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Sep 6 11:29:00 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:00.536859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f9e0b172-5869-4849-9c18-4ea415eaacb6 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f877f550>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:00.572248 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f9e0b172-5869-4849-9c18-4ea415eaacb6 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd" status: 200 len: 287 microversion: 2.1 time: 0.039935 Sep 06 11:29:00.575124 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3083/6113] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:29:00 2022] GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:29:01.587296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5e21297a-f8d1-4533-9fe5-a7b81280bc1d tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f3573280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:01.618709 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5e21297a-f8d1-4533-9fe5-a7b81280bc1d tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd" status: 200 len: 287 microversion: 2.1 time: 0.037604 Sep 06 11:29:01.619329 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3031/6114] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:29:01 2022] GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:02.631969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e3d4824-1ecb-44b0-a9cf-d08fe074108f tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f8796820>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:02.662499 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5e3d4824-1ecb-44b0-a9cf-d08fe074108f tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd" status: 200 len: 287 microversion: 2.1 time: 0.035827 Sep 06 11:29:02.663102 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3084/6115] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:29:02 2022] GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:03.676869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-08d89531-80e9-46b9-a7e6-9b7aa4bb54d5 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90fcfa4790>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:03.711036 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-08d89531-80e9-46b9-a7e6-9b7aa4bb54d5 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd" status: 200 len: 288 microversion: 2.1 time: 0.039284 Sep 06 11:29:03.713098 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3032/6116] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:29:03 2022] GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:03.725266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-78a46b28-82df-42bd-913d-7c3ac24cac5c tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f84cb0d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:03.888634 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-78a46b28-82df-42bd-913d-7c3ac24cac5c tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd" status: 202 len: 0 microversion: 2.1 time: 0.167846 Sep 06 11:29:03.893289 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3085/6117] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Sep 6 11:29:03 2022] DELETE /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:29:03.900573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b0a42b70-8bcc-4b87-af5c-7cb875db31ce tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90fcfa41f0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:03.932680 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b0a42b70-8bcc-4b87-af5c-7cb875db31ce tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd" status: 200 len: 287 microversion: 2.1 time: 0.036992 Sep 06 11:29:03.934111 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3033/6118] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:29:03 2022] GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:04.947258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d47d050b-1cad-4560-b2b2-48ce820a12a8 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f8647f70>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:04.979285 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d47d050b-1cad-4560-b2b2-48ce820a12a8 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd" status: 200 len: 287 microversion: 2.1 time: 0.036564 Sep 06 11:29:04.979868 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3086/6119] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:29:04 2022] GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:05.993691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24d45a7e-79c8-4c8d-99b2-35e567c9e874 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f32b4e50>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:06.053517 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-24d45a7e-79c8-4c8d-99b2-35e567c9e874 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd" status: 200 len: 287 microversion: 2.1 time: 0.046397 Sep 06 11:29:06.053517 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3034/6120] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:29:05 2022] GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:07.050759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-67f7b58d-ec60-461c-8d7a-7aaab1116efb tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f8ce75e0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:07.080943 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-67f7b58d-ec60-461c-8d7a-7aaab1116efb tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd" status: 200 len: 287 microversion: 2.1 time: 0.036251 Sep 06 11:29:07.081524 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3087/6121] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:29:07 2022] GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:08.101229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c1de8665-019a-4071-9a18-6b4147affc4d tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f35e8040>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:08.129876 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-c1de8665-019a-4071-9a18-6b4147affc4d tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] HTTP exception thrown: Snapshot 5ef5ae08-81d8-4c21-9f17-3693039cc2bd could not be found. Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c1de8665-019a-4071-9a18-6b4147affc4d tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Request method failure captured: Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd HTTP/1.1 Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy74GbWI4AqH1JykGYjenyG7I4karSHAq0UuM-DRvFhdod63fTO2kiTVO1pS-cnbR7tTbRdn1qXqK_h0zgbyh-AU7o80nwjUD6r5VNQZqCHSapcBlgqJ3vTrHzUT3b3EHQPK2voLXwnB26_GKixyWYCTMaCmprY2WD40WFvTFzFBv0g Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 54e35bc5bedd4f1b95313973f8118470 Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1899004621 Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_54e35bc5bedd4f1b95313973f8118470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/54e35bc5bedd4f1b95313973f8118470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/54e35bc5bedd4f1b95313973f8118470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/54e35bc5bedd4f1b95313973f8118470"}]}] Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1899004621 Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 54e35bc5bedd4f1b95313973f8118470 Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1899004621 Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-VolumesSnapshotsTestJSON-1899004621-project Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: c3ea9be43d92471584942594b3febc06 Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1899004621-project Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: exception: Snapshot 5ef5ae08-81d8-4c21-9f17-3693039cc2bd could not be found. Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '5ef5ae08-81d8-4c21-9f17-3693039cc2bd'} Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5ef5ae08-81d8-4c21-9f17-3693039cc2bd could not be found. (HTTP 404) (Request-ID: req-ee38c0a4-5a53-4725-a1a3-e7b6eefd5f01) Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 11:29:08.148216 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5ef5ae08-81d8-4c21-9f17-3693039cc2bd could not be found. Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5ef5ae08-81d8-4c21-9f17-3693039cc2bd could not be found. Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5ef5ae08-81d8-4c21-9f17-3693039cc2bd could not be found. Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c1de8665-019a-4071-9a18-6b4147affc4d tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Returning 404 to user: Snapshot 5ef5ae08-81d8-4c21-9f17-3693039cc2bd could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c1de8665-019a-4071-9a18-6b4147affc4d tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd" status: 404 len: 111 microversion: 2.1 time: 0.059842 Sep 06 11:29:08.154791 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3035/6122] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:29:08 2022] GET /compute/v2.1/os-snapshots/5ef5ae08-81d8-4c21-9f17-3693039cc2bd => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:29:08.161843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f84cb9d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:08.420394 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 202 len: 0 microversion: 2.1 time: 0.261235 Sep 06 11:29:08.422239 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3088/6123] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:29:08 2022] DELETE /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:29:08.429335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-beae9948-350b-4ae9-8caf-461bbe6ecfd2 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f32a50d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:08.511574 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-beae9948-350b-4ae9-8caf-461bbe6ecfd2 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 200 len: 338 microversion: 2.1 time: 0.087526 Sep 06 11:29:08.518538 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3036/6124] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:29:08 2022] GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 338 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:09.526996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1f6e00a6-5abd-4f06-b4fd-d2a5b5aa0ce5 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90fd0373a0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:09.577777 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1f6e00a6-5abd-4f06-b4fd-d2a5b5aa0ce5 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 200 len: 338 microversion: 2.1 time: 0.055743 Sep 06 11:29:09.578356 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3089/6125] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:29:09 2022] GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 338 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:10.593998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-12a9187d-b4b6-487b-9a41-acdd5aee8380 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f32a50d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:10.643389 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-12a9187d-b4b6-487b-9a41-acdd5aee8380 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 200 len: 338 microversion: 2.1 time: 0.054788 Sep 06 11:29:10.644007 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3037/6126] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:29:10 2022] GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 338 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:11.654740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:11.655552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:11.660803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-94083cc6-47d1-4ab1-9579-4898c0b77ebe tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f8647c10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:11.709172 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-94083cc6-47d1-4ab1-9579-4898c0b77ebe tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 200 len: 338 microversion: 2.1 time: 0.055063 Sep 06 11:29:11.709755 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3090/6127] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:29:11 2022] GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 338 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:12.725550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f05aaff9-4dc7-4412-88c7-440e6fca985a tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f3155700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:12.780206 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f05aaff9-4dc7-4412-88c7-440e6fca985a tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 200 len: 338 microversion: 2.1 time: 0.060159 Sep 06 11:29:12.780787 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3038/6128] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:29:12 2022] GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 338 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:13.796460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-404dda54-9a33-4b05-a183-3abedde45cf8 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f858d9d0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:13.847696 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-404dda54-9a33-4b05-a183-3abedde45cf8 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 200 len: 338 microversion: 2.1 time: 0.055841 Sep 06 11:29:13.848284 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3091/6129] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:29:13 2022] GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 338 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:14.863966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-36e63cd0-6a1f-455b-863a-3bd639135ce8 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f328c700>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:14.921347 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-36e63cd0-6a1f-455b-863a-3bd639135ce8 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 200 len: 338 microversion: 2.1 time: 0.062482 Sep 06 11:29:14.921930 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3039/6130] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:29:14 2022] GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 338 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:15.937410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-578daaca-4f99-4db9-be1b-f2160ff580e7 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f84cb4c0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:15.986444 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-578daaca-4f99-4db9-be1b-f2160ff580e7 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 200 len: 338 microversion: 2.1 time: 0.053890 Sep 06 11:29:15.987151 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3092/6131] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:29:15 2022] GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 338 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:29:17.002019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f7331e90-09af-4bff-b40d-348ec1fb3d68 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f3287ca0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:17.031271 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-f7331e90-09af-4bff-b40d-348ec1fb3d68 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] HTTP exception thrown: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f7331e90-09af-4bff-b40d-348ec1fb3d68 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Request method failure captured: Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 HTTP/1.1 Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy74GbWI4AqH1JykGYjenyG7I4karSHAq0UuM-DRvFhdod63fTO2kiTVO1pS-cnbR7tTbRdn1qXqK_h0zgbyh-AU7o80nwjUD6r5VNQZqCHSapcBlgqJ3vTrHzUT3b3EHQPK2voLXwnB26_GKixyWYCTMaCmprY2WD40WFvTFzFBv0g Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 54e35bc5bedd4f1b95313973f8118470 Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1899004621 Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_54e35bc5bedd4f1b95313973f8118470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/54e35bc5bedd4f1b95313973f8118470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/54e35bc5bedd4f1b95313973f8118470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/54e35bc5bedd4f1b95313973f8118470"}]}] Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1899004621 Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 54e35bc5bedd4f1b95313973f8118470 Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1899004621 Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-VolumesSnapshotsTestJSON-1899004621-project Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: c3ea9be43d92471584942594b3febc06 Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1899004621-project Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: exception: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'b54a911f-e276-4a81-b4b7-cbdafe431637'} Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. (HTTP 404) (Request-ID: req-e6919d85-54d8-4b0e-ada2-b95a92c5aebd) Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 11:29:17.036281 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f7331e90-09af-4bff-b40d-348ec1fb3d68 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Returning 404 to user: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f7331e90-09af-4bff-b40d-348ec1fb3d68 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 404 len: 109 microversion: 2.1 time: 0.040835 Sep 06 11:29:17.042552 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3040/6132] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:29:16 2022] GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:29:17.050861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-63fc5caf-1577-4c89-952e-110b8f746c18 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90fcffb310>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:17.088400 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-63fc5caf-1577-4c89-952e-110b8f746c18 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] HTTP exception thrown: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-63fc5caf-1577-4c89-952e-110b8f746c18 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Request method failure captured: Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 HTTP/1.1 Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy74GbWI4AqH1JykGYjenyG7I4karSHAq0UuM-DRvFhdod63fTO2kiTVO1pS-cnbR7tTbRdn1qXqK_h0zgbyh-AU7o80nwjUD6r5VNQZqCHSapcBlgqJ3vTrHzUT3b3EHQPK2voLXwnB26_GKixyWYCTMaCmprY2WD40WFvTFzFBv0g Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 54e35bc5bedd4f1b95313973f8118470 Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1899004621 Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_54e35bc5bedd4f1b95313973f8118470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/54e35bc5bedd4f1b95313973f8118470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/54e35bc5bedd4f1b95313973f8118470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/54e35bc5bedd4f1b95313973f8118470"}]}] Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1899004621 Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 54e35bc5bedd4f1b95313973f8118470 Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1899004621 Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-VolumesSnapshotsTestJSON-1899004621-project Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: c3ea9be43d92471584942594b3febc06 Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1899004621-project Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: method: Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: exception: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'b54a911f-e276-4a81-b4b7-cbdafe431637'} Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. (HTTP 404) (Request-ID: req-ad59e07c-6758-4909-9a9a-8863ca3ca3f0) Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 11:29:17.090676 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-63fc5caf-1577-4c89-952e-110b8f746c18 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Returning 404 to user: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-63fc5caf-1577-4c89-952e-110b8f746c18 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 404 len: 109 microversion: 2.1 time: 0.046440 Sep 06 11:29:17.095505 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3093/6133] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:29:17 2022] DELETE /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:29:17.108729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3989eaf2-be69-40e6-adb3-7f77596ba898 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Calling method '.version_select at 0x7f90f3155b80>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:29:17.141555 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-3989eaf2-be69-40e6-adb3-7f77596ba898 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] HTTP exception thrown: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3989eaf2-be69-40e6-adb3-7f77596ba898 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Request method failure captured: Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 HTTP/1.1 Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFy74GbWI4AqH1JykGYjenyG7I4karSHAq0UuM-DRvFhdod63fTO2kiTVO1pS-cnbR7tTbRdn1qXqK_h0zgbyh-AU7o80nwjUD6r5VNQZqCHSapcBlgqJ3vTrHzUT3b3EHQPK2voLXwnB26_GKixyWYCTMaCmprY2WD40WFvTFzFBv0g Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 54e35bc5bedd4f1b95313973f8118470 Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1899004621 Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_54e35bc5bedd4f1b95313973f8118470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/54e35bc5bedd4f1b95313973f8118470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/54e35bc5bedd4f1b95313973f8118470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/54e35bc5bedd4f1b95313973f8118470"}]}] Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1899004621 Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 54e35bc5bedd4f1b95313973f8118470 Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1899004621 Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-VolumesSnapshotsTestJSON-1899004621-project Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: c3ea9be43d92471584942594b3febc06 Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1899004621-project Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: method: Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: exception: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'b54a911f-e276-4a81-b4b7-cbdafe431637'} Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. (HTTP 404) (Request-ID: req-1792796f-ba0f-42b7-b20f-38f069d0a554) Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 11:29:17.144361 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3989eaf2-be69-40e6-adb3-7f77596ba898 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] Returning 404 to user: Volume b54a911f-e276-4a81-b4b7-cbdafe431637 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3989eaf2-be69-40e6-adb3-7f77596ba898 tempest-VolumesSnapshotsTestJSON-1899004621 tempest-VolumesSnapshotsTestJSON-1899004621-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637" status: 404 len: 109 microversion: 2.1 time: 0.048464 Sep 06 11:29:17.149893 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3041/6134] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:29:17 2022] GET /compute/v2.1/os-volumes/b54a911f-e276-4a81-b4b7-cbdafe431637 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:30:39.943701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1867787175", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:30:40.299056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:30:40.638061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:30:40.638061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:30:40.638061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:30:40.638061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:30:40.638061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:30:40.647463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:40.648164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:40.648804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:40.649967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:40.650592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:40.651223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:40.673776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Getting quotas for project 0b461b8622c143ce8f77d8b48970cade. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:30:40.680132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Getting quotas for user 0f883ece2e5e49698d2bd382ab3a40dd and project 0b461b8622c143ce8f77d8b48970cade. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:30:40.695254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:30:40.702123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:30:40.904800 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d9f98060-4b9f-4b23-b14b-19181a61dbe3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.968869 Sep 06 11:30:40.905473 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3094/6135] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:30:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:30:40.914642 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f437706c-3085-4043-9dae-91c01118faaa] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 11:30:40.916057 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:30:40.916209 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 11:30:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 (ip 10.222.0.20) !!! Sep 06 11:30:40.918131 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:30:40.918251 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 11:30:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 (ip 10.222.0.20) !!! Sep 06 11:30:40.919339 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:30:40.919448 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 11:30:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 (ip 10.222.0.20) !!! Sep 06 11:30:40.939586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1fc067ca-83b4-4b25-91f8-27eb68c10fc9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:30:40.942844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1fc067ca-83b4-4b25-91f8-27eb68c10fc9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:30:41.253353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1fc067ca-83b4-4b25-91f8-27eb68c10fc9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:30:41.260796 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1fc067ca-83b4-4b25-91f8-27eb68c10fc9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1214 microversion: 2.1 time: 0.347903 Sep 06 11:30:41.261386 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3042/6136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:30:40 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1214 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:30:42.287716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8f486861-ebbb-4b48-a6fe-0d5e939cf3ca tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:30:42.289181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8f486861-ebbb-4b48-a6fe-0d5e939cf3ca tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:30:42.355721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8f486861-ebbb-4b48-a6fe-0d5e939cf3ca tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:30:42.362987 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8f486861-ebbb-4b48-a6fe-0d5e939cf3ca tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1214 microversion: 2.1 time: 0.081910 Sep 06 11:30:42.364208 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3095/6137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:30:42 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:30:43.385899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9bca8c25-0879-49b6-a8bf-04587ea6ff95 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:30:43.387404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9bca8c25-0879-49b6-a8bf-04587ea6ff95 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:30:43.402838 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] [f437706c-3085-4043-9dae-91c01118faaa] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50008. Sep 06 11:30:43.405346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bca8c25-0879-49b6-a8bf-04587ea6ff95 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:43.406117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bca8c25-0879-49b6-a8bf-04587ea6ff95 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:43.406656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bca8c25-0879-49b6-a8bf-04587ea6ff95 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:43.407506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bca8c25-0879-49b6-a8bf-04587ea6ff95 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:43.408053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bca8c25-0879-49b6-a8bf-04587ea6ff95 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:43.408563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bca8c25-0879-49b6-a8bf-04587ea6ff95 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:43.477280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9bca8c25-0879-49b6-a8bf-04587ea6ff95 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:30:43.485810 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9bca8c25-0879-49b6-a8bf-04587ea6ff95 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1266 microversion: 2.1 time: 0.103831 Sep 06 11:30:43.487339 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3043/6138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:30:43 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:30:44.511901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-31dc4c42-bfe0-4bae-a089-0e4a555a938a tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:30:44.512448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-31dc4c42-bfe0-4bae-a089-0e4a555a938a tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:30:44.520321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31dc4c42-bfe0-4bae-a089-0e4a555a938a tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:44.520873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31dc4c42-bfe0-4bae-a089-0e4a555a938a tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:44.521306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31dc4c42-bfe0-4bae-a089-0e4a555a938a tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:44.522032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31dc4c42-bfe0-4bae-a089-0e4a555a938a tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:44.522492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31dc4c42-bfe0-4bae-a089-0e4a555a938a tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:44.523186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-31dc4c42-bfe0-4bae-a089-0e4a555a938a tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:44.626530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-31dc4c42-bfe0-4bae-a089-0e4a555a938a tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:30:44.641090 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-31dc4c42-bfe0-4bae-a089-0e4a555a938a tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1272 microversion: 2.1 time: 0.133661 Sep 06 11:30:44.641875 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3096/6139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:30:44 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1272 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:30:45.666602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6b0b738a-b7ba-4740-8349-b7189107b785 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:30:45.670424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6b0b738a-b7ba-4740-8349-b7189107b785 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:30:45.679810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b0b738a-b7ba-4740-8349-b7189107b785 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:45.680326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b0b738a-b7ba-4740-8349-b7189107b785 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:45.683276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b0b738a-b7ba-4740-8349-b7189107b785 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:45.684214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b0b738a-b7ba-4740-8349-b7189107b785 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:45.684853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b0b738a-b7ba-4740-8349-b7189107b785 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:45.685757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b0b738a-b7ba-4740-8349-b7189107b785 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:45.890321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6b0b738a-b7ba-4740-8349-b7189107b785 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:30:45.901190 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6b0b738a-b7ba-4740-8349-b7189107b785 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1314 microversion: 2.1 time: 0.238957 Sep 06 11:30:45.902193 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3044/6140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:30:45 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:30:46.924948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7e151e5b-dacb-440b-b267-c816b08831c9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:30:46.925578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7e151e5b-dacb-440b-b267-c816b08831c9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:30:46.932728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e151e5b-dacb-440b-b267-c816b08831c9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:46.933450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e151e5b-dacb-440b-b267-c816b08831c9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:46.933721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e151e5b-dacb-440b-b267-c816b08831c9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:46.934470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e151e5b-dacb-440b-b267-c816b08831c9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:46.934881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e151e5b-dacb-440b-b267-c816b08831c9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:46.938939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7e151e5b-dacb-440b-b267-c816b08831c9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:47.102648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7e151e5b-dacb-440b-b267-c816b08831c9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:30:47.112767 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7e151e5b-dacb-440b-b267-c816b08831c9 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1314 microversion: 2.1 time: 0.191849 Sep 06 11:30:47.113358 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3097/6141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:30:46 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:30:47.564692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a9d4fbbd-dbbf-47fe-b732-4b074c5b7b12 req-c685fc30-6919-44c9-a45c-2e4768ce7678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7080126e-9166-4cf7-b8d1-91cee44b5479", "tag": "c9053b01-f262-44b2-9d56-da0532b25ada"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:30:47.585341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a9d4fbbd-dbbf-47fe-b732-4b074c5b7b12 req-c685fc30-6919-44c9-a45c-2e4768ce7678 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:47.585954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a9d4fbbd-dbbf-47fe-b732-4b074c5b7b12 req-c685fc30-6919-44c9-a45c-2e4768ce7678 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:47.586557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a9d4fbbd-dbbf-47fe-b732-4b074c5b7b12 req-c685fc30-6919-44c9-a45c-2e4768ce7678 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:47.603665 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a9d4fbbd-dbbf-47fe-b732-4b074c5b7b12 req-c685fc30-6919-44c9-a45c-2e4768ce7678 service nova] Creating event network-changed:c9053b01-f262-44b2-9d56-da0532b25ada for instance 7080126e-9166-4cf7-b8d1-91cee44b5479 on nch1-master-1 Sep 06 11:30:47.613008 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a9d4fbbd-dbbf-47fe-b732-4b074c5b7b12 req-c685fc30-6919-44c9-a45c-2e4768ce7678 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057754 Sep 06 11:30:47.614297 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3045/6142] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:30:48.141329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-980213f2-4c5a-43aa-92c2-f7047297fe01 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:30:48.143758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-980213f2-4c5a-43aa-92c2-f7047297fe01 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:30:48.151913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-980213f2-4c5a-43aa-92c2-f7047297fe01 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:48.152642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-980213f2-4c5a-43aa-92c2-f7047297fe01 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:48.153344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-980213f2-4c5a-43aa-92c2-f7047297fe01 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:48.154111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-980213f2-4c5a-43aa-92c2-f7047297fe01 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:48.154575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-980213f2-4c5a-43aa-92c2-f7047297fe01 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:48.155035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-980213f2-4c5a-43aa-92c2-f7047297fe01 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:48.389877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-980213f2-4c5a-43aa-92c2-f7047297fe01 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:30:48.400460 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-980213f2-4c5a-43aa-92c2-f7047297fe01 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1314 microversion: 2.1 time: 0.264190 Sep 06 11:30:48.403044 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3098/6143] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:30:48 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:30:49.425483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e333ae0-d88b-424a-a5da-759a08c77a68 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:30:49.426198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3e333ae0-d88b-424a-a5da-759a08c77a68 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:30:49.434487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e333ae0-d88b-424a-a5da-759a08c77a68 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:49.434997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e333ae0-d88b-424a-a5da-759a08c77a68 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:49.435482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e333ae0-d88b-424a-a5da-759a08c77a68 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:49.436212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e333ae0-d88b-424a-a5da-759a08c77a68 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:49.436680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e333ae0-d88b-424a-a5da-759a08c77a68 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:49.437124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e333ae0-d88b-424a-a5da-759a08c77a68 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:49.621844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3e333ae0-d88b-424a-a5da-759a08c77a68 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:30:49.637508 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3e333ae0-d88b-424a-a5da-759a08c77a68 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1314 microversion: 2.1 time: 0.216489 Sep 06 11:30:49.638895 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3046/6144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:30:49 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:30:50.664262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b3acccbb-de03-4315-97db-f6e42d958e29 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:30:50.664915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b3acccbb-de03-4315-97db-f6e42d958e29 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:30:50.675108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:50.679322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3acccbb-de03-4315-97db-f6e42d958e29 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:50.680031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3acccbb-de03-4315-97db-f6e42d958e29 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:50.680826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3acccbb-de03-4315-97db-f6e42d958e29 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:50.681640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3acccbb-de03-4315-97db-f6e42d958e29 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:50.682209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3acccbb-de03-4315-97db-f6e42d958e29 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:50.682657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3acccbb-de03-4315-97db-f6e42d958e29 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:50.876723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b3acccbb-de03-4315-97db-f6e42d958e29 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:30:50.885347 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b3acccbb-de03-4315-97db-f6e42d958e29 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1314 microversion: 2.1 time: 0.225602 Sep 06 11:30:50.886058 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3099/6145] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:30:50 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:30:51.909394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-14a6ed08-7d21-4d40-ae31-d6d42edeb34d tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:30:51.910018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-14a6ed08-7d21-4d40-ae31-d6d42edeb34d tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:30:51.912896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:51.917815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14a6ed08-7d21-4d40-ae31-d6d42edeb34d tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:51.918299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14a6ed08-7d21-4d40-ae31-d6d42edeb34d tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:51.920952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14a6ed08-7d21-4d40-ae31-d6d42edeb34d tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:51.920952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14a6ed08-7d21-4d40-ae31-d6d42edeb34d tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:51.920952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14a6ed08-7d21-4d40-ae31-d6d42edeb34d tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:51.921336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14a6ed08-7d21-4d40-ae31-d6d42edeb34d tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:52.062045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-14a6ed08-7d21-4d40-ae31-d6d42edeb34d tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:30:52.071639 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-14a6ed08-7d21-4d40-ae31-d6d42edeb34d tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1314 microversion: 2.1 time: 0.166049 Sep 06 11:30:52.072534 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3047/6146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:30:51 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:30:52.523101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-0c3241dd-f0fa-4e3b-9600-63d73172e3ae req-f7d04be8-9ed0-47f9-8cb9-371fee27aaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7080126e-9166-4cf7-b8d1-91cee44b5479", "name": "network-vif-plugged", "status": "completed", "tag": "c9053b01-f262-44b2-9d56-da0532b25ada"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:30:52.533211 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:30:52.534025 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 11:30:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 06 11:30:52.537307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:52.555063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0c3241dd-f0fa-4e3b-9600-63d73172e3ae req-f7d04be8-9ed0-47f9-8cb9-371fee27aaf7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:52.555556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0c3241dd-f0fa-4e3b-9600-63d73172e3ae req-f7d04be8-9ed0-47f9-8cb9-371fee27aaf7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:52.556001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0c3241dd-f0fa-4e3b-9600-63d73172e3ae req-f7d04be8-9ed0-47f9-8cb9-371fee27aaf7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:52.570593 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-0c3241dd-f0fa-4e3b-9600-63d73172e3ae req-f7d04be8-9ed0-47f9-8cb9-371fee27aaf7 service nova] Creating event network-vif-plugged:c9053b01-f262-44b2-9d56-da0532b25ada for instance 7080126e-9166-4cf7-b8d1-91cee44b5479 on nch1-master-1 Sep 06 11:30:52.576515 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-0c3241dd-f0fa-4e3b-9600-63d73172e3ae req-f7d04be8-9ed0-47f9-8cb9-371fee27aaf7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057307 Sep 06 11:30:52.577196 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3100/6147] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:30:53.096728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a4911a24-dd41-4f07-9ffb-e9ae9c3d359e tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:30:53.097368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a4911a24-dd41-4f07-9ffb-e9ae9c3d359e tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:30:53.118699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4911a24-dd41-4f07-9ffb-e9ae9c3d359e tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:53.123201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4911a24-dd41-4f07-9ffb-e9ae9c3d359e tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:53.123201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4911a24-dd41-4f07-9ffb-e9ae9c3d359e tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:53.123201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4911a24-dd41-4f07-9ffb-e9ae9c3d359e tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:53.123201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4911a24-dd41-4f07-9ffb-e9ae9c3d359e tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:53.123201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4911a24-dd41-4f07-9ffb-e9ae9c3d359e tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:53.290581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a4911a24-dd41-4f07-9ffb-e9ae9c3d359e tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:30:53.302749 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a4911a24-dd41-4f07-9ffb-e9ae9c3d359e tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1314 microversion: 2.1 time: 0.210485 Sep 06 11:30:53.303982 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3048/6148] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:30:53 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:30:54.338384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4cd75575-3543-48f0-9aea-1e379796a9e3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:30:54.340388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4cd75575-3543-48f0-9aea-1e379796a9e3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:30:54.351453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cd75575-3543-48f0-9aea-1e379796a9e3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:54.352275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cd75575-3543-48f0-9aea-1e379796a9e3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:54.352734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cd75575-3543-48f0-9aea-1e379796a9e3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:54.353463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cd75575-3543-48f0-9aea-1e379796a9e3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:54.353939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cd75575-3543-48f0-9aea-1e379796a9e3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:54.354387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4cd75575-3543-48f0-9aea-1e379796a9e3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:54.526744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4cd75575-3543-48f0-9aea-1e379796a9e3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:30:54.537789 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4cd75575-3543-48f0-9aea-1e379796a9e3 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1464 microversion: 2.1 time: 0.213084 Sep 06 11:30:54.539377 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3101/6149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:30:54 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1464 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:30:54.565706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-21af801c-ee79-4a92-9942-c48a26794145 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f4eb326-623e-49b5-80c8-22c1dc568e07", "device": "/dev/sdb"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:30:54.568405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-21af801c-ee79-4a92-9942-c48a26794145 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:30:54.582557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21af801c-ee79-4a92-9942-c48a26794145 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:54.583059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21af801c-ee79-4a92-9942-c48a26794145 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:54.583445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21af801c-ee79-4a92-9942-c48a26794145 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:54.584164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21af801c-ee79-4a92-9942-c48a26794145 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:30:54.584785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21af801c-ee79-4a92-9942-c48a26794145 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:30:54.585376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-21af801c-ee79-4a92-9942-c48a26794145 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:30:55.487039 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-21af801c-ee79-4a92-9942-c48a26794145 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "POST /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.927947 Sep 06 11:30:55.487898 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3049/6150] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:30:54 2022] POST /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479/os-volume_attachments => generated 194 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:31:23.658279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3d1adbff-d712-4138-9452-c9d3a51506f7 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:31:23.658862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3d1adbff-d712-4138-9452-c9d3a51506f7 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:31:23.661450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:31:23.662194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=34 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:31:23.667586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d1adbff-d712-4138-9452-c9d3a51506f7 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:23.668363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d1adbff-d712-4138-9452-c9d3a51506f7 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:23.668982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d1adbff-d712-4138-9452-c9d3a51506f7 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:23.670372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d1adbff-d712-4138-9452-c9d3a51506f7 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:23.670923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d1adbff-d712-4138-9452-c9d3a51506f7 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:23.671455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3d1adbff-d712-4138-9452-c9d3a51506f7 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:23.777353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-3d1adbff-d712-4138-9452-c9d3a51506f7 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lazy-loading 'services' on Instance uuid 7080126e-9166-4cf7-b8d1-91cee44b5479 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:31:24.072911 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3d1adbff-d712-4138-9452-c9d3a51506f7 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479/os-volume_attachments/4f4eb326-623e-49b5-80c8-22c1dc568e07" status: 202 len: 0 microversion: 2.1 time: 0.417485 Sep 06 11:31:24.072911 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3102/6151] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 11:31:23 2022] DELETE /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479/os-volume_attachments/4f4eb326-623e-49b5-80c8-22c1dc568e07 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:31:25.237317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=18 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:31:25.238578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:31:25.243416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a8b7aea7-0526-4517-bcf6-882715632357 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:31:25.244035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a8b7aea7-0526-4517-bcf6-882715632357 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:31:25.252502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8b7aea7-0526-4517-bcf6-882715632357 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:25.252909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8b7aea7-0526-4517-bcf6-882715632357 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:25.253356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8b7aea7-0526-4517-bcf6-882715632357 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:25.254302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8b7aea7-0526-4517-bcf6-882715632357 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:25.254772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8b7aea7-0526-4517-bcf6-882715632357 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:25.255273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8b7aea7-0526-4517-bcf6-882715632357 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:25.286547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a8b7aea7-0526-4517-bcf6-882715632357 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:31:25.667485 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a8b7aea7-0526-4517-bcf6-882715632357 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 204 len: 0 microversion: 2.1 time: 0.431959 Sep 06 11:31:25.668395 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3050/6152] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:31:25 2022] DELETE /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:31:25.679125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d3d93f5f-b88b-4a06-bb49-6f5069d0b891 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:31:25.679915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3d93f5f-b88b-4a06-bb49-6f5069d0b891 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:31:25.686718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d93f5f-b88b-4a06-bb49-6f5069d0b891 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:25.687249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d93f5f-b88b-4a06-bb49-6f5069d0b891 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:25.687696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d93f5f-b88b-4a06-bb49-6f5069d0b891 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:25.688422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d93f5f-b88b-4a06-bb49-6f5069d0b891 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:25.689528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d93f5f-b88b-4a06-bb49-6f5069d0b891 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:25.689962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3d93f5f-b88b-4a06-bb49-6f5069d0b891 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:26.018096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d3d93f5f-b88b-4a06-bb49-6f5069d0b891 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:31:26.030385 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d3d93f5f-b88b-4a06-bb49-6f5069d0b891 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1470 microversion: 2.1 time: 0.357168 Sep 06 11:31:26.031495 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3103/6153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:31:25 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1470 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:31:27.056508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e05cbd61-a80f-4635-b54b-76b320567069 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:31:27.057211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e05cbd61-a80f-4635-b54b-76b320567069 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:31:27.066305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e05cbd61-a80f-4635-b54b-76b320567069 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:27.066797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e05cbd61-a80f-4635-b54b-76b320567069 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:27.067355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e05cbd61-a80f-4635-b54b-76b320567069 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:27.068073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e05cbd61-a80f-4635-b54b-76b320567069 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:27.068758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e05cbd61-a80f-4635-b54b-76b320567069 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:27.069470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e05cbd61-a80f-4635-b54b-76b320567069 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:27.303716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e05cbd61-a80f-4635-b54b-76b320567069 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:31:27.317985 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e05cbd61-a80f-4635-b54b-76b320567069 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1470 microversion: 2.1 time: 0.265479 Sep 06 11:31:27.319176 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3051/6154] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:31:27 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1470 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:31:27.877623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-7cae437e-f732-49a6-b750-9cef6ce6ef45 req-5aad013f-2196-420c-b823-56f445bf5537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7080126e-9166-4cf7-b8d1-91cee44b5479", "name": "network-vif-deleted", "tag": "c9053b01-f262-44b2-9d56-da0532b25ada"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:31:27.889015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7cae437e-f732-49a6-b750-9cef6ce6ef45 req-5aad013f-2196-420c-b823-56f445bf5537 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:27.889514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7cae437e-f732-49a6-b750-9cef6ce6ef45 req-5aad013f-2196-420c-b823-56f445bf5537 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:27.889969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7cae437e-f732-49a6-b750-9cef6ce6ef45 req-5aad013f-2196-420c-b823-56f445bf5537 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:27.906610 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-7cae437e-f732-49a6-b750-9cef6ce6ef45 req-5aad013f-2196-420c-b823-56f445bf5537 service nova] Creating event network-vif-deleted:c9053b01-f262-44b2-9d56-da0532b25ada for instance 7080126e-9166-4cf7-b8d1-91cee44b5479 on nch1-master-1 Sep 06 11:31:27.914390 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-7cae437e-f732-49a6-b750-9cef6ce6ef45 req-5aad013f-2196-420c-b823-56f445bf5537 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044297 Sep 06 11:31:27.918038 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3104/6155] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:31:28.341518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:31:28.342272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:31:28.359810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:28.361687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:28.367458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:28.368357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:28.371853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:28.372883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:28.420962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:28.421774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:28.428028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:28.428028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lazy-loading 'fault' on Instance uuid 7080126e-9166-4cf7-b8d1-91cee44b5479 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:31:28.487319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f883ece2e5e49698d2bd382ab3a40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b461b8622c143ce8f77d8b48970cade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:31:28.496400 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-012e02d7-adb9-4089-9ad5-57ac9838dabd tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 200 len: 1304 microversion: 2.1 time: 0.159522 Sep 06 11:31:28.497172 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3052/6156] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:31:28 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:31:29.526600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b1698230-49eb-4877-8fce-5fc2ce14da34 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:31:29.528009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b1698230-49eb-4877-8fce-5fc2ce14da34 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] [instance: 7080126e-9166-4cf7-b8d1-91cee44b5479] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:31:29.535554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1698230-49eb-4877-8fce-5fc2ce14da34 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:29.536056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1698230-49eb-4877-8fce-5fc2ce14da34 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:29.536813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1698230-49eb-4877-8fce-5fc2ce14da34 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:29.537548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1698230-49eb-4877-8fce-5fc2ce14da34 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:31:29.538170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1698230-49eb-4877-8fce-5fc2ce14da34 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:31:29.539325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1698230-49eb-4877-8fce-5fc2ce14da34 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-b1698230-49eb-4877-8fce-5fc2ce14da34 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] HTTP exception thrown: Instance 7080126e-9166-4cf7-b8d1-91cee44b5479 could not be found. Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b1698230-49eb-4877-8fce-5fc2ce14da34 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Request method failure captured: Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 HTTP/1.1 Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy9cOYbJ_RdTEx38j_4bT-aSw90IaLBKiqoa_DD61-iYtO6bZml9GAzJm3x2PCTp2RLxOuTNtNAcynMOLNQkcm5LpsSlKZoi7c2pVx5rEzfVltuvI6OipCdkmTReZcUhZBDAF4qz-yNl3kztkxPVHPE4j7Y2jgCJxKyLtc3uqsU9PdE Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0b461b8622c143ce8f77d8b48970cade Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-VolumesBackupsTest-639521729 Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0b461b8622c143ce8f77d8b48970cade"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b461b8622c143ce8f77d8b48970cade"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0b461b8622c143ce8f77d8b48970cade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b461b8622c143ce8f77d8b48970cade"}]}] Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-VolumesBackupsTest-639521729 Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0b461b8622c143ce8f77d8b48970cade Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-VolumesBackupsTest-639521729 Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-VolumesBackupsTest-639521729-project Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 0f883ece2e5e49698d2bd382ab3a40dd Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-VolumesBackupsTest-639521729-project Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 7080126e-9166-4cf7-b8d1-91cee44b5479 could not be found. Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '7080126e-9166-4cf7-b8d1-91cee44b5479'} Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7080126e-9166-4cf7-b8d1-91cee44b5479 could not be found. Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:31:29.558347 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7080126e-9166-4cf7-b8d1-91cee44b5479 could not be found. Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7080126e-9166-4cf7-b8d1-91cee44b5479 could not be found. Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b1698230-49eb-4877-8fce-5fc2ce14da34 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] Returning 404 to user: Instance 7080126e-9166-4cf7-b8d1-91cee44b5479 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b1698230-49eb-4877-8fce-5fc2ce14da34 tempest-VolumesBackupsTest-639521729 tempest-VolumesBackupsTest-639521729-project] 10.222.0.20 "GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479" status: 404 len: 111 microversion: 2.1 time: 0.036178 Sep 06 11:31:29.561759 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3105/6157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:31:29 2022] GET /compute/v2.1/servers/7080126e-9166-4cf7-b8d1-91cee44b5479 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:33:16.520702 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f57fb853-595b-4ef1-91ec-6bf7ec660ec1] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 11:33:16.521457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:16.522282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:16.527868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1681490708", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "f3ec9212-c08a-44f5-9c93-11aeafe2d7b0"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:33:16.584867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] validate_networks() for [('f3ec9212-c08a-44f5-9c93-11aeafe2d7b0', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:33:17.072005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:33:17.072440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:33:17.072923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:33:17.073342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:33:17.073769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:33:17.083212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:17.083692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:17.084149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:17.084906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:17.085372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:17.085806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:17.104263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Getting quotas for project eb7c997d05c141afb82389298ecb372c. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:33:17.111317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Getting quotas for user 4a1fe9d40733413a9c56393762549c7d and project eb7c997d05c141afb82389298ecb372c. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:33:17.124547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:33:17.126939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:33:17.286803 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3d30cd29-3aea-4b9c-94a3-98395aa6f949 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767935 Sep 06 11:33:17.291064 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3053/6158] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:33:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:33:17.298046 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e366ae3e-f715-4bfe-a538-76a63bf43111] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 11:33:17.299667 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 11:33:17.300828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:17.301537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:17.303143 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 11:33:17.307353 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 11:33:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 (ip 10.222.0.20) !!! Sep 06 11:33:17.308519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-11125271-3f6e-45d0-8afb-17cd315c850f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:33:17.309529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-11125271-3f6e-45d0-8afb-17cd315c850f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:33:17.394482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-11125271-3f6e-45d0-8afb-17cd315c850f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:33:17.412092 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-11125271-3f6e-45d0-8afb-17cd315c850f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1219 microversion: 2.1 time: 0.116513 Sep 06 11:33:17.413226 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3106/6159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:33:17 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:33:18.438897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0d863a32-93c8-4700-8ea2-d868bcaa7f42 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:33:18.439545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0d863a32-93c8-4700-8ea2-d868bcaa7f42 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:33:18.464723 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] [f57fb853-595b-4ef1-91ec-6bf7ec660ec1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52398. Sep 06 11:33:18.502025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0d863a32-93c8-4700-8ea2-d868bcaa7f42 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:33:18.506643 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0d863a32-93c8-4700-8ea2-d868bcaa7f42 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1219 microversion: 2.1 time: 0.074129 Sep 06 11:33:18.507347 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3054/6160] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:33:18 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:33:19.532425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34d243fc-68d3-4c6e-897c-b449193136c2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:33:19.533284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-34d243fc-68d3-4c6e-897c-b449193136c2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:33:19.547291 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] [e366ae3e-f715-4bfe-a538-76a63bf43111] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52430. Sep 06 11:33:19.559826 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52432. Sep 06 11:33:19.563544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d243fc-68d3-4c6e-897c-b449193136c2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:19.564255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d243fc-68d3-4c6e-897c-b449193136c2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:19.565212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d243fc-68d3-4c6e-897c-b449193136c2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:19.566149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d243fc-68d3-4c6e-897c-b449193136c2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:19.566768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d243fc-68d3-4c6e-897c-b449193136c2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:19.567389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-34d243fc-68d3-4c6e-897c-b449193136c2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:19.642745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-34d243fc-68d3-4c6e-897c-b449193136c2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:33:19.651340 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-34d243fc-68d3-4c6e-897c-b449193136c2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1271 microversion: 2.1 time: 0.124677 Sep 06 11:33:19.652199 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3107/6161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:33:19 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:33:20.681885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-36f579f2-5b52-4590-bbd8-326f3ce6af48 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:33:20.688646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-36f579f2-5b52-4590-bbd8-326f3ce6af48 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:33:20.691223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36f579f2-5b52-4590-bbd8-326f3ce6af48 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:20.691733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36f579f2-5b52-4590-bbd8-326f3ce6af48 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:20.692200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36f579f2-5b52-4590-bbd8-326f3ce6af48 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:20.692912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36f579f2-5b52-4590-bbd8-326f3ce6af48 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:20.693381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36f579f2-5b52-4590-bbd8-326f3ce6af48 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:20.693818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36f579f2-5b52-4590-bbd8-326f3ce6af48 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:20.771976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-36f579f2-5b52-4590-bbd8-326f3ce6af48 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:33:20.781381 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-36f579f2-5b52-4590-bbd8-326f3ce6af48 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1277 microversion: 2.1 time: 0.102741 Sep 06 11:33:20.782013 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3055/6162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:33:20 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:33:21.807214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-520c6e81-cdd7-4825-b34d-2fc7ba487413 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:33:21.808091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-520c6e81-cdd7-4825-b34d-2fc7ba487413 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:33:21.818211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-520c6e81-cdd7-4825-b34d-2fc7ba487413 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:21.818814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-520c6e81-cdd7-4825-b34d-2fc7ba487413 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:21.819732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-520c6e81-cdd7-4825-b34d-2fc7ba487413 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:21.820583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-520c6e81-cdd7-4825-b34d-2fc7ba487413 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:21.821220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-520c6e81-cdd7-4825-b34d-2fc7ba487413 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:21.821768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-520c6e81-cdd7-4825-b34d-2fc7ba487413 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:21.968065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-520c6e81-cdd7-4825-b34d-2fc7ba487413 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:33:21.985717 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-520c6e81-cdd7-4825-b34d-2fc7ba487413 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1319 microversion: 2.1 time: 0.183464 Sep 06 11:33:21.995787 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3108/6163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:33:21 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:33:22.486352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-4144cac4-a8d1-4421-bc80-c9fd78ebef2f req-6326185e-4f19-4da0-9b91-c493c51654a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5", "tag": "349605ad-2102-44a6-a14d-d26de873e59b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:33:22.503629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4144cac4-a8d1-4421-bc80-c9fd78ebef2f req-6326185e-4f19-4da0-9b91-c493c51654a6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:22.504197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4144cac4-a8d1-4421-bc80-c9fd78ebef2f req-6326185e-4f19-4da0-9b91-c493c51654a6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:22.504768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4144cac4-a8d1-4421-bc80-c9fd78ebef2f req-6326185e-4f19-4da0-9b91-c493c51654a6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:22.518578 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-4144cac4-a8d1-4421-bc80-c9fd78ebef2f req-6326185e-4f19-4da0-9b91-c493c51654a6 service nova] Creating event network-changed:349605ad-2102-44a6-a14d-d26de873e59b for instance ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 on nch1-master-1 Sep 06 11:33:22.523771 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-4144cac4-a8d1-4421-bc80-c9fd78ebef2f req-6326185e-4f19-4da0-9b91-c493c51654a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225042 Sep 06 11:33:22.524623 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3056/6164] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:33:23.013078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-80aaae14-18f8-4647-be1e-e867cf8371fc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:33:23.013826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-80aaae14-18f8-4647-be1e-e867cf8371fc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:33:23.021334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80aaae14-18f8-4647-be1e-e867cf8371fc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:23.021835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80aaae14-18f8-4647-be1e-e867cf8371fc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:23.022290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80aaae14-18f8-4647-be1e-e867cf8371fc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:23.023197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80aaae14-18f8-4647-be1e-e867cf8371fc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:23.023799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80aaae14-18f8-4647-be1e-e867cf8371fc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:23.024291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80aaae14-18f8-4647-be1e-e867cf8371fc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:23.172352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-80aaae14-18f8-4647-be1e-e867cf8371fc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:33:23.180573 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-80aaae14-18f8-4647-be1e-e867cf8371fc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1319 microversion: 2.1 time: 0.171615 Sep 06 11:33:23.181159 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3109/6165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:33:23 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:33:24.205403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8c618a6c-f92e-45c3-bfed-ce34722a1054 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:33:24.206127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8c618a6c-f92e-45c3-bfed-ce34722a1054 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:33:24.214917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c618a6c-f92e-45c3-bfed-ce34722a1054 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:24.215666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c618a6c-f92e-45c3-bfed-ce34722a1054 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:24.216286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c618a6c-f92e-45c3-bfed-ce34722a1054 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:24.217260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c618a6c-f92e-45c3-bfed-ce34722a1054 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:24.218004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c618a6c-f92e-45c3-bfed-ce34722a1054 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:24.218648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c618a6c-f92e-45c3-bfed-ce34722a1054 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:24.376729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8c618a6c-f92e-45c3-bfed-ce34722a1054 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:33:24.385350 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8c618a6c-f92e-45c3-bfed-ce34722a1054 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1319 microversion: 2.1 time: 0.185093 Sep 06 11:33:24.386839 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3057/6166] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:33:24 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:33:25.412693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1305f785-70e3-4f0c-859f-c899700e6099 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:33:25.413286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1305f785-70e3-4f0c-859f-c899700e6099 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:33:25.421094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1305f785-70e3-4f0c-859f-c899700e6099 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:25.421906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1305f785-70e3-4f0c-859f-c899700e6099 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:25.422039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1305f785-70e3-4f0c-859f-c899700e6099 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:25.422732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1305f785-70e3-4f0c-859f-c899700e6099 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:25.423261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1305f785-70e3-4f0c-859f-c899700e6099 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:25.423261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1305f785-70e3-4f0c-859f-c899700e6099 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:25.588488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1305f785-70e3-4f0c-859f-c899700e6099 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:33:25.601521 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1305f785-70e3-4f0c-859f-c899700e6099 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1319 microversion: 2.1 time: 0.190050 Sep 06 11:33:25.601521 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3110/6167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:33:25 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:33:26.624123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f01628aa-28fa-4469-87d5-09093f5e2d6c tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:33:26.624752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f01628aa-28fa-4469-87d5-09093f5e2d6c tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:33:26.633048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f01628aa-28fa-4469-87d5-09093f5e2d6c tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:26.637543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f01628aa-28fa-4469-87d5-09093f5e2d6c tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:26.637543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f01628aa-28fa-4469-87d5-09093f5e2d6c tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:26.637543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f01628aa-28fa-4469-87d5-09093f5e2d6c tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:26.637543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f01628aa-28fa-4469-87d5-09093f5e2d6c tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:26.637543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f01628aa-28fa-4469-87d5-09093f5e2d6c tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:26.796098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f01628aa-28fa-4469-87d5-09093f5e2d6c tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:33:26.805209 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f01628aa-28fa-4469-87d5-09093f5e2d6c tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1319 microversion: 2.1 time: 0.185389 Sep 06 11:33:26.806051 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3058/6168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:33:26 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:33:27.163780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-4a4a8e27-b88f-451e-9304-f9ab2b830638 req-0ae02ef2-5ba6-403a-ab9b-5d0f1029288e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5", "name": "network-vif-plugged", "status": "completed", "tag": "349605ad-2102-44a6-a14d-d26de873e59b"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:33:27.174805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4a4a8e27-b88f-451e-9304-f9ab2b830638 req-0ae02ef2-5ba6-403a-ab9b-5d0f1029288e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:27.175316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4a4a8e27-b88f-451e-9304-f9ab2b830638 req-0ae02ef2-5ba6-403a-ab9b-5d0f1029288e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:27.175755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4a4a8e27-b88f-451e-9304-f9ab2b830638 req-0ae02ef2-5ba6-403a-ab9b-5d0f1029288e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:27.188494 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-4a4a8e27-b88f-451e-9304-f9ab2b830638 req-0ae02ef2-5ba6-403a-ab9b-5d0f1029288e service nova] Creating event network-vif-plugged:349605ad-2102-44a6-a14d-d26de873e59b for instance ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 on nch1-master-1 Sep 06 11:33:27.197058 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-4a4a8e27-b88f-451e-9304-f9ab2b830638 req-0ae02ef2-5ba6-403a-ab9b-5d0f1029288e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114909 Sep 06 11:33:27.197058 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3111/6169] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:33:27.830848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9a6042a3-0046-4475-804f-bcc619e332ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:33:27.832044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9a6042a3-0046-4475-804f-bcc619e332ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:33:27.835361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:27.840027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a6042a3-0046-4475-804f-bcc619e332ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:27.840530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a6042a3-0046-4475-804f-bcc619e332ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:27.840981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a6042a3-0046-4475-804f-bcc619e332ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:27.842317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a6042a3-0046-4475-804f-bcc619e332ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:27.842783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a6042a3-0046-4475-804f-bcc619e332ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:27.843243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a6042a3-0046-4475-804f-bcc619e332ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:27.997850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9a6042a3-0046-4475-804f-bcc619e332ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:33:28.005952 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9a6042a3-0046-4475-804f-bcc619e332ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1319 microversion: 2.1 time: 0.180088 Sep 06 11:33:28.006599 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3059/6170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:33:27 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:33:29.034427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-606f4af5-43c6-4648-a16e-71541a73966e tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:33:29.045257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-606f4af5-43c6-4648-a16e-71541a73966e tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:33:29.045257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:29.045257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-606f4af5-43c6-4648-a16e-71541a73966e tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:29.045257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-606f4af5-43c6-4648-a16e-71541a73966e tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:29.045257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-606f4af5-43c6-4648-a16e-71541a73966e tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:29.045780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-606f4af5-43c6-4648-a16e-71541a73966e tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:29.046506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-606f4af5-43c6-4648-a16e-71541a73966e tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:29.046506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-606f4af5-43c6-4648-a16e-71541a73966e tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:29.200190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-606f4af5-43c6-4648-a16e-71541a73966e tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:33:29.208888 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-606f4af5-43c6-4648-a16e-71541a73966e tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1508 microversion: 2.1 time: 0.183889 Sep 06 11:33:29.209479 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3112/6171] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:33:29 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:33:38.628013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d811911f-7135-4822-aa2d-99ff0b4a1787", "device": "/dev/sdb"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:33:38.630439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:33:38.632639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:38.638867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:38.638867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=28 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:38.640680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:38.641358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:38.641887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:38.642676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:33:38.643356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:33:38.644015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:33:39.798933 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "POST /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.174611 Sep 06 11:33:39.799949 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3060/6172] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:33:38 2022] POST /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5/os-volume_attachments => generated 194 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:34:48.491543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=16 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:48.492341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=32 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:48.675299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-622deb57-e1f6-4cb1-b9b2-426e06b5361b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'create', calling method: .version_select at 0x7f90f87495e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-579086117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVwJqOr69A/eNc5DP/EH+6bS88DW88GbLwWcCyEcZ3nFweoH1+s0ysk5Q3JswhcLKffFYtRo4KdHKZESwVCqx55tLEmr5Gtm/csejBI4wd6cMKnzOJTMhHvxiLsJTR7KQ=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:34:48.691539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-622deb57-e1f6-4cb1-b9b2-426e06b5361b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:34:48.696959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-622deb57-e1f6-4cb1-b9b2-426e06b5361b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for user fcaddf25fc12498b90d2cc1ec08e5da3 and project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:34:48.711253 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [None req-622deb57-e1f6-4cb1-b9b2-426e06b5361b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [7b5429c0-e824-481c-9fad-9708bdd31e04] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 11:34:49.726244 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [None req-622deb57-e1f6-4cb1-b9b2-426e06b5361b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [7b5429c0-e824-481c-9fad-9708bdd31e04] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54100. Sep 06 11:34:49.828090 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-622deb57-e1f6-4cb1-b9b2-426e06b5361b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.338634 Sep 06 11:34:49.828761 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3113/6173] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:34:48 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:34:59.158690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:59.160193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:59.161066 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:34:59.161245 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 11:34:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 06 11:34:59.167625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-466356045", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "5133e1a2-c373-43d9-8c7b-ed143f6478d2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-579086117", "security_groups": [{"name": "tempest-secgroup-smoke-65442564"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:34:59.304431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] validate_networks() for [('5133e1a2-c373-43d9-8c7b-ed143f6478d2', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:34:59.843231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:34:59.844476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:34:59.847038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:34:59.847669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:34:59.848199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:34:59.858737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:34:59.859257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:34:59.860595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:34:59.861515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:34:59.862438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:34:59.863080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:34:59.909521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:34:59.917536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for user fcaddf25fc12498b90d2cc1ec08e5da3 and project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:34:59.934089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:34:59.937389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:35:00.146521 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-26b35275-42d2-4821-94a3-246a5f2f17f5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.989722 Sep 06 11:35:00.147829 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3061/6174] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:34:59 2022] POST /compute/v2.1/servers => generated 404 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:35:00.160279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dd3231ed-e46a-4b07-9583-b7f44738fe51 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:00.162753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dd3231ed-e46a-4b07-9583-b7f44738fe51 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:00.174949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:00.176011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:00.233802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dd3231ed-e46a-4b07-9583-b7f44738fe51 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:00.243734 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dd3231ed-e46a-4b07-9583-b7f44738fe51 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1265 microversion: 2.1 time: 0.087833 Sep 06 11:35:00.248408 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3114/6175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:00 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:01.268356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1cccf6d5-15b2-4bd6-81a3-53c14b489de8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:01.269084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1cccf6d5-15b2-4bd6-81a3-53c14b489de8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:01.326777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1cccf6d5-15b2-4bd6-81a3-53c14b489de8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:01.334190 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1cccf6d5-15b2-4bd6-81a3-53c14b489de8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1265 microversion: 2.1 time: 0.070788 Sep 06 11:35:01.347000 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3062/6176] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:01 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1265 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:02.359496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1987b025-af92-423d-83c7-927d00eaa27a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:02.360377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1987b025-af92-423d-83c7-927d00eaa27a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:02.370249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1987b025-af92-423d-83c7-927d00eaa27a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:02.370745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1987b025-af92-423d-83c7-927d00eaa27a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:02.371257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1987b025-af92-423d-83c7-927d00eaa27a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:02.371968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1987b025-af92-423d-83c7-927d00eaa27a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:02.372436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1987b025-af92-423d-83c7-927d00eaa27a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:02.372869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1987b025-af92-423d-83c7-927d00eaa27a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:02.447723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1987b025-af92-423d-83c7-927d00eaa27a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:02.455834 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1987b025-af92-423d-83c7-927d00eaa27a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1317 microversion: 2.1 time: 0.101579 Sep 06 11:35:02.456983 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3115/6177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:02 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1317 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:03.482214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-83b60085-8be2-496c-b15b-ca0408674081 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:03.482760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-83b60085-8be2-496c-b15b-ca0408674081 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:03.492321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83b60085-8be2-496c-b15b-ca0408674081 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:03.492827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83b60085-8be2-496c-b15b-ca0408674081 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:03.493285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83b60085-8be2-496c-b15b-ca0408674081 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:03.494041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83b60085-8be2-496c-b15b-ca0408674081 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:03.494517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83b60085-8be2-496c-b15b-ca0408674081 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:03.494960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83b60085-8be2-496c-b15b-ca0408674081 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:03.573612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-83b60085-8be2-496c-b15b-ca0408674081 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:03.582436 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-83b60085-8be2-496c-b15b-ca0408674081 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1323 microversion: 2.1 time: 0.104295 Sep 06 11:35:03.583427 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3063/6178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:03 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1323 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:04.607049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-74576088-b5cb-48a9-9868-c63c78562dea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:04.607675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-74576088-b5cb-48a9-9868-c63c78562dea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:04.615987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74576088-b5cb-48a9-9868-c63c78562dea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:04.615987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74576088-b5cb-48a9-9868-c63c78562dea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:04.617800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74576088-b5cb-48a9-9868-c63c78562dea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:04.617800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74576088-b5cb-48a9-9868-c63c78562dea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:04.617800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74576088-b5cb-48a9-9868-c63c78562dea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:04.618509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74576088-b5cb-48a9-9868-c63c78562dea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:04.783765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-74576088-b5cb-48a9-9868-c63c78562dea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:04.792363 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-74576088-b5cb-48a9-9868-c63c78562dea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1389 microversion: 2.1 time: 0.189303 Sep 06 11:35:04.793415 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3116/6179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:04 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1389 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:05.204668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f81d94e9-5f06-4683-9e05-7279199377a0 req-a3d7b8d9-8e96-4c03-ae9e-d9d16fd7394c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041a08f6-a7e3-4d0c-aedd-6a7e48b9340a", "tag": "87f49413-0b0b-4cd0-8270-8a568fa3c107"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:35:05.217197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f81d94e9-5f06-4683-9e05-7279199377a0 req-a3d7b8d9-8e96-4c03-ae9e-d9d16fd7394c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:05.219418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f81d94e9-5f06-4683-9e05-7279199377a0 req-a3d7b8d9-8e96-4c03-ae9e-d9d16fd7394c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:05.220346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f81d94e9-5f06-4683-9e05-7279199377a0 req-a3d7b8d9-8e96-4c03-ae9e-d9d16fd7394c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:05.237850 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f81d94e9-5f06-4683-9e05-7279199377a0 req-a3d7b8d9-8e96-4c03-ae9e-d9d16fd7394c service nova] Creating event network-changed:87f49413-0b0b-4cd0-8270-8a568fa3c107 for instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a on nch2-master-1 Sep 06 11:35:05.244156 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f81d94e9-5f06-4683-9e05-7279199377a0 req-a3d7b8d9-8e96-4c03-ae9e-d9d16fd7394c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043139 Sep 06 11:35:05.244809 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3064/6180] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:35:05.817033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f8208bce-1fa1-45f9-a91b-e7c8bf0dce40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:05.818464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f8208bce-1fa1-45f9-a91b-e7c8bf0dce40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:05.827173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8208bce-1fa1-45f9-a91b-e7c8bf0dce40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:05.827678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8208bce-1fa1-45f9-a91b-e7c8bf0dce40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:05.828727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8208bce-1fa1-45f9-a91b-e7c8bf0dce40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:05.829456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8208bce-1fa1-45f9-a91b-e7c8bf0dce40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:05.829931 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8208bce-1fa1-45f9-a91b-e7c8bf0dce40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:05.830436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f8208bce-1fa1-45f9-a91b-e7c8bf0dce40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:06.001530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f8208bce-1fa1-45f9-a91b-e7c8bf0dce40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:06.017658 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f8208bce-1fa1-45f9-a91b-e7c8bf0dce40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1389 microversion: 2.1 time: 0.205027 Sep 06 11:35:06.022013 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3117/6181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:05 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1389 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:07.049643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-85734136-8a18-4eb8-92b7-6d1598a1877b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:07.050946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-85734136-8a18-4eb8-92b7-6d1598a1877b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:07.057864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85734136-8a18-4eb8-92b7-6d1598a1877b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:07.058373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85734136-8a18-4eb8-92b7-6d1598a1877b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:07.058838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85734136-8a18-4eb8-92b7-6d1598a1877b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:07.059595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85734136-8a18-4eb8-92b7-6d1598a1877b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:07.060069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85734136-8a18-4eb8-92b7-6d1598a1877b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:07.060606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85734136-8a18-4eb8-92b7-6d1598a1877b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:07.206322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-85734136-8a18-4eb8-92b7-6d1598a1877b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:07.215316 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-85734136-8a18-4eb8-92b7-6d1598a1877b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1389 microversion: 2.1 time: 0.170803 Sep 06 11:35:07.215964 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3065/6182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:07 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1389 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:08.240969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-989e87ce-c71a-4cef-85dd-3ae6d21e8bea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:08.241497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-989e87ce-c71a-4cef-85dd-3ae6d21e8bea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:08.248484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-989e87ce-c71a-4cef-85dd-3ae6d21e8bea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:08.248979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-989e87ce-c71a-4cef-85dd-3ae6d21e8bea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:08.249430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-989e87ce-c71a-4cef-85dd-3ae6d21e8bea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:08.252988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-989e87ce-c71a-4cef-85dd-3ae6d21e8bea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:08.252988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-989e87ce-c71a-4cef-85dd-3ae6d21e8bea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:08.252988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-989e87ce-c71a-4cef-85dd-3ae6d21e8bea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:08.394578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-989e87ce-c71a-4cef-85dd-3ae6d21e8bea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:08.402494 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-989e87ce-c71a-4cef-85dd-3ae6d21e8bea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1389 microversion: 2.1 time: 0.165656 Sep 06 11:35:08.403373 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3118/6183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:08 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:09.426406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e39c03fe-1aae-45e2-8ce6-b165a937e524 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:09.427736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e39c03fe-1aae-45e2-8ce6-b165a937e524 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:09.443352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e39c03fe-1aae-45e2-8ce6-b165a937e524 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:09.443352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e39c03fe-1aae-45e2-8ce6-b165a937e524 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:09.443352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e39c03fe-1aae-45e2-8ce6-b165a937e524 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:09.443352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e39c03fe-1aae-45e2-8ce6-b165a937e524 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:09.443352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e39c03fe-1aae-45e2-8ce6-b165a937e524 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:09.443352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e39c03fe-1aae-45e2-8ce6-b165a937e524 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:09.579793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e39c03fe-1aae-45e2-8ce6-b165a937e524 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:09.589304 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e39c03fe-1aae-45e2-8ce6-b165a937e524 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1389 microversion: 2.1 time: 0.167370 Sep 06 11:35:09.589947 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3066/6184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:09 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1389 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:10.120623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-96ea3afa-0a92-43d6-a749-8f6ff1baa065 req-055c8bae-253b-43a0-8f5e-f0bdf10f4aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041a08f6-a7e3-4d0c-aedd-6a7e48b9340a", "name": "network-vif-plugged", "status": "completed", "tag": "87f49413-0b0b-4cd0-8270-8a568fa3c107"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:35:10.132696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-96ea3afa-0a92-43d6-a749-8f6ff1baa065 req-055c8bae-253b-43a0-8f5e-f0bdf10f4aa7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:10.133181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-96ea3afa-0a92-43d6-a749-8f6ff1baa065 req-055c8bae-253b-43a0-8f5e-f0bdf10f4aa7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:10.133616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-96ea3afa-0a92-43d6-a749-8f6ff1baa065 req-055c8bae-253b-43a0-8f5e-f0bdf10f4aa7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:10.145902 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-96ea3afa-0a92-43d6-a749-8f6ff1baa065 req-055c8bae-253b-43a0-8f5e-f0bdf10f4aa7 service nova] Creating event network-vif-plugged:87f49413-0b0b-4cd0-8270-8a568fa3c107 for instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a on nch2-master-1 Sep 06 11:35:10.151332 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-96ea3afa-0a92-43d6-a749-8f6ff1baa065 req-055c8bae-253b-43a0-8f5e-f0bdf10f4aa7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034748 Sep 06 11:35:10.151965 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3119/6185] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:35:10.612716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4bf10641-0937-41c1-9e48-6315d12f75af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:10.613337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4bf10641-0937-41c1-9e48-6315d12f75af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:10.615382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:10.621601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bf10641-0937-41c1-9e48-6315d12f75af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:10.622107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bf10641-0937-41c1-9e48-6315d12f75af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:10.622559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bf10641-0937-41c1-9e48-6315d12f75af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:10.623312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bf10641-0937-41c1-9e48-6315d12f75af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:10.623852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bf10641-0937-41c1-9e48-6315d12f75af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:10.624298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bf10641-0937-41c1-9e48-6315d12f75af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:10.778066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4bf10641-0937-41c1-9e48-6315d12f75af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:10.787592 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4bf10641-0937-41c1-9e48-6315d12f75af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1389 microversion: 2.1 time: 0.178695 Sep 06 11:35:10.788195 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3067/6186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:10 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1389 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:11.814187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-79be103b-b3e6-4c72-930f-cdbd6880a20e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:11.814888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-79be103b-b3e6-4c72-930f-cdbd6880a20e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:11.821438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79be103b-b3e6-4c72-930f-cdbd6880a20e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:11.821924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79be103b-b3e6-4c72-930f-cdbd6880a20e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:11.822366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79be103b-b3e6-4c72-930f-cdbd6880a20e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:11.823091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79be103b-b3e6-4c72-930f-cdbd6880a20e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:11.823621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79be103b-b3e6-4c72-930f-cdbd6880a20e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:11.824055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79be103b-b3e6-4c72-930f-cdbd6880a20e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:11.960786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-79be103b-b3e6-4c72-930f-cdbd6880a20e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:11.968780 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-79be103b-b3e6-4c72-930f-cdbd6880a20e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1561 microversion: 2.1 time: 0.160454 Sep 06 11:35:11.969362 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3120/6187] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:11 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:11.991353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6181e98a-2605-4e99-9235-fa4a3413e828 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:11.992127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6181e98a-2605-4e99-9235-fa4a3413e828 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:11.994601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:12.002775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6181e98a-2605-4e99-9235-fa4a3413e828 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:12.002775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6181e98a-2605-4e99-9235-fa4a3413e828 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:12.002775 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6181e98a-2605-4e99-9235-fa4a3413e828 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:12.003091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6181e98a-2605-4e99-9235-fa4a3413e828 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:12.003319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6181e98a-2605-4e99-9235-fa4a3413e828 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:12.003765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6181e98a-2605-4e99-9235-fa4a3413e828 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:12.141618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6181e98a-2605-4e99-9235-fa4a3413e828 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:12.149490 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6181e98a-2605-4e99-9235-fa4a3413e828 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1561 microversion: 2.1 time: 0.162204 Sep 06 11:35:12.150931 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3068/6188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:11 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:14.655633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ef158fac-c720-471e-b3a9-a4e5a281ddc6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:14.656892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ef158fac-c720-471e-b3a9-a4e5a281ddc6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:14.659233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:14.659382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-d1e5aa80-73c8-4a34-8df5-44b79551f61b req-e5acecaa-206c-4800-a47d-31ad815c56e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041a08f6-a7e3-4d0c-aedd-6a7e48b9340a", "tag": "87f49413-0b0b-4cd0-8270-8a568fa3c107"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:35:14.665962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef158fac-c720-471e-b3a9-a4e5a281ddc6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:14.666786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef158fac-c720-471e-b3a9-a4e5a281ddc6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:14.667520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef158fac-c720-471e-b3a9-a4e5a281ddc6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:14.668329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef158fac-c720-471e-b3a9-a4e5a281ddc6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:14.668868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef158fac-c720-471e-b3a9-a4e5a281ddc6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:14.669458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ef158fac-c720-471e-b3a9-a4e5a281ddc6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:14.669739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d1e5aa80-73c8-4a34-8df5-44b79551f61b req-e5acecaa-206c-4800-a47d-31ad815c56e4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:14.670233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d1e5aa80-73c8-4a34-8df5-44b79551f61b req-e5acecaa-206c-4800-a47d-31ad815c56e4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:14.670677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d1e5aa80-73c8-4a34-8df5-44b79551f61b req-e5acecaa-206c-4800-a47d-31ad815c56e4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:14.692484 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-d1e5aa80-73c8-4a34-8df5-44b79551f61b req-e5acecaa-206c-4800-a47d-31ad815c56e4 service nova] Creating event network-changed:87f49413-0b0b-4cd0-8270-8a568fa3c107 for instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a on nch2-master-1 Sep 06 11:35:14.698957 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-d1e5aa80-73c8-4a34-8df5-44b79551f61b req-e5acecaa-206c-4800-a47d-31ad815c56e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045512 Sep 06 11:35:14.701423 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3069/6189] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:35:14.826843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ef158fac-c720-471e-b3a9-a4e5a281ddc6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:14.836156 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ef158fac-c720-471e-b3a9-a4e5a281ddc6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1561 microversion: 2.1 time: 0.185280 Sep 06 11:35:14.837940 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3121/6190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:14 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:35.609545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:35.611381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=36 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:35.615195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-818311d0-bf87-41f0-b4ad-67ff1e442bff tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:35.615794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-818311d0-bf87-41f0-b4ad-67ff1e442bff tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:35.622158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-818311d0-bf87-41f0-b4ad-67ff1e442bff tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:35.622651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-818311d0-bf87-41f0-b4ad-67ff1e442bff tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:35.623131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-818311d0-bf87-41f0-b4ad-67ff1e442bff tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:35.623948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-818311d0-bf87-41f0-b4ad-67ff1e442bff tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:35.624411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-818311d0-bf87-41f0-b4ad-67ff1e442bff tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:35.624846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-818311d0-bf87-41f0-b4ad-67ff1e442bff tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:35.717467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-818311d0-bf87-41f0-b4ad-67ff1e442bff tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lazy-loading 'services' on Instance uuid ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:35:36.033442 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-818311d0-bf87-41f0-b4ad-67ff1e442bff tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5/os-volume_attachments/d811911f-7135-4822-aa2d-99ff0b4a1787" status: 202 len: 0 microversion: 2.1 time: 0.425763 Sep 06 11:35:36.034031 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3070/6191] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 11:35:35 2022] DELETE /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5/os-volume_attachments/d811911f-7135-4822-aa2d-99ff0b4a1787 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:35:36.107045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5b84f281-f8c3-4b2a-8e9e-e95333affa58 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:35:36.109946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5b84f281-f8c3-4b2a-8e9e-e95333affa58 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:36.112681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=18 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:36.113457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=38 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:36.118363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b84f281-f8c3-4b2a-8e9e-e95333affa58 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:36.118853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b84f281-f8c3-4b2a-8e9e-e95333affa58 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:36.119376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b84f281-f8c3-4b2a-8e9e-e95333affa58 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:36.120095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b84f281-f8c3-4b2a-8e9e-e95333affa58 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:36.120559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b84f281-f8c3-4b2a-8e9e-e95333affa58 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:36.120995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b84f281-f8c3-4b2a-8e9e-e95333affa58 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:36.192489 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5b84f281-f8c3-4b2a-8e9e-e95333affa58 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a/action" status: 200 len: 24566 microversion: 2.1 time: 0.089874 Sep 06 11:35:36.193162 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3122/6192] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:35:36 2022] POST /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a/action => generated 24566 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:35:37.166264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2e6398a4-8867-4472-8d48-2e21a3d3402f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:37.166855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2e6398a4-8867-4472-8d48-2e21a3d3402f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:37.174855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e6398a4-8867-4472-8d48-2e21a3d3402f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:37.175375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e6398a4-8867-4472-8d48-2e21a3d3402f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:37.175823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e6398a4-8867-4472-8d48-2e21a3d3402f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:37.176535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e6398a4-8867-4472-8d48-2e21a3d3402f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:37.177000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e6398a4-8867-4472-8d48-2e21a3d3402f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:37.177435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2e6398a4-8867-4472-8d48-2e21a3d3402f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:37.210498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2e6398a4-8867-4472-8d48-2e21a3d3402f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:35:37.494334 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2e6398a4-8867-4472-8d48-2e21a3d3402f tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 204 len: 0 microversion: 2.1 time: 0.332729 Sep 06 11:35:37.494843 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3071/6193] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:35:37 2022] DELETE /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:35:37.505446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1d30b625-9cf5-4cb5-bf54-0e30480bba18 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:37.506166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1d30b625-9cf5-4cb5-bf54-0e30480bba18 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:37.515964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d30b625-9cf5-4cb5-bf54-0e30480bba18 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:37.516496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d30b625-9cf5-4cb5-bf54-0e30480bba18 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:37.516970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d30b625-9cf5-4cb5-bf54-0e30480bba18 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:37.518312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d30b625-9cf5-4cb5-bf54-0e30480bba18 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:37.518809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d30b625-9cf5-4cb5-bf54-0e30480bba18 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:37.519276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1d30b625-9cf5-4cb5-bf54-0e30480bba18 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:37.656281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1d30b625-9cf5-4cb5-bf54-0e30480bba18 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:37.664849 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1d30b625-9cf5-4cb5-bf54-0e30480bba18 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1514 microversion: 2.1 time: 0.165247 Sep 06 11:35:37.665422 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3123/6194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:37 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:38.689605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-974b9e2a-3d71-47f6-8e78-1298ced9e004 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:38.690904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-974b9e2a-3d71-47f6-8e78-1298ced9e004 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:38.698018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-974b9e2a-3d71-47f6-8e78-1298ced9e004 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:38.698517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-974b9e2a-3d71-47f6-8e78-1298ced9e004 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:38.698964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-974b9e2a-3d71-47f6-8e78-1298ced9e004 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:38.699769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-974b9e2a-3d71-47f6-8e78-1298ced9e004 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:38.700261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-974b9e2a-3d71-47f6-8e78-1298ced9e004 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:38.700695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-974b9e2a-3d71-47f6-8e78-1298ced9e004 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:38.847933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-974b9e2a-3d71-47f6-8e78-1298ced9e004 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:38.858221 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-974b9e2a-3d71-47f6-8e78-1298ced9e004 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1514 microversion: 2.1 time: 0.173048 Sep 06 11:35:38.858874 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3072/6195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:38 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:39.540770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-3d82aedb-5a3c-460b-ad5d-dad17b7d4b04 req-5c6d09ed-3fd6-423c-abf0-e19bed133324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5", "name": "network-vif-deleted", "tag": "349605ad-2102-44a6-a14d-d26de873e59b"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:35:39.552637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3d82aedb-5a3c-460b-ad5d-dad17b7d4b04 req-5c6d09ed-3fd6-423c-abf0-e19bed133324 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:39.553130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3d82aedb-5a3c-460b-ad5d-dad17b7d4b04 req-5c6d09ed-3fd6-423c-abf0-e19bed133324 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:39.553655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3d82aedb-5a3c-460b-ad5d-dad17b7d4b04 req-5c6d09ed-3fd6-423c-abf0-e19bed133324 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:39.565763 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-3d82aedb-5a3c-460b-ad5d-dad17b7d4b04 req-5c6d09ed-3fd6-423c-abf0-e19bed133324 service nova] Creating event network-vif-deleted:349605ad-2102-44a6-a14d-d26de873e59b for instance ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 on nch1-master-1 Sep 06 11:35:39.571185 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-3d82aedb-5a3c-460b-ad5d-dad17b7d4b04 req-5c6d09ed-3fd6-423c-abf0-e19bed133324 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034205 Sep 06 11:35:39.571930 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3124/6196] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:35:39.882722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:39.884063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:39.892252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:39.892756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:39.893202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:39.893945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:39.894519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:39.894959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:39.930537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:39.930930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:39.931403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:39.931898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lazy-loading 'fault' on Instance uuid ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:35:39.975962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:39.983990 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f00ea6f0-4b50-4215-8b2d-a3324a1b44b7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 200 len: 1309 microversion: 2.1 time: 0.105239 Sep 06 11:35:39.984575 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3073/6197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:39 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:41.011975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9792468-8ccf-4741-8a16-f8cc0d2526e7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:41.013461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d9792468-8ccf-4741-8a16-f8cc0d2526e7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:41.020872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9792468-8ccf-4741-8a16-f8cc0d2526e7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:41.021374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9792468-8ccf-4741-8a16-f8cc0d2526e7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:41.021823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9792468-8ccf-4741-8a16-f8cc0d2526e7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:41.022545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9792468-8ccf-4741-8a16-f8cc0d2526e7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:41.023059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9792468-8ccf-4741-8a16-f8cc0d2526e7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:41.023504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9792468-8ccf-4741-8a16-f8cc0d2526e7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:41.039279 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-d9792468-8ccf-4741-8a16-f8cc0d2526e7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] HTTP exception thrown: Instance ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 could not be found. Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9792468-8ccf-4741-8a16-f8cc0d2526e7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Request method failure captured: Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 HTTP/1.1 Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy91X871OIdc9SsMYbHL9klU2jOPDCw8xQbq-a1xy8Zg9EPIHWrj_1m1LnS8Szmdh1KxiEVrzFNEJJKV3yG_1a36NbAZWtxz-g9QvDA4hEDpIBrkyxP1sUCMMgHtsvUuMm8lirX-zGfZEYD-JDsLGOiL5LPkBinewwdjIOhxLBSkDtA Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: eb7c997d05c141afb82389298ecb372c Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1413768274 Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eb7c997d05c141afb82389298ecb372c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb7c997d05c141afb82389298ecb372c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eb7c997d05c141afb82389298ecb372c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb7c997d05c141afb82389298ecb372c"}]}] Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-VolumesSnapshotTestJSON-1413768274 Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: eb7c997d05c141afb82389298ecb372c Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1413768274 Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-VolumesSnapshotTestJSON-1413768274-project Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 4a1fe9d40733413a9c56393762549c7d Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-VolumesSnapshotTestJSON-1413768274-project Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 could not be found. Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5'} Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 could not be found. Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 could not be found. Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:35:41.040978 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:35:41.045388 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:35:41.045388 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:35:41.045388 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:35:41.045388 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:35:41.045388 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:35:41.045388 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 could not be found. Sep 06 11:35:41.045388 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:35:41.045388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9792468-8ccf-4741-8a16-f8cc0d2526e7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Returning 404 to user: Instance ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:35:41.045388 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d9792468-8ccf-4741-8a16-f8cc0d2526e7 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5" status: 404 len: 111 microversion: 2.1 time: 0.035589 Sep 06 11:35:41.045388 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3125/6198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:41 2022] GET /compute/v2.1/servers/ce588a1c-9a7a-4f0f-9c17-f49b47dd1fb5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:35:46.904933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0739e9fa-0cf2-4f39-9ef1-8b9e03c9bbe3 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:46.905582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0739e9fa-0cf2-4f39-9ef1-8b9e03c9bbe3 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:46.913314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0739e9fa-0cf2-4f39-9ef1-8b9e03c9bbe3 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:46.913805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0739e9fa-0cf2-4f39-9ef1-8b9e03c9bbe3 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:46.914244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0739e9fa-0cf2-4f39-9ef1-8b9e03c9bbe3 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:46.914950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0739e9fa-0cf2-4f39-9ef1-8b9e03c9bbe3 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:46.915488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0739e9fa-0cf2-4f39-9ef1-8b9e03c9bbe3 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:46.916087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0739e9fa-0cf2-4f39-9ef1-8b9e03c9bbe3 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:47.525375 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0739e9fa-0cf2-4f39-9ef1-8b9e03c9bbe3 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1831 microversion: 2.1 time: 0.624502 Sep 06 11:35:47.525859 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3074/6199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:46 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1831 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:47.548253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9cfb34a4-76f5-4dcf-99ec-2601f88ccb9b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:47.548891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9cfb34a4-76f5-4dcf-99ec-2601f88ccb9b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:47.557520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cfb34a4-76f5-4dcf-99ec-2601f88ccb9b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:47.558590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cfb34a4-76f5-4dcf-99ec-2601f88ccb9b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:47.558590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cfb34a4-76f5-4dcf-99ec-2601f88ccb9b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:47.559272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cfb34a4-76f5-4dcf-99ec-2601f88ccb9b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:47.559818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cfb34a4-76f5-4dcf-99ec-2601f88ccb9b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:47.560259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9cfb34a4-76f5-4dcf-99ec-2601f88ccb9b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:47.770042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9cfb34a4-76f5-4dcf-99ec-2601f88ccb9b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:47.778413 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9cfb34a4-76f5-4dcf-99ec-2601f88ccb9b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1680 microversion: 2.1 time: 0.233806 Sep 06 11:35:47.779026 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3126/6200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:47 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:47.885170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5641c0ca-b30f-4c30-97fe-57d0ec67d921 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:35:47.887759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5641c0ca-b30f-4c30-97fe-57d0ec67d921 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:47.894668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5641c0ca-b30f-4c30-97fe-57d0ec67d921 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:47.895188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5641c0ca-b30f-4c30-97fe-57d0ec67d921 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:47.895638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5641c0ca-b30f-4c30-97fe-57d0ec67d921 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:47.896355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5641c0ca-b30f-4c30-97fe-57d0ec67d921 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:47.896821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5641c0ca-b30f-4c30-97fe-57d0ec67d921 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:47.897261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5641c0ca-b30f-4c30-97fe-57d0ec67d921 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:47.968545 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5641c0ca-b30f-4c30-97fe-57d0ec67d921 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a/action" status: 200 len: 32644 microversion: 2.1 time: 0.087113 Sep 06 11:35:47.970115 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3075/6201] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:35:47 2022] POST /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a/action => generated 32644 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:35:48.148357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-741b1c6c-0891-415b-81f5-12f0a9b026bd tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:35:48.148946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-741b1c6c-0891-415b-81f5-12f0a9b026bd tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:48.155738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741b1c6c-0891-415b-81f5-12f0a9b026bd tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:48.156226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741b1c6c-0891-415b-81f5-12f0a9b026bd tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:48.156671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741b1c6c-0891-415b-81f5-12f0a9b026bd tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:48.157561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741b1c6c-0891-415b-81f5-12f0a9b026bd tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:48.158031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741b1c6c-0891-415b-81f5-12f0a9b026bd tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:48.158480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-741b1c6c-0891-415b-81f5-12f0a9b026bd tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:48.260426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-741b1c6c-0891-415b-81f5-12f0a9b026bd tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f25ab44649ae45ab99061c93809e55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04385e36a65e4f41aab4eceff7b42e68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:48.261046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-741b1c6c-0891-415b-81f5-12f0a9b026bd tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] flavor_id is None. Assuming migration. {{(pid=140876) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 06 11:35:48.261490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-741b1c6c-0891-415b-81f5-12f0a9b026bd tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140876) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:35:48.762018 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-741b1c6c-0891-415b-81f5-12f0a9b026bd tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a/action" status: 202 len: 0 microversion: 2.1 time: 0.618001 Sep 06 11:35:48.765756 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3127/6202] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:35:48 2022] POST /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:35:48.772424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4b58dcb8-81bd-4af6-9882-850c6a418bb9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:48.773148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4b58dcb8-81bd-4af6-9882-850c6a418bb9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:48.788475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b58dcb8-81bd-4af6-9882-850c6a418bb9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:48.788691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b58dcb8-81bd-4af6-9882-850c6a418bb9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:48.789158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b58dcb8-81bd-4af6-9882-850c6a418bb9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:48.789896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b58dcb8-81bd-4af6-9882-850c6a418bb9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:48.790367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b58dcb8-81bd-4af6-9882-850c6a418bb9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:48.791041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b58dcb8-81bd-4af6-9882-850c6a418bb9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:48.949747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4b58dcb8-81bd-4af6-9882-850c6a418bb9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:48.964721 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4b58dcb8-81bd-4af6-9882-850c6a418bb9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1689 microversion: 2.1 time: 0.192706 Sep 06 11:35:48.964721 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3076/6203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:48 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:49.984800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3ce54471-39f1-47c7-b319-7d34bdafdde3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:49.985549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3ce54471-39f1-47c7-b319-7d34bdafdde3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:49.998102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ce54471-39f1-47c7-b319-7d34bdafdde3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:49.998102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ce54471-39f1-47c7-b319-7d34bdafdde3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:49.998102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ce54471-39f1-47c7-b319-7d34bdafdde3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:49.998102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ce54471-39f1-47c7-b319-7d34bdafdde3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:49.998102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ce54471-39f1-47c7-b319-7d34bdafdde3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:49.998102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ce54471-39f1-47c7-b319-7d34bdafdde3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:50.140715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3ce54471-39f1-47c7-b319-7d34bdafdde3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:50.149672 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3ce54471-39f1-47c7-b319-7d34bdafdde3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1689 microversion: 2.1 time: 0.169989 Sep 06 11:35:50.150250 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3128/6204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:49 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:51.175386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b8b19148-3a33-4f6e-b7f3-e1bdc54585d7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:51.176241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b8b19148-3a33-4f6e-b7f3-e1bdc54585d7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:51.184247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b19148-3a33-4f6e-b7f3-e1bdc54585d7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:51.184746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b19148-3a33-4f6e-b7f3-e1bdc54585d7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:51.186327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b19148-3a33-4f6e-b7f3-e1bdc54585d7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:51.186327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b19148-3a33-4f6e-b7f3-e1bdc54585d7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:51.186551 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b19148-3a33-4f6e-b7f3-e1bdc54585d7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:51.186811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b19148-3a33-4f6e-b7f3-e1bdc54585d7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:51.330338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b8b19148-3a33-4f6e-b7f3-e1bdc54585d7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:51.339447 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b8b19148-3a33-4f6e-b7f3-e1bdc54585d7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1689 microversion: 2.1 time: 0.169661 Sep 06 11:35:51.340029 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3077/6205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:51 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:52.367623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d3e0dc94-8b4d-49dc-9ae8-557f554041fb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:52.368257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3e0dc94-8b4d-49dc-9ae8-557f554041fb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:52.377677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e0dc94-8b4d-49dc-9ae8-557f554041fb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:52.378993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e0dc94-8b4d-49dc-9ae8-557f554041fb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:52.379768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e0dc94-8b4d-49dc-9ae8-557f554041fb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:52.380915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e0dc94-8b4d-49dc-9ae8-557f554041fb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:52.381704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e0dc94-8b4d-49dc-9ae8-557f554041fb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:52.382416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3e0dc94-8b4d-49dc-9ae8-557f554041fb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:52.556254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d3e0dc94-8b4d-49dc-9ae8-557f554041fb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:52.556254 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d3e0dc94-8b4d-49dc-9ae8-557f554041fb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1689 microversion: 2.1 time: 0.185417 Sep 06 11:35:52.556254 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3129/6206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:52 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:53.574348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dd145285-f2e0-402c-9184-ce853884e91e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:53.575394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dd145285-f2e0-402c-9184-ce853884e91e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:53.583342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd145285-f2e0-402c-9184-ce853884e91e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:53.583874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd145285-f2e0-402c-9184-ce853884e91e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:53.587025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd145285-f2e0-402c-9184-ce853884e91e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:53.587025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd145285-f2e0-402c-9184-ce853884e91e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:53.587025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd145285-f2e0-402c-9184-ce853884e91e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:53.587025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd145285-f2e0-402c-9184-ce853884e91e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:53.726900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dd145285-f2e0-402c-9184-ce853884e91e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:53.735473 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dd145285-f2e0-402c-9184-ce853884e91e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1694 microversion: 2.1 time: 0.166706 Sep 06 11:35:53.736070 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3078/6207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:53 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:54.088131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-372695856", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "f3ec9212-c08a-44f5-9c93-11aeafe2d7b0"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:35:54.144064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] validate_networks() for [('f3ec9212-c08a-44f5-9c93-11aeafe2d7b0', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:35:54.515330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:35:54.515762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:35:54.516243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:35:54.516751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:35:54.517170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:35:54.526450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:54.526995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:54.527526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:54.528531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:54.528993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:54.529424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:54.547161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Getting quotas for project eb7c997d05c141afb82389298ecb372c. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:35:54.553346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Getting quotas for user 4a1fe9d40733413a9c56393762549c7d and project eb7c997d05c141afb82389298ecb372c. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:35:54.566553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:35:54.569112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:35:54.699471 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f365ff55-f3f4-4a6e-b333-2e652b422353 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615097 Sep 06 11:35:54.700144 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3130/6208] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:35:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:35:54.711601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-945cc6fb-fc3d-4639-b025-8bf5fd8993eb tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:54.712226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-945cc6fb-fc3d-4639-b025-8bf5fd8993eb tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:54.760653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a1e08cc6-42f6-4c91-b6fb-57cc6d34162b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:54.761283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a1e08cc6-42f6-4c91-b6fb-57cc6d34162b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:54.771310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1e08cc6-42f6-4c91-b6fb-57cc6d34162b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:54.772112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1e08cc6-42f6-4c91-b6fb-57cc6d34162b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:54.772734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1e08cc6-42f6-4c91-b6fb-57cc6d34162b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:54.772983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-945cc6fb-fc3d-4639-b025-8bf5fd8993eb tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:54.773637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1e08cc6-42f6-4c91-b6fb-57cc6d34162b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:54.774249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1e08cc6-42f6-4c91-b6fb-57cc6d34162b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:54.774690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a1e08cc6-42f6-4c91-b6fb-57cc6d34162b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:54.783272 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-945cc6fb-fc3d-4639-b025-8bf5fd8993eb tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 200 len: 1218 microversion: 2.1 time: 0.075625 Sep 06 11:35:54.783873 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3079/6209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:54 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:54.940027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a1e08cc6-42f6-4c91-b6fb-57cc6d34162b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:54.948704 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a1e08cc6-42f6-4c91-b6fb-57cc6d34162b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1694 microversion: 2.1 time: 0.192161 Sep 06 11:35:54.949299 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3131/6210] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:54 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:55.807612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0284d8dc-e85a-4bb5-9046-05273f5d75c8 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:55.808303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0284d8dc-e85a-4bb5-9046-05273f5d75c8 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:55.816105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0284d8dc-e85a-4bb5-9046-05273f5d75c8 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:55.816712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0284d8dc-e85a-4bb5-9046-05273f5d75c8 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:55.817155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0284d8dc-e85a-4bb5-9046-05273f5d75c8 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:55.817860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0284d8dc-e85a-4bb5-9046-05273f5d75c8 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:55.818323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0284d8dc-e85a-4bb5-9046-05273f5d75c8 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:55.818754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0284d8dc-e85a-4bb5-9046-05273f5d75c8 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:55.881570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0284d8dc-e85a-4bb5-9046-05273f5d75c8 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:55.889641 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0284d8dc-e85a-4bb5-9046-05273f5d75c8 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 200 len: 1222 microversion: 2.1 time: 0.085930 Sep 06 11:35:55.890231 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3080/6211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:55 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:55.978135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7569187-a58f-47a0-b056-0a2db1aba7be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:55.979488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d7569187-a58f-47a0-b056-0a2db1aba7be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:55.990505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7569187-a58f-47a0-b056-0a2db1aba7be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:55.991043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7569187-a58f-47a0-b056-0a2db1aba7be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:55.991515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7569187-a58f-47a0-b056-0a2db1aba7be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:55.992511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7569187-a58f-47a0-b056-0a2db1aba7be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:55.993163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7569187-a58f-47a0-b056-0a2db1aba7be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:55.993739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7569187-a58f-47a0-b056-0a2db1aba7be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:56.155507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d7569187-a58f-47a0-b056-0a2db1aba7be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:56.172436 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d7569187-a58f-47a0-b056-0a2db1aba7be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1694 microversion: 2.1 time: 0.202554 Sep 06 11:35:56.173822 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3132/6212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:55 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:56.913744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-07c3e5a4-3a1b-4a94-b91b-6435bd09a6c3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:56.914417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-07c3e5a4-3a1b-4a94-b91b-6435bd09a6c3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:56.921552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07c3e5a4-3a1b-4a94-b91b-6435bd09a6c3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:56.922036 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07c3e5a4-3a1b-4a94-b91b-6435bd09a6c3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:56.922479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07c3e5a4-3a1b-4a94-b91b-6435bd09a6c3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:56.923222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07c3e5a4-3a1b-4a94-b91b-6435bd09a6c3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:56.923705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07c3e5a4-3a1b-4a94-b91b-6435bd09a6c3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:56.924135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07c3e5a4-3a1b-4a94-b91b-6435bd09a6c3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:56.993248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-07c3e5a4-3a1b-4a94-b91b-6435bd09a6c3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:57.001745 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-07c3e5a4-3a1b-4a94-b91b-6435bd09a6c3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 200 len: 1270 microversion: 2.1 time: 0.092569 Sep 06 11:35:57.002337 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3081/6213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:56 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:35:57.198877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4b27923b-a6c1-4325-9c20-d6cbffcb5dd8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:57.199609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4b27923b-a6c1-4325-9c20-d6cbffcb5dd8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:57.214560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b27923b-a6c1-4325-9c20-d6cbffcb5dd8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:57.215101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b27923b-a6c1-4325-9c20-d6cbffcb5dd8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:57.215577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b27923b-a6c1-4325-9c20-d6cbffcb5dd8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:57.216302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b27923b-a6c1-4325-9c20-d6cbffcb5dd8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:57.216776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b27923b-a6c1-4325-9c20-d6cbffcb5dd8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:57.217443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b27923b-a6c1-4325-9c20-d6cbffcb5dd8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:57.361166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4b27923b-a6c1-4325-9c20-d6cbffcb5dd8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:57.370202 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4b27923b-a6c1-4325-9c20-d6cbffcb5dd8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1694 microversion: 2.1 time: 0.175340 Sep 06 11:35:57.370828 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3133/6214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:57 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:58.027607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-003f1511-c635-4065-b82a-2e2fd4b847f5 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:58.029109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-003f1511-c635-4065-b82a-2e2fd4b847f5 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:58.035915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-003f1511-c635-4065-b82a-2e2fd4b847f5 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:58.036602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-003f1511-c635-4065-b82a-2e2fd4b847f5 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:58.037053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-003f1511-c635-4065-b82a-2e2fd4b847f5 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:58.037805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-003f1511-c635-4065-b82a-2e2fd4b847f5 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:58.038266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-003f1511-c635-4065-b82a-2e2fd4b847f5 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:58.038697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-003f1511-c635-4065-b82a-2e2fd4b847f5 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:58.177918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-003f1511-c635-4065-b82a-2e2fd4b847f5 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:58.188243 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-003f1511-c635-4065-b82a-2e2fd4b847f5 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 200 len: 1318 microversion: 2.1 time: 0.165795 Sep 06 11:35:58.189728 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3082/6215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:58 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:58.394355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-88a0ab38-56c2-4c82-8f49-5486f81a07ed tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:58.395098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-88a0ab38-56c2-4c82-8f49-5486f81a07ed tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:58.401942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88a0ab38-56c2-4c82-8f49-5486f81a07ed tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:58.402438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88a0ab38-56c2-4c82-8f49-5486f81a07ed tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:58.402884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88a0ab38-56c2-4c82-8f49-5486f81a07ed tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:58.403884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88a0ab38-56c2-4c82-8f49-5486f81a07ed tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:58.404357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88a0ab38-56c2-4c82-8f49-5486f81a07ed tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:58.404795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88a0ab38-56c2-4c82-8f49-5486f81a07ed tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:58.558618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-88a0ab38-56c2-4c82-8f49-5486f81a07ed tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:58.570331 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-88a0ab38-56c2-4c82-8f49-5486f81a07ed tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1694 microversion: 2.1 time: 0.179827 Sep 06 11:35:58.571756 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3134/6216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:58 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:58.828381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-92fe73d0-e2d3-4e68-b853-b4f877c39b2d req-6586353c-b5ab-4378-ab85-8c9880897131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6722a0c0-e113-442f-b4c2-8ec30e58b2a4", "tag": "b8a9bd8d-c51b-4f7c-a347-98c8f5d77e1d"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:35:58.838790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-92fe73d0-e2d3-4e68-b853-b4f877c39b2d req-6586353c-b5ab-4378-ab85-8c9880897131 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:58.839305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-92fe73d0-e2d3-4e68-b853-b4f877c39b2d req-6586353c-b5ab-4378-ab85-8c9880897131 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:58.839743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-92fe73d0-e2d3-4e68-b853-b4f877c39b2d req-6586353c-b5ab-4378-ab85-8c9880897131 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:58.858061 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-92fe73d0-e2d3-4e68-b853-b4f877c39b2d req-6586353c-b5ab-4378-ab85-8c9880897131 service nova] Creating event network-changed:b8a9bd8d-c51b-4f7c-a347-98c8f5d77e1d for instance 6722a0c0-e113-442f-b4c2-8ec30e58b2a4 on nch1-master-1 Sep 06 11:35:58.864539 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-92fe73d0-e2d3-4e68-b853-b4f877c39b2d req-6586353c-b5ab-4378-ab85-8c9880897131 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039444 Sep 06 11:35:58.871405 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3083/6217] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:35:59.212206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-864ebe95-0fbe-4b6a-8609-47f46aaa9879 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:59.212852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-864ebe95-0fbe-4b6a-8609-47f46aaa9879 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:59.219788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-864ebe95-0fbe-4b6a-8609-47f46aaa9879 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:59.220248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-864ebe95-0fbe-4b6a-8609-47f46aaa9879 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:59.220698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-864ebe95-0fbe-4b6a-8609-47f46aaa9879 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:59.221413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-864ebe95-0fbe-4b6a-8609-47f46aaa9879 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:59.221877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-864ebe95-0fbe-4b6a-8609-47f46aaa9879 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:59.222348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-864ebe95-0fbe-4b6a-8609-47f46aaa9879 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:59.365974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-864ebe95-0fbe-4b6a-8609-47f46aaa9879 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:59.374577 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-864ebe95-0fbe-4b6a-8609-47f46aaa9879 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 200 len: 1318 microversion: 2.1 time: 0.166299 Sep 06 11:35:59.375547 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3135/6218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:59 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:35:59.595686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3354dcaa-64af-4cdd-835f-105fe86012c9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:35:59.596409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3354dcaa-64af-4cdd-835f-105fe86012c9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:35:59.602774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3354dcaa-64af-4cdd-835f-105fe86012c9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:59.603302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3354dcaa-64af-4cdd-835f-105fe86012c9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:59.603936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3354dcaa-64af-4cdd-835f-105fe86012c9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:59.604661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3354dcaa-64af-4cdd-835f-105fe86012c9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:35:59.605128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3354dcaa-64af-4cdd-835f-105fe86012c9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:35:59.605671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3354dcaa-64af-4cdd-835f-105fe86012c9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:35:59.759432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3354dcaa-64af-4cdd-835f-105fe86012c9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:35:59.767507 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3354dcaa-64af-4cdd-835f-105fe86012c9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1694 microversion: 2.1 time: 0.177224 Sep 06 11:35:59.768100 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3084/6219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:35:59 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:00.398002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-928fa2f1-3f39-4c42-be35-667bfaca7cfc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:00.398667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-928fa2f1-3f39-4c42-be35-667bfaca7cfc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:00.406669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-928fa2f1-3f39-4c42-be35-667bfaca7cfc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:00.407202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-928fa2f1-3f39-4c42-be35-667bfaca7cfc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:00.407665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-928fa2f1-3f39-4c42-be35-667bfaca7cfc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:00.408445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-928fa2f1-3f39-4c42-be35-667bfaca7cfc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:00.408914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-928fa2f1-3f39-4c42-be35-667bfaca7cfc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:00.409354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-928fa2f1-3f39-4c42-be35-667bfaca7cfc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:00.589787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-928fa2f1-3f39-4c42-be35-667bfaca7cfc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:00.598242 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-928fa2f1-3f39-4c42-be35-667bfaca7cfc tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 200 len: 1318 microversion: 2.1 time: 0.204203 Sep 06 11:36:00.599076 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3136/6220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:00 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:00.793522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f9f91408-ce46-452f-bcd1-0ee492718f75 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:00.794321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f9f91408-ce46-452f-bcd1-0ee492718f75 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:00.801245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9f91408-ce46-452f-bcd1-0ee492718f75 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:00.801745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9f91408-ce46-452f-bcd1-0ee492718f75 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:00.802196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9f91408-ce46-452f-bcd1-0ee492718f75 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:00.805754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9f91408-ce46-452f-bcd1-0ee492718f75 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:00.806304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9f91408-ce46-452f-bcd1-0ee492718f75 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:00.806759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9f91408-ce46-452f-bcd1-0ee492718f75 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:00.951507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f9f91408-ce46-452f-bcd1-0ee492718f75 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:00.955164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:00.960484 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f9f91408-ce46-452f-bcd1-0ee492718f75 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1694 microversion: 2.1 time: 0.171207 Sep 06 11:36:00.961137 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3085/6221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:00 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:01.882278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a55d4494-0065-414a-b1a8-c5aa84730ef4 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:01.882278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a55d4494-0065-414a-b1a8-c5aa84730ef4 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:01.896170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a55d4494-0065-414a-b1a8-c5aa84730ef4 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:01.897341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a55d4494-0065-414a-b1a8-c5aa84730ef4 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:01.898756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a55d4494-0065-414a-b1a8-c5aa84730ef4 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:01.900195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a55d4494-0065-414a-b1a8-c5aa84730ef4 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:01.901285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a55d4494-0065-414a-b1a8-c5aa84730ef4 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:01.902065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a55d4494-0065-414a-b1a8-c5aa84730ef4 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:01.988816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff0a2013-df07-4dc1-8b53-75effed63826 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:01.988816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff0a2013-df07-4dc1-8b53-75effed63826 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:01.998253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff0a2013-df07-4dc1-8b53-75effed63826 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:02.004654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff0a2013-df07-4dc1-8b53-75effed63826 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:02.005355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff0a2013-df07-4dc1-8b53-75effed63826 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:02.006266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff0a2013-df07-4dc1-8b53-75effed63826 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:02.007189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff0a2013-df07-4dc1-8b53-75effed63826 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:02.007584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff0a2013-df07-4dc1-8b53-75effed63826 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:02.162190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a55d4494-0065-414a-b1a8-c5aa84730ef4 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:02.174769 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a55d4494-0065-414a-b1a8-c5aa84730ef4 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 200 len: 1318 microversion: 2.1 time: 0.557553 Sep 06 11:36:02.202144 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3137/6222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:01 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:02.231432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff0a2013-df07-4dc1-8b53-75effed63826 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:02.240320 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff0a2013-df07-4dc1-8b53-75effed63826 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1694 microversion: 2.1 time: 0.258390 Sep 06 11:36:02.240830 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3086/6223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:01 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1694 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:36:03.209214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dba164b4-a52f-4bd4-a435-8a5096c0baa2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:03.209214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dba164b4-a52f-4bd4-a435-8a5096c0baa2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:03.216134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dba164b4-a52f-4bd4-a435-8a5096c0baa2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:03.216632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dba164b4-a52f-4bd4-a435-8a5096c0baa2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:03.217084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dba164b4-a52f-4bd4-a435-8a5096c0baa2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:03.217804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dba164b4-a52f-4bd4-a435-8a5096c0baa2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:03.218272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dba164b4-a52f-4bd4-a435-8a5096c0baa2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:03.218718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dba164b4-a52f-4bd4-a435-8a5096c0baa2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:03.263187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-62a94df0-a2f8-4ad7-9f16-5aa1fbe1b6cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:03.263855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-62a94df0-a2f8-4ad7-9f16-5aa1fbe1b6cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:03.271075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62a94df0-a2f8-4ad7-9f16-5aa1fbe1b6cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:03.271870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62a94df0-a2f8-4ad7-9f16-5aa1fbe1b6cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:03.272319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62a94df0-a2f8-4ad7-9f16-5aa1fbe1b6cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:03.273038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62a94df0-a2f8-4ad7-9f16-5aa1fbe1b6cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:03.273505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62a94df0-a2f8-4ad7-9f16-5aa1fbe1b6cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:03.273950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62a94df0-a2f8-4ad7-9f16-5aa1fbe1b6cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:03.419615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dba164b4-a52f-4bd4-a435-8a5096c0baa2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:03.436795 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dba164b4-a52f-4bd4-a435-8a5096c0baa2 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 200 len: 1318 microversion: 2.1 time: 0.229961 Sep 06 11:36:03.436795 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3138/6224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:03 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:03.472694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-62a94df0-a2f8-4ad7-9f16-5aa1fbe1b6cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:03.481665 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-62a94df0-a2f8-4ad7-9f16-5aa1fbe1b6cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1694 microversion: 2.1 time: 0.222231 Sep 06 11:36:03.482263 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3087/6225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:03 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1694 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:36:03.808873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9aa1f508-4f7b-4add-90db-fcb5c891e800 req-4682374c-465f-47e5-a721-cdbd63af83a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6722a0c0-e113-442f-b4c2-8ec30e58b2a4", "name": "network-vif-plugged", "status": "completed", "tag": "b8a9bd8d-c51b-4f7c-a347-98c8f5d77e1d"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:03.819682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9aa1f508-4f7b-4add-90db-fcb5c891e800 req-4682374c-465f-47e5-a721-cdbd63af83a4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:03.820180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9aa1f508-4f7b-4add-90db-fcb5c891e800 req-4682374c-465f-47e5-a721-cdbd63af83a4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:03.820656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9aa1f508-4f7b-4add-90db-fcb5c891e800 req-4682374c-465f-47e5-a721-cdbd63af83a4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:03.825168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:03.833630 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9aa1f508-4f7b-4add-90db-fcb5c891e800 req-4682374c-465f-47e5-a721-cdbd63af83a4 service nova] Creating event network-vif-plugged:b8a9bd8d-c51b-4f7c-a347-98c8f5d77e1d for instance 6722a0c0-e113-442f-b4c2-8ec30e58b2a4 on nch1-master-1 Sep 06 11:36:03.839815 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9aa1f508-4f7b-4add-90db-fcb5c891e800 req-4682374c-465f-47e5-a721-cdbd63af83a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034256 Sep 06 11:36:03.840309 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3139/6226] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:36:04.458039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-990427c3-232f-4f65-b0c9-41b51aa725ea tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:04.458626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-990427c3-232f-4f65-b0c9-41b51aa725ea tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:04.465547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-990427c3-232f-4f65-b0c9-41b51aa725ea tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:04.465987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-990427c3-232f-4f65-b0c9-41b51aa725ea tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:04.466432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-990427c3-232f-4f65-b0c9-41b51aa725ea tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:04.467290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-990427c3-232f-4f65-b0c9-41b51aa725ea tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:04.467762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-990427c3-232f-4f65-b0c9-41b51aa725ea tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:04.468191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-990427c3-232f-4f65-b0c9-41b51aa725ea tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:04.509567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-52246be2-6f2d-4478-9ca6-d2bef4d1864d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:04.510289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-52246be2-6f2d-4478-9ca6-d2bef4d1864d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:04.517269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52246be2-6f2d-4478-9ca6-d2bef4d1864d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:04.517717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52246be2-6f2d-4478-9ca6-d2bef4d1864d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:04.518160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52246be2-6f2d-4478-9ca6-d2bef4d1864d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:04.519987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52246be2-6f2d-4478-9ca6-d2bef4d1864d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:04.520835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52246be2-6f2d-4478-9ca6-d2bef4d1864d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:04.521638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-52246be2-6f2d-4478-9ca6-d2bef4d1864d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:04.541302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:04.561214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:04.743046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-990427c3-232f-4f65-b0c9-41b51aa725ea tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:04.751741 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-990427c3-232f-4f65-b0c9-41b51aa725ea tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 200 len: 1318 microversion: 2.1 time: 0.298131 Sep 06 11:36:04.752608 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3088/6227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:04 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:04.800409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-52246be2-6f2d-4478-9ca6-d2bef4d1864d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:04.809599 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-52246be2-6f2d-4478-9ca6-d2bef4d1864d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1694 microversion: 2.1 time: 0.307479 Sep 06 11:36:04.810837 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3140/6228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:04 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1694 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:36:05.300899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f005b616-16cf-4676-a16b-52298aae6d93 req-477d74af-8ae3-4ccf-98b6-b225ca9a8d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041a08f6-a7e3-4d0c-aedd-6a7e48b9340a", "name": "network-vif-unplugged", "status": "completed", "tag": "87f49413-0b0b-4cd0-8270-8a568fa3c107"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:05.310334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:05.316719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f005b616-16cf-4676-a16b-52298aae6d93 req-477d74af-8ae3-4ccf-98b6-b225ca9a8d6a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:05.317209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f005b616-16cf-4676-a16b-52298aae6d93 req-477d74af-8ae3-4ccf-98b6-b225ca9a8d6a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:05.317653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f005b616-16cf-4676-a16b-52298aae6d93 req-477d74af-8ae3-4ccf-98b6-b225ca9a8d6a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:05.329758 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f005b616-16cf-4676-a16b-52298aae6d93 req-477d74af-8ae3-4ccf-98b6-b225ca9a8d6a service nova] Creating event network-vif-unplugged:87f49413-0b0b-4cd0-8270-8a568fa3c107 for instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a on nch1-master-1 Sep 06 11:36:05.335454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-f005b616-16cf-4676-a16b-52298aae6d93 req-477d74af-8ae3-4ccf-98b6-b225ca9a8d6a service nova] Instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:36:05.349090 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f005b616-16cf-4676-a16b-52298aae6d93 req-477d74af-8ae3-4ccf-98b6-b225ca9a8d6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050583 Sep 06 11:36:05.349090 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3089/6229] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:36:05.778724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-faf61e2a-a93f-4eab-b0dd-58d2457b4927 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:05.779489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-faf61e2a-a93f-4eab-b0dd-58d2457b4927 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:05.787267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-faf61e2a-a93f-4eab-b0dd-58d2457b4927 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:05.787793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-faf61e2a-a93f-4eab-b0dd-58d2457b4927 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:05.788533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-faf61e2a-a93f-4eab-b0dd-58d2457b4927 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:05.789301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-faf61e2a-a93f-4eab-b0dd-58d2457b4927 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:05.789737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-faf61e2a-a93f-4eab-b0dd-58d2457b4927 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:05.790169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-faf61e2a-a93f-4eab-b0dd-58d2457b4927 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:05.836977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fd439652-32db-4c3f-a701-334e1866b786 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:05.838366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fd439652-32db-4c3f-a701-334e1866b786 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:05.845735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd439652-32db-4c3f-a701-334e1866b786 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:05.846294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd439652-32db-4c3f-a701-334e1866b786 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:05.847542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd439652-32db-4c3f-a701-334e1866b786 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:05.848455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd439652-32db-4c3f-a701-334e1866b786 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:05.849101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd439652-32db-4c3f-a701-334e1866b786 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:05.849703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fd439652-32db-4c3f-a701-334e1866b786 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:06.466797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fd439652-32db-4c3f-a701-334e1866b786 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:06.471959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-faf61e2a-a93f-4eab-b0dd-58d2457b4927 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:06.489841 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fd439652-32db-4c3f-a701-334e1866b786 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1693 microversion: 2.1 time: 0.659719 Sep 06 11:36:06.490448 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3090/6230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:05 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1693 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:36:06.500658 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-faf61e2a-a93f-4eab-b0dd-58d2457b4927 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 200 len: 1506 microversion: 2.1 time: 0.721185 Sep 06 11:36:06.501930 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3141/6231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:05 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 1506 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:06.530948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ad363b52-9eaf-4920-baf8-9d44fb970678 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19567f19-1cb2-4e80-bf09-e8c419539694", "device": "/dev/sdb"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:06.535465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ad363b52-9eaf-4920-baf8-9d44fb970678 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:06.547042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad363b52-9eaf-4920-baf8-9d44fb970678 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:06.547042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad363b52-9eaf-4920-baf8-9d44fb970678 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:06.547042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad363b52-9eaf-4920-baf8-9d44fb970678 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:06.547042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad363b52-9eaf-4920-baf8-9d44fb970678 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:06.547042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad363b52-9eaf-4920-baf8-9d44fb970678 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:06.547042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ad363b52-9eaf-4920-baf8-9d44fb970678 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:07.363131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-1cac5ef0-f686-4e29-9217-0306148f4f12 req-083d6955-eaa5-4403-94d3-bc382eb65925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041a08f6-a7e3-4d0c-aedd-6a7e48b9340a", "tag": "87f49413-0b0b-4cd0-8270-8a568fa3c107"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:07.384280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1cac5ef0-f686-4e29-9217-0306148f4f12 req-083d6955-eaa5-4403-94d3-bc382eb65925 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:07.384768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1cac5ef0-f686-4e29-9217-0306148f4f12 req-083d6955-eaa5-4403-94d3-bc382eb65925 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:07.385460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1cac5ef0-f686-4e29-9217-0306148f4f12 req-083d6955-eaa5-4403-94d3-bc382eb65925 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:07.392380 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ad363b52-9eaf-4920-baf8-9d44fb970678 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "POST /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.866458 Sep 06 11:36:07.393239 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3091/6232] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:36:06 2022] POST /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4/os-volume_attachments => generated 194 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:36:07.402634 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-1cac5ef0-f686-4e29-9217-0306148f4f12 req-083d6955-eaa5-4403-94d3-bc382eb65925 service nova] Creating event network-changed:87f49413-0b0b-4cd0-8270-8a568fa3c107 for instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a on nch1-master-1 Sep 06 11:36:07.410196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-1cac5ef0-f686-4e29-9217-0306148f4f12 req-083d6955-eaa5-4403-94d3-bc382eb65925 service nova] Instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:36:07.423809 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-1cac5ef0-f686-4e29-9217-0306148f4f12 req-083d6955-eaa5-4403-94d3-bc382eb65925 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063967 Sep 06 11:36:07.427938 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3142/6233] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:36:07.524821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-533311b7-56af-468a-9706-442bfd6eee7e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:07.525578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-533311b7-56af-468a-9706-442bfd6eee7e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:07.532210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:07.535397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-533311b7-56af-468a-9706-442bfd6eee7e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:07.536088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-533311b7-56af-468a-9706-442bfd6eee7e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:07.536719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-533311b7-56af-468a-9706-442bfd6eee7e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:07.538159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-533311b7-56af-468a-9706-442bfd6eee7e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:07.538778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-533311b7-56af-468a-9706-442bfd6eee7e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:07.539630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-533311b7-56af-468a-9706-442bfd6eee7e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:07.734091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-533311b7-56af-468a-9706-442bfd6eee7e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:07.759384 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-533311b7-56af-468a-9706-442bfd6eee7e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1691 microversion: 2.1 time: 0.225233 Sep 06 11:36:07.759384 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3092/6234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:07 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1691 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:08.779564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dcdf2de1-f35f-4cf6-b5af-909cf12ec51a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:08.780361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dcdf2de1-f35f-4cf6-b5af-909cf12ec51a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:08.804076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:08.806148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcdf2de1-f35f-4cf6-b5af-909cf12ec51a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:08.806657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcdf2de1-f35f-4cf6-b5af-909cf12ec51a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:08.807134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcdf2de1-f35f-4cf6-b5af-909cf12ec51a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:08.808058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcdf2de1-f35f-4cf6-b5af-909cf12ec51a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:08.810078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcdf2de1-f35f-4cf6-b5af-909cf12ec51a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:08.810419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dcdf2de1-f35f-4cf6-b5af-909cf12ec51a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:09.060807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dcdf2de1-f35f-4cf6-b5af-909cf12ec51a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:09.072374 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dcdf2de1-f35f-4cf6-b5af-909cf12ec51a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1691 microversion: 2.1 time: 0.298240 Sep 06 11:36:09.089763 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3143/6235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:08 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1691 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:10.101380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-11f80595-8dca-4b53-a32e-bf3a114009eb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:10.101964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-11f80595-8dca-4b53-a32e-bf3a114009eb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:10.110134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11f80595-8dca-4b53-a32e-bf3a114009eb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:10.110642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11f80595-8dca-4b53-a32e-bf3a114009eb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:10.111141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11f80595-8dca-4b53-a32e-bf3a114009eb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:10.118203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11f80595-8dca-4b53-a32e-bf3a114009eb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:10.118203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11f80595-8dca-4b53-a32e-bf3a114009eb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:10.118203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11f80595-8dca-4b53-a32e-bf3a114009eb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:10.275476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-11f80595-8dca-4b53-a32e-bf3a114009eb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:10.284599 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-11f80595-8dca-4b53-a32e-bf3a114009eb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1688 microversion: 2.1 time: 0.189098 Sep 06 11:36:10.285276 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3093/6236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:10 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:10.309188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cd1a9e73-e938-4a98-80c5-93aafb30cbdb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:10.310066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cd1a9e73-e938-4a98-80c5-93aafb30cbdb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:10.319746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd1a9e73-e938-4a98-80c5-93aafb30cbdb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:10.322198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd1a9e73-e938-4a98-80c5-93aafb30cbdb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:10.322198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd1a9e73-e938-4a98-80c5-93aafb30cbdb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:10.322198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd1a9e73-e938-4a98-80c5-93aafb30cbdb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:10.322198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd1a9e73-e938-4a98-80c5-93aafb30cbdb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:10.322572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cd1a9e73-e938-4a98-80c5-93aafb30cbdb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:10.539932 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cd1a9e73-e938-4a98-80c5-93aafb30cbdb tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a/action" status: 204 len: 0 microversion: 2.1 time: 0.235220 Sep 06 11:36:10.541017 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3144/6237] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:36:10 2022] POST /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a/action => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:36:10.556403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cf4b3f74-9751-4d57-b43d-ecbf1fee0b04 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:10.557260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cf4b3f74-9751-4d57-b43d-ecbf1fee0b04 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:10.564058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf4b3f74-9751-4d57-b43d-ecbf1fee0b04 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:10.564771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf4b3f74-9751-4d57-b43d-ecbf1fee0b04 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:10.565209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf4b3f74-9751-4d57-b43d-ecbf1fee0b04 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:10.566709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf4b3f74-9751-4d57-b43d-ecbf1fee0b04 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:10.567529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf4b3f74-9751-4d57-b43d-ecbf1fee0b04 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:10.567968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf4b3f74-9751-4d57-b43d-ecbf1fee0b04 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:10.722741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cf4b3f74-9751-4d57-b43d-ecbf1fee0b04 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:10.732808 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cf4b3f74-9751-4d57-b43d-ecbf1fee0b04 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1688 microversion: 2.1 time: 0.184103 Sep 06 11:36:10.733406 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3094/6238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:10 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:11.775433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-953903d1-6225-477d-a27d-585fbd4a0c8b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:11.776167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-953903d1-6225-477d-a27d-585fbd4a0c8b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:11.793244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-953903d1-6225-477d-a27d-585fbd4a0c8b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:11.793763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-953903d1-6225-477d-a27d-585fbd4a0c8b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:11.794209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-953903d1-6225-477d-a27d-585fbd4a0c8b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:11.794951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-953903d1-6225-477d-a27d-585fbd4a0c8b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:11.795459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-953903d1-6225-477d-a27d-585fbd4a0c8b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:11.795902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-953903d1-6225-477d-a27d-585fbd4a0c8b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:12.054692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-953903d1-6225-477d-a27d-585fbd4a0c8b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:12.069374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-17489f2d-d201-4bc3-8ef5-75ce2bf01f7b req-19004ccc-faae-4b62-a7c4-c0ff3372a2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041a08f6-a7e3-4d0c-aedd-6a7e48b9340a", "name": "network-vif-plugged", "status": "completed", "tag": "87f49413-0b0b-4cd0-8270-8a568fa3c107"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:12.077196 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-953903d1-6225-477d-a27d-585fbd4a0c8b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1688 microversion: 2.1 time: 0.311996 Sep 06 11:36:12.077825 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3145/6239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:11 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1688 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:12.084658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-17489f2d-d201-4bc3-8ef5-75ce2bf01f7b req-19004ccc-faae-4b62-a7c4-c0ff3372a2d5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:12.085391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-17489f2d-d201-4bc3-8ef5-75ce2bf01f7b req-19004ccc-faae-4b62-a7c4-c0ff3372a2d5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:12.085985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-17489f2d-d201-4bc3-8ef5-75ce2bf01f7b req-19004ccc-faae-4b62-a7c4-c0ff3372a2d5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:12.100111 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-17489f2d-d201-4bc3-8ef5-75ce2bf01f7b req-19004ccc-faae-4b62-a7c4-c0ff3372a2d5 service nova] Creating event network-vif-plugged:87f49413-0b0b-4cd0-8270-8a568fa3c107 for instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a on nch1-master-1 Sep 06 11:36:12.107435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-17489f2d-d201-4bc3-8ef5-75ce2bf01f7b req-19004ccc-faae-4b62-a7c4-c0ff3372a2d5 service nova] Instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:36:12.121309 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-17489f2d-d201-4bc3-8ef5-75ce2bf01f7b req-19004ccc-faae-4b62-a7c4-c0ff3372a2d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057564 Sep 06 11:36:12.122432 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3095/6240] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:36:12.769263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3fa76d59-660e-4bdc-b33d-f95504fd80dd tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Action: 'create', calling method: .version_select at 0x7f90f877fd30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2082753353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGu5ercBBuME3wpuKo+CtknCVoLv+Dp1x1n2v2LvhwORy3abT73Rs9SjQI0SnGkdJMicouE+PSiFZMyJQJCog5sXIYS9ARg/ph8r6U2V8O0JL7SXP8CmPjDUGEUfW4iZ0A=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:12.787632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-3fa76d59-660e-4bdc-b33d-f95504fd80dd tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Getting quotas for project d3a7bd2f2a3d4318bc4445e9c4be13fb. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:36:12.794198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-3fa76d59-660e-4bdc-b33d-f95504fd80dd tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Getting quotas for user cde9fe6d32c54f008d430dc9d3ef6e47 and project d3a7bd2f2a3d4318bc4445e9c4be13fb. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:36:12.922337 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3fa76d59-660e-4bdc-b33d-f95504fd80dd tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.157408 Sep 06 11:36:12.929948 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3146/6241] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:36:12 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:36:13.106422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-31d4e150-7e3d-44dc-99ae-2e1f80bd0068 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:13.107601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-31d4e150-7e3d-44dc-99ae-2e1f80bd0068 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:13.115631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31d4e150-7e3d-44dc-99ae-2e1f80bd0068 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:13.116143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31d4e150-7e3d-44dc-99ae-2e1f80bd0068 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:13.116588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31d4e150-7e3d-44dc-99ae-2e1f80bd0068 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:13.117477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31d4e150-7e3d-44dc-99ae-2e1f80bd0068 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:13.118595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31d4e150-7e3d-44dc-99ae-2e1f80bd0068 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:13.119199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-31d4e150-7e3d-44dc-99ae-2e1f80bd0068 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:13.289199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-31d4e150-7e3d-44dc-99ae-2e1f80bd0068 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:13.304750 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-31d4e150-7e3d-44dc-99ae-2e1f80bd0068 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1688 microversion: 2.1 time: 0.203884 Sep 06 11:36:13.305791 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3096/6242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:13 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1688 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:14.329067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ce1f6e4f-74a1-470d-8543-f91f2f974016 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:14.329695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ce1f6e4f-74a1-470d-8543-f91f2f974016 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:14.338326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce1f6e4f-74a1-470d-8543-f91f2f974016 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:14.343553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce1f6e4f-74a1-470d-8543-f91f2f974016 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:14.343553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce1f6e4f-74a1-470d-8543-f91f2f974016 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:14.343553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce1f6e4f-74a1-470d-8543-f91f2f974016 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:14.343553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce1f6e4f-74a1-470d-8543-f91f2f974016 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:14.343553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce1f6e4f-74a1-470d-8543-f91f2f974016 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:14.496886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce1f6e4f-74a1-470d-8543-f91f2f974016 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:14.508131 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ce1f6e4f-74a1-470d-8543-f91f2f974016 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1680 microversion: 2.1 time: 0.183638 Sep 06 11:36:14.508664 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3147/6243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:14 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:16.068075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-447139425", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "f9e1ccd7-8967-4988-8246-0b5a90677379"}], "key_name": "tempest-TestNetworkBasicOps-2082753353", "security_groups": [{"name": "tempest-secgroup-smoke-1221175779"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:16.185854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] validate_networks() for [('f9e1ccd7-8967-4988-8246-0b5a90677379', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:36:16.591488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:36:16.591953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:36:16.610816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:36:16.610816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:36:16.610816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:36:16.610816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:16.610816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:16.610816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:16.610816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:16.610816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:16.610816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:16.624458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Getting quotas for project d3a7bd2f2a3d4318bc4445e9c4be13fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:36:16.630822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Getting quotas for user cde9fe6d32c54f008d430dc9d3ef6e47 and project d3a7bd2f2a3d4318bc4445e9c4be13fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:36:16.644311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:36:16.646772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:36:16.756932 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dca996e5-aabb-419c-8241-e211873f0a45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.693427 Sep 06 11:36:16.760677 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3097/6244] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:36:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:36:16.768882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e535fbfa-0795-4c11-95c8-175e1ec11074 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:16.769729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e535fbfa-0795-4c11-95c8-175e1ec11074 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:16.826268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e535fbfa-0795-4c11-95c8-175e1ec11074 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:16.834331 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e535fbfa-0795-4c11-95c8-175e1ec11074 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1248 microversion: 2.1 time: 0.069325 Sep 06 11:36:16.834923 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3148/6245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:16 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1248 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:17.863960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-677c20ba-7ec2-4649-9674-f011ee11876e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:17.865132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-677c20ba-7ec2-4649-9674-f011ee11876e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:17.922270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-677c20ba-7ec2-4649-9674-f011ee11876e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:17.930325 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-677c20ba-7ec2-4649-9674-f011ee11876e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1248 microversion: 2.1 time: 0.076204 Sep 06 11:36:17.930886 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3098/6246] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:17 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1248 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:36:18.953672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-542c9b2b-6423-4c4c-ba77-b862a6f54e4d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:18.954344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-542c9b2b-6423-4c4c-ba77-b862a6f54e4d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:18.962855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-542c9b2b-6423-4c4c-ba77-b862a6f54e4d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:18.963393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-542c9b2b-6423-4c4c-ba77-b862a6f54e4d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:18.963851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-542c9b2b-6423-4c4c-ba77-b862a6f54e4d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:18.964595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-542c9b2b-6423-4c4c-ba77-b862a6f54e4d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:18.965072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-542c9b2b-6423-4c4c-ba77-b862a6f54e4d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:18.965516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-542c9b2b-6423-4c4c-ba77-b862a6f54e4d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:19.027660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-542c9b2b-6423-4c4c-ba77-b862a6f54e4d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:19.039181 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-542c9b2b-6423-4c4c-ba77-b862a6f54e4d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1244 microversion: 2.1 time: 0.089234 Sep 06 11:36:19.040256 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3149/6247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:18 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:20.063394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-62dd8915-09dd-4a61-8219-075200d09256 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:20.067936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-62dd8915-09dd-4a61-8219-075200d09256 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:20.072262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62dd8915-09dd-4a61-8219-075200d09256 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:20.072765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62dd8915-09dd-4a61-8219-075200d09256 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:20.073269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62dd8915-09dd-4a61-8219-075200d09256 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:20.073999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62dd8915-09dd-4a61-8219-075200d09256 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:20.074471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62dd8915-09dd-4a61-8219-075200d09256 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:20.074913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-62dd8915-09dd-4a61-8219-075200d09256 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:20.152822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-62dd8915-09dd-4a61-8219-075200d09256 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:20.161444 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-62dd8915-09dd-4a61-8219-075200d09256 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1306 microversion: 2.1 time: 0.102165 Sep 06 11:36:20.162032 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3099/6248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:20 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:21.185425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-20bbc002-ed9f-4b93-8b46-a8d4ee8bd1a3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:21.187173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-20bbc002-ed9f-4b93-8b46-a8d4ee8bd1a3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:21.192757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20bbc002-ed9f-4b93-8b46-a8d4ee8bd1a3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:21.193314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20bbc002-ed9f-4b93-8b46-a8d4ee8bd1a3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:21.193754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20bbc002-ed9f-4b93-8b46-a8d4ee8bd1a3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:21.194472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20bbc002-ed9f-4b93-8b46-a8d4ee8bd1a3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:21.195104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20bbc002-ed9f-4b93-8b46-a8d4ee8bd1a3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:21.195548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20bbc002-ed9f-4b93-8b46-a8d4ee8bd1a3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:21.342269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-20bbc002-ed9f-4b93-8b46-a8d4ee8bd1a3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:21.350885 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-20bbc002-ed9f-4b93-8b46-a8d4ee8bd1a3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1374 microversion: 2.1 time: 0.169734 Sep 06 11:36:21.351519 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3150/6249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:21 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:21.550947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e855618b-bdda-4bc9-8b89-10ac149b879c req-565d12e7-c59c-4057-9bc1-8a30cc6c92f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de03813-d081-447a-93d1-f867b29aa202", "tag": "585b317e-be84-47a5-8bce-042ab6614644"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:21.562637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e855618b-bdda-4bc9-8b89-10ac149b879c req-565d12e7-c59c-4057-9bc1-8a30cc6c92f9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:21.563179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e855618b-bdda-4bc9-8b89-10ac149b879c req-565d12e7-c59c-4057-9bc1-8a30cc6c92f9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:21.563713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e855618b-bdda-4bc9-8b89-10ac149b879c req-565d12e7-c59c-4057-9bc1-8a30cc6c92f9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:21.575887 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e855618b-bdda-4bc9-8b89-10ac149b879c req-565d12e7-c59c-4057-9bc1-8a30cc6c92f9 service nova] Creating event network-changed:585b317e-be84-47a5-8bce-042ab6614644 for instance 0de03813-d081-447a-93d1-f867b29aa202 on nch2-master-1 Sep 06 11:36:21.581026 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e855618b-bdda-4bc9-8b89-10ac149b879c req-565d12e7-c59c-4057-9bc1-8a30cc6c92f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038894 Sep 06 11:36:21.581792 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3100/6250] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:36:22.379823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bf1e5db7-039f-4ebb-bc24-b6630bcbed26 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:22.380528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bf1e5db7-039f-4ebb-bc24-b6630bcbed26 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:22.388063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf1e5db7-039f-4ebb-bc24-b6630bcbed26 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:22.388640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf1e5db7-039f-4ebb-bc24-b6630bcbed26 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:22.389063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf1e5db7-039f-4ebb-bc24-b6630bcbed26 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:22.389827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf1e5db7-039f-4ebb-bc24-b6630bcbed26 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:22.390446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf1e5db7-039f-4ebb-bc24-b6630bcbed26 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:22.390880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf1e5db7-039f-4ebb-bc24-b6630bcbed26 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:22.538966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bf1e5db7-039f-4ebb-bc24-b6630bcbed26 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:22.547145 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bf1e5db7-039f-4ebb-bc24-b6630bcbed26 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1374 microversion: 2.1 time: 0.171915 Sep 06 11:36:22.547778 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3151/6251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:22 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:23.572113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cb62a1fb-05d0-4fa7-b71d-caff4af1e619 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:23.572763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cb62a1fb-05d0-4fa7-b71d-caff4af1e619 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:23.579217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb62a1fb-05d0-4fa7-b71d-caff4af1e619 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:23.579740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb62a1fb-05d0-4fa7-b71d-caff4af1e619 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:23.580189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb62a1fb-05d0-4fa7-b71d-caff4af1e619 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:23.580893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb62a1fb-05d0-4fa7-b71d-caff4af1e619 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:23.581361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb62a1fb-05d0-4fa7-b71d-caff4af1e619 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:23.581799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb62a1fb-05d0-4fa7-b71d-caff4af1e619 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:23.717398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cb62a1fb-05d0-4fa7-b71d-caff4af1e619 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:23.725934 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cb62a1fb-05d0-4fa7-b71d-caff4af1e619 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1374 microversion: 2.1 time: 0.159690 Sep 06 11:36:23.727557 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3101/6252] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:23 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:24.750079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f41b7536-8f3e-4e03-9fc2-d920f49c2e56 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:24.750693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f41b7536-8f3e-4e03-9fc2-d920f49c2e56 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:24.759899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f41b7536-8f3e-4e03-9fc2-d920f49c2e56 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:24.760397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f41b7536-8f3e-4e03-9fc2-d920f49c2e56 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:24.760839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f41b7536-8f3e-4e03-9fc2-d920f49c2e56 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:24.761546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f41b7536-8f3e-4e03-9fc2-d920f49c2e56 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:24.762004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f41b7536-8f3e-4e03-9fc2-d920f49c2e56 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:24.762433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f41b7536-8f3e-4e03-9fc2-d920f49c2e56 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:24.910309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f41b7536-8f3e-4e03-9fc2-d920f49c2e56 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:24.919826 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f41b7536-8f3e-4e03-9fc2-d920f49c2e56 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1374 microversion: 2.1 time: 0.173730 Sep 06 11:36:24.924141 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3152/6253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:24 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:25.943696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4aa25ca1-0eb0-4aa4-8fd0-7fd7d5240918 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:25.944314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4aa25ca1-0eb0-4aa4-8fd0-7fd7d5240918 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:25.951323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aa25ca1-0eb0-4aa4-8fd0-7fd7d5240918 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:25.951815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aa25ca1-0eb0-4aa4-8fd0-7fd7d5240918 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:25.952261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aa25ca1-0eb0-4aa4-8fd0-7fd7d5240918 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:25.952965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aa25ca1-0eb0-4aa4-8fd0-7fd7d5240918 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:25.953429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aa25ca1-0eb0-4aa4-8fd0-7fd7d5240918 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:25.953866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4aa25ca1-0eb0-4aa4-8fd0-7fd7d5240918 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:26.093233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4aa25ca1-0eb0-4aa4-8fd0-7fd7d5240918 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:26.107077 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4aa25ca1-0eb0-4aa4-8fd0-7fd7d5240918 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1374 microversion: 2.1 time: 0.164521 Sep 06 11:36:26.107077 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3102/6254] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:25 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:26.540344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-8d709d13-d3f5-4ef9-baea-b0a2369cb4c7 req-02f120f6-d9f3-4c3e-b3d7-2fc5d13c22da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de03813-d081-447a-93d1-f867b29aa202", "name": "network-vif-plugged", "status": "completed", "tag": "585b317e-be84-47a5-8bce-042ab6614644"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:26.551421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8d709d13-d3f5-4ef9-baea-b0a2369cb4c7 req-02f120f6-d9f3-4c3e-b3d7-2fc5d13c22da service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:26.551918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8d709d13-d3f5-4ef9-baea-b0a2369cb4c7 req-02f120f6-d9f3-4c3e-b3d7-2fc5d13c22da service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:26.552360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8d709d13-d3f5-4ef9-baea-b0a2369cb4c7 req-02f120f6-d9f3-4c3e-b3d7-2fc5d13c22da service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:26.567390 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-8d709d13-d3f5-4ef9-baea-b0a2369cb4c7 req-02f120f6-d9f3-4c3e-b3d7-2fc5d13c22da service nova] Creating event network-vif-plugged:585b317e-be84-47a5-8bce-042ab6614644 for instance 0de03813-d081-447a-93d1-f867b29aa202 on nch2-master-1 Sep 06 11:36:26.572721 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-8d709d13-d3f5-4ef9-baea-b0a2369cb4c7 req-02f120f6-d9f3-4c3e-b3d7-2fc5d13c22da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036713 Sep 06 11:36:26.573348 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3153/6255] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:36:27.126813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0882d887-3666-4ee2-a150-3ad0b6cf236d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:27.127453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0882d887-3666-4ee2-a150-3ad0b6cf236d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:27.129546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:27.135358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0882d887-3666-4ee2-a150-3ad0b6cf236d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:27.142221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0882d887-3666-4ee2-a150-3ad0b6cf236d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:27.142221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0882d887-3666-4ee2-a150-3ad0b6cf236d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:27.142221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0882d887-3666-4ee2-a150-3ad0b6cf236d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:27.142221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0882d887-3666-4ee2-a150-3ad0b6cf236d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:27.142221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0882d887-3666-4ee2-a150-3ad0b6cf236d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:27.281992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0882d887-3666-4ee2-a150-3ad0b6cf236d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:27.289949 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0882d887-3666-4ee2-a150-3ad0b6cf236d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1374 microversion: 2.1 time: 0.167097 Sep 06 11:36:27.290535 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3103/6256] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:27 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:28.310927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:28.315958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-17f645c0-145e-4ba9-8f15-20421a29c824 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:28.316682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-17f645c0-145e-4ba9-8f15-20421a29c824 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:28.323827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17f645c0-145e-4ba9-8f15-20421a29c824 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:28.324328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17f645c0-145e-4ba9-8f15-20421a29c824 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:28.331743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17f645c0-145e-4ba9-8f15-20421a29c824 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:28.331743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17f645c0-145e-4ba9-8f15-20421a29c824 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:28.331743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17f645c0-145e-4ba9-8f15-20421a29c824 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:28.331743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17f645c0-145e-4ba9-8f15-20421a29c824 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:28.464115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-17f645c0-145e-4ba9-8f15-20421a29c824 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:28.472405 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-17f645c0-145e-4ba9-8f15-20421a29c824 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1546 microversion: 2.1 time: 0.162597 Sep 06 11:36:28.472985 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3154/6257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:28 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1546 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:28.495710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dd819e1a-b532-49e4-bbfc-f7eff12c8f74 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:28.496336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dd819e1a-b532-49e4-bbfc-f7eff12c8f74 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:28.498202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:28.503992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd819e1a-b532-49e4-bbfc-f7eff12c8f74 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:28.504499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd819e1a-b532-49e4-bbfc-f7eff12c8f74 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:28.504945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd819e1a-b532-49e4-bbfc-f7eff12c8f74 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:28.505655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd819e1a-b532-49e4-bbfc-f7eff12c8f74 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:28.506721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd819e1a-b532-49e4-bbfc-f7eff12c8f74 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:28.507188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd819e1a-b532-49e4-bbfc-f7eff12c8f74 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:28.511404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:28.652172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dd819e1a-b532-49e4-bbfc-f7eff12c8f74 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:28.660449 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dd819e1a-b532-49e4-bbfc-f7eff12c8f74 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1546 microversion: 2.1 time: 0.168777 Sep 06 11:36:28.661057 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3104/6258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:28 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:30.854060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-982b8662-840c-4dc4-876c-b4a59dc5c4c1 req-7d6c2a6d-a1ae-4e72-a566-ba5c9ad4cf19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de03813-d081-447a-93d1-f867b29aa202", "tag": "585b317e-be84-47a5-8bce-042ab6614644"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:30.866618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-982b8662-840c-4dc4-876c-b4a59dc5c4c1 req-7d6c2a6d-a1ae-4e72-a566-ba5c9ad4cf19 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:30.867242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-982b8662-840c-4dc4-876c-b4a59dc5c4c1 req-7d6c2a6d-a1ae-4e72-a566-ba5c9ad4cf19 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:30.867780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-982b8662-840c-4dc4-876c-b4a59dc5c4c1 req-7d6c2a6d-a1ae-4e72-a566-ba5c9ad4cf19 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:30.881480 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-982b8662-840c-4dc4-876c-b4a59dc5c4c1 req-7d6c2a6d-a1ae-4e72-a566-ba5c9ad4cf19 service nova] Creating event network-changed:585b317e-be84-47a5-8bce-042ab6614644 for instance 0de03813-d081-447a-93d1-f867b29aa202 on nch2-master-1 Sep 06 11:36:30.887879 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-982b8662-840c-4dc4-876c-b4a59dc5c4c1 req-7d6c2a6d-a1ae-4e72-a566-ba5c9ad4cf19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038214 Sep 06 11:36:30.889394 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3155/6259] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:36:34.705244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c1068ac4-31ce-4892-ab44-000342cd6f2a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:34.705842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c1068ac4-31ce-4892-ab44-000342cd6f2a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:34.713675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1068ac4-31ce-4892-ab44-000342cd6f2a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:34.714176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1068ac4-31ce-4892-ab44-000342cd6f2a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:34.714623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1068ac4-31ce-4892-ab44-000342cd6f2a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:34.715370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1068ac4-31ce-4892-ab44-000342cd6f2a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:34.715836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1068ac4-31ce-4892-ab44-000342cd6f2a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:34.716303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c1068ac4-31ce-4892-ab44-000342cd6f2a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:34.775699 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c1068ac4-31ce-4892-ab44-000342cd6f2a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a/action" status: 200 len: 24575 microversion: 2.1 time: 0.075845 Sep 06 11:36:34.776630 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3105/6260] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:36:34 2022] POST /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a/action => generated 24575 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:36:41.014365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3457b634-bf47-4dac-958b-dcf70ed0e8d0 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:41.014884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3457b634-bf47-4dac-958b-dcf70ed0e8d0 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:41.018867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:41.019605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:41.026110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3457b634-bf47-4dac-958b-dcf70ed0e8d0 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:41.026605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3457b634-bf47-4dac-958b-dcf70ed0e8d0 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:41.027074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3457b634-bf47-4dac-958b-dcf70ed0e8d0 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:41.027804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3457b634-bf47-4dac-958b-dcf70ed0e8d0 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:41.028268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3457b634-bf47-4dac-958b-dcf70ed0e8d0 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:41.029029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3457b634-bf47-4dac-958b-dcf70ed0e8d0 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:41.169463 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3457b634-bf47-4dac-958b-dcf70ed0e8d0 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1831 microversion: 2.1 time: 0.159591 Sep 06 11:36:41.174010 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3156/6261] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:41 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1831 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:42.432196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-074dad40-564b-497d-92cb-8fa8374804ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:42.432795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-074dad40-564b-497d-92cb-8fa8374804ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:42.435872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-702bbb1b-192e-47cc-ac47-cc5c5a72de7c req-c472a5eb-1393-4d5d-8333-d00210a4bc25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041a08f6-a7e3-4d0c-aedd-6a7e48b9340a", "tag": "87f49413-0b0b-4cd0-8270-8a568fa3c107"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:42.437676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:42.442327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-074dad40-564b-497d-92cb-8fa8374804ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:42.443649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-074dad40-564b-497d-92cb-8fa8374804ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:42.444374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-074dad40-564b-497d-92cb-8fa8374804ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:42.445531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-074dad40-564b-497d-92cb-8fa8374804ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:42.446005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-074dad40-564b-497d-92cb-8fa8374804ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:42.446444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-074dad40-564b-497d-92cb-8fa8374804ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:42.449124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-702bbb1b-192e-47cc-ac47-cc5c5a72de7c req-c472a5eb-1393-4d5d-8333-d00210a4bc25 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:42.449724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-702bbb1b-192e-47cc-ac47-cc5c5a72de7c req-c472a5eb-1393-4d5d-8333-d00210a4bc25 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:42.450382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-702bbb1b-192e-47cc-ac47-cc5c5a72de7c req-c472a5eb-1393-4d5d-8333-d00210a4bc25 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:42.463893 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-702bbb1b-192e-47cc-ac47-cc5c5a72de7c req-c472a5eb-1393-4d5d-8333-d00210a4bc25 service nova] Creating event network-changed:87f49413-0b0b-4cd0-8270-8a568fa3c107 for instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a on nch1-master-1 Sep 06 11:36:42.470460 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-702bbb1b-192e-47cc-ac47-cc5c5a72de7c req-c472a5eb-1393-4d5d-8333-d00210a4bc25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040354 Sep 06 11:36:42.471486 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3157/6262] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:36:42.480468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-074dad40-564b-497d-92cb-8fa8374804ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:36:42.804791 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-074dad40-564b-497d-92cb-8fa8374804ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "DELETE /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 204 len: 0 microversion: 2.1 time: 0.376921 Sep 06 11:36:42.805590 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3106/6263] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:36:42 2022] DELETE /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:36:42.817338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fa3513d6-60b6-4002-afe2-9756ab189443 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:42.818070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fa3513d6-60b6-4002-afe2-9756ab189443 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:42.825595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa3513d6-60b6-4002-afe2-9756ab189443 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:42.826092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa3513d6-60b6-4002-afe2-9756ab189443 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:42.826530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa3513d6-60b6-4002-afe2-9756ab189443 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:42.828037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa3513d6-60b6-4002-afe2-9756ab189443 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:42.828170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa3513d6-60b6-4002-afe2-9756ab189443 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:42.828609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa3513d6-60b6-4002-afe2-9756ab189443 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:42.986116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fa3513d6-60b6-4002-afe2-9756ab189443 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:42.996200 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fa3513d6-60b6-4002-afe2-9756ab189443 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1686 microversion: 2.1 time: 0.185143 Sep 06 11:36:42.996806 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3158/6264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:42 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:44.021567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-13146133-c956-45a1-88b6-c1844c72ab29 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:44.022272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-13146133-c956-45a1-88b6-c1844c72ab29 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:44.030609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13146133-c956-45a1-88b6-c1844c72ab29 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:44.031119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13146133-c956-45a1-88b6-c1844c72ab29 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:44.031567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13146133-c956-45a1-88b6-c1844c72ab29 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:44.032264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13146133-c956-45a1-88b6-c1844c72ab29 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:44.032725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13146133-c956-45a1-88b6-c1844c72ab29 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:44.033155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13146133-c956-45a1-88b6-c1844c72ab29 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:44.179373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-13146133-c956-45a1-88b6-c1844c72ab29 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:44.188341 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-13146133-c956-45a1-88b6-c1844c72ab29 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1686 microversion: 2.1 time: 0.171206 Sep 06 11:36:44.188939 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3107/6265] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:44 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:36:44.713782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-34ed0104-cad6-480e-8c42-8638bf8a71d1 req-18dac4d7-355d-4077-872e-c7f631d8409d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041a08f6-a7e3-4d0c-aedd-6a7e48b9340a", "name": "network-vif-deleted", "tag": "87f49413-0b0b-4cd0-8270-8a568fa3c107"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:44.724482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-34ed0104-cad6-480e-8c42-8638bf8a71d1 req-18dac4d7-355d-4077-872e-c7f631d8409d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:44.724967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-34ed0104-cad6-480e-8c42-8638bf8a71d1 req-18dac4d7-355d-4077-872e-c7f631d8409d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:44.725407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-34ed0104-cad6-480e-8c42-8638bf8a71d1 req-18dac4d7-355d-4077-872e-c7f631d8409d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:44.736863 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-34ed0104-cad6-480e-8c42-8638bf8a71d1 req-18dac4d7-355d-4077-872e-c7f631d8409d service nova] Creating event network-vif-deleted:87f49413-0b0b-4cd0-8270-8a568fa3c107 for instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a on nch1-master-1 Sep 06 11:36:44.741878 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-34ed0104-cad6-480e-8c42-8638bf8a71d1 req-18dac4d7-355d-4077-872e-c7f631d8409d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032490 Sep 06 11:36:44.742493 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3159/6266] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:36:45.211356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:45.211974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:45.219442 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:45.220024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:45.220480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:45.221200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:45.221697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:45.222155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:45.256385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:45.256792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:45.257239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:45.258291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lazy-loading 'fault' on Instance uuid 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:36:45.299354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:36:45.307833 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f8ddc5d8-a040-44b8-8e47-f210ff91ce3d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 200 len: 1355 microversion: 2.1 time: 0.100647 Sep 06 11:36:45.308415 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3108/6267] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:45 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 1355 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:36:46.333743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-15bfdb41-12f6-401e-bc54-d4eb5c323fb7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:46.334463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-15bfdb41-12f6-401e-bc54-d4eb5c323fb7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:46.341215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15bfdb41-12f6-401e-bc54-d4eb5c323fb7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:46.341717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15bfdb41-12f6-401e-bc54-d4eb5c323fb7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:46.342172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15bfdb41-12f6-401e-bc54-d4eb5c323fb7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:46.342896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15bfdb41-12f6-401e-bc54-d4eb5c323fb7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:46.343402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15bfdb41-12f6-401e-bc54-d4eb5c323fb7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:46.343848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15bfdb41-12f6-401e-bc54-d4eb5c323fb7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:46.358872 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-15bfdb41-12f6-401e-bc54-d4eb5c323fb7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] HTTP exception thrown: Instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a could not be found. Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-15bfdb41-12f6-401e-bc54-d4eb5c323fb7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Request method failure captured: Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a HTTP/1.1 Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzBX9CuU5UzfyxndnVZJJmTYQ3vK0GMlL8LNZgpJ5tksaXSMavHz_rJbRFm6T87lgBe9pS926ALKmRt8aQ4iI83LdY1vm2a5H52JafVqkAEM9TtY6-ItP-NrdpPjrmU2smFwTA5uczMzMisnvP5xPvXyFn1yLnZV5ywo_B1CSGR_HGg Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: aa117f0cf74342a3b24c0c247565a6c7 Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-993249934 Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa117f0cf74342a3b24c0c247565a6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa117f0cf74342a3b24c0c247565a6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa117f0cf74342a3b24c0c247565a6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa117f0cf74342a3b24c0c247565a6c7"}]}] Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TestNetworkAdvancedServerOps-993249934 Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: aa117f0cf74342a3b24c0c247565a6c7 Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-993249934 Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TestNetworkAdvancedServerOps-993249934-project Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: fcaddf25fc12498b90d2cc1ec08e5da3 Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TestNetworkAdvancedServerOps-993249934-project Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a could not be found. Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '041a08f6-a7e3-4d0c-aedd-6a7e48b9340a'} Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a could not be found. Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a could not be found. Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:36:46.360612 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:36:46.369907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:36:46.369907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:36:46.369907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:36:46.369907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:36:46.369907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:36:46.369907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:36:46.369907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a could not be found. Sep 06 11:36:46.369907 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:36:46.369907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-15bfdb41-12f6-401e-bc54-d4eb5c323fb7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Returning 404 to user: Instance 041a08f6-a7e3-4d0c-aedd-6a7e48b9340a could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:36:46.369907 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-15bfdb41-12f6-401e-bc54-d4eb5c323fb7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a" status: 404 len: 111 microversion: 2.1 time: 0.033818 Sep 06 11:36:46.369907 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3160/6268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:36:46 2022] GET /compute/v2.1/servers/041a08f6-a7e3-4d0c-aedd-6a7e48b9340a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:36:50.835817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d18e8e83-192f-4447-950f-fb4eddbc582d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '.version_select at 0x7f90f32d7a60>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:36:50.947412 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d18e8e83-192f-4447-950f-fb4eddbc582d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-579086117" status: 202 len: 0 microversion: 2.1 time: 0.123412 Sep 06 11:36:50.948368 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3109/6269] 10.222.0.20 () {58 vars in 1281 bytes} [Tue Sep 6 11:36:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-579086117 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:36:50.983319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f923f9bb-c2f2-4f6b-aee5-31da15c6e1df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'create', calling method: .version_select at 0x7f90fcffbdc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-598579607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnVYei92A+S66i7F3kXf5c/Rmqxl1uWTh0uJp9JuKJkDuRvhw8UMrwhQJ+iBP6Aros3k5bfNr+Jl1TLogpi6kHUd0jLg2c+r0x/OrG6qudbL1X4EkNaSGXcQ51+uUDuRA=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:51.000525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f923f9bb-c2f2-4f6b-aee5-31da15c6e1df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:36:51.007072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-f923f9bb-c2f2-4f6b-aee5-31da15c6e1df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for user fcaddf25fc12498b90d2cc1ec08e5da3 and project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:36:51.092067 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f923f9bb-c2f2-4f6b-aee5-31da15c6e1df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.113014 Sep 06 11:36:51.092782 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3161/6270] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:36:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:36:53.275541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e50f7464-6c62-42cf-a154-e3f421e79982 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:36:53.277812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e50f7464-6c62-42cf-a154-e3f421e79982 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:36:53.287115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e50f7464-6c62-42cf-a154-e3f421e79982 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:53.287641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e50f7464-6c62-42cf-a154-e3f421e79982 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:53.288077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e50f7464-6c62-42cf-a154-e3f421e79982 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:53.289370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e50f7464-6c62-42cf-a154-e3f421e79982 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:36:53.289803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e50f7464-6c62-42cf-a154-e3f421e79982 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:36:53.290322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e50f7464-6c62-42cf-a154-e3f421e79982 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:36:53.362585 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e50f7464-6c62-42cf-a154-e3f421e79982 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "POST /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202/action" status: 200 len: 24564 microversion: 2.1 time: 0.090669 Sep 06 11:36:53.363924 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3110/6271] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:36:53 2022] POST /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202/action => generated 24564 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:37:00.533349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=18 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:00.537941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-119317150", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "8060416f-7125-49b0-88e2-0074b751eb96"}], "key_name": "tempest-TestNetworkAdvancedServerOps-598579607", "security_groups": [{"name": "tempest-secgroup-smoke-1107931109"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:00.668229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] validate_networks() for [('8060416f-7125-49b0-88e2-0074b751eb96', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:37:01.015684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:01.161563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:37:01.161997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:37:01.162482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:37:01.162908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:37:01.163367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:37:01.173267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:01.173768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:01.174249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:01.175051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:01.175504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:01.175945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:01.195817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:37:01.201990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for user fcaddf25fc12498b90d2cc1ec08e5da3 and project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:37:01.215860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:37:01.218214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:37:01.373251 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fb01f87c-1744-4e1c-b27f-12252f0bb683 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.841600 Sep 06 11:37:01.374029 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3162/6272] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:37:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:37:01.387566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c122ddc6-4be1-4f13-b103-1fc09b898ed0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:01.388540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c122ddc6-4be1-4f13-b103-1fc09b898ed0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:01.482460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c122ddc6-4be1-4f13-b103-1fc09b898ed0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:01.492070 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c122ddc6-4be1-4f13-b103-1fc09b898ed0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1265 microversion: 2.1 time: 0.107823 Sep 06 11:37:01.492975 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3111/6273] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:01 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:02.524411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5a5bc247-5b40-4ba9-9807-a552117e49f3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:02.524411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5a5bc247-5b40-4ba9-9807-a552117e49f3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:02.536436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a5bc247-5b40-4ba9-9807-a552117e49f3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:02.536854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a5bc247-5b40-4ba9-9807-a552117e49f3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:02.537294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a5bc247-5b40-4ba9-9807-a552117e49f3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:02.538801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a5bc247-5b40-4ba9-9807-a552117e49f3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:02.539503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a5bc247-5b40-4ba9-9807-a552117e49f3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:02.540156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5a5bc247-5b40-4ba9-9807-a552117e49f3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:02.619233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5a5bc247-5b40-4ba9-9807-a552117e49f3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:02.628229 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5a5bc247-5b40-4ba9-9807-a552117e49f3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1269 microversion: 2.1 time: 0.116637 Sep 06 11:37:02.637373 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3163/6274] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:02 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1269 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:03.652829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5234cd29-d011-48f7-8536-01d6e52e9b94 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:03.653558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5234cd29-d011-48f7-8536-01d6e52e9b94 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:03.657858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:03.664139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5234cd29-d011-48f7-8536-01d6e52e9b94 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:03.664385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5234cd29-d011-48f7-8536-01d6e52e9b94 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:03.665034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5234cd29-d011-48f7-8536-01d6e52e9b94 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:03.666033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5234cd29-d011-48f7-8536-01d6e52e9b94 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:03.666937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5234cd29-d011-48f7-8536-01d6e52e9b94 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:03.667610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5234cd29-d011-48f7-8536-01d6e52e9b94 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:03.783829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5234cd29-d011-48f7-8536-01d6e52e9b94 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:03.808912 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5234cd29-d011-48f7-8536-01d6e52e9b94 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1325 microversion: 2.1 time: 0.160431 Sep 06 11:37:03.810096 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3112/6275] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:03 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1325 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:04.833442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-18e1fb85-d772-48d8-8daf-582113b49b43 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:04.834065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-18e1fb85-d772-48d8-8daf-582113b49b43 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:04.841568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18e1fb85-d772-48d8-8daf-582113b49b43 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:04.842074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18e1fb85-d772-48d8-8daf-582113b49b43 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:04.843892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18e1fb85-d772-48d8-8daf-582113b49b43 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:04.844407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18e1fb85-d772-48d8-8daf-582113b49b43 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:04.844893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18e1fb85-d772-48d8-8daf-582113b49b43 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:04.845446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-18e1fb85-d772-48d8-8daf-582113b49b43 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:05.021060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-18e1fb85-d772-48d8-8daf-582113b49b43 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:05.031136 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-18e1fb85-d772-48d8-8daf-582113b49b43 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1391 microversion: 2.1 time: 0.201472 Sep 06 11:37:05.031794 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3164/6276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:04 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:05.783487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a98b54fd-7852-4fc9-ba53-02ff78897097 req-8f9d5dad-5f7e-4eda-a5b8-cc254b6ead71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa8d5548-d996-4b4a-b94d-28afae7c281b", "tag": "11538fbe-5d0f-454a-8a16-e4c1137f2aed"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:05.798201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a98b54fd-7852-4fc9-ba53-02ff78897097 req-8f9d5dad-5f7e-4eda-a5b8-cc254b6ead71 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:05.798617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a98b54fd-7852-4fc9-ba53-02ff78897097 req-8f9d5dad-5f7e-4eda-a5b8-cc254b6ead71 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:05.799099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a98b54fd-7852-4fc9-ba53-02ff78897097 req-8f9d5dad-5f7e-4eda-a5b8-cc254b6ead71 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:05.810574 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a98b54fd-7852-4fc9-ba53-02ff78897097 req-8f9d5dad-5f7e-4eda-a5b8-cc254b6ead71 service nova] Creating event network-changed:11538fbe-5d0f-454a-8a16-e4c1137f2aed for instance fa8d5548-d996-4b4a-b94d-28afae7c281b on nch1-master-1 Sep 06 11:37:05.815716 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a98b54fd-7852-4fc9-ba53-02ff78897097 req-8f9d5dad-5f7e-4eda-a5b8-cc254b6ead71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036582 Sep 06 11:37:05.820401 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3113/6277] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:37:06.060363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-301f0f5b-d005-47d2-87fc-30dcb7afa92b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:06.061102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-301f0f5b-d005-47d2-87fc-30dcb7afa92b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:06.068451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-301f0f5b-d005-47d2-87fc-30dcb7afa92b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:06.069066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-301f0f5b-d005-47d2-87fc-30dcb7afa92b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:06.069590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-301f0f5b-d005-47d2-87fc-30dcb7afa92b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:06.071041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-301f0f5b-d005-47d2-87fc-30dcb7afa92b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:06.071620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-301f0f5b-d005-47d2-87fc-30dcb7afa92b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:06.072137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-301f0f5b-d005-47d2-87fc-30dcb7afa92b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:06.215761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-301f0f5b-d005-47d2-87fc-30dcb7afa92b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:06.224292 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-301f0f5b-d005-47d2-87fc-30dcb7afa92b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1391 microversion: 2.1 time: 0.167940 Sep 06 11:37:06.224887 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3165/6278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:06 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:37:07.249008 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9842550a-1247-4706-9fbb-337f8149bf1a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:07.249626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9842550a-1247-4706-9fbb-337f8149bf1a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:07.256514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9842550a-1247-4706-9fbb-337f8149bf1a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:07.256998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9842550a-1247-4706-9fbb-337f8149bf1a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:07.257444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9842550a-1247-4706-9fbb-337f8149bf1a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:07.258704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9842550a-1247-4706-9fbb-337f8149bf1a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:07.259193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9842550a-1247-4706-9fbb-337f8149bf1a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:07.259628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9842550a-1247-4706-9fbb-337f8149bf1a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:07.392770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9842550a-1247-4706-9fbb-337f8149bf1a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:07.401409 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9842550a-1247-4706-9fbb-337f8149bf1a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1391 microversion: 2.1 time: 0.157928 Sep 06 11:37:07.402046 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3114/6279] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:07 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:08.425138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-67019ae4-3c89-4dd1-b081-2f335cc0f98d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:08.425800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-67019ae4-3c89-4dd1-b081-2f335cc0f98d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:08.434020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67019ae4-3c89-4dd1-b081-2f335cc0f98d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:08.434517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67019ae4-3c89-4dd1-b081-2f335cc0f98d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:08.437339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67019ae4-3c89-4dd1-b081-2f335cc0f98d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:08.437339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67019ae4-3c89-4dd1-b081-2f335cc0f98d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:08.437339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67019ae4-3c89-4dd1-b081-2f335cc0f98d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:08.437339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-67019ae4-3c89-4dd1-b081-2f335cc0f98d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:08.670921 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-67019ae4-3c89-4dd1-b081-2f335cc0f98d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:08.679056 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-67019ae4-3c89-4dd1-b081-2f335cc0f98d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1391 microversion: 2.1 time: 0.257962 Sep 06 11:37:08.680287 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3166/6280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:08 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1391 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:37:09.212656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-999f239b-8cb7-4a3b-af36-1269ad60983b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Action: 'create', calling method: .version_select at 0x7f90f32d7a60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1208535861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5cJxpH3PLY+HDrYA9qTUPjv6DQ2JBO5MliKs6Y6Ew8WiysYL3yqIOG49f3ee7xTA8Ryhu9d+JBFco4hu7nl0hTVdHYmjcdEZaRpJJdXPTElPsM9wIPdsXjZ95Y+RvzUw=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:09.229714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-999f239b-8cb7-4a3b-af36-1269ad60983b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Getting quotas for project d3a7bd2f2a3d4318bc4445e9c4be13fb. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:37:09.235763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-999f239b-8cb7-4a3b-af36-1269ad60983b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Getting quotas for user cde9fe6d32c54f008d430dc9d3ef6e47 and project d3a7bd2f2a3d4318bc4445e9c4be13fb. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:37:09.333169 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-999f239b-8cb7-4a3b-af36-1269ad60983b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.124529 Sep 06 11:37:09.333845 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3115/6281] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:37:09 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:37:09.702350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-09a9e919-4939-4010-b8cc-8548739469f9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:09.702986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-09a9e919-4939-4010-b8cc-8548739469f9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:09.710289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09a9e919-4939-4010-b8cc-8548739469f9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:09.710809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09a9e919-4939-4010-b8cc-8548739469f9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:09.711285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09a9e919-4939-4010-b8cc-8548739469f9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:09.711996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09a9e919-4939-4010-b8cc-8548739469f9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:09.712624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09a9e919-4939-4010-b8cc-8548739469f9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:09.712889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09a9e919-4939-4010-b8cc-8548739469f9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:09.871196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-09a9e919-4939-4010-b8cc-8548739469f9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:09.883119 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-09a9e919-4939-4010-b8cc-8548739469f9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1391 microversion: 2.1 time: 0.181704 Sep 06 11:37:09.883119 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3167/6282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:09 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:10.314820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-1b153f41-bf3a-4bc6-b5a2-4cb111bf9c76 req-b0242339-dd66-4bb1-92b0-9af2a5d0f9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8d5548-d996-4b4a-b94d-28afae7c281b", "name": "network-vif-plugged", "status": "completed", "tag": "11538fbe-5d0f-454a-8a16-e4c1137f2aed"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:10.326255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1b153f41-bf3a-4bc6-b5a2-4cb111bf9c76 req-b0242339-dd66-4bb1-92b0-9af2a5d0f9a3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:10.326857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1b153f41-bf3a-4bc6-b5a2-4cb111bf9c76 req-b0242339-dd66-4bb1-92b0-9af2a5d0f9a3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:10.327392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1b153f41-bf3a-4bc6-b5a2-4cb111bf9c76 req-b0242339-dd66-4bb1-92b0-9af2a5d0f9a3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:10.339628 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-1b153f41-bf3a-4bc6-b5a2-4cb111bf9c76 req-b0242339-dd66-4bb1-92b0-9af2a5d0f9a3 service nova] Creating event network-vif-plugged:11538fbe-5d0f-454a-8a16-e4c1137f2aed for instance fa8d5548-d996-4b4a-b94d-28afae7c281b on nch1-master-1 Sep 06 11:37:10.344774 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-1b153f41-bf3a-4bc6-b5a2-4cb111bf9c76 req-b0242339-dd66-4bb1-92b0-9af2a5d0f9a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036205 Sep 06 11:37:10.345546 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3116/6283] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:37:10.904570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dde52f4b-7215-495d-84c9-bf0812122841 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:10.905229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dde52f4b-7215-495d-84c9-bf0812122841 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:10.918467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dde52f4b-7215-495d-84c9-bf0812122841 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:10.919216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dde52f4b-7215-495d-84c9-bf0812122841 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:10.920333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dde52f4b-7215-495d-84c9-bf0812122841 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:10.921610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dde52f4b-7215-495d-84c9-bf0812122841 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:10.922468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dde52f4b-7215-495d-84c9-bf0812122841 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:10.923543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dde52f4b-7215-495d-84c9-bf0812122841 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:11.107977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dde52f4b-7215-495d-84c9-bf0812122841 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:11.118669 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dde52f4b-7215-495d-84c9-bf0812122841 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1391 microversion: 2.1 time: 0.219117 Sep 06 11:37:11.119855 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3168/6284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:10 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1391 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:12.144564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-07e275fd-4928-45f6-bafe-b0b9ea4aa6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:12.145279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-07e275fd-4928-45f6-bafe-b0b9ea4aa6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:12.153295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e275fd-4928-45f6-bafe-b0b9ea4aa6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:12.154089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e275fd-4928-45f6-bafe-b0b9ea4aa6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:12.154545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e275fd-4928-45f6-bafe-b0b9ea4aa6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:12.155305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e275fd-4928-45f6-bafe-b0b9ea4aa6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:12.155801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e275fd-4928-45f6-bafe-b0b9ea4aa6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:12.156250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-07e275fd-4928-45f6-bafe-b0b9ea4aa6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:12.244456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1293108654", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "8a4ab80d-89eb-48af-9882-5fafdee4c851"}], "key_name": "tempest-TestNetworkBasicOps-1208535861", "security_groups": [{"name": "tempest-secgroup-smoke-1538345518"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:12.246856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:12.247463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:12.248724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:12.305917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-07e275fd-4928-45f6-bafe-b0b9ea4aa6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:12.313816 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-07e275fd-4928-45f6-bafe-b0b9ea4aa6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1564 microversion: 2.1 time: 0.173585 Sep 06 11:37:12.314409 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3117/6285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:12 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:12.343208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b51c446d-6037-47a1-8bb8-fc307c600182 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:12.344149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b51c446d-6037-47a1-8bb8-fc307c600182 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:12.351866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b51c446d-6037-47a1-8bb8-fc307c600182 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:12.353571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b51c446d-6037-47a1-8bb8-fc307c600182 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:12.353814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] validate_networks() for [('8a4ab80d-89eb-48af-9882-5fafdee4c851', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:37:12.353926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b51c446d-6037-47a1-8bb8-fc307c600182 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:12.354703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b51c446d-6037-47a1-8bb8-fc307c600182 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:12.355388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b51c446d-6037-47a1-8bb8-fc307c600182 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:12.355641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b51c446d-6037-47a1-8bb8-fc307c600182 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:12.578017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b51c446d-6037-47a1-8bb8-fc307c600182 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:12.586720 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b51c446d-6037-47a1-8bb8-fc307c600182 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1564 microversion: 2.1 time: 0.247948 Sep 06 11:37:12.590157 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3118/6286] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:12 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1564 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:12.828669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:37:12.829107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:37:12.829781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:37:12.830026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:37:12.830447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:37:12.839661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:12.840165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:12.840617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:12.841490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:12.841835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:12.842274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:12.861138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Getting quotas for project d3a7bd2f2a3d4318bc4445e9c4be13fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:37:12.866521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Getting quotas for user cde9fe6d32c54f008d430dc9d3ef6e47 and project d3a7bd2f2a3d4318bc4445e9c4be13fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:37:12.880308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:37:12.883504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:37:13.026944 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-959ae4ae-501a-4646-ad93-34ea78f803a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.793039 Sep 06 11:37:13.027669 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3169/6287] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:37:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:37:13.040363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-38dcd891-2233-4278-8b20-656bc8e3563b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:13.041083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-38dcd891-2233-4278-8b20-656bc8e3563b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:13.043264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:13.148450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-38dcd891-2233-4278-8b20-656bc8e3563b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:13.160831 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-38dcd891-2233-4278-8b20-656bc8e3563b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1249 microversion: 2.1 time: 0.125060 Sep 06 11:37:13.161423 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3119/6288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:13 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1249 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:14.186621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9e6ba88b-4e35-4afe-9b6d-11e1d8c44194 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:14.187454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9e6ba88b-4e35-4afe-9b6d-11e1d8c44194 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:14.196830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e6ba88b-4e35-4afe-9b6d-11e1d8c44194 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:14.197335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e6ba88b-4e35-4afe-9b6d-11e1d8c44194 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:14.197849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e6ba88b-4e35-4afe-9b6d-11e1d8c44194 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:14.198573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e6ba88b-4e35-4afe-9b6d-11e1d8c44194 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:14.199073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e6ba88b-4e35-4afe-9b6d-11e1d8c44194 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:14.199513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e6ba88b-4e35-4afe-9b6d-11e1d8c44194 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:14.269951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9e6ba88b-4e35-4afe-9b6d-11e1d8c44194 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:14.278007 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9e6ba88b-4e35-4afe-9b6d-11e1d8c44194 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1253 microversion: 2.1 time: 0.096295 Sep 06 11:37:14.278601 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3170/6289] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:14 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1253 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:14.657408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f681637b-79ee-44bd-b79d-3b19299194be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:14.658066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f681637b-79ee-44bd-b79d-3b19299194be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:14.668866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f681637b-79ee-44bd-b79d-3b19299194be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:14.669379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f681637b-79ee-44bd-b79d-3b19299194be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:14.669871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f681637b-79ee-44bd-b79d-3b19299194be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:14.670561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f681637b-79ee-44bd-b79d-3b19299194be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:14.671060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f681637b-79ee-44bd-b79d-3b19299194be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:14.671497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f681637b-79ee-44bd-b79d-3b19299194be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:14.673945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-61cce2d6-b68e-46ef-8ac7-f7f11488e738 req-1d036c65-bc75-41b9-aec1-64b69705170a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa8d5548-d996-4b4a-b94d-28afae7c281b", "tag": "11538fbe-5d0f-454a-8a16-e4c1137f2aed"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:14.686224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-61cce2d6-b68e-46ef-8ac7-f7f11488e738 req-1d036c65-bc75-41b9-aec1-64b69705170a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:14.687539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-61cce2d6-b68e-46ef-8ac7-f7f11488e738 req-1d036c65-bc75-41b9-aec1-64b69705170a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:14.687539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-61cce2d6-b68e-46ef-8ac7-f7f11488e738 req-1d036c65-bc75-41b9-aec1-64b69705170a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:14.700731 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-61cce2d6-b68e-46ef-8ac7-f7f11488e738 req-1d036c65-bc75-41b9-aec1-64b69705170a service nova] Creating event network-changed:11538fbe-5d0f-454a-8a16-e4c1137f2aed for instance fa8d5548-d996-4b4a-b94d-28afae7c281b on nch1-master-1 Sep 06 11:37:14.706556 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-61cce2d6-b68e-46ef-8ac7-f7f11488e738 req-1d036c65-bc75-41b9-aec1-64b69705170a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037599 Sep 06 11:37:14.708004 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3171/6290] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:37:14.848809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f681637b-79ee-44bd-b79d-3b19299194be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:14.859991 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f681637b-79ee-44bd-b79d-3b19299194be tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1564 microversion: 2.1 time: 0.207063 Sep 06 11:37:14.861322 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3120/6291] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:14 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1564 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:15.304107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-82c70a19-16f9-4474-a146-1163a972f461 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:15.305608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-82c70a19-16f9-4474-a146-1163a972f461 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:15.312355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82c70a19-16f9-4474-a146-1163a972f461 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:15.312848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82c70a19-16f9-4474-a146-1163a972f461 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:15.313477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82c70a19-16f9-4474-a146-1163a972f461 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:15.314193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82c70a19-16f9-4474-a146-1163a972f461 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:15.314656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82c70a19-16f9-4474-a146-1163a972f461 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:15.315231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-82c70a19-16f9-4474-a146-1163a972f461 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:15.408928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-82c70a19-16f9-4474-a146-1163a972f461 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:15.417891 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-82c70a19-16f9-4474-a146-1163a972f461 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1301 microversion: 2.1 time: 0.119392 Sep 06 11:37:15.419106 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3172/6292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:15 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1301 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:16.452670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d0efd61f-ef1e-4da9-9c0b-ba7d3da36e18 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:16.453938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d0efd61f-ef1e-4da9-9c0b-ba7d3da36e18 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:16.466595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0efd61f-ef1e-4da9-9c0b-ba7d3da36e18 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:16.467259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0efd61f-ef1e-4da9-9c0b-ba7d3da36e18 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:16.467783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0efd61f-ef1e-4da9-9c0b-ba7d3da36e18 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:16.468590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0efd61f-ef1e-4da9-9c0b-ba7d3da36e18 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:16.469130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0efd61f-ef1e-4da9-9c0b-ba7d3da36e18 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:16.469656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0efd61f-ef1e-4da9-9c0b-ba7d3da36e18 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:16.629284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d0efd61f-ef1e-4da9-9c0b-ba7d3da36e18 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:16.637710 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d0efd61f-ef1e-4da9-9c0b-ba7d3da36e18 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1375 microversion: 2.1 time: 0.194963 Sep 06 11:37:16.638331 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3121/6293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:16 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1375 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:17.497242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-bef2f6bc-b71c-4ccd-95c6-df4473ef28fc req-06bc3f98-e5d1-4e6b-b069-bb6c307799d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92978b91-d60a-4f97-aef6-3d4a7f6de1ec", "tag": "7d2ee8d0-3f23-4629-8fb9-7071100f9f75"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:17.509385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-bef2f6bc-b71c-4ccd-95c6-df4473ef28fc req-06bc3f98-e5d1-4e6b-b069-bb6c307799d8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:17.509882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-bef2f6bc-b71c-4ccd-95c6-df4473ef28fc req-06bc3f98-e5d1-4e6b-b069-bb6c307799d8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:17.510322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-bef2f6bc-b71c-4ccd-95c6-df4473ef28fc req-06bc3f98-e5d1-4e6b-b069-bb6c307799d8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:17.521666 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-bef2f6bc-b71c-4ccd-95c6-df4473ef28fc req-06bc3f98-e5d1-4e6b-b069-bb6c307799d8 service nova] Creating event network-changed:7d2ee8d0-3f23-4629-8fb9-7071100f9f75 for instance 92978b91-d60a-4f97-aef6-3d4a7f6de1ec on nch2-master-1 Sep 06 11:37:17.527619 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-bef2f6bc-b71c-4ccd-95c6-df4473ef28fc req-06bc3f98-e5d1-4e6b-b069-bb6c307799d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035093 Sep 06 11:37:17.528266 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3173/6294] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:37:17.662100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bc99b636-f29b-4eb6-867d-f6961ad48887 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:17.662795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bc99b636-f29b-4eb6-867d-f6961ad48887 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:17.670207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc99b636-f29b-4eb6-867d-f6961ad48887 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:17.670698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc99b636-f29b-4eb6-867d-f6961ad48887 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:17.671170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc99b636-f29b-4eb6-867d-f6961ad48887 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:17.671933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc99b636-f29b-4eb6-867d-f6961ad48887 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:17.672397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc99b636-f29b-4eb6-867d-f6961ad48887 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:17.672905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc99b636-f29b-4eb6-867d-f6961ad48887 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:17.819281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bc99b636-f29b-4eb6-867d-f6961ad48887 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:17.828162 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bc99b636-f29b-4eb6-867d-f6961ad48887 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1375 microversion: 2.1 time: 0.170064 Sep 06 11:37:17.828752 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3122/6295] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:17 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:18.853954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7cfb5efc-5b12-4154-ba95-93ecf5ef3dac tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:18.854666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7cfb5efc-5b12-4154-ba95-93ecf5ef3dac tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:18.861301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cfb5efc-5b12-4154-ba95-93ecf5ef3dac tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:18.861776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cfb5efc-5b12-4154-ba95-93ecf5ef3dac tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:18.862221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cfb5efc-5b12-4154-ba95-93ecf5ef3dac tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:18.863030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cfb5efc-5b12-4154-ba95-93ecf5ef3dac tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:18.863506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cfb5efc-5b12-4154-ba95-93ecf5ef3dac tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:18.863937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7cfb5efc-5b12-4154-ba95-93ecf5ef3dac tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:19.015347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7cfb5efc-5b12-4154-ba95-93ecf5ef3dac tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:19.024373 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7cfb5efc-5b12-4154-ba95-93ecf5ef3dac tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1375 microversion: 2.1 time: 0.176084 Sep 06 11:37:19.024957 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3174/6296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:18 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:20.046632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-92c8b5e1-7baa-45ff-ab7e-ee2214ec8d5d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:20.047359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-92c8b5e1-7baa-45ff-ab7e-ee2214ec8d5d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:20.054201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92c8b5e1-7baa-45ff-ab7e-ee2214ec8d5d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:20.054692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92c8b5e1-7baa-45ff-ab7e-ee2214ec8d5d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:20.055159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92c8b5e1-7baa-45ff-ab7e-ee2214ec8d5d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:20.055852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92c8b5e1-7baa-45ff-ab7e-ee2214ec8d5d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:20.056311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92c8b5e1-7baa-45ff-ab7e-ee2214ec8d5d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:20.056738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92c8b5e1-7baa-45ff-ab7e-ee2214ec8d5d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:20.191757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-92c8b5e1-7baa-45ff-ab7e-ee2214ec8d5d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:20.200177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-92c8b5e1-7baa-45ff-ab7e-ee2214ec8d5d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1375 microversion: 2.1 time: 0.157503 Sep 06 11:37:20.200749 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3123/6297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:20 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:21.224703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a760ec27-279a-4d1a-a647-1eb93a283705 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:21.225321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a760ec27-279a-4d1a-a647-1eb93a283705 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:21.232595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a760ec27-279a-4d1a-a647-1eb93a283705 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:21.233125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a760ec27-279a-4d1a-a647-1eb93a283705 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:21.233730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a760ec27-279a-4d1a-a647-1eb93a283705 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:21.234459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a760ec27-279a-4d1a-a647-1eb93a283705 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:21.234933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a760ec27-279a-4d1a-a647-1eb93a283705 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:21.235399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a760ec27-279a-4d1a-a647-1eb93a283705 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:21.378183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a760ec27-279a-4d1a-a647-1eb93a283705 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:21.387393 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a760ec27-279a-4d1a-a647-1eb93a283705 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1375 microversion: 2.1 time: 0.166711 Sep 06 11:37:21.388214 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3175/6298] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:21 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:37:22.411195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fbcd0740-2fa4-4a87-b765-0b64b494b2fe tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:22.411832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fbcd0740-2fa4-4a87-b765-0b64b494b2fe tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:22.420265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbcd0740-2fa4-4a87-b765-0b64b494b2fe tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:22.421065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbcd0740-2fa4-4a87-b765-0b64b494b2fe tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:22.421526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbcd0740-2fa4-4a87-b765-0b64b494b2fe tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:22.422259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbcd0740-2fa4-4a87-b765-0b64b494b2fe tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:22.422726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbcd0740-2fa4-4a87-b765-0b64b494b2fe tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:22.423193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbcd0740-2fa4-4a87-b765-0b64b494b2fe tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:22.561725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fbcd0740-2fa4-4a87-b765-0b64b494b2fe tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:22.578815 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fbcd0740-2fa4-4a87-b765-0b64b494b2fe tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1375 microversion: 2.1 time: 0.163334 Sep 06 11:37:22.578815 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3124/6299] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:22 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:22.927135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a9defb2d-ed9a-4027-a5f3-0d25475c93cf req-66d0fcdd-7427-4088-b881-83da0ddfe209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92978b91-d60a-4f97-aef6-3d4a7f6de1ec", "name": "network-vif-plugged", "status": "completed", "tag": "7d2ee8d0-3f23-4629-8fb9-7071100f9f75"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:22.927135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:22.927135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:22.931344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a9defb2d-ed9a-4027-a5f3-0d25475c93cf req-66d0fcdd-7427-4088-b881-83da0ddfe209 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:22.931850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a9defb2d-ed9a-4027-a5f3-0d25475c93cf req-66d0fcdd-7427-4088-b881-83da0ddfe209 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:22.932390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a9defb2d-ed9a-4027-a5f3-0d25475c93cf req-66d0fcdd-7427-4088-b881-83da0ddfe209 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:22.943621 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a9defb2d-ed9a-4027-a5f3-0d25475c93cf req-66d0fcdd-7427-4088-b881-83da0ddfe209 service nova] Creating event network-vif-plugged:7d2ee8d0-3f23-4629-8fb9-7071100f9f75 for instance 92978b91-d60a-4f97-aef6-3d4a7f6de1ec on nch2-master-1 Sep 06 11:37:22.949772 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a9defb2d-ed9a-4027-a5f3-0d25475c93cf req-66d0fcdd-7427-4088-b881-83da0ddfe209 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038485 Sep 06 11:37:22.950805 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3176/6300] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:37:23.596883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3faecb84-5fb4-4f26-8095-3c8007692ed4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:23.597517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3faecb84-5fb4-4f26-8095-3c8007692ed4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:23.600633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:23.607658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3faecb84-5fb4-4f26-8095-3c8007692ed4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:23.607658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3faecb84-5fb4-4f26-8095-3c8007692ed4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:23.607658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3faecb84-5fb4-4f26-8095-3c8007692ed4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:23.607658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3faecb84-5fb4-4f26-8095-3c8007692ed4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:23.607658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3faecb84-5fb4-4f26-8095-3c8007692ed4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:23.607658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3faecb84-5fb4-4f26-8095-3c8007692ed4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:23.742264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3faecb84-5fb4-4f26-8095-3c8007692ed4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:23.750236 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3faecb84-5fb4-4f26-8095-3c8007692ed4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1375 microversion: 2.1 time: 0.157418 Sep 06 11:37:23.750819 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3125/6301] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:23 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:24.776403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b1d2e2ee-bc7c-4dbf-bf5c-456adf3cd546 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:24.777120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b1d2e2ee-bc7c-4dbf-bf5c-456adf3cd546 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:24.784925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1d2e2ee-bc7c-4dbf-bf5c-456adf3cd546 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:24.785420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1d2e2ee-bc7c-4dbf-bf5c-456adf3cd546 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:24.785873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1d2e2ee-bc7c-4dbf-bf5c-456adf3cd546 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:24.786666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1d2e2ee-bc7c-4dbf-bf5c-456adf3cd546 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:24.787169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1d2e2ee-bc7c-4dbf-bf5c-456adf3cd546 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:24.787613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1d2e2ee-bc7c-4dbf-bf5c-456adf3cd546 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:24.932026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b1d2e2ee-bc7c-4dbf-bf5c-456adf3cd546 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:24.942514 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b1d2e2ee-bc7c-4dbf-bf5c-456adf3cd546 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1548 microversion: 2.1 time: 0.172271 Sep 06 11:37:24.943166 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3177/6302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:24 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:24.982768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e016ff72-c4d9-483e-8fa0-aa3ff4e2bfb2 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:24.983446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e016ff72-c4d9-483e-8fa0-aa3ff4e2bfb2 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:24.990586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e016ff72-c4d9-483e-8fa0-aa3ff4e2bfb2 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:24.991128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e016ff72-c4d9-483e-8fa0-aa3ff4e2bfb2 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:24.991583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e016ff72-c4d9-483e-8fa0-aa3ff4e2bfb2 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:24.992343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e016ff72-c4d9-483e-8fa0-aa3ff4e2bfb2 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:24.992965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e016ff72-c4d9-483e-8fa0-aa3ff4e2bfb2 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:24.993404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e016ff72-c4d9-483e-8fa0-aa3ff4e2bfb2 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:25.134023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e016ff72-c4d9-483e-8fa0-aa3ff4e2bfb2 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:25.141900 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e016ff72-c4d9-483e-8fa0-aa3ff4e2bfb2 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1548 microversion: 2.1 time: 0.163401 Sep 06 11:37:25.142487 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3126/6303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:24 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:36.163979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fbdc4add-8fac-4d9c-b030-f2f1e6fcdd24 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:36.166131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fbdc4add-8fac-4d9c-b030-f2f1e6fcdd24 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:36.169060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:36.169847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=76 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:36.174671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbdc4add-8fac-4d9c-b030-f2f1e6fcdd24 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:36.175206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbdc4add-8fac-4d9c-b030-f2f1e6fcdd24 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:36.175656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbdc4add-8fac-4d9c-b030-f2f1e6fcdd24 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:36.176358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbdc4add-8fac-4d9c-b030-f2f1e6fcdd24 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:36.176825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbdc4add-8fac-4d9c-b030-f2f1e6fcdd24 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:36.177263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fbdc4add-8fac-4d9c-b030-f2f1e6fcdd24 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:36.230074 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fbdc4add-8fac-4d9c-b030-f2f1e6fcdd24 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b/action" status: 200 len: 24576 microversion: 2.1 time: 0.070041 Sep 06 11:37:36.230726 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3178/6304] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:37:36 2022] POST /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b/action => generated 24576 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:37:47.186175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-12ad8425-89f3-48b6-9fc2-80f7990e0c48 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:47.186697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-12ad8425-89f3-48b6-9fc2-80f7990e0c48 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:47.189259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=17 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:47.190033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=70 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:47.195464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12ad8425-89f3-48b6-9fc2-80f7990e0c48 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:47.195970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12ad8425-89f3-48b6-9fc2-80f7990e0c48 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:47.196423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12ad8425-89f3-48b6-9fc2-80f7990e0c48 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:47.197144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12ad8425-89f3-48b6-9fc2-80f7990e0c48 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:47.197615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12ad8425-89f3-48b6-9fc2-80f7990e0c48 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:47.198088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12ad8425-89f3-48b6-9fc2-80f7990e0c48 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:47.595572 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-12ad8425-89f3-48b6-9fc2-80f7990e0c48 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1834 microversion: 2.1 time: 0.413287 Sep 06 11:37:47.596146 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3127/6305] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:47 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1834 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:47.620552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0db67ff0-4504-4633-a758-0dd8759bf68f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:47.622664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0db67ff0-4504-4633-a758-0dd8759bf68f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:47.628824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0db67ff0-4504-4633-a758-0dd8759bf68f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:47.629304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0db67ff0-4504-4633-a758-0dd8759bf68f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:47.629749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0db67ff0-4504-4633-a758-0dd8759bf68f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:47.630444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0db67ff0-4504-4633-a758-0dd8759bf68f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:47.631482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0db67ff0-4504-4633-a758-0dd8759bf68f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:47.631917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0db67ff0-4504-4633-a758-0dd8759bf68f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:47.767197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0db67ff0-4504-4633-a758-0dd8759bf68f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:47.775285 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0db67ff0-4504-4633-a758-0dd8759bf68f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1683 microversion: 2.1 time: 0.160363 Sep 06 11:37:47.775894 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3179/6306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:47 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:47.871591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fded3b85-2904-48c3-a998-44245e92c10c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:47.873800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fded3b85-2904-48c3-a998-44245e92c10c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:47.880030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fded3b85-2904-48c3-a998-44245e92c10c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:47.880530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fded3b85-2904-48c3-a998-44245e92c10c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:47.881618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fded3b85-2904-48c3-a998-44245e92c10c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:47.882329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fded3b85-2904-48c3-a998-44245e92c10c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:47.882796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fded3b85-2904-48c3-a998-44245e92c10c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:47.883267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fded3b85-2904-48c3-a998-44245e92c10c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:47.937384 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fded3b85-2904-48c3-a998-44245e92c10c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b/action" status: 200 len: 32646 microversion: 2.1 time: 0.069515 Sep 06 11:37:47.940552 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3128/6307] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:37:47 2022] POST /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b/action => generated 32646 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:37:48.122083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0c80c0eb-12f7-42a2-88da-cf215e1936f1 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:48.122596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0c80c0eb-12f7-42a2-88da-cf215e1936f1 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:48.129194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c80c0eb-12f7-42a2-88da-cf215e1936f1 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:48.129684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c80c0eb-12f7-42a2-88da-cf215e1936f1 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:48.130135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c80c0eb-12f7-42a2-88da-cf215e1936f1 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:48.130837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c80c0eb-12f7-42a2-88da-cf215e1936f1 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:48.131327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c80c0eb-12f7-42a2-88da-cf215e1936f1 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:48.131763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c80c0eb-12f7-42a2-88da-cf215e1936f1 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:48.159283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0c80c0eb-12f7-42a2-88da-cf215e1936f1 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f25ab44649ae45ab99061c93809e55d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04385e36a65e4f41aab4eceff7b42e68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:48.159882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0c80c0eb-12f7-42a2-88da-cf215e1936f1 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] flavor_id is None. Assuming migration. {{(pid=140876) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 06 11:37:48.160343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0c80c0eb-12f7-42a2-88da-cf215e1936f1 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140876) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:37:48.408127 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0c80c0eb-12f7-42a2-88da-cf215e1936f1 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b/action" status: 202 len: 0 microversion: 2.1 time: 0.289885 Sep 06 11:37:48.408674 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3180/6308] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:37:48 2022] POST /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:37:48.418124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-369b0853-be1c-42ce-8066-2392cdc7c8a5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:48.418836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-369b0853-be1c-42ce-8066-2392cdc7c8a5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:48.426184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-369b0853-be1c-42ce-8066-2392cdc7c8a5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:48.426690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-369b0853-be1c-42ce-8066-2392cdc7c8a5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:48.427216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-369b0853-be1c-42ce-8066-2392cdc7c8a5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:48.428124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-369b0853-be1c-42ce-8066-2392cdc7c8a5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:48.428360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-369b0853-be1c-42ce-8066-2392cdc7c8a5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:48.428798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-369b0853-be1c-42ce-8066-2392cdc7c8a5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:48.564352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-369b0853-be1c-42ce-8066-2392cdc7c8a5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:48.572675 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-369b0853-be1c-42ce-8066-2392cdc7c8a5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1692 microversion: 2.1 time: 0.158759 Sep 06 11:37:48.573283 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3129/6309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:48 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:49.597838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-24018274-6d26-49d0-9c40-6fa81939afc0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:49.598565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-24018274-6d26-49d0-9c40-6fa81939afc0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:49.606844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24018274-6d26-49d0-9c40-6fa81939afc0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:49.607386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24018274-6d26-49d0-9c40-6fa81939afc0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:49.607866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24018274-6d26-49d0-9c40-6fa81939afc0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:49.608729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24018274-6d26-49d0-9c40-6fa81939afc0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:49.609209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24018274-6d26-49d0-9c40-6fa81939afc0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:49.609809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24018274-6d26-49d0-9c40-6fa81939afc0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:49.753874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-24018274-6d26-49d0-9c40-6fa81939afc0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:49.764826 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-24018274-6d26-49d0-9c40-6fa81939afc0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1692 microversion: 2.1 time: 0.171889 Sep 06 11:37:49.765438 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3181/6310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:49 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:50.790897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-909b790e-fcfb-433b-ac40-96842f0b6075 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:50.792937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-909b790e-fcfb-433b-ac40-96842f0b6075 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:50.803092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-909b790e-fcfb-433b-ac40-96842f0b6075 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:50.805018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-909b790e-fcfb-433b-ac40-96842f0b6075 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:50.805561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-909b790e-fcfb-433b-ac40-96842f0b6075 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:50.806243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-909b790e-fcfb-433b-ac40-96842f0b6075 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:50.806730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-909b790e-fcfb-433b-ac40-96842f0b6075 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:50.807224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-909b790e-fcfb-433b-ac40-96842f0b6075 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:50.985660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-909b790e-fcfb-433b-ac40-96842f0b6075 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:50.987531 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-909b790e-fcfb-433b-ac40-96842f0b6075 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1692 microversion: 2.1 time: 0.201285 Sep 06 11:37:50.988119 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3130/6311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:50 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1692 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:51.251984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6ec4b971-2bfb-4f72-81ed-5070b15ec9a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:51.252524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6ec4b971-2bfb-4f72-81ed-5070b15ec9a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:51.260026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ec4b971-2bfb-4f72-81ed-5070b15ec9a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:51.263860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ec4b971-2bfb-4f72-81ed-5070b15ec9a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:51.263860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ec4b971-2bfb-4f72-81ed-5070b15ec9a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:51.263860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ec4b971-2bfb-4f72-81ed-5070b15ec9a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:51.263860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ec4b971-2bfb-4f72-81ed-5070b15ec9a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:51.263860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ec4b971-2bfb-4f72-81ed-5070b15ec9a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:51.294307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6ec4b971-2bfb-4f72-81ed-5070b15ec9a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:37:51.634523 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6ec4b971-2bfb-4f72-81ed-5070b15ec9a4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "DELETE /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 204 len: 0 microversion: 2.1 time: 0.386102 Sep 06 11:37:51.645299 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3182/6312] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:37:51 2022] DELETE /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:37:51.645444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e466fb1-1fdd-445b-86b2-5106977d805c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:51.645444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e466fb1-1fdd-445b-86b2-5106977d805c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:51.651159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e466fb1-1fdd-445b-86b2-5106977d805c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:51.652061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e466fb1-1fdd-445b-86b2-5106977d805c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:51.652696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e466fb1-1fdd-445b-86b2-5106977d805c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:51.653617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e466fb1-1fdd-445b-86b2-5106977d805c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:51.654355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e466fb1-1fdd-445b-86b2-5106977d805c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:51.654805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e466fb1-1fdd-445b-86b2-5106977d805c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:51.812018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7e466fb1-1fdd-445b-86b2-5106977d805c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:51.821652 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e466fb1-1fdd-445b-86b2-5106977d805c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1554 microversion: 2.1 time: 0.182201 Sep 06 11:37:51.822920 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3131/6313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:51 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:52.012244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-36b4df3c-d216-4aa6-a64f-6ee7d2721aa6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:52.013091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-36b4df3c-d216-4aa6-a64f-6ee7d2721aa6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:52.020218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36b4df3c-d216-4aa6-a64f-6ee7d2721aa6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:52.020863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36b4df3c-d216-4aa6-a64f-6ee7d2721aa6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:52.021959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36b4df3c-d216-4aa6-a64f-6ee7d2721aa6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:52.022809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36b4df3c-d216-4aa6-a64f-6ee7d2721aa6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:52.023443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36b4df3c-d216-4aa6-a64f-6ee7d2721aa6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:52.024178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-36b4df3c-d216-4aa6-a64f-6ee7d2721aa6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:52.174177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-36b4df3c-d216-4aa6-a64f-6ee7d2721aa6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:52.183340 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-36b4df3c-d216-4aa6-a64f-6ee7d2721aa6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1692 microversion: 2.1 time: 0.175399 Sep 06 11:37:52.186744 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3183/6314] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:52 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:52.847126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0cdf6e2d-dc40-4c3a-a417-95edf208571e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:52.847807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0cdf6e2d-dc40-4c3a-a417-95edf208571e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:52.856419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cdf6e2d-dc40-4c3a-a417-95edf208571e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:52.856943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cdf6e2d-dc40-4c3a-a417-95edf208571e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:52.857428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cdf6e2d-dc40-4c3a-a417-95edf208571e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:52.858254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cdf6e2d-dc40-4c3a-a417-95edf208571e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:52.858720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cdf6e2d-dc40-4c3a-a417-95edf208571e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:52.859338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0cdf6e2d-dc40-4c3a-a417-95edf208571e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:53.018049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0cdf6e2d-dc40-4c3a-a417-95edf208571e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:53.026794 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0cdf6e2d-dc40-4c3a-a417-95edf208571e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1554 microversion: 2.1 time: 0.184051 Sep 06 11:37:53.027652 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3132/6315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:52 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:37:53.208831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-444936d6-b653-4d4c-809e-ffc2059fa390 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:53.209521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-444936d6-b653-4d4c-809e-ffc2059fa390 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:53.221531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-444936d6-b653-4d4c-809e-ffc2059fa390 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:53.222758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-444936d6-b653-4d4c-809e-ffc2059fa390 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:53.223969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-444936d6-b653-4d4c-809e-ffc2059fa390 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:53.226181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-444936d6-b653-4d4c-809e-ffc2059fa390 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:53.227324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-444936d6-b653-4d4c-809e-ffc2059fa390 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:53.227926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-444936d6-b653-4d4c-809e-ffc2059fa390 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:53.382465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-444936d6-b653-4d4c-809e-ffc2059fa390 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:53.390717 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-444936d6-b653-4d4c-809e-ffc2059fa390 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1697 microversion: 2.1 time: 0.185921 Sep 06 11:37:53.392581 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3184/6316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:53 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:37:53.492371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7c7c6306-caa3-44af-9425-c699b84d2134 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:53.492816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7c7c6306-caa3-44af-9425-c699b84d2134 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:53.498950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c7c6306-caa3-44af-9425-c699b84d2134 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:53.499494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c7c6306-caa3-44af-9425-c699b84d2134 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:53.499952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c7c6306-caa3-44af-9425-c699b84d2134 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:53.500675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c7c6306-caa3-44af-9425-c699b84d2134 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:53.501172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c7c6306-caa3-44af-9425-c699b84d2134 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:53.501617 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7c7c6306-caa3-44af-9425-c699b84d2134 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:53.600006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-7c7c6306-caa3-44af-9425-c699b84d2134 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lazy-loading 'services' on Instance uuid 6722a0c0-e113-442f-b4c2-8ec30e58b2a4 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:37:53.776643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-471a6d6a-03c1-47d5-8706-db5bc0befc8a req-dde3e505-0d63-492a-8a49-3464505b7a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92978b91-d60a-4f97-aef6-3d4a7f6de1ec", "name": "network-vif-deleted", "tag": "7d2ee8d0-3f23-4629-8fb9-7071100f9f75"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:53.787154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-471a6d6a-03c1-47d5-8706-db5bc0befc8a req-dde3e505-0d63-492a-8a49-3464505b7a85 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:53.787608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-471a6d6a-03c1-47d5-8706-db5bc0befc8a req-dde3e505-0d63-492a-8a49-3464505b7a85 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:53.788053 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-471a6d6a-03c1-47d5-8706-db5bc0befc8a req-dde3e505-0d63-492a-8a49-3464505b7a85 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:53.799438 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-471a6d6a-03c1-47d5-8706-db5bc0befc8a req-dde3e505-0d63-492a-8a49-3464505b7a85 service nova] Creating event network-vif-deleted:7d2ee8d0-3f23-4629-8fb9-7071100f9f75 for instance 92978b91-d60a-4f97-aef6-3d4a7f6de1ec on nch2-master-1 Sep 06 11:37:53.805238 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-471a6d6a-03c1-47d5-8706-db5bc0befc8a req-dde3e505-0d63-492a-8a49-3464505b7a85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035038 Sep 06 11:37:53.809577 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3185/6317] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:37:53.867066 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7c7c6306-caa3-44af-9425-c699b84d2134 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4/os-volume_attachments/19567f19-1cb2-4e80-bf09-e8c419539694" status: 202 len: 0 microversion: 2.1 time: 0.378566 Sep 06 11:37:53.868296 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3133/6318] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 11:37:53 2022] DELETE /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4/os-volume_attachments/19567f19-1cb2-4e80-bf09-e8c419539694 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:37:54.053234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:54.055558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:54.063291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:54.063784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:54.064227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:54.064937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:54.065408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:54.065833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:54.106730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:54.107252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:54.107888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:54.108350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lazy-loading 'fault' on Instance uuid 92978b91-d60a-4f97-aef6-3d4a7f6de1ec {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:37:54.162768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:54.172091 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ab5c1382-17e7-4f6e-83fb-786029f8dc2d tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 200 len: 1339 microversion: 2.1 time: 0.124463 Sep 06 11:37:54.173049 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3186/6319] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:54 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 1339 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:37:54.416489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cf76fdef-f095-46c3-be10-a6e0508d6ab1 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:54.417120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cf76fdef-f095-46c3-be10-a6e0508d6ab1 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:54.423774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf76fdef-f095-46c3-be10-a6e0508d6ab1 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:54.424273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf76fdef-f095-46c3-be10-a6e0508d6ab1 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:54.424724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf76fdef-f095-46c3-be10-a6e0508d6ab1 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:54.425475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf76fdef-f095-46c3-be10-a6e0508d6ab1 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:54.425951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf76fdef-f095-46c3-be10-a6e0508d6ab1 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:54.426387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf76fdef-f095-46c3-be10-a6e0508d6ab1 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:54.574150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cf76fdef-f095-46c3-be10-a6e0508d6ab1 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:54.585805 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cf76fdef-f095-46c3-be10-a6e0508d6ab1 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1697 microversion: 2.1 time: 0.174196 Sep 06 11:37:54.586545 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3134/6320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:54 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:37:55.006716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f400d2c8-36c7-430e-93bd-3c23411964da tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:55.007266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f400d2c8-36c7-430e-93bd-3c23411964da tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:55.014049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f400d2c8-36c7-430e-93bd-3c23411964da tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:55.014535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f400d2c8-36c7-430e-93bd-3c23411964da tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:55.020050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f400d2c8-36c7-430e-93bd-3c23411964da tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:55.020050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f400d2c8-36c7-430e-93bd-3c23411964da tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:55.020050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f400d2c8-36c7-430e-93bd-3c23411964da tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:55.020050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f400d2c8-36c7-430e-93bd-3c23411964da tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:55.044686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f400d2c8-36c7-430e-93bd-3c23411964da tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:37:55.198517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1a276778-8c1c-426e-a1c8-b77424aa4e45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:55.199080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1a276778-8c1c-426e-a1c8-b77424aa4e45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92978b91-d60a-4f97-aef6-3d4a7f6de1ec] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:55.206152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a276778-8c1c-426e-a1c8-b77424aa4e45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:55.206627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a276778-8c1c-426e-a1c8-b77424aa4e45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:55.207092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a276778-8c1c-426e-a1c8-b77424aa4e45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:55.207798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a276778-8c1c-426e-a1c8-b77424aa4e45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:55.208300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a276778-8c1c-426e-a1c8-b77424aa4e45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:55.208770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a276778-8c1c-426e-a1c8-b77424aa4e45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:55.222458 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-1a276778-8c1c-426e-a1c8-b77424aa4e45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] HTTP exception thrown: Instance 92978b91-d60a-4f97-aef6-3d4a7f6de1ec could not be found. Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1a276778-8c1c-426e-a1c8-b77424aa4e45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Request method failure captured: Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec HTTP/1.1 Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzCh-VPlmUT_4_OVXtlT2bInKm9mEstqRIZTbFYTSSjBxARQNLQfO_wK7r3OKQBOYO2DbH6IBuG6RdJn9DFhS5-aAI2LYyipuTEvlriFomkTBG28jVAfMekgKXaGVveRfM3NEfa_uQWUfMSB7OD62OJGnK0PKMPXeJNDPmbaaUaULR0 Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: d3a7bd2f2a3d4318bc4445e9c4be13fb Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestNetworkBasicOps-865989598 Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d3a7bd2f2a3d4318bc4445e9c4be13fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3a7bd2f2a3d4318bc4445e9c4be13fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d3a7bd2f2a3d4318bc4445e9c4be13fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3a7bd2f2a3d4318bc4445e9c4be13fb"}]}] Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestNetworkBasicOps-865989598 Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: d3a7bd2f2a3d4318bc4445e9c4be13fb Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestNetworkBasicOps-865989598 Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestNetworkBasicOps-865989598-project Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: cde9fe6d32c54f008d430dc9d3ef6e47 Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestNetworkBasicOps-865989598-project Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 92978b91-d60a-4f97-aef6-3d4a7f6de1ec could not be found. Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '92978b91-d60a-4f97-aef6-3d4a7f6de1ec'} Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92978b91-d60a-4f97-aef6-3d4a7f6de1ec could not be found. Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92978b91-d60a-4f97-aef6-3d4a7f6de1ec could not be found. Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:37:55.225113 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:37:55.231643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:37:55.231643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:37:55.231643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:37:55.231643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:37:55.231643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:37:55.231643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92978b91-d60a-4f97-aef6-3d4a7f6de1ec could not be found. Sep 06 11:37:55.231643 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:37:55.231643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1a276778-8c1c-426e-a1c8-b77424aa4e45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Returning 404 to user: Instance 92978b91-d60a-4f97-aef6-3d4a7f6de1ec could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:37:55.231643 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1a276778-8c1c-426e-a1c8-b77424aa4e45 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec" status: 404 len: 111 microversion: 2.1 time: 0.032120 Sep 06 11:37:55.231643 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3135/6321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:55 2022] GET /compute/v2.1/servers/92978b91-d60a-4f97-aef6-3d4a7f6de1ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:37:55.317433 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f400d2c8-36c7-430e-93bd-3c23411964da tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 204 len: 0 microversion: 2.1 time: 0.314970 Sep 06 11:37:55.318097 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3187/6322] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:37:55 2022] DELETE /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:37:55.327362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-05651e03-143f-4fd3-ab5f-af4f9342f0b3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:55.328292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-05651e03-143f-4fd3-ab5f-af4f9342f0b3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:55.337832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05651e03-143f-4fd3-ab5f-af4f9342f0b3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:55.340836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05651e03-143f-4fd3-ab5f-af4f9342f0b3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:55.340836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05651e03-143f-4fd3-ab5f-af4f9342f0b3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:55.340836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05651e03-143f-4fd3-ab5f-af4f9342f0b3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:55.340836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05651e03-143f-4fd3-ab5f-af4f9342f0b3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:55.340836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05651e03-143f-4fd3-ab5f-af4f9342f0b3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:55.480659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-05651e03-143f-4fd3-ab5f-af4f9342f0b3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:55.488975 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-05651e03-143f-4fd3-ab5f-af4f9342f0b3 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 200 len: 1512 microversion: 2.1 time: 0.165975 Sep 06 11:37:55.491717 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3136/6323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:55 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:55.497075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-34154dc0-901f-4c67-a26e-be3701c0655e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '.version_select at 0x7f90fcf79670>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:55.570997 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-34154dc0-901f-4c67-a26e-be3701c0655e tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1208535861" status: 202 len: 0 microversion: 2.1 time: 0.078229 Sep 06 11:37:55.572047 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3188/6324] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Sep 6 11:37:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1208535861 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:37:55.619365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6c68ac41-41bf-49bb-8cd8-0f39fc2299ea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:55.620023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6c68ac41-41bf-49bb-8cd8-0f39fc2299ea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:55.627323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c68ac41-41bf-49bb-8cd8-0f39fc2299ea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:55.628095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c68ac41-41bf-49bb-8cd8-0f39fc2299ea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:55.629160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c68ac41-41bf-49bb-8cd8-0f39fc2299ea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:55.630145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c68ac41-41bf-49bb-8cd8-0f39fc2299ea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:55.631220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c68ac41-41bf-49bb-8cd8-0f39fc2299ea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:55.631668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c68ac41-41bf-49bb-8cd8-0f39fc2299ea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:56.097629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6c68ac41-41bf-49bb-8cd8-0f39fc2299ea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:56.106418 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6c68ac41-41bf-49bb-8cd8-0f39fc2299ea tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1697 microversion: 2.1 time: 0.491215 Sep 06 11:37:56.113862 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3137/6325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:55 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1697 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:56.515306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-27236b83-1fdc-407f-bae5-5bc34fe56d11 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:56.516070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-27236b83-1fdc-407f-bae5-5bc34fe56d11 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:56.527710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27236b83-1fdc-407f-bae5-5bc34fe56d11 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:56.528252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27236b83-1fdc-407f-bae5-5bc34fe56d11 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:56.528883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27236b83-1fdc-407f-bae5-5bc34fe56d11 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:56.529890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27236b83-1fdc-407f-bae5-5bc34fe56d11 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:56.530363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27236b83-1fdc-407f-bae5-5bc34fe56d11 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:56.530801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27236b83-1fdc-407f-bae5-5bc34fe56d11 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:56.774121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-27236b83-1fdc-407f-bae5-5bc34fe56d11 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:56.784366 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-27236b83-1fdc-407f-bae5-5bc34fe56d11 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 200 len: 1512 microversion: 2.1 time: 0.275280 Sep 06 11:37:56.785067 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3189/6326] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:56 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 1512 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:57.129468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fb117d58-c303-4f81-8315-4ddfad79b6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:57.130108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb117d58-c303-4f81-8315-4ddfad79b6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:57.138200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb117d58-c303-4f81-8315-4ddfad79b6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:57.138746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb117d58-c303-4f81-8315-4ddfad79b6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:57.145184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb117d58-c303-4f81-8315-4ddfad79b6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:57.145184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb117d58-c303-4f81-8315-4ddfad79b6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:57.145184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb117d58-c303-4f81-8315-4ddfad79b6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:57.145184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb117d58-c303-4f81-8315-4ddfad79b6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:57.285169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb117d58-c303-4f81-8315-4ddfad79b6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:57.293446 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fb117d58-c303-4f81-8315-4ddfad79b6fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1697 microversion: 2.1 time: 0.168040 Sep 06 11:37:57.294302 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3138/6327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:57 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:37:57.578081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-b751505a-f16e-463f-9fbc-d6cb76f7ac6c req-b210e4c2-6e78-45e9-b59c-8075708f9868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6722a0c0-e113-442f-b4c2-8ec30e58b2a4", "name": "network-vif-deleted", "tag": "b8a9bd8d-c51b-4f7c-a347-98c8f5d77e1d"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:57.588311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b751505a-f16e-463f-9fbc-d6cb76f7ac6c req-b210e4c2-6e78-45e9-b59c-8075708f9868 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:57.588796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b751505a-f16e-463f-9fbc-d6cb76f7ac6c req-b210e4c2-6e78-45e9-b59c-8075708f9868 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:57.589237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b751505a-f16e-463f-9fbc-d6cb76f7ac6c req-b210e4c2-6e78-45e9-b59c-8075708f9868 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:57.601537 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-b751505a-f16e-463f-9fbc-d6cb76f7ac6c req-b210e4c2-6e78-45e9-b59c-8075708f9868 service nova] Creating event network-vif-deleted:b8a9bd8d-c51b-4f7c-a347-98c8f5d77e1d for instance 6722a0c0-e113-442f-b4c2-8ec30e58b2a4 on nch1-master-1 Sep 06 11:37:57.606555 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-b751505a-f16e-463f-9fbc-d6cb76f7ac6c req-b210e4c2-6e78-45e9-b59c-8075708f9868 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032514 Sep 06 11:37:57.607367 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3190/6328] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:37:57.809218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a227f00d-e8b6-4d67-ace4-c27afa7a0329 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:57.809867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a227f00d-e8b6-4d67-ace4-c27afa7a0329 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:57.816917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a227f00d-e8b6-4d67-ace4-c27afa7a0329 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:57.817339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a227f00d-e8b6-4d67-ace4-c27afa7a0329 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:57.817785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a227f00d-e8b6-4d67-ace4-c27afa7a0329 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:57.819031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a227f00d-e8b6-4d67-ace4-c27afa7a0329 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:57.819581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a227f00d-e8b6-4d67-ace4-c27afa7a0329 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:57.819981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a227f00d-e8b6-4d67-ace4-c27afa7a0329 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:57.892715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a227f00d-e8b6-4d67-ace4-c27afa7a0329 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1fe9d40733413a9c56393762549c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7c997d05c141afb82389298ecb372c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:57.900082 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a227f00d-e8b6-4d67-ace4-c27afa7a0329 tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 200 len: 1303 microversion: 2.1 time: 0.094948 Sep 06 11:37:57.900705 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3139/6329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:57 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:37:58.318287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-03139d6d-b4f3-4ada-8214-be5f54f3efa5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:58.319063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-03139d6d-b4f3-4ada-8214-be5f54f3efa5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:58.325653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03139d6d-b4f3-4ada-8214-be5f54f3efa5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:58.326156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03139d6d-b4f3-4ada-8214-be5f54f3efa5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:58.326615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03139d6d-b4f3-4ada-8214-be5f54f3efa5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:58.327372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03139d6d-b4f3-4ada-8214-be5f54f3efa5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:58.327846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03139d6d-b4f3-4ada-8214-be5f54f3efa5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:58.328291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03139d6d-b4f3-4ada-8214-be5f54f3efa5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:58.488753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-03139d6d-b4f3-4ada-8214-be5f54f3efa5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:58.493997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:58.499497 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-03139d6d-b4f3-4ada-8214-be5f54f3efa5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1697 microversion: 2.1 time: 0.185923 Sep 06 11:37:58.500103 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3191/6330] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:58 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:58.624317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1dfe40f1-8e5a-451f-9440-ef760617634f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:58.625570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1dfe40f1-8e5a-451f-9440-ef760617634f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:58.633609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dfe40f1-8e5a-451f-9440-ef760617634f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:58.634090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dfe40f1-8e5a-451f-9440-ef760617634f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:58.634670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dfe40f1-8e5a-451f-9440-ef760617634f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:58.635436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dfe40f1-8e5a-451f-9440-ef760617634f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:58.635894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dfe40f1-8e5a-451f-9440-ef760617634f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:58.636329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1dfe40f1-8e5a-451f-9440-ef760617634f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:58.666306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1dfe40f1-8e5a-451f-9440-ef760617634f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:37:58.924651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-008c0ad5-61a2-41e0-b822-f157f670a9ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:58.930856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-008c0ad5-61a2-41e0-b822-f157f670a9ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] [instance: 6722a0c0-e113-442f-b4c2-8ec30e58b2a4] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:58.933832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-008c0ad5-61a2-41e0-b822-f157f670a9ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:58.934345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-008c0ad5-61a2-41e0-b822-f157f670a9ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:58.934799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-008c0ad5-61a2-41e0-b822-f157f670a9ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:58.935572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-008c0ad5-61a2-41e0-b822-f157f670a9ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:58.936241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-008c0ad5-61a2-41e0-b822-f157f670a9ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:58.936679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-008c0ad5-61a2-41e0-b822-f157f670a9ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:58.955224 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-008c0ad5-61a2-41e0-b822-f157f670a9ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] HTTP exception thrown: Instance 6722a0c0-e113-442f-b4c2-8ec30e58b2a4 could not be found. Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-008c0ad5-61a2-41e0-b822-f157f670a9ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Request method failure captured: Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 HTTP/1.1 Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFy91X871OIdc9SsMYbHL9klU2jOPDCw8xQbq-a1xy8Zg9EPIHWrj_1m1LnS8Szmdh1KxiEVrzFNEJJKV3yG_1a36NbAZWtxz-g9QvDA4hEDpIBrkyxP1sUCMMgHtsvUuMm8lirX-zGfZEYD-JDsLGOiL5LPkBinewwdjIOhxLBSkDtA Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: eb7c997d05c141afb82389298ecb372c Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1413768274 Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eb7c997d05c141afb82389298ecb372c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb7c997d05c141afb82389298ecb372c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eb7c997d05c141afb82389298ecb372c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb7c997d05c141afb82389298ecb372c"}]}] Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-VolumesSnapshotTestJSON-1413768274 Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: eb7c997d05c141afb82389298ecb372c Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1413768274 Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-VolumesSnapshotTestJSON-1413768274-project Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 4a1fe9d40733413a9c56393762549c7d Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-VolumesSnapshotTestJSON-1413768274-project Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 6722a0c0-e113-442f-b4c2-8ec30e58b2a4 could not be found. Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '6722a0c0-e113-442f-b4c2-8ec30e58b2a4'} Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6722a0c0-e113-442f-b4c2-8ec30e58b2a4 could not be found. Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6722a0c0-e113-442f-b4c2-8ec30e58b2a4 could not be found. Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:37:58.959602 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:37:58.963638 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:37:58.963638 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:37:58.963638 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:37:58.963638 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:37:58.963638 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:37:58.963638 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6722a0c0-e113-442f-b4c2-8ec30e58b2a4 could not be found. Sep 06 11:37:58.963638 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:37:58.963638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-008c0ad5-61a2-41e0-b822-f157f670a9ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] Returning 404 to user: Instance 6722a0c0-e113-442f-b4c2-8ec30e58b2a4 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:37:58.963638 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-008c0ad5-61a2-41e0-b822-f157f670a9ca tempest-VolumesSnapshotTestJSON-1413768274 tempest-VolumesSnapshotTestJSON-1413768274-project] 10.222.0.20 "GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4" status: 404 len: 111 microversion: 2.1 time: 0.040880 Sep 06 11:37:58.963638 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3192/6331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:58 2022] GET /compute/v2.1/servers/6722a0c0-e113-442f-b4c2-8ec30e58b2a4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:37:59.026262 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1dfe40f1-8e5a-451f-9440-ef760617634f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 204 len: 0 microversion: 2.1 time: 0.405834 Sep 06 11:37:59.027462 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3140/6332] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:37:58 2022] DELETE /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:37:59.035982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-53f1329f-6f0b-4913-9d3c-c5e686c3457b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:59.036670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-53f1329f-6f0b-4913-9d3c-c5e686c3457b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:59.043480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-53f1329f-6f0b-4913-9d3c-c5e686c3457b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:59.043988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-53f1329f-6f0b-4913-9d3c-c5e686c3457b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:59.044597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-53f1329f-6f0b-4913-9d3c-c5e686c3457b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:59.045170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-53f1329f-6f0b-4913-9d3c-c5e686c3457b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:59.045646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-53f1329f-6f0b-4913-9d3c-c5e686c3457b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:59.046109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-53f1329f-6f0b-4913-9d3c-c5e686c3457b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:59.215269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-53f1329f-6f0b-4913-9d3c-c5e686c3457b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:59.227397 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-53f1329f-6f0b-4913-9d3c-c5e686c3457b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1671 microversion: 2.1 time: 0.195332 Sep 06 11:37:59.228521 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3193/6333] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:59 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1671 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:37:59.525463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c55aebc9-b0b5-4961-ae02-c5502b63b3a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:37:59.526408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c55aebc9-b0b5-4961-ae02-c5502b63b3a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:37:59.533371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c55aebc9-b0b5-4961-ae02-c5502b63b3a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:59.533903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c55aebc9-b0b5-4961-ae02-c5502b63b3a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:59.534355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c55aebc9-b0b5-4961-ae02-c5502b63b3a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:59.535139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c55aebc9-b0b5-4961-ae02-c5502b63b3a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:59.535687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c55aebc9-b0b5-4961-ae02-c5502b63b3a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:59.536127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c55aebc9-b0b5-4961-ae02-c5502b63b3a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:59.636701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-6511af58-02ed-4ba5-88ab-3673298e064b req-292478d0-7a10-4a80-973e-1440a9ab4e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de03813-d081-447a-93d1-f867b29aa202", "tag": "585b317e-be84-47a5-8bce-042ab6614644"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:37:59.661145 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6511af58-02ed-4ba5-88ab-3673298e064b req-292478d0-7a10-4a80-973e-1440a9ab4e32 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:37:59.661656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6511af58-02ed-4ba5-88ab-3673298e064b req-292478d0-7a10-4a80-973e-1440a9ab4e32 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:37:59.673312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6511af58-02ed-4ba5-88ab-3673298e064b req-292478d0-7a10-4a80-973e-1440a9ab4e32 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:37:59.675871 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-6511af58-02ed-4ba5-88ab-3673298e064b req-292478d0-7a10-4a80-973e-1440a9ab4e32 service nova] Creating event network-changed:585b317e-be84-47a5-8bce-042ab6614644 for instance 0de03813-d081-447a-93d1-f867b29aa202 on nch2-master-1 Sep 06 11:37:59.682240 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-6511af58-02ed-4ba5-88ab-3673298e064b req-292478d0-7a10-4a80-973e-1440a9ab4e32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057090 Sep 06 11:37:59.686939 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3194/6334] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:37:59.698483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c55aebc9-b0b5-4961-ae02-c5502b63b3a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:37:59.709099 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c55aebc9-b0b5-4961-ae02-c5502b63b3a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1697 microversion: 2.1 time: 0.188145 Sep 06 11:37:59.709702 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3141/6335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:37:59 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:00.253478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b81688eb-b52a-450e-8804-716b1809cfe1 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:00.254138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b81688eb-b52a-450e-8804-716b1809cfe1 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:00.260597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b81688eb-b52a-450e-8804-716b1809cfe1 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:00.265688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b81688eb-b52a-450e-8804-716b1809cfe1 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:00.265688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b81688eb-b52a-450e-8804-716b1809cfe1 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:00.265688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b81688eb-b52a-450e-8804-716b1809cfe1 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:00.265688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b81688eb-b52a-450e-8804-716b1809cfe1 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:00.265688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b81688eb-b52a-450e-8804-716b1809cfe1 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:00.412580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b81688eb-b52a-450e-8804-716b1809cfe1 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:00.421099 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b81688eb-b52a-450e-8804-716b1809cfe1 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1671 microversion: 2.1 time: 0.172726 Sep 06 11:38:00.430361 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3195/6336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:00 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:00.734273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bdf6242f-24f6-4464-8787-988f0b374ffc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:00.735591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bdf6242f-24f6-4464-8787-988f0b374ffc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:00.745729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdf6242f-24f6-4464-8787-988f0b374ffc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:00.747121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdf6242f-24f6-4464-8787-988f0b374ffc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:00.747772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdf6242f-24f6-4464-8787-988f0b374ffc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:00.748913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdf6242f-24f6-4464-8787-988f0b374ffc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:00.749471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdf6242f-24f6-4464-8787-988f0b374ffc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:00.750069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdf6242f-24f6-4464-8787-988f0b374ffc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:00.756020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:00.929826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bdf6242f-24f6-4464-8787-988f0b374ffc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:00.938245 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bdf6242f-24f6-4464-8787-988f0b374ffc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1697 microversion: 2.1 time: 0.208564 Sep 06 11:38:00.947084 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3142/6337] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:00 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1697 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:01.444479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e2a82f03-12e1-4ea9-94e2-ab9de233fce4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:01.445106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e2a82f03-12e1-4ea9-94e2-ab9de233fce4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:01.452224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2a82f03-12e1-4ea9-94e2-ab9de233fce4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:01.452746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2a82f03-12e1-4ea9-94e2-ab9de233fce4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:01.453197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2a82f03-12e1-4ea9-94e2-ab9de233fce4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:01.453915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2a82f03-12e1-4ea9-94e2-ab9de233fce4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:01.454380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2a82f03-12e1-4ea9-94e2-ab9de233fce4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:01.454817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e2a82f03-12e1-4ea9-94e2-ab9de233fce4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:01.523813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e2a82f03-12e1-4ea9-94e2-ab9de233fce4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:01.532416 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e2a82f03-12e1-4ea9-94e2-ab9de233fce4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1603 microversion: 2.1 time: 0.092398 Sep 06 11:38:01.533022 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3196/6338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:01 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1603 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:01.697993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f0db83a5-6368-4b1e-abb4-d4a958681091 req-e39f18ca-d8a7-4aa1-b161-f34e8a26b8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de03813-d081-447a-93d1-f867b29aa202", "name": "network-vif-deleted", "tag": "585b317e-be84-47a5-8bce-042ab6614644"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:01.709587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f0db83a5-6368-4b1e-abb4-d4a958681091 req-e39f18ca-d8a7-4aa1-b161-f34e8a26b8f5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:01.710139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f0db83a5-6368-4b1e-abb4-d4a958681091 req-e39f18ca-d8a7-4aa1-b161-f34e8a26b8f5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:01.710637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f0db83a5-6368-4b1e-abb4-d4a958681091 req-e39f18ca-d8a7-4aa1-b161-f34e8a26b8f5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:01.723521 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f0db83a5-6368-4b1e-abb4-d4a958681091 req-e39f18ca-d8a7-4aa1-b161-f34e8a26b8f5 service nova] Creating event network-vif-deleted:585b317e-be84-47a5-8bce-042ab6614644 for instance 0de03813-d081-447a-93d1-f867b29aa202 on nch2-master-1 Sep 06 11:38:01.729863 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f0db83a5-6368-4b1e-abb4-d4a958681091 req-e39f18ca-d8a7-4aa1-b161-f34e8a26b8f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035303 Sep 06 11:38:01.730481 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3143/6339] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:38:01.964398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-508a0d14-8097-40de-9b48-b6ac59a6f776 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:01.965106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-508a0d14-8097-40de-9b48-b6ac59a6f776 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:01.971840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-508a0d14-8097-40de-9b48-b6ac59a6f776 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:01.973673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-508a0d14-8097-40de-9b48-b6ac59a6f776 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:01.973673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-508a0d14-8097-40de-9b48-b6ac59a6f776 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:01.973673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-508a0d14-8097-40de-9b48-b6ac59a6f776 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:01.974386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-508a0d14-8097-40de-9b48-b6ac59a6f776 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:01.974386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-508a0d14-8097-40de-9b48-b6ac59a6f776 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:02.123207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-508a0d14-8097-40de-9b48-b6ac59a6f776 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:02.131474 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-508a0d14-8097-40de-9b48-b6ac59a6f776 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1697 microversion: 2.1 time: 0.171216 Sep 06 11:38:02.132698 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3197/6340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:01 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:02.558250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:02.558959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:02.566089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:02.566576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:02.567034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:02.567735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:02.568198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:02.568844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:02.603033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:02.603526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:02.603976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:02.604437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lazy-loading 'fault' on Instance uuid 0de03813-d081-447a-93d1-f867b29aa202 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:38:02.646559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:02.655555 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a65f8048-c4e4-421e-89e5-a73e74ec1178 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 200 len: 1338 microversion: 2.1 time: 0.102730 Sep 06 11:38:02.657005 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3144/6341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:02 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:03.156924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3c69a4c4-0f0f-4ece-9765-7c00493c2b05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:03.157796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3c69a4c4-0f0f-4ece-9765-7c00493c2b05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:03.164578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c69a4c4-0f0f-4ece-9765-7c00493c2b05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:03.165077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c69a4c4-0f0f-4ece-9765-7c00493c2b05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:03.165531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c69a4c4-0f0f-4ece-9765-7c00493c2b05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:03.166254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c69a4c4-0f0f-4ece-9765-7c00493c2b05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:03.166727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c69a4c4-0f0f-4ece-9765-7c00493c2b05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:03.167219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3c69a4c4-0f0f-4ece-9765-7c00493c2b05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:03.316811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3c69a4c4-0f0f-4ece-9765-7c00493c2b05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:03.325501 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3c69a4c4-0f0f-4ece-9765-7c00493c2b05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1697 microversion: 2.1 time: 0.172770 Sep 06 11:38:03.326087 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3198/6342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:03 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:03.682724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e905a05-6bc6-4072-8d86-01b565df1f19 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:03.683508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3e905a05-6bc6-4072-8d86-01b565df1f19 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 0de03813-d081-447a-93d1-f867b29aa202] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:03.691535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e905a05-6bc6-4072-8d86-01b565df1f19 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:03.692028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e905a05-6bc6-4072-8d86-01b565df1f19 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:03.692474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e905a05-6bc6-4072-8d86-01b565df1f19 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:03.693184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e905a05-6bc6-4072-8d86-01b565df1f19 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:03.693678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e905a05-6bc6-4072-8d86-01b565df1f19 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:03.694111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e905a05-6bc6-4072-8d86-01b565df1f19 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:03.708132 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-3e905a05-6bc6-4072-8d86-01b565df1f19 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] HTTP exception thrown: Instance 0de03813-d081-447a-93d1-f867b29aa202 could not be found. Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e905a05-6bc6-4072-8d86-01b565df1f19 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Request method failure captured: Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 HTTP/1.1 Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzCh-VPlmUT_4_OVXtlT2bInKm9mEstqRIZTbFYTSSjBxARQNLQfO_wK7r3OKQBOYO2DbH6IBuG6RdJn9DFhS5-aAI2LYyipuTEvlriFomkTBG28jVAfMekgKXaGVveRfM3NEfa_uQWUfMSB7OD62OJGnK0PKMPXeJNDPmbaaUaULR0 Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: d3a7bd2f2a3d4318bc4445e9c4be13fb Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestNetworkBasicOps-865989598 Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d3a7bd2f2a3d4318bc4445e9c4be13fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3a7bd2f2a3d4318bc4445e9c4be13fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d3a7bd2f2a3d4318bc4445e9c4be13fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3a7bd2f2a3d4318bc4445e9c4be13fb"}]}] Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestNetworkBasicOps-865989598 Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: d3a7bd2f2a3d4318bc4445e9c4be13fb Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestNetworkBasicOps-865989598 Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestNetworkBasicOps-865989598-project Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: cde9fe6d32c54f008d430dc9d3ef6e47 Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestNetworkBasicOps-865989598-project Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 0de03813-d081-447a-93d1-f867b29aa202 could not be found. Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '0de03813-d081-447a-93d1-f867b29aa202'} Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de03813-d081-447a-93d1-f867b29aa202 could not be found. Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de03813-d081-447a-93d1-f867b29aa202 could not be found. Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:38:03.709806 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:38:03.714662 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:38:03.714662 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:38:03.714662 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:38:03.714662 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:38:03.714662 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:38:03.714662 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de03813-d081-447a-93d1-f867b29aa202 could not be found. Sep 06 11:38:03.714662 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:38:03.714662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e905a05-6bc6-4072-8d86-01b565df1f19 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Returning 404 to user: Instance 0de03813-d081-447a-93d1-f867b29aa202 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:38:03.714662 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3e905a05-6bc6-4072-8d86-01b565df1f19 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202" status: 404 len: 111 microversion: 2.1 time: 0.033062 Sep 06 11:38:03.714662 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3145/6343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:03 2022] GET /compute/v2.1/servers/0de03813-d081-447a-93d1-f867b29aa202 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:38:03.957402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3e4b1fe3-3fdc-4474-9d85-107bd36462e7 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '.version_select at 0x7f90f38bb550>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:04.069161 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3e4b1fe3-3fdc-4474-9d85-107bd36462e7 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2082753353" status: 202 len: 0 microversion: 2.1 time: 0.115541 Sep 06 11:38:04.070361 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3199/6344] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Sep 6 11:38:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2082753353 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:38:04.358121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-02ea8fc8-5a0c-4038-8705-96317e1b040e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:04.363407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-02ea8fc8-5a0c-4038-8705-96317e1b040e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:04.365696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02ea8fc8-5a0c-4038-8705-96317e1b040e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:04.366937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02ea8fc8-5a0c-4038-8705-96317e1b040e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:04.367673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02ea8fc8-5a0c-4038-8705-96317e1b040e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:04.368578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02ea8fc8-5a0c-4038-8705-96317e1b040e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:04.369184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02ea8fc8-5a0c-4038-8705-96317e1b040e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:04.369636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-02ea8fc8-5a0c-4038-8705-96317e1b040e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:04.516762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-02ea8fc8-5a0c-4038-8705-96317e1b040e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:04.525068 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-02ea8fc8-5a0c-4038-8705-96317e1b040e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1696 microversion: 2.1 time: 0.171199 Sep 06 11:38:04.525658 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3146/6345] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:04 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:05.235386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-1c214ba1-3f83-4a94-947e-87d630991628 req-d45b8745-3085-458c-b526-aaaa0fe83cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8d5548-d996-4b4a-b94d-28afae7c281b", "name": "network-vif-unplugged", "status": "completed", "tag": "11538fbe-5d0f-454a-8a16-e4c1137f2aed"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:05.247635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1c214ba1-3f83-4a94-947e-87d630991628 req-d45b8745-3085-458c-b526-aaaa0fe83cd7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:05.248934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1c214ba1-3f83-4a94-947e-87d630991628 req-d45b8745-3085-458c-b526-aaaa0fe83cd7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:05.248934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1c214ba1-3f83-4a94-947e-87d630991628 req-d45b8745-3085-458c-b526-aaaa0fe83cd7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:05.261708 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-1c214ba1-3f83-4a94-947e-87d630991628 req-d45b8745-3085-458c-b526-aaaa0fe83cd7 service nova] Creating event network-vif-unplugged:11538fbe-5d0f-454a-8a16-e4c1137f2aed for instance fa8d5548-d996-4b4a-b94d-28afae7c281b on nch2-master-1 Sep 06 11:38:05.270140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-1c214ba1-3f83-4a94-947e-87d630991628 req-d45b8745-3085-458c-b526-aaaa0fe83cd7 service nova] Instance fa8d5548-d996-4b4a-b94d-28afae7c281b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:38:05.290068 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-1c214ba1-3f83-4a94-947e-87d630991628 req-d45b8745-3085-458c-b526-aaaa0fe83cd7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060519 Sep 06 11:38:05.290692 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3200/6346] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:38:05.551659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff5d56f7-07ec-428b-b5f2-d028fb7a3461 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:05.552314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff5d56f7-07ec-428b-b5f2-d028fb7a3461 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:05.564968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff5d56f7-07ec-428b-b5f2-d028fb7a3461 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:05.565731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff5d56f7-07ec-428b-b5f2-d028fb7a3461 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:05.566372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff5d56f7-07ec-428b-b5f2-d028fb7a3461 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:05.567505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff5d56f7-07ec-428b-b5f2-d028fb7a3461 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:05.568146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff5d56f7-07ec-428b-b5f2-d028fb7a3461 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:05.568749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff5d56f7-07ec-428b-b5f2-d028fb7a3461 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:05.742849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ff5d56f7-07ec-428b-b5f2-d028fb7a3461 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:05.769927 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff5d56f7-07ec-428b-b5f2-d028fb7a3461 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1696 microversion: 2.1 time: 0.224575 Sep 06 11:38:05.783494 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3147/6347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:05 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1696 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:06.796540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-182bab7a-3668-4bca-847d-8b40e03399bc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:06.798230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-182bab7a-3668-4bca-847d-8b40e03399bc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:06.805750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-182bab7a-3668-4bca-847d-8b40e03399bc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:06.806469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-182bab7a-3668-4bca-847d-8b40e03399bc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:06.807032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-182bab7a-3668-4bca-847d-8b40e03399bc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:06.808352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-182bab7a-3668-4bca-847d-8b40e03399bc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:06.808935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-182bab7a-3668-4bca-847d-8b40e03399bc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:06.809474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-182bab7a-3668-4bca-847d-8b40e03399bc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:07.126045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-182bab7a-3668-4bca-847d-8b40e03399bc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:07.138229 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-182bab7a-3668-4bca-847d-8b40e03399bc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1696 microversion: 2.1 time: 0.347803 Sep 06 11:38:07.139503 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3201/6348] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:06 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1696 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:07.317843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a92750b5-bfe5-480a-8b1b-29aef102360c req-e7a143cf-69a5-44d1-ac33-0cb9b8a36f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa8d5548-d996-4b4a-b94d-28afae7c281b", "tag": "11538fbe-5d0f-454a-8a16-e4c1137f2aed"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:07.330950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a92750b5-bfe5-480a-8b1b-29aef102360c req-e7a143cf-69a5-44d1-ac33-0cb9b8a36f01 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:07.331852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a92750b5-bfe5-480a-8b1b-29aef102360c req-e7a143cf-69a5-44d1-ac33-0cb9b8a36f01 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:07.332548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a92750b5-bfe5-480a-8b1b-29aef102360c req-e7a143cf-69a5-44d1-ac33-0cb9b8a36f01 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:07.346007 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a92750b5-bfe5-480a-8b1b-29aef102360c req-e7a143cf-69a5-44d1-ac33-0cb9b8a36f01 service nova] Creating event network-changed:11538fbe-5d0f-454a-8a16-e4c1137f2aed for instance fa8d5548-d996-4b4a-b94d-28afae7c281b on nch2-master-1 Sep 06 11:38:07.352731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-a92750b5-bfe5-480a-8b1b-29aef102360c req-e7a143cf-69a5-44d1-ac33-0cb9b8a36f01 service nova] Instance fa8d5548-d996-4b4a-b94d-28afae7c281b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:38:07.367307 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a92750b5-bfe5-480a-8b1b-29aef102360c req-e7a143cf-69a5-44d1-ac33-0cb9b8a36f01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053125 Sep 06 11:38:07.370763 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3148/6349] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:38:08.163766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c13352f1-26db-47b0-af19-7b9ae16f8ca2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:08.164407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c13352f1-26db-47b0-af19-7b9ae16f8ca2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:08.184602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c13352f1-26db-47b0-af19-7b9ae16f8ca2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:08.184602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c13352f1-26db-47b0-af19-7b9ae16f8ca2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:08.184602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c13352f1-26db-47b0-af19-7b9ae16f8ca2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:08.184602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c13352f1-26db-47b0-af19-7b9ae16f8ca2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:08.184602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c13352f1-26db-47b0-af19-7b9ae16f8ca2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:08.184602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c13352f1-26db-47b0-af19-7b9ae16f8ca2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:08.481160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c13352f1-26db-47b0-af19-7b9ae16f8ca2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:08.490429 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c13352f1-26db-47b0-af19-7b9ae16f8ca2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1694 microversion: 2.1 time: 0.331975 Sep 06 11:38:08.491050 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3202/6350] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:08 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1694 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:09.516444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1a9a1be3-4b8d-4702-86b5-4a894c60230c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:09.517768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1a9a1be3-4b8d-4702-86b5-4a894c60230c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:09.525669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a9a1be3-4b8d-4702-86b5-4a894c60230c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:09.526165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a9a1be3-4b8d-4702-86b5-4a894c60230c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:09.526813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a9a1be3-4b8d-4702-86b5-4a894c60230c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:09.527581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a9a1be3-4b8d-4702-86b5-4a894c60230c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:09.528050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a9a1be3-4b8d-4702-86b5-4a894c60230c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:09.528490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1a9a1be3-4b8d-4702-86b5-4a894c60230c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:09.696874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1a9a1be3-4b8d-4702-86b5-4a894c60230c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:09.704930 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1a9a1be3-4b8d-4702-86b5-4a894c60230c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1691 microversion: 2.1 time: 0.193959 Sep 06 11:38:09.705521 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3149/6351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:09 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1691 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:09.728836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b28d7321-849c-491e-9c19-f0829ccbd654 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:09.729387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b28d7321-849c-491e-9c19-f0829ccbd654 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:09.736565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b28d7321-849c-491e-9c19-f0829ccbd654 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:09.737068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b28d7321-849c-491e-9c19-f0829ccbd654 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:09.737538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b28d7321-849c-491e-9c19-f0829ccbd654 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:09.738389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b28d7321-849c-491e-9c19-f0829ccbd654 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:09.738854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b28d7321-849c-491e-9c19-f0829ccbd654 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:09.739327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b28d7321-849c-491e-9c19-f0829ccbd654 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:10.305163 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b28d7321-849c-491e-9c19-f0829ccbd654 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b/action" status: 202 len: 0 microversion: 2.1 time: 0.580713 Sep 06 11:38:10.305911 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3203/6352] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:38:09 2022] POST /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:38:10.315834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-339d7c8d-5ee1-4b49-be9f-6a6eba0a4945 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:10.316686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-339d7c8d-5ee1-4b49-be9f-6a6eba0a4945 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:10.324373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-339d7c8d-5ee1-4b49-be9f-6a6eba0a4945 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:10.324875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-339d7c8d-5ee1-4b49-be9f-6a6eba0a4945 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:10.325345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-339d7c8d-5ee1-4b49-be9f-6a6eba0a4945 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:10.326085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-339d7c8d-5ee1-4b49-be9f-6a6eba0a4945 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:10.326605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-339d7c8d-5ee1-4b49-be9f-6a6eba0a4945 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:10.327861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-339d7c8d-5ee1-4b49-be9f-6a6eba0a4945 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:10.473094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-339d7c8d-5ee1-4b49-be9f-6a6eba0a4945 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:10.481888 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-339d7c8d-5ee1-4b49-be9f-6a6eba0a4945 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1690 microversion: 2.1 time: 0.171537 Sep 06 11:38:10.482715 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3150/6353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:10 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:11.238697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-ffc97103-e081-48ee-a201-15c2f7f1b7ea req-5e9e9c44-93bb-46ba-ba09-7089d1e5957d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8d5548-d996-4b4a-b94d-28afae7c281b", "name": "network-vif-plugged", "status": "completed", "tag": "11538fbe-5d0f-454a-8a16-e4c1137f2aed"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:11.250767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ffc97103-e081-48ee-a201-15c2f7f1b7ea req-5e9e9c44-93bb-46ba-ba09-7089d1e5957d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:11.251365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ffc97103-e081-48ee-a201-15c2f7f1b7ea req-5e9e9c44-93bb-46ba-ba09-7089d1e5957d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:11.251805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ffc97103-e081-48ee-a201-15c2f7f1b7ea req-5e9e9c44-93bb-46ba-ba09-7089d1e5957d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:11.264438 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-ffc97103-e081-48ee-a201-15c2f7f1b7ea req-5e9e9c44-93bb-46ba-ba09-7089d1e5957d service nova] Creating event network-vif-plugged:11538fbe-5d0f-454a-8a16-e4c1137f2aed for instance fa8d5548-d996-4b4a-b94d-28afae7c281b on nch2-master-1 Sep 06 11:38:11.270305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-ffc97103-e081-48ee-a201-15c2f7f1b7ea req-5e9e9c44-93bb-46ba-ba09-7089d1e5957d service nova] Instance fa8d5548-d996-4b4a-b94d-28afae7c281b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:38:11.284795 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-ffc97103-e081-48ee-a201-15c2f7f1b7ea req-5e9e9c44-93bb-46ba-ba09-7089d1e5957d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051950 Sep 06 11:38:11.285794 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3204/6354] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:38:11.506169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8c4d1ee9-e35b-45fb-807e-b4993fd97e0a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:11.507436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8c4d1ee9-e35b-45fb-807e-b4993fd97e0a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:11.514570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c4d1ee9-e35b-45fb-807e-b4993fd97e0a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:11.515236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c4d1ee9-e35b-45fb-807e-b4993fd97e0a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:11.515701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c4d1ee9-e35b-45fb-807e-b4993fd97e0a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:11.516440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c4d1ee9-e35b-45fb-807e-b4993fd97e0a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:11.516917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c4d1ee9-e35b-45fb-807e-b4993fd97e0a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:11.517366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8c4d1ee9-e35b-45fb-807e-b4993fd97e0a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:11.676974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8c4d1ee9-e35b-45fb-807e-b4993fd97e0a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:11.685644 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8c4d1ee9-e35b-45fb-807e-b4993fd97e0a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1690 microversion: 2.1 time: 0.183691 Sep 06 11:38:11.686228 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3151/6355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:11 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:12.720568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5592d864-67e1-48cd-a1c1-f4a2ae371082 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:12.721283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5592d864-67e1-48cd-a1c1-f4a2ae371082 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:12.730484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5592d864-67e1-48cd-a1c1-f4a2ae371082 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:12.731261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5592d864-67e1-48cd-a1c1-f4a2ae371082 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:12.731872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5592d864-67e1-48cd-a1c1-f4a2ae371082 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:12.732778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5592d864-67e1-48cd-a1c1-f4a2ae371082 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:12.733577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5592d864-67e1-48cd-a1c1-f4a2ae371082 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:12.734169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5592d864-67e1-48cd-a1c1-f4a2ae371082 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:12.914143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5592d864-67e1-48cd-a1c1-f4a2ae371082 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:12.923470 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5592d864-67e1-48cd-a1c1-f4a2ae371082 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1690 microversion: 2.1 time: 0.208728 Sep 06 11:38:12.935755 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3205/6356] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:12 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1690 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:13.947955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cb8b51cb-aeae-47bb-b754-55885bbc15ad tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:13.949305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cb8b51cb-aeae-47bb-b754-55885bbc15ad tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:13.956772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb8b51cb-aeae-47bb-b754-55885bbc15ad tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:13.957322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb8b51cb-aeae-47bb-b754-55885bbc15ad tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:13.957885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb8b51cb-aeae-47bb-b754-55885bbc15ad tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:13.958640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb8b51cb-aeae-47bb-b754-55885bbc15ad tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:13.959219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb8b51cb-aeae-47bb-b754-55885bbc15ad tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:13.960348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb8b51cb-aeae-47bb-b754-55885bbc15ad tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:14.205986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cb8b51cb-aeae-47bb-b754-55885bbc15ad tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:14.218777 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cb8b51cb-aeae-47bb-b754-55885bbc15ad tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1690 microversion: 2.1 time: 0.275147 Sep 06 11:38:14.229121 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3152/6357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:13 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1690 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:15.184344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-5d7a4a5d-0c8d-4e8d-90f1-15b48c002592 req-5c7ad4a0-586c-48cd-8d70-aa1fe8aed8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8d5548-d996-4b4a-b94d-28afae7c281b", "name": "network-vif-unplugged", "status": "completed", "tag": "11538fbe-5d0f-454a-8a16-e4c1137f2aed"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:15.205314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5d7a4a5d-0c8d-4e8d-90f1-15b48c002592 req-5c7ad4a0-586c-48cd-8d70-aa1fe8aed8fb service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:15.206260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5d7a4a5d-0c8d-4e8d-90f1-15b48c002592 req-5c7ad4a0-586c-48cd-8d70-aa1fe8aed8fb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:15.207268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5d7a4a5d-0c8d-4e8d-90f1-15b48c002592 req-5c7ad4a0-586c-48cd-8d70-aa1fe8aed8fb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:15.246356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-51faa347-05c2-4c91-a36f-d4d7caa5c3ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:15.248468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-51faa347-05c2-4c91-a36f-d4d7caa5c3ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:15.258722 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-5d7a4a5d-0c8d-4e8d-90f1-15b48c002592 req-5c7ad4a0-586c-48cd-8d70-aa1fe8aed8fb service nova] Creating event network-vif-unplugged:11538fbe-5d0f-454a-8a16-e4c1137f2aed for instance fa8d5548-d996-4b4a-b94d-28afae7c281b on nch1-master-1 Sep 06 11:38:15.259238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51faa347-05c2-4c91-a36f-d4d7caa5c3ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:15.260134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51faa347-05c2-4c91-a36f-d4d7caa5c3ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:15.260774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51faa347-05c2-4c91-a36f-d4d7caa5c3ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:15.261891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51faa347-05c2-4c91-a36f-d4d7caa5c3ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:15.262553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51faa347-05c2-4c91-a36f-d4d7caa5c3ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:15.263207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51faa347-05c2-4c91-a36f-d4d7caa5c3ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:15.282075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-5d7a4a5d-0c8d-4e8d-90f1-15b48c002592 req-5c7ad4a0-586c-48cd-8d70-aa1fe8aed8fb service nova] Instance fa8d5548-d996-4b4a-b94d-28afae7c281b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:38:15.310492 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-5d7a4a5d-0c8d-4e8d-90f1-15b48c002592 req-5c7ad4a0-586c-48cd-8d70-aa1fe8aed8fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130344 Sep 06 11:38:15.315240 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3206/6358] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:38:15.724077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-51faa347-05c2-4c91-a36f-d4d7caa5c3ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:15.734929 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-51faa347-05c2-4c91-a36f-d4d7caa5c3ca tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1690 microversion: 2.1 time: 0.493228 Sep 06 11:38:15.736238 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3153/6359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:15 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1690 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:16.763087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2ca98cc3-29d1-426c-984e-24398a48dcaa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:16.765778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2ca98cc3-29d1-426c-984e-24398a48dcaa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:16.774509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ca98cc3-29d1-426c-984e-24398a48dcaa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:16.775225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ca98cc3-29d1-426c-984e-24398a48dcaa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:16.775675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ca98cc3-29d1-426c-984e-24398a48dcaa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:16.776391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ca98cc3-29d1-426c-984e-24398a48dcaa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:16.777008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ca98cc3-29d1-426c-984e-24398a48dcaa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:16.777594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ca98cc3-29d1-426c-984e-24398a48dcaa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:17.147316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2ca98cc3-29d1-426c-984e-24398a48dcaa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:17.164598 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2ca98cc3-29d1-426c-984e-24398a48dcaa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1690 microversion: 2.1 time: 0.404511 Sep 06 11:38:17.181073 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3207/6360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:16 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1690 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:17.383931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-faaec30d-1eae-4f72-9b23-aa7b250e2d25 req-60ed0266-373a-4ca3-8bc5-328a3a113c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa8d5548-d996-4b4a-b94d-28afae7c281b", "tag": "11538fbe-5d0f-454a-8a16-e4c1137f2aed"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:17.411731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-faaec30d-1eae-4f72-9b23-aa7b250e2d25 req-60ed0266-373a-4ca3-8bc5-328a3a113c38 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:17.412546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-faaec30d-1eae-4f72-9b23-aa7b250e2d25 req-60ed0266-373a-4ca3-8bc5-328a3a113c38 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:17.413134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-faaec30d-1eae-4f72-9b23-aa7b250e2d25 req-60ed0266-373a-4ca3-8bc5-328a3a113c38 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:17.434879 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-faaec30d-1eae-4f72-9b23-aa7b250e2d25 req-60ed0266-373a-4ca3-8bc5-328a3a113c38 service nova] Creating event network-changed:11538fbe-5d0f-454a-8a16-e4c1137f2aed for instance fa8d5548-d996-4b4a-b94d-28afae7c281b on nch1-master-1 Sep 06 11:38:17.445319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-faaec30d-1eae-4f72-9b23-aa7b250e2d25 req-60ed0266-373a-4ca3-8bc5-328a3a113c38 service nova] Instance fa8d5548-d996-4b4a-b94d-28afae7c281b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:38:17.463991 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-faaec30d-1eae-4f72-9b23-aa7b250e2d25 req-60ed0266-373a-4ca3-8bc5-328a3a113c38 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082323 Sep 06 11:38:17.466817 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3154/6361] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:38:17.566513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-27cd0ac4-ae3a-4ed0-940a-40bf6095489c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Action: 'create', calling method: .version_select at 0x7f90f853c820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-725344460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhPxre0ru8KsLbjC/Er7IVVJrL8BXBJ+vcckViDcEDVsnoSDn1ctANzyCugzCJCmGgvG9HBTqSJusNWTFG2TQ5M6e6gNNMC/zVfe0yz+r45DJH/o2jPmnqnEFHpWu8kLQ=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:17.586038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-27cd0ac4-ae3a-4ed0-940a-40bf6095489c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Getting quotas for project d3a7bd2f2a3d4318bc4445e9c4be13fb. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:38:17.594466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-27cd0ac4-ae3a-4ed0-940a-40bf6095489c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Getting quotas for user cde9fe6d32c54f008d430dc9d3ef6e47 and project d3a7bd2f2a3d4318bc4445e9c4be13fb. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:38:17.700871 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-27cd0ac4-ae3a-4ed0-940a-40bf6095489c tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.140698 Sep 06 11:38:17.703047 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3208/6362] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:38:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:38:18.194416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-feffe412-80c4-4c2a-8d83-4ec378a59e69 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:18.196785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-feffe412-80c4-4c2a-8d83-4ec378a59e69 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:18.200440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:18.206441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-feffe412-80c4-4c2a-8d83-4ec378a59e69 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:18.207202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-feffe412-80c4-4c2a-8d83-4ec378a59e69 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:18.208534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-feffe412-80c4-4c2a-8d83-4ec378a59e69 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:18.210253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-feffe412-80c4-4c2a-8d83-4ec378a59e69 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:18.210739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-feffe412-80c4-4c2a-8d83-4ec378a59e69 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:18.211250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-feffe412-80c4-4c2a-8d83-4ec378a59e69 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:18.597903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-feffe412-80c4-4c2a-8d83-4ec378a59e69 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:18.625785 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-feffe412-80c4-4c2a-8d83-4ec378a59e69 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1690 microversion: 2.1 time: 0.440315 Sep 06 11:38:18.626403 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3155/6363] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:18 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1690 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:19.650541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-12cf8f79-e42d-4f5b-a348-ae88b9d97a9d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:19.651689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-12cf8f79-e42d-4f5b-a348-ae88b9d97a9d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:19.655371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:19.661111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12cf8f79-e42d-4f5b-a348-ae88b9d97a9d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:19.661611 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12cf8f79-e42d-4f5b-a348-ae88b9d97a9d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:19.662093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12cf8f79-e42d-4f5b-a348-ae88b9d97a9d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:19.663056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12cf8f79-e42d-4f5b-a348-ae88b9d97a9d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:19.663769 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12cf8f79-e42d-4f5b-a348-ae88b9d97a9d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:19.664322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12cf8f79-e42d-4f5b-a348-ae88b9d97a9d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:19.827460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-12cf8f79-e42d-4f5b-a348-ae88b9d97a9d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:19.837494 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-12cf8f79-e42d-4f5b-a348-ae88b9d97a9d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1683 microversion: 2.1 time: 0.192122 Sep 06 11:38:19.838592 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3209/6364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:19 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1683 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:38:20.454213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-fa04433a-1e5b-4d4b-87e2-eeddc6396f6e req-8fab6f32-92d9-4ba5-9798-1f3d911a2770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8d5548-d996-4b4a-b94d-28afae7c281b", "name": "network-vif-plugged", "status": "completed", "tag": "11538fbe-5d0f-454a-8a16-e4c1137f2aed"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:20.466714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fa04433a-1e5b-4d4b-87e2-eeddc6396f6e req-8fab6f32-92d9-4ba5-9798-1f3d911a2770 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:20.467787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fa04433a-1e5b-4d4b-87e2-eeddc6396f6e req-8fab6f32-92d9-4ba5-9798-1f3d911a2770 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:20.470685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fa04433a-1e5b-4d4b-87e2-eeddc6396f6e req-8fab6f32-92d9-4ba5-9798-1f3d911a2770 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:20.481631 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-fa04433a-1e5b-4d4b-87e2-eeddc6396f6e req-8fab6f32-92d9-4ba5-9798-1f3d911a2770 service nova] Creating event network-vif-plugged:11538fbe-5d0f-454a-8a16-e4c1137f2aed for instance fa8d5548-d996-4b4a-b94d-28afae7c281b on nch1-master-1 Sep 06 11:38:20.486563 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-fa04433a-1e5b-4d4b-87e2-eeddc6396f6e req-8fab6f32-92d9-4ba5-9798-1f3d911a2770 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037367 Sep 06 11:38:20.487204 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3156/6365] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:38:20.910246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-612269507", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "7aea377a-e4f3-48a4-a315-5085a3dbbd69"}], "key_name": "tempest-TestNetworkBasicOps-725344460", "security_groups": [{"name": "tempest-secgroup-smoke-1549316818"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:21.025547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] validate_networks() for [('7aea377a-e4f3-48a4-a315-5085a3dbbd69', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:38:21.434507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:38:21.434947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:38:21.435452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:38:21.435873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:38:21.436303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:38:21.446048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:21.446228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:21.446645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:21.447419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:21.447923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:21.448358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:21.467074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Getting quotas for project d3a7bd2f2a3d4318bc4445e9c4be13fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:38:21.479307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Getting quotas for user cde9fe6d32c54f008d430dc9d3ef6e47 and project d3a7bd2f2a3d4318bc4445e9c4be13fb. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:38:21.492272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:38:21.494633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:38:21.624323 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-30e91469-e896-4807-9352-e745d1587fe3 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.720178 Sep 06 11:38:21.625159 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3210/6366] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:38:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:38:21.638153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5a8b77ed-d4db-4178-8c1d-3983e108d4d0 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:21.639111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5a8b77ed-d4db-4178-8c1d-3983e108d4d0 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:21.695836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5a8b77ed-d4db-4178-8c1d-3983e108d4d0 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:21.704177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5a8b77ed-d4db-4178-8c1d-3983e108d4d0 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1247 microversion: 2.1 time: 0.071272 Sep 06 11:38:21.705021 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3157/6367] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:21 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1247 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:22.732730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1b26d427-6005-481b-891b-df3a925bad4a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:22.733345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1b26d427-6005-481b-891b-df3a925bad4a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:22.740489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b26d427-6005-481b-891b-df3a925bad4a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:22.740984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b26d427-6005-481b-891b-df3a925bad4a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:22.741435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b26d427-6005-481b-891b-df3a925bad4a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:22.742147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b26d427-6005-481b-891b-df3a925bad4a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:22.743231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b26d427-6005-481b-891b-df3a925bad4a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:22.743676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1b26d427-6005-481b-891b-df3a925bad4a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:22.808166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1b26d427-6005-481b-891b-df3a925bad4a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:22.810384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:22.816925 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1b26d427-6005-481b-891b-df3a925bad4a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1251 microversion: 2.1 time: 0.089810 Sep 06 11:38:22.822976 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3211/6368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:22 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1251 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:23.840980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-81816352-5565-4117-8509-8b10cdce7258 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:23.841611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-81816352-5565-4117-8509-8b10cdce7258 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:23.850419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81816352-5565-4117-8509-8b10cdce7258 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:23.852554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81816352-5565-4117-8509-8b10cdce7258 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:23.852554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81816352-5565-4117-8509-8b10cdce7258 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:23.852774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81816352-5565-4117-8509-8b10cdce7258 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:23.853219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81816352-5565-4117-8509-8b10cdce7258 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:23.853651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81816352-5565-4117-8509-8b10cdce7258 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:23.921126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-81816352-5565-4117-8509-8b10cdce7258 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:23.929108 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-81816352-5565-4117-8509-8b10cdce7258 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1299 microversion: 2.1 time: 0.092055 Sep 06 11:38:23.935753 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3158/6369] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:23 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:24.959207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0fc97d06-eea6-4cbb-86bf-c71892663017 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:24.959207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0fc97d06-eea6-4cbb-86bf-c71892663017 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:24.963766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fc97d06-eea6-4cbb-86bf-c71892663017 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:24.964274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fc97d06-eea6-4cbb-86bf-c71892663017 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:24.964726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fc97d06-eea6-4cbb-86bf-c71892663017 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:24.965459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fc97d06-eea6-4cbb-86bf-c71892663017 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:24.965959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fc97d06-eea6-4cbb-86bf-c71892663017 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:24.966577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fc97d06-eea6-4cbb-86bf-c71892663017 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:25.135927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0fc97d06-eea6-4cbb-86bf-c71892663017 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:25.144119 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0fc97d06-eea6-4cbb-86bf-c71892663017 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1373 microversion: 2.1 time: 0.195232 Sep 06 11:38:25.144711 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3212/6370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:24 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1373 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:26.174280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-74b00f1b-959d-4c8e-b063-e888cf25e70f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:26.174910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-74b00f1b-959d-4c8e-b063-e888cf25e70f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:26.184190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74b00f1b-959d-4c8e-b063-e888cf25e70f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:26.184689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74b00f1b-959d-4c8e-b063-e888cf25e70f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:26.187498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74b00f1b-959d-4c8e-b063-e888cf25e70f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:26.187498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74b00f1b-959d-4c8e-b063-e888cf25e70f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:26.187498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74b00f1b-959d-4c8e-b063-e888cf25e70f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:26.187498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74b00f1b-959d-4c8e-b063-e888cf25e70f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:26.213282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-c5335840-d7f0-473c-84aa-fa4cb89b606e req-ce3ac164-0d37-4df4-a096-56dde1724698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c9dfc9-42e5-4247-905a-b97a8c133472", "tag": "a0e34e0f-8c12-4398-9a72-351a20acfbfb"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:26.223903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c5335840-d7f0-473c-84aa-fa4cb89b606e req-ce3ac164-0d37-4df4-a096-56dde1724698 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:26.224394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c5335840-d7f0-473c-84aa-fa4cb89b606e req-ce3ac164-0d37-4df4-a096-56dde1724698 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:26.224880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c5335840-d7f0-473c-84aa-fa4cb89b606e req-ce3ac164-0d37-4df4-a096-56dde1724698 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:26.236869 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-c5335840-d7f0-473c-84aa-fa4cb89b606e req-ce3ac164-0d37-4df4-a096-56dde1724698 service nova] Creating event network-changed:a0e34e0f-8c12-4398-9a72-351a20acfbfb for instance 92c9dfc9-42e5-4247-905a-b97a8c133472 on nch2-master-1 Sep 06 11:38:26.243976 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-c5335840-d7f0-473c-84aa-fa4cb89b606e req-ce3ac164-0d37-4df4-a096-56dde1724698 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119708 Sep 06 11:38:26.244818 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3159/6371] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:38:26.337757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-74b00f1b-959d-4c8e-b063-e888cf25e70f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:26.345514 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-74b00f1b-959d-4c8e-b063-e888cf25e70f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1373 microversion: 2.1 time: 0.179414 Sep 06 11:38:26.346105 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3213/6372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:26 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:38:27.369180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-83321420-33b7-45bf-a374-7661f50b7572 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:27.369896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-83321420-33b7-45bf-a374-7661f50b7572 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:27.377015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83321420-33b7-45bf-a374-7661f50b7572 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:27.378390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83321420-33b7-45bf-a374-7661f50b7572 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:27.378390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83321420-33b7-45bf-a374-7661f50b7572 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:27.378718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83321420-33b7-45bf-a374-7661f50b7572 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:27.379227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83321420-33b7-45bf-a374-7661f50b7572 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:27.379668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83321420-33b7-45bf-a374-7661f50b7572 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:27.515690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-83321420-33b7-45bf-a374-7661f50b7572 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:27.523538 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-83321420-33b7-45bf-a374-7661f50b7572 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1373 microversion: 2.1 time: 0.159342 Sep 06 11:38:27.524201 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3160/6373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:27 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:28.547367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0fb217ac-18bb-440f-a544-0c9a86c4436a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:28.548021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0fb217ac-18bb-440f-a544-0c9a86c4436a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:28.555959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fb217ac-18bb-440f-a544-0c9a86c4436a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:28.556404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fb217ac-18bb-440f-a544-0c9a86c4436a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:28.556841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fb217ac-18bb-440f-a544-0c9a86c4436a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:28.557561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fb217ac-18bb-440f-a544-0c9a86c4436a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:28.558160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fb217ac-18bb-440f-a544-0c9a86c4436a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:28.558627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0fb217ac-18bb-440f-a544-0c9a86c4436a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:28.694890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0fb217ac-18bb-440f-a544-0c9a86c4436a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:28.703919 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0fb217ac-18bb-440f-a544-0c9a86c4436a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1373 microversion: 2.1 time: 0.160426 Sep 06 11:38:28.704524 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3214/6374] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:28 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:29.727804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-17b91ea7-0da2-4cec-96da-1f010e4b4f78 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:29.728429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-17b91ea7-0da2-4cec-96da-1f010e4b4f78 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:29.735582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17b91ea7-0da2-4cec-96da-1f010e4b4f78 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:29.736082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17b91ea7-0da2-4cec-96da-1f010e4b4f78 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:29.736534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17b91ea7-0da2-4cec-96da-1f010e4b4f78 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:29.737272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17b91ea7-0da2-4cec-96da-1f010e4b4f78 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:29.737740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17b91ea7-0da2-4cec-96da-1f010e4b4f78 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:29.738178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17b91ea7-0da2-4cec-96da-1f010e4b4f78 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:29.885765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-17b91ea7-0da2-4cec-96da-1f010e4b4f78 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:29.893965 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-17b91ea7-0da2-4cec-96da-1f010e4b4f78 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1373 microversion: 2.1 time: 0.170647 Sep 06 11:38:29.894491 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3161/6375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:29 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:30.917892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e7281fc5-0a92-494a-aa6c-ff868b37d6c4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:30.918511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e7281fc5-0a92-494a-aa6c-ff868b37d6c4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:30.926120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7281fc5-0a92-494a-aa6c-ff868b37d6c4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:30.930316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7281fc5-0a92-494a-aa6c-ff868b37d6c4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:30.930316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7281fc5-0a92-494a-aa6c-ff868b37d6c4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:30.930316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7281fc5-0a92-494a-aa6c-ff868b37d6c4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:30.930316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7281fc5-0a92-494a-aa6c-ff868b37d6c4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:30.930316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7281fc5-0a92-494a-aa6c-ff868b37d6c4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:31.065578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e7281fc5-0a92-494a-aa6c-ff868b37d6c4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:31.073664 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e7281fc5-0a92-494a-aa6c-ff868b37d6c4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1373 microversion: 2.1 time: 0.159702 Sep 06 11:38:31.074246 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3215/6376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:30 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:32.097175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-34dd8377-316c-423e-a1fc-d6f861bc0af8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:32.097784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-34dd8377-316c-423e-a1fc-d6f861bc0af8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:32.100614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:32.106343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34dd8377-316c-423e-a1fc-d6f861bc0af8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:32.110787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34dd8377-316c-423e-a1fc-d6f861bc0af8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:32.110787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34dd8377-316c-423e-a1fc-d6f861bc0af8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:32.110787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34dd8377-316c-423e-a1fc-d6f861bc0af8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:32.110787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34dd8377-316c-423e-a1fc-d6f861bc0af8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:32.110787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34dd8377-316c-423e-a1fc-d6f861bc0af8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:32.242433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-34dd8377-316c-423e-a1fc-d6f861bc0af8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:32.245940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:32.250561 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-34dd8377-316c-423e-a1fc-d6f861bc0af8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1373 microversion: 2.1 time: 0.157364 Sep 06 11:38:32.251163 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3162/6377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:32 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:33.254259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:33.255101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=10 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:33.273363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-25d82ac4-a878-47fe-a9bd-a5aa48fe13c7 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:33.274090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-25d82ac4-a878-47fe-a9bd-a5aa48fe13c7 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:33.282099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25d82ac4-a878-47fe-a9bd-a5aa48fe13c7 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:33.282607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25d82ac4-a878-47fe-a9bd-a5aa48fe13c7 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:33.283087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25d82ac4-a878-47fe-a9bd-a5aa48fe13c7 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:33.283810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25d82ac4-a878-47fe-a9bd-a5aa48fe13c7 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:33.284287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25d82ac4-a878-47fe-a9bd-a5aa48fe13c7 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:33.284766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25d82ac4-a878-47fe-a9bd-a5aa48fe13c7 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:33.323107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-db23b34e-8fab-4f4f-a6c7-ca4f21b1aac3 req-e30db21a-0382-467e-8098-ab634feec4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c9dfc9-42e5-4247-905a-b97a8c133472", "name": "network-vif-plugged", "status": "completed", "tag": "a0e34e0f-8c12-4398-9a72-351a20acfbfb"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:33.334862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-db23b34e-8fab-4f4f-a6c7-ca4f21b1aac3 req-e30db21a-0382-467e-8098-ab634feec4be service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:33.335389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-db23b34e-8fab-4f4f-a6c7-ca4f21b1aac3 req-e30db21a-0382-467e-8098-ab634feec4be service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:33.335862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-db23b34e-8fab-4f4f-a6c7-ca4f21b1aac3 req-e30db21a-0382-467e-8098-ab634feec4be service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:33.348578 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-db23b34e-8fab-4f4f-a6c7-ca4f21b1aac3 req-e30db21a-0382-467e-8098-ab634feec4be service nova] Creating event network-vif-plugged:a0e34e0f-8c12-4398-9a72-351a20acfbfb for instance 92c9dfc9-42e5-4247-905a-b97a8c133472 on nch2-master-1 Sep 06 11:38:33.354391 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-db23b34e-8fab-4f4f-a6c7-ca4f21b1aac3 req-e30db21a-0382-467e-8098-ab634feec4be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104647 Sep 06 11:38:33.355038 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3216/6378] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:38:33.457158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-25d82ac4-a878-47fe-a9bd-a5aa48fe13c7 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:33.467287 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-25d82ac4-a878-47fe-a9bd-a5aa48fe13c7 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1373 microversion: 2.1 time: 0.197505 Sep 06 11:38:33.468807 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3163/6379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:33 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1373 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:38:34.491504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e985191-0c2c-4f1e-b1c1-66c24f335032 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:34.492277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5e985191-0c2c-4f1e-b1c1-66c24f335032 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:34.498621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e985191-0c2c-4f1e-b1c1-66c24f335032 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:34.499147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e985191-0c2c-4f1e-b1c1-66c24f335032 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:34.499606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e985191-0c2c-4f1e-b1c1-66c24f335032 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:34.500326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e985191-0c2c-4f1e-b1c1-66c24f335032 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:34.500794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e985191-0c2c-4f1e-b1c1-66c24f335032 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:34.501232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e985191-0c2c-4f1e-b1c1-66c24f335032 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:34.649101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5e985191-0c2c-4f1e-b1c1-66c24f335032 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:34.658834 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5e985191-0c2c-4f1e-b1c1-66c24f335032 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1373 microversion: 2.1 time: 0.172666 Sep 06 11:38:34.659454 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3217/6380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:34 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:38:35.683206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c7c4579-73e6-4913-8b19-fcdecb147c04 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:35.684475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c7c4579-73e6-4913-8b19-fcdecb147c04 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:35.691519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c7c4579-73e6-4913-8b19-fcdecb147c04 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:35.692016 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c7c4579-73e6-4913-8b19-fcdecb147c04 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:35.692468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c7c4579-73e6-4913-8b19-fcdecb147c04 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:35.693176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c7c4579-73e6-4913-8b19-fcdecb147c04 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:35.693644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c7c4579-73e6-4913-8b19-fcdecb147c04 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:35.694088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c7c4579-73e6-4913-8b19-fcdecb147c04 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:35.838526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2c7c4579-73e6-4913-8b19-fcdecb147c04 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:35.846627 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c7c4579-73e6-4913-8b19-fcdecb147c04 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1545 microversion: 2.1 time: 0.167450 Sep 06 11:38:35.847301 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3164/6381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:35 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1545 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:35.872014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b6561399-7281-4bf1-aba2-c0b9332ffb9a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:35.872572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b6561399-7281-4bf1-aba2-c0b9332ffb9a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:35.880378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6561399-7281-4bf1-aba2-c0b9332ffb9a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:35.880880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6561399-7281-4bf1-aba2-c0b9332ffb9a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:35.881332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6561399-7281-4bf1-aba2-c0b9332ffb9a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:35.882379 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6561399-7281-4bf1-aba2-c0b9332ffb9a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:35.883363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6561399-7281-4bf1-aba2-c0b9332ffb9a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:35.883992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b6561399-7281-4bf1-aba2-c0b9332ffb9a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:36.024993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b6561399-7281-4bf1-aba2-c0b9332ffb9a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:36.033129 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b6561399-7281-4bf1-aba2-c0b9332ffb9a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1545 microversion: 2.1 time: 0.165191 Sep 06 11:38:36.033807 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3218/6382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:35 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1545 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:38.527975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9382bee9-0121-4456-891b-ff7419934c6c req-58648be3-33e7-42b2-bc36-2359e640fa1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c9dfc9-42e5-4247-905a-b97a8c133472", "tag": "a0e34e0f-8c12-4398-9a72-351a20acfbfb"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:38.538153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9382bee9-0121-4456-891b-ff7419934c6c req-58648be3-33e7-42b2-bc36-2359e640fa1e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:38.539292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9382bee9-0121-4456-891b-ff7419934c6c req-58648be3-33e7-42b2-bc36-2359e640fa1e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:38.539932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9382bee9-0121-4456-891b-ff7419934c6c req-58648be3-33e7-42b2-bc36-2359e640fa1e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:38.551566 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9382bee9-0121-4456-891b-ff7419934c6c req-58648be3-33e7-42b2-bc36-2359e640fa1e service nova] Creating event network-changed:a0e34e0f-8c12-4398-9a72-351a20acfbfb for instance 92c9dfc9-42e5-4247-905a-b97a8c133472 on nch2-master-1 Sep 06 11:38:38.557712 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9382bee9-0121-4456-891b-ff7419934c6c req-58648be3-33e7-42b2-bc36-2359e640fa1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108955 Sep 06 11:38:38.558321 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3165/6383] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:38:44.052952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-64216572-ff38-404b-9a71-881dcce5d1c4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:44.055310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-64216572-ff38-404b-9a71-881dcce5d1c4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:44.063639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64216572-ff38-404b-9a71-881dcce5d1c4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:44.064137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64216572-ff38-404b-9a71-881dcce5d1c4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:44.064596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64216572-ff38-404b-9a71-881dcce5d1c4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:44.065312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64216572-ff38-404b-9a71-881dcce5d1c4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:44.065803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64216572-ff38-404b-9a71-881dcce5d1c4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:44.066242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64216572-ff38-404b-9a71-881dcce5d1c4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:44.129443 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-64216572-ff38-404b-9a71-881dcce5d1c4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b/action" status: 200 len: 63228 microversion: 2.1 time: 0.080280 Sep 06 11:38:44.130170 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3219/6384] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:38:44 2022] POST /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b/action => generated 63228 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:38:50.588012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=23 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:50.588912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=14 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:50.592921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d66de890-8cc5-4cc7-8869-6117f6886f4f tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:50.593659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d66de890-8cc5-4cc7-8869-6117f6886f4f tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:50.599702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d66de890-8cc5-4cc7-8869-6117f6886f4f tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:50.600188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d66de890-8cc5-4cc7-8869-6117f6886f4f tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:50.600633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d66de890-8cc5-4cc7-8869-6117f6886f4f tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:50.601362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d66de890-8cc5-4cc7-8869-6117f6886f4f tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:50.601818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d66de890-8cc5-4cc7-8869-6117f6886f4f tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:50.602248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d66de890-8cc5-4cc7-8869-6117f6886f4f tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:50.739803 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d66de890-8cc5-4cc7-8869-6117f6886f4f tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1834 microversion: 2.1 time: 0.153951 Sep 06 11:38:50.743699 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3166/6385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:50 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1834 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:51.837808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-003a1e73-00cf-414d-b59e-74c48a288b53 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:51.838548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-003a1e73-00cf-414d-b59e-74c48a288b53 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:51.840356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-2c5fd873-7662-4f0c-9d00-323ab74c57ab req-36c544a7-39c4-4c8d-9e2a-a8fcbe18242b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa8d5548-d996-4b4a-b94d-28afae7c281b", "tag": "11538fbe-5d0f-454a-8a16-e4c1137f2aed"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:51.841571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:51.846798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-003a1e73-00cf-414d-b59e-74c48a288b53 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:51.847324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-003a1e73-00cf-414d-b59e-74c48a288b53 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:51.848002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-003a1e73-00cf-414d-b59e-74c48a288b53 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:51.848826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-003a1e73-00cf-414d-b59e-74c48a288b53 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:51.849294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-003a1e73-00cf-414d-b59e-74c48a288b53 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:51.849738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-003a1e73-00cf-414d-b59e-74c48a288b53 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:51.855896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2c5fd873-7662-4f0c-9d00-323ab74c57ab req-36c544a7-39c4-4c8d-9e2a-a8fcbe18242b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:51.856676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2c5fd873-7662-4f0c-9d00-323ab74c57ab req-36c544a7-39c4-4c8d-9e2a-a8fcbe18242b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:51.857439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2c5fd873-7662-4f0c-9d00-323ab74c57ab req-36c544a7-39c4-4c8d-9e2a-a8fcbe18242b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:51.872193 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-2c5fd873-7662-4f0c-9d00-323ab74c57ab req-36c544a7-39c4-4c8d-9e2a-a8fcbe18242b service nova] Creating event network-changed:11538fbe-5d0f-454a-8a16-e4c1137f2aed for instance fa8d5548-d996-4b4a-b94d-28afae7c281b on nch1-master-1 Sep 06 11:38:51.878449 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-2c5fd873-7662-4f0c-9d00-323ab74c57ab req-36c544a7-39c4-4c8d-9e2a-a8fcbe18242b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042573 Sep 06 11:38:51.879955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-003a1e73-00cf-414d-b59e-74c48a288b53 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:38:51.880651 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3167/6386] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:38:52.333798 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-003a1e73-00cf-414d-b59e-74c48a288b53 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 204 len: 0 microversion: 2.1 time: 0.500095 Sep 06 11:38:52.340112 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3220/6387] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:38:51 2022] DELETE /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:38:52.345269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2f4f9626-3bce-4055-9d01-ee0c76aab8de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:52.346159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2f4f9626-3bce-4055-9d01-ee0c76aab8de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:52.357164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f4f9626-3bce-4055-9d01-ee0c76aab8de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:52.357806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f4f9626-3bce-4055-9d01-ee0c76aab8de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:52.358546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f4f9626-3bce-4055-9d01-ee0c76aab8de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:52.359670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f4f9626-3bce-4055-9d01-ee0c76aab8de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:52.360284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f4f9626-3bce-4055-9d01-ee0c76aab8de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:52.360921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2f4f9626-3bce-4055-9d01-ee0c76aab8de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:52.608581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2f4f9626-3bce-4055-9d01-ee0c76aab8de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:52.616983 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2f4f9626-3bce-4055-9d01-ee0c76aab8de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1689 microversion: 2.1 time: 0.276678 Sep 06 11:38:52.618190 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3168/6388] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:52 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1689 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:53.645077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-56204df9-6f33-4d11-b3a2-4dd8fce7bb4a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:53.646688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-56204df9-6f33-4d11-b3a2-4dd8fce7bb4a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:53.656742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56204df9-6f33-4d11-b3a2-4dd8fce7bb4a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:53.657598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56204df9-6f33-4d11-b3a2-4dd8fce7bb4a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:53.658230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56204df9-6f33-4d11-b3a2-4dd8fce7bb4a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:53.659451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56204df9-6f33-4d11-b3a2-4dd8fce7bb4a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:53.660235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56204df9-6f33-4d11-b3a2-4dd8fce7bb4a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:53.660747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-56204df9-6f33-4d11-b3a2-4dd8fce7bb4a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:53.940146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-56204df9-6f33-4d11-b3a2-4dd8fce7bb4a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:53.946342 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-56204df9-6f33-4d11-b3a2-4dd8fce7bb4a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1570 microversion: 2.1 time: 0.308168 Sep 06 11:38:53.946936 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3221/6389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:53 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1570 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:54.580992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-921db06e-194a-4d87-b2a6-9c021c10ea33 req-c4710af9-9b08-4e38-8ee5-7e008415d69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8d5548-d996-4b4a-b94d-28afae7c281b", "name": "network-vif-deleted", "tag": "11538fbe-5d0f-454a-8a16-e4c1137f2aed"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:54.603414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-921db06e-194a-4d87-b2a6-9c021c10ea33 req-c4710af9-9b08-4e38-8ee5-7e008415d69c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:54.603741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-921db06e-194a-4d87-b2a6-9c021c10ea33 req-c4710af9-9b08-4e38-8ee5-7e008415d69c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:54.604395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-921db06e-194a-4d87-b2a6-9c021c10ea33 req-c4710af9-9b08-4e38-8ee5-7e008415d69c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:54.630173 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-921db06e-194a-4d87-b2a6-9c021c10ea33 req-c4710af9-9b08-4e38-8ee5-7e008415d69c service nova] Creating event network-vif-deleted:11538fbe-5d0f-454a-8a16-e4c1137f2aed for instance fa8d5548-d996-4b4a-b94d-28afae7c281b on nch1-master-1 Sep 06 11:38:54.638698 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-921db06e-194a-4d87-b2a6-9c021c10ea33 req-c4710af9-9b08-4e38-8ee5-7e008415d69c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060972 Sep 06 11:38:54.644455 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3169/6390] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:38:54.969798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:54.983944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:54.999694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:55.003567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:55.006952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:55.008056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:55.008704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:55.009325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:55.076332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:55.077120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:55.077973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:55.078678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lazy-loading 'fault' on Instance uuid fa8d5548-d996-4b4a-b94d-28afae7c281b {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:38:55.157331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:38:55.159990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:55.169521 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-649e4a47-a3a2-4fcc-8e96-1db33678e562 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 200 len: 1355 microversion: 2.1 time: 0.202529 Sep 06 11:38:55.175522 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3222/6391] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:54 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 1355 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:38:56.197093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-506468de-4672-4173-b1fb-43d98c47e911 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:38:56.198235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-506468de-4672-4173-b1fb-43d98c47e911 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: fa8d5548-d996-4b4a-b94d-28afae7c281b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:56.204857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-506468de-4672-4173-b1fb-43d98c47e911 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:56.205357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-506468de-4672-4173-b1fb-43d98c47e911 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:56.206048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-506468de-4672-4173-b1fb-43d98c47e911 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:56.206973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-506468de-4672-4173-b1fb-43d98c47e911 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:56.207491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-506468de-4672-4173-b1fb-43d98c47e911 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:56.207933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-506468de-4672-4173-b1fb-43d98c47e911 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:56.235714 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-506468de-4672-4173-b1fb-43d98c47e911 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] HTTP exception thrown: Instance fa8d5548-d996-4b4a-b94d-28afae7c281b could not be found. Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-506468de-4672-4173-b1fb-43d98c47e911 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Request method failure captured: Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b HTTP/1.1 Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzBX9CuU5UzfyxndnVZJJmTYQ3vK0GMlL8LNZgpJ5tksaXSMavHz_rJbRFm6T87lgBe9pS926ALKmRt8aQ4iI83LdY1vm2a5H52JafVqkAEM9TtY6-ItP-NrdpPjrmU2smFwTA5uczMzMisnvP5xPvXyFn1yLnZV5ywo_B1CSGR_HGg Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aa117f0cf74342a3b24c0c247565a6c7 Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-993249934 Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa117f0cf74342a3b24c0c247565a6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa117f0cf74342a3b24c0c247565a6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa117f0cf74342a3b24c0c247565a6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa117f0cf74342a3b24c0c247565a6c7"}]}] Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestNetworkAdvancedServerOps-993249934 Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aa117f0cf74342a3b24c0c247565a6c7 Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-993249934 Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestNetworkAdvancedServerOps-993249934-project Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: fcaddf25fc12498b90d2cc1ec08e5da3 Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestNetworkAdvancedServerOps-993249934-project Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance fa8d5548-d996-4b4a-b94d-28afae7c281b could not be found. Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'fa8d5548-d996-4b4a-b94d-28afae7c281b'} Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa8d5548-d996-4b4a-b94d-28afae7c281b could not be found. Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa8d5548-d996-4b4a-b94d-28afae7c281b could not be found. Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:38:56.238947 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:38:56.256067 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:38:56.256067 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:38:56.256067 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:38:56.256067 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:38:56.256067 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:38:56.256067 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:38:56.256067 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa8d5548-d996-4b4a-b94d-28afae7c281b could not be found. Sep 06 11:38:56.256067 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:38:56.256067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-506468de-4672-4173-b1fb-43d98c47e911 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Returning 404 to user: Instance fa8d5548-d996-4b4a-b94d-28afae7c281b could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:38:56.256067 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-506468de-4672-4173-b1fb-43d98c47e911 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b" status: 404 len: 111 microversion: 2.1 time: 0.053245 Sep 06 11:38:56.256067 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3170/6392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:38:56 2022] GET /compute/v2.1/servers/fa8d5548-d996-4b4a-b94d-28afae7c281b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:38:59.689283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f8a2547-add9-4c71-aefe-c68a22509c37 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:38:59.691780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4f8a2547-add9-4c71-aefe-c68a22509c37 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:38:59.700187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f8a2547-add9-4c71-aefe-c68a22509c37 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:59.700785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f8a2547-add9-4c71-aefe-c68a22509c37 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:59.701480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f8a2547-add9-4c71-aefe-c68a22509c37 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:59.702423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f8a2547-add9-4c71-aefe-c68a22509c37 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:38:59.703133 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f8a2547-add9-4c71-aefe-c68a22509c37 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:38:59.703798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f8a2547-add9-4c71-aefe-c68a22509c37 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:38:59.851133 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4f8a2547-add9-4c71-aefe-c68a22509c37 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "POST /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472/action" status: 200 len: 24568 microversion: 2.1 time: 0.166818 Sep 06 11:38:59.852146 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3223/6393] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:38:59 2022] POST /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472/action => generated 24568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:39:00.896951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2eb91fbd-09a1-4408-9541-c67029c5904e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '.version_select at 0x7f90f3136f70>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:01.007471 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2eb91fbd-09a1-4408-9541-c67029c5904e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-598579607" status: 202 len: 0 microversion: 2.1 time: 0.114379 Sep 06 11:39:01.008313 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3171/6394] 10.222.0.20 () {58 vars in 1281 bytes} [Tue Sep 6 11:39:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-598579607 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:39:01.052256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6212198d-41b1-4b51-ac5e-b9df680375a8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'create', calling method: .version_select at 0x7f90f870dca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-72705516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4qK4X+zZDJMk2Hah1HZ1hhMGV5D4qhnTWRu3yf6ZZnhozz0BP5lI3qJfWQEZ7jA5JoGUZYyZ2QmnUFPLIiZgE1/Zu99/Bw5RxAo7aKIZb0pbfasPQ1dFIuG6WxJl793A=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:01.093603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-6212198d-41b1-4b51-ac5e-b9df680375a8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:39:01.140494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-6212198d-41b1-4b51-ac5e-b9df680375a8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for user fcaddf25fc12498b90d2cc1ec08e5da3 and project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:39:01.256811 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6212198d-41b1-4b51-ac5e-b9df680375a8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.208789 Sep 06 11:39:01.259335 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3224/6395] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:39:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:39:06.391562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=18 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:06.399138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b9c35604-304b-48ea-9d7d-48b8387c6ec8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:06.402543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b9c35604-304b-48ea-9d7d-48b8387c6ec8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:06.410862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9c35604-304b-48ea-9d7d-48b8387c6ec8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:06.411545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9c35604-304b-48ea-9d7d-48b8387c6ec8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:06.423634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9c35604-304b-48ea-9d7d-48b8387c6ec8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:06.423634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9c35604-304b-48ea-9d7d-48b8387c6ec8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:06.423634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9c35604-304b-48ea-9d7d-48b8387c6ec8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:06.423634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9c35604-304b-48ea-9d7d-48b8387c6ec8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:06.499653 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b9c35604-304b-48ea-9d7d-48b8387c6ec8 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "POST /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472/action" status: 200 len: 32638 microversion: 2.1 time: 0.109688 Sep 06 11:39:06.501928 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3172/6396] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:39:06 2022] POST /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472/action => generated 32638 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:39:07.770057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2cbc89f1-2b24-48e1-858c-1836da598960 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:07.770057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2cbc89f1-2b24-48e1-858c-1836da598960 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:07.780227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cbc89f1-2b24-48e1-858c-1836da598960 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:07.783303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cbc89f1-2b24-48e1-858c-1836da598960 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:07.783887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cbc89f1-2b24-48e1-858c-1836da598960 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:07.784756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cbc89f1-2b24-48e1-858c-1836da598960 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:07.785743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cbc89f1-2b24-48e1-858c-1836da598960 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:07.786467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cbc89f1-2b24-48e1-858c-1836da598960 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:07.788689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b1af2757-eb5b-412d-be75-aadd71f35322 req-adb18299-b612-4825-9c33-54dc362f63da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c9dfc9-42e5-4247-905a-b97a8c133472", "tag": "a0e34e0f-8c12-4398-9a72-351a20acfbfb"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:07.810095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b1af2757-eb5b-412d-be75-aadd71f35322 req-adb18299-b612-4825-9c33-54dc362f63da service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:07.810473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b1af2757-eb5b-412d-be75-aadd71f35322 req-adb18299-b612-4825-9c33-54dc362f63da service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:07.810919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b1af2757-eb5b-412d-be75-aadd71f35322 req-adb18299-b612-4825-9c33-54dc362f63da service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:07.849525 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b1af2757-eb5b-412d-be75-aadd71f35322 req-adb18299-b612-4825-9c33-54dc362f63da service nova] Creating event network-changed:a0e34e0f-8c12-4398-9a72-351a20acfbfb for instance 92c9dfc9-42e5-4247-905a-b97a8c133472 on nch2-master-1 Sep 06 11:39:07.869600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2cbc89f1-2b24-48e1-858c-1836da598960 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:39:07.872391 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b1af2757-eb5b-412d-be75-aadd71f35322 req-adb18299-b612-4825-9c33-54dc362f63da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086763 Sep 06 11:39:07.875539 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3173/6397] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:39:08.301333 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2cbc89f1-2b24-48e1-858c-1836da598960 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "DELETE /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 204 len: 0 microversion: 2.1 time: 0.539611 Sep 06 11:39:08.306003 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3225/6398] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:39:07 2022] DELETE /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:39:08.317490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3e7c7b0-48e5-45df-bcf0-32d1dae88712 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:08.320167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f3e7c7b0-48e5-45df-bcf0-32d1dae88712 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:08.337887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3e7c7b0-48e5-45df-bcf0-32d1dae88712 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:08.338413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3e7c7b0-48e5-45df-bcf0-32d1dae88712 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:08.340816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3e7c7b0-48e5-45df-bcf0-32d1dae88712 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:08.341634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3e7c7b0-48e5-45df-bcf0-32d1dae88712 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:08.342116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3e7c7b0-48e5-45df-bcf0-32d1dae88712 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:08.342561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3e7c7b0-48e5-45df-bcf0-32d1dae88712 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:08.553103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f3e7c7b0-48e5-45df-bcf0-32d1dae88712 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:08.569768 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f3e7c7b0-48e5-45df-bcf0-32d1dae88712 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1669 microversion: 2.1 time: 0.259902 Sep 06 11:39:08.570697 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3174/6399] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:08 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1669 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:09.603761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e4df3ded-83ee-4281-8f8f-8213c2bb01e4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:09.604753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e4df3ded-83ee-4281-8f8f-8213c2bb01e4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:09.624665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4df3ded-83ee-4281-8f8f-8213c2bb01e4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:09.625184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4df3ded-83ee-4281-8f8f-8213c2bb01e4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:09.625631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4df3ded-83ee-4281-8f8f-8213c2bb01e4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:09.626363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4df3ded-83ee-4281-8f8f-8213c2bb01e4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:09.626828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4df3ded-83ee-4281-8f8f-8213c2bb01e4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:09.627278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4df3ded-83ee-4281-8f8f-8213c2bb01e4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:09.812625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e4df3ded-83ee-4281-8f8f-8213c2bb01e4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:09.819465 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e4df3ded-83ee-4281-8f8f-8213c2bb01e4 tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1669 microversion: 2.1 time: 0.227490 Sep 06 11:39:09.820394 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3226/6400] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:09 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1669 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:10.844838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cf7d2dbd-e190-4bea-ba65-2d195c98bbad tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:10.845664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cf7d2dbd-e190-4bea-ba65-2d195c98bbad tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:10.853691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf7d2dbd-e190-4bea-ba65-2d195c98bbad tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:10.854198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf7d2dbd-e190-4bea-ba65-2d195c98bbad tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:10.854737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf7d2dbd-e190-4bea-ba65-2d195c98bbad tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:10.855536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf7d2dbd-e190-4bea-ba65-2d195c98bbad tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:10.856243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf7d2dbd-e190-4bea-ba65-2d195c98bbad tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:10.856988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf7d2dbd-e190-4bea-ba65-2d195c98bbad tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:10.947684 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cf7d2dbd-e190-4bea-ba65-2d195c98bbad tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:10.959725 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cf7d2dbd-e190-4bea-ba65-2d195c98bbad tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1483 microversion: 2.1 time: 0.119256 Sep 06 11:39:10.960591 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3175/6401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:10 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1483 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:11.156077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-efc86d19-f3b6-4f95-bb00-edd0ccb2b02b req-6fddc343-1924-45cb-886e-9498650c095d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c9dfc9-42e5-4247-905a-b97a8c133472", "name": "network-vif-deleted", "tag": "a0e34e0f-8c12-4398-9a72-351a20acfbfb"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:11.163762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:11.169228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-efc86d19-f3b6-4f95-bb00-edd0ccb2b02b req-6fddc343-1924-45cb-886e-9498650c095d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:11.169899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-efc86d19-f3b6-4f95-bb00-edd0ccb2b02b req-6fddc343-1924-45cb-886e-9498650c095d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:11.170500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-efc86d19-f3b6-4f95-bb00-edd0ccb2b02b req-6fddc343-1924-45cb-886e-9498650c095d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:11.192098 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-efc86d19-f3b6-4f95-bb00-edd0ccb2b02b req-6fddc343-1924-45cb-886e-9498650c095d service nova] Creating event network-vif-deleted:a0e34e0f-8c12-4398-9a72-351a20acfbfb for instance 92c9dfc9-42e5-4247-905a-b97a8c133472 on nch2-master-1 Sep 06 11:39:11.213058 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-efc86d19-f3b6-4f95-bb00-edd0ccb2b02b req-6fddc343-1924-45cb-886e-9498650c095d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061906 Sep 06 11:39:11.213958 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3227/6402] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:39:11.985816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:11.990133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:11.997108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:11.997980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:11.998688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:11.999862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:12.000554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:12.001263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:12.070866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:12.070866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:12.071307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:12.072448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lazy-loading 'fault' on Instance uuid 92c9dfc9-42e5-4247-905a-b97a8c133472 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:39:12.145736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9fe6d32c54f008d430dc9d3ef6e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:12.163081 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e4cce2a8-fd0c-4bb8-81a5-29988db39a9b tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 200 len: 1337 microversion: 2.1 time: 0.181465 Sep 06 11:39:12.185422 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3176/6403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:11 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 1337 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:12.522899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-691879138", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "a71a38a4-8f59-4374-9cca-90e4d2424752"}], "key_name": "tempest-TestNetworkAdvancedServerOps-72705516", "security_groups": [{"name": "tempest-secgroup-smoke-288242708"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:12.647167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] validate_networks() for [('a71a38a4-8f59-4374-9cca-90e4d2424752', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:39:13.057338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:39:13.058668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:39:13.059218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:39:13.059646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:39:13.060063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:39:13.070310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:13.070792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:13.072341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:13.073093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:13.073554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:13.075156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:13.094318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:39:13.100192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for user fcaddf25fc12498b90d2cc1ec08e5da3 and project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:39:13.114834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:39:13.117321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:39:13.194067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f0579512-2c18-4796-b8f1-1d789ee3cc1a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:13.194691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f0579512-2c18-4796-b8f1-1d789ee3cc1a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] [instance: 92c9dfc9-42e5-4247-905a-b97a8c133472] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:13.202432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0579512-2c18-4796-b8f1-1d789ee3cc1a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:13.202919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0579512-2c18-4796-b8f1-1d789ee3cc1a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:13.203393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0579512-2c18-4796-b8f1-1d789ee3cc1a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:13.204100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0579512-2c18-4796-b8f1-1d789ee3cc1a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:13.204562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0579512-2c18-4796-b8f1-1d789ee3cc1a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:13.205000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0579512-2c18-4796-b8f1-1d789ee3cc1a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:13.227463 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-f0579512-2c18-4796-b8f1-1d789ee3cc1a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] HTTP exception thrown: Instance 92c9dfc9-42e5-4247-905a-b97a8c133472 could not be found. Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f0579512-2c18-4796-b8f1-1d789ee3cc1a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Request method failure captured: Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 HTTP/1.1 Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzCh-VPlmUT_4_OVXtlT2bInKm9mEstqRIZTbFYTSSjBxARQNLQfO_wK7r3OKQBOYO2DbH6IBuG6RdJn9DFhS5-aAI2LYyipuTEvlriFomkTBG28jVAfMekgKXaGVveRfM3NEfa_uQWUfMSB7OD62OJGnK0PKMPXeJNDPmbaaUaULR0 Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: d3a7bd2f2a3d4318bc4445e9c4be13fb Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestNetworkBasicOps-865989598 Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d3a7bd2f2a3d4318bc4445e9c4be13fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3a7bd2f2a3d4318bc4445e9c4be13fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d3a7bd2f2a3d4318bc4445e9c4be13fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3a7bd2f2a3d4318bc4445e9c4be13fb"}]}] Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestNetworkBasicOps-865989598 Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: d3a7bd2f2a3d4318bc4445e9c4be13fb Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestNetworkBasicOps-865989598 Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestNetworkBasicOps-865989598-project Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: cde9fe6d32c54f008d430dc9d3ef6e47 Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestNetworkBasicOps-865989598-project Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 92c9dfc9-42e5-4247-905a-b97a8c133472 could not be found. Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '92c9dfc9-42e5-4247-905a-b97a8c133472'} Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92c9dfc9-42e5-4247-905a-b97a8c133472 could not be found. Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92c9dfc9-42e5-4247-905a-b97a8c133472 could not be found. Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:39:13.229422 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:13.234296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:39:13.234296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:39:13.234296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:39:13.234296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:39:13.234296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:39:13.234296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92c9dfc9-42e5-4247-905a-b97a8c133472 could not be found. Sep 06 11:39:13.234296 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:13.234296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f0579512-2c18-4796-b8f1-1d789ee3cc1a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Returning 404 to user: Instance 92c9dfc9-42e5-4247-905a-b97a8c133472 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:39:13.234296 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f0579512-2c18-4796-b8f1-1d789ee3cc1a tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472" status: 404 len: 111 microversion: 2.1 time: 0.040987 Sep 06 11:39:13.234296 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3177/6404] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:13 2022] GET /compute/v2.1/servers/92c9dfc9-42e5-4247-905a-b97a8c133472 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:39:13.267130 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-64ec4c59-d6c9-4062-95b1-8dfa86d8b6de tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.748727 Sep 06 11:39:13.277290 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3228/6405] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:39:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:39:13.315269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e3b92f6-93d6-47db-b20c-1cfebf7e1566 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:13.316006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3e3b92f6-93d6-47db-b20c-1cfebf7e1566 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:13.397058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3e3b92f6-93d6-47db-b20c-1cfebf7e1566 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:13.406285 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3e3b92f6-93d6-47db-b20c-1cfebf7e1566 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1264 microversion: 2.1 time: 0.098350 Sep 06 11:39:13.407451 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3178/6406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:13 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1264 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:13.536781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cdb3a4b7-3812-42ce-a92a-24cc0af75e7f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] Calling method '.version_select at 0x7f90f3820430>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:13.652045 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cdb3a4b7-3812-42ce-a92a-24cc0af75e7f tempest-TestNetworkBasicOps-865989598 tempest-TestNetworkBasicOps-865989598-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-725344460" status: 202 len: 0 microversion: 2.1 time: 0.125345 Sep 06 11:39:13.653015 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3229/6407] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Sep 6 11:39:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-725344460 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:39:14.429789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-32f381a5-f105-49f7-ba78-05a2da918a30 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:14.430426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-32f381a5-f105-49f7-ba78-05a2da918a30 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:14.515910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-32f381a5-f105-49f7-ba78-05a2da918a30 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:14.524086 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-32f381a5-f105-49f7-ba78-05a2da918a30 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1264 microversion: 2.1 time: 0.098273 Sep 06 11:39:14.525308 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3179/6408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:14 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1264 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:15.189010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1762028232", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f8363fcb-784c-4aa1-b3ac-54356f34c8b5", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f6d6137d-8475-499d-9c0a-ad20e4d07df5"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:15.321839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] validate_networks() for [('f6d6137d-8475-499d-9c0a-ad20e4d07df5', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:39:15.548104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6853e434-cf1c-42d0-807e-ef3a1e405976 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:15.549651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6853e434-cf1c-42d0-807e-ef3a1e405976 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:15.566322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6853e434-cf1c-42d0-807e-ef3a1e405976 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:15.567223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6853e434-cf1c-42d0-807e-ef3a1e405976 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:15.570038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6853e434-cf1c-42d0-807e-ef3a1e405976 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:15.571110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6853e434-cf1c-42d0-807e-ef3a1e405976 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:15.574521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6853e434-cf1c-42d0-807e-ef3a1e405976 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:15.575105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6853e434-cf1c-42d0-807e-ef3a1e405976 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:15.697916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6853e434-cf1c-42d0-807e-ef3a1e405976 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:15.706193 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6853e434-cf1c-42d0-807e-ef3a1e405976 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1316 microversion: 2.1 time: 0.162289 Sep 06 11:39:15.706793 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3180/6409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:15 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:39:15.923397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:39:15.924068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:39:15.924689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:39:15.925177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:39:15.925777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:39:15.938830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:15.939850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:15.940785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:15.942415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:15.943154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:15.943838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:15.967432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Getting quotas for project edc027a6f642454d8592b308777d59e4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:39:15.973797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Getting quotas for user a36875e5990b487bb1357e0b46dac402 and project edc027a6f642454d8592b308777d59e4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:39:15.989097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:39:15.991727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f8363fcb-784c-4aa1-b3ac-54356f34c8b5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:39:16.222875 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041843 Sep 06 11:39:16.226638 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3230/6410] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:39:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:39:16.238053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6fc4583c-2b18-4d67-956d-48452a6403e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:16.239178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6fc4583c-2b18-4d67-956d-48452a6403e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:16.340523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6fc4583c-2b18-4d67-956d-48452a6403e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:16.363579 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6fc4583c-2b18-4d67-956d-48452a6403e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1057 microversion: 2.1 time: 0.114677 Sep 06 11:39:16.363579 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3181/6411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:16 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1057 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:16.738658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-16e6d2fc-b932-43df-a3e4-98ccbbf9277a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:16.738658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-16e6d2fc-b932-43df-a3e4-98ccbbf9277a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:16.752533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16e6d2fc-b932-43df-a3e4-98ccbbf9277a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:16.753499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16e6d2fc-b932-43df-a3e4-98ccbbf9277a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:16.754281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16e6d2fc-b932-43df-a3e4-98ccbbf9277a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:16.755543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16e6d2fc-b932-43df-a3e4-98ccbbf9277a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:16.756259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16e6d2fc-b932-43df-a3e4-98ccbbf9277a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:16.756891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-16e6d2fc-b932-43df-a3e4-98ccbbf9277a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:16.864381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-16e6d2fc-b932-43df-a3e4-98ccbbf9277a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:16.873621 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-16e6d2fc-b932-43df-a3e4-98ccbbf9277a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1322 microversion: 2.1 time: 0.147658 Sep 06 11:39:16.874217 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3231/6412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:16 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:17.382950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6e6f98d1-cbbc-4cf7-9860-c0efd1b3d172 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:17.383692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6e6f98d1-cbbc-4cf7-9860-c0efd1b3d172 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:17.641504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6e6f98d1-cbbc-4cf7-9860-c0efd1b3d172 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:17.648617 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6e6f98d1-cbbc-4cf7-9860-c0efd1b3d172 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1057 microversion: 2.1 time: 0.274442 Sep 06 11:39:17.663032 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3182/6413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:17 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1057 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:17.912049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-71a63664-64f1-4d00-8bc0-18d49e2d8397 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:17.913646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-71a63664-64f1-4d00-8bc0-18d49e2d8397 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:17.926411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71a63664-64f1-4d00-8bc0-18d49e2d8397 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:17.933508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71a63664-64f1-4d00-8bc0-18d49e2d8397 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:17.933508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71a63664-64f1-4d00-8bc0-18d49e2d8397 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:17.933508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71a63664-64f1-4d00-8bc0-18d49e2d8397 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:17.933508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71a63664-64f1-4d00-8bc0-18d49e2d8397 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:17.933508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-71a63664-64f1-4d00-8bc0-18d49e2d8397 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:18.224581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-71a63664-64f1-4d00-8bc0-18d49e2d8397 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:18.234187 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-71a63664-64f1-4d00-8bc0-18d49e2d8397 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1389 microversion: 2.1 time: 0.340774 Sep 06 11:39:18.240367 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3232/6414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:17 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1389 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:18.454987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e3949f2d-6270-4984-b229-5dfee456fe16 req-428ed8eb-9fe9-4b82-8dcd-836cc9928141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875de0f0-0ad6-42df-9bb4-11b6f547590c", "tag": "b0d7b843-646f-4e01-9354-2d6b7fc13044"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:18.466100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e3949f2d-6270-4984-b229-5dfee456fe16 req-428ed8eb-9fe9-4b82-8dcd-836cc9928141 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:18.467169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e3949f2d-6270-4984-b229-5dfee456fe16 req-428ed8eb-9fe9-4b82-8dcd-836cc9928141 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:18.467869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e3949f2d-6270-4984-b229-5dfee456fe16 req-428ed8eb-9fe9-4b82-8dcd-836cc9928141 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:18.482104 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e3949f2d-6270-4984-b229-5dfee456fe16 req-428ed8eb-9fe9-4b82-8dcd-836cc9928141 service nova] Creating event network-changed:b0d7b843-646f-4e01-9354-2d6b7fc13044 for instance 875de0f0-0ad6-42df-9bb4-11b6f547590c on nch1-master-1 Sep 06 11:39:18.488043 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e3949f2d-6270-4984-b229-5dfee456fe16 req-428ed8eb-9fe9-4b82-8dcd-836cc9928141 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037310 Sep 06 11:39:18.489014 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3183/6415] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:39:18.673659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5be27ae3-a0bc-48d8-87f6-ceb6635d1f82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:18.674252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5be27ae3-a0bc-48d8-87f6-ceb6635d1f82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:18.680562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5be27ae3-a0bc-48d8-87f6-ceb6635d1f82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:18.681050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5be27ae3-a0bc-48d8-87f6-ceb6635d1f82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:18.681489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5be27ae3-a0bc-48d8-87f6-ceb6635d1f82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:18.682421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5be27ae3-a0bc-48d8-87f6-ceb6635d1f82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:18.682885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5be27ae3-a0bc-48d8-87f6-ceb6635d1f82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:18.683370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5be27ae3-a0bc-48d8-87f6-ceb6635d1f82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:18.752724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5be27ae3-a0bc-48d8-87f6-ceb6635d1f82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:18.760857 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5be27ae3-a0bc-48d8-87f6-ceb6635d1f82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1109 microversion: 2.1 time: 0.091299 Sep 06 11:39:18.761442 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3233/6416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:18 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1109 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:19.259091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4bd0f665-0d9c-4243-adc1-8de4e81f7f05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:19.260069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4bd0f665-0d9c-4243-adc1-8de4e81f7f05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:19.266465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bd0f665-0d9c-4243-adc1-8de4e81f7f05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:19.266971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bd0f665-0d9c-4243-adc1-8de4e81f7f05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:19.267453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bd0f665-0d9c-4243-adc1-8de4e81f7f05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:19.268173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bd0f665-0d9c-4243-adc1-8de4e81f7f05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:19.268904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bd0f665-0d9c-4243-adc1-8de4e81f7f05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:19.269512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4bd0f665-0d9c-4243-adc1-8de4e81f7f05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:19.447208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4bd0f665-0d9c-4243-adc1-8de4e81f7f05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:19.457245 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4bd0f665-0d9c-4243-adc1-8de4e81f7f05 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1389 microversion: 2.1 time: 0.202294 Sep 06 11:39:19.458164 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3184/6417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:19 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1389 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:19.785668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4b3cc8d5-6eac-4d04-b989-b8172b94a91a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:19.786306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4b3cc8d5-6eac-4d04-b989-b8172b94a91a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:19.793808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b3cc8d5-6eac-4d04-b989-b8172b94a91a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:19.794310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b3cc8d5-6eac-4d04-b989-b8172b94a91a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:19.794901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b3cc8d5-6eac-4d04-b989-b8172b94a91a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:19.795753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b3cc8d5-6eac-4d04-b989-b8172b94a91a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:19.796223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b3cc8d5-6eac-4d04-b989-b8172b94a91a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:19.796667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b3cc8d5-6eac-4d04-b989-b8172b94a91a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:19.876660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4b3cc8d5-6eac-4d04-b989-b8172b94a91a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:19.884803 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4b3cc8d5-6eac-4d04-b989-b8172b94a91a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1127 microversion: 2.1 time: 0.103629 Sep 06 11:39:19.885387 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3234/6418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:19 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1127 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:20.481679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0c25db54-83f2-4a08-b3d7-f5513604b2c8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:20.482203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0c25db54-83f2-4a08-b3d7-f5513604b2c8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:20.489457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c25db54-83f2-4a08-b3d7-f5513604b2c8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:20.490234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c25db54-83f2-4a08-b3d7-f5513604b2c8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:20.490681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c25db54-83f2-4a08-b3d7-f5513604b2c8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:20.491424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c25db54-83f2-4a08-b3d7-f5513604b2c8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:20.491893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c25db54-83f2-4a08-b3d7-f5513604b2c8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:20.492331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c25db54-83f2-4a08-b3d7-f5513604b2c8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:20.669507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0c25db54-83f2-4a08-b3d7-f5513604b2c8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:20.678354 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0c25db54-83f2-4a08-b3d7-f5513604b2c8 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1389 microversion: 2.1 time: 0.201676 Sep 06 11:39:20.678987 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3185/6419] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:20 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1389 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:20.914042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-22181ead-8e90-4096-b147-f702e4533009 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:20.914663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-22181ead-8e90-4096-b147-f702e4533009 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:20.922045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22181ead-8e90-4096-b147-f702e4533009 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:20.922536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22181ead-8e90-4096-b147-f702e4533009 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:20.922982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22181ead-8e90-4096-b147-f702e4533009 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:20.923906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22181ead-8e90-4096-b147-f702e4533009 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:20.924383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22181ead-8e90-4096-b147-f702e4533009 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:20.924819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-22181ead-8e90-4096-b147-f702e4533009 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:21.099134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-22181ead-8e90-4096-b147-f702e4533009 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:21.108776 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-22181ead-8e90-4096-b147-f702e4533009 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1169 microversion: 2.1 time: 0.198569 Sep 06 11:39:21.109681 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3235/6420] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:20 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1169 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:21.303683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-8dcbd77b-3cbb-41f7-8be4-e5e7651e02be req-21a6b6c5-de34-44a0-85c2-0f66de6e9d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14ad35c3-e2f2-414b-a87e-d32a6961a04a", "tag": "0dd7f7b8-d68d-46bf-ab43-ee23f809a856"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:21.311239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:21.318977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8dcbd77b-3cbb-41f7-8be4-e5e7651e02be req-21a6b6c5-de34-44a0-85c2-0f66de6e9d03 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:21.319597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8dcbd77b-3cbb-41f7-8be4-e5e7651e02be req-21a6b6c5-de34-44a0-85c2-0f66de6e9d03 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:21.320117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8dcbd77b-3cbb-41f7-8be4-e5e7651e02be req-21a6b6c5-de34-44a0-85c2-0f66de6e9d03 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:21.334323 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-8dcbd77b-3cbb-41f7-8be4-e5e7651e02be req-21a6b6c5-de34-44a0-85c2-0f66de6e9d03 service nova] Creating event network-changed:0dd7f7b8-d68d-46bf-ab43-ee23f809a856 for instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a on nch2-master-1 Sep 06 11:39:21.339987 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-8dcbd77b-3cbb-41f7-8be4-e5e7651e02be req-21a6b6c5-de34-44a0-85c2-0f66de6e9d03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040118 Sep 06 11:39:21.341215 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3186/6421] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:39:21.701904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8977a12b-3732-4b06-825b-3263b8ee663d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:21.702525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8977a12b-3732-4b06-825b-3263b8ee663d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:21.708801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8977a12b-3732-4b06-825b-3263b8ee663d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:21.709350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8977a12b-3732-4b06-825b-3263b8ee663d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:21.710041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8977a12b-3732-4b06-825b-3263b8ee663d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:21.710761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8977a12b-3732-4b06-825b-3263b8ee663d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:21.711262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8977a12b-3732-4b06-825b-3263b8ee663d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:21.712301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8977a12b-3732-4b06-825b-3263b8ee663d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:21.853987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8977a12b-3732-4b06-825b-3263b8ee663d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:21.862184 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8977a12b-3732-4b06-825b-3263b8ee663d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1389 microversion: 2.1 time: 0.164174 Sep 06 11:39:21.862985 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3236/6422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:21 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:22.138276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5d009d0d-f6c7-47e7-903e-3b5ef9b50586 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:22.139139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5d009d0d-f6c7-47e7-903e-3b5ef9b50586 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:22.146057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d009d0d-f6c7-47e7-903e-3b5ef9b50586 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:22.146556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d009d0d-f6c7-47e7-903e-3b5ef9b50586 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:22.147038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d009d0d-f6c7-47e7-903e-3b5ef9b50586 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:22.147746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d009d0d-f6c7-47e7-903e-3b5ef9b50586 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:22.148212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d009d0d-f6c7-47e7-903e-3b5ef9b50586 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:22.148648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5d009d0d-f6c7-47e7-903e-3b5ef9b50586 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:22.280427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5d009d0d-f6c7-47e7-903e-3b5ef9b50586 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:22.288364 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5d009d0d-f6c7-47e7-903e-3b5ef9b50586 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1169 microversion: 2.1 time: 0.156260 Sep 06 11:39:22.293809 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3187/6423] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:22 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1169 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:22.885670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-90be9b22-a90b-4463-a11e-fae8207b0552 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:22.886284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-90be9b22-a90b-4463-a11e-fae8207b0552 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:22.889064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:22.893895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90be9b22-a90b-4463-a11e-fae8207b0552 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:22.894386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90be9b22-a90b-4463-a11e-fae8207b0552 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:22.894843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90be9b22-a90b-4463-a11e-fae8207b0552 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:22.895572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90be9b22-a90b-4463-a11e-fae8207b0552 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:22.896045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90be9b22-a90b-4463-a11e-fae8207b0552 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:22.902207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-90be9b22-a90b-4463-a11e-fae8207b0552 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:23.035808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-90be9b22-a90b-4463-a11e-fae8207b0552 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:23.046406 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-90be9b22-a90b-4463-a11e-fae8207b0552 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1389 microversion: 2.1 time: 0.164309 Sep 06 11:39:23.046997 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3237/6424] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:22 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:23.311660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-05766879-ec62-4f33-9799-c95ae574ee88 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:23.317072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-05766879-ec62-4f33-9799-c95ae574ee88 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:23.319202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05766879-ec62-4f33-9799-c95ae574ee88 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:23.319696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05766879-ec62-4f33-9799-c95ae574ee88 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:23.320150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05766879-ec62-4f33-9799-c95ae574ee88 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:23.320887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05766879-ec62-4f33-9799-c95ae574ee88 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:23.321365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05766879-ec62-4f33-9799-c95ae574ee88 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:23.321814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05766879-ec62-4f33-9799-c95ae574ee88 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:23.453364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-05766879-ec62-4f33-9799-c95ae574ee88 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:23.461138 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-05766879-ec62-4f33-9799-c95ae574ee88 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1169 microversion: 2.1 time: 0.153429 Sep 06 11:39:23.462246 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3188/6425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:23 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1169 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:24.070385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2dd6482d-5d17-4cc2-8640-24b30df946bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:24.071629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2dd6482d-5d17-4cc2-8640-24b30df946bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:24.079215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dd6482d-5d17-4cc2-8640-24b30df946bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:24.079732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dd6482d-5d17-4cc2-8640-24b30df946bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:24.080176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dd6482d-5d17-4cc2-8640-24b30df946bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:24.080908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dd6482d-5d17-4cc2-8640-24b30df946bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:24.081605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dd6482d-5d17-4cc2-8640-24b30df946bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:24.082073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2dd6482d-5d17-4cc2-8640-24b30df946bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:24.219433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2dd6482d-5d17-4cc2-8640-24b30df946bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:24.227949 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2dd6482d-5d17-4cc2-8640-24b30df946bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1389 microversion: 2.1 time: 0.161366 Sep 06 11:39:24.228557 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3238/6426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:24 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:24.484389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0fa5730f-10e4-4e94-985e-546f90b6b304 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:24.485034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0fa5730f-10e4-4e94-985e-546f90b6b304 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:24.492023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fa5730f-10e4-4e94-985e-546f90b6b304 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:24.496721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fa5730f-10e4-4e94-985e-546f90b6b304 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:24.496721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fa5730f-10e4-4e94-985e-546f90b6b304 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:24.496721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fa5730f-10e4-4e94-985e-546f90b6b304 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:24.496721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fa5730f-10e4-4e94-985e-546f90b6b304 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:24.496721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0fa5730f-10e4-4e94-985e-546f90b6b304 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:24.607574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-58a81907-6aed-4086-96d2-9c790fb3b9c5 req-7d63784d-36da-4173-bb0d-2cd0e93cb9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875de0f0-0ad6-42df-9bb4-11b6f547590c", "name": "network-vif-plugged", "status": "completed", "tag": "b0d7b843-646f-4e01-9354-2d6b7fc13044"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:24.621478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-58a81907-6aed-4086-96d2-9c790fb3b9c5 req-7d63784d-36da-4173-bb0d-2cd0e93cb9a8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:24.622247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-58a81907-6aed-4086-96d2-9c790fb3b9c5 req-7d63784d-36da-4173-bb0d-2cd0e93cb9a8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:24.622677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-58a81907-6aed-4086-96d2-9c790fb3b9c5 req-7d63784d-36da-4173-bb0d-2cd0e93cb9a8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:24.636712 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-58a81907-6aed-4086-96d2-9c790fb3b9c5 req-7d63784d-36da-4173-bb0d-2cd0e93cb9a8 service nova] Creating event network-vif-plugged:b0d7b843-646f-4e01-9354-2d6b7fc13044 for instance 875de0f0-0ad6-42df-9bb4-11b6f547590c on nch1-master-1 Sep 06 11:39:24.636843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0fa5730f-10e4-4e94-985e-546f90b6b304 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:24.639479 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-58a81907-6aed-4086-96d2-9c790fb3b9c5 req-7d63784d-36da-4173-bb0d-2cd0e93cb9a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036081 Sep 06 11:39:24.640083 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3239/6427] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:39:24.646994 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0fa5730f-10e4-4e94-985e-546f90b6b304 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1169 microversion: 2.1 time: 0.166553 Sep 06 11:39:24.648472 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3189/6428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:24 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1169 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:25.252850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-13036b98-c1a8-4c75-a320-902be64c9756 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:25.253483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-13036b98-c1a8-4c75-a320-902be64c9756 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:25.260322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13036b98-c1a8-4c75-a320-902be64c9756 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:25.260801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13036b98-c1a8-4c75-a320-902be64c9756 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:25.261250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13036b98-c1a8-4c75-a320-902be64c9756 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:25.261956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13036b98-c1a8-4c75-a320-902be64c9756 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:25.262419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13036b98-c1a8-4c75-a320-902be64c9756 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:25.262861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13036b98-c1a8-4c75-a320-902be64c9756 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:25.397924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-13036b98-c1a8-4c75-a320-902be64c9756 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:25.406901 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-13036b98-c1a8-4c75-a320-902be64c9756 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1389 microversion: 2.1 time: 0.159265 Sep 06 11:39:25.410009 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3240/6429] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:25 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:25.671504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a4a28c6b-ee30-4168-aa11-c0c3915137bc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:25.672130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a4a28c6b-ee30-4168-aa11-c0c3915137bc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:25.679180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4a28c6b-ee30-4168-aa11-c0c3915137bc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:25.679677 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4a28c6b-ee30-4168-aa11-c0c3915137bc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:25.680665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4a28c6b-ee30-4168-aa11-c0c3915137bc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:25.681381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4a28c6b-ee30-4168-aa11-c0c3915137bc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:25.681908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4a28c6b-ee30-4168-aa11-c0c3915137bc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:25.682351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4a28c6b-ee30-4168-aa11-c0c3915137bc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:25.827755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a4a28c6b-ee30-4168-aa11-c0c3915137bc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:25.836075 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a4a28c6b-ee30-4168-aa11-c0c3915137bc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1203 microversion: 2.1 time: 0.168671 Sep 06 11:39:25.836656 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3190/6430] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:25 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:26.430472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9f7408a0-0ca9-4afd-a227-60f1180365ce tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:26.431149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9f7408a0-0ca9-4afd-a227-60f1180365ce tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:26.433091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:26.433782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:26.439868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f7408a0-0ca9-4afd-a227-60f1180365ce tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:26.440445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f7408a0-0ca9-4afd-a227-60f1180365ce tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:26.440894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f7408a0-0ca9-4afd-a227-60f1180365ce tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:26.441596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f7408a0-0ca9-4afd-a227-60f1180365ce tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:26.442057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f7408a0-0ca9-4afd-a227-60f1180365ce tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:26.442495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f7408a0-0ca9-4afd-a227-60f1180365ce tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:26.577755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9f7408a0-0ca9-4afd-a227-60f1180365ce tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:26.585873 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9f7408a0-0ca9-4afd-a227-60f1180365ce tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1561 microversion: 2.1 time: 0.159962 Sep 06 11:39:26.586489 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3241/6431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:26 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:26.609528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b7007f48-d7d9-422b-8041-49e82c92ec2d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:26.610244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b7007f48-d7d9-422b-8041-49e82c92ec2d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:26.616509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7007f48-d7d9-422b-8041-49e82c92ec2d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:26.616997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7007f48-d7d9-422b-8041-49e82c92ec2d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:26.617443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7007f48-d7d9-422b-8041-49e82c92ec2d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:26.618753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7007f48-d7d9-422b-8041-49e82c92ec2d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:26.619343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7007f48-d7d9-422b-8041-49e82c92ec2d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:26.619780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7007f48-d7d9-422b-8041-49e82c92ec2d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:26.764897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b7007f48-d7d9-422b-8041-49e82c92ec2d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:26.772871 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b7007f48-d7d9-422b-8041-49e82c92ec2d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1561 microversion: 2.1 time: 0.167280 Sep 06 11:39:26.773444 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3191/6432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:26 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:26.859308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9aff989-5e75-4753-97e8-364fb2f452a6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:26.859929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d9aff989-5e75-4753-97e8-364fb2f452a6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:26.865995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9aff989-5e75-4753-97e8-364fb2f452a6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:26.868377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9aff989-5e75-4753-97e8-364fb2f452a6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:26.868377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9aff989-5e75-4753-97e8-364fb2f452a6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:26.868377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9aff989-5e75-4753-97e8-364fb2f452a6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:26.868377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9aff989-5e75-4753-97e8-364fb2f452a6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:26.868853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9aff989-5e75-4753-97e8-364fb2f452a6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:27.074990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d9aff989-5e75-4753-97e8-364fb2f452a6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:27.084598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:27.084598 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d9aff989-5e75-4753-97e8-364fb2f452a6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1203 microversion: 2.1 time: 0.228355 Sep 06 11:39:27.084598 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3242/6433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:26 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1203 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:28.107680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-12d23aaa-23bc-4208-a972-1a0d58a1f157 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:28.108307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-12d23aaa-23bc-4208-a972-1a0d58a1f157 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:28.110394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:28.116186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12d23aaa-23bc-4208-a972-1a0d58a1f157 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:28.117137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12d23aaa-23bc-4208-a972-1a0d58a1f157 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:28.117137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12d23aaa-23bc-4208-a972-1a0d58a1f157 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:28.118496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12d23aaa-23bc-4208-a972-1a0d58a1f157 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:28.118971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12d23aaa-23bc-4208-a972-1a0d58a1f157 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:28.119436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12d23aaa-23bc-4208-a972-1a0d58a1f157 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:28.307582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-12d23aaa-23bc-4208-a972-1a0d58a1f157 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:28.316005 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-12d23aaa-23bc-4208-a972-1a0d58a1f157 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1203 microversion: 2.1 time: 0.212401 Sep 06 11:39:28.316596 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3192/6434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:28 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1203 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:28.873380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-079ca634-2be0-4d5c-9a71-797d0fe29ec3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:28.874014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-079ca634-2be0-4d5c-9a71-797d0fe29ec3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:28.874413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-8e439f45-8717-4e6b-9afa-f63e4337daf8 req-6d2395a0-c7ed-4280-9ae1-e886c32f0ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875de0f0-0ad6-42df-9bb4-11b6f547590c", "tag": "b0d7b843-646f-4e01-9354-2d6b7fc13044"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:28.881876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-079ca634-2be0-4d5c-9a71-797d0fe29ec3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:28.882861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-079ca634-2be0-4d5c-9a71-797d0fe29ec3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:28.883791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-079ca634-2be0-4d5c-9a71-797d0fe29ec3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:28.884527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-079ca634-2be0-4d5c-9a71-797d0fe29ec3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:28.885002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-079ca634-2be0-4d5c-9a71-797d0fe29ec3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:28.885444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-079ca634-2be0-4d5c-9a71-797d0fe29ec3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:28.888829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8e439f45-8717-4e6b-9afa-f63e4337daf8 req-6d2395a0-c7ed-4280-9ae1-e886c32f0ed3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:28.894964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8e439f45-8717-4e6b-9afa-f63e4337daf8 req-6d2395a0-c7ed-4280-9ae1-e886c32f0ed3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:28.894964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8e439f45-8717-4e6b-9afa-f63e4337daf8 req-6d2395a0-c7ed-4280-9ae1-e886c32f0ed3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:28.902048 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-8e439f45-8717-4e6b-9afa-f63e4337daf8 req-6d2395a0-c7ed-4280-9ae1-e886c32f0ed3 service nova] Creating event network-changed:b0d7b843-646f-4e01-9354-2d6b7fc13044 for instance 875de0f0-0ad6-42df-9bb4-11b6f547590c on nch1-master-1 Sep 06 11:39:28.910915 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-8e439f45-8717-4e6b-9afa-f63e4337daf8 req-6d2395a0-c7ed-4280-9ae1-e886c32f0ed3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040303 Sep 06 11:39:28.911991 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3193/6435] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:39:29.037890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-079ca634-2be0-4d5c-9a71-797d0fe29ec3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:29.047724 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-079ca634-2be0-4d5c-9a71-797d0fe29ec3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1561 microversion: 2.1 time: 0.179845 Sep 06 11:39:29.048650 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3243/6436] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:28 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:29.340943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a127b55c-ada8-4fa2-9316-155c668d89b1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:29.341679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a127b55c-ada8-4fa2-9316-155c668d89b1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:29.348425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a127b55c-ada8-4fa2-9316-155c668d89b1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:29.349010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a127b55c-ada8-4fa2-9316-155c668d89b1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:29.349615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a127b55c-ada8-4fa2-9316-155c668d89b1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:29.350359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a127b55c-ada8-4fa2-9316-155c668d89b1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:29.351076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a127b55c-ada8-4fa2-9316-155c668d89b1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:29.351527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a127b55c-ada8-4fa2-9316-155c668d89b1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:29.513250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a127b55c-ada8-4fa2-9316-155c668d89b1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:29.521721 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a127b55c-ada8-4fa2-9316-155c668d89b1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1203 microversion: 2.1 time: 0.186441 Sep 06 11:39:29.522307 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3194/6437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:29 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1203 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:30.545780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-607487db-19d6-40ed-992e-d54b6d147f9c tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:30.546436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-607487db-19d6-40ed-992e-d54b6d147f9c tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:30.553790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-607487db-19d6-40ed-992e-d54b6d147f9c tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:30.554287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-607487db-19d6-40ed-992e-d54b6d147f9c tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:30.554740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-607487db-19d6-40ed-992e-d54b6d147f9c tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:30.556116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-607487db-19d6-40ed-992e-d54b6d147f9c tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:30.556584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-607487db-19d6-40ed-992e-d54b6d147f9c tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:30.557025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-607487db-19d6-40ed-992e-d54b6d147f9c tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:30.686397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-607487db-19d6-40ed-992e-d54b6d147f9c tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:30.694258 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-607487db-19d6-40ed-992e-d54b6d147f9c tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1203 microversion: 2.1 time: 0.152757 Sep 06 11:39:30.694836 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3244/6438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:30 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:31.525477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-1b7b31b9-ab35-4eef-a9a3-32980c086e13 req-0c23dcb0-f60f-48d0-867f-988648e86baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ad35c3-e2f2-414b-a87e-d32a6961a04a", "name": "network-vif-plugged", "status": "completed", "tag": "0dd7f7b8-d68d-46bf-ab43-ee23f809a856"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:31.536583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1b7b31b9-ab35-4eef-a9a3-32980c086e13 req-0c23dcb0-f60f-48d0-867f-988648e86baf service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:31.537070 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1b7b31b9-ab35-4eef-a9a3-32980c086e13 req-0c23dcb0-f60f-48d0-867f-988648e86baf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:31.537511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1b7b31b9-ab35-4eef-a9a3-32980c086e13 req-0c23dcb0-f60f-48d0-867f-988648e86baf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:31.549330 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-1b7b31b9-ab35-4eef-a9a3-32980c086e13 req-0c23dcb0-f60f-48d0-867f-988648e86baf service nova] Creating event network-vif-plugged:0dd7f7b8-d68d-46bf-ab43-ee23f809a856 for instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a on nch2-master-1 Sep 06 11:39:31.554443 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-1b7b31b9-ab35-4eef-a9a3-32980c086e13 req-0c23dcb0-f60f-48d0-867f-988648e86baf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033372 Sep 06 11:39:31.555463 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3195/6439] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:39:31.718247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-24199b42-49b6-4075-9c59-a4359f86bd30 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:31.718969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-24199b42-49b6-4075-9c59-a4359f86bd30 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:31.726676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24199b42-49b6-4075-9c59-a4359f86bd30 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:31.727879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24199b42-49b6-4075-9c59-a4359f86bd30 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:31.728335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24199b42-49b6-4075-9c59-a4359f86bd30 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:31.729046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24199b42-49b6-4075-9c59-a4359f86bd30 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:31.729510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24199b42-49b6-4075-9c59-a4359f86bd30 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:31.729948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24199b42-49b6-4075-9c59-a4359f86bd30 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:31.862828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-24199b42-49b6-4075-9c59-a4359f86bd30 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:31.870820 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-24199b42-49b6-4075-9c59-a4359f86bd30 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1203 microversion: 2.1 time: 0.156587 Sep 06 11:39:31.871434 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3245/6440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:31 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:32.894923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5067ab86-9a48-4119-8517-81e5e4e2b58e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:32.895661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5067ab86-9a48-4119-8517-81e5e4e2b58e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:32.903293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5067ab86-9a48-4119-8517-81e5e4e2b58e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:32.903786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5067ab86-9a48-4119-8517-81e5e4e2b58e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:32.904236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5067ab86-9a48-4119-8517-81e5e4e2b58e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:32.905197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5067ab86-9a48-4119-8517-81e5e4e2b58e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:32.905661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5067ab86-9a48-4119-8517-81e5e4e2b58e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:32.906098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5067ab86-9a48-4119-8517-81e5e4e2b58e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:32.926467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:33.039754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5067ab86-9a48-4119-8517-81e5e4e2b58e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:33.046002 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5067ab86-9a48-4119-8517-81e5e4e2b58e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1203 microversion: 2.1 time: 0.155630 Sep 06 11:39:33.046580 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3196/6441] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:32 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:34.068976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a589f9f5-17d2-49ff-8ece-bcb0ff15d155 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:34.069599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a589f9f5-17d2-49ff-8ece-bcb0ff15d155 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:34.076626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a589f9f5-17d2-49ff-8ece-bcb0ff15d155 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:34.077115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a589f9f5-17d2-49ff-8ece-bcb0ff15d155 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:34.077563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a589f9f5-17d2-49ff-8ece-bcb0ff15d155 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:34.078265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a589f9f5-17d2-49ff-8ece-bcb0ff15d155 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:34.078732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a589f9f5-17d2-49ff-8ece-bcb0ff15d155 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:34.079199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a589f9f5-17d2-49ff-8ece-bcb0ff15d155 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:34.223605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a589f9f5-17d2-49ff-8ece-bcb0ff15d155 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:34.232274 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a589f9f5-17d2-49ff-8ece-bcb0ff15d155 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1390 microversion: 2.1 time: 0.167357 Sep 06 11:39:34.232855 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3246/6442] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:34 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:34.255195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-640e3d53-3e0f-4cf2-8a29-8b8db7772cb5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:34.255818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-640e3d53-3e0f-4cf2-8a29-8b8db7772cb5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:34.262768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-640e3d53-3e0f-4cf2-8a29-8b8db7772cb5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:34.263316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-640e3d53-3e0f-4cf2-8a29-8b8db7772cb5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:34.263768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-640e3d53-3e0f-4cf2-8a29-8b8db7772cb5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:34.264471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-640e3d53-3e0f-4cf2-8a29-8b8db7772cb5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:34.264992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-640e3d53-3e0f-4cf2-8a29-8b8db7772cb5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:34.265437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-640e3d53-3e0f-4cf2-8a29-8b8db7772cb5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:34.406888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-640e3d53-3e0f-4cf2-8a29-8b8db7772cb5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:34.416230 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-640e3d53-3e0f-4cf2-8a29-8b8db7772cb5 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1390 microversion: 2.1 time: 0.164947 Sep 06 11:39:34.416749 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3197/6443] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:34 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:34.437724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-33943337-a010-439f-ba87-3ad4bbd71890 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:34.438647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-33943337-a010-439f-ba87-3ad4bbd71890 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:34.445065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33943337-a010-439f-ba87-3ad4bbd71890 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:34.445708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33943337-a010-439f-ba87-3ad4bbd71890 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:34.446068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33943337-a010-439f-ba87-3ad4bbd71890 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:34.446776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33943337-a010-439f-ba87-3ad4bbd71890 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:34.447273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33943337-a010-439f-ba87-3ad4bbd71890 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:34.447710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33943337-a010-439f-ba87-3ad4bbd71890 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:34.591024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-33943337-a010-439f-ba87-3ad4bbd71890 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:34.599162 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-33943337-a010-439f-ba87-3ad4bbd71890 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1390 microversion: 2.1 time: 0.165321 Sep 06 11:39:34.599739 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3247/6444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:34 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:39:34.683303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-14406af1-6dbc-480e-a3d2-755dd91d52cc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:34.683739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-14406af1-6dbc-480e-a3d2-755dd91d52cc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:34.689922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14406af1-6dbc-480e-a3d2-755dd91d52cc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:34.690416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14406af1-6dbc-480e-a3d2-755dd91d52cc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:34.690863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14406af1-6dbc-480e-a3d2-755dd91d52cc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:34.691594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14406af1-6dbc-480e-a3d2-755dd91d52cc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:34.692058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14406af1-6dbc-480e-a3d2-755dd91d52cc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:34.692492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-14406af1-6dbc-480e-a3d2-755dd91d52cc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:34.718729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-14406af1-6dbc-480e-a3d2-755dd91d52cc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:39:34.995800 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-14406af1-6dbc-480e-a3d2-755dd91d52cc tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 204 len: 0 microversion: 2.1 time: 0.316301 Sep 06 11:39:34.996605 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3198/6445] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:39:34 2022] DELETE /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:39:35.004907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1e1942fd-3ff8-4b62-a66d-a1c64316f964 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:35.005233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1e1942fd-3ff8-4b62-a66d-a1c64316f964 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:35.012049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e1942fd-3ff8-4b62-a66d-a1c64316f964 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:35.012557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e1942fd-3ff8-4b62-a66d-a1c64316f964 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:35.013014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e1942fd-3ff8-4b62-a66d-a1c64316f964 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:35.013736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e1942fd-3ff8-4b62-a66d-a1c64316f964 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:35.014206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e1942fd-3ff8-4b62-a66d-a1c64316f964 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:35.014646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e1942fd-3ff8-4b62-a66d-a1c64316f964 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:35.149333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1e1942fd-3ff8-4b62-a66d-a1c64316f964 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:35.158021 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1e1942fd-3ff8-4b62-a66d-a1c64316f964 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1396 microversion: 2.1 time: 0.157412 Sep 06 11:39:35.158680 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3248/6446] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:34 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1396 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:36.181196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-86f2cca0-60bb-4ec3-ace8-7af35cb8b89b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:36.181854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-86f2cca0-60bb-4ec3-ace8-7af35cb8b89b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:36.189030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86f2cca0-60bb-4ec3-ace8-7af35cb8b89b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:36.189536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86f2cca0-60bb-4ec3-ace8-7af35cb8b89b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:36.190005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86f2cca0-60bb-4ec3-ace8-7af35cb8b89b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:36.190726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86f2cca0-60bb-4ec3-ace8-7af35cb8b89b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:36.191241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86f2cca0-60bb-4ec3-ace8-7af35cb8b89b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:36.191690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-86f2cca0-60bb-4ec3-ace8-7af35cb8b89b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:36.319582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-86f2cca0-60bb-4ec3-ace8-7af35cb8b89b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:36.328417 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-86f2cca0-60bb-4ec3-ace8-7af35cb8b89b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1396 microversion: 2.1 time: 0.151747 Sep 06 11:39:36.329020 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3199/6447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:36 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1396 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:37.146801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-b00dbc6d-0790-4322-9af8-66b5ddf063e0 req-1850663e-1a64-4c8d-af85-627908a32df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ad35c3-e2f2-414b-a87e-d32a6961a04a", "name": "network-vif-deleted", "tag": "0dd7f7b8-d68d-46bf-ab43-ee23f809a856"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:37.158271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b00dbc6d-0790-4322-9af8-66b5ddf063e0 req-1850663e-1a64-4c8d-af85-627908a32df6 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:37.158752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b00dbc6d-0790-4322-9af8-66b5ddf063e0 req-1850663e-1a64-4c8d-af85-627908a32df6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:37.159235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b00dbc6d-0790-4322-9af8-66b5ddf063e0 req-1850663e-1a64-4c8d-af85-627908a32df6 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:37.171926 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-b00dbc6d-0790-4322-9af8-66b5ddf063e0 req-1850663e-1a64-4c8d-af85-627908a32df6 service nova] Creating event network-vif-deleted:0dd7f7b8-d68d-46bf-ab43-ee23f809a856 for instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a on nch2-master-1 Sep 06 11:39:37.177435 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-b00dbc6d-0790-4322-9af8-66b5ddf063e0 req-1850663e-1a64-4c8d-af85-627908a32df6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034368 Sep 06 11:39:37.178359 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3249/6448] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:39:37.352211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ef9d481-c42f-4d89-988d-ada97fc253e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:37.353239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ef9d481-c42f-4d89-988d-ada97fc253e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:37.359893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ef9d481-c42f-4d89-988d-ada97fc253e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:37.360389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ef9d481-c42f-4d89-988d-ada97fc253e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:37.360839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ef9d481-c42f-4d89-988d-ada97fc253e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:37.361553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ef9d481-c42f-4d89-988d-ada97fc253e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:37.362018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ef9d481-c42f-4d89-988d-ada97fc253e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:37.362452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ef9d481-c42f-4d89-988d-ada97fc253e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:37.432268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ef9d481-c42f-4d89-988d-ada97fc253e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:37.440268 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ef9d481-c42f-4d89-988d-ada97fc253e7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1188 microversion: 2.1 time: 0.092697 Sep 06 11:39:37.440844 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3200/6449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:37 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:38.463634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:38.464353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:38.471620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:38.472109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:38.472627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:38.473331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:38.473799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:38.474235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:38.506792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:38.507321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:38.507768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:38.508222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lazy-loading 'fault' on Instance uuid 14ad35c3-e2f2-414b-a87e-d32a6961a04a {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:39:38.550580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:38.559932 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-04beedf3-c884-408f-94ad-f50e9269b4e8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 200 len: 1193 microversion: 2.1 time: 0.100109 Sep 06 11:39:38.559932 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3250/6450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:38 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 1193 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:39.582504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d8bf4a92-b2b5-4c21-b3e7-0bb8b032103e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:39.583224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d8bf4a92-b2b5-4c21-b3e7-0bb8b032103e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:39.590323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8bf4a92-b2b5-4c21-b3e7-0bb8b032103e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:39.590815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8bf4a92-b2b5-4c21-b3e7-0bb8b032103e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:39.591280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8bf4a92-b2b5-4c21-b3e7-0bb8b032103e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:39.591980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8bf4a92-b2b5-4c21-b3e7-0bb8b032103e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:39.592452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8bf4a92-b2b5-4c21-b3e7-0bb8b032103e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:39.592888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8bf4a92-b2b5-4c21-b3e7-0bb8b032103e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:39.606476 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-d8bf4a92-b2b5-4c21-b3e7-0bb8b032103e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] HTTP exception thrown: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d8bf4a92-b2b5-4c21-b3e7-0bb8b032103e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Request method failure captured: Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a HTTP/1.1 Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzFQ2vLizXv-0F-MgRIpiXyEibY_kxkSM2EYhf_76f4Yzg4uNz9f1hiW7ZUxoZZgEMvk03CE7DmCEkes4ZvISQGLuK5qOnzLWzkfpL8ruFps5TAXJ1tYu_xPENd2xtzF5jkFYVyT7UrqsmlOZyu7GWTnBTwaFFG6ehsVTIiLA3QpBAI Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edc027a6f642454d8592b308777d59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edc027a6f642454d8592b308777d59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}] Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestVolumeBootPattern-929733958 Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a36875e5990b487bb1357e0b46dac402 Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '14ad35c3-e2f2-414b-a87e-d32a6961a04a'} Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:39:39.608162 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:39.613598 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:39:39.613598 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:39:39.613598 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:39:39.613598 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:39:39.613598 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:39:39.613598 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:39.613598 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:39.613598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d8bf4a92-b2b5-4c21-b3e7-0bb8b032103e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Returning 404 to user: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:39:39.613598 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d8bf4a92-b2b5-4c21-b3e7-0bb8b032103e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 404 len: 111 microversion: 2.1 time: 0.031094 Sep 06 11:39:39.613598 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3201/6451] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:39 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:39:41.754831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-854a89a9-2d14-4180-b8ba-2274dbf15181 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:41.758865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-854a89a9-2d14-4180-b8ba-2274dbf15181 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:41.762950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-854a89a9-2d14-4180-b8ba-2274dbf15181 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:41.763484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-854a89a9-2d14-4180-b8ba-2274dbf15181 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:41.763936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-854a89a9-2d14-4180-b8ba-2274dbf15181 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:41.764641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-854a89a9-2d14-4180-b8ba-2274dbf15181 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:41.765151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-854a89a9-2d14-4180-b8ba-2274dbf15181 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:41.765590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-854a89a9-2d14-4180-b8ba-2274dbf15181 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:41.780359 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-854a89a9-2d14-4180-b8ba-2274dbf15181 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] HTTP exception thrown: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-854a89a9-2d14-4180-b8ba-2274dbf15181 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Request method failure captured: Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a HTTP/1.1 Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzFQ2vLizXv-0F-MgRIpiXyEibY_kxkSM2EYhf_76f4Yzg4uNz9f1hiW7ZUxoZZgEMvk03CE7DmCEkes4ZvISQGLuK5qOnzLWzkfpL8ruFps5TAXJ1tYu_xPENd2xtzF5jkFYVyT7UrqsmlOZyu7GWTnBTwaFFG6ehsVTIiLA3QpBAI Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edc027a6f642454d8592b308777d59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edc027a6f642454d8592b308777d59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}] Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TestVolumeBootPattern-929733958 Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: a36875e5990b487bb1357e0b46dac402 Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '14ad35c3-e2f2-414b-a87e-d32a6961a04a'} Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:39:41.782048 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-854a89a9-2d14-4180-b8ba-2274dbf15181 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Returning 404 to user: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-854a89a9-2d14-4180-b8ba-2274dbf15181 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 404 len: 111 microversion: 2.1 time: 0.032747 Sep 06 11:39:41.786256 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3251/6452] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:39:41 2022] DELETE /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:39:41.792521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-372f2082-5477-463d-aecd-1252db7b4b09 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:41.793141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-372f2082-5477-463d-aecd-1252db7b4b09 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 14ad35c3-e2f2-414b-a87e-d32a6961a04a] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:41.800039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372f2082-5477-463d-aecd-1252db7b4b09 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:41.800526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372f2082-5477-463d-aecd-1252db7b4b09 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:41.800969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372f2082-5477-463d-aecd-1252db7b4b09 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:41.801669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372f2082-5477-463d-aecd-1252db7b4b09 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:41.802131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372f2082-5477-463d-aecd-1252db7b4b09 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:41.802563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-372f2082-5477-463d-aecd-1252db7b4b09 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:41.816408 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-372f2082-5477-463d-aecd-1252db7b4b09 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] HTTP exception thrown: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-372f2082-5477-463d-aecd-1252db7b4b09 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Request method failure captured: Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a HTTP/1.1 Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzFQ2vLizXv-0F-MgRIpiXyEibY_kxkSM2EYhf_76f4Yzg4uNz9f1hiW7ZUxoZZgEMvk03CE7DmCEkes4ZvISQGLuK5qOnzLWzkfpL8ruFps5TAXJ1tYu_xPENd2xtzF5jkFYVyT7UrqsmlOZyu7GWTnBTwaFFG6ehsVTIiLA3QpBAI Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edc027a6f642454d8592b308777d59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edc027a6f642454d8592b308777d59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}] Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestVolumeBootPattern-929733958 Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a36875e5990b487bb1357e0b46dac402 Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '14ad35c3-e2f2-414b-a87e-d32a6961a04a'} Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:39:41.817932 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:41.823780 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:39:41.823780 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:39:41.823780 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:39:41.823780 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:39:41.823780 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:39:41.823780 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. Sep 06 11:39:41.823780 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:39:41.823780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-372f2082-5477-463d-aecd-1252db7b4b09 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Returning 404 to user: Instance 14ad35c3-e2f2-414b-a87e-d32a6961a04a could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:39:41.823780 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-372f2082-5477-463d-aecd-1252db7b4b09 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a" status: 404 len: 111 microversion: 2.1 time: 0.030753 Sep 06 11:39:41.823780 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3202/6453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:41 2022] GET /compute/v2.1/servers/14ad35c3-e2f2-414b-a87e-d32a6961a04a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:39:51.619499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ded87d58-d436-4732-a6b6-85cae2dc84d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:51.622717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ded87d58-d436-4732-a6b6-85cae2dc84d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:51.629016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ded87d58-d436-4732-a6b6-85cae2dc84d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:51.629505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ded87d58-d436-4732-a6b6-85cae2dc84d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:51.629957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ded87d58-d436-4732-a6b6-85cae2dc84d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:51.630662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ded87d58-d436-4732-a6b6-85cae2dc84d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:51.631204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ded87d58-d436-4732-a6b6-85cae2dc84d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:51.631634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ded87d58-d436-4732-a6b6-85cae2dc84d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:51.684419 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ded87d58-d436-4732-a6b6-85cae2dc84d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c/action" status: 200 len: 24577 microversion: 2.1 time: 0.310160 Sep 06 11:39:51.685048 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3252/6454] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:39:51 2022] POST /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c/action => generated 24577 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:39:53.668110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1240040121", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "169b6d3b-4e9b-4155-abb3-f8285161aaf2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f6d6137d-8475-499d-9c0a-ad20e4d07df5"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:53.678550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:53.679250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:53.731871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] validate_networks() for [('f6d6137d-8475-499d-9c0a-ad20e4d07df5', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:39:54.474313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:39:54.474770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:39:54.475288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:39:54.475707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:39:54.476125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:39:54.485122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:54.485615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:54.486064 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:54.486791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:54.487293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:54.487725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:54.506344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Getting quotas for project edc027a6f642454d8592b308777d59e4. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:39:54.512243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Getting quotas for user a36875e5990b487bb1357e0b46dac402 and project edc027a6f642454d8592b308777d59e4. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:39:54.570818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:39:54.573002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='169b6d3b-4e9b-4155-abb3-f8285161aaf2',volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:39:54.970778 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.307781 Sep 06 11:39:54.971765 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3203/6455] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:39:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:39:54.983979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b19fb5d5-fde8-482f-a132-21f9d5171731 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:54.988636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b19fb5d5-fde8-482f-a132-21f9d5171731 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:54.988636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=34 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:55.043047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b19fb5d5-fde8-482f-a132-21f9d5171731 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:55.050588 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b19fb5d5-fde8-482f-a132-21f9d5171731 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1071 microversion: 2.1 time: 0.071509 Sep 06 11:39:55.051231 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3253/6456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:54 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1071 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:56.074331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6557b95c-8e09-472d-9219-de4521907437 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:56.075062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6557b95c-8e09-472d-9219-de4521907437 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:56.082270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6557b95c-8e09-472d-9219-de4521907437 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:56.082769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6557b95c-8e09-472d-9219-de4521907437 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:56.083247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6557b95c-8e09-472d-9219-de4521907437 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:56.083967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6557b95c-8e09-472d-9219-de4521907437 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:56.084472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6557b95c-8e09-472d-9219-de4521907437 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:56.084916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6557b95c-8e09-472d-9219-de4521907437 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:56.148383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6557b95c-8e09-472d-9219-de4521907437 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:56.156586 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6557b95c-8e09-472d-9219-de4521907437 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1121 microversion: 2.1 time: 0.087214 Sep 06 11:39:56.159713 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3204/6457] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:56 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1121 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:39:57.179957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4d98f1ed-0913-4e69-96ef-e865ff063769 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:57.180576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4d98f1ed-0913-4e69-96ef-e865ff063769 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:57.188675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d98f1ed-0913-4e69-96ef-e865ff063769 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:57.189174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d98f1ed-0913-4e69-96ef-e865ff063769 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:57.189618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d98f1ed-0913-4e69-96ef-e865ff063769 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:57.190328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d98f1ed-0913-4e69-96ef-e865ff063769 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:57.190789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d98f1ed-0913-4e69-96ef-e865ff063769 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:57.191254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d98f1ed-0913-4e69-96ef-e865ff063769 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:57.257419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4d98f1ed-0913-4e69-96ef-e865ff063769 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:57.266029 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4d98f1ed-0913-4e69-96ef-e865ff063769 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1177 microversion: 2.1 time: 0.090015 Sep 06 11:39:57.266615 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3254/6458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:57 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1177 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:58.075081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3dc8703-7404-40d5-adf4-2edd644ed608 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:58.076180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f3dc8703-7404-40d5-adf4-2edd644ed608 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:58.083427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3dc8703-7404-40d5-adf4-2edd644ed608 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:58.084119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3dc8703-7404-40d5-adf4-2edd644ed608 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:58.084735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3dc8703-7404-40d5-adf4-2edd644ed608 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:58.085631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3dc8703-7404-40d5-adf4-2edd644ed608 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:58.086255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3dc8703-7404-40d5-adf4-2edd644ed608 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:58.086924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f3dc8703-7404-40d5-adf4-2edd644ed608 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:58.225211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f3dc8703-7404-40d5-adf4-2edd644ed608 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:58.235345 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f3dc8703-7404-40d5-adf4-2edd644ed608 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1680 microversion: 2.1 time: 0.164137 Sep 06 11:39:58.235945 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3205/6459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:58 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:58.291676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bd8e2394-997c-402f-9ca2-e4773fe3810d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:58.292317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bd8e2394-997c-402f-9ca2-e4773fe3810d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:58.299887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd8e2394-997c-402f-9ca2-e4773fe3810d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:58.300473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd8e2394-997c-402f-9ca2-e4773fe3810d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:58.300994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd8e2394-997c-402f-9ca2-e4773fe3810d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:58.301816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd8e2394-997c-402f-9ca2-e4773fe3810d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:58.302417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd8e2394-997c-402f-9ca2-e4773fe3810d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:58.302877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd8e2394-997c-402f-9ca2-e4773fe3810d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:58.346950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-83e8cebe-9929-4d8d-94cf-f4c113307ba7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:58.349565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-83e8cebe-9929-4d8d-94cf-f4c113307ba7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:58.358498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83e8cebe-9929-4d8d-94cf-f4c113307ba7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:58.359038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83e8cebe-9929-4d8d-94cf-f4c113307ba7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:58.359484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83e8cebe-9929-4d8d-94cf-f4c113307ba7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:58.360256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83e8cebe-9929-4d8d-94cf-f4c113307ba7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:58.360731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83e8cebe-9929-4d8d-94cf-f4c113307ba7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:58.361181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-83e8cebe-9929-4d8d-94cf-f4c113307ba7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:58.417528 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-83e8cebe-9929-4d8d-94cf-f4c113307ba7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c/action" status: 200 len: 32647 microversion: 2.1 time: 0.074305 Sep 06 11:39:58.419092 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3206/6460] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:39:58 2022] POST /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c/action => generated 32647 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:39:58.476755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bd8e2394-997c-402f-9ca2-e4773fe3810d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:58.485806 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bd8e2394-997c-402f-9ca2-e4773fe3810d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1229 microversion: 2.1 time: 0.198635 Sep 06 11:39:58.486479 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3255/6461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:58 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1229 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:58.749786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4a7bbcaf-8dca-436b-825b-1a6e5eedb71b tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:58.750495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4a7bbcaf-8dca-436b-825b-1a6e5eedb71b tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:58.757729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a7bbcaf-8dca-436b-825b-1a6e5eedb71b tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:58.759880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a7bbcaf-8dca-436b-825b-1a6e5eedb71b tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:58.759880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a7bbcaf-8dca-436b-825b-1a6e5eedb71b tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:58.759880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a7bbcaf-8dca-436b-825b-1a6e5eedb71b tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:58.759880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a7bbcaf-8dca-436b-825b-1a6e5eedb71b tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:58.760767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a7bbcaf-8dca-436b-825b-1a6e5eedb71b tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:58.797615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-593e00de-1d14-4eab-9cdd-21cb315e06bc req-a7de6e08-c0e9-4dd4-9ee3-cdc36440a5ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35788763-b35e-4a7e-be2c-7426719f1e8d", "tag": "0d53e5e0-cd2b-4bbb-8f04-7b8eb61d1ba7"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:58.831805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-593e00de-1d14-4eab-9cdd-21cb315e06bc req-a7de6e08-c0e9-4dd4-9ee3-cdc36440a5ce service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:58.832451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-593e00de-1d14-4eab-9cdd-21cb315e06bc req-a7de6e08-c0e9-4dd4-9ee3-cdc36440a5ce service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:58.832967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-593e00de-1d14-4eab-9cdd-21cb315e06bc req-a7de6e08-c0e9-4dd4-9ee3-cdc36440a5ce service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:58.848597 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-593e00de-1d14-4eab-9cdd-21cb315e06bc req-a7de6e08-c0e9-4dd4-9ee3-cdc36440a5ce service nova] Creating event network-changed:0d53e5e0-cd2b-4bbb-8f04-7b8eb61d1ba7 for instance 35788763-b35e-4a7e-be2c-7426719f1e8d on nch2-master-1 Sep 06 11:39:58.853571 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-593e00de-1d14-4eab-9cdd-21cb315e06bc req-a7de6e08-c0e9-4dd4-9ee3-cdc36440a5ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059869 Sep 06 11:39:58.854213 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3256/6462] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:39:58.911109 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4a7bbcaf-8dca-436b-825b-1a6e5eedb71b tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1831 microversion: 2.1 time: 0.287915 Sep 06 11:39:58.912501 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3207/6463] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:58 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1831 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:39:58.944452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fabc0a62-1854-426d-b981-196761388e67 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:39:58.946801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fabc0a62-1854-426d-b981-196761388e67 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:58.954727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fabc0a62-1854-426d-b981-196761388e67 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:58.955366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fabc0a62-1854-426d-b981-196761388e67 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:58.955949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fabc0a62-1854-426d-b981-196761388e67 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:58.956751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fabc0a62-1854-426d-b981-196761388e67 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:58.957285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fabc0a62-1854-426d-b981-196761388e67 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:58.957790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fabc0a62-1854-426d-b981-196761388e67 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:58.983321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-fabc0a62-1854-426d-b981-196761388e67 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lazy-loading 'flavor' on Instance uuid 875de0f0-0ad6-42df-9bb4-11b6f547590c {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:39:58.997094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fabc0a62-1854-426d-b981-196761388e67 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Going to try to live migrate instance to another host {{(pid=140876) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 06 11:39:59.513056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-96d65b5c-201e-4604-892a-7438357ca098 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:39:59.513685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-96d65b5c-201e-4604-892a-7438357ca098 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:39:59.521273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96d65b5c-201e-4604-892a-7438357ca098 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:59.522076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96d65b5c-201e-4604-892a-7438357ca098 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:59.522538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96d65b5c-201e-4604-892a-7438357ca098 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:59.523280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96d65b5c-201e-4604-892a-7438357ca098 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:39:59.523913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96d65b5c-201e-4604-892a-7438357ca098 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:39:59.524364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-96d65b5c-201e-4604-892a-7438357ca098 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:39:59.691593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-96d65b5c-201e-4604-892a-7438357ca098 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:39:59.700826 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-96d65b5c-201e-4604-892a-7438357ca098 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1217 microversion: 2.1 time: 0.191792 Sep 06 11:39:59.705183 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3208/6464] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:39:59 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1217 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:40:00.726216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ceda9999-94ae-44db-a343-7587d069b488 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:00.726854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ceda9999-94ae-44db-a343-7587d069b488 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:00.734503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ceda9999-94ae-44db-a343-7587d069b488 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:00.736579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ceda9999-94ae-44db-a343-7587d069b488 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:00.736579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ceda9999-94ae-44db-a343-7587d069b488 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:00.736579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ceda9999-94ae-44db-a343-7587d069b488 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:00.736876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ceda9999-94ae-44db-a343-7587d069b488 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:00.737073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ceda9999-94ae-44db-a343-7587d069b488 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:00.869214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ceda9999-94ae-44db-a343-7587d069b488 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:00.877400 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ceda9999-94ae-44db-a343-7587d069b488 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1217 microversion: 2.1 time: 0.155319 Sep 06 11:40:00.877983 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3209/6465] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:00 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:40:01.582939 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fabc0a62-1854-426d-b981-196761388e67 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c/action" status: 202 len: 0 microversion: 2.1 time: 2.643457 Sep 06 11:40:01.583596 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3257/6466] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:39:58 2022] POST /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c/action => generated 0 bytes in 2645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:40:01.593126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4e150b04-8b40-445e-8827-dc3aa89ac55c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:01.593747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4e150b04-8b40-445e-8827-dc3aa89ac55c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:01.599830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e150b04-8b40-445e-8827-dc3aa89ac55c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:01.612074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e150b04-8b40-445e-8827-dc3aa89ac55c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:01.612074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e150b04-8b40-445e-8827-dc3aa89ac55c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:01.612074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e150b04-8b40-445e-8827-dc3aa89ac55c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:01.612074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e150b04-8b40-445e-8827-dc3aa89ac55c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:01.612074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e150b04-8b40-445e-8827-dc3aa89ac55c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:01.743863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4e150b04-8b40-445e-8827-dc3aa89ac55c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:01.752113 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4e150b04-8b40-445e-8827-dc3aa89ac55c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1690 microversion: 2.1 time: 0.163505 Sep 06 11:40:01.752697 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3210/6467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:01 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:01.900857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ce60a7fe-ff95-4499-8ed1-e32fc1c3fe3f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:01.901559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ce60a7fe-ff95-4499-8ed1-e32fc1c3fe3f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:01.909307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce60a7fe-ff95-4499-8ed1-e32fc1c3fe3f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:01.909808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce60a7fe-ff95-4499-8ed1-e32fc1c3fe3f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:01.910258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce60a7fe-ff95-4499-8ed1-e32fc1c3fe3f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:01.911123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce60a7fe-ff95-4499-8ed1-e32fc1c3fe3f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:01.911507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce60a7fe-ff95-4499-8ed1-e32fc1c3fe3f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:01.911949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce60a7fe-ff95-4499-8ed1-e32fc1c3fe3f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:01.916958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:02.044456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce60a7fe-ff95-4499-8ed1-e32fc1c3fe3f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:02.052732 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ce60a7fe-ff95-4499-8ed1-e32fc1c3fe3f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1217 microversion: 2.1 time: 0.156007 Sep 06 11:40:02.053414 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3258/6468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:01 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:02.776711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a6e9c4e5-0ad1-475a-a5f6-fd0f1c058d77 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:02.777345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a6e9c4e5-0ad1-475a-a5f6-fd0f1c058d77 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:02.784852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6e9c4e5-0ad1-475a-a5f6-fd0f1c058d77 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:02.785379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6e9c4e5-0ad1-475a-a5f6-fd0f1c058d77 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:02.785819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6e9c4e5-0ad1-475a-a5f6-fd0f1c058d77 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:02.786542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6e9c4e5-0ad1-475a-a5f6-fd0f1c058d77 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:02.787049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6e9c4e5-0ad1-475a-a5f6-fd0f1c058d77 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:02.787480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6e9c4e5-0ad1-475a-a5f6-fd0f1c058d77 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:02.945672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a6e9c4e5-0ad1-475a-a5f6-fd0f1c058d77 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:02.955565 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a6e9c4e5-0ad1-475a-a5f6-fd0f1c058d77 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1690 microversion: 2.1 time: 0.182775 Sep 06 11:40:02.956458 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3211/6469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:02 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:03.075353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-83397464-045a-46b4-9069-0784f4b51569 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:03.075985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-83397464-045a-46b4-9069-0784f4b51569 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:03.083308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83397464-045a-46b4-9069-0784f4b51569 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:03.083834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83397464-045a-46b4-9069-0784f4b51569 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:03.084292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83397464-045a-46b4-9069-0784f4b51569 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:03.085002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83397464-045a-46b4-9069-0784f4b51569 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:03.085470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83397464-045a-46b4-9069-0784f4b51569 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:03.085909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-83397464-045a-46b4-9069-0784f4b51569 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:03.121790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-494fa4c4-0b66-4955-960e-a07c18939405 req-6bd14b87-cb40-44b4-b120-55d885fe07d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875de0f0-0ad6-42df-9bb4-11b6f547590c", "name": "network-vif-unplugged", "status": "completed", "tag": "b0d7b843-646f-4e01-9354-2d6b7fc13044"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:03.131854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-494fa4c4-0b66-4955-960e-a07c18939405 req-6bd14b87-cb40-44b4-b120-55d885fe07d4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:03.132340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-494fa4c4-0b66-4955-960e-a07c18939405 req-6bd14b87-cb40-44b4-b120-55d885fe07d4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:03.132784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-494fa4c4-0b66-4955-960e-a07c18939405 req-6bd14b87-cb40-44b4-b120-55d885fe07d4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:03.144332 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-494fa4c4-0b66-4955-960e-a07c18939405 req-6bd14b87-cb40-44b4-b120-55d885fe07d4 service nova] Creating event network-vif-unplugged:b0d7b843-646f-4e01-9354-2d6b7fc13044 for instance 875de0f0-0ad6-42df-9bb4-11b6f547590c on nch1-master-1 Sep 06 11:40:03.150180 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-494fa4c4-0b66-4955-960e-a07c18939405 req-6bd14b87-cb40-44b4-b120-55d885fe07d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031745 Sep 06 11:40:03.150791 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3212/6470] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:40:03.218062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-83397464-045a-46b4-9069-0784f4b51569 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:03.226065 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-83397464-045a-46b4-9069-0784f4b51569 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1217 microversion: 2.1 time: 0.155008 Sep 06 11:40:03.226662 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3259/6471] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:03 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:03.980411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3fae207e-168c-4e8e-9235-c452b5a59e31 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:03.981739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3fae207e-168c-4e8e-9235-c452b5a59e31 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:03.989847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3fae207e-168c-4e8e-9235-c452b5a59e31 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:03.995812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3fae207e-168c-4e8e-9235-c452b5a59e31 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:03.995812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3fae207e-168c-4e8e-9235-c452b5a59e31 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:03.995812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3fae207e-168c-4e8e-9235-c452b5a59e31 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:03.995812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3fae207e-168c-4e8e-9235-c452b5a59e31 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:03.995812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3fae207e-168c-4e8e-9235-c452b5a59e31 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:04.134345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3fae207e-168c-4e8e-9235-c452b5a59e31 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:04.142868 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3fae207e-168c-4e8e-9235-c452b5a59e31 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1690 microversion: 2.1 time: 0.166815 Sep 06 11:40:04.143549 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3213/6472] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:03 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:04.250200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-855655a7-1e08-4edb-aa09-62aa80a1af3a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:04.250848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-855655a7-1e08-4edb-aa09-62aa80a1af3a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:04.257886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-855655a7-1e08-4edb-aa09-62aa80a1af3a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:04.258340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-855655a7-1e08-4edb-aa09-62aa80a1af3a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:04.258790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-855655a7-1e08-4edb-aa09-62aa80a1af3a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:04.259523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-855655a7-1e08-4edb-aa09-62aa80a1af3a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:04.259988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-855655a7-1e08-4edb-aa09-62aa80a1af3a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:04.260426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-855655a7-1e08-4edb-aa09-62aa80a1af3a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:04.397434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-855655a7-1e08-4edb-aa09-62aa80a1af3a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:04.405974 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-855655a7-1e08-4edb-aa09-62aa80a1af3a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1217 microversion: 2.1 time: 0.160311 Sep 06 11:40:04.406782 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3260/6473] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:04 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:05.165347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-96d4c551-2018-4d97-868a-afdf66067e7e req-a33058d9-0826-49da-8220-dfab067b1747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875de0f0-0ad6-42df-9bb4-11b6f547590c", "tag": "b0d7b843-646f-4e01-9354-2d6b7fc13044"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:05.165826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-41e6e00e-7eb5-4f90-8773-fab437ed2eb3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:05.166116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-41e6e00e-7eb5-4f90-8773-fab437ed2eb3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:05.168568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:05.170363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:05.171074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:05.173494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41e6e00e-7eb5-4f90-8773-fab437ed2eb3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:05.174030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41e6e00e-7eb5-4f90-8773-fab437ed2eb3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:05.174474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41e6e00e-7eb5-4f90-8773-fab437ed2eb3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:05.175200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41e6e00e-7eb5-4f90-8773-fab437ed2eb3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:05.177610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41e6e00e-7eb5-4f90-8773-fab437ed2eb3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:05.177610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-41e6e00e-7eb5-4f90-8773-fab437ed2eb3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:05.177829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-96d4c551-2018-4d97-868a-afdf66067e7e req-a33058d9-0826-49da-8220-dfab067b1747 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:05.177829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-96d4c551-2018-4d97-868a-afdf66067e7e req-a33058d9-0826-49da-8220-dfab067b1747 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:05.178189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-96d4c551-2018-4d97-868a-afdf66067e7e req-a33058d9-0826-49da-8220-dfab067b1747 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:05.189499 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-96d4c551-2018-4d97-868a-afdf66067e7e req-a33058d9-0826-49da-8220-dfab067b1747 service nova] Creating event network-changed:b0d7b843-646f-4e01-9354-2d6b7fc13044 for instance 875de0f0-0ad6-42df-9bb4-11b6f547590c on nch1-master-1 Sep 06 11:40:05.194445 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-96d4c551-2018-4d97-868a-afdf66067e7e req-a33058d9-0826-49da-8220-dfab067b1747 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032959 Sep 06 11:40:05.195404 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3214/6474] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:40:05.318089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-41e6e00e-7eb5-4f90-8773-fab437ed2eb3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:05.326709 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-41e6e00e-7eb5-4f90-8773-fab437ed2eb3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1690 microversion: 2.1 time: 0.165081 Sep 06 11:40:05.327434 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3261/6475] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:05 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:40:05.429638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ab2f4413-0e59-4654-81e5-84ff8462c5c0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:05.430446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ab2f4413-0e59-4654-81e5-84ff8462c5c0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:05.438490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab2f4413-0e59-4654-81e5-84ff8462c5c0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:05.439104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab2f4413-0e59-4654-81e5-84ff8462c5c0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:05.439568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab2f4413-0e59-4654-81e5-84ff8462c5c0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:05.440329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab2f4413-0e59-4654-81e5-84ff8462c5c0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:05.440809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab2f4413-0e59-4654-81e5-84ff8462c5c0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:05.441259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab2f4413-0e59-4654-81e5-84ff8462c5c0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:05.583172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ab2f4413-0e59-4654-81e5-84ff8462c5c0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:05.592055 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ab2f4413-0e59-4654-81e5-84ff8462c5c0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1217 microversion: 2.1 time: 0.166809 Sep 06 11:40:05.606981 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3215/6476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:05 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:05.675252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-db6f4851-14d0-4de4-bc56-041bd7db3fb7 req-8513d317-c288-4e80-ab3f-5fc3e8de0371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35788763-b35e-4a7e-be2c-7426719f1e8d", "name": "network-vif-plugged", "status": "completed", "tag": "0d53e5e0-cd2b-4bbb-8f04-7b8eb61d1ba7"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:05.687338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-db6f4851-14d0-4de4-bc56-041bd7db3fb7 req-8513d317-c288-4e80-ab3f-5fc3e8de0371 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:05.690874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-db6f4851-14d0-4de4-bc56-041bd7db3fb7 req-8513d317-c288-4e80-ab3f-5fc3e8de0371 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:05.690874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-db6f4851-14d0-4de4-bc56-041bd7db3fb7 req-8513d317-c288-4e80-ab3f-5fc3e8de0371 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:05.703732 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-db6f4851-14d0-4de4-bc56-041bd7db3fb7 req-8513d317-c288-4e80-ab3f-5fc3e8de0371 service nova] Creating event network-vif-plugged:0d53e5e0-cd2b-4bbb-8f04-7b8eb61d1ba7 for instance 35788763-b35e-4a7e-be2c-7426719f1e8d on nch2-master-1 Sep 06 11:40:05.709199 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-db6f4851-14d0-4de4-bc56-041bd7db3fb7 req-8513d317-c288-4e80-ab3f-5fc3e8de0371 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038270 Sep 06 11:40:05.710191 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3262/6477] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:40:06.350517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a6810787-7431-4c71-a24f-9f12ba20ea48 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:06.351189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a6810787-7431-4c71-a24f-9f12ba20ea48 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:06.358894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6810787-7431-4c71-a24f-9f12ba20ea48 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:06.359439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6810787-7431-4c71-a24f-9f12ba20ea48 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:06.359893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6810787-7431-4c71-a24f-9f12ba20ea48 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:06.360612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6810787-7431-4c71-a24f-9f12ba20ea48 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:06.361086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6810787-7431-4c71-a24f-9f12ba20ea48 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:06.361531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a6810787-7431-4c71-a24f-9f12ba20ea48 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:06.496184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a6810787-7431-4c71-a24f-9f12ba20ea48 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:06.504291 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a6810787-7431-4c71-a24f-9f12ba20ea48 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1690 microversion: 2.1 time: 0.157752 Sep 06 11:40:06.504866 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3216/6478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:06 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:06.615320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-de5b7547-f500-4974-824e-cdd34f2f410d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:06.615942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-de5b7547-f500-4974-824e-cdd34f2f410d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:06.623153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de5b7547-f500-4974-824e-cdd34f2f410d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:06.623643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de5b7547-f500-4974-824e-cdd34f2f410d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:06.624086 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de5b7547-f500-4974-824e-cdd34f2f410d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:06.624780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de5b7547-f500-4974-824e-cdd34f2f410d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:06.625240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de5b7547-f500-4974-824e-cdd34f2f410d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:06.625667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de5b7547-f500-4974-824e-cdd34f2f410d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:06.757836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-de5b7547-f500-4974-824e-cdd34f2f410d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:06.766176 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-de5b7547-f500-4974-824e-cdd34f2f410d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1217 microversion: 2.1 time: 0.155423 Sep 06 11:40:06.766755 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3263/6479] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:06 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:07.527941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b9201c12-6faa-4930-ba93-74a15a689f39 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:07.528587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b9201c12-6faa-4930-ba93-74a15a689f39 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:07.536949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9201c12-6faa-4930-ba93-74a15a689f39 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:07.537448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9201c12-6faa-4930-ba93-74a15a689f39 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:07.537904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9201c12-6faa-4930-ba93-74a15a689f39 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:07.538630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9201c12-6faa-4930-ba93-74a15a689f39 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:07.539203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9201c12-6faa-4930-ba93-74a15a689f39 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:07.539582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9201c12-6faa-4930-ba93-74a15a689f39 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:07.673783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b9201c12-6faa-4930-ba93-74a15a689f39 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:07.681747 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b9201c12-6faa-4930-ba93-74a15a689f39 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1690 microversion: 2.1 time: 0.157832 Sep 06 11:40:07.682324 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3217/6480] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:07 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:07.790004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e0428d7c-4651-4ae0-b24b-27cfc781febd tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:07.790630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e0428d7c-4651-4ae0-b24b-27cfc781febd tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:07.798274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0428d7c-4651-4ae0-b24b-27cfc781febd tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:07.798809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0428d7c-4651-4ae0-b24b-27cfc781febd tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:07.799291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0428d7c-4651-4ae0-b24b-27cfc781febd tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:07.800003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0428d7c-4651-4ae0-b24b-27cfc781febd tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:07.800491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0428d7c-4651-4ae0-b24b-27cfc781febd tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:07.800933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e0428d7c-4651-4ae0-b24b-27cfc781febd tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:07.943968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e0428d7c-4651-4ae0-b24b-27cfc781febd tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:07.951931 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e0428d7c-4651-4ae0-b24b-27cfc781febd tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1405 microversion: 2.1 time: 0.166004 Sep 06 11:40:07.952509 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3264/6481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:07 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:07.974119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-13f5990a-3b8a-4f0b-80a7-addde8935e60 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:07.974734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-13f5990a-3b8a-4f0b-80a7-addde8935e60 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:07.981564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13f5990a-3b8a-4f0b-80a7-addde8935e60 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:07.982048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13f5990a-3b8a-4f0b-80a7-addde8935e60 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:07.982490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13f5990a-3b8a-4f0b-80a7-addde8935e60 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:07.983221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13f5990a-3b8a-4f0b-80a7-addde8935e60 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:07.983687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13f5990a-3b8a-4f0b-80a7-addde8935e60 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:07.984119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13f5990a-3b8a-4f0b-80a7-addde8935e60 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:08.111620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-13f5990a-3b8a-4f0b-80a7-addde8935e60 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:08.119476 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-13f5990a-3b8a-4f0b-80a7-addde8935e60 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1405 microversion: 2.1 time: 0.149219 Sep 06 11:40:08.120057 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3218/6482] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:07 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:08.142211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-791331b2-7906-404c-aba5-548f983ff9b6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1779736009"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:08.144547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-791331b2-7906-404c-aba5-548f983ff9b6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:08.150521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-791331b2-7906-404c-aba5-548f983ff9b6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:08.151038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-791331b2-7906-404c-aba5-548f983ff9b6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:08.151494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-791331b2-7906-404c-aba5-548f983ff9b6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:08.152785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-791331b2-7906-404c-aba5-548f983ff9b6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:08.153258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-791331b2-7906-404c-aba5-548f983ff9b6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:08.153693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-791331b2-7906-404c-aba5-548f983ff9b6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:08.242900 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.compute.api [None req-791331b2-7906-404c-aba5-548f983ff9b6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Attempting to quiesce instance before volume snapshot. Sep 06 11:40:08.259232 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.compute.api [None req-791331b2-7906-404c-aba5-548f983ff9b6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 06 11:40:08.484158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-791331b2-7906-404c-aba5-548f983ff9b6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Creating snapshot from volume 169b6d3b-4e9b-4155-abb3-f8285161aaf2. {{(pid=140876) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 06 11:40:08.709624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b9adcaf7-337a-4658-a214-0c4dfb0d2a21 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:08.710180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b9adcaf7-337a-4658-a214-0c4dfb0d2a21 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:08.717309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9adcaf7-337a-4658-a214-0c4dfb0d2a21 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:08.717807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9adcaf7-337a-4658-a214-0c4dfb0d2a21 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:08.718258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9adcaf7-337a-4658-a214-0c4dfb0d2a21 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:08.718967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9adcaf7-337a-4658-a214-0c4dfb0d2a21 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:08.719465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9adcaf7-337a-4658-a214-0c4dfb0d2a21 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:08.719908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b9adcaf7-337a-4658-a214-0c4dfb0d2a21 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:08.857528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b9adcaf7-337a-4658-a214-0c4dfb0d2a21 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:08.865598 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b9adcaf7-337a-4658-a214-0c4dfb0d2a21 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1690 microversion: 2.1 time: 0.160036 Sep 06 11:40:08.866194 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3219/6483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:08 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:40:09.893156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-12a463a3-47e3-434d-a966-b92e9d7f01b4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:09.894942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-12a463a3-47e3-434d-a966-b92e9d7f01b4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:09.902674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12a463a3-47e3-434d-a966-b92e9d7f01b4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:09.903211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12a463a3-47e3-434d-a966-b92e9d7f01b4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:09.910448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12a463a3-47e3-434d-a966-b92e9d7f01b4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:09.910448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12a463a3-47e3-434d-a966-b92e9d7f01b4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:09.910448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12a463a3-47e3-434d-a966-b92e9d7f01b4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:09.910448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-12a463a3-47e3-434d-a966-b92e9d7f01b4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:10.046632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-12a463a3-47e3-434d-a966-b92e9d7f01b4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:10.056178 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-12a463a3-47e3-434d-a966-b92e9d7f01b4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1690 microversion: 2.1 time: 0.170540 Sep 06 11:40:10.056891 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3220/6484] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:09 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:40:10.202462 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-791331b2-7906-404c-aba5-548f983ff9b6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "POST /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d/action" status: 202 len: 0 microversion: 2.1 time: 2.064196 Sep 06 11:40:10.204052 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3265/6485] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:40:08 2022] POST /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d/action => generated 0 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 06 11:40:11.080794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f138544d-9b6f-4ee0-b59c-5ed1a0716fc5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:11.081427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f138544d-9b6f-4ee0-b59c-5ed1a0716fc5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:11.088634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f138544d-9b6f-4ee0-b59c-5ed1a0716fc5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:11.089145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f138544d-9b6f-4ee0-b59c-5ed1a0716fc5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:11.090492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f138544d-9b6f-4ee0-b59c-5ed1a0716fc5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:11.091375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f138544d-9b6f-4ee0-b59c-5ed1a0716fc5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:11.091837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f138544d-9b6f-4ee0-b59c-5ed1a0716fc5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:11.092282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f138544d-9b6f-4ee0-b59c-5ed1a0716fc5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:11.227108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f138544d-9b6f-4ee0-b59c-5ed1a0716fc5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:11.230675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:11.235422 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f138544d-9b6f-4ee0-b59c-5ed1a0716fc5 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1690 microversion: 2.1 time: 0.158698 Sep 06 11:40:11.236005 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3221/6486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:11 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:11.362750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-840169829", "imageRef": "f810b1b0-dcb4-48a0-93c6-d8e0c85499cf", "flavorRef": "452", "networks": [{"uuid": "f6d6137d-8475-499d-9c0a-ad20e4d07df5"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:11.417770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] validate_networks() for [('f6d6137d-8475-499d-9c0a-ad20e4d07df5', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:40:11.800874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:40:11.801261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:40:11.801973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:40:11.802405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:40:11.802837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:40:11.812589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:11.813118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:11.813579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:11.814331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:11.814811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:11.815335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:11.833410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Getting quotas for project edc027a6f642454d8592b308777d59e4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:40:11.838843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Getting quotas for user a36875e5990b487bb1357e0b46dac402 and project edc027a6f642454d8592b308777d59e4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:40:11.851324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:40:11.854294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3c8fc43c-28ea-4093-9f52-c2d8acd25044',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:40:12.010822 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a35a9a57-4369-4afe-923b-b3512ca823f2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653105 Sep 06 11:40:12.011534 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3266/6487] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:40:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:40:12.022925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-35d76b22-b753-49ec-9f71-c311bce5324b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:12.023587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-35d76b22-b753-49ec-9f71-c311bce5324b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:12.085763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-35d76b22-b753-49ec-9f71-c311bce5324b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:12.094655 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-35d76b22-b753-49ec-9f71-c311bce5324b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1229 microversion: 2.1 time: 0.075812 Sep 06 11:40:12.095287 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3222/6488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:12 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1229 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:12.259037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-da760cf9-75da-476f-8377-12d404051ac3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:12.259561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-da760cf9-75da-476f-8377-12d404051ac3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:12.269040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da760cf9-75da-476f-8377-12d404051ac3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:12.269543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da760cf9-75da-476f-8377-12d404051ac3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:12.270003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da760cf9-75da-476f-8377-12d404051ac3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:12.270719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da760cf9-75da-476f-8377-12d404051ac3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:12.271221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da760cf9-75da-476f-8377-12d404051ac3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:12.271671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da760cf9-75da-476f-8377-12d404051ac3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:12.422190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-da760cf9-75da-476f-8377-12d404051ac3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:12.432359 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-da760cf9-75da-476f-8377-12d404051ac3 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1680 microversion: 2.1 time: 0.177414 Sep 06 11:40:12.432970 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3267/6489] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:12 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:12.455227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f29470df-0a74-424a-897c-d45d149b8875 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:12.455878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f29470df-0a74-424a-897c-d45d149b8875 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:12.469979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f29470df-0a74-424a-897c-d45d149b8875 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:12.470485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f29470df-0a74-424a-897c-d45d149b8875 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:12.470964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f29470df-0a74-424a-897c-d45d149b8875 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:12.472161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f29470df-0a74-424a-897c-d45d149b8875 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:12.472161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f29470df-0a74-424a-897c-d45d149b8875 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:12.472591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f29470df-0a74-424a-897c-d45d149b8875 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:12.605516 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f29470df-0a74-424a-897c-d45d149b8875 tempest-TestNetworkAdvancedServerOps-1246086125 tempest-TestNetworkAdvancedServerOps-1246086125-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1831 microversion: 2.1 time: 0.154067 Sep 06 11:40:12.606035 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3223/6490] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:12 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1831 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:12.632048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-901595c9-e183-45c8-bdb3-a78bde63e519 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:12.632764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-901595c9-e183-45c8-bdb3-a78bde63e519 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:12.639749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-901595c9-e183-45c8-bdb3-a78bde63e519 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:12.640313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-901595c9-e183-45c8-bdb3-a78bde63e519 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:12.640774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-901595c9-e183-45c8-bdb3-a78bde63e519 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:12.641629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-901595c9-e183-45c8-bdb3-a78bde63e519 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:12.642105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-901595c9-e183-45c8-bdb3-a78bde63e519 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:12.642556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-901595c9-e183-45c8-bdb3-a78bde63e519 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:12.787528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-901595c9-e183-45c8-bdb3-a78bde63e519 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:12.795514 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-901595c9-e183-45c8-bdb3-a78bde63e519 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1680 microversion: 2.1 time: 0.167330 Sep 06 11:40:12.796098 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3268/6491] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:12 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:12.894092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b8cbe31c-936f-47e8-8a32-7e3976831dda tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:12.896405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b8cbe31c-936f-47e8-8a32-7e3976831dda tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:12.902610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8cbe31c-936f-47e8-8a32-7e3976831dda tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:12.908194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8cbe31c-936f-47e8-8a32-7e3976831dda tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:12.908194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8cbe31c-936f-47e8-8a32-7e3976831dda tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:12.908194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8cbe31c-936f-47e8-8a32-7e3976831dda tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:12.908194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8cbe31c-936f-47e8-8a32-7e3976831dda tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:12.908194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8cbe31c-936f-47e8-8a32-7e3976831dda tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:12.968160 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b8cbe31c-936f-47e8-8a32-7e3976831dda tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c/action" status: 200 len: 38555 microversion: 2.1 time: 0.077835 Sep 06 11:40:12.968829 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3224/6492] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:40:12 2022] POST /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c/action => generated 38555 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:40:13.118478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1de4b192-35d6-4392-997f-bc86ced691e1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:13.119153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1de4b192-35d6-4392-997f-bc86ced691e1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:13.126590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de4b192-35d6-4392-997f-bc86ced691e1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:13.126849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de4b192-35d6-4392-997f-bc86ced691e1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:13.127352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de4b192-35d6-4392-997f-bc86ced691e1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:13.128067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de4b192-35d6-4392-997f-bc86ced691e1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:13.128539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de4b192-35d6-4392-997f-bc86ced691e1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:13.128979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1de4b192-35d6-4392-997f-bc86ced691e1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:13.191492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1de4b192-35d6-4392-997f-bc86ced691e1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:13.199899 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1de4b192-35d6-4392-997f-bc86ced691e1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1233 microversion: 2.1 time: 0.084881 Sep 06 11:40:13.200540 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3269/6493] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:13 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:14.223361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1944ab49-05f2-4df3-8eee-79b79f055ad6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:14.224079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1944ab49-05f2-4df3-8eee-79b79f055ad6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:14.232203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1944ab49-05f2-4df3-8eee-79b79f055ad6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:14.232711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1944ab49-05f2-4df3-8eee-79b79f055ad6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:14.233168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1944ab49-05f2-4df3-8eee-79b79f055ad6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:14.233893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1944ab49-05f2-4df3-8eee-79b79f055ad6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:14.234413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1944ab49-05f2-4df3-8eee-79b79f055ad6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:14.234792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1944ab49-05f2-4df3-8eee-79b79f055ad6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:14.305329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1944ab49-05f2-4df3-8eee-79b79f055ad6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:14.314540 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1944ab49-05f2-4df3-8eee-79b79f055ad6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1299 microversion: 2.1 time: 0.095738 Sep 06 11:40:14.315511 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3225/6494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:14 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:15.337954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e1317170-fe99-4f31-84a5-1e14148f132e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:15.339168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e1317170-fe99-4f31-84a5-1e14148f132e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:15.346668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1317170-fe99-4f31-84a5-1e14148f132e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:15.347544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1317170-fe99-4f31-84a5-1e14148f132e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:15.348845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1317170-fe99-4f31-84a5-1e14148f132e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:15.348845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1317170-fe99-4f31-84a5-1e14148f132e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:15.349128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1317170-fe99-4f31-84a5-1e14148f132e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:15.349755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e1317170-fe99-4f31-84a5-1e14148f132e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:15.492686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e1317170-fe99-4f31-84a5-1e14148f132e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:15.501322 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e1317170-fe99-4f31-84a5-1e14148f132e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1341 microversion: 2.1 time: 0.167414 Sep 06 11:40:15.501916 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3270/6495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:15 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:15.802529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-a9576f2a-98f3-4987-9329-00964ac086ef req-019aaa2f-0999-46ae-93a7-e5a80ded5914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846c8ef7-96fe-4495-bc7b-dc7bcea84dd2", "tag": "7be0b0ff-4518-4534-888a-2b0c5d769b51"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:15.816864 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a9576f2a-98f3-4987-9329-00964ac086ef req-019aaa2f-0999-46ae-93a7-e5a80ded5914 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:15.820622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a9576f2a-98f3-4987-9329-00964ac086ef req-019aaa2f-0999-46ae-93a7-e5a80ded5914 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:15.820622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-a9576f2a-98f3-4987-9329-00964ac086ef req-019aaa2f-0999-46ae-93a7-e5a80ded5914 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:15.834034 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-a9576f2a-98f3-4987-9329-00964ac086ef req-019aaa2f-0999-46ae-93a7-e5a80ded5914 service nova] Creating event network-changed:7be0b0ff-4518-4534-888a-2b0c5d769b51 for instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 on nch1-master-1 Sep 06 11:40:15.839250 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-a9576f2a-98f3-4987-9329-00964ac086ef req-019aaa2f-0999-46ae-93a7-e5a80ded5914 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041105 Sep 06 11:40:15.839885 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3226/6496] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:40:16.524947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-28072fc0-130a-4fd5-886b-29bd3650a1cb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:16.525623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-28072fc0-130a-4fd5-886b-29bd3650a1cb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:16.533868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28072fc0-130a-4fd5-886b-29bd3650a1cb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:16.534376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28072fc0-130a-4fd5-886b-29bd3650a1cb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:16.534839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28072fc0-130a-4fd5-886b-29bd3650a1cb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:16.535598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28072fc0-130a-4fd5-886b-29bd3650a1cb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:16.536073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28072fc0-130a-4fd5-886b-29bd3650a1cb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:16.536515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-28072fc0-130a-4fd5-886b-29bd3650a1cb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:16.673373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-28072fc0-130a-4fd5-886b-29bd3650a1cb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:16.695191 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-28072fc0-130a-4fd5-886b-29bd3650a1cb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1341 microversion: 2.1 time: 0.174399 Sep 06 11:40:16.695808 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3271/6497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:16 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1341 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:40:17.644435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e4100528-6eda-4193-8684-61fa88cc5652 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:17.645096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e4100528-6eda-4193-8684-61fa88cc5652 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:17.651812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4100528-6eda-4193-8684-61fa88cc5652 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:17.652317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4100528-6eda-4193-8684-61fa88cc5652 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:17.652782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4100528-6eda-4193-8684-61fa88cc5652 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:17.653499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4100528-6eda-4193-8684-61fa88cc5652 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:17.653971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4100528-6eda-4193-8684-61fa88cc5652 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:17.654416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e4100528-6eda-4193-8684-61fa88cc5652 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:17.682232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e4100528-6eda-4193-8684-61fa88cc5652 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:40:17.721179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3e0d3a32-c1de-437b-9a40-c6642a85272e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:17.722173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3e0d3a32-c1de-437b-9a40-c6642a85272e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:17.729457 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0d3a32-c1de-437b-9a40-c6642a85272e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:17.730274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0d3a32-c1de-437b-9a40-c6642a85272e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:17.731539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0d3a32-c1de-437b-9a40-c6642a85272e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:17.732348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0d3a32-c1de-437b-9a40-c6642a85272e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:17.732837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0d3a32-c1de-437b-9a40-c6642a85272e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:17.736059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e0d3a32-c1de-437b-9a40-c6642a85272e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:17.895579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3e0d3a32-c1de-437b-9a40-c6642a85272e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:17.907425 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3e0d3a32-c1de-437b-9a40-c6642a85272e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1341 microversion: 2.1 time: 0.190118 Sep 06 11:40:17.908184 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3272/6498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:17 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1341 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:17.932271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-23100d09-55fe-49c9-bafe-03e0fc024e79 req-d792fc75-e2ea-47a9-87d8-e0d479bd8065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875de0f0-0ad6-42df-9bb4-11b6f547590c", "tag": "b0d7b843-646f-4e01-9354-2d6b7fc13044"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:17.944722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-23100d09-55fe-49c9-bafe-03e0fc024e79 req-d792fc75-e2ea-47a9-87d8-e0d479bd8065 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:17.945225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-23100d09-55fe-49c9-bafe-03e0fc024e79 req-d792fc75-e2ea-47a9-87d8-e0d479bd8065 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:17.945676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-23100d09-55fe-49c9-bafe-03e0fc024e79 req-d792fc75-e2ea-47a9-87d8-e0d479bd8065 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:17.960983 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-23100d09-55fe-49c9-bafe-03e0fc024e79 req-d792fc75-e2ea-47a9-87d8-e0d479bd8065 service nova] Creating event network-changed:b0d7b843-646f-4e01-9354-2d6b7fc13044 for instance 875de0f0-0ad6-42df-9bb4-11b6f547590c on nch2-master-1 Sep 06 11:40:17.966465 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-23100d09-55fe-49c9-bafe-03e0fc024e79 req-d792fc75-e2ea-47a9-87d8-e0d479bd8065 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040570 Sep 06 11:40:17.967746 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e4100528-6eda-4193-8684-61fa88cc5652 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "DELETE /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 204 len: 0 microversion: 2.1 time: 0.329517 Sep 06 11:40:17.968057 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3273/6499] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:40:17.968710 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3227/6500] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:40:17 2022] DELETE /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:40:17.978092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-72b3cc06-c8ee-47aa-91dd-71326e9098cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:17.979101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-72b3cc06-c8ee-47aa-91dd-71326e9098cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:17.986975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72b3cc06-c8ee-47aa-91dd-71326e9098cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:17.987741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72b3cc06-c8ee-47aa-91dd-71326e9098cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:17.988399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72b3cc06-c8ee-47aa-91dd-71326e9098cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:17.989194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72b3cc06-c8ee-47aa-91dd-71326e9098cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:17.990105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72b3cc06-c8ee-47aa-91dd-71326e9098cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:17.990227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72b3cc06-c8ee-47aa-91dd-71326e9098cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:18.020594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:18.162986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-72b3cc06-c8ee-47aa-91dd-71326e9098cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:18.172070 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-72b3cc06-c8ee-47aa-91dd-71326e9098cc tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1686 microversion: 2.1 time: 0.198684 Sep 06 11:40:18.172764 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3274/6501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:17 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1686 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:18.941595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a4921df9-0077-4e25-a560-562c1b17e99f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:18.942546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a4921df9-0077-4e25-a560-562c1b17e99f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:18.955588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4921df9-0077-4e25-a560-562c1b17e99f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:18.956313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4921df9-0077-4e25-a560-562c1b17e99f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:18.957314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4921df9-0077-4e25-a560-562c1b17e99f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:18.958277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4921df9-0077-4e25-a560-562c1b17e99f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:18.958971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4921df9-0077-4e25-a560-562c1b17e99f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:18.959665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a4921df9-0077-4e25-a560-562c1b17e99f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:19.147418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a4921df9-0077-4e25-a560-562c1b17e99f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:19.157268 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a4921df9-0077-4e25-a560-562c1b17e99f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1341 microversion: 2.1 time: 0.220334 Sep 06 11:40:19.159243 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3228/6502] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:18 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1341 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:19.198936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0bb88e0c-d35b-4bac-83f9-61c6db815bfe tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:19.200582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0bb88e0c-d35b-4bac-83f9-61c6db815bfe tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:19.207923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bb88e0c-d35b-4bac-83f9-61c6db815bfe tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:19.208551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bb88e0c-d35b-4bac-83f9-61c6db815bfe tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:19.209234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bb88e0c-d35b-4bac-83f9-61c6db815bfe tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:19.210190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bb88e0c-d35b-4bac-83f9-61c6db815bfe tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:19.210897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bb88e0c-d35b-4bac-83f9-61c6db815bfe tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:19.211556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0bb88e0c-d35b-4bac-83f9-61c6db815bfe tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:19.356055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0bb88e0c-d35b-4bac-83f9-61c6db815bfe tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:19.364700 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0bb88e0c-d35b-4bac-83f9-61c6db815bfe tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 200 len: 1686 microversion: 2.1 time: 0.171120 Sep 06 11:40:19.365878 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3275/6503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:19 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:19.987169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-fb138a08-6843-47b3-8be2-c5fd95ca3e5f req-e14d4e25-6212-4bca-8443-346a01d566d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875de0f0-0ad6-42df-9bb4-11b6f547590c", "name": "network-vif-deleted", "tag": "b0d7b843-646f-4e01-9354-2d6b7fc13044"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:19.997568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fb138a08-6843-47b3-8be2-c5fd95ca3e5f req-e14d4e25-6212-4bca-8443-346a01d566d0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:19.997991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fb138a08-6843-47b3-8be2-c5fd95ca3e5f req-e14d4e25-6212-4bca-8443-346a01d566d0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:19.998438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fb138a08-6843-47b3-8be2-c5fd95ca3e5f req-e14d4e25-6212-4bca-8443-346a01d566d0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:20.009826 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-fb138a08-6843-47b3-8be2-c5fd95ca3e5f req-e14d4e25-6212-4bca-8443-346a01d566d0 service nova] Creating event network-vif-deleted:b0d7b843-646f-4e01-9354-2d6b7fc13044 for instance 875de0f0-0ad6-42df-9bb4-11b6f547590c on nch2-master-1 Sep 06 11:40:20.015324 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-fb138a08-6843-47b3-8be2-c5fd95ca3e5f req-e14d4e25-6212-4bca-8443-346a01d566d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031809 Sep 06 11:40:20.015925 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3229/6504] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:40:20.182247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-daf5ddb5-780d-45ab-a360-214c2f87f5cf tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:20.182908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-daf5ddb5-780d-45ab-a360-214c2f87f5cf tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:20.190403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daf5ddb5-780d-45ab-a360-214c2f87f5cf tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:20.190913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daf5ddb5-780d-45ab-a360-214c2f87f5cf tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:20.191496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daf5ddb5-780d-45ab-a360-214c2f87f5cf tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:20.192212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daf5ddb5-780d-45ab-a360-214c2f87f5cf tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:20.192695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daf5ddb5-780d-45ab-a360-214c2f87f5cf tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:20.193146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daf5ddb5-780d-45ab-a360-214c2f87f5cf tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:20.323018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-daf5ddb5-780d-45ab-a360-214c2f87f5cf tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:20.331540 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-daf5ddb5-780d-45ab-a360-214c2f87f5cf tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1387 microversion: 2.1 time: 0.154193 Sep 06 11:40:20.332113 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3276/6505] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:20 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1387 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:20.390602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-59002aa2-bcf1-41f9-aa35-3fe999a47c99 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:20.391334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-59002aa2-bcf1-41f9-aa35-3fe999a47c99 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: 875de0f0-0ad6-42df-9bb4-11b6f547590c] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:20.397548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59002aa2-bcf1-41f9-aa35-3fe999a47c99 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:20.398030 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59002aa2-bcf1-41f9-aa35-3fe999a47c99 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:20.398473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59002aa2-bcf1-41f9-aa35-3fe999a47c99 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:20.399209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59002aa2-bcf1-41f9-aa35-3fe999a47c99 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:20.399671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59002aa2-bcf1-41f9-aa35-3fe999a47c99 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:20.400109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59002aa2-bcf1-41f9-aa35-3fe999a47c99 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:20.413518 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-59002aa2-bcf1-41f9-aa35-3fe999a47c99 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] HTTP exception thrown: Instance 875de0f0-0ad6-42df-9bb4-11b6f547590c could not be found. Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-59002aa2-bcf1-41f9-aa35-3fe999a47c99 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Request method failure captured: Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c HTTP/1.1 Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzBX9CuU5UzfyxndnVZJJmTYQ3vK0GMlL8LNZgpJ5tksaXSMavHz_rJbRFm6T87lgBe9pS926ALKmRt8aQ4iI83LdY1vm2a5H52JafVqkAEM9TtY6-ItP-NrdpPjrmU2smFwTA5uczMzMisnvP5xPvXyFn1yLnZV5ywo_B1CSGR_HGg Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aa117f0cf74342a3b24c0c247565a6c7 Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-993249934 Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa117f0cf74342a3b24c0c247565a6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa117f0cf74342a3b24c0c247565a6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa117f0cf74342a3b24c0c247565a6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa117f0cf74342a3b24c0c247565a6c7"}]}] Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestNetworkAdvancedServerOps-993249934 Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aa117f0cf74342a3b24c0c247565a6c7 Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-993249934 Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestNetworkAdvancedServerOps-993249934-project Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: fcaddf25fc12498b90d2cc1ec08e5da3 Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestNetworkAdvancedServerOps-993249934-project Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 875de0f0-0ad6-42df-9bb4-11b6f547590c could not be found. Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '875de0f0-0ad6-42df-9bb4-11b6f547590c'} Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 875de0f0-0ad6-42df-9bb4-11b6f547590c could not be found. Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 875de0f0-0ad6-42df-9bb4-11b6f547590c could not be found. Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:40:20.415224 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:40:20.421228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:40:20.421228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:40:20.421228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:40:20.421228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:40:20.421228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:40:20.421228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:40:20.421228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 875de0f0-0ad6-42df-9bb4-11b6f547590c could not be found. Sep 06 11:40:20.421228 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:40:20.421228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-59002aa2-bcf1-41f9-aa35-3fe999a47c99 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Returning 404 to user: Instance 875de0f0-0ad6-42df-9bb4-11b6f547590c could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:40:20.421228 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-59002aa2-bcf1-41f9-aa35-3fe999a47c99 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c" status: 404 len: 111 microversion: 2.1 time: 0.031006 Sep 06 11:40:20.421228 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3230/6506] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:20 2022] GET /compute/v2.1/servers/875de0f0-0ad6-42df-9bb4-11b6f547590c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:40:21.354952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-874fb8e2-59c4-4d7d-903a-5e40f2a6f9db tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:21.355649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-874fb8e2-59c4-4d7d-903a-5e40f2a6f9db tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:21.362693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-874fb8e2-59c4-4d7d-903a-5e40f2a6f9db tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:21.363243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-874fb8e2-59c4-4d7d-903a-5e40f2a6f9db tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:21.363709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-874fb8e2-59c4-4d7d-903a-5e40f2a6f9db tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:21.364440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-874fb8e2-59c4-4d7d-903a-5e40f2a6f9db tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:21.364922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-874fb8e2-59c4-4d7d-903a-5e40f2a6f9db tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:21.365374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-874fb8e2-59c4-4d7d-903a-5e40f2a6f9db tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:21.522300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-874fb8e2-59c4-4d7d-903a-5e40f2a6f9db tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:21.536919 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-874fb8e2-59c4-4d7d-903a-5e40f2a6f9db tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1375 microversion: 2.1 time: 0.185898 Sep 06 11:40:21.537513 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3277/6507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:21 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:22.562399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1523aca4-9d39-48c6-b6ec-9f7072453e7a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:22.563545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1523aca4-9d39-48c6-b6ec-9f7072453e7a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:22.566665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:22.571697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1523aca4-9d39-48c6-b6ec-9f7072453e7a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:22.575676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1523aca4-9d39-48c6-b6ec-9f7072453e7a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:22.575676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1523aca4-9d39-48c6-b6ec-9f7072453e7a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:22.575676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1523aca4-9d39-48c6-b6ec-9f7072453e7a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:22.575676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1523aca4-9d39-48c6-b6ec-9f7072453e7a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:22.575676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1523aca4-9d39-48c6-b6ec-9f7072453e7a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:22.741891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1523aca4-9d39-48c6-b6ec-9f7072453e7a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:22.752354 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1523aca4-9d39-48c6-b6ec-9f7072453e7a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1375 microversion: 2.1 time: 0.195414 Sep 06 11:40:22.753043 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3231/6508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:22 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1375 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:23.776296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76a484b5-1448-4d42-9ef4-60118a60f9c9 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:23.776937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-76a484b5-1448-4d42-9ef4-60118a60f9c9 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:23.779670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:23.781050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:23.786963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76a484b5-1448-4d42-9ef4-60118a60f9c9 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:23.787526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76a484b5-1448-4d42-9ef4-60118a60f9c9 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:23.787990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76a484b5-1448-4d42-9ef4-60118a60f9c9 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:23.789529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76a484b5-1448-4d42-9ef4-60118a60f9c9 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:23.790199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76a484b5-1448-4d42-9ef4-60118a60f9c9 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:23.792434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76a484b5-1448-4d42-9ef4-60118a60f9c9 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:23.961977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-76a484b5-1448-4d42-9ef4-60118a60f9c9 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:23.970804 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-76a484b5-1448-4d42-9ef4-60118a60f9c9 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1375 microversion: 2.1 time: 0.198454 Sep 06 11:40:23.976143 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3278/6509] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:23 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1375 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:24.308402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6c2a3d6b-cea0-49b1-89d8-5322e20f315a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '.version_select at 0x7f90f3d71280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:24.318398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:24.374594 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6c2a3d6b-cea0-49b1-89d8-5322e20f315a tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-72705516" status: 202 len: 0 microversion: 2.1 time: 0.070877 Sep 06 11:40:24.375234 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3232/6510] 10.222.0.20 () {58 vars in 1278 bytes} [Tue Sep 6 11:40:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-72705516 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:40:24.407291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-82fbb3a1-12f3-4a3a-a6a3-6db491cae0a4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'create', calling method: .version_select at 0x7f90f39fc5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-617033041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKy2LqBQnGVsfbhBedh8CcwhRaXsBO3dU9wsDn4RTc7Utf2qGeSRKTjMv39PXDQfpEwq8XvRvdw6iRYNAUbiSeNlqS10zXhzNCXPMWvK0iV3mBN9MKLakbU3botiK3XOJg=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:24.423550 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-82fbb3a1-12f3-4a3a-a6a3-6db491cae0a4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:40:24.428813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-82fbb3a1-12f3-4a3a-a6a3-6db491cae0a4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for user fcaddf25fc12498b90d2cc1ec08e5da3 and project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:40:24.515917 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-82fbb3a1-12f3-4a3a-a6a3-6db491cae0a4 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.112827 Sep 06 11:40:24.516555 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3279/6511] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:40:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:40:24.997126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b8b53d1e-a8f1-4255-a891-78c40f6500d4 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:24.998027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b8b53d1e-a8f1-4255-a891-78c40f6500d4 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:25.006992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b53d1e-a8f1-4255-a891-78c40f6500d4 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:25.008142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b53d1e-a8f1-4255-a891-78c40f6500d4 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:25.008679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b53d1e-a8f1-4255-a891-78c40f6500d4 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:25.009638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b53d1e-a8f1-4255-a891-78c40f6500d4 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:25.010294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b53d1e-a8f1-4255-a891-78c40f6500d4 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:25.010785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b53d1e-a8f1-4255-a891-78c40f6500d4 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:25.158379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b8b53d1e-a8f1-4255-a891-78c40f6500d4 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:25.167559 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b8b53d1e-a8f1-4255-a891-78c40f6500d4 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1375 microversion: 2.1 time: 0.174999 Sep 06 11:40:25.168444 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3233/6512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:24 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:26.193943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fc4700cc-0f72-4056-acfa-a32c96c8b70d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:26.194695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fc4700cc-0f72-4056-acfa-a32c96c8b70d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:26.196624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:26.202235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc4700cc-0f72-4056-acfa-a32c96c8b70d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:26.202967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc4700cc-0f72-4056-acfa-a32c96c8b70d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:26.203459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc4700cc-0f72-4056-acfa-a32c96c8b70d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:26.204178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc4700cc-0f72-4056-acfa-a32c96c8b70d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:26.204650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc4700cc-0f72-4056-acfa-a32c96c8b70d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:26.205095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc4700cc-0f72-4056-acfa-a32c96c8b70d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:26.339493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fc4700cc-0f72-4056-acfa-a32c96c8b70d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:26.347681 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fc4700cc-0f72-4056-acfa-a32c96c8b70d tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1375 microversion: 2.1 time: 0.158849 Sep 06 11:40:26.349178 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3280/6513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:26 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:40:26.902989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b0d76573-05d0-4676-b997-6966c6bda91b req-6103b0e5-fc9b-4861-b8b3-2094e94b4fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846c8ef7-96fe-4495-bc7b-dc7bcea84dd2", "name": "network-vif-plugged", "status": "completed", "tag": "7be0b0ff-4518-4534-888a-2b0c5d769b51"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:26.918492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b0d76573-05d0-4676-b997-6966c6bda91b req-6103b0e5-fc9b-4861-b8b3-2094e94b4fbe service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:26.919039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b0d76573-05d0-4676-b997-6966c6bda91b req-6103b0e5-fc9b-4861-b8b3-2094e94b4fbe service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:26.919472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b0d76573-05d0-4676-b997-6966c6bda91b req-6103b0e5-fc9b-4861-b8b3-2094e94b4fbe service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:26.931240 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b0d76573-05d0-4676-b997-6966c6bda91b req-6103b0e5-fc9b-4861-b8b3-2094e94b4fbe service nova] Creating event network-vif-plugged:7be0b0ff-4518-4534-888a-2b0c5d769b51 for instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 on nch1-master-1 Sep 06 11:40:26.936136 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b0d76573-05d0-4676-b997-6966c6bda91b req-6103b0e5-fc9b-4861-b8b3-2094e94b4fbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037547 Sep 06 11:40:26.940213 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3234/6514] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:40:27.373781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e11cc06-4ded-414a-9aea-132bb1aac816 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:27.374366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5e11cc06-4ded-414a-9aea-132bb1aac816 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:27.381461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e11cc06-4ded-414a-9aea-132bb1aac816 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:27.382130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e11cc06-4ded-414a-9aea-132bb1aac816 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:27.382592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e11cc06-4ded-414a-9aea-132bb1aac816 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:27.383325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e11cc06-4ded-414a-9aea-132bb1aac816 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:27.383800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e11cc06-4ded-414a-9aea-132bb1aac816 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:27.384241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e11cc06-4ded-414a-9aea-132bb1aac816 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:27.532846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5e11cc06-4ded-414a-9aea-132bb1aac816 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:27.540997 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5e11cc06-4ded-414a-9aea-132bb1aac816 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1375 microversion: 2.1 time: 0.172517 Sep 06 11:40:27.541585 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3281/6515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:27 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:28.566690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7f9df4c2-d696-473a-aa07-e7e9683456d8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:28.567440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7f9df4c2-d696-473a-aa07-e7e9683456d8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:28.573877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f9df4c2-d696-473a-aa07-e7e9683456d8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:28.574381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f9df4c2-d696-473a-aa07-e7e9683456d8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:28.574839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f9df4c2-d696-473a-aa07-e7e9683456d8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:28.576270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f9df4c2-d696-473a-aa07-e7e9683456d8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:28.576774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f9df4c2-d696-473a-aa07-e7e9683456d8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:28.577248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f9df4c2-d696-473a-aa07-e7e9683456d8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:28.737576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7f9df4c2-d696-473a-aa07-e7e9683456d8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:28.746041 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7f9df4c2-d696-473a-aa07-e7e9683456d8 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1375 microversion: 2.1 time: 0.184492 Sep 06 11:40:28.755208 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3235/6516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:28 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1375 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:29.772601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c155ec65-d402-4607-ae5b-d3c1df018a32 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:29.773267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c155ec65-d402-4607-ae5b-d3c1df018a32 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:29.781047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c155ec65-d402-4607-ae5b-d3c1df018a32 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:29.784406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c155ec65-d402-4607-ae5b-d3c1df018a32 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:29.784406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c155ec65-d402-4607-ae5b-d3c1df018a32 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:29.784406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c155ec65-d402-4607-ae5b-d3c1df018a32 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:29.784406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c155ec65-d402-4607-ae5b-d3c1df018a32 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:29.784406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c155ec65-d402-4607-ae5b-d3c1df018a32 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:29.929505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c155ec65-d402-4607-ae5b-d3c1df018a32 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:29.938117 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c155ec65-d402-4607-ae5b-d3c1df018a32 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1562 microversion: 2.1 time: 0.170277 Sep 06 11:40:29.938625 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3282/6517] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:29 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:29.961285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cf71b444-8054-4360-8ba9-b291b3675344 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:29.962061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cf71b444-8054-4360-8ba9-b291b3675344 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:29.969815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf71b444-8054-4360-8ba9-b291b3675344 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:29.970347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf71b444-8054-4360-8ba9-b291b3675344 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:29.970835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf71b444-8054-4360-8ba9-b291b3675344 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:29.971586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf71b444-8054-4360-8ba9-b291b3675344 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:29.972093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf71b444-8054-4360-8ba9-b291b3675344 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:29.972536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf71b444-8054-4360-8ba9-b291b3675344 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:30.118579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cf71b444-8054-4360-8ba9-b291b3675344 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:30.130964 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cf71b444-8054-4360-8ba9-b291b3675344 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1562 microversion: 2.1 time: 0.173749 Sep 06 11:40:30.136513 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3236/6518] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:29 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:30.215961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:30.216753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:30.222996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:30.223540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:30.224007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:30.224732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:30.225216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:30.225668 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:30.252277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:40:30.570676 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 204 len: 0 microversion: 2.1 time: 0.358061 Sep 06 11:40:30.571877 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3283/6519] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:40:30 2022] DELETE /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:40:30.581387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-906a8f29-195f-4b10-8334-af89168b0c82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:30.583489 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-906a8f29-195f-4b10-8334-af89168b0c82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:30.594527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-906a8f29-195f-4b10-8334-af89168b0c82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:30.595487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-906a8f29-195f-4b10-8334-af89168b0c82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:30.596433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-906a8f29-195f-4b10-8334-af89168b0c82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:30.597173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-906a8f29-195f-4b10-8334-af89168b0c82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:30.597650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-906a8f29-195f-4b10-8334-af89168b0c82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:30.598090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-906a8f29-195f-4b10-8334-af89168b0c82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:30.758046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-906a8f29-195f-4b10-8334-af89168b0c82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:30.769278 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-906a8f29-195f-4b10-8334-af89168b0c82 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1568 microversion: 2.1 time: 0.192117 Sep 06 11:40:30.770267 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3237/6520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:30 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:31.795912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5bd5e456-0366-43d8-947a-ec7940f23d2e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:31.797853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5bd5e456-0366-43d8-947a-ec7940f23d2e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:31.804849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bd5e456-0366-43d8-947a-ec7940f23d2e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:31.805366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bd5e456-0366-43d8-947a-ec7940f23d2e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:31.805828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bd5e456-0366-43d8-947a-ec7940f23d2e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:31.806729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bd5e456-0366-43d8-947a-ec7940f23d2e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:31.807258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bd5e456-0366-43d8-947a-ec7940f23d2e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:31.807707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5bd5e456-0366-43d8-947a-ec7940f23d2e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:31.999529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5bd5e456-0366-43d8-947a-ec7940f23d2e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:32.010298 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5bd5e456-0366-43d8-947a-ec7940f23d2e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1568 microversion: 2.1 time: 0.218441 Sep 06 11:40:32.011275 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3284/6521] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:31 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:32.957843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b61a11c1-da1d-441d-a082-81580544961a req-e02cb357-53c5-4662-b516-919cb832e530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846c8ef7-96fe-4495-bc7b-dc7bcea84dd2", "name": "network-vif-deleted", "tag": "7be0b0ff-4518-4534-888a-2b0c5d769b51"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:32.977194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b61a11c1-da1d-441d-a082-81580544961a req-e02cb357-53c5-4662-b516-919cb832e530 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:32.981703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b61a11c1-da1d-441d-a082-81580544961a req-e02cb357-53c5-4662-b516-919cb832e530 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:32.981703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b61a11c1-da1d-441d-a082-81580544961a req-e02cb357-53c5-4662-b516-919cb832e530 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:33.023035 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b61a11c1-da1d-441d-a082-81580544961a req-e02cb357-53c5-4662-b516-919cb832e530 service nova] Creating event network-vif-deleted:7be0b0ff-4518-4534-888a-2b0c5d769b51 for instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 on nch1-master-1 Sep 06 11:40:33.037126 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b61a11c1-da1d-441d-a082-81580544961a req-e02cb357-53c5-4662-b516-919cb832e530 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083564 Sep 06 11:40:33.038797 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3238/6522] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:40:33.044666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4091eda4-3ee8-4fd7-8e1b-0c28246d8b70 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:33.045495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4091eda4-3ee8-4fd7-8e1b-0c28246d8b70 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:33.066896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4091eda4-3ee8-4fd7-8e1b-0c28246d8b70 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:33.071856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4091eda4-3ee8-4fd7-8e1b-0c28246d8b70 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:33.072961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4091eda4-3ee8-4fd7-8e1b-0c28246d8b70 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:33.074499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4091eda4-3ee8-4fd7-8e1b-0c28246d8b70 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:33.080776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4091eda4-3ee8-4fd7-8e1b-0c28246d8b70 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:33.080776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4091eda4-3ee8-4fd7-8e1b-0c28246d8b70 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:33.216751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4091eda4-3ee8-4fd7-8e1b-0c28246d8b70 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:33.226212 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4091eda4-3ee8-4fd7-8e1b-0c28246d8b70 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1526 microversion: 2.1 time: 0.194892 Sep 06 11:40:33.248182 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3285/6523] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:33 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1526 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:40:33.954907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1254592972", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "0f826fc1-2587-4111-8dd3-1cbaffc84efc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-617033041", "security_groups": [{"name": "tempest-secgroup-smoke-1529849627"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:34.083732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] validate_networks() for [('0f826fc1-2587-4111-8dd3-1cbaffc84efc', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:40:34.253803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:34.253803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:34.259916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:34.260536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:34.261072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:34.262700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:34.263443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:34.263963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:34.301040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:34.301850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:34.302319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:34.302879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lazy-loading 'fault' on Instance uuid 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:40:34.370167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:34.376192 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a463ca4c-c84e-4984-a0a2-0f882d77ee72 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 200 len: 1365 microversion: 2.1 time: 0.128549 Sep 06 11:40:34.378109 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3286/6524] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:34 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 1365 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:40:34.523249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:40:34.523697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:40:34.524266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:40:34.524690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:40:34.525324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:40:34.535810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:34.536310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:34.536762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:34.538148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:34.538850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:34.539346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:34.558065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:40:34.564041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Getting quotas for user fcaddf25fc12498b90d2cc1ec08e5da3 and project aa117f0cf74342a3b24c0c247565a6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:40:34.578114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:40:34.580665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:40:34.735299 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-92a9fa95-e316-49d5-b6c7-58c683d9787d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.786703 Sep 06 11:40:34.742238 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3239/6525] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:40:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:40:34.749212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fdc63d6f-28f6-40a7-a6de-a7726bb13daa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:34.753376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fdc63d6f-28f6-40a7-a6de-a7726bb13daa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:34.755089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:34.811986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fdc63d6f-28f6-40a7-a6de-a7726bb13daa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:34.819977 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fdc63d6f-28f6-40a7-a6de-a7726bb13daa tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1266 microversion: 2.1 time: 0.076075 Sep 06 11:40:34.820561 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3287/6526] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:34 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:35.403524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ea6ebd2-0b2c-417b-be1b-ffd3be363801 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:35.404268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0ea6ebd2-0b2c-417b-be1b-ffd3be363801 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:35.412186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ea6ebd2-0b2c-417b-be1b-ffd3be363801 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:35.417711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ea6ebd2-0b2c-417b-be1b-ffd3be363801 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:35.417711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ea6ebd2-0b2c-417b-be1b-ffd3be363801 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:35.417711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ea6ebd2-0b2c-417b-be1b-ffd3be363801 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:35.417711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ea6ebd2-0b2c-417b-be1b-ffd3be363801 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:35.417711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ea6ebd2-0b2c-417b-be1b-ffd3be363801 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:35.428921 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-0ea6ebd2-0b2c-417b-be1b-ffd3be363801 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] HTTP exception thrown: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ea6ebd2-0b2c-417b-be1b-ffd3be363801 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Request method failure captured: Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 HTTP/1.1 Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzFQ2vLizXv-0F-MgRIpiXyEibY_kxkSM2EYhf_76f4Yzg4uNz9f1hiW7ZUxoZZgEMvk03CE7DmCEkes4ZvISQGLuK5qOnzLWzkfpL8ruFps5TAXJ1tYu_xPENd2xtzF5jkFYVyT7UrqsmlOZyu7GWTnBTwaFFG6ehsVTIiLA3QpBAI Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edc027a6f642454d8592b308777d59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edc027a6f642454d8592b308777d59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}] Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestVolumeBootPattern-929733958 Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a36875e5990b487bb1357e0b46dac402 Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '846c8ef7-96fe-4495-bc7b-dc7bcea84dd2'} Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:40:35.430620 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:40:35.439557 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:40:35.439557 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:40:35.439557 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:40:35.439557 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:40:35.439557 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:40:35.439557 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:40:35.439557 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:40:35.439557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ea6ebd2-0b2c-417b-be1b-ffd3be363801 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Returning 404 to user: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:40:35.439557 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0ea6ebd2-0b2c-417b-be1b-ffd3be363801 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 404 len: 111 microversion: 2.1 time: 0.034025 Sep 06 11:40:35.439557 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3240/6527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:35 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:40:35.853486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f2360860-dc03-48bf-9822-a060312c92a6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:35.854266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f2360860-dc03-48bf-9822-a060312c92a6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:35.862470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2360860-dc03-48bf-9822-a060312c92a6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:35.866079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2360860-dc03-48bf-9822-a060312c92a6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:35.866079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2360860-dc03-48bf-9822-a060312c92a6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:35.866079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2360860-dc03-48bf-9822-a060312c92a6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:35.866079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2360860-dc03-48bf-9822-a060312c92a6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:35.866079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f2360860-dc03-48bf-9822-a060312c92a6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:35.941673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f2360860-dc03-48bf-9822-a060312c92a6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:35.950970 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f2360860-dc03-48bf-9822-a060312c92a6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1270 microversion: 2.1 time: 0.105326 Sep 06 11:40:35.954151 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3288/6528] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:35 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:36.974582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3cec4d0c-31e6-4466-8004-549adca18350 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:36.975274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3cec4d0c-31e6-4466-8004-549adca18350 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:36.984758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cec4d0c-31e6-4466-8004-549adca18350 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:36.985256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cec4d0c-31e6-4466-8004-549adca18350 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:36.985957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cec4d0c-31e6-4466-8004-549adca18350 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:36.986700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cec4d0c-31e6-4466-8004-549adca18350 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:36.987403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cec4d0c-31e6-4466-8004-549adca18350 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:36.988066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cec4d0c-31e6-4466-8004-549adca18350 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:37.060562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3cec4d0c-31e6-4466-8004-549adca18350 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:37.076420 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3cec4d0c-31e6-4466-8004-549adca18350 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1326 microversion: 2.1 time: 0.106057 Sep 06 11:40:37.077220 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3241/6529] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:36 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:38.100923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0b035410-5622-4dc8-ae25-8147976f72cf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:38.101472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0b035410-5622-4dc8-ae25-8147976f72cf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:38.108978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b035410-5622-4dc8-ae25-8147976f72cf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:38.109481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b035410-5622-4dc8-ae25-8147976f72cf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:38.109959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b035410-5622-4dc8-ae25-8147976f72cf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:38.110662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b035410-5622-4dc8-ae25-8147976f72cf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:38.111192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b035410-5622-4dc8-ae25-8147976f72cf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:38.111649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b035410-5622-4dc8-ae25-8147976f72cf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:38.258860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0b035410-5622-4dc8-ae25-8147976f72cf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:38.267836 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0b035410-5622-4dc8-ae25-8147976f72cf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1392 microversion: 2.1 time: 0.170885 Sep 06 11:40:38.270848 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3289/6530] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:38 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:38.742467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-08cf8a09-6e62-4b60-be5c-bdb40b0faf9d req-a2b456ce-cd68-4212-92ed-02d2d03dcc60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a97b55-b81a-43c0-b068-60ab0517eb36", "tag": "ba90e0ab-8d57-43ad-9909-13475f849c34"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:38.754707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-08cf8a09-6e62-4b60-be5c-bdb40b0faf9d req-a2b456ce-cd68-4212-92ed-02d2d03dcc60 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:38.755233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-08cf8a09-6e62-4b60-be5c-bdb40b0faf9d req-a2b456ce-cd68-4212-92ed-02d2d03dcc60 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:38.755685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-08cf8a09-6e62-4b60-be5c-bdb40b0faf9d req-a2b456ce-cd68-4212-92ed-02d2d03dcc60 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:38.768349 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-08cf8a09-6e62-4b60-be5c-bdb40b0faf9d req-a2b456ce-cd68-4212-92ed-02d2d03dcc60 service nova] Creating event network-changed:ba90e0ab-8d57-43ad-9909-13475f849c34 for instance e3a97b55-b81a-43c0-b068-60ab0517eb36 on nch1-master-1 Sep 06 11:40:38.773318 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-08cf8a09-6e62-4b60-be5c-bdb40b0faf9d req-a2b456ce-cd68-4212-92ed-02d2d03dcc60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034791 Sep 06 11:40:38.773940 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3242/6531] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:40:39.291366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2248b232-2ece-41ac-a67c-f177d70f7ec2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:39.292047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2248b232-2ece-41ac-a67c-f177d70f7ec2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:39.299213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2248b232-2ece-41ac-a67c-f177d70f7ec2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:39.299717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2248b232-2ece-41ac-a67c-f177d70f7ec2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:39.300177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2248b232-2ece-41ac-a67c-f177d70f7ec2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:39.300898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2248b232-2ece-41ac-a67c-f177d70f7ec2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:39.301568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2248b232-2ece-41ac-a67c-f177d70f7ec2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:39.302134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2248b232-2ece-41ac-a67c-f177d70f7ec2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:39.442148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2248b232-2ece-41ac-a67c-f177d70f7ec2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:39.450207 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2248b232-2ece-41ac-a67c-f177d70f7ec2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1392 microversion: 2.1 time: 0.162782 Sep 06 11:40:39.450793 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3290/6532] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:39 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:40.473865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dbe6ad31-d35d-4343-ad4f-dc523a21cc8d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:40.474582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dbe6ad31-d35d-4343-ad4f-dc523a21cc8d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:40.480951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbe6ad31-d35d-4343-ad4f-dc523a21cc8d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:40.481443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbe6ad31-d35d-4343-ad4f-dc523a21cc8d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:40.481897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbe6ad31-d35d-4343-ad4f-dc523a21cc8d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:40.482603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbe6ad31-d35d-4343-ad4f-dc523a21cc8d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:40.483100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbe6ad31-d35d-4343-ad4f-dc523a21cc8d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:40.483541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dbe6ad31-d35d-4343-ad4f-dc523a21cc8d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:40.627291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dbe6ad31-d35d-4343-ad4f-dc523a21cc8d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:40.639813 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dbe6ad31-d35d-4343-ad4f-dc523a21cc8d tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1392 microversion: 2.1 time: 0.166592 Sep 06 11:40:40.639813 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3243/6533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:40 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:41.658580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6297e639-70d7-4b7e-aafb-370524adc887 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:41.659182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6297e639-70d7-4b7e-aafb-370524adc887 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:41.666286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6297e639-70d7-4b7e-aafb-370524adc887 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:41.666781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6297e639-70d7-4b7e-aafb-370524adc887 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:41.667269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6297e639-70d7-4b7e-aafb-370524adc887 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:41.667972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6297e639-70d7-4b7e-aafb-370524adc887 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:41.668941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6297e639-70d7-4b7e-aafb-370524adc887 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:41.669388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6297e639-70d7-4b7e-aafb-370524adc887 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:41.673510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:41.803129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6297e639-70d7-4b7e-aafb-370524adc887 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:41.813386 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6297e639-70d7-4b7e-aafb-370524adc887 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1392 microversion: 2.1 time: 0.159015 Sep 06 11:40:41.813973 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3291/6534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:41 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:42.836198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5f04d3ab-f1fa-436b-a751-576e7f7d1bf2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:42.836814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5f04d3ab-f1fa-436b-a751-576e7f7d1bf2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:42.843818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f04d3ab-f1fa-436b-a751-576e7f7d1bf2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:42.844308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f04d3ab-f1fa-436b-a751-576e7f7d1bf2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:42.844806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f04d3ab-f1fa-436b-a751-576e7f7d1bf2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:42.849315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f04d3ab-f1fa-436b-a751-576e7f7d1bf2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:42.849315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f04d3ab-f1fa-436b-a751-576e7f7d1bf2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:42.849315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f04d3ab-f1fa-436b-a751-576e7f7d1bf2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:42.849315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:42.991381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5f04d3ab-f1fa-436b-a751-576e7f7d1bf2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:42.999972 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5f04d3ab-f1fa-436b-a751-576e7f7d1bf2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1392 microversion: 2.1 time: 0.167701 Sep 06 11:40:43.004825 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3244/6535] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:42 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:44.025595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5555529e-5278-4541-8984-e0c732b8a1e9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:44.026271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5555529e-5278-4541-8984-e0c732b8a1e9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:44.034061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5555529e-5278-4541-8984-e0c732b8a1e9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:44.036088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5555529e-5278-4541-8984-e0c732b8a1e9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:44.036088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5555529e-5278-4541-8984-e0c732b8a1e9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:44.036088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5555529e-5278-4541-8984-e0c732b8a1e9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:44.036446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5555529e-5278-4541-8984-e0c732b8a1e9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:44.036643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5555529e-5278-4541-8984-e0c732b8a1e9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:44.172183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5555529e-5278-4541-8984-e0c732b8a1e9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:44.184636 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5555529e-5278-4541-8984-e0c732b8a1e9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1392 microversion: 2.1 time: 0.162416 Sep 06 11:40:44.187955 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3292/6536] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:44 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:45.076801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ef1804a7-b4e1-445c-a35d-e886ab7d877e req-57a5e2d5-5b7c-4452-a65d-eb28f623d15b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a97b55-b81a-43c0-b068-60ab0517eb36", "name": "network-vif-plugged", "status": "completed", "tag": "ba90e0ab-8d57-43ad-9909-13475f849c34"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:45.082481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:45.083208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:45.088459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ef1804a7-b4e1-445c-a35d-e886ab7d877e req-57a5e2d5-5b7c-4452-a65d-eb28f623d15b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:45.088949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ef1804a7-b4e1-445c-a35d-e886ab7d877e req-57a5e2d5-5b7c-4452-a65d-eb28f623d15b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:45.089394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ef1804a7-b4e1-445c-a35d-e886ab7d877e req-57a5e2d5-5b7c-4452-a65d-eb28f623d15b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:45.100613 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ef1804a7-b4e1-445c-a35d-e886ab7d877e req-57a5e2d5-5b7c-4452-a65d-eb28f623d15b service nova] Creating event network-vif-plugged:ba90e0ab-8d57-43ad-9909-13475f849c34 for instance e3a97b55-b81a-43c0-b068-60ab0517eb36 on nch1-master-1 Sep 06 11:40:45.105534 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ef1804a7-b4e1-445c-a35d-e886ab7d877e req-57a5e2d5-5b7c-4452-a65d-eb28f623d15b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033365 Sep 06 11:40:45.106142 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3245/6537] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:40:45.208934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-57d26997-eab7-45b4-95c8-128548ea409e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:45.209914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-57d26997-eab7-45b4-95c8-128548ea409e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:45.221906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57d26997-eab7-45b4-95c8-128548ea409e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:45.221906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57d26997-eab7-45b4-95c8-128548ea409e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:45.221906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57d26997-eab7-45b4-95c8-128548ea409e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:45.221906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57d26997-eab7-45b4-95c8-128548ea409e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:45.222441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57d26997-eab7-45b4-95c8-128548ea409e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:45.222666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-57d26997-eab7-45b4-95c8-128548ea409e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:45.363763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-57d26997-eab7-45b4-95c8-128548ea409e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:45.372041 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-57d26997-eab7-45b4-95c8-128548ea409e tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1392 microversion: 2.1 time: 0.166692 Sep 06 11:40:45.372625 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3293/6538] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:45 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:46.397437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-227f5b6f-dca0-4ccd-a54d-80e7365c85fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:46.398145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-227f5b6f-dca0-4ccd-a54d-80e7365c85fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:46.406424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-227f5b6f-dca0-4ccd-a54d-80e7365c85fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:46.406922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-227f5b6f-dca0-4ccd-a54d-80e7365c85fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:46.409493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-227f5b6f-dca0-4ccd-a54d-80e7365c85fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:46.409493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-227f5b6f-dca0-4ccd-a54d-80e7365c85fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:46.409493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-227f5b6f-dca0-4ccd-a54d-80e7365c85fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:46.409493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-227f5b6f-dca0-4ccd-a54d-80e7365c85fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:46.549777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-227f5b6f-dca0-4ccd-a54d-80e7365c85fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:46.557862 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-227f5b6f-dca0-4ccd-a54d-80e7365c85fd tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1565 microversion: 2.1 time: 0.166022 Sep 06 11:40:46.558479 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3246/6539] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:46 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:46.580873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-99fa4b21-afcb-4568-b2af-05e265271c0b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:46.581643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-99fa4b21-afcb-4568-b2af-05e265271c0b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:46.583572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:46.589337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99fa4b21-afcb-4568-b2af-05e265271c0b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:46.589830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99fa4b21-afcb-4568-b2af-05e265271c0b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:46.594867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99fa4b21-afcb-4568-b2af-05e265271c0b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:46.594867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99fa4b21-afcb-4568-b2af-05e265271c0b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:46.594867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99fa4b21-afcb-4568-b2af-05e265271c0b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:46.594867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-99fa4b21-afcb-4568-b2af-05e265271c0b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:46.726069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-99fa4b21-afcb-4568-b2af-05e265271c0b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:46.733958 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-99fa4b21-afcb-4568-b2af-05e265271c0b tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1565 microversion: 2.1 time: 0.157005 Sep 06 11:40:46.734547 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3294/6540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:46 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:40:48.983648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fc6739d2-2d0a-4ae0-ad1d-0747b4259844 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:40:48.984276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fc6739d2-2d0a-4ae0-ad1d-0747b4259844 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:40:48.992449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-d0b3a120-e6bb-4a21-83df-c703e83fe708 req-cba8605a-b7a7-4a6e-b748-3725cfe15eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a97b55-b81a-43c0-b068-60ab0517eb36", "tag": "ba90e0ab-8d57-43ad-9909-13475f849c34"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:40:49.003921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc6739d2-2d0a-4ae0-ad1d-0747b4259844 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:49.004421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc6739d2-2d0a-4ae0-ad1d-0747b4259844 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:49.005027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d0b3a120-e6bb-4a21-83df-c703e83fe708 req-cba8605a-b7a7-4a6e-b748-3725cfe15eb0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:49.005320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc6739d2-2d0a-4ae0-ad1d-0747b4259844 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:49.005554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d0b3a120-e6bb-4a21-83df-c703e83fe708 req-cba8605a-b7a7-4a6e-b748-3725cfe15eb0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:49.006004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d0b3a120-e6bb-4a21-83df-c703e83fe708 req-cba8605a-b7a7-4a6e-b748-3725cfe15eb0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:49.006316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc6739d2-2d0a-4ae0-ad1d-0747b4259844 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:40:49.006852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc6739d2-2d0a-4ae0-ad1d-0747b4259844 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:40:49.007446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc6739d2-2d0a-4ae0-ad1d-0747b4259844 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:40:49.018999 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d0b3a120-e6bb-4a21-83df-c703e83fe708 req-cba8605a-b7a7-4a6e-b748-3725cfe15eb0 service nova] Creating event network-changed:ba90e0ab-8d57-43ad-9909-13475f849c34 for instance e3a97b55-b81a-43c0-b068-60ab0517eb36 on nch1-master-1 Sep 06 11:40:49.025151 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-d0b3a120-e6bb-4a21-83df-c703e83fe708 req-cba8605a-b7a7-4a6e-b748-3725cfe15eb0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036276 Sep 06 11:40:49.026197 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3295/6541] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:40:49.246062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fc6739d2-2d0a-4ae0-ad1d-0747b4259844 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:40:49.256181 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fc6739d2-2d0a-4ae0-ad1d-0747b4259844 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1565 microversion: 2.1 time: 0.276463 Sep 06 11:40:49.256773 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3247/6542] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:40:48 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1565 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:11.794672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:11.795465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=24 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:11.800043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-24b65dbc-8c86-4faa-93ed-122c01f35204 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:11.800645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-24b65dbc-8c86-4faa-93ed-122c01f35204 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:11.806809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b65dbc-8c86-4faa-93ed-122c01f35204 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:11.807589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b65dbc-8c86-4faa-93ed-122c01f35204 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:11.807793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b65dbc-8c86-4faa-93ed-122c01f35204 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:11.808507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b65dbc-8c86-4faa-93ed-122c01f35204 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:11.808985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b65dbc-8c86-4faa-93ed-122c01f35204 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:11.809444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-24b65dbc-8c86-4faa-93ed-122c01f35204 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:11.835326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-24b65dbc-8c86-4faa-93ed-122c01f35204 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:41:12.161022 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-24b65dbc-8c86-4faa-93ed-122c01f35204 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 204 len: 0 microversion: 2.1 time: 0.368142 Sep 06 11:41:12.161601 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3296/6543] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:41:11 2022] DELETE /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:41:12.170316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56f6e781-9ab0-478a-86d4-d562ee35a1ca tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:12.170940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56f6e781-9ab0-478a-86d4-d562ee35a1ca tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:12.174659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:12.175363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=19 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:12.180146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56f6e781-9ab0-478a-86d4-d562ee35a1ca tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:12.180640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56f6e781-9ab0-478a-86d4-d562ee35a1ca tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:12.181093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56f6e781-9ab0-478a-86d4-d562ee35a1ca tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:12.181800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56f6e781-9ab0-478a-86d4-d562ee35a1ca tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:12.182275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56f6e781-9ab0-478a-86d4-d562ee35a1ca tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:12.182716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56f6e781-9ab0-478a-86d4-d562ee35a1ca tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:12.318899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-56f6e781-9ab0-478a-86d4-d562ee35a1ca tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:12.327262 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56f6e781-9ab0-478a-86d4-d562ee35a1ca tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1411 microversion: 2.1 time: 0.161125 Sep 06 11:41:12.327859 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3248/6544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:12 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1411 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:41:12.513551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7085263e-89d4-4ad0-b23e-eb56da0f8c0f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:41:12.515831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7085263e-89d4-4ad0-b23e-eb56da0f8c0f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:12.522342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7085263e-89d4-4ad0-b23e-eb56da0f8c0f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:12.522834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7085263e-89d4-4ad0-b23e-eb56da0f8c0f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:12.523326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7085263e-89d4-4ad0-b23e-eb56da0f8c0f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:12.524061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7085263e-89d4-4ad0-b23e-eb56da0f8c0f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:12.524531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7085263e-89d4-4ad0-b23e-eb56da0f8c0f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:12.524973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7085263e-89d4-4ad0-b23e-eb56da0f8c0f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:12.575542 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7085263e-89d4-4ad0-b23e-eb56da0f8c0f tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36/action" status: 200 len: 24576 microversion: 2.1 time: 0.066338 Sep 06 11:41:12.576392 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3297/6545] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:41:12 2022] POST /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36/action => generated 24576 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:41:13.351634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-90f6fef1-a8b6-4091-9a6e-06cc9acea950 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:13.352258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-90f6fef1-a8b6-4091-9a6e-06cc9acea950 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:13.359802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90f6fef1-a8b6-4091-9a6e-06cc9acea950 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:13.360297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90f6fef1-a8b6-4091-9a6e-06cc9acea950 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:13.360746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90f6fef1-a8b6-4091-9a6e-06cc9acea950 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:13.361452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90f6fef1-a8b6-4091-9a6e-06cc9acea950 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:13.361917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90f6fef1-a8b6-4091-9a6e-06cc9acea950 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:13.362354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-90f6fef1-a8b6-4091-9a6e-06cc9acea950 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:13.495119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-90f6fef1-a8b6-4091-9a6e-06cc9acea950 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:13.504193 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-90f6fef1-a8b6-4091-9a6e-06cc9acea950 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1411 microversion: 2.1 time: 0.156377 Sep 06 11:41:13.504792 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3249/6546] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:13 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:14.531576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0c71d080-f839-428c-bcb8-d6c8bffa9b9f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:14.532084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0c71d080-f839-428c-bcb8-d6c8bffa9b9f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:14.541344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c71d080-f839-428c-bcb8-d6c8bffa9b9f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:14.542027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c71d080-f839-428c-bcb8-d6c8bffa9b9f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:14.542605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c71d080-f839-428c-bcb8-d6c8bffa9b9f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:14.543434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c71d080-f839-428c-bcb8-d6c8bffa9b9f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:14.543994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c71d080-f839-428c-bcb8-d6c8bffa9b9f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:14.544480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c71d080-f839-428c-bcb8-d6c8bffa9b9f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:14.609299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-bebfea5e-6c80-43a9-9285-86caa5e910c9 req-391c9cc0-a366-4b35-bf18-2b0e68232e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35788763-b35e-4a7e-be2c-7426719f1e8d", "name": "network-vif-deleted", "tag": "0d53e5e0-cd2b-4bbb-8f04-7b8eb61d1ba7"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:41:14.629383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bebfea5e-6c80-43a9-9285-86caa5e910c9 req-391c9cc0-a366-4b35-bf18-2b0e68232e2f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:14.634399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bebfea5e-6c80-43a9-9285-86caa5e910c9 req-391c9cc0-a366-4b35-bf18-2b0e68232e2f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:14.634399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bebfea5e-6c80-43a9-9285-86caa5e910c9 req-391c9cc0-a366-4b35-bf18-2b0e68232e2f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:14.645820 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-bebfea5e-6c80-43a9-9285-86caa5e910c9 req-391c9cc0-a366-4b35-bf18-2b0e68232e2f service nova] Creating event network-vif-deleted:0d53e5e0-cd2b-4bbb-8f04-7b8eb61d1ba7 for instance 35788763-b35e-4a7e-be2c-7426719f1e8d on nch2-master-1 Sep 06 11:41:14.651510 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-bebfea5e-6c80-43a9-9285-86caa5e910c9 req-391c9cc0-a366-4b35-bf18-2b0e68232e2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045856 Sep 06 11:41:14.652329 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3250/6547] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:41:14.694358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0c71d080-f839-428c-bcb8-d6c8bffa9b9f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:14.703641 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0c71d080-f839-428c-bcb8-d6c8bffa9b9f tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1369 microversion: 2.1 time: 0.179645 Sep 06 11:41:14.704774 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3298/6548] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:14 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1369 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:15.728720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:15.729432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:15.735732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:15.736229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:15.736682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:15.737388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:15.737856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:15.738293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:15.770401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:15.770888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:15.771363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:15.771821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lazy-loading 'fault' on Instance uuid 35788763-b35e-4a7e-be2c-7426719f1e8d {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:41:15.816714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:15.826084 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7731b467-d126-42df-b12f-0c140923a4ed tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 200 len: 1207 microversion: 2.1 time: 0.102459 Sep 06 11:41:15.826849 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3251/6549] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:15 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 1207 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:16.852324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6cf38a1c-0e4b-41a8-af47-e1d7e84b4e4e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:16.852988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6cf38a1c-0e4b-41a8-af47-e1d7e84b4e4e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:16.860922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cf38a1c-0e4b-41a8-af47-e1d7e84b4e4e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:16.861434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cf38a1c-0e4b-41a8-af47-e1d7e84b4e4e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:16.861901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cf38a1c-0e4b-41a8-af47-e1d7e84b4e4e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:16.862625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cf38a1c-0e4b-41a8-af47-e1d7e84b4e4e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:16.863135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cf38a1c-0e4b-41a8-af47-e1d7e84b4e4e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:16.863592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cf38a1c-0e4b-41a8-af47-e1d7e84b4e4e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:16.877265 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-6cf38a1c-0e4b-41a8-af47-e1d7e84b4e4e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] HTTP exception thrown: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6cf38a1c-0e4b-41a8-af47-e1d7e84b4e4e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Request method failure captured: Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d HTTP/1.1 Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzFQ2vLizXv-0F-MgRIpiXyEibY_kxkSM2EYhf_76f4Yzg4uNz9f1hiW7ZUxoZZgEMvk03CE7DmCEkes4ZvISQGLuK5qOnzLWzkfpL8ruFps5TAXJ1tYu_xPENd2xtzF5jkFYVyT7UrqsmlOZyu7GWTnBTwaFFG6ehsVTIiLA3QpBAI Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edc027a6f642454d8592b308777d59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edc027a6f642454d8592b308777d59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}] Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: a36875e5990b487bb1357e0b46dac402 Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '35788763-b35e-4a7e-be2c-7426719f1e8d'} Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:41:16.879051 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:16.884033 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:16.884033 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:41:16.884033 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:41:16.884033 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:41:16.884033 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:41:16.884033 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:16.884033 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:16.884033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6cf38a1c-0e4b-41a8-af47-e1d7e84b4e4e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Returning 404 to user: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:41:16.884033 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6cf38a1c-0e4b-41a8-af47-e1d7e84b4e4e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 404 len: 111 microversion: 2.1 time: 0.032434 Sep 06 11:41:16.884033 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3299/6550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:16 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:41:18.975791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:41:18.978586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:18.986128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:18.986623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:18.987089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:18.987812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:18.988273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:18.988706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:19.069366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:41:19.069792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:41:19.070284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:41:19.070687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:41:19.071128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:41:19.323476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:19.330344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:19.330855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:19.331359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:19.332099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:19.332556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:19.332997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:19.359659 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-df50207e-3e38-40a7-bfa8-b6c0391d88d9 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36/action" status: 202 len: 1139 microversion: 2.1 time: 0.388099 Sep 06 11:41:19.360349 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3252/6551] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:41:18 2022] POST /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36/action => generated 1139 bytes in 390 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 06 11:41:19.379353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c8d28d80-e896-4394-aeb5-c1f048b4ab07 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:19.380011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c8d28d80-e896-4394-aeb5-c1f048b4ab07 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:19.387073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8d28d80-e896-4394-aeb5-c1f048b4ab07 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:19.387576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8d28d80-e896-4394-aeb5-c1f048b4ab07 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:19.388036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8d28d80-e896-4394-aeb5-c1f048b4ab07 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:19.388743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8d28d80-e896-4394-aeb5-c1f048b4ab07 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:19.389218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8d28d80-e896-4394-aeb5-c1f048b4ab07 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:19.389660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8d28d80-e896-4394-aeb5-c1f048b4ab07 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:19.523743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c8d28d80-e896-4394-aeb5-c1f048b4ab07 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:19.532109 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c8d28d80-e896-4394-aeb5-c1f048b4ab07 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1693 microversion: 2.1 time: 0.156698 Sep 06 11:41:19.532704 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3300/6552] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:19 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:41:20.557031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01ac25b4-56c5-48e6-a779-8d018af334a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:20.557654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-01ac25b4-56c5-48e6-a779-8d018af334a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:20.565490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01ac25b4-56c5-48e6-a779-8d018af334a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:20.566014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01ac25b4-56c5-48e6-a779-8d018af334a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:20.566463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01ac25b4-56c5-48e6-a779-8d018af334a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:20.567213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01ac25b4-56c5-48e6-a779-8d018af334a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:20.567676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01ac25b4-56c5-48e6-a779-8d018af334a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:20.568110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01ac25b4-56c5-48e6-a779-8d018af334a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:20.701135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-01ac25b4-56c5-48e6-a779-8d018af334a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:20.709116 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-01ac25b4-56c5-48e6-a779-8d018af334a7 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1693 microversion: 2.1 time: 0.156203 Sep 06 11:41:20.709699 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3253/6553] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:20 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:21.133672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7ee73076-cfaa-4ab7-835a-791c8305f135 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:21.134197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7ee73076-cfaa-4ab7-835a-791c8305f135 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:21.140884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ee73076-cfaa-4ab7-835a-791c8305f135 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:21.141385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ee73076-cfaa-4ab7-835a-791c8305f135 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:21.141844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ee73076-cfaa-4ab7-835a-791c8305f135 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:21.142554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ee73076-cfaa-4ab7-835a-791c8305f135 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:21.143062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ee73076-cfaa-4ab7-835a-791c8305f135 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:21.143511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7ee73076-cfaa-4ab7-835a-791c8305f135 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:21.160001 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-7ee73076-cfaa-4ab7-835a-791c8305f135 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] HTTP exception thrown: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7ee73076-cfaa-4ab7-835a-791c8305f135 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Request method failure captured: Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 HTTP/1.1 Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzFQ2vLizXv-0F-MgRIpiXyEibY_kxkSM2EYhf_76f4Yzg4uNz9f1hiW7ZUxoZZgEMvk03CE7DmCEkes4ZvISQGLuK5qOnzLWzkfpL8ruFps5TAXJ1tYu_xPENd2xtzF5jkFYVyT7UrqsmlOZyu7GWTnBTwaFFG6ehsVTIiLA3QpBAI Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edc027a6f642454d8592b308777d59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edc027a6f642454d8592b308777d59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}] Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: a36875e5990b487bb1357e0b46dac402 Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '846c8ef7-96fe-4495-bc7b-dc7bcea84dd2'} Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:41:21.161874 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7ee73076-cfaa-4ab7-835a-791c8305f135 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Returning 404 to user: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7ee73076-cfaa-4ab7-835a-791c8305f135 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 404 len: 111 microversion: 2.1 time: 0.033552 Sep 06 11:41:21.166540 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3301/6554] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:41:21 2022] DELETE /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:41:21.172202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c70ad558-896a-40da-a1a8-e5b471b56215 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:21.172849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c70ad558-896a-40da-a1a8-e5b471b56215 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:21.179700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c70ad558-896a-40da-a1a8-e5b471b56215 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:21.180193 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c70ad558-896a-40da-a1a8-e5b471b56215 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:21.180640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c70ad558-896a-40da-a1a8-e5b471b56215 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:21.181344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c70ad558-896a-40da-a1a8-e5b471b56215 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:21.181808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c70ad558-896a-40da-a1a8-e5b471b56215 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:21.182244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c70ad558-896a-40da-a1a8-e5b471b56215 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:21.195587 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-c70ad558-896a-40da-a1a8-e5b471b56215 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] HTTP exception thrown: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c70ad558-896a-40da-a1a8-e5b471b56215 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Request method failure captured: Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 HTTP/1.1 Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzFQ2vLizXv-0F-MgRIpiXyEibY_kxkSM2EYhf_76f4Yzg4uNz9f1hiW7ZUxoZZgEMvk03CE7DmCEkes4ZvISQGLuK5qOnzLWzkfpL8ruFps5TAXJ1tYu_xPENd2xtzF5jkFYVyT7UrqsmlOZyu7GWTnBTwaFFG6ehsVTIiLA3QpBAI Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edc027a6f642454d8592b308777d59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edc027a6f642454d8592b308777d59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}] Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a36875e5990b487bb1357e0b46dac402 Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '846c8ef7-96fe-4495-bc7b-dc7bcea84dd2'} Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:41:21.197218 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:41:21.201954 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:21.201954 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:41:21.201954 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:41:21.201954 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:41:21.201954 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:41:21.201954 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. Sep 06 11:41:21.201954 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:41:21.201954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c70ad558-896a-40da-a1a8-e5b471b56215 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Returning 404 to user: Instance 846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:41:21.201954 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c70ad558-896a-40da-a1a8-e5b471b56215 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2" status: 404 len: 111 microversion: 2.1 time: 0.030428 Sep 06 11:41:21.201954 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3254/6555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:21 2022] GET /compute/v2.1/servers/846c8ef7-96fe-4495-bc7b-dc7bcea84dd2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:41:21.732862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-10ddea22-b8b2-441a-9050-d0899e2a96bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:21.733449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-10ddea22-b8b2-441a-9050-d0899e2a96bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:21.739790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10ddea22-b8b2-441a-9050-d0899e2a96bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:21.740424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10ddea22-b8b2-441a-9050-d0899e2a96bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:21.740911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10ddea22-b8b2-441a-9050-d0899e2a96bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:21.747339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10ddea22-b8b2-441a-9050-d0899e2a96bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:21.747339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10ddea22-b8b2-441a-9050-d0899e2a96bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:21.747339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10ddea22-b8b2-441a-9050-d0899e2a96bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:21.886377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-10ddea22-b8b2-441a-9050-d0899e2a96bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:21.895098 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-10ddea22-b8b2-441a-9050-d0899e2a96bf tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1693 microversion: 2.1 time: 0.166568 Sep 06 11:41:21.895679 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3302/6556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:21 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:22.022474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24a6ff19-0195-4d11-8c9a-84a3eab2a927 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:22.022991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-24a6ff19-0195-4d11-8c9a-84a3eab2a927 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:22.029935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24a6ff19-0195-4d11-8c9a-84a3eab2a927 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:22.030700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24a6ff19-0195-4d11-8c9a-84a3eab2a927 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:22.031182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24a6ff19-0195-4d11-8c9a-84a3eab2a927 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:22.031896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24a6ff19-0195-4d11-8c9a-84a3eab2a927 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:22.032401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24a6ff19-0195-4d11-8c9a-84a3eab2a927 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:22.032844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-24a6ff19-0195-4d11-8c9a-84a3eab2a927 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:22.046657 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-24a6ff19-0195-4d11-8c9a-84a3eab2a927 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] HTTP exception thrown: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24a6ff19-0195-4d11-8c9a-84a3eab2a927 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Request method failure captured: Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d HTTP/1.1 Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzFQ2vLizXv-0F-MgRIpiXyEibY_kxkSM2EYhf_76f4Yzg4uNz9f1hiW7ZUxoZZgEMvk03CE7DmCEkes4ZvISQGLuK5qOnzLWzkfpL8ruFps5TAXJ1tYu_xPENd2xtzF5jkFYVyT7UrqsmlOZyu7GWTnBTwaFFG6ehsVTIiLA3QpBAI Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edc027a6f642454d8592b308777d59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edc027a6f642454d8592b308777d59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}] Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a36875e5990b487bb1357e0b46dac402 Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '35788763-b35e-4a7e-be2c-7426719f1e8d'} Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:41:22.048764 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-24a6ff19-0195-4d11-8c9a-84a3eab2a927 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Returning 404 to user: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-24a6ff19-0195-4d11-8c9a-84a3eab2a927 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 404 len: 111 microversion: 2.1 time: 0.031697 Sep 06 11:41:22.053326 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3255/6557] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:41:22 2022] DELETE /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:41:22.059290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-526d7aa5-165f-41da-ae19-7f3963206f36 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:22.059981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-526d7aa5-165f-41da-ae19-7f3963206f36 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 35788763-b35e-4a7e-be2c-7426719f1e8d] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:22.066803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-526d7aa5-165f-41da-ae19-7f3963206f36 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:22.067343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-526d7aa5-165f-41da-ae19-7f3963206f36 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:22.067810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-526d7aa5-165f-41da-ae19-7f3963206f36 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:22.068533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-526d7aa5-165f-41da-ae19-7f3963206f36 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:22.069018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-526d7aa5-165f-41da-ae19-7f3963206f36 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:22.069474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-526d7aa5-165f-41da-ae19-7f3963206f36 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:22.083295 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-526d7aa5-165f-41da-ae19-7f3963206f36 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] HTTP exception thrown: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-526d7aa5-165f-41da-ae19-7f3963206f36 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Request method failure captured: Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d HTTP/1.1 Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzFQ2vLizXv-0F-MgRIpiXyEibY_kxkSM2EYhf_76f4Yzg4uNz9f1hiW7ZUxoZZgEMvk03CE7DmCEkes4ZvISQGLuK5qOnzLWzkfpL8ruFps5TAXJ1tYu_xPENd2xtzF5jkFYVyT7UrqsmlOZyu7GWTnBTwaFFG6ehsVTIiLA3QpBAI Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edc027a6f642454d8592b308777d59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edc027a6f642454d8592b308777d59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}] Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: a36875e5990b487bb1357e0b46dac402 Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '35788763-b35e-4a7e-be2c-7426719f1e8d'} Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:41:22.084854 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:22.089415 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:41:22.089415 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:41:22.089415 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:41:22.089415 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:41:22.089415 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:41:22.089415 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. Sep 06 11:41:22.089415 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:41:22.089415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-526d7aa5-165f-41da-ae19-7f3963206f36 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Returning 404 to user: Instance 35788763-b35e-4a7e-be2c-7426719f1e8d could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:41:22.089415 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-526d7aa5-165f-41da-ae19-7f3963206f36 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d" status: 404 len: 111 microversion: 2.1 time: 0.031155 Sep 06 11:41:22.089415 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3303/6558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:22 2022] GET /compute/v2.1/servers/35788763-b35e-4a7e-be2c-7426719f1e8d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:41:22.158810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8bc77d6d-bfa9-497f-b108-eb550c521eae tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Action: 'create', calling method: .version_select at 0x7f90f3d71f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1927053780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKER0ytx9GQTrbteDa7lJfIhLOiIEJJyzP9OOlNzzsCzovcFcVLFsbdbNQvFIUNILHViHHwp/xVBL/XDP59wESY51opNXCAYH56gbqi2LmFc6h2QD3t4tmVmFcXKnjnrQ=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:41:22.174690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8bc77d6d-bfa9-497f-b108-eb550c521eae tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Getting quotas for project edc027a6f642454d8592b308777d59e4. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:41:22.179934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8bc77d6d-bfa9-497f-b108-eb550c521eae tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Getting quotas for user a36875e5990b487bb1357e0b46dac402 and project edc027a6f642454d8592b308777d59e4. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:41:22.287159 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8bc77d6d-bfa9-497f-b108-eb550c521eae tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.132531 Sep 06 11:41:22.287780 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3256/6559] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:41:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:41:22.918273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-591e3875-aef1-40a6-8d64-1feae38e3103 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:22.919636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-591e3875-aef1-40a6-8d64-1feae38e3103 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:22.925947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-591e3875-aef1-40a6-8d64-1feae38e3103 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:22.926446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-591e3875-aef1-40a6-8d64-1feae38e3103 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:22.926901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-591e3875-aef1-40a6-8d64-1feae38e3103 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:22.927636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-591e3875-aef1-40a6-8d64-1feae38e3103 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:22.928117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-591e3875-aef1-40a6-8d64-1feae38e3103 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:22.928565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-591e3875-aef1-40a6-8d64-1feae38e3103 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:23.062694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-591e3875-aef1-40a6-8d64-1feae38e3103 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:23.070750 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-591e3875-aef1-40a6-8d64-1feae38e3103 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1693 microversion: 2.1 time: 0.156418 Sep 06 11:41:23.071350 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3304/6560] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:22 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:41:24.096037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-997d0f50-fa05-4d51-9911-bbbe6d5b5967 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:24.096721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-997d0f50-fa05-4d51-9911-bbbe6d5b5967 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:24.103889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-997d0f50-fa05-4d51-9911-bbbe6d5b5967 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:24.104389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-997d0f50-fa05-4d51-9911-bbbe6d5b5967 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:24.104839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-997d0f50-fa05-4d51-9911-bbbe6d5b5967 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:24.105558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-997d0f50-fa05-4d51-9911-bbbe6d5b5967 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:24.106032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-997d0f50-fa05-4d51-9911-bbbe6d5b5967 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:24.106519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-997d0f50-fa05-4d51-9911-bbbe6d5b5967 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:24.247300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-997d0f50-fa05-4d51-9911-bbbe6d5b5967 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:24.255660 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-997d0f50-fa05-4d51-9911-bbbe6d5b5967 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1693 microversion: 2.1 time: 0.164644 Sep 06 11:41:24.255798 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3257/6561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:24 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:25.279308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-338d583e-efa8-4012-b95c-e61cc3723257 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:25.279937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-338d583e-efa8-4012-b95c-e61cc3723257 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:25.287156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-338d583e-efa8-4012-b95c-e61cc3723257 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:25.287654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-338d583e-efa8-4012-b95c-e61cc3723257 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:25.288108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-338d583e-efa8-4012-b95c-e61cc3723257 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:25.288811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-338d583e-efa8-4012-b95c-e61cc3723257 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:25.289286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-338d583e-efa8-4012-b95c-e61cc3723257 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:25.289763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-338d583e-efa8-4012-b95c-e61cc3723257 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:25.425300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-338d583e-efa8-4012-b95c-e61cc3723257 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:25.433421 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-338d583e-efa8-4012-b95c-e61cc3723257 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1693 microversion: 2.1 time: 0.158119 Sep 06 11:41:25.434073 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3305/6562] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:25 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:26.457062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-13a25a8d-7856-4109-95c9-9e56d0ddc3a2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:26.457623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-13a25a8d-7856-4109-95c9-9e56d0ddc3a2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:26.464695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13a25a8d-7856-4109-95c9-9e56d0ddc3a2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:26.465194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13a25a8d-7856-4109-95c9-9e56d0ddc3a2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:26.465646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13a25a8d-7856-4109-95c9-9e56d0ddc3a2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:26.466357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13a25a8d-7856-4109-95c9-9e56d0ddc3a2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:26.466824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13a25a8d-7856-4109-95c9-9e56d0ddc3a2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:26.467292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-13a25a8d-7856-4109-95c9-9e56d0ddc3a2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:26.606479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-13a25a8d-7856-4109-95c9-9e56d0ddc3a2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:26.615142 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-13a25a8d-7856-4109-95c9-9e56d0ddc3a2 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1693 microversion: 2.1 time: 0.162107 Sep 06 11:41:26.615962 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3258/6563] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:26 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:27.638487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-db30bd6b-2185-41a3-8a9b-27e1a958d180 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:27.639149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-db30bd6b-2185-41a3-8a9b-27e1a958d180 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:27.646236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db30bd6b-2185-41a3-8a9b-27e1a958d180 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:27.646738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db30bd6b-2185-41a3-8a9b-27e1a958d180 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:27.647265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db30bd6b-2185-41a3-8a9b-27e1a958d180 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:27.647960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db30bd6b-2185-41a3-8a9b-27e1a958d180 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:27.648444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db30bd6b-2185-41a3-8a9b-27e1a958d180 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:27.648896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-db30bd6b-2185-41a3-8a9b-27e1a958d180 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:27.782727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-db30bd6b-2185-41a3-8a9b-27e1a958d180 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:27.791601 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-db30bd6b-2185-41a3-8a9b-27e1a958d180 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1693 microversion: 2.1 time: 0.156979 Sep 06 11:41:27.792192 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3306/6564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:27 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:28.815857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-17763568-ab68-4042-9794-fc724c7523df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:28.816493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-17763568-ab68-4042-9794-fc724c7523df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:28.823567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17763568-ab68-4042-9794-fc724c7523df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:28.824071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17763568-ab68-4042-9794-fc724c7523df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:28.824527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17763568-ab68-4042-9794-fc724c7523df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:28.825245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17763568-ab68-4042-9794-fc724c7523df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:28.825718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17763568-ab68-4042-9794-fc724c7523df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:28.826161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17763568-ab68-4042-9794-fc724c7523df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:28.958613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-17763568-ab68-4042-9794-fc724c7523df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:28.966386 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-17763568-ab68-4042-9794-fc724c7523df tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1693 microversion: 2.1 time: 0.154531 Sep 06 11:41:28.966954 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3259/6565] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:28 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:29.443419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2068732064", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1927053780", "security_groups": [{"name": "tempest-secgroup-smoke-717013760"}], "block_device_mapping_v2": [{"uuid": "957404cf-5ff8-4abb-99cf-02aca65af86d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6d6137d-8475-499d-9c0a-ad20e4d07df5"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:41:29.572135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] validate_networks() for [('f6d6137d-8475-499d-9c0a-ad20e4d07df5', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:41:29.993026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2a1b9370-b3ff-49cb-a6d5-b465ae0cae40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:29.993817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2a1b9370-b3ff-49cb-a6d5-b465ae0cae40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:30.001076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a1b9370-b3ff-49cb-a6d5-b465ae0cae40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:30.001575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a1b9370-b3ff-49cb-a6d5-b465ae0cae40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:30.002043 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a1b9370-b3ff-49cb-a6d5-b465ae0cae40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:30.002860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a1b9370-b3ff-49cb-a6d5-b465ae0cae40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:30.003259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a1b9370-b3ff-49cb-a6d5-b465ae0cae40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:30.004693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2a1b9370-b3ff-49cb-a6d5-b465ae0cae40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:30.005383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:41:30.005836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:41:30.006334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:41:30.006755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:41:30.007228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:41:30.016671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:30.017184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:30.017659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:30.018414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:30.018890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:30.019370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:30.039002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Getting quotas for project edc027a6f642454d8592b308777d59e4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:41:30.044516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Getting quotas for user a36875e5990b487bb1357e0b46dac402 and project edc027a6f642454d8592b308777d59e4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:41:30.103747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:41:30.105905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='957404cf-5ff8-4abb-99cf-02aca65af86d',volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:41:30.144266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2a1b9370-b3ff-49cb-a6d5-b465ae0cae40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:30.152689 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2a1b9370-b3ff-49cb-a6d5-b465ae0cae40 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1693 microversion: 2.1 time: 0.163824 Sep 06 11:41:30.153281 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3260/6566] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:29 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:41:30.459353 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-298442f8-9c6d-4fdb-a070-c625f716c6ac tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.020427 Sep 06 11:41:30.460363 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3307/6567] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:41:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:41:30.471936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c440ac2c-7c6d-4876-92d0-a560af2da8fb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:30.472559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c440ac2c-7c6d-4876-92d0-a560af2da8fb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:30.535985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c440ac2c-7c6d-4876-92d0-a560af2da8fb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:30.543233 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c440ac2c-7c6d-4876-92d0-a560af2da8fb tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1095 microversion: 2.1 time: 0.075845 Sep 06 11:41:30.544148 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3261/6568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:30 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:41:31.176979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d3578185-2396-451e-8d4f-03a9db126659 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:31.177597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d3578185-2396-451e-8d4f-03a9db126659 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:31.184554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3578185-2396-451e-8d4f-03a9db126659 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:31.185060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3578185-2396-451e-8d4f-03a9db126659 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:31.185520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3578185-2396-451e-8d4f-03a9db126659 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:31.186234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3578185-2396-451e-8d4f-03a9db126659 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:31.186709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3578185-2396-451e-8d4f-03a9db126659 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:31.187187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d3578185-2396-451e-8d4f-03a9db126659 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:31.328174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d3578185-2396-451e-8d4f-03a9db126659 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:31.337452 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d3578185-2396-451e-8d4f-03a9db126659 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1693 microversion: 2.1 time: 0.164968 Sep 06 11:41:31.338330 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3308/6569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:31 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:31.566123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-af61b67f-5167-4664-b60f-cdd4b36864d7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:31.566741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-af61b67f-5167-4664-b60f-cdd4b36864d7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:31.574612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af61b67f-5167-4664-b60f-cdd4b36864d7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:31.575126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af61b67f-5167-4664-b60f-cdd4b36864d7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:31.575572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af61b67f-5167-4664-b60f-cdd4b36864d7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:31.576292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af61b67f-5167-4664-b60f-cdd4b36864d7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:31.576735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af61b67f-5167-4664-b60f-cdd4b36864d7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:31.577169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-af61b67f-5167-4664-b60f-cdd4b36864d7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:31.638440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-af61b67f-5167-4664-b60f-cdd4b36864d7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:31.646249 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-af61b67f-5167-4664-b60f-cdd4b36864d7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1145 microversion: 2.1 time: 0.084156 Sep 06 11:41:31.646838 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3262/6570] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:31 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:32.361416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-38899846-c974-41c0-a01e-3b8122874def tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:32.362289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-38899846-c974-41c0-a01e-3b8122874def tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:32.371339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38899846-c974-41c0-a01e-3b8122874def tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:32.372306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38899846-c974-41c0-a01e-3b8122874def tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:32.373120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38899846-c974-41c0-a01e-3b8122874def tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:32.374408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38899846-c974-41c0-a01e-3b8122874def tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:32.375329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38899846-c974-41c0-a01e-3b8122874def tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:32.376148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38899846-c974-41c0-a01e-3b8122874def tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:32.521652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-38899846-c974-41c0-a01e-3b8122874def tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:32.533774 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-38899846-c974-41c0-a01e-3b8122874def tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1699 microversion: 2.1 time: 0.176246 Sep 06 11:41:32.534507 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3309/6571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:32 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1699 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:32.670268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-76f8cdcd-d1fa-429b-a77d-8c3b5fe7843a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:32.671093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-76f8cdcd-d1fa-429b-a77d-8c3b5fe7843a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:32.678795 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76f8cdcd-d1fa-429b-a77d-8c3b5fe7843a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:32.679328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76f8cdcd-d1fa-429b-a77d-8c3b5fe7843a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:32.679788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76f8cdcd-d1fa-429b-a77d-8c3b5fe7843a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:32.680512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76f8cdcd-d1fa-429b-a77d-8c3b5fe7843a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:32.681060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76f8cdcd-d1fa-429b-a77d-8c3b5fe7843a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:32.681423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-76f8cdcd-d1fa-429b-a77d-8c3b5fe7843a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:32.751258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-76f8cdcd-d1fa-429b-a77d-8c3b5fe7843a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:32.761722 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-76f8cdcd-d1fa-429b-a77d-8c3b5fe7843a tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1201 microversion: 2.1 time: 0.095544 Sep 06 11:41:32.762432 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3263/6572] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:32 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:33.560914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c074199a-8b55-414f-9dc1-8f55250cf52c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:33.561553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c074199a-8b55-414f-9dc1-8f55250cf52c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:33.569325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c074199a-8b55-414f-9dc1-8f55250cf52c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:33.570002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c074199a-8b55-414f-9dc1-8f55250cf52c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:33.570560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c074199a-8b55-414f-9dc1-8f55250cf52c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:33.571528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c074199a-8b55-414f-9dc1-8f55250cf52c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:33.572208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c074199a-8b55-414f-9dc1-8f55250cf52c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:33.573227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c074199a-8b55-414f-9dc1-8f55250cf52c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:33.717495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c074199a-8b55-414f-9dc1-8f55250cf52c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:33.725696 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c074199a-8b55-414f-9dc1-8f55250cf52c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1699 microversion: 2.1 time: 0.169444 Sep 06 11:41:33.728868 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3310/6573] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:33 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1699 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:33.787181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3f313136-aba7-4c30-adba-e3c6ad8ff81b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:33.787810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3f313136-aba7-4c30-adba-e3c6ad8ff81b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:33.800054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f313136-aba7-4c30-adba-e3c6ad8ff81b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:33.800561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f313136-aba7-4c30-adba-e3c6ad8ff81b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:33.801015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f313136-aba7-4c30-adba-e3c6ad8ff81b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:33.801757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f313136-aba7-4c30-adba-e3c6ad8ff81b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:33.811643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f313136-aba7-4c30-adba-e3c6ad8ff81b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:33.812541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3f313136-aba7-4c30-adba-e3c6ad8ff81b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:33.959700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3f313136-aba7-4c30-adba-e3c6ad8ff81b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:33.968195 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3f313136-aba7-4c30-adba-e3c6ad8ff81b tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1278 microversion: 2.1 time: 0.185291 Sep 06 11:41:33.971854 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3264/6574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:33 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:34.331500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9bfc3420-5d94-4e8e-9e17-496695dc14da req-555137e3-9d4a-4ae7-b3fd-e513ea86356a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269fb053-e855-4fdb-b688-ab4e36fa07fc", "tag": "15db4cf3-31c7-4a53-9f77-af4220e91f03"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:41:34.342495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9bfc3420-5d94-4e8e-9e17-496695dc14da req-555137e3-9d4a-4ae7-b3fd-e513ea86356a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:34.343000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9bfc3420-5d94-4e8e-9e17-496695dc14da req-555137e3-9d4a-4ae7-b3fd-e513ea86356a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:34.343514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9bfc3420-5d94-4e8e-9e17-496695dc14da req-555137e3-9d4a-4ae7-b3fd-e513ea86356a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:34.356964 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9bfc3420-5d94-4e8e-9e17-496695dc14da req-555137e3-9d4a-4ae7-b3fd-e513ea86356a service nova] Creating event network-changed:15db4cf3-31c7-4a53-9f77-af4220e91f03 for instance 269fb053-e855-4fdb-b688-ab4e36fa07fc on nch2-master-1 Sep 06 11:41:34.363490 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9bfc3420-5d94-4e8e-9e17-496695dc14da req-555137e3-9d4a-4ae7-b3fd-e513ea86356a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040054 Sep 06 11:41:34.364109 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3311/6575] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:41:34.749829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a8a141eb-2f21-43ac-9eec-642028cd82af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:34.750475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a8a141eb-2f21-43ac-9eec-642028cd82af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:34.756527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8a141eb-2f21-43ac-9eec-642028cd82af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:34.766814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8a141eb-2f21-43ac-9eec-642028cd82af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:34.766814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8a141eb-2f21-43ac-9eec-642028cd82af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:34.766814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8a141eb-2f21-43ac-9eec-642028cd82af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:34.766814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8a141eb-2f21-43ac-9eec-642028cd82af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:34.766814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8a141eb-2f21-43ac-9eec-642028cd82af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:34.898086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a8a141eb-2f21-43ac-9eec-642028cd82af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:34.907154 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a8a141eb-2f21-43ac-9eec-642028cd82af tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1684 microversion: 2.1 time: 0.161168 Sep 06 11:41:34.907803 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3265/6576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:34 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:34.993266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-626d8054-77c0-4d18-a830-43ebb6b37286 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:34.993822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-626d8054-77c0-4d18-a830-43ebb6b37286 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:35.000805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-626d8054-77c0-4d18-a830-43ebb6b37286 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:35.001305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-626d8054-77c0-4d18-a830-43ebb6b37286 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:35.002013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-626d8054-77c0-4d18-a830-43ebb6b37286 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:35.002468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-626d8054-77c0-4d18-a830-43ebb6b37286 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:35.002937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-626d8054-77c0-4d18-a830-43ebb6b37286 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:35.003409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-626d8054-77c0-4d18-a830-43ebb6b37286 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:35.142052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-626d8054-77c0-4d18-a830-43ebb6b37286 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:35.153660 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-626d8054-77c0-4d18-a830-43ebb6b37286 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1266 microversion: 2.1 time: 0.165176 Sep 06 11:41:35.154244 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3312/6577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:34 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:35.314352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-c309e6b4-a340-4c59-b89e-4b00b2391ca0 req-a51e3fab-0cfb-48c5-aa3b-153a7716ce72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a97b55-b81a-43c0-b068-60ab0517eb36", "name": "network-vif-unplugged", "status": "completed", "tag": "ba90e0ab-8d57-43ad-9909-13475f849c34"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:41:35.323882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c309e6b4-a340-4c59-b89e-4b00b2391ca0 req-a51e3fab-0cfb-48c5-aa3b-153a7716ce72 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:35.324366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c309e6b4-a340-4c59-b89e-4b00b2391ca0 req-a51e3fab-0cfb-48c5-aa3b-153a7716ce72 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:35.324814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c309e6b4-a340-4c59-b89e-4b00b2391ca0 req-a51e3fab-0cfb-48c5-aa3b-153a7716ce72 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:35.328765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:35.337476 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-c309e6b4-a340-4c59-b89e-4b00b2391ca0 req-a51e3fab-0cfb-48c5-aa3b-153a7716ce72 service nova] Creating event network-vif-unplugged:ba90e0ab-8d57-43ad-9909-13475f849c34 for instance e3a97b55-b81a-43c0-b068-60ab0517eb36 on nch1-master-1 Sep 06 11:41:35.342607 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-c309e6b4-a340-4c59-b89e-4b00b2391ca0 req-a51e3fab-0cfb-48c5-aa3b-153a7716ce72 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032521 Sep 06 11:41:35.343458 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3266/6578] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:41:36.180254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6f7fee68-51c3-433a-9c77-f893c9e1f69e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:36.180254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6f7fee68-51c3-433a-9c77-f893c9e1f69e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:36.185558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f7fee68-51c3-433a-9c77-f893c9e1f69e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:36.186047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f7fee68-51c3-433a-9c77-f893c9e1f69e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:36.186883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f7fee68-51c3-433a-9c77-f893c9e1f69e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:36.187568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f7fee68-51c3-433a-9c77-f893c9e1f69e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:36.187917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f7fee68-51c3-433a-9c77-f893c9e1f69e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:36.188370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6f7fee68-51c3-433a-9c77-f893c9e1f69e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:36.344160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6f7fee68-51c3-433a-9c77-f893c9e1f69e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:36.353281 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6f7fee68-51c3-433a-9c77-f893c9e1f69e tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1266 microversion: 2.1 time: 0.179900 Sep 06 11:41:36.353869 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3313/6579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:36 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:41:37.368305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-2934ce93-282f-4c63-8f4b-46ec773af03a req-d708a459-ee21-4f59-8603-53e05bfa4ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a97b55-b81a-43c0-b068-60ab0517eb36", "name": "network-vif-plugged", "status": "completed", "tag": "ba90e0ab-8d57-43ad-9909-13475f849c34"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:41:37.377363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6b944193-2304-4986-a9bd-1429bf2728b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:37.378139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6b944193-2304-4986-a9bd-1429bf2728b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:37.379515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2934ce93-282f-4c63-8f4b-46ec773af03a req-d708a459-ee21-4f59-8603-53e05bfa4ee9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:37.379841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2934ce93-282f-4c63-8f4b-46ec773af03a req-d708a459-ee21-4f59-8603-53e05bfa4ee9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:37.380540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2934ce93-282f-4c63-8f4b-46ec773af03a req-d708a459-ee21-4f59-8603-53e05bfa4ee9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:37.385530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b944193-2304-4986-a9bd-1429bf2728b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:37.387316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b944193-2304-4986-a9bd-1429bf2728b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:37.387316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b944193-2304-4986-a9bd-1429bf2728b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:37.387316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b944193-2304-4986-a9bd-1429bf2728b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:37.387856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b944193-2304-4986-a9bd-1429bf2728b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:37.388162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6b944193-2304-4986-a9bd-1429bf2728b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:37.396450 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-2934ce93-282f-4c63-8f4b-46ec773af03a req-d708a459-ee21-4f59-8603-53e05bfa4ee9 service nova] Creating event network-vif-plugged:ba90e0ab-8d57-43ad-9909-13475f849c34 for instance e3a97b55-b81a-43c0-b068-60ab0517eb36 on nch1-master-1 Sep 06 11:41:37.402154 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-2934ce93-282f-4c63-8f4b-46ec773af03a req-d708a459-ee21-4f59-8603-53e05bfa4ee9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041367 Sep 06 11:41:37.404479 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3267/6580] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:41:37.410405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:37.531023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6b944193-2304-4986-a9bd-1429bf2728b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:37.542036 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6b944193-2304-4986-a9bd-1429bf2728b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1266 microversion: 2.1 time: 0.169356 Sep 06 11:41:37.542630 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3314/6581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:37 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:41:38.566946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-97bb277e-f755-418c-9c7b-5b66c887ccf2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:38.567683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-97bb277e-f755-418c-9c7b-5b66c887ccf2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:38.576235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97bb277e-f755-418c-9c7b-5b66c887ccf2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:38.576728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97bb277e-f755-418c-9c7b-5b66c887ccf2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:38.577176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97bb277e-f755-418c-9c7b-5b66c887ccf2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:38.577924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97bb277e-f755-418c-9c7b-5b66c887ccf2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:38.578387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97bb277e-f755-418c-9c7b-5b66c887ccf2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:38.578819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-97bb277e-f755-418c-9c7b-5b66c887ccf2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:38.716205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-97bb277e-f755-418c-9c7b-5b66c887ccf2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:38.724394 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-97bb277e-f755-418c-9c7b-5b66c887ccf2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1266 microversion: 2.1 time: 0.162575 Sep 06 11:41:38.725170 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3268/6582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:38 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:39.748085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-48dc50fd-687d-479b-805d-2165063f47c7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:39.748637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-48dc50fd-687d-479b-805d-2165063f47c7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:39.756299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48dc50fd-687d-479b-805d-2165063f47c7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:39.756797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48dc50fd-687d-479b-805d-2165063f47c7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:39.757252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48dc50fd-687d-479b-805d-2165063f47c7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:39.757963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48dc50fd-687d-479b-805d-2165063f47c7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:39.758434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48dc50fd-687d-479b-805d-2165063f47c7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:39.758872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-48dc50fd-687d-479b-805d-2165063f47c7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:39.899218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-48dc50fd-687d-479b-805d-2165063f47c7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:39.907508 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-48dc50fd-687d-479b-805d-2165063f47c7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1266 microversion: 2.1 time: 0.163273 Sep 06 11:41:39.908537 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3315/6583] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:39 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:40.931520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-25493cb9-c815-4369-b448-005f9a8afdc2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:40.932139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-25493cb9-c815-4369-b448-005f9a8afdc2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:40.935826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:40.941049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25493cb9-c815-4369-b448-005f9a8afdc2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:40.941544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25493cb9-c815-4369-b448-005f9a8afdc2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:40.941992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25493cb9-c815-4369-b448-005f9a8afdc2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:40.942700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25493cb9-c815-4369-b448-005f9a8afdc2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:40.943202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25493cb9-c815-4369-b448-005f9a8afdc2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:40.943633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-25493cb9-c815-4369-b448-005f9a8afdc2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:41.075280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-25493cb9-c815-4369-b448-005f9a8afdc2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:41.083675 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-25493cb9-c815-4369-b448-005f9a8afdc2 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1266 microversion: 2.1 time: 0.156271 Sep 06 11:41:41.084256 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3269/6584] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:40 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:42.107365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2ba3437c-df60-4f9d-82f9-b6b94e10b4d1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:42.107997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2ba3437c-df60-4f9d-82f9-b6b94e10b4d1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:42.109879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:42.110603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:42.112697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:42.117519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ba3437c-df60-4f9d-82f9-b6b94e10b4d1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:42.119750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ba3437c-df60-4f9d-82f9-b6b94e10b4d1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:42.119750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ba3437c-df60-4f9d-82f9-b6b94e10b4d1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:42.119750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ba3437c-df60-4f9d-82f9-b6b94e10b4d1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:42.119750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ba3437c-df60-4f9d-82f9-b6b94e10b4d1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:42.120203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ba3437c-df60-4f9d-82f9-b6b94e10b4d1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:42.149579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e22d54b7-1b31-4126-96b0-0724144fae72 req-1df14138-6310-4d40-bee1-1b36a9a1efd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269fb053-e855-4fdb-b688-ab4e36fa07fc", "name": "network-vif-plugged", "status": "completed", "tag": "15db4cf3-31c7-4a53-9f77-af4220e91f03"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:41:42.161075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e22d54b7-1b31-4126-96b0-0724144fae72 req-1df14138-6310-4d40-bee1-1b36a9a1efd5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:42.161581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e22d54b7-1b31-4126-96b0-0724144fae72 req-1df14138-6310-4d40-bee1-1b36a9a1efd5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:42.162127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e22d54b7-1b31-4126-96b0-0724144fae72 req-1df14138-6310-4d40-bee1-1b36a9a1efd5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:42.177905 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e22d54b7-1b31-4126-96b0-0724144fae72 req-1df14138-6310-4d40-bee1-1b36a9a1efd5 service nova] Creating event network-vif-plugged:15db4cf3-31c7-4a53-9f77-af4220e91f03 for instance 269fb053-e855-4fdb-b688-ab4e36fa07fc on nch2-master-1 Sep 06 11:41:42.182878 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e22d54b7-1b31-4126-96b0-0724144fae72 req-1df14138-6310-4d40-bee1-1b36a9a1efd5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037504 Sep 06 11:41:42.183507 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3270/6585] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:41:42.274161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2ba3437c-df60-4f9d-82f9-b6b94e10b4d1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:42.288314 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2ba3437c-df60-4f9d-82f9-b6b94e10b4d1 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1266 microversion: 2.1 time: 0.185032 Sep 06 11:41:42.289094 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3316/6586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:42 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:43.313363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7a44d47f-74e2-4f45-ba51-8fa4d2c80511 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:43.314638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7a44d47f-74e2-4f45-ba51-8fa4d2c80511 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:43.320894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a44d47f-74e2-4f45-ba51-8fa4d2c80511 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:43.321384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a44d47f-74e2-4f45-ba51-8fa4d2c80511 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:43.321833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a44d47f-74e2-4f45-ba51-8fa4d2c80511 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:43.322533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a44d47f-74e2-4f45-ba51-8fa4d2c80511 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:43.323041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a44d47f-74e2-4f45-ba51-8fa4d2c80511 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:43.323460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a44d47f-74e2-4f45-ba51-8fa4d2c80511 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:43.454376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7a44d47f-74e2-4f45-ba51-8fa4d2c80511 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:43.462226 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7a44d47f-74e2-4f45-ba51-8fa4d2c80511 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1266 microversion: 2.1 time: 0.154032 Sep 06 11:41:43.462803 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3271/6587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:43 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:44.486174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe8cbf74-a8f0-4e71-a740-80ae4a93dd41 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:44.486715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe8cbf74-a8f0-4e71-a740-80ae4a93dd41 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:44.494217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe8cbf74-a8f0-4e71-a740-80ae4a93dd41 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:44.494719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe8cbf74-a8f0-4e71-a740-80ae4a93dd41 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:44.495214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe8cbf74-a8f0-4e71-a740-80ae4a93dd41 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:44.495935 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe8cbf74-a8f0-4e71-a740-80ae4a93dd41 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:44.496415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe8cbf74-a8f0-4e71-a740-80ae4a93dd41 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:44.496864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe8cbf74-a8f0-4e71-a740-80ae4a93dd41 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:44.632012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe8cbf74-a8f0-4e71-a740-80ae4a93dd41 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:44.640506 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe8cbf74-a8f0-4e71-a740-80ae4a93dd41 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1454 microversion: 2.1 time: 0.158894 Sep 06 11:41:44.641103 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3317/6588] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:44 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:41:44.670934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b83dcd0-6fcf-435a-ad3d-ccd7950e83b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:44.672253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2b83dcd0-6fcf-435a-ad3d-ccd7950e83b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:44.677006 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:44.684328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b83dcd0-6fcf-435a-ad3d-ccd7950e83b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:44.685110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b83dcd0-6fcf-435a-ad3d-ccd7950e83b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:44.685798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b83dcd0-6fcf-435a-ad3d-ccd7950e83b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:44.686880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b83dcd0-6fcf-435a-ad3d-ccd7950e83b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:44.687640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b83dcd0-6fcf-435a-ad3d-ccd7950e83b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:44.688316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b83dcd0-6fcf-435a-ad3d-ccd7950e83b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:44.833275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2b83dcd0-6fcf-435a-ad3d-ccd7950e83b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:41:44.841196 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b83dcd0-6fcf-435a-ad3d-ccd7950e83b0 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1454 microversion: 2.1 time: 0.175899 Sep 06 11:41:44.841766 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3272/6589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:41:44 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1454 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:41:47.147451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-c99e6baa-2e66-49ab-a81d-913b2d08aed6 req-6c16e9e0-47d7-4b45-bd5f-51baa0a267b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269fb053-e855-4fdb-b688-ab4e36fa07fc", "tag": "15db4cf3-31c7-4a53-9f77-af4220e91f03"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:41:47.169844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c99e6baa-2e66-49ab-a81d-913b2d08aed6 req-6c16e9e0-47d7-4b45-bd5f-51baa0a267b1 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:47.173435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c99e6baa-2e66-49ab-a81d-913b2d08aed6 req-6c16e9e0-47d7-4b45-bd5f-51baa0a267b1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:47.173435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c99e6baa-2e66-49ab-a81d-913b2d08aed6 req-6c16e9e0-47d7-4b45-bd5f-51baa0a267b1 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:47.183382 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-c99e6baa-2e66-49ab-a81d-913b2d08aed6 req-6c16e9e0-47d7-4b45-bd5f-51baa0a267b1 service nova] Creating event network-changed:15db4cf3-31c7-4a53-9f77-af4220e91f03 for instance 269fb053-e855-4fdb-b688-ab4e36fa07fc on nch2-master-1 Sep 06 11:41:47.189147 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-c99e6baa-2e66-49ab-a81d-913b2d08aed6 req-6c16e9e0-47d7-4b45-bd5f-51baa0a267b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045382 Sep 06 11:41:47.190377 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3318/6590] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:41:59.137579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b8adde49-2c46-4a56-917f-bcb0a4271265 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:41:59.139939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b8adde49-2c46-4a56-917f-bcb0a4271265 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:41:59.143154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:59.143918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=28 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:59.148585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8adde49-2c46-4a56-917f-bcb0a4271265 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:59.149077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8adde49-2c46-4a56-917f-bcb0a4271265 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:59.149525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8adde49-2c46-4a56-917f-bcb0a4271265 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:59.150228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8adde49-2c46-4a56-917f-bcb0a4271265 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:59.150690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8adde49-2c46-4a56-917f-bcb0a4271265 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:59.151153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8adde49-2c46-4a56-917f-bcb0a4271265 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:59.208909 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b8adde49-2c46-4a56-917f-bcb0a4271265 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "POST /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36/action" status: 200 len: 24571 microversion: 2.1 time: 0.075304 Sep 06 11:41:59.209477 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3273/6591] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:41:59 2022] POST /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36/action => generated 24571 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:42:11.198353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=5 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:11.200317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=22 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:11.203102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-965a441d-32ca-4f2a-bd84-fd92c59dc5e6 req-0ec59389-7537-4737-805e-783fa5ccf159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a97b55-b81a-43c0-b068-60ab0517eb36", "tag": "ba90e0ab-8d57-43ad-9909-13475f849c34"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:42:11.203684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b287efd8-c2e8-47d7-a406-4ad5e7a7134c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:11.204374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b287efd8-c2e8-47d7-a406-4ad5e7a7134c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:11.210788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b287efd8-c2e8-47d7-a406-4ad5e7a7134c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:11.212150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b287efd8-c2e8-47d7-a406-4ad5e7a7134c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:11.212929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b287efd8-c2e8-47d7-a406-4ad5e7a7134c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:11.213514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b287efd8-c2e8-47d7-a406-4ad5e7a7134c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:11.214067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b287efd8-c2e8-47d7-a406-4ad5e7a7134c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:11.214579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b287efd8-c2e8-47d7-a406-4ad5e7a7134c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:11.217793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-965a441d-32ca-4f2a-bd84-fd92c59dc5e6 req-0ec59389-7537-4737-805e-783fa5ccf159 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:11.218609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-965a441d-32ca-4f2a-bd84-fd92c59dc5e6 req-0ec59389-7537-4737-805e-783fa5ccf159 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:11.219920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-965a441d-32ca-4f2a-bd84-fd92c59dc5e6 req-0ec59389-7537-4737-805e-783fa5ccf159 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:11.234196 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-965a441d-32ca-4f2a-bd84-fd92c59dc5e6 req-0ec59389-7537-4737-805e-783fa5ccf159 service nova] Creating event network-changed:ba90e0ab-8d57-43ad-9909-13475f849c34 for instance e3a97b55-b81a-43c0-b068-60ab0517eb36 on nch1-master-1 Sep 06 11:42:11.240529 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-965a441d-32ca-4f2a-bd84-fd92c59dc5e6 req-0ec59389-7537-4737-805e-783fa5ccf159 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042193 Sep 06 11:42:11.241434 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3274/6592] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:42:11.244863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b287efd8-c2e8-47d7-a406-4ad5e7a7134c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:42:11.525716 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b287efd8-c2e8-47d7-a406-4ad5e7a7134c tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 204 len: 0 microversion: 2.1 time: 0.329704 Sep 06 11:42:11.526410 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3319/6593] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:42:11 2022] DELETE /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:42:11.536294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a61f1b46-3ec1-4b63-a3b5-ada34dad7537 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:11.537117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a61f1b46-3ec1-4b63-a3b5-ada34dad7537 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:11.544456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a61f1b46-3ec1-4b63-a3b5-ada34dad7537 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:11.544988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a61f1b46-3ec1-4b63-a3b5-ada34dad7537 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:11.545444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a61f1b46-3ec1-4b63-a3b5-ada34dad7537 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:11.546194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a61f1b46-3ec1-4b63-a3b5-ada34dad7537 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:11.546665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a61f1b46-3ec1-4b63-a3b5-ada34dad7537 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:11.547136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a61f1b46-3ec1-4b63-a3b5-ada34dad7537 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:11.685648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a61f1b46-3ec1-4b63-a3b5-ada34dad7537 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:11.693754 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a61f1b46-3ec1-4b63-a3b5-ada34dad7537 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1690 microversion: 2.1 time: 0.162494 Sep 06 11:42:11.694341 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3275/6594] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:11 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:12.718428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-796d5d8c-b486-48ae-b4f7-9e84ba308db6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:12.719199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-796d5d8c-b486-48ae-b4f7-9e84ba308db6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:12.726345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-796d5d8c-b486-48ae-b4f7-9e84ba308db6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:12.727383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-796d5d8c-b486-48ae-b4f7-9e84ba308db6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:12.729296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-796d5d8c-b486-48ae-b4f7-9e84ba308db6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:12.729296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-796d5d8c-b486-48ae-b4f7-9e84ba308db6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:12.729296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-796d5d8c-b486-48ae-b4f7-9e84ba308db6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:12.729604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-796d5d8c-b486-48ae-b4f7-9e84ba308db6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:12.871046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-796d5d8c-b486-48ae-b4f7-9e84ba308db6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:12.880189 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-796d5d8c-b486-48ae-b4f7-9e84ba308db6 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1690 microversion: 2.1 time: 0.166187 Sep 06 11:42:12.883720 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3320/6595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:12 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:13.610880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-76163c89-8530-4a0a-b6f2-798fddbb7494 req-03b71620-ddc7-4065-aba4-4e89dfa55ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a97b55-b81a-43c0-b068-60ab0517eb36", "name": "network-vif-deleted", "tag": "ba90e0ab-8d57-43ad-9909-13475f849c34"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:42:13.621963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-76163c89-8530-4a0a-b6f2-798fddbb7494 req-03b71620-ddc7-4065-aba4-4e89dfa55ece service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:13.624903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-76163c89-8530-4a0a-b6f2-798fddbb7494 req-03b71620-ddc7-4065-aba4-4e89dfa55ece service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:13.624903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-76163c89-8530-4a0a-b6f2-798fddbb7494 req-03b71620-ddc7-4065-aba4-4e89dfa55ece service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:13.637930 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-76163c89-8530-4a0a-b6f2-798fddbb7494 req-03b71620-ddc7-4065-aba4-4e89dfa55ece service nova] Creating event network-vif-deleted:ba90e0ab-8d57-43ad-9909-13475f849c34 for instance e3a97b55-b81a-43c0-b068-60ab0517eb36 on nch1-master-1 Sep 06 11:42:13.643100 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-76163c89-8530-4a0a-b6f2-798fddbb7494 req-03b71620-ddc7-4065-aba4-4e89dfa55ece service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035978 Sep 06 11:42:13.647775 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3276/6596] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:42:13.904772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:13.905734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:13.913699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:13.914771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:13.915249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:13.916027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:13.916497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:13.916981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:13.959997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:13.960331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:13.960812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:13.961295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lazy-loading 'fault' on Instance uuid e3a97b55-b81a-43c0-b068-60ab0517eb36 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:42:14.008107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaddf25fc12498b90d2cc1ec08e5da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa117f0cf74342a3b24c0c247565a6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:14.016480 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4bff9880-1c03-4306-ba84-9c13b4103b66 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 200 len: 1356 microversion: 2.1 time: 0.115720 Sep 06 11:42:14.022109 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3321/6597] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:13 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 1356 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:15.043730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c7bf7fd0-b147-48d0-8849-7143af2a0839 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:15.044467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c7bf7fd0-b147-48d0-8849-7143af2a0839 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] [instance: e3a97b55-b81a-43c0-b068-60ab0517eb36] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:15.050881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7bf7fd0-b147-48d0-8849-7143af2a0839 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:15.051401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7bf7fd0-b147-48d0-8849-7143af2a0839 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:15.051847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7bf7fd0-b147-48d0-8849-7143af2a0839 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:15.052546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7bf7fd0-b147-48d0-8849-7143af2a0839 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:15.053007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7bf7fd0-b147-48d0-8849-7143af2a0839 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:15.053441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7bf7fd0-b147-48d0-8849-7143af2a0839 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:15.067571 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-c7bf7fd0-b147-48d0-8849-7143af2a0839 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] HTTP exception thrown: Instance e3a97b55-b81a-43c0-b068-60ab0517eb36 could not be found. Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c7bf7fd0-b147-48d0-8849-7143af2a0839 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Request method failure captured: Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 HTTP/1.1 Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzBX9CuU5UzfyxndnVZJJmTYQ3vK0GMlL8LNZgpJ5tksaXSMavHz_rJbRFm6T87lgBe9pS926ALKmRt8aQ4iI83LdY1vm2a5H52JafVqkAEM9TtY6-ItP-NrdpPjrmU2smFwTA5uczMzMisnvP5xPvXyFn1yLnZV5ywo_B1CSGR_HGg Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: aa117f0cf74342a3b24c0c247565a6c7 Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-993249934 Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa117f0cf74342a3b24c0c247565a6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa117f0cf74342a3b24c0c247565a6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa117f0cf74342a3b24c0c247565a6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa117f0cf74342a3b24c0c247565a6c7"}]}] Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestNetworkAdvancedServerOps-993249934 Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: aa117f0cf74342a3b24c0c247565a6c7 Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-993249934 Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestNetworkAdvancedServerOps-993249934-project Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: fcaddf25fc12498b90d2cc1ec08e5da3 Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestNetworkAdvancedServerOps-993249934-project Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance e3a97b55-b81a-43c0-b068-60ab0517eb36 could not be found. Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'e3a97b55-b81a-43c0-b068-60ab0517eb36'} Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a97b55-b81a-43c0-b068-60ab0517eb36 could not be found. Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a97b55-b81a-43c0-b068-60ab0517eb36 could not be found. Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:42:15.069195 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:42:15.074942 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:42:15.074942 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:42:15.074942 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:42:15.074942 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:42:15.074942 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:42:15.074942 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:42:15.074942 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a97b55-b81a-43c0-b068-60ab0517eb36 could not be found. Sep 06 11:42:15.074942 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:42:15.074942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c7bf7fd0-b147-48d0-8849-7143af2a0839 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Returning 404 to user: Instance e3a97b55-b81a-43c0-b068-60ab0517eb36 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:42:15.074942 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c7bf7fd0-b147-48d0-8849-7143af2a0839 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36" status: 404 len: 111 microversion: 2.1 time: 0.032341 Sep 06 11:42:15.074942 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3277/6598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:15 2022] GET /compute/v2.1/servers/e3a97b55-b81a-43c0-b068-60ab0517eb36 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:42:18.941139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed968144-9a89-4176-90b6-14719b2402b0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] Calling method '.version_select at 0x7f90f30d7670>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:19.005098 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ed968144-9a89-4176-90b6-14719b2402b0 tempest-TestNetworkAdvancedServerOps-993249934 tempest-TestNetworkAdvancedServerOps-993249934-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-617033041" status: 202 len: 0 microversion: 2.1 time: 0.067957 Sep 06 11:42:19.005699 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3322/6599] 10.222.0.20 () {58 vars in 1281 bytes} [Tue Sep 6 11:42:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-617033041 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:42:40.447080 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=10 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:40.448280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=16 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:40.658575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ab8b6483-cde3-4e8f-8d47-a359b29c7eca tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Action: 'create', calling method: .version_select at 0x7f90f3dac0d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-595103322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUbnZF3cUARM4rq21F071OPSisC9w7tpVvFlg/KEjnyCg7NlvU2V0CKUyBgdc4uIexS35mKoChMCWz44kz6glT1yg0YoFKPfq5Llkqq1LpUdbDDrkxGd5VdxQwH2UStqA=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:42:40.672289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ab8b6483-cde3-4e8f-8d47-a359b29c7eca tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Getting quotas for project 0dfc5d591ce044de8497d55f8df5248a. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:42:40.678726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-ab8b6483-cde3-4e8f-8d47-a359b29c7eca tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Getting quotas for user 6b891d06b3f9408aa56f2a7fcf042b88 and project 0dfc5d591ce044de8497d55f8df5248a. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:42:40.794349 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ab8b6483-cde3-4e8f-8d47-a359b29c7eca tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.353823 Sep 06 11:42:40.794995 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3278/6600] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:42:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:42:43.458857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:43.459955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:43.463923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1119769745", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-595103322", "security_groups": [{"name": "tempest-secgroup-smoke-986571947"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "48041d1e-f654-4b0e-8e97-1916e7208d75"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:42:43.577606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] validate_networks() for [('48041d1e-f654-4b0e-8e97-1916e7208d75', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:42:44.279750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Getting quotas for project 0dfc5d591ce044de8497d55f8df5248a. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:42:44.285347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Getting quotas for user 6b891d06b3f9408aa56f2a7fcf042b88 and project 0dfc5d591ce044de8497d55f8df5248a. Resources: dict_keys(['metadata_items']) {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:42:44.298209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:42:44.298642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:42:44.299155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:42:44.299580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:42:44.300003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:42:44.309163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:44.309783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:44.310244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:44.311162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:44.311633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:44.312788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:44.330531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Getting quotas for project 0dfc5d591ce044de8497d55f8df5248a. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:42:44.336138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Getting quotas for user 6b891d06b3f9408aa56f2a7fcf042b88 and project 0dfc5d591ce044de8497d55f8df5248a. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:42:44.353166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:42:44.355534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:42:44.486632 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4d6fd90e-c1e1-434e-98c6-d6005fc45bd9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.033421 Sep 06 11:42:44.487380 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3323/6601] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:42:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:42:44.499698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a90df457-5c4d-4cd0-83f9-237b70730bf1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:44.500497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a90df457-5c4d-4cd0-83f9-237b70730bf1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:44.562630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a90df457-5c4d-4cd0-83f9-237b70730bf1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:44.570138 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a90df457-5c4d-4cd0-83f9-237b70730bf1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1302 microversion: 2.1 time: 0.074527 Sep 06 11:42:44.570938 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3279/6602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:44 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1302 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:45.594764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-11fa25d6-b95e-4ba9-8b5c-593d9b6a5be5 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:45.595451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-11fa25d6-b95e-4ba9-8b5c-593d9b6a5be5 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:45.651360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-11fa25d6-b95e-4ba9-8b5c-593d9b6a5be5 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:45.659163 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-11fa25d6-b95e-4ba9-8b5c-593d9b6a5be5 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1302 microversion: 2.1 time: 0.069218 Sep 06 11:42:45.659729 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3324/6603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:45 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1302 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:46.682719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7ebd578f-4d73-4d1c-bb01-f18b7ea7d1c8 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:46.683352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7ebd578f-4d73-4d1c-bb01-f18b7ea7d1c8 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:46.691252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ebd578f-4d73-4d1c-bb01-f18b7ea7d1c8 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:46.695542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ebd578f-4d73-4d1c-bb01-f18b7ea7d1c8 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:46.695542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ebd578f-4d73-4d1c-bb01-f18b7ea7d1c8 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:46.695542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ebd578f-4d73-4d1c-bb01-f18b7ea7d1c8 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:46.695542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ebd578f-4d73-4d1c-bb01-f18b7ea7d1c8 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:46.695542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ebd578f-4d73-4d1c-bb01-f18b7ea7d1c8 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:46.756587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7ebd578f-4d73-4d1c-bb01-f18b7ea7d1c8 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:46.764529 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7ebd578f-4d73-4d1c-bb01-f18b7ea7d1c8 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1354 microversion: 2.1 time: 0.085848 Sep 06 11:42:46.765111 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3280/6604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:46 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:47.789785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fad2ccba-eb63-41c1-be78-900408f0428d tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:47.791302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fad2ccba-eb63-41c1-be78-900408f0428d tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:47.798199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fad2ccba-eb63-41c1-be78-900408f0428d tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:47.798704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fad2ccba-eb63-41c1-be78-900408f0428d tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:47.799216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fad2ccba-eb63-41c1-be78-900408f0428d tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:47.799934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fad2ccba-eb63-41c1-be78-900408f0428d tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:47.800417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fad2ccba-eb63-41c1-be78-900408f0428d tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:47.800866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fad2ccba-eb63-41c1-be78-900408f0428d tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:47.957322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fad2ccba-eb63-41c1-be78-900408f0428d tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:47.965954 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fad2ccba-eb63-41c1-be78-900408f0428d tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1427 microversion: 2.1 time: 0.180040 Sep 06 11:42:47.966489 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3325/6605] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:47 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1427 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:48.770458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-7e028498-e4bd-4df9-b8e3-37f2683c00d2 req-2c5a1332-2132-4b38-801a-39af20517321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1f3a42-da0d-4473-adbd-46e375dc05cd", "tag": "dadf99c8-59f6-4fd8-a720-ed39ee4836a1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:42:48.781626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7e028498-e4bd-4df9-b8e3-37f2683c00d2 req-2c5a1332-2132-4b38-801a-39af20517321 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:48.782152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7e028498-e4bd-4df9-b8e3-37f2683c00d2 req-2c5a1332-2132-4b38-801a-39af20517321 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:48.782594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7e028498-e4bd-4df9-b8e3-37f2683c00d2 req-2c5a1332-2132-4b38-801a-39af20517321 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:48.794474 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7e028498-e4bd-4df9-b8e3-37f2683c00d2 req-2c5a1332-2132-4b38-801a-39af20517321 service nova] Creating event network-changed:dadf99c8-59f6-4fd8-a720-ed39ee4836a1 for instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd on nch1-master-1 Sep 06 11:42:48.799834 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-7e028498-e4bd-4df9-b8e3-37f2683c00d2 req-2c5a1332-2132-4b38-801a-39af20517321 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033425 Sep 06 11:42:48.800465 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3281/6606] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:42:48.994846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-11d0c120-72f3-4eef-bbad-77d4d6784595 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:48.995513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-11d0c120-72f3-4eef-bbad-77d4d6784595 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:49.002539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11d0c120-72f3-4eef-bbad-77d4d6784595 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:49.003128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11d0c120-72f3-4eef-bbad-77d4d6784595 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:49.003525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11d0c120-72f3-4eef-bbad-77d4d6784595 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:49.004239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11d0c120-72f3-4eef-bbad-77d4d6784595 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:49.004714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11d0c120-72f3-4eef-bbad-77d4d6784595 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:49.005163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11d0c120-72f3-4eef-bbad-77d4d6784595 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:49.142777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-11d0c120-72f3-4eef-bbad-77d4d6784595 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:49.150910 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-11d0c120-72f3-4eef-bbad-77d4d6784595 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1427 microversion: 2.1 time: 0.160981 Sep 06 11:42:49.151796 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3326/6607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:48 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1427 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:50.175497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-600e3906-138b-4ead-9087-2d1dd11538f1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:50.176136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-600e3906-138b-4ead-9087-2d1dd11538f1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:50.182484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-600e3906-138b-4ead-9087-2d1dd11538f1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:50.182971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-600e3906-138b-4ead-9087-2d1dd11538f1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:50.183447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-600e3906-138b-4ead-9087-2d1dd11538f1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:50.184161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-600e3906-138b-4ead-9087-2d1dd11538f1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:50.184633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-600e3906-138b-4ead-9087-2d1dd11538f1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:50.185074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-600e3906-138b-4ead-9087-2d1dd11538f1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:50.322497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-600e3906-138b-4ead-9087-2d1dd11538f1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:50.331216 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-600e3906-138b-4ead-9087-2d1dd11538f1 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1427 microversion: 2.1 time: 0.160977 Sep 06 11:42:50.331804 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3282/6608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:50 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1427 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:51.354209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0e9ac6d4-17eb-4b2d-8384-bc61195e64e9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:51.354839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0e9ac6d4-17eb-4b2d-8384-bc61195e64e9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:51.361729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e9ac6d4-17eb-4b2d-8384-bc61195e64e9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:51.361866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e9ac6d4-17eb-4b2d-8384-bc61195e64e9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:51.362258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e9ac6d4-17eb-4b2d-8384-bc61195e64e9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:51.362969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e9ac6d4-17eb-4b2d-8384-bc61195e64e9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:51.363469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e9ac6d4-17eb-4b2d-8384-bc61195e64e9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:51.363916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0e9ac6d4-17eb-4b2d-8384-bc61195e64e9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:51.497207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0e9ac6d4-17eb-4b2d-8384-bc61195e64e9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:51.505398 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0e9ac6d4-17eb-4b2d-8384-bc61195e64e9 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1427 microversion: 2.1 time: 0.155484 Sep 06 11:42:51.505964 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3327/6609] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:51 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1427 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:52.528658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-11af5cab-9f8c-470e-9363-ab7a015fe477 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:52.529270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-11af5cab-9f8c-470e-9363-ab7a015fe477 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:52.536978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11af5cab-9f8c-470e-9363-ab7a015fe477 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:52.537413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11af5cab-9f8c-470e-9363-ab7a015fe477 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:52.537869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11af5cab-9f8c-470e-9363-ab7a015fe477 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:52.538654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11af5cab-9f8c-470e-9363-ab7a015fe477 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:52.539782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11af5cab-9f8c-470e-9363-ab7a015fe477 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:52.540298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11af5cab-9f8c-470e-9363-ab7a015fe477 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:52.675159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-11af5cab-9f8c-470e-9363-ab7a015fe477 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:52.683621 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-11af5cab-9f8c-470e-9363-ab7a015fe477 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1427 microversion: 2.1 time: 0.158310 Sep 06 11:42:52.684197 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3283/6610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:52 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1427 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:53.705976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fac7aab4-46dd-480a-ab2d-5261598e6888 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:53.706602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fac7aab4-46dd-480a-ab2d-5261598e6888 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:53.713744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fac7aab4-46dd-480a-ab2d-5261598e6888 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:53.714275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fac7aab4-46dd-480a-ab2d-5261598e6888 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:53.714730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fac7aab4-46dd-480a-ab2d-5261598e6888 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:53.715500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fac7aab4-46dd-480a-ab2d-5261598e6888 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:53.715984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fac7aab4-46dd-480a-ab2d-5261598e6888 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:53.716434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fac7aab4-46dd-480a-ab2d-5261598e6888 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:53.851035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fac7aab4-46dd-480a-ab2d-5261598e6888 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:53.859249 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fac7aab4-46dd-480a-ab2d-5261598e6888 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1427 microversion: 2.1 time: 0.157280 Sep 06 11:42:53.859879 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3328/6611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:53 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:54.882856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3052d1aa-1023-4093-8b76-7fac82926621 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:54.883534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3052d1aa-1023-4093-8b76-7fac82926621 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:54.886315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:54.891388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3052d1aa-1023-4093-8b76-7fac82926621 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:54.891888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3052d1aa-1023-4093-8b76-7fac82926621 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:54.892341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3052d1aa-1023-4093-8b76-7fac82926621 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:54.893134 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3052d1aa-1023-4093-8b76-7fac82926621 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:54.893599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3052d1aa-1023-4093-8b76-7fac82926621 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:54.899478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3052d1aa-1023-4093-8b76-7fac82926621 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:55.027739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3052d1aa-1023-4093-8b76-7fac82926621 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:55.035938 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3052d1aa-1023-4093-8b76-7fac82926621 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1427 microversion: 2.1 time: 0.157007 Sep 06 11:42:55.036518 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3284/6612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:54 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1427 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:55.704794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-ddc02f25-bb44-41b9-b919-2452b4ac1e93 req-2a64ceba-3fd1-41c6-9aa5-1dbac50326a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1f3a42-da0d-4473-adbd-46e375dc05cd", "name": "network-vif-plugged", "status": "completed", "tag": "dadf99c8-59f6-4fd8-a720-ed39ee4836a1"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:42:55.712451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:55.712451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:55.717753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ddc02f25-bb44-41b9-b919-2452b4ac1e93 req-2a64ceba-3fd1-41c6-9aa5-1dbac50326a5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:55.718261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ddc02f25-bb44-41b9-b919-2452b4ac1e93 req-2a64ceba-3fd1-41c6-9aa5-1dbac50326a5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:55.718720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ddc02f25-bb44-41b9-b919-2452b4ac1e93 req-2a64ceba-3fd1-41c6-9aa5-1dbac50326a5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:55.729982 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-ddc02f25-bb44-41b9-b919-2452b4ac1e93 req-2a64ceba-3fd1-41c6-9aa5-1dbac50326a5 service nova] Creating event network-vif-plugged:dadf99c8-59f6-4fd8-a720-ed39ee4836a1 for instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd on nch1-master-1 Sep 06 11:42:55.735499 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-ddc02f25-bb44-41b9-b919-2452b4ac1e93 req-2a64ceba-3fd1-41c6-9aa5-1dbac50326a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034341 Sep 06 11:42:55.735832 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3329/6613] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:42:56.059935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5a3830eb-4df4-4c2d-a7cc-4f3859d6c898 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:56.060686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5a3830eb-4df4-4c2d-a7cc-4f3859d6c898 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:56.068146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a3830eb-4df4-4c2d-a7cc-4f3859d6c898 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:56.068666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a3830eb-4df4-4c2d-a7cc-4f3859d6c898 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:56.069149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a3830eb-4df4-4c2d-a7cc-4f3859d6c898 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:56.069855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a3830eb-4df4-4c2d-a7cc-4f3859d6c898 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:56.070349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a3830eb-4df4-4c2d-a7cc-4f3859d6c898 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:56.070780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a3830eb-4df4-4c2d-a7cc-4f3859d6c898 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:56.210244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5a3830eb-4df4-4c2d-a7cc-4f3859d6c898 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:56.218250 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5a3830eb-4df4-4c2d-a7cc-4f3859d6c898 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1427 microversion: 2.1 time: 0.162875 Sep 06 11:42:56.218836 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3285/6614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:56 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1427 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:57.242899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ccfbccda-e4b0-4059-a3e6-42eac2af5e99 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:57.243576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ccfbccda-e4b0-4059-a3e6-42eac2af5e99 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:57.251508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccfbccda-e4b0-4059-a3e6-42eac2af5e99 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:57.252012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccfbccda-e4b0-4059-a3e6-42eac2af5e99 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:57.252478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccfbccda-e4b0-4059-a3e6-42eac2af5e99 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:57.253194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccfbccda-e4b0-4059-a3e6-42eac2af5e99 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:57.253672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccfbccda-e4b0-4059-a3e6-42eac2af5e99 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:57.254148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccfbccda-e4b0-4059-a3e6-42eac2af5e99 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:57.388754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ccfbccda-e4b0-4059-a3e6-42eac2af5e99 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:57.396665 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ccfbccda-e4b0-4059-a3e6-42eac2af5e99 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1606 microversion: 2.1 time: 0.158955 Sep 06 11:42:57.397258 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3330/6615] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:57 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1606 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:57.419859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0586ba8a-8be3-4f93-8e20-a762337ec04b tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:57.420514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0586ba8a-8be3-4f93-8e20-a762337ec04b tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:57.427508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0586ba8a-8be3-4f93-8e20-a762337ec04b tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:57.428005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0586ba8a-8be3-4f93-8e20-a762337ec04b tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:57.428458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0586ba8a-8be3-4f93-8e20-a762337ec04b tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:57.429159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0586ba8a-8be3-4f93-8e20-a762337ec04b tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:57.429743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0586ba8a-8be3-4f93-8e20-a762337ec04b tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:57.430188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0586ba8a-8be3-4f93-8e20-a762337ec04b tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:57.567534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0586ba8a-8be3-4f93-8e20-a762337ec04b tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:57.575442 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0586ba8a-8be3-4f93-8e20-a762337ec04b tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1606 microversion: 2.1 time: 0.160168 Sep 06 11:42:57.582333 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3286/6616] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:57 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1606 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:57.597638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-402436af-1879-48f7-b280-2f67252fd115 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:57.598285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-402436af-1879-48f7-b280-2f67252fd115 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:42:57.604399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-402436af-1879-48f7-b280-2f67252fd115 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:57.605474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-402436af-1879-48f7-b280-2f67252fd115 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:57.605943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-402436af-1879-48f7-b280-2f67252fd115 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:57.606661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-402436af-1879-48f7-b280-2f67252fd115 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:42:57.607169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-402436af-1879-48f7-b280-2f67252fd115 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:42:57.610999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-402436af-1879-48f7-b280-2f67252fd115 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:42:57.739271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-402436af-1879-48f7-b280-2f67252fd115 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:42:57.747320 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-402436af-1879-48f7-b280-2f67252fd115 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1606 microversion: 2.1 time: 0.153530 Sep 06 11:42:57.747907 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3331/6617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:42:57 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1606 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:43:00.027342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-1efaadb1-cc04-4b31-b1e8-2b7f75e8574e req-3d514252-7ed7-4b4e-8464-0da9949b5518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1f3a42-da0d-4473-adbd-46e375dc05cd", "tag": "dadf99c8-59f6-4fd8-a720-ed39ee4836a1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:00.038216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1efaadb1-cc04-4b31-b1e8-2b7f75e8574e req-3d514252-7ed7-4b4e-8464-0da9949b5518 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:43:00.038703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1efaadb1-cc04-4b31-b1e8-2b7f75e8574e req-3d514252-7ed7-4b4e-8464-0da9949b5518 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:43:00.039175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1efaadb1-cc04-4b31-b1e8-2b7f75e8574e req-3d514252-7ed7-4b4e-8464-0da9949b5518 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:43:00.051352 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-1efaadb1-cc04-4b31-b1e8-2b7f75e8574e req-3d514252-7ed7-4b4e-8464-0da9949b5518 service nova] Creating event network-changed:dadf99c8-59f6-4fd8-a720-ed39ee4836a1 for instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd on nch1-master-1 Sep 06 11:43:00.055651 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-1efaadb1-cc04-4b31-b1e8-2b7f75e8574e req-3d514252-7ed7-4b4e-8464-0da9949b5518 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033194 Sep 06 11:43:00.056272 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3287/6618] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:36.772393 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-011d9778-ccc4-4dcb-b18d-53c7b442f807 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:36.772944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-011d9778-ccc4-4dcb-b18d-53c7b442f807 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:43:36.775273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:43:36.775971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=40 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:43:36.782074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-011d9778-ccc4-4dcb-b18d-53c7b442f807 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:43:36.782577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-011d9778-ccc4-4dcb-b18d-53c7b442f807 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:43:36.783074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-011d9778-ccc4-4dcb-b18d-53c7b442f807 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:43:36.789252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-011d9778-ccc4-4dcb-b18d-53c7b442f807 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:43:36.789252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-011d9778-ccc4-4dcb-b18d-53c7b442f807 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:43:36.789252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-011d9778-ccc4-4dcb-b18d-53c7b442f807 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:43:36.810361 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-011d9778-ccc4-4dcb-b18d-53c7b442f807 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042136 Sep 06 11:43:36.810947 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3332/6619] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Sep 6 11:43:36 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd/os-server-password => generated 116 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:45:17.402878 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f57fb853-595b-4ef1-91ec-6bf7ec660ec1] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 11:45:17.403787 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f437706c-3085-4043-9dae-91c01118faaa] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 11:45:17.404392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:45:17.405724 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=40 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:45:17.406937 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:45:17.407119 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 11:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc/action (ip 10.222.0.20) !!! Sep 06 11:45:17.408838 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 11:45:17.408971 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 11:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc/action (ip 10.222.0.20) !!! Sep 06 11:45:17.541097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-abf256d3-74c2-47bd-a6a2-22cea659d550 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:45:17.547669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-abf256d3-74c2-47bd-a6a2-22cea659d550 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:45:17.550535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abf256d3-74c2-47bd-a6a2-22cea659d550 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:17.551050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abf256d3-74c2-47bd-a6a2-22cea659d550 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:17.551504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abf256d3-74c2-47bd-a6a2-22cea659d550 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:17.552212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abf256d3-74c2-47bd-a6a2-22cea659d550 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:17.552676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abf256d3-74c2-47bd-a6a2-22cea659d550 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:17.553115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-abf256d3-74c2-47bd-a6a2-22cea659d550 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:18.411889 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] [f57fb853-595b-4ef1-91ec-6bf7ec660ec1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58962. Sep 06 11:45:18.416261 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-abf256d3-74c2-47bd-a6a2-22cea659d550 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "POST /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc/action" status: 200 len: 24570 microversion: 2.1 time: 1.015150 Sep 06 11:45:18.416918 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3288/6620] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:45:17 2022] POST /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc/action => generated 24570 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:45:19.330648 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e366ae3e-f715-4bfe-a538-76a63bf43111] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 11:45:19.331906 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 11:45:19.333624 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:45:19.333827 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 11:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc (ip 10.222.0.20) !!! Sep 06 11:45:19.334016 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] [f437706c-3085-4043-9dae-91c01118faaa] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58964. Sep 06 11:45:19.337003 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:45:19.337181 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 11:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc (ip 10.222.0.20) !!! Sep 06 11:45:19.346951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-74053faf-439e-4401-9481-fbd2e5ea7b96 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:45:19.347678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-74053faf-439e-4401-9481-fbd2e5ea7b96 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:45:19.368325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74053faf-439e-4401-9481-fbd2e5ea7b96 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:19.368840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74053faf-439e-4401-9481-fbd2e5ea7b96 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:19.369297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74053faf-439e-4401-9481-fbd2e5ea7b96 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:19.370022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74053faf-439e-4401-9481-fbd2e5ea7b96 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:19.370495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74053faf-439e-4401-9481-fbd2e5ea7b96 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:19.370939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-74053faf-439e-4401-9481-fbd2e5ea7b96 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:19.399871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-74053faf-439e-4401-9481-fbd2e5ea7b96 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:45:19.417208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-4eadaab8-6ee2-4a70-94b7-7d282ec8be29 req-a1200772-2874-4f14-b251-641fac5bbc21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269fb053-e855-4fdb-b688-ab4e36fa07fc", "tag": "15db4cf3-31c7-4a53-9f77-af4220e91f03"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:45:19.435140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4eadaab8-6ee2-4a70-94b7-7d282ec8be29 req-a1200772-2874-4f14-b251-641fac5bbc21 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:19.435140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4eadaab8-6ee2-4a70-94b7-7d282ec8be29 req-a1200772-2874-4f14-b251-641fac5bbc21 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:19.435140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4eadaab8-6ee2-4a70-94b7-7d282ec8be29 req-a1200772-2874-4f14-b251-641fac5bbc21 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:19.440940 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-4eadaab8-6ee2-4a70-94b7-7d282ec8be29 req-a1200772-2874-4f14-b251-641fac5bbc21 service nova] Creating event network-changed:15db4cf3-31c7-4a53-9f77-af4220e91f03 for instance 269fb053-e855-4fdb-b688-ab4e36fa07fc on nch2-master-1 Sep 06 11:45:19.446135 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-4eadaab8-6ee2-4a70-94b7-7d282ec8be29 req-a1200772-2874-4f14-b251-641fac5bbc21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113757 Sep 06 11:45:19.446897 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3289/6621] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:45:19.714658 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-74053faf-439e-4401-9481-fbd2e5ea7b96 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 204 len: 0 microversion: 2.1 time: 0.385594 Sep 06 11:45:19.716704 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3333/6622] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:45:19 2022] DELETE /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:45:19.724630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d0486e63-0e56-4f11-b421-ac66707172d3 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:45:19.725352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d0486e63-0e56-4f11-b421-ac66707172d3 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:45:19.732110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0486e63-0e56-4f11-b421-ac66707172d3 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:19.732599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0486e63-0e56-4f11-b421-ac66707172d3 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:19.733797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0486e63-0e56-4f11-b421-ac66707172d3 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:19.734520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0486e63-0e56-4f11-b421-ac66707172d3 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:19.734984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0486e63-0e56-4f11-b421-ac66707172d3 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:19.735629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d0486e63-0e56-4f11-b421-ac66707172d3 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:19.874997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d0486e63-0e56-4f11-b421-ac66707172d3 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:45:19.883221 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d0486e63-0e56-4f11-b421-ac66707172d3 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1579 microversion: 2.1 time: 0.162954 Sep 06 11:45:19.888818 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3290/6623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:45:19 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:45:20.907402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b786ee96-433e-4ce4-a84d-872db1710da6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:45:20.908754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b786ee96-433e-4ce4-a84d-872db1710da6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:45:20.924615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b786ee96-433e-4ce4-a84d-872db1710da6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:20.925131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b786ee96-433e-4ce4-a84d-872db1710da6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:20.925592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b786ee96-433e-4ce4-a84d-872db1710da6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:20.926324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b786ee96-433e-4ce4-a84d-872db1710da6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:20.926804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b786ee96-433e-4ce4-a84d-872db1710da6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:20.927301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b786ee96-433e-4ce4-a84d-872db1710da6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:20.930667 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58988. Sep 06 11:45:20.934538 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] [e366ae3e-f715-4bfe-a538-76a63bf43111] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58986. Sep 06 11:45:21.089438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b786ee96-433e-4ce4-a84d-872db1710da6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:45:21.097671 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b786ee96-433e-4ce4-a84d-872db1710da6 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1579 microversion: 2.1 time: 0.195498 Sep 06 11:45:21.098346 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3334/6624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:45:20 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1579 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:45:21.968393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-5b31d241-1a47-4db6-81ba-e1e0e21c9ed8 req-8cb4f5c5-a945-43d8-aca1-01fbab4bc253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269fb053-e855-4fdb-b688-ab4e36fa07fc", "name": "network-vif-deleted", "tag": "15db4cf3-31c7-4a53-9f77-af4220e91f03"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:45:21.977947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5b31d241-1a47-4db6-81ba-e1e0e21c9ed8 req-8cb4f5c5-a945-43d8-aca1-01fbab4bc253 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:21.978437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5b31d241-1a47-4db6-81ba-e1e0e21c9ed8 req-8cb4f5c5-a945-43d8-aca1-01fbab4bc253 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:21.978884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5b31d241-1a47-4db6-81ba-e1e0e21c9ed8 req-8cb4f5c5-a945-43d8-aca1-01fbab4bc253 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:21.990142 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5b31d241-1a47-4db6-81ba-e1e0e21c9ed8 req-8cb4f5c5-a945-43d8-aca1-01fbab4bc253 service nova] Creating event network-vif-deleted:15db4cf3-31c7-4a53-9f77-af4220e91f03 for instance 269fb053-e855-4fdb-b688-ab4e36fa07fc on nch2-master-1 Sep 06 11:45:21.995000 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-5b31d241-1a47-4db6-81ba-e1e0e21c9ed8 req-8cb4f5c5-a945-43d8-aca1-01fbab4bc253 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093629 Sep 06 11:45:21.995627 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3291/6625] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:45:22.122119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-df7c9e36-8e6e-4bf9-9b18-43bb2c12da34 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:45:22.122746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-df7c9e36-8e6e-4bf9-9b18-43bb2c12da34 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:45:22.130497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df7c9e36-8e6e-4bf9-9b18-43bb2c12da34 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:22.130998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df7c9e36-8e6e-4bf9-9b18-43bb2c12da34 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:22.131484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df7c9e36-8e6e-4bf9-9b18-43bb2c12da34 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:22.132191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df7c9e36-8e6e-4bf9-9b18-43bb2c12da34 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:22.132700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df7c9e36-8e6e-4bf9-9b18-43bb2c12da34 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:22.133144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-df7c9e36-8e6e-4bf9-9b18-43bb2c12da34 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:22.207982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-df7c9e36-8e6e-4bf9-9b18-43bb2c12da34 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36875e5990b487bb1357e0b46dac402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc027a6f642454d8592b308777d59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:45:22.216441 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-df7c9e36-8e6e-4bf9-9b18-43bb2c12da34 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 200 len: 1226 microversion: 2.1 time: 0.098480 Sep 06 11:45:22.217175 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3335/6626] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:45:22 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:45:23.242780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b076da60-9637-4ee1-81df-440b9fb4a800 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:45:23.243526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b076da60-9637-4ee1-81df-440b9fb4a800 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] [instance: 269fb053-e855-4fdb-b688-ab4e36fa07fc] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:45:23.250566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b076da60-9637-4ee1-81df-440b9fb4a800 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:23.251086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b076da60-9637-4ee1-81df-440b9fb4a800 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:23.251537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b076da60-9637-4ee1-81df-440b9fb4a800 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:23.252248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b076da60-9637-4ee1-81df-440b9fb4a800 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:45:23.252717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b076da60-9637-4ee1-81df-440b9fb4a800 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:45:23.253156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b076da60-9637-4ee1-81df-440b9fb4a800 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:45:23.267307 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-b076da60-9637-4ee1-81df-440b9fb4a800 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] HTTP exception thrown: Instance 269fb053-e855-4fdb-b688-ab4e36fa07fc could not be found. Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b076da60-9637-4ee1-81df-440b9fb4a800 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Request method failure captured: Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc HTTP/1.1 Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzFQ2vLizXv-0F-MgRIpiXyEibY_kxkSM2EYhf_76f4Yzg4uNz9f1hiW7ZUxoZZgEMvk03CE7DmCEkes4ZvISQGLuK5qOnzLWzkfpL8ruFps5TAXJ1tYu_xPENd2xtzF5jkFYVyT7UrqsmlOZyu7GWTnBTwaFFG6ehsVTIiLA3QpBAI Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edc027a6f642454d8592b308777d59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edc027a6f642454d8592b308777d59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edc027a6f642454d8592b308777d59e4"}]}] Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestVolumeBootPattern-929733958 Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: edc027a6f642454d8592b308777d59e4 Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestVolumeBootPattern-929733958 Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a36875e5990b487bb1357e0b46dac402 Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestVolumeBootPattern-929733958-project Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 269fb053-e855-4fdb-b688-ab4e36fa07fc could not be found. Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '269fb053-e855-4fdb-b688-ab4e36fa07fc'} Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 269fb053-e855-4fdb-b688-ab4e36fa07fc could not be found. Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 269fb053-e855-4fdb-b688-ab4e36fa07fc could not be found. Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:45:23.268955 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:45:23.279179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:45:23.279179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:45:23.279179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:45:23.279179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:45:23.279179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:45:23.279179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 269fb053-e855-4fdb-b688-ab4e36fa07fc could not be found. Sep 06 11:45:23.279179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:45:23.279179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b076da60-9637-4ee1-81df-440b9fb4a800 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Returning 404 to user: Instance 269fb053-e855-4fdb-b688-ab4e36fa07fc could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:45:23.279179 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b076da60-9637-4ee1-81df-440b9fb4a800 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc" status: 404 len: 111 microversion: 2.1 time: 0.032868 Sep 06 11:45:23.279179 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3292/6627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:45:23 2022] GET /compute/v2.1/servers/269fb053-e855-4fdb-b688-ab4e36fa07fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:45:28.987519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3c7f3ab0-c13e-4a91-adf6-fef8ac44cce7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] Calling method '.version_select at 0x7f90f8ade550>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:45:29.052594 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3c7f3ab0-c13e-4a91-adf6-fef8ac44cce7 tempest-TestVolumeBootPattern-929733958 tempest-TestVolumeBootPattern-929733958-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1927053780" status: 202 len: 0 microversion: 2.1 time: 0.068951 Sep 06 11:45:29.053191 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3336/6628] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:45:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1927053780 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:47:40.222137 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=10 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:47:40.223465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=16 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:47:40.228276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-17306703-7543-4f21-9769-3be05377f402 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:47:40.228785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-17306703-7543-4f21-9769-3be05377f402 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:47:40.235004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17306703-7543-4f21-9769-3be05377f402 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:40.236736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17306703-7543-4f21-9769-3be05377f402 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:40.236736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17306703-7543-4f21-9769-3be05377f402 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:40.236736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17306703-7543-4f21-9769-3be05377f402 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:40.237181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17306703-7543-4f21-9769-3be05377f402 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:40.237619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17306703-7543-4f21-9769-3be05377f402 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:40.266880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-17306703-7543-4f21-9769-3be05377f402 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:47:40.499304 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-17306703-7543-4f21-9769-3be05377f402 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 204 len: 0 microversion: 2.1 time: 0.278991 Sep 06 11:47:40.499825 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3293/6629] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:47:40 2022] DELETE /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:47:40.508087 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 11:47:40.509698 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e366ae3e-f715-4bfe-a538-76a63bf43111] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 11:47:40.510090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:47:40.510858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:47:40.692280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-598229a3-9525-488b-9f30-e655b3180ca4 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:47:40.692853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-598229a3-9525-488b-9f30-e655b3180ca4 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:47:40.700388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-598229a3-9525-488b-9f30-e655b3180ca4 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:40.702002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-598229a3-9525-488b-9f30-e655b3180ca4 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:40.702002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-598229a3-9525-488b-9f30-e655b3180ca4 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:40.702232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-598229a3-9525-488b-9f30-e655b3180ca4 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:40.702581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-598229a3-9525-488b-9f30-e655b3180ca4 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:40.703056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-598229a3-9525-488b-9f30-e655b3180ca4 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:40.951571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-598229a3-9525-488b-9f30-e655b3180ca4 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:47:40.959492 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-598229a3-9525-488b-9f30-e655b3180ca4 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1731 microversion: 2.1 time: 0.455311 Sep 06 11:47:40.960063 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3337/6630] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:47:40 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1731 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:47:41.982386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1886bb37-6987-47a3-a29f-7c8a85d58eb2 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:47:41.983123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1886bb37-6987-47a3-a29f-7c8a85d58eb2 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:47:41.990249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1886bb37-6987-47a3-a29f-7c8a85d58eb2 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:41.990750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1886bb37-6987-47a3-a29f-7c8a85d58eb2 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:41.991227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1886bb37-6987-47a3-a29f-7c8a85d58eb2 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:41.991938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1886bb37-6987-47a3-a29f-7c8a85d58eb2 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:41.992404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1886bb37-6987-47a3-a29f-7c8a85d58eb2 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:41.992841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1886bb37-6987-47a3-a29f-7c8a85d58eb2 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:42.182371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1886bb37-6987-47a3-a29f-7c8a85d58eb2 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:47:42.190441 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1886bb37-6987-47a3-a29f-7c8a85d58eb2 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1731 microversion: 2.1 time: 0.212280 Sep 06 11:47:42.191037 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3294/6631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:47:41 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:47:43.152147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-f1bede55-44ed-4b3a-b5ef-90b7af8a5833 req-b0fc35f4-edfa-4391-bb4d-785792104767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1f3a42-da0d-4473-adbd-46e375dc05cd", "name": "network-vif-deleted", "tag": "dadf99c8-59f6-4fd8-a720-ed39ee4836a1"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:47:43.166794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f1bede55-44ed-4b3a-b5ef-90b7af8a5833 req-b0fc35f4-edfa-4391-bb4d-785792104767 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:43.167363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f1bede55-44ed-4b3a-b5ef-90b7af8a5833 req-b0fc35f4-edfa-4391-bb4d-785792104767 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:43.167822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f1bede55-44ed-4b3a-b5ef-90b7af8a5833 req-b0fc35f4-edfa-4391-bb4d-785792104767 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:43.180140 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59182. Sep 06 11:47:43.183422 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f1bede55-44ed-4b3a-b5ef-90b7af8a5833 req-b0fc35f4-edfa-4391-bb4d-785792104767 service nova] Creating event network-vif-deleted:dadf99c8-59f6-4fd8-a720-ed39ee4836a1 for instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd on nch1-master-1 Sep 06 11:47:43.188638 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-f1bede55-44ed-4b3a-b5ef-90b7af8a5833 req-b0fc35f4-edfa-4391-bb4d-785792104767 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040294 Sep 06 11:47:43.189331 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3338/6632] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:47:43.215093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-75fb1d66-69bc-4cd5-8842-75fda913ea6a tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:47:43.215746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-75fb1d66-69bc-4cd5-8842-75fda913ea6a tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:47:43.222746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75fb1d66-69bc-4cd5-8842-75fda913ea6a tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:43.223985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75fb1d66-69bc-4cd5-8842-75fda913ea6a tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:43.224436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75fb1d66-69bc-4cd5-8842-75fda913ea6a tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:43.225357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75fb1d66-69bc-4cd5-8842-75fda913ea6a tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:43.225825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75fb1d66-69bc-4cd5-8842-75fda913ea6a tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:43.226637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75fb1d66-69bc-4cd5-8842-75fda913ea6a tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:43.298979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-75fb1d66-69bc-4cd5-8842-75fda913ea6a tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b891d06b3f9408aa56f2a7fcf042b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfc5d591ce044de8497d55f8df5248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:47:43.304100 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-75fb1d66-69bc-4cd5-8842-75fda913ea6a tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 200 len: 1664 microversion: 2.1 time: 0.092749 Sep 06 11:47:43.304927 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3295/6633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:47:43 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 1664 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:47:44.329781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7ff3a79-384a-4fc1-9b93-28f44fba194e tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:47:44.330634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d7ff3a79-384a-4fc1-9b93-28f44fba194e tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:47:44.332920 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] [e366ae3e-f715-4bfe-a538-76a63bf43111] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59184. Sep 06 11:47:44.339215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7ff3a79-384a-4fc1-9b93-28f44fba194e tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:44.339511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7ff3a79-384a-4fc1-9b93-28f44fba194e tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:44.340064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7ff3a79-384a-4fc1-9b93-28f44fba194e tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:44.340673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7ff3a79-384a-4fc1-9b93-28f44fba194e tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:44.341154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7ff3a79-384a-4fc1-9b93-28f44fba194e tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:44.341606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7ff3a79-384a-4fc1-9b93-28f44fba194e tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:44.355900 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-d7ff3a79-384a-4fc1-9b93-28f44fba194e tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] HTTP exception thrown: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7ff3a79-384a-4fc1-9b93-28f44fba194e tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Request method failure captured: Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd HTTP/1.1 Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzIqbp9pen9QEUFC5n2gGk5YAeQmwGOVNqTxQVUKibTp83c6RcMMftldDM0OCWuaJe8qwnASAwAF7L-MVNEDvDFBs9VIGBwkAbPWpJ_5mr1A0QIMa4lDGmBIE4jNUNymLBDNk5Cs56FUcmod26gO15eqhO6-xczbXE19w1iLWo9ugwA Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0dfc5d591ce044de8497d55f8df5248a Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TestServerBasicOps-446899151 Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0dfc5d591ce044de8497d55f8df5248a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0dfc5d591ce044de8497d55f8df5248a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0dfc5d591ce044de8497d55f8df5248a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0dfc5d591ce044de8497d55f8df5248a"}]}] Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TestServerBasicOps-446899151 Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0dfc5d591ce044de8497d55f8df5248a Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TestServerBasicOps-446899151 Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TestServerBasicOps-446899151-project Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6b891d06b3f9408aa56f2a7fcf042b88 Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TestServerBasicOps-446899151-project Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '2e1f3a42-da0d-4473-adbd-46e375dc05cd'} Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:47:44.357573 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.363201 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:47:44.363201 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:47:44.363201 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:47:44.363201 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:47:44.363201 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:47:44.363201 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.363201 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.363201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7ff3a79-384a-4fc1-9b93-28f44fba194e tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Returning 404 to user: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:47:44.363201 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d7ff3a79-384a-4fc1-9b93-28f44fba194e tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 404 len: 111 microversion: 2.1 time: 0.034086 Sep 06 11:47:44.363201 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3339/6634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:47:44 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:47:44.871150 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-28bd0e3c-03f4-4dd6-a2d7-2c36b8bc5733 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:47:44.871757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-28bd0e3c-03f4-4dd6-a2d7-2c36b8bc5733 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:47:44.882446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28bd0e3c-03f4-4dd6-a2d7-2c36b8bc5733 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:44.882446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28bd0e3c-03f4-4dd6-a2d7-2c36b8bc5733 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:44.882446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28bd0e3c-03f4-4dd6-a2d7-2c36b8bc5733 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:44.882446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28bd0e3c-03f4-4dd6-a2d7-2c36b8bc5733 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:44.882446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28bd0e3c-03f4-4dd6-a2d7-2c36b8bc5733 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:44.882446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28bd0e3c-03f4-4dd6-a2d7-2c36b8bc5733 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:44.895420 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-28bd0e3c-03f4-4dd6-a2d7-2c36b8bc5733 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] HTTP exception thrown: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-28bd0e3c-03f4-4dd6-a2d7-2c36b8bc5733 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Request method failure captured: Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd HTTP/1.1 Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzIqbp9pen9QEUFC5n2gGk5YAeQmwGOVNqTxQVUKibTp83c6RcMMftldDM0OCWuaJe8qwnASAwAF7L-MVNEDvDFBs9VIGBwkAbPWpJ_5mr1A0QIMa4lDGmBIE4jNUNymLBDNk5Cs56FUcmod26gO15eqhO6-xczbXE19w1iLWo9ugwA Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 0dfc5d591ce044de8497d55f8df5248a Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestServerBasicOps-446899151 Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0dfc5d591ce044de8497d55f8df5248a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0dfc5d591ce044de8497d55f8df5248a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0dfc5d591ce044de8497d55f8df5248a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0dfc5d591ce044de8497d55f8df5248a"}]}] Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestServerBasicOps-446899151 Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 0dfc5d591ce044de8497d55f8df5248a Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestServerBasicOps-446899151 Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestServerBasicOps-446899151-project Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6b891d06b3f9408aa56f2a7fcf042b88 Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestServerBasicOps-446899151-project Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '2e1f3a42-da0d-4473-adbd-46e375dc05cd'} Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:47:44.897772 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-28bd0e3c-03f4-4dd6-a2d7-2c36b8bc5733 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Returning 404 to user: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-28bd0e3c-03f4-4dd6-a2d7-2c36b8bc5733 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 404 len: 111 microversion: 2.1 time: 0.032111 Sep 06 11:47:44.902501 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3296/6635] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:47:44 2022] DELETE /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:47:44.908245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7a4ce0e-442c-41e6-bd03-a26a1f62f975 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:47:44.908885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d7a4ce0e-442c-41e6-bd03-a26a1f62f975 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] [instance: 2e1f3a42-da0d-4473-adbd-46e375dc05cd] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:47:44.914978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7a4ce0e-442c-41e6-bd03-a26a1f62f975 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:44.915507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7a4ce0e-442c-41e6-bd03-a26a1f62f975 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:44.915967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7a4ce0e-442c-41e6-bd03-a26a1f62f975 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:44.916680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7a4ce0e-442c-41e6-bd03-a26a1f62f975 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:47:44.917158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7a4ce0e-442c-41e6-bd03-a26a1f62f975 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:47:44.917602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d7a4ce0e-442c-41e6-bd03-a26a1f62f975 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:47:44.931193 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-d7a4ce0e-442c-41e6-bd03-a26a1f62f975 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] HTTP exception thrown: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7a4ce0e-442c-41e6-bd03-a26a1f62f975 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Request method failure captured: Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd HTTP/1.1 Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzIqbp9pen9QEUFC5n2gGk5YAeQmwGOVNqTxQVUKibTp83c6RcMMftldDM0OCWuaJe8qwnASAwAF7L-MVNEDvDFBs9VIGBwkAbPWpJ_5mr1A0QIMa4lDGmBIE4jNUNymLBDNk5Cs56FUcmod26gO15eqhO6-xczbXE19w1iLWo9ugwA Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 0dfc5d591ce044de8497d55f8df5248a Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TestServerBasicOps-446899151 Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0dfc5d591ce044de8497d55f8df5248a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0dfc5d591ce044de8497d55f8df5248a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0dfc5d591ce044de8497d55f8df5248a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0dfc5d591ce044de8497d55f8df5248a"}]}] Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TestServerBasicOps-446899151 Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 0dfc5d591ce044de8497d55f8df5248a Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TestServerBasicOps-446899151 Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TestServerBasicOps-446899151-project Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6b891d06b3f9408aa56f2a7fcf042b88 Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TestServerBasicOps-446899151-project Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '2e1f3a42-da0d-4473-adbd-46e375dc05cd'} Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:47:44.932747 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.937508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:47:44.937508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:47:44.937508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:47:44.937508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:47:44.937508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:47:44.937508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. Sep 06 11:47:44.937508 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:47:44.937508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d7a4ce0e-442c-41e6-bd03-a26a1f62f975 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Returning 404 to user: Instance 2e1f3a42-da0d-4473-adbd-46e375dc05cd could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:47:44.937508 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d7a4ce0e-442c-41e6-bd03-a26a1f62f975 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd" status: 404 len: 111 microversion: 2.1 time: 0.030076 Sep 06 11:47:44.937508 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3340/6636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:47:44 2022] GET /compute/v2.1/servers/2e1f3a42-da0d-4473-adbd-46e375dc05cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:47:45.162020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fcbf093b-1f74-4c2a-9512-4e13460c4dc8 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] Calling method '.version_select at 0x7f90f3388670>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:47:45.232507 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fcbf093b-1f74-4c2a-9512-4e13460c4dc8 tempest-TestServerBasicOps-446899151 tempest-TestServerBasicOps-446899151-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-595103322" status: 202 len: 0 microversion: 2.1 time: 0.074919 Sep 06 11:47:45.233112 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3297/6637] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:47:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-595103322 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:48:08.656516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:08.657336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:08.805118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-25636838", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:48:08.881325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] validate_networks() for None {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:48:09.180743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:48:09.181260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:48:09.181801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:48:09.182315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:48:09.182803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:48:09.193318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:09.198493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:09.198493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:09.198493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:09.198493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:09.198493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:09.215002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Getting quotas for project d7a6f20b7d4143dda501dce5b788f4f6. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:48:09.221077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Getting quotas for user 4d8b745bd5c84c3780ade7252222f1d4 and project d7a6f20b7d4143dda501dce5b788f4f6. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:48:09.235285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:48:09.237680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:48:09.370759 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a7ea0c84-4a32-404e-8fb7-7d26cf5c22ac tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720678 Sep 06 11:48:09.371446 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3341/6638] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:48:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:48:09.385061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:09.389695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:09.403913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ea592d71-1530-4342-83e4-1b07649931cb tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:09.403913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ea592d71-1530-4342-83e4-1b07649931cb tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:09.459164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ea592d71-1530-4342-83e4-1b07649931cb tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:09.469022 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ea592d71-1530-4342-83e4-1b07649931cb tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1220 microversion: 2.1 time: 0.087243 Sep 06 11:48:09.469827 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3298/6639] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:09 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:10.499757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a1def9ec-9cfe-409b-861f-f9a6953b5389 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:10.500392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a1def9ec-9cfe-409b-861f-f9a6953b5389 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:10.561117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a1def9ec-9cfe-409b-861f-f9a6953b5389 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:10.569160 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a1def9ec-9cfe-409b-861f-f9a6953b5389 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1220 microversion: 2.1 time: 0.074234 Sep 06 11:48:10.569753 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3342/6640] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:10 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1220 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:48:11.594862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e85a77e3-db62-465f-9cfc-1a009f60b96f tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:11.595685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e85a77e3-db62-465f-9cfc-1a009f60b96f tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:11.605651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e85a77e3-db62-465f-9cfc-1a009f60b96f tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:11.606263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e85a77e3-db62-465f-9cfc-1a009f60b96f tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:11.606720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e85a77e3-db62-465f-9cfc-1a009f60b96f tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:11.607528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e85a77e3-db62-465f-9cfc-1a009f60b96f tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:11.607956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e85a77e3-db62-465f-9cfc-1a009f60b96f tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:11.608402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e85a77e3-db62-465f-9cfc-1a009f60b96f tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:11.688991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e85a77e3-db62-465f-9cfc-1a009f60b96f tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:11.699819 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e85a77e3-db62-465f-9cfc-1a009f60b96f tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1280 microversion: 2.1 time: 0.109854 Sep 06 11:48:11.700440 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3299/6641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:11 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1280 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:12.724275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2fae6dbb-4883-4bd2-865e-66f3750259ab tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:12.724900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2fae6dbb-4883-4bd2-865e-66f3750259ab tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:12.732098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fae6dbb-4883-4bd2-865e-66f3750259ab tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:12.732599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fae6dbb-4883-4bd2-865e-66f3750259ab tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:12.734461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fae6dbb-4883-4bd2-865e-66f3750259ab tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:12.734461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fae6dbb-4883-4bd2-865e-66f3750259ab tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:12.734461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fae6dbb-4883-4bd2-865e-66f3750259ab tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:12.734777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2fae6dbb-4883-4bd2-865e-66f3750259ab tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:12.798761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2fae6dbb-4883-4bd2-865e-66f3750259ab tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:12.807661 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2fae6dbb-4883-4bd2-865e-66f3750259ab tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1278 microversion: 2.1 time: 0.088158 Sep 06 11:48:12.808252 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3343/6642] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:12 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:13.770247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-960cf365-0ac7-4a76-bb30-b83efdcbff09 req-eb5e1b37-20e2-4b97-a4b8-2170b4cfbb64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460", "tag": "39df1b2d-4aa9-44c3-a877-c3a52e005ad4"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:48:13.782095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-960cf365-0ac7-4a76-bb30-b83efdcbff09 req-eb5e1b37-20e2-4b97-a4b8-2170b4cfbb64 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:13.782610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-960cf365-0ac7-4a76-bb30-b83efdcbff09 req-eb5e1b37-20e2-4b97-a4b8-2170b4cfbb64 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:13.783270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-960cf365-0ac7-4a76-bb30-b83efdcbff09 req-eb5e1b37-20e2-4b97-a4b8-2170b4cfbb64 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:13.796530 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-960cf365-0ac7-4a76-bb30-b83efdcbff09 req-eb5e1b37-20e2-4b97-a4b8-2170b4cfbb64 service nova] Creating event network-changed:39df1b2d-4aa9-44c3-a877-c3a52e005ad4 for instance 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 on nch1-master-1 Sep 06 11:48:13.802207 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-960cf365-0ac7-4a76-bb30-b83efdcbff09 req-eb5e1b37-20e2-4b97-a4b8-2170b4cfbb64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038382 Sep 06 11:48:13.803325 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3300/6643] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:48:13.830734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-12a1343c-c25a-44d6-8968-2b5d83c5b6de tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:13.832537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-12a1343c-c25a-44d6-8968-2b5d83c5b6de tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:13.840391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12a1343c-c25a-44d6-8968-2b5d83c5b6de tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:13.840907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12a1343c-c25a-44d6-8968-2b5d83c5b6de tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:13.841361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12a1343c-c25a-44d6-8968-2b5d83c5b6de tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:13.842832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12a1343c-c25a-44d6-8968-2b5d83c5b6de tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:13.842832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12a1343c-c25a-44d6-8968-2b5d83c5b6de tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:13.843123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12a1343c-c25a-44d6-8968-2b5d83c5b6de tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:13.987917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-12a1343c-c25a-44d6-8968-2b5d83c5b6de tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:13.995966 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-12a1343c-c25a-44d6-8968-2b5d83c5b6de tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1320 microversion: 2.1 time: 0.169365 Sep 06 11:48:13.996624 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3344/6644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:13 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:15.021128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c7058003-35fe-4d9d-ae93-8e78c24f42a3 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:15.021852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c7058003-35fe-4d9d-ae93-8e78c24f42a3 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:15.028882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7058003-35fe-4d9d-ae93-8e78c24f42a3 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:15.029380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7058003-35fe-4d9d-ae93-8e78c24f42a3 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:15.029831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7058003-35fe-4d9d-ae93-8e78c24f42a3 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:15.030562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7058003-35fe-4d9d-ae93-8e78c24f42a3 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:15.031043 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7058003-35fe-4d9d-ae93-8e78c24f42a3 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:15.031752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c7058003-35fe-4d9d-ae93-8e78c24f42a3 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:15.171757 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c7058003-35fe-4d9d-ae93-8e78c24f42a3 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:15.180385 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c7058003-35fe-4d9d-ae93-8e78c24f42a3 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1320 microversion: 2.1 time: 0.164498 Sep 06 11:48:15.180967 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3301/6645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:15 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1320 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:16.203341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8deb609f-8c43-4eda-8158-35b156211dd7 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:16.203882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8deb609f-8c43-4eda-8158-35b156211dd7 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:16.210872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8deb609f-8c43-4eda-8158-35b156211dd7 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:16.211406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8deb609f-8c43-4eda-8158-35b156211dd7 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:16.211877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8deb609f-8c43-4eda-8158-35b156211dd7 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:16.212586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8deb609f-8c43-4eda-8158-35b156211dd7 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:16.213065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8deb609f-8c43-4eda-8158-35b156211dd7 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:16.213514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8deb609f-8c43-4eda-8158-35b156211dd7 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:16.641944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8deb609f-8c43-4eda-8158-35b156211dd7 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:16.649670 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8deb609f-8c43-4eda-8158-35b156211dd7 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1320 microversion: 2.1 time: 0.450392 Sep 06 11:48:16.650261 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3345/6646] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:16 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1320 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:17.673293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7a821343-be3e-4833-9eac-54cee7564d07 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:17.673909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7a821343-be3e-4833-9eac-54cee7564d07 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:17.681565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a821343-be3e-4833-9eac-54cee7564d07 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:17.682056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a821343-be3e-4833-9eac-54cee7564d07 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:17.682508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a821343-be3e-4833-9eac-54cee7564d07 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:17.683242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a821343-be3e-4833-9eac-54cee7564d07 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:17.683715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a821343-be3e-4833-9eac-54cee7564d07 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:17.684156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a821343-be3e-4833-9eac-54cee7564d07 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:17.811877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7a821343-be3e-4833-9eac-54cee7564d07 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:17.820123 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7a821343-be3e-4833-9eac-54cee7564d07 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1320 microversion: 2.1 time: 0.150824 Sep 06 11:48:17.820705 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3302/6647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:17 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1320 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:18.843189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-202ff025-2ac7-48c9-9dcb-aba7caf1c54d tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:18.843821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-202ff025-2ac7-48c9-9dcb-aba7caf1c54d tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:18.850915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-202ff025-2ac7-48c9-9dcb-aba7caf1c54d tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:18.851465 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-202ff025-2ac7-48c9-9dcb-aba7caf1c54d tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:18.851971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-202ff025-2ac7-48c9-9dcb-aba7caf1c54d tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:18.852694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-202ff025-2ac7-48c9-9dcb-aba7caf1c54d tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:18.853175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-202ff025-2ac7-48c9-9dcb-aba7caf1c54d tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:18.853626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-202ff025-2ac7-48c9-9dcb-aba7caf1c54d tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:18.994281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-202ff025-2ac7-48c9-9dcb-aba7caf1c54d tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:19.002239 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-202ff025-2ac7-48c9-9dcb-aba7caf1c54d tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1320 microversion: 2.1 time: 0.163005 Sep 06 11:48:19.002831 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3346/6648] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:18 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:19.173583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-d4bd7eeb-4b36-4ef5-838c-35a2207fe33f req-60effe2a-b657-4ffd-86bb-4b1a79d9c479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460", "name": "network-vif-plugged", "status": "completed", "tag": "39df1b2d-4aa9-44c3-a877-c3a52e005ad4"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:48:19.184913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d4bd7eeb-4b36-4ef5-838c-35a2207fe33f req-60effe2a-b657-4ffd-86bb-4b1a79d9c479 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:19.189190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d4bd7eeb-4b36-4ef5-838c-35a2207fe33f req-60effe2a-b657-4ffd-86bb-4b1a79d9c479 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:19.189190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d4bd7eeb-4b36-4ef5-838c-35a2207fe33f req-60effe2a-b657-4ffd-86bb-4b1a79d9c479 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:19.198091 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-d4bd7eeb-4b36-4ef5-838c-35a2207fe33f req-60effe2a-b657-4ffd-86bb-4b1a79d9c479 service nova] Creating event network-vif-plugged:39df1b2d-4aa9-44c3-a877-c3a52e005ad4 for instance 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 on nch1-master-1 Sep 06 11:48:19.203321 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-d4bd7eeb-4b36-4ef5-838c-35a2207fe33f req-60effe2a-b657-4ffd-86bb-4b1a79d9c479 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161635 Sep 06 11:48:19.203967 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3303/6649] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:48:20.025342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e7d79c92-a0fb-4609-a2ed-68b9e74a8fa2 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:20.025974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e7d79c92-a0fb-4609-a2ed-68b9e74a8fa2 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:20.028044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:20.034057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7d79c92-a0fb-4609-a2ed-68b9e74a8fa2 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:20.034563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7d79c92-a0fb-4609-a2ed-68b9e74a8fa2 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:20.035549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7d79c92-a0fb-4609-a2ed-68b9e74a8fa2 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:20.036270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7d79c92-a0fb-4609-a2ed-68b9e74a8fa2 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:20.036749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7d79c92-a0fb-4609-a2ed-68b9e74a8fa2 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:20.037200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7d79c92-a0fb-4609-a2ed-68b9e74a8fa2 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:20.210705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e7d79c92-a0fb-4609-a2ed-68b9e74a8fa2 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:20.218492 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e7d79c92-a0fb-4609-a2ed-68b9e74a8fa2 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1320 microversion: 2.1 time: 0.197232 Sep 06 11:48:20.219080 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3347/6650] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:20 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:21.241816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ac8bfd69-8ed6-44ff-ae48-56f24bf8b80b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:21.242530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ac8bfd69-8ed6-44ff-ae48-56f24bf8b80b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:21.244613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:21.250785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac8bfd69-8ed6-44ff-ae48-56f24bf8b80b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:21.251325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac8bfd69-8ed6-44ff-ae48-56f24bf8b80b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:21.251777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac8bfd69-8ed6-44ff-ae48-56f24bf8b80b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:21.252523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac8bfd69-8ed6-44ff-ae48-56f24bf8b80b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:21.252990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac8bfd69-8ed6-44ff-ae48-56f24bf8b80b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:21.253431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ac8bfd69-8ed6-44ff-ae48-56f24bf8b80b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:21.523326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ac8bfd69-8ed6-44ff-ae48-56f24bf8b80b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:21.531566 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ac8bfd69-8ed6-44ff-ae48-56f24bf8b80b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1470 microversion: 2.1 time: 0.293869 Sep 06 11:48:21.532309 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3304/6651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:21 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1470 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:21.557938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:21.604790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6f404c32-05e5-437c-829c-eb9a7a952d32 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Calling method '.version_select at 0x7f90f30c9e50>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:21.669975 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6f404c32-05e5-437c-829c-eb9a7a952d32 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/e2092d74a5c249869ecdd12efc7429d4" status: 200 len: 371 microversion: 2.1 time: 0.116497 Sep 06 11:48:21.670550 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3348/6652] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 11:48:21 2022] GET /compute/v2.1/os-quota-sets/e2092d74a5c249869ecdd12efc7429d4 => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:48:21.682713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e785eab5-ac9c-4ace-afe7-cee56d6d1ebc tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1080195958", "id": 898845380, "os-flavor-access:is_public": "True"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:48:21.756046 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e785eab5-ac9c-4ace-afe7-cee56d6d1ebc tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.077215 Sep 06 11:48:21.756645 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3305/6653] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:48:21 2022] POST /compute/v2.1/flavors => generated 435 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:48:21.769647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "898845380"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:48:21.772048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:21.778159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:21.778659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:21.779138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:21.779844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:21.780315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:21.780758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:21.915963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cc9be9e86a2b4204b035a1b09d4c733c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2092d74a5c249869ecdd12efc7429d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:21.922603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1080195958 {{(pid=140876) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:48:21.929762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:21.930267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:21.930727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:21.931579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:21.932056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:21.932507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:21.957915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Getting quotas for project d7a6f20b7d4143dda501dce5b788f4f6. Resources: {'ram', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:48:21.962906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Getting quotas for user 4d8b745bd5c84c3780ade7252222f1d4 and project d7a6f20b7d4143dda501dce5b788f4f6. Resources: {'ram', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:48:21.974900 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.compute.api [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] ram quota exceeded for e2092d74a5c249869ecdd12efc7429d4, tried to resize instance. Sep 06 11:48:21.975495 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Request method failure captured: Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460/action HTTP/1.1 Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 38 Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzN4QNrMEi4iFOWL4AejltlLooOb8k9wlEpxxYBpLD2PwI2NwsvWyBBQf5gt_KMFqiyVwy2WNFHvIjb0JVatgJEucHClsBOnmV1spZLBohowEfY-XLo04ESfOpASt3hWxdp9LK2tEbYffvtduQLd9OEEGdcR9EZdgj14H8mVRdgAwPg Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: e2092d74a5c249869ecdd12efc7429d4 Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-690292975 Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Role: admin,member,reader Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: admin,member,reader Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e2092d74a5c249869ecdd12efc7429d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2092d74a5c249869ecdd12efc7429d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e2092d74a5c249869ecdd12efc7429d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2092d74a5c249869ecdd12efc7429d4"}]}] Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersAdminNegativeTestJSON-690292975 Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: e2092d74a5c249869ecdd12efc7429d4 Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-690292975 Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersAdminNegativeTestJSON-690292975-project-admin Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: cc9be9e86a2b4204b035a1b09d4c733c Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersAdminNegativeTestJSON-690292975-project-admin Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: {"resize": {"flavorRef": "898845380"}} Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460', 'body': {'resize': {'flavorRef': '898845380'}}} Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:48:21.977499 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-58e21523-baab-40a4-9c53-72ebba54ef92 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460/action" status: 403 len: 118 microversion: 2.1 time: 0.213797 Sep 06 11:48:21.982809 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3349/6654] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:48:21 2022] POST /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460/action => generated 118 bytes in 215 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:48:21.988514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-df519127-0e06-4a9f-b60c-81a76ce167fe tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:22.053195 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-df519127-0e06-4a9f-b60c-81a76ce167fe tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/898845380" status: 202 len: 0 microversion: 2.1 time: 0.068919 Sep 06 11:48:22.053790 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3306/6655] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 11:48:21 2022] DELETE /compute/v2.1/flavors/898845380 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:48:22.061804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-279fad1b-f5dc-468b-bf45-d6ee02da0f4e tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:22.083325 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-279fad1b-f5dc-468b-bf45-d6ee02da0f4e tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025077 Sep 06 11:48:22.083918 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3350/6656] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 11:48:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:22.106687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2a7eff51-8c40-4166-b17d-45b60bd6be17 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Calling method '.version_select at 0x7f90fd07b670>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:22.173871 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2a7eff51-8c40-4166-b17d-45b60bd6be17 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/e2092d74a5c249869ecdd12efc7429d4" status: 200 len: 371 microversion: 2.1 time: 0.071002 Sep 06 11:48:22.174452 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3307/6657] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 11:48:22 2022] GET /compute/v2.1/os-quota-sets/e2092d74a5c249869ecdd12efc7429d4 => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:48:22.186187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1604407e-773f-4227-9708-5d1c901cf7c4 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1625648511", "id": 1602478719, "os-flavor-access:is_public": "True"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:48:22.270981 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1604407e-773f-4227-9708-5d1c901cf7c4 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.088496 Sep 06 11:48:22.271601 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3351/6658] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:48:22 2022] POST /compute/v2.1/flavors => generated 437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:48:22.284232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1602478719"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:48:22.287310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:22.294209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:22.294698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:22.295174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:22.295904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:22.296415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:22.296853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:22.434034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cc9be9e86a2b4204b035a1b09d4c733c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2092d74a5c249869ecdd12efc7429d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:22.441372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1625648511 {{(pid=140875) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:48:22.448104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:22.448594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:22.449046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:22.449789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:22.450263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:22.450702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:22.471716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Getting quotas for project d7a6f20b7d4143dda501dce5b788f4f6. Resources: {'ram', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:48:22.476906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Getting quotas for user 4d8b745bd5c84c3780ade7252222f1d4 and project d7a6f20b7d4143dda501dce5b788f4f6. Resources: {'ram', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:48:22.488841 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.compute.api [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] cores quota exceeded for e2092d74a5c249869ecdd12efc7429d4, tried to resize instance. Sep 06 11:48:22.489392 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Request method failure captured: Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460/action HTTP/1.1 Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 39 Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzN4QNrMEi4iFOWL4AejltlLooOb8k9wlEpxxYBpLD2PwI2NwsvWyBBQf5gt_KMFqiyVwy2WNFHvIjb0JVatgJEucHClsBOnmV1spZLBohowEfY-XLo04ESfOpASt3hWxdp9LK2tEbYffvtduQLd9OEEGdcR9EZdgj14H8mVRdgAwPg Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: e2092d74a5c249869ecdd12efc7429d4 Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-690292975 Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Role: admin,member,reader Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: admin,member,reader Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e2092d74a5c249869ecdd12efc7429d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2092d74a5c249869ecdd12efc7429d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e2092d74a5c249869ecdd12efc7429d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2092d74a5c249869ecdd12efc7429d4"}]}] Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersAdminNegativeTestJSON-690292975 Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: e2092d74a5c249869ecdd12efc7429d4 Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-690292975 Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersAdminNegativeTestJSON-690292975-project-admin Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: cc9be9e86a2b4204b035a1b09d4c733c Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersAdminNegativeTestJSON-690292975-project-admin Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: {"resize": {"flavorRef": "1602478719"}} Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460', 'body': {'resize': {'flavorRef': '1602478719'}}} Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:48:22.491515 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ffbf437-972f-408f-86ad-e7df68778c99 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460/action" status: 403 len: 113 microversion: 2.1 time: 0.212989 Sep 06 11:48:22.496392 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3308/6659] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:48:22 2022] POST /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460/action => generated 113 bytes in 214 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:48:22.501866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0a48dd31-9427-4fe2-9ea2-348000018a0d tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:22.590614 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0a48dd31-9427-4fe2-9ea2-348000018a0d tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1602478719" status: 202 len: 0 microversion: 2.1 time: 0.092300 Sep 06 11:48:22.591268 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3352/6660] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Sep 6 11:48:22 2022] DELETE /compute/v2.1/flavors/1602478719 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:48:22.599366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-19d32674-6c1c-4ae7-be40-1bc30ff4d05d tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:22.619534 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-19d32674-6c1c-4ae7-be40-1bc30ff4d05d tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024037 Sep 06 11:48:22.622724 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3309/6661] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 11:48:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:22.644790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-544148c0-4e49-4d73-9150-6711562227bf tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:22.645302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-544148c0-4e49-4d73-9150-6711562227bf tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:22.652093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-544148c0-4e49-4d73-9150-6711562227bf tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:22.652615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-544148c0-4e49-4d73-9150-6711562227bf tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:22.656676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-544148c0-4e49-4d73-9150-6711562227bf tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:22.656676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-544148c0-4e49-4d73-9150-6711562227bf tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:22.656676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-544148c0-4e49-4d73-9150-6711562227bf tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:22.656676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-544148c0-4e49-4d73-9150-6711562227bf tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:22.680643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-544148c0-4e49-4d73-9150-6711562227bf tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:48:22.910916 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-544148c0-4e49-4d73-9150-6711562227bf tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 204 len: 0 microversion: 2.1 time: 0.271250 Sep 06 11:48:22.910916 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3353/6662] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:48:22 2022] DELETE /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:48:22.923893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f0c01c47-d315-4e2e-984d-37cbeb4154af tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:22.924515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f0c01c47-d315-4e2e-984d-37cbeb4154af tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:22.931777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0c01c47-d315-4e2e-984d-37cbeb4154af tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:22.932474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0c01c47-d315-4e2e-984d-37cbeb4154af tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:22.932847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0c01c47-d315-4e2e-984d-37cbeb4154af tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:22.933598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0c01c47-d315-4e2e-984d-37cbeb4154af tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:22.934086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0c01c47-d315-4e2e-984d-37cbeb4154af tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:22.934525 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0c01c47-d315-4e2e-984d-37cbeb4154af tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:23.067187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f0c01c47-d315-4e2e-984d-37cbeb4154af tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:23.075160 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f0c01c47-d315-4e2e-984d-37cbeb4154af tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1476 microversion: 2.1 time: 0.155242 Sep 06 11:48:23.075736 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3310/6663] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:22 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1476 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:24.100790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b41152a9-e528-4c30-ae6b-57719f306f7b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:24.102016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b41152a9-e528-4c30-ae6b-57719f306f7b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:24.110295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b41152a9-e528-4c30-ae6b-57719f306f7b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:24.110805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b41152a9-e528-4c30-ae6b-57719f306f7b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:24.111298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b41152a9-e528-4c30-ae6b-57719f306f7b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:24.112631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b41152a9-e528-4c30-ae6b-57719f306f7b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:24.113686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b41152a9-e528-4c30-ae6b-57719f306f7b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:24.114276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b41152a9-e528-4c30-ae6b-57719f306f7b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:24.327678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b41152a9-e528-4c30-ae6b-57719f306f7b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:24.336449 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b41152a9-e528-4c30-ae6b-57719f306f7b tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1476 microversion: 2.1 time: 0.241937 Sep 06 11:48:24.337030 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3354/6664] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:24 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1476 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:24.764366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-5e8a7408-b837-4cc8-ba99-8b044abbcf33 req-99b08f3c-29d1-429a-b8f8-73d51b1bf1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460", "name": "network-vif-deleted", "tag": "39df1b2d-4aa9-44c3-a877-c3a52e005ad4"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:48:24.775916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5e8a7408-b837-4cc8-ba99-8b044abbcf33 req-99b08f3c-29d1-429a-b8f8-73d51b1bf1e4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:24.776467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5e8a7408-b837-4cc8-ba99-8b044abbcf33 req-99b08f3c-29d1-429a-b8f8-73d51b1bf1e4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:24.776905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5e8a7408-b837-4cc8-ba99-8b044abbcf33 req-99b08f3c-29d1-429a-b8f8-73d51b1bf1e4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:24.789421 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5e8a7408-b837-4cc8-ba99-8b044abbcf33 req-99b08f3c-29d1-429a-b8f8-73d51b1bf1e4 service nova] Creating event network-vif-deleted:39df1b2d-4aa9-44c3-a877-c3a52e005ad4 for instance 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 on nch1-master-1 Sep 06 11:48:24.794699 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-5e8a7408-b837-4cc8-ba99-8b044abbcf33 req-99b08f3c-29d1-429a-b8f8-73d51b1bf1e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034000 Sep 06 11:48:24.798523 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3311/6665] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:48:25.359836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:25.360473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:25.368656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:25.369158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:25.369614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:25.370324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:25.370796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:25.371270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:25.402029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:25.402516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:25.402969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:25.403449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lazy-loading 'fault' on Instance uuid 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:48:25.444870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8b745bd5c84c3780ade7252222f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a6f20b7d4143dda501dce5b788f4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:25.452600 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-322a0836-432c-480a-acad-1cd7658c9900 tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 200 len: 1310 microversion: 2.1 time: 0.096627 Sep 06 11:48:25.453164 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3355/6666] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:25 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:26.477410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9a5a5b66-cefd-41d2-8dda-42e8dde74f8a tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:26.478132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9a5a5b66-cefd-41d2-8dda-42e8dde74f8a tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] [instance: 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:26.484483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a5a5b66-cefd-41d2-8dda-42e8dde74f8a tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:26.484988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a5a5b66-cefd-41d2-8dda-42e8dde74f8a tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:26.485447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a5a5b66-cefd-41d2-8dda-42e8dde74f8a tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:26.486160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a5a5b66-cefd-41d2-8dda-42e8dde74f8a tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:26.486632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a5a5b66-cefd-41d2-8dda-42e8dde74f8a tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:26.487112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9a5a5b66-cefd-41d2-8dda-42e8dde74f8a tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:26.501080 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-9a5a5b66-cefd-41d2-8dda-42e8dde74f8a tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] HTTP exception thrown: Instance 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 could not be found. Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9a5a5b66-cefd-41d2-8dda-42e8dde74f8a tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Request method failure captured: Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 HTTP/1.1 Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzN39SKcs0xmEDZ2qUcZozHUd3D42cFmSMS0dljXGs9skspMK2tkdRxk3uestQaC9iTUdGpB4LJn-Bshw9FFAxrToQZr-mC5gFntuTjTErY_JIB4pfhyNANoI_gg5rW0uT0T9l6zu1nOJKBn_PrKwfx-1MFc9M6oYfcbGyaPM7z2jyQ Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: d7a6f20b7d4143dda501dce5b788f4f6 Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1685715056 Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d7a6f20b7d4143dda501dce5b788f4f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d7a6f20b7d4143dda501dce5b788f4f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d7a6f20b7d4143dda501dce5b788f4f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d7a6f20b7d4143dda501dce5b788f4f6"}]}] Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1685715056 Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: d7a6f20b7d4143dda501dce5b788f4f6 Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1685715056 Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersAdminNegativeTestJSON-1685715056-project Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 4d8b745bd5c84c3780ade7252222f1d4 Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1685715056-project Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 could not be found. Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460'} Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 could not be found. Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 could not be found. Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:48:26.502726 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:48:26.508179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:48:26.508179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:48:26.508179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:48:26.508179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:48:26.508179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:48:26.508179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:48:26.508179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 could not be found. Sep 06 11:48:26.508179 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:48:26.508179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9a5a5b66-cefd-41d2-8dda-42e8dde74f8a tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] Returning 404 to user: Instance 6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:48:26.508179 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9a5a5b66-cefd-41d2-8dda-42e8dde74f8a tempest-ServersAdminNegativeTestJSON-1685715056 tempest-ServersAdminNegativeTestJSON-1685715056-project] 10.222.0.20 "GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460" status: 404 len: 111 microversion: 2.1 time: 0.032735 Sep 06 11:48:26.508179 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3312/6667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:26 2022] GET /compute/v2.1/servers/6200ba3e-fe0c-4ba4-b43e-0fc7dd01c460 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:48:35.163273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:35.164933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:35.284067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1415541477", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "f3b469ad-5f00-41f9-9347-441f74317131"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:48:35.345916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] validate_networks() for [('f3b469ad-5f00-41f9-9347-441f74317131', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:48:35.449368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:35.747837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:48:35.748280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:48:35.748778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:48:35.749229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:48:35.749689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:48:35.760217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:35.760731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:35.761194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:35.762179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:35.762658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:35.763143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:35.782205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Getting quotas for project ed84581848dc4945aceddca0cbb802a4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:48:35.789125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Getting quotas for user 3181493b161543c69b83f3f368360031 and project ed84581848dc4945aceddca0cbb802a4. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:48:35.803233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:48:35.805646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:48:35.894404 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-33719155-246a-4ba6-813c-c1bb6beb40d7 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736600 Sep 06 11:48:35.895116 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3356/6668] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:48:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:48:35.906622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f3505eb6-9ccb-4e75-a6ea-27ee8b341b37 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:35.911501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f3505eb6-9ccb-4e75-a6ea-27ee8b341b37 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:35.911501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:35.912262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:35.968850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f3505eb6-9ccb-4e75-a6ea-27ee8b341b37 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:35.974724 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f3505eb6-9ccb-4e75-a6ea-27ee8b341b37 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1215 microversion: 2.1 time: 0.072281 Sep 06 11:48:35.975334 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3313/6669] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:35 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:36.999536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-683801ab-70ea-49d9-b130-51e11eb270b5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:37.000865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-683801ab-70ea-49d9-b130-51e11eb270b5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:37.060677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-683801ab-70ea-49d9-b130-51e11eb270b5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:37.068662 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-683801ab-70ea-49d9-b130-51e11eb270b5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1215 microversion: 2.1 time: 0.073993 Sep 06 11:48:37.069485 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3357/6670] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:36 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:38.093481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7bd84f4d-f842-41ef-807f-b58035fe6633 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:38.094111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7bd84f4d-f842-41ef-807f-b58035fe6633 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:38.096428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=51 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:38.157087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7bd84f4d-f842-41ef-807f-b58035fe6633 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:38.166384 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7bd84f4d-f842-41ef-807f-b58035fe6633 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1215 microversion: 2.1 time: 0.077334 Sep 06 11:48:38.167264 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3314/6671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:38 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:39.190204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b9ede12d-08d7-4689-8def-ee453aa2091a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:39.190765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b9ede12d-08d7-4689-8def-ee453aa2091a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:39.193455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:39.245052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b9ede12d-08d7-4689-8def-ee453aa2091a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:39.252508 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b9ede12d-08d7-4689-8def-ee453aa2091a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1215 microversion: 2.1 time: 0.066460 Sep 06 11:48:39.254974 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3358/6672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:39 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:40.276007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-398ac370-619b-4883-9da4-496efd59b83b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:40.276794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-398ac370-619b-4883-9da4-496efd59b83b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:40.285045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398ac370-619b-4883-9da4-496efd59b83b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:40.285546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398ac370-619b-4883-9da4-496efd59b83b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:40.286000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398ac370-619b-4883-9da4-496efd59b83b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:40.286725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398ac370-619b-4883-9da4-496efd59b83b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:40.287228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398ac370-619b-4883-9da4-496efd59b83b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:40.287670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-398ac370-619b-4883-9da4-496efd59b83b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:40.350572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-398ac370-619b-4883-9da4-496efd59b83b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:40.359153 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-398ac370-619b-4883-9da4-496efd59b83b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1219 microversion: 2.1 time: 0.087067 Sep 06 11:48:40.359851 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3315/6673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:40 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:41.384397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7aab7db4-3b6a-4478-8d48-6fd4e1860a4a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:41.385057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7aab7db4-3b6a-4478-8d48-6fd4e1860a4a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:41.392560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7aab7db4-3b6a-4478-8d48-6fd4e1860a4a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:41.393073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7aab7db4-3b6a-4478-8d48-6fd4e1860a4a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:41.393584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7aab7db4-3b6a-4478-8d48-6fd4e1860a4a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:41.395004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7aab7db4-3b6a-4478-8d48-6fd4e1860a4a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:41.395507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7aab7db4-3b6a-4478-8d48-6fd4e1860a4a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:41.395948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7aab7db4-3b6a-4478-8d48-6fd4e1860a4a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:41.466450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7aab7db4-3b6a-4478-8d48-6fd4e1860a4a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:41.475049 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7aab7db4-3b6a-4478-8d48-6fd4e1860a4a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1219 microversion: 2.1 time: 0.094806 Sep 06 11:48:41.475692 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3359/6674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:41 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:42.498028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4505846c-2e09-4fca-9989-20f2a152bc65 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:42.498591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4505846c-2e09-4fca-9989-20f2a152bc65 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:42.505957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4505846c-2e09-4fca-9989-20f2a152bc65 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:42.506485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4505846c-2e09-4fca-9989-20f2a152bc65 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:42.506929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4505846c-2e09-4fca-9989-20f2a152bc65 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:42.507670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4505846c-2e09-4fca-9989-20f2a152bc65 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:42.508239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4505846c-2e09-4fca-9989-20f2a152bc65 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:42.508675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4505846c-2e09-4fca-9989-20f2a152bc65 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:42.578417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4505846c-2e09-4fca-9989-20f2a152bc65 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:42.590182 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4505846c-2e09-4fca-9989-20f2a152bc65 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1273 microversion: 2.1 time: 0.095948 Sep 06 11:48:42.591273 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3316/6675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:42 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1273 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:43.619337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-559cf0c6-b54b-4ee3-bb15-08f799887c41 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:43.620402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-559cf0c6-b54b-4ee3-bb15-08f799887c41 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:43.628842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-559cf0c6-b54b-4ee3-bb15-08f799887c41 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:43.629377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-559cf0c6-b54b-4ee3-bb15-08f799887c41 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:43.629839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-559cf0c6-b54b-4ee3-bb15-08f799887c41 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:43.630570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-559cf0c6-b54b-4ee3-bb15-08f799887c41 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:43.631070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-559cf0c6-b54b-4ee3-bb15-08f799887c41 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:43.631523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-559cf0c6-b54b-4ee3-bb15-08f799887c41 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:43.772404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-559cf0c6-b54b-4ee3-bb15-08f799887c41 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:43.780514 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-559cf0c6-b54b-4ee3-bb15-08f799887c41 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1315 microversion: 2.1 time: 0.168824 Sep 06 11:48:43.781106 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3360/6676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:43 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:44.117939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-545426b6-7c14-4713-b9e2-63dd7864114c req-29c2c8e3-33a5-4ef8-bc95-0af67b00163b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11145993-2237-4755-bc00-eb425ca83800", "tag": "b7f05b5f-a22b-4df8-a372-17fa913485d1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:48:44.122993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:44.129533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-545426b6-7c14-4713-b9e2-63dd7864114c req-29c2c8e3-33a5-4ef8-bc95-0af67b00163b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:44.130084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-545426b6-7c14-4713-b9e2-63dd7864114c req-29c2c8e3-33a5-4ef8-bc95-0af67b00163b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:44.130549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-545426b6-7c14-4713-b9e2-63dd7864114c req-29c2c8e3-33a5-4ef8-bc95-0af67b00163b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:44.141779 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-545426b6-7c14-4713-b9e2-63dd7864114c req-29c2c8e3-33a5-4ef8-bc95-0af67b00163b service nova] Creating event network-changed:b7f05b5f-a22b-4df8-a372-17fa913485d1 for instance 11145993-2237-4755-bc00-eb425ca83800 on nch1-master-1 Sep 06 11:48:44.147310 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-545426b6-7c14-4713-b9e2-63dd7864114c req-29c2c8e3-33a5-4ef8-bc95-0af67b00163b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098747 Sep 06 11:48:44.153007 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3317/6677] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:48:44.804232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5f298616-d648-4e71-9858-ac04b28dde33 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:44.804849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5f298616-d648-4e71-9858-ac04b28dde33 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:44.812014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f298616-d648-4e71-9858-ac04b28dde33 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:44.812519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f298616-d648-4e71-9858-ac04b28dde33 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:44.812976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f298616-d648-4e71-9858-ac04b28dde33 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:44.813692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f298616-d648-4e71-9858-ac04b28dde33 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:44.814170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f298616-d648-4e71-9858-ac04b28dde33 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:44.814617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f298616-d648-4e71-9858-ac04b28dde33 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:44.954228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5f298616-d648-4e71-9858-ac04b28dde33 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:44.963129 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5f298616-d648-4e71-9858-ac04b28dde33 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1315 microversion: 2.1 time: 0.162792 Sep 06 11:48:44.963753 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3361/6678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:44 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:45.987985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e8e75971-b3eb-4d9b-9069-10a481af29a0 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:45.988699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e8e75971-b3eb-4d9b-9069-10a481af29a0 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:45.995297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8e75971-b3eb-4d9b-9069-10a481af29a0 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:45.995790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8e75971-b3eb-4d9b-9069-10a481af29a0 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:45.996241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8e75971-b3eb-4d9b-9069-10a481af29a0 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:45.996958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8e75971-b3eb-4d9b-9069-10a481af29a0 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:45.997436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8e75971-b3eb-4d9b-9069-10a481af29a0 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:45.997877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8e75971-b3eb-4d9b-9069-10a481af29a0 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:46.141635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e8e75971-b3eb-4d9b-9069-10a481af29a0 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:46.150649 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e8e75971-b3eb-4d9b-9069-10a481af29a0 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1315 microversion: 2.1 time: 0.168228 Sep 06 11:48:46.151283 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3318/6679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:45 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:47.174748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2c116324-bf92-4335-b02f-3c592ddb5dbb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:47.175426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2c116324-bf92-4335-b02f-3c592ddb5dbb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:47.178025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:47.185450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c116324-bf92-4335-b02f-3c592ddb5dbb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:47.186767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c116324-bf92-4335-b02f-3c592ddb5dbb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:47.186767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c116324-bf92-4335-b02f-3c592ddb5dbb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:47.187779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c116324-bf92-4335-b02f-3c592ddb5dbb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:47.188268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c116324-bf92-4335-b02f-3c592ddb5dbb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:47.189017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2c116324-bf92-4335-b02f-3c592ddb5dbb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:47.354700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2c116324-bf92-4335-b02f-3c592ddb5dbb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:47.365778 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2c116324-bf92-4335-b02f-3c592ddb5dbb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1315 microversion: 2.1 time: 0.195332 Sep 06 11:48:47.366303 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3362/6680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:47 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:48.388766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a61e3ec0-d6ec-4a38-9c8e-608bbaf39243 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:48.389388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a61e3ec0-d6ec-4a38-9c8e-608bbaf39243 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:48.392272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:48.397294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a61e3ec0-d6ec-4a38-9c8e-608bbaf39243 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:48.397790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a61e3ec0-d6ec-4a38-9c8e-608bbaf39243 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:48.398238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a61e3ec0-d6ec-4a38-9c8e-608bbaf39243 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:48.398953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a61e3ec0-d6ec-4a38-9c8e-608bbaf39243 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:48.403702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a61e3ec0-d6ec-4a38-9c8e-608bbaf39243 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:48.403702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a61e3ec0-d6ec-4a38-9c8e-608bbaf39243 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:48.530965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a61e3ec0-d6ec-4a38-9c8e-608bbaf39243 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:48.539441 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a61e3ec0-d6ec-4a38-9c8e-608bbaf39243 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1315 microversion: 2.1 time: 0.154613 Sep 06 11:48:48.540014 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3319/6681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:48 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:48:49.236335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-1b940faf-17a6-4ebe-afa2-a24a07f4dce4 req-9f92f9a1-fb2f-451c-8a4b-7f4e4dd2c5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11145993-2237-4755-bc00-eb425ca83800", "name": "network-vif-plugged", "status": "completed", "tag": "b7f05b5f-a22b-4df8-a372-17fa913485d1"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:48:49.246431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1b940faf-17a6-4ebe-afa2-a24a07f4dce4 req-9f92f9a1-fb2f-451c-8a4b-7f4e4dd2c5c2 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:49.246932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1b940faf-17a6-4ebe-afa2-a24a07f4dce4 req-9f92f9a1-fb2f-451c-8a4b-7f4e4dd2c5c2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:49.247410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1b940faf-17a6-4ebe-afa2-a24a07f4dce4 req-9f92f9a1-fb2f-451c-8a4b-7f4e4dd2c5c2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:49.250162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=10 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:49.260349 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-1b940faf-17a6-4ebe-afa2-a24a07f4dce4 req-9f92f9a1-fb2f-451c-8a4b-7f4e4dd2c5c2 service nova] Creating event network-vif-plugged:b7f05b5f-a22b-4df8-a372-17fa913485d1 for instance 11145993-2237-4755-bc00-eb425ca83800 on nch1-master-1 Sep 06 11:48:49.267050 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-1b940faf-17a6-4ebe-afa2-a24a07f4dce4 req-9f92f9a1-fb2f-451c-8a4b-7f4e4dd2c5c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086233 Sep 06 11:48:49.273586 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3363/6682] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:48:49.562224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-432ec281-167c-448c-b87b-fab7f5319a76 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:49.562831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-432ec281-167c-448c-b87b-fab7f5319a76 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:49.570426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-432ec281-167c-448c-b87b-fab7f5319a76 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:49.570921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-432ec281-167c-448c-b87b-fab7f5319a76 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:49.571401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-432ec281-167c-448c-b87b-fab7f5319a76 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:49.572119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-432ec281-167c-448c-b87b-fab7f5319a76 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:49.572589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-432ec281-167c-448c-b87b-fab7f5319a76 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:49.573028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-432ec281-167c-448c-b87b-fab7f5319a76 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:49.712993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-432ec281-167c-448c-b87b-fab7f5319a76 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:49.721088 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-432ec281-167c-448c-b87b-fab7f5319a76 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1315 microversion: 2.1 time: 0.162794 Sep 06 11:48:49.721669 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3320/6683] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:49 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:50.745774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-00ab0110-580f-48a0-8c4c-f6d392e65e5a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:50.746489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-00ab0110-580f-48a0-8c4c-f6d392e65e5a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:50.754008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00ab0110-580f-48a0-8c4c-f6d392e65e5a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:50.754503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00ab0110-580f-48a0-8c4c-f6d392e65e5a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:50.754960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00ab0110-580f-48a0-8c4c-f6d392e65e5a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:50.755697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00ab0110-580f-48a0-8c4c-f6d392e65e5a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:50.756171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00ab0110-580f-48a0-8c4c-f6d392e65e5a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:50.756612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00ab0110-580f-48a0-8c4c-f6d392e65e5a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:50.892940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-00ab0110-580f-48a0-8c4c-f6d392e65e5a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:50.902481 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-00ab0110-580f-48a0-8c4c-f6d392e65e5a tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1500 microversion: 2.1 time: 0.162019 Sep 06 11:48:50.903088 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3364/6684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:50 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1500 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:50.927515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:48:50.929898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:50.936201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:50.936697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:50.937149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:50.937862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:50.938317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:50.938749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:50.969468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:50.979814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Old instance type m1.heat2, new instance type m1.heat {{(pid=140875) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:48:50.987190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:48:50.987642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:48:50.988200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:48:50.988645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:48:50.989077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:48:51.180780 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [428d1555-7861-45d9-8351-2804dbcf1ad1] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 11:48:52.187612 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [428d1555-7861-45d9-8351-2804dbcf1ad1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59540. Sep 06 11:48:52.191546 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-26c1ac6d-40d6-46f7-ba2d-0700e44c31ad tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "POST /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800/action" status: 202 len: 0 microversion: 2.1 time: 1.269994 Sep 06 11:48:52.192186 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3321/6685] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:48:50 2022] POST /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800/action => generated 0 bytes in 1271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:48:52.200314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-89fe3a4f-9abb-4f73-bef3-90f039f4947b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:52.201041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-89fe3a4f-9abb-4f73-bef3-90f039f4947b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:52.209128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89fe3a4f-9abb-4f73-bef3-90f039f4947b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:52.209642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89fe3a4f-9abb-4f73-bef3-90f039f4947b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:52.210109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89fe3a4f-9abb-4f73-bef3-90f039f4947b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:52.210852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89fe3a4f-9abb-4f73-bef3-90f039f4947b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:52.211371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89fe3a4f-9abb-4f73-bef3-90f039f4947b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:52.211824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89fe3a4f-9abb-4f73-bef3-90f039f4947b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:52.353451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-89fe3a4f-9abb-4f73-bef3-90f039f4947b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:52.361522 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-89fe3a4f-9abb-4f73-bef3-90f039f4947b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1509 microversion: 2.1 time: 0.165070 Sep 06 11:48:52.362111 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3365/6686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:52 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:53.385208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-48f1b371-9092-48f3-8271-81396a7ab596 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:53.385868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-48f1b371-9092-48f3-8271-81396a7ab596 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:53.393366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-48f1b371-9092-48f3-8271-81396a7ab596 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:53.394379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-48f1b371-9092-48f3-8271-81396a7ab596 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:53.394840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-48f1b371-9092-48f3-8271-81396a7ab596 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:53.395594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-48f1b371-9092-48f3-8271-81396a7ab596 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:53.396068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-48f1b371-9092-48f3-8271-81396a7ab596 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:53.396511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-48f1b371-9092-48f3-8271-81396a7ab596 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:53.535676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-48f1b371-9092-48f3-8271-81396a7ab596 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:53.544068 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-48f1b371-9092-48f3-8271-81396a7ab596 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1509 microversion: 2.1 time: 0.163673 Sep 06 11:48:53.544662 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3322/6687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:53 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:54.568419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-02bf7247-69a9-42ab-91d5-92055f7458bb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:54.569043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-02bf7247-69a9-42ab-91d5-92055f7458bb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:54.576211 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02bf7247-69a9-42ab-91d5-92055f7458bb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:54.576747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02bf7247-69a9-42ab-91d5-92055f7458bb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:54.577203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02bf7247-69a9-42ab-91d5-92055f7458bb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:54.577918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02bf7247-69a9-42ab-91d5-92055f7458bb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:54.578388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02bf7247-69a9-42ab-91d5-92055f7458bb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:54.578825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02bf7247-69a9-42ab-91d5-92055f7458bb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:54.715033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-02bf7247-69a9-42ab-91d5-92055f7458bb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:54.724413 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-02bf7247-69a9-42ab-91d5-92055f7458bb tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1509 microversion: 2.1 time: 0.160661 Sep 06 11:48:54.725067 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3366/6688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:54 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:48:55.749018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4618ede2-a9ba-4ebc-aa9d-82f226d1f323 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:55.749648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4618ede2-a9ba-4ebc-aa9d-82f226d1f323 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:55.756929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4618ede2-a9ba-4ebc-aa9d-82f226d1f323 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:55.757552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4618ede2-a9ba-4ebc-aa9d-82f226d1f323 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:55.758044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4618ede2-a9ba-4ebc-aa9d-82f226d1f323 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:55.758787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4618ede2-a9ba-4ebc-aa9d-82f226d1f323 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:55.759286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4618ede2-a9ba-4ebc-aa9d-82f226d1f323 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:55.762204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4618ede2-a9ba-4ebc-aa9d-82f226d1f323 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:55.900853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4618ede2-a9ba-4ebc-aa9d-82f226d1f323 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:55.910226 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4618ede2-a9ba-4ebc-aa9d-82f226d1f323 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1509 microversion: 2.1 time: 0.164772 Sep 06 11:48:55.910830 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3323/6689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:55 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:56.934139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-07185f9d-890f-4919-b91c-b9848f63d8e9 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:56.934816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-07185f9d-890f-4919-b91c-b9848f63d8e9 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:56.942172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07185f9d-890f-4919-b91c-b9848f63d8e9 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:56.942677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07185f9d-890f-4919-b91c-b9848f63d8e9 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:56.943164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07185f9d-890f-4919-b91c-b9848f63d8e9 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:56.943879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07185f9d-890f-4919-b91c-b9848f63d8e9 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:56.944352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07185f9d-890f-4919-b91c-b9848f63d8e9 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:56.944794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07185f9d-890f-4919-b91c-b9848f63d8e9 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:57.076367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-07185f9d-890f-4919-b91c-b9848f63d8e9 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:57.084198 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-07185f9d-890f-4919-b91c-b9848f63d8e9 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.154574 Sep 06 11:48:57.084776 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3367/6690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:56 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:48:58.111560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9706f562-0281-4631-aeaa-f0546b39253f tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:58.112215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9706f562-0281-4631-aeaa-f0546b39253f tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:58.119283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9706f562-0281-4631-aeaa-f0546b39253f tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:58.119778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9706f562-0281-4631-aeaa-f0546b39253f tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:58.120228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9706f562-0281-4631-aeaa-f0546b39253f tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:58.120956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9706f562-0281-4631-aeaa-f0546b39253f tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:58.121405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9706f562-0281-4631-aeaa-f0546b39253f tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:58.121848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9706f562-0281-4631-aeaa-f0546b39253f tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:58.261486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9706f562-0281-4631-aeaa-f0546b39253f tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:58.269878 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9706f562-0281-4631-aeaa-f0546b39253f tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.162254 Sep 06 11:48:58.270468 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3324/6691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:58 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:59.294167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-29829b22-80c2-4487-acd1-00c769252b7e tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:59.294795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-29829b22-80c2-4487-acd1-00c769252b7e tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:48:59.302823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29829b22-80c2-4487-acd1-00c769252b7e tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:59.303358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29829b22-80c2-4487-acd1-00c769252b7e tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:59.303832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29829b22-80c2-4487-acd1-00c769252b7e tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:59.304555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29829b22-80c2-4487-acd1-00c769252b7e tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:59.305029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29829b22-80c2-4487-acd1-00c769252b7e tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:59.305481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-29829b22-80c2-4487-acd1-00c769252b7e tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:59.448513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-29829b22-80c2-4487-acd1-00c769252b7e tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:48:59.457190 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-29829b22-80c2-4487-acd1-00c769252b7e tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.166365 Sep 06 11:48:59.457816 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3368/6692] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:48:59 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:00.481136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fb0dc3ff-9b1b-4b0f-81fa-26c379d07d6b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:00.481787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb0dc3ff-9b1b-4b0f-81fa-26c379d07d6b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:00.489391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb0dc3ff-9b1b-4b0f-81fa-26c379d07d6b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:00.489930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb0dc3ff-9b1b-4b0f-81fa-26c379d07d6b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:00.490377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb0dc3ff-9b1b-4b0f-81fa-26c379d07d6b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:00.491145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb0dc3ff-9b1b-4b0f-81fa-26c379d07d6b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:00.491612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb0dc3ff-9b1b-4b0f-81fa-26c379d07d6b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:00.492049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb0dc3ff-9b1b-4b0f-81fa-26c379d07d6b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:00.630450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fb0dc3ff-9b1b-4b0f-81fa-26c379d07d6b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:00.638938 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fb0dc3ff-9b1b-4b0f-81fa-26c379d07d6b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.161689 Sep 06 11:49:00.639569 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3325/6693] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:00 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:01.662302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-26dbf158-d124-4d92-871d-34a086a499c3 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:01.662862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-26dbf158-d124-4d92-871d-34a086a499c3 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:01.669942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26dbf158-d124-4d92-871d-34a086a499c3 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:01.670447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26dbf158-d124-4d92-871d-34a086a499c3 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:01.670902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26dbf158-d124-4d92-871d-34a086a499c3 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:01.671642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26dbf158-d124-4d92-871d-34a086a499c3 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:01.672119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26dbf158-d124-4d92-871d-34a086a499c3 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:01.672565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-26dbf158-d124-4d92-871d-34a086a499c3 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:01.811779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-26dbf158-d124-4d92-871d-34a086a499c3 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:01.820618 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-26dbf158-d124-4d92-871d-34a086a499c3 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.162355 Sep 06 11:49:01.821211 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3369/6694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:01 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:02.844339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f87b989f-f435-4d21-a654-ee116dca37f5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:02.844945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f87b989f-f435-4d21-a654-ee116dca37f5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:02.853163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f87b989f-f435-4d21-a654-ee116dca37f5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:02.853656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f87b989f-f435-4d21-a654-ee116dca37f5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:02.854102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f87b989f-f435-4d21-a654-ee116dca37f5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:02.854807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f87b989f-f435-4d21-a654-ee116dca37f5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:02.855294 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f87b989f-f435-4d21-a654-ee116dca37f5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:02.855731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f87b989f-f435-4d21-a654-ee116dca37f5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:03.003097 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f87b989f-f435-4d21-a654-ee116dca37f5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:03.011668 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f87b989f-f435-4d21-a654-ee116dca37f5 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.171099 Sep 06 11:49:03.011933 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3326/6695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:02 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:04.035085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-11d51a7f-9c1d-4e87-9bf6-705d0616e617 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:04.035735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-11d51a7f-9c1d-4e87-9bf6-705d0616e617 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:04.042159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11d51a7f-9c1d-4e87-9bf6-705d0616e617 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:04.043178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11d51a7f-9c1d-4e87-9bf6-705d0616e617 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:04.043178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11d51a7f-9c1d-4e87-9bf6-705d0616e617 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:04.043859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11d51a7f-9c1d-4e87-9bf6-705d0616e617 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:04.044332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11d51a7f-9c1d-4e87-9bf6-705d0616e617 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:04.044777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11d51a7f-9c1d-4e87-9bf6-705d0616e617 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:04.189855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-11d51a7f-9c1d-4e87-9bf6-705d0616e617 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:04.198657 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-11d51a7f-9c1d-4e87-9bf6-705d0616e617 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.168626 Sep 06 11:49:04.199309 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3370/6696] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:04 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:05.222033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-47931011-6343-4075-9102-7a60d5a4c748 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:05.222635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-47931011-6343-4075-9102-7a60d5a4c748 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:05.229486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47931011-6343-4075-9102-7a60d5a4c748 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:05.229975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47931011-6343-4075-9102-7a60d5a4c748 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:05.230420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47931011-6343-4075-9102-7a60d5a4c748 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:05.231142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47931011-6343-4075-9102-7a60d5a4c748 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:05.231605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47931011-6343-4075-9102-7a60d5a4c748 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:05.232038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47931011-6343-4075-9102-7a60d5a4c748 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:05.364866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-47931011-6343-4075-9102-7a60d5a4c748 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:05.372864 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-47931011-6343-4075-9102-7a60d5a4c748 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.154918 Sep 06 11:49:05.373461 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3327/6697] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:05 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:06.396620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-694ff4f5-e72f-40a5-b958-6bf0492c7fbc tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:06.397360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-694ff4f5-e72f-40a5-b958-6bf0492c7fbc tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:06.414052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-694ff4f5-e72f-40a5-b958-6bf0492c7fbc tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:06.415286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-694ff4f5-e72f-40a5-b958-6bf0492c7fbc tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:06.415286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-694ff4f5-e72f-40a5-b958-6bf0492c7fbc tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:06.415868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-694ff4f5-e72f-40a5-b958-6bf0492c7fbc tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:06.416340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-694ff4f5-e72f-40a5-b958-6bf0492c7fbc tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:06.416789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-694ff4f5-e72f-40a5-b958-6bf0492c7fbc tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:06.419738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=71 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:06.552968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-694ff4f5-e72f-40a5-b958-6bf0492c7fbc tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:06.561576 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-694ff4f5-e72f-40a5-b958-6bf0492c7fbc tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.169785 Sep 06 11:49:06.563079 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3371/6698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:06 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:07.586461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b5872812-cd09-4fbe-83bd-1e2c8cd59485 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:07.587003 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b5872812-cd09-4fbe-83bd-1e2c8cd59485 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:07.594329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5872812-cd09-4fbe-83bd-1e2c8cd59485 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:07.594817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5872812-cd09-4fbe-83bd-1e2c8cd59485 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:07.595291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5872812-cd09-4fbe-83bd-1e2c8cd59485 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:07.596000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5872812-cd09-4fbe-83bd-1e2c8cd59485 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:07.596459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5872812-cd09-4fbe-83bd-1e2c8cd59485 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:07.596892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b5872812-cd09-4fbe-83bd-1e2c8cd59485 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:07.727222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b5872812-cd09-4fbe-83bd-1e2c8cd59485 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:07.734565 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b5872812-cd09-4fbe-83bd-1e2c8cd59485 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.152746 Sep 06 11:49:07.735162 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3328/6699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:07 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:08.758657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a77c72aa-2eb0-454e-a8b5-2818823d0a13 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:08.759251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a77c72aa-2eb0-454e-a8b5-2818823d0a13 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:08.766202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a77c72aa-2eb0-454e-a8b5-2818823d0a13 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:08.766701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a77c72aa-2eb0-454e-a8b5-2818823d0a13 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:08.767510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a77c72aa-2eb0-454e-a8b5-2818823d0a13 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:08.768052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a77c72aa-2eb0-454e-a8b5-2818823d0a13 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:08.768520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a77c72aa-2eb0-454e-a8b5-2818823d0a13 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:08.768961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a77c72aa-2eb0-454e-a8b5-2818823d0a13 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:08.898392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a77c72aa-2eb0-454e-a8b5-2818823d0a13 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:08.906276 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a77c72aa-2eb0-454e-a8b5-2818823d0a13 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.152335 Sep 06 11:49:08.907197 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3372/6700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:08 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:09.931446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-75d06156-bede-40e5-8a38-3d5a5aa88644 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:09.931446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-75d06156-bede-40e5-8a38-3d5a5aa88644 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:09.938313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75d06156-bede-40e5-8a38-3d5a5aa88644 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:09.938809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75d06156-bede-40e5-8a38-3d5a5aa88644 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:09.940045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75d06156-bede-40e5-8a38-3d5a5aa88644 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:09.940045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75d06156-bede-40e5-8a38-3d5a5aa88644 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:09.940458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75d06156-bede-40e5-8a38-3d5a5aa88644 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:09.940898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75d06156-bede-40e5-8a38-3d5a5aa88644 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:09.943593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:10.077932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-75d06156-bede-40e5-8a38-3d5a5aa88644 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:10.085812 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-75d06156-bede-40e5-8a38-3d5a5aa88644 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.159231 Sep 06 11:49:10.087922 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3329/6701] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:09 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:11.108559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-96025186-6942-4178-a256-2f513a1b4f30 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:11.109121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-96025186-6942-4178-a256-2f513a1b4f30 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:11.117336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96025186-6942-4178-a256-2f513a1b4f30 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:11.117834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96025186-6942-4178-a256-2f513a1b4f30 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:11.118349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96025186-6942-4178-a256-2f513a1b4f30 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:11.119103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96025186-6942-4178-a256-2f513a1b4f30 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:11.119576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96025186-6942-4178-a256-2f513a1b4f30 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:11.120032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-96025186-6942-4178-a256-2f513a1b4f30 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:11.251926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-96025186-6942-4178-a256-2f513a1b4f30 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:11.260503 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-96025186-6942-4178-a256-2f513a1b4f30 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.156038 Sep 06 11:49:11.261090 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3373/6702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:11 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:12.284898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e053a7f8-c39d-41a4-a798-74f74cef0a06 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:12.285519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e053a7f8-c39d-41a4-a798-74f74cef0a06 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:12.293014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e053a7f8-c39d-41a4-a798-74f74cef0a06 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:12.293501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e053a7f8-c39d-41a4-a798-74f74cef0a06 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:12.293947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e053a7f8-c39d-41a4-a798-74f74cef0a06 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:12.294666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e053a7f8-c39d-41a4-a798-74f74cef0a06 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:12.295129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e053a7f8-c39d-41a4-a798-74f74cef0a06 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:12.295566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e053a7f8-c39d-41a4-a798-74f74cef0a06 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:12.431125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e053a7f8-c39d-41a4-a798-74f74cef0a06 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:12.439113 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e053a7f8-c39d-41a4-a798-74f74cef0a06 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1514 microversion: 2.1 time: 0.158426 Sep 06 11:49:12.439697 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3330/6703] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:12 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:13.465559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ae86c6d4-8390-4a1c-af30-1458e651689b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:13.466199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ae86c6d4-8390-4a1c-af30-1458e651689b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:13.474567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae86c6d4-8390-4a1c-af30-1458e651689b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:13.474567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae86c6d4-8390-4a1c-af30-1458e651689b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:13.474567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae86c6d4-8390-4a1c-af30-1458e651689b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:13.475207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae86c6d4-8390-4a1c-af30-1458e651689b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:13.475442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae86c6d4-8390-4a1c-af30-1458e651689b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:13.475860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae86c6d4-8390-4a1c-af30-1458e651689b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:13.482975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-daf4c540-6c05-48a1-b84f-2c96d4a3a6fb req-d4f1b8b5-13db-4dfc-a0d0-b4c68c40b32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11145993-2237-4755-bc00-eb425ca83800", "name": "network-vif-unplugged", "status": "completed", "tag": "b7f05b5f-a22b-4df8-a372-17fa913485d1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:49:13.495247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-daf4c540-6c05-48a1-b84f-2c96d4a3a6fb req-d4f1b8b5-13db-4dfc-a0d0-b4c68c40b32a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:13.500731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-daf4c540-6c05-48a1-b84f-2c96d4a3a6fb req-d4f1b8b5-13db-4dfc-a0d0-b4c68c40b32a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:13.500731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-daf4c540-6c05-48a1-b84f-2c96d4a3a6fb req-d4f1b8b5-13db-4dfc-a0d0-b4c68c40b32a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:13.508790 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-daf4c540-6c05-48a1-b84f-2c96d4a3a6fb req-d4f1b8b5-13db-4dfc-a0d0-b4c68c40b32a service nova] Creating event network-vif-unplugged:b7f05b5f-a22b-4df8-a372-17fa913485d1 for instance 11145993-2237-4755-bc00-eb425ca83800 on nch2-master-1 Sep 06 11:49:13.514456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-daf4c540-6c05-48a1-b84f-2c96d4a3a6fb req-d4f1b8b5-13db-4dfc-a0d0-b4c68c40b32a service nova] Instance 11145993-2237-4755-bc00-eb425ca83800 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:49:13.525911 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-daf4c540-6c05-48a1-b84f-2c96d4a3a6fb req-d4f1b8b5-13db-4dfc-a0d0-b4c68c40b32a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047476 Sep 06 11:49:13.526546 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3331/6704] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:49:13.616104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ae86c6d4-8390-4a1c-af30-1458e651689b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:13.624408 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ae86c6d4-8390-4a1c-af30-1458e651689b tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1513 microversion: 2.1 time: 0.163174 Sep 06 11:49:13.624991 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3374/6705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:13 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:14.650290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cc8365eb-ed85-4c05-9cfe-4d67004b83da tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:14.651002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cc8365eb-ed85-4c05-9cfe-4d67004b83da tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:14.657691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc8365eb-ed85-4c05-9cfe-4d67004b83da tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:14.658180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc8365eb-ed85-4c05-9cfe-4d67004b83da tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:14.658624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc8365eb-ed85-4c05-9cfe-4d67004b83da tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:14.659449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc8365eb-ed85-4c05-9cfe-4d67004b83da tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:14.659914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc8365eb-ed85-4c05-9cfe-4d67004b83da tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:14.660347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc8365eb-ed85-4c05-9cfe-4d67004b83da tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:14.793360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cc8365eb-ed85-4c05-9cfe-4d67004b83da tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:14.802164 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cc8365eb-ed85-4c05-9cfe-4d67004b83da tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1513 microversion: 2.1 time: 0.157543 Sep 06 11:49:14.802755 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3332/6706] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:14 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:15.541608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-1d5f4328-97b5-41f2-af4b-009f0a7b96cd req-6654d239-6ac3-4cb7-b524-64e8df29ae52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11145993-2237-4755-bc00-eb425ca83800", "tag": "b7f05b5f-a22b-4df8-a372-17fa913485d1"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:49:15.547375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=36 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:15.553246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1d5f4328-97b5-41f2-af4b-009f0a7b96cd req-6654d239-6ac3-4cb7-b524-64e8df29ae52 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:15.553744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1d5f4328-97b5-41f2-af4b-009f0a7b96cd req-6654d239-6ac3-4cb7-b524-64e8df29ae52 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:15.554206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-1d5f4328-97b5-41f2-af4b-009f0a7b96cd req-6654d239-6ac3-4cb7-b524-64e8df29ae52 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:15.566663 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-1d5f4328-97b5-41f2-af4b-009f0a7b96cd req-6654d239-6ac3-4cb7-b524-64e8df29ae52 service nova] Creating event network-changed:b7f05b5f-a22b-4df8-a372-17fa913485d1 for instance 11145993-2237-4755-bc00-eb425ca83800 on nch2-master-1 Sep 06 11:49:15.572957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-1d5f4328-97b5-41f2-af4b-009f0a7b96cd req-6654d239-6ac3-4cb7-b524-64e8df29ae52 service nova] Instance 11145993-2237-4755-bc00-eb425ca83800 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:49:15.585538 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-1d5f4328-97b5-41f2-af4b-009f0a7b96cd req-6654d239-6ac3-4cb7-b524-64e8df29ae52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047730 Sep 06 11:49:15.586345 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3375/6707] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:49:15.825967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1cf6c157-7691-49c8-82eb-22339ba0ec26 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:15.826581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1cf6c157-7691-49c8-82eb-22339ba0ec26 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:15.834197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cf6c157-7691-49c8-82eb-22339ba0ec26 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:15.834933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cf6c157-7691-49c8-82eb-22339ba0ec26 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:15.835600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cf6c157-7691-49c8-82eb-22339ba0ec26 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:15.836321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cf6c157-7691-49c8-82eb-22339ba0ec26 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:15.836791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cf6c157-7691-49c8-82eb-22339ba0ec26 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:15.837231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1cf6c157-7691-49c8-82eb-22339ba0ec26 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:15.979343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1cf6c157-7691-49c8-82eb-22339ba0ec26 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:15.987280 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1cf6c157-7691-49c8-82eb-22339ba0ec26 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1511 microversion: 2.1 time: 0.165342 Sep 06 11:49:15.988040 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3333/6708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:15 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:17.012729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-70b28cbb-fc3d-4e4e-b427-32feb60a24f8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:17.013489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-70b28cbb-fc3d-4e4e-b427-32feb60a24f8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:17.021959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70b28cbb-fc3d-4e4e-b427-32feb60a24f8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:17.026553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70b28cbb-fc3d-4e4e-b427-32feb60a24f8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:17.026553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70b28cbb-fc3d-4e4e-b427-32feb60a24f8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:17.026553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70b28cbb-fc3d-4e4e-b427-32feb60a24f8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:17.026553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70b28cbb-fc3d-4e4e-b427-32feb60a24f8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:17.026553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-70b28cbb-fc3d-4e4e-b427-32feb60a24f8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:17.164044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-70b28cbb-fc3d-4e4e-b427-32feb60a24f8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:17.172490 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-70b28cbb-fc3d-4e4e-b427-32feb60a24f8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1508 microversion: 2.1 time: 0.164612 Sep 06 11:49:17.173077 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3376/6709] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:17 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:17.196056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-914ae13a-5c01-4101-95d4-488965e8cee8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:17.196656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-914ae13a-5c01-4101-95d4-488965e8cee8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:17.199753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=38 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:17.206021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-914ae13a-5c01-4101-95d4-488965e8cee8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:17.206646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-914ae13a-5c01-4101-95d4-488965e8cee8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:17.207189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-914ae13a-5c01-4101-95d4-488965e8cee8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:17.210073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-914ae13a-5c01-4101-95d4-488965e8cee8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:17.210073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-914ae13a-5c01-4101-95d4-488965e8cee8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:17.210073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-914ae13a-5c01-4101-95d4-488965e8cee8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:17.236950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-914ae13a-5c01-4101-95d4-488965e8cee8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:49:17.330608 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.compute.api [None req-914ae13a-5c01-4101-95d4-488965e8cee8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Found an unconfirmed migration during delete, id: 16, status: finished Sep 06 11:49:19.578366 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-914ae13a-5c01-4101-95d4-488965e8cee8 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "DELETE /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 204 len: 0 microversion: 2.1 time: 2.386996 Sep 06 11:49:19.579200 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3334/6710] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:49:17 2022] DELETE /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 0 bytes in 2389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:49:19.587698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-778ba607-b594-4014-b68c-f494566f9304 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:19.588328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-778ba607-b594-4014-b68c-f494566f9304 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:19.595428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-778ba607-b594-4014-b68c-f494566f9304 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:19.595932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-778ba607-b594-4014-b68c-f494566f9304 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:19.596389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-778ba607-b594-4014-b68c-f494566f9304 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:19.597102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-778ba607-b594-4014-b68c-f494566f9304 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:19.597580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-778ba607-b594-4014-b68c-f494566f9304 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:19.598625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-778ba607-b594-4014-b68c-f494566f9304 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:19.732425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-778ba607-b594-4014-b68c-f494566f9304 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:19.741671 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-778ba607-b594-4014-b68c-f494566f9304 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1500 microversion: 2.1 time: 0.157871 Sep 06 11:49:19.750145 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3377/6711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:19 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1500 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:20.541508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-1e4d2b58-f8e0-45fb-99be-14d809b8584c req-284eb614-3ad7-4840-a726-22440040399d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11145993-2237-4755-bc00-eb425ca83800", "name": "network-vif-plugged", "status": "completed", "tag": "b7f05b5f-a22b-4df8-a372-17fa913485d1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:49:20.553953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1e4d2b58-f8e0-45fb-99be-14d809b8584c req-284eb614-3ad7-4840-a726-22440040399d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:20.554447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1e4d2b58-f8e0-45fb-99be-14d809b8584c req-284eb614-3ad7-4840-a726-22440040399d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:20.554891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1e4d2b58-f8e0-45fb-99be-14d809b8584c req-284eb614-3ad7-4840-a726-22440040399d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:20.565784 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-1e4d2b58-f8e0-45fb-99be-14d809b8584c req-284eb614-3ad7-4840-a726-22440040399d service nova] Creating event network-vif-plugged:b7f05b5f-a22b-4df8-a372-17fa913485d1 for instance 11145993-2237-4755-bc00-eb425ca83800 on nch2-master-1 Sep 06 11:49:20.571366 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-1e4d2b58-f8e0-45fb-99be-14d809b8584c req-284eb614-3ad7-4840-a726-22440040399d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034033 Sep 06 11:49:20.571972 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3335/6712] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:49:20.765843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9ec23f37-bf2d-4f4c-9185-586746fc067d tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:20.766466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9ec23f37-bf2d-4f4c-9185-586746fc067d tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:20.769076 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:49:20.769218 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 11:49:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 (ip 10.222.0.20) !!! Sep 06 11:49:20.776543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec23f37-bf2d-4f4c-9185-586746fc067d tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:20.777055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec23f37-bf2d-4f4c-9185-586746fc067d tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:20.777510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec23f37-bf2d-4f4c-9185-586746fc067d tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:20.778233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec23f37-bf2d-4f4c-9185-586746fc067d tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:20.778708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec23f37-bf2d-4f4c-9185-586746fc067d tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:20.779189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9ec23f37-bf2d-4f4c-9185-586746fc067d tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:20.914252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9ec23f37-bf2d-4f4c-9185-586746fc067d tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:20.922257 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9ec23f37-bf2d-4f4c-9185-586746fc067d tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1500 microversion: 2.1 time: 0.160376 Sep 06 11:49:20.922834 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3378/6713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:20 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1500 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:21.504514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-5b85942b-0d6e-40af-ba41-0d141b5d50e2 req-e9bf87cc-088e-422c-bc4e-e738424d094b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11145993-2237-4755-bc00-eb425ca83800", "name": "network-vif-deleted", "tag": "b7f05b5f-a22b-4df8-a372-17fa913485d1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:49:21.514710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5b85942b-0d6e-40af-ba41-0d141b5d50e2 req-e9bf87cc-088e-422c-bc4e-e738424d094b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:21.515236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5b85942b-0d6e-40af-ba41-0d141b5d50e2 req-e9bf87cc-088e-422c-bc4e-e738424d094b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:21.515713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5b85942b-0d6e-40af-ba41-0d141b5d50e2 req-e9bf87cc-088e-422c-bc4e-e738424d094b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:21.527859 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5b85942b-0d6e-40af-ba41-0d141b5d50e2 req-e9bf87cc-088e-422c-bc4e-e738424d094b service nova] Creating event network-vif-deleted:b7f05b5f-a22b-4df8-a372-17fa913485d1 for instance 11145993-2237-4755-bc00-eb425ca83800 on nch2-master-1 Sep 06 11:49:21.533184 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-5b85942b-0d6e-40af-ba41-0d141b5d50e2 req-e9bf87cc-088e-422c-bc4e-e738424d094b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033376 Sep 06 11:49:21.533863 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3336/6714] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:49:21.947108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:21.947737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:21.954408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:21.954907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:21.955387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:21.956126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:21.956596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:21.957036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:21.989403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:21.990535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:21.990989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:21.991471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lazy-loading 'fault' on Instance uuid 11145993-2237-4755-bc00-eb425ca83800 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:49:22.032990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3181493b161543c69b83f3f368360031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed84581848dc4945aceddca0cbb802a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:22.041637 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-39721f47-2934-4087-bb26-5b158dfafb1c tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 200 len: 1305 microversion: 2.1 time: 0.099072 Sep 06 11:49:22.050476 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3379/6715] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:21 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:23.066425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9715ba18-445b-4679-ba99-e44689880c82 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:23.067194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9715ba18-445b-4679-ba99-e44689880c82 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:23.073414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9715ba18-445b-4679-ba99-e44689880c82 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:23.073904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9715ba18-445b-4679-ba99-e44689880c82 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:23.074355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9715ba18-445b-4679-ba99-e44689880c82 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:23.075085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9715ba18-445b-4679-ba99-e44689880c82 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:23.075578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9715ba18-445b-4679-ba99-e44689880c82 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:23.076020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9715ba18-445b-4679-ba99-e44689880c82 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:23.092423 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-9715ba18-445b-4679-ba99-e44689880c82 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] HTTP exception thrown: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9715ba18-445b-4679-ba99-e44689880c82 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Request method failure captured: Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 HTTP/1.1 Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzOTZpgpZH-fDOSfiXy6sHw-YodrCCVMYvR1JxL6tWmUZQirrMjSav-t6OpSPjsr1BS8_fLbxxbfe96dIB9SK8HxkOPS4r3O6Nc5lSbGo-3dHCdTwllUOV4rqzrCgH5tOds8Tp4Vc3-bcFwR2XV2wlhAzatvSZEAnm8IqfCzs8coUxQ Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ed84581848dc4945aceddca0cbb802a4 Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-106156129 Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed84581848dc4945aceddca0cbb802a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed84581848dc4945aceddca0cbb802a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed84581848dc4945aceddca0cbb802a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed84581848dc4945aceddca0cbb802a4"}]}] Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-106156129 Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ed84581848dc4945aceddca0cbb802a4 Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-106156129 Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-106156129-project Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3181493b161543c69b83f3f368360031 Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-106156129-project Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '11145993-2237-4755-bc00-eb425ca83800'} Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:49:23.094078 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.099001 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:49:23.099001 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:49:23.099001 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:49:23.099001 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:49:23.099001 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:49:23.099001 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.099001 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.099001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9715ba18-445b-4679-ba99-e44689880c82 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Returning 404 to user: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:49:23.099001 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9715ba18-445b-4679-ba99-e44689880c82 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 404 len: 111 microversion: 2.1 time: 0.034323 Sep 06 11:49:23.099001 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3337/6716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:23 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:49:23.113171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76ac3ef2-855b-4ef7-ba8a-f38d03923e95 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:23.113697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-76ac3ef2-855b-4ef7-ba8a-f38d03923e95 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:23.121412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ac3ef2-855b-4ef7-ba8a-f38d03923e95 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:23.121917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ac3ef2-855b-4ef7-ba8a-f38d03923e95 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:23.122380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ac3ef2-855b-4ef7-ba8a-f38d03923e95 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:23.123117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ac3ef2-855b-4ef7-ba8a-f38d03923e95 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:23.123621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ac3ef2-855b-4ef7-ba8a-f38d03923e95 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:23.124073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76ac3ef2-855b-4ef7-ba8a-f38d03923e95 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:23.137674 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-76ac3ef2-855b-4ef7-ba8a-f38d03923e95 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] HTTP exception thrown: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76ac3ef2-855b-4ef7-ba8a-f38d03923e95 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Request method failure captured: Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 HTTP/1.1 Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzOTZpgpZH-fDOSfiXy6sHw-YodrCCVMYvR1JxL6tWmUZQirrMjSav-t6OpSPjsr1BS8_fLbxxbfe96dIB9SK8HxkOPS4r3O6Nc5lSbGo-3dHCdTwllUOV4rqzrCgH5tOds8Tp4Vc3-bcFwR2XV2wlhAzatvSZEAnm8IqfCzs8coUxQ Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: ed84581848dc4945aceddca0cbb802a4 Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-DeleteServersTestJSON-106156129 Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed84581848dc4945aceddca0cbb802a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed84581848dc4945aceddca0cbb802a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed84581848dc4945aceddca0cbb802a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed84581848dc4945aceddca0cbb802a4"}]}] Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-DeleteServersTestJSON-106156129 Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: ed84581848dc4945aceddca0cbb802a4 Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-DeleteServersTestJSON-106156129 Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-DeleteServersTestJSON-106156129-project Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3181493b161543c69b83f3f368360031 Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-DeleteServersTestJSON-106156129-project Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '11145993-2237-4755-bc00-eb425ca83800'} Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:49:23.139395 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76ac3ef2-855b-4ef7-ba8a-f38d03923e95 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Returning 404 to user: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-76ac3ef2-855b-4ef7-ba8a-f38d03923e95 tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "DELETE /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 404 len: 111 microversion: 2.1 time: 0.031687 Sep 06 11:49:23.143868 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3380/6717] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:49:23 2022] DELETE /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:49:23.149316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-055b3fc4-1fe1-41dc-bdf7-4b866b8c15df tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:23.149942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-055b3fc4-1fe1-41dc-bdf7-4b866b8c15df tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] [instance: 11145993-2237-4755-bc00-eb425ca83800] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:23.156012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-055b3fc4-1fe1-41dc-bdf7-4b866b8c15df tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:23.156778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-055b3fc4-1fe1-41dc-bdf7-4b866b8c15df tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:23.157230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-055b3fc4-1fe1-41dc-bdf7-4b866b8c15df tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:23.157924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-055b3fc4-1fe1-41dc-bdf7-4b866b8c15df tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:23.158387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-055b3fc4-1fe1-41dc-bdf7-4b866b8c15df tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:23.158851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-055b3fc4-1fe1-41dc-bdf7-4b866b8c15df tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:23.172926 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-055b3fc4-1fe1-41dc-bdf7-4b866b8c15df tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] HTTP exception thrown: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-055b3fc4-1fe1-41dc-bdf7-4b866b8c15df tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Request method failure captured: Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 HTTP/1.1 Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzOTZpgpZH-fDOSfiXy6sHw-YodrCCVMYvR1JxL6tWmUZQirrMjSav-t6OpSPjsr1BS8_fLbxxbfe96dIB9SK8HxkOPS4r3O6Nc5lSbGo-3dHCdTwllUOV4rqzrCgH5tOds8Tp4Vc3-bcFwR2XV2wlhAzatvSZEAnm8IqfCzs8coUxQ Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: ed84581848dc4945aceddca0cbb802a4 Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-DeleteServersTestJSON-106156129 Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed84581848dc4945aceddca0cbb802a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed84581848dc4945aceddca0cbb802a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed84581848dc4945aceddca0cbb802a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed84581848dc4945aceddca0cbb802a4"}]}] Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-DeleteServersTestJSON-106156129 Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: ed84581848dc4945aceddca0cbb802a4 Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-DeleteServersTestJSON-106156129 Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-DeleteServersTestJSON-106156129-project Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3181493b161543c69b83f3f368360031 Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-DeleteServersTestJSON-106156129-project Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '11145993-2237-4755-bc00-eb425ca83800'} Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:49:23.174460 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.183982 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:49:23.183982 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:49:23.183982 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:49:23.183982 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:49:23.183982 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:49:23.183982 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. Sep 06 11:49:23.183982 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:49:23.183982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-055b3fc4-1fe1-41dc-bdf7-4b866b8c15df tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] Returning 404 to user: Instance 11145993-2237-4755-bc00-eb425ca83800 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:49:23.183982 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-055b3fc4-1fe1-41dc-bdf7-4b866b8c15df tempest-DeleteServersTestJSON-106156129 tempest-DeleteServersTestJSON-106156129-project] 10.222.0.20 "GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800" status: 404 len: 111 microversion: 2.1 time: 0.030430 Sep 06 11:49:23.183982 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3338/6718] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:23 2022] GET /compute/v2.1/servers/11145993-2237-4755-bc00-eb425ca83800 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:49:33.564319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=13 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:33.565876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=55 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:33.691870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1100622196", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "21c06314-ea3d-4b44-8ee3-4cd9dce22bad"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:49:33.752225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] validate_networks() for [('21c06314-ea3d-4b44-8ee3-4cd9dce22bad', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:49:34.139899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:49:34.140586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:49:34.141373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:49:34.142018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:49:34.142691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:49:34.160405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:34.160929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:34.161388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:34.162737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:34.163242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:34.163687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:34.185591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Getting quotas for project 79eeb48bec764f39b1f0953ae0812355. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:49:34.191184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Getting quotas for user 8baf03f68275463e8a86261e7ccab728 and project 79eeb48bec764f39b1f0953ae0812355. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:49:34.204407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:49:34.206925 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:49:34.322048 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-095326a7-cccb-4f9b-afc9-adf5a1b124c2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764160 Sep 06 11:49:34.322715 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3381/6719] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:49:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:49:34.333993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7410e533-64c7-4d33-858b-1d51b7fa7cc2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:34.334624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7410e533-64c7-4d33-858b-1d51b7fa7cc2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:34.337882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:34.338662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:34.419752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7410e533-64c7-4d33-858b-1d51b7fa7cc2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:34.432044 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7410e533-64c7-4d33-858b-1d51b7fa7cc2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1218 microversion: 2.1 time: 0.101835 Sep 06 11:49:34.432636 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3339/6720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:34 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:35.457027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6e7674ef-f6e9-49aa-97d8-fa8dc9ba96db tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:35.457640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6e7674ef-f6e9-49aa-97d8-fa8dc9ba96db tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:35.518488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6e7674ef-f6e9-49aa-97d8-fa8dc9ba96db tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:35.526463 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6e7674ef-f6e9-49aa-97d8-fa8dc9ba96db tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1218 microversion: 2.1 time: 0.074500 Sep 06 11:49:35.527343 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3382/6721] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:35 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:36.553199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-498e3942-56d9-4b82-be95-903ef2370de1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:36.553923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-498e3942-56d9-4b82-be95-903ef2370de1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:36.566836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-498e3942-56d9-4b82-be95-903ef2370de1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:36.567454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-498e3942-56d9-4b82-be95-903ef2370de1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:36.567967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-498e3942-56d9-4b82-be95-903ef2370de1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:36.568960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-498e3942-56d9-4b82-be95-903ef2370de1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:36.569631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-498e3942-56d9-4b82-be95-903ef2370de1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:36.570130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-498e3942-56d9-4b82-be95-903ef2370de1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:36.640988 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-498e3942-56d9-4b82-be95-903ef2370de1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:36.650215 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-498e3942-56d9-4b82-be95-903ef2370de1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1278 microversion: 2.1 time: 0.101770 Sep 06 11:49:36.663246 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3340/6722] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:36 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1278 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:37.679735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1e36863d-e2b9-4043-aaea-224aaa0c09c7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:37.680563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1e36863d-e2b9-4043-aaea-224aaa0c09c7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:37.687641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e36863d-e2b9-4043-aaea-224aaa0c09c7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:37.688141 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e36863d-e2b9-4043-aaea-224aaa0c09c7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:37.688837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e36863d-e2b9-4043-aaea-224aaa0c09c7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:37.689556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e36863d-e2b9-4043-aaea-224aaa0c09c7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:37.690276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e36863d-e2b9-4043-aaea-224aaa0c09c7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:37.690829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1e36863d-e2b9-4043-aaea-224aaa0c09c7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:37.848524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1e36863d-e2b9-4043-aaea-224aaa0c09c7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:37.854708 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1e36863d-e2b9-4043-aaea-224aaa0c09c7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1318 microversion: 2.1 time: 0.179423 Sep 06 11:49:37.855338 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3383/6723] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:37 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:38.664705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-7ceec49d-08ff-406b-9889-746f069ce710 req-16d89a6b-be58-4ad4-8e51-bcf9c37e1e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f4821e-7f2d-4966-9663-220b107ae3f9", "tag": "2c9d15cf-3a2b-4829-a741-66290e3e1cf4"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:49:38.675730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7ceec49d-08ff-406b-9889-746f069ce710 req-16d89a6b-be58-4ad4-8e51-bcf9c37e1e33 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:38.676288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7ceec49d-08ff-406b-9889-746f069ce710 req-16d89a6b-be58-4ad4-8e51-bcf9c37e1e33 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:38.676806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7ceec49d-08ff-406b-9889-746f069ce710 req-16d89a6b-be58-4ad4-8e51-bcf9c37e1e33 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:38.689128 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7ceec49d-08ff-406b-9889-746f069ce710 req-16d89a6b-be58-4ad4-8e51-bcf9c37e1e33 service nova] Creating event network-changed:2c9d15cf-3a2b-4829-a741-66290e3e1cf4 for instance d8f4821e-7f2d-4966-9663-220b107ae3f9 on nch2-master-1 Sep 06 11:49:38.694994 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-7ceec49d-08ff-406b-9889-746f069ce710 req-16d89a6b-be58-4ad4-8e51-bcf9c37e1e33 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034075 Sep 06 11:49:38.695639 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3341/6724] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:49:38.878089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-09185227-e6ae-4840-b52b-c810147311cd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:38.878722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-09185227-e6ae-4840-b52b-c810147311cd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:38.886790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09185227-e6ae-4840-b52b-c810147311cd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:38.887348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09185227-e6ae-4840-b52b-c810147311cd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:38.887888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09185227-e6ae-4840-b52b-c810147311cd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:38.888743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09185227-e6ae-4840-b52b-c810147311cd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:38.889217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09185227-e6ae-4840-b52b-c810147311cd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:38.889662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09185227-e6ae-4840-b52b-c810147311cd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:39.025216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-09185227-e6ae-4840-b52b-c810147311cd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:39.033745 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-09185227-e6ae-4840-b52b-c810147311cd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1318 microversion: 2.1 time: 0.159575 Sep 06 11:49:39.034317 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3384/6725] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:38 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:40.058063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4172cb0b-17c9-4b10-abd5-775f3ad83cd2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:40.058731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4172cb0b-17c9-4b10-abd5-775f3ad83cd2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:40.065114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4172cb0b-17c9-4b10-abd5-775f3ad83cd2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:40.065599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4172cb0b-17c9-4b10-abd5-775f3ad83cd2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:40.066040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4172cb0b-17c9-4b10-abd5-775f3ad83cd2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:40.066735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4172cb0b-17c9-4b10-abd5-775f3ad83cd2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:40.067222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4172cb0b-17c9-4b10-abd5-775f3ad83cd2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:40.067655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4172cb0b-17c9-4b10-abd5-775f3ad83cd2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:40.198857 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4172cb0b-17c9-4b10-abd5-775f3ad83cd2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:40.206952 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4172cb0b-17c9-4b10-abd5-775f3ad83cd2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1318 microversion: 2.1 time: 0.154059 Sep 06 11:49:40.207562 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3342/6726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:40 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:41.230917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3e7c677d-6cbd-454e-90af-a2f4f848dcac tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:41.231556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3e7c677d-6cbd-454e-90af-a2f4f848dcac tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:41.238400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e7c677d-6cbd-454e-90af-a2f4f848dcac tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:41.238896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e7c677d-6cbd-454e-90af-a2f4f848dcac tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:41.239381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e7c677d-6cbd-454e-90af-a2f4f848dcac tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:41.240732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e7c677d-6cbd-454e-90af-a2f4f848dcac tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:41.241203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e7c677d-6cbd-454e-90af-a2f4f848dcac tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:41.241645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e7c677d-6cbd-454e-90af-a2f4f848dcac tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:41.372703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3e7c677d-6cbd-454e-90af-a2f4f848dcac tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:41.380518 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3e7c677d-6cbd-454e-90af-a2f4f848dcac tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1318 microversion: 2.1 time: 0.153534 Sep 06 11:49:41.381092 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3385/6727] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:41 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:42.403317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9e360103-7e2e-4c00-8462-382468f36f22 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:42.403927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9e360103-7e2e-4c00-8462-382468f36f22 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:42.411124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e360103-7e2e-4c00-8462-382468f36f22 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:42.412126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e360103-7e2e-4c00-8462-382468f36f22 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:42.412656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e360103-7e2e-4c00-8462-382468f36f22 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:42.413350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e360103-7e2e-4c00-8462-382468f36f22 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:42.413808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e360103-7e2e-4c00-8462-382468f36f22 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:42.414236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e360103-7e2e-4c00-8462-382468f36f22 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:42.543624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9e360103-7e2e-4c00-8462-382468f36f22 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:42.551761 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9e360103-7e2e-4c00-8462-382468f36f22 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1318 microversion: 2.1 time: 0.152445 Sep 06 11:49:42.553039 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3343/6728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:42 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:43.575323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-507be4f4-ce9a-45c9-a708-f3b9e49c471a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:43.576007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-507be4f4-ce9a-45c9-a708-f3b9e49c471a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:43.582355 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-507be4f4-ce9a-45c9-a708-f3b9e49c471a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:43.582811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-507be4f4-ce9a-45c9-a708-f3b9e49c471a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:43.583298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-507be4f4-ce9a-45c9-a708-f3b9e49c471a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:43.584522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-507be4f4-ce9a-45c9-a708-f3b9e49c471a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:43.585001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-507be4f4-ce9a-45c9-a708-f3b9e49c471a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:43.585450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-507be4f4-ce9a-45c9-a708-f3b9e49c471a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:43.717889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-507be4f4-ce9a-45c9-a708-f3b9e49c471a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:43.726270 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-507be4f4-ce9a-45c9-a708-f3b9e49c471a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1318 microversion: 2.1 time: 0.155135 Sep 06 11:49:43.726853 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3386/6729] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:43 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:44.720746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-83b2db09-62a8-4560-a561-035d0a4f8b26 req-73a3b481-285c-4f00-bb8b-cc1f458ad8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f4821e-7f2d-4966-9663-220b107ae3f9", "name": "network-vif-plugged", "status": "completed", "tag": "2c9d15cf-3a2b-4829-a741-66290e3e1cf4"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:49:44.725341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:44.730715 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-83b2db09-62a8-4560-a561-035d0a4f8b26 req-73a3b481-285c-4f00-bb8b-cc1f458ad8b3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:44.731233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-83b2db09-62a8-4560-a561-035d0a4f8b26 req-73a3b481-285c-4f00-bb8b-cc1f458ad8b3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:44.731733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-83b2db09-62a8-4560-a561-035d0a4f8b26 req-73a3b481-285c-4f00-bb8b-cc1f458ad8b3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:44.743701 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-83b2db09-62a8-4560-a561-035d0a4f8b26 req-73a3b481-285c-4f00-bb8b-cc1f458ad8b3 service nova] Creating event network-vif-plugged:2c9d15cf-3a2b-4829-a741-66290e3e1cf4 for instance d8f4821e-7f2d-4966-9663-220b107ae3f9 on nch2-master-1 Sep 06 11:49:44.749238 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-83b2db09-62a8-4560-a561-035d0a4f8b26 req-73a3b481-285c-4f00-bb8b-cc1f458ad8b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034399 Sep 06 11:49:44.749496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-af54d237-8852-4e78-9109-b380243c15f9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:44.749964 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3344/6730] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:49:44.750065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-af54d237-8852-4e78-9109-b380243c15f9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:44.752031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:44.757884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af54d237-8852-4e78-9109-b380243c15f9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:44.758383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af54d237-8852-4e78-9109-b380243c15f9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:44.758837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af54d237-8852-4e78-9109-b380243c15f9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:44.759572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af54d237-8852-4e78-9109-b380243c15f9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:44.760049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af54d237-8852-4e78-9109-b380243c15f9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:44.760489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af54d237-8852-4e78-9109-b380243c15f9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:44.908346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-af54d237-8852-4e78-9109-b380243c15f9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:44.917062 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-af54d237-8852-4e78-9109-b380243c15f9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1318 microversion: 2.1 time: 0.171901 Sep 06 11:49:44.917949 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3387/6731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:44 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:49:45.944021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-95af2dbe-4aff-44e0-a697-d9ed993a510c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:45.944740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-95af2dbe-4aff-44e0-a697-d9ed993a510c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:45.951126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95af2dbe-4aff-44e0-a697-d9ed993a510c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:45.951628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95af2dbe-4aff-44e0-a697-d9ed993a510c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:45.952121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95af2dbe-4aff-44e0-a697-d9ed993a510c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:45.952835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95af2dbe-4aff-44e0-a697-d9ed993a510c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:45.953307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95af2dbe-4aff-44e0-a697-d9ed993a510c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:45.953746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95af2dbe-4aff-44e0-a697-d9ed993a510c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:46.088639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-95af2dbe-4aff-44e0-a697-d9ed993a510c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:46.099603 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-95af2dbe-4aff-44e0-a697-d9ed993a510c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1318 microversion: 2.1 time: 0.159032 Sep 06 11:49:46.099603 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3345/6732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:45 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:47.120181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-07cf64f2-04d2-489a-b3a8-a6c999fd6842 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:47.120813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-07cf64f2-04d2-489a-b3a8-a6c999fd6842 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:47.122775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:47.128488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07cf64f2-04d2-489a-b3a8-a6c999fd6842 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:47.128982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07cf64f2-04d2-489a-b3a8-a6c999fd6842 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:47.129435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07cf64f2-04d2-489a-b3a8-a6c999fd6842 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:47.130154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07cf64f2-04d2-489a-b3a8-a6c999fd6842 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:47.130638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07cf64f2-04d2-489a-b3a8-a6c999fd6842 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:47.131103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07cf64f2-04d2-489a-b3a8-a6c999fd6842 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:47.265230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-07cf64f2-04d2-489a-b3a8-a6c999fd6842 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:47.273741 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-07cf64f2-04d2-489a-b3a8-a6c999fd6842 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1509 microversion: 2.1 time: 0.157485 Sep 06 11:49:47.274328 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3388/6733] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:47 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:47.296543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c71dda4e-58ac-486c-afec-32ac736191f6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:47.297167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c71dda4e-58ac-486c-afec-32ac736191f6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:47.304110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c71dda4e-58ac-486c-afec-32ac736191f6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:47.304606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c71dda4e-58ac-486c-afec-32ac736191f6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:47.305052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c71dda4e-58ac-486c-afec-32ac736191f6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:47.305753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c71dda4e-58ac-486c-afec-32ac736191f6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:47.306215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c71dda4e-58ac-486c-afec-32ac736191f6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:47.306681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c71dda4e-58ac-486c-afec-32ac736191f6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:47.437169 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c71dda4e-58ac-486c-afec-32ac736191f6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:47.445437 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c71dda4e-58ac-486c-afec-32ac736191f6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1509 microversion: 2.1 time: 0.152744 Sep 06 11:49:47.446038 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3346/6734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:47 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:47.468396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c49873e-4d48-41af-be46-37db50617d2e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:49:47.470850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4c49873e-4d48-41af-be46-37db50617d2e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:47.477486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c49873e-4d48-41af-be46-37db50617d2e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:47.477988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c49873e-4d48-41af-be46-37db50617d2e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:47.478445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c49873e-4d48-41af-be46-37db50617d2e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:47.479181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c49873e-4d48-41af-be46-37db50617d2e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:47.479657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c49873e-4d48-41af-be46-37db50617d2e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:47.480106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c49873e-4d48-41af-be46-37db50617d2e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:47.633856 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4c49873e-4d48-41af-be46-37db50617d2e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "PUT /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1081 microversion: 2.1 time: 0.169377 Sep 06 11:49:47.634554 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3389/6735] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Sep 6 11:49:47 2022] PUT /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1081 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:47.654484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-42b19430-b6c7-404a-9ea4-ad51dd705930 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:47.655135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-42b19430-b6c7-404a-9ea4-ad51dd705930 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:47.661621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42b19430-b6c7-404a-9ea4-ad51dd705930 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:47.662114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42b19430-b6c7-404a-9ea4-ad51dd705930 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:47.662562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42b19430-b6c7-404a-9ea4-ad51dd705930 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:47.663306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42b19430-b6c7-404a-9ea4-ad51dd705930 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:47.663799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42b19430-b6c7-404a-9ea4-ad51dd705930 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:47.664239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-42b19430-b6c7-404a-9ea4-ad51dd705930 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:47.798390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-42b19430-b6c7-404a-9ea4-ad51dd705930 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:47.806524 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-42b19430-b6c7-404a-9ea4-ad51dd705930 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1507 microversion: 2.1 time: 0.156256 Sep 06 11:49:47.807125 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3347/6736] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:47 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:47.828864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-de92a078-fdb7-4f43-b137-ed58aecac02d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:47.829503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-de92a078-fdb7-4f43-b137-ed58aecac02d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:47.836227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de92a078-fdb7-4f43-b137-ed58aecac02d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:47.836731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de92a078-fdb7-4f43-b137-ed58aecac02d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:47.837205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de92a078-fdb7-4f43-b137-ed58aecac02d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:47.837913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de92a078-fdb7-4f43-b137-ed58aecac02d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:47.838386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de92a078-fdb7-4f43-b137-ed58aecac02d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:47.838825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-de92a078-fdb7-4f43-b137-ed58aecac02d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:47.966866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-de92a078-fdb7-4f43-b137-ed58aecac02d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:47.974740 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-de92a078-fdb7-4f43-b137-ed58aecac02d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1507 microversion: 2.1 time: 0.149812 Sep 06 11:49:47.975341 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3390/6737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:47 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:47.999630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:49:48.001632 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:48.008261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:48.008750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:48.009196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:48.009887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:48.010910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:48.011374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:48.040499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:48.047189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Old instance type m1.heat2, new instance type m1.heat {{(pid=140875) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:49:48.054379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:49:48.054808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:49:48.055314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:49:48.055734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:49:48.056153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:49:48.237752 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-09dca4e8-af18-455e-af4b-2e93f814e427 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "POST /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9/action" status: 202 len: 0 microversion: 2.1 time: 0.242894 Sep 06 11:49:48.238386 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3348/6738] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:49:47 2022] POST /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:49:48.247467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7f878d38-48e0-4a91-82c0-331da5806b5b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:48.248180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7f878d38-48e0-4a91-82c0-331da5806b5b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:48.256447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f878d38-48e0-4a91-82c0-331da5806b5b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:48.256949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f878d38-48e0-4a91-82c0-331da5806b5b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:48.257406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f878d38-48e0-4a91-82c0-331da5806b5b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:48.258125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f878d38-48e0-4a91-82c0-331da5806b5b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:48.258596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f878d38-48e0-4a91-82c0-331da5806b5b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:48.259055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7f878d38-48e0-4a91-82c0-331da5806b5b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:48.404752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7f878d38-48e0-4a91-82c0-331da5806b5b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:48.415149 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7f878d38-48e0-4a91-82c0-331da5806b5b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1518 microversion: 2.1 time: 0.171648 Sep 06 11:49:48.415745 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3391/6739] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:48 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:49.443089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bea1f6d4-ac1f-4e98-985c-4ed2de6d7fbd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:49.443646 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bea1f6d4-ac1f-4e98-985c-4ed2de6d7fbd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:49.449586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bea1f6d4-ac1f-4e98-985c-4ed2de6d7fbd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:49.450077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bea1f6d4-ac1f-4e98-985c-4ed2de6d7fbd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:49.450524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bea1f6d4-ac1f-4e98-985c-4ed2de6d7fbd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:49.451247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bea1f6d4-ac1f-4e98-985c-4ed2de6d7fbd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:49.451714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bea1f6d4-ac1f-4e98-985c-4ed2de6d7fbd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:49.452145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bea1f6d4-ac1f-4e98-985c-4ed2de6d7fbd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:49.596828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bea1f6d4-ac1f-4e98-985c-4ed2de6d7fbd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:49.606700 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bea1f6d4-ac1f-4e98-985c-4ed2de6d7fbd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1518 microversion: 2.1 time: 0.168671 Sep 06 11:49:49.608104 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3349/6740] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:49 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:50.629748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-19b8d1fb-2086-4cf2-9a00-22d123713ea1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:50.630972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-19b8d1fb-2086-4cf2-9a00-22d123713ea1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:50.638082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19b8d1fb-2086-4cf2-9a00-22d123713ea1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:50.638578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19b8d1fb-2086-4cf2-9a00-22d123713ea1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:50.639051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19b8d1fb-2086-4cf2-9a00-22d123713ea1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:50.639803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19b8d1fb-2086-4cf2-9a00-22d123713ea1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:50.640273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19b8d1fb-2086-4cf2-9a00-22d123713ea1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:50.640770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19b8d1fb-2086-4cf2-9a00-22d123713ea1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:50.776070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19b8d1fb-2086-4cf2-9a00-22d123713ea1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:50.785090 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-19b8d1fb-2086-4cf2-9a00-22d123713ea1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1518 microversion: 2.1 time: 0.159250 Sep 06 11:49:50.785681 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3392/6741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:50 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:51.809023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a3891d90-6aab-4586-a32a-41c7e8d1eba4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:51.809642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a3891d90-6aab-4586-a32a-41c7e8d1eba4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:51.816672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3891d90-6aab-4586-a32a-41c7e8d1eba4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:51.817164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3891d90-6aab-4586-a32a-41c7e8d1eba4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:51.818263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3891d90-6aab-4586-a32a-41c7e8d1eba4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:51.818964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3891d90-6aab-4586-a32a-41c7e8d1eba4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:51.819527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3891d90-6aab-4586-a32a-41c7e8d1eba4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:51.819965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a3891d90-6aab-4586-a32a-41c7e8d1eba4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:51.949224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a3891d90-6aab-4586-a32a-41c7e8d1eba4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:51.957081 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a3891d90-6aab-4586-a32a-41c7e8d1eba4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.152079 Sep 06 11:49:51.957661 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3350/6742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:51 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:52.982037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-135e9679-291c-4e4d-b0fb-64f267955207 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:52.982558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-135e9679-291c-4e4d-b0fb-64f267955207 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:52.989573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-135e9679-291c-4e4d-b0fb-64f267955207 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:52.990069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-135e9679-291c-4e4d-b0fb-64f267955207 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:52.990533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-135e9679-291c-4e4d-b0fb-64f267955207 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:52.991296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-135e9679-291c-4e4d-b0fb-64f267955207 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:52.991779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-135e9679-291c-4e4d-b0fb-64f267955207 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:52.992229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-135e9679-291c-4e4d-b0fb-64f267955207 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:53.119766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-135e9679-291c-4e4d-b0fb-64f267955207 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:53.127669 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-135e9679-291c-4e4d-b0fb-64f267955207 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.149721 Sep 06 11:49:53.128250 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3393/6743] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:52 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:54.152505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8d459bea-9112-4538-8397-0304f7d1cd34 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:54.153125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8d459bea-9112-4538-8397-0304f7d1cd34 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:54.160390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d459bea-9112-4538-8397-0304f7d1cd34 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:54.160824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d459bea-9112-4538-8397-0304f7d1cd34 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:54.161929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d459bea-9112-4538-8397-0304f7d1cd34 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:54.162629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d459bea-9112-4538-8397-0304f7d1cd34 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:54.163120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d459bea-9112-4538-8397-0304f7d1cd34 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:54.163559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d459bea-9112-4538-8397-0304f7d1cd34 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:54.296307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8d459bea-9112-4538-8397-0304f7d1cd34 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:54.304162 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8d459bea-9112-4538-8397-0304f7d1cd34 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.155679 Sep 06 11:49:54.304736 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3351/6744] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:54 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:49:55.326215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-68fa2a1b-8855-4b66-902f-04ca29c4565f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:55.326843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-68fa2a1b-8855-4b66-902f-04ca29c4565f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:55.334486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68fa2a1b-8855-4b66-902f-04ca29c4565f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:55.335471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68fa2a1b-8855-4b66-902f-04ca29c4565f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:55.335471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68fa2a1b-8855-4b66-902f-04ca29c4565f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:55.336144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68fa2a1b-8855-4b66-902f-04ca29c4565f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:55.336680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68fa2a1b-8855-4b66-902f-04ca29c4565f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:55.337130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-68fa2a1b-8855-4b66-902f-04ca29c4565f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:55.468778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-68fa2a1b-8855-4b66-902f-04ca29c4565f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:55.476518 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-68fa2a1b-8855-4b66-902f-04ca29c4565f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.154179 Sep 06 11:49:55.477083 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3394/6745] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:55 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:56.499589 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4f8ccd85-f8cd-472a-ba2e-cf651158dc50 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:56.500217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4f8ccd85-f8cd-472a-ba2e-cf651158dc50 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:56.507295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f8ccd85-f8cd-472a-ba2e-cf651158dc50 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:56.507785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f8ccd85-f8cd-472a-ba2e-cf651158dc50 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:56.508233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f8ccd85-f8cd-472a-ba2e-cf651158dc50 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:56.508933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f8ccd85-f8cd-472a-ba2e-cf651158dc50 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:56.509401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f8ccd85-f8cd-472a-ba2e-cf651158dc50 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:56.509836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4f8ccd85-f8cd-472a-ba2e-cf651158dc50 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:56.644138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4f8ccd85-f8cd-472a-ba2e-cf651158dc50 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:56.653904 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4f8ccd85-f8cd-472a-ba2e-cf651158dc50 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.157134 Sep 06 11:49:56.653904 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3352/6746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:56 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:57.676342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dbd4bd7b-c95b-4252-9843-d25d5436edf3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:57.677524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dbd4bd7b-c95b-4252-9843-d25d5436edf3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:57.684447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbd4bd7b-c95b-4252-9843-d25d5436edf3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:57.684940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbd4bd7b-c95b-4252-9843-d25d5436edf3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:57.685388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbd4bd7b-c95b-4252-9843-d25d5436edf3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:57.686101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbd4bd7b-c95b-4252-9843-d25d5436edf3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:57.686571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbd4bd7b-c95b-4252-9843-d25d5436edf3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:57.687033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbd4bd7b-c95b-4252-9843-d25d5436edf3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:57.819154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dbd4bd7b-c95b-4252-9843-d25d5436edf3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:57.827145 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dbd4bd7b-c95b-4252-9843-d25d5436edf3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.154757 Sep 06 11:49:57.829102 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3395/6747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:57 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:49:58.849898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-58e3c35b-6839-4eef-b619-c8b5c9f4da47 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:49:58.851212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-58e3c35b-6839-4eef-b619-c8b5c9f4da47 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:49:58.858447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58e3c35b-6839-4eef-b619-c8b5c9f4da47 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:58.858957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58e3c35b-6839-4eef-b619-c8b5c9f4da47 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:58.859429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58e3c35b-6839-4eef-b619-c8b5c9f4da47 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:58.860179 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58e3c35b-6839-4eef-b619-c8b5c9f4da47 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:58.860625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58e3c35b-6839-4eef-b619-c8b5c9f4da47 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:58.861065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-58e3c35b-6839-4eef-b619-c8b5c9f4da47 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:58.995032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-58e3c35b-6839-4eef-b619-c8b5c9f4da47 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:49:59.003076 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-58e3c35b-6839-4eef-b619-c8b5c9f4da47 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.157170 Sep 06 11:49:59.003666 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3353/6748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:49:58 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:00.026661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6dd382d1-26bf-42e8-a7cc-e03bc326e455 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:00.027313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6dd382d1-26bf-42e8-a7cc-e03bc326e455 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:00.034471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6dd382d1-26bf-42e8-a7cc-e03bc326e455 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:00.034966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6dd382d1-26bf-42e8-a7cc-e03bc326e455 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:00.035439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6dd382d1-26bf-42e8-a7cc-e03bc326e455 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:00.036144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6dd382d1-26bf-42e8-a7cc-e03bc326e455 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:00.036614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6dd382d1-26bf-42e8-a7cc-e03bc326e455 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:00.037052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6dd382d1-26bf-42e8-a7cc-e03bc326e455 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:00.169403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6dd382d1-26bf-42e8-a7cc-e03bc326e455 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:00.177674 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6dd382d1-26bf-42e8-a7cc-e03bc326e455 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.154984 Sep 06 11:50:00.178244 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3396/6749] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:00 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:01.201743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4b9a7d7b-f249-4f02-ae2d-ebb0e6029a9e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:01.202305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4b9a7d7b-f249-4f02-ae2d-ebb0e6029a9e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:01.209210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b9a7d7b-f249-4f02-ae2d-ebb0e6029a9e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:01.209697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b9a7d7b-f249-4f02-ae2d-ebb0e6029a9e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:01.210140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b9a7d7b-f249-4f02-ae2d-ebb0e6029a9e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:01.210835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b9a7d7b-f249-4f02-ae2d-ebb0e6029a9e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:01.211322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b9a7d7b-f249-4f02-ae2d-ebb0e6029a9e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:01.211755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b9a7d7b-f249-4f02-ae2d-ebb0e6029a9e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:01.342727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4b9a7d7b-f249-4f02-ae2d-ebb0e6029a9e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:01.351095 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4b9a7d7b-f249-4f02-ae2d-ebb0e6029a9e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.153579 Sep 06 11:50:01.351694 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3354/6750] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:01 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:02.374980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b3104012-d2c9-4d8c-9cbc-0c3b8a13ecf1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:02.375636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b3104012-d2c9-4d8c-9cbc-0c3b8a13ecf1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:02.382516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3104012-d2c9-4d8c-9cbc-0c3b8a13ecf1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:02.383026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3104012-d2c9-4d8c-9cbc-0c3b8a13ecf1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:02.383498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3104012-d2c9-4d8c-9cbc-0c3b8a13ecf1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:02.384207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3104012-d2c9-4d8c-9cbc-0c3b8a13ecf1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:02.384681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3104012-d2c9-4d8c-9cbc-0c3b8a13ecf1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:02.385128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3104012-d2c9-4d8c-9cbc-0c3b8a13ecf1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:02.519651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b3104012-d2c9-4d8c-9cbc-0c3b8a13ecf1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:02.528510 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b3104012-d2c9-4d8c-9cbc-0c3b8a13ecf1 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.157336 Sep 06 11:50:02.529112 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3397/6751] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:02 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:03.553596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bdc8f88b-087d-4c7b-808a-2e6c139c753b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:03.554229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bdc8f88b-087d-4c7b-808a-2e6c139c753b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:03.561550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdc8f88b-087d-4c7b-808a-2e6c139c753b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:03.562049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdc8f88b-087d-4c7b-808a-2e6c139c753b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:03.562498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdc8f88b-087d-4c7b-808a-2e6c139c753b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:03.563377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdc8f88b-087d-4c7b-808a-2e6c139c753b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:03.563841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdc8f88b-087d-4c7b-808a-2e6c139c753b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:03.564283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bdc8f88b-087d-4c7b-808a-2e6c139c753b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:03.700719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bdc8f88b-087d-4c7b-808a-2e6c139c753b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:03.708654 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bdc8f88b-087d-4c7b-808a-2e6c139c753b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.159743 Sep 06 11:50:03.709241 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3355/6752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:03 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:04.732868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-42919630-bfb4-4d94-bb96-c455bf63734f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:04.733505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-42919630-bfb4-4d94-bb96-c455bf63734f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:04.736360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:04.741236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42919630-bfb4-4d94-bb96-c455bf63734f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:04.742893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42919630-bfb4-4d94-bb96-c455bf63734f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:04.742893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42919630-bfb4-4d94-bb96-c455bf63734f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:04.742893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42919630-bfb4-4d94-bb96-c455bf63734f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:04.743399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42919630-bfb4-4d94-bb96-c455bf63734f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:04.743851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-42919630-bfb4-4d94-bb96-c455bf63734f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:04.746497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:04.884075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-42919630-bfb4-4d94-bb96-c455bf63734f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:04.891905 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-42919630-bfb4-4d94-bb96-c455bf63734f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.163208 Sep 06 11:50:04.892480 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3398/6753] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:04 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:05.916776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-def7ae41-a53b-4d80-b5d1-f83038f9da4e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:05.917353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-def7ae41-a53b-4d80-b5d1-f83038f9da4e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:05.924274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-def7ae41-a53b-4d80-b5d1-f83038f9da4e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:05.924760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-def7ae41-a53b-4d80-b5d1-f83038f9da4e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:05.925202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-def7ae41-a53b-4d80-b5d1-f83038f9da4e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:05.925906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-def7ae41-a53b-4d80-b5d1-f83038f9da4e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:05.926368 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-def7ae41-a53b-4d80-b5d1-f83038f9da4e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:05.926801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-def7ae41-a53b-4d80-b5d1-f83038f9da4e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:05.948542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:06.066015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-def7ae41-a53b-4d80-b5d1-f83038f9da4e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:06.075600 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-def7ae41-a53b-4d80-b5d1-f83038f9da4e tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.162532 Sep 06 11:50:06.076280 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3356/6754] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:05 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:07.105837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-edcfbbe6-cec7-43e5-a14c-22b90881784d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:07.106471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-edcfbbe6-cec7-43e5-a14c-22b90881784d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:07.114185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edcfbbe6-cec7-43e5-a14c-22b90881784d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:07.114696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edcfbbe6-cec7-43e5-a14c-22b90881784d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:07.115271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edcfbbe6-cec7-43e5-a14c-22b90881784d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:07.116012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edcfbbe6-cec7-43e5-a14c-22b90881784d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:07.116500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edcfbbe6-cec7-43e5-a14c-22b90881784d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:07.116952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-edcfbbe6-cec7-43e5-a14c-22b90881784d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:07.252641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-edcfbbe6-cec7-43e5-a14c-22b90881784d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:07.261716 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-edcfbbe6-cec7-43e5-a14c-22b90881784d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.159794 Sep 06 11:50:07.262315 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3399/6755] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:07 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:08.287576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-864d668a-726d-441d-b9ee-ade54d265e87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:08.288200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-864d668a-726d-441d-b9ee-ade54d265e87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:08.291543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=43 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:08.297469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-864d668a-726d-441d-b9ee-ade54d265e87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:08.307483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-864d668a-726d-441d-b9ee-ade54d265e87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:08.307483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-864d668a-726d-441d-b9ee-ade54d265e87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:08.307483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-864d668a-726d-441d-b9ee-ade54d265e87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:08.307483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-864d668a-726d-441d-b9ee-ade54d265e87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:08.307483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-864d668a-726d-441d-b9ee-ade54d265e87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:08.460466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-864d668a-726d-441d-b9ee-ade54d265e87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:08.468581 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-864d668a-726d-441d-b9ee-ade54d265e87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1523 microversion: 2.1 time: 0.186149 Sep 06 11:50:08.470352 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3357/6756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:08 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:09.205969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-6b5bb6d0-5fa7-4a03-ad4c-db9a30beb694 req-c1c641ee-b75f-46f9-94fc-7dded400c8ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f4821e-7f2d-4966-9663-220b107ae3f9", "name": "network-vif-unplugged", "status": "completed", "tag": "2c9d15cf-3a2b-4829-a741-66290e3e1cf4"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:09.217089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6b5bb6d0-5fa7-4a03-ad4c-db9a30beb694 req-c1c641ee-b75f-46f9-94fc-7dded400c8ba service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:09.217589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6b5bb6d0-5fa7-4a03-ad4c-db9a30beb694 req-c1c641ee-b75f-46f9-94fc-7dded400c8ba service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:09.218042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-6b5bb6d0-5fa7-4a03-ad4c-db9a30beb694 req-c1c641ee-b75f-46f9-94fc-7dded400c8ba service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:09.230690 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-6b5bb6d0-5fa7-4a03-ad4c-db9a30beb694 req-c1c641ee-b75f-46f9-94fc-7dded400c8ba service nova] Creating event network-vif-unplugged:2c9d15cf-3a2b-4829-a741-66290e3e1cf4 for instance d8f4821e-7f2d-4966-9663-220b107ae3f9 on nch1-master-1 Sep 06 11:50:09.237128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-6b5bb6d0-5fa7-4a03-ad4c-db9a30beb694 req-c1c641ee-b75f-46f9-94fc-7dded400c8ba service nova] Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:50:09.249270 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-6b5bb6d0-5fa7-4a03-ad4c-db9a30beb694 req-c1c641ee-b75f-46f9-94fc-7dded400c8ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047322 Sep 06 11:50:09.250068 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3400/6757] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:09.494000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c71f959d-8bd0-4a44-bd73-463595323a09 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:09.494644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c71f959d-8bd0-4a44-bd73-463595323a09 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:09.502635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c71f959d-8bd0-4a44-bd73-463595323a09 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:09.503177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c71f959d-8bd0-4a44-bd73-463595323a09 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:09.503638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c71f959d-8bd0-4a44-bd73-463595323a09 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:09.504380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c71f959d-8bd0-4a44-bd73-463595323a09 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:09.504895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c71f959d-8bd0-4a44-bd73-463595323a09 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:09.505340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c71f959d-8bd0-4a44-bd73-463595323a09 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:09.652627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c71f959d-8bd0-4a44-bd73-463595323a09 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:09.666556 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c71f959d-8bd0-4a44-bd73-463595323a09 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1522 microversion: 2.1 time: 0.174585 Sep 06 11:50:09.666556 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3358/6758] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:09 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:10.690730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ab994006-0861-42b0-8bf3-d9ffdd8e75da tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:10.691528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ab994006-0861-42b0-8bf3-d9ffdd8e75da tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:10.697955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab994006-0861-42b0-8bf3-d9ffdd8e75da tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:10.698464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab994006-0861-42b0-8bf3-d9ffdd8e75da tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:10.698927 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab994006-0861-42b0-8bf3-d9ffdd8e75da tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:10.699698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab994006-0861-42b0-8bf3-d9ffdd8e75da tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:10.700174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab994006-0861-42b0-8bf3-d9ffdd8e75da tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:10.700622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab994006-0861-42b0-8bf3-d9ffdd8e75da tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:10.844512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ab994006-0861-42b0-8bf3-d9ffdd8e75da tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:10.856771 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ab994006-0861-42b0-8bf3-d9ffdd8e75da tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1520 microversion: 2.1 time: 0.170890 Sep 06 11:50:10.857389 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3401/6759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:10 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:11.264758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-337f3fd2-8732-424e-94de-809ad711a3bf req-9d000919-62ca-4a5e-ac6e-a1d1517fcd75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f4821e-7f2d-4966-9663-220b107ae3f9", "tag": "2c9d15cf-3a2b-4829-a741-66290e3e1cf4"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:11.275093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-337f3fd2-8732-424e-94de-809ad711a3bf req-9d000919-62ca-4a5e-ac6e-a1d1517fcd75 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:11.275583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-337f3fd2-8732-424e-94de-809ad711a3bf req-9d000919-62ca-4a5e-ac6e-a1d1517fcd75 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:11.276363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-337f3fd2-8732-424e-94de-809ad711a3bf req-9d000919-62ca-4a5e-ac6e-a1d1517fcd75 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:11.291607 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-337f3fd2-8732-424e-94de-809ad711a3bf req-9d000919-62ca-4a5e-ac6e-a1d1517fcd75 service nova] Creating event network-changed:2c9d15cf-3a2b-4829-a741-66290e3e1cf4 for instance d8f4821e-7f2d-4966-9663-220b107ae3f9 on nch1-master-1 Sep 06 11:50:11.297241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-337f3fd2-8732-424e-94de-809ad711a3bf req-9d000919-62ca-4a5e-ac6e-a1d1517fcd75 service nova] Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:50:11.308450 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-337f3fd2-8732-424e-94de-809ad711a3bf req-9d000919-62ca-4a5e-ac6e-a1d1517fcd75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047636 Sep 06 11:50:11.309063 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3359/6760] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:11.886896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-61076d5e-cacc-48ca-9ff8-c61ef8dcdd6d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:11.888015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-61076d5e-cacc-48ca-9ff8-c61ef8dcdd6d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:11.896660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61076d5e-cacc-48ca-9ff8-c61ef8dcdd6d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:11.899266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61076d5e-cacc-48ca-9ff8-c61ef8dcdd6d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:11.899266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61076d5e-cacc-48ca-9ff8-c61ef8dcdd6d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:11.899266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61076d5e-cacc-48ca-9ff8-c61ef8dcdd6d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:11.899266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61076d5e-cacc-48ca-9ff8-c61ef8dcdd6d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:11.899266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61076d5e-cacc-48ca-9ff8-c61ef8dcdd6d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:12.071453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-61076d5e-cacc-48ca-9ff8-c61ef8dcdd6d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:12.081829 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-61076d5e-cacc-48ca-9ff8-c61ef8dcdd6d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1520 microversion: 2.1 time: 0.201606 Sep 06 11:50:12.082679 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3402/6761] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:11 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:13.121636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4e18fb92-255e-49ab-ae09-4a3c7ee284de tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:13.122516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4e18fb92-255e-49ab-ae09-4a3c7ee284de tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:13.128634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e18fb92-255e-49ab-ae09-4a3c7ee284de tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:13.129119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e18fb92-255e-49ab-ae09-4a3c7ee284de tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:13.130065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e18fb92-255e-49ab-ae09-4a3c7ee284de tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:13.130763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e18fb92-255e-49ab-ae09-4a3c7ee284de tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:13.131316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e18fb92-255e-49ab-ae09-4a3c7ee284de tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:13.131746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e18fb92-255e-49ab-ae09-4a3c7ee284de tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:13.262793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4e18fb92-255e-49ab-ae09-4a3c7ee284de tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:13.271287 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4e18fb92-255e-49ab-ae09-4a3c7ee284de tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1517 microversion: 2.1 time: 0.154834 Sep 06 11:50:13.271869 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3360/6762] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:13 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:13.294043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c2d4964c-70ac-4259-ac9d-54a8e00651a8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:13.294596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c2d4964c-70ac-4259-ac9d-54a8e00651a8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:13.301017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2d4964c-70ac-4259-ac9d-54a8e00651a8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:13.301548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2d4964c-70ac-4259-ac9d-54a8e00651a8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:13.302010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2d4964c-70ac-4259-ac9d-54a8e00651a8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:13.302740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2d4964c-70ac-4259-ac9d-54a8e00651a8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:13.303258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2d4964c-70ac-4259-ac9d-54a8e00651a8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:13.303705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c2d4964c-70ac-4259-ac9d-54a8e00651a8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:13.507976 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c2d4964c-70ac-4259-ac9d-54a8e00651a8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "POST /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9/action" status: 204 len: 0 microversion: 2.1 time: 0.217748 Sep 06 11:50:13.509754 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3403/6763] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:50:13 2022] POST /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9/action => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:50:13.517000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-36bd7429-e0cf-45bd-808f-6b497413bc23 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:13.517771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-36bd7429-e0cf-45bd-808f-6b497413bc23 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:13.523846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36bd7429-e0cf-45bd-808f-6b497413bc23 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:13.524342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36bd7429-e0cf-45bd-808f-6b497413bc23 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:13.524789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36bd7429-e0cf-45bd-808f-6b497413bc23 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:13.525502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36bd7429-e0cf-45bd-808f-6b497413bc23 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:13.525972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36bd7429-e0cf-45bd-808f-6b497413bc23 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:13.526408 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36bd7429-e0cf-45bd-808f-6b497413bc23 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:13.669785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-36bd7429-e0cf-45bd-808f-6b497413bc23 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:13.679234 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-36bd7429-e0cf-45bd-808f-6b497413bc23 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1517 microversion: 2.1 time: 0.166043 Sep 06 11:50:13.679847 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3361/6764] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:13 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:14.704542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-160d5d92-2cc9-415a-b18a-8e39c95cbd74 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:14.705270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-160d5d92-2cc9-415a-b18a-8e39c95cbd74 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:14.712297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-160d5d92-2cc9-415a-b18a-8e39c95cbd74 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:14.712799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-160d5d92-2cc9-415a-b18a-8e39c95cbd74 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:14.713259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-160d5d92-2cc9-415a-b18a-8e39c95cbd74 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:14.713996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-160d5d92-2cc9-415a-b18a-8e39c95cbd74 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:14.714475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-160d5d92-2cc9-415a-b18a-8e39c95cbd74 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:14.714922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-160d5d92-2cc9-415a-b18a-8e39c95cbd74 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:14.848460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-160d5d92-2cc9-415a-b18a-8e39c95cbd74 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:14.856440 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-160d5d92-2cc9-415a-b18a-8e39c95cbd74 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1517 microversion: 2.1 time: 0.157225 Sep 06 11:50:14.857035 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3404/6765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:14 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:15.569319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-33389e56-1569-40d6-89d8-eecc847cfe80 req-bc1e1661-9616-4e3e-aa77-553749bd6661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f4821e-7f2d-4966-9663-220b107ae3f9", "name": "network-vif-plugged", "status": "completed", "tag": "2c9d15cf-3a2b-4829-a741-66290e3e1cf4"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:15.579970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-33389e56-1569-40d6-89d8-eecc847cfe80 req-bc1e1661-9616-4e3e-aa77-553749bd6661 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:15.580456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-33389e56-1569-40d6-89d8-eecc847cfe80 req-bc1e1661-9616-4e3e-aa77-553749bd6661 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:15.580900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-33389e56-1569-40d6-89d8-eecc847cfe80 req-bc1e1661-9616-4e3e-aa77-553749bd6661 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:15.592911 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-33389e56-1569-40d6-89d8-eecc847cfe80 req-bc1e1661-9616-4e3e-aa77-553749bd6661 service nova] Creating event network-vif-plugged:2c9d15cf-3a2b-4829-a741-66290e3e1cf4 for instance d8f4821e-7f2d-4966-9663-220b107ae3f9 on nch1-master-1 Sep 06 11:50:15.599874 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-33389e56-1569-40d6-89d8-eecc847cfe80 req-bc1e1661-9616-4e3e-aa77-553749bd6661 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034120 Sep 06 11:50:15.600518 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3362/6766] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:15.880193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e38c9c29-c431-418d-a5f4-291ed76a55a5 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:15.880835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e38c9c29-c431-418d-a5f4-291ed76a55a5 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:15.888324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e38c9c29-c431-418d-a5f4-291ed76a55a5 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:15.888837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e38c9c29-c431-418d-a5f4-291ed76a55a5 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:15.889295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e38c9c29-c431-418d-a5f4-291ed76a55a5 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:15.890025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e38c9c29-c431-418d-a5f4-291ed76a55a5 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:15.890502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e38c9c29-c431-418d-a5f4-291ed76a55a5 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:15.890948 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e38c9c29-c431-418d-a5f4-291ed76a55a5 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:16.037776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e38c9c29-c431-418d-a5f4-291ed76a55a5 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:16.048602 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e38c9c29-c431-418d-a5f4-291ed76a55a5 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1509 microversion: 2.1 time: 0.172282 Sep 06 11:50:16.049276 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3405/6767] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:15 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:16.081125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-18884b48-28c2-4846-90b2-cbfc5444c39c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:16.083202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-18884b48-28c2-4846-90b2-cbfc5444c39c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:16.090120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18884b48-28c2-4846-90b2-cbfc5444c39c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:16.090611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18884b48-28c2-4846-90b2-cbfc5444c39c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:16.091172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18884b48-28c2-4846-90b2-cbfc5444c39c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:16.091807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18884b48-28c2-4846-90b2-cbfc5444c39c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:16.092273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18884b48-28c2-4846-90b2-cbfc5444c39c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:16.092713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-18884b48-28c2-4846-90b2-cbfc5444c39c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:16.224536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-18884b48-28c2-4846-90b2-cbfc5444c39c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:16.232354 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-18884b48-28c2-4846-90b2-cbfc5444c39c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1509 microversion: 2.1 time: 0.156468 Sep 06 11:50:16.232948 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3363/6768] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:16 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:16.258004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d8feccec-4a33-4d2e-97bd-f21b1afa633b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Action: 'create', calling method: .version_select at 0x7f90f30c9c10>, body: {"keypair": {"name": "tempest-keypair-826696194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzaqWAK4y63UlcFIfSTL1JCmkWObzLY6HTRm8LBanNZo1UyVKjxE7zZoH+rCmdat49wb51J3tmHmFgqxywH+eCypcifcvhUtmui1ac2i8PtC2Bv2hetP8UYhXNcWmL6Sw=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:16.273940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d8feccec-4a33-4d2e-97bd-f21b1afa633b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Getting quotas for project 79eeb48bec764f39b1f0953ae0812355. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:50:16.279164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-d8feccec-4a33-4d2e-97bd-f21b1afa633b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Getting quotas for user 8baf03f68275463e8a86261e7ccab728 and project 79eeb48bec764f39b1f0953ae0812355. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:50:16.389604 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d8feccec-4a33-4d2e-97bd-f21b1afa633b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135968 Sep 06 11:50:16.390438 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3406/6769] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:50:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:18.466829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d3ab986b-3464-469c-9625-b9c4b0fb1055 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:18.467483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d3ab986b-3464-469c-9625-b9c4b0fb1055 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:18.474457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3ab986b-3464-469c-9625-b9c4b0fb1055 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:18.474945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3ab986b-3464-469c-9625-b9c4b0fb1055 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:18.475410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3ab986b-3464-469c-9625-b9c4b0fb1055 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:18.476103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3ab986b-3464-469c-9625-b9c4b0fb1055 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:18.476562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3ab986b-3464-469c-9625-b9c4b0fb1055 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:18.476991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d3ab986b-3464-469c-9625-b9c4b0fb1055 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:18.606849 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d3ab986b-3464-469c-9625-b9c4b0fb1055 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:18.615350 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d3ab986b-3464-469c-9625-b9c4b0fb1055 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 200 len: 1509 microversion: 2.1 time: 0.152683 Sep 06 11:50:18.615938 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3364/6770] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:18 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:18.638467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5aab89fd-20e6-4f13-b406-a2a48ac8a74d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:18.638997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5aab89fd-20e6-4f13-b406-a2a48ac8a74d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:18.645792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5aab89fd-20e6-4f13-b406-a2a48ac8a74d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:18.646302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5aab89fd-20e6-4f13-b406-a2a48ac8a74d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:18.646765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5aab89fd-20e6-4f13-b406-a2a48ac8a74d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:18.647512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5aab89fd-20e6-4f13-b406-a2a48ac8a74d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:18.647991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5aab89fd-20e6-4f13-b406-a2a48ac8a74d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:18.648440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5aab89fd-20e6-4f13-b406-a2a48ac8a74d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:18.673529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5aab89fd-20e6-4f13-b406-a2a48ac8a74d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:50:18.982049 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5aab89fd-20e6-4f13-b406-a2a48ac8a74d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 204 len: 0 microversion: 2.1 time: 0.348157 Sep 06 11:50:18.982713 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3407/6771] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:50:18 2022] DELETE /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:50:19.041820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1089608146", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "21c06314-ea3d-4b44-8ee3-4cd9dce22bad"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:19.094662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] validate_networks() for [('21c06314-ea3d-4b44-8ee3-4cd9dce22bad', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:50:19.854474 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:50:19.855073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:50:19.855424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:50:19.855846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:50:19.856265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:50:19.865797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:19.866287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:19.866735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:19.867517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:19.867983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:19.868420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:19.889251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Getting quotas for project 79eeb48bec764f39b1f0953ae0812355. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:50:19.894482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Getting quotas for user 8baf03f68275463e8a86261e7ccab728 and project 79eeb48bec764f39b1f0953ae0812355. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:50:19.907680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:50:19.910050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:50:20.018402 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1f686683-b385-4cf6-916d-66b9b1af42f4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980386 Sep 06 11:50:20.022794 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3365/6772] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:50:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:50:20.031679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ddd737a3-48f4-4503-a04b-911b681bad4f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:20.033088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ddd737a3-48f4-4503-a04b-911b681bad4f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:20.095257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ddd737a3-48f4-4503-a04b-911b681bad4f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:20.108420 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ddd737a3-48f4-4503-a04b-911b681bad4f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1218 microversion: 2.1 time: 0.081581 Sep 06 11:50:20.110510 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3408/6773] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:20 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:21.134709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-72794380-4156-4c0d-a44d-a0b5eb3e21a4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:21.136570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-72794380-4156-4c0d-a44d-a0b5eb3e21a4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:21.154892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72794380-4156-4c0d-a44d-a0b5eb3e21a4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:21.155350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72794380-4156-4c0d-a44d-a0b5eb3e21a4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:21.155824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72794380-4156-4c0d-a44d-a0b5eb3e21a4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:21.156850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72794380-4156-4c0d-a44d-a0b5eb3e21a4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:21.157338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72794380-4156-4c0d-a44d-a0b5eb3e21a4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:21.157885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72794380-4156-4c0d-a44d-a0b5eb3e21a4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:21.232065 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9336c56e-2a4b-4fed-a193-749b956be879 req-c5554ce2-05c5-427f-ba7b-ceefd1beb4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f4821e-7f2d-4966-9663-220b107ae3f9", "name": "network-vif-deleted", "tag": "2c9d15cf-3a2b-4829-a741-66290e3e1cf4"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:21.241399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-72794380-4156-4c0d-a44d-a0b5eb3e21a4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:21.245278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9336c56e-2a4b-4fed-a193-749b956be879 req-c5554ce2-05c5-427f-ba7b-ceefd1beb4b2 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:21.251938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9336c56e-2a4b-4fed-a193-749b956be879 req-c5554ce2-05c5-427f-ba7b-ceefd1beb4b2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:21.251938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9336c56e-2a4b-4fed-a193-749b956be879 req-c5554ce2-05c5-427f-ba7b-ceefd1beb4b2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:21.254943 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-72794380-4156-4c0d-a44d-a0b5eb3e21a4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1222 microversion: 2.1 time: 0.125015 Sep 06 11:50:21.255697 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3366/6774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:21 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:21.265291 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9336c56e-2a4b-4fed-a193-749b956be879 req-c5554ce2-05c5-427f-ba7b-ceefd1beb4b2 service nova] Creating event network-vif-deleted:2c9d15cf-3a2b-4829-a741-66290e3e1cf4 for instance d8f4821e-7f2d-4966-9663-220b107ae3f9 on nch1-master-1 Sep 06 11:50:21.271275 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9336c56e-2a4b-4fed-a193-749b956be879 req-c5554ce2-05c5-427f-ba7b-ceefd1beb4b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042940 Sep 06 11:50:21.272200 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3409/6775] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:50:22.279511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-379ec312-0bc1-4d19-b0c4-5a4904166a3c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:22.280151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-379ec312-0bc1-4d19-b0c4-5a4904166a3c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:22.288229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-379ec312-0bc1-4d19-b0c4-5a4904166a3c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:22.288737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-379ec312-0bc1-4d19-b0c4-5a4904166a3c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:22.289189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-379ec312-0bc1-4d19-b0c4-5a4904166a3c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:22.289929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-379ec312-0bc1-4d19-b0c4-5a4904166a3c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:22.290397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-379ec312-0bc1-4d19-b0c4-5a4904166a3c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:22.290834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-379ec312-0bc1-4d19-b0c4-5a4904166a3c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:22.363054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-379ec312-0bc1-4d19-b0c4-5a4904166a3c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:22.372660 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-379ec312-0bc1-4d19-b0c4-5a4904166a3c tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1278 microversion: 2.1 time: 0.097278 Sep 06 11:50:22.373312 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3367/6776] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:22 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:23.397075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d15342a1-4f83-4c98-a672-893093d50701 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:23.397838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d15342a1-4f83-4c98-a672-893093d50701 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:23.408484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d15342a1-4f83-4c98-a672-893093d50701 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:23.409003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d15342a1-4f83-4c98-a672-893093d50701 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:23.409468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d15342a1-4f83-4c98-a672-893093d50701 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:23.410208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d15342a1-4f83-4c98-a672-893093d50701 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:23.410738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d15342a1-4f83-4c98-a672-893093d50701 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:23.411265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d15342a1-4f83-4c98-a672-893093d50701 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:23.557483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d15342a1-4f83-4c98-a672-893093d50701 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:23.571670 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d15342a1-4f83-4c98-a672-893093d50701 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1318 microversion: 2.1 time: 0.178791 Sep 06 11:50:23.572460 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3410/6777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:23 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:23.853098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-3d23341b-d91d-4bd9-88b1-33abe1680e6c req-95352ca9-3fd4-4534-8e7f-8521d3000d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3958bd5d-ed93-4409-bba5-dc0791d2133f", "tag": "1d9883be-52d5-4948-9c22-4b35c9d609b1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:23.865708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3d23341b-d91d-4bd9-88b1-33abe1680e6c req-95352ca9-3fd4-4534-8e7f-8521d3000d3e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:23.866594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3d23341b-d91d-4bd9-88b1-33abe1680e6c req-95352ca9-3fd4-4534-8e7f-8521d3000d3e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:23.867142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3d23341b-d91d-4bd9-88b1-33abe1680e6c req-95352ca9-3fd4-4534-8e7f-8521d3000d3e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:23.879565 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-3d23341b-d91d-4bd9-88b1-33abe1680e6c req-95352ca9-3fd4-4534-8e7f-8521d3000d3e service nova] Creating event network-changed:1d9883be-52d5-4948-9c22-4b35c9d609b1 for instance 3958bd5d-ed93-4409-bba5-dc0791d2133f on nch1-master-1 Sep 06 11:50:23.884961 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-3d23341b-d91d-4bd9-88b1-33abe1680e6c req-95352ca9-3fd4-4534-8e7f-8521d3000d3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035780 Sep 06 11:50:23.885689 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3368/6778] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:24.595712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9506b4d3-7dff-4706-b0c2-f4f05504264b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:24.596356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9506b4d3-7dff-4706-b0c2-f4f05504264b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:24.605836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9506b4d3-7dff-4706-b0c2-f4f05504264b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:24.606346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9506b4d3-7dff-4706-b0c2-f4f05504264b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:24.606798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9506b4d3-7dff-4706-b0c2-f4f05504264b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:24.607570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9506b4d3-7dff-4706-b0c2-f4f05504264b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:24.608039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9506b4d3-7dff-4706-b0c2-f4f05504264b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:24.608481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9506b4d3-7dff-4706-b0c2-f4f05504264b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:24.745542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9506b4d3-7dff-4706-b0c2-f4f05504264b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:24.753616 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9506b4d3-7dff-4706-b0c2-f4f05504264b tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1318 microversion: 2.1 time: 0.161829 Sep 06 11:50:24.754223 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3411/6779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:24 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:25.777411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5a2725ab-65f4-42bf-8079-c2fe347f9bb8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:25.778139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5a2725ab-65f4-42bf-8079-c2fe347f9bb8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:25.785865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a2725ab-65f4-42bf-8079-c2fe347f9bb8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:25.786360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a2725ab-65f4-42bf-8079-c2fe347f9bb8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:25.786809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a2725ab-65f4-42bf-8079-c2fe347f9bb8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:25.787558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a2725ab-65f4-42bf-8079-c2fe347f9bb8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:25.788027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a2725ab-65f4-42bf-8079-c2fe347f9bb8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:25.788467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5a2725ab-65f4-42bf-8079-c2fe347f9bb8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:25.933596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5a2725ab-65f4-42bf-8079-c2fe347f9bb8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:25.942030 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5a2725ab-65f4-42bf-8079-c2fe347f9bb8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1318 microversion: 2.1 time: 0.168925 Sep 06 11:50:25.942629 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3369/6780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:25 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:26.966609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3521def2-5001-487c-ae0f-a29693839069 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:26.967280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3521def2-5001-487c-ae0f-a29693839069 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:26.974646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3521def2-5001-487c-ae0f-a29693839069 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:26.975274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3521def2-5001-487c-ae0f-a29693839069 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:26.975688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3521def2-5001-487c-ae0f-a29693839069 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:26.976593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3521def2-5001-487c-ae0f-a29693839069 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:26.977063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3521def2-5001-487c-ae0f-a29693839069 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:26.977506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3521def2-5001-487c-ae0f-a29693839069 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:27.120754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3521def2-5001-487c-ae0f-a29693839069 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:27.128712 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3521def2-5001-487c-ae0f-a29693839069 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1318 microversion: 2.1 time: 0.166476 Sep 06 11:50:27.129981 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3412/6781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:26 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:28.152819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1396cc68-2295-49ab-aca1-647e0e9cfdcc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:28.153432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1396cc68-2295-49ab-aca1-647e0e9cfdcc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:28.162797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1396cc68-2295-49ab-aca1-647e0e9cfdcc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:28.163262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1396cc68-2295-49ab-aca1-647e0e9cfdcc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:28.163712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1396cc68-2295-49ab-aca1-647e0e9cfdcc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:28.164413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1396cc68-2295-49ab-aca1-647e0e9cfdcc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:28.164868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1396cc68-2295-49ab-aca1-647e0e9cfdcc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:28.165300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1396cc68-2295-49ab-aca1-647e0e9cfdcc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:28.322939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1396cc68-2295-49ab-aca1-647e0e9cfdcc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:28.330906 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1396cc68-2295-49ab-aca1-647e0e9cfdcc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1318 microversion: 2.1 time: 0.182086 Sep 06 11:50:28.331509 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3370/6782] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:28 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:29.357310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-392f7c68-97c9-466c-9d29-21b9766f5d5a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:29.357939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-392f7c68-97c9-466c-9d29-21b9766f5d5a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:29.366706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-392f7c68-97c9-466c-9d29-21b9766f5d5a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:29.367417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-392f7c68-97c9-466c-9d29-21b9766f5d5a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:29.367714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-392f7c68-97c9-466c-9d29-21b9766f5d5a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:29.368569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-392f7c68-97c9-466c-9d29-21b9766f5d5a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:29.368920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-392f7c68-97c9-466c-9d29-21b9766f5d5a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:29.369358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-392f7c68-97c9-466c-9d29-21b9766f5d5a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:29.522399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-392f7c68-97c9-466c-9d29-21b9766f5d5a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:29.524028 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-392f7c68-97c9-466c-9d29-21b9766f5d5a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1318 microversion: 2.1 time: 0.171138 Sep 06 11:50:29.524508 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3413/6783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:29 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:29.581548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-3c179b07-a950-4e51-b64a-80912b912d7e req-91defaf4-f3c7-4c55-aeef-eb1ddf96a06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3958bd5d-ed93-4409-bba5-dc0791d2133f", "name": "network-vif-plugged", "status": "completed", "tag": "1d9883be-52d5-4948-9c22-4b35c9d609b1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:29.592704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3c179b07-a950-4e51-b64a-80912b912d7e req-91defaf4-f3c7-4c55-aeef-eb1ddf96a06c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:29.593198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3c179b07-a950-4e51-b64a-80912b912d7e req-91defaf4-f3c7-4c55-aeef-eb1ddf96a06c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:29.593648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-3c179b07-a950-4e51-b64a-80912b912d7e req-91defaf4-f3c7-4c55-aeef-eb1ddf96a06c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:29.606715 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-3c179b07-a950-4e51-b64a-80912b912d7e req-91defaf4-f3c7-4c55-aeef-eb1ddf96a06c service nova] Creating event network-vif-plugged:1d9883be-52d5-4948-9c22-4b35c9d609b1 for instance 3958bd5d-ed93-4409-bba5-dc0791d2133f on nch1-master-1 Sep 06 11:50:29.611918 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-3c179b07-a950-4e51-b64a-80912b912d7e req-91defaf4-f3c7-4c55-aeef-eb1ddf96a06c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034210 Sep 06 11:50:29.612538 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3371/6784] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:30.548819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6053f985-37f0-44d4-b44e-77539e8ed766 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:30.549521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6053f985-37f0-44d4-b44e-77539e8ed766 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:30.552313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:30.558484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6053f985-37f0-44d4-b44e-77539e8ed766 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:30.558983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6053f985-37f0-44d4-b44e-77539e8ed766 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:30.581529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6053f985-37f0-44d4-b44e-77539e8ed766 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:30.581529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6053f985-37f0-44d4-b44e-77539e8ed766 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:30.581529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6053f985-37f0-44d4-b44e-77539e8ed766 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:30.581529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6053f985-37f0-44d4-b44e-77539e8ed766 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:30.700780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6053f985-37f0-44d4-b44e-77539e8ed766 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:30.706621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:30.714724 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6053f985-37f0-44d4-b44e-77539e8ed766 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1318 microversion: 2.1 time: 0.169906 Sep 06 11:50:30.718456 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3414/6785] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:30 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:31.736694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:31.737509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:31.743223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-df691a91-8dc1-42e3-8fdb-594a5c748a8f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:31.743940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-df691a91-8dc1-42e3-8fdb-594a5c748a8f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:31.752732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df691a91-8dc1-42e3-8fdb-594a5c748a8f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:31.753389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df691a91-8dc1-42e3-8fdb-594a5c748a8f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:31.754447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df691a91-8dc1-42e3-8fdb-594a5c748a8f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:31.755236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df691a91-8dc1-42e3-8fdb-594a5c748a8f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:31.755717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df691a91-8dc1-42e3-8fdb-594a5c748a8f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:31.756167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df691a91-8dc1-42e3-8fdb-594a5c748a8f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:31.905951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-df691a91-8dc1-42e3-8fdb-594a5c748a8f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:31.921030 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-df691a91-8dc1-42e3-8fdb-594a5c748a8f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1508 microversion: 2.1 time: 0.184932 Sep 06 11:50:31.922055 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3372/6786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:31 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:31.948802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f1e30a54-290a-43ba-ab19-ffc062a2b25d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:31.949425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f1e30a54-290a-43ba-ab19-ffc062a2b25d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:31.956703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1e30a54-290a-43ba-ab19-ffc062a2b25d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:31.957246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1e30a54-290a-43ba-ab19-ffc062a2b25d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:31.957700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1e30a54-290a-43ba-ab19-ffc062a2b25d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:31.958417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1e30a54-290a-43ba-ab19-ffc062a2b25d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:31.958891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1e30a54-290a-43ba-ab19-ffc062a2b25d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:31.959368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f1e30a54-290a-43ba-ab19-ffc062a2b25d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:32.102623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f1e30a54-290a-43ba-ab19-ffc062a2b25d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:32.111139 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f1e30a54-290a-43ba-ab19-ffc062a2b25d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1508 microversion: 2.1 time: 0.166469 Sep 06 11:50:32.111746 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3415/6787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:31 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:32.135678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:32.139435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:32.148630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:32.149180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:32.149619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:32.150333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:32.150788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:32.151437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:32.200010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:32.214192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Old instance type m1.heat2, new instance type m1.heat {{(pid=140875) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:50:32.224388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:50:32.224823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:50:32.225353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:50:32.225772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:50:32.226198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:50:32.449313 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-594a6982-ba73-47e8-b9a8-ba41a7b8d67a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "POST /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f/action" status: 202 len: 0 microversion: 2.1 time: 0.318586 Sep 06 11:50:32.449836 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3373/6788] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:50:32 2022] POST /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:50:32.459284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1eed480e-81ec-4ebc-b825-b3ee5edfec16 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:32.459837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1eed480e-81ec-4ebc-b825-b3ee5edfec16 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:32.466791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1eed480e-81ec-4ebc-b825-b3ee5edfec16 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:32.467416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1eed480e-81ec-4ebc-b825-b3ee5edfec16 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:32.468109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1eed480e-81ec-4ebc-b825-b3ee5edfec16 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:32.469077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1eed480e-81ec-4ebc-b825-b3ee5edfec16 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:32.469740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1eed480e-81ec-4ebc-b825-b3ee5edfec16 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:32.470261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1eed480e-81ec-4ebc-b825-b3ee5edfec16 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:32.633742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1eed480e-81ec-4ebc-b825-b3ee5edfec16 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:32.643550 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1eed480e-81ec-4ebc-b825-b3ee5edfec16 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1515 microversion: 2.1 time: 0.188977 Sep 06 11:50:32.644195 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3416/6789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:32 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:33.668979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9f53c1de-ac4e-40d1-a9f9-f8d8036874dd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:33.669599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9f53c1de-ac4e-40d1-a9f9-f8d8036874dd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:33.676580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f53c1de-ac4e-40d1-a9f9-f8d8036874dd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:33.677074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f53c1de-ac4e-40d1-a9f9-f8d8036874dd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:33.677517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f53c1de-ac4e-40d1-a9f9-f8d8036874dd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:33.678233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f53c1de-ac4e-40d1-a9f9-f8d8036874dd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:33.678727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f53c1de-ac4e-40d1-a9f9-f8d8036874dd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:33.679249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f53c1de-ac4e-40d1-a9f9-f8d8036874dd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:33.817779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9f53c1de-ac4e-40d1-a9f9-f8d8036874dd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:33.822018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:33.826725 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9f53c1de-ac4e-40d1-a9f9-f8d8036874dd tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1515 microversion: 2.1 time: 0.162571 Sep 06 11:50:33.827364 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3374/6790] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:33 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:34.850819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-935538e5-ef49-47a0-bdb7-b12433a7c22a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:34.851491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-935538e5-ef49-47a0-bdb7-b12433a7c22a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:34.858864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-935538e5-ef49-47a0-bdb7-b12433a7c22a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:34.859390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-935538e5-ef49-47a0-bdb7-b12433a7c22a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:34.859847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-935538e5-ef49-47a0-bdb7-b12433a7c22a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:34.860553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-935538e5-ef49-47a0-bdb7-b12433a7c22a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:34.861027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-935538e5-ef49-47a0-bdb7-b12433a7c22a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:34.861470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-935538e5-ef49-47a0-bdb7-b12433a7c22a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:34.999757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-935538e5-ef49-47a0-bdb7-b12433a7c22a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:35.007904 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-935538e5-ef49-47a0-bdb7-b12433a7c22a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1515 microversion: 2.1 time: 0.161662 Sep 06 11:50:35.008492 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3417/6791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:34 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:36.033825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d8d75136-ff10-4f5a-b854-888197130b65 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:36.034485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d8d75136-ff10-4f5a-b854-888197130b65 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:36.046743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8d75136-ff10-4f5a-b854-888197130b65 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:36.047282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8d75136-ff10-4f5a-b854-888197130b65 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:36.047816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8d75136-ff10-4f5a-b854-888197130b65 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:36.048567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8d75136-ff10-4f5a-b854-888197130b65 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:36.049042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8d75136-ff10-4f5a-b854-888197130b65 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:36.049478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8d75136-ff10-4f5a-b854-888197130b65 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:36.192893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d8d75136-ff10-4f5a-b854-888197130b65 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:36.200999 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d8d75136-ff10-4f5a-b854-888197130b65 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1515 microversion: 2.1 time: 0.171756 Sep 06 11:50:36.201605 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3375/6792] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:36 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:37.226338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-21de1315-7e49-4858-81d7-4c042efd0423 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:37.226967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-21de1315-7e49-4858-81d7-4c042efd0423 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:37.229861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:37.235219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-21de1315-7e49-4858-81d7-4c042efd0423 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:37.235725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-21de1315-7e49-4858-81d7-4c042efd0423 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:37.236186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-21de1315-7e49-4858-81d7-4c042efd0423 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:37.236917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-21de1315-7e49-4858-81d7-4c042efd0423 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:37.237467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-21de1315-7e49-4858-81d7-4c042efd0423 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:37.237916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-21de1315-7e49-4858-81d7-4c042efd0423 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:37.387253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-21de1315-7e49-4858-81d7-4c042efd0423 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:37.395554 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-21de1315-7e49-4858-81d7-4c042efd0423 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.173413 Sep 06 11:50:37.397017 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3418/6793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:37 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:38.421067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3b26abc2-e95e-4eaf-95fb-3f37412ae80f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:38.421779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3b26abc2-e95e-4eaf-95fb-3f37412ae80f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:38.429167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b26abc2-e95e-4eaf-95fb-3f37412ae80f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:38.429663 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b26abc2-e95e-4eaf-95fb-3f37412ae80f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:38.430114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b26abc2-e95e-4eaf-95fb-3f37412ae80f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:38.430826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b26abc2-e95e-4eaf-95fb-3f37412ae80f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:38.431323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b26abc2-e95e-4eaf-95fb-3f37412ae80f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:38.431766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3b26abc2-e95e-4eaf-95fb-3f37412ae80f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:38.571199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3b26abc2-e95e-4eaf-95fb-3f37412ae80f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:38.580110 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3b26abc2-e95e-4eaf-95fb-3f37412ae80f tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.162898 Sep 06 11:50:38.580721 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3376/6794] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:38 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:39.605224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9787bcee-488c-4259-873c-490d499948f8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:39.605908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9787bcee-488c-4259-873c-490d499948f8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:39.614472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9787bcee-488c-4259-873c-490d499948f8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:39.615722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9787bcee-488c-4259-873c-490d499948f8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:39.616248 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9787bcee-488c-4259-873c-490d499948f8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:39.616944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9787bcee-488c-4259-873c-490d499948f8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:39.617464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9787bcee-488c-4259-873c-490d499948f8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:39.617908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9787bcee-488c-4259-873c-490d499948f8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:39.782244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9787bcee-488c-4259-873c-490d499948f8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:39.790690 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9787bcee-488c-4259-873c-490d499948f8 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.189327 Sep 06 11:50:39.791324 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3419/6795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:39 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:40.815763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-406b4c62-91db-4ecc-9e5b-428bb3e58d75 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:40.816603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-406b4c62-91db-4ecc-9e5b-428bb3e58d75 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:40.821341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:40.826912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-406b4c62-91db-4ecc-9e5b-428bb3e58d75 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:40.830631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-406b4c62-91db-4ecc-9e5b-428bb3e58d75 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:40.830631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-406b4c62-91db-4ecc-9e5b-428bb3e58d75 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:40.830631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-406b4c62-91db-4ecc-9e5b-428bb3e58d75 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:40.830631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-406b4c62-91db-4ecc-9e5b-428bb3e58d75 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:40.830631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-406b4c62-91db-4ecc-9e5b-428bb3e58d75 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:40.970661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-406b4c62-91db-4ecc-9e5b-428bb3e58d75 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:40.979635 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-406b4c62-91db-4ecc-9e5b-428bb3e58d75 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.168905 Sep 06 11:50:40.980208 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3377/6796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:40 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:42.005999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-854b0e2d-018a-4518-9621-02a8b4efacae tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:42.006657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-854b0e2d-018a-4518-9621-02a8b4efacae tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:42.013968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-854b0e2d-018a-4518-9621-02a8b4efacae tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:42.014467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-854b0e2d-018a-4518-9621-02a8b4efacae tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:42.014922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-854b0e2d-018a-4518-9621-02a8b4efacae tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:42.015665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-854b0e2d-018a-4518-9621-02a8b4efacae tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:42.016134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-854b0e2d-018a-4518-9621-02a8b4efacae tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:42.016572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-854b0e2d-018a-4518-9621-02a8b4efacae tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:42.157502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-854b0e2d-018a-4518-9621-02a8b4efacae tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:42.166565 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-854b0e2d-018a-4518-9621-02a8b4efacae tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.165235 Sep 06 11:50:42.167086 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3420/6797] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:42 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:43.190804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e11d42d-cb26-43a8-9dac-078136263631 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:43.191416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e11d42d-cb26-43a8-9dac-078136263631 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:43.199470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e11d42d-cb26-43a8-9dac-078136263631 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:43.199980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e11d42d-cb26-43a8-9dac-078136263631 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:43.200426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e11d42d-cb26-43a8-9dac-078136263631 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:43.201186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e11d42d-cb26-43a8-9dac-078136263631 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:43.201647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e11d42d-cb26-43a8-9dac-078136263631 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:43.202083 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e11d42d-cb26-43a8-9dac-078136263631 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:43.350625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7e11d42d-cb26-43a8-9dac-078136263631 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:43.358548 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e11d42d-cb26-43a8-9dac-078136263631 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.171827 Sep 06 11:50:43.363406 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3378/6798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:43 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:44.384173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1320c322-3b66-4e9b-96d6-27e06afd7257 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:44.384987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1320c322-3b66-4e9b-96d6-27e06afd7257 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:44.392157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1320c322-3b66-4e9b-96d6-27e06afd7257 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:44.393392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1320c322-3b66-4e9b-96d6-27e06afd7257 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:44.393886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1320c322-3b66-4e9b-96d6-27e06afd7257 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:44.394817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1320c322-3b66-4e9b-96d6-27e06afd7257 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:44.395262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1320c322-3b66-4e9b-96d6-27e06afd7257 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:44.395761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1320c322-3b66-4e9b-96d6-27e06afd7257 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:44.553362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1320c322-3b66-4e9b-96d6-27e06afd7257 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:44.561629 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1320c322-3b66-4e9b-96d6-27e06afd7257 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.182152 Sep 06 11:50:44.562219 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3421/6799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:44 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:45.586347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3839869b-132e-493d-a2c0-b6d1a8c170fc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:45.586951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3839869b-132e-493d-a2c0-b6d1a8c170fc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:45.594250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3839869b-132e-493d-a2c0-b6d1a8c170fc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:45.594768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3839869b-132e-493d-a2c0-b6d1a8c170fc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:45.595242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3839869b-132e-493d-a2c0-b6d1a8c170fc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:45.595948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3839869b-132e-493d-a2c0-b6d1a8c170fc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:45.596422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3839869b-132e-493d-a2c0-b6d1a8c170fc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:45.596853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3839869b-132e-493d-a2c0-b6d1a8c170fc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:45.742035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3839869b-132e-493d-a2c0-b6d1a8c170fc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:45.750521 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3839869b-132e-493d-a2c0-b6d1a8c170fc tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.168780 Sep 06 11:50:45.751148 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3379/6800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:45 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:46.775041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8fbc14d2-fd97-475f-aece-567ca5021800 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:46.775675 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8fbc14d2-fd97-475f-aece-567ca5021800 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:46.782794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fbc14d2-fd97-475f-aece-567ca5021800 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:46.783323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fbc14d2-fd97-475f-aece-567ca5021800 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:46.783773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fbc14d2-fd97-475f-aece-567ca5021800 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:46.784479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fbc14d2-fd97-475f-aece-567ca5021800 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:46.784947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fbc14d2-fd97-475f-aece-567ca5021800 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:46.785390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8fbc14d2-fd97-475f-aece-567ca5021800 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:46.929637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8fbc14d2-fd97-475f-aece-567ca5021800 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:46.939272 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8fbc14d2-fd97-475f-aece-567ca5021800 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.168577 Sep 06 11:50:46.939866 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3422/6801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:46 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:47.962629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6954eea0-66a3-4a41-8503-64280baef4a7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:47.963493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6954eea0-66a3-4a41-8503-64280baef4a7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:47.970221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6954eea0-66a3-4a41-8503-64280baef4a7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:47.970711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6954eea0-66a3-4a41-8503-64280baef4a7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:47.971209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6954eea0-66a3-4a41-8503-64280baef4a7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:47.971933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6954eea0-66a3-4a41-8503-64280baef4a7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:47.972397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6954eea0-66a3-4a41-8503-64280baef4a7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:47.972844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6954eea0-66a3-4a41-8503-64280baef4a7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:48.117648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6954eea0-66a3-4a41-8503-64280baef4a7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:48.126200 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6954eea0-66a3-4a41-8503-64280baef4a7 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.168084 Sep 06 11:50:48.126804 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3380/6802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:47 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:49.151690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-302de556-90d4-4c0f-b1e9-b920f5715a5d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:49.152864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-302de556-90d4-4c0f-b1e9-b920f5715a5d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:49.163075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-302de556-90d4-4c0f-b1e9-b920f5715a5d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:49.163803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-302de556-90d4-4c0f-b1e9-b920f5715a5d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:49.164273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-302de556-90d4-4c0f-b1e9-b920f5715a5d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:49.165016 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-302de556-90d4-4c0f-b1e9-b920f5715a5d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:49.165497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-302de556-90d4-4c0f-b1e9-b920f5715a5d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:49.165979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-302de556-90d4-4c0f-b1e9-b920f5715a5d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:49.298099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-302de556-90d4-4c0f-b1e9-b920f5715a5d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:49.305882 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-302de556-90d4-4c0f-b1e9-b920f5715a5d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.159037 Sep 06 11:50:49.306451 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3423/6803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:49 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:50.335035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-46e6633a-a540-4b40-965d-0b9e3fc3e7be tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:50.335678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-46e6633a-a540-4b40-965d-0b9e3fc3e7be tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:50.342269 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46e6633a-a540-4b40-965d-0b9e3fc3e7be tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:50.342767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46e6633a-a540-4b40-965d-0b9e3fc3e7be tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:50.343252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46e6633a-a540-4b40-965d-0b9e3fc3e7be tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:50.343978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46e6633a-a540-4b40-965d-0b9e3fc3e7be tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:50.344454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46e6633a-a540-4b40-965d-0b9e3fc3e7be tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:50.344916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-46e6633a-a540-4b40-965d-0b9e3fc3e7be tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:50.501160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-46e6633a-a540-4b40-965d-0b9e3fc3e7be tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:50.509958 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-46e6633a-a540-4b40-965d-0b9e3fc3e7be tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.183798 Sep 06 11:50:50.510573 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3381/6804] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:50 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:51.536991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-44cbfb66-965f-43ae-b365-0378962dff51 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:51.537619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-44cbfb66-965f-43ae-b365-0378962dff51 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:51.545072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44cbfb66-965f-43ae-b365-0378962dff51 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:51.545568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44cbfb66-965f-43ae-b365-0378962dff51 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:51.546026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44cbfb66-965f-43ae-b365-0378962dff51 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:51.546742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44cbfb66-965f-43ae-b365-0378962dff51 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:51.547242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44cbfb66-965f-43ae-b365-0378962dff51 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:51.547680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-44cbfb66-965f-43ae-b365-0378962dff51 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:51.693822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-44cbfb66-965f-43ae-b365-0378962dff51 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:51.702210 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-44cbfb66-965f-43ae-b365-0378962dff51 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.169583 Sep 06 11:50:51.702831 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3424/6805] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:51 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:52.728763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ea31e7a6-b8ef-41e7-9305-fc86ed2aca63 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:52.729639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ea31e7a6-b8ef-41e7-9305-fc86ed2aca63 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:52.737168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea31e7a6-b8ef-41e7-9305-fc86ed2aca63 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:52.737673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea31e7a6-b8ef-41e7-9305-fc86ed2aca63 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:52.738119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea31e7a6-b8ef-41e7-9305-fc86ed2aca63 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:52.738831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea31e7a6-b8ef-41e7-9305-fc86ed2aca63 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:52.739345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea31e7a6-b8ef-41e7-9305-fc86ed2aca63 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:52.739782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ea31e7a6-b8ef-41e7-9305-fc86ed2aca63 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:52.879287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ea31e7a6-b8ef-41e7-9305-fc86ed2aca63 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:52.889081 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ea31e7a6-b8ef-41e7-9305-fc86ed2aca63 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1520 microversion: 2.1 time: 0.164332 Sep 06 11:50:52.889672 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3382/6806] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:52 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:53.917527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-95faee35-287a-4b26-9915-5d1c7591c0b4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:53.918705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-95faee35-287a-4b26-9915-5d1c7591c0b4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:53.928020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95faee35-287a-4b26-9915-5d1c7591c0b4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:53.928598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95faee35-287a-4b26-9915-5d1c7591c0b4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:53.929115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95faee35-287a-4b26-9915-5d1c7591c0b4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:53.929869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95faee35-287a-4b26-9915-5d1c7591c0b4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:53.930388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95faee35-287a-4b26-9915-5d1c7591c0b4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:53.930996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95faee35-287a-4b26-9915-5d1c7591c0b4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:54.032966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-941e1dd1-b3a9-4778-8747-3efdeff65262 req-a733c978-bee5-4db4-a313-4d4518ee108a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3958bd5d-ed93-4409-bba5-dc0791d2133f", "name": "network-vif-unplugged", "status": "completed", "tag": "1d9883be-52d5-4948-9c22-4b35c9d609b1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:54.045919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-941e1dd1-b3a9-4778-8747-3efdeff65262 req-a733c978-bee5-4db4-a313-4d4518ee108a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:54.049799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-941e1dd1-b3a9-4778-8747-3efdeff65262 req-a733c978-bee5-4db4-a313-4d4518ee108a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:54.049799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-941e1dd1-b3a9-4778-8747-3efdeff65262 req-a733c978-bee5-4db4-a313-4d4518ee108a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:54.069400 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-941e1dd1-b3a9-4778-8747-3efdeff65262 req-a733c978-bee5-4db4-a313-4d4518ee108a service nova] Creating event network-vif-unplugged:1d9883be-52d5-4948-9c22-4b35c9d609b1 for instance 3958bd5d-ed93-4409-bba5-dc0791d2133f on nch2-master-1 Sep 06 11:50:54.076073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-941e1dd1-b3a9-4778-8747-3efdeff65262 req-a733c978-bee5-4db4-a313-4d4518ee108a service nova] Instance 3958bd5d-ed93-4409-bba5-dc0791d2133f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:50:54.085574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-95faee35-287a-4b26-9915-5d1c7591c0b4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:54.088368 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-941e1dd1-b3a9-4778-8747-3efdeff65262 req-a733c978-bee5-4db4-a313-4d4518ee108a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060052 Sep 06 11:50:54.089000 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3383/6807] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:50:54.094909 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-95faee35-287a-4b26-9915-5d1c7591c0b4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1519 microversion: 2.1 time: 0.184913 Sep 06 11:50:54.097967 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3425/6808] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:53 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:55.126278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-57f5d1d0-fb51-44a6-9b1c-e23e1baf7da6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:55.126986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-57f5d1d0-fb51-44a6-9b1c-e23e1baf7da6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:55.133732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57f5d1d0-fb51-44a6-9b1c-e23e1baf7da6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:55.134220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57f5d1d0-fb51-44a6-9b1c-e23e1baf7da6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:55.134668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57f5d1d0-fb51-44a6-9b1c-e23e1baf7da6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:55.135422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57f5d1d0-fb51-44a6-9b1c-e23e1baf7da6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:55.135887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57f5d1d0-fb51-44a6-9b1c-e23e1baf7da6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:55.136334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-57f5d1d0-fb51-44a6-9b1c-e23e1baf7da6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:55.303074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-57f5d1d0-fb51-44a6-9b1c-e23e1baf7da6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:55.311135 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-57f5d1d0-fb51-44a6-9b1c-e23e1baf7da6 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1519 microversion: 2.1 time: 0.191052 Sep 06 11:50:55.311900 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3384/6809] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:55 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:56.104290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-29a1eff3-ecdd-4fac-958e-e882a59e0d63 req-0eebacb4-c739-4533-8edf-f65626483942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3958bd5d-ed93-4409-bba5-dc0791d2133f", "tag": "1d9883be-52d5-4948-9c22-4b35c9d609b1"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:56.116027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-29a1eff3-ecdd-4fac-958e-e882a59e0d63 req-0eebacb4-c739-4533-8edf-f65626483942 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.116528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-29a1eff3-ecdd-4fac-958e-e882a59e0d63 req-0eebacb4-c739-4533-8edf-f65626483942 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.116996 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-29a1eff3-ecdd-4fac-958e-e882a59e0d63 req-0eebacb4-c739-4533-8edf-f65626483942 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:56.130524 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-29a1eff3-ecdd-4fac-958e-e882a59e0d63 req-0eebacb4-c739-4533-8edf-f65626483942 service nova] Creating event network-changed:1d9883be-52d5-4948-9c22-4b35c9d609b1 for instance 3958bd5d-ed93-4409-bba5-dc0791d2133f on nch2-master-1 Sep 06 11:50:56.137025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-29a1eff3-ecdd-4fac-958e-e882a59e0d63 req-0eebacb4-c739-4533-8edf-f65626483942 service nova] Instance 3958bd5d-ed93-4409-bba5-dc0791d2133f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:50:56.148370 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-29a1eff3-ecdd-4fac-958e-e882a59e0d63 req-0eebacb4-c739-4533-8edf-f65626483942 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048300 Sep 06 11:50:56.151669 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3426/6810] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:50:56.335117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1b172dd7-3b96-4b27-8b9f-2c1438cd77d9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:56.336166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1b172dd7-3b96-4b27-8b9f-2c1438cd77d9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:56.344639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b172dd7-3b96-4b27-8b9f-2c1438cd77d9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.345220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b172dd7-3b96-4b27-8b9f-2c1438cd77d9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.345744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b172dd7-3b96-4b27-8b9f-2c1438cd77d9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:56.346712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b172dd7-3b96-4b27-8b9f-2c1438cd77d9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.347409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b172dd7-3b96-4b27-8b9f-2c1438cd77d9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.347910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1b172dd7-3b96-4b27-8b9f-2c1438cd77d9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:56.502890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1b172dd7-3b96-4b27-8b9f-2c1438cd77d9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:56.514329 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1b172dd7-3b96-4b27-8b9f-2c1438cd77d9 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1517 microversion: 2.1 time: 0.183992 Sep 06 11:50:56.515309 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3385/6811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:56 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:57.540148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0b796e34-14cf-46f5-b9c5-1253cecdfa1a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:57.541086 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0b796e34-14cf-46f5-b9c5-1253cecdfa1a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:57.547667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b796e34-14cf-46f5-b9c5-1253cecdfa1a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.548187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b796e34-14cf-46f5-b9c5-1253cecdfa1a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.548643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b796e34-14cf-46f5-b9c5-1253cecdfa1a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:57.549394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b796e34-14cf-46f5-b9c5-1253cecdfa1a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.549950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b796e34-14cf-46f5-b9c5-1253cecdfa1a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.550403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b796e34-14cf-46f5-b9c5-1253cecdfa1a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:57.690117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0b796e34-14cf-46f5-b9c5-1253cecdfa1a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:57.698629 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0b796e34-14cf-46f5-b9c5-1253cecdfa1a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1514 microversion: 2.1 time: 0.163698 Sep 06 11:50:57.699321 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3427/6812] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:57 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:57.721839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6e2758c2-90fe-4060-83b6-7703d9853341 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:57.722419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6e2758c2-90fe-4060-83b6-7703d9853341 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:57.729932 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2758c2-90fe-4060-83b6-7703d9853341 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.730426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2758c2-90fe-4060-83b6-7703d9853341 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.730871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2758c2-90fe-4060-83b6-7703d9853341 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:57.731699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2758c2-90fe-4060-83b6-7703d9853341 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.732156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2758c2-90fe-4060-83b6-7703d9853341 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.732591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6e2758c2-90fe-4060-83b6-7703d9853341 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:57.970766 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6e2758c2-90fe-4060-83b6-7703d9853341 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "POST /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f/action" status: 204 len: 0 microversion: 2.1 time: 0.252385 Sep 06 11:50:57.971524 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3386/6813] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:50:57 2022] POST /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f/action => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:50:57.980271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0443bd5c-0a7d-4b08-b38d-5e6857f96754 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:57.980917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0443bd5c-0a7d-4b08-b38d-5e6857f96754 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:57.987454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0443bd5c-0a7d-4b08-b38d-5e6857f96754 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.987971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0443bd5c-0a7d-4b08-b38d-5e6857f96754 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.988440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0443bd5c-0a7d-4b08-b38d-5e6857f96754 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:57.989827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0443bd5c-0a7d-4b08-b38d-5e6857f96754 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.990327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0443bd5c-0a7d-4b08-b38d-5e6857f96754 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.990795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0443bd5c-0a7d-4b08-b38d-5e6857f96754 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:58.142569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0443bd5c-0a7d-4b08-b38d-5e6857f96754 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:58.151377 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0443bd5c-0a7d-4b08-b38d-5e6857f96754 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1514 microversion: 2.1 time: 0.175080 Sep 06 11:50:58.151983 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3428/6814] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:57 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:59.177537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8473b0de-43db-4404-814d-90b112f3534d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:59.178257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8473b0de-43db-4404-814d-90b112f3534d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:59.185131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8473b0de-43db-4404-814d-90b112f3534d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:59.197343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8473b0de-43db-4404-814d-90b112f3534d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:59.197343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8473b0de-43db-4404-814d-90b112f3534d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:59.197343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8473b0de-43db-4404-814d-90b112f3534d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:59.197343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8473b0de-43db-4404-814d-90b112f3534d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:59.197343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8473b0de-43db-4404-814d-90b112f3534d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:59.342868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8473b0de-43db-4404-814d-90b112f3534d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:59.352434 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8473b0de-43db-4404-814d-90b112f3534d tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1514 microversion: 2.1 time: 0.180128 Sep 06 11:50:59.353094 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3387/6815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:59 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:00.377391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1ac1b798-29b0-40bc-bd0b-8ae7c701a488 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:00.378017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1ac1b798-29b0-40bc-bd0b-8ae7c701a488 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:00.385097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ac1b798-29b0-40bc-bd0b-8ae7c701a488 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.385681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ac1b798-29b0-40bc-bd0b-8ae7c701a488 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.386154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ac1b798-29b0-40bc-bd0b-8ae7c701a488 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.386867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ac1b798-29b0-40bc-bd0b-8ae7c701a488 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.387361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ac1b798-29b0-40bc-bd0b-8ae7c701a488 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.387797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1ac1b798-29b0-40bc-bd0b-8ae7c701a488 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.530509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1ac1b798-29b0-40bc-bd0b-8ae7c701a488 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:00.539516 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1ac1b798-29b0-40bc-bd0b-8ae7c701a488 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1506 microversion: 2.1 time: 0.165994 Sep 06 11:51:00.540108 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3429/6816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:00 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:00.562631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e2693770-00c3-4820-9ad0-443ad4cab323 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:00.563314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e2693770-00c3-4820-9ad0-443ad4cab323 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:00.566594 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:51:00.566836 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 11:51:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f (ip 10.222.0.20) !!! Sep 06 11:51:00.575843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2693770-00c3-4820-9ad0-443ad4cab323 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.576337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2693770-00c3-4820-9ad0-443ad4cab323 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.576782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2693770-00c3-4820-9ad0-443ad4cab323 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.577498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2693770-00c3-4820-9ad0-443ad4cab323 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.577965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2693770-00c3-4820-9ad0-443ad4cab323 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.578481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2693770-00c3-4820-9ad0-443ad4cab323 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.716832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e2693770-00c3-4820-9ad0-443ad4cab323 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:00.725071 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e2693770-00c3-4820-9ad0-443ad4cab323 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1506 microversion: 2.1 time: 0.166327 Sep 06 11:51:00.725676 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3388/6817] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:00 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:00.747957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3ca63c4c-e9e0-4dc9-9f8a-ff021162b87a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:00.748591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3ca63c4c-e9e0-4dc9-9f8a-ff021162b87a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:00.755297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ca63c4c-e9e0-4dc9-9f8a-ff021162b87a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.755800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ca63c4c-e9e0-4dc9-9f8a-ff021162b87a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.756255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ca63c4c-e9e0-4dc9-9f8a-ff021162b87a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.756963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ca63c4c-e9e0-4dc9-9f8a-ff021162b87a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.757437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ca63c4c-e9e0-4dc9-9f8a-ff021162b87a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.757913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3ca63c4c-e9e0-4dc9-9f8a-ff021162b87a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.891552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3ca63c4c-e9e0-4dc9-9f8a-ff021162b87a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:00.900090 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3ca63c4c-e9e0-4dc9-9f8a-ff021162b87a tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1506 microversion: 2.1 time: 0.156081 Sep 06 11:51:00.900676 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3430/6818] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:00 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:00.923164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-09690a96-5787-48ef-9efa-a95c1abb8789 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:00.923619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-09690a96-5787-48ef-9efa-a95c1abb8789 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:00.930933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09690a96-5787-48ef-9efa-a95c1abb8789 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.931463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09690a96-5787-48ef-9efa-a95c1abb8789 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.932206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09690a96-5787-48ef-9efa-a95c1abb8789 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.932610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09690a96-5787-48ef-9efa-a95c1abb8789 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.933076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09690a96-5787-48ef-9efa-a95c1abb8789 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.933611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09690a96-5787-48ef-9efa-a95c1abb8789 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.959887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-09690a96-5787-48ef-9efa-a95c1abb8789 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:51:00.995780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:01.181418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-07811c28-e68b-43ff-9c9e-41dc28184288 req-9bbeccf6-f3a6-43b2-b8b6-bf05e162130d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3958bd5d-ed93-4409-bba5-dc0791d2133f", "name": "network-vif-plugged", "status": "completed", "tag": "1d9883be-52d5-4948-9c22-4b35c9d609b1"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:01.186350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-07811c28-e68b-43ff-9c9e-41dc28184288 req-9bbeccf6-f3a6-43b2-b8b6-bf05e162130d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:01.186852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-07811c28-e68b-43ff-9c9e-41dc28184288 req-9bbeccf6-f3a6-43b2-b8b6-bf05e162130d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:01.187345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-07811c28-e68b-43ff-9c9e-41dc28184288 req-9bbeccf6-f3a6-43b2-b8b6-bf05e162130d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:01.198904 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-07811c28-e68b-43ff-9c9e-41dc28184288 req-9bbeccf6-f3a6-43b2-b8b6-bf05e162130d service nova] Creating event network-vif-plugged:1d9883be-52d5-4948-9c22-4b35c9d609b1 for instance 3958bd5d-ed93-4409-bba5-dc0791d2133f on nch2-master-1 Sep 06 11:51:01.204206 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-07811c28-e68b-43ff-9c9e-41dc28184288 req-9bbeccf6-f3a6-43b2-b8b6-bf05e162130d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031580 Sep 06 11:51:01.204815 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3431/6819] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:51:01.377322 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-09690a96-5787-48ef-9efa-a95c1abb8789 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 204 len: 0 microversion: 2.1 time: 0.457351 Sep 06 11:51:01.381329 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3389/6820] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:51:00 2022] DELETE /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:51:01.397084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1a7dda63-439f-42b9-bf9c-0ec1efe6c3a3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:01.398059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1a7dda63-439f-42b9-bf9c-0ec1efe6c3a3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:01.405838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7dda63-439f-42b9-bf9c-0ec1efe6c3a3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:01.406315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7dda63-439f-42b9-bf9c-0ec1efe6c3a3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:01.407081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7dda63-439f-42b9-bf9c-0ec1efe6c3a3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:01.407871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7dda63-439f-42b9-bf9c-0ec1efe6c3a3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:01.408562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7dda63-439f-42b9-bf9c-0ec1efe6c3a3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:01.409022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1a7dda63-439f-42b9-bf9c-0ec1efe6c3a3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:01.432122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:01.438157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1a7dda63-439f-42b9-bf9c-0ec1efe6c3a3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:51:01.492898 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.compute.api [None req-1a7dda63-439f-42b9-bf9c-0ec1efe6c3a3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Instance is already in deleting state, ignoring this request Sep 06 11:51:01.494210 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1a7dda63-439f-42b9-bf9c-0ec1efe6c3a3 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 204 len: 0 microversion: 2.1 time: 0.102247 Sep 06 11:51:01.495130 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3432/6821] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:51:01 2022] DELETE /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:51:01.505407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0588cae8-c136-4e31-8685-5ec32f2f0fc4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:01.506122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0588cae8-c136-4e31-8685-5ec32f2f0fc4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:01.512266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0588cae8-c136-4e31-8685-5ec32f2f0fc4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:01.512761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0588cae8-c136-4e31-8685-5ec32f2f0fc4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:01.513213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0588cae8-c136-4e31-8685-5ec32f2f0fc4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:01.513930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0588cae8-c136-4e31-8685-5ec32f2f0fc4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:01.514425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0588cae8-c136-4e31-8685-5ec32f2f0fc4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:01.514861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0588cae8-c136-4e31-8685-5ec32f2f0fc4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:01.656085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0588cae8-c136-4e31-8685-5ec32f2f0fc4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:01.664764 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0588cae8-c136-4e31-8685-5ec32f2f0fc4 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1512 microversion: 2.1 time: 0.164317 Sep 06 11:51:01.665374 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3390/6822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:01 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:02.688562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-195f6284-6446-4c8b-9d8c-6244daf09b66 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:02.689195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-195f6284-6446-4c8b-9d8c-6244daf09b66 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:02.696681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-195f6284-6446-4c8b-9d8c-6244daf09b66 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:02.697186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-195f6284-6446-4c8b-9d8c-6244daf09b66 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:02.697646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-195f6284-6446-4c8b-9d8c-6244daf09b66 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:02.698665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-195f6284-6446-4c8b-9d8c-6244daf09b66 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:02.699173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-195f6284-6446-4c8b-9d8c-6244daf09b66 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:02.699635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-195f6284-6446-4c8b-9d8c-6244daf09b66 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:02.842058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-195f6284-6446-4c8b-9d8c-6244daf09b66 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:02.850542 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-195f6284-6446-4c8b-9d8c-6244daf09b66 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1512 microversion: 2.1 time: 0.165795 Sep 06 11:51:02.854280 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3433/6823] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:02 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:03.827104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9c25bd93-b26b-4edd-83ab-f819921d4ea8 req-a9a503dc-e181-4f69-b74a-efc30c2b1082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3958bd5d-ed93-4409-bba5-dc0791d2133f", "name": "network-vif-deleted", "tag": "1d9883be-52d5-4948-9c22-4b35c9d609b1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:03.841191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9c25bd93-b26b-4edd-83ab-f819921d4ea8 req-a9a503dc-e181-4f69-b74a-efc30c2b1082 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:03.841995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9c25bd93-b26b-4edd-83ab-f819921d4ea8 req-a9a503dc-e181-4f69-b74a-efc30c2b1082 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:03.842625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9c25bd93-b26b-4edd-83ab-f819921d4ea8 req-a9a503dc-e181-4f69-b74a-efc30c2b1082 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:03.857161 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9c25bd93-b26b-4edd-83ab-f819921d4ea8 req-a9a503dc-e181-4f69-b74a-efc30c2b1082 service nova] Creating event network-vif-deleted:1d9883be-52d5-4948-9c22-4b35c9d609b1 for instance 3958bd5d-ed93-4409-bba5-dc0791d2133f on nch2-master-1 Sep 06 11:51:03.864573 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9c25bd93-b26b-4edd-83ab-f819921d4ea8 req-a9a503dc-e181-4f69-b74a-efc30c2b1082 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042437 Sep 06 11:51:03.865506 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3391/6824] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:03.874926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-00186c0d-3099-49e8-95f3-135beca53205 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:03.875717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-00186c0d-3099-49e8-95f3-135beca53205 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:03.883940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00186c0d-3099-49e8-95f3-135beca53205 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:03.887153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00186c0d-3099-49e8-95f3-135beca53205 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:03.887153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00186c0d-3099-49e8-95f3-135beca53205 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:03.887153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00186c0d-3099-49e8-95f3-135beca53205 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:03.887153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00186c0d-3099-49e8-95f3-135beca53205 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:03.887153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-00186c0d-3099-49e8-95f3-135beca53205 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:03.983724 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-00186c0d-3099-49e8-95f3-135beca53205 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8baf03f68275463e8a86261e7ccab728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79eeb48bec764f39b1f0953ae0812355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:03.993675 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-00186c0d-3099-49e8-95f3-135beca53205 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 200 len: 1470 microversion: 2.1 time: 0.122667 Sep 06 11:51:03.994282 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3434/6825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:03 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 1470 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:05.019670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4dfbe62a-affe-4979-b2d5-d47a9d557270 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:05.020380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4dfbe62a-affe-4979-b2d5-d47a9d557270 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: 3958bd5d-ed93-4409-bba5-dc0791d2133f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:05.027333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4dfbe62a-affe-4979-b2d5-d47a9d557270 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:05.027886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4dfbe62a-affe-4979-b2d5-d47a9d557270 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:05.028328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4dfbe62a-affe-4979-b2d5-d47a9d557270 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:05.029227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4dfbe62a-affe-4979-b2d5-d47a9d557270 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:05.029505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4dfbe62a-affe-4979-b2d5-d47a9d557270 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:05.029936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4dfbe62a-affe-4979-b2d5-d47a9d557270 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:05.045692 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-4dfbe62a-affe-4979-b2d5-d47a9d557270 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] HTTP exception thrown: Instance 3958bd5d-ed93-4409-bba5-dc0791d2133f could not be found. Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4dfbe62a-affe-4979-b2d5-d47a9d557270 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Request method failure captured: Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f HTTP/1.1 Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzPNfc9O_seZdnIlwxcThf-M7rDpND8sVAWJIMoMQxRxDV4rFmwESifawkP-ThGLvi74S1dCBJOgIt2HeiarYZflJLeBw6t2qj3HmrNSH0SOIa4ZuU427aWgfGmvpxJTbIAoGG48cWKcQN1NSh-i_YgnEnAEExRNeWXKyd7JD6i7jD8 Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 79eeb48bec764f39b1f0953ae0812355 Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerDiskConfigTestJSON-965424673 Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79eeb48bec764f39b1f0953ae0812355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79eeb48bec764f39b1f0953ae0812355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79eeb48bec764f39b1f0953ae0812355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79eeb48bec764f39b1f0953ae0812355"}]}] Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerDiskConfigTestJSON-965424673 Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 79eeb48bec764f39b1f0953ae0812355 Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-965424673 Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerDiskConfigTestJSON-965424673-project Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 8baf03f68275463e8a86261e7ccab728 Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerDiskConfigTestJSON-965424673-project Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 3958bd5d-ed93-4409-bba5-dc0791d2133f could not be found. Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '3958bd5d-ed93-4409-bba5-dc0791d2133f'} Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3958bd5d-ed93-4409-bba5-dc0791d2133f could not be found. Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3958bd5d-ed93-4409-bba5-dc0791d2133f could not be found. Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:51:05.047416 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:51:05.052945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:51:05.052945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:51:05.052945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:51:05.052945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:51:05.052945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:51:05.052945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3958bd5d-ed93-4409-bba5-dc0791d2133f could not be found. Sep 06 11:51:05.052945 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:51:05.052945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4dfbe62a-affe-4979-b2d5-d47a9d557270 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Returning 404 to user: Instance 3958bd5d-ed93-4409-bba5-dc0791d2133f could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:51:05.052945 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4dfbe62a-affe-4979-b2d5-d47a9d557270 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f" status: 404 len: 111 microversion: 2.1 time: 0.034661 Sep 06 11:51:05.052945 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3392/6826] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:05 2022] GET /compute/v2.1/servers/3958bd5d-ed93-4409-bba5-dc0791d2133f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:51:05.059089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2a9eb2ab-8207-416d-9b21-17096ee77399 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '.version_select at 0x7f90f2fcad30>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:05.232750 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2a9eb2ab-8207-416d-9b21-17096ee77399 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-826696194" status: 202 len: 0 microversion: 2.1 time: 0.177618 Sep 06 11:51:05.233277 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3435/6827] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 11:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-826696194 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:51:06.033999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6dc911b6-c83c-41ba-9ee0-4a347d7965f2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:06.034567 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6dc911b6-c83c-41ba-9ee0-4a347d7965f2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:06.042392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6dc911b6-c83c-41ba-9ee0-4a347d7965f2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:06.042901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6dc911b6-c83c-41ba-9ee0-4a347d7965f2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:06.043358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6dc911b6-c83c-41ba-9ee0-4a347d7965f2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:06.044072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6dc911b6-c83c-41ba-9ee0-4a347d7965f2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:06.044546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6dc911b6-c83c-41ba-9ee0-4a347d7965f2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:06.044980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6dc911b6-c83c-41ba-9ee0-4a347d7965f2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:06.061041 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-6dc911b6-c83c-41ba-9ee0-4a347d7965f2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] HTTP exception thrown: Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 could not be found. Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6dc911b6-c83c-41ba-9ee0-4a347d7965f2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Request method failure captured: Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 HTTP/1.1 Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzPNfc9O_seZdnIlwxcThf-M7rDpND8sVAWJIMoMQxRxDV4rFmwESifawkP-ThGLvi74S1dCBJOgIt2HeiarYZflJLeBw6t2qj3HmrNSH0SOIa4ZuU427aWgfGmvpxJTbIAoGG48cWKcQN1NSh-i_YgnEnAEExRNeWXKyd7JD6i7jD8 Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 79eeb48bec764f39b1f0953ae0812355 Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerDiskConfigTestJSON-965424673 Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79eeb48bec764f39b1f0953ae0812355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79eeb48bec764f39b1f0953ae0812355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79eeb48bec764f39b1f0953ae0812355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79eeb48bec764f39b1f0953ae0812355"}]}] Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerDiskConfigTestJSON-965424673 Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 79eeb48bec764f39b1f0953ae0812355 Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-965424673 Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerDiskConfigTestJSON-965424673-project Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 8baf03f68275463e8a86261e7ccab728 Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerDiskConfigTestJSON-965424673-project Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 could not be found. Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'd8f4821e-7f2d-4966-9663-220b107ae3f9'} Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 could not be found. Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:51:06.062028 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 could not be found. Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 could not be found. Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6dc911b6-c83c-41ba-9ee0-4a347d7965f2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Returning 404 to user: Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6dc911b6-c83c-41ba-9ee0-4a347d7965f2 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 404 len: 111 microversion: 2.1 time: 0.033777 Sep 06 11:51:06.067045 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3393/6828] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:51:06 2022] DELETE /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:51:06.073285 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ea8d55dd-952b-4e3d-8c99-019fa01b5c87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:06.073915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ea8d55dd-952b-4e3d-8c99-019fa01b5c87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] [instance: d8f4821e-7f2d-4966-9663-220b107ae3f9] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:06.081055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea8d55dd-952b-4e3d-8c99-019fa01b5c87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:06.081485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea8d55dd-952b-4e3d-8c99-019fa01b5c87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:06.081949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea8d55dd-952b-4e3d-8c99-019fa01b5c87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:06.083229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea8d55dd-952b-4e3d-8c99-019fa01b5c87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:06.083725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea8d55dd-952b-4e3d-8c99-019fa01b5c87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:06.084170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea8d55dd-952b-4e3d-8c99-019fa01b5c87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:06.099115 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-ea8d55dd-952b-4e3d-8c99-019fa01b5c87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] HTTP exception thrown: Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 could not be found. Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ea8d55dd-952b-4e3d-8c99-019fa01b5c87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Request method failure captured: Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 HTTP/1.1 Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzPNfc9O_seZdnIlwxcThf-M7rDpND8sVAWJIMoMQxRxDV4rFmwESifawkP-ThGLvi74S1dCBJOgIt2HeiarYZflJLeBw6t2qj3HmrNSH0SOIa4ZuU427aWgfGmvpxJTbIAoGG48cWKcQN1NSh-i_YgnEnAEExRNeWXKyd7JD6i7jD8 Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 79eeb48bec764f39b1f0953ae0812355 Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerDiskConfigTestJSON-965424673 Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79eeb48bec764f39b1f0953ae0812355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79eeb48bec764f39b1f0953ae0812355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79eeb48bec764f39b1f0953ae0812355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79eeb48bec764f39b1f0953ae0812355"}]}] Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerDiskConfigTestJSON-965424673 Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 79eeb48bec764f39b1f0953ae0812355 Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-965424673 Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerDiskConfigTestJSON-965424673-project Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 8baf03f68275463e8a86261e7ccab728 Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerDiskConfigTestJSON-965424673-project Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 could not be found. Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'd8f4821e-7f2d-4966-9663-220b107ae3f9'} Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 could not be found. Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 could not be found. Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:51:06.100832 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:51:06.105972 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:51:06.105972 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:51:06.105972 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:51:06.105972 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:51:06.105972 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:51:06.105972 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 could not be found. Sep 06 11:51:06.105972 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:51:06.105972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ea8d55dd-952b-4e3d-8c99-019fa01b5c87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] Returning 404 to user: Instance d8f4821e-7f2d-4966-9663-220b107ae3f9 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:51:06.105972 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ea8d55dd-952b-4e3d-8c99-019fa01b5c87 tempest-ServerDiskConfigTestJSON-965424673 tempest-ServerDiskConfigTestJSON-965424673-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9" status: 404 len: 111 microversion: 2.1 time: 0.034110 Sep 06 11:51:06.105972 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3436/6829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:06 2022] GET /compute/v2.1/servers/d8f4821e-7f2d-4966-9663-220b107ae3f9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:51:18.173707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:18.174502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:18.380935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-071d468f-ebd1-4be5-8f56-0844af0affa4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'create', calling method: .version_select at 0x7f90fd160940>, body: {"keypair": {"name": "tempest-keypair-2082908436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLyoe/rGsF5bi2HtDntRuzWgbLT34MH/1ZqABtPKbtgaFw+QQJt/Hwb4MCc0gqCYowrrkicv+sUj5+nH+rJfw7DLZpj7lQWo/uRSbuPTeOGF6YbOwdRvEZmqsObs1eGhQ=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:18.399763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-071d468f-ebd1-4be5-8f56-0844af0affa4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:51:18.412164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-071d468f-ebd1-4be5-8f56-0844af0affa4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for user 3d09c9d5440c4987a99e81bfed501cb5 and project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:51:18.515232 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-071d468f-ebd1-4be5-8f56-0844af0affa4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.347154 Sep 06 11:51:18.516230 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3394/6830] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:51:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:21.289101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1300475768", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e79a5869-abcd-46ff-bc21-f802fff42f51"}], "security_groups": [{"name": "tempest-securitygroup--302884786"}], "key_name": "tempest-keypair-2082908436", "user_data": "}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:21.304025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:21.304762 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:21.444906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] validate_networks() for [('e79a5869-abcd-46ff-bc21-f802fff42f51', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:51:22.116993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:51:22.117436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:51:22.117928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:51:22.118357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:51:22.118812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:51:22.134123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:22.135004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:22.135885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:22.137078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:22.137863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:22.138645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:22.164154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:51:22.173005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for user 3d09c9d5440c4987a99e81bfed501cb5 and project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:51:22.192174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:51:22.195458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:51:22.344584 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-93ac0411-b24e-4b3a-96ed-7ea59cb2da06 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.064327 Sep 06 11:51:22.345437 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3437/6831] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:51:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:51:22.364550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aff6be80-396a-42d7-ad8e-38dc242791fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:22.365452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aff6be80-396a-42d7-ad8e-38dc242791fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:22.461456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aff6be80-396a-42d7-ad8e-38dc242791fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:22.475831 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aff6be80-396a-42d7-ad8e-38dc242791fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1239 microversion: 2.1 time: 0.118971 Sep 06 11:51:22.476980 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3395/6832] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:22 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1239 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:23.520067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-33b24e41-380b-46d5-ac62-b3230e97f0aa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:23.520067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-33b24e41-380b-46d5-ac62-b3230e97f0aa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:23.525228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33b24e41-380b-46d5-ac62-b3230e97f0aa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:23.525738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33b24e41-380b-46d5-ac62-b3230e97f0aa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:23.526202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33b24e41-380b-46d5-ac62-b3230e97f0aa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:23.526977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33b24e41-380b-46d5-ac62-b3230e97f0aa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:23.527570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33b24e41-380b-46d5-ac62-b3230e97f0aa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:23.528045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-33b24e41-380b-46d5-ac62-b3230e97f0aa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:23.613981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-33b24e41-380b-46d5-ac62-b3230e97f0aa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:23.624496 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-33b24e41-380b-46d5-ac62-b3230e97f0aa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1243 microversion: 2.1 time: 0.113911 Sep 06 11:51:23.625056 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3438/6833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:23 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1243 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:24.647716 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e2cff4f4-90be-4c83-8c67-4fb42e65286f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:24.648335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e2cff4f4-90be-4c83-8c67-4fb42e65286f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:24.655980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2cff4f4-90be-4c83-8c67-4fb42e65286f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:24.656731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2cff4f4-90be-4c83-8c67-4fb42e65286f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:24.657204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2cff4f4-90be-4c83-8c67-4fb42e65286f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:24.657960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2cff4f4-90be-4c83-8c67-4fb42e65286f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:24.658432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2cff4f4-90be-4c83-8c67-4fb42e65286f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:24.658873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e2cff4f4-90be-4c83-8c67-4fb42e65286f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:25.066649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e2cff4f4-90be-4c83-8c67-4fb42e65286f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:25.075343 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e2cff4f4-90be-4c83-8c67-4fb42e65286f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1291 microversion: 2.1 time: 0.431502 Sep 06 11:51:25.076052 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3396/6834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:24 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1291 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:26.107232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bfc3fdf9-cfe2-4e56-99ce-5cbd99f3f537 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:26.108218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bfc3fdf9-cfe2-4e56-99ce-5cbd99f3f537 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:26.115736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfc3fdf9-cfe2-4e56-99ce-5cbd99f3f537 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:26.116245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfc3fdf9-cfe2-4e56-99ce-5cbd99f3f537 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:26.116695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfc3fdf9-cfe2-4e56-99ce-5cbd99f3f537 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:26.117409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfc3fdf9-cfe2-4e56-99ce-5cbd99f3f537 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:26.117882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfc3fdf9-cfe2-4e56-99ce-5cbd99f3f537 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:26.118331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfc3fdf9-cfe2-4e56-99ce-5cbd99f3f537 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:26.253230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bfc3fdf9-cfe2-4e56-99ce-5cbd99f3f537 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:26.261027 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bfc3fdf9-cfe2-4e56-99ce-5cbd99f3f537 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1364 microversion: 2.1 time: 0.157777 Sep 06 11:51:26.261658 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3439/6835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:26 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:26.715536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ca1d3ce7-6d7e-469d-8754-56164d05f24f req-ea157708-694b-4ca9-9ab6-d71609cd9d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ff15a5-802e-40ea-b63d-bf30ea9017a7", "tag": "065bb386-0229-44f4-a412-0f1f6407c369"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:26.725620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ca1d3ce7-6d7e-469d-8754-56164d05f24f req-ea157708-694b-4ca9-9ab6-d71609cd9d1d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:26.726104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ca1d3ce7-6d7e-469d-8754-56164d05f24f req-ea157708-694b-4ca9-9ab6-d71609cd9d1d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:26.726542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ca1d3ce7-6d7e-469d-8754-56164d05f24f req-ea157708-694b-4ca9-9ab6-d71609cd9d1d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:26.738950 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ca1d3ce7-6d7e-469d-8754-56164d05f24f req-ea157708-694b-4ca9-9ab6-d71609cd9d1d service nova] Creating event network-changed:065bb386-0229-44f4-a412-0f1f6407c369 for instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 on nch1-master-1 Sep 06 11:51:26.748019 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ca1d3ce7-6d7e-469d-8754-56164d05f24f req-ea157708-694b-4ca9-9ab6-d71609cd9d1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033005 Sep 06 11:51:26.748019 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3397/6836] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:27.288334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-569b5bd2-bbc2-4cbf-aa1f-28a8bf687695 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:27.289002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-569b5bd2-bbc2-4cbf-aa1f-28a8bf687695 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:27.296260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569b5bd2-bbc2-4cbf-aa1f-28a8bf687695 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:27.296768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569b5bd2-bbc2-4cbf-aa1f-28a8bf687695 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:27.297225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569b5bd2-bbc2-4cbf-aa1f-28a8bf687695 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:27.298491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569b5bd2-bbc2-4cbf-aa1f-28a8bf687695 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:27.298491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569b5bd2-bbc2-4cbf-aa1f-28a8bf687695 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:27.298856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-569b5bd2-bbc2-4cbf-aa1f-28a8bf687695 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:27.458147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-569b5bd2-bbc2-4cbf-aa1f-28a8bf687695 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:27.466669 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-569b5bd2-bbc2-4cbf-aa1f-28a8bf687695 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1364 microversion: 2.1 time: 0.182385 Sep 06 11:51:27.467325 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3440/6837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:27 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:28.493002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4a267b99-2303-4625-8d3c-4fe73ed76c1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:28.493712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4a267b99-2303-4625-8d3c-4fe73ed76c1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:28.500048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a267b99-2303-4625-8d3c-4fe73ed76c1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:28.500538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a267b99-2303-4625-8d3c-4fe73ed76c1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:28.500984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a267b99-2303-4625-8d3c-4fe73ed76c1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:28.501687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a267b99-2303-4625-8d3c-4fe73ed76c1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:28.502152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a267b99-2303-4625-8d3c-4fe73ed76c1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:28.502587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a267b99-2303-4625-8d3c-4fe73ed76c1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:28.635205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4a267b99-2303-4625-8d3c-4fe73ed76c1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:28.643119 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4a267b99-2303-4625-8d3c-4fe73ed76c1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1364 microversion: 2.1 time: 0.155912 Sep 06 11:51:28.644293 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3398/6838] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:28 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:29.667132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-357e71ff-7282-4b9d-b76c-a28333586be7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:29.667801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-357e71ff-7282-4b9d-b76c-a28333586be7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:29.674989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-357e71ff-7282-4b9d-b76c-a28333586be7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:29.675423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-357e71ff-7282-4b9d-b76c-a28333586be7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:29.675686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-357e71ff-7282-4b9d-b76c-a28333586be7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:29.676427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-357e71ff-7282-4b9d-b76c-a28333586be7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:29.676886 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-357e71ff-7282-4b9d-b76c-a28333586be7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:29.677339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-357e71ff-7282-4b9d-b76c-a28333586be7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:29.828220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-357e71ff-7282-4b9d-b76c-a28333586be7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:29.837587 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-357e71ff-7282-4b9d-b76c-a28333586be7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1364 microversion: 2.1 time: 0.174384 Sep 06 11:51:29.838180 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3441/6839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:29 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:30.862046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b13fd65a-f820-4004-bd4b-b26fae35bd5e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:30.863203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b13fd65a-f820-4004-bd4b-b26fae35bd5e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:30.870749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b13fd65a-f820-4004-bd4b-b26fae35bd5e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:30.871267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b13fd65a-f820-4004-bd4b-b26fae35bd5e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:30.871826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b13fd65a-f820-4004-bd4b-b26fae35bd5e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:30.872531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b13fd65a-f820-4004-bd4b-b26fae35bd5e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:30.872994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b13fd65a-f820-4004-bd4b-b26fae35bd5e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:30.873428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b13fd65a-f820-4004-bd4b-b26fae35bd5e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:31.009382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b13fd65a-f820-4004-bd4b-b26fae35bd5e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:31.017539 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b13fd65a-f820-4004-bd4b-b26fae35bd5e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1364 microversion: 2.1 time: 0.159537 Sep 06 11:51:31.018107 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3399/6840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:30 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:31.870643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-c060299f-1ada-4bf3-96a9-51fc4fadf644 req-dfe6f34b-3e3f-410e-a861-de6e5156dfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ff15a5-802e-40ea-b63d-bf30ea9017a7", "name": "network-vif-plugged", "status": "completed", "tag": "065bb386-0229-44f4-a412-0f1f6407c369"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:31.885005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c060299f-1ada-4bf3-96a9-51fc4fadf644 req-dfe6f34b-3e3f-410e-a861-de6e5156dfb7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:31.885537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c060299f-1ada-4bf3-96a9-51fc4fadf644 req-dfe6f34b-3e3f-410e-a861-de6e5156dfb7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:31.885994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c060299f-1ada-4bf3-96a9-51fc4fadf644 req-dfe6f34b-3e3f-410e-a861-de6e5156dfb7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:31.901037 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-c060299f-1ada-4bf3-96a9-51fc4fadf644 req-dfe6f34b-3e3f-410e-a861-de6e5156dfb7 service nova] Creating event network-vif-plugged:065bb386-0229-44f4-a412-0f1f6407c369 for instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 on nch1-master-1 Sep 06 11:51:31.911557 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-c060299f-1ada-4bf3-96a9-51fc4fadf644 req-dfe6f34b-3e3f-410e-a861-de6e5156dfb7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044722 Sep 06 11:51:31.912176 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3442/6841] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:51:32.044702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8a634e80-bd61-4250-a337-36cf174c9985 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:32.045840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8a634e80-bd61-4250-a337-36cf174c9985 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:32.058164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a634e80-bd61-4250-a337-36cf174c9985 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:32.059201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a634e80-bd61-4250-a337-36cf174c9985 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:32.060349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a634e80-bd61-4250-a337-36cf174c9985 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:32.061645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a634e80-bd61-4250-a337-36cf174c9985 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:32.062585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a634e80-bd61-4250-a337-36cf174c9985 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:32.063529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8a634e80-bd61-4250-a337-36cf174c9985 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:32.200586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8a634e80-bd61-4250-a337-36cf174c9985 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:32.208859 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8a634e80-bd61-4250-a337-36cf174c9985 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1364 microversion: 2.1 time: 0.171094 Sep 06 11:51:32.209455 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3400/6842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:32 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:33.232060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:33.232817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:33.238116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aa740c75-6d10-4c89-8f69-9bac35a97b66 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:33.238899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aa740c75-6d10-4c89-8f69-9bac35a97b66 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:33.245979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa740c75-6d10-4c89-8f69-9bac35a97b66 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:33.246599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa740c75-6d10-4c89-8f69-9bac35a97b66 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:33.247089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa740c75-6d10-4c89-8f69-9bac35a97b66 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:33.247825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa740c75-6d10-4c89-8f69-9bac35a97b66 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:33.248297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa740c75-6d10-4c89-8f69-9bac35a97b66 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:33.248742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa740c75-6d10-4c89-8f69-9bac35a97b66 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:33.683099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aa740c75-6d10-4c89-8f69-9bac35a97b66 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:33.691323 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aa740c75-6d10-4c89-8f69-9bac35a97b66 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1364 microversion: 2.1 time: 0.460364 Sep 06 11:51:33.691925 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3443/6843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:33 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1364 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:34.714940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-df46f733-fb42-4cc0-97f3-7f4144cfe97f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:34.716171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-df46f733-fb42-4cc0-97f3-7f4144cfe97f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:34.718452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:34.724937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df46f733-fb42-4cc0-97f3-7f4144cfe97f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:34.725457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df46f733-fb42-4cc0-97f3-7f4144cfe97f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:34.725904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df46f733-fb42-4cc0-97f3-7f4144cfe97f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:34.726607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df46f733-fb42-4cc0-97f3-7f4144cfe97f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:34.727102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df46f733-fb42-4cc0-97f3-7f4144cfe97f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:34.727543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df46f733-fb42-4cc0-97f3-7f4144cfe97f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:34.871905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-df46f733-fb42-4cc0-97f3-7f4144cfe97f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:34.880692 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-df46f733-fb42-4cc0-97f3-7f4144cfe97f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1550 microversion: 2.1 time: 0.169600 Sep 06 11:51:34.887969 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3401/6844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:34 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:34.907201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a0e04cbe-f676-4090-bb57-f1b4f1e069ca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:34.907736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a0e04cbe-f676-4090-bb57-f1b4f1e069ca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:34.915592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0e04cbe-f676-4090-bb57-f1b4f1e069ca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:34.916033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0e04cbe-f676-4090-bb57-f1b4f1e069ca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:34.916492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0e04cbe-f676-4090-bb57-f1b4f1e069ca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:34.917216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0e04cbe-f676-4090-bb57-f1b4f1e069ca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:34.917686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0e04cbe-f676-4090-bb57-f1b4f1e069ca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:34.918129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0e04cbe-f676-4090-bb57-f1b4f1e069ca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:35.008809 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a0e04cbe-f676-4090-bb57-f1b4f1e069ca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105820 Sep 06 11:51:35.009410 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3444/6845] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:51:34 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:36.363295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-edf1eb35-2a39-43aa-9657-ff587fb40730 req-b38a59ce-b55e-4281-98b9-06dc373ddd1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ff15a5-802e-40ea-b63d-bf30ea9017a7", "tag": "065bb386-0229-44f4-a412-0f1f6407c369"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:36.374972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-edf1eb35-2a39-43aa-9657-ff587fb40730 req-b38a59ce-b55e-4281-98b9-06dc373ddd1d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:36.375488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-edf1eb35-2a39-43aa-9657-ff587fb40730 req-b38a59ce-b55e-4281-98b9-06dc373ddd1d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:36.375938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-edf1eb35-2a39-43aa-9657-ff587fb40730 req-b38a59ce-b55e-4281-98b9-06dc373ddd1d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:36.392039 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-edf1eb35-2a39-43aa-9657-ff587fb40730 req-b38a59ce-b55e-4281-98b9-06dc373ddd1d service nova] Creating event network-changed:065bb386-0229-44f4-a412-0f1f6407c369 for instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 on nch1-master-1 Sep 06 11:51:36.397427 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-edf1eb35-2a39-43aa-9657-ff587fb40730 req-b38a59ce-b55e-4281-98b9-06dc373ddd1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037872 Sep 06 11:51:36.398396 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3402/6846] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:52:10.605796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:10.607161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=38 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:10.611436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-13ca88ea-fc84-46a0-b197-bc34dc3c8909 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:10.612655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-13ca88ea-fc84-46a0-b197-bc34dc3c8909 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:10.623022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13ca88ea-fc84-46a0-b197-bc34dc3c8909 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:10.625657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13ca88ea-fc84-46a0-b197-bc34dc3c8909 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:10.625657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13ca88ea-fc84-46a0-b197-bc34dc3c8909 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:10.625657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13ca88ea-fc84-46a0-b197-bc34dc3c8909 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:10.625657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13ca88ea-fc84-46a0-b197-bc34dc3c8909 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:10.625657 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-13ca88ea-fc84-46a0-b197-bc34dc3c8909 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:10.806321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-13ca88ea-fc84-46a0-b197-bc34dc3c8909 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:10.818615 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-13ca88ea-fc84-46a0-b197-bc34dc3c8909 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1669 microversion: 2.1 time: 0.214713 Sep 06 11:52:10.826419 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3445/6847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:10 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1669 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:10.842500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:10.844255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=34 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:10.850076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c3dd3f2a-c886-4c9b-a481-ab28b8cd1cda tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:10.850829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c3dd3f2a-c886-4c9b-a481-ab28b8cd1cda tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:10.862661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3dd3f2a-c886-4c9b-a481-ab28b8cd1cda tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:10.862661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3dd3f2a-c886-4c9b-a481-ab28b8cd1cda tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:10.862661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3dd3f2a-c886-4c9b-a481-ab28b8cd1cda tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:10.862661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3dd3f2a-c886-4c9b-a481-ab28b8cd1cda tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:10.862661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3dd3f2a-c886-4c9b-a481-ab28b8cd1cda tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:10.862661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c3dd3f2a-c886-4c9b-a481-ab28b8cd1cda tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:11.034660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c3dd3f2a-c886-4c9b-a481-ab28b8cd1cda tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:11.043425 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c3dd3f2a-c886-4c9b-a481-ab28b8cd1cda tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1669 microversion: 2.1 time: 0.203238 Sep 06 11:52:11.044166 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3403/6848] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:10 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1669 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:11.067365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-426db456-34f5-4e44-9bd5-d71304aab0e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:11.072361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-426db456-34f5-4e44-9bd5-d71304aab0e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:11.074864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-426db456-34f5-4e44-9bd5-d71304aab0e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:11.075416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-426db456-34f5-4e44-9bd5-d71304aab0e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:11.075885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-426db456-34f5-4e44-9bd5-d71304aab0e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:11.076642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-426db456-34f5-4e44-9bd5-d71304aab0e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:11.077160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-426db456-34f5-4e44-9bd5-d71304aab0e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:11.077832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-426db456-34f5-4e44-9bd5-d71304aab0e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:11.244536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-426db456-34f5-4e44-9bd5-d71304aab0e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:11.255282 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-426db456-34f5-4e44-9bd5-d71304aab0e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1669 microversion: 2.1 time: 0.192265 Sep 06 11:52:11.255887 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3446/6849] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:11 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1669 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:11.282062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:11.284995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:11.292471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:11.293011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:11.293581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:11.294333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:11.294865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:11.295384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:11.336505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:11.346068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Old instance type m1.heat2, new instance type m1.heat {{(pid=140875) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:52:11.357339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:52:11.358108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:52:11.358877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:52:11.359534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:52:11.360300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:52:11.628461 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4e83190d-b831-4bda-97f5-1952eb9f60ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7/action" status: 202 len: 0 microversion: 2.1 time: 0.351883 Sep 06 11:52:11.629200 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3404/6850] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:52:11 2022] POST /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:52:11.640547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a80a8025-7a12-4fa3-9207-41cd4a279a54 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:11.641412 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a80a8025-7a12-4fa3-9207-41cd4a279a54 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:11.655186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80a8025-7a12-4fa3-9207-41cd4a279a54 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:11.656087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80a8025-7a12-4fa3-9207-41cd4a279a54 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:11.657290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80a8025-7a12-4fa3-9207-41cd4a279a54 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:11.658600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80a8025-7a12-4fa3-9207-41cd4a279a54 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:11.659532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80a8025-7a12-4fa3-9207-41cd4a279a54 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:11.660348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a80a8025-7a12-4fa3-9207-41cd4a279a54 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:11.816010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a80a8025-7a12-4fa3-9207-41cd4a279a54 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:11.826491 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a80a8025-7a12-4fa3-9207-41cd4a279a54 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1678 microversion: 2.1 time: 0.191637 Sep 06 11:52:11.827395 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3447/6851] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:11 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:12.858602 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d9836802-3d82-4ddd-aff6-402b76003af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:12.859272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d9836802-3d82-4ddd-aff6-402b76003af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:12.868108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9836802-3d82-4ddd-aff6-402b76003af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:12.868974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9836802-3d82-4ddd-aff6-402b76003af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:12.869647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9836802-3d82-4ddd-aff6-402b76003af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:12.870921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9836802-3d82-4ddd-aff6-402b76003af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:12.871674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9836802-3d82-4ddd-aff6-402b76003af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:12.872309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9836802-3d82-4ddd-aff6-402b76003af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:13.073575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d9836802-3d82-4ddd-aff6-402b76003af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:13.089684 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d9836802-3d82-4ddd-aff6-402b76003af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1678 microversion: 2.1 time: 0.235536 Sep 06 11:52:13.090688 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3405/6852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:12 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:14.130179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0587671d-8152-44dc-a856-3f51255b3e16 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:14.130930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0587671d-8152-44dc-a856-3f51255b3e16 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:14.137671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0587671d-8152-44dc-a856-3f51255b3e16 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:14.138235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0587671d-8152-44dc-a856-3f51255b3e16 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:14.138736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0587671d-8152-44dc-a856-3f51255b3e16 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:14.139527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0587671d-8152-44dc-a856-3f51255b3e16 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:14.140058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0587671d-8152-44dc-a856-3f51255b3e16 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:14.140524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0587671d-8152-44dc-a856-3f51255b3e16 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:14.312529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0587671d-8152-44dc-a856-3f51255b3e16 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:14.330323 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0587671d-8152-44dc-a856-3f51255b3e16 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1678 microversion: 2.1 time: 0.205536 Sep 06 11:52:14.331829 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3448/6853] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:14 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:15.373157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f72d063e-4790-4636-bfa9-ae343c8e000a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:15.374207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f72d063e-4790-4636-bfa9-ae343c8e000a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:15.385469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f72d063e-4790-4636-bfa9-ae343c8e000a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:15.386319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f72d063e-4790-4636-bfa9-ae343c8e000a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:15.387154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f72d063e-4790-4636-bfa9-ae343c8e000a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:15.388426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f72d063e-4790-4636-bfa9-ae343c8e000a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:15.389288 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f72d063e-4790-4636-bfa9-ae343c8e000a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:15.389896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f72d063e-4790-4636-bfa9-ae343c8e000a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:15.557514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f72d063e-4790-4636-bfa9-ae343c8e000a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:15.569231 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f72d063e-4790-4636-bfa9-ae343c8e000a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1683 microversion: 2.1 time: 0.202457 Sep 06 11:52:15.570242 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3406/6854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:15 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1683 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:16.602164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-980fee0c-4a33-4d01-ad51-5d7e118b701b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:16.602780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-980fee0c-4a33-4d01-ad51-5d7e118b701b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:16.614397 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-980fee0c-4a33-4d01-ad51-5d7e118b701b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:16.615289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-980fee0c-4a33-4d01-ad51-5d7e118b701b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:16.616069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-980fee0c-4a33-4d01-ad51-5d7e118b701b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:16.617405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-980fee0c-4a33-4d01-ad51-5d7e118b701b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:16.618081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-980fee0c-4a33-4d01-ad51-5d7e118b701b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:16.618782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-980fee0c-4a33-4d01-ad51-5d7e118b701b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:16.768733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-980fee0c-4a33-4d01-ad51-5d7e118b701b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:16.778222 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-980fee0c-4a33-4d01-ad51-5d7e118b701b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1683 microversion: 2.1 time: 0.179933 Sep 06 11:52:16.778865 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3449/6855] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:16 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:17.817321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-eff24dc3-3d3a-4cb6-a033-d668888ae297 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:17.818292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-eff24dc3-3d3a-4cb6-a033-d668888ae297 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:17.825760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eff24dc3-3d3a-4cb6-a033-d668888ae297 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:17.826372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eff24dc3-3d3a-4cb6-a033-d668888ae297 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:17.827154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eff24dc3-3d3a-4cb6-a033-d668888ae297 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:17.828009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eff24dc3-3d3a-4cb6-a033-d668888ae297 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:17.828604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eff24dc3-3d3a-4cb6-a033-d668888ae297 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:17.829078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-eff24dc3-3d3a-4cb6-a033-d668888ae297 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:18.003318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-eff24dc3-3d3a-4cb6-a033-d668888ae297 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:18.014528 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-eff24dc3-3d3a-4cb6-a033-d668888ae297 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1683 microversion: 2.1 time: 0.203756 Sep 06 11:52:18.015214 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3407/6856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:17 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1683 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:19.040423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d84ab7e2-0326-4f04-b824-41a35612a743 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:19.041036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d84ab7e2-0326-4f04-b824-41a35612a743 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:19.048267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d84ab7e2-0326-4f04-b824-41a35612a743 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:19.048899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d84ab7e2-0326-4f04-b824-41a35612a743 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:19.050050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d84ab7e2-0326-4f04-b824-41a35612a743 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:19.050885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d84ab7e2-0326-4f04-b824-41a35612a743 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:19.051506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d84ab7e2-0326-4f04-b824-41a35612a743 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:19.052245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d84ab7e2-0326-4f04-b824-41a35612a743 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:19.211705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d84ab7e2-0326-4f04-b824-41a35612a743 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:19.226893 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d84ab7e2-0326-4f04-b824-41a35612a743 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1683 microversion: 2.1 time: 0.190502 Sep 06 11:52:19.227520 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3450/6857] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:19 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:20.255081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-985b4da9-d0b8-485f-95dc-a981c043e134 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:20.256000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-985b4da9-d0b8-485f-95dc-a981c043e134 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:20.262346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-985b4da9-d0b8-485f-95dc-a981c043e134 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:20.262999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-985b4da9-d0b8-485f-95dc-a981c043e134 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:20.263461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-985b4da9-d0b8-485f-95dc-a981c043e134 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:20.264259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-985b4da9-d0b8-485f-95dc-a981c043e134 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:20.264728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-985b4da9-d0b8-485f-95dc-a981c043e134 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:20.265160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-985b4da9-d0b8-485f-95dc-a981c043e134 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:20.425187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-985b4da9-d0b8-485f-95dc-a981c043e134 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:20.434261 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-985b4da9-d0b8-485f-95dc-a981c043e134 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1683 microversion: 2.1 time: 0.186530 Sep 06 11:52:20.434877 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3408/6858] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:20 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:21.460160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-12c0082f-7631-4147-9667-b411d47da370 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:21.460843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-12c0082f-7631-4147-9667-b411d47da370 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:21.468501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12c0082f-7631-4147-9667-b411d47da370 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:21.468907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12c0082f-7631-4147-9667-b411d47da370 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:21.469365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12c0082f-7631-4147-9667-b411d47da370 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:21.470106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12c0082f-7631-4147-9667-b411d47da370 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:21.470584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12c0082f-7631-4147-9667-b411d47da370 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:21.471089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12c0082f-7631-4147-9667-b411d47da370 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:21.627501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-12c0082f-7631-4147-9667-b411d47da370 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:21.642401 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-12c0082f-7631-4147-9667-b411d47da370 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1683 microversion: 2.1 time: 0.186636 Sep 06 11:52:21.643799 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3451/6859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:21 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:22.681647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e89f5dac-18d8-40a7-91d1-02b5e352a216 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:22.682585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e89f5dac-18d8-40a7-91d1-02b5e352a216 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:22.691409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e89f5dac-18d8-40a7-91d1-02b5e352a216 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:22.691895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e89f5dac-18d8-40a7-91d1-02b5e352a216 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:22.692336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e89f5dac-18d8-40a7-91d1-02b5e352a216 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:22.693045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e89f5dac-18d8-40a7-91d1-02b5e352a216 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:22.693506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e89f5dac-18d8-40a7-91d1-02b5e352a216 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:22.694053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e89f5dac-18d8-40a7-91d1-02b5e352a216 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:22.853157 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e89f5dac-18d8-40a7-91d1-02b5e352a216 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:22.867200 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e89f5dac-18d8-40a7-91d1-02b5e352a216 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1683 microversion: 2.1 time: 0.191198 Sep 06 11:52:22.868109 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3409/6860] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:22 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1683 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:23.895910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-518119dc-bda0-4e56-9e45-47d1396bf6c1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:23.896771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-518119dc-bda0-4e56-9e45-47d1396bf6c1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:23.906024 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-518119dc-bda0-4e56-9e45-47d1396bf6c1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:23.906783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-518119dc-bda0-4e56-9e45-47d1396bf6c1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:23.907356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-518119dc-bda0-4e56-9e45-47d1396bf6c1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:23.908109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-518119dc-bda0-4e56-9e45-47d1396bf6c1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:23.909198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-518119dc-bda0-4e56-9e45-47d1396bf6c1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:23.909648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-518119dc-bda0-4e56-9e45-47d1396bf6c1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:24.081680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-518119dc-bda0-4e56-9e45-47d1396bf6c1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:24.090210 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-518119dc-bda0-4e56-9e45-47d1396bf6c1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1683 microversion: 2.1 time: 0.200132 Sep 06 11:52:24.090860 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3452/6861] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:23 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1683 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:25.115714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-121b13f6-bca3-4cbb-be2d-7baa71f1d211 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:25.116539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-121b13f6-bca3-4cbb-be2d-7baa71f1d211 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:25.124627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-121b13f6-bca3-4cbb-be2d-7baa71f1d211 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:25.125123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-121b13f6-bca3-4cbb-be2d-7baa71f1d211 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:25.125579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-121b13f6-bca3-4cbb-be2d-7baa71f1d211 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:25.126299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-121b13f6-bca3-4cbb-be2d-7baa71f1d211 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:25.126765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-121b13f6-bca3-4cbb-be2d-7baa71f1d211 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:25.127267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-121b13f6-bca3-4cbb-be2d-7baa71f1d211 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:25.292648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-121b13f6-bca3-4cbb-be2d-7baa71f1d211 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:25.301983 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-121b13f6-bca3-4cbb-be2d-7baa71f1d211 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1683 microversion: 2.1 time: 0.190873 Sep 06 11:52:25.302584 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3410/6862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:25 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:26.327339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-558fd411-7977-4959-bee0-33674049205c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:26.327984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-558fd411-7977-4959-bee0-33674049205c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:26.335913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-558fd411-7977-4959-bee0-33674049205c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:26.336432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-558fd411-7977-4959-bee0-33674049205c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:26.336897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-558fd411-7977-4959-bee0-33674049205c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:26.337630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-558fd411-7977-4959-bee0-33674049205c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:26.338105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-558fd411-7977-4959-bee0-33674049205c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:26.338558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-558fd411-7977-4959-bee0-33674049205c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:26.497241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-558fd411-7977-4959-bee0-33674049205c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:26.505496 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-558fd411-7977-4959-bee0-33674049205c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1683 microversion: 2.1 time: 0.182172 Sep 06 11:52:26.506105 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3453/6863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:26 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:27.530296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8d474e4d-1158-44a4-b619-8968c789b472 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:27.531218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8d474e4d-1158-44a4-b619-8968c789b472 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:27.538880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d474e4d-1158-44a4-b619-8968c789b472 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:27.539424 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d474e4d-1158-44a4-b619-8968c789b472 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:27.539873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d474e4d-1158-44a4-b619-8968c789b472 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:27.540586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d474e4d-1158-44a4-b619-8968c789b472 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:27.541050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d474e4d-1158-44a4-b619-8968c789b472 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:27.541488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8d474e4d-1158-44a4-b619-8968c789b472 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:27.690547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8d474e4d-1158-44a4-b619-8968c789b472 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:27.699567 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8d474e4d-1158-44a4-b619-8968c789b472 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1682 microversion: 2.1 time: 0.172961 Sep 06 11:52:27.700180 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3411/6864] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:27 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:28.145375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-8aac5fdd-181e-41e5-9aa2-ced216714825 req-79a5682a-ec51-4a8d-9312-a244319bb6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ff15a5-802e-40ea-b63d-bf30ea9017a7", "name": "network-vif-unplugged", "status": "completed", "tag": "065bb386-0229-44f4-a412-0f1f6407c369"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:28.156505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8aac5fdd-181e-41e5-9aa2-ced216714825 req-79a5682a-ec51-4a8d-9312-a244319bb6b2 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:28.157399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8aac5fdd-181e-41e5-9aa2-ced216714825 req-79a5682a-ec51-4a8d-9312-a244319bb6b2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:28.157867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-8aac5fdd-181e-41e5-9aa2-ced216714825 req-79a5682a-ec51-4a8d-9312-a244319bb6b2 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:28.170396 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-8aac5fdd-181e-41e5-9aa2-ced216714825 req-79a5682a-ec51-4a8d-9312-a244319bb6b2 service nova] Creating event network-vif-unplugged:065bb386-0229-44f4-a412-0f1f6407c369 for instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 on nch2-master-1 Sep 06 11:52:28.175943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-8aac5fdd-181e-41e5-9aa2-ced216714825 req-79a5682a-ec51-4a8d-9312-a244319bb6b2 service nova] Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:52:28.187403 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-8aac5fdd-181e-41e5-9aa2-ced216714825 req-79a5682a-ec51-4a8d-9312-a244319bb6b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046321 Sep 06 11:52:28.188029 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3454/6865] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:52:28.725759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fc962275-a5c0-41a7-8c35-a416561ad09c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:28.726618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fc962275-a5c0-41a7-8c35-a416561ad09c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:28.733658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc962275-a5c0-41a7-8c35-a416561ad09c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:28.734154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc962275-a5c0-41a7-8c35-a416561ad09c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:28.734668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc962275-a5c0-41a7-8c35-a416561ad09c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:28.735421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc962275-a5c0-41a7-8c35-a416561ad09c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:28.735901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc962275-a5c0-41a7-8c35-a416561ad09c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:28.736858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc962275-a5c0-41a7-8c35-a416561ad09c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:28.874805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fc962275-a5c0-41a7-8c35-a416561ad09c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:28.896751 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fc962275-a5c0-41a7-8c35-a416561ad09c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1682 microversion: 2.1 time: 0.162630 Sep 06 11:52:28.896751 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3412/6866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:28 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:29.912391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dbb8009e-e9e9-40fb-97be-7d717360fadf tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:29.914082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dbb8009e-e9e9-40fb-97be-7d717360fadf tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:29.922258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbb8009e-e9e9-40fb-97be-7d717360fadf tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:29.923208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbb8009e-e9e9-40fb-97be-7d717360fadf tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:29.923967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbb8009e-e9e9-40fb-97be-7d717360fadf tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:29.925194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbb8009e-e9e9-40fb-97be-7d717360fadf tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:29.925895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbb8009e-e9e9-40fb-97be-7d717360fadf tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:29.926476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dbb8009e-e9e9-40fb-97be-7d717360fadf tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:30.088527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dbb8009e-e9e9-40fb-97be-7d717360fadf tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:30.098878 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dbb8009e-e9e9-40fb-97be-7d717360fadf tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1680 microversion: 2.1 time: 0.193950 Sep 06 11:52:30.099577 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3455/6867] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:29 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1680 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:30.204041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ad68c808-d5bb-450f-aee3-0c9626040434 req-db25e826-197c-4d9e-8ba2-aa2c3b82d08e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ff15a5-802e-40ea-b63d-bf30ea9017a7", "tag": "065bb386-0229-44f4-a412-0f1f6407c369"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:30.214697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ad68c808-d5bb-450f-aee3-0c9626040434 req-db25e826-197c-4d9e-8ba2-aa2c3b82d08e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:30.215216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ad68c808-d5bb-450f-aee3-0c9626040434 req-db25e826-197c-4d9e-8ba2-aa2c3b82d08e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:30.215665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ad68c808-d5bb-450f-aee3-0c9626040434 req-db25e826-197c-4d9e-8ba2-aa2c3b82d08e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:30.229668 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ad68c808-d5bb-450f-aee3-0c9626040434 req-db25e826-197c-4d9e-8ba2-aa2c3b82d08e service nova] Creating event network-changed:065bb386-0229-44f4-a412-0f1f6407c369 for instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 on nch2-master-1 Sep 06 11:52:30.236062 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-ad68c808-d5bb-450f-aee3-0c9626040434 req-db25e826-197c-4d9e-8ba2-aa2c3b82d08e service nova] Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:52:30.248114 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ad68c808-d5bb-450f-aee3-0c9626040434 req-db25e826-197c-4d9e-8ba2-aa2c3b82d08e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048574 Sep 06 11:52:30.248737 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3413/6868] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:52:31.123594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-891b5cbe-e284-4a66-85dc-16fa304dc4d2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:31.124228 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-891b5cbe-e284-4a66-85dc-16fa304dc4d2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:31.131676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-891b5cbe-e284-4a66-85dc-16fa304dc4d2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:31.132186 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-891b5cbe-e284-4a66-85dc-16fa304dc4d2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:31.132659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-891b5cbe-e284-4a66-85dc-16fa304dc4d2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:31.133373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-891b5cbe-e284-4a66-85dc-16fa304dc4d2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:31.133851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-891b5cbe-e284-4a66-85dc-16fa304dc4d2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:31.134383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-891b5cbe-e284-4a66-85dc-16fa304dc4d2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:31.296838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-891b5cbe-e284-4a66-85dc-16fa304dc4d2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:31.305625 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-891b5cbe-e284-4a66-85dc-16fa304dc4d2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1680 microversion: 2.1 time: 0.186022 Sep 06 11:52:31.306233 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3456/6869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:31 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:32.331502 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fbb15c77-6356-46cd-a54e-f1db92dea582 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:32.332415 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fbb15c77-6356-46cd-a54e-f1db92dea582 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:32.340887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbb15c77-6356-46cd-a54e-f1db92dea582 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:32.341436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbb15c77-6356-46cd-a54e-f1db92dea582 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:32.342121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbb15c77-6356-46cd-a54e-f1db92dea582 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:32.343245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbb15c77-6356-46cd-a54e-f1db92dea582 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:32.343771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbb15c77-6356-46cd-a54e-f1db92dea582 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:32.344226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fbb15c77-6356-46cd-a54e-f1db92dea582 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:32.488570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fbb15c77-6356-46cd-a54e-f1db92dea582 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:32.499073 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fbb15c77-6356-46cd-a54e-f1db92dea582 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1677 microversion: 2.1 time: 0.173471 Sep 06 11:52:32.499687 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3414/6870] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:32 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:32.523071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b1ed64d6-33d7-48a6-8bf8-e01b6a888f3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:32.523695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b1ed64d6-33d7-48a6-8bf8-e01b6a888f3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:32.531068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1ed64d6-33d7-48a6-8bf8-e01b6a888f3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:32.531848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1ed64d6-33d7-48a6-8bf8-e01b6a888f3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:32.532307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1ed64d6-33d7-48a6-8bf8-e01b6a888f3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:32.533036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1ed64d6-33d7-48a6-8bf8-e01b6a888f3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:32.533522 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1ed64d6-33d7-48a6-8bf8-e01b6a888f3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:32.534009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b1ed64d6-33d7-48a6-8bf8-e01b6a888f3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:32.837319 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b1ed64d6-33d7-48a6-8bf8-e01b6a888f3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7/action" status: 204 len: 0 microversion: 2.1 time: 0.318282 Sep 06 11:52:32.838035 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3457/6871] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:52:32 2022] POST /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7/action => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:52:32.848058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dc1e760a-e36d-48f8-a36d-b6ac8b91a67f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:32.849091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dc1e760a-e36d-48f8-a36d-b6ac8b91a67f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:32.857154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc1e760a-e36d-48f8-a36d-b6ac8b91a67f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:32.857664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc1e760a-e36d-48f8-a36d-b6ac8b91a67f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:32.858118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc1e760a-e36d-48f8-a36d-b6ac8b91a67f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:32.858851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc1e760a-e36d-48f8-a36d-b6ac8b91a67f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:32.859349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc1e760a-e36d-48f8-a36d-b6ac8b91a67f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:32.859981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc1e760a-e36d-48f8-a36d-b6ac8b91a67f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:33.050305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dc1e760a-e36d-48f8-a36d-b6ac8b91a67f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:33.063682 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dc1e760a-e36d-48f8-a36d-b6ac8b91a67f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1677 microversion: 2.1 time: 0.220843 Sep 06 11:52:33.064315 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3415/6872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:32 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:34.101055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b3405f64-8216-4cea-9c01-32b73fb73bbd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:34.101055 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b3405f64-8216-4cea-9c01-32b73fb73bbd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:34.106200 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3405f64-8216-4cea-9c01-32b73fb73bbd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:34.106717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3405f64-8216-4cea-9c01-32b73fb73bbd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:34.107220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3405f64-8216-4cea-9c01-32b73fb73bbd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:34.108119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3405f64-8216-4cea-9c01-32b73fb73bbd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:34.108451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3405f64-8216-4cea-9c01-32b73fb73bbd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:34.108905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b3405f64-8216-4cea-9c01-32b73fb73bbd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:34.288360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b3405f64-8216-4cea-9c01-32b73fb73bbd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:34.298803 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b3405f64-8216-4cea-9c01-32b73fb73bbd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1677 microversion: 2.1 time: 0.206048 Sep 06 11:52:34.300236 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3458/6873] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:34 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:35.325192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3ef45f95-0184-496d-9d2f-cadec77374e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:35.325938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3ef45f95-0184-496d-9d2f-cadec77374e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:35.333188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ef45f95-0184-496d-9d2f-cadec77374e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:35.333689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ef45f95-0184-496d-9d2f-cadec77374e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:35.334139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ef45f95-0184-496d-9d2f-cadec77374e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:35.334855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ef45f95-0184-496d-9d2f-cadec77374e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:35.335352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ef45f95-0184-496d-9d2f-cadec77374e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:35.335806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ef45f95-0184-496d-9d2f-cadec77374e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:35.484147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3ef45f95-0184-496d-9d2f-cadec77374e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:35.493639 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3ef45f95-0184-496d-9d2f-cadec77374e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1669 microversion: 2.1 time: 0.172289 Sep 06 11:52:35.494249 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3416/6874] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:35 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1669 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:35.519983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-01963732-b96d-4de9-a58b-7d1261265fd2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:35.520615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-01963732-b96d-4de9-a58b-7d1261265fd2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:35.529527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01963732-b96d-4de9-a58b-7d1261265fd2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:35.530034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01963732-b96d-4de9-a58b-7d1261265fd2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:35.530496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01963732-b96d-4de9-a58b-7d1261265fd2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:35.531259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01963732-b96d-4de9-a58b-7d1261265fd2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:35.532014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01963732-b96d-4de9-a58b-7d1261265fd2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:35.532462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-01963732-b96d-4de9-a58b-7d1261265fd2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:35.677191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-01963732-b96d-4de9-a58b-7d1261265fd2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:35.685862 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-01963732-b96d-4de9-a58b-7d1261265fd2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1669 microversion: 2.1 time: 0.170648 Sep 06 11:52:35.686466 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3459/6875] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:35 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:35.710748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-70b915a4-de1c-4c08-89f7-26fb5b83f73b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:35.711411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-70b915a4-de1c-4c08-89f7-26fb5b83f73b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:35.717786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-70b915a4-de1c-4c08-89f7-26fb5b83f73b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:35.718291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-70b915a4-de1c-4c08-89f7-26fb5b83f73b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:35.718746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-70b915a4-de1c-4c08-89f7-26fb5b83f73b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:35.719512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-70b915a4-de1c-4c08-89f7-26fb5b83f73b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:35.719990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-70b915a4-de1c-4c08-89f7-26fb5b83f73b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:35.720422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-70b915a4-de1c-4c08-89f7-26fb5b83f73b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:35.873861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-cec94a43-6e07-4fa0-a4bc-d42534cc873a req-001536b8-15b4-4692-820a-6c4d72ecece4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ff15a5-802e-40ea-b63d-bf30ea9017a7", "name": "network-vif-plugged", "status": "completed", "tag": "065bb386-0229-44f4-a412-0f1f6407c369"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:35.886223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cec94a43-6e07-4fa0-a4bc-d42534cc873a req-001536b8-15b4-4692-820a-6c4d72ecece4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:35.886767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cec94a43-6e07-4fa0-a4bc-d42534cc873a req-001536b8-15b4-4692-820a-6c4d72ecece4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:35.887262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-cec94a43-6e07-4fa0-a4bc-d42534cc873a req-001536b8-15b4-4692-820a-6c4d72ecece4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:35.888355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-70b915a4-de1c-4c08-89f7-26fb5b83f73b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:35.897227 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-70b915a4-de1c-4c08-89f7-26fb5b83f73b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1669 microversion: 2.1 time: 0.190467 Sep 06 11:52:35.897830 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3417/6876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:35 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1669 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:35.901593 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-cec94a43-6e07-4fa0-a4bc-d42534cc873a req-001536b8-15b4-4692-820a-6c4d72ecece4 service nova] Creating event network-vif-plugged:065bb386-0229-44f4-a412-0f1f6407c369 for instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 on nch2-master-1 Sep 06 11:52:35.907245 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-cec94a43-6e07-4fa0-a4bc-d42534cc873a req-001536b8-15b4-4692-820a-6c4d72ecece4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038223 Sep 06 11:52:35.908039 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3460/6877] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:52:35.921426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2af54f11-a7df-46aa-a6ad-db7512e8f42e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:35.921952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2af54f11-a7df-46aa-a6ad-db7512e8f42e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:35.928726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2af54f11-a7df-46aa-a6ad-db7512e8f42e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:35.929224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2af54f11-a7df-46aa-a6ad-db7512e8f42e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:35.929672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2af54f11-a7df-46aa-a6ad-db7512e8f42e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:35.930405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2af54f11-a7df-46aa-a6ad-db7512e8f42e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:35.930973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2af54f11-a7df-46aa-a6ad-db7512e8f42e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:35.931440 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2af54f11-a7df-46aa-a6ad-db7512e8f42e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:35.953562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:35.960902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2af54f11-a7df-46aa-a6ad-db7512e8f42e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:52:36.244495 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2af54f11-a7df-46aa-a6ad-db7512e8f42e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 204 len: 0 microversion: 2.1 time: 0.326790 Sep 06 11:52:36.245071 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3418/6878] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:52:35 2022] DELETE /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:52:36.254647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aeedef3a-a630-4eb9-bccb-2e4bb44e97ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:36.255466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aeedef3a-a630-4eb9-bccb-2e4bb44e97ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:36.262006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aeedef3a-a630-4eb9-bccb-2e4bb44e97ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:36.262518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aeedef3a-a630-4eb9-bccb-2e4bb44e97ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:36.262980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aeedef3a-a630-4eb9-bccb-2e4bb44e97ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:36.263736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aeedef3a-a630-4eb9-bccb-2e4bb44e97ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:36.264218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aeedef3a-a630-4eb9-bccb-2e4bb44e97ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:36.264667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aeedef3a-a630-4eb9-bccb-2e4bb44e97ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:36.281985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:36.410806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aeedef3a-a630-4eb9-bccb-2e4bb44e97ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:36.418682 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aeedef3a-a630-4eb9-bccb-2e4bb44e97ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1675 microversion: 2.1 time: 0.168975 Sep 06 11:52:36.419275 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3461/6879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:36 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:37.444897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b42173a9-1cbc-48e1-8ec7-ef8ecef2ab0a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:37.445616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b42173a9-1cbc-48e1-8ec7-ef8ecef2ab0a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:37.453903 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b42173a9-1cbc-48e1-8ec7-ef8ecef2ab0a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:37.454454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b42173a9-1cbc-48e1-8ec7-ef8ecef2ab0a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:37.454944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b42173a9-1cbc-48e1-8ec7-ef8ecef2ab0a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:37.456696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b42173a9-1cbc-48e1-8ec7-ef8ecef2ab0a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:37.457149 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b42173a9-1cbc-48e1-8ec7-ef8ecef2ab0a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:37.457622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b42173a9-1cbc-48e1-8ec7-ef8ecef2ab0a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:37.603053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b42173a9-1cbc-48e1-8ec7-ef8ecef2ab0a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:37.611073 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b42173a9-1cbc-48e1-8ec7-ef8ecef2ab0a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1675 microversion: 2.1 time: 0.172146 Sep 06 11:52:37.611784 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3419/6880] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:37 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:38.635969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-59b577be-436b-4c88-bbb8-c6a95c5c948a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:38.636526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-59b577be-436b-4c88-bbb8-c6a95c5c948a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:38.644637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b577be-436b-4c88-bbb8-c6a95c5c948a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:38.645307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b577be-436b-4c88-bbb8-c6a95c5c948a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:38.651127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b577be-436b-4c88-bbb8-c6a95c5c948a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:38.651127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b577be-436b-4c88-bbb8-c6a95c5c948a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:38.651127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b577be-436b-4c88-bbb8-c6a95c5c948a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:38.651127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-59b577be-436b-4c88-bbb8-c6a95c5c948a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:38.718816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-59b577be-436b-4c88-bbb8-c6a95c5c948a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:38.726993 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-59b577be-436b-4c88-bbb8-c6a95c5c948a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 200 len: 1608 microversion: 2.1 time: 0.095131 Sep 06 11:52:38.727754 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3462/6881] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:38 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 1608 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:38.913797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-66193df4-b37b-4d07-89b0-24a5790efe3a req-67e9e3bc-f2d9-4f01-ac9c-53d9d381677b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ff15a5-802e-40ea-b63d-bf30ea9017a7", "name": "network-vif-deleted", "tag": "065bb386-0229-44f4-a412-0f1f6407c369"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:38.923871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-66193df4-b37b-4d07-89b0-24a5790efe3a req-67e9e3bc-f2d9-4f01-ac9c-53d9d381677b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:38.925148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-66193df4-b37b-4d07-89b0-24a5790efe3a req-67e9e3bc-f2d9-4f01-ac9c-53d9d381677b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:38.928902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-66193df4-b37b-4d07-89b0-24a5790efe3a req-67e9e3bc-f2d9-4f01-ac9c-53d9d381677b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:38.938472 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-66193df4-b37b-4d07-89b0-24a5790efe3a req-67e9e3bc-f2d9-4f01-ac9c-53d9d381677b service nova] Creating event network-vif-deleted:065bb386-0229-44f4-a412-0f1f6407c369 for instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 on nch2-master-1 Sep 06 11:52:38.944414 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-66193df4-b37b-4d07-89b0-24a5790efe3a req-67e9e3bc-f2d9-4f01-ac9c-53d9d381677b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035619 Sep 06 11:52:38.945042 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3420/6882] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:52:39.750039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f12283a9-7f30-4afe-b3f4-8ebf570b49f8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:39.750763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f12283a9-7f30-4afe-b3f4-8ebf570b49f8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:39.761323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12283a9-7f30-4afe-b3f4-8ebf570b49f8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:39.761579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12283a9-7f30-4afe-b3f4-8ebf570b49f8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:39.762072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12283a9-7f30-4afe-b3f4-8ebf570b49f8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:39.763337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12283a9-7f30-4afe-b3f4-8ebf570b49f8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:39.764069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12283a9-7f30-4afe-b3f4-8ebf570b49f8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:39.764638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f12283a9-7f30-4afe-b3f4-8ebf570b49f8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:39.783611 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-f12283a9-7f30-4afe-b3f4-8ebf570b49f8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f12283a9-7f30-4afe-b3f4-8ebf570b49f8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 HTTP/1.1 Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '21ff15a5-802e-40ea-b63d-bf30ea9017a7'} Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:52:39.788176 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:52:39.794168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:39.794168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:52:39.794168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:52:39.794168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:52:39.794168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:52:39.794168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:52:39.794168 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:52:39.794168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f12283a9-7f30-4afe-b3f4-8ebf570b49f8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:52:39.794168 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f12283a9-7f30-4afe-b3f4-8ebf570b49f8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 404 len: 111 microversion: 2.1 time: 0.040864 Sep 06 11:52:39.794168 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3463/6883] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:39 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:52:39.803246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-975fee42-1bba-4f96-9a0e-223d64cbe4be tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:39.803962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-975fee42-1bba-4f96-9a0e-223d64cbe4be tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:39.810452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-975fee42-1bba-4f96-9a0e-223d64cbe4be tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:39.810938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-975fee42-1bba-4f96-9a0e-223d64cbe4be tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:39.811410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-975fee42-1bba-4f96-9a0e-223d64cbe4be tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:39.812123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-975fee42-1bba-4f96-9a0e-223d64cbe4be tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:39.812582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-975fee42-1bba-4f96-9a0e-223d64cbe4be tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:39.813010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-975fee42-1bba-4f96-9a0e-223d64cbe4be tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:39.833415 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-975fee42-1bba-4f96-9a0e-223d64cbe4be tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-975fee42-1bba-4f96-9a0e-223d64cbe4be tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 HTTP/1.1 Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '21ff15a5-802e-40ea-b63d-bf30ea9017a7'} Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:52:39.835226 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:52:39.849606 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:39.849606 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:52:39.849606 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:52:39.849606 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:52:39.849606 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:52:39.849606 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:52:39.849606 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:52:39.849606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-975fee42-1bba-4f96-9a0e-223d64cbe4be tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:52:39.849606 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-975fee42-1bba-4f96-9a0e-223d64cbe4be tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 404 len: 111 microversion: 2.1 time: 0.038293 Sep 06 11:52:39.849606 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3421/6884] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:39 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:52:39.888924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-287126878", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "e79a5869-abcd-46ff-bc21-f802fff42f51"}], "security_groups": [{"name": "tempest-securitygroup--302884786"}], "key_name": "tempest-keypair-2082908436", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:40.004754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] validate_networks() for [('e79a5869-abcd-46ff-bc21-f802fff42f51', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:52:40.416659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:52:40.417138 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:52:40.417632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:52:40.418062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:52:40.418527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:52:40.428196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:40.428696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:40.429151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:40.429902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:40.430392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:40.430828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:40.448734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:52:40.454041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for user 3d09c9d5440c4987a99e81bfed501cb5 and project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:52:40.466885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:52:40.469258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:52:40.625775 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4b04c91d-44de-4038-bd40-b7286c5cc9fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.741230 Sep 06 11:52:40.626354 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3464/6885] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:52:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:52:40.638517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3823541f-cc6c-4db2-bbe6-8aecc3d47bcc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:40.639164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3823541f-cc6c-4db2-bbe6-8aecc3d47bcc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:40.696865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3823541f-cc6c-4db2-bbe6-8aecc3d47bcc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:40.703989 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3823541f-cc6c-4db2-bbe6-8aecc3d47bcc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1238 microversion: 2.1 time: 0.069342 Sep 06 11:52:40.704690 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3422/6886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:40 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:41.727548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-284521a9-ecde-42de-8320-7c24521d4fc1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:41.728190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-284521a9-ecde-42de-8320-7c24521d4fc1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:41.732352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:41.737224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-284521a9-ecde-42de-8320-7c24521d4fc1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:41.737738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-284521a9-ecde-42de-8320-7c24521d4fc1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:41.738207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-284521a9-ecde-42de-8320-7c24521d4fc1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:41.738932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-284521a9-ecde-42de-8320-7c24521d4fc1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:41.739443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-284521a9-ecde-42de-8320-7c24521d4fc1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:41.739898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-284521a9-ecde-42de-8320-7c24521d4fc1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:41.802543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-284521a9-ecde-42de-8320-7c24521d4fc1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:41.813230 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-284521a9-ecde-42de-8320-7c24521d4fc1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1242 microversion: 2.1 time: 0.089669 Sep 06 11:52:41.814088 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3465/6887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:41 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:42.837858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c5f809c1-781b-4dfb-84c3-a8558879a48f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:42.838475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c5f809c1-781b-4dfb-84c3-a8558879a48f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:42.841352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:42.846706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f809c1-781b-4dfb-84c3-a8558879a48f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:42.847244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f809c1-781b-4dfb-84c3-a8558879a48f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:42.847672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f809c1-781b-4dfb-84c3-a8558879a48f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:42.848373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f809c1-781b-4dfb-84c3-a8558879a48f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:42.848843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f809c1-781b-4dfb-84c3-a8558879a48f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:42.849281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c5f809c1-781b-4dfb-84c3-a8558879a48f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:42.937217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c5f809c1-781b-4dfb-84c3-a8558879a48f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:42.945609 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c5f809c1-781b-4dfb-84c3-a8558879a48f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1290 microversion: 2.1 time: 0.111706 Sep 06 11:52:42.946202 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3423/6888] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:42 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1290 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:43.969913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-785fdc05-7326-44bb-919e-8a6d02b05be8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:43.970740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-785fdc05-7326-44bb-919e-8a6d02b05be8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:43.977761 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-785fdc05-7326-44bb-919e-8a6d02b05be8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:43.978270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-785fdc05-7326-44bb-919e-8a6d02b05be8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:43.978932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-785fdc05-7326-44bb-919e-8a6d02b05be8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:43.979700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-785fdc05-7326-44bb-919e-8a6d02b05be8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:43.980179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-785fdc05-7326-44bb-919e-8a6d02b05be8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:43.980626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-785fdc05-7326-44bb-919e-8a6d02b05be8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:44.128132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-785fdc05-7326-44bb-919e-8a6d02b05be8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:44.136044 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-785fdc05-7326-44bb-919e-8a6d02b05be8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1363 microversion: 2.1 time: 0.170029 Sep 06 11:52:44.136739 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3466/6889] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:43 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:44.824668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-816ef0ab-34da-4b41-a164-22893256ca40 req-c4733643-9469-40be-80b2-bf8c0d81dddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972f32f8-bef5-49aa-aaf9-b29d65a7c859", "tag": "16b13873-991b-43ce-85a0-39d9dfcd3082"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:44.835756 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-816ef0ab-34da-4b41-a164-22893256ca40 req-c4733643-9469-40be-80b2-bf8c0d81dddf service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:44.836241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-816ef0ab-34da-4b41-a164-22893256ca40 req-c4733643-9469-40be-80b2-bf8c0d81dddf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:44.836681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-816ef0ab-34da-4b41-a164-22893256ca40 req-c4733643-9469-40be-80b2-bf8c0d81dddf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:44.849188 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-816ef0ab-34da-4b41-a164-22893256ca40 req-c4733643-9469-40be-80b2-bf8c0d81dddf service nova] Creating event network-changed:16b13873-991b-43ce-85a0-39d9dfcd3082 for instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 on nch1-master-1 Sep 06 11:52:44.854181 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-816ef0ab-34da-4b41-a164-22893256ca40 req-c4733643-9469-40be-80b2-bf8c0d81dddf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034074 Sep 06 11:52:44.854999 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3424/6890] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:52:45.161934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e168eb9a-fa67-410b-8da3-7133659caa53 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:45.162597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e168eb9a-fa67-410b-8da3-7133659caa53 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:45.169874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e168eb9a-fa67-410b-8da3-7133659caa53 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:45.170396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e168eb9a-fa67-410b-8da3-7133659caa53 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:45.170851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e168eb9a-fa67-410b-8da3-7133659caa53 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:45.171594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e168eb9a-fa67-410b-8da3-7133659caa53 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:45.172068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e168eb9a-fa67-410b-8da3-7133659caa53 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:45.172511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e168eb9a-fa67-410b-8da3-7133659caa53 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:45.311517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e168eb9a-fa67-410b-8da3-7133659caa53 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:45.320189 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e168eb9a-fa67-410b-8da3-7133659caa53 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1363 microversion: 2.1 time: 0.163585 Sep 06 11:52:45.320789 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3467/6891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:45 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:46.344534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f93ecf86-e52f-4530-b0d6-98f3691483b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:46.345249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f93ecf86-e52f-4530-b0d6-98f3691483b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:46.352972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f93ecf86-e52f-4530-b0d6-98f3691483b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:46.353466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f93ecf86-e52f-4530-b0d6-98f3691483b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:46.353917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f93ecf86-e52f-4530-b0d6-98f3691483b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:46.354628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f93ecf86-e52f-4530-b0d6-98f3691483b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:46.355127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f93ecf86-e52f-4530-b0d6-98f3691483b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:46.355569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f93ecf86-e52f-4530-b0d6-98f3691483b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:46.494001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f93ecf86-e52f-4530-b0d6-98f3691483b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:46.505438 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f93ecf86-e52f-4530-b0d6-98f3691483b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1363 microversion: 2.1 time: 0.165175 Sep 06 11:52:46.506017 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3425/6892] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:46 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:47.529405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3372af20-af24-43ab-8c0b-567daba571d1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:47.530036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3372af20-af24-43ab-8c0b-567daba571d1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:47.537316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3372af20-af24-43ab-8c0b-567daba571d1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:47.537815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3372af20-af24-43ab-8c0b-567daba571d1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:47.538276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3372af20-af24-43ab-8c0b-567daba571d1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:47.538988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3372af20-af24-43ab-8c0b-567daba571d1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:47.539497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3372af20-af24-43ab-8c0b-567daba571d1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:47.539943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3372af20-af24-43ab-8c0b-567daba571d1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:47.672440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3372af20-af24-43ab-8c0b-567daba571d1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:47.680335 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3372af20-af24-43ab-8c0b-567daba571d1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1363 microversion: 2.1 time: 0.154948 Sep 06 11:52:47.680916 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3468/6893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:47 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:48.705630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cde0aef2-b976-40bc-a92d-d32afb1b6822 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:48.706187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cde0aef2-b976-40bc-a92d-d32afb1b6822 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:48.712712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cde0aef2-b976-40bc-a92d-d32afb1b6822 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:48.713208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cde0aef2-b976-40bc-a92d-d32afb1b6822 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:48.713659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cde0aef2-b976-40bc-a92d-d32afb1b6822 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:48.714367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cde0aef2-b976-40bc-a92d-d32afb1b6822 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:48.714832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cde0aef2-b976-40bc-a92d-d32afb1b6822 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:48.715365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cde0aef2-b976-40bc-a92d-d32afb1b6822 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:48.849231 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cde0aef2-b976-40bc-a92d-d32afb1b6822 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:48.857157 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cde0aef2-b976-40bc-a92d-d32afb1b6822 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1363 microversion: 2.1 time: 0.156468 Sep 06 11:52:48.857731 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3426/6894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:48 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:49.880338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4af3b40e-3d82-436a-8f33-b1ba3cd95da1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:49.880968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4af3b40e-3d82-436a-8f33-b1ba3cd95da1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:49.888047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4af3b40e-3d82-436a-8f33-b1ba3cd95da1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:49.888549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4af3b40e-3d82-436a-8f33-b1ba3cd95da1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:49.889001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4af3b40e-3d82-436a-8f33-b1ba3cd95da1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:49.889717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4af3b40e-3d82-436a-8f33-b1ba3cd95da1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:49.890243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4af3b40e-3d82-436a-8f33-b1ba3cd95da1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:49.890684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4af3b40e-3d82-436a-8f33-b1ba3cd95da1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:50.026663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4af3b40e-3d82-436a-8f33-b1ba3cd95da1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:50.035555 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4af3b40e-3d82-436a-8f33-b1ba3cd95da1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1363 microversion: 2.1 time: 0.159742 Sep 06 11:52:50.036157 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3469/6895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:49 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:50.221280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-369954a7-0dc3-43c2-a0d5-eb8b0aec38c2 req-f2cc0c90-659b-4184-a8aa-ccd054c1494e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972f32f8-bef5-49aa-aaf9-b29d65a7c859", "name": "network-vif-plugged", "status": "completed", "tag": "16b13873-991b-43ce-85a0-39d9dfcd3082"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:50.231834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-369954a7-0dc3-43c2-a0d5-eb8b0aec38c2 req-f2cc0c90-659b-4184-a8aa-ccd054c1494e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:50.232325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-369954a7-0dc3-43c2-a0d5-eb8b0aec38c2 req-f2cc0c90-659b-4184-a8aa-ccd054c1494e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:50.232766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-369954a7-0dc3-43c2-a0d5-eb8b0aec38c2 req-f2cc0c90-659b-4184-a8aa-ccd054c1494e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:50.244112 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-369954a7-0dc3-43c2-a0d5-eb8b0aec38c2 req-f2cc0c90-659b-4184-a8aa-ccd054c1494e service nova] Creating event network-vif-plugged:16b13873-991b-43ce-85a0-39d9dfcd3082 for instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 on nch1-master-1 Sep 06 11:52:50.249295 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-369954a7-0dc3-43c2-a0d5-eb8b0aec38c2 req-f2cc0c90-659b-4184-a8aa-ccd054c1494e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032996 Sep 06 11:52:50.249668 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3427/6896] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:52:51.060254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c423e75-127b-4f70-a79e-f58a73f536de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:51.060909 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8c423e75-127b-4f70-a79e-f58a73f536de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:51.062827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:51.063548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:51.069381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c423e75-127b-4f70-a79e-f58a73f536de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:51.069889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c423e75-127b-4f70-a79e-f58a73f536de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:51.070353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c423e75-127b-4f70-a79e-f58a73f536de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:51.071137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c423e75-127b-4f70-a79e-f58a73f536de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:51.071625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c423e75-127b-4f70-a79e-f58a73f536de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:51.072074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c423e75-127b-4f70-a79e-f58a73f536de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:51.203777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8c423e75-127b-4f70-a79e-f58a73f536de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:51.212323 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8c423e75-127b-4f70-a79e-f58a73f536de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1363 microversion: 2.1 time: 0.156090 Sep 06 11:52:51.212934 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3470/6897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:51 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:52.233229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:52.238842 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b8b39648-cfcd-471d-9220-5aeb81323583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:52.239588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b8b39648-cfcd-471d-9220-5aeb81323583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:52.245750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b39648-cfcd-471d-9220-5aeb81323583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:52.246243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b39648-cfcd-471d-9220-5aeb81323583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:52.246698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b39648-cfcd-471d-9220-5aeb81323583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:52.247435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b39648-cfcd-471d-9220-5aeb81323583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:52.247908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b39648-cfcd-471d-9220-5aeb81323583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:52.248349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b8b39648-cfcd-471d-9220-5aeb81323583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:52.390138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b8b39648-cfcd-471d-9220-5aeb81323583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:52.400364 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b8b39648-cfcd-471d-9220-5aeb81323583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1549 microversion: 2.1 time: 0.168119 Sep 06 11:52:52.400956 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3428/6898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:52 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:52.426305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-515484e7-452d-4064-a544-943a1b60aa7d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:52.426824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-515484e7-452d-4064-a544-943a1b60aa7d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:52.433869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-515484e7-452d-4064-a544-943a1b60aa7d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:52.435915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-515484e7-452d-4064-a544-943a1b60aa7d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:52.435915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-515484e7-452d-4064-a544-943a1b60aa7d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:52.435915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-515484e7-452d-4064-a544-943a1b60aa7d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:52.436217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-515484e7-452d-4064-a544-943a1b60aa7d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:52.436535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-515484e7-452d-4064-a544-943a1b60aa7d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:52.526193 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-515484e7-452d-4064-a544-943a1b60aa7d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104888 Sep 06 11:52:52.526955 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3471/6899] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:52:52 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:52:53.714482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-d74f06f6-4de3-4246-bcd5-b3ee00a999ac req-3716bcaf-f823-47be-b165-f9c5a95e1d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972f32f8-bef5-49aa-aaf9-b29d65a7c859", "tag": "16b13873-991b-43ce-85a0-39d9dfcd3082"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:53.724127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d74f06f6-4de3-4246-bcd5-b3ee00a999ac req-3716bcaf-f823-47be-b165-f9c5a95e1d24 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:53.724621 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d74f06f6-4de3-4246-bcd5-b3ee00a999ac req-3716bcaf-f823-47be-b165-f9c5a95e1d24 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:53.725065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-d74f06f6-4de3-4246-bcd5-b3ee00a999ac req-3716bcaf-f823-47be-b165-f9c5a95e1d24 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:53.739814 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-d74f06f6-4de3-4246-bcd5-b3ee00a999ac req-3716bcaf-f823-47be-b165-f9c5a95e1d24 service nova] Creating event network-changed:16b13873-991b-43ce-85a0-39d9dfcd3082 for instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 on nch1-master-1 Sep 06 11:52:53.745304 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-d74f06f6-4de3-4246-bcd5-b3ee00a999ac req-3716bcaf-f823-47be-b165-f9c5a95e1d24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088939 Sep 06 11:52:53.745927 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3429/6900] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:53:28.536113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=13 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:28.536912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=53 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:28.541504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d219be6b-a380-46fa-b2ff-c6b72bb93073 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:53:28.547571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d219be6b-a380-46fa-b2ff-c6b72bb93073 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:28.548073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d219be6b-a380-46fa-b2ff-c6b72bb93073 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:28.548529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d219be6b-a380-46fa-b2ff-c6b72bb93073 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:28.571759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d219be6b-a380-46fa-b2ff-c6b72bb93073 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Going to try to stop instance {{(pid=140876) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 11:53:29.013083 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d219be6b-a380-46fa-b2ff-c6b72bb93073 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859/action" status: 202 len: 0 microversion: 2.1 time: 0.479797 Sep 06 11:53:29.013708 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3472/6901] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:53:28 2022] POST /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:53:29.026577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aea8bfe8-fa5e-4b1d-9f60-3363b32dd821 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:29.047324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aea8bfe8-fa5e-4b1d-9f60-3363b32dd821 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:29.047324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=13 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:29.047324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:29.047324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aea8bfe8-fa5e-4b1d-9f60-3363b32dd821 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:29.047324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aea8bfe8-fa5e-4b1d-9f60-3363b32dd821 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:29.047324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aea8bfe8-fa5e-4b1d-9f60-3363b32dd821 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:29.047324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aea8bfe8-fa5e-4b1d-9f60-3363b32dd821 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:29.047324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aea8bfe8-fa5e-4b1d-9f60-3363b32dd821 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:29.047324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aea8bfe8-fa5e-4b1d-9f60-3363b32dd821 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:29.241291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aea8bfe8-fa5e-4b1d-9f60-3363b32dd821 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:29.249964 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aea8bfe8-fa5e-4b1d-9f60-3363b32dd821 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.230997 Sep 06 11:53:29.250581 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3430/6902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:29 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:30.275525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7a42690a-4183-4d6e-a41e-47bb643e78fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:30.276254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7a42690a-4183-4d6e-a41e-47bb643e78fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:30.282956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a42690a-4183-4d6e-a41e-47bb643e78fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:30.283569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a42690a-4183-4d6e-a41e-47bb643e78fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:30.284037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a42690a-4183-4d6e-a41e-47bb643e78fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:30.284763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a42690a-4183-4d6e-a41e-47bb643e78fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:30.285755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a42690a-4183-4d6e-a41e-47bb643e78fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:30.286206 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a42690a-4183-4d6e-a41e-47bb643e78fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:30.476552 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7a42690a-4183-4d6e-a41e-47bb643e78fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:30.484721 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7a42690a-4183-4d6e-a41e-47bb643e78fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.214410 Sep 06 11:53:30.485317 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3473/6903] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:30 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:31.510650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d12941ca-eb06-4124-b4a1-e31eece4595d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:31.511307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d12941ca-eb06-4124-b4a1-e31eece4595d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:31.519040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d12941ca-eb06-4124-b4a1-e31eece4595d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:31.520079 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d12941ca-eb06-4124-b4a1-e31eece4595d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:31.520585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d12941ca-eb06-4124-b4a1-e31eece4595d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:31.521356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d12941ca-eb06-4124-b4a1-e31eece4595d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:31.521823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d12941ca-eb06-4124-b4a1-e31eece4595d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:31.522262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d12941ca-eb06-4124-b4a1-e31eece4595d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:31.658017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d12941ca-eb06-4124-b4a1-e31eece4595d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:31.666963 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d12941ca-eb06-4124-b4a1-e31eece4595d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.160701 Sep 06 11:53:31.668062 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3431/6904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:31 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:32.691088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8adb1d5d-d99f-4dc7-9d6b-bd323fb613df tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:32.691743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8adb1d5d-d99f-4dc7-9d6b-bd323fb613df tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:32.698883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8adb1d5d-d99f-4dc7-9d6b-bd323fb613df tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:32.699423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8adb1d5d-d99f-4dc7-9d6b-bd323fb613df tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:32.699911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8adb1d5d-d99f-4dc7-9d6b-bd323fb613df tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:32.700629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8adb1d5d-d99f-4dc7-9d6b-bd323fb613df tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:32.701101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8adb1d5d-d99f-4dc7-9d6b-bd323fb613df tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:32.701547 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8adb1d5d-d99f-4dc7-9d6b-bd323fb613df tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:32.837046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8adb1d5d-d99f-4dc7-9d6b-bd323fb613df tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:32.845143 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8adb1d5d-d99f-4dc7-9d6b-bd323fb613df tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.157963 Sep 06 11:53:32.845739 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3474/6905] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:32 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:33.869807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-797cc3a5-0a78-43f2-b21a-ccbd4583a964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:33.870422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-797cc3a5-0a78-43f2-b21a-ccbd4583a964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:33.877696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-797cc3a5-0a78-43f2-b21a-ccbd4583a964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:33.878166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-797cc3a5-0a78-43f2-b21a-ccbd4583a964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:33.878611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-797cc3a5-0a78-43f2-b21a-ccbd4583a964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:33.879375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-797cc3a5-0a78-43f2-b21a-ccbd4583a964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:33.879834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-797cc3a5-0a78-43f2-b21a-ccbd4583a964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:33.880262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-797cc3a5-0a78-43f2-b21a-ccbd4583a964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:34.022785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-797cc3a5-0a78-43f2-b21a-ccbd4583a964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:34.031871 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-797cc3a5-0a78-43f2-b21a-ccbd4583a964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.165696 Sep 06 11:53:34.035815 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3432/6906] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:33 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:35.057328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-923d1292-b11a-4df9-a512-f35e37c7e2b7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:35.057972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-923d1292-b11a-4df9-a512-f35e37c7e2b7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:35.065327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-923d1292-b11a-4df9-a512-f35e37c7e2b7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:35.065837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-923d1292-b11a-4df9-a512-f35e37c7e2b7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:35.066353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-923d1292-b11a-4df9-a512-f35e37c7e2b7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:35.067110 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-923d1292-b11a-4df9-a512-f35e37c7e2b7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:35.067595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-923d1292-b11a-4df9-a512-f35e37c7e2b7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:35.068052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-923d1292-b11a-4df9-a512-f35e37c7e2b7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:35.212373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-923d1292-b11a-4df9-a512-f35e37c7e2b7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:35.220830 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-923d1292-b11a-4df9-a512-f35e37c7e2b7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.167586 Sep 06 11:53:35.221437 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3475/6907] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:35 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:36.245338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-314aecd7-3b26-4c2a-ae94-a1c265b372ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:36.245925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-314aecd7-3b26-4c2a-ae94-a1c265b372ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:36.253586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-314aecd7-3b26-4c2a-ae94-a1c265b372ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:36.254596 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-314aecd7-3b26-4c2a-ae94-a1c265b372ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:36.255057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-314aecd7-3b26-4c2a-ae94-a1c265b372ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:36.255758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-314aecd7-3b26-4c2a-ae94-a1c265b372ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:36.256221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-314aecd7-3b26-4c2a-ae94-a1c265b372ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:36.256651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-314aecd7-3b26-4c2a-ae94-a1c265b372ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:36.407967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-314aecd7-3b26-4c2a-ae94-a1c265b372ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:36.417377 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-314aecd7-3b26-4c2a-ae94-a1c265b372ec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.176202 Sep 06 11:53:36.418037 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3433/6908] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:36 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:37.443270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-845b723a-2459-45c9-b609-7f96724ced49 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:37.443905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-845b723a-2459-45c9-b609-7f96724ced49 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:37.451728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-845b723a-2459-45c9-b609-7f96724ced49 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:37.452293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-845b723a-2459-45c9-b609-7f96724ced49 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:37.452878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-845b723a-2459-45c9-b609-7f96724ced49 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:37.453751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-845b723a-2459-45c9-b609-7f96724ced49 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:37.454345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-845b723a-2459-45c9-b609-7f96724ced49 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:37.454838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-845b723a-2459-45c9-b609-7f96724ced49 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:37.599733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-845b723a-2459-45c9-b609-7f96724ced49 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:37.607904 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-845b723a-2459-45c9-b609-7f96724ced49 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.168999 Sep 06 11:53:37.608774 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3476/6909] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:37 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:38.630729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7a0cc7b1-fc8a-418a-84ee-a1027646945c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:38.631441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7a0cc7b1-fc8a-418a-84ee-a1027646945c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:38.638890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a0cc7b1-fc8a-418a-84ee-a1027646945c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:38.639439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a0cc7b1-fc8a-418a-84ee-a1027646945c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:38.639880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a0cc7b1-fc8a-418a-84ee-a1027646945c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:38.640590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a0cc7b1-fc8a-418a-84ee-a1027646945c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:38.641052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a0cc7b1-fc8a-418a-84ee-a1027646945c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:38.641492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a0cc7b1-fc8a-418a-84ee-a1027646945c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:38.805018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7a0cc7b1-fc8a-418a-84ee-a1027646945c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:38.818317 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7a0cc7b1-fc8a-418a-84ee-a1027646945c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.191345 Sep 06 11:53:38.819269 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3434/6910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:38 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:39.851467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9968899e-880a-4d3f-81f7-4339d900c891 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:39.852111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9968899e-880a-4d3f-81f7-4339d900c891 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:39.859790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9968899e-880a-4d3f-81f7-4339d900c891 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:39.860312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9968899e-880a-4d3f-81f7-4339d900c891 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:39.860771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9968899e-880a-4d3f-81f7-4339d900c891 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:39.861516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9968899e-880a-4d3f-81f7-4339d900c891 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:39.862007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9968899e-880a-4d3f-81f7-4339d900c891 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:39.862461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9968899e-880a-4d3f-81f7-4339d900c891 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:40.013581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9968899e-880a-4d3f-81f7-4339d900c891 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:40.022324 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9968899e-880a-4d3f-81f7-4339d900c891 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.175570 Sep 06 11:53:40.022914 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3477/6911] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:39 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:41.048742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-74788f35-c65f-478e-bd2c-67ec275cef90 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:41.049361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-74788f35-c65f-478e-bd2c-67ec275cef90 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:41.057473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74788f35-c65f-478e-bd2c-67ec275cef90 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:41.058000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74788f35-c65f-478e-bd2c-67ec275cef90 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:41.058453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74788f35-c65f-478e-bd2c-67ec275cef90 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:41.059203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74788f35-c65f-478e-bd2c-67ec275cef90 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:41.059671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74788f35-c65f-478e-bd2c-67ec275cef90 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:41.060109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74788f35-c65f-478e-bd2c-67ec275cef90 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:41.210640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-74788f35-c65f-478e-bd2c-67ec275cef90 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:41.219235 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-74788f35-c65f-478e-bd2c-67ec275cef90 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.174646 Sep 06 11:53:41.223864 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3435/6912] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:41 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:42.243630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4939a6a-86fc-48cd-8c75-8defcc2e1601 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:42.244199 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b4939a6a-86fc-48cd-8c75-8defcc2e1601 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:42.251389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4939a6a-86fc-48cd-8c75-8defcc2e1601 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:42.251904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4939a6a-86fc-48cd-8c75-8defcc2e1601 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:42.252373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4939a6a-86fc-48cd-8c75-8defcc2e1601 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:42.253108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4939a6a-86fc-48cd-8c75-8defcc2e1601 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:42.254105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4939a6a-86fc-48cd-8c75-8defcc2e1601 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:42.254561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4939a6a-86fc-48cd-8c75-8defcc2e1601 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:42.388418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b4939a6a-86fc-48cd-8c75-8defcc2e1601 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:42.397016 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b4939a6a-86fc-48cd-8c75-8defcc2e1601 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.157558 Sep 06 11:53:42.397633 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3478/6913] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:42 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:43.421451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-70643a28-f887-46df-b627-7c86ea2defa9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:43.422085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-70643a28-f887-46df-b627-7c86ea2defa9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:43.429329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-70643a28-f887-46df-b627-7c86ea2defa9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:43.429839 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-70643a28-f887-46df-b627-7c86ea2defa9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:43.430299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-70643a28-f887-46df-b627-7c86ea2defa9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:43.431045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-70643a28-f887-46df-b627-7c86ea2defa9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:43.431514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-70643a28-f887-46df-b627-7c86ea2defa9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:43.431957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-70643a28-f887-46df-b627-7c86ea2defa9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:43.578582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-70643a28-f887-46df-b627-7c86ea2defa9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:43.587085 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-70643a28-f887-46df-b627-7c86ea2defa9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.169704 Sep 06 11:53:43.587678 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3436/6914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:43 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:44.611188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e36edd31-e3ee-4086-a4c3-8d372d02f964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:44.612007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e36edd31-e3ee-4086-a4c3-8d372d02f964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:44.619275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e36edd31-e3ee-4086-a4c3-8d372d02f964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:44.619789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e36edd31-e3ee-4086-a4c3-8d372d02f964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:44.620344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e36edd31-e3ee-4086-a4c3-8d372d02f964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:44.621072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e36edd31-e3ee-4086-a4c3-8d372d02f964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:44.621549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e36edd31-e3ee-4086-a4c3-8d372d02f964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:44.621997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e36edd31-e3ee-4086-a4c3-8d372d02f964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:44.793403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e36edd31-e3ee-4086-a4c3-8d372d02f964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:44.802170 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e36edd31-e3ee-4086-a4c3-8d372d02f964 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.195131 Sep 06 11:53:44.802748 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3479/6915] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:44 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:45.826311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f9b1f52e-fb3c-4a3e-929a-b7b8eda9fe1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:45.826927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f9b1f52e-fb3c-4a3e-929a-b7b8eda9fe1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:45.834241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9b1f52e-fb3c-4a3e-929a-b7b8eda9fe1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:45.834777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9b1f52e-fb3c-4a3e-929a-b7b8eda9fe1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:45.835316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9b1f52e-fb3c-4a3e-929a-b7b8eda9fe1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:45.836605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9b1f52e-fb3c-4a3e-929a-b7b8eda9fe1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:45.836605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9b1f52e-fb3c-4a3e-929a-b7b8eda9fe1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:45.836922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f9b1f52e-fb3c-4a3e-929a-b7b8eda9fe1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:45.980358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f9b1f52e-fb3c-4a3e-929a-b7b8eda9fe1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:45.991856 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f9b1f52e-fb3c-4a3e-929a-b7b8eda9fe1b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1655 microversion: 2.1 time: 0.169571 Sep 06 11:53:45.992589 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3437/6916] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:45 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1655 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:46.023221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:53:46.027352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:46.039175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:46.043162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:46.043162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:46.043162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:46.043162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:46.043162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:46.083198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:46.090906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Old instance type m1.heat2, new instance type m1.heat {{(pid=140876) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:53:46.101182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:53:46.101182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:53:46.101637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:53:46.102063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:53:46.102503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:53:46.341907 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3223bf8c-8064-4110-b9a7-35d77b248470 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859/action" status: 202 len: 0 microversion: 2.1 time: 0.324995 Sep 06 11:53:46.342778 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3480/6917] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:53:46 2022] POST /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:53:46.350983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dda0c284-381f-42db-932c-487850c95534 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:46.351733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dda0c284-381f-42db-932c-487850c95534 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:46.358971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dda0c284-381f-42db-932c-487850c95534 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:46.362071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dda0c284-381f-42db-932c-487850c95534 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:46.362071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dda0c284-381f-42db-932c-487850c95534 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:46.362071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dda0c284-381f-42db-932c-487850c95534 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:46.362071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dda0c284-381f-42db-932c-487850c95534 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:46.362071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dda0c284-381f-42db-932c-487850c95534 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:46.509354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dda0c284-381f-42db-932c-487850c95534 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:46.518145 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dda0c284-381f-42db-932c-487850c95534 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.171080 Sep 06 11:53:46.519686 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3438/6918] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:46 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:47.545721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ff9c22ec-3c05-45ef-ae91-baadf33f61cd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:47.546506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ff9c22ec-3c05-45ef-ae91-baadf33f61cd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:47.553560 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff9c22ec-3c05-45ef-ae91-baadf33f61cd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:47.554074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff9c22ec-3c05-45ef-ae91-baadf33f61cd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:47.554535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff9c22ec-3c05-45ef-ae91-baadf33f61cd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:47.555306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff9c22ec-3c05-45ef-ae91-baadf33f61cd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:47.555786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff9c22ec-3c05-45ef-ae91-baadf33f61cd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:47.556235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ff9c22ec-3c05-45ef-ae91-baadf33f61cd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:47.700276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ff9c22ec-3c05-45ef-ae91-baadf33f61cd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:47.710349 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ff9c22ec-3c05-45ef-ae91-baadf33f61cd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.169407 Sep 06 11:53:47.710965 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3481/6919] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:47 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:48.734001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-89f74cff-5277-47cd-b74e-57dc3b2ec5ef tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:48.734623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-89f74cff-5277-47cd-b74e-57dc3b2ec5ef tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:48.742598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89f74cff-5277-47cd-b74e-57dc3b2ec5ef tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:48.743166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89f74cff-5277-47cd-b74e-57dc3b2ec5ef tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:48.744454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89f74cff-5277-47cd-b74e-57dc3b2ec5ef tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:48.745409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89f74cff-5277-47cd-b74e-57dc3b2ec5ef tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:48.746107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89f74cff-5277-47cd-b74e-57dc3b2ec5ef tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:48.746600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-89f74cff-5277-47cd-b74e-57dc3b2ec5ef tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:48.900220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-89f74cff-5277-47cd-b74e-57dc3b2ec5ef tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:48.910070 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-89f74cff-5277-47cd-b74e-57dc3b2ec5ef tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1678 microversion: 2.1 time: 0.179547 Sep 06 11:53:48.910676 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3439/6920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:48 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:49.934471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7c8c324f-fefc-467a-8d52-235f7e374af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:49.935139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7c8c324f-fefc-467a-8d52-235f7e374af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:49.942849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c8c324f-fefc-467a-8d52-235f7e374af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:49.943439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c8c324f-fefc-467a-8d52-235f7e374af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:49.943895 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c8c324f-fefc-467a-8d52-235f7e374af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:49.944650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c8c324f-fefc-467a-8d52-235f7e374af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:49.945127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c8c324f-fefc-467a-8d52-235f7e374af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:49.945575 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c8c324f-fefc-467a-8d52-235f7e374af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:50.089760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7c8c324f-fefc-467a-8d52-235f7e374af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:50.098956 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7c8c324f-fefc-467a-8d52-235f7e374af5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1683 microversion: 2.1 time: 0.168527 Sep 06 11:53:50.099588 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3482/6921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:49 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:51.123743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-79b563db-d4c2-4888-84a1-4dfb4ac0d91f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:51.142428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-79b563db-d4c2-4888-84a1-4dfb4ac0d91f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:51.142428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79b563db-d4c2-4888-84a1-4dfb4ac0d91f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:51.142428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79b563db-d4c2-4888-84a1-4dfb4ac0d91f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:51.142428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79b563db-d4c2-4888-84a1-4dfb4ac0d91f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:51.142428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79b563db-d4c2-4888-84a1-4dfb4ac0d91f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:51.142428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79b563db-d4c2-4888-84a1-4dfb4ac0d91f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:51.142428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79b563db-d4c2-4888-84a1-4dfb4ac0d91f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:51.280802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-79b563db-d4c2-4888-84a1-4dfb4ac0d91f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:51.289904 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-79b563db-d4c2-4888-84a1-4dfb4ac0d91f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1683 microversion: 2.1 time: 0.170193 Sep 06 11:53:51.311323 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3440/6922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:51 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:52.314181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-19413a7d-1d2d-4086-9c63-ef179d01372a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:52.314928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-19413a7d-1d2d-4086-9c63-ef179d01372a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:52.322257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19413a7d-1d2d-4086-9c63-ef179d01372a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:52.322767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19413a7d-1d2d-4086-9c63-ef179d01372a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:52.323264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19413a7d-1d2d-4086-9c63-ef179d01372a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:52.324006 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19413a7d-1d2d-4086-9c63-ef179d01372a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:52.324478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19413a7d-1d2d-4086-9c63-ef179d01372a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:52.324916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-19413a7d-1d2d-4086-9c63-ef179d01372a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:52.477935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-8c84fe58-4877-4f11-920f-480e94fb373d req-1786b764-ed85-4bdf-9339-62bd42cd9624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972f32f8-bef5-49aa-aaf9-b29d65a7c859", "name": "network-vif-unplugged", "status": "completed", "tag": "16b13873-991b-43ce-85a0-39d9dfcd3082"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:53:52.488052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8c84fe58-4877-4f11-920f-480e94fb373d req-1786b764-ed85-4bdf-9339-62bd42cd9624 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:52.488554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8c84fe58-4877-4f11-920f-480e94fb373d req-1786b764-ed85-4bdf-9339-62bd42cd9624 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:52.488998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8c84fe58-4877-4f11-920f-480e94fb373d req-1786b764-ed85-4bdf-9339-62bd42cd9624 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:52.497044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-19413a7d-1d2d-4086-9c63-ef179d01372a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:52.501781 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-8c84fe58-4877-4f11-920f-480e94fb373d req-1786b764-ed85-4bdf-9339-62bd42cd9624 service nova] Creating event network-vif-unplugged:16b13873-991b-43ce-85a0-39d9dfcd3082 for instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 on nch2-master-1 Sep 06 11:53:52.505398 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-19413a7d-1d2d-4086-9c63-ef179d01372a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1682 microversion: 2.1 time: 0.195362 Sep 06 11:53:52.506215 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3483/6923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:52 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:52.507972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-8c84fe58-4877-4f11-920f-480e94fb373d req-1786b764-ed85-4bdf-9339-62bd42cd9624 service nova] Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:53:52.526041 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-8c84fe58-4877-4f11-920f-480e94fb373d req-1786b764-ed85-4bdf-9339-62bd42cd9624 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114837 Sep 06 11:53:52.526667 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3441/6924] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:53:53.529930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cce07c42-2f39-43c5-836f-1dee18e2c804 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:53.530656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cce07c42-2f39-43c5-836f-1dee18e2c804 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:53.539087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cce07c42-2f39-43c5-836f-1dee18e2c804 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:53.539603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cce07c42-2f39-43c5-836f-1dee18e2c804 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:53.540068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cce07c42-2f39-43c5-836f-1dee18e2c804 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:53.540834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cce07c42-2f39-43c5-836f-1dee18e2c804 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:53.541450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cce07c42-2f39-43c5-836f-1dee18e2c804 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:53.541913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cce07c42-2f39-43c5-836f-1dee18e2c804 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:53.696664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cce07c42-2f39-43c5-836f-1dee18e2c804 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:53.704970 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cce07c42-2f39-43c5-836f-1dee18e2c804 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1682 microversion: 2.1 time: 0.178988 Sep 06 11:53:53.705656 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3484/6925] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:53 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:54.544725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b7005d47-73e3-4d39-a1f5-37359502a22c req-5f86f2bd-95f7-4e9c-aa0a-0d0f536fe77d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972f32f8-bef5-49aa-aaf9-b29d65a7c859", "tag": "16b13873-991b-43ce-85a0-39d9dfcd3082"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:53:54.555427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b7005d47-73e3-4d39-a1f5-37359502a22c req-5f86f2bd-95f7-4e9c-aa0a-0d0f536fe77d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:54.555933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b7005d47-73e3-4d39-a1f5-37359502a22c req-5f86f2bd-95f7-4e9c-aa0a-0d0f536fe77d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:54.556361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b7005d47-73e3-4d39-a1f5-37359502a22c req-5f86f2bd-95f7-4e9c-aa0a-0d0f536fe77d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:54.569980 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b7005d47-73e3-4d39-a1f5-37359502a22c req-5f86f2bd-95f7-4e9c-aa0a-0d0f536fe77d service nova] Creating event network-changed:16b13873-991b-43ce-85a0-39d9dfcd3082 for instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 on nch2-master-1 Sep 06 11:53:54.576135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-b7005d47-73e3-4d39-a1f5-37359502a22c req-5f86f2bd-95f7-4e9c-aa0a-0d0f536fe77d service nova] Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:53:54.592786 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b7005d47-73e3-4d39-a1f5-37359502a22c req-5f86f2bd-95f7-4e9c-aa0a-0d0f536fe77d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053092 Sep 06 11:53:54.593044 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3442/6926] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:53:54.730572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-54f30ae7-0600-4cc2-9d19-4c1d12f0e0f4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:54.731280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-54f30ae7-0600-4cc2-9d19-4c1d12f0e0f4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:54.740778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f30ae7-0600-4cc2-9d19-4c1d12f0e0f4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:54.741330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f30ae7-0600-4cc2-9d19-4c1d12f0e0f4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:54.741796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f30ae7-0600-4cc2-9d19-4c1d12f0e0f4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:54.742531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f30ae7-0600-4cc2-9d19-4c1d12f0e0f4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:54.743032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f30ae7-0600-4cc2-9d19-4c1d12f0e0f4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:54.743482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f30ae7-0600-4cc2-9d19-4c1d12f0e0f4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:55.276240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-54f30ae7-0600-4cc2-9d19-4c1d12f0e0f4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:55.288147 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-54f30ae7-0600-4cc2-9d19-4c1d12f0e0f4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1680 microversion: 2.1 time: 0.562022 Sep 06 11:53:55.288784 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3485/6927] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:54 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1680 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:56.316553 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-570b7042-ea9a-4bea-adc8-d3090114122e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:56.317298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-570b7042-ea9a-4bea-adc8-d3090114122e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:56.325790 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570b7042-ea9a-4bea-adc8-d3090114122e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:56.326203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570b7042-ea9a-4bea-adc8-d3090114122e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:56.326650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570b7042-ea9a-4bea-adc8-d3090114122e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:56.327411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570b7042-ea9a-4bea-adc8-d3090114122e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:56.327878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570b7042-ea9a-4bea-adc8-d3090114122e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:56.328312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-570b7042-ea9a-4bea-adc8-d3090114122e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:56.485626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-570b7042-ea9a-4bea-adc8-d3090114122e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:56.497876 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-570b7042-ea9a-4bea-adc8-d3090114122e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1676 microversion: 2.1 time: 0.186427 Sep 06 11:53:56.498498 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3443/6928] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:56 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:56.530031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8b02a821-638d-4410-a5af-d865d24a57e1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:53:56.530621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8b02a821-638d-4410-a5af-d865d24a57e1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:56.539859 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b02a821-638d-4410-a5af-d865d24a57e1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:56.540460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b02a821-638d-4410-a5af-d865d24a57e1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:56.541003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b02a821-638d-4410-a5af-d865d24a57e1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:56.541852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b02a821-638d-4410-a5af-d865d24a57e1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:56.542441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b02a821-638d-4410-a5af-d865d24a57e1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:56.542920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b02a821-638d-4410-a5af-d865d24a57e1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:56.548300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:56.974774 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8b02a821-638d-4410-a5af-d865d24a57e1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859/action" status: 204 len: 0 microversion: 2.1 time: 0.449078 Sep 06 11:53:56.975979 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3486/6929] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:53:56 2022] POST /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859/action => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:53:56.986691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-be96bfa0-6d10-4816-94b9-cd59067cbc78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:56.990038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-be96bfa0-6d10-4816-94b9-cd59067cbc78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:56.994767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be96bfa0-6d10-4816-94b9-cd59067cbc78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:56.995311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be96bfa0-6d10-4816-94b9-cd59067cbc78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:56.995769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be96bfa0-6d10-4816-94b9-cd59067cbc78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:56.996555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be96bfa0-6d10-4816-94b9-cd59067cbc78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:56.997033 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be96bfa0-6d10-4816-94b9-cd59067cbc78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:56.997477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be96bfa0-6d10-4816-94b9-cd59067cbc78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:57.163135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-be96bfa0-6d10-4816-94b9-cd59067cbc78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:57.171452 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-be96bfa0-6d10-4816-94b9-cd59067cbc78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1676 microversion: 2.1 time: 0.189806 Sep 06 11:53:57.172548 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3444/6930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:56 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:58.203408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-21c592dd-19be-4241-a670-85d4ffbfa997 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:58.204802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-21c592dd-19be-4241-a670-85d4ffbfa997 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:58.218405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-21c592dd-19be-4241-a670-85d4ffbfa997 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:58.219360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-21c592dd-19be-4241-a670-85d4ffbfa997 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:58.220227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-21c592dd-19be-4241-a670-85d4ffbfa997 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:58.221573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-21c592dd-19be-4241-a670-85d4ffbfa997 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:58.222475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-21c592dd-19be-4241-a670-85d4ffbfa997 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:58.223687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-21c592dd-19be-4241-a670-85d4ffbfa997 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:58.452541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-21c592dd-19be-4241-a670-85d4ffbfa997 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:58.467330 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-21c592dd-19be-4241-a670-85d4ffbfa997 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1676 microversion: 2.1 time: 0.273717 Sep 06 11:53:58.467956 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3487/6931] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:58 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1676 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:59.493268 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5ee07041-ef36-4dff-af4b-aa24cd189970 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:59.493878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5ee07041-ef36-4dff-af4b-aa24cd189970 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:59.501687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ee07041-ef36-4dff-af4b-aa24cd189970 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:59.502301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ee07041-ef36-4dff-af4b-aa24cd189970 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:59.502638 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ee07041-ef36-4dff-af4b-aa24cd189970 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:59.503833 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ee07041-ef36-4dff-af4b-aa24cd189970 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:59.503968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ee07041-ef36-4dff-af4b-aa24cd189970 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:59.505145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ee07041-ef36-4dff-af4b-aa24cd189970 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:59.671262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5ee07041-ef36-4dff-af4b-aa24cd189970 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:59.685580 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5ee07041-ef36-4dff-af4b-aa24cd189970 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1655 microversion: 2.1 time: 0.196347 Sep 06 11:53:59.686684 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3445/6932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:59 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1655 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:59.724127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-624a7c46-4d17-427d-946e-72fbd4d3c468 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:59.728370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-624a7c46-4d17-427d-946e-72fbd4d3c468 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:59.732332 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=37 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:59.741268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-624a7c46-4d17-427d-946e-72fbd4d3c468 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:59.745949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-624a7c46-4d17-427d-946e-72fbd4d3c468 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:59.753740 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-624a7c46-4d17-427d-946e-72fbd4d3c468 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:59.754559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-624a7c46-4d17-427d-946e-72fbd4d3c468 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:59.755080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-624a7c46-4d17-427d-946e-72fbd4d3c468 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:59.755800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-624a7c46-4d17-427d-946e-72fbd4d3c468 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:59.918734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-624a7c46-4d17-427d-946e-72fbd4d3c468 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:59.927391 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-624a7c46-4d17-427d-946e-72fbd4d3c468 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1655 microversion: 2.1 time: 0.208975 Sep 06 11:53:59.928342 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3488/6933] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:59 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1655 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:59.952251 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-47b15b7a-1593-44ff-adbe-f8499d0b605c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:53:59.959767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47b15b7a-1593-44ff-adbe-f8499d0b605c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:59.960279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47b15b7a-1593-44ff-adbe-f8499d0b605c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:59.960811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47b15b7a-1593-44ff-adbe-f8499d0b605c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:59.998828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-47b15b7a-1593-44ff-adbe-f8499d0b605c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Going to try to start instance {{(pid=140875) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 11:54:00.019479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=100 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:00.539854 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-47b15b7a-1593-44ff-adbe-f8499d0b605c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859/action" status: 202 len: 0 microversion: 2.1 time: 0.591144 Sep 06 11:54:00.540970 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3446/6934] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:53:59 2022] POST /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:54:00.558876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f88a237b-b182-4879-a9d4-fc6339587c2f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:00.560421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f88a237b-b182-4879-a9d4-fc6339587c2f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:00.567436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f88a237b-b182-4879-a9d4-fc6339587c2f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:00.568028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f88a237b-b182-4879-a9d4-fc6339587c2f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:00.568555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f88a237b-b182-4879-a9d4-fc6339587c2f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:00.569374 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f88a237b-b182-4879-a9d4-fc6339587c2f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:00.569915 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f88a237b-b182-4879-a9d4-fc6339587c2f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:00.570492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f88a237b-b182-4879-a9d4-fc6339587c2f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:00.625499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-daf248de-3941-48fb-9ee4-b8af137eb009 req-c19cde61-e0e6-4e85-a633-47f26378a79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972f32f8-bef5-49aa-aaf9-b29d65a7c859", "name": "network-vif-plugged", "status": "completed", "tag": "16b13873-991b-43ce-85a0-39d9dfcd3082"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:00.637443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-daf248de-3941-48fb-9ee4-b8af137eb009 req-c19cde61-e0e6-4e85-a633-47f26378a79e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:00.637974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-daf248de-3941-48fb-9ee4-b8af137eb009 req-c19cde61-e0e6-4e85-a633-47f26378a79e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:00.638432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-daf248de-3941-48fb-9ee4-b8af137eb009 req-c19cde61-e0e6-4e85-a633-47f26378a79e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:00.652206 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-daf248de-3941-48fb-9ee4-b8af137eb009 req-c19cde61-e0e6-4e85-a633-47f26378a79e service nova] Creating event network-vif-plugged:16b13873-991b-43ce-85a0-39d9dfcd3082 for instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 on nch2-master-1 Sep 06 11:54:00.658912 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-daf248de-3941-48fb-9ee4-b8af137eb009 req-c19cde61-e0e6-4e85-a633-47f26378a79e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138229 Sep 06 11:54:00.659674 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3489/6935] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:54:00.750113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f88a237b-b182-4879-a9d4-fc6339587c2f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:00.764864 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f88a237b-b182-4879-a9d4-fc6339587c2f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1664 microversion: 2.1 time: 0.212033 Sep 06 11:54:00.765778 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3447/6936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:00 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1664 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:01.794131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ccf671a7-f795-4e0f-af85-6b488171793f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:01.794908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ccf671a7-f795-4e0f-af85-6b488171793f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:01.802408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf671a7-f795-4e0f-af85-6b488171793f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:01.803237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf671a7-f795-4e0f-af85-6b488171793f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:01.803709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf671a7-f795-4e0f-af85-6b488171793f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:01.804440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf671a7-f795-4e0f-af85-6b488171793f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:01.804928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf671a7-f795-4e0f-af85-6b488171793f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:01.805384 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ccf671a7-f795-4e0f-af85-6b488171793f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:01.944943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ccf671a7-f795-4e0f-af85-6b488171793f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:01.952956 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ccf671a7-f795-4e0f-af85-6b488171793f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1664 microversion: 2.1 time: 0.164471 Sep 06 11:54:01.953525 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3490/6937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:01 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:02.978737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6a15cf18-f2dc-4ed2-a5a8-947f81eddf0f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:02.979372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6a15cf18-f2dc-4ed2-a5a8-947f81eddf0f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:02.982326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=37 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:02.987256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a15cf18-f2dc-4ed2-a5a8-947f81eddf0f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.987751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a15cf18-f2dc-4ed2-a5a8-947f81eddf0f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.988196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a15cf18-f2dc-4ed2-a5a8-947f81eddf0f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:02.988908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a15cf18-f2dc-4ed2-a5a8-947f81eddf0f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.989370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a15cf18-f2dc-4ed2-a5a8-947f81eddf0f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.989802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6a15cf18-f2dc-4ed2-a5a8-947f81eddf0f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:03.125810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6a15cf18-f2dc-4ed2-a5a8-947f81eddf0f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:03.134043 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6a15cf18-f2dc-4ed2-a5a8-947f81eddf0f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1668 microversion: 2.1 time: 0.159216 Sep 06 11:54:03.134630 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3448/6938] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:02 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:03.158321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f0a826d7-417a-4f98-ae94-117e268d3162 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:03.159629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f0a826d7-417a-4f98-ae94-117e268d3162 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:03.166957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0a826d7-417a-4f98-ae94-117e268d3162 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:03.167501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0a826d7-417a-4f98-ae94-117e268d3162 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:03.167965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0a826d7-417a-4f98-ae94-117e268d3162 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:03.168696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0a826d7-417a-4f98-ae94-117e268d3162 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:03.169174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0a826d7-417a-4f98-ae94-117e268d3162 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:03.169621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0a826d7-417a-4f98-ae94-117e268d3162 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:03.197847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f0a826d7-417a-4f98-ae94-117e268d3162 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:54:03.535647 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f0a826d7-417a-4f98-ae94-117e268d3162 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 204 len: 0 microversion: 2.1 time: 0.381206 Sep 06 11:54:03.536251 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3491/6939] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:54:03 2022] DELETE /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:54:03.544730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-45d62b39-39be-407c-9dd8-77bca6a70a52 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:03.545488 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-45d62b39-39be-407c-9dd8-77bca6a70a52 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:03.552539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45d62b39-39be-407c-9dd8-77bca6a70a52 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:03.554814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45d62b39-39be-407c-9dd8-77bca6a70a52 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:03.554814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45d62b39-39be-407c-9dd8-77bca6a70a52 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:03.554814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45d62b39-39be-407c-9dd8-77bca6a70a52 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:03.554814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45d62b39-39be-407c-9dd8-77bca6a70a52 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:03.555271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-45d62b39-39be-407c-9dd8-77bca6a70a52 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:03.684816 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-45d62b39-39be-407c-9dd8-77bca6a70a52 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:03.692815 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-45d62b39-39be-407c-9dd8-77bca6a70a52 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1674 microversion: 2.1 time: 0.152131 Sep 06 11:54:03.693389 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3449/6940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:03 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:04.718012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-993df25a-f176-4b82-acc9-1d930ec2e954 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:04.718754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-993df25a-f176-4b82-acc9-1d930ec2e954 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:04.726697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-993df25a-f176-4b82-acc9-1d930ec2e954 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:04.727255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-993df25a-f176-4b82-acc9-1d930ec2e954 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:04.727726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-993df25a-f176-4b82-acc9-1d930ec2e954 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:04.728466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-993df25a-f176-4b82-acc9-1d930ec2e954 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:04.728955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-993df25a-f176-4b82-acc9-1d930ec2e954 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:04.729410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-993df25a-f176-4b82-acc9-1d930ec2e954 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:04.894710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-993df25a-f176-4b82-acc9-1d930ec2e954 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:04.903157 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-993df25a-f176-4b82-acc9-1d930ec2e954 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1674 microversion: 2.1 time: 0.189566 Sep 06 11:54:04.903765 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3492/6941] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:04 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:05.900272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-fa7c6a30-2c1a-4634-891e-ddc70f583f77 req-ce1cf4d6-52f6-4b75-9af9-57bf3ae03b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972f32f8-bef5-49aa-aaf9-b29d65a7c859", "name": "network-vif-deleted", "tag": "16b13873-991b-43ce-85a0-39d9dfcd3082"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:05.917699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fa7c6a30-2c1a-4634-891e-ddc70f583f77 req-ce1cf4d6-52f6-4b75-9af9-57bf3ae03b8b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:05.917699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fa7c6a30-2c1a-4634-891e-ddc70f583f77 req-ce1cf4d6-52f6-4b75-9af9-57bf3ae03b8b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:05.917699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fa7c6a30-2c1a-4634-891e-ddc70f583f77 req-ce1cf4d6-52f6-4b75-9af9-57bf3ae03b8b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:05.925785 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-fa7c6a30-2c1a-4634-891e-ddc70f583f77 req-ce1cf4d6-52f6-4b75-9af9-57bf3ae03b8b service nova] Creating event network-vif-deleted:16b13873-991b-43ce-85a0-39d9dfcd3082 for instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 on nch2-master-1 Sep 06 11:54:05.931335 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-fa7c6a30-2c1a-4634-891e-ddc70f583f77 req-ce1cf4d6-52f6-4b75-9af9-57bf3ae03b8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035048 Sep 06 11:54:05.931563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a816d016-47d2-4be6-834c-2f70db88e326 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:05.932373 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3450/6942] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:54:05.933382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a816d016-47d2-4be6-834c-2f70db88e326 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:05.940401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a816d016-47d2-4be6-834c-2f70db88e326 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:05.940915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a816d016-47d2-4be6-834c-2f70db88e326 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:05.941380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a816d016-47d2-4be6-834c-2f70db88e326 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:05.942112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a816d016-47d2-4be6-834c-2f70db88e326 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:05.942596 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a816d016-47d2-4be6-834c-2f70db88e326 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:05.943093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a816d016-47d2-4be6-834c-2f70db88e326 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:06.017505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a816d016-47d2-4be6-834c-2f70db88e326 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:06.031197 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a816d016-47d2-4be6-834c-2f70db88e326 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 200 len: 1607 microversion: 2.1 time: 0.103479 Sep 06 11:54:06.039911 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3493/6943] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:05 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 1607 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:54:07.060678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e205b7cf-13aa-4b47-884a-8709abfba264 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:07.061538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e205b7cf-13aa-4b47-884a-8709abfba264 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:07.069883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e205b7cf-13aa-4b47-884a-8709abfba264 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.070501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e205b7cf-13aa-4b47-884a-8709abfba264 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.071111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e205b7cf-13aa-4b47-884a-8709abfba264 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.071922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e205b7cf-13aa-4b47-884a-8709abfba264 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.072473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e205b7cf-13aa-4b47-884a-8709abfba264 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.072950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e205b7cf-13aa-4b47-884a-8709abfba264 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.088430 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-e205b7cf-13aa-4b47-884a-8709abfba264 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e205b7cf-13aa-4b47-884a-8709abfba264 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 HTTP/1.1 Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '972f32f8-bef5-49aa-aaf9-b29d65a7c859'} Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:54:07.090128 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.096779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:54:07.096779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:54:07.096779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:54:07.096779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:54:07.096779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:54:07.096779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:54:07.096779 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.096779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e205b7cf-13aa-4b47-884a-8709abfba264 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:54:07.096779 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e205b7cf-13aa-4b47-884a-8709abfba264 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 404 len: 111 microversion: 2.1 time: 0.037258 Sep 06 11:54:07.096779 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3451/6944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:07 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:54:07.115872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4340aa4-46cd-4124-b1ce-7f5debd88eb7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:07.116533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b4340aa4-46cd-4124-b1ce-7f5debd88eb7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:07.129813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4340aa4-46cd-4124-b1ce-7f5debd88eb7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.129813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4340aa4-46cd-4124-b1ce-7f5debd88eb7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.129813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4340aa4-46cd-4124-b1ce-7f5debd88eb7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.129813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4340aa4-46cd-4124-b1ce-7f5debd88eb7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.129813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4340aa4-46cd-4124-b1ce-7f5debd88eb7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.129813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4340aa4-46cd-4124-b1ce-7f5debd88eb7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.147525 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-b4340aa4-46cd-4124-b1ce-7f5debd88eb7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4340aa4-46cd-4124-b1ce-7f5debd88eb7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 HTTP/1.1 Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '972f32f8-bef5-49aa-aaf9-b29d65a7c859'} Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:54:07.149257 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.157690 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:54:07.157690 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:54:07.157690 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:54:07.157690 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:54:07.157690 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:54:07.157690 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:54:07.157690 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.157690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4340aa4-46cd-4124-b1ce-7f5debd88eb7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:54:07.157690 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b4340aa4-46cd-4124-b1ce-7f5debd88eb7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 404 len: 111 microversion: 2.1 time: 0.040787 Sep 06 11:54:07.157690 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3494/6945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:07 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:54:07.208034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-350980168", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "e79a5869-abcd-46ff-bc21-f802fff42f51"}], "security_groups": [{"name": "tempest-securitygroup--302884786"}], "key_name": "tempest-keypair-2082908436", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:07.332311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] validate_networks() for [('e79a5869-abcd-46ff-bc21-f802fff42f51', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:54:07.766821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:54:07.767987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:54:07.769188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:54:07.770313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:54:07.771106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:54:07.786117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.786832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.787406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.788211 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.788726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.789243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.813566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:54:07.820166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for user 3d09c9d5440c4987a99e81bfed501cb5 and project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:54:07.842973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:54:07.848177 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:54:07.982909 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8f53422e-27c8-4d2c-8d4d-469034d90478 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.781967 Sep 06 11:54:07.984163 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3452/6946] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:54:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:54:08.005247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-066828ef-80aa-4ce5-aee2-61a327419115 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:08.006405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-066828ef-80aa-4ce5-aee2-61a327419115 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:08.092523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-066828ef-80aa-4ce5-aee2-61a327419115 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:08.105379 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-066828ef-80aa-4ce5-aee2-61a327419115 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1238 microversion: 2.1 time: 0.107482 Sep 06 11:54:08.106791 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3495/6947] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:07 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1238 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:09.153140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e067341a-606b-49bb-8768-0b26694ee6af tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:09.154161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e067341a-606b-49bb-8768-0b26694ee6af tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:09.246503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e067341a-606b-49bb-8768-0b26694ee6af tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:09.256565 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e067341a-606b-49bb-8768-0b26694ee6af tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1238 microversion: 2.1 time: 0.113283 Sep 06 11:54:09.257165 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3453/6948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:09 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1238 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:10.280526 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b50b1384-dc59-4f0d-bf09-0c2a0ba7a893 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:10.281218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b50b1384-dc59-4f0d-bf09-0c2a0ba7a893 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:10.290243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b50b1384-dc59-4f0d-bf09-0c2a0ba7a893 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:10.290758 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b50b1384-dc59-4f0d-bf09-0c2a0ba7a893 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:10.291258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b50b1384-dc59-4f0d-bf09-0c2a0ba7a893 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:10.291990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b50b1384-dc59-4f0d-bf09-0c2a0ba7a893 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:10.292468 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b50b1384-dc59-4f0d-bf09-0c2a0ba7a893 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:10.292918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b50b1384-dc59-4f0d-bf09-0c2a0ba7a893 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:10.360092 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b50b1384-dc59-4f0d-bf09-0c2a0ba7a893 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:10.370003 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b50b1384-dc59-4f0d-bf09-0c2a0ba7a893 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1290 microversion: 2.1 time: 0.093630 Sep 06 11:54:10.370771 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3496/6949] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:10 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:11.414732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-66daf98f-961b-42d6-8f6e-45776e073d1f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:11.415847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-66daf98f-961b-42d6-8f6e-45776e073d1f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:11.429901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66daf98f-961b-42d6-8f6e-45776e073d1f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:11.430771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66daf98f-961b-42d6-8f6e-45776e073d1f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:11.431723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66daf98f-961b-42d6-8f6e-45776e073d1f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:11.433018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66daf98f-961b-42d6-8f6e-45776e073d1f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:11.433831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66daf98f-961b-42d6-8f6e-45776e073d1f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:11.434608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-66daf98f-961b-42d6-8f6e-45776e073d1f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:11.546086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-66daf98f-961b-42d6-8f6e-45776e073d1f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:11.555514 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-66daf98f-961b-42d6-8f6e-45776e073d1f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1296 microversion: 2.1 time: 0.149355 Sep 06 11:54:11.566251 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3454/6950] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:11 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1296 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:12.592027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-275b0a85-618a-4ee7-b28f-662b29582345 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:12.592888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-275b0a85-618a-4ee7-b28f-662b29582345 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:12.600225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-275b0a85-618a-4ee7-b28f-662b29582345 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:12.600749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-275b0a85-618a-4ee7-b28f-662b29582345 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:12.601246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-275b0a85-618a-4ee7-b28f-662b29582345 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:12.601972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-275b0a85-618a-4ee7-b28f-662b29582345 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:12.602450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-275b0a85-618a-4ee7-b28f-662b29582345 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:12.602906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-275b0a85-618a-4ee7-b28f-662b29582345 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:12.764549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-275b0a85-618a-4ee7-b28f-662b29582345 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:12.777025 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-275b0a85-618a-4ee7-b28f-662b29582345 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1363 microversion: 2.1 time: 0.189319 Sep 06 11:54:12.777742 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3497/6951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:12 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:12.943094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-27a90a21-92fe-4605-9e46-826b01a5f864 req-32acb504-e7ed-4eba-8c65-e57773fbd1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dda4f51b-3257-4bb0-81b8-a68cbda02294", "tag": "5af891e1-aa65-404e-bd37-e2e5bfe97743"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:12.954212 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-27a90a21-92fe-4605-9e46-826b01a5f864 req-32acb504-e7ed-4eba-8c65-e57773fbd1d5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:12.954703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-27a90a21-92fe-4605-9e46-826b01a5f864 req-32acb504-e7ed-4eba-8c65-e57773fbd1d5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:12.955213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-27a90a21-92fe-4605-9e46-826b01a5f864 req-32acb504-e7ed-4eba-8c65-e57773fbd1d5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:12.969352 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-27a90a21-92fe-4605-9e46-826b01a5f864 req-32acb504-e7ed-4eba-8c65-e57773fbd1d5 service nova] Creating event network-changed:5af891e1-aa65-404e-bd37-e2e5bfe97743 for instance dda4f51b-3257-4bb0-81b8-a68cbda02294 on nch1-master-1 Sep 06 11:54:12.975374 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-27a90a21-92fe-4605-9e46-826b01a5f864 req-32acb504-e7ed-4eba-8c65-e57773fbd1d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037078 Sep 06 11:54:12.977008 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3455/6952] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:54:13.803076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6565a17d-91df-4b41-b8a5-0149378e723d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:13.803721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6565a17d-91df-4b41-b8a5-0149378e723d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:13.810033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6565a17d-91df-4b41-b8a5-0149378e723d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:13.810559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6565a17d-91df-4b41-b8a5-0149378e723d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:13.811041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6565a17d-91df-4b41-b8a5-0149378e723d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:13.811788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6565a17d-91df-4b41-b8a5-0149378e723d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:13.812261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6565a17d-91df-4b41-b8a5-0149378e723d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:13.812713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6565a17d-91df-4b41-b8a5-0149378e723d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:13.955968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6565a17d-91df-4b41-b8a5-0149378e723d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:13.964073 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6565a17d-91df-4b41-b8a5-0149378e723d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1363 microversion: 2.1 time: 0.166188 Sep 06 11:54:13.964650 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3498/6953] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:13 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:14.991145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-32503c46-1108-4fb3-96b2-af5ac8254682 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:14.991783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-32503c46-1108-4fb3-96b2-af5ac8254682 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:14.998327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32503c46-1108-4fb3-96b2-af5ac8254682 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:15.002879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32503c46-1108-4fb3-96b2-af5ac8254682 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:15.002879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32503c46-1108-4fb3-96b2-af5ac8254682 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:15.002879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32503c46-1108-4fb3-96b2-af5ac8254682 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:15.002879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32503c46-1108-4fb3-96b2-af5ac8254682 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:15.002879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-32503c46-1108-4fb3-96b2-af5ac8254682 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:15.150116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-32503c46-1108-4fb3-96b2-af5ac8254682 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:15.162167 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-32503c46-1108-4fb3-96b2-af5ac8254682 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1363 microversion: 2.1 time: 0.177314 Sep 06 11:54:15.163183 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3456/6954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:14 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:16.196166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aa4f6b31-7dad-46af-8297-9b186c361e47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:16.196990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aa4f6b31-7dad-46af-8297-9b186c361e47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:16.204391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa4f6b31-7dad-46af-8297-9b186c361e47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:16.204926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa4f6b31-7dad-46af-8297-9b186c361e47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:16.205981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa4f6b31-7dad-46af-8297-9b186c361e47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:16.206722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa4f6b31-7dad-46af-8297-9b186c361e47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:16.207239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa4f6b31-7dad-46af-8297-9b186c361e47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:16.207694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa4f6b31-7dad-46af-8297-9b186c361e47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:16.352477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aa4f6b31-7dad-46af-8297-9b186c361e47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:16.361353 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aa4f6b31-7dad-46af-8297-9b186c361e47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1363 microversion: 2.1 time: 0.169334 Sep 06 11:54:16.361933 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3499/6955] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:16 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:17.384665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d539fd91-d27e-4f83-9a01-581d58947313 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:17.385230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d539fd91-d27e-4f83-9a01-581d58947313 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:17.392285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d539fd91-d27e-4f83-9a01-581d58947313 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:17.393290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d539fd91-d27e-4f83-9a01-581d58947313 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:17.393749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d539fd91-d27e-4f83-9a01-581d58947313 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:17.395648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d539fd91-d27e-4f83-9a01-581d58947313 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:17.396267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d539fd91-d27e-4f83-9a01-581d58947313 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:17.396778 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d539fd91-d27e-4f83-9a01-581d58947313 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:17.555979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d539fd91-d27e-4f83-9a01-581d58947313 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:17.563754 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d539fd91-d27e-4f83-9a01-581d58947313 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1363 microversion: 2.1 time: 0.183315 Sep 06 11:54:17.565123 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3457/6956] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:17 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:18.588503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe1aaa16-479b-40f4-b0d0-3abf5e4f02ba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:18.589848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe1aaa16-479b-40f4-b0d0-3abf5e4f02ba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:18.592894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:18.598797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe1aaa16-479b-40f4-b0d0-3abf5e4f02ba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:18.599352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe1aaa16-479b-40f4-b0d0-3abf5e4f02ba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:18.599820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe1aaa16-479b-40f4-b0d0-3abf5e4f02ba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:18.600571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe1aaa16-479b-40f4-b0d0-3abf5e4f02ba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:18.601061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe1aaa16-479b-40f4-b0d0-3abf5e4f02ba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:18.601515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe1aaa16-479b-40f4-b0d0-3abf5e4f02ba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:18.696279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-393de357-e0c5-4514-a7a9-0cf5789860d5 req-bf27cdf2-d82b-4f4d-ae03-69330af73530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda4f51b-3257-4bb0-81b8-a68cbda02294", "name": "network-vif-plugged", "status": "completed", "tag": "5af891e1-aa65-404e-bd37-e2e5bfe97743"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:18.705741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:18.711760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-393de357-e0c5-4514-a7a9-0cf5789860d5 req-bf27cdf2-d82b-4f4d-ae03-69330af73530 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:18.712255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-393de357-e0c5-4514-a7a9-0cf5789860d5 req-bf27cdf2-d82b-4f4d-ae03-69330af73530 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:18.712709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-393de357-e0c5-4514-a7a9-0cf5789860d5 req-bf27cdf2-d82b-4f4d-ae03-69330af73530 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:18.725333 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-393de357-e0c5-4514-a7a9-0cf5789860d5 req-bf27cdf2-d82b-4f4d-ae03-69330af73530 service nova] Creating event network-vif-plugged:5af891e1-aa65-404e-bd37-e2e5bfe97743 for instance dda4f51b-3257-4bb0-81b8-a68cbda02294 on nch1-master-1 Sep 06 11:54:18.735956 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-393de357-e0c5-4514-a7a9-0cf5789860d5 req-bf27cdf2-d82b-4f4d-ae03-69330af73530 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038855 Sep 06 11:54:18.735956 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3458/6957] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:54:18.765266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe1aaa16-479b-40f4-b0d0-3abf5e4f02ba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:18.777564 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe1aaa16-479b-40f4-b0d0-3abf5e4f02ba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1363 microversion: 2.1 time: 0.192832 Sep 06 11:54:18.781937 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3500/6958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:18 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:19.805695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cf55c9ac-4d97-4b72-aef8-85d1ea8fa3d4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:19.806429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cf55c9ac-4d97-4b72-aef8-85d1ea8fa3d4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:19.808536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:19.814896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf55c9ac-4d97-4b72-aef8-85d1ea8fa3d4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:19.815412 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf55c9ac-4d97-4b72-aef8-85d1ea8fa3d4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:19.815855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf55c9ac-4d97-4b72-aef8-85d1ea8fa3d4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:19.816633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf55c9ac-4d97-4b72-aef8-85d1ea8fa3d4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:19.817082 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf55c9ac-4d97-4b72-aef8-85d1ea8fa3d4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:19.817515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cf55c9ac-4d97-4b72-aef8-85d1ea8fa3d4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:20.000618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cf55c9ac-4d97-4b72-aef8-85d1ea8fa3d4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:20.010548 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cf55c9ac-4d97-4b72-aef8-85d1ea8fa3d4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1363 microversion: 2.1 time: 0.209442 Sep 06 11:54:20.015785 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3459/6959] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:19 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:21.038433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c13becc3-c388-47a7-b56a-b7dc43ea48fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:21.039342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c13becc3-c388-47a7-b56a-b7dc43ea48fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:21.046352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c13becc3-c388-47a7-b56a-b7dc43ea48fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:21.046870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c13becc3-c388-47a7-b56a-b7dc43ea48fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:21.047360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c13becc3-c388-47a7-b56a-b7dc43ea48fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:21.048095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c13becc3-c388-47a7-b56a-b7dc43ea48fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:21.048595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c13becc3-c388-47a7-b56a-b7dc43ea48fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:21.049030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c13becc3-c388-47a7-b56a-b7dc43ea48fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:21.216989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c13becc3-c388-47a7-b56a-b7dc43ea48fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:21.230633 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c13becc3-c388-47a7-b56a-b7dc43ea48fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1549 microversion: 2.1 time: 0.195871 Sep 06 11:54:21.231786 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3501/6960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:21 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1549 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:21.258605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b53b41b3-f6dd-4183-b615-2db1864d4b78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:21.259247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b53b41b3-f6dd-4183-b615-2db1864d4b78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:21.261565 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:54:21.261752 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 11:54:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294/os-interface (ip 10.222.0.20) !!! Sep 06 11:54:21.274780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b53b41b3-f6dd-4183-b615-2db1864d4b78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:21.275673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b53b41b3-f6dd-4183-b615-2db1864d4b78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:21.276207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b53b41b3-f6dd-4183-b615-2db1864d4b78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:21.276948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b53b41b3-f6dd-4183-b615-2db1864d4b78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:21.277419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b53b41b3-f6dd-4183-b615-2db1864d4b78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:21.277873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b53b41b3-f6dd-4183-b615-2db1864d4b78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:21.402625 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b53b41b3-f6dd-4183-b615-2db1864d4b78 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148043 Sep 06 11:54:21.403273 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3460/6961] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:54:21 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:54:22.593749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-9deb2353-5f77-4e9e-8e69-9efc73e8da6d req-061f0748-b32c-41f7-a936-38cabac89926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dda4f51b-3257-4bb0-81b8-a68cbda02294", "tag": "5af891e1-aa65-404e-bd37-e2e5bfe97743"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:22.602917 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:54:22.603250 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 11:54:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 06 11:54:22.614015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9deb2353-5f77-4e9e-8e69-9efc73e8da6d req-061f0748-b32c-41f7-a936-38cabac89926 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:22.614687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9deb2353-5f77-4e9e-8e69-9efc73e8da6d req-061f0748-b32c-41f7-a936-38cabac89926 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:22.615315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-9deb2353-5f77-4e9e-8e69-9efc73e8da6d req-061f0748-b32c-41f7-a936-38cabac89926 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:22.633649 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-9deb2353-5f77-4e9e-8e69-9efc73e8da6d req-061f0748-b32c-41f7-a936-38cabac89926 service nova] Creating event network-changed:5af891e1-aa65-404e-bd37-e2e5bfe97743 for instance dda4f51b-3257-4bb0-81b8-a68cbda02294 on nch1-master-1 Sep 06 11:54:22.639939 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-9deb2353-5f77-4e9e-8e69-9efc73e8da6d req-061f0748-b32c-41f7-a936-38cabac89926 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050631 Sep 06 11:54:22.640989 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3502/6962] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:54:56.466297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:56.467806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:56.474285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:56.480291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:56.491400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:56.491901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:56.492344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:56.493159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:56.493620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:56.494167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:56.536739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:56.544392 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Old instance type m1.heat2, new instance type m1.heat {{(pid=140875) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:54:56.552441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:54:56.557249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:54:56.557249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:54:56.557249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:54:56.557249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:54:56.920384 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a929481e-c4ed-4782-b7d2-e710bb4bf5c3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294/action" status: 202 len: 0 microversion: 2.1 time: 0.457551 Sep 06 11:54:56.921316 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3461/6963] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:54:56 2022] POST /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:54:56.929116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:56.932413 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:56.938717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b81414f1-8d80-4dd9-ba7c-b0cd52347b4a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:56.939435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b81414f1-8d80-4dd9-ba7c-b0cd52347b4a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:56.949193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b81414f1-8d80-4dd9-ba7c-b0cd52347b4a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:56.950049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b81414f1-8d80-4dd9-ba7c-b0cd52347b4a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:56.953897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b81414f1-8d80-4dd9-ba7c-b0cd52347b4a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:56.955975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b81414f1-8d80-4dd9-ba7c-b0cd52347b4a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:56.956822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b81414f1-8d80-4dd9-ba7c-b0cd52347b4a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:56.957585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b81414f1-8d80-4dd9-ba7c-b0cd52347b4a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:57.116067 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b81414f1-8d80-4dd9-ba7c-b0cd52347b4a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:57.127103 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b81414f1-8d80-4dd9-ba7c-b0cd52347b4a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1677 microversion: 2.1 time: 0.200739 Sep 06 11:54:57.127809 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3503/6964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:56 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:54:58.157159 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7bfb7b82-817d-412a-b2e1-f028322579de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:58.157962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7bfb7b82-817d-412a-b2e1-f028322579de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:58.164950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bfb7b82-817d-412a-b2e1-f028322579de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:58.165456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bfb7b82-817d-412a-b2e1-f028322579de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:58.165895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bfb7b82-817d-412a-b2e1-f028322579de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:58.166610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bfb7b82-817d-412a-b2e1-f028322579de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:58.167095 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bfb7b82-817d-412a-b2e1-f028322579de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:58.167536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7bfb7b82-817d-412a-b2e1-f028322579de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:58.326644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7bfb7b82-817d-412a-b2e1-f028322579de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:58.336035 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7bfb7b82-817d-412a-b2e1-f028322579de tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1677 microversion: 2.1 time: 0.184332 Sep 06 11:54:58.336631 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3462/6965] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:58 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:54:59.361645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a93d5217-8850-42b6-a9c6-b016a85f8780 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:59.362260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a93d5217-8850-42b6-a9c6-b016a85f8780 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:59.370085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a93d5217-8850-42b6-a9c6-b016a85f8780 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:59.370581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a93d5217-8850-42b6-a9c6-b016a85f8780 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:59.371123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a93d5217-8850-42b6-a9c6-b016a85f8780 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:59.371837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a93d5217-8850-42b6-a9c6-b016a85f8780 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:59.372312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a93d5217-8850-42b6-a9c6-b016a85f8780 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:59.372757 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a93d5217-8850-42b6-a9c6-b016a85f8780 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:59.511500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a93d5217-8850-42b6-a9c6-b016a85f8780 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:59.521135 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a93d5217-8850-42b6-a9c6-b016a85f8780 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1677 microversion: 2.1 time: 0.163623 Sep 06 11:54:59.521781 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3504/6966] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:59 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:00.545310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a8bc1539-6fb7-46a8-9bc1-e938c443fa46 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:00.545953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a8bc1539-6fb7-46a8-9bc1-e938c443fa46 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:00.559995 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8bc1539-6fb7-46a8-9bc1-e938c443fa46 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:00.560933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8bc1539-6fb7-46a8-9bc1-e938c443fa46 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:00.561535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8bc1539-6fb7-46a8-9bc1-e938c443fa46 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:00.562966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8bc1539-6fb7-46a8-9bc1-e938c443fa46 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:00.563665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8bc1539-6fb7-46a8-9bc1-e938c443fa46 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:00.564114 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8bc1539-6fb7-46a8-9bc1-e938c443fa46 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:00.793783 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a8bc1539-6fb7-46a8-9bc1-e938c443fa46 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:00.805916 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a8bc1539-6fb7-46a8-9bc1-e938c443fa46 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1677 microversion: 2.1 time: 0.263826 Sep 06 11:55:00.806732 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3463/6967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:00 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1677 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:01.833071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f9b5ec9e-2212-4615-9516-a26413afc6d7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:01.833754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f9b5ec9e-2212-4615-9516-a26413afc6d7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:01.841930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9b5ec9e-2212-4615-9516-a26413afc6d7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:01.842469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9b5ec9e-2212-4615-9516-a26413afc6d7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:01.842985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9b5ec9e-2212-4615-9516-a26413afc6d7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:01.851702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9b5ec9e-2212-4615-9516-a26413afc6d7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:01.851702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9b5ec9e-2212-4615-9516-a26413afc6d7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:01.851702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f9b5ec9e-2212-4615-9516-a26413afc6d7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:01.984076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f9b5ec9e-2212-4615-9516-a26413afc6d7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:01.992933 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f9b5ec9e-2212-4615-9516-a26413afc6d7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1682 microversion: 2.1 time: 0.164030 Sep 06 11:55:01.993537 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3505/6968] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:01 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:03.018363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2ff1a88b-73c3-4f4b-8a37-a64fca88c42a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:03.019262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2ff1a88b-73c3-4f4b-8a37-a64fca88c42a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:03.026527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ff1a88b-73c3-4f4b-8a37-a64fca88c42a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:03.027051 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ff1a88b-73c3-4f4b-8a37-a64fca88c42a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:03.027498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ff1a88b-73c3-4f4b-8a37-a64fca88c42a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:03.028208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ff1a88b-73c3-4f4b-8a37-a64fca88c42a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:03.028664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ff1a88b-73c3-4f4b-8a37-a64fca88c42a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:03.029098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ff1a88b-73c3-4f4b-8a37-a64fca88c42a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:03.169920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2ff1a88b-73c3-4f4b-8a37-a64fca88c42a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:03.179230 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2ff1a88b-73c3-4f4b-8a37-a64fca88c42a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1682 microversion: 2.1 time: 0.165164 Sep 06 11:55:03.179822 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3464/6969] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:03 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:04.205806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d44b8488-496a-4f93-b43e-1e525589b7e6 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:04.206389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d44b8488-496a-4f93-b43e-1e525589b7e6 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:04.214514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d44b8488-496a-4f93-b43e-1e525589b7e6 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:04.215050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d44b8488-496a-4f93-b43e-1e525589b7e6 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:04.215518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d44b8488-496a-4f93-b43e-1e525589b7e6 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:04.216260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d44b8488-496a-4f93-b43e-1e525589b7e6 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:04.216739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d44b8488-496a-4f93-b43e-1e525589b7e6 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:04.217192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d44b8488-496a-4f93-b43e-1e525589b7e6 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:04.352177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d44b8488-496a-4f93-b43e-1e525589b7e6 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:04.360530 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d44b8488-496a-4f93-b43e-1e525589b7e6 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1682 microversion: 2.1 time: 0.158852 Sep 06 11:55:04.361117 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3506/6970] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:04 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:05.384945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-71b57297-f8e0-4c8f-b045-67347f8581f0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:05.385571 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-71b57297-f8e0-4c8f-b045-67347f8581f0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:05.393252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71b57297-f8e0-4c8f-b045-67347f8581f0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:05.393789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71b57297-f8e0-4c8f-b045-67347f8581f0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:05.394298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71b57297-f8e0-4c8f-b045-67347f8581f0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:05.395099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71b57297-f8e0-4c8f-b045-67347f8581f0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:05.396109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71b57297-f8e0-4c8f-b045-67347f8581f0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:05.396549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-71b57297-f8e0-4c8f-b045-67347f8581f0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:05.531317 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-71b57297-f8e0-4c8f-b045-67347f8581f0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:05.540013 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-71b57297-f8e0-4c8f-b045-67347f8581f0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1682 microversion: 2.1 time: 0.158954 Sep 06 11:55:05.540608 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3465/6971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:05 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:06.564223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-af27ea55-3e01-4a73-8e43-8c43acaf6016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:06.564882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-af27ea55-3e01-4a73-8e43-8c43acaf6016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:06.572166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af27ea55-3e01-4a73-8e43-8c43acaf6016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:06.572699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af27ea55-3e01-4a73-8e43-8c43acaf6016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:06.573156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af27ea55-3e01-4a73-8e43-8c43acaf6016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:06.573885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af27ea55-3e01-4a73-8e43-8c43acaf6016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:06.574364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af27ea55-3e01-4a73-8e43-8c43acaf6016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:06.574809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af27ea55-3e01-4a73-8e43-8c43acaf6016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:06.715128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-af27ea55-3e01-4a73-8e43-8c43acaf6016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:06.723061 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-af27ea55-3e01-4a73-8e43-8c43acaf6016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1682 microversion: 2.1 time: 0.162883 Sep 06 11:55:06.724294 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3507/6972] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:06 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:07.747548 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-be75643d-df83-4b64-a14e-5208c89f28b5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:07.748107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-be75643d-df83-4b64-a14e-5208c89f28b5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:07.755468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be75643d-df83-4b64-a14e-5208c89f28b5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:07.755963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be75643d-df83-4b64-a14e-5208c89f28b5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:07.756407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be75643d-df83-4b64-a14e-5208c89f28b5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:07.757119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be75643d-df83-4b64-a14e-5208c89f28b5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:07.757578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be75643d-df83-4b64-a14e-5208c89f28b5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:07.758011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-be75643d-df83-4b64-a14e-5208c89f28b5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:07.920820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-be75643d-df83-4b64-a14e-5208c89f28b5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:07.931035 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-be75643d-df83-4b64-a14e-5208c89f28b5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1682 microversion: 2.1 time: 0.187967 Sep 06 11:55:07.931638 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3466/6973] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:07 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:08.961439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-167f7581-40b1-4093-a210-cfbde3db0bec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:08.962142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-167f7581-40b1-4093-a210-cfbde3db0bec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:08.970362 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-167f7581-40b1-4093-a210-cfbde3db0bec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:08.970915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-167f7581-40b1-4093-a210-cfbde3db0bec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:08.971517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-167f7581-40b1-4093-a210-cfbde3db0bec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:08.972467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-167f7581-40b1-4093-a210-cfbde3db0bec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:08.973085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-167f7581-40b1-4093-a210-cfbde3db0bec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:08.973930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-167f7581-40b1-4093-a210-cfbde3db0bec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:09.128557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-167f7581-40b1-4093-a210-cfbde3db0bec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:09.140488 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-167f7581-40b1-4093-a210-cfbde3db0bec tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1682 microversion: 2.1 time: 0.183626 Sep 06 11:55:09.141356 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3508/6974] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:08 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:10.176396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a8527b5c-b5bc-4d18-835a-bdef4868d295 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:10.177346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a8527b5c-b5bc-4d18-835a-bdef4868d295 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:10.186536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8527b5c-b5bc-4d18-835a-bdef4868d295 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:10.187196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8527b5c-b5bc-4d18-835a-bdef4868d295 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:10.187891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8527b5c-b5bc-4d18-835a-bdef4868d295 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:10.188694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8527b5c-b5bc-4d18-835a-bdef4868d295 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:10.189249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8527b5c-b5bc-4d18-835a-bdef4868d295 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:10.189773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a8527b5c-b5bc-4d18-835a-bdef4868d295 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:10.361521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a8527b5c-b5bc-4d18-835a-bdef4868d295 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:10.370332 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a8527b5c-b5bc-4d18-835a-bdef4868d295 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1682 microversion: 2.1 time: 0.201324 Sep 06 11:55:10.370918 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3467/6975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:10 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:11.395871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-facf6473-327b-484d-84bb-c81fa447e0d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:11.396563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-facf6473-327b-484d-84bb-c81fa447e0d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:11.404023 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-facf6473-327b-484d-84bb-c81fa447e0d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:11.404536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-facf6473-327b-484d-84bb-c81fa447e0d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:11.405002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-facf6473-327b-484d-84bb-c81fa447e0d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:11.405736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-facf6473-327b-484d-84bb-c81fa447e0d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:11.406224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-facf6473-327b-484d-84bb-c81fa447e0d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:11.406679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-facf6473-327b-484d-84bb-c81fa447e0d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:11.580455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-facf6473-327b-484d-84bb-c81fa447e0d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:11.589433 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-facf6473-327b-484d-84bb-c81fa447e0d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1682 microversion: 2.1 time: 0.198633 Sep 06 11:55:11.589981 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3509/6976] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:11 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:12.616900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2af7222a-de72-4494-8611-104f314e62d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:12.618140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2af7222a-de72-4494-8611-104f314e62d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:12.629568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2af7222a-de72-4494-8611-104f314e62d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:12.630071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2af7222a-de72-4494-8611-104f314e62d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:12.630530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2af7222a-de72-4494-8611-104f314e62d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:12.631301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2af7222a-de72-4494-8611-104f314e62d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:12.631780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2af7222a-de72-4494-8611-104f314e62d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:12.632236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2af7222a-de72-4494-8611-104f314e62d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:12.793261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2af7222a-de72-4494-8611-104f314e62d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:12.803529 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2af7222a-de72-4494-8611-104f314e62d9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1682 microversion: 2.1 time: 0.193331 Sep 06 11:55:12.804236 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3468/6977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:12 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:13.834756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3fd81e34-3809-4628-b701-5f9be9bfdc24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:13.842512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3fd81e34-3809-4628-b701-5f9be9bfdc24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:13.843616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fd81e34-3809-4628-b701-5f9be9bfdc24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:13.844556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fd81e34-3809-4628-b701-5f9be9bfdc24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:13.845057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fd81e34-3809-4628-b701-5f9be9bfdc24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:13.845825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fd81e34-3809-4628-b701-5f9be9bfdc24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:13.846318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fd81e34-3809-4628-b701-5f9be9bfdc24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:13.846774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fd81e34-3809-4628-b701-5f9be9bfdc24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:14.008840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3fd81e34-3809-4628-b701-5f9be9bfdc24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:14.017486 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3fd81e34-3809-4628-b701-5f9be9bfdc24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1682 microversion: 2.1 time: 0.187953 Sep 06 11:55:14.018099 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3510/6978] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:13 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:15.013396 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-bf113006-29de-428f-87ea-4b28301a5865 req-114b9900-cb77-466b-843d-ee2a47e531c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda4f51b-3257-4bb0-81b8-a68cbda02294", "name": "network-vif-unplugged", "status": "completed", "tag": "5af891e1-aa65-404e-bd37-e2e5bfe97743"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:15.028951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bf113006-29de-428f-87ea-4b28301a5865 req-114b9900-cb77-466b-843d-ee2a47e531c5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:15.029448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bf113006-29de-428f-87ea-4b28301a5865 req-114b9900-cb77-466b-843d-ee2a47e531c5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:15.029893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bf113006-29de-428f-87ea-4b28301a5865 req-114b9900-cb77-466b-843d-ee2a47e531c5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:15.044536 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-bf113006-29de-428f-87ea-4b28301a5865 req-114b9900-cb77-466b-843d-ee2a47e531c5 service nova] Creating event network-vif-unplugged:5af891e1-aa65-404e-bd37-e2e5bfe97743 for instance dda4f51b-3257-4bb0-81b8-a68cbda02294 on nch2-master-1 Sep 06 11:55:15.048654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0f9baf6c-4c44-4317-b1e7-be72383033db tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:15.048654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0f9baf6c-4c44-4317-b1e7-be72383033db tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:15.050887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-bf113006-29de-428f-87ea-4b28301a5865 req-114b9900-cb77-466b-843d-ee2a47e531c5 service nova] Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:55:15.057506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f9baf6c-4c44-4317-b1e7-be72383033db tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:15.058725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f9baf6c-4c44-4317-b1e7-be72383033db tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:15.059321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f9baf6c-4c44-4317-b1e7-be72383033db tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:15.060223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f9baf6c-4c44-4317-b1e7-be72383033db tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:15.061401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f9baf6c-4c44-4317-b1e7-be72383033db tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:15.062164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0f9baf6c-4c44-4317-b1e7-be72383033db tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:15.062947 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-bf113006-29de-428f-87ea-4b28301a5865 req-114b9900-cb77-466b-843d-ee2a47e531c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055942 Sep 06 11:55:15.063613 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3469/6979] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:55:15.235095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0f9baf6c-4c44-4317-b1e7-be72383033db tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:15.243795 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0f9baf6c-4c44-4317-b1e7-be72383033db tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1681 microversion: 2.1 time: 0.204592 Sep 06 11:55:15.255191 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3511/6980] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:15 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:16.281011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-72034fda-1168-4739-b70e-966c7fcab7fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:16.281898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-72034fda-1168-4739-b70e-966c7fcab7fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:16.290670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72034fda-1168-4739-b70e-966c7fcab7fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:16.291352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72034fda-1168-4739-b70e-966c7fcab7fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:16.291987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72034fda-1168-4739-b70e-966c7fcab7fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:16.292980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72034fda-1168-4739-b70e-966c7fcab7fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:16.293587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72034fda-1168-4739-b70e-966c7fcab7fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:16.294228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-72034fda-1168-4739-b70e-966c7fcab7fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:16.470418 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-72034fda-1168-4739-b70e-966c7fcab7fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:16.486030 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-72034fda-1168-4739-b70e-966c7fcab7fb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1681 microversion: 2.1 time: 0.210866 Sep 06 11:55:16.487207 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3470/6981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:16 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:17.078041 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-feeafa5f-d8e5-42f0-ad58-2174d51e7e37 req-f0561815-07f2-4bbf-8895-af66afaf3712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dda4f51b-3257-4bb0-81b8-a68cbda02294", "tag": "5af891e1-aa65-404e-bd37-e2e5bfe97743"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:17.089946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-feeafa5f-d8e5-42f0-ad58-2174d51e7e37 req-f0561815-07f2-4bbf-8895-af66afaf3712 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:17.090446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-feeafa5f-d8e5-42f0-ad58-2174d51e7e37 req-f0561815-07f2-4bbf-8895-af66afaf3712 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:17.090897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-feeafa5f-d8e5-42f0-ad58-2174d51e7e37 req-f0561815-07f2-4bbf-8895-af66afaf3712 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:17.108201 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-feeafa5f-d8e5-42f0-ad58-2174d51e7e37 req-f0561815-07f2-4bbf-8895-af66afaf3712 service nova] Creating event network-changed:5af891e1-aa65-404e-bd37-e2e5bfe97743 for instance dda4f51b-3257-4bb0-81b8-a68cbda02294 on nch2-master-1 Sep 06 11:55:17.115444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-feeafa5f-d8e5-42f0-ad58-2174d51e7e37 req-f0561815-07f2-4bbf-8895-af66afaf3712 service nova] Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:55:17.128855 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-feeafa5f-d8e5-42f0-ad58-2174d51e7e37 req-f0561815-07f2-4bbf-8895-af66afaf3712 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054766 Sep 06 11:55:17.129487 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3512/6982] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:55:17.525237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8847d62d-9eee-4f33-8617-a1d69be8dcdc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:17.526390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8847d62d-9eee-4f33-8617-a1d69be8dcdc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:17.539722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8847d62d-9eee-4f33-8617-a1d69be8dcdc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:17.539722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8847d62d-9eee-4f33-8617-a1d69be8dcdc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:17.539722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8847d62d-9eee-4f33-8617-a1d69be8dcdc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:17.539722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8847d62d-9eee-4f33-8617-a1d69be8dcdc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:17.540154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8847d62d-9eee-4f33-8617-a1d69be8dcdc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:17.540561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8847d62d-9eee-4f33-8617-a1d69be8dcdc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:17.734848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8847d62d-9eee-4f33-8617-a1d69be8dcdc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:17.747853 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8847d62d-9eee-4f33-8617-a1d69be8dcdc tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1679 microversion: 2.1 time: 0.228638 Sep 06 11:55:17.748473 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3471/6983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:17 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:18.776366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f60ba180-b6fd-468a-8424-10aa7ebd9240 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:18.777291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f60ba180-b6fd-468a-8424-10aa7ebd9240 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:18.786149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f60ba180-b6fd-468a-8424-10aa7ebd9240 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:18.795786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f60ba180-b6fd-468a-8424-10aa7ebd9240 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:18.795786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f60ba180-b6fd-468a-8424-10aa7ebd9240 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:18.795786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f60ba180-b6fd-468a-8424-10aa7ebd9240 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:18.795786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f60ba180-b6fd-468a-8424-10aa7ebd9240 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:18.795786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f60ba180-b6fd-468a-8424-10aa7ebd9240 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:18.977772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f60ba180-b6fd-468a-8424-10aa7ebd9240 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:18.990303 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f60ba180-b6fd-468a-8424-10aa7ebd9240 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1676 microversion: 2.1 time: 0.219845 Sep 06 11:55:18.991260 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3513/6984] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:18 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1676 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:19.030102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:19.031131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:19.041220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:19.041947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:19.042426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:19.043523 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:19.044289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:19.045002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:19.108576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:19.109107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:19.109573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:19.110339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:19.110810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:19.111282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:19.135232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'ram', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:55:19.146094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for user 3d09c9d5440c4987a99e81bfed501cb5 and project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'ram', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:55:19.667964 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-811bb002-199f-4dfc-9181-fb445ff96565 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294/action" status: 202 len: 0 microversion: 2.1 time: 0.643547 Sep 06 11:55:19.669330 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3472/6985] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:55:19 2022] POST /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:55:19.682333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-374cbba6-b091-423c-b3d4-97dd59174e83 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:19.683756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-374cbba6-b091-423c-b3d4-97dd59174e83 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:19.694347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-374cbba6-b091-423c-b3d4-97dd59174e83 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:19.694868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-374cbba6-b091-423c-b3d4-97dd59174e83 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:19.695380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-374cbba6-b091-423c-b3d4-97dd59174e83 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:19.696119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-374cbba6-b091-423c-b3d4-97dd59174e83 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:19.696603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-374cbba6-b091-423c-b3d4-97dd59174e83 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:19.697062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-374cbba6-b091-423c-b3d4-97dd59174e83 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:19.866956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-374cbba6-b091-423c-b3d4-97dd59174e83 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:19.880023 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-374cbba6-b091-423c-b3d4-97dd59174e83 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1675 microversion: 2.1 time: 0.202465 Sep 06 11:55:19.887072 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3514/6986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:19 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1675 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:55:20.921534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c6c47aa-750d-4a88-bc2c-8ade59deb24d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:20.924010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c6c47aa-750d-4a88-bc2c-8ade59deb24d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:20.933792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c6c47aa-750d-4a88-bc2c-8ade59deb24d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:20.934298 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c6c47aa-750d-4a88-bc2c-8ade59deb24d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:20.934856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c6c47aa-750d-4a88-bc2c-8ade59deb24d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:20.935611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c6c47aa-750d-4a88-bc2c-8ade59deb24d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:20.936072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c6c47aa-750d-4a88-bc2c-8ade59deb24d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:20.936504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c6c47aa-750d-4a88-bc2c-8ade59deb24d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:20.962519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:21.115517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2c6c47aa-750d-4a88-bc2c-8ade59deb24d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:21.128040 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c6c47aa-750d-4a88-bc2c-8ade59deb24d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1675 microversion: 2.1 time: 0.225026 Sep 06 11:55:21.129070 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3473/6987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:20 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:55:22.156754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e7cd60eb-588e-40ff-964a-293f0d38f797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:22.157665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e7cd60eb-588e-40ff-964a-293f0d38f797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:22.169432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7cd60eb-588e-40ff-964a-293f0d38f797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:22.169962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7cd60eb-588e-40ff-964a-293f0d38f797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:22.170701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7cd60eb-588e-40ff-964a-293f0d38f797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:22.171968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7cd60eb-588e-40ff-964a-293f0d38f797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:22.172838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7cd60eb-588e-40ff-964a-293f0d38f797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:22.173399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e7cd60eb-588e-40ff-964a-293f0d38f797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:22.370233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e7cd60eb-588e-40ff-964a-293f0d38f797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:22.379543 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e7cd60eb-588e-40ff-964a-293f0d38f797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1675 microversion: 2.1 time: 0.228055 Sep 06 11:55:22.380461 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3515/6988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:22 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:22.783975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e9d6da2c-55b2-47ef-9660-f931bfe5a3a9 req-3a203c2d-779d-4dd0-874a-912449b83550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda4f51b-3257-4bb0-81b8-a68cbda02294", "name": "network-vif-plugged", "status": "completed", "tag": "5af891e1-aa65-404e-bd37-e2e5bfe97743"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:22.807256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e9d6da2c-55b2-47ef-9660-f931bfe5a3a9 req-3a203c2d-779d-4dd0-874a-912449b83550 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:22.808058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e9d6da2c-55b2-47ef-9660-f931bfe5a3a9 req-3a203c2d-779d-4dd0-874a-912449b83550 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:22.808791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e9d6da2c-55b2-47ef-9660-f931bfe5a3a9 req-3a203c2d-779d-4dd0-874a-912449b83550 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:22.824553 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e9d6da2c-55b2-47ef-9660-f931bfe5a3a9 req-3a203c2d-779d-4dd0-874a-912449b83550 service nova] Creating event network-vif-plugged:5af891e1-aa65-404e-bd37-e2e5bfe97743 for instance dda4f51b-3257-4bb0-81b8-a68cbda02294 on nch2-master-1 Sep 06 11:55:22.831077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-e9d6da2c-55b2-47ef-9660-f931bfe5a3a9 req-3a203c2d-779d-4dd0-874a-912449b83550 service nova] Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:55:22.843361 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e9d6da2c-55b2-47ef-9660-f931bfe5a3a9 req-3a203c2d-779d-4dd0-874a-912449b83550 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065087 Sep 06 11:55:22.844027 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3474/6989] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:55:23.414274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e4482bd5-d14e-4287-9c3d-a90d7c81b1bb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:23.415429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e4482bd5-d14e-4287-9c3d-a90d7c81b1bb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:23.426081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4482bd5-d14e-4287-9c3d-a90d7c81b1bb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:23.427511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4482bd5-d14e-4287-9c3d-a90d7c81b1bb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:23.428122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4482bd5-d14e-4287-9c3d-a90d7c81b1bb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:23.429352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4482bd5-d14e-4287-9c3d-a90d7c81b1bb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:23.430119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4482bd5-d14e-4287-9c3d-a90d7c81b1bb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:23.430805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4482bd5-d14e-4287-9c3d-a90d7c81b1bb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:23.640587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e4482bd5-d14e-4287-9c3d-a90d7c81b1bb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:23.652839 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e4482bd5-d14e-4287-9c3d-a90d7c81b1bb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1675 microversion: 2.1 time: 0.246606 Sep 06 11:55:23.653459 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3516/6990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:23 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1675 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:24.291227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e1aad12a-8ef8-441f-9fb1-f7a68f23c606 req-00ad19f5-9ee3-4e13-94b1-dc761c54027a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda4f51b-3257-4bb0-81b8-a68cbda02294", "name": "network-vif-unplugged", "status": "completed", "tag": "5af891e1-aa65-404e-bd37-e2e5bfe97743"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:24.309809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e1aad12a-8ef8-441f-9fb1-f7a68f23c606 req-00ad19f5-9ee3-4e13-94b1-dc761c54027a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:24.311858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e1aad12a-8ef8-441f-9fb1-f7a68f23c606 req-00ad19f5-9ee3-4e13-94b1-dc761c54027a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:24.311858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e1aad12a-8ef8-441f-9fb1-f7a68f23c606 req-00ad19f5-9ee3-4e13-94b1-dc761c54027a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:24.334888 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e1aad12a-8ef8-441f-9fb1-f7a68f23c606 req-00ad19f5-9ee3-4e13-94b1-dc761c54027a service nova] Creating event network-vif-unplugged:5af891e1-aa65-404e-bd37-e2e5bfe97743 for instance dda4f51b-3257-4bb0-81b8-a68cbda02294 on nch1-master-1 Sep 06 11:55:24.344904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-e1aad12a-8ef8-441f-9fb1-f7a68f23c606 req-00ad19f5-9ee3-4e13-94b1-dc761c54027a service nova] Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:55:24.363364 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e1aad12a-8ef8-441f-9fb1-f7a68f23c606 req-00ad19f5-9ee3-4e13-94b1-dc761c54027a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080304 Sep 06 11:55:24.364589 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3475/6991] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:55:24.690463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ec24dca9-1c08-4da7-8355-05fab0fe7685 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:24.693548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ec24dca9-1c08-4da7-8355-05fab0fe7685 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:24.703335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec24dca9-1c08-4da7-8355-05fab0fe7685 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:24.708209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec24dca9-1c08-4da7-8355-05fab0fe7685 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:24.708209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec24dca9-1c08-4da7-8355-05fab0fe7685 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:24.708209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec24dca9-1c08-4da7-8355-05fab0fe7685 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:24.708209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec24dca9-1c08-4da7-8355-05fab0fe7685 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:24.708209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ec24dca9-1c08-4da7-8355-05fab0fe7685 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:24.899483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ec24dca9-1c08-4da7-8355-05fab0fe7685 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:24.903886 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ec24dca9-1c08-4da7-8355-05fab0fe7685 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1675 microversion: 2.1 time: 0.221100 Sep 06 11:55:24.904789 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3517/6992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:24 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1675 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:25.948094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-53ae4120-1bb9-4ce4-82c9-92a8d72cd2fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:25.949439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-53ae4120-1bb9-4ce4-82c9-92a8d72cd2fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:25.961126 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53ae4120-1bb9-4ce4-82c9-92a8d72cd2fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:25.961640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53ae4120-1bb9-4ce4-82c9-92a8d72cd2fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:25.962591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53ae4120-1bb9-4ce4-82c9-92a8d72cd2fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:25.963379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53ae4120-1bb9-4ce4-82c9-92a8d72cd2fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:25.964310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53ae4120-1bb9-4ce4-82c9-92a8d72cd2fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:25.965934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-53ae4120-1bb9-4ce4-82c9-92a8d72cd2fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:26.127798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-53ae4120-1bb9-4ce4-82c9-92a8d72cd2fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:26.149656 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-53ae4120-1bb9-4ce4-82c9-92a8d72cd2fa tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1675 microversion: 2.1 time: 0.210976 Sep 06 11:55:26.150859 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3476/6993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:25 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1675 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:55:26.383476 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-5f8ce042-fae1-4ad7-a0fe-5fcc3b93d72c req-769b8369-92fb-4105-b6a7-e8d0c8c0323b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dda4f51b-3257-4bb0-81b8-a68cbda02294", "tag": "5af891e1-aa65-404e-bd37-e2e5bfe97743"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:26.401613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5f8ce042-fae1-4ad7-a0fe-5fcc3b93d72c req-769b8369-92fb-4105-b6a7-e8d0c8c0323b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:26.402400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5f8ce042-fae1-4ad7-a0fe-5fcc3b93d72c req-769b8369-92fb-4105-b6a7-e8d0c8c0323b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:26.403230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5f8ce042-fae1-4ad7-a0fe-5fcc3b93d72c req-769b8369-92fb-4105-b6a7-e8d0c8c0323b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:26.424165 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-5f8ce042-fae1-4ad7-a0fe-5fcc3b93d72c req-769b8369-92fb-4105-b6a7-e8d0c8c0323b service nova] Creating event network-changed:5af891e1-aa65-404e-bd37-e2e5bfe97743 for instance dda4f51b-3257-4bb0-81b8-a68cbda02294 on nch1-master-1 Sep 06 11:55:26.432159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-5f8ce042-fae1-4ad7-a0fe-5fcc3b93d72c req-769b8369-92fb-4105-b6a7-e8d0c8c0323b service nova] Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:55:26.451425 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-5f8ce042-fae1-4ad7-a0fe-5fcc3b93d72c req-769b8369-92fb-4105-b6a7-e8d0c8c0323b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075030 Sep 06 11:55:26.452575 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3518/6994] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:55:27.174889 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f710dfed-702b-4a12-b3ba-55412fe9a175 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:27.175647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f710dfed-702b-4a12-b3ba-55412fe9a175 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:27.185325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:27.193622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f710dfed-702b-4a12-b3ba-55412fe9a175 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:27.194423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f710dfed-702b-4a12-b3ba-55412fe9a175 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:27.194954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f710dfed-702b-4a12-b3ba-55412fe9a175 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:27.195801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f710dfed-702b-4a12-b3ba-55412fe9a175 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:27.196372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f710dfed-702b-4a12-b3ba-55412fe9a175 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:27.196823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f710dfed-702b-4a12-b3ba-55412fe9a175 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:27.391492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f710dfed-702b-4a12-b3ba-55412fe9a175 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:27.402389 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f710dfed-702b-4a12-b3ba-55412fe9a175 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1675 microversion: 2.1 time: 0.231448 Sep 06 11:55:27.403316 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3477/6995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:27 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:55:28.437737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f53bba94-954b-4929-8b96-4d411a4e2f59 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:28.438543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f53bba94-954b-4929-8b96-4d411a4e2f59 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:28.445350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f53bba94-954b-4929-8b96-4d411a4e2f59 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:28.445855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f53bba94-954b-4929-8b96-4d411a4e2f59 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:28.446313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f53bba94-954b-4929-8b96-4d411a4e2f59 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:28.447070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f53bba94-954b-4929-8b96-4d411a4e2f59 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:28.447538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f53bba94-954b-4929-8b96-4d411a4e2f59 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:28.448284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f53bba94-954b-4929-8b96-4d411a4e2f59 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:28.643797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f53bba94-954b-4929-8b96-4d411a4e2f59 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:28.657466 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f53bba94-954b-4929-8b96-4d411a4e2f59 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1668 microversion: 2.1 time: 0.224776 Sep 06 11:55:28.658546 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3519/6996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:28 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1668 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:28.694319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9158de43-ac53-450b-bc23-f06083c78c47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:28.694868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9158de43-ac53-450b-bc23-f06083c78c47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:28.704904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9158de43-ac53-450b-bc23-f06083c78c47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:28.705583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9158de43-ac53-450b-bc23-f06083c78c47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:28.706037 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9158de43-ac53-450b-bc23-f06083c78c47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:28.706766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9158de43-ac53-450b-bc23-f06083c78c47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:28.707267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9158de43-ac53-450b-bc23-f06083c78c47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:28.708320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9158de43-ac53-450b-bc23-f06083c78c47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:28.907151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9158de43-ac53-450b-bc23-f06083c78c47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:28.919731 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9158de43-ac53-450b-bc23-f06083c78c47 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1668 microversion: 2.1 time: 0.229060 Sep 06 11:55:28.920748 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3478/6997] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:28 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1668 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:28.960600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7c1a5523-085a-489b-b4ec-8c8fc8aac4da tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:28.961604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7c1a5523-085a-489b-b4ec-8c8fc8aac4da tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:28.970962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c1a5523-085a-489b-b4ec-8c8fc8aac4da tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:28.971855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c1a5523-085a-489b-b4ec-8c8fc8aac4da tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:28.972585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c1a5523-085a-489b-b4ec-8c8fc8aac4da tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:28.974203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c1a5523-085a-489b-b4ec-8c8fc8aac4da tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:28.975072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c1a5523-085a-489b-b4ec-8c8fc8aac4da tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:28.975684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c1a5523-085a-489b-b4ec-8c8fc8aac4da tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:28.984255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=100 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:29.159506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7c1a5523-085a-489b-b4ec-8c8fc8aac4da tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:29.172138 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7c1a5523-085a-489b-b4ec-8c8fc8aac4da tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1668 microversion: 2.1 time: 0.217056 Sep 06 11:55:29.173176 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3520/6998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:28 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1668 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:29.201608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bff6c084-b11d-4b09-ab27-76d2701d1828 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:29.201608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bff6c084-b11d-4b09-ab27-76d2701d1828 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:29.204788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:29.214040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bff6c084-b11d-4b09-ab27-76d2701d1828 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:29.214564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bff6c084-b11d-4b09-ab27-76d2701d1828 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:29.215121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bff6c084-b11d-4b09-ab27-76d2701d1828 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:29.215868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bff6c084-b11d-4b09-ab27-76d2701d1828 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:29.216339 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bff6c084-b11d-4b09-ab27-76d2701d1828 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:29.216787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bff6c084-b11d-4b09-ab27-76d2701d1828 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:29.265919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bff6c084-b11d-4b09-ab27-76d2701d1828 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:55:29.747306 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bff6c084-b11d-4b09-ab27-76d2701d1828 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 204 len: 0 microversion: 2.1 time: 0.554412 Sep 06 11:55:29.748029 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3479/6999] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:55:29 2022] DELETE /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:55:29.766689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a4b702bd-1c22-4ebf-8748-4b0d9c0fb3e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:29.767887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a4b702bd-1c22-4ebf-8748-4b0d9c0fb3e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:29.773621 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=37 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:29.782392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4b702bd-1c22-4ebf-8748-4b0d9c0fb3e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:29.783149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4b702bd-1c22-4ebf-8748-4b0d9c0fb3e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:29.783725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4b702bd-1c22-4ebf-8748-4b0d9c0fb3e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:29.784495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4b702bd-1c22-4ebf-8748-4b0d9c0fb3e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:29.785240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4b702bd-1c22-4ebf-8748-4b0d9c0fb3e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:29.786842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a4b702bd-1c22-4ebf-8748-4b0d9c0fb3e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:29.967645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a4b702bd-1c22-4ebf-8748-4b0d9c0fb3e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:29.976082 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a4b702bd-1c22-4ebf-8748-4b0d9c0fb3e2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1674 microversion: 2.1 time: 0.221043 Sep 06 11:55:29.976674 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3521/7000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:29 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:55:31.021838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c91cb46-91bc-4506-87e7-e09f938125fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:31.022841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c91cb46-91bc-4506-87e7-e09f938125fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:31.034726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c91cb46-91bc-4506-87e7-e09f938125fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:31.035319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c91cb46-91bc-4506-87e7-e09f938125fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:31.036073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c91cb46-91bc-4506-87e7-e09f938125fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:31.037026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c91cb46-91bc-4506-87e7-e09f938125fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:31.037746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c91cb46-91bc-4506-87e7-e09f938125fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:31.038195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c91cb46-91bc-4506-87e7-e09f938125fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:31.136900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-2fbd1410-b14a-4602-9849-cc6a82af2d95 req-ab7cbabd-cc0c-4d61-82fb-f669bd2a1c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda4f51b-3257-4bb0-81b8-a68cbda02294", "name": "network-vif-plugged", "status": "completed", "tag": "5af891e1-aa65-404e-bd37-e2e5bfe97743"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:31.152820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2fbd1410-b14a-4602-9849-cc6a82af2d95 req-ab7cbabd-cc0c-4d61-82fb-f669bd2a1c14 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:31.154180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2fbd1410-b14a-4602-9849-cc6a82af2d95 req-ab7cbabd-cc0c-4d61-82fb-f669bd2a1c14 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:31.154971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2fbd1410-b14a-4602-9849-cc6a82af2d95 req-ab7cbabd-cc0c-4d61-82fb-f669bd2a1c14 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:31.177390 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-2fbd1410-b14a-4602-9849-cc6a82af2d95 req-ab7cbabd-cc0c-4d61-82fb-f669bd2a1c14 service nova] Creating event network-vif-plugged:5af891e1-aa65-404e-bd37-e2e5bfe97743 for instance dda4f51b-3257-4bb0-81b8-a68cbda02294 on nch1-master-1 Sep 06 11:55:31.184193 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-2fbd1410-b14a-4602-9849-cc6a82af2d95 req-ab7cbabd-cc0c-4d61-82fb-f669bd2a1c14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051121 Sep 06 11:55:31.185159 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3522/7001] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:55:31.241209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2c91cb46-91bc-4506-87e7-e09f938125fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:31.262057 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c91cb46-91bc-4506-87e7-e09f938125fd tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1674 microversion: 2.1 time: 0.253694 Sep 06 11:55:31.263224 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3480/7002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:31 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1674 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:32.305964 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-15b123aa-8c1b-4ae9-a099-de6b55564726 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:32.307181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-15b123aa-8c1b-4ae9-a099-de6b55564726 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:32.315329 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15b123aa-8c1b-4ae9-a099-de6b55564726 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:32.318396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15b123aa-8c1b-4ae9-a099-de6b55564726 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:32.318396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15b123aa-8c1b-4ae9-a099-de6b55564726 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:32.318396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15b123aa-8c1b-4ae9-a099-de6b55564726 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:32.319209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15b123aa-8c1b-4ae9-a099-de6b55564726 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:32.319798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-15b123aa-8c1b-4ae9-a099-de6b55564726 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:32.417655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-15b123aa-8c1b-4ae9-a099-de6b55564726 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:32.435258 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-15b123aa-8c1b-4ae9-a099-de6b55564726 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1607 microversion: 2.1 time: 0.137383 Sep 06 11:55:32.436209 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3523/7003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:32 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1607 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:32.468414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ed107d85-9898-4c82-92c0-5de32389899c req-6169adb1-b586-4d84-aec2-abcabd2ff06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda4f51b-3257-4bb0-81b8-a68cbda02294", "name": "network-vif-deleted", "tag": "5af891e1-aa65-404e-bd37-e2e5bfe97743"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:32.482351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ed107d85-9898-4c82-92c0-5de32389899c req-6169adb1-b586-4d84-aec2-abcabd2ff06d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:32.482971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ed107d85-9898-4c82-92c0-5de32389899c req-6169adb1-b586-4d84-aec2-abcabd2ff06d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:32.483492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ed107d85-9898-4c82-92c0-5de32389899c req-6169adb1-b586-4d84-aec2-abcabd2ff06d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:32.496561 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ed107d85-9898-4c82-92c0-5de32389899c req-6169adb1-b586-4d84-aec2-abcabd2ff06d service nova] Creating event network-vif-deleted:5af891e1-aa65-404e-bd37-e2e5bfe97743 for instance dda4f51b-3257-4bb0-81b8-a68cbda02294 on nch1-master-1 Sep 06 11:55:32.502447 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ed107d85-9898-4c82-92c0-5de32389899c req-6169adb1-b586-4d84-aec2-abcabd2ff06d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045975 Sep 06 11:55:32.503446 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3481/7004] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:55:33.475566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:33.476707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:33.489598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:33.490499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:33.491373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:33.492688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:33.493801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:33.494549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:33.544050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:33.545002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:33.545677 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:33.546555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lazy-loading 'fault' on Instance uuid dda4f51b-3257-4bb0-81b8-a68cbda02294 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:55:33.606276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:33.622885 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-54e8e05d-c43b-4cee-8df9-fdc0867018a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 200 len: 1328 microversion: 2.1 time: 0.151452 Sep 06 11:55:33.629530 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3524/7005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:33 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 1328 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:34.669265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-179192f4-71af-4e3e-9a5d-305b2e6747ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:34.671991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-179192f4-71af-4e3e-9a5d-305b2e6747ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:34.682248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-179192f4-71af-4e3e-9a5d-305b2e6747ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:34.683262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-179192f4-71af-4e3e-9a5d-305b2e6747ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:34.684660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-179192f4-71af-4e3e-9a5d-305b2e6747ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:34.685233 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-179192f4-71af-4e3e-9a5d-305b2e6747ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:34.686052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-179192f4-71af-4e3e-9a5d-305b2e6747ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:34.686794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-179192f4-71af-4e3e-9a5d-305b2e6747ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:34.711418 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-179192f4-71af-4e3e-9a5d-305b2e6747ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-179192f4-71af-4e3e-9a5d-305b2e6747ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 HTTP/1.1 Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'dda4f51b-3257-4bb0-81b8-a68cbda02294'} Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:55:34.713209 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:55:34.723985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:55:34.723985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:55:34.723985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:55:34.723985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:55:34.723985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:55:34.723985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:55:34.723985 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:55:34.723985 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-179192f4-71af-4e3e-9a5d-305b2e6747ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:55:34.723985 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-179192f4-71af-4e3e-9a5d-305b2e6747ea tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 404 len: 111 microversion: 2.1 time: 0.055157 Sep 06 11:55:34.723985 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3482/7006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:34 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:55:34.741038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-586bea57-a46a-435f-80c1-f9170453ce93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:34.741942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-586bea57-a46a-435f-80c1-f9170453ce93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:34.750336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-586bea57-a46a-435f-80c1-f9170453ce93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:34.750829 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-586bea57-a46a-435f-80c1-f9170453ce93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:34.751321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-586bea57-a46a-435f-80c1-f9170453ce93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:34.752123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-586bea57-a46a-435f-80c1-f9170453ce93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:34.752642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-586bea57-a46a-435f-80c1-f9170453ce93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:34.753368 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-586bea57-a46a-435f-80c1-f9170453ce93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:34.773713 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-586bea57-a46a-435f-80c1-f9170453ce93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-586bea57-a46a-435f-80c1-f9170453ce93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 HTTP/1.1 Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'dda4f51b-3257-4bb0-81b8-a68cbda02294'} Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:55:34.775880 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:55:34.793511 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:55:34.793511 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:55:34.793511 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:55:34.793511 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:55:34.793511 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:55:34.793511 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:55:34.793511 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:55:34.793511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-586bea57-a46a-435f-80c1-f9170453ce93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:55:34.793511 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-586bea57-a46a-435f-80c1-f9170453ce93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 404 len: 111 microversion: 2.1 time: 0.042182 Sep 06 11:55:34.793511 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3525/7007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:34 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:55:34.912656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1667828713", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "e79a5869-abcd-46ff-bc21-f802fff42f51"}], "security_groups": [{"name": "tempest-securitygroup--302884786"}], "key_name": "tempest-keypair-2082908436", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:35.092654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] validate_networks() for [('e79a5869-abcd-46ff-bc21-f802fff42f51', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:55:35.965476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:55:35.966181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:55:35.966886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:55:35.967338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:55:35.967789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:55:35.978252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:35.978701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:35.979188 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:35.979940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:35.980402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:35.980840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:36.000476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:55:36.016356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for user 3d09c9d5440c4987a99e81bfed501cb5 and project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:55:36.041244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:55:36.043737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:55:36.208869 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-db85f04a-0d4d-40bc-898b-c0a188fe8d3b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.302484 Sep 06 11:55:36.209706 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3483/7008] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:55:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:55:36.226559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3a40624c-ab9b-4a97-b910-7b503d955bc7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:36.227498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3a40624c-ab9b-4a97-b910-7b503d955bc7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:36.306196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3a40624c-ab9b-4a97-b910-7b503d955bc7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:36.318543 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3a40624c-ab9b-4a97-b910-7b503d955bc7 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1239 microversion: 2.1 time: 0.099859 Sep 06 11:55:36.319529 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3526/7009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:36 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1239 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:55:37.356316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5acd52c0-c09b-4438-b969-55811b09a87f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:37.357094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5acd52c0-c09b-4438-b969-55811b09a87f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:37.421486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5acd52c0-c09b-4438-b969-55811b09a87f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:37.429597 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5acd52c0-c09b-4438-b969-55811b09a87f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1239 microversion: 2.1 time: 0.078313 Sep 06 11:55:37.430201 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3484/7010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:37 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:38.456287 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f3f6d9bb-e21b-48d5-9ad4-3b99cc9a6251 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:38.457079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f3f6d9bb-e21b-48d5-9ad4-3b99cc9a6251 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:38.465340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3f6d9bb-e21b-48d5-9ad4-3b99cc9a6251 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:38.465855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3f6d9bb-e21b-48d5-9ad4-3b99cc9a6251 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:38.466316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3f6d9bb-e21b-48d5-9ad4-3b99cc9a6251 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:38.467171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3f6d9bb-e21b-48d5-9ad4-3b99cc9a6251 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:38.467658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3f6d9bb-e21b-48d5-9ad4-3b99cc9a6251 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:38.468122 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f3f6d9bb-e21b-48d5-9ad4-3b99cc9a6251 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:38.555187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f3f6d9bb-e21b-48d5-9ad4-3b99cc9a6251 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:38.570687 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f3f6d9bb-e21b-48d5-9ad4-3b99cc9a6251 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1291 microversion: 2.1 time: 0.119227 Sep 06 11:55:38.571772 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3527/7011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:38 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1291 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:39.614255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cb6a7369-a98a-4851-ac8a-ed6ac88b5e32 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:39.615611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cb6a7369-a98a-4851-ac8a-ed6ac88b5e32 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:39.622982 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb6a7369-a98a-4851-ac8a-ed6ac88b5e32 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:39.623880 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb6a7369-a98a-4851-ac8a-ed6ac88b5e32 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:39.624521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb6a7369-a98a-4851-ac8a-ed6ac88b5e32 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:39.625420 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb6a7369-a98a-4851-ac8a-ed6ac88b5e32 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:39.626076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb6a7369-a98a-4851-ac8a-ed6ac88b5e32 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:39.626691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cb6a7369-a98a-4851-ac8a-ed6ac88b5e32 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:39.821729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cb6a7369-a98a-4851-ac8a-ed6ac88b5e32 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:39.834471 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cb6a7369-a98a-4851-ac8a-ed6ac88b5e32 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1364 microversion: 2.1 time: 0.224184 Sep 06 11:55:39.835898 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3485/7012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:39 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:40.644028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-285d7b3b-68f2-48ae-b9e4-91c637dfe736 req-5ead6d59-b2fe-448a-a233-6ba0d7e0025f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f", "tag": "453920ef-aad2-450b-b21d-a956c1b87dbe"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:40.655871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-285d7b3b-68f2-48ae-b9e4-91c637dfe736 req-5ead6d59-b2fe-448a-a233-6ba0d7e0025f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:40.656532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-285d7b3b-68f2-48ae-b9e4-91c637dfe736 req-5ead6d59-b2fe-448a-a233-6ba0d7e0025f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:40.657042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-285d7b3b-68f2-48ae-b9e4-91c637dfe736 req-5ead6d59-b2fe-448a-a233-6ba0d7e0025f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:40.669375 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-285d7b3b-68f2-48ae-b9e4-91c637dfe736 req-5ead6d59-b2fe-448a-a233-6ba0d7e0025f service nova] Creating event network-changed:453920ef-aad2-450b-b21d-a956c1b87dbe for instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f on nch1-master-1 Sep 06 11:55:40.674651 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-285d7b3b-68f2-48ae-b9e4-91c637dfe736 req-5ead6d59-b2fe-448a-a233-6ba0d7e0025f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034465 Sep 06 11:55:40.675308 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3528/7013] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:55:40.873367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-987d631e-e0ec-4011-a6fa-d89a3f5b79a3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:40.874063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-987d631e-e0ec-4011-a6fa-d89a3f5b79a3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:40.881817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-987d631e-e0ec-4011-a6fa-d89a3f5b79a3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:40.882372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-987d631e-e0ec-4011-a6fa-d89a3f5b79a3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:40.882823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-987d631e-e0ec-4011-a6fa-d89a3f5b79a3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:40.883568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-987d631e-e0ec-4011-a6fa-d89a3f5b79a3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:40.884045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-987d631e-e0ec-4011-a6fa-d89a3f5b79a3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:40.884503 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-987d631e-e0ec-4011-a6fa-d89a3f5b79a3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:41.025155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-987d631e-e0ec-4011-a6fa-d89a3f5b79a3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:41.033111 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-987d631e-e0ec-4011-a6fa-d89a3f5b79a3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1364 microversion: 2.1 time: 0.163562 Sep 06 11:55:41.033668 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3486/7014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:40 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:42.060015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7c942333-bc6d-406f-8be8-bd7ff9dfc012 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:42.060960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7c942333-bc6d-406f-8be8-bd7ff9dfc012 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:42.072885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c942333-bc6d-406f-8be8-bd7ff9dfc012 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:42.073809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c942333-bc6d-406f-8be8-bd7ff9dfc012 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:42.074548 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c942333-bc6d-406f-8be8-bd7ff9dfc012 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:42.075797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c942333-bc6d-406f-8be8-bd7ff9dfc012 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:42.076409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c942333-bc6d-406f-8be8-bd7ff9dfc012 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:42.077129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7c942333-bc6d-406f-8be8-bd7ff9dfc012 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:42.264990 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7c942333-bc6d-406f-8be8-bd7ff9dfc012 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:42.274550 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7c942333-bc6d-406f-8be8-bd7ff9dfc012 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1364 microversion: 2.1 time: 0.220904 Sep 06 11:55:42.275184 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3529/7015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:42 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:43.299678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-69e11826-8343-4411-af65-306daa80f0a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:43.300335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-69e11826-8343-4411-af65-306daa80f0a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:43.311785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69e11826-8343-4411-af65-306daa80f0a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:43.311785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69e11826-8343-4411-af65-306daa80f0a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:43.311785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69e11826-8343-4411-af65-306daa80f0a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:43.311785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69e11826-8343-4411-af65-306daa80f0a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:43.311785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69e11826-8343-4411-af65-306daa80f0a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:43.311785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-69e11826-8343-4411-af65-306daa80f0a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:43.472409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-69e11826-8343-4411-af65-306daa80f0a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:43.481387 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-69e11826-8343-4411-af65-306daa80f0a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1364 microversion: 2.1 time: 0.185871 Sep 06 11:55:43.482014 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3487/7016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:43 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:44.514797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1c7b66e7-7597-45a3-91d9-af8e0ee36df5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:44.515580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1c7b66e7-7597-45a3-91d9-af8e0ee36df5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:44.522785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c7b66e7-7597-45a3-91d9-af8e0ee36df5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:44.523394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c7b66e7-7597-45a3-91d9-af8e0ee36df5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:44.523861 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c7b66e7-7597-45a3-91d9-af8e0ee36df5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:44.524586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c7b66e7-7597-45a3-91d9-af8e0ee36df5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:44.525060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c7b66e7-7597-45a3-91d9-af8e0ee36df5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:44.525505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1c7b66e7-7597-45a3-91d9-af8e0ee36df5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:44.677026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1c7b66e7-7597-45a3-91d9-af8e0ee36df5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:44.685541 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1c7b66e7-7597-45a3-91d9-af8e0ee36df5 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1364 microversion: 2.1 time: 0.174970 Sep 06 11:55:44.689298 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3530/7017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:44 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:55:45.709862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5ff6a6cd-b6f4-42cd-97ca-b7a84221b797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:45.710466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5ff6a6cd-b6f4-42cd-97ca-b7a84221b797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:45.717925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ff6a6cd-b6f4-42cd-97ca-b7a84221b797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:45.718427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ff6a6cd-b6f4-42cd-97ca-b7a84221b797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:45.718875 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ff6a6cd-b6f4-42cd-97ca-b7a84221b797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:45.719641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ff6a6cd-b6f4-42cd-97ca-b7a84221b797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:45.720112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ff6a6cd-b6f4-42cd-97ca-b7a84221b797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:45.720549 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ff6a6cd-b6f4-42cd-97ca-b7a84221b797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:45.863737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5ff6a6cd-b6f4-42cd-97ca-b7a84221b797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:45.872177 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5ff6a6cd-b6f4-42cd-97ca-b7a84221b797 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1364 microversion: 2.1 time: 0.166400 Sep 06 11:55:45.872796 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3488/7018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:45 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:46.897354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-862d55e4-2ba2-4054-bf1d-68720718a91e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:46.897999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-862d55e4-2ba2-4054-bf1d-68720718a91e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:46.901007 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:46.906659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-862d55e4-2ba2-4054-bf1d-68720718a91e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:46.907217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-862d55e4-2ba2-4054-bf1d-68720718a91e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:46.907684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-862d55e4-2ba2-4054-bf1d-68720718a91e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:46.909063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-862d55e4-2ba2-4054-bf1d-68720718a91e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:46.909260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-862d55e4-2ba2-4054-bf1d-68720718a91e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:46.909557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-862d55e4-2ba2-4054-bf1d-68720718a91e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:47.064317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-862d55e4-2ba2-4054-bf1d-68720718a91e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:47.072547 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-862d55e4-2ba2-4054-bf1d-68720718a91e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1364 microversion: 2.1 time: 0.179396 Sep 06 11:55:47.073508 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3531/7019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:46 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:47.185884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e3433ab2-4f7d-46fc-9888-240cd3d7ca8e req-d8b7cf13-2c09-4f15-a8b3-884f46cf434f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f", "name": "network-vif-plugged", "status": "completed", "tag": "453920ef-aad2-450b-b21d-a956c1b87dbe"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:47.191506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:47.198176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e3433ab2-4f7d-46fc-9888-240cd3d7ca8e req-d8b7cf13-2c09-4f15-a8b3-884f46cf434f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:47.198668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e3433ab2-4f7d-46fc-9888-240cd3d7ca8e req-d8b7cf13-2c09-4f15-a8b3-884f46cf434f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:47.199454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e3433ab2-4f7d-46fc-9888-240cd3d7ca8e req-d8b7cf13-2c09-4f15-a8b3-884f46cf434f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:47.211843 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e3433ab2-4f7d-46fc-9888-240cd3d7ca8e req-d8b7cf13-2c09-4f15-a8b3-884f46cf434f service nova] Creating event network-vif-plugged:453920ef-aad2-450b-b21d-a956c1b87dbe for instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f on nch1-master-1 Sep 06 11:55:47.217349 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e3433ab2-4f7d-46fc-9888-240cd3d7ca8e req-d8b7cf13-2c09-4f15-a8b3-884f46cf434f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035400 Sep 06 11:55:47.218003 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3489/7020] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:55:48.097337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d5b47dbb-d328-4ed3-8f3b-2629d3f90d34 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:48.098000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d5b47dbb-d328-4ed3-8f3b-2629d3f90d34 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:48.105968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5b47dbb-d328-4ed3-8f3b-2629d3f90d34 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:48.106492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5b47dbb-d328-4ed3-8f3b-2629d3f90d34 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:48.106950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5b47dbb-d328-4ed3-8f3b-2629d3f90d34 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:48.107779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5b47dbb-d328-4ed3-8f3b-2629d3f90d34 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:48.108262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5b47dbb-d328-4ed3-8f3b-2629d3f90d34 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:48.108714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d5b47dbb-d328-4ed3-8f3b-2629d3f90d34 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:48.260615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d5b47dbb-d328-4ed3-8f3b-2629d3f90d34 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:48.269952 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d5b47dbb-d328-4ed3-8f3b-2629d3f90d34 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1364 microversion: 2.1 time: 0.176619 Sep 06 11:55:48.271414 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3532/7021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:48 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:49.295346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fa193f63-b1bc-45ef-8225-c5092212d16c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:49.296060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fa193f63-b1bc-45ef-8225-c5092212d16c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:49.298274 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=8 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:49.304005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa193f63-b1bc-45ef-8225-c5092212d16c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:49.304497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa193f63-b1bc-45ef-8225-c5092212d16c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:49.304997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa193f63-b1bc-45ef-8225-c5092212d16c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:49.305767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa193f63-b1bc-45ef-8225-c5092212d16c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:49.306225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa193f63-b1bc-45ef-8225-c5092212d16c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:49.306660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fa193f63-b1bc-45ef-8225-c5092212d16c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:49.454293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fa193f63-b1bc-45ef-8225-c5092212d16c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:49.463890 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fa193f63-b1bc-45ef-8225-c5092212d16c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1550 microversion: 2.1 time: 0.173566 Sep 06 11:55:49.464862 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3490/7022] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:49 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1550 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:49.489445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a532f7a4-3856-4642-9cde-7502ebdf5ef1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:49.491088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a532f7a4-3856-4642-9cde-7502ebdf5ef1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:49.502128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a532f7a4-3856-4642-9cde-7502ebdf5ef1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:49.502671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a532f7a4-3856-4642-9cde-7502ebdf5ef1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:49.503187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a532f7a4-3856-4642-9cde-7502ebdf5ef1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:49.503954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a532f7a4-3856-4642-9cde-7502ebdf5ef1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:49.504434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a532f7a4-3856-4642-9cde-7502ebdf5ef1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:49.504887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a532f7a4-3856-4642-9cde-7502ebdf5ef1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:49.589833 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a532f7a4-3856-4642-9cde-7502ebdf5ef1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104402 Sep 06 11:55:49.590608 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3533/7023] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:55:49 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:55:50.656644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-0f1d612f-acb5-4bfd-ac6e-ed30f7c6444f req-470e5302-877d-4f06-99d4-2a5298c14694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f", "tag": "453920ef-aad2-450b-b21d-a956c1b87dbe"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:50.668358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0f1d612f-acb5-4bfd-ac6e-ed30f7c6444f req-470e5302-877d-4f06-99d4-2a5298c14694 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:50.668848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0f1d612f-acb5-4bfd-ac6e-ed30f7c6444f req-470e5302-877d-4f06-99d4-2a5298c14694 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:50.669373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0f1d612f-acb5-4bfd-ac6e-ed30f7c6444f req-470e5302-877d-4f06-99d4-2a5298c14694 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:50.681658 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-0f1d612f-acb5-4bfd-ac6e-ed30f7c6444f req-470e5302-877d-4f06-99d4-2a5298c14694 service nova] Creating event network-changed:453920ef-aad2-450b-b21d-a956c1b87dbe for instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f on nch1-master-1 Sep 06 11:55:50.687339 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-0f1d612f-acb5-4bfd-ac6e-ed30f7c6444f req-470e5302-877d-4f06-99d4-2a5298c14694 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033995 Sep 06 11:55:50.687936 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3491/7024] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:56:26.744474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=29 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:26.745345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=64 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:26.746464 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:56:26.746620 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 11:56:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f (ip 10.222.0.20) !!! Sep 06 11:56:26.751919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-93ef8ee8-e457-49e5-a9f0-43135453fe93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:26.752582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-93ef8ee8-e457-49e5-a9f0-43135453fe93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:26.763669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ef8ee8-e457-49e5-a9f0-43135453fe93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:26.764194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ef8ee8-e457-49e5-a9f0-43135453fe93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:26.764667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ef8ee8-e457-49e5-a9f0-43135453fe93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:26.765441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ef8ee8-e457-49e5-a9f0-43135453fe93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:26.765932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ef8ee8-e457-49e5-a9f0-43135453fe93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:26.766392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93ef8ee8-e457-49e5-a9f0-43135453fe93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:26.933976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-93ef8ee8-e457-49e5-a9f0-43135453fe93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:26.944524 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-93ef8ee8-e457-49e5-a9f0-43135453fe93 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1669 microversion: 2.1 time: 0.201598 Sep 06 11:56:26.945165 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3534/7025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:26 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1669 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:26.966972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:26.967887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:26.973205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a98b0341-636e-46f1-a3a0-2194a084a583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "424f3e42-8c1b-46bf-bef5-aca7d79e7532"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:26.976360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a98b0341-636e-46f1-a3a0-2194a084a583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:26.984043 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a98b0341-636e-46f1-a3a0-2194a084a583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:26.989128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a98b0341-636e-46f1-a3a0-2194a084a583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:26.989128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a98b0341-636e-46f1-a3a0-2194a084a583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:26.989128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a98b0341-636e-46f1-a3a0-2194a084a583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:26.989128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a98b0341-636e-46f1-a3a0-2194a084a583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:26.989128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a98b0341-636e-46f1-a3a0-2194a084a583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:27.878306 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a98b0341-636e-46f1-a3a0-2194a084a583 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.913272 Sep 06 11:56:27.879321 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3492/7026] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:56:26 2022] POST /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f/os-volume_attachments => generated 194 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:56:32.485146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:32.487733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:32.496127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:32.496644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:32.497106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:32.497836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:32.498314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:32.498768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:32.533062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:32.540104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Old instance type m1.heat2, new instance type m1.heat {{(pid=140876) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 11:56:32.549633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:56:32.550083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:56:32.550574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:56:32.550989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:56:32.551450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:56:32.822647 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-652ab556-b13a-4e2b-b506-1797bf1c56eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f/action" status: 202 len: 0 microversion: 2.1 time: 0.341728 Sep 06 11:56:32.823527 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3535/7027] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:56:32 2022] POST /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:56:32.839136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-17f808ad-e347-464e-b3b2-014e6bef8781 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:32.840040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-17f808ad-e347-464e-b3b2-014e6bef8781 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:32.853493 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f808ad-e347-464e-b3b2-014e6bef8781 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:32.854365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f808ad-e347-464e-b3b2-014e6bef8781 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:32.855154 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f808ad-e347-464e-b3b2-014e6bef8781 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:32.858687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f808ad-e347-464e-b3b2-014e6bef8781 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:32.858687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f808ad-e347-464e-b3b2-014e6bef8781 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:32.858687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17f808ad-e347-464e-b3b2-014e6bef8781 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:33.038046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-17f808ad-e347-464e-b3b2-014e6bef8781 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:33.047538 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-17f808ad-e347-464e-b3b2-014e6bef8781 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1724 microversion: 2.1 time: 0.218870 Sep 06 11:56:33.048244 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3493/7028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:32 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:34.076473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2cf92696-c10c-479d-942c-3d3022627ea3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:34.080094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2cf92696-c10c-479d-942c-3d3022627ea3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:34.086344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cf92696-c10c-479d-942c-3d3022627ea3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:34.086864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cf92696-c10c-479d-942c-3d3022627ea3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:34.087366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cf92696-c10c-479d-942c-3d3022627ea3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:34.088105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cf92696-c10c-479d-942c-3d3022627ea3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:34.088591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cf92696-c10c-479d-942c-3d3022627ea3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:34.089039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2cf92696-c10c-479d-942c-3d3022627ea3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:34.247258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2cf92696-c10c-479d-942c-3d3022627ea3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:34.256736 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2cf92696-c10c-479d-942c-3d3022627ea3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1724 microversion: 2.1 time: 0.188985 Sep 06 11:56:34.257346 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3536/7029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:34 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:35.281528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-142e21e9-8939-48db-b25f-a8806c9922fe tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:35.282176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-142e21e9-8939-48db-b25f-a8806c9922fe tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:35.289899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-142e21e9-8939-48db-b25f-a8806c9922fe tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:35.290399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-142e21e9-8939-48db-b25f-a8806c9922fe tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:35.290862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-142e21e9-8939-48db-b25f-a8806c9922fe tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:35.292254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-142e21e9-8939-48db-b25f-a8806c9922fe tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:35.292744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-142e21e9-8939-48db-b25f-a8806c9922fe tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:35.293190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-142e21e9-8939-48db-b25f-a8806c9922fe tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:35.432669 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-142e21e9-8939-48db-b25f-a8806c9922fe tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:35.441178 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-142e21e9-8939-48db-b25f-a8806c9922fe tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1724 microversion: 2.1 time: 0.163506 Sep 06 11:56:35.441759 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3494/7030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:35 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:36.466603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-eecd1e19-bba6-4fe5-b8c7-df8583859784 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:36.467308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-eecd1e19-bba6-4fe5-b8c7-df8583859784 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:36.474415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eecd1e19-bba6-4fe5-b8c7-df8583859784 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:36.474944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eecd1e19-bba6-4fe5-b8c7-df8583859784 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:36.477893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eecd1e19-bba6-4fe5-b8c7-df8583859784 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:36.477893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eecd1e19-bba6-4fe5-b8c7-df8583859784 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:36.477893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eecd1e19-bba6-4fe5-b8c7-df8583859784 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:36.477893 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-eecd1e19-bba6-4fe5-b8c7-df8583859784 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:36.633518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-eecd1e19-bba6-4fe5-b8c7-df8583859784 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:36.642449 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-eecd1e19-bba6-4fe5-b8c7-df8583859784 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1724 microversion: 2.1 time: 0.180612 Sep 06 11:56:36.643061 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3537/7031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:36 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:37.668123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-09f155b0-34dc-44fd-872f-8accba525d7f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:37.668747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-09f155b0-34dc-44fd-872f-8accba525d7f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:37.676068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09f155b0-34dc-44fd-872f-8accba525d7f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:37.676558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09f155b0-34dc-44fd-872f-8accba525d7f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:37.677002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09f155b0-34dc-44fd-872f-8accba525d7f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:37.677702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09f155b0-34dc-44fd-872f-8accba525d7f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:37.678237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09f155b0-34dc-44fd-872f-8accba525d7f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:37.678672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09f155b0-34dc-44fd-872f-8accba525d7f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:37.814078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-09f155b0-34dc-44fd-872f-8accba525d7f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:37.822555 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-09f155b0-34dc-44fd-872f-8accba525d7f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.158349 Sep 06 11:56:37.823146 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3495/7032] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:37 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:38.846867 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a8fcdb35-ba03-4aef-9fca-5e349043e805 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:38.847576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a8fcdb35-ba03-4aef-9fca-5e349043e805 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:38.854777 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8fcdb35-ba03-4aef-9fca-5e349043e805 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:38.855316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8fcdb35-ba03-4aef-9fca-5e349043e805 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:38.855794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8fcdb35-ba03-4aef-9fca-5e349043e805 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:38.856515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8fcdb35-ba03-4aef-9fca-5e349043e805 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:38.857030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8fcdb35-ba03-4aef-9fca-5e349043e805 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:38.857485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a8fcdb35-ba03-4aef-9fca-5e349043e805 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:38.988688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a8fcdb35-ba03-4aef-9fca-5e349043e805 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:38.997697 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a8fcdb35-ba03-4aef-9fca-5e349043e805 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.154767 Sep 06 11:56:38.998297 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3538/7033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:38 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:40.024300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bcc43a80-51de-495d-9517-37cc76b77016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:40.025322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bcc43a80-51de-495d-9517-37cc76b77016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:40.032197 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bcc43a80-51de-495d-9517-37cc76b77016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:40.032696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bcc43a80-51de-495d-9517-37cc76b77016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:40.033145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bcc43a80-51de-495d-9517-37cc76b77016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:40.033869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bcc43a80-51de-495d-9517-37cc76b77016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:40.034342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bcc43a80-51de-495d-9517-37cc76b77016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:40.034784 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bcc43a80-51de-495d-9517-37cc76b77016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:40.187683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bcc43a80-51de-495d-9517-37cc76b77016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:40.196974 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bcc43a80-51de-495d-9517-37cc76b77016 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.178175 Sep 06 11:56:40.204291 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3496/7034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:40 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:41.221577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-23d659cf-2c72-4fd7-b08d-cc025cf8e0a2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:41.222147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-23d659cf-2c72-4fd7-b08d-cc025cf8e0a2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:41.229271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23d659cf-2c72-4fd7-b08d-cc025cf8e0a2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:41.229786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23d659cf-2c72-4fd7-b08d-cc025cf8e0a2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:41.230253 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23d659cf-2c72-4fd7-b08d-cc025cf8e0a2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:41.231062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23d659cf-2c72-4fd7-b08d-cc025cf8e0a2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:41.231551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23d659cf-2c72-4fd7-b08d-cc025cf8e0a2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:41.232005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-23d659cf-2c72-4fd7-b08d-cc025cf8e0a2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:41.381736 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-23d659cf-2c72-4fd7-b08d-cc025cf8e0a2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:41.391612 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-23d659cf-2c72-4fd7-b08d-cc025cf8e0a2 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.174063 Sep 06 11:56:41.392214 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3539/7035] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:41 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:42.417741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e994a885-c1ec-4beb-8dd3-6cbb5eae1e2c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:42.418467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e994a885-c1ec-4beb-8dd3-6cbb5eae1e2c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:42.432184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e994a885-c1ec-4beb-8dd3-6cbb5eae1e2c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:42.432693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e994a885-c1ec-4beb-8dd3-6cbb5eae1e2c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:42.433145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e994a885-c1ec-4beb-8dd3-6cbb5eae1e2c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:42.433945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e994a885-c1ec-4beb-8dd3-6cbb5eae1e2c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:42.434377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e994a885-c1ec-4beb-8dd3-6cbb5eae1e2c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:42.434832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e994a885-c1ec-4beb-8dd3-6cbb5eae1e2c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:42.606148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e994a885-c1ec-4beb-8dd3-6cbb5eae1e2c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:42.615621 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e994a885-c1ec-4beb-8dd3-6cbb5eae1e2c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.202346 Sep 06 11:56:42.616233 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3497/7036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:42 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:43.643871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fc93fa2e-b46b-4287-870a-6a4152ac6c24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:43.644898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fc93fa2e-b46b-4287-870a-6a4152ac6c24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:43.652523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc93fa2e-b46b-4287-870a-6a4152ac6c24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:43.653045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc93fa2e-b46b-4287-870a-6a4152ac6c24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:43.653511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc93fa2e-b46b-4287-870a-6a4152ac6c24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:43.654260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc93fa2e-b46b-4287-870a-6a4152ac6c24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:43.654961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc93fa2e-b46b-4287-870a-6a4152ac6c24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:43.655445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fc93fa2e-b46b-4287-870a-6a4152ac6c24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:43.814801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fc93fa2e-b46b-4287-870a-6a4152ac6c24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:43.826338 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fc93fa2e-b46b-4287-870a-6a4152ac6c24 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.189747 Sep 06 11:56:43.826862 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3540/7037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:43 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:44.850583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bb10b11e-f837-46b0-93e0-b5bec4477cba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:44.852065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bb10b11e-f837-46b0-93e0-b5bec4477cba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:44.859541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb10b11e-f837-46b0-93e0-b5bec4477cba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:44.860118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb10b11e-f837-46b0-93e0-b5bec4477cba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:44.860611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb10b11e-f837-46b0-93e0-b5bec4477cba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:44.861610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb10b11e-f837-46b0-93e0-b5bec4477cba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:44.862191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb10b11e-f837-46b0-93e0-b5bec4477cba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:44.862694 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bb10b11e-f837-46b0-93e0-b5bec4477cba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:45.029961 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bb10b11e-f837-46b0-93e0-b5bec4477cba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:45.038980 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bb10b11e-f837-46b0-93e0-b5bec4477cba tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.192477 Sep 06 11:56:45.039603 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3498/7038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:44 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:46.063001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7088123e-549b-4acd-b3d4-b88190bceb9e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:46.063838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7088123e-549b-4acd-b3d4-b88190bceb9e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:46.071256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7088123e-549b-4acd-b3d4-b88190bceb9e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:46.071783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7088123e-549b-4acd-b3d4-b88190bceb9e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:46.072254 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7088123e-549b-4acd-b3d4-b88190bceb9e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:46.073001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7088123e-549b-4acd-b3d4-b88190bceb9e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:46.073491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7088123e-549b-4acd-b3d4-b88190bceb9e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:46.073966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7088123e-549b-4acd-b3d4-b88190bceb9e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:46.225514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7088123e-549b-4acd-b3d4-b88190bceb9e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:46.235394 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7088123e-549b-4acd-b3d4-b88190bceb9e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.176388 Sep 06 11:56:46.238034 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3541/7039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:46 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:47.262763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e30dbf15-d24d-4089-b674-318a0abcf90b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:47.263590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e30dbf15-d24d-4089-b674-318a0abcf90b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:47.270622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e30dbf15-d24d-4089-b674-318a0abcf90b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:47.271146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e30dbf15-d24d-4089-b674-318a0abcf90b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:47.271595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e30dbf15-d24d-4089-b674-318a0abcf90b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:47.272306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e30dbf15-d24d-4089-b674-318a0abcf90b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:47.272766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e30dbf15-d24d-4089-b674-318a0abcf90b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:47.273803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e30dbf15-d24d-4089-b674-318a0abcf90b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:47.430746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e30dbf15-d24d-4089-b674-318a0abcf90b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:47.441409 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e30dbf15-d24d-4089-b674-318a0abcf90b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.182449 Sep 06 11:56:47.442487 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3499/7040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:47 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:48.468336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3579e65b-2a4e-4e2f-81dc-548f43e77fca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:48.468989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3579e65b-2a4e-4e2f-81dc-548f43e77fca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:48.477083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3579e65b-2a4e-4e2f-81dc-548f43e77fca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:48.477734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3579e65b-2a4e-4e2f-81dc-548f43e77fca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:48.478358 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3579e65b-2a4e-4e2f-81dc-548f43e77fca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:48.479121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3579e65b-2a4e-4e2f-81dc-548f43e77fca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:48.479595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3579e65b-2a4e-4e2f-81dc-548f43e77fca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:48.480037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3579e65b-2a4e-4e2f-81dc-548f43e77fca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:48.636785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3579e65b-2a4e-4e2f-81dc-548f43e77fca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:48.651526 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3579e65b-2a4e-4e2f-81dc-548f43e77fca tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.186966 Sep 06 11:56:48.652373 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3542/7041] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:48 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:49.687430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2308b94a-43e5-4812-a8a5-e6f198f8a85c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:49.688329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2308b94a-43e5-4812-a8a5-e6f198f8a85c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:49.697195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2308b94a-43e5-4812-a8a5-e6f198f8a85c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:49.697904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2308b94a-43e5-4812-a8a5-e6f198f8a85c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:49.698519 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2308b94a-43e5-4812-a8a5-e6f198f8a85c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:49.699454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2308b94a-43e5-4812-a8a5-e6f198f8a85c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:49.700072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2308b94a-43e5-4812-a8a5-e6f198f8a85c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:49.700722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2308b94a-43e5-4812-a8a5-e6f198f8a85c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:49.858281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2308b94a-43e5-4812-a8a5-e6f198f8a85c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:49.867828 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2308b94a-43e5-4812-a8a5-e6f198f8a85c tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.185804 Sep 06 11:56:49.868428 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3500/7042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:49 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:50.891729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8b80cce7-9ade-4607-92f3-55da4c9befbb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:50.892452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8b80cce7-9ade-4607-92f3-55da4c9befbb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:50.899612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b80cce7-9ade-4607-92f3-55da4c9befbb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:50.900120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b80cce7-9ade-4607-92f3-55da4c9befbb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:50.900581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b80cce7-9ade-4607-92f3-55da4c9befbb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:50.901306 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b80cce7-9ade-4607-92f3-55da4c9befbb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:50.901814 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b80cce7-9ade-4607-92f3-55da4c9befbb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:50.902262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8b80cce7-9ade-4607-92f3-55da4c9befbb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:51.080530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8b80cce7-9ade-4607-92f3-55da4c9befbb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:51.089888 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8b80cce7-9ade-4607-92f3-55da4c9befbb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.202118 Sep 06 11:56:51.090330 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3543/7043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:50 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:52.115397 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-73591951-8561-43e3-9355-e9b201ba188e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:52.116151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-73591951-8561-43e3-9355-e9b201ba188e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:52.123822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73591951-8561-43e3-9355-e9b201ba188e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:52.124320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73591951-8561-43e3-9355-e9b201ba188e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:52.124763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73591951-8561-43e3-9355-e9b201ba188e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:52.125484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73591951-8561-43e3-9355-e9b201ba188e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:52.125983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73591951-8561-43e3-9355-e9b201ba188e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:52.126447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73591951-8561-43e3-9355-e9b201ba188e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:52.272707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-73591951-8561-43e3-9355-e9b201ba188e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:52.282112 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-73591951-8561-43e3-9355-e9b201ba188e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.170839 Sep 06 11:56:52.282862 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3501/7044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:52 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:53.310739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-809ca680-ccbf-4caf-a49a-9c9413d66ffb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:53.311817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-809ca680-ccbf-4caf-a49a-9c9413d66ffb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:53.323500 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-809ca680-ccbf-4caf-a49a-9c9413d66ffb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:53.324357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-809ca680-ccbf-4caf-a49a-9c9413d66ffb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:53.325140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-809ca680-ccbf-4caf-a49a-9c9413d66ffb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:53.326433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-809ca680-ccbf-4caf-a49a-9c9413d66ffb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:53.327308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-809ca680-ccbf-4caf-a49a-9c9413d66ffb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:53.328031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-809ca680-ccbf-4caf-a49a-9c9413d66ffb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:53.505825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-809ca680-ccbf-4caf-a49a-9c9413d66ffb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:53.523972 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-809ca680-ccbf-4caf-a49a-9c9413d66ffb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.218472 Sep 06 11:56:53.524958 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3544/7045] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:53 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:54.552407 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-cc9d9973-884f-4b14-81e4-bac7cc72cff0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:54.553029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-cc9d9973-884f-4b14-81e4-bac7cc72cff0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:54.561172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc9d9973-884f-4b14-81e4-bac7cc72cff0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:54.561678 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc9d9973-884f-4b14-81e4-bac7cc72cff0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:54.562127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc9d9973-884f-4b14-81e4-bac7cc72cff0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:54.562851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc9d9973-884f-4b14-81e4-bac7cc72cff0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:54.563363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc9d9973-884f-4b14-81e4-bac7cc72cff0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:54.563797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-cc9d9973-884f-4b14-81e4-bac7cc72cff0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:54.730514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-cc9d9973-884f-4b14-81e4-bac7cc72cff0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:54.748404 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-cc9d9973-884f-4b14-81e4-bac7cc72cff0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1729 microversion: 2.1 time: 0.197728 Sep 06 11:56:54.748404 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3502/7046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:54 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:55.770139 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5aee725a-c972-4646-a3a0-ba2fb14fac97 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:55.771342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5aee725a-c972-4646-a3a0-ba2fb14fac97 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:55.779075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5aee725a-c972-4646-a3a0-ba2fb14fac97 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:55.779959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5aee725a-c972-4646-a3a0-ba2fb14fac97 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:55.780438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5aee725a-c972-4646-a3a0-ba2fb14fac97 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:55.781237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5aee725a-c972-4646-a3a0-ba2fb14fac97 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:55.781776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5aee725a-c972-4646-a3a0-ba2fb14fac97 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:55.782190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5aee725a-c972-4646-a3a0-ba2fb14fac97 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:55.947835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5aee725a-c972-4646-a3a0-ba2fb14fac97 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:55.954748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-14ce81a8-5aaf-4860-8f78-0982b268a9f1 req-7b5e149b-e734-41a2-927f-bec06153bd7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f", "name": "network-vif-unplugged", "status": "completed", "tag": "453920ef-aad2-450b-b21d-a956c1b87dbe"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:55.961192 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5aee725a-c972-4646-a3a0-ba2fb14fac97 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1728 microversion: 2.1 time: 0.194453 Sep 06 11:56:55.965244 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3545/7047] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:55 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:55.966649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-14ce81a8-5aaf-4860-8f78-0982b268a9f1 req-7b5e149b-e734-41a2-927f-bec06153bd7c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:55.967191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-14ce81a8-5aaf-4860-8f78-0982b268a9f1 req-7b5e149b-e734-41a2-927f-bec06153bd7c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:55.967639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-14ce81a8-5aaf-4860-8f78-0982b268a9f1 req-7b5e149b-e734-41a2-927f-bec06153bd7c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:55.980751 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-14ce81a8-5aaf-4860-8f78-0982b268a9f1 req-7b5e149b-e734-41a2-927f-bec06153bd7c service nova] Creating event network-vif-unplugged:453920ef-aad2-450b-b21d-a956c1b87dbe for instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f on nch2-master-1 Sep 06 11:56:55.986824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-14ce81a8-5aaf-4860-8f78-0982b268a9f1 req-7b5e149b-e734-41a2-927f-bec06153bd7c service nova] Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:56:55.999827 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-14ce81a8-5aaf-4860-8f78-0982b268a9f1 req-7b5e149b-e734-41a2-927f-bec06153bd7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049189 Sep 06 11:56:56.000511 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3503/7048] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:56:56.987390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-89185e48-553e-453d-8ffa-f5824165a98a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:56.988501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-89185e48-553e-453d-8ffa-f5824165a98a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:56.991956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=29 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:56.997294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89185e48-553e-453d-8ffa-f5824165a98a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:56.997877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89185e48-553e-453d-8ffa-f5824165a98a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:56.998350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89185e48-553e-453d-8ffa-f5824165a98a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:56.999339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89185e48-553e-453d-8ffa-f5824165a98a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:57.007951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89185e48-553e-453d-8ffa-f5824165a98a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:57.007951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89185e48-553e-453d-8ffa-f5824165a98a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:57.007951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:57.182894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-89185e48-553e-453d-8ffa-f5824165a98a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:57.197115 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-89185e48-553e-453d-8ffa-f5824165a98a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1728 microversion: 2.1 time: 0.213480 Sep 06 11:56:57.197797 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3546/7049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:56 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:58.017942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-37cd2a81-e82f-4cbe-9cfb-ba3fc49e2df8 req-5f4b45d7-f58a-4e61-9655-1dbe7a957d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f", "tag": "453920ef-aad2-450b-b21d-a956c1b87dbe"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:58.027388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=25 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:58.037382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-37cd2a81-e82f-4cbe-9cfb-ba3fc49e2df8 req-5f4b45d7-f58a-4e61-9655-1dbe7a957d68 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:58.037979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-37cd2a81-e82f-4cbe-9cfb-ba3fc49e2df8 req-5f4b45d7-f58a-4e61-9655-1dbe7a957d68 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:58.038537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-37cd2a81-e82f-4cbe-9cfb-ba3fc49e2df8 req-5f4b45d7-f58a-4e61-9655-1dbe7a957d68 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:58.042423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:58.058751 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-37cd2a81-e82f-4cbe-9cfb-ba3fc49e2df8 req-5f4b45d7-f58a-4e61-9655-1dbe7a957d68 service nova] Creating event network-changed:453920ef-aad2-450b-b21d-a956c1b87dbe for instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f on nch2-master-1 Sep 06 11:56:58.062930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-37cd2a81-e82f-4cbe-9cfb-ba3fc49e2df8 req-5f4b45d7-f58a-4e61-9655-1dbe7a957d68 service nova] Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:56:58.082691 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-37cd2a81-e82f-4cbe-9cfb-ba3fc49e2df8 req-5f4b45d7-f58a-4e61-9655-1dbe7a957d68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070129 Sep 06 11:56:58.084847 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3504/7050] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:56:58.224924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-957a1c83-dbb5-4175-b5b2-f4486ba46074 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:58.226420 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-957a1c83-dbb5-4175-b5b2-f4486ba46074 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:58.234958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957a1c83-dbb5-4175-b5b2-f4486ba46074 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:58.238846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957a1c83-dbb5-4175-b5b2-f4486ba46074 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:58.238846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957a1c83-dbb5-4175-b5b2-f4486ba46074 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:58.238846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957a1c83-dbb5-4175-b5b2-f4486ba46074 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:58.238846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957a1c83-dbb5-4175-b5b2-f4486ba46074 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:58.238846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957a1c83-dbb5-4175-b5b2-f4486ba46074 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:58.456549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-957a1c83-dbb5-4175-b5b2-f4486ba46074 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:58.466627 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-957a1c83-dbb5-4175-b5b2-f4486ba46074 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1726 microversion: 2.1 time: 0.245962 Sep 06 11:56:58.467602 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3547/7051] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:58 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1726 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:59.503884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6474e7e9-7317-4e09-bee0-8ac781bcc74d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:59.505110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6474e7e9-7317-4e09-bee0-8ac781bcc74d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:59.513476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6474e7e9-7317-4e09-bee0-8ac781bcc74d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:59.513966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6474e7e9-7317-4e09-bee0-8ac781bcc74d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:59.514460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6474e7e9-7317-4e09-bee0-8ac781bcc74d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:59.515343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6474e7e9-7317-4e09-bee0-8ac781bcc74d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:59.515829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6474e7e9-7317-4e09-bee0-8ac781bcc74d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:59.516276 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6474e7e9-7317-4e09-bee0-8ac781bcc74d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:59.671123 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6474e7e9-7317-4e09-bee0-8ac781bcc74d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:59.680112 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6474e7e9-7317-4e09-bee0-8ac781bcc74d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1726 microversion: 2.1 time: 0.182971 Sep 06 11:56:59.680705 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3505/7052] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:59 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:00.709579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-799efd1b-8e4b-4158-9299-351a06c56189 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:00.711039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-799efd1b-8e4b-4158-9299-351a06c56189 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:00.721624 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-799efd1b-8e4b-4158-9299-351a06c56189 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:00.722421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-799efd1b-8e4b-4158-9299-351a06c56189 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:00.723234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-799efd1b-8e4b-4158-9299-351a06c56189 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:00.724400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-799efd1b-8e4b-4158-9299-351a06c56189 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:00.725144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-799efd1b-8e4b-4158-9299-351a06c56189 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:00.725889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-799efd1b-8e4b-4158-9299-351a06c56189 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:00.943233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-799efd1b-8e4b-4158-9299-351a06c56189 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:00.956831 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-799efd1b-8e4b-4158-9299-351a06c56189 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1726 microversion: 2.1 time: 0.255229 Sep 06 11:57:00.957759 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3548/7053] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:00 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1726 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:01.986978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d03fbeba-c98c-4dfd-96ec-45045c2477c8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:01.987706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d03fbeba-c98c-4dfd-96ec-45045c2477c8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:01.995342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d03fbeba-c98c-4dfd-96ec-45045c2477c8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:01.995840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d03fbeba-c98c-4dfd-96ec-45045c2477c8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:01.996293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d03fbeba-c98c-4dfd-96ec-45045c2477c8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:01.997004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d03fbeba-c98c-4dfd-96ec-45045c2477c8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:01.997471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d03fbeba-c98c-4dfd-96ec-45045c2477c8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:01.997911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d03fbeba-c98c-4dfd-96ec-45045c2477c8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:02.133225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d03fbeba-c98c-4dfd-96ec-45045c2477c8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:02.142129 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d03fbeba-c98c-4dfd-96ec-45045c2477c8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1726 microversion: 2.1 time: 0.159809 Sep 06 11:57:02.142815 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3506/7054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:01 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:03.168806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ac1d0d24-396b-4ea9-a027-a98ca6436e5f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:03.169534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ac1d0d24-396b-4ea9-a027-a98ca6436e5f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:03.178313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac1d0d24-396b-4ea9-a027-a98ca6436e5f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:03.182646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac1d0d24-396b-4ea9-a027-a98ca6436e5f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:03.182646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac1d0d24-396b-4ea9-a027-a98ca6436e5f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:03.182646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac1d0d24-396b-4ea9-a027-a98ca6436e5f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:03.182646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac1d0d24-396b-4ea9-a027-a98ca6436e5f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:03.182646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac1d0d24-396b-4ea9-a027-a98ca6436e5f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:03.369637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ac1d0d24-396b-4ea9-a027-a98ca6436e5f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:03.378210 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ac1d0d24-396b-4ea9-a027-a98ca6436e5f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1726 microversion: 2.1 time: 0.214923 Sep 06 11:57:03.378808 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3549/7055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:03 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:04.402579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0dbb84e4-dee9-4505-b555-d75d0f77b14e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:04.403458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0dbb84e4-dee9-4505-b555-d75d0f77b14e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:04.410533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dbb84e4-dee9-4505-b555-d75d0f77b14e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:04.411067 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dbb84e4-dee9-4505-b555-d75d0f77b14e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:04.411524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dbb84e4-dee9-4505-b555-d75d0f77b14e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:04.412297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dbb84e4-dee9-4505-b555-d75d0f77b14e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:04.412821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dbb84e4-dee9-4505-b555-d75d0f77b14e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:04.413264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0dbb84e4-dee9-4505-b555-d75d0f77b14e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:04.569976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0dbb84e4-dee9-4505-b555-d75d0f77b14e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:04.578432 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0dbb84e4-dee9-4505-b555-d75d0f77b14e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1723 microversion: 2.1 time: 0.180476 Sep 06 11:57:04.579054 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3507/7056] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:04 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:04.601892 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:04.602506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:04.609472 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:04.610018 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:04.610454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:04.612052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:04.612052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:04.612289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:04.651216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:04.651730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:04.652201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:04.653027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:04.653448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:04.653904 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:04.680742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'ram', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:57:04.686375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Getting quotas for user 3d09c9d5440c4987a99e81bfed501cb5 and project bbe9b44c84c6418387b9c76f8dda94df. Resources: {'ram', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:57:05.167430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-61e5ac6a-4b78-4b45-8569-9a84b7876c79 req-232ce7e6-5c13-435e-8947-5886bc0bcac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f", "name": "network-vif-plugged", "status": "completed", "tag": "453920ef-aad2-450b-b21d-a956c1b87dbe"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:05.177485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-61e5ac6a-4b78-4b45-8569-9a84b7876c79 req-232ce7e6-5c13-435e-8947-5886bc0bcac7 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:05.181868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-61e5ac6a-4b78-4b45-8569-9a84b7876c79 req-232ce7e6-5c13-435e-8947-5886bc0bcac7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:05.181868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-61e5ac6a-4b78-4b45-8569-9a84b7876c79 req-232ce7e6-5c13-435e-8947-5886bc0bcac7 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:05.193887 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-61e5ac6a-4b78-4b45-8569-9a84b7876c79 req-232ce7e6-5c13-435e-8947-5886bc0bcac7 service nova] Creating event network-vif-plugged:453920ef-aad2-450b-b21d-a956c1b87dbe for instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f on nch2-master-1 Sep 06 11:57:05.199959 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-61e5ac6a-4b78-4b45-8569-9a84b7876c79 req-232ce7e6-5c13-435e-8947-5886bc0bcac7 service nova] Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:57:05.211804 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-61e5ac6a-4b78-4b45-8569-9a84b7876c79 req-232ce7e6-5c13-435e-8947-5886bc0bcac7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048154 Sep 06 11:57:05.212454 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3508/7057] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:57:05.422676 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-54f1b301-ffb8-4bcb-8079-768e043e1e9a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "POST /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f/action" status: 202 len: 0 microversion: 2.1 time: 0.824970 Sep 06 11:57:05.423560 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3550/7058] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:57:04 2022] POST /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f/action => generated 0 bytes in 827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:57:05.433136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d7ab3ee9-2088-4f0e-8ea6-d1ba9b90300d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:05.433848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d7ab3ee9-2088-4f0e-8ea6-d1ba9b90300d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:05.441131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ee9-2088-4f0e-8ea6-d1ba9b90300d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:05.441619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ee9-2088-4f0e-8ea6-d1ba9b90300d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:05.442057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ee9-2088-4f0e-8ea6-d1ba9b90300d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:05.442761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ee9-2088-4f0e-8ea6-d1ba9b90300d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:05.443245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ee9-2088-4f0e-8ea6-d1ba9b90300d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:05.443674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ee9-2088-4f0e-8ea6-d1ba9b90300d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:05.582804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d7ab3ee9-2088-4f0e-8ea6-d1ba9b90300d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:05.592186 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d7ab3ee9-2088-4f0e-8ea6-d1ba9b90300d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1722 microversion: 2.1 time: 0.164139 Sep 06 11:57:05.592783 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3509/7059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:05 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:57:06.619214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-712c775f-c258-4c25-bab6-ef487bc80e98 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:06.619947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-712c775f-c258-4c25-bab6-ef487bc80e98 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:06.627330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-712c775f-c258-4c25-bab6-ef487bc80e98 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:06.627843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-712c775f-c258-4c25-bab6-ef487bc80e98 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:06.628304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-712c775f-c258-4c25-bab6-ef487bc80e98 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:06.629093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-712c775f-c258-4c25-bab6-ef487bc80e98 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:06.629504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-712c775f-c258-4c25-bab6-ef487bc80e98 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:06.629986 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-712c775f-c258-4c25-bab6-ef487bc80e98 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:06.768086 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-712c775f-c258-4c25-bab6-ef487bc80e98 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:06.776664 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-712c775f-c258-4c25-bab6-ef487bc80e98 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1722 microversion: 2.1 time: 0.163510 Sep 06 11:57:06.781795 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3551/7060] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:06 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:07.802202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0ebdcea5-60c5-4e8a-a19d-0d955c0a2eab tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:07.802846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0ebdcea5-60c5-4e8a-a19d-0d955c0a2eab tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:07.810517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ebdcea5-60c5-4e8a-a19d-0d955c0a2eab tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:07.811045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ebdcea5-60c5-4e8a-a19d-0d955c0a2eab tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:07.811499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ebdcea5-60c5-4e8a-a19d-0d955c0a2eab tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:07.812273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ebdcea5-60c5-4e8a-a19d-0d955c0a2eab tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:07.812746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ebdcea5-60c5-4e8a-a19d-0d955c0a2eab tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:07.813186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0ebdcea5-60c5-4e8a-a19d-0d955c0a2eab tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:07.950388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0ebdcea5-60c5-4e8a-a19d-0d955c0a2eab tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:07.962591 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0ebdcea5-60c5-4e8a-a19d-0d955c0a2eab tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1722 microversion: 2.1 time: 0.161389 Sep 06 11:57:07.962591 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3510/7061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:07 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:08.984841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-daedda30-ea2c-42f5-b4d6-805bc275e67b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:08.985488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-daedda30-ea2c-42f5-b4d6-805bc275e67b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:08.995398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daedda30-ea2c-42f5-b4d6-805bc275e67b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:08.995920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daedda30-ea2c-42f5-b4d6-805bc275e67b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:08.996401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daedda30-ea2c-42f5-b4d6-805bc275e67b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:08.997150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daedda30-ea2c-42f5-b4d6-805bc275e67b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:08.997731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daedda30-ea2c-42f5-b4d6-805bc275e67b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:08.998567 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-daedda30-ea2c-42f5-b4d6-805bc275e67b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:09.157401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-daedda30-ea2c-42f5-b4d6-805bc275e67b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:09.173173 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-daedda30-ea2c-42f5-b4d6-805bc275e67b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1722 microversion: 2.1 time: 0.185446 Sep 06 11:57:09.173173 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3552/7062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:08 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:10.199287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0755c931-0630-4681-8c36-d605d923487b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:10.199938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0755c931-0630-4681-8c36-d605d923487b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:10.207704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0755c931-0630-4681-8c36-d605d923487b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:10.208187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0755c931-0630-4681-8c36-d605d923487b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:10.208704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0755c931-0630-4681-8c36-d605d923487b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:10.209463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0755c931-0630-4681-8c36-d605d923487b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:10.209936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0755c931-0630-4681-8c36-d605d923487b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:10.210381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0755c931-0630-4681-8c36-d605d923487b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:10.366924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0755c931-0630-4681-8c36-d605d923487b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:10.377264 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0755c931-0630-4681-8c36-d605d923487b tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1722 microversion: 2.1 time: 0.183103 Sep 06 11:57:10.377963 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3511/7063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:10 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:10.910181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-2528d114-7996-4eb5-ab9c-40a50927e757 req-fec67bdc-197c-4312-a8a9-bbaddaf2691f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f", "name": "network-vif-unplugged", "status": "completed", "tag": "453920ef-aad2-450b-b21d-a956c1b87dbe"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:10.925490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2528d114-7996-4eb5-ab9c-40a50927e757 req-fec67bdc-197c-4312-a8a9-bbaddaf2691f service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:10.925490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2528d114-7996-4eb5-ab9c-40a50927e757 req-fec67bdc-197c-4312-a8a9-bbaddaf2691f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:10.929269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2528d114-7996-4eb5-ab9c-40a50927e757 req-fec67bdc-197c-4312-a8a9-bbaddaf2691f service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:10.938944 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-2528d114-7996-4eb5-ab9c-40a50927e757 req-fec67bdc-197c-4312-a8a9-bbaddaf2691f service nova] Creating event network-vif-unplugged:453920ef-aad2-450b-b21d-a956c1b87dbe for instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f on nch1-master-1 Sep 06 11:57:10.944912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-2528d114-7996-4eb5-ab9c-40a50927e757 req-fec67bdc-197c-4312-a8a9-bbaddaf2691f service nova] Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:57:10.955953 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-2528d114-7996-4eb5-ab9c-40a50927e757 req-fec67bdc-197c-4312-a8a9-bbaddaf2691f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049814 Sep 06 11:57:10.958011 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3553/7064] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:57:11.403181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-403a18d7-0cad-40cd-ae8a-471ed274e9b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:11.408013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-403a18d7-0cad-40cd-ae8a-471ed274e9b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:11.411049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403a18d7-0cad-40cd-ae8a-471ed274e9b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:11.411552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403a18d7-0cad-40cd-ae8a-471ed274e9b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:11.411991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403a18d7-0cad-40cd-ae8a-471ed274e9b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:11.412698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403a18d7-0cad-40cd-ae8a-471ed274e9b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:11.413160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403a18d7-0cad-40cd-ae8a-471ed274e9b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:11.414307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403a18d7-0cad-40cd-ae8a-471ed274e9b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:11.556299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-403a18d7-0cad-40cd-ae8a-471ed274e9b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:11.565296 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-403a18d7-0cad-40cd-ae8a-471ed274e9b3 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1722 microversion: 2.1 time: 0.168140 Sep 06 11:57:11.565916 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3512/7065] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:11 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:12.591084 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ae59da6d-e00c-4aa0-b8ea-a66aa6eca7e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:12.591839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ae59da6d-e00c-4aa0-b8ea-a66aa6eca7e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:12.598377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae59da6d-e00c-4aa0-b8ea-a66aa6eca7e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:12.598871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae59da6d-e00c-4aa0-b8ea-a66aa6eca7e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:12.599449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae59da6d-e00c-4aa0-b8ea-a66aa6eca7e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:12.600071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae59da6d-e00c-4aa0-b8ea-a66aa6eca7e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:12.600546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae59da6d-e00c-4aa0-b8ea-a66aa6eca7e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:12.601531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae59da6d-e00c-4aa0-b8ea-a66aa6eca7e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:12.748345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ae59da6d-e00c-4aa0-b8ea-a66aa6eca7e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:12.757623 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ae59da6d-e00c-4aa0-b8ea-a66aa6eca7e0 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1722 microversion: 2.1 time: 0.172135 Sep 06 11:57:12.758228 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3554/7066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:12 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:12.977436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-976c6c37-3f6e-436b-b02e-88f0148670fa req-77245476-0bec-4267-b836-a1a813c26056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f", "tag": "453920ef-aad2-450b-b21d-a956c1b87dbe"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:12.988378 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-976c6c37-3f6e-436b-b02e-88f0148670fa req-77245476-0bec-4267-b836-a1a813c26056 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:12.988970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-976c6c37-3f6e-436b-b02e-88f0148670fa req-77245476-0bec-4267-b836-a1a813c26056 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:12.989492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-976c6c37-3f6e-436b-b02e-88f0148670fa req-77245476-0bec-4267-b836-a1a813c26056 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:13.002972 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-976c6c37-3f6e-436b-b02e-88f0148670fa req-77245476-0bec-4267-b836-a1a813c26056 service nova] Creating event network-changed:453920ef-aad2-450b-b21d-a956c1b87dbe for instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f on nch1-master-1 Sep 06 11:57:13.009688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-976c6c37-3f6e-436b-b02e-88f0148670fa req-77245476-0bec-4267-b836-a1a813c26056 service nova] Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 11:57:13.021666 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-976c6c37-3f6e-436b-b02e-88f0148670fa req-77245476-0bec-4267-b836-a1a813c26056 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049490 Sep 06 11:57:13.022548 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3513/7067] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:57:13.782174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-025e9a49-2ff9-447c-9f07-bde0a8a046a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:13.783078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-025e9a49-2ff9-447c-9f07-bde0a8a046a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:13.790054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-025e9a49-2ff9-447c-9f07-bde0a8a046a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:13.790582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-025e9a49-2ff9-447c-9f07-bde0a8a046a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:13.791074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-025e9a49-2ff9-447c-9f07-bde0a8a046a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:13.791825 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-025e9a49-2ff9-447c-9f07-bde0a8a046a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:13.792395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-025e9a49-2ff9-447c-9f07-bde0a8a046a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:13.792823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-025e9a49-2ff9-447c-9f07-bde0a8a046a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:13.939241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-025e9a49-2ff9-447c-9f07-bde0a8a046a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:13.948493 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-025e9a49-2ff9-447c-9f07-bde0a8a046a4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1722 microversion: 2.1 time: 0.170436 Sep 06 11:57:13.949119 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3555/7068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:13 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:14.975575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f708ea3a-8737-422c-b493-e263bda99b72 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:14.977091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f708ea3a-8737-422c-b493-e263bda99b72 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:14.984124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f708ea3a-8737-422c-b493-e263bda99b72 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:14.984574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f708ea3a-8737-422c-b493-e263bda99b72 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:14.985034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f708ea3a-8737-422c-b493-e263bda99b72 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:14.985942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f708ea3a-8737-422c-b493-e263bda99b72 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:14.986447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f708ea3a-8737-422c-b493-e263bda99b72 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:14.986883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f708ea3a-8737-422c-b493-e263bda99b72 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:15.135517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f708ea3a-8737-422c-b493-e263bda99b72 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:15.144106 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f708ea3a-8737-422c-b493-e263bda99b72 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1722 microversion: 2.1 time: 0.174254 Sep 06 11:57:15.144673 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3514/7069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:14 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:57:16.168216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-94764331-9959-4324-b39e-e12eecbecce8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:16.168855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-94764331-9959-4324-b39e-e12eecbecce8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:16.170871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:16.177435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94764331-9959-4324-b39e-e12eecbecce8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:16.177941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94764331-9959-4324-b39e-e12eecbecce8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:16.178399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94764331-9959-4324-b39e-e12eecbecce8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:16.179164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94764331-9959-4324-b39e-e12eecbecce8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:16.179645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94764331-9959-4324-b39e-e12eecbecce8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:16.180118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94764331-9959-4324-b39e-e12eecbecce8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:16.331680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-94764331-9959-4324-b39e-e12eecbecce8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:16.340742 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-94764331-9959-4324-b39e-e12eecbecce8 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1722 microversion: 2.1 time: 0.177061 Sep 06 11:57:16.341344 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3556/7070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:16 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:17.366168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-edcb4a12-b0de-4761-9514-697211922f80 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:17.384437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-edcb4a12-b0de-4761-9514-697211922f80 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:17.384437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edcb4a12-b0de-4761-9514-697211922f80 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:17.384437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edcb4a12-b0de-4761-9514-697211922f80 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:17.384437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edcb4a12-b0de-4761-9514-697211922f80 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:17.384437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edcb4a12-b0de-4761-9514-697211922f80 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:17.384437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edcb4a12-b0de-4761-9514-697211922f80 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:17.384437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-edcb4a12-b0de-4761-9514-697211922f80 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:17.544668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-edcb4a12-b0de-4761-9514-697211922f80 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:17.553567 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-edcb4a12-b0de-4761-9514-697211922f80 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1722 microversion: 2.1 time: 0.191861 Sep 06 11:57:17.555096 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3515/7071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:17 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:18.578507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-49743147-dd94-49cb-9ade-bed128ee2fd1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:18.579217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-49743147-dd94-49cb-9ade-bed128ee2fd1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:18.586295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49743147-dd94-49cb-9ade-bed128ee2fd1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:18.586800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49743147-dd94-49cb-9ade-bed128ee2fd1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:18.587284 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49743147-dd94-49cb-9ade-bed128ee2fd1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:18.588015 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49743147-dd94-49cb-9ade-bed128ee2fd1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:18.588492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49743147-dd94-49cb-9ade-bed128ee2fd1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:18.588937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-49743147-dd94-49cb-9ade-bed128ee2fd1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:18.725568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-49743147-dd94-49cb-9ade-bed128ee2fd1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:18.734747 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-49743147-dd94-49cb-9ade-bed128ee2fd1 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1715 microversion: 2.1 time: 0.160152 Sep 06 11:57:18.735376 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3557/7072] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:18 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:18.758608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1c293170-2e2e-4bd7-9d9a-f1adf6fade95 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:18.759261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1c293170-2e2e-4bd7-9d9a-f1adf6fade95 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:18.765664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c293170-2e2e-4bd7-9d9a-f1adf6fade95 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:18.766165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c293170-2e2e-4bd7-9d9a-f1adf6fade95 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:18.766618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c293170-2e2e-4bd7-9d9a-f1adf6fade95 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:18.767356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c293170-2e2e-4bd7-9d9a-f1adf6fade95 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:18.767826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c293170-2e2e-4bd7-9d9a-f1adf6fade95 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:18.768267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1c293170-2e2e-4bd7-9d9a-f1adf6fade95 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:18.906814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1c293170-2e2e-4bd7-9d9a-f1adf6fade95 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:18.915507 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1c293170-2e2e-4bd7-9d9a-f1adf6fade95 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1715 microversion: 2.1 time: 0.161202 Sep 06 11:57:18.916127 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3516/7073] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:18 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1715 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:18.939079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-acd37d9a-1550-41ae-b35a-099bfb677e6d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:18.939751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-acd37d9a-1550-41ae-b35a-099bfb677e6d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:18.947028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acd37d9a-1550-41ae-b35a-099bfb677e6d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:18.947546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acd37d9a-1550-41ae-b35a-099bfb677e6d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:18.948009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acd37d9a-1550-41ae-b35a-099bfb677e6d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:18.948747 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acd37d9a-1550-41ae-b35a-099bfb677e6d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:18.949224 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acd37d9a-1550-41ae-b35a-099bfb677e6d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:18.949672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acd37d9a-1550-41ae-b35a-099bfb677e6d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:19.083607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-acd37d9a-1550-41ae-b35a-099bfb677e6d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:19.092538 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-acd37d9a-1550-41ae-b35a-099bfb677e6d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1715 microversion: 2.1 time: 0.157507 Sep 06 11:57:19.093120 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3558/7074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:18 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:19.118812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a2eb1c1b-3ba0-4842-9016-be41f61f80c4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:19.119261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a2eb1c1b-3ba0-4842-9016-be41f61f80c4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:19.125292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2eb1c1b-3ba0-4842-9016-be41f61f80c4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:19.125779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2eb1c1b-3ba0-4842-9016-be41f61f80c4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:19.126235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2eb1c1b-3ba0-4842-9016-be41f61f80c4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:19.126934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2eb1c1b-3ba0-4842-9016-be41f61f80c4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:19.127417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2eb1c1b-3ba0-4842-9016-be41f61f80c4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:19.127852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2eb1c1b-3ba0-4842-9016-be41f61f80c4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:19.157384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a2eb1c1b-3ba0-4842-9016-be41f61f80c4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:57:19.506717 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a2eb1c1b-3ba0-4842-9016-be41f61f80c4 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 204 len: 0 microversion: 2.1 time: 0.391624 Sep 06 11:57:19.508188 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3517/7075] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:57:19 2022] DELETE /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:57:19.517715 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e08a357c-177e-4734-8dcf-1f3f21859644 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:19.518366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e08a357c-177e-4734-8dcf-1f3f21859644 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:19.525751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e08a357c-177e-4734-8dcf-1f3f21859644 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:19.526011 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e08a357c-177e-4734-8dcf-1f3f21859644 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:19.526400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e08a357c-177e-4734-8dcf-1f3f21859644 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:19.527167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e08a357c-177e-4734-8dcf-1f3f21859644 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:19.527648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e08a357c-177e-4734-8dcf-1f3f21859644 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:19.528099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e08a357c-177e-4734-8dcf-1f3f21859644 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:19.598696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-45259672-a84c-4f19-a2ff-9cd5f34b063a req-9d9a7093-3dc4-459e-a056-3d9e0b54d116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f", "name": "network-vif-plugged", "status": "completed", "tag": "453920ef-aad2-450b-b21d-a956c1b87dbe"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:19.608622 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-45259672-a84c-4f19-a2ff-9cd5f34b063a req-9d9a7093-3dc4-459e-a056-3d9e0b54d116 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:19.609122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-45259672-a84c-4f19-a2ff-9cd5f34b063a req-9d9a7093-3dc4-459e-a056-3d9e0b54d116 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:19.609570 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-45259672-a84c-4f19-a2ff-9cd5f34b063a req-9d9a7093-3dc4-459e-a056-3d9e0b54d116 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:19.627526 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-45259672-a84c-4f19-a2ff-9cd5f34b063a req-9d9a7093-3dc4-459e-a056-3d9e0b54d116 service nova] Creating event network-vif-plugged:453920ef-aad2-450b-b21d-a956c1b87dbe for instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f on nch1-master-1 Sep 06 11:57:19.627926 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-45259672-a84c-4f19-a2ff-9cd5f34b063a req-9d9a7093-3dc4-459e-a056-3d9e0b54d116 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035240 Sep 06 11:57:19.628551 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3518/7076] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:57:19.687745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e08a357c-177e-4734-8dcf-1f3f21859644 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:19.699715 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e08a357c-177e-4734-8dcf-1f3f21859644 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1721 microversion: 2.1 time: 0.186552 Sep 06 11:57:19.700823 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3559/7077] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:19 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:20.793230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2c248055-77e8-4661-abdc-42f93dfd9d62 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:20.793944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2c248055-77e8-4661-abdc-42f93dfd9d62 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:20.803485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c248055-77e8-4661-abdc-42f93dfd9d62 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:20.804650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c248055-77e8-4661-abdc-42f93dfd9d62 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:20.805107 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c248055-77e8-4661-abdc-42f93dfd9d62 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:20.805825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c248055-77e8-4661-abdc-42f93dfd9d62 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:20.806312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c248055-77e8-4661-abdc-42f93dfd9d62 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:20.806769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2c248055-77e8-4661-abdc-42f93dfd9d62 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:20.947085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2c248055-77e8-4661-abdc-42f93dfd9d62 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:20.955789 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2c248055-77e8-4661-abdc-42f93dfd9d62 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1721 microversion: 2.1 time: 0.168324 Sep 06 11:57:20.956378 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3519/7078] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:20 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:21.979735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bc3e5009-1573-47a4-b1ec-e3dcce058c82 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:21.980370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bc3e5009-1573-47a4-b1ec-e3dcce058c82 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:21.987907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bc3e5009-1573-47a4-b1ec-e3dcce058c82 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:21.988499 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bc3e5009-1573-47a4-b1ec-e3dcce058c82 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:21.988966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bc3e5009-1573-47a4-b1ec-e3dcce058c82 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:21.989701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bc3e5009-1573-47a4-b1ec-e3dcce058c82 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:21.990182 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bc3e5009-1573-47a4-b1ec-e3dcce058c82 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:21.990737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bc3e5009-1573-47a4-b1ec-e3dcce058c82 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:21.994191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:22.140021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bc3e5009-1573-47a4-b1ec-e3dcce058c82 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:22.148753 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bc3e5009-1573-47a4-b1ec-e3dcce058c82 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1721 microversion: 2.1 time: 0.172946 Sep 06 11:57:22.149383 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3560/7079] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:21 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:22.493391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-62c7c3d8-a933-487f-9b90-cd7006f2cd49 req-338a58f0-f357-4caa-bef7-ef3b34257542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f", "name": "network-vif-deleted", "tag": "453920ef-aad2-450b-b21d-a956c1b87dbe"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:22.505261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-62c7c3d8-a933-487f-9b90-cd7006f2cd49 req-338a58f0-f357-4caa-bef7-ef3b34257542 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:22.507930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-62c7c3d8-a933-487f-9b90-cd7006f2cd49 req-338a58f0-f357-4caa-bef7-ef3b34257542 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:22.507930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-62c7c3d8-a933-487f-9b90-cd7006f2cd49 req-338a58f0-f357-4caa-bef7-ef3b34257542 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:22.518663 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-62c7c3d8-a933-487f-9b90-cd7006f2cd49 req-338a58f0-f357-4caa-bef7-ef3b34257542 service nova] Creating event network-vif-deleted:453920ef-aad2-450b-b21d-a956c1b87dbe for instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f on nch1-master-1 Sep 06 11:57:22.524523 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-62c7c3d8-a933-487f-9b90-cd7006f2cd49 req-338a58f0-f357-4caa-bef7-ef3b34257542 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035707 Sep 06 11:57:22.525239 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3520/7080] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:57:23.173438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:23.174071 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:23.183275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:23.183838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:23.184381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:23.185347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:23.186013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:23.186506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:23.225520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:23.226217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:23.226770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:23.235147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lazy-loading 'fault' on Instance uuid 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:57:23.281324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d09c9d5440c4987a99e81bfed501cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe9b44c84c6418387b9c76f8dda94df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:23.291744 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-030e858a-90ae-4a44-bd85-25746c356873 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 200 len: 1375 microversion: 2.1 time: 0.123350 Sep 06 11:57:23.292348 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3561/7081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:23 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 1375 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:24.331668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e1ae7774-1c0a-4f07-8078-fde9dff3d7c9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:24.332448 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e1ae7774-1c0a-4f07-8078-fde9dff3d7c9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:24.339290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1ae7774-1c0a-4f07-8078-fde9dff3d7c9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:24.339777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1ae7774-1c0a-4f07-8078-fde9dff3d7c9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:24.340223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1ae7774-1c0a-4f07-8078-fde9dff3d7c9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:24.340969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1ae7774-1c0a-4f07-8078-fde9dff3d7c9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:24.341438 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1ae7774-1c0a-4f07-8078-fde9dff3d7c9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:24.341861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e1ae7774-1c0a-4f07-8078-fde9dff3d7c9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:24.356606 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-e1ae7774-1c0a-4f07-8078-fde9dff3d7c9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e1ae7774-1c0a-4f07-8078-fde9dff3d7c9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f HTTP/1.1 Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f'} Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:24.359147 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:24.368960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:24.368960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:24.368960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:24.368960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:57:24.368960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:57:24.368960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:24.368960 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:24.368960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e1ae7774-1c0a-4f07-8078-fde9dff3d7c9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:57:24.368960 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e1ae7774-1c0a-4f07-8078-fde9dff3d7c9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 404 len: 111 microversion: 2.1 time: 0.033484 Sep 06 11:57:24.368960 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3521/7082] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:24 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:57:24.430189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d102910e-b0a5-4ff3-a45b-280c8e3be60e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:24.433504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d102910e-b0a5-4ff3-a45b-280c8e3be60e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:24.440157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d102910e-b0a5-4ff3-a45b-280c8e3be60e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:24.440662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d102910e-b0a5-4ff3-a45b-280c8e3be60e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:24.441117 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d102910e-b0a5-4ff3-a45b-280c8e3be60e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:24.441833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d102910e-b0a5-4ff3-a45b-280c8e3be60e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:24.442311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d102910e-b0a5-4ff3-a45b-280c8e3be60e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:24.442753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d102910e-b0a5-4ff3-a45b-280c8e3be60e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:24.456861 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-d102910e-b0a5-4ff3-a45b-280c8e3be60e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d102910e-b0a5-4ff3-a45b-280c8e3be60e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f/os-volume_attachments HTTP/1.1 Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'server_id': '8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f'} Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:57:24.458605 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d102910e-b0a5-4ff3-a45b-280c8e3be60e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d102910e-b0a5-4ff3-a45b-280c8e3be60e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035451 Sep 06 11:57:24.464594 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3562/7083] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:57:24 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:57:29.052163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-653018a2-bd71-4b81-b9fc-d1da3f96b73a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:29.052743 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-653018a2-bd71-4b81-b9fc-d1da3f96b73a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:29.056000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:29.061172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-653018a2-bd71-4b81-b9fc-d1da3f96b73a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.061735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-653018a2-bd71-4b81-b9fc-d1da3f96b73a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.062130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-653018a2-bd71-4b81-b9fc-d1da3f96b73a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.062853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-653018a2-bd71-4b81-b9fc-d1da3f96b73a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.063355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-653018a2-bd71-4b81-b9fc-d1da3f96b73a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.070229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-653018a2-bd71-4b81-b9fc-d1da3f96b73a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.070229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:29.082306 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-653018a2-bd71-4b81-b9fc-d1da3f96b73a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-653018a2-bd71-4b81-b9fc-d1da3f96b73a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f HTTP/1.1 Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f'} Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:57:29.084406 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-653018a2-bd71-4b81-b9fc-d1da3f96b73a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-653018a2-bd71-4b81-b9fc-d1da3f96b73a tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 404 len: 111 microversion: 2.1 time: 0.038654 Sep 06 11:57:29.092692 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3522/7084] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:57:29 2022] DELETE /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:57:29.099119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c7febd4-9765-4676-8d86-6e80346cff2d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:29.099878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8c7febd4-9765-4676-8d86-6e80346cff2d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:29.103404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:29.108881 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c7febd4-9765-4676-8d86-6e80346cff2d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.115218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c7febd4-9765-4676-8d86-6e80346cff2d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.115218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c7febd4-9765-4676-8d86-6e80346cff2d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.115218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c7febd4-9765-4676-8d86-6e80346cff2d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.115218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c7febd4-9765-4676-8d86-6e80346cff2d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.115218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c7febd4-9765-4676-8d86-6e80346cff2d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.130742 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-8c7febd4-9765-4676-8d86-6e80346cff2d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c7febd4-9765-4676-8d86-6e80346cff2d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f HTTP/1.1 Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f'} Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.132582 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.138535 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.138535 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.138535 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.138535 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:57:29.138535 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:57:29.138535 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. Sep 06 11:57:29.138535 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.138535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c7febd4-9765-4676-8d86-6e80346cff2d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance 8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:57:29.138535 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8c7febd4-9765-4676-8d86-6e80346cff2d tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f" status: 404 len: 111 microversion: 2.1 time: 0.040971 Sep 06 11:57:29.138535 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3563/7085] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:29 2022] GET /compute/v2.1/servers/8a0077b9-77a6-4ae7-9279-c0a7bf22ec4f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:57:29.144390 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff2ea237-228d-4dc5-b1e5-2216fb64a389 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:29.144936 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ff2ea237-228d-4dc5-b1e5-2216fb64a389 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:29.154186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff2ea237-228d-4dc5-b1e5-2216fb64a389 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.154186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff2ea237-228d-4dc5-b1e5-2216fb64a389 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.154186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff2ea237-228d-4dc5-b1e5-2216fb64a389 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.161540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff2ea237-228d-4dc5-b1e5-2216fb64a389 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.161540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff2ea237-228d-4dc5-b1e5-2216fb64a389 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.161540 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ff2ea237-228d-4dc5-b1e5-2216fb64a389 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.171906 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-ff2ea237-228d-4dc5-b1e5-2216fb64a389 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff2ea237-228d-4dc5-b1e5-2216fb64a389 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 HTTP/1.1 Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'dda4f51b-3257-4bb0-81b8-a68cbda02294'} Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:57:29.173692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ff2ea237-228d-4dc5-b1e5-2216fb64a389 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ff2ea237-228d-4dc5-b1e5-2216fb64a389 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 404 len: 111 microversion: 2.1 time: 0.035849 Sep 06 11:57:29.180258 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3523/7086] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:57:29 2022] DELETE /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:57:29.184685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-473eaa42-ac33-4723-a838-3ec91e5615a9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:29.185322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-473eaa42-ac33-4723-a838-3ec91e5615a9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: dda4f51b-3257-4bb0-81b8-a68cbda02294] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:29.191569 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-473eaa42-ac33-4723-a838-3ec91e5615a9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.192069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-473eaa42-ac33-4723-a838-3ec91e5615a9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.192528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-473eaa42-ac33-4723-a838-3ec91e5615a9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.193240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-473eaa42-ac33-4723-a838-3ec91e5615a9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.193721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-473eaa42-ac33-4723-a838-3ec91e5615a9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.194171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-473eaa42-ac33-4723-a838-3ec91e5615a9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.209965 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-473eaa42-ac33-4723-a838-3ec91e5615a9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-473eaa42-ac33-4723-a838-3ec91e5615a9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 HTTP/1.1 Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'dda4f51b-3257-4bb0-81b8-a68cbda02294'} Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.212959 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.222671 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.222671 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.222671 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.222671 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:57:29.222671 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:57:29.222671 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. Sep 06 11:57:29.222671 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.222671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-473eaa42-ac33-4723-a838-3ec91e5615a9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance dda4f51b-3257-4bb0-81b8-a68cbda02294 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:57:29.222671 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-473eaa42-ac33-4723-a838-3ec91e5615a9 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294" status: 404 len: 111 microversion: 2.1 time: 0.033962 Sep 06 11:57:29.222671 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3564/7087] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:29 2022] GET /compute/v2.1/servers/dda4f51b-3257-4bb0-81b8-a68cbda02294 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:57:29.229506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f53204a1-cb7b-4b5f-a44f-3fb667ac3b3f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:29.230406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f53204a1-cb7b-4b5f-a44f-3fb667ac3b3f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:29.239227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f53204a1-cb7b-4b5f-a44f-3fb667ac3b3f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.239734 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f53204a1-cb7b-4b5f-a44f-3fb667ac3b3f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.240190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f53204a1-cb7b-4b5f-a44f-3fb667ac3b3f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.241043 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f53204a1-cb7b-4b5f-a44f-3fb667ac3b3f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.242065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f53204a1-cb7b-4b5f-a44f-3fb667ac3b3f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.242505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f53204a1-cb7b-4b5f-a44f-3fb667ac3b3f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.261676 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-f53204a1-cb7b-4b5f-a44f-3fb667ac3b3f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f53204a1-cb7b-4b5f-a44f-3fb667ac3b3f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 HTTP/1.1 Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '972f32f8-bef5-49aa-aaf9-b29d65a7c859'} Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:57:29.263310 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f53204a1-cb7b-4b5f-a44f-3fb667ac3b3f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f53204a1-cb7b-4b5f-a44f-3fb667ac3b3f tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 404 len: 111 microversion: 2.1 time: 0.042603 Sep 06 11:57:29.271445 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3524/7088] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:57:29 2022] DELETE /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:57:29.273985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-684fa12a-21cd-46ea-8418-ad33d3f00323 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:29.274629 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-684fa12a-21cd-46ea-8418-ad33d3f00323 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 972f32f8-bef5-49aa-aaf9-b29d65a7c859] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:29.282061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-684fa12a-21cd-46ea-8418-ad33d3f00323 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.282712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-684fa12a-21cd-46ea-8418-ad33d3f00323 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.283275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-684fa12a-21cd-46ea-8418-ad33d3f00323 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.284165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-684fa12a-21cd-46ea-8418-ad33d3f00323 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.284742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-684fa12a-21cd-46ea-8418-ad33d3f00323 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.285274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-684fa12a-21cd-46ea-8418-ad33d3f00323 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.303193 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-684fa12a-21cd-46ea-8418-ad33d3f00323 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-684fa12a-21cd-46ea-8418-ad33d3f00323 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 HTTP/1.1 Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '972f32f8-bef5-49aa-aaf9-b29d65a7c859'} Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.321604 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.328083 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.328083 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.328083 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.328083 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:57:29.328083 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:57:29.328083 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. Sep 06 11:57:29.328083 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.328083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-684fa12a-21cd-46ea-8418-ad33d3f00323 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance 972f32f8-bef5-49aa-aaf9-b29d65a7c859 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:57:29.328083 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-684fa12a-21cd-46ea-8418-ad33d3f00323 tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859" status: 404 len: 111 microversion: 2.1 time: 0.037033 Sep 06 11:57:29.328083 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3565/7089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:29 2022] GET /compute/v2.1/servers/972f32f8-bef5-49aa-aaf9-b29d65a7c859 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:57:29.329809 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9186076d-d3e7-4dd9-907e-78db4dc3198e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:29.330346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9186076d-d3e7-4dd9-907e-78db4dc3198e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:29.338316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9186076d-d3e7-4dd9-907e-78db4dc3198e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.338858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9186076d-d3e7-4dd9-907e-78db4dc3198e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.339333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9186076d-d3e7-4dd9-907e-78db4dc3198e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.340046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9186076d-d3e7-4dd9-907e-78db4dc3198e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.340504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9186076d-d3e7-4dd9-907e-78db4dc3198e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.340970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9186076d-d3e7-4dd9-907e-78db4dc3198e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.355670 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-9186076d-d3e7-4dd9-907e-78db4dc3198e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9186076d-d3e7-4dd9-907e-78db4dc3198e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 HTTP/1.1 Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '21ff15a5-802e-40ea-b63d-bf30ea9017a7'} Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:57:29.357210 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9186076d-d3e7-4dd9-907e-78db4dc3198e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9186076d-d3e7-4dd9-907e-78db4dc3198e tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 404 len: 111 microversion: 2.1 time: 0.033665 Sep 06 11:57:29.363102 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3525/7090] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:57:29 2022] DELETE /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:57:29.368884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3a926c91-344e-4c44-99ad-7cb7656f43eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:29.369392 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3a926c91-344e-4c44-99ad-7cb7656f43eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [instance: 21ff15a5-802e-40ea-b63d-bf30ea9017a7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:29.375983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a926c91-344e-4c44-99ad-7cb7656f43eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.376489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a926c91-344e-4c44-99ad-7cb7656f43eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.376937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a926c91-344e-4c44-99ad-7cb7656f43eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.377643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a926c91-344e-4c44-99ad-7cb7656f43eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.378116 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a926c91-344e-4c44-99ad-7cb7656f43eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.378632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a926c91-344e-4c44-99ad-7cb7656f43eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.394427 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-3a926c91-344e-4c44-99ad-7cb7656f43eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] HTTP exception thrown: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3a926c91-344e-4c44-99ad-7cb7656f43eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Request method failure captured: Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 HTTP/1.1 Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzQ2GoqsBiEk3fX_-tbjdzafwAfINOfINtY1rIwXD5dvJBdpqwVH7Qg4ZvfZ8KUAVVhieCF4UX8qJrLVYXIo0g2ncKrdZfYHKqhFvvnNrOxvcdgZfrn3a-WcM_ooTTiDSuysbTQOY2R-hF82Cci0THepT6Di_AvY-fxZWwt0qbekBLw Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbe9b44c84c6418387b9c76f8dda94df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbe9b44c84c6418387b9c76f8dda94df"}]}] Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: bbe9b44c84c6418387b9c76f8dda94df Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServerActionsTestJSON-1249565603 Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 3d09c9d5440c4987a99e81bfed501cb5 Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServerActionsTestJSON-1249565603-project Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': '21ff15a5-802e-40ea-b63d-bf30ea9017a7'} Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:29.396047 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.427782 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:29.427782 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:29.427782 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:29.427782 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:57:29.427782 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:57:29.427782 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. Sep 06 11:57:29.427782 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:57:29.427782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3a926c91-344e-4c44-99ad-7cb7656f43eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Returning 404 to user: Instance 21ff15a5-802e-40ea-b63d-bf30ea9017a7 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:57:29.427782 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3a926c91-344e-4c44-99ad-7cb7656f43eb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7" status: 404 len: 111 microversion: 2.1 time: 0.033941 Sep 06 11:57:29.427782 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3566/7091] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:29 2022] GET /compute/v2.1/servers/21ff15a5-802e-40ea-b63d-bf30ea9017a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:57:29.429328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-94909cbb-826f-4c6f-ba0c-768a35319beb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] Calling method '.version_select at 0x7f90f3177b80>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:29.429328 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [None req-94909cbb-826f-4c6f-ba0c-768a35319beb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [4ed601cc-d1b9-4d75-8bf4-fc5a2264f003] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 11:57:30.424080 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [None req-94909cbb-826f-4c6f-ba0c-768a35319beb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] [4ed601cc-d1b9-4d75-8bf4-fc5a2264f003] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 32946. Sep 06 11:57:30.522185 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-94909cbb-826f-4c6f-ba0c-768a35319beb tempest-ServerActionsTestJSON-1249565603 tempest-ServerActionsTestJSON-1249565603-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082908436" status: 202 len: 0 microversion: 2.1 time: 1.118419 Sep 06 11:57:30.523527 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3526/7092] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:57:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082908436 => generated 0 bytes in 1121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:57:45.590426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=7 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:45.591585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=23 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:45.795100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1833418649", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "e403b4d3-2bee-471a-afb8-0cd835202459"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:45.892956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] validate_networks() for [('e403b4d3-2bee-471a-afb8-0cd835202459', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:57:46.491936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:57:46.492434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:57:46.492983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:57:46.493462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:57:46.493952 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:57:46.511135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:46.511703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:46.512173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:46.513043 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:46.513533 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:46.513985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:46.533870 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Getting quotas for project 27b27569b95443409ce3122494d2fa2f. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:57:46.542606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Getting quotas for user 28c8864e0ffd4c00808bd9649b4981c4 and project 27b27569b95443409ce3122494d2fa2f. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:57:46.559374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:57:46.561807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:57:46.729425 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-957637c5-ce19-446a-830d-56738fde994a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.145489 Sep 06 11:57:46.746312 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3567/7093] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:57:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:57:46.746583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=7 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:46.746583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:46.748182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e4fb5c5a-12b2-4767-87d6-f5da6a1d5ec2 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:46.749445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e4fb5c5a-12b2-4767-87d6-f5da6a1d5ec2 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:46.832278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e4fb5c5a-12b2-4767-87d6-f5da6a1d5ec2 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:46.840384 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e4fb5c5a-12b2-4767-87d6-f5da6a1d5ec2 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1217 microversion: 2.1 time: 0.102539 Sep 06 11:57:46.840995 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3527/7094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:46 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:47.873780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b143203f-287f-40ac-94ee-106d435ddd06 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:47.875658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b143203f-287f-40ac-94ee-106d435ddd06 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:47.959713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b143203f-287f-40ac-94ee-106d435ddd06 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:47.972120 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b143203f-287f-40ac-94ee-106d435ddd06 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1217 microversion: 2.1 time: 0.110000 Sep 06 11:57:47.976494 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3568/7095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:47 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:49.000514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b7b8fe99-ef85-4a12-8321-67f6df44b879 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:49.001320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b7b8fe99-ef85-4a12-8321-67f6df44b879 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:49.084044 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b7b8fe99-ef85-4a12-8321-67f6df44b879 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:49.093069 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b7b8fe99-ef85-4a12-8321-67f6df44b879 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1217 microversion: 2.1 time: 0.096092 Sep 06 11:57:49.093595 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3528/7096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:48 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:50.121295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f8425ea5-b64d-48df-ab18-867da35ea6db tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:50.122091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f8425ea5-b64d-48df-ab18-867da35ea6db tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:50.193576 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f8425ea5-b64d-48df-ab18-867da35ea6db tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:50.204040 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f8425ea5-b64d-48df-ab18-867da35ea6db tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1217 microversion: 2.1 time: 0.088804 Sep 06 11:57:50.208753 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3569/7097] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:50 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:51.230791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-300fd7f0-7917-4f71-bef3-f0bc8710e504 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:51.231444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-300fd7f0-7917-4f71-bef3-f0bc8710e504 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:51.243504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-300fd7f0-7917-4f71-bef3-f0bc8710e504 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:51.246751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-300fd7f0-7917-4f71-bef3-f0bc8710e504 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:51.246751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-300fd7f0-7917-4f71-bef3-f0bc8710e504 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:51.246751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-300fd7f0-7917-4f71-bef3-f0bc8710e504 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:51.247282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-300fd7f0-7917-4f71-bef3-f0bc8710e504 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:51.248072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-300fd7f0-7917-4f71-bef3-f0bc8710e504 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:51.323066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-300fd7f0-7917-4f71-bef3-f0bc8710e504 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:51.335742 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-300fd7f0-7917-4f71-bef3-f0bc8710e504 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1221 microversion: 2.1 time: 0.108381 Sep 06 11:57:51.336828 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3529/7098] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:51 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:52.365433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-108d8f7a-9033-4656-aef0-f02a6b363fa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:52.366898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-108d8f7a-9033-4656-aef0-f02a6b363fa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:52.374722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-108d8f7a-9033-4656-aef0-f02a6b363fa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:52.375275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-108d8f7a-9033-4656-aef0-f02a6b363fa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:52.375745 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-108d8f7a-9033-4656-aef0-f02a6b363fa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:52.376494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-108d8f7a-9033-4656-aef0-f02a6b363fa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:52.376977 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-108d8f7a-9033-4656-aef0-f02a6b363fa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:52.377441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-108d8f7a-9033-4656-aef0-f02a6b363fa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:52.448403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-108d8f7a-9033-4656-aef0-f02a6b363fa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:52.457430 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-108d8f7a-9033-4656-aef0-f02a6b363fa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1221 microversion: 2.1 time: 0.096084 Sep 06 11:57:52.462873 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3570/7099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:52 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:53.487746 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d9caaf78-f3d6-4990-ad16-10f945fedee6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:53.489878 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d9caaf78-f3d6-4990-ad16-10f945fedee6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:53.496506 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9caaf78-f3d6-4990-ad16-10f945fedee6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:53.497404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9caaf78-f3d6-4990-ad16-10f945fedee6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:53.498242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9caaf78-f3d6-4990-ad16-10f945fedee6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:53.499383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9caaf78-f3d6-4990-ad16-10f945fedee6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:53.500071 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9caaf78-f3d6-4990-ad16-10f945fedee6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:53.500895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d9caaf78-f3d6-4990-ad16-10f945fedee6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:53.575997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d9caaf78-f3d6-4990-ad16-10f945fedee6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:53.583550 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d9caaf78-f3d6-4990-ad16-10f945fedee6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1277 microversion: 2.1 time: 0.101776 Sep 06 11:57:53.594423 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3530/7100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:53 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:54.607636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-88fef0d6-941e-4b6a-8d1f-e28b3f13de04 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:54.608419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-88fef0d6-941e-4b6a-8d1f-e28b3f13de04 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:54.615544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88fef0d6-941e-4b6a-8d1f-e28b3f13de04 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:54.616046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88fef0d6-941e-4b6a-8d1f-e28b3f13de04 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:54.616523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88fef0d6-941e-4b6a-8d1f-e28b3f13de04 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:54.617241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88fef0d6-941e-4b6a-8d1f-e28b3f13de04 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:54.617713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88fef0d6-941e-4b6a-8d1f-e28b3f13de04 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:54.618156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-88fef0d6-941e-4b6a-8d1f-e28b3f13de04 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:54.758720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-88fef0d6-941e-4b6a-8d1f-e28b3f13de04 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:54.768656 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-88fef0d6-941e-4b6a-8d1f-e28b3f13de04 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1317 microversion: 2.1 time: 0.164971 Sep 06 11:57:54.769288 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3571/7101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:54 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:55.321221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-7316a998-02ca-44b4-ac6f-34d3a917e42c req-7eea0f8b-c954-420d-a005-a48d7b770948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0157af0-66f5-49d0-a123-916b1f5d0469", "tag": "966195ab-572c-4172-a849-e40f1d187dc0"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:55.344574 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7316a998-02ca-44b4-ac6f-34d3a917e42c req-7eea0f8b-c954-420d-a005-a48d7b770948 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:55.345377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7316a998-02ca-44b4-ac6f-34d3a917e42c req-7eea0f8b-c954-420d-a005-a48d7b770948 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:55.346166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7316a998-02ca-44b4-ac6f-34d3a917e42c req-7eea0f8b-c954-420d-a005-a48d7b770948 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:55.364107 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7316a998-02ca-44b4-ac6f-34d3a917e42c req-7eea0f8b-c954-420d-a005-a48d7b770948 service nova] Creating event network-changed:966195ab-572c-4172-a849-e40f1d187dc0 for instance c0157af0-66f5-49d0-a123-916b1f5d0469 on nch2-master-1 Sep 06 11:57:55.370588 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-7316a998-02ca-44b4-ac6f-34d3a917e42c req-7eea0f8b-c954-420d-a005-a48d7b770948 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058900 Sep 06 11:57:55.371688 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3531/7102] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:57:55.793328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8029cfec-9317-479d-a5dd-d348da807a91 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:55.794307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8029cfec-9317-479d-a5dd-d348da807a91 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:55.801616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8029cfec-9317-479d-a5dd-d348da807a91 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:55.802236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8029cfec-9317-479d-a5dd-d348da807a91 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:55.802755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8029cfec-9317-479d-a5dd-d348da807a91 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:55.803537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8029cfec-9317-479d-a5dd-d348da807a91 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:55.804600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8029cfec-9317-479d-a5dd-d348da807a91 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:55.805152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8029cfec-9317-479d-a5dd-d348da807a91 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:55.996947 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8029cfec-9317-479d-a5dd-d348da807a91 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:56.008128 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8029cfec-9317-479d-a5dd-d348da807a91 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1317 microversion: 2.1 time: 0.217896 Sep 06 11:57:56.009403 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3572/7103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:55 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:57.043310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-65092cfd-c723-4f9b-958d-f148ff8ad7c1 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:57.044138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-65092cfd-c723-4f9b-958d-f148ff8ad7c1 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:57.050893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65092cfd-c723-4f9b-958d-f148ff8ad7c1 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:57.051458 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65092cfd-c723-4f9b-958d-f148ff8ad7c1 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:57.051882 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65092cfd-c723-4f9b-958d-f148ff8ad7c1 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:57.052591 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65092cfd-c723-4f9b-958d-f148ff8ad7c1 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:57.053111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65092cfd-c723-4f9b-958d-f148ff8ad7c1 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:57.054413 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-65092cfd-c723-4f9b-958d-f148ff8ad7c1 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:57.232732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-65092cfd-c723-4f9b-958d-f148ff8ad7c1 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:57.242971 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-65092cfd-c723-4f9b-958d-f148ff8ad7c1 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1317 microversion: 2.1 time: 0.206300 Sep 06 11:57:57.243585 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3532/7104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:57 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:58.270309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b96dca79-7a72-4a87-863f-603520fe6d1b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:58.271456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b96dca79-7a72-4a87-863f-603520fe6d1b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:58.274209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:58.281557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b96dca79-7a72-4a87-863f-603520fe6d1b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:58.282094 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b96dca79-7a72-4a87-863f-603520fe6d1b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:58.282636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b96dca79-7a72-4a87-863f-603520fe6d1b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:58.283380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b96dca79-7a72-4a87-863f-603520fe6d1b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:58.283860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b96dca79-7a72-4a87-863f-603520fe6d1b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:58.284318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b96dca79-7a72-4a87-863f-603520fe6d1b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:58.469246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b96dca79-7a72-4a87-863f-603520fe6d1b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:58.479503 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b96dca79-7a72-4a87-863f-603520fe6d1b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1317 microversion: 2.1 time: 0.215738 Sep 06 11:57:58.480180 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3573/7105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:58 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:59.507329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b0568d97-dfd9-4ba5-b20c-c7cc68e943c7 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:59.508383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b0568d97-dfd9-4ba5-b20c-c7cc68e943c7 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:59.511499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:59.516583 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0568d97-dfd9-4ba5-b20c-c7cc68e943c7 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:59.517088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0568d97-dfd9-4ba5-b20c-c7cc68e943c7 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:59.517656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0568d97-dfd9-4ba5-b20c-c7cc68e943c7 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:59.518379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0568d97-dfd9-4ba5-b20c-c7cc68e943c7 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:59.518899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0568d97-dfd9-4ba5-b20c-c7cc68e943c7 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:59.523797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b0568d97-dfd9-4ba5-b20c-c7cc68e943c7 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:59.697517 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b0568d97-dfd9-4ba5-b20c-c7cc68e943c7 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:59.705644 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b0568d97-dfd9-4ba5-b20c-c7cc68e943c7 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1317 microversion: 2.1 time: 0.204355 Sep 06 11:57:59.706110 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3533/7106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:59 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:00.729901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5c607a6f-2637-454b-aee4-02b97f70ca59 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:00.730528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5c607a6f-2637-454b-aee4-02b97f70ca59 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:00.733390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=10 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:00.740134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c607a6f-2637-454b-aee4-02b97f70ca59 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:00.740654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c607a6f-2637-454b-aee4-02b97f70ca59 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:00.741180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c607a6f-2637-454b-aee4-02b97f70ca59 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:00.742426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c607a6f-2637-454b-aee4-02b97f70ca59 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:00.746877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c607a6f-2637-454b-aee4-02b97f70ca59 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:00.746877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5c607a6f-2637-454b-aee4-02b97f70ca59 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:00.909597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5c607a6f-2637-454b-aee4-02b97f70ca59 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:00.928352 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5c607a6f-2637-454b-aee4-02b97f70ca59 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1317 microversion: 2.1 time: 0.202634 Sep 06 11:58:00.929265 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3574/7107] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:00 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:01.476105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f014eb9c-5071-447b-8ffd-56c4cf7e9c1a req-55876f43-110f-4d81-8ae0-cf05cd0831fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0157af0-66f5-49d0-a123-916b1f5d0469", "name": "network-vif-plugged", "status": "completed", "tag": "966195ab-572c-4172-a849-e40f1d187dc0"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:58:01.488840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f014eb9c-5071-447b-8ffd-56c4cf7e9c1a req-55876f43-110f-4d81-8ae0-cf05cd0831fd service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:01.489344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f014eb9c-5071-447b-8ffd-56c4cf7e9c1a req-55876f43-110f-4d81-8ae0-cf05cd0831fd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:01.489846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f014eb9c-5071-447b-8ffd-56c4cf7e9c1a req-55876f43-110f-4d81-8ae0-cf05cd0831fd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:01.504787 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f014eb9c-5071-447b-8ffd-56c4cf7e9c1a req-55876f43-110f-4d81-8ae0-cf05cd0831fd service nova] Creating event network-vif-plugged:966195ab-572c-4172-a849-e40f1d187dc0 for instance c0157af0-66f5-49d0-a123-916b1f5d0469 on nch2-master-1 Sep 06 11:58:01.510529 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f014eb9c-5071-447b-8ffd-56c4cf7e9c1a req-55876f43-110f-4d81-8ae0-cf05cd0831fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038558 Sep 06 11:58:01.511164 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3534/7108] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:58:01.963313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9a0123ec-4b4a-4f2e-8653-dff8a6271a5c tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:01.964238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9a0123ec-4b4a-4f2e-8653-dff8a6271a5c tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:01.975438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a0123ec-4b4a-4f2e-8653-dff8a6271a5c tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:01.976858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a0123ec-4b4a-4f2e-8653-dff8a6271a5c tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:01.977700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a0123ec-4b4a-4f2e-8653-dff8a6271a5c tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:01.978860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a0123ec-4b4a-4f2e-8653-dff8a6271a5c tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:01.979425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a0123ec-4b4a-4f2e-8653-dff8a6271a5c tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:01.980120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9a0123ec-4b4a-4f2e-8653-dff8a6271a5c tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:02.178654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9a0123ec-4b4a-4f2e-8653-dff8a6271a5c tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:02.188121 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9a0123ec-4b4a-4f2e-8653-dff8a6271a5c tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1317 microversion: 2.1 time: 0.229407 Sep 06 11:58:02.188797 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3575/7109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:01 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:03.217760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-acd511c9-e579-452a-853a-7431cddfd146 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:03.218391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-acd511c9-e579-452a-853a-7431cddfd146 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:03.226639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acd511c9-e579-452a-853a-7431cddfd146 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:03.227445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acd511c9-e579-452a-853a-7431cddfd146 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:03.228049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acd511c9-e579-452a-853a-7431cddfd146 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:03.228930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acd511c9-e579-452a-853a-7431cddfd146 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:03.229495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acd511c9-e579-452a-853a-7431cddfd146 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:03.230041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-acd511c9-e579-452a-853a-7431cddfd146 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:03.417935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-acd511c9-e579-452a-853a-7431cddfd146 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:03.427496 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-acd511c9-e579-452a-853a-7431cddfd146 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1506 microversion: 2.1 time: 0.214080 Sep 06 11:58:03.428103 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3535/7110] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:03 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:03.502648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-146740279", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "e403b4d3-2bee-471a-afb8-0cd835202459"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:58:03.579408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] validate_networks() for [('e403b4d3-2bee-471a-afb8-0cd835202459', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:58:04.037432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:58:04.037989 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:58:04.039032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:58:04.039486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:58:04.039914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:58:04.049956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:04.050401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:04.050857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:04.051652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:04.052123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:04.052656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:04.070949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Getting quotas for project 27b27569b95443409ce3122494d2fa2f. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:58:04.076427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Getting quotas for user 28c8864e0ffd4c00808bd9649b4981c4 and project 27b27569b95443409ce3122494d2fa2f. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:58:04.094868 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:58:04.098305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:58:04.247566 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-03891d39-78b9-4f22-b530-3b2b574e4144 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748914 Sep 06 11:58:04.248572 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3576/7111] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:58:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:58:04.260248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-915e06ec-bf8c-41cd-bd2d-75f86a6fdd57 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:04.260912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-915e06ec-bf8c-41cd-bd2d-75f86a6fdd57 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:04.324510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-915e06ec-bf8c-41cd-bd2d-75f86a6fdd57 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:04.332530 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-915e06ec-bf8c-41cd-bd2d-75f86a6fdd57 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1216 microversion: 2.1 time: 0.076780 Sep 06 11:58:04.333163 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3536/7112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:04 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1216 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:05.355988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5b96b4bc-f7d6-40af-b76a-d1d05b17f6f0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:05.356632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5b96b4bc-f7d6-40af-b76a-d1d05b17f6f0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:05.413965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5b96b4bc-f7d6-40af-b76a-d1d05b17f6f0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:05.421447 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5b96b4bc-f7d6-40af-b76a-d1d05b17f6f0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1216 microversion: 2.1 time: 0.070364 Sep 06 11:58:05.422035 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3577/7113] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:05 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:06.445798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3847d4f5-2375-466b-b62f-37cb43ac2b55 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:06.446496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3847d4f5-2375-466b-b62f-37cb43ac2b55 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:06.456482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3847d4f5-2375-466b-b62f-37cb43ac2b55 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:06.457007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3847d4f5-2375-466b-b62f-37cb43ac2b55 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:06.457508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3847d4f5-2375-466b-b62f-37cb43ac2b55 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:06.458227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3847d4f5-2375-466b-b62f-37cb43ac2b55 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:06.459337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3847d4f5-2375-466b-b62f-37cb43ac2b55 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:06.459337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3847d4f5-2375-466b-b62f-37cb43ac2b55 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:06.531494 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3847d4f5-2375-466b-b62f-37cb43ac2b55 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:06.539613 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3847d4f5-2375-466b-b62f-37cb43ac2b55 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1268 microversion: 2.1 time: 0.098433 Sep 06 11:58:06.540386 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3537/7114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:06 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1268 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:07.563665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a6688e70-e1ee-4c6d-86db-8dc44148d496 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:07.564519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a6688e70-e1ee-4c6d-86db-8dc44148d496 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:07.567703 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:58:07.567896 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 11:58:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 (ip 10.222.0.20) !!! Sep 06 11:58:07.576343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6688e70-e1ee-4c6d-86db-8dc44148d496 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:07.577174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6688e70-e1ee-4c6d-86db-8dc44148d496 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:07.577662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6688e70-e1ee-4c6d-86db-8dc44148d496 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:07.578373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6688e70-e1ee-4c6d-86db-8dc44148d496 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:07.578849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6688e70-e1ee-4c6d-86db-8dc44148d496 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:07.579334 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a6688e70-e1ee-4c6d-86db-8dc44148d496 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:07.647670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a6688e70-e1ee-4c6d-86db-8dc44148d496 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:07.656069 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a6688e70-e1ee-4c6d-86db-8dc44148d496 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1274 microversion: 2.1 time: 0.096389 Sep 06 11:58:07.656665 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3578/7115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:07 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:08.680214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4c7b55f7-c1e6-4252-99a8-209d6fe245ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:08.680895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4c7b55f7-c1e6-4252-99a8-209d6fe245ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:08.683308 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:58:08.683448 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 11:58:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 (ip 10.222.0.20) !!! Sep 06 11:58:08.692815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c7b55f7-c1e6-4252-99a8-209d6fe245ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:08.693313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c7b55f7-c1e6-4252-99a8-209d6fe245ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:08.693879 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c7b55f7-c1e6-4252-99a8-209d6fe245ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:08.694604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c7b55f7-c1e6-4252-99a8-209d6fe245ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:08.695133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c7b55f7-c1e6-4252-99a8-209d6fe245ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:08.695576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4c7b55f7-c1e6-4252-99a8-209d6fe245ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:08.840728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4c7b55f7-c1e6-4252-99a8-209d6fe245ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:08.848812 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4c7b55f7-c1e6-4252-99a8-209d6fe245ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1316 microversion: 2.1 time: 0.172614 Sep 06 11:58:08.849484 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3538/7116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:08 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:09.089323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a1160e5b-9336-4e50-b7bf-fb64ea38fcb2 req-bf8c7379-897e-4244-b455-d31f92267aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f037e4b0-3091-4649-8f82-7cb3d6a49d34", "tag": "cf19cd26-f28b-4943-88b2-0688f163b173"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:58:09.100319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a1160e5b-9336-4e50-b7bf-fb64ea38fcb2 req-bf8c7379-897e-4244-b455-d31f92267aa8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:09.103069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a1160e5b-9336-4e50-b7bf-fb64ea38fcb2 req-bf8c7379-897e-4244-b455-d31f92267aa8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:09.103069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a1160e5b-9336-4e50-b7bf-fb64ea38fcb2 req-bf8c7379-897e-4244-b455-d31f92267aa8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:09.114168 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a1160e5b-9336-4e50-b7bf-fb64ea38fcb2 req-bf8c7379-897e-4244-b455-d31f92267aa8 service nova] Creating event network-changed:cf19cd26-f28b-4943-88b2-0688f163b173 for instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 on nch1-master-1 Sep 06 11:58:09.120191 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a1160e5b-9336-4e50-b7bf-fb64ea38fcb2 req-bf8c7379-897e-4244-b455-d31f92267aa8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034870 Sep 06 11:58:09.120819 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3579/7117] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:58:09.872782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-aa0b339e-9a58-4044-865d-bc6f2fcee182 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:09.873379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-aa0b339e-9a58-4044-865d-bc6f2fcee182 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:09.880786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa0b339e-9a58-4044-865d-bc6f2fcee182 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:09.881287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa0b339e-9a58-4044-865d-bc6f2fcee182 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:09.881832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa0b339e-9a58-4044-865d-bc6f2fcee182 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:09.882505 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa0b339e-9a58-4044-865d-bc6f2fcee182 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:09.882972 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa0b339e-9a58-4044-865d-bc6f2fcee182 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:09.883563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-aa0b339e-9a58-4044-865d-bc6f2fcee182 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:10.021863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-aa0b339e-9a58-4044-865d-bc6f2fcee182 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:10.037280 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-aa0b339e-9a58-4044-865d-bc6f2fcee182 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1316 microversion: 2.1 time: 0.162121 Sep 06 11:58:10.037280 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3539/7118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:09 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:58:11.056966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-61fb9d85-4c8b-4055-9a90-0db7a20ad70a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:11.057690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-61fb9d85-4c8b-4055-9a90-0db7a20ad70a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:11.064326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61fb9d85-4c8b-4055-9a90-0db7a20ad70a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:11.064841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61fb9d85-4c8b-4055-9a90-0db7a20ad70a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:11.065300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61fb9d85-4c8b-4055-9a90-0db7a20ad70a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:11.066022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61fb9d85-4c8b-4055-9a90-0db7a20ad70a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:11.066495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61fb9d85-4c8b-4055-9a90-0db7a20ad70a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:11.066938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-61fb9d85-4c8b-4055-9a90-0db7a20ad70a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:11.205938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-61fb9d85-4c8b-4055-9a90-0db7a20ad70a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:11.214966 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-61fb9d85-4c8b-4055-9a90-0db7a20ad70a tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1316 microversion: 2.1 time: 0.163263 Sep 06 11:58:11.215663 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3580/7119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:11 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:12.239698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2dbac3c5-358c-4bae-9716-86dde153a49e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:12.240404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2dbac3c5-358c-4bae-9716-86dde153a49e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:12.248348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2dbac3c5-358c-4bae-9716-86dde153a49e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:12.248848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2dbac3c5-358c-4bae-9716-86dde153a49e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:12.249337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2dbac3c5-358c-4bae-9716-86dde153a49e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:12.250119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2dbac3c5-358c-4bae-9716-86dde153a49e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:12.250586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2dbac3c5-358c-4bae-9716-86dde153a49e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:12.251041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2dbac3c5-358c-4bae-9716-86dde153a49e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:12.391830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2dbac3c5-358c-4bae-9716-86dde153a49e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:12.400434 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2dbac3c5-358c-4bae-9716-86dde153a49e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1316 microversion: 2.1 time: 0.165621 Sep 06 11:58:12.401017 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3540/7120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:12 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:13.424902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d167e410-9668-4b8d-b618-60fd0fcc64a6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:13.425562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d167e410-9668-4b8d-b618-60fd0fcc64a6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:13.432649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d167e410-9668-4b8d-b618-60fd0fcc64a6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:13.433148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d167e410-9668-4b8d-b618-60fd0fcc64a6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:13.433604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d167e410-9668-4b8d-b618-60fd0fcc64a6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:13.434312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d167e410-9668-4b8d-b618-60fd0fcc64a6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:13.434787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d167e410-9668-4b8d-b618-60fd0fcc64a6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:13.435262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d167e410-9668-4b8d-b618-60fd0fcc64a6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:13.578225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d167e410-9668-4b8d-b618-60fd0fcc64a6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:13.586868 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d167e410-9668-4b8d-b618-60fd0fcc64a6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1316 microversion: 2.1 time: 0.165969 Sep 06 11:58:13.587249 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3581/7121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:13 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:13.725802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-1add419c-8f7c-45ec-b3a1-fcd42094030d req-da892634-f45a-46cf-b492-ff86c5fba6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f037e4b0-3091-4649-8f82-7cb3d6a49d34", "name": "network-vif-plugged", "status": "completed", "tag": "cf19cd26-f28b-4943-88b2-0688f163b173"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:58:13.739300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1add419c-8f7c-45ec-b3a1-fcd42094030d req-da892634-f45a-46cf-b492-ff86c5fba6d3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:13.739300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1add419c-8f7c-45ec-b3a1-fcd42094030d req-da892634-f45a-46cf-b492-ff86c5fba6d3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:13.739300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1add419c-8f7c-45ec-b3a1-fcd42094030d req-da892634-f45a-46cf-b492-ff86c5fba6d3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:13.749737 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-1add419c-8f7c-45ec-b3a1-fcd42094030d req-da892634-f45a-46cf-b492-ff86c5fba6d3 service nova] Creating event network-vif-plugged:cf19cd26-f28b-4943-88b2-0688f163b173 for instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 on nch1-master-1 Sep 06 11:58:13.754812 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-1add419c-8f7c-45ec-b3a1-fcd42094030d req-da892634-f45a-46cf-b492-ff86c5fba6d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032894 Sep 06 11:58:13.755481 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3541/7122] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:58:14.610060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f0674247-92bf-4e03-9efd-f032cff277ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:14.610676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f0674247-92bf-4e03-9efd-f032cff277ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:14.612737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:14.618595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0674247-92bf-4e03-9efd-f032cff277ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:14.619128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0674247-92bf-4e03-9efd-f032cff277ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:14.619592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0674247-92bf-4e03-9efd-f032cff277ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:14.620308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0674247-92bf-4e03-9efd-f032cff277ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:14.620785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0674247-92bf-4e03-9efd-f032cff277ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:14.621263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f0674247-92bf-4e03-9efd-f032cff277ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:14.760555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f0674247-92bf-4e03-9efd-f032cff277ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:14.768660 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f0674247-92bf-4e03-9efd-f032cff277ac tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1316 microversion: 2.1 time: 0.162677 Sep 06 11:58:14.769241 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3582/7123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:14 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:15.789640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:15.794887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-543af0da-9ae4-4f35-b8cb-0b0595eed975 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:15.795629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-543af0da-9ae4-4f35-b8cb-0b0595eed975 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:15.802311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-543af0da-9ae4-4f35-b8cb-0b0595eed975 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:15.802804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-543af0da-9ae4-4f35-b8cb-0b0595eed975 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:15.803285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-543af0da-9ae4-4f35-b8cb-0b0595eed975 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:15.804046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-543af0da-9ae4-4f35-b8cb-0b0595eed975 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:15.804861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-543af0da-9ae4-4f35-b8cb-0b0595eed975 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:15.805305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-543af0da-9ae4-4f35-b8cb-0b0595eed975 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:15.949700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-543af0da-9ae4-4f35-b8cb-0b0595eed975 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:15.957855 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-543af0da-9ae4-4f35-b8cb-0b0595eed975 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1505 microversion: 2.1 time: 0.169191 Sep 06 11:58:15.959071 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3542/7124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:15 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:15.980266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c3dfc427-4b9d-4459-8deb-17b51fd3823d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:15.980801 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c3dfc427-4b9d-4459-8deb-17b51fd3823d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:15.982652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:15.984184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:15.989109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3dfc427-4b9d-4459-8deb-17b51fd3823d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:15.989607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3dfc427-4b9d-4459-8deb-17b51fd3823d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:15.990061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3dfc427-4b9d-4459-8deb-17b51fd3823d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:15.990772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3dfc427-4b9d-4459-8deb-17b51fd3823d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:15.991318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3dfc427-4b9d-4459-8deb-17b51fd3823d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:15.992270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c3dfc427-4b9d-4459-8deb-17b51fd3823d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:15.995083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=67 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:16.024598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c3dfc427-4b9d-4459-8deb-17b51fd3823d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:58:16.498577 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c3dfc427-4b9d-4459-8deb-17b51fd3823d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 204 len: 0 microversion: 2.1 time: 0.521991 Sep 06 11:58:16.499227 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3583/7125] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:58:15 2022] DELETE /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:58:16.507309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8fe90be2-c67b-470d-a2e8-6e794f2f5b29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:16.507937 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8fe90be2-c67b-470d-a2e8-6e794f2f5b29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:16.514089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8fe90be2-c67b-470d-a2e8-6e794f2f5b29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:16.514582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8fe90be2-c67b-470d-a2e8-6e794f2f5b29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:16.515048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8fe90be2-c67b-470d-a2e8-6e794f2f5b29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:16.515763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8fe90be2-c67b-470d-a2e8-6e794f2f5b29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:16.516230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8fe90be2-c67b-470d-a2e8-6e794f2f5b29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:16.516665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8fe90be2-c67b-470d-a2e8-6e794f2f5b29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:16.652529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8fe90be2-c67b-470d-a2e8-6e794f2f5b29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:16.661149 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8fe90be2-c67b-470d-a2e8-6e794f2f5b29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1511 microversion: 2.1 time: 0.157763 Sep 06 11:58:16.661803 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3543/7126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:16 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:17.687225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-87e75bb9-aa47-4510-bf9e-d2c40d8451a4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:17.687901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-87e75bb9-aa47-4510-bf9e-d2c40d8451a4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:17.695312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87e75bb9-aa47-4510-bf9e-d2c40d8451a4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:17.696063 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87e75bb9-aa47-4510-bf9e-d2c40d8451a4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:17.697061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87e75bb9-aa47-4510-bf9e-d2c40d8451a4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:17.697788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87e75bb9-aa47-4510-bf9e-d2c40d8451a4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:17.698270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87e75bb9-aa47-4510-bf9e-d2c40d8451a4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:17.698720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-87e75bb9-aa47-4510-bf9e-d2c40d8451a4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:17.856257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-87e75bb9-aa47-4510-bf9e-d2c40d8451a4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:17.869164 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-87e75bb9-aa47-4510-bf9e-d2c40d8451a4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1511 microversion: 2.1 time: 0.186357 Sep 06 11:58:17.869762 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3584/7127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:17 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1511 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:18.446105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-2a01c241-e089-4958-98e1-75d235d44b8d req-819ac12d-ab6a-4505-99b3-ee50d5fcb329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f037e4b0-3091-4649-8f82-7cb3d6a49d34", "name": "network-vif-deleted", "tag": "cf19cd26-f28b-4943-88b2-0688f163b173"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:58:18.457077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2a01c241-e089-4958-98e1-75d235d44b8d req-819ac12d-ab6a-4505-99b3-ee50d5fcb329 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:18.457554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2a01c241-e089-4958-98e1-75d235d44b8d req-819ac12d-ab6a-4505-99b3-ee50d5fcb329 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:18.458205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2a01c241-e089-4958-98e1-75d235d44b8d req-819ac12d-ab6a-4505-99b3-ee50d5fcb329 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:18.462831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=73 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:18.471996 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-2a01c241-e089-4958-98e1-75d235d44b8d req-819ac12d-ab6a-4505-99b3-ee50d5fcb329 service nova] Creating event network-vif-deleted:cf19cd26-f28b-4943-88b2-0688f163b173 for instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 on nch1-master-1 Sep 06 11:58:18.478187 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-2a01c241-e089-4958-98e1-75d235d44b8d req-819ac12d-ab6a-4505-99b3-ee50d5fcb329 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035912 Sep 06 11:58:18.479412 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3544/7128] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:58:18.895585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e5c8ff03-fd16-432c-885e-0ac7e36f6868 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:18.896234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e5c8ff03-fd16-432c-885e-0ac7e36f6868 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:18.903532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5c8ff03-fd16-432c-885e-0ac7e36f6868 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:18.906005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5c8ff03-fd16-432c-885e-0ac7e36f6868 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:18.906005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5c8ff03-fd16-432c-885e-0ac7e36f6868 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:18.906005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5c8ff03-fd16-432c-885e-0ac7e36f6868 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:18.906005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5c8ff03-fd16-432c-885e-0ac7e36f6868 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:18.906450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e5c8ff03-fd16-432c-885e-0ac7e36f6868 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:18.974045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e5c8ff03-fd16-432c-885e-0ac7e36f6868 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:18.983443 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e5c8ff03-fd16-432c-885e-0ac7e36f6868 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 200 len: 1301 microversion: 2.1 time: 0.091979 Sep 06 11:58:18.984333 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3585/7129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:18 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 1301 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:20.010789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-78e9e242-980f-4dec-8f67-dc524ab0c3c4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:20.012192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-78e9e242-980f-4dec-8f67-dc524ab0c3c4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:20.016242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=43 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:20.022940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78e9e242-980f-4dec-8f67-dc524ab0c3c4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.023471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78e9e242-980f-4dec-8f67-dc524ab0c3c4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.023927 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78e9e242-980f-4dec-8f67-dc524ab0c3c4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:20.025283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78e9e242-980f-4dec-8f67-dc524ab0c3c4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.025751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78e9e242-980f-4dec-8f67-dc524ab0c3c4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.026195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-78e9e242-980f-4dec-8f67-dc524ab0c3c4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:20.040141 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-78e9e242-980f-4dec-8f67-dc524ab0c3c4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] HTTP exception thrown: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-78e9e242-980f-4dec-8f67-dc524ab0c3c4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Request method failure captured: Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 HTTP/1.1 Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzW5NxscITDKGy1P5g02Gp_W7tSyAKzaoyijiGESA1HFcvAEEwMa9sl7Fi0oC7sDvnK0Axl6QTDhzOoNjreq9DjC3ab0Jk4gRYVATowSrERIdvT2zVdEVqCQ9TVuM3gHAViwH-oNGDRV7Wg4cF19CWX-_zXe4pc4wnlJb6A202CTq6s Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27b27569b95443409ce3122494d2fa2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}] Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 28c8864e0ffd4c00808bd9649b4981c4 Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'f037e4b0-3091-4649-8f82-7cb3d6a49d34'} Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:20.048981 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.055249 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:20.055249 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:20.055249 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:20.055249 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:58:20.055249 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:58:20.055249 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:20.055249 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.055249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-78e9e242-980f-4dec-8f67-dc524ab0c3c4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Returning 404 to user: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:58:20.055249 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-78e9e242-980f-4dec-8f67-dc524ab0c3c4 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 404 len: 111 microversion: 2.1 time: 0.039799 Sep 06 11:58:20.055249 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3545/7130] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:20 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:58:20.056218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6c7d5669-8af9-4d47-b6d2-63db1abe4719 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:20.056218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6c7d5669-8af9-4d47-b6d2-63db1abe4719 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:20.061593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c7d5669-8af9-4d47-b6d2-63db1abe4719 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.062101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c7d5669-8af9-4d47-b6d2-63db1abe4719 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.062557 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c7d5669-8af9-4d47-b6d2-63db1abe4719 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:20.063314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c7d5669-8af9-4d47-b6d2-63db1abe4719 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.063790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c7d5669-8af9-4d47-b6d2-63db1abe4719 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.064242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c7d5669-8af9-4d47-b6d2-63db1abe4719 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:20.205579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6c7d5669-8af9-4d47-b6d2-63db1abe4719 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:20.213681 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6c7d5669-8af9-4d47-b6d2-63db1abe4719 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1506 microversion: 2.1 time: 0.164756 Sep 06 11:58:20.214281 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3586/7131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:20 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:20.236966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7c489dbd-2b8d-4c0a-a8b5-b64cd4f35243 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:58:20.239291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7c489dbd-2b8d-4c0a-a8b5-b64cd4f35243 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: 7451afa2-8f47-43ab-8e98-deb9d211d471] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:20.245899 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-7c489dbd-2b8d-4c0a-a8b5-b64cd4f35243 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] HTTP exception thrown: Instance 7451afa2-8f47-43ab-8e98-deb9d211d471 could not be found. Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7c489dbd-2b8d-4c0a-a8b5-b64cd4f35243 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Request method failure captured: Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/7451afa2-8f47-43ab-8e98-deb9d211d471/action HTTP/1.1 Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 32 Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzW5NxscITDKGy1P5g02Gp_W7tSyAKzaoyijiGESA1HFcvAEEwMa9sl7Fi0oC7sDvnK0Axl6QTDhzOoNjreq9DjC3ab0Jk4gRYVATowSrERIdvT2zVdEVqCQ9TVuM3gHAViwH-oNGDRV7Wg4cF19CWX-_zXe4pc4wnlJb6A202CTq6s Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27b27569b95443409ce3122494d2fa2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}] Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 28c8864e0ffd4c00808bd9649b4981c4 Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: {"resize": {"flavorRef": "452"}} Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 7451afa2-8f47-43ab-8e98-deb9d211d471 could not be found. Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '7451afa2-8f47-43ab-8e98-deb9d211d471', 'body': {'resize': {'flavorRef': '452'}}} Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7451afa2-8f47-43ab-8e98-deb9d211d471 could not be found. Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:58:20.247532 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7451afa2-8f47-43ab-8e98-deb9d211d471 could not be found. Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7451afa2-8f47-43ab-8e98-deb9d211d471 could not be found. Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7c489dbd-2b8d-4c0a-a8b5-b64cd4f35243 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Returning 404 to user: Instance 7451afa2-8f47-43ab-8e98-deb9d211d471 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7c489dbd-2b8d-4c0a-a8b5-b64cd4f35243 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "POST /compute/v2.1/servers/7451afa2-8f47-43ab-8e98-deb9d211d471/action" status: 404 len: 111 microversion: 2.1 time: 0.016365 Sep 06 11:58:20.253647 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3546/7132] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:58:20 2022] POST /compute/v2.1/servers/7451afa2-8f47-43ab-8e98-deb9d211d471/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:58:20.258237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b368a602-dc00-4ff2-92c1-1125fc96ffea tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:20.264685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b368a602-dc00-4ff2-92c1-1125fc96ffea tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:20.265177 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b368a602-dc00-4ff2-92c1-1125fc96ffea tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.265674 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b368a602-dc00-4ff2-92c1-1125fc96ffea tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.266124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b368a602-dc00-4ff2-92c1-1125fc96ffea tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:20.266833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b368a602-dc00-4ff2-92c1-1125fc96ffea tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.267337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b368a602-dc00-4ff2-92c1-1125fc96ffea tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.267781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b368a602-dc00-4ff2-92c1-1125fc96ffea tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:20.403188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b368a602-dc00-4ff2-92c1-1125fc96ffea tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:20.411313 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b368a602-dc00-4ff2-92c1-1125fc96ffea tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1506 microversion: 2.1 time: 0.157016 Sep 06 11:58:20.411911 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3587/7133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:20 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:20.435888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-73fe9982-942e-4878-bd31-e5e29afc941e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:20.436498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-73fe9982-942e-4878-bd31-e5e29afc941e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:20.443657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73fe9982-942e-4878-bd31-e5e29afc941e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.444145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73fe9982-942e-4878-bd31-e5e29afc941e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.444594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73fe9982-942e-4878-bd31-e5e29afc941e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:20.445292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73fe9982-942e-4878-bd31-e5e29afc941e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.445753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73fe9982-942e-4878-bd31-e5e29afc941e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.446238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-73fe9982-942e-4878-bd31-e5e29afc941e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:20.579315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-73fe9982-942e-4878-bd31-e5e29afc941e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:20.587798 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-73fe9982-942e-4878-bd31-e5e29afc941e tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1506 microversion: 2.1 time: 0.155760 Sep 06 11:58:20.588370 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3547/7134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:20 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:20.611317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-748a20cf-91e0-41bd-9f91-543f18e41853 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "f1cde136-9bc5-4e35-8445-d285a4c0a08e"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:58:20.613781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-748a20cf-91e0-41bd-9f91-543f18e41853 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:20.620225 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-748a20cf-91e0-41bd-9f91-543f18e41853 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.620730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-748a20cf-91e0-41bd-9f91-543f18e41853 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.621190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-748a20cf-91e0-41bd-9f91-543f18e41853 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:20.621958 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-748a20cf-91e0-41bd-9f91-543f18e41853 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.622434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-748a20cf-91e0-41bd-9f91-543f18e41853 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.622883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-748a20cf-91e0-41bd-9f91-543f18e41853 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:20.652908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-748a20cf-91e0-41bd-9f91-543f18e41853 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:20.658201 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-748a20cf-91e0-41bd-9f91-543f18e41853 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] HTTP exception thrown: Flavor f1cde136-9bc5-4e35-8445-d285a4c0a08e could not be found. Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-748a20cf-91e0-41bd-9f91-543f18e41853 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Request method failure captured: Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: request: POST /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469/action HTTP/1.1 Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 65 Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzW5NxscITDKGy1P5g02Gp_W7tSyAKzaoyijiGESA1HFcvAEEwMa9sl7Fi0oC7sDvnK0Axl6QTDhzOoNjreq9DjC3ab0Jk4gRYVATowSrERIdvT2zVdEVqCQ9TVuM3gHAViwH-oNGDRV7Wg4cF19CWX-_zXe4pc4wnlJb6A202CTq6s Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27b27569b95443409ce3122494d2fa2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}] Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 28c8864e0ffd4c00808bd9649b4981c4 Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: {"resize": {"flavorRef": "f1cde136-9bc5-4e35-8445-d285a4c0a08e"}} Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: exception: Flavor f1cde136-9bc5-4e35-8445-d285a4c0a08e could not be found. Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'c0157af0-66f5-49d0-a123-916b1f5d0469', 'body': {'resize': {'flavorRef': 'f1cde136-9bc5-4e35-8445-d285a4c0a08e'}}} Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:58:20.674905 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f1cde136-9bc5-4e35-8445-d285a4c0a08e could not be found. Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor f1cde136-9bc5-4e35-8445-d285a4c0a08e could not be found. Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f1cde136-9bc5-4e35-8445-d285a4c0a08e could not be found. Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-748a20cf-91e0-41bd-9f91-543f18e41853 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Returning 400 to user: Flavor f1cde136-9bc5-4e35-8445-d285a4c0a08e could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-748a20cf-91e0-41bd-9f91-543f18e41853 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "POST /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469/action" status: 400 len: 107 microversion: 2.1 time: 0.069380 Sep 06 11:58:20.680574 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3588/7135] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:58:20 2022] POST /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469/action => generated 107 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:58:20.685411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d23fc1af-8c80-4b53-9523-f056b1d67758 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:20.686065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d23fc1af-8c80-4b53-9523-f056b1d67758 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:20.692181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d23fc1af-8c80-4b53-9523-f056b1d67758 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.692672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d23fc1af-8c80-4b53-9523-f056b1d67758 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.693121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d23fc1af-8c80-4b53-9523-f056b1d67758 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:20.693858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d23fc1af-8c80-4b53-9523-f056b1d67758 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.694357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d23fc1af-8c80-4b53-9523-f056b1d67758 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.694772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d23fc1af-8c80-4b53-9523-f056b1d67758 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:20.832456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d23fc1af-8c80-4b53-9523-f056b1d67758 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:20.841213 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d23fc1af-8c80-4b53-9523-f056b1d67758 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1506 microversion: 2.1 time: 0.159729 Sep 06 11:58:20.841899 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3548/7136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:20 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:20.864993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-20da2f9b-adc0-4089-8d2e-013cfa93c9b6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:20.865625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-20da2f9b-adc0-4089-8d2e-013cfa93c9b6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:20.871863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20da2f9b-adc0-4089-8d2e-013cfa93c9b6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.872304 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20da2f9b-adc0-4089-8d2e-013cfa93c9b6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.872779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20da2f9b-adc0-4089-8d2e-013cfa93c9b6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:20.873490 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20da2f9b-adc0-4089-8d2e-013cfa93c9b6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:20.873974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20da2f9b-adc0-4089-8d2e-013cfa93c9b6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:20.874418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20da2f9b-adc0-4089-8d2e-013cfa93c9b6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:21.010169 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-20da2f9b-adc0-4089-8d2e-013cfa93c9b6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:21.020890 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-20da2f9b-adc0-4089-8d2e-013cfa93c9b6 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1506 microversion: 2.1 time: 0.159764 Sep 06 11:58:21.021516 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3589/7137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:20 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:21.049989 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9a86bd82-b045-4093-8cf4-854f306d0cb5 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9a86bd82-b045-4093-8cf4-854f306d0cb5 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Request method failure captured: Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: request: POST /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469/action HTTP/1.1 Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 29 Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzW5NxscITDKGy1P5g02Gp_W7tSyAKzaoyijiGESA1HFcvAEEwMa9sl7Fi0oC7sDvnK0Axl6QTDhzOoNjreq9DjC3ab0Jk4gRYVATowSrERIdvT2zVdEVqCQ9TVuM3gHAViwH-oNGDRV7Wg4cF19CWX-_zXe4pc4wnlJb6A202CTq6s Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27b27569b95443409ce3122494d2fa2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}] Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 28c8864e0ffd4c00808bd9649b4981c4 Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: {"resize": {"flavorRef": ""}} Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'c0157af0-66f5-49d0-a123-916b1f5d0469', 'body': {'resize': {'flavorRef': ''}}} Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise error Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi '' Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.053588 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:21.059788 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.059788 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:21.059788 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:21.059788 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:21.059788 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 11:58:21.059788 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 11:58:21.059788 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 06 11:58:21.059788 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.059788 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9a86bd82-b045-4093-8cf4-854f306d0cb5 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:58:21.059788 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9a86bd82-b045-4093-8cf4-854f306d0cb5 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "POST /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469/action" status: 400 len: 113 microversion: 2.1 time: 0.009330 Sep 06 11:58:21.059788 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3549/7138] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 11:58:21 2022] POST /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:58:21.064570 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2e77e39a-1764-438f-9c00-170f6df651f9 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:21.069477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2e77e39a-1764-438f-9c00-170f6df651f9 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:21.072970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e77e39a-1764-438f-9c00-170f6df651f9 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:21.073482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e77e39a-1764-438f-9c00-170f6df651f9 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:21.073965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e77e39a-1764-438f-9c00-170f6df651f9 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:21.074681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e77e39a-1764-438f-9c00-170f6df651f9 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:21.075191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e77e39a-1764-438f-9c00-170f6df651f9 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:21.075641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2e77e39a-1764-438f-9c00-170f6df651f9 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:21.211603 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2e77e39a-1764-438f-9c00-170f6df651f9 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:21.219698 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2e77e39a-1764-438f-9c00-170f6df651f9 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1506 microversion: 2.1 time: 0.159318 Sep 06 11:58:21.235376 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3590/7139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:21 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:21.246829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7ca2d96c-6a4e-4601-90a7-43fcc1754aa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:21.247366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7ca2d96c-6a4e-4601-90a7-43fcc1754aa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:21.254730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ca2d96c-6a4e-4601-90a7-43fcc1754aa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:21.255265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ca2d96c-6a4e-4601-90a7-43fcc1754aa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:21.255713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ca2d96c-6a4e-4601-90a7-43fcc1754aa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:21.256431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ca2d96c-6a4e-4601-90a7-43fcc1754aa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:21.256894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ca2d96c-6a4e-4601-90a7-43fcc1754aa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:21.257329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7ca2d96c-6a4e-4601-90a7-43fcc1754aa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:21.271777 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-7ca2d96c-6a4e-4601-90a7-43fcc1754aa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] HTTP exception thrown: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7ca2d96c-6a4e-4601-90a7-43fcc1754aa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Request method failure captured: Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: request: DELETE /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 HTTP/1.1 Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzW5NxscITDKGy1P5g02Gp_W7tSyAKzaoyijiGESA1HFcvAEEwMa9sl7Fi0oC7sDvnK0Axl6QTDhzOoNjreq9DjC3ab0Jk4gRYVATowSrERIdvT2zVdEVqCQ9TVuM3gHAViwH-oNGDRV7Wg4cF19CWX-_zXe4pc4wnlJb6A202CTq6s Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27b27569b95443409ce3122494d2fa2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}] Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 28c8864e0ffd4c00808bd9649b4981c4 Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'f037e4b0-3091-4649-8f82-7cb3d6a49d34'} Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:58:21.273364 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7ca2d96c-6a4e-4601-90a7-43fcc1754aa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Returning 404 to user: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7ca2d96c-6a4e-4601-90a7-43fcc1754aa0 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 404 len: 111 microversion: 2.1 time: 0.033272 Sep 06 11:58:21.278653 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3550/7140] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:58:21 2022] DELETE /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:58:21.283604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bd394a6c-ec9c-4b63-b73d-691013d2e69b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:21.289155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bd394a6c-ec9c-4b63-b73d-691013d2e69b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: f037e4b0-3091-4649-8f82-7cb3d6a49d34] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:21.290581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd394a6c-ec9c-4b63-b73d-691013d2e69b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:21.291124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd394a6c-ec9c-4b63-b73d-691013d2e69b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:21.291587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd394a6c-ec9c-4b63-b73d-691013d2e69b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:21.292307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd394a6c-ec9c-4b63-b73d-691013d2e69b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:21.292786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd394a6c-ec9c-4b63-b73d-691013d2e69b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:21.293236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bd394a6c-ec9c-4b63-b73d-691013d2e69b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-bd394a6c-ec9c-4b63-b73d-691013d2e69b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] HTTP exception thrown: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bd394a6c-ec9c-4b63-b73d-691013d2e69b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Request method failure captured: Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 HTTP/1.1 Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzW5NxscITDKGy1P5g02Gp_W7tSyAKzaoyijiGESA1HFcvAEEwMa9sl7Fi0oC7sDvnK0Axl6QTDhzOoNjreq9DjC3ab0Jk4gRYVATowSrERIdvT2zVdEVqCQ9TVuM3gHAViwH-oNGDRV7Wg4cF19CWX-_zXe4pc4wnlJb6A202CTq6s Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27b27569b95443409ce3122494d2fa2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}] Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 28c8864e0ffd4c00808bd9649b4981c4 Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'f037e4b0-3091-4649-8f82-7cb3d6a49d34'} Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:58:21.316316 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bd394a6c-ec9c-4b63-b73d-691013d2e69b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Returning 404 to user: Instance f037e4b0-3091-4649-8f82-7cb3d6a49d34 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bd394a6c-ec9c-4b63-b73d-691013d2e69b tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34" status: 404 len: 111 microversion: 2.1 time: 0.031256 Sep 06 11:58:21.322239 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3591/7141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:21 2022] GET /compute/v2.1/servers/f037e4b0-3091-4649-8f82-7cb3d6a49d34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:58:21.323444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-93178786-1764-41e4-83ac-10e8236a467d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:21.323444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-93178786-1764-41e4-83ac-10e8236a467d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:21.327337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93178786-1764-41e4-83ac-10e8236a467d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:21.327837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93178786-1764-41e4-83ac-10e8236a467d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:21.328284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93178786-1764-41e4-83ac-10e8236a467d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:21.328999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93178786-1764-41e4-83ac-10e8236a467d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:21.329468 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93178786-1764-41e4-83ac-10e8236a467d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:21.329907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-93178786-1764-41e4-83ac-10e8236a467d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:21.355704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-93178786-1764-41e4-83ac-10e8236a467d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:58:21.778562 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-93178786-1764-41e4-83ac-10e8236a467d tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 204 len: 0 microversion: 2.1 time: 0.462317 Sep 06 11:58:21.779204 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3551/7142] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:58:21 2022] DELETE /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:58:21.787589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3df6620e-3938-419d-b517-95d99690aa29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:21.793768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3df6620e-3938-419d-b517-95d99690aa29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:21.794913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3df6620e-3938-419d-b517-95d99690aa29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:21.795471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3df6620e-3938-419d-b517-95d99690aa29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:21.795932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3df6620e-3938-419d-b517-95d99690aa29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:21.796737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3df6620e-3938-419d-b517-95d99690aa29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:21.797212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3df6620e-3938-419d-b517-95d99690aa29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:21.797659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3df6620e-3938-419d-b517-95d99690aa29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:21.944951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3df6620e-3938-419d-b517-95d99690aa29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:21.954203 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3df6620e-3938-419d-b517-95d99690aa29 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1512 microversion: 2.1 time: 0.170434 Sep 06 11:58:21.954803 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3592/7143] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:21 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:22.982584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-efdf01d5-4c26-4b86-a727-67c2ad6c8450 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:22.983313 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-efdf01d5-4c26-4b86-a727-67c2ad6c8450 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:22.990906 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efdf01d5-4c26-4b86-a727-67c2ad6c8450 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:22.991429 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efdf01d5-4c26-4b86-a727-67c2ad6c8450 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:22.991873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efdf01d5-4c26-4b86-a727-67c2ad6c8450 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:22.992593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efdf01d5-4c26-4b86-a727-67c2ad6c8450 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:22.993073 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efdf01d5-4c26-4b86-a727-67c2ad6c8450 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:22.993718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-efdf01d5-4c26-4b86-a727-67c2ad6c8450 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:23.149299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-efdf01d5-4c26-4b86-a727-67c2ad6c8450 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:23.151479 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-efdf01d5-4c26-4b86-a727-67c2ad6c8450 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1512 microversion: 2.1 time: 0.173204 Sep 06 11:58:23.152061 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3552/7144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:22 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:23.831518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-f6adc3a3-98a6-47ca-be4d-618812f4c1f0 req-1ee2cfb1-764e-4d57-b890-1545a39699da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0157af0-66f5-49d0-a123-916b1f5d0469", "name": "network-vif-deleted", "tag": "966195ab-572c-4172-a849-e40f1d187dc0"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:58:23.842994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f6adc3a3-98a6-47ca-be4d-618812f4c1f0 req-1ee2cfb1-764e-4d57-b890-1545a39699da service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:23.843515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f6adc3a3-98a6-47ca-be4d-618812f4c1f0 req-1ee2cfb1-764e-4d57-b890-1545a39699da service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:23.843975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f6adc3a3-98a6-47ca-be4d-618812f4c1f0 req-1ee2cfb1-764e-4d57-b890-1545a39699da service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:23.863637 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f6adc3a3-98a6-47ca-be4d-618812f4c1f0 req-1ee2cfb1-764e-4d57-b890-1545a39699da service nova] Creating event network-vif-deleted:966195ab-572c-4172-a849-e40f1d187dc0 for instance c0157af0-66f5-49d0-a123-916b1f5d0469 on nch2-master-1 Sep 06 11:58:23.868721 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-f6adc3a3-98a6-47ca-be4d-618812f4c1f0 req-1ee2cfb1-764e-4d57-b890-1545a39699da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041051 Sep 06 11:58:23.870157 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3593/7145] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:58:24.175441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3cca5c66-7594-4ada-a49c-9dc6e347a045 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:24.176011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3cca5c66-7594-4ada-a49c-9dc6e347a045 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:24.183769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cca5c66-7594-4ada-a49c-9dc6e347a045 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:24.184323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cca5c66-7594-4ada-a49c-9dc6e347a045 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:24.184830 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cca5c66-7594-4ada-a49c-9dc6e347a045 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:24.185580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cca5c66-7594-4ada-a49c-9dc6e347a045 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:24.186054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cca5c66-7594-4ada-a49c-9dc6e347a045 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:24.186495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3cca5c66-7594-4ada-a49c-9dc6e347a045 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:24.253578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3cca5c66-7594-4ada-a49c-9dc6e347a045 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c8864e0ffd4c00808bd9649b4981c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b27569b95443409ce3122494d2fa2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:24.262501 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3cca5c66-7594-4ada-a49c-9dc6e347a045 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 200 len: 1302 microversion: 2.1 time: 0.091617 Sep 06 11:58:24.263109 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3553/7146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:24 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 1302 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:25.289313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c190bc85-f214-45b0-a234-279f6c840368 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:25.290136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c190bc85-f214-45b0-a234-279f6c840368 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] [instance: c0157af0-66f5-49d0-a123-916b1f5d0469] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:25.296676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c190bc85-f214-45b0-a234-279f6c840368 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:25.302544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c190bc85-f214-45b0-a234-279f6c840368 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:25.302544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c190bc85-f214-45b0-a234-279f6c840368 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:25.302544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c190bc85-f214-45b0-a234-279f6c840368 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:25.302544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c190bc85-f214-45b0-a234-279f6c840368 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:25.302544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c190bc85-f214-45b0-a234-279f6c840368 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:25.316228 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-c190bc85-f214-45b0-a234-279f6c840368 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] HTTP exception thrown: Instance c0157af0-66f5-49d0-a123-916b1f5d0469 could not be found. Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c190bc85-f214-45b0-a234-279f6c840368 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Request method failure captured: Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 HTTP/1.1 Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzW5NxscITDKGy1P5g02Gp_W7tSyAKzaoyijiGESA1HFcvAEEwMa9sl7Fi0oC7sDvnK0Axl6QTDhzOoNjreq9DjC3ab0Jk4gRYVATowSrERIdvT2zVdEVqCQ9TVuM3gHAViwH-oNGDRV7Wg4cF19CWX-_zXe4pc4wnlJb6A202CTq6s Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27b27569b95443409ce3122494d2fa2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27b27569b95443409ce3122494d2fa2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27b27569b95443409ce3122494d2fa2f"}]}] Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 27b27569b95443409ce3122494d2fa2f Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-ServersNegativeTestJSON-210871505 Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 28c8864e0ffd4c00808bd9649b4981c4 Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-ServersNegativeTestJSON-210871505-project Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance c0157af0-66f5-49d0-a123-916b1f5d0469 could not be found. Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'c0157af0-66f5-49d0-a123-916b1f5d0469'} Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0157af0-66f5-49d0-a123-916b1f5d0469 could not be found. Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0157af0-66f5-49d0-a123-916b1f5d0469 could not be found. Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:25.317916 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:25.324610 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:25.324610 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:25.324610 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:25.324610 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:58:25.324610 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:58:25.324610 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0157af0-66f5-49d0-a123-916b1f5d0469 could not be found. Sep 06 11:58:25.324610 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 11:58:25.324610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c190bc85-f214-45b0-a234-279f6c840368 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] Returning 404 to user: Instance c0157af0-66f5-49d0-a123-916b1f5d0469 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:58:25.324610 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c190bc85-f214-45b0-a234-279f6c840368 tempest-ServersNegativeTestJSON-210871505 tempest-ServersNegativeTestJSON-210871505-project] 10.222.0.20 "GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469" status: 404 len: 111 microversion: 2.1 time: 0.035599 Sep 06 11:58:25.324610 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3594/7147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:25 2022] GET /compute/v2.1/servers/c0157af0-66f5-49d0-a123-916b1f5d0469 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:59:27.334550 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:27.338957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:27.339569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6811e797-21a1-4a37-a59f-d15a289c556d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Action: 'create', calling method: .version_select at 0x7f90f35b8ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-798353267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIM0i5fS0eqzRJE1QDYAb4MPJD5Vq3kdgDSdRnRXM7ACxS7nAlNqbOei7QrGtsxWiSPR7JrbfVl+vHziNawle1hInVBImp0N4DeChRh2b/LD1WkfjcY+g9lqPz/1YI4CQ=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:59:27.354532 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6811e797-21a1-4a37-a59f-d15a289c556d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Getting quotas for project bd1282dd54c14401bf4e63d865a67dee. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:59:27.360834 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6811e797-21a1-4a37-a59f-d15a289c556d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Getting quotas for user a4cff140fd1740ff80c13526874a7113 and project bd1282dd54c14401bf4e63d865a67dee. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:59:27.463859 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6811e797-21a1-4a37-a59f-d15a289c556d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.131302 Sep 06 11:59:27.464402 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3554/7148] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 11:59:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:27.516326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:27.517074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:27.521340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-215548770", "imageRef": "dc3413f9-85d4-4ce0-a6f3-54b91609ab53", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-798353267", "networks": [{"uuid": "d97b72be-d691-4ac4-944e-6c2e5cd60ec0"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:59:27.694405 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] validate_networks() for [('d97b72be-d691-4ac4-944e-6c2e5cd60ec0', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:59:28.092418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:59:28.092945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:59:28.093498 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:59:28.093944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:59:28.094381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:59:28.103483 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:28.103987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:28.104444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:28.105193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:28.105671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:28.106118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:28.125792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Getting quotas for project bd1282dd54c14401bf4e63d865a67dee. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:59:28.131423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Getting quotas for user a4cff140fd1740ff80c13526874a7113 and project bd1282dd54c14401bf4e63d865a67dee. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:59:28.144143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:59:28.146428 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dc3413f9-85d4-4ce0-a6f3-54b91609ab53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:59:28.272585 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-12236155-3112-42a0-a00d-08bf9ec8c493 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758444 Sep 06 11:59:28.273282 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3595/7149] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:59:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:59:28.285386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6ce97afd-7e97-4eca-b979-3e2d324a0a39 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:28.286017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6ce97afd-7e97-4eca-b979-3e2d324a0a39 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:28.450945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6ce97afd-7e97-4eca-b979-3e2d324a0a39 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:28.458256 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6ce97afd-7e97-4eca-b979-3e2d324a0a39 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1257 microversion: 2.1 time: 0.177516 Sep 06 11:59:28.458835 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3555/7150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:28 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1257 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:29.483620 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8f190647-11e5-453d-a235-ec54ca931869 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:29.484260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8f190647-11e5-453d-a235-ec54ca931869 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:29.540730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8f190647-11e5-453d-a235-ec54ca931869 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:29.553017 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8f190647-11e5-453d-a235-ec54ca931869 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1257 microversion: 2.1 time: 0.074795 Sep 06 11:59:29.553655 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3596/7151] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:29 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:30.577304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2564f0e6-e921-41ef-aca3-a7da7a18e317 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:30.577962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2564f0e6-e921-41ef-aca3-a7da7a18e317 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:30.586890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2564f0e6-e921-41ef-aca3-a7da7a18e317 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:30.587498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2564f0e6-e921-41ef-aca3-a7da7a18e317 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:30.587949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2564f0e6-e921-41ef-aca3-a7da7a18e317 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:30.588668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2564f0e6-e921-41ef-aca3-a7da7a18e317 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:30.589142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2564f0e6-e921-41ef-aca3-a7da7a18e317 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:30.589582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2564f0e6-e921-41ef-aca3-a7da7a18e317 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:30.654719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2564f0e6-e921-41ef-aca3-a7da7a18e317 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:30.662792 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2564f0e6-e921-41ef-aca3-a7da7a18e317 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1309 microversion: 2.1 time: 0.090421 Sep 06 11:59:30.666668 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3556/7152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:30 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:31.687229 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cbccaa51-fc59-44d6-8883-60b7dcda5034 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:31.687929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cbccaa51-fc59-44d6-8883-60b7dcda5034 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:31.703800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbccaa51-fc59-44d6-8883-60b7dcda5034 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:31.704323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbccaa51-fc59-44d6-8883-60b7dcda5034 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:31.704792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbccaa51-fc59-44d6-8883-60b7dcda5034 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:31.705609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbccaa51-fc59-44d6-8883-60b7dcda5034 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:31.706010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbccaa51-fc59-44d6-8883-60b7dcda5034 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:31.706461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cbccaa51-fc59-44d6-8883-60b7dcda5034 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:31.779389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cbccaa51-fc59-44d6-8883-60b7dcda5034 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:31.788238 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cbccaa51-fc59-44d6-8883-60b7dcda5034 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1315 microversion: 2.1 time: 0.105914 Sep 06 11:59:31.789100 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3597/7153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:31 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1315 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:32.813417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7630e87d-07bc-4adb-a3f3-51b2befbb28c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:32.814280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7630e87d-07bc-4adb-a3f3-51b2befbb28c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:32.822585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7630e87d-07bc-4adb-a3f3-51b2befbb28c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:32.824366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7630e87d-07bc-4adb-a3f3-51b2befbb28c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:32.825354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7630e87d-07bc-4adb-a3f3-51b2befbb28c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:32.827221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7630e87d-07bc-4adb-a3f3-51b2befbb28c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:32.828322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7630e87d-07bc-4adb-a3f3-51b2befbb28c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:32.829039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7630e87d-07bc-4adb-a3f3-51b2befbb28c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:33.057845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7630e87d-07bc-4adb-a3f3-51b2befbb28c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:33.068749 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7630e87d-07bc-4adb-a3f3-51b2befbb28c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1357 microversion: 2.1 time: 0.259570 Sep 06 11:59:33.087253 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3557/7154] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:32 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1357 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:33.980525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-d1e549eb-8076-43c5-be6d-a3984a4a0140 req-125218d6-c282-4e56-8778-5dbcc4608b11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e4f587b-03b2-40ff-b58f-c24327dd3462", "tag": "9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:59:33.992922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d1e549eb-8076-43c5-be6d-a3984a4a0140 req-125218d6-c282-4e56-8778-5dbcc4608b11 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:33.993545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d1e549eb-8076-43c5-be6d-a3984a4a0140 req-125218d6-c282-4e56-8778-5dbcc4608b11 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:33.994104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-d1e549eb-8076-43c5-be6d-a3984a4a0140 req-125218d6-c282-4e56-8778-5dbcc4608b11 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.006658 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-d1e549eb-8076-43c5-be6d-a3984a4a0140 req-125218d6-c282-4e56-8778-5dbcc4608b11 service nova] Creating event network-changed:9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd for instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 on nch1-master-1 Sep 06 11:59:34.012345 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-d1e549eb-8076-43c5-be6d-a3984a4a0140 req-125218d6-c282-4e56-8778-5dbcc4608b11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137322 Sep 06 11:59:34.013148 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3598/7155] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:34.094480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c14162c4-f712-48b2-9203-ef0f60f0b55f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:34.095257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c14162c4-f712-48b2-9203-ef0f60f0b55f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:34.102726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c14162c4-f712-48b2-9203-ef0f60f0b55f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.102957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c14162c4-f712-48b2-9203-ef0f60f0b55f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.103409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c14162c4-f712-48b2-9203-ef0f60f0b55f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.104133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c14162c4-f712-48b2-9203-ef0f60f0b55f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.104598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c14162c4-f712-48b2-9203-ef0f60f0b55f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.105035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c14162c4-f712-48b2-9203-ef0f60f0b55f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.266911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c14162c4-f712-48b2-9203-ef0f60f0b55f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:34.275441 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c14162c4-f712-48b2-9203-ef0f60f0b55f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1357 microversion: 2.1 time: 0.185489 Sep 06 11:59:34.276022 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3558/7156] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:34 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:35.300900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-09d9a13b-a079-400f-a9ea-f8b52c69054d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:35.302706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-09d9a13b-a079-400f-a9ea-f8b52c69054d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:35.311440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09d9a13b-a079-400f-a9ea-f8b52c69054d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:35.312446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09d9a13b-a079-400f-a9ea-f8b52c69054d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:35.313132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09d9a13b-a079-400f-a9ea-f8b52c69054d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:35.314073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09d9a13b-a079-400f-a9ea-f8b52c69054d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:35.317639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09d9a13b-a079-400f-a9ea-f8b52c69054d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:35.317639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09d9a13b-a079-400f-a9ea-f8b52c69054d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:35.499753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-09d9a13b-a079-400f-a9ea-f8b52c69054d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:35.510835 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-09d9a13b-a079-400f-a9ea-f8b52c69054d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1357 microversion: 2.1 time: 0.214657 Sep 06 11:59:35.511882 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3599/7157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:35 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:59:36.547854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f4b80200-9fc6-49c3-81c2-041f622dc05b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:36.548768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f4b80200-9fc6-49c3-81c2-041f622dc05b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:36.557002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4b80200-9fc6-49c3-81c2-041f622dc05b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:36.558184 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4b80200-9fc6-49c3-81c2-041f622dc05b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:36.558381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4b80200-9fc6-49c3-81c2-041f622dc05b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:36.560946 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4b80200-9fc6-49c3-81c2-041f622dc05b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:36.561801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4b80200-9fc6-49c3-81c2-041f622dc05b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:36.562257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f4b80200-9fc6-49c3-81c2-041f622dc05b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:36.712629 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f4b80200-9fc6-49c3-81c2-041f622dc05b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:36.722570 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f4b80200-9fc6-49c3-81c2-041f622dc05b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1357 microversion: 2.1 time: 0.181351 Sep 06 11:59:36.723272 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3559/7158] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:36 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:37.746723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-414d1f58-373b-4515-9ebe-78f423baadd8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:37.748926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-414d1f58-373b-4515-9ebe-78f423baadd8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:37.757488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-414d1f58-373b-4515-9ebe-78f423baadd8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:37.758001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-414d1f58-373b-4515-9ebe-78f423baadd8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:37.758860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-414d1f58-373b-4515-9ebe-78f423baadd8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:37.759778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-414d1f58-373b-4515-9ebe-78f423baadd8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:37.760404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-414d1f58-373b-4515-9ebe-78f423baadd8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:37.760857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-414d1f58-373b-4515-9ebe-78f423baadd8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:37.926159 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-414d1f58-373b-4515-9ebe-78f423baadd8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:37.937344 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-414d1f58-373b-4515-9ebe-78f423baadd8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1357 microversion: 2.1 time: 0.194791 Sep 06 11:59:37.947768 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3600/7159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:37 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:38.972491 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b842d3ac-2c0c-482a-89dd-f139bbe71764 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:38.973128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b842d3ac-2c0c-482a-89dd-f139bbe71764 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:38.977761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:38.982261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b842d3ac-2c0c-482a-89dd-f139bbe71764 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:38.983529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b842d3ac-2c0c-482a-89dd-f139bbe71764 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:38.983923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b842d3ac-2c0c-482a-89dd-f139bbe71764 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:38.984654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b842d3ac-2c0c-482a-89dd-f139bbe71764 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:38.985116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b842d3ac-2c0c-482a-89dd-f139bbe71764 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:38.985922 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b842d3ac-2c0c-482a-89dd-f139bbe71764 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:39.159773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b842d3ac-2c0c-482a-89dd-f139bbe71764 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:39.168083 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b842d3ac-2c0c-482a-89dd-f139bbe71764 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1357 microversion: 2.1 time: 0.199787 Sep 06 11:59:39.168598 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3560/7160] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:38 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:40.198097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-09678b5b-ab0f-4598-81bb-6b9b55aac041 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:40.198749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-09678b5b-ab0f-4598-81bb-6b9b55aac041 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:40.201390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:40.202987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:40.209580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09678b5b-ab0f-4598-81bb-6b9b55aac041 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:40.210107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09678b5b-ab0f-4598-81bb-6b9b55aac041 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:40.211178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09678b5b-ab0f-4598-81bb-6b9b55aac041 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:40.212072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09678b5b-ab0f-4598-81bb-6b9b55aac041 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:40.212563 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09678b5b-ab0f-4598-81bb-6b9b55aac041 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:40.213021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-09678b5b-ab0f-4598-81bb-6b9b55aac041 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:40.356485 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-09678b5b-ab0f-4598-81bb-6b9b55aac041 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:40.364557 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-09678b5b-ab0f-4598-81bb-6b9b55aac041 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1357 microversion: 2.1 time: 0.170365 Sep 06 11:59:40.365156 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3601/7161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:40 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:41.388822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9ac42d18-6a36-4235-8ee0-44b346980828 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:41.389514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9ac42d18-6a36-4235-8ee0-44b346980828 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:41.396689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ac42d18-6a36-4235-8ee0-44b346980828 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:41.397199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ac42d18-6a36-4235-8ee0-44b346980828 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:41.397654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ac42d18-6a36-4235-8ee0-44b346980828 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:41.398385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ac42d18-6a36-4235-8ee0-44b346980828 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:41.398855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ac42d18-6a36-4235-8ee0-44b346980828 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:41.399461 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9ac42d18-6a36-4235-8ee0-44b346980828 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:41.534979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9ac42d18-6a36-4235-8ee0-44b346980828 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:41.542967 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9ac42d18-6a36-4235-8ee0-44b346980828 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1357 microversion: 2.1 time: 0.158711 Sep 06 11:59:41.543576 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3561/7162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:41 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:59:42.567748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e70fa6c1-cbe8-4f77-a285-b0004532d030 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:42.568363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e70fa6c1-cbe8-4f77-a285-b0004532d030 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:42.575456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e70fa6c1-cbe8-4f77-a285-b0004532d030 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:42.575953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e70fa6c1-cbe8-4f77-a285-b0004532d030 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:42.576410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e70fa6c1-cbe8-4f77-a285-b0004532d030 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:42.577126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e70fa6c1-cbe8-4f77-a285-b0004532d030 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:42.577599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e70fa6c1-cbe8-4f77-a285-b0004532d030 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:42.578044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e70fa6c1-cbe8-4f77-a285-b0004532d030 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:42.715784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e70fa6c1-cbe8-4f77-a285-b0004532d030 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:42.724449 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e70fa6c1-cbe8-4f77-a285-b0004532d030 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1357 microversion: 2.1 time: 0.161052 Sep 06 11:59:42.725034 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3602/7163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:42 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:43.748049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fafaa667-f3c8-43aa-995c-4fda698cb580 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:43.748739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fafaa667-f3c8-43aa-995c-4fda698cb580 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:43.755636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fafaa667-f3c8-43aa-995c-4fda698cb580 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:43.756133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fafaa667-f3c8-43aa-995c-4fda698cb580 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:43.756579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fafaa667-f3c8-43aa-995c-4fda698cb580 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:43.757296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fafaa667-f3c8-43aa-995c-4fda698cb580 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:43.757761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fafaa667-f3c8-43aa-995c-4fda698cb580 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:43.758199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fafaa667-f3c8-43aa-995c-4fda698cb580 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:43.911736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fafaa667-f3c8-43aa-995c-4fda698cb580 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:43.921695 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fafaa667-f3c8-43aa-995c-4fda698cb580 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1357 microversion: 2.1 time: 0.178041 Sep 06 11:59:43.922302 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3562/7164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:43 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:44.946220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6cd42324-4a42-4f7b-b850-0da74c39b8f8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:44.946827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6cd42324-4a42-4f7b-b850-0da74c39b8f8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:44.953976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cd42324-4a42-4f7b-b850-0da74c39b8f8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:44.954484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cd42324-4a42-4f7b-b850-0da74c39b8f8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:44.954943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cd42324-4a42-4f7b-b850-0da74c39b8f8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:44.955695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cd42324-4a42-4f7b-b850-0da74c39b8f8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:44.956172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cd42324-4a42-4f7b-b850-0da74c39b8f8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:44.956619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cd42324-4a42-4f7b-b850-0da74c39b8f8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:45.090682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6cd42324-4a42-4f7b-b850-0da74c39b8f8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:45.098793 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6cd42324-4a42-4f7b-b850-0da74c39b8f8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1357 microversion: 2.1 time: 0.156857 Sep 06 11:59:45.102959 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3603/7165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:44 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:46.121797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e53c3f16-c654-4ee3-bb6c-b8d7dff90d75 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:46.122421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e53c3f16-c654-4ee3-bb6c-b8d7dff90d75 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:46.129520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e53c3f16-c654-4ee3-bb6c-b8d7dff90d75 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:46.130005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e53c3f16-c654-4ee3-bb6c-b8d7dff90d75 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:46.130452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e53c3f16-c654-4ee3-bb6c-b8d7dff90d75 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:46.131190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e53c3f16-c654-4ee3-bb6c-b8d7dff90d75 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:46.131718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e53c3f16-c654-4ee3-bb6c-b8d7dff90d75 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:46.132091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e53c3f16-c654-4ee3-bb6c-b8d7dff90d75 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:46.267341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e53c3f16-c654-4ee3-bb6c-b8d7dff90d75 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:46.275287 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e53c3f16-c654-4ee3-bb6c-b8d7dff90d75 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1357 microversion: 2.1 time: 0.157365 Sep 06 11:59:46.275870 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3563/7166] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:46 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:46.451114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a9b1dc45-95b0-4884-943b-d58eb3c70689 req-e67bf11a-ce4b-40e7-9031-9280066d2827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e4f587b-03b2-40ff-b58f-c24327dd3462", "name": "network-vif-plugged", "status": "completed", "tag": "9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:59:46.461009 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a9b1dc45-95b0-4884-943b-d58eb3c70689 req-e67bf11a-ce4b-40e7-9031-9280066d2827 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:46.461511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a9b1dc45-95b0-4884-943b-d58eb3c70689 req-e67bf11a-ce4b-40e7-9031-9280066d2827 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:46.461961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a9b1dc45-95b0-4884-943b-d58eb3c70689 req-e67bf11a-ce4b-40e7-9031-9280066d2827 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:46.473853 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a9b1dc45-95b0-4884-943b-d58eb3c70689 req-e67bf11a-ce4b-40e7-9031-9280066d2827 service nova] Creating event network-vif-plugged:9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd for instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 on nch1-master-1 Sep 06 11:59:46.486403 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a9b1dc45-95b0-4884-943b-d58eb3c70689 req-e67bf11a-ce4b-40e7-9031-9280066d2827 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091598 Sep 06 11:59:46.486403 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3604/7167] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 11:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:47.299813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a90e6cab-10e0-4fe5-adb9-91b76224533e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:47.300443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a90e6cab-10e0-4fe5-adb9-91b76224533e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:47.308106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a90e6cab-10e0-4fe5-adb9-91b76224533e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:47.308593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a90e6cab-10e0-4fe5-adb9-91b76224533e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:47.309038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a90e6cab-10e0-4fe5-adb9-91b76224533e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:47.309744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a90e6cab-10e0-4fe5-adb9-91b76224533e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:47.310215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a90e6cab-10e0-4fe5-adb9-91b76224533e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:47.310642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a90e6cab-10e0-4fe5-adb9-91b76224533e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:47.441270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a90e6cab-10e0-4fe5-adb9-91b76224533e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:47.449225 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a90e6cab-10e0-4fe5-adb9-91b76224533e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1357 microversion: 2.1 time: 0.153353 Sep 06 11:59:47.449798 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3564/7168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:47 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:48.475130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-55bfba80-6a33-478a-b162-96e903ac51bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:48.475853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-55bfba80-6a33-478a-b162-96e903ac51bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:48.482536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55bfba80-6a33-478a-b162-96e903ac51bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.483048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55bfba80-6a33-478a-b162-96e903ac51bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.483508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55bfba80-6a33-478a-b162-96e903ac51bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:48.484218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55bfba80-6a33-478a-b162-96e903ac51bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.484690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55bfba80-6a33-478a-b162-96e903ac51bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.485132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-55bfba80-6a33-478a-b162-96e903ac51bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:48.616443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-55bfba80-6a33-478a-b162-96e903ac51bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:48.624424 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-55bfba80-6a33-478a-b162-96e903ac51bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1548 microversion: 2.1 time: 0.155195 Sep 06 11:59:48.624996 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3605/7169] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:48 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:59:48.647498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-672ca8c7-c976-4a45-98cb-c6fd3717db9d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:48.651981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-672ca8c7-c976-4a45-98cb-c6fd3717db9d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:48.654793 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-672ca8c7-c976-4a45-98cb-c6fd3717db9d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.655318 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-672ca8c7-c976-4a45-98cb-c6fd3717db9d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.655759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-672ca8c7-c976-4a45-98cb-c6fd3717db9d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:48.656451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-672ca8c7-c976-4a45-98cb-c6fd3717db9d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.656910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-672ca8c7-c976-4a45-98cb-c6fd3717db9d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.657343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-672ca8c7-c976-4a45-98cb-c6fd3717db9d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:48.798099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-672ca8c7-c976-4a45-98cb-c6fd3717db9d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:48.806022 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-672ca8c7-c976-4a45-98cb-c6fd3717db9d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1548 microversion: 2.1 time: 0.162670 Sep 06 11:59:48.806638 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3565/7170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:48 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:59:48.829941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-07fdf859-5bb5-423a-b6c8-5162cb0e7508 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:48.834770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-07fdf859-5bb5-423a-b6c8-5162cb0e7508 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:48.835592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-07fdf859-5bb5-423a-b6c8-5162cb0e7508 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Searching by: {'deleted': False, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:59:48.841079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07fdf859-5bb5-423a-b6c8-5162cb0e7508 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.841615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07fdf859-5bb5-423a-b6c8-5162cb0e7508 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.842305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07fdf859-5bb5-423a-b6c8-5162cb0e7508 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:48.842858 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07fdf859-5bb5-423a-b6c8-5162cb0e7508 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.843337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07fdf859-5bb5-423a-b6c8-5162cb0e7508 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.843785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-07fdf859-5bb5-423a-b6c8-5162cb0e7508 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:48.867705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-07fdf859-5bb5-423a-b6c8-5162cb0e7508 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:59:48.896364 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-07fdf859-5bb5-423a-b6c8-5162cb0e7508 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070893 Sep 06 11:59:48.896956 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3606/7171] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 11:59:48 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:48.908897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c445b6fa-f0e0-4d54-93f0-6e4d512c0636 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:48.909511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c445b6fa-f0e0-4d54-93f0-6e4d512c0636 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:48.915620 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c445b6fa-f0e0-4d54-93f0-6e4d512c0636 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.916101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c445b6fa-f0e0-4d54-93f0-6e4d512c0636 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.916537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c445b6fa-f0e0-4d54-93f0-6e4d512c0636 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:48.917235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c445b6fa-f0e0-4d54-93f0-6e4d512c0636 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.917683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c445b6fa-f0e0-4d54-93f0-6e4d512c0636 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.918115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c445b6fa-f0e0-4d54-93f0-6e4d512c0636 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:49.049345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c445b6fa-f0e0-4d54-93f0-6e4d512c0636 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:49.057199 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c445b6fa-f0e0-4d54-93f0-6e4d512c0636 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1548 microversion: 2.1 time: 0.152233 Sep 06 11:59:49.058065 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3566/7172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:48 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:59:51.051534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-66390e4d-32b5-4844-83e5-2a0633f25ed9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1ace877-72d2-43c8-bc36-8c61db18328a"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:59:51.053962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-66390e4d-32b5-4844-83e5-2a0633f25ed9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:51.062455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-66390e4d-32b5-4844-83e5-2a0633f25ed9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:51.063277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-66390e4d-32b5-4844-83e5-2a0633f25ed9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:51.063918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-66390e4d-32b5-4844-83e5-2a0633f25ed9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:51.064654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-66390e4d-32b5-4844-83e5-2a0633f25ed9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:51.065128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-66390e4d-32b5-4844-83e5-2a0633f25ed9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:51.065574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-66390e4d-32b5-4844-83e5-2a0633f25ed9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:52.067407 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-66390e4d-32b5-4844-83e5-2a0633f25ed9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "POST /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.020541 Sep 06 11:59:52.068164 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3607/7173] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 11:59:51 2022] POST /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/os-volume_attachments => generated 194 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:59.191305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-95689f16-cf1b-43d7-9459-b0e629bf486b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:59.191949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-95689f16-cf1b-43d7-9459-b0e629bf486b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:59.194725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:59.195566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=66 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:59.200323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95689f16-cf1b-43d7-9459-b0e629bf486b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:59.200845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95689f16-cf1b-43d7-9459-b0e629bf486b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:59.201290 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95689f16-cf1b-43d7-9459-b0e629bf486b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:59.202741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95689f16-cf1b-43d7-9459-b0e629bf486b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:59.203239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95689f16-cf1b-43d7-9459-b0e629bf486b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:59.203688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-95689f16-cf1b-43d7-9459-b0e629bf486b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:59.343512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-95689f16-cf1b-43d7-9459-b0e629bf486b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:59.352093 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-95689f16-cf1b-43d7-9459-b0e629bf486b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1594 microversion: 2.1 time: 0.165379 Sep 06 11:59:59.352756 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3567/7174] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:59 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1594 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:00:01.932626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:01.935438 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:01.948349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:02.020741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-debe50b0-f038-46fa-b873-3522eaecc103 req-a3b3d8e4-c3f8-4f80-89b7-b23cf760e17c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e4f587b-03b2-40ff-b58f-c24327dd3462", "tag": "9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:00:02.034131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-debe50b0-f038-46fa-b873-3522eaecc103 req-a3b3d8e4-c3f8-4f80-89b7-b23cf760e17c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:02.034966 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-debe50b0-f038-46fa-b873-3522eaecc103 req-a3b3d8e4-c3f8-4f80-89b7-b23cf760e17c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:02.035653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-debe50b0-f038-46fa-b873-3522eaecc103 req-a3b3d8e4-c3f8-4f80-89b7-b23cf760e17c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:02.048473 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-debe50b0-f038-46fa-b873-3522eaecc103 req-a3b3d8e4-c3f8-4f80-89b7-b23cf760e17c service nova] Creating event network-changed:9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd for instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 on nch1-master-1 Sep 06 12:00:02.054855 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-debe50b0-f038-46fa-b873-3522eaecc103 req-a3b3d8e4-c3f8-4f80-89b7-b23cf760e17c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132478 Sep 06 12:00:02.059352 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3608/7175] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:05.127334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7b84e969-5f55-4631-ae58-23f055bbb750 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-869926358"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:00:05.127911 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7b84e969-5f55-4631-ae58-23f055bbb750 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:05.136661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b84e969-5f55-4631-ae58-23f055bbb750 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:05.137127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b84e969-5f55-4631-ae58-23f055bbb750 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:05.137581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b84e969-5f55-4631-ae58-23f055bbb750 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:05.138307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b84e969-5f55-4631-ae58-23f055bbb750 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:05.138828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b84e969-5f55-4631-ae58-23f055bbb750 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:05.139463 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7b84e969-5f55-4631-ae58-23f055bbb750 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:05.271165 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.network.security_group_api [None req-7b84e969-5f55-4631-ae58-23f055bbb750 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Adding security group 269fc6e4-ddf8-4626-9104-6ce5c0f8dc4f to port 9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd Sep 06 12:00:05.678190 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7b84e969-5f55-4631-ae58-23f055bbb750 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "POST /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/action" status: 202 len: 0 microversion: 2.1 time: 0.555591 Sep 06 12:00:05.679101 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3568/7176] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:00:05 2022] POST /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:00:05.697221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-91093aea-4bc8-40e4-af94-2979998b48a5 req-72c922ef-de17-49f2-a581-f8fd2e63aeb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e4f587b-03b2-40ff-b58f-c24327dd3462", "tag": "9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:00:05.700593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c3d1809-c8da-4792-8066-9bd9e8bb55cc tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:05.702077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8c3d1809-c8da-4792-8066-9bd9e8bb55cc tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:05.718737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c3d1809-c8da-4792-8066-9bd9e8bb55cc tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:05.718737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c3d1809-c8da-4792-8066-9bd9e8bb55cc tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:05.725653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c3d1809-c8da-4792-8066-9bd9e8bb55cc tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:05.725653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c3d1809-c8da-4792-8066-9bd9e8bb55cc tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:05.725653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c3d1809-c8da-4792-8066-9bd9e8bb55cc tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:05.725653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c3d1809-c8da-4792-8066-9bd9e8bb55cc tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:05.726029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-91093aea-4bc8-40e4-af94-2979998b48a5 req-72c922ef-de17-49f2-a581-f8fd2e63aeb4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:05.726376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-91093aea-4bc8-40e4-af94-2979998b48a5 req-72c922ef-de17-49f2-a581-f8fd2e63aeb4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:05.726723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-91093aea-4bc8-40e4-af94-2979998b48a5 req-72c922ef-de17-49f2-a581-f8fd2e63aeb4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:05.742054 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-91093aea-4bc8-40e4-af94-2979998b48a5 req-72c922ef-de17-49f2-a581-f8fd2e63aeb4 service nova] Creating event network-changed:9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd for instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 on nch1-master-1 Sep 06 12:00:05.753683 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-91093aea-4bc8-40e4-af94-2979998b48a5 req-72c922ef-de17-49f2-a581-f8fd2e63aeb4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056531 Sep 06 12:00:05.757199 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3569/7177] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:05.946205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8c3d1809-c8da-4792-8066-9bd9e8bb55cc tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:00:05.960015 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8c3d1809-c8da-4792-8066-9bd9e8bb55cc tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1759 microversion: 2.1 time: 0.272452 Sep 06 12:00:05.975631 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3609/7178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:00:05 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1759 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:02:13.287869 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f57fb853-595b-4ef1-91ec-6bf7ec660ec1] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 12:02:13.288882 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f437706c-3085-4043-9dae-91c01118faaa] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 12:02:13.289447 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:13.290209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=12 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:13.292052 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:02:13.292269 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 12:02:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/action (ip 10.222.0.20) !!! Sep 06 12:02:13.293450 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:02:13.293450 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 12:02:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/action (ip 10.222.0.20) !!! Sep 06 12:02:13.299296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-819eba13-8949-4dbe-82a4-6b1a7158b672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:02:13.301627 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-819eba13-8949-4dbe-82a4-6b1a7158b672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:13.310941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-819eba13-8949-4dbe-82a4-6b1a7158b672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:13.311475 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-819eba13-8949-4dbe-82a4-6b1a7158b672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:13.312185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-819eba13-8949-4dbe-82a4-6b1a7158b672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:13.312899 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-819eba13-8949-4dbe-82a4-6b1a7158b672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:13.313364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-819eba13-8949-4dbe-82a4-6b1a7158b672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:13.313799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-819eba13-8949-4dbe-82a4-6b1a7158b672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:13.535637 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-819eba13-8949-4dbe-82a4-6b1a7158b672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "POST /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/action" status: 202 len: 0 microversion: 2.1 time: 0.249627 Sep 06 12:02:13.536364 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3570/7179] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:02:13 2022] POST /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:02:13.546922 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-930a0459-951d-4a27-87d5-94f0d792a2a0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:13.547595 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-930a0459-951d-4a27-87d5-94f0d792a2a0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:13.550367 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 12:02:13.550852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:13.551690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:13.553174 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 06 12:02:13.554483 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:02:13.554612 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 12:02:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 (ip 10.222.0.20) !!! Sep 06 12:02:13.568341 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-930a0459-951d-4a27-87d5-94f0d792a2a0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:13.568851 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-930a0459-951d-4a27-87d5-94f0d792a2a0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:13.569312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-930a0459-951d-4a27-87d5-94f0d792a2a0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:13.570039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-930a0459-951d-4a27-87d5-94f0d792a2a0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:13.570554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-930a0459-951d-4a27-87d5-94f0d792a2a0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:13.571002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-930a0459-951d-4a27-87d5-94f0d792a2a0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:13.739828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-930a0459-951d-4a27-87d5-94f0d792a2a0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:02:13.749052 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-930a0459-951d-4a27-87d5-94f0d792a2a0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1761 microversion: 2.1 time: 0.208327 Sep 06 12:02:13.749708 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3610/7180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:02:13 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1761 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:02:14.775898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-85aec9ca-3f79-49a4-be31-bb17c8a1da6c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:14.776634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-85aec9ca-3f79-49a4-be31-bb17c8a1da6c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:14.785683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85aec9ca-3f79-49a4-be31-bb17c8a1da6c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:14.789941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85aec9ca-3f79-49a4-be31-bb17c8a1da6c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:14.789941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85aec9ca-3f79-49a4-be31-bb17c8a1da6c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:14.789941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85aec9ca-3f79-49a4-be31-bb17c8a1da6c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:14.789941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85aec9ca-3f79-49a4-be31-bb17c8a1da6c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:14.789941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-85aec9ca-3f79-49a4-be31-bb17c8a1da6c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:14.793052 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] [f57fb853-595b-4ef1-91ec-6bf7ec660ec1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33892. Sep 06 12:02:14.796128 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] [f437706c-3085-4043-9dae-91c01118faaa] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33894. Sep 06 12:02:14.944582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-85aec9ca-3f79-49a4-be31-bb17c8a1da6c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:02:14.956857 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-85aec9ca-3f79-49a4-be31-bb17c8a1da6c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1766 microversion: 2.1 time: 0.187162 Sep 06 12:02:14.957445 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3571/7181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:02:14 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1766 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:02:15.981572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-46605a86-43ec-4bb7-ace6-275831f7622f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:15.982203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-46605a86-43ec-4bb7-ace6-275831f7622f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:15.992656 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33900. Sep 06 12:02:15.997396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46605a86-43ec-4bb7-ace6-275831f7622f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:15.997894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46605a86-43ec-4bb7-ace6-275831f7622f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:15.998352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46605a86-43ec-4bb7-ace6-275831f7622f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:15.999108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46605a86-43ec-4bb7-ace6-275831f7622f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:15.999580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46605a86-43ec-4bb7-ace6-275831f7622f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:16.000025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46605a86-43ec-4bb7-ace6-275831f7622f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:16.153813 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-46605a86-43ec-4bb7-ace6-275831f7622f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:02:16.162627 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-46605a86-43ec-4bb7-ace6-275831f7622f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1759 microversion: 2.1 time: 0.185067 Sep 06 12:02:16.163318 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3611/7182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:02:15 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1759 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:03:26.069385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:26.070065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:26.074091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-67784eb9-44bc-4226-a822-43149d51ca08 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-869926358"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:03:26.074657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-67784eb9-44bc-4226-a822-43149d51ca08 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:26.080514 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67784eb9-44bc-4226-a822-43149d51ca08 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:26.083170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67784eb9-44bc-4226-a822-43149d51ca08 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:26.083170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67784eb9-44bc-4226-a822-43149d51ca08 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:26.083170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67784eb9-44bc-4226-a822-43149d51ca08 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:26.083170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67784eb9-44bc-4226-a822-43149d51ca08 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:26.083170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-67784eb9-44bc-4226-a822-43149d51ca08 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:26.216715 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.network.security_group_api [None req-67784eb9-44bc-4226-a822-43149d51ca08 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Removing security group 269fc6e4-ddf8-4626-9104-6ce5c0f8dc4f from port 9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd Sep 06 12:03:26.614369 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-67784eb9-44bc-4226-a822-43149d51ca08 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "POST /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/action" status: 202 len: 0 microversion: 2.1 time: 0.546979 Sep 06 12:03:26.618447 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3572/7183] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:03:26 2022] POST /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:03:26.624190 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:26.626463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:26.630506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-99440da4-a929-40b1-a256-66c279cf2373 req-d61752f8-c6e6-45af-817c-195c8eed4a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e4f587b-03b2-40ff-b58f-c24327dd3462", "tag": "9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:03:26.657646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-99440da4-a929-40b1-a256-66c279cf2373 req-d61752f8-c6e6-45af-817c-195c8eed4a78 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:26.657915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-99440da4-a929-40b1-a256-66c279cf2373 req-d61752f8-c6e6-45af-817c-195c8eed4a78 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:26.658213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-99440da4-a929-40b1-a256-66c279cf2373 req-d61752f8-c6e6-45af-817c-195c8eed4a78 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:26.673714 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-99440da4-a929-40b1-a256-66c279cf2373 req-d61752f8-c6e6-45af-817c-195c8eed4a78 service nova] Creating event network-changed:9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd for instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 on nch1-master-1 Sep 06 12:03:26.678093 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [req-99440da4-a929-40b1-a256-66c279cf2373 req-d61752f8-c6e6-45af-817c-195c8eed4a78 service nova] [e8d4ddfe-f36b-4e07-8513-5c75864601fa] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 12:03:27.684937 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [req-99440da4-a929-40b1-a256-66c279cf2373 req-d61752f8-c6e6-45af-817c-195c8eed4a78 service nova] [e8d4ddfe-f36b-4e07-8513-5c75864601fa] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33948. Sep 06 12:03:27.688339 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-99440da4-a929-40b1-a256-66c279cf2373 req-d61752f8-c6e6-45af-817c-195c8eed4a78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.066106 Sep 06 12:03:27.689268 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3612/7184] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:27.893680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-28ec0fe5-0238-4a8e-b51b-50f204c80163 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:27.894767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-28ec0fe5-0238-4a8e-b51b-50f204c80163 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:27.901953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28ec0fe5-0238-4a8e-b51b-50f204c80163 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:27.902446 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28ec0fe5-0238-4a8e-b51b-50f204c80163 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:27.902888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28ec0fe5-0238-4a8e-b51b-50f204c80163 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:27.906618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28ec0fe5-0238-4a8e-b51b-50f204c80163 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:27.908618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28ec0fe5-0238-4a8e-b51b-50f204c80163 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:27.909351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28ec0fe5-0238-4a8e-b51b-50f204c80163 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:28.000725 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-28ec0fe5-0238-4a8e-b51b-50f204c80163 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lazy-loading 'services' on Instance uuid 0e4f587b-03b2-40ff-b58f-c24327dd3462 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:03:28.240696 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-28ec0fe5-0238-4a8e-b51b-50f204c80163 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/os-volume_attachments/b1ace877-72d2-43c8-bc36-8c61db18328a" status: 202 len: 0 microversion: 2.1 time: 0.352715 Sep 06 12:03:28.241359 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3573/7185] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 12:03:27 2022] DELETE /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/os-volume_attachments/b1ace877-72d2-43c8-bc36-8c61db18328a => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:03:28.252458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dc336897-0526-444c-b88e-d00c667b9f04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:28.256856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dc336897-0526-444c-b88e-d00c667b9f04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:28.265044 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc336897-0526-444c-b88e-d00c667b9f04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:28.267074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc336897-0526-444c-b88e-d00c667b9f04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:28.267074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc336897-0526-444c-b88e-d00c667b9f04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:28.267487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc336897-0526-444c-b88e-d00c667b9f04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:28.267946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc336897-0526-444c-b88e-d00c667b9f04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:28.268402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc336897-0526-444c-b88e-d00c667b9f04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:28.303362 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dc336897-0526-444c-b88e-d00c667b9f04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057249 Sep 06 12:03:28.303956 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3613/7186] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:28 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:29.318564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3adaabfb-ba3f-4e06-85ac-9cf910125ca7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:29.321027 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3adaabfb-ba3f-4e06-85ac-9cf910125ca7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:29.327370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3adaabfb-ba3f-4e06-85ac-9cf910125ca7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:29.327856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3adaabfb-ba3f-4e06-85ac-9cf910125ca7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:29.328299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3adaabfb-ba3f-4e06-85ac-9cf910125ca7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:29.328998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3adaabfb-ba3f-4e06-85ac-9cf910125ca7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:29.329459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3adaabfb-ba3f-4e06-85ac-9cf910125ca7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:29.329904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3adaabfb-ba3f-4e06-85ac-9cf910125ca7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:29.358343 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3adaabfb-ba3f-4e06-85ac-9cf910125ca7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046348 Sep 06 12:03:29.358826 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3574/7187] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:29 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 12:03:29.370425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-46a511d9-7553-4aa7-9ae0-386fbf98e672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:29.371388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-46a511d9-7553-4aa7-9ae0-386fbf98e672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:29.378022 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46a511d9-7553-4aa7-9ae0-386fbf98e672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:29.378520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46a511d9-7553-4aa7-9ae0-386fbf98e672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:29.379555 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46a511d9-7553-4aa7-9ae0-386fbf98e672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:29.380274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46a511d9-7553-4aa7-9ae0-386fbf98e672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:29.380742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46a511d9-7553-4aa7-9ae0-386fbf98e672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:29.381185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-46a511d9-7553-4aa7-9ae0-386fbf98e672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:29.459622 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-46a511d9-7553-4aa7-9ae0-386fbf98e672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] HTTP exception thrown: Instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 is not attached to volume b1ace877-72d2-43c8-bc36-8c61db18328a Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-46a511d9-7553-4aa7-9ae0-386fbf98e672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Request method failure captured: Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/os-volume_attachments/b1ace877-72d2-43c8-bc36-8c61db18328a HTTP/1.1 Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzYNo-ATiJCoPDUpOJdjF0OIeaJ6LFiFl1ps6MrGFWroLpmfzS7qgiwcrbIcJ2aJ_Brl67NVMAu9CZN8q2eRytfR91QWIPqgKTYaTjNnI5v7LUeEVq_S5rLwW7IlYCCD3Ikrc7Vhl4g02z-J5De6xiTdI27Ar1HLqqvFAyCCeuPy87k Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: bd1282dd54c14401bf4e63d865a67dee Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TestMinimumBasicScenario-1042596127 Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd1282dd54c14401bf4e63d865a67dee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd1282dd54c14401bf4e63d865a67dee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd1282dd54c14401bf4e63d865a67dee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd1282dd54c14401bf4e63d865a67dee"}]}] Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TestMinimumBasicScenario-1042596127 Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: bd1282dd54c14401bf4e63d865a67dee Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1042596127 Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TestMinimumBasicScenario-1042596127-project Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: a4cff140fd1740ff80c13526874a7113 Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TestMinimumBasicScenario-1042596127-project Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 is not attached to volume b1ace877-72d2-43c8-bc36-8c61db18328a Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'server_id': '0e4f587b-03b2-40ff-b58f-c24327dd3462', 'id': 'b1ace877-72d2-43c8-bc36-8c61db18328a'} Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b1ace877-72d2-43c8-bc36-8c61db18328a. Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 is not attached to volume b1ace877-72d2-43c8-bc36-8c61db18328a Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:03:29.466789 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:03:29.472481 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:03:29.472481 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:03:29.472481 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 is not attached to volume b1ace877-72d2-43c8-bc36-8c61db18328a Sep 06 12:03:29.472481 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:03:29.472481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-46a511d9-7553-4aa7-9ae0-386fbf98e672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Returning 404 to user: Instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 is not attached to volume b1ace877-72d2-43c8-bc36-8c61db18328a {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:03:29.472481 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-46a511d9-7553-4aa7-9ae0-386fbf98e672 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/os-volume_attachments/b1ace877-72d2-43c8-bc36-8c61db18328a" status: 404 len: 154 microversion: 2.1 time: 0.102313 Sep 06 12:03:29.472481 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3614/7188] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 12:03:29 2022] DELETE /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462/os-volume_attachments/b1ace877-72d2-43c8-bc36-8c61db18328a => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:03:29.703321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ef78e6b4-e60b-4c9f-befb-355ff4e84954 req-a7764a17-4a1d-428d-83e8-dfbe3408aca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e4f587b-03b2-40ff-b58f-c24327dd3462", "tag": "9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:03:29.713490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ef78e6b4-e60b-4c9f-befb-355ff4e84954 req-a7764a17-4a1d-428d-83e8-dfbe3408aca3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:29.714001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ef78e6b4-e60b-4c9f-befb-355ff4e84954 req-a7764a17-4a1d-428d-83e8-dfbe3408aca3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:29.715072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ef78e6b4-e60b-4c9f-befb-355ff4e84954 req-a7764a17-4a1d-428d-83e8-dfbe3408aca3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:29.728445 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ef78e6b4-e60b-4c9f-befb-355ff4e84954 req-a7764a17-4a1d-428d-83e8-dfbe3408aca3 service nova] Creating event network-changed:9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd for instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 on nch1-master-1 Sep 06 12:03:29.733671 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ef78e6b4-e60b-4c9f-befb-355ff4e84954 req-a7764a17-4a1d-428d-83e8-dfbe3408aca3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034332 Sep 06 12:03:29.734341 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3575/7189] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:32.804436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-89516565-c72f-4e03-93ad-8ebd2ece430b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:32.805068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-89516565-c72f-4e03-93ad-8ebd2ece430b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:32.812735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89516565-c72f-4e03-93ad-8ebd2ece430b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:32.814173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89516565-c72f-4e03-93ad-8ebd2ece430b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:32.814173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89516565-c72f-4e03-93ad-8ebd2ece430b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:32.814660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89516565-c72f-4e03-93ad-8ebd2ece430b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:32.815161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89516565-c72f-4e03-93ad-8ebd2ece430b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:32.815608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89516565-c72f-4e03-93ad-8ebd2ece430b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:32.841059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-89516565-c72f-4e03-93ad-8ebd2ece430b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:03:33.137892 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-89516565-c72f-4e03-93ad-8ebd2ece430b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 204 len: 0 microversion: 2.1 time: 0.337001 Sep 06 12:03:33.138422 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3615/7190] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 12:03:32 2022] DELETE /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:03:33.147258 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4b9a6442-67a9-4a2e-bb5c-55d9638cbd0f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:33.150226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4b9a6442-67a9-4a2e-bb5c-55d9638cbd0f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:33.155272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b9a6442-67a9-4a2e-bb5c-55d9638cbd0f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:33.155765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b9a6442-67a9-4a2e-bb5c-55d9638cbd0f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:33.156213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b9a6442-67a9-4a2e-bb5c-55d9638cbd0f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:33.156913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b9a6442-67a9-4a2e-bb5c-55d9638cbd0f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:33.157385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b9a6442-67a9-4a2e-bb5c-55d9638cbd0f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:33.157827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b9a6442-67a9-4a2e-bb5c-55d9638cbd0f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:33.291846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4b9a6442-67a9-4a2e-bb5c-55d9638cbd0f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:03:33.300155 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4b9a6442-67a9-4a2e-bb5c-55d9638cbd0f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1554 microversion: 2.1 time: 0.157209 Sep 06 12:03:33.301254 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3576/7191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:33 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:03:34.325826 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-efe38832-667e-4af3-9863-866624fa3aa7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:34.326578 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-efe38832-667e-4af3-9863-866624fa3aa7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:34.334192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efe38832-667e-4af3-9863-866624fa3aa7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:34.334688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efe38832-667e-4af3-9863-866624fa3aa7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:34.335173 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efe38832-667e-4af3-9863-866624fa3aa7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:34.335888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efe38832-667e-4af3-9863-866624fa3aa7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:34.336360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efe38832-667e-4af3-9863-866624fa3aa7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:34.336798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-efe38832-667e-4af3-9863-866624fa3aa7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:34.471114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-efe38832-667e-4af3-9863-866624fa3aa7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:03:34.479587 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-efe38832-667e-4af3-9863-866624fa3aa7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1554 microversion: 2.1 time: 0.158068 Sep 06 12:03:34.480162 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3616/7192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:34 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:03:35.248377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ff631860-1ad2-47c4-8770-3dc079788ed7 req-c4c1606f-e96d-46f7-b3df-fa6605da0aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e4f587b-03b2-40ff-b58f-c24327dd3462", "name": "network-vif-deleted", "tag": "9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:03:35.259404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ff631860-1ad2-47c4-8770-3dc079788ed7 req-c4c1606f-e96d-46f7-b3df-fa6605da0aea service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:35.260017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ff631860-1ad2-47c4-8770-3dc079788ed7 req-c4c1606f-e96d-46f7-b3df-fa6605da0aea service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:35.260624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ff631860-1ad2-47c4-8770-3dc079788ed7 req-c4c1606f-e96d-46f7-b3df-fa6605da0aea service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:35.272482 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ff631860-1ad2-47c4-8770-3dc079788ed7 req-c4c1606f-e96d-46f7-b3df-fa6605da0aea service nova] Creating event network-vif-deleted:9079c1d2-16a2-4f64-bc8e-2a5125ac1dfd for instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 on nch1-master-1 Sep 06 12:03:35.277489 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ff631860-1ad2-47c4-8770-3dc079788ed7 req-c4c1606f-e96d-46f7-b3df-fa6605da0aea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033028 Sep 06 12:03:35.278071 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3577/7193] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:35.503878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-39c635cf-da82-4a41-9799-8170f8bf3a05 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:35.504448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-39c635cf-da82-4a41-9799-8170f8bf3a05 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:35.512240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39c635cf-da82-4a41-9799-8170f8bf3a05 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:35.512797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39c635cf-da82-4a41-9799-8170f8bf3a05 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:35.513212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39c635cf-da82-4a41-9799-8170f8bf3a05 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:35.513951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39c635cf-da82-4a41-9799-8170f8bf3a05 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:35.514437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39c635cf-da82-4a41-9799-8170f8bf3a05 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:35.514885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-39c635cf-da82-4a41-9799-8170f8bf3a05 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:35.588872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-39c635cf-da82-4a41-9799-8170f8bf3a05 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:03:35.598246 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-39c635cf-da82-4a41-9799-8170f8bf3a05 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 200 len: 1342 microversion: 2.1 time: 0.097904 Sep 06 12:03:35.598856 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3617/7194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:35 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 1342 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:03:36.623074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d22ae534-cef6-4228-9498-0b9dbc5220f7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:36.623940 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d22ae534-cef6-4228-9498-0b9dbc5220f7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: 0e4f587b-03b2-40ff-b58f-c24327dd3462] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:36.630192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d22ae534-cef6-4228-9498-0b9dbc5220f7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:36.630681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d22ae534-cef6-4228-9498-0b9dbc5220f7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:36.631158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d22ae534-cef6-4228-9498-0b9dbc5220f7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:36.631862 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d22ae534-cef6-4228-9498-0b9dbc5220f7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:36.632328 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d22ae534-cef6-4228-9498-0b9dbc5220f7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:36.632773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d22ae534-cef6-4228-9498-0b9dbc5220f7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:36.646012 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-d22ae534-cef6-4228-9498-0b9dbc5220f7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] HTTP exception thrown: Instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 could not be found. Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d22ae534-cef6-4228-9498-0b9dbc5220f7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Request method failure captured: Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 HTTP/1.1 Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzYNo-ATiJCoPDUpOJdjF0OIeaJ6LFiFl1ps6MrGFWroLpmfzS7qgiwcrbIcJ2aJ_Brl67NVMAu9CZN8q2eRytfR91QWIPqgKTYaTjNnI5v7LUeEVq_S5rLwW7IlYCCD3Ikrc7Vhl4g02z-J5De6xiTdI27Ar1HLqqvFAyCCeuPy87k Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: bd1282dd54c14401bf4e63d865a67dee Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestMinimumBasicScenario-1042596127 Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd1282dd54c14401bf4e63d865a67dee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd1282dd54c14401bf4e63d865a67dee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd1282dd54c14401bf4e63d865a67dee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd1282dd54c14401bf4e63d865a67dee"}]}] Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestMinimumBasicScenario-1042596127 Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: bd1282dd54c14401bf4e63d865a67dee Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1042596127 Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestMinimumBasicScenario-1042596127-project Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a4cff140fd1740ff80c13526874a7113 Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestMinimumBasicScenario-1042596127-project Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 could not be found. Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '0e4f587b-03b2-40ff-b58f-c24327dd3462'} Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 could not be found. Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 could not be found. Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:03:36.647692 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:03:36.653292 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:03:36.653292 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:03:36.653292 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:03:36.653292 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:03:36.653292 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:03:36.653292 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 could not be found. Sep 06 12:03:36.653292 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:03:36.653292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d22ae534-cef6-4228-9498-0b9dbc5220f7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Returning 404 to user: Instance 0e4f587b-03b2-40ff-b58f-c24327dd3462 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:03:36.653292 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d22ae534-cef6-4228-9498-0b9dbc5220f7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462" status: 404 len: 111 microversion: 2.1 time: 0.031410 Sep 06 12:03:36.653292 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3578/7195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:36 2022] GET /compute/v2.1/servers/0e4f587b-03b2-40ff-b58f-c24327dd3462 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:03:36.657979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4769f0b-3a54-49e2-ba0f-b4f749fbc0a6 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '.version_select at 0x7f90f8597670>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:36.734153 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b4769f0b-3a54-49e2-ba0f-b4f749fbc0a6 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-798353267" status: 202 len: 0 microversion: 2.1 time: 0.079888 Sep 06 12:03:36.734671 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3618/7196] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 12:03:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-798353267 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 12:03:47.725515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-31d635fd-278d-4168-a348-0e96a394e19a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Action: 'create', calling method: .version_select at 0x7f90f9f8b280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-824286637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5xcDhYQrB00gvvHe+Z2frb9KsYeZbk6jKYUkPAeoDfUWybBGmxGFFPc8Dm1G5K5aklXFvozCSrEbNe2Q2C99N2PoN2U5tKF45oyQ56ET5uDOgMnUvveqO+K7AM6w1beQ=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:03:47.731158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=14 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:47.731823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:47.742823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-31d635fd-278d-4168-a348-0e96a394e19a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Getting quotas for project bd1282dd54c14401bf4e63d865a67dee. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:03:47.748720 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-31d635fd-278d-4168-a348-0e96a394e19a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Getting quotas for user a4cff140fd1740ff80c13526874a7113 and project bd1282dd54c14401bf4e63d865a67dee. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:03:47.865024 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-31d635fd-278d-4168-a348-0e96a394e19a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.144195 Sep 06 12:03:47.866701 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3579/7197] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 12:03:47 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:47.917534 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:47.918416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:47.922503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2130418738", "imageRef": "e03dea33-9229-4dad-9078-b0dc46147251", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-824286637", "networks": [{"uuid": "d97b72be-d691-4ac4-944e-6c2e5cd60ec0"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:03:47.976529 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] validate_networks() for [('d97b72be-d691-4ac4-944e-6c2e5cd60ec0', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:03:48.398601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:03:48.399062 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:03:48.399588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:03:48.400017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:03:48.400451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:03:48.409478 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:48.409983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:48.410444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:48.411242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:48.411721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:48.412174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:48.428984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Getting quotas for project bd1282dd54c14401bf4e63d865a67dee. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:03:48.435259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Getting quotas for user a4cff140fd1740ff80c13526874a7113 and project bd1282dd54c14401bf4e63d865a67dee. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:03:48.448756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:03:48.451132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e03dea33-9229-4dad-9078-b0dc46147251',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:03:48.599766 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-73ea6d3a-24a4-49e6-87c3-0b2736f05491 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684035 Sep 06 12:03:48.600456 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3619/7198] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 12:03:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:03:48.612688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a06232e7-e981-4647-81dc-8ca04c66e0e0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:48.613347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a06232e7-e981-4647-81dc-8ca04c66e0e0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:48.670852 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a06232e7-e981-4647-81dc-8ca04c66e0e0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:03:48.677960 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a06232e7-e981-4647-81dc-8ca04c66e0e0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1258 microversion: 2.1 time: 0.069577 Sep 06 12:03:48.679067 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3580/7199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:48 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:03:49.703137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dc963a17-344a-4280-94d7-3f5dc8a256b0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:49.703778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dc963a17-344a-4280-94d7-3f5dc8a256b0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:49.710095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc963a17-344a-4280-94d7-3f5dc8a256b0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:49.713209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc963a17-344a-4280-94d7-3f5dc8a256b0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:49.713209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc963a17-344a-4280-94d7-3f5dc8a256b0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:49.713209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc963a17-344a-4280-94d7-3f5dc8a256b0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:49.713209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc963a17-344a-4280-94d7-3f5dc8a256b0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:49.713209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dc963a17-344a-4280-94d7-3f5dc8a256b0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:49.774923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dc963a17-344a-4280-94d7-3f5dc8a256b0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:03:49.782784 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dc963a17-344a-4280-94d7-3f5dc8a256b0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1262 microversion: 2.1 time: 0.084895 Sep 06 12:03:49.783398 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3620/7200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:49 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:03:50.806472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4708b8e7-149b-4bdf-8340-b27da0850dc7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:50.807144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4708b8e7-149b-4bdf-8340-b27da0850dc7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:50.814162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4708b8e7-149b-4bdf-8340-b27da0850dc7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:50.814928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4708b8e7-149b-4bdf-8340-b27da0850dc7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:50.815416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4708b8e7-149b-4bdf-8340-b27da0850dc7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:50.816246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4708b8e7-149b-4bdf-8340-b27da0850dc7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:50.816713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4708b8e7-149b-4bdf-8340-b27da0850dc7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:50.817148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4708b8e7-149b-4bdf-8340-b27da0850dc7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:50.884552 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4708b8e7-149b-4bdf-8340-b27da0850dc7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:03:50.893044 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4708b8e7-149b-4bdf-8340-b27da0850dc7 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1318 microversion: 2.1 time: 0.091117 Sep 06 12:03:50.898873 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3581/7201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:50 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1318 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:03:51.917917 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e406bb36-d922-4cb9-8f8e-31b63678058c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:51.918549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e406bb36-d922-4cb9-8f8e-31b63678058c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:51.926278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e406bb36-d922-4cb9-8f8e-31b63678058c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:51.927356 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e406bb36-d922-4cb9-8f8e-31b63678058c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:51.927918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e406bb36-d922-4cb9-8f8e-31b63678058c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:51.928713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e406bb36-d922-4cb9-8f8e-31b63678058c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:51.929495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e406bb36-d922-4cb9-8f8e-31b63678058c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:51.930269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e406bb36-d922-4cb9-8f8e-31b63678058c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:52.096430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e406bb36-d922-4cb9-8f8e-31b63678058c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:03:52.110134 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e406bb36-d922-4cb9-8f8e-31b63678058c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1358 microversion: 2.1 time: 0.196662 Sep 06 12:03:52.112800 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3621/7202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:51 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:03:53.141510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e57cb16-de2c-400a-a6a0-2dd7b259afaa tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:53.142145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e57cb16-de2c-400a-a6a0-2dd7b259afaa tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:53.149727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e57cb16-de2c-400a-a6a0-2dd7b259afaa tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:53.150221 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e57cb16-de2c-400a-a6a0-2dd7b259afaa tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:53.150666 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e57cb16-de2c-400a-a6a0-2dd7b259afaa tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:53.153511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e57cb16-de2c-400a-a6a0-2dd7b259afaa tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:53.154181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e57cb16-de2c-400a-a6a0-2dd7b259afaa tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:53.154642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e57cb16-de2c-400a-a6a0-2dd7b259afaa tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:53.296436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7e57cb16-de2c-400a-a6a0-2dd7b259afaa tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:03:53.305368 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e57cb16-de2c-400a-a6a0-2dd7b259afaa tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1358 microversion: 2.1 time: 0.167749 Sep 06 12:03:53.305961 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3582/7203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:53 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:03:54.329537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-100e8bba-f555-4ef3-abcb-ce0a8e1a9cee tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:54.330273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-100e8bba-f555-4ef3-abcb-ce0a8e1a9cee tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:54.339290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-100e8bba-f555-4ef3-abcb-ce0a8e1a9cee tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:54.339805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-100e8bba-f555-4ef3-abcb-ce0a8e1a9cee tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:54.340452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-100e8bba-f555-4ef3-abcb-ce0a8e1a9cee tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:54.341402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-100e8bba-f555-4ef3-abcb-ce0a8e1a9cee tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:54.341974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-100e8bba-f555-4ef3-abcb-ce0a8e1a9cee tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:54.342525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-100e8bba-f555-4ef3-abcb-ce0a8e1a9cee tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:54.486649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-100e8bba-f555-4ef3-abcb-ce0a8e1a9cee tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:03:54.497750 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-100e8bba-f555-4ef3-abcb-ce0a8e1a9cee tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1358 microversion: 2.1 time: 0.172187 Sep 06 12:03:54.514909 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3622/7204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:54 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:03:55.523061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-634eacf1-6b35-4d1c-92b7-38e3b80fac0c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:55.524886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-634eacf1-6b35-4d1c-92b7-38e3b80fac0c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:55.532942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-634eacf1-6b35-4d1c-92b7-38e3b80fac0c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:55.534841 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-634eacf1-6b35-4d1c-92b7-38e3b80fac0c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:55.535515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-634eacf1-6b35-4d1c-92b7-38e3b80fac0c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:55.536327 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-634eacf1-6b35-4d1c-92b7-38e3b80fac0c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:55.536877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-634eacf1-6b35-4d1c-92b7-38e3b80fac0c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:55.537393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-634eacf1-6b35-4d1c-92b7-38e3b80fac0c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:55.685585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-634eacf1-6b35-4d1c-92b7-38e3b80fac0c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:03:55.694366 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-634eacf1-6b35-4d1c-92b7-38e3b80fac0c tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1358 microversion: 2.1 time: 0.175179 Sep 06 12:03:55.695224 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3583/7205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:55 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:03:56.728112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-02c53aec-c9f9-4327-915f-31d52b31366e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:56.728883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-02c53aec-c9f9-4327-915f-31d52b31366e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:56.737321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02c53aec-c9f9-4327-915f-31d52b31366e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:56.737835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02c53aec-c9f9-4327-915f-31d52b31366e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:56.738299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02c53aec-c9f9-4327-915f-31d52b31366e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:56.739056 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02c53aec-c9f9-4327-915f-31d52b31366e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:56.739539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02c53aec-c9f9-4327-915f-31d52b31366e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:56.739992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-02c53aec-c9f9-4327-915f-31d52b31366e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:56.895357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-02c53aec-c9f9-4327-915f-31d52b31366e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:03:56.904499 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-02c53aec-c9f9-4327-915f-31d52b31366e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1358 microversion: 2.1 time: 0.181020 Sep 06 12:03:56.905199 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3623/7206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:56 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:03:57.929129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0c2ce103-9405-45ec-b38f-3a82f41f2908 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:57.930262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0c2ce103-9405-45ec-b38f-3a82f41f2908 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:57.937500 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c2ce103-9405-45ec-b38f-3a82f41f2908 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:57.938081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c2ce103-9405-45ec-b38f-3a82f41f2908 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:57.938613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c2ce103-9405-45ec-b38f-3a82f41f2908 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:57.939389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c2ce103-9405-45ec-b38f-3a82f41f2908 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:57.940132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c2ce103-9405-45ec-b38f-3a82f41f2908 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:57.940573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c2ce103-9405-45ec-b38f-3a82f41f2908 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:58.082755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0c2ce103-9405-45ec-b38f-3a82f41f2908 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:03:58.096719 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0c2ce103-9405-45ec-b38f-3a82f41f2908 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1358 microversion: 2.1 time: 0.171628 Sep 06 12:03:58.108643 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3584/7207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:57 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:03:59.120936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed4b0762-f900-4ef5-bda6-3956ff9566fd tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:59.121542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ed4b0762-f900-4ef5-bda6-3956ff9566fd tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:59.124247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:59.124942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:59.129792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed4b0762-f900-4ef5-bda6-3956ff9566fd tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:59.130296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed4b0762-f900-4ef5-bda6-3956ff9566fd tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:59.130756 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed4b0762-f900-4ef5-bda6-3956ff9566fd tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:59.131496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed4b0762-f900-4ef5-bda6-3956ff9566fd tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:59.138347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed4b0762-f900-4ef5-bda6-3956ff9566fd tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:59.138347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed4b0762-f900-4ef5-bda6-3956ff9566fd tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:59.262196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ed4b0762-f900-4ef5-bda6-3956ff9566fd tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:03:59.270059 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ed4b0762-f900-4ef5-bda6-3956ff9566fd tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1358 microversion: 2.1 time: 0.153775 Sep 06 12:03:59.270642 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3624/7208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:03:59 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:00.294640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dd35e88a-f59f-4a18-b934-31583225d162 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:00.295325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dd35e88a-f59f-4a18-b934-31583225d162 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:00.297224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:00.303275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd35e88a-f59f-4a18-b934-31583225d162 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:00.303769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd35e88a-f59f-4a18-b934-31583225d162 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:00.304238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd35e88a-f59f-4a18-b934-31583225d162 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:00.304947 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd35e88a-f59f-4a18-b934-31583225d162 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:00.305439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd35e88a-f59f-4a18-b934-31583225d162 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:00.305866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dd35e88a-f59f-4a18-b934-31583225d162 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:00.443229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dd35e88a-f59f-4a18-b934-31583225d162 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:00.451795 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dd35e88a-f59f-4a18-b934-31583225d162 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1358 microversion: 2.1 time: 0.161236 Sep 06 12:04:00.452380 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3585/7209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:00 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:00.530427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-dd8391c5-6968-4d9f-94fb-02c8d8e800ae req-b0041230-bc50-4866-a1e2-ed13bc820f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b96f3d-c4fc-4125-9517-4c7da26eeaf7", "tag": "1570ec27-3e6a-4ca6-bfc0-9114c5e4930f"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:04:00.542004 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dd8391c5-6968-4d9f-94fb-02c8d8e800ae req-b0041230-bc50-4866-a1e2-ed13bc820f48 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:00.544013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dd8391c5-6968-4d9f-94fb-02c8d8e800ae req-b0041230-bc50-4866-a1e2-ed13bc820f48 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:00.544013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-dd8391c5-6968-4d9f-94fb-02c8d8e800ae req-b0041230-bc50-4866-a1e2-ed13bc820f48 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:00.555325 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-dd8391c5-6968-4d9f-94fb-02c8d8e800ae req-b0041230-bc50-4866-a1e2-ed13bc820f48 service nova] Creating event network-changed:1570ec27-3e6a-4ca6-bfc0-9114c5e4930f for instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 on nch2-master-1 Sep 06 12:04:00.561314 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-dd8391c5-6968-4d9f-94fb-02c8d8e800ae req-b0041230-bc50-4866-a1e2-ed13bc820f48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036415 Sep 06 12:04:00.565591 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3625/7210] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:01.475283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7f348e00-0fcf-4191-8676-d0b0855dbc55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:01.475847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7f348e00-0fcf-4191-8676-d0b0855dbc55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:01.482679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f348e00-0fcf-4191-8676-d0b0855dbc55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:01.483272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f348e00-0fcf-4191-8676-d0b0855dbc55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:01.483727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f348e00-0fcf-4191-8676-d0b0855dbc55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:01.484425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f348e00-0fcf-4191-8676-d0b0855dbc55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:01.484890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f348e00-0fcf-4191-8676-d0b0855dbc55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:01.485325 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7f348e00-0fcf-4191-8676-d0b0855dbc55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:01.626022 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7f348e00-0fcf-4191-8676-d0b0855dbc55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:01.635197 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7f348e00-0fcf-4191-8676-d0b0855dbc55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1358 microversion: 2.1 time: 0.163902 Sep 06 12:04:01.635794 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3586/7211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:01 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:02.658359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6306bd6b-bd59-4b4f-871f-c4a931bf2c04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:02.659100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6306bd6b-bd59-4b4f-871f-c4a931bf2c04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:02.666208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6306bd6b-bd59-4b4f-871f-c4a931bf2c04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:02.666704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6306bd6b-bd59-4b4f-871f-c4a931bf2c04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:02.667193 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6306bd6b-bd59-4b4f-871f-c4a931bf2c04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:02.667897 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6306bd6b-bd59-4b4f-871f-c4a931bf2c04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:02.668369 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6306bd6b-bd59-4b4f-871f-c4a931bf2c04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:02.668810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6306bd6b-bd59-4b4f-871f-c4a931bf2c04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:02.800968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6306bd6b-bd59-4b4f-871f-c4a931bf2c04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:02.808909 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6306bd6b-bd59-4b4f-871f-c4a931bf2c04 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1358 microversion: 2.1 time: 0.154812 Sep 06 12:04:02.809482 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3626/7212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:02 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:03.833587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c23cf9dc-c40f-4231-a3ee-33030918eaa0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:03.834248 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c23cf9dc-c40f-4231-a3ee-33030918eaa0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:03.842243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c23cf9dc-c40f-4231-a3ee-33030918eaa0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:03.842736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c23cf9dc-c40f-4231-a3ee-33030918eaa0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:03.843213 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c23cf9dc-c40f-4231-a3ee-33030918eaa0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:03.843934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c23cf9dc-c40f-4231-a3ee-33030918eaa0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:03.844400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c23cf9dc-c40f-4231-a3ee-33030918eaa0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:03.844837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c23cf9dc-c40f-4231-a3ee-33030918eaa0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:03.987840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c23cf9dc-c40f-4231-a3ee-33030918eaa0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:03.995648 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c23cf9dc-c40f-4231-a3ee-33030918eaa0 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1358 microversion: 2.1 time: 0.166297 Sep 06 12:04:03.996227 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3587/7213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:03 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:05.018119 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4bbf7dfc-8639-4e7c-b50a-f70c2c601f3a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:05.018971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4bbf7dfc-8639-4e7c-b50a-f70c2c601f3a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:05.026766 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bbf7dfc-8639-4e7c-b50a-f70c2c601f3a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:05.027303 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bbf7dfc-8639-4e7c-b50a-f70c2c601f3a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:05.027759 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bbf7dfc-8639-4e7c-b50a-f70c2c601f3a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:05.028486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bbf7dfc-8639-4e7c-b50a-f70c2c601f3a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:05.028963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bbf7dfc-8639-4e7c-b50a-f70c2c601f3a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:05.029541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4bbf7dfc-8639-4e7c-b50a-f70c2c601f3a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:05.113249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-b023824e-8aed-4134-a30b-4fec9bef615b req-bbcebeb4-2ed4-4cb8-a578-1c1f51264f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b96f3d-c4fc-4125-9517-4c7da26eeaf7", "name": "network-vif-plugged", "status": "completed", "tag": "1570ec27-3e6a-4ca6-bfc0-9114c5e4930f"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:04:05.123041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b023824e-8aed-4134-a30b-4fec9bef615b req-bbcebeb4-2ed4-4cb8-a578-1c1f51264f3a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:05.123584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b023824e-8aed-4134-a30b-4fec9bef615b req-bbcebeb4-2ed4-4cb8-a578-1c1f51264f3a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:05.124286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-b023824e-8aed-4134-a30b-4fec9bef615b req-bbcebeb4-2ed4-4cb8-a578-1c1f51264f3a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:05.136249 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-b023824e-8aed-4134-a30b-4fec9bef615b req-bbcebeb4-2ed4-4cb8-a578-1c1f51264f3a service nova] Creating event network-vif-plugged:1570ec27-3e6a-4ca6-bfc0-9114c5e4930f for instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 on nch2-master-1 Sep 06 12:04:05.141528 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-b023824e-8aed-4134-a30b-4fec9bef615b req-bbcebeb4-2ed4-4cb8-a578-1c1f51264f3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034029 Sep 06 12:04:05.142218 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3588/7214] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:05.176751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4bbf7dfc-8639-4e7c-b50a-f70c2c601f3a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:05.184931 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4bbf7dfc-8639-4e7c-b50a-f70c2c601f3a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1358 microversion: 2.1 time: 0.170948 Sep 06 12:04:05.185727 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3627/7215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:05 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:04:06.209444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bc0152a6-7873-4b65-ae3d-dd3714451980 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:06.210259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bc0152a6-7873-4b65-ae3d-dd3714451980 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:06.216426 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc0152a6-7873-4b65-ae3d-dd3714451980 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:06.216920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc0152a6-7873-4b65-ae3d-dd3714451980 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:06.217362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc0152a6-7873-4b65-ae3d-dd3714451980 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:06.218065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc0152a6-7873-4b65-ae3d-dd3714451980 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:06.218521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc0152a6-7873-4b65-ae3d-dd3714451980 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:06.218953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bc0152a6-7873-4b65-ae3d-dd3714451980 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:06.356608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bc0152a6-7873-4b65-ae3d-dd3714451980 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:06.366543 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bc0152a6-7873-4b65-ae3d-dd3714451980 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1358 microversion: 2.1 time: 0.162199 Sep 06 12:04:06.370376 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3589/7216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:06 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:07.389866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9f839b3a-f977-45ce-bc1d-f134d261ee73 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:07.390510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9f839b3a-f977-45ce-bc1d-f134d261ee73 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:07.397599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f839b3a-f977-45ce-bc1d-f134d261ee73 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.398273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f839b3a-f977-45ce-bc1d-f134d261ee73 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.398787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f839b3a-f977-45ce-bc1d-f134d261ee73 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.400162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f839b3a-f977-45ce-bc1d-f134d261ee73 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.400651 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f839b3a-f977-45ce-bc1d-f134d261ee73 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.401106 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9f839b3a-f977-45ce-bc1d-f134d261ee73 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.532042 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9f839b3a-f977-45ce-bc1d-f134d261ee73 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:07.540227 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9f839b3a-f977-45ce-bc1d-f134d261ee73 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1549 microversion: 2.1 time: 0.154312 Sep 06 12:04:07.540817 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3628/7217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:07 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:07.563538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-858d808c-f957-4195-8967-27eba20d02bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:07.564153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-858d808c-f957-4195-8967-27eba20d02bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:07.571823 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-858d808c-f957-4195-8967-27eba20d02bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.576896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-858d808c-f957-4195-8967-27eba20d02bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.576896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-858d808c-f957-4195-8967-27eba20d02bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.576896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-858d808c-f957-4195-8967-27eba20d02bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.576896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-858d808c-f957-4195-8967-27eba20d02bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.576896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-858d808c-f957-4195-8967-27eba20d02bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.711484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-858d808c-f957-4195-8967-27eba20d02bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:07.719985 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-858d808c-f957-4195-8967-27eba20d02bf tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1549 microversion: 2.1 time: 0.160650 Sep 06 12:04:07.720668 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3590/7218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:07 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:07.747326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5fbfb7e6-1248-47b4-b51c-35656b195c3b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:07.752143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5fbfb7e6-1248-47b4-b51c-35656b195c3b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:07.752933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5fbfb7e6-1248-47b4-b51c-35656b195c3b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Searching by: {'deleted': False, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee'} {{(pid=140876) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 12:04:07.764920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fbfb7e6-1248-47b4-b51c-35656b195c3b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.764920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fbfb7e6-1248-47b4-b51c-35656b195c3b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.764920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fbfb7e6-1248-47b4-b51c-35656b195c3b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.764920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fbfb7e6-1248-47b4-b51c-35656b195c3b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.764920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fbfb7e6-1248-47b4-b51c-35656b195c3b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.764920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5fbfb7e6-1248-47b4-b51c-35656b195c3b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.785694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.multi_cell_list [None req-5fbfb7e6-1248-47b4-b51c-35656b195c3b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 12:04:07.813465 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5fbfb7e6-1248-47b4-b51c-35656b195c3b tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070123 Sep 06 12:04:07.814056 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3629/7219] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 12:04:07 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:07.827235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-77a46d80-e91b-49bd-9ec1-5cbc61aee918 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:07.827858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-77a46d80-e91b-49bd-9ec1-5cbc61aee918 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:07.834217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77a46d80-e91b-49bd-9ec1-5cbc61aee918 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.834798 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77a46d80-e91b-49bd-9ec1-5cbc61aee918 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.835265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77a46d80-e91b-49bd-9ec1-5cbc61aee918 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.835960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77a46d80-e91b-49bd-9ec1-5cbc61aee918 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.836473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77a46d80-e91b-49bd-9ec1-5cbc61aee918 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.837457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77a46d80-e91b-49bd-9ec1-5cbc61aee918 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.967283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-77a46d80-e91b-49bd-9ec1-5cbc61aee918 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:07.975745 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-77a46d80-e91b-49bd-9ec1-5cbc61aee918 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1549 microversion: 2.1 time: 0.152039 Sep 06 12:04:07.976039 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3591/7220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:07 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:09.744648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3e3deae0-504c-442b-aa96-21608defc611 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47600f94-2570-400a-98ff-86ac42272fea"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:04:09.747203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3e3deae0-504c-442b-aa96-21608defc611 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:09.753407 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e3deae0-504c-442b-aa96-21608defc611 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:09.753910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e3deae0-504c-442b-aa96-21608defc611 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:09.754365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e3deae0-504c-442b-aa96-21608defc611 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:09.755104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e3deae0-504c-442b-aa96-21608defc611 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:09.755579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e3deae0-504c-442b-aa96-21608defc611 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:09.756025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3e3deae0-504c-442b-aa96-21608defc611 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:10.468196 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3e3deae0-504c-442b-aa96-21608defc611 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "POST /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.731673 Sep 06 12:04:10.468830 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3630/7221] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 12:04:09 2022] POST /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/os-volume_attachments => generated 194 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:13.834496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-827442c8-d513-4218-9ed5-2b46a0201135 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:13.835143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-827442c8-d513-4218-9ed5-2b46a0201135 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:13.842366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-827442c8-d513-4218-9ed5-2b46a0201135 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:13.842861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-827442c8-d513-4218-9ed5-2b46a0201135 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:13.843354 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-827442c8-d513-4218-9ed5-2b46a0201135 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:13.844118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-827442c8-d513-4218-9ed5-2b46a0201135 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:13.844608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-827442c8-d513-4218-9ed5-2b46a0201135 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:13.845048 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-827442c8-d513-4218-9ed5-2b46a0201135 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:13.979818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-827442c8-d513-4218-9ed5-2b46a0201135 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:13.988168 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-827442c8-d513-4218-9ed5-2b46a0201135 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1595 microversion: 2.1 time: 0.157559 Sep 06 12:04:13.988738 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3592/7222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:13 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:16.238707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-35e79eea-62af-41b3-addd-a212cb3e3440 req-bcb3ef1e-f272-487e-b64b-61ef4790a633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b96f3d-c4fc-4125-9517-4c7da26eeaf7", "tag": "1570ec27-3e6a-4ca6-bfc0-9114c5e4930f"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:04:16.249824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-35e79eea-62af-41b3-addd-a212cb3e3440 req-bcb3ef1e-f272-487e-b64b-61ef4790a633 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:16.250378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-35e79eea-62af-41b3-addd-a212cb3e3440 req-bcb3ef1e-f272-487e-b64b-61ef4790a633 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:16.250773 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-35e79eea-62af-41b3-addd-a212cb3e3440 req-bcb3ef1e-f272-487e-b64b-61ef4790a633 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:16.263290 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-35e79eea-62af-41b3-addd-a212cb3e3440 req-bcb3ef1e-f272-487e-b64b-61ef4790a633 service nova] Creating event network-changed:1570ec27-3e6a-4ca6-bfc0-9114c5e4930f for instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 on nch2-master-1 Sep 06 12:04:16.272277 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-35e79eea-62af-41b3-addd-a212cb3e3440 req-bcb3ef1e-f272-487e-b64b-61ef4790a633 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035712 Sep 06 12:04:16.272277 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3631/7223] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:18.678329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9c8edcdc-df8b-4cec-9ecd-0523ad349cfb tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1119223350"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:04:18.678329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9c8edcdc-df8b-4cec-9ecd-0523ad349cfb tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:18.678971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:18.683719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c8edcdc-df8b-4cec-9ecd-0523ad349cfb tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:18.684217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c8edcdc-df8b-4cec-9ecd-0523ad349cfb tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:18.684741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c8edcdc-df8b-4cec-9ecd-0523ad349cfb tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:18.685658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c8edcdc-df8b-4cec-9ecd-0523ad349cfb tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:18.686119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c8edcdc-df8b-4cec-9ecd-0523ad349cfb tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:18.687087 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9c8edcdc-df8b-4cec-9ecd-0523ad349cfb tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:18.689668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=69 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:18.825105 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.network.security_group_api [None req-9c8edcdc-df8b-4cec-9ecd-0523ad349cfb tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Adding security group 8f72a52b-cc51-4552-8ff6-d5a8a783b659 to port 1570ec27-3e6a-4ca6-bfc0-9114c5e4930f Sep 06 12:04:19.225019 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9c8edcdc-df8b-4cec-9ecd-0523ad349cfb tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "POST /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/action" status: 202 len: 0 microversion: 2.1 time: 0.543102 Sep 06 12:04:19.225019 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3593/7224] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:04:18 2022] POST /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:04:19.225019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-34c46b26-74e2-42bc-baa1-f447cef9b117 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:19.225297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-c685de70-02f0-4ff3-be0e-2ce503dbade3 req-a5ce50a7-471f-4e2a-927c-806bfc62bbcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b96f3d-c4fc-4125-9517-4c7da26eeaf7", "tag": "1570ec27-3e6a-4ca6-bfc0-9114c5e4930f"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:04:19.225772 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-34c46b26-74e2-42bc-baa1-f447cef9b117 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:19.229855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:19.230685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34c46b26-74e2-42bc-baa1-f447cef9b117 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:19.230841 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:19.231366 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34c46b26-74e2-42bc-baa1-f447cef9b117 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:19.231887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34c46b26-74e2-42bc-baa1-f447cef9b117 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:19.232918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34c46b26-74e2-42bc-baa1-f447cef9b117 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:19.233747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34c46b26-74e2-42bc-baa1-f447cef9b117 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:19.234367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34c46b26-74e2-42bc-baa1-f447cef9b117 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:19.236337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c685de70-02f0-4ff3-be0e-2ce503dbade3 req-a5ce50a7-471f-4e2a-927c-806bfc62bbcd service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:19.237054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c685de70-02f0-4ff3-be0e-2ce503dbade3 req-a5ce50a7-471f-4e2a-927c-806bfc62bbcd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:19.237698 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-c685de70-02f0-4ff3-be0e-2ce503dbade3 req-a5ce50a7-471f-4e2a-927c-806bfc62bbcd service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:19.242517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:19.254167 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-c685de70-02f0-4ff3-be0e-2ce503dbade3 req-a5ce50a7-471f-4e2a-927c-806bfc62bbcd service nova] Creating event network-changed:1570ec27-3e6a-4ca6-bfc0-9114c5e4930f for instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 on nch2-master-1 Sep 06 12:04:19.263792 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-c685de70-02f0-4ff3-be0e-2ce503dbade3 req-a5ce50a7-471f-4e2a-927c-806bfc62bbcd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044290 Sep 06 12:04:19.265976 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3632/7225] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:19.408190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-34c46b26-74e2-42bc-baa1-f447cef9b117 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:19.417254 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-34c46b26-74e2-42bc-baa1-f447cef9b117 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1760 microversion: 2.1 time: 0.197674 Sep 06 12:04:19.419054 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3594/7226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:19 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1760 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:04:37.726381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-20168fcb-1bf8-4391-977a-bb85d1028435 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:04:37.728795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-20168fcb-1bf8-4391-977a-bb85d1028435 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:37.736938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20168fcb-1bf8-4391-977a-bb85d1028435 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:37.737440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20168fcb-1bf8-4391-977a-bb85d1028435 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:37.737911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20168fcb-1bf8-4391-977a-bb85d1028435 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:37.738770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20168fcb-1bf8-4391-977a-bb85d1028435 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:37.739137 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20168fcb-1bf8-4391-977a-bb85d1028435 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:37.743170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20168fcb-1bf8-4391-977a-bb85d1028435 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:37.971116 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-20168fcb-1bf8-4391-977a-bb85d1028435 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "POST /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/action" status: 202 len: 0 microversion: 2.1 time: 0.251152 Sep 06 12:04:37.971794 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3633/7227] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:04:37 2022] POST /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:04:37.980419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-721db225-4714-469c-a5d2-9d4d0628aca9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:37.980970 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-721db225-4714-469c-a5d2-9d4d0628aca9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:37.985304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:37.987043 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=9 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:37.990115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-721db225-4714-469c-a5d2-9d4d0628aca9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:37.990615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-721db225-4714-469c-a5d2-9d4d0628aca9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:37.991096 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-721db225-4714-469c-a5d2-9d4d0628aca9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:37.991813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-721db225-4714-469c-a5d2-9d4d0628aca9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:37.992277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-721db225-4714-469c-a5d2-9d4d0628aca9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:37.992713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-721db225-4714-469c-a5d2-9d4d0628aca9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:38.189702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-721db225-4714-469c-a5d2-9d4d0628aca9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:38.198487 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-721db225-4714-469c-a5d2-9d4d0628aca9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1752 microversion: 2.1 time: 0.222503 Sep 06 12:04:38.199088 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3595/7228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:37 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1752 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:39.223445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-93819fca-909b-4b6b-81cf-870e24fc5578 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:39.224081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-93819fca-909b-4b6b-81cf-870e24fc5578 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:39.231083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93819fca-909b-4b6b-81cf-870e24fc5578 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:39.231583 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93819fca-909b-4b6b-81cf-870e24fc5578 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:39.232038 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93819fca-909b-4b6b-81cf-870e24fc5578 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:39.232749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93819fca-909b-4b6b-81cf-870e24fc5578 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:39.233222 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93819fca-909b-4b6b-81cf-870e24fc5578 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:39.233664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93819fca-909b-4b6b-81cf-870e24fc5578 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:39.425270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-93819fca-909b-4b6b-81cf-870e24fc5578 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:39.434171 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-93819fca-909b-4b6b-81cf-870e24fc5578 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1757 microversion: 2.1 time: 0.216029 Sep 06 12:04:39.434754 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3634/7229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:39 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:40.459255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a2459aa8-05b7-4bf8-8ee9-76f77178d8a8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:40.459846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a2459aa8-05b7-4bf8-8ee9-76f77178d8a8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:40.466607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2459aa8-05b7-4bf8-8ee9-76f77178d8a8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:40.467131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2459aa8-05b7-4bf8-8ee9-76f77178d8a8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:40.467582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2459aa8-05b7-4bf8-8ee9-76f77178d8a8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:40.468340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2459aa8-05b7-4bf8-8ee9-76f77178d8a8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:40.468813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2459aa8-05b7-4bf8-8ee9-76f77178d8a8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:40.469250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a2459aa8-05b7-4bf8-8ee9-76f77178d8a8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:40.615304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a2459aa8-05b7-4bf8-8ee9-76f77178d8a8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:40.624413 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a2459aa8-05b7-4bf8-8ee9-76f77178d8a8 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1757 microversion: 2.1 time: 0.169473 Sep 06 12:04:40.624996 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3596/7230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:40 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:41.648174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f810424d-2c34-4ecf-9cd4-f9131bb9abc9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:41.648810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f810424d-2c34-4ecf-9cd4-f9131bb9abc9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:41.656311 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f810424d-2c34-4ecf-9cd4-f9131bb9abc9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:41.656830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f810424d-2c34-4ecf-9cd4-f9131bb9abc9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:41.657290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f810424d-2c34-4ecf-9cd4-f9131bb9abc9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:41.658032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f810424d-2c34-4ecf-9cd4-f9131bb9abc9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:41.658512 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f810424d-2c34-4ecf-9cd4-f9131bb9abc9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:41.658967 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f810424d-2c34-4ecf-9cd4-f9131bb9abc9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:41.814012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-f810424d-2c34-4ecf-9cd4-f9131bb9abc9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:41.823515 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f810424d-2c34-4ecf-9cd4-f9131bb9abc9 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1757 microversion: 2.1 time: 0.178803 Sep 06 12:04:41.824205 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3635/7231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:41 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:42.848355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-74498b2b-7bc4-46d5-9046-7bb9b05f9970 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:42.848966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-74498b2b-7bc4-46d5-9046-7bb9b05f9970 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:42.856388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74498b2b-7bc4-46d5-9046-7bb9b05f9970 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:42.856881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74498b2b-7bc4-46d5-9046-7bb9b05f9970 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:42.857332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74498b2b-7bc4-46d5-9046-7bb9b05f9970 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:42.858039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74498b2b-7bc4-46d5-9046-7bb9b05f9970 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:42.858515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74498b2b-7bc4-46d5-9046-7bb9b05f9970 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:42.858953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-74498b2b-7bc4-46d5-9046-7bb9b05f9970 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:43.008335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-74498b2b-7bc4-46d5-9046-7bb9b05f9970 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:43.016877 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-74498b2b-7bc4-46d5-9046-7bb9b05f9970 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1757 microversion: 2.1 time: 0.172509 Sep 06 12:04:43.017457 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3597/7232] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:42 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:44.041820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ed22f26e-841b-471b-8c06-6ed5b50aafa3 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:44.042477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ed22f26e-841b-471b-8c06-6ed5b50aafa3 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:44.049348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed22f26e-841b-471b-8c06-6ed5b50aafa3 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:44.049846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed22f26e-841b-471b-8c06-6ed5b50aafa3 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:44.050345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed22f26e-841b-471b-8c06-6ed5b50aafa3 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:44.051090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed22f26e-841b-471b-8c06-6ed5b50aafa3 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:44.051564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed22f26e-841b-471b-8c06-6ed5b50aafa3 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:44.052005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ed22f26e-841b-471b-8c06-6ed5b50aafa3 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:44.200608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ed22f26e-841b-471b-8c06-6ed5b50aafa3 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:44.209245 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ed22f26e-841b-471b-8c06-6ed5b50aafa3 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1757 microversion: 2.1 time: 0.171757 Sep 06 12:04:44.209854 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3636/7233] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:44 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:45.233275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-75527944-1809-4872-b7c6-e1988abc4d55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:45.233858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-75527944-1809-4872-b7c6-e1988abc4d55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:45.240090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75527944-1809-4872-b7c6-e1988abc4d55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:45.240585 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75527944-1809-4872-b7c6-e1988abc4d55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:45.241026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75527944-1809-4872-b7c6-e1988abc4d55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:45.241727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75527944-1809-4872-b7c6-e1988abc4d55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:45.242189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75527944-1809-4872-b7c6-e1988abc4d55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:45.242624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-75527944-1809-4872-b7c6-e1988abc4d55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:45.382329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-75527944-1809-4872-b7c6-e1988abc4d55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:45.391447 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-75527944-1809-4872-b7c6-e1988abc4d55 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1757 microversion: 2.1 time: 0.162205 Sep 06 12:04:45.398281 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3598/7234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:45 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:46.414460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-73cafc96-6b27-483e-9ea5-e6f03ed7d63a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:46.415089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-73cafc96-6b27-483e-9ea5-e6f03ed7d63a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:46.421821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73cafc96-6b27-483e-9ea5-e6f03ed7d63a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:46.422258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73cafc96-6b27-483e-9ea5-e6f03ed7d63a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:46.422708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73cafc96-6b27-483e-9ea5-e6f03ed7d63a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:46.423455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73cafc96-6b27-483e-9ea5-e6f03ed7d63a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:46.423924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73cafc96-6b27-483e-9ea5-e6f03ed7d63a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:46.424365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-73cafc96-6b27-483e-9ea5-e6f03ed7d63a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:46.569581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-73cafc96-6b27-483e-9ea5-e6f03ed7d63a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:46.578678 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-73cafc96-6b27-483e-9ea5-e6f03ed7d63a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1757 microversion: 2.1 time: 0.168291 Sep 06 12:04:46.579286 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3637/7235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:46 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:47.603116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-28df2632-d07c-4240-9668-d4a99decc46a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:47.603693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-28df2632-d07c-4240-9668-d4a99decc46a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:47.611692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28df2632-d07c-4240-9668-d4a99decc46a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:47.612178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28df2632-d07c-4240-9668-d4a99decc46a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:47.612618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28df2632-d07c-4240-9668-d4a99decc46a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:47.613314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28df2632-d07c-4240-9668-d4a99decc46a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:47.613773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28df2632-d07c-4240-9668-d4a99decc46a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:47.614202 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28df2632-d07c-4240-9668-d4a99decc46a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:47.757428 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-28df2632-d07c-4240-9668-d4a99decc46a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:47.766137 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-28df2632-d07c-4240-9668-d4a99decc46a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1757 microversion: 2.1 time: 0.167155 Sep 06 12:04:47.766721 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3599/7236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:47 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:48.790377 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-784a35c9-933d-4f7c-979c-8e76caf55529 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:48.790997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-784a35c9-933d-4f7c-979c-8e76caf55529 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:48.798782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-784a35c9-933d-4f7c-979c-8e76caf55529 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:48.799328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-784a35c9-933d-4f7c-979c-8e76caf55529 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:48.799794 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-784a35c9-933d-4f7c-979c-8e76caf55529 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:48.800516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-784a35c9-933d-4f7c-979c-8e76caf55529 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:48.800999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-784a35c9-933d-4f7c-979c-8e76caf55529 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:48.801452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-784a35c9-933d-4f7c-979c-8e76caf55529 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:48.966134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-784a35c9-933d-4f7c-979c-8e76caf55529 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:48.974670 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-784a35c9-933d-4f7c-979c-8e76caf55529 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1757 microversion: 2.1 time: 0.188424 Sep 06 12:04:48.975282 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3638/7237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:48 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:04:49.998994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1d463eb7-80e5-4b43-9139-a62593355f2d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:49.999644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1d463eb7-80e5-4b43-9139-a62593355f2d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:50.006807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d463eb7-80e5-4b43-9139-a62593355f2d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:50.007329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d463eb7-80e5-4b43-9139-a62593355f2d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:50.007774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d463eb7-80e5-4b43-9139-a62593355f2d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:50.008478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d463eb7-80e5-4b43-9139-a62593355f2d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:50.008938 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d463eb7-80e5-4b43-9139-a62593355f2d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:50.009372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1d463eb7-80e5-4b43-9139-a62593355f2d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:50.157537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1d463eb7-80e5-4b43-9139-a62593355f2d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:04:50.166162 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1d463eb7-80e5-4b43-9139-a62593355f2d tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1760 microversion: 2.1 time: 0.171618 Sep 06 12:04:50.167298 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3600/7238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:04:49 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1760 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:05:22.736446 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5f6cfb7c-f32a-4d65-99ea-7fa6f7d2fb8e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1119223350"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:05:22.737120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5f6cfb7c-f32a-4d65-99ea-7fa6f7d2fb8e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:22.739354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=13 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:22.740046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:22.745351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f6cfb7c-f32a-4d65-99ea-7fa6f7d2fb8e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:22.745903 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f6cfb7c-f32a-4d65-99ea-7fa6f7d2fb8e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:22.746417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f6cfb7c-f32a-4d65-99ea-7fa6f7d2fb8e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:22.747742 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f6cfb7c-f32a-4d65-99ea-7fa6f7d2fb8e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:22.748232 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f6cfb7c-f32a-4d65-99ea-7fa6f7d2fb8e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:22.748682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f6cfb7c-f32a-4d65-99ea-7fa6f7d2fb8e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:22.882606 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.network.security_group_api [None req-5f6cfb7c-f32a-4d65-99ea-7fa6f7d2fb8e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Removing security group 8f72a52b-cc51-4552-8ff6-d5a8a783b659 from port 1570ec27-3e6a-4ca6-bfc0-9114c5e4930f Sep 06 12:05:23.214116 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5f6cfb7c-f32a-4d65-99ea-7fa6f7d2fb8e tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "POST /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/action" status: 202 len: 0 microversion: 2.1 time: 0.481845 Sep 06 12:05:23.214749 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3639/7239] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:05:22 2022] POST /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:05:23.224951 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=12 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:23.225730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=36 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:23.342230 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-1c15507e-c69f-4f5b-a80f-40dda37d24d4 req-87c02627-8050-4fac-ae8b-6479ad12bb44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b96f3d-c4fc-4125-9517-4c7da26eeaf7", "tag": "1570ec27-3e6a-4ca6-bfc0-9114c5e4930f"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:05:23.352113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1c15507e-c69f-4f5b-a80f-40dda37d24d4 req-87c02627-8050-4fac-ae8b-6479ad12bb44 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:23.352749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1c15507e-c69f-4f5b-a80f-40dda37d24d4 req-87c02627-8050-4fac-ae8b-6479ad12bb44 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:23.353293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-1c15507e-c69f-4f5b-a80f-40dda37d24d4 req-87c02627-8050-4fac-ae8b-6479ad12bb44 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:23.365682 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-1c15507e-c69f-4f5b-a80f-40dda37d24d4 req-87c02627-8050-4fac-ae8b-6479ad12bb44 service nova] Creating event network-changed:1570ec27-3e6a-4ca6-bfc0-9114c5e4930f for instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 on nch2-master-1 Sep 06 12:05:23.371801 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-1c15507e-c69f-4f5b-a80f-40dda37d24d4 req-87c02627-8050-4fac-ae8b-6479ad12bb44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151765 Sep 06 12:05:23.373582 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3601/7240] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:24.436473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-da0e4ca0-b5f8-4551-b47d-c9a1977c3d36 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:24.437095 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-da0e4ca0-b5f8-4551-b47d-c9a1977c3d36 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:24.444047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da0e4ca0-b5f8-4551-b47d-c9a1977c3d36 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:24.444559 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da0e4ca0-b5f8-4551-b47d-c9a1977c3d36 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:24.445021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da0e4ca0-b5f8-4551-b47d-c9a1977c3d36 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:24.445744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da0e4ca0-b5f8-4551-b47d-c9a1977c3d36 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:24.446223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da0e4ca0-b5f8-4551-b47d-c9a1977c3d36 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:24.446671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-da0e4ca0-b5f8-4551-b47d-c9a1977c3d36 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:24.532267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-da0e4ca0-b5f8-4551-b47d-c9a1977c3d36 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lazy-loading 'services' on Instance uuid c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:05:24.701148 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-da0e4ca0-b5f8-4551-b47d-c9a1977c3d36 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/os-volume_attachments/47600f94-2570-400a-98ff-86ac42272fea" status: 202 len: 0 microversion: 2.1 time: 0.268848 Sep 06 12:05:24.701817 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3640/7241] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 12:05:24 2022] DELETE /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/os-volume_attachments/47600f94-2570-400a-98ff-86ac42272fea => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:05:24.713876 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dc11605f-9f10-433b-be73-368d925f270f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:24.716991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dc11605f-9f10-433b-be73-368d925f270f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:24.723299 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc11605f-9f10-433b-be73-368d925f270f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:24.723825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc11605f-9f10-433b-be73-368d925f270f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:24.724279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc11605f-9f10-433b-be73-368d925f270f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:24.724986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc11605f-9f10-433b-be73-368d925f270f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:24.725453 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc11605f-9f10-433b-be73-368d925f270f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:24.725893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dc11605f-9f10-433b-be73-368d925f270f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:24.756640 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dc11605f-9f10-433b-be73-368d925f270f tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050084 Sep 06 12:05:24.757233 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3602/7242] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:24 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:25.391403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-926f8812-f1ea-4cfa-bf0a-4f6d82223080 req-9a287815-2990-4334-a517-7d492342e8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b96f3d-c4fc-4125-9517-4c7da26eeaf7", "tag": "1570ec27-3e6a-4ca6-bfc0-9114c5e4930f"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:05:25.403087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-926f8812-f1ea-4cfa-bf0a-4f6d82223080 req-9a287815-2990-4334-a517-7d492342e8a0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:25.404113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-926f8812-f1ea-4cfa-bf0a-4f6d82223080 req-9a287815-2990-4334-a517-7d492342e8a0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:25.404598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-926f8812-f1ea-4cfa-bf0a-4f6d82223080 req-9a287815-2990-4334-a517-7d492342e8a0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:25.421532 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-926f8812-f1ea-4cfa-bf0a-4f6d82223080 req-9a287815-2990-4334-a517-7d492342e8a0 service nova] Creating event network-changed:1570ec27-3e6a-4ca6-bfc0-9114c5e4930f for instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 on nch2-master-1 Sep 06 12:05:25.426789 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-926f8812-f1ea-4cfa-bf0a-4f6d82223080 req-9a287815-2990-4334-a517-7d492342e8a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040163 Sep 06 12:05:25.427303 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3641/7243] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:25.769104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0e6ac68a-7a21-4f18-883d-09c018b18207 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:25.771598 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0e6ac68a-7a21-4f18-883d-09c018b18207 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:25.779750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e6ac68a-7a21-4f18-883d-09c018b18207 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:25.780341 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e6ac68a-7a21-4f18-883d-09c018b18207 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:25.781866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e6ac68a-7a21-4f18-883d-09c018b18207 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:25.781866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e6ac68a-7a21-4f18-883d-09c018b18207 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:25.782116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e6ac68a-7a21-4f18-883d-09c018b18207 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:25.782465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0e6ac68a-7a21-4f18-883d-09c018b18207 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:25.815143 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0e6ac68a-7a21-4f18-883d-09c018b18207 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049958 Sep 06 12:05:25.816047 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3603/7244] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:25 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 12:05:25.828527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f94f854f-fa14-4651-b380-b836f516f817 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:25.829129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-f94f854f-fa14-4651-b380-b836f516f817 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:25.835627 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f94f854f-fa14-4651-b380-b836f516f817 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:25.836128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f94f854f-fa14-4651-b380-b836f516f817 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:25.836588 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f94f854f-fa14-4651-b380-b836f516f817 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:25.837315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f94f854f-fa14-4651-b380-b836f516f817 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:25.837790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f94f854f-fa14-4651-b380-b836f516f817 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:25.838241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-f94f854f-fa14-4651-b380-b836f516f817 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:25.916249 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-f94f854f-fa14-4651-b380-b836f516f817 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] HTTP exception thrown: Instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 is not attached to volume 47600f94-2570-400a-98ff-86ac42272fea Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f94f854f-fa14-4651-b380-b836f516f817 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Request method failure captured: Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: request: DELETE /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/os-volume_attachments/47600f94-2570-400a-98ff-86ac42272fea HTTP/1.1 Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzYNo-ATiJCoPDUpOJdjF0OIeaJ6LFiFl1ps6MrGFWroLpmfzS7qgiwcrbIcJ2aJ_Brl67NVMAu9CZN8q2eRytfR91QWIPqgKTYaTjNnI5v7LUeEVq_S5rLwW7IlYCCD3Ikrc7Vhl4g02z-J5De6xiTdI27Ar1HLqqvFAyCCeuPy87k Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: bd1282dd54c14401bf4e63d865a67dee Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TestMinimumBasicScenario-1042596127 Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd1282dd54c14401bf4e63d865a67dee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd1282dd54c14401bf4e63d865a67dee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd1282dd54c14401bf4e63d865a67dee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd1282dd54c14401bf4e63d865a67dee"}]}] Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TestMinimumBasicScenario-1042596127 Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: bd1282dd54c14401bf4e63d865a67dee Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1042596127 Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TestMinimumBasicScenario-1042596127-project Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: a4cff140fd1740ff80c13526874a7113 Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TestMinimumBasicScenario-1042596127-project Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 is not attached to volume 47600f94-2570-400a-98ff-86ac42272fea Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'server_id': 'c0b96f3d-c4fc-4125-9517-4c7da26eeaf7', 'id': '47600f94-2570-400a-98ff-86ac42272fea'} Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 47600f94-2570-400a-98ff-86ac42272fea. Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 is not attached to volume 47600f94-2570-400a-98ff-86ac42272fea Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:05:25.918102 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:05:25.927699 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:05:25.927699 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:05:25.927699 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 is not attached to volume 47600f94-2570-400a-98ff-86ac42272fea Sep 06 12:05:25.927699 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:05:25.927699 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-f94f854f-fa14-4651-b380-b836f516f817 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Returning 404 to user: Instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 is not attached to volume 47600f94-2570-400a-98ff-86ac42272fea {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:05:25.927699 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-f94f854f-fa14-4651-b380-b836f516f817 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/os-volume_attachments/47600f94-2570-400a-98ff-86ac42272fea" status: 404 len: 154 microversion: 2.1 time: 0.098522 Sep 06 12:05:25.927699 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3642/7245] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 12:05:25 2022] DELETE /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7/os-volume_attachments/47600f94-2570-400a-98ff-86ac42272fea => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:05:29.356659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-403eaa61-779c-486c-a436-89378b141d53 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:29.357153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-403eaa61-779c-486c-a436-89378b141d53 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:29.364113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403eaa61-779c-486c-a436-89378b141d53 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:29.364605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403eaa61-779c-486c-a436-89378b141d53 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:29.365052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403eaa61-779c-486c-a436-89378b141d53 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:29.365752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403eaa61-779c-486c-a436-89378b141d53 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:29.366215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403eaa61-779c-486c-a436-89378b141d53 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:29.366650 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-403eaa61-779c-486c-a436-89378b141d53 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:29.394718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-403eaa61-779c-486c-a436-89378b141d53 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:05:29.709463 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-403eaa61-779c-486c-a436-89378b141d53 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 204 len: 0 microversion: 2.1 time: 0.356870 Sep 06 12:05:29.709999 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3604/7246] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 12:05:29 2022] DELETE /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 12:05:29.719097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-11474169-9f0e-497d-9ff4-4f8a6b517c94 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:29.723760 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-11474169-9f0e-497d-9ff4-4f8a6b517c94 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:29.728608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11474169-9f0e-497d-9ff4-4f8a6b517c94 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:29.729129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11474169-9f0e-497d-9ff4-4f8a6b517c94 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:29.729717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11474169-9f0e-497d-9ff4-4f8a6b517c94 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:29.730432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11474169-9f0e-497d-9ff4-4f8a6b517c94 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:29.730901 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11474169-9f0e-497d-9ff4-4f8a6b517c94 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:29.731976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-11474169-9f0e-497d-9ff4-4f8a6b517c94 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:29.882872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-11474169-9f0e-497d-9ff4-4f8a6b517c94 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:05:29.891505 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-11474169-9f0e-497d-9ff4-4f8a6b517c94 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1555 microversion: 2.1 time: 0.176946 Sep 06 12:05:29.892102 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3643/7247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:05:29 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:05:30.916607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f6789bea-c542-4cf9-8e8b-8019c87c8219 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:30.917319 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f6789bea-c542-4cf9-8e8b-8019c87c8219 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:30.924774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6789bea-c542-4cf9-8e8b-8019c87c8219 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:30.925265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6789bea-c542-4cf9-8e8b-8019c87c8219 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:30.925711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6789bea-c542-4cf9-8e8b-8019c87c8219 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:30.926419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6789bea-c542-4cf9-8e8b-8019c87c8219 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:30.926888 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6789bea-c542-4cf9-8e8b-8019c87c8219 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:30.927348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f6789bea-c542-4cf9-8e8b-8019c87c8219 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:31.056886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f6789bea-c542-4cf9-8e8b-8019c87c8219 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:05:31.078355 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f6789bea-c542-4cf9-8e8b-8019c87c8219 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1555 microversion: 2.1 time: 0.152529 Sep 06 12:05:31.078355 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3605/7248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:05:30 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:05:32.088542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9b3d8025-deae-479c-b0ba-c8319be4f543 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:32.089296 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9b3d8025-deae-479c-b0ba-c8319be4f543 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:32.096138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b3d8025-deae-479c-b0ba-c8319be4f543 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:32.097273 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b3d8025-deae-479c-b0ba-c8319be4f543 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:32.097722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b3d8025-deae-479c-b0ba-c8319be4f543 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:32.098439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b3d8025-deae-479c-b0ba-c8319be4f543 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:32.098902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b3d8025-deae-479c-b0ba-c8319be4f543 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:32.099365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9b3d8025-deae-479c-b0ba-c8319be4f543 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:32.150039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-2f800241-2c31-4571-8c3f-2c27d7441905 req-88a101bb-ff08-4264-a87e-1a8f20bd95aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b96f3d-c4fc-4125-9517-4c7da26eeaf7", "name": "network-vif-deleted", "tag": "1570ec27-3e6a-4ca6-bfc0-9114c5e4930f"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:05:32.161125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2f800241-2c31-4571-8c3f-2c27d7441905 req-88a101bb-ff08-4264-a87e-1a8f20bd95aa service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:32.161940 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2f800241-2c31-4571-8c3f-2c27d7441905 req-88a101bb-ff08-4264-a87e-1a8f20bd95aa service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:32.162598 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-2f800241-2c31-4571-8c3f-2c27d7441905 req-88a101bb-ff08-4264-a87e-1a8f20bd95aa service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:32.165831 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9b3d8025-deae-479c-b0ba-c8319be4f543 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cff140fd1740ff80c13526874a7113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1282dd54c14401bf4e63d865a67dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:05:32.174867 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9b3d8025-deae-479c-b0ba-c8319be4f543 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 200 len: 1513 microversion: 2.1 time: 0.090306 Sep 06 12:05:32.175242 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-2f800241-2c31-4571-8c3f-2c27d7441905 req-88a101bb-ff08-4264-a87e-1a8f20bd95aa service nova] Creating event network-vif-deleted:1570ec27-3e6a-4ca6-bfc0-9114c5e4930f for instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 on nch2-master-1 Sep 06 12:05:32.175482 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3606/7249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:05:32 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 1513 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:05:32.185580 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-2f800241-2c31-4571-8c3f-2c27d7441905 req-88a101bb-ff08-4264-a87e-1a8f20bd95aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097220 Sep 06 12:05:32.185580 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3644/7250] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:33.203077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ebc08174-ef08-40ff-a928-112d2396858a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:33.203639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ebc08174-ef08-40ff-a928-112d2396858a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] [instance: c0b96f3d-c4fc-4125-9517-4c7da26eeaf7] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:33.212601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ebc08174-ef08-40ff-a928-112d2396858a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:33.213380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ebc08174-ef08-40ff-a928-112d2396858a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:33.214104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ebc08174-ef08-40ff-a928-112d2396858a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:33.215203 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ebc08174-ef08-40ff-a928-112d2396858a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:33.215718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ebc08174-ef08-40ff-a928-112d2396858a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:33.216160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ebc08174-ef08-40ff-a928-112d2396858a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:33.229891 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-ebc08174-ef08-40ff-a928-112d2396858a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] HTTP exception thrown: Instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 could not be found. Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ebc08174-ef08-40ff-a928-112d2396858a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Request method failure captured: Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 HTTP/1.1 Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzYNo-ATiJCoPDUpOJdjF0OIeaJ6LFiFl1ps6MrGFWroLpmfzS7qgiwcrbIcJ2aJ_Brl67NVMAu9CZN8q2eRytfR91QWIPqgKTYaTjNnI5v7LUeEVq_S5rLwW7IlYCCD3Ikrc7Vhl4g02z-J5De6xiTdI27Ar1HLqqvFAyCCeuPy87k Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: bd1282dd54c14401bf4e63d865a67dee Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestMinimumBasicScenario-1042596127 Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd1282dd54c14401bf4e63d865a67dee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd1282dd54c14401bf4e63d865a67dee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd1282dd54c14401bf4e63d865a67dee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd1282dd54c14401bf4e63d865a67dee"}]}] Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestMinimumBasicScenario-1042596127 Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: bd1282dd54c14401bf4e63d865a67dee Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1042596127 Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestMinimumBasicScenario-1042596127-project Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: a4cff140fd1740ff80c13526874a7113 Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestMinimumBasicScenario-1042596127-project Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 could not be found. Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'c0b96f3d-c4fc-4125-9517-4c7da26eeaf7'} Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 could not be found. Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 could not be found. Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:05:33.231594 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:05:33.236950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:05:33.236950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:05:33.236950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:05:33.236950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:05:33.236950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:05:33.236950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 could not be found. Sep 06 12:05:33.236950 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:05:33.236950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ebc08174-ef08-40ff-a928-112d2396858a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Returning 404 to user: Instance c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:05:33.236950 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ebc08174-ef08-40ff-a928-112d2396858a tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7" status: 404 len: 111 microversion: 2.1 time: 0.037225 Sep 06 12:05:33.236950 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3607/7251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:05:33 2022] GET /compute/v2.1/servers/c0b96f3d-c4fc-4125-9517-4c7da26eeaf7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:05:33.243718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ff52b55f-617a-4153-92aa-a0b3f0118c02 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] Calling method '.version_select at 0x7f90f8e06c10>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:33.333044 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ff52b55f-617a-4153-92aa-a0b3f0118c02 tempest-TestMinimumBasicScenario-1042596127 tempest-TestMinimumBasicScenario-1042596127-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-824286637" status: 202 len: 0 microversion: 2.1 time: 0.094710 Sep 06 12:05:33.333762 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3645/7252] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 12:05:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-824286637 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:05:45.531149 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:05:45.531877 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 12:05:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Sep 06 12:05:45.533257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:45.534008 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:45.706659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f5d49bd2-5067-4149-9c09-93a1ce14bd0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'create', calling method: .version_select at 0x7f90f3107b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1480304786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABBNKR99ASY2uGgmn0s1cCtFRv/9LmvGswoRgocqDvQM0BarbnRaztNUwXOJ0skwHJZ51+RR0uKOaX8bbr1XVCff4hy/Ye3hFFbgKblQ4OlSvsD+CZKtif55SG2zGBn8g=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:05:45.723153 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f5d49bd2-5067-4149-9c09-93a1ce14bd0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:05:45.729597 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-f5d49bd2-5067-4149-9c09-93a1ce14bd0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for user 38e0c4e314274ad0bbdc4125638b0916 and project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:05:45.836699 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f5d49bd2-5067-4149-9c09-93a1ce14bd0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.311334 Sep 06 12:05:45.837531 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3608/7253] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 12:05:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:55.685844 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 06 12:05:55.686812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:55.688694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:55.694276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-994745848", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "49be9e98-7576-4709-80f6-67eb9f6eb348"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1480304786", "security_groups": [{"name": "tempest-secgroup-smoke-72572772"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:05:55.824920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] validate_networks() for [('49be9e98-7576-4709-80f6-67eb9f6eb348', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:05:56.434662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:05:56.436039 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:05:56.436981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:05:56.437782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:05:56.438565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:05:56.449963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:56.451538 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:56.452249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:56.453258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:56.453968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:56.454662 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:56.479054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:05:56.485896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for user 38e0c4e314274ad0bbdc4125638b0916 and project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:05:56.504431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:05:56.507869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:05:56.633101 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0c700ddc-6b0d-42b3-9a77-bec1df626fa5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.949961 Sep 06 12:05:56.633867 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3646/7254] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 12:05:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:05:56.644205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=4 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:56.648219 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:56.649386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6b3fd1eb-a08a-4bb7-83df-2fd08a2a89e0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:56.650226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6b3fd1eb-a08a-4bb7-83df-2fd08a2a89e0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:56.714867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6b3fd1eb-a08a-4bb7-83df-2fd08a2a89e0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:05:56.725150 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6b3fd1eb-a08a-4bb7-83df-2fd08a2a89e0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1266 microversion: 2.1 time: 0.082748 Sep 06 12:05:56.725810 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3609/7255] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:05:56 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:05:57.755848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7869b90f-90be-4492-92ca-54ead5c107ed tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:57.756535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7869b90f-90be-4492-92ca-54ead5c107ed tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:57.821625 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7869b90f-90be-4492-92ca-54ead5c107ed tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:05:57.829652 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7869b90f-90be-4492-92ca-54ead5c107ed tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1266 microversion: 2.1 time: 0.078765 Sep 06 12:05:57.830254 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3647/7256] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:05:57 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:05:58.854360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fe8a857d-a98c-4bc1-8451-e8f94ec906ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:58.855181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fe8a857d-a98c-4bc1-8451-e8f94ec906ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:58.870623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8a857d-a98c-4bc1-8451-e8f94ec906ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:58.871178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8a857d-a98c-4bc1-8451-e8f94ec906ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:58.871630 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8a857d-a98c-4bc1-8451-e8f94ec906ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:58.872389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8a857d-a98c-4bc1-8451-e8f94ec906ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:58.872895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8a857d-a98c-4bc1-8451-e8f94ec906ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:58.873342 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fe8a857d-a98c-4bc1-8451-e8f94ec906ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:58.951588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fe8a857d-a98c-4bc1-8451-e8f94ec906ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:05:58.959642 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fe8a857d-a98c-4bc1-8451-e8f94ec906ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1318 microversion: 2.1 time: 0.111045 Sep 06 12:05:58.966167 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3610/7257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:05:58 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1318 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:05:59.996714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-72a180ba-afe4-4c86-bc47-d54cd28ef88f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:59.998189 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-72a180ba-afe4-4c86-bc47-d54cd28ef88f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:00.008505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72a180ba-afe4-4c86-bc47-d54cd28ef88f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:00.009541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72a180ba-afe4-4c86-bc47-d54cd28ef88f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:00.010571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72a180ba-afe4-4c86-bc47-d54cd28ef88f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:00.012350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72a180ba-afe4-4c86-bc47-d54cd28ef88f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:00.013965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72a180ba-afe4-4c86-bc47-d54cd28ef88f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:00.015350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-72a180ba-afe4-4c86-bc47-d54cd28ef88f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:00.177237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-72a180ba-afe4-4c86-bc47-d54cd28ef88f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:00.187927 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-72a180ba-afe4-4c86-bc47-d54cd28ef88f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1390 microversion: 2.1 time: 0.195257 Sep 06 12:06:00.204190 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3648/7258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:05:59 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1390 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:01.066853 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9bb99234-513f-4657-824b-7c15e31faa2d req-e5ecab72-77ac-4668-a43d-5b532dd38316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea40f801-8f2c-4309-8001-cb313a7c9e14", "tag": "0058afe7-678a-4025-8ac9-5663fb385779"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:06:01.079130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9bb99234-513f-4657-824b-7c15e31faa2d req-e5ecab72-77ac-4668-a43d-5b532dd38316 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:01.080004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9bb99234-513f-4657-824b-7c15e31faa2d req-e5ecab72-77ac-4668-a43d-5b532dd38316 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:01.080456 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9bb99234-513f-4657-824b-7c15e31faa2d req-e5ecab72-77ac-4668-a43d-5b532dd38316 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:01.092237 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9bb99234-513f-4657-824b-7c15e31faa2d req-e5ecab72-77ac-4668-a43d-5b532dd38316 service nova] Creating event network-changed:0058afe7-678a-4025-8ac9-5663fb385779 for instance ea40f801-8f2c-4309-8001-cb313a7c9e14 on nch1-master-1 Sep 06 12:06:01.097632 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9bb99234-513f-4657-824b-7c15e31faa2d req-e5ecab72-77ac-4668-a43d-5b532dd38316 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034445 Sep 06 12:06:01.098427 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3611/7259] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:01.221727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e95e6373-a1cd-42f5-9c0d-383de29225fe tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:01.222290 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e95e6373-a1cd-42f5-9c0d-383de29225fe tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:01.230069 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e95e6373-a1cd-42f5-9c0d-383de29225fe tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:01.230584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e95e6373-a1cd-42f5-9c0d-383de29225fe tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:01.231075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e95e6373-a1cd-42f5-9c0d-383de29225fe tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:01.231788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e95e6373-a1cd-42f5-9c0d-383de29225fe tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:01.232292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e95e6373-a1cd-42f5-9c0d-383de29225fe tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:01.232743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e95e6373-a1cd-42f5-9c0d-383de29225fe tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:01.378098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e95e6373-a1cd-42f5-9c0d-383de29225fe tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:01.386250 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e95e6373-a1cd-42f5-9c0d-383de29225fe tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1390 microversion: 2.1 time: 0.168519 Sep 06 12:06:01.386833 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3649/7260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:01 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:02.411443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-47673563-4f72-4dcb-8f06-1980a0f965de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:02.412155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-47673563-4f72-4dcb-8f06-1980a0f965de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:02.418431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47673563-4f72-4dcb-8f06-1980a0f965de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:02.418921 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47673563-4f72-4dcb-8f06-1980a0f965de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:02.419469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47673563-4f72-4dcb-8f06-1980a0f965de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:02.420293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47673563-4f72-4dcb-8f06-1980a0f965de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:02.420763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47673563-4f72-4dcb-8f06-1980a0f965de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:02.421196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47673563-4f72-4dcb-8f06-1980a0f965de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:02.563705 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-47673563-4f72-4dcb-8f06-1980a0f965de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:02.572042 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-47673563-4f72-4dcb-8f06-1980a0f965de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1390 microversion: 2.1 time: 0.165906 Sep 06 12:06:02.572635 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3612/7261] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:02 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:03.596733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-89559fe4-6aa7-4401-9136-233ac92bfada tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:03.597518 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-89559fe4-6aa7-4401-9136-233ac92bfada tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:03.612437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89559fe4-6aa7-4401-9136-233ac92bfada tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:03.612949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89559fe4-6aa7-4401-9136-233ac92bfada tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:03.613443 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89559fe4-6aa7-4401-9136-233ac92bfada tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:03.614172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89559fe4-6aa7-4401-9136-233ac92bfada tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:03.614649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89559fe4-6aa7-4401-9136-233ac92bfada tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:03.615132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-89559fe4-6aa7-4401-9136-233ac92bfada tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:03.761372 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-89559fe4-6aa7-4401-9136-233ac92bfada tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:03.769567 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-89559fe4-6aa7-4401-9136-233ac92bfada tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1390 microversion: 2.1 time: 0.176896 Sep 06 12:06:03.771560 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3650/7262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:03 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:04.793228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-99b2600a-4932-4956-846c-faf1ef779ec1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:04.794025 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-99b2600a-4932-4956-846c-faf1ef779ec1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:04.802271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99b2600a-4932-4956-846c-faf1ef779ec1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:04.802774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99b2600a-4932-4956-846c-faf1ef779ec1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:04.803332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99b2600a-4932-4956-846c-faf1ef779ec1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:04.804314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99b2600a-4932-4956-846c-faf1ef779ec1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:04.804824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99b2600a-4932-4956-846c-faf1ef779ec1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:04.805275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-99b2600a-4932-4956-846c-faf1ef779ec1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:04.956321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-99b2600a-4932-4956-846c-faf1ef779ec1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:04.965672 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-99b2600a-4932-4956-846c-faf1ef779ec1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1390 microversion: 2.1 time: 0.176276 Sep 06 12:06:04.966524 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3613/7263] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:04 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:05.989955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c03255c-7156-4ddb-8231-1c6834ce902e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:05.990635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4c03255c-7156-4ddb-8231-1c6834ce902e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:05.997949 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c03255c-7156-4ddb-8231-1c6834ce902e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:05.998411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c03255c-7156-4ddb-8231-1c6834ce902e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:05.998939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c03255c-7156-4ddb-8231-1c6834ce902e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:06.000345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c03255c-7156-4ddb-8231-1c6834ce902e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:06.000573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c03255c-7156-4ddb-8231-1c6834ce902e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:06.001064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c03255c-7156-4ddb-8231-1c6834ce902e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:06.145247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4c03255c-7156-4ddb-8231-1c6834ce902e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:06.157939 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4c03255c-7156-4ddb-8231-1c6834ce902e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1390 microversion: 2.1 time: 0.171857 Sep 06 12:06:06.158680 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3651/7264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:05 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:06.208333 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-6c64e334-6d30-4e0f-bcce-acd654290cd5 req-9d72f6e4-e9e2-497f-aebc-9411f1585aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea40f801-8f2c-4309-8001-cb313a7c9e14", "name": "network-vif-plugged", "status": "completed", "tag": "0058afe7-678a-4025-8ac9-5663fb385779"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:06:06.217063 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6c64e334-6d30-4e0f-bcce-acd654290cd5 req-9d72f6e4-e9e2-497f-aebc-9411f1585aec service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:06.217558 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6c64e334-6d30-4e0f-bcce-acd654290cd5 req-9d72f6e4-e9e2-497f-aebc-9411f1585aec service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:06.218002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-6c64e334-6d30-4e0f-bcce-acd654290cd5 req-9d72f6e4-e9e2-497f-aebc-9411f1585aec service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:06.229864 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-6c64e334-6d30-4e0f-bcce-acd654290cd5 req-9d72f6e4-e9e2-497f-aebc-9411f1585aec service nova] Creating event network-vif-plugged:0058afe7-678a-4025-8ac9-5663fb385779 for instance ea40f801-8f2c-4309-8001-cb313a7c9e14 on nch1-master-1 Sep 06 12:06:06.235209 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-6c64e334-6d30-4e0f-bcce-acd654290cd5 req-9d72f6e4-e9e2-497f-aebc-9411f1585aec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093553 Sep 06 12:06:06.235816 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3614/7265] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:07.180617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fe102e2c-3505-4381-bf24-d641ce5b8a6f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:07.181153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fe102e2c-3505-4381-bf24-d641ce5b8a6f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:07.183114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:07.189003 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe102e2c-3505-4381-bf24-d641ce5b8a6f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:07.189515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe102e2c-3505-4381-bf24-d641ce5b8a6f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:07.189975 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe102e2c-3505-4381-bf24-d641ce5b8a6f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:07.190704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe102e2c-3505-4381-bf24-d641ce5b8a6f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:07.191340 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe102e2c-3505-4381-bf24-d641ce5b8a6f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:07.195198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fe102e2c-3505-4381-bf24-d641ce5b8a6f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:07.332872 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fe102e2c-3505-4381-bf24-d641ce5b8a6f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:07.341443 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fe102e2c-3505-4381-bf24-d641ce5b8a6f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1390 microversion: 2.1 time: 0.164888 Sep 06 12:06:07.349993 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3652/7266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:07 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:08.362664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:08.368332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2830c1b4-126e-4c08-af2c-db35810b3164 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:08.374118 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2830c1b4-126e-4c08-af2c-db35810b3164 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:08.375729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2830c1b4-126e-4c08-af2c-db35810b3164 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:08.376228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2830c1b4-126e-4c08-af2c-db35810b3164 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:08.376674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2830c1b4-126e-4c08-af2c-db35810b3164 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:08.377913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2830c1b4-126e-4c08-af2c-db35810b3164 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:08.378386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2830c1b4-126e-4c08-af2c-db35810b3164 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:08.378824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2830c1b4-126e-4c08-af2c-db35810b3164 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:08.538182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2830c1b4-126e-4c08-af2c-db35810b3164 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:08.538182 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2830c1b4-126e-4c08-af2c-db35810b3164 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1562 microversion: 2.1 time: 0.176240 Sep 06 12:06:08.538498 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3615/7267] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:08 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1562 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:08.561058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-17ffa3d7-c571-4d64-8595-2cdc6214c800 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:08.561695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-17ffa3d7-c571-4d64-8595-2cdc6214c800 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:08.563751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:08.570714 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17ffa3d7-c571-4d64-8595-2cdc6214c800 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:08.571256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17ffa3d7-c571-4d64-8595-2cdc6214c800 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:08.571725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17ffa3d7-c571-4d64-8595-2cdc6214c800 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:08.572449 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17ffa3d7-c571-4d64-8595-2cdc6214c800 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:08.572930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17ffa3d7-c571-4d64-8595-2cdc6214c800 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:08.573381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-17ffa3d7-c571-4d64-8595-2cdc6214c800 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:08.713441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-17ffa3d7-c571-4d64-8595-2cdc6214c800 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:08.722379 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-17ffa3d7-c571-4d64-8595-2cdc6214c800 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1562 microversion: 2.1 time: 0.165177 Sep 06 12:06:08.724464 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3653/7268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:08 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:10.809799 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3a01d163-f9fa-4292-8986-761b907da486 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:10.810422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3a01d163-f9fa-4292-8986-761b907da486 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:10.819712 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a01d163-f9fa-4292-8986-761b907da486 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:10.820776 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a01d163-f9fa-4292-8986-761b907da486 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:10.821521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a01d163-f9fa-4292-8986-761b907da486 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:10.822450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a01d163-f9fa-4292-8986-761b907da486 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:10.823255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a01d163-f9fa-4292-8986-761b907da486 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:10.823929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3a01d163-f9fa-4292-8986-761b907da486 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:10.824099 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-3c93b58b-5f63-4ae8-be7e-d5e0ef9510a8 req-c9c0df44-0606-465d-a14f-24407df46d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea40f801-8f2c-4309-8001-cb313a7c9e14", "tag": "0058afe7-678a-4025-8ac9-5663fb385779"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:06:10.838480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3c93b58b-5f63-4ae8-be7e-d5e0ef9510a8 req-c9c0df44-0606-465d-a14f-24407df46d44 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:10.839121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3c93b58b-5f63-4ae8-be7e-d5e0ef9510a8 req-c9c0df44-0606-465d-a14f-24407df46d44 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:10.839680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3c93b58b-5f63-4ae8-be7e-d5e0ef9510a8 req-c9c0df44-0606-465d-a14f-24407df46d44 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:10.854420 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-3c93b58b-5f63-4ae8-be7e-d5e0ef9510a8 req-c9c0df44-0606-465d-a14f-24407df46d44 service nova] Creating event network-changed:0058afe7-678a-4025-8ac9-5663fb385779 for instance ea40f801-8f2c-4309-8001-cb313a7c9e14 on nch1-master-1 Sep 06 12:06:10.862526 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-3c93b58b-5f63-4ae8-be7e-d5e0ef9510a8 req-c9c0df44-0606-465d-a14f-24407df46d44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045064 Sep 06 12:06:10.863731 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3654/7269] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:06:11.027867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3a01d163-f9fa-4292-8986-761b907da486 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:11.045867 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3a01d163-f9fa-4292-8986-761b907da486 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1562 microversion: 2.1 time: 0.239772 Sep 06 12:06:11.056174 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3616/7270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:10 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1562 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:32.369310 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:32.370096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=40 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:32.374386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bfb8466d-bc69-412c-91c7-9c08adf90532 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:06:32.376711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bfb8466d-bc69-412c-91c7-9c08adf90532 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:32.382987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfb8466d-bc69-412c-91c7-9c08adf90532 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:32.385513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfb8466d-bc69-412c-91c7-9c08adf90532 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:32.385513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfb8466d-bc69-412c-91c7-9c08adf90532 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:32.385513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfb8466d-bc69-412c-91c7-9c08adf90532 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:32.385513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfb8466d-bc69-412c-91c7-9c08adf90532 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:32.385513 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bfb8466d-bc69-412c-91c7-9c08adf90532 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:32.439052 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bfb8466d-bc69-412c-91c7-9c08adf90532 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14/action" status: 200 len: 24560 microversion: 2.1 time: 0.071726 Sep 06 12:06:32.439735 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3655/7271] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:06:32 2022] POST /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14/action => generated 24560 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:06:43.458135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b9427c3-00fd-4fe5-93eb-77c12d40e9a9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:06:43.458786 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2b9427c3-00fd-4fe5-93eb-77c12d40e9a9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:43.460930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=18 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:43.466145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=34 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:43.467200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b9427c3-00fd-4fe5-93eb-77c12d40e9a9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:43.467697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b9427c3-00fd-4fe5-93eb-77c12d40e9a9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:43.468144 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b9427c3-00fd-4fe5-93eb-77c12d40e9a9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:43.468847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b9427c3-00fd-4fe5-93eb-77c12d40e9a9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:43.469309 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b9427c3-00fd-4fe5-93eb-77c12d40e9a9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:43.469745 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b9427c3-00fd-4fe5-93eb-77c12d40e9a9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:43.656063 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b9427c3-00fd-4fe5-93eb-77c12d40e9a9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14/action" status: 202 len: 0 microversion: 2.1 time: 0.202034 Sep 06 12:06:43.656737 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3617/7272] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:06:43 2022] POST /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:06:43.668178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e4aa88cd-cd39-48b4-bffb-4a3eb2b2f560 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:43.668178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e4aa88cd-cd39-48b4-bffb-4a3eb2b2f560 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:43.675584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4aa88cd-cd39-48b4-bffb-4a3eb2b2f560 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:43.676089 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4aa88cd-cd39-48b4-bffb-4a3eb2b2f560 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:43.676546 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4aa88cd-cd39-48b4-bffb-4a3eb2b2f560 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:43.677264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4aa88cd-cd39-48b4-bffb-4a3eb2b2f560 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:43.677888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4aa88cd-cd39-48b4-bffb-4a3eb2b2f560 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:43.678322 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e4aa88cd-cd39-48b4-bffb-4a3eb2b2f560 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:43.820798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e4aa88cd-cd39-48b4-bffb-4a3eb2b2f560 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:43.828378 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e4aa88cd-cd39-48b4-bffb-4a3eb2b2f560 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1686 microversion: 2.1 time: 0.166890 Sep 06 12:06:43.829097 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3656/7273] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:43 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:06:44.854430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-09f9543d-e8b1-4804-ab2f-9d5984560f6b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:44.855311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-09f9543d-e8b1-4804-ab2f-9d5984560f6b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:44.861386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09f9543d-e8b1-4804-ab2f-9d5984560f6b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:44.861881 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09f9543d-e8b1-4804-ab2f-9d5984560f6b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:44.862330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09f9543d-e8b1-4804-ab2f-9d5984560f6b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:44.863056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09f9543d-e8b1-4804-ab2f-9d5984560f6b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:44.863528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09f9543d-e8b1-4804-ab2f-9d5984560f6b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:44.863962 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-09f9543d-e8b1-4804-ab2f-9d5984560f6b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:44.999281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-09f9543d-e8b1-4804-ab2f-9d5984560f6b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:45.007416 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-09f9543d-e8b1-4804-ab2f-9d5984560f6b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1666 microversion: 2.1 time: 0.158232 Sep 06 12:06:45.008038 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3618/7274] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:44 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:46.107852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1227620d-1fc9-4780-a013-3c93f44bb50a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:06:46.110098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1227620d-1fc9-4780-a013-3c93f44bb50a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:46.117899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1227620d-1fc9-4780-a013-3c93f44bb50a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:46.118406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1227620d-1fc9-4780-a013-3c93f44bb50a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:46.118863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1227620d-1fc9-4780-a013-3c93f44bb50a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:46.119630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1227620d-1fc9-4780-a013-3c93f44bb50a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:46.120107 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1227620d-1fc9-4780-a013-3c93f44bb50a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:46.120554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1227620d-1fc9-4780-a013-3c93f44bb50a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:46.172892 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1227620d-1fc9-4780-a013-3c93f44bb50a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14/action" status: 200 len: 32630 microversion: 2.1 time: 0.068723 Sep 06 12:06:46.172892 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3657/7275] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:06:46 2022] POST /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14/action => generated 32630 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:06:46.184478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3ee31d24-fe6d-4384-9cbe-371eaf7a3072 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:06:46.185041 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3ee31d24-fe6d-4384-9cbe-371eaf7a3072 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:46.191897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ee31d24-fe6d-4384-9cbe-371eaf7a3072 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:46.192383 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ee31d24-fe6d-4384-9cbe-371eaf7a3072 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:46.192826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ee31d24-fe6d-4384-9cbe-371eaf7a3072 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:46.193780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ee31d24-fe6d-4384-9cbe-371eaf7a3072 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:46.194235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ee31d24-fe6d-4384-9cbe-371eaf7a3072 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:46.194665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3ee31d24-fe6d-4384-9cbe-371eaf7a3072 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:46.363424 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3ee31d24-fe6d-4384-9cbe-371eaf7a3072 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14/action" status: 202 len: 0 microversion: 2.1 time: 0.182595 Sep 06 12:06:46.364088 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3619/7276] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:06:46 2022] POST /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:06:46.373267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-20d9d3c9-8a82-4413-a3c1-f85366f79bd2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:46.374118 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-20d9d3c9-8a82-4413-a3c1-f85366f79bd2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:46.382157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20d9d3c9-8a82-4413-a3c1-f85366f79bd2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:46.382666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20d9d3c9-8a82-4413-a3c1-f85366f79bd2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:46.383168 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20d9d3c9-8a82-4413-a3c1-f85366f79bd2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:46.383905 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20d9d3c9-8a82-4413-a3c1-f85366f79bd2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:46.384389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20d9d3c9-8a82-4413-a3c1-f85366f79bd2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:46.384846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20d9d3c9-8a82-4413-a3c1-f85366f79bd2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:46.523642 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-20d9d3c9-8a82-4413-a3c1-f85366f79bd2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:46.532306 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-20d9d3c9-8a82-4413-a3c1-f85366f79bd2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1673 microversion: 2.1 time: 0.163468 Sep 06 12:06:46.532880 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3658/7277] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:46 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:47.557604 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-461f0760-e634-4071-b2af-6f896c079591 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:47.558304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-461f0760-e634-4071-b2af-6f896c079591 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:47.565091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-461f0760-e634-4071-b2af-6f896c079591 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:47.565575 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-461f0760-e634-4071-b2af-6f896c079591 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:47.566014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-461f0760-e634-4071-b2af-6f896c079591 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:47.566706 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-461f0760-e634-4071-b2af-6f896c079591 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:47.567199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-461f0760-e634-4071-b2af-6f896c079591 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:47.567628 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-461f0760-e634-4071-b2af-6f896c079591 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:47.702094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-461f0760-e634-4071-b2af-6f896c079591 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:47.709876 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-461f0760-e634-4071-b2af-6f896c079591 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1681 microversion: 2.1 time: 0.157434 Sep 06 12:06:47.710484 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3620/7278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:47 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:47.807330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-548bfb29-556b-4d9d-8a90-1f9d2a5f7cd7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:06:47.810388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-548bfb29-556b-4d9d-8a90-1f9d2a5f7cd7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:47.818673 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-548bfb29-556b-4d9d-8a90-1f9d2a5f7cd7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:47.819216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-548bfb29-556b-4d9d-8a90-1f9d2a5f7cd7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:47.819680 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-548bfb29-556b-4d9d-8a90-1f9d2a5f7cd7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:47.820394 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-548bfb29-556b-4d9d-8a90-1f9d2a5f7cd7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:47.820866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-548bfb29-556b-4d9d-8a90-1f9d2a5f7cd7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:47.821317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-548bfb29-556b-4d9d-8a90-1f9d2a5f7cd7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:47.870456 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-548bfb29-556b-4d9d-8a90-1f9d2a5f7cd7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14/action" status: 200 len: 38439 microversion: 2.1 time: 0.066943 Sep 06 12:06:47.871144 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3659/7279] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:06:47 2022] POST /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14/action => generated 38439 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:06:49.278058 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d38f7d75-9bc3-4c1e-a621-38985d859a09 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:49.278595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d38f7d75-9bc3-4c1e-a621-38985d859a09 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:49.279924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-0563a793-9dca-497c-a6f8-1cf0d97bddd1 req-e34ad9b1-3441-4008-8df9-50089f138cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea40f801-8f2c-4309-8001-cb313a7c9e14", "tag": "0058afe7-678a-4025-8ac9-5663fb385779"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:06:49.284891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d38f7d75-9bc3-4c1e-a621-38985d859a09 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:49.285435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d38f7d75-9bc3-4c1e-a621-38985d859a09 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:49.285912 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d38f7d75-9bc3-4c1e-a621-38985d859a09 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:49.286590 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d38f7d75-9bc3-4c1e-a621-38985d859a09 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:49.287081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d38f7d75-9bc3-4c1e-a621-38985d859a09 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:49.287773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d38f7d75-9bc3-4c1e-a621-38985d859a09 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:49.291249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0563a793-9dca-497c-a6f8-1cf0d97bddd1 req-e34ad9b1-3441-4008-8df9-50089f138cbe service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:49.291842 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0563a793-9dca-497c-a6f8-1cf0d97bddd1 req-e34ad9b1-3441-4008-8df9-50089f138cbe service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:49.292297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0563a793-9dca-497c-a6f8-1cf0d97bddd1 req-e34ad9b1-3441-4008-8df9-50089f138cbe service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:49.305600 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-0563a793-9dca-497c-a6f8-1cf0d97bddd1 req-e34ad9b1-3441-4008-8df9-50089f138cbe service nova] Creating event network-changed:0058afe7-678a-4025-8ac9-5663fb385779 for instance ea40f801-8f2c-4309-8001-cb313a7c9e14 on nch1-master-1 Sep 06 12:06:49.312133 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-0563a793-9dca-497c-a6f8-1cf0d97bddd1 req-e34ad9b1-3441-4008-8df9-50089f138cbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036633 Sep 06 12:06:49.313694 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3660/7280] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:06:49.317616 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d38f7d75-9bc3-4c1e-a621-38985d859a09 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:06:49.640593 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d38f7d75-9bc3-4c1e-a621-38985d859a09 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 204 len: 0 microversion: 2.1 time: 0.367615 Sep 06 12:06:49.641199 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3621/7281] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 12:06:49 2022] DELETE /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:06:49.650639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6cc4342b-9f92-42ac-a2c0-123af4f97217 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:49.653716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6cc4342b-9f92-42ac-a2c0-123af4f97217 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:49.657873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cc4342b-9f92-42ac-a2c0-123af4f97217 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:49.658389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cc4342b-9f92-42ac-a2c0-123af4f97217 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:49.658857 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cc4342b-9f92-42ac-a2c0-123af4f97217 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:49.659618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cc4342b-9f92-42ac-a2c0-123af4f97217 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:49.660109 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cc4342b-9f92-42ac-a2c0-123af4f97217 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:49.660551 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6cc4342b-9f92-42ac-a2c0-123af4f97217 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:49.814929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6cc4342b-9f92-42ac-a2c0-123af4f97217 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:49.823107 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6cc4342b-9f92-42ac-a2c0-123af4f97217 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1687 microversion: 2.1 time: 0.177180 Sep 06 12:06:49.823716 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3661/7282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:49 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:50.849702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e2d33df-5d11-468f-a869-ca57649e7c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:50.851301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e2d33df-5d11-468f-a869-ca57649e7c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:50.858631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e2d33df-5d11-468f-a869-ca57649e7c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:50.859148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e2d33df-5d11-468f-a869-ca57649e7c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:50.859676 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e2d33df-5d11-468f-a869-ca57649e7c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:50.860394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e2d33df-5d11-468f-a869-ca57649e7c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:50.860944 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e2d33df-5d11-468f-a869-ca57649e7c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:50.861379 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e2d33df-5d11-468f-a869-ca57649e7c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:51.008331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7e2d33df-5d11-468f-a869-ca57649e7c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:51.017134 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e2d33df-5d11-468f-a869-ca57649e7c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1687 microversion: 2.1 time: 0.172102 Sep 06 12:06:51.017957 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3622/7283] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:50 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:51.653887 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-f80827e5-17d9-400b-9228-8db318fc4060 req-783e41d1-044b-4fa6-8783-be52108c27ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea40f801-8f2c-4309-8001-cb313a7c9e14", "name": "network-vif-deleted", "tag": "0058afe7-678a-4025-8ac9-5663fb385779"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:06:51.664907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f80827e5-17d9-400b-9228-8db318fc4060 req-783e41d1-044b-4fa6-8783-be52108c27ea service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:51.667082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f80827e5-17d9-400b-9228-8db318fc4060 req-783e41d1-044b-4fa6-8783-be52108c27ea service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:51.667082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-f80827e5-17d9-400b-9228-8db318fc4060 req-783e41d1-044b-4fa6-8783-be52108c27ea service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:51.679959 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-f80827e5-17d9-400b-9228-8db318fc4060 req-783e41d1-044b-4fa6-8783-be52108c27ea service nova] Creating event network-vif-deleted:0058afe7-678a-4025-8ac9-5663fb385779 for instance ea40f801-8f2c-4309-8001-cb313a7c9e14 on nch1-master-1 Sep 06 12:06:51.686657 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-f80827e5-17d9-400b-9228-8db318fc4060 req-783e41d1-044b-4fa6-8783-be52108c27ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037154 Sep 06 12:06:51.687637 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3662/7284] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:52.044040 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:52.048092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:52.052432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:52.052917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:52.053581 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:52.054312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:52.054781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:52.055305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:52.093239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:52.093733 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:52.094236 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:52.094808 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lazy-loading 'fault' on Instance uuid ea40f801-8f2c-4309-8001-cb313a7c9e14 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:06:52.139926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:06:52.147881 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ab1aa10f-af61-410f-83b7-76f6180ad406 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 200 len: 1356 microversion: 2.1 time: 0.108746 Sep 06 12:06:52.148592 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3623/7285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:52 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:06:53.172432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2ec85859-433e-4746-b04c-284d9ca09f51 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:53.173090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2ec85859-433e-4746-b04c-284d9ca09f51 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: ea40f801-8f2c-4309-8001-cb313a7c9e14] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:53.180376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ec85859-433e-4746-b04c-284d9ca09f51 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:53.180889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ec85859-433e-4746-b04c-284d9ca09f51 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:53.181365 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ec85859-433e-4746-b04c-284d9ca09f51 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:53.182096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ec85859-433e-4746-b04c-284d9ca09f51 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:53.182577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ec85859-433e-4746-b04c-284d9ca09f51 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:53.183054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2ec85859-433e-4746-b04c-284d9ca09f51 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:53.199821 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-2ec85859-433e-4746-b04c-284d9ca09f51 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] HTTP exception thrown: Instance ea40f801-8f2c-4309-8001-cb313a7c9e14 could not be found. Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2ec85859-433e-4746-b04c-284d9ca09f51 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Request method failure captured: Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 HTTP/1.1 Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzeYVfZJz-bvpRJpbNxoClgmmS38luZVJYnn1c4uHPDNGT6x9mu_OAgJT7SDXZyhhmmM8HWW0WfRoxBDThE9ODnuq3d1gSBx5-I2qdQNYW8FnNVfSLu7r3kZhvwwaUR1Z_VNwXCKdV70KfkyQVz432u5zXg1J26TiMa6aej16G2Ghw4 Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 36e1c59f75934cc38e904fa0dae0d587 Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36e1c59f75934cc38e904fa0dae0d587"}]}] Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 36e1c59f75934cc38e904fa0dae0d587 Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TestNetworkAdvancedServerOps-2051570988-project Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 38e0c4e314274ad0bbdc4125638b0916 Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2051570988-project Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance ea40f801-8f2c-4309-8001-cb313a7c9e14 could not be found. Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'ea40f801-8f2c-4309-8001-cb313a7c9e14'} Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea40f801-8f2c-4309-8001-cb313a7c9e14 could not be found. Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea40f801-8f2c-4309-8001-cb313a7c9e14 could not be found. Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:06:53.202530 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:06:53.209797 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:06:53.209797 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:06:53.209797 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:06:53.209797 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:06:53.209797 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:06:53.209797 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:06:53.209797 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea40f801-8f2c-4309-8001-cb313a7c9e14 could not be found. Sep 06 12:06:53.209797 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:06:53.209797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2ec85859-433e-4746-b04c-284d9ca09f51 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Returning 404 to user: Instance ea40f801-8f2c-4309-8001-cb313a7c9e14 could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:06:53.209797 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2ec85859-433e-4746-b04c-284d9ca09f51 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14" status: 404 len: 111 microversion: 2.1 time: 0.036255 Sep 06 12:06:53.209797 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3663/7286] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:06:53 2022] GET /compute/v2.1/servers/ea40f801-8f2c-4309-8001-cb313a7c9e14 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 12:06:57.026492 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-db8c8818-ab51-4cc2-aada-4cd7a85572b2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '.version_select at 0x7f90f94c0280>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:57.121615 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-db8c8818-ab51-4cc2-aada-4cd7a85572b2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1480304786" status: 202 len: 0 microversion: 2.1 time: 0.104401 Sep 06 12:06:57.122626 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3624/7287] 10.222.0.20 () {58 vars in 1284 bytes} [Tue Sep 6 12:06:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1480304786 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:06:57.152328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ecf6998b-7984-4e99-9fc9-df0b126816ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'create', calling method: .version_select at 0x7f90f3a1ec10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2130262149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfnGUtrWCGmObwqExg6tSxVy/GtA5cZzY3E1BV+xFUFFR4qiFTRteaK8F61cJ0hGjPw+vXqAyYxE+n5axUf6F1ceH5yBdymKOs+JV2chqVihztstz46sEVKYJq40bUXbg=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:06:57.170125 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ecf6998b-7984-4e99-9fc9-df0b126816ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:06:57.175665 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-ecf6998b-7984-4e99-9fc9-df0b126816ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for user 38e0c4e314274ad0bbdc4125638b0916 and project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:06:57.270090 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ecf6998b-7984-4e99-9fc9-df0b126816ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.122263 Sep 06 12:06:57.276115 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3664/7288] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 12:06:57 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:06.361836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:06.367311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1468390861", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "f102e9a9-9d9d-44b5-bf26-74b36464112e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2130262149", "security_groups": [{"name": "tempest-secgroup-smoke-1378400731"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:07:06.507100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] validate_networks() for [('f102e9a9-9d9d-44b5-bf26-74b36464112e', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:07:07.073344 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:07:07.079385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:07:07.079385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:07:07.079385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:07:07.079385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:07:07.085782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:07.086445 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:07.087182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:07.088218 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:07.088796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:07.089728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:07.113897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:07:07.119738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for user 38e0c4e314274ad0bbdc4125638b0916 and project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:07:07.134208 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:07:07.136952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:07:07.261007 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b376e147-c0e0-4ed3-8759-2b68fa8343da tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.901915 Sep 06 12:07:07.261867 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3625/7289] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 12:07:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:07:07.273417 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=36 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:07.274648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:07.275374 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:07.280609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-769c4d34-2d36-43e4-b5b1-5ce9af9f2403 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:07.281237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-769c4d34-2d36-43e4-b5b1-5ce9af9f2403 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:07.365021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-769c4d34-2d36-43e4-b5b1-5ce9af9f2403 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:07.378514 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-769c4d34-2d36-43e4-b5b1-5ce9af9f2403 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1267 microversion: 2.1 time: 0.106804 Sep 06 12:07:07.399473 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3665/7290] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:07 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1267 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:08.406049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6f7c51c3-efc9-4d56-8208-20fb9195d3ec tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:08.406662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6f7c51c3-efc9-4d56-8208-20fb9195d3ec tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:08.412762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f7c51c3-efc9-4d56-8208-20fb9195d3ec tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:08.413254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f7c51c3-efc9-4d56-8208-20fb9195d3ec tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:08.413699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f7c51c3-efc9-4d56-8208-20fb9195d3ec tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:08.414395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f7c51c3-efc9-4d56-8208-20fb9195d3ec tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:08.415125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f7c51c3-efc9-4d56-8208-20fb9195d3ec tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:08.415865 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6f7c51c3-efc9-4d56-8208-20fb9195d3ec tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:08.511031 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6f7c51c3-efc9-4d56-8208-20fb9195d3ec tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:08.523049 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6f7c51c3-efc9-4d56-8208-20fb9195d3ec tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1271 microversion: 2.1 time: 0.121608 Sep 06 12:07:08.523826 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3626/7291] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:08 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:09.553296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bf2cf104-4c71-4226-b7f7-5d2a0feca7ba tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:09.555300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bf2cf104-4c71-4226-b7f7-5d2a0feca7ba tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:09.563733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf2cf104-4c71-4226-b7f7-5d2a0feca7ba tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:09.564354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf2cf104-4c71-4226-b7f7-5d2a0feca7ba tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:09.566984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf2cf104-4c71-4226-b7f7-5d2a0feca7ba tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:09.566984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf2cf104-4c71-4226-b7f7-5d2a0feca7ba tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:09.566984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf2cf104-4c71-4226-b7f7-5d2a0feca7ba tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:09.566984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf2cf104-4c71-4226-b7f7-5d2a0feca7ba tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:09.648363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bf2cf104-4c71-4226-b7f7-5d2a0feca7ba tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:09.656989 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bf2cf104-4c71-4226-b7f7-5d2a0feca7ba tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1327 microversion: 2.1 time: 0.108050 Sep 06 12:07:09.657587 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3666/7292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:09 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:10.682004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-863e9597-ca1b-42da-a2fc-6023009741ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:10.682719 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-863e9597-ca1b-42da-a2fc-6023009741ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:10.689738 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-863e9597-ca1b-42da-a2fc-6023009741ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:10.690244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-863e9597-ca1b-42da-a2fc-6023009741ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:10.690731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-863e9597-ca1b-42da-a2fc-6023009741ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:10.691485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-863e9597-ca1b-42da-a2fc-6023009741ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:10.691958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-863e9597-ca1b-42da-a2fc-6023009741ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:10.692404 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-863e9597-ca1b-42da-a2fc-6023009741ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:10.838163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-863e9597-ca1b-42da-a2fc-6023009741ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:10.846823 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-863e9597-ca1b-42da-a2fc-6023009741ca tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1393 microversion: 2.1 time: 0.169023 Sep 06 12:07:10.847468 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3627/7293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:10 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:11.652282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-0c3d7241-e64c-4521-b95a-f21dddcd8dc3 req-564ac22f-ec2d-41c9-bb76-cca1151e4e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f01d977-56d4-464d-9259-99d997ad6d51", "tag": "65306e64-bd1f-4728-bbc9-d7e67c3fea20"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:07:11.665787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0c3d7241-e64c-4521-b95a-f21dddcd8dc3 req-564ac22f-ec2d-41c9-bb76-cca1151e4e28 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:11.665787 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0c3d7241-e64c-4521-b95a-f21dddcd8dc3 req-564ac22f-ec2d-41c9-bb76-cca1151e4e28 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:11.666171 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-0c3d7241-e64c-4521-b95a-f21dddcd8dc3 req-564ac22f-ec2d-41c9-bb76-cca1151e4e28 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:11.679825 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-0c3d7241-e64c-4521-b95a-f21dddcd8dc3 req-564ac22f-ec2d-41c9-bb76-cca1151e4e28 service nova] Creating event network-changed:65306e64-bd1f-4728-bbc9-d7e67c3fea20 for instance 8f01d977-56d4-464d-9259-99d997ad6d51 on nch1-master-1 Sep 06 12:07:11.685804 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-0c3d7241-e64c-4521-b95a-f21dddcd8dc3 req-564ac22f-ec2d-41c9-bb76-cca1151e4e28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037783 Sep 06 12:07:11.686893 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3667/7294] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:11.876242 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fc4b96c3-ca2f-4c88-a19d-7208ef01fd7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:11.877966 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fc4b96c3-ca2f-4c88-a19d-7208ef01fd7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:11.884533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc4b96c3-ca2f-4c88-a19d-7208ef01fd7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:11.885399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc4b96c3-ca2f-4c88-a19d-7208ef01fd7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:11.886035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc4b96c3-ca2f-4c88-a19d-7208ef01fd7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:11.886934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc4b96c3-ca2f-4c88-a19d-7208ef01fd7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:11.887804 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc4b96c3-ca2f-4c88-a19d-7208ef01fd7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:11.888688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fc4b96c3-ca2f-4c88-a19d-7208ef01fd7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:12.038641 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-fc4b96c3-ca2f-4c88-a19d-7208ef01fd7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:12.047145 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fc4b96c3-ca2f-4c88-a19d-7208ef01fd7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1393 microversion: 2.1 time: 0.176728 Sep 06 12:07:12.047739 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3628/7295] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:11 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:13.071822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e9a7e0ae-2eda-457a-8a2e-691bab11fd02 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:13.072543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e9a7e0ae-2eda-457a-8a2e-691bab11fd02 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:13.079666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9a7e0ae-2eda-457a-8a2e-691bab11fd02 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:13.080163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9a7e0ae-2eda-457a-8a2e-691bab11fd02 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:13.083535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9a7e0ae-2eda-457a-8a2e-691bab11fd02 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:13.083535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9a7e0ae-2eda-457a-8a2e-691bab11fd02 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:13.083535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9a7e0ae-2eda-457a-8a2e-691bab11fd02 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:13.083535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e9a7e0ae-2eda-457a-8a2e-691bab11fd02 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:13.220415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e9a7e0ae-2eda-457a-8a2e-691bab11fd02 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:13.228298 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e9a7e0ae-2eda-457a-8a2e-691bab11fd02 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1393 microversion: 2.1 time: 0.161914 Sep 06 12:07:13.228892 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3668/7296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:13 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:14.252002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4b8bdea4-8c2d-4fb3-961c-3b3d46532ef0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:14.252651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4b8bdea4-8c2d-4fb3-961c-3b3d46532ef0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:14.255578 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:14.260381 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b8bdea4-8c2d-4fb3-961c-3b3d46532ef0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:14.265187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b8bdea4-8c2d-4fb3-961c-3b3d46532ef0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:14.265187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b8bdea4-8c2d-4fb3-961c-3b3d46532ef0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:14.265187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b8bdea4-8c2d-4fb3-961c-3b3d46532ef0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:14.265187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b8bdea4-8c2d-4fb3-961c-3b3d46532ef0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:14.265187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4b8bdea4-8c2d-4fb3-961c-3b3d46532ef0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:14.399758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4b8bdea4-8c2d-4fb3-961c-3b3d46532ef0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:14.407604 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4b8bdea4-8c2d-4fb3-961c-3b3d46532ef0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1393 microversion: 2.1 time: 0.159624 Sep 06 12:07:14.408225 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3629/7297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:14 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:15.430844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-acf1e52d-3db5-4eb8-b491-fae09798843d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:15.431535 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-acf1e52d-3db5-4eb8-b491-fae09798843d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:15.438889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acf1e52d-3db5-4eb8-b491-fae09798843d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:15.439418 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acf1e52d-3db5-4eb8-b491-fae09798843d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:15.439877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acf1e52d-3db5-4eb8-b491-fae09798843d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:15.440581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acf1e52d-3db5-4eb8-b491-fae09798843d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:15.441058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acf1e52d-3db5-4eb8-b491-fae09798843d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:15.441501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-acf1e52d-3db5-4eb8-b491-fae09798843d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:15.578404 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-acf1e52d-3db5-4eb8-b491-fae09798843d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:15.586404 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-acf1e52d-3db5-4eb8-b491-fae09798843d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1393 microversion: 2.1 time: 0.159507 Sep 06 12:07:15.587033 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3669/7298] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:15 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:16.411279 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-8078cc3a-ad69-45ea-b1b4-111e26c52ed7 req-897185b2-2b39-4e20-9703-574d41348181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f01d977-56d4-464d-9259-99d997ad6d51", "name": "network-vif-plugged", "status": "completed", "tag": "65306e64-bd1f-4728-bbc9-d7e67c3fea20"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:07:16.424247 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8078cc3a-ad69-45ea-b1b4-111e26c52ed7 req-897185b2-2b39-4e20-9703-574d41348181 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:16.424744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8078cc3a-ad69-45ea-b1b4-111e26c52ed7 req-897185b2-2b39-4e20-9703-574d41348181 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:16.425190 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8078cc3a-ad69-45ea-b1b4-111e26c52ed7 req-897185b2-2b39-4e20-9703-574d41348181 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:16.439614 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-8078cc3a-ad69-45ea-b1b4-111e26c52ed7 req-897185b2-2b39-4e20-9703-574d41348181 service nova] Creating event network-vif-plugged:65306e64-bd1f-4728-bbc9-d7e67c3fea20 for instance 8f01d977-56d4-464d-9259-99d997ad6d51 on nch1-master-1 Sep 06 12:07:16.441797 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-8078cc3a-ad69-45ea-b1b4-111e26c52ed7 req-897185b2-2b39-4e20-9703-574d41348181 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034973 Sep 06 12:07:16.442392 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3630/7299] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:16.610158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4b4de91b-d2e6-4cdf-98fb-430b63eda814 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:16.610797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4b4de91b-d2e6-4cdf-98fb-430b63eda814 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:16.617566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b4de91b-d2e6-4cdf-98fb-430b63eda814 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:16.618073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b4de91b-d2e6-4cdf-98fb-430b63eda814 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:16.618536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b4de91b-d2e6-4cdf-98fb-430b63eda814 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:16.619289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b4de91b-d2e6-4cdf-98fb-430b63eda814 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:16.619772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b4de91b-d2e6-4cdf-98fb-430b63eda814 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:16.620226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4b4de91b-d2e6-4cdf-98fb-430b63eda814 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:16.753338 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4b4de91b-d2e6-4cdf-98fb-430b63eda814 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:16.761078 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4b4de91b-d2e6-4cdf-98fb-430b63eda814 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1393 microversion: 2.1 time: 0.155181 Sep 06 12:07:16.761666 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3670/7300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:16 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:17.782389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:17.783331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:17.788748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6c402ac6-a66d-4ecc-9124-7da6184fc1f0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:17.789479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6c402ac6-a66d-4ecc-9124-7da6184fc1f0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:17.796081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c402ac6-a66d-4ecc-9124-7da6184fc1f0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:17.796568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c402ac6-a66d-4ecc-9124-7da6184fc1f0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:17.797017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c402ac6-a66d-4ecc-9124-7da6184fc1f0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:17.797729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c402ac6-a66d-4ecc-9124-7da6184fc1f0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:17.798200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c402ac6-a66d-4ecc-9124-7da6184fc1f0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:17.798631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6c402ac6-a66d-4ecc-9124-7da6184fc1f0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:17.943204 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6c402ac6-a66d-4ecc-9124-7da6184fc1f0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:17.952633 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6c402ac6-a66d-4ecc-9124-7da6184fc1f0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1564 microversion: 2.1 time: 0.171191 Sep 06 12:07:17.953415 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3631/7301] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:17 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:17.978494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e99569a6-ac68-4b12-a88c-24f64d0720b0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:17.979180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e99569a6-ac68-4b12-a88c-24f64d0720b0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:17.981289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:17.988345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e99569a6-ac68-4b12-a88c-24f64d0720b0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:17.988891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e99569a6-ac68-4b12-a88c-24f64d0720b0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:17.989349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e99569a6-ac68-4b12-a88c-24f64d0720b0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:17.990081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e99569a6-ac68-4b12-a88c-24f64d0720b0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:17.990564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e99569a6-ac68-4b12-a88c-24f64d0720b0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:17.991046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e99569a6-ac68-4b12-a88c-24f64d0720b0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:18.131103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e99569a6-ac68-4b12-a88c-24f64d0720b0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:18.139769 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e99569a6-ac68-4b12-a88c-24f64d0720b0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1564 microversion: 2.1 time: 0.165569 Sep 06 12:07:18.140338 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3671/7302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:17 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:20.348021 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c2f2c203-1b2a-48d5-9b61-a7308dfa3a33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:20.348942 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c2f2c203-1b2a-48d5-9b61-a7308dfa3a33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:20.350632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-3b634f4e-c000-427f-b090-a0139257b38d req-47645f8c-defb-40be-881b-c65466459328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f01d977-56d4-464d-9259-99d997ad6d51", "tag": "65306e64-bd1f-4728-bbc9-d7e67c3fea20"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:07:20.356606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2f2c203-1b2a-48d5-9b61-a7308dfa3a33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:20.357866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2f2c203-1b2a-48d5-9b61-a7308dfa3a33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:20.358416 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2f2c203-1b2a-48d5-9b61-a7308dfa3a33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:20.359303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2f2c203-1b2a-48d5-9b61-a7308dfa3a33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:20.360066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2f2c203-1b2a-48d5-9b61-a7308dfa3a33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:20.360611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c2f2c203-1b2a-48d5-9b61-a7308dfa3a33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:20.363281 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3b634f4e-c000-427f-b090-a0139257b38d req-47645f8c-defb-40be-881b-c65466459328 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:20.363718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3b634f4e-c000-427f-b090-a0139257b38d req-47645f8c-defb-40be-881b-c65466459328 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:20.364174 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-3b634f4e-c000-427f-b090-a0139257b38d req-47645f8c-defb-40be-881b-c65466459328 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:20.377207 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-3b634f4e-c000-427f-b090-a0139257b38d req-47645f8c-defb-40be-881b-c65466459328 service nova] Creating event network-changed:65306e64-bd1f-4728-bbc9-d7e67c3fea20 for instance 8f01d977-56d4-464d-9259-99d997ad6d51 on nch1-master-1 Sep 06 12:07:20.384234 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-3b634f4e-c000-427f-b090-a0139257b38d req-47645f8c-defb-40be-881b-c65466459328 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037070 Sep 06 12:07:20.385193 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3672/7303] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:20.520554 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c2f2c203-1b2a-48d5-9b61-a7308dfa3a33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:20.529502 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c2f2c203-1b2a-48d5-9b61-a7308dfa3a33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1564 microversion: 2.1 time: 0.185242 Sep 06 12:07:20.531212 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3632/7304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:20 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:43.788684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4efe2b0c-3c78-4f9b-a74f-91fa466d5a85 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:07:43.791160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4efe2b0c-3c78-4f9b-a74f-91fa466d5a85 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:43.795194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=18 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:43.795911 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=34 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:43.801209 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4efe2b0c-3c78-4f9b-a74f-91fa466d5a85 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:43.802938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4efe2b0c-3c78-4f9b-a74f-91fa466d5a85 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:43.802938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4efe2b0c-3c78-4f9b-a74f-91fa466d5a85 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:43.802938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4efe2b0c-3c78-4f9b-a74f-91fa466d5a85 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:43.803328 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4efe2b0c-3c78-4f9b-a74f-91fa466d5a85 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:43.803776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4efe2b0c-3c78-4f9b-a74f-91fa466d5a85 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:43.858506 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4efe2b0c-3c78-4f9b-a74f-91fa466d5a85 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51/action" status: 200 len: 24572 microversion: 2.1 time: 0.074018 Sep 06 12:07:43.859954 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3673/7305] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:07:43 2022] POST /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51/action => generated 24572 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:07:50.185682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-df207712-7685-48d1-9b51-d116f59514e6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:07:50.188485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-df207712-7685-48d1-9b51-d116f59514e6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:50.191455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=7 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:50.192194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=40 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:50.197117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df207712-7685-48d1-9b51-d116f59514e6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:50.197742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df207712-7685-48d1-9b51-d116f59514e6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:50.198140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df207712-7685-48d1-9b51-d116f59514e6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:50.198843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df207712-7685-48d1-9b51-d116f59514e6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:50.199326 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df207712-7685-48d1-9b51-d116f59514e6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:50.199759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-df207712-7685-48d1-9b51-d116f59514e6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:50.363630 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-df207712-7685-48d1-9b51-d116f59514e6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51/action" status: 202 len: 0 microversion: 2.1 time: 0.181838 Sep 06 12:07:50.364294 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3633/7306] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:07:50 2022] POST /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:07:50.373608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-258e35a7-f2be-4516-b31c-2e1107f04451 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:50.374985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-258e35a7-f2be-4516-b31c-2e1107f04451 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:50.382124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-258e35a7-f2be-4516-b31c-2e1107f04451 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:50.384896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-258e35a7-f2be-4516-b31c-2e1107f04451 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:50.384896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-258e35a7-f2be-4516-b31c-2e1107f04451 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:50.384896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-258e35a7-f2be-4516-b31c-2e1107f04451 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:50.384896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-258e35a7-f2be-4516-b31c-2e1107f04451 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:50.384896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-258e35a7-f2be-4516-b31c-2e1107f04451 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:50.534749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-258e35a7-f2be-4516-b31c-2e1107f04451 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:50.542936 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-258e35a7-f2be-4516-b31c-2e1107f04451 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1675 microversion: 2.1 time: 0.174139 Sep 06 12:07:50.543542 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3674/7307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:50 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:51.569683 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ce95209d-0eef-4cd5-bcf9-dec4ed703ee9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:51.570394 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ce95209d-0eef-4cd5-bcf9-dec4ed703ee9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:51.576673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce95209d-0eef-4cd5-bcf9-dec4ed703ee9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:51.577165 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce95209d-0eef-4cd5-bcf9-dec4ed703ee9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:51.578222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce95209d-0eef-4cd5-bcf9-dec4ed703ee9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:51.578928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce95209d-0eef-4cd5-bcf9-dec4ed703ee9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:51.579427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce95209d-0eef-4cd5-bcf9-dec4ed703ee9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:51.579904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ce95209d-0eef-4cd5-bcf9-dec4ed703ee9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:51.720183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ce95209d-0eef-4cd5-bcf9-dec4ed703ee9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:51.728141 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ce95209d-0eef-4cd5-bcf9-dec4ed703ee9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1680 microversion: 2.1 time: 0.163857 Sep 06 12:07:51.728722 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3634/7308] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:51 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:52.752477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8f701885-0409-4555-9771-f6bcf2cb209a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:52.753114 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8f701885-0409-4555-9771-f6bcf2cb209a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:52.760026 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f701885-0409-4555-9771-f6bcf2cb209a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:52.760525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f701885-0409-4555-9771-f6bcf2cb209a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:52.760981 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f701885-0409-4555-9771-f6bcf2cb209a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:52.761689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f701885-0409-4555-9771-f6bcf2cb209a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:52.762160 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f701885-0409-4555-9771-f6bcf2cb209a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:52.762606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f701885-0409-4555-9771-f6bcf2cb209a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:52.896135 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8f701885-0409-4555-9771-f6bcf2cb209a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:52.904028 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8f701885-0409-4555-9771-f6bcf2cb209a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1680 microversion: 2.1 time: 0.156125 Sep 06 12:07:52.904601 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3675/7309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:52 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:53.927556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ed580b8c-5ebd-428e-8495-85c360cca15b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:53.928176 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ed580b8c-5ebd-428e-8495-85c360cca15b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:53.934957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed580b8c-5ebd-428e-8495-85c360cca15b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:53.935477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed580b8c-5ebd-428e-8495-85c360cca15b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:53.935918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed580b8c-5ebd-428e-8495-85c360cca15b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:53.937120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed580b8c-5ebd-428e-8495-85c360cca15b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:53.937582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed580b8c-5ebd-428e-8495-85c360cca15b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:53.938014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed580b8c-5ebd-428e-8495-85c360cca15b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:54.072156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ed580b8c-5ebd-428e-8495-85c360cca15b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:54.080669 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ed580b8c-5ebd-428e-8495-85c360cca15b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1680 microversion: 2.1 time: 0.157095 Sep 06 12:07:54.081240 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3635/7310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:53 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:55.104256 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2a32920d-796b-4f54-af2f-1e31c596bede tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:55.104883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2a32920d-796b-4f54-af2f-1e31c596bede tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:55.112156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a32920d-796b-4f54-af2f-1e31c596bede tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:55.112670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a32920d-796b-4f54-af2f-1e31c596bede tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:55.113096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a32920d-796b-4f54-af2f-1e31c596bede tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:55.113806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a32920d-796b-4f54-af2f-1e31c596bede tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:55.114279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a32920d-796b-4f54-af2f-1e31c596bede tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:55.114723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2a32920d-796b-4f54-af2f-1e31c596bede tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:55.250130 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2a32920d-796b-4f54-af2f-1e31c596bede tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:55.258166 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2a32920d-796b-4f54-af2f-1e31c596bede tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1680 microversion: 2.1 time: 0.157869 Sep 06 12:07:55.262584 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3676/7311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:55 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:07:56.282913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d5925372-3184-4fa4-ac8d-b9c566bd5aef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:56.283588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d5925372-3184-4fa4-ac8d-b9c566bd5aef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:56.290480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5925372-3184-4fa4-ac8d-b9c566bd5aef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:56.290981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5925372-3184-4fa4-ac8d-b9c566bd5aef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:56.291470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5925372-3184-4fa4-ac8d-b9c566bd5aef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:56.292178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5925372-3184-4fa4-ac8d-b9c566bd5aef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:56.292648 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5925372-3184-4fa4-ac8d-b9c566bd5aef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:56.293088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5925372-3184-4fa4-ac8d-b9c566bd5aef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:56.425441 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d5925372-3184-4fa4-ac8d-b9c566bd5aef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:56.433436 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d5925372-3184-4fa4-ac8d-b9c566bd5aef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1680 microversion: 2.1 time: 0.154998 Sep 06 12:07:56.436786 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3636/7312] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:56 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:57.457061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bf931a0a-78e7-4cbd-a05a-4f56080ada50 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:57.457697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bf931a0a-78e7-4cbd-a05a-4f56080ada50 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:57.464807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf931a0a-78e7-4cbd-a05a-4f56080ada50 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:57.465320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf931a0a-78e7-4cbd-a05a-4f56080ada50 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:57.465783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf931a0a-78e7-4cbd-a05a-4f56080ada50 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:57.466506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf931a0a-78e7-4cbd-a05a-4f56080ada50 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:57.466988 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf931a0a-78e7-4cbd-a05a-4f56080ada50 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:57.467464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf931a0a-78e7-4cbd-a05a-4f56080ada50 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:57.605879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bf931a0a-78e7-4cbd-a05a-4f56080ada50 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:57.614793 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bf931a0a-78e7-4cbd-a05a-4f56080ada50 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1680 microversion: 2.1 time: 0.161794 Sep 06 12:07:57.615396 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3677/7313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:57 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:58.638235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01b2bf0d-3367-409f-809e-103f1c468c5c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:58.638832 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-01b2bf0d-3367-409f-809e-103f1c468c5c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:58.645703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01b2bf0d-3367-409f-809e-103f1c468c5c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:58.646189 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01b2bf0d-3367-409f-809e-103f1c468c5c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:58.646634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01b2bf0d-3367-409f-809e-103f1c468c5c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:58.647351 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01b2bf0d-3367-409f-809e-103f1c468c5c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:58.647813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01b2bf0d-3367-409f-809e-103f1c468c5c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:58.648246 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01b2bf0d-3367-409f-809e-103f1c468c5c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:58.783140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-01b2bf0d-3367-409f-809e-103f1c468c5c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:58.791185 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-01b2bf0d-3367-409f-809e-103f1c468c5c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1680 microversion: 2.1 time: 0.156713 Sep 06 12:07:58.791774 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3637/7314] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:58 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:07:59.815687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2024a2ee-56f9-4f76-9d61-a860e5dc6d58 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:59.816325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2024a2ee-56f9-4f76-9d61-a860e5dc6d58 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:59.823669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2024a2ee-56f9-4f76-9d61-a860e5dc6d58 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:59.824175 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2024a2ee-56f9-4f76-9d61-a860e5dc6d58 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:59.824636 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2024a2ee-56f9-4f76-9d61-a860e5dc6d58 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:59.825382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2024a2ee-56f9-4f76-9d61-a860e5dc6d58 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:59.825926 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2024a2ee-56f9-4f76-9d61-a860e5dc6d58 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:59.826375 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2024a2ee-56f9-4f76-9d61-a860e5dc6d58 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:59.963380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2024a2ee-56f9-4f76-9d61-a860e5dc6d58 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:07:59.971285 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2024a2ee-56f9-4f76-9d61-a860e5dc6d58 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1680 microversion: 2.1 time: 0.160334 Sep 06 12:07:59.971854 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3678/7315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:07:59 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:08:00.995124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8e7fa8a5-b717-4467-8b48-549edefbabe8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:00.995773 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8e7fa8a5-b717-4467-8b48-549edefbabe8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:01.003801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e7fa8a5-b717-4467-8b48-549edefbabe8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:01.004293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e7fa8a5-b717-4467-8b48-549edefbabe8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:01.004737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e7fa8a5-b717-4467-8b48-549edefbabe8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:01.005437 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e7fa8a5-b717-4467-8b48-549edefbabe8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:01.005901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e7fa8a5-b717-4467-8b48-549edefbabe8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:01.006361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e7fa8a5-b717-4467-8b48-549edefbabe8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:01.140593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8e7fa8a5-b717-4467-8b48-549edefbabe8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:08:01.149040 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8e7fa8a5-b717-4467-8b48-549edefbabe8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1680 microversion: 2.1 time: 0.157833 Sep 06 12:08:01.149618 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3638/7316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:00 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:08:02.174213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0274753c-1929-4e36-aa8f-4307a247c16d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:02.174778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0274753c-1929-4e36-aa8f-4307a247c16d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:02.181788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0274753c-1929-4e36-aa8f-4307a247c16d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:02.182288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0274753c-1929-4e36-aa8f-4307a247c16d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:02.182750 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0274753c-1929-4e36-aa8f-4307a247c16d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:02.183504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0274753c-1929-4e36-aa8f-4307a247c16d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:02.183987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0274753c-1929-4e36-aa8f-4307a247c16d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:02.184437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0274753c-1929-4e36-aa8f-4307a247c16d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:02.320196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0274753c-1929-4e36-aa8f-4307a247c16d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:08:02.326789 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0274753c-1929-4e36-aa8f-4307a247c16d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1683 microversion: 2.1 time: 0.157315 Sep 06 12:08:02.327393 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3679/7317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:02 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:08:26.520524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8e35b167-bfd6-4dcd-b2ca-ed7fa163b0ce tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:08:26.522728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8e35b167-bfd6-4dcd-b2ca-ed7fa163b0ce tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:26.525240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=12 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:26.525909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:26.530635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e35b167-bfd6-4dcd-b2ca-ed7fa163b0ce tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:26.531201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e35b167-bfd6-4dcd-b2ca-ed7fa163b0ce tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:26.531649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e35b167-bfd6-4dcd-b2ca-ed7fa163b0ce tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:26.532347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e35b167-bfd6-4dcd-b2ca-ed7fa163b0ce tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:26.532810 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e35b167-bfd6-4dcd-b2ca-ed7fa163b0ce tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:26.533244 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e35b167-bfd6-4dcd-b2ca-ed7fa163b0ce tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:26.591977 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8e35b167-bfd6-4dcd-b2ca-ed7fa163b0ce tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51/action" status: 200 len: 68976 microversion: 2.1 time: 0.075201 Sep 06 12:08:26.592653 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3639/7318] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:08:26 2022] POST /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51/action => generated 68976 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:08:33.680216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d2cfe646-a4db-429a-9879-6f7a0e60fc1c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:33.680799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d2cfe646-a4db-429a-9879-6f7a0e60fc1c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:33.682856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-5e883310-54f6-4190-9db3-1edad404d001 req-2dcdfcc6-c637-46fd-b5d7-67f798f11aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f01d977-56d4-464d-9259-99d997ad6d51", "tag": "65306e64-bd1f-4728-bbc9-d7e67c3fea20"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:08:33.685687 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=14 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:33.686382 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=40 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:33.690734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2cfe646-a4db-429a-9879-6f7a0e60fc1c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:33.690932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2cfe646-a4db-429a-9879-6f7a0e60fc1c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:33.691510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2cfe646-a4db-429a-9879-6f7a0e60fc1c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:33.693439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2cfe646-a4db-429a-9879-6f7a0e60fc1c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:33.693619 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2cfe646-a4db-429a-9879-6f7a0e60fc1c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:33.694103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d2cfe646-a4db-429a-9879-6f7a0e60fc1c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:33.697060 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5e883310-54f6-4190-9db3-1edad404d001 req-2dcdfcc6-c637-46fd-b5d7-67f798f11aa0 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:33.698409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5e883310-54f6-4190-9db3-1edad404d001 req-2dcdfcc6-c637-46fd-b5d7-67f798f11aa0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:33.698409 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-5e883310-54f6-4190-9db3-1edad404d001 req-2dcdfcc6-c637-46fd-b5d7-67f798f11aa0 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:33.709957 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-5e883310-54f6-4190-9db3-1edad404d001 req-2dcdfcc6-c637-46fd-b5d7-67f798f11aa0 service nova] Creating event network-changed:65306e64-bd1f-4728-bbc9-d7e67c3fea20 for instance 8f01d977-56d4-464d-9259-99d997ad6d51 on nch1-master-1 Sep 06 12:08:33.715518 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-5e883310-54f6-4190-9db3-1edad404d001 req-2dcdfcc6-c637-46fd-b5d7-67f798f11aa0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037179 Sep 06 12:08:33.717027 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3640/7319] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:33.735327 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d2cfe646-a4db-429a-9879-6f7a0e60fc1c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:08:34.182573 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d2cfe646-a4db-429a-9879-6f7a0e60fc1c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 204 len: 0 microversion: 2.1 time: 0.506721 Sep 06 12:08:34.187725 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3680/7320] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 12:08:33 2022] DELETE /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:08:34.195901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6b3bfa6c-985d-4c99-b3d6-ebff7ab87085 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:34.196637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6b3bfa6c-985d-4c99-b3d6-ebff7ab87085 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:34.203697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b3bfa6c-985d-4c99-b3d6-ebff7ab87085 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:34.204191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b3bfa6c-985d-4c99-b3d6-ebff7ab87085 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:34.204633 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b3bfa6c-985d-4c99-b3d6-ebff7ab87085 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:34.205343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b3bfa6c-985d-4c99-b3d6-ebff7ab87085 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:34.205967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b3bfa6c-985d-4c99-b3d6-ebff7ab87085 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:34.206697 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b3bfa6c-985d-4c99-b3d6-ebff7ab87085 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:34.348614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6b3bfa6c-985d-4c99-b3d6-ebff7ab87085 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:08:34.358858 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6b3bfa6c-985d-4c99-b3d6-ebff7ab87085 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1689 microversion: 2.1 time: 0.168907 Sep 06 12:08:34.359235 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3641/7321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:34 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:08:35.384719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-92b50e32-f93e-4690-8618-db487bb68498 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:35.385445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-92b50e32-f93e-4690-8618-db487bb68498 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:35.394739 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92b50e32-f93e-4690-8618-db487bb68498 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:35.395298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92b50e32-f93e-4690-8618-db487bb68498 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:35.395771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92b50e32-f93e-4690-8618-db487bb68498 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:35.396545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92b50e32-f93e-4690-8618-db487bb68498 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:35.397153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92b50e32-f93e-4690-8618-db487bb68498 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:35.397612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92b50e32-f93e-4690-8618-db487bb68498 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:35.543427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-92b50e32-f93e-4690-8618-db487bb68498 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:08:35.552005 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-92b50e32-f93e-4690-8618-db487bb68498 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1689 microversion: 2.1 time: 0.171986 Sep 06 12:08:35.552792 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3681/7322] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:35 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:08:36.172039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-8c01b0e2-1334-43bf-a9af-af4cd945bb46 req-312632cc-394e-40f7-99f8-4cb0975bd3bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f01d977-56d4-464d-9259-99d997ad6d51", "name": "network-vif-deleted", "tag": "65306e64-bd1f-4728-bbc9-d7e67c3fea20"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:08:36.181513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8c01b0e2-1334-43bf-a9af-af4cd945bb46 req-312632cc-394e-40f7-99f8-4cb0975bd3bb service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:36.181993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8c01b0e2-1334-43bf-a9af-af4cd945bb46 req-312632cc-394e-40f7-99f8-4cb0975bd3bb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:36.182434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8c01b0e2-1334-43bf-a9af-af4cd945bb46 req-312632cc-394e-40f7-99f8-4cb0975bd3bb service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:36.194209 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-8c01b0e2-1334-43bf-a9af-af4cd945bb46 req-312632cc-394e-40f7-99f8-4cb0975bd3bb service nova] Creating event network-vif-deleted:65306e64-bd1f-4728-bbc9-d7e67c3fea20 for instance 8f01d977-56d4-464d-9259-99d997ad6d51 on nch1-master-1 Sep 06 12:08:36.199739 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-8c01b0e2-1334-43bf-a9af-af4cd945bb46 req-312632cc-394e-40f7-99f8-4cb0975bd3bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032305 Sep 06 12:08:36.200604 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3642/7323] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:36.576142 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:36.577170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:36.593695 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:36.594309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:36.594985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:36.595889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:36.596366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:36.596815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:36.630172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:36.630663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:36.631148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:36.631616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lazy-loading 'fault' on Instance uuid 8f01d977-56d4-464d-9259-99d997ad6d51 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:08:36.671890 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:08:36.684497 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7205bc2b-4a92-491b-8eb2-a6a0fc684776 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 200 len: 1357 microversion: 2.1 time: 0.108373 Sep 06 12:08:36.684497 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3682/7324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:36 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 1357 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:08:37.706534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2d9da52d-d057-41d7-8e0f-600ed3e68d79 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:37.707826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2d9da52d-d057-41d7-8e0f-600ed3e68d79 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 8f01d977-56d4-464d-9259-99d997ad6d51] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:37.714018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d9da52d-d057-41d7-8e0f-600ed3e68d79 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:37.714507 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d9da52d-d057-41d7-8e0f-600ed3e68d79 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:37.714971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d9da52d-d057-41d7-8e0f-600ed3e68d79 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:37.715689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d9da52d-d057-41d7-8e0f-600ed3e68d79 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:37.716155 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d9da52d-d057-41d7-8e0f-600ed3e68d79 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:37.716615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2d9da52d-d057-41d7-8e0f-600ed3e68d79 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:37.730684 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-2d9da52d-d057-41d7-8e0f-600ed3e68d79 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] HTTP exception thrown: Instance 8f01d977-56d4-464d-9259-99d997ad6d51 could not be found. Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2d9da52d-d057-41d7-8e0f-600ed3e68d79 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Request method failure captured: Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 HTTP/1.1 Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzeYVfZJz-bvpRJpbNxoClgmmS38luZVJYnn1c4uHPDNGT6x9mu_OAgJT7SDXZyhhmmM8HWW0WfRoxBDThE9ODnuq3d1gSBx5-I2qdQNYW8FnNVfSLu7r3kZhvwwaUR1Z_VNwXCKdV70KfkyQVz432u5zXg1J26TiMa6aej16G2Ghw4 Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 36e1c59f75934cc38e904fa0dae0d587 Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36e1c59f75934cc38e904fa0dae0d587"}]}] Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 36e1c59f75934cc38e904fa0dae0d587 Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestNetworkAdvancedServerOps-2051570988-project Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 38e0c4e314274ad0bbdc4125638b0916 Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2051570988-project Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 8f01d977-56d4-464d-9259-99d997ad6d51 could not be found. Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '8f01d977-56d4-464d-9259-99d997ad6d51'} Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f01d977-56d4-464d-9259-99d997ad6d51 could not be found. Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f01d977-56d4-464d-9259-99d997ad6d51 could not be found. Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:08:37.732387 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:08:37.738800 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:08:37.738800 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:08:37.738800 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:08:37.738800 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:08:37.738800 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:08:37.738800 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:08:37.738800 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f01d977-56d4-464d-9259-99d997ad6d51 could not be found. Sep 06 12:08:37.738800 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:08:37.738800 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2d9da52d-d057-41d7-8e0f-600ed3e68d79 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Returning 404 to user: Instance 8f01d977-56d4-464d-9259-99d997ad6d51 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:08:37.738800 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2d9da52d-d057-41d7-8e0f-600ed3e68d79 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51" status: 404 len: 111 microversion: 2.1 time: 0.032951 Sep 06 12:08:37.738800 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3643/7325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:37 2022] GET /compute/v2.1/servers/8f01d977-56d4-464d-9259-99d997ad6d51 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:08:41.519163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-902e1b94-b409-4155-a5c3-b9bb7ad48efe tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '.version_select at 0x7f90f8942040>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:41.577922 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-902e1b94-b409-4155-a5c3-b9bb7ad48efe tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2130262149" status: 202 len: 0 microversion: 2.1 time: 0.062758 Sep 06 12:08:41.578537 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3683/7326] 10.222.0.20 () {58 vars in 1284 bytes} [Tue Sep 6 12:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2130262149 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:08:41.607255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7c945afd-fcd2-4184-a550-f98b3bd322b4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'create', calling method: .version_select at 0x7f90f3059310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1992967068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSdeFjYWVzZNNodEQnh3cMJNpHv/4m3gFGTqzM6RlNVZvdVPHNhTtzkOW9qU/kb3nbUrGthWfwCvZuHc2T9X+7NKl4gasGd6+zkpMuV0iY6i2OEPNh2dnrdC8smk2SdUg=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:08:41.624987 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-7c945afd-fcd2-4184-a550-f98b3bd322b4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:08:41.630229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-7c945afd-fcd2-4184-a550-f98b3bd322b4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for user 38e0c4e314274ad0bbdc4125638b0916 and project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:08:41.692248 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7c945afd-fcd2-4184-a550-f98b3bd322b4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.088792 Sep 06 12:08:41.692757 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3644/7327] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 12:08:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:49.521289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:49.525704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2044225235", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "2efef94c-fe2b-4e39-a30f-747836d5315f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1992967068", "security_groups": [{"name": "tempest-secgroup-smoke-1509205765"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:08:49.637366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] validate_networks() for [('2efef94c-fe2b-4e39-a30f-747836d5315f', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:08:50.124054 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:08:50.124753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:08:50.125686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:08:50.125869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:08:50.126315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:08:50.140351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:50.140865 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:50.141539 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:50.142488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:50.143187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:50.143934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:50.183775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:08:50.194710 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for user 38e0c4e314274ad0bbdc4125638b0916 and project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:08:50.210616 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:08:50.213723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:08:50.371676 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [a4cd438c-07df-4f70-9971-680b6fd4c356] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 12:08:51.383780 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [a4cd438c-07df-4f70-9971-680b6fd4c356] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35070. Sep 06 12:08:51.388086 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-917e8969-a13c-440d-8b56-42a795113977 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.869430 Sep 06 12:08:51.388750 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3684/7328] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 12:08:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:08:51.398992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=16 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:51.404896 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a56e9747-afdc-493b-ab90-bd1063639310 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:51.405780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a56e9747-afdc-493b-ab90-bd1063639310 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:51.478357 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a56e9747-afdc-493b-ab90-bd1063639310 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:08:51.486935 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a56e9747-afdc-493b-ab90-bd1063639310 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1267 microversion: 2.1 time: 0.088878 Sep 06 12:08:51.487640 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3645/7329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:51 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:08:52.512243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-65257be1-faeb-4539-bc13-ec170fcaf6b3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:52.512875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-65257be1-faeb-4539-bc13-ec170fcaf6b3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:52.519184 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65257be1-faeb-4539-bc13-ec170fcaf6b3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:52.519692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65257be1-faeb-4539-bc13-ec170fcaf6b3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:52.520147 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65257be1-faeb-4539-bc13-ec170fcaf6b3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:52.520863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65257be1-faeb-4539-bc13-ec170fcaf6b3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:52.521335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65257be1-faeb-4539-bc13-ec170fcaf6b3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:52.521780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-65257be1-faeb-4539-bc13-ec170fcaf6b3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:52.586032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-65257be1-faeb-4539-bc13-ec170fcaf6b3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:08:52.593937 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-65257be1-faeb-4539-bc13-ec170fcaf6b3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1271 microversion: 2.1 time: 0.086631 Sep 06 12:08:52.594511 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3685/7330] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:52 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:08:53.617976 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c17edc9b-6bfb-4fc3-9f4e-f25d6574dc41 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:53.618755 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c17edc9b-6bfb-4fc3-9f4e-f25d6574dc41 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:53.627747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c17edc9b-6bfb-4fc3-9f4e-f25d6574dc41 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:53.628252 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c17edc9b-6bfb-4fc3-9f4e-f25d6574dc41 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:53.628708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c17edc9b-6bfb-4fc3-9f4e-f25d6574dc41 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:53.629425 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c17edc9b-6bfb-4fc3-9f4e-f25d6574dc41 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:53.630292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c17edc9b-6bfb-4fc3-9f4e-f25d6574dc41 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:53.630980 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c17edc9b-6bfb-4fc3-9f4e-f25d6574dc41 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:53.701220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c17edc9b-6bfb-4fc3-9f4e-f25d6574dc41 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:08:53.709575 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c17edc9b-6bfb-4fc3-9f4e-f25d6574dc41 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1327 microversion: 2.1 time: 0.096483 Sep 06 12:08:53.710169 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3646/7331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:53 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:08:54.734028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-77c9bc86-6ba8-4a37-90a4-332de4bf8b87 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:54.734661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-77c9bc86-6ba8-4a37-90a4-332de4bf8b87 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:54.742183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77c9bc86-6ba8-4a37-90a4-332de4bf8b87 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:54.742706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77c9bc86-6ba8-4a37-90a4-332de4bf8b87 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:54.743201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77c9bc86-6ba8-4a37-90a4-332de4bf8b87 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:54.743942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77c9bc86-6ba8-4a37-90a4-332de4bf8b87 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:54.744424 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77c9bc86-6ba8-4a37-90a4-332de4bf8b87 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:54.744879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-77c9bc86-6ba8-4a37-90a4-332de4bf8b87 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:54.895894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-77c9bc86-6ba8-4a37-90a4-332de4bf8b87 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:08:54.904228 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-77c9bc86-6ba8-4a37-90a4-332de4bf8b87 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1393 microversion: 2.1 time: 0.174271 Sep 06 12:08:54.917136 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3686/7332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:54 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:08:55.564563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f0d801b8-62c9-45fa-841c-eaee04146ad1 req-ee97a608-0543-43d0-8355-702351a8e053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e700de-c196-4fc6-9792-363dbe3e9b3f", "tag": "ccbd741b-cb87-4f5c-99c2-8639208c9ec1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:08:55.577206 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f0d801b8-62c9-45fa-841c-eaee04146ad1 req-ee97a608-0543-43d0-8355-702351a8e053 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:55.577701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f0d801b8-62c9-45fa-841c-eaee04146ad1 req-ee97a608-0543-43d0-8355-702351a8e053 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:55.578141 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f0d801b8-62c9-45fa-841c-eaee04146ad1 req-ee97a608-0543-43d0-8355-702351a8e053 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:55.592079 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f0d801b8-62c9-45fa-841c-eaee04146ad1 req-ee97a608-0543-43d0-8355-702351a8e053 service nova] Creating event network-changed:ccbd741b-cb87-4f5c-99c2-8639208c9ec1 for instance 33e700de-c196-4fc6-9792-363dbe3e9b3f on nch1-master-1 Sep 06 12:08:55.597406 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f0d801b8-62c9-45fa-841c-eaee04146ad1 req-ee97a608-0543-43d0-8355-702351a8e053 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036631 Sep 06 12:08:55.598035 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3647/7333] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:55.931614 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cec59ceb-63a2-48e7-8682-d5b24fda95af tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:55.932269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cec59ceb-63a2-48e7-8682-d5b24fda95af tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:55.939320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cec59ceb-63a2-48e7-8682-d5b24fda95af tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:55.939802 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cec59ceb-63a2-48e7-8682-d5b24fda95af tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:55.940265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cec59ceb-63a2-48e7-8682-d5b24fda95af tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:55.940979 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cec59ceb-63a2-48e7-8682-d5b24fda95af tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:55.941453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cec59ceb-63a2-48e7-8682-d5b24fda95af tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:55.941898 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cec59ceb-63a2-48e7-8682-d5b24fda95af tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:56.082487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cec59ceb-63a2-48e7-8682-d5b24fda95af tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:08:56.091289 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cec59ceb-63a2-48e7-8682-d5b24fda95af tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1393 microversion: 2.1 time: 0.165813 Sep 06 12:08:56.091878 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3687/7334] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:55 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:08:57.115861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ec2aff9c-ff72-4f20-935c-8d24a84cd85f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:57.116511 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ec2aff9c-ff72-4f20-935c-8d24a84cd85f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:57.119340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:57.124490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec2aff9c-ff72-4f20-935c-8d24a84cd85f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:57.124983 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec2aff9c-ff72-4f20-935c-8d24a84cd85f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:57.125430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec2aff9c-ff72-4f20-935c-8d24a84cd85f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:57.126138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec2aff9c-ff72-4f20-935c-8d24a84cd85f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:57.126603 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec2aff9c-ff72-4f20-935c-8d24a84cd85f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:57.127066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec2aff9c-ff72-4f20-935c-8d24a84cd85f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:57.262644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ec2aff9c-ff72-4f20-935c-8d24a84cd85f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:08:57.271080 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ec2aff9c-ff72-4f20-935c-8d24a84cd85f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1393 microversion: 2.1 time: 0.159153 Sep 06 12:08:57.271663 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3648/7335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:57 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:08:58.294507 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ac7669e2-e32e-47ec-94e9-3de6c9592b5b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:58.295151 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ac7669e2-e32e-47ec-94e9-3de6c9592b5b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:58.302361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac7669e2-e32e-47ec-94e9-3de6c9592b5b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:58.302871 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac7669e2-e32e-47ec-94e9-3de6c9592b5b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:58.306452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac7669e2-e32e-47ec-94e9-3de6c9592b5b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:58.306452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac7669e2-e32e-47ec-94e9-3de6c9592b5b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:58.306452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac7669e2-e32e-47ec-94e9-3de6c9592b5b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:58.306452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ac7669e2-e32e-47ec-94e9-3de6c9592b5b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:58.441289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ac7669e2-e32e-47ec-94e9-3de6c9592b5b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:08:58.450144 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ac7669e2-e32e-47ec-94e9-3de6c9592b5b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1393 microversion: 2.1 time: 0.160087 Sep 06 12:08:58.450733 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3688/7336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:58 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:08:59.472991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-81db5d94-e8cd-47fc-ab14-f57cc9650ce4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:59.473634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-81db5d94-e8cd-47fc-ab14-f57cc9650ce4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:59.480469 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81db5d94-e8cd-47fc-ab14-f57cc9650ce4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:59.480984 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81db5d94-e8cd-47fc-ab14-f57cc9650ce4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:59.481414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81db5d94-e8cd-47fc-ab14-f57cc9650ce4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:59.482185 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81db5d94-e8cd-47fc-ab14-f57cc9650ce4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:59.482895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81db5d94-e8cd-47fc-ab14-f57cc9650ce4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:59.483386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-81db5d94-e8cd-47fc-ab14-f57cc9650ce4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:59.623359 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-81db5d94-e8cd-47fc-ab14-f57cc9650ce4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:08:59.631332 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-81db5d94-e8cd-47fc-ab14-f57cc9650ce4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1393 microversion: 2.1 time: 0.162364 Sep 06 12:08:59.631912 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3649/7337] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:08:59 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:00.654788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e22dd474-262a-4530-bff1-8b871a23d732 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:00.655447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e22dd474-262a-4530-bff1-8b871a23d732 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:00.658252 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:00.659442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:00.664779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e22dd474-262a-4530-bff1-8b871a23d732 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:00.665353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e22dd474-262a-4530-bff1-8b871a23d732 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:00.665820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e22dd474-262a-4530-bff1-8b871a23d732 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:00.671531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e22dd474-262a-4530-bff1-8b871a23d732 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:00.671531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e22dd474-262a-4530-bff1-8b871a23d732 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:00.671531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e22dd474-262a-4530-bff1-8b871a23d732 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:00.804058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e22dd474-262a-4530-bff1-8b871a23d732 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:00.812203 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e22dd474-262a-4530-bff1-8b871a23d732 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1393 microversion: 2.1 time: 0.161440 Sep 06 12:09:00.812779 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3689/7338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:00 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:00.981110 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-eb21310f-4373-4b41-98dd-1905f10ff32c req-06d4a99f-a0a3-416a-b550-54c4a3fc793d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e700de-c196-4fc6-9792-363dbe3e9b3f", "name": "network-vif-plugged", "status": "completed", "tag": "ccbd741b-cb87-4f5c-99c2-8639208c9ec1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:09:00.992892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-eb21310f-4373-4b41-98dd-1905f10ff32c req-06d4a99f-a0a3-416a-b550-54c4a3fc793d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:00.993382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-eb21310f-4373-4b41-98dd-1905f10ff32c req-06d4a99f-a0a3-416a-b550-54c4a3fc793d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:00.993817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-eb21310f-4373-4b41-98dd-1905f10ff32c req-06d4a99f-a0a3-416a-b550-54c4a3fc793d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:01.008588 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-eb21310f-4373-4b41-98dd-1905f10ff32c req-06d4a99f-a0a3-416a-b550-54c4a3fc793d service nova] Creating event network-vif-plugged:ccbd741b-cb87-4f5c-99c2-8639208c9ec1 for instance 33e700de-c196-4fc6-9792-363dbe3e9b3f on nch1-master-1 Sep 06 12:09:01.014004 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-eb21310f-4373-4b41-98dd-1905f10ff32c req-06d4a99f-a0a3-416a-b550-54c4a3fc793d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037031 Sep 06 12:09:01.014591 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3650/7339] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:01.837221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-379234e2-2f88-45e8-9752-8dd4d1bb9da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:01.837807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-379234e2-2f88-45e8-9752-8dd4d1bb9da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:01.844778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-379234e2-2f88-45e8-9752-8dd4d1bb9da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:01.845318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-379234e2-2f88-45e8-9752-8dd4d1bb9da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:01.845763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-379234e2-2f88-45e8-9752-8dd4d1bb9da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:01.846484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-379234e2-2f88-45e8-9752-8dd4d1bb9da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:01.846963 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-379234e2-2f88-45e8-9752-8dd4d1bb9da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:01.847447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-379234e2-2f88-45e8-9752-8dd4d1bb9da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:01.980828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-379234e2-2f88-45e8-9752-8dd4d1bb9da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:01.990278 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-379234e2-2f88-45e8-9752-8dd4d1bb9da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1393 microversion: 2.1 time: 0.157516 Sep 06 12:09:01.990278 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3690/7340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:01 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:03.010186 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:03.015261 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0784daa0-874e-4fc4-8fe7-da1b774c01cc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:03.015999 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0784daa0-874e-4fc4-8fe7-da1b774c01cc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:03.022272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0784daa0-874e-4fc4-8fe7-da1b774c01cc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:03.028805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0784daa0-874e-4fc4-8fe7-da1b774c01cc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:03.028805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0784daa0-874e-4fc4-8fe7-da1b774c01cc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:03.028805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0784daa0-874e-4fc4-8fe7-da1b774c01cc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:03.028805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0784daa0-874e-4fc4-8fe7-da1b774c01cc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:03.028805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0784daa0-874e-4fc4-8fe7-da1b774c01cc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:03.161125 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0784daa0-874e-4fc4-8fe7-da1b774c01cc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:03.169007 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0784daa0-874e-4fc4-8fe7-da1b774c01cc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1565 microversion: 2.1 time: 0.159832 Sep 06 12:09:03.169585 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3651/7341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:03 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:03.191711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c215d3c-cd6b-4da5-ba0e-f471fc6dcbbc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:03.192436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8c215d3c-cd6b-4da5-ba0e-f471fc6dcbbc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:03.200343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c215d3c-cd6b-4da5-ba0e-f471fc6dcbbc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:03.200839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c215d3c-cd6b-4da5-ba0e-f471fc6dcbbc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:03.201292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c215d3c-cd6b-4da5-ba0e-f471fc6dcbbc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:03.202046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c215d3c-cd6b-4da5-ba0e-f471fc6dcbbc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:03.202519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c215d3c-cd6b-4da5-ba0e-f471fc6dcbbc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:03.202961 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c215d3c-cd6b-4da5-ba0e-f471fc6dcbbc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:03.333693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8c215d3c-cd6b-4da5-ba0e-f471fc6dcbbc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:03.341758 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8c215d3c-cd6b-4da5-ba0e-f471fc6dcbbc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1565 microversion: 2.1 time: 0.153956 Sep 06 12:09:03.342343 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3691/7342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:03 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:05.251692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-68e9664a-440d-405d-8f46-ef8ee6700244 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:05.253897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-68e9664a-440d-405d-8f46-ef8ee6700244 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:05.255347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-ad5b47e8-a395-43e4-866a-4c1e4d3772f2 req-d8d70f22-cf5b-4d44-b624-e842be328772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e700de-c196-4fc6-9792-363dbe3e9b3f", "tag": "ccbd741b-cb87-4f5c-99c2-8639208c9ec1"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:09:05.261564 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e9664a-440d-405d-8f46-ef8ee6700244 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:05.262205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e9664a-440d-405d-8f46-ef8ee6700244 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:05.262658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e9664a-440d-405d-8f46-ef8ee6700244 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:05.263400 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e9664a-440d-405d-8f46-ef8ee6700244 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:05.263869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e9664a-440d-405d-8f46-ef8ee6700244 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:05.264305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-68e9664a-440d-405d-8f46-ef8ee6700244 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:05.266000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:05.268579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ad5b47e8-a395-43e4-866a-4c1e4d3772f2 req-d8d70f22-cf5b-4d44-b624-e842be328772 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:05.268579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ad5b47e8-a395-43e4-866a-4c1e4d3772f2 req-d8d70f22-cf5b-4d44-b624-e842be328772 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:05.268973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ad5b47e8-a395-43e4-866a-4c1e4d3772f2 req-d8d70f22-cf5b-4d44-b624-e842be328772 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:05.281660 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-ad5b47e8-a395-43e4-866a-4c1e4d3772f2 req-d8d70f22-cf5b-4d44-b624-e842be328772 service nova] Creating event network-changed:ccbd741b-cb87-4f5c-99c2-8639208c9ec1 for instance 33e700de-c196-4fc6-9792-363dbe3e9b3f on nch1-master-1 Sep 06 12:09:05.287880 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-ad5b47e8-a395-43e4-866a-4c1e4d3772f2 req-d8d70f22-cf5b-4d44-b624-e842be328772 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037447 Sep 06 12:09:05.289117 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3692/7343] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:05.408887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-68e9664a-440d-405d-8f46-ef8ee6700244 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:05.416972 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-68e9664a-440d-405d-8f46-ef8ee6700244 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1565 microversion: 2.1 time: 0.169578 Sep 06 12:09:05.417882 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3652/7344] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:05 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:27.727191 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=46 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:27.732120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6c76bf9c-afee-4ed4-a6d5-abfec81fffcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:09:27.734444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6c76bf9c-afee-4ed4-a6d5-abfec81fffcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:27.742647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c76bf9c-afee-4ed4-a6d5-abfec81fffcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:27.753785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c76bf9c-afee-4ed4-a6d5-abfec81fffcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:27.753785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c76bf9c-afee-4ed4-a6d5-abfec81fffcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:27.753785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c76bf9c-afee-4ed4-a6d5-abfec81fffcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:27.753785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c76bf9c-afee-4ed4-a6d5-abfec81fffcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:27.753785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6c76bf9c-afee-4ed4-a6d5-abfec81fffcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:27.814446 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6c76bf9c-afee-4ed4-a6d5-abfec81fffcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f/action" status: 200 len: 24568 microversion: 2.1 time: 0.088979 Sep 06 12:09:27.815152 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3693/7345] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:09:27 2022] POST /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f/action => generated 24568 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:09:34.220890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:09:34.223057 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:34.225297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=9 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:34.226009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=34 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:34.231704 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:34.239254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:34.239254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:34.239254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:34.239254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:34.239254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:34.275521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:34.282225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Old instance type m1.heat2, new instance type m1.heat {{(pid=140875) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 06 12:09:34.288794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:09:34.289220 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:09:34.289703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:09:34.290121 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:09:34.290541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:09:34.505694 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-004c066e-f0d2-4125-b510-271c2a7ee860 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f/action" status: 202 len: 0 microversion: 2.1 time: 0.288765 Sep 06 12:09:34.506231 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3653/7346] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:09:34 2022] POST /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:09:34.515973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-95d2202d-426b-4e76-a22d-443f88e84166 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:34.516718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-95d2202d-426b-4e76-a22d-443f88e84166 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:34.524574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95d2202d-426b-4e76-a22d-443f88e84166 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:34.525087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95d2202d-426b-4e76-a22d-443f88e84166 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:34.525554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95d2202d-426b-4e76-a22d-443f88e84166 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:34.526294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95d2202d-426b-4e76-a22d-443f88e84166 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:34.526771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95d2202d-426b-4e76-a22d-443f88e84166 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:34.527246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-95d2202d-426b-4e76-a22d-443f88e84166 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:34.660943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-95d2202d-426b-4e76-a22d-443f88e84166 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:34.670094 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-95d2202d-426b-4e76-a22d-443f88e84166 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1692 microversion: 2.1 time: 0.158801 Sep 06 12:09:34.670717 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3694/7347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:34 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:35.896687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-dcf2be74-981d-4b7c-927b-4508dbad1a84 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:35.896687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-dcf2be74-981d-4b7c-927b-4508dbad1a84 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:35.896687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcf2be74-981d-4b7c-927b-4508dbad1a84 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:35.896687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcf2be74-981d-4b7c-927b-4508dbad1a84 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:35.896687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcf2be74-981d-4b7c-927b-4508dbad1a84 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:35.896687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcf2be74-981d-4b7c-927b-4508dbad1a84 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:35.896687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcf2be74-981d-4b7c-927b-4508dbad1a84 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:35.896687 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-dcf2be74-981d-4b7c-927b-4508dbad1a84 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:36.134377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-dcf2be74-981d-4b7c-927b-4508dbad1a84 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:36.142667 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-dcf2be74-981d-4b7c-927b-4508dbad1a84 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1692 microversion: 2.1 time: 0.451260 Sep 06 12:09:36.143341 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3654/7348] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:35 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1692 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:37.168860 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-05542f90-23f4-4922-af33-3619268e7b33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:37.169395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-05542f90-23f4-4922-af33-3619268e7b33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:37.176653 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05542f90-23f4-4922-af33-3619268e7b33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:37.177162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05542f90-23f4-4922-af33-3619268e7b33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:37.177751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05542f90-23f4-4922-af33-3619268e7b33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:37.178467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05542f90-23f4-4922-af33-3619268e7b33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:37.178943 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05542f90-23f4-4922-af33-3619268e7b33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:37.179415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-05542f90-23f4-4922-af33-3619268e7b33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:37.326726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-05542f90-23f4-4922-af33-3619268e7b33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:37.335339 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-05542f90-23f4-4922-af33-3619268e7b33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1692 microversion: 2.1 time: 0.171111 Sep 06 12:09:37.335931 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3695/7349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:37 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:38.359480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2b7f5e00-6a33-4642-bf5c-d9b6c00c31f7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:38.360101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2b7f5e00-6a33-4642-bf5c-d9b6c00c31f7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:38.367066 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b7f5e00-6a33-4642-bf5c-d9b6c00c31f7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:38.367562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b7f5e00-6a33-4642-bf5c-d9b6c00c31f7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:38.368522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b7f5e00-6a33-4642-bf5c-d9b6c00c31f7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:38.369228 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b7f5e00-6a33-4642-bf5c-d9b6c00c31f7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:38.369701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b7f5e00-6a33-4642-bf5c-d9b6c00c31f7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:38.370139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2b7f5e00-6a33-4642-bf5c-d9b6c00c31f7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:38.555069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2b7f5e00-6a33-4642-bf5c-d9b6c00c31f7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:38.563701 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2b7f5e00-6a33-4642-bf5c-d9b6c00c31f7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1697 microversion: 2.1 time: 0.208068 Sep 06 12:09:38.564285 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3655/7350] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:38 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1697 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:39.589672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a12ef152-d8e3-49f0-b3c0-3ddd086ab077 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:39.590302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a12ef152-d8e3-49f0-b3c0-3ddd086ab077 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:39.597755 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12ef152-d8e3-49f0-b3c0-3ddd086ab077 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:39.598286 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12ef152-d8e3-49f0-b3c0-3ddd086ab077 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:39.598743 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12ef152-d8e3-49f0-b3c0-3ddd086ab077 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:39.599525 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12ef152-d8e3-49f0-b3c0-3ddd086ab077 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:39.600005 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12ef152-d8e3-49f0-b3c0-3ddd086ab077 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:39.600452 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a12ef152-d8e3-49f0-b3c0-3ddd086ab077 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:39.782129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a12ef152-d8e3-49f0-b3c0-3ddd086ab077 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:39.789969 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a12ef152-d8e3-49f0-b3c0-3ddd086ab077 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1697 microversion: 2.1 time: 0.204267 Sep 06 12:09:39.790541 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3696/7351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:39 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1697 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:40.813320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-30881d76-55a4-41a7-b3f2-cfcf47fdfbc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:40.814161 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-30881d76-55a4-41a7-b3f2-cfcf47fdfbc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:40.821916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30881d76-55a4-41a7-b3f2-cfcf47fdfbc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:40.822435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30881d76-55a4-41a7-b3f2-cfcf47fdfbc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:40.822873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30881d76-55a4-41a7-b3f2-cfcf47fdfbc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:40.823640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30881d76-55a4-41a7-b3f2-cfcf47fdfbc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:40.824117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30881d76-55a4-41a7-b3f2-cfcf47fdfbc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:40.824561 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-30881d76-55a4-41a7-b3f2-cfcf47fdfbc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:40.960384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-30881d76-55a4-41a7-b3f2-cfcf47fdfbc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:40.968886 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-30881d76-55a4-41a7-b3f2-cfcf47fdfbc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1697 microversion: 2.1 time: 0.159655 Sep 06 12:09:40.969487 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3656/7352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:40 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:41.992291 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-69ba4262-8643-4bea-a77a-ae08b6030afc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:41.992928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-69ba4262-8643-4bea-a77a-ae08b6030afc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:42.000075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69ba4262-8643-4bea-a77a-ae08b6030afc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:42.000475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69ba4262-8643-4bea-a77a-ae08b6030afc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:42.000944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69ba4262-8643-4bea-a77a-ae08b6030afc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:42.001676 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69ba4262-8643-4bea-a77a-ae08b6030afc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:42.002220 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69ba4262-8643-4bea-a77a-ae08b6030afc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:42.002604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-69ba4262-8643-4bea-a77a-ae08b6030afc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:42.133874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-69ba4262-8643-4bea-a77a-ae08b6030afc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:42.141789 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-69ba4262-8643-4bea-a77a-ae08b6030afc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1697 microversion: 2.1 time: 0.153455 Sep 06 12:09:42.142367 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3697/7353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:41 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:43.166520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-40ad645d-6109-406f-ba27-f6572c4b59d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:43.167090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-40ad645d-6109-406f-ba27-f6572c4b59d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:43.173910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40ad645d-6109-406f-ba27-f6572c4b59d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:43.174405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40ad645d-6109-406f-ba27-f6572c4b59d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:43.174861 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40ad645d-6109-406f-ba27-f6572c4b59d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:43.175601 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40ad645d-6109-406f-ba27-f6572c4b59d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:43.176075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40ad645d-6109-406f-ba27-f6572c4b59d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:43.176515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40ad645d-6109-406f-ba27-f6572c4b59d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:43.315026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-40ad645d-6109-406f-ba27-f6572c4b59d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:43.323242 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-40ad645d-6109-406f-ba27-f6572c4b59d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1697 microversion: 2.1 time: 0.161237 Sep 06 12:09:43.323840 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3657/7354] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:43 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:44.348101 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-833410db-37f2-4dbd-9a84-55c0c6614387 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:44.348781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-833410db-37f2-4dbd-9a84-55c0c6614387 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:44.355782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-833410db-37f2-4dbd-9a84-55c0c6614387 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:44.356313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-833410db-37f2-4dbd-9a84-55c0c6614387 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:44.356781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-833410db-37f2-4dbd-9a84-55c0c6614387 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:44.357493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-833410db-37f2-4dbd-9a84-55c0c6614387 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:44.357968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-833410db-37f2-4dbd-9a84-55c0c6614387 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:44.358416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-833410db-37f2-4dbd-9a84-55c0c6614387 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:44.490704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-833410db-37f2-4dbd-9a84-55c0c6614387 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:44.499139 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-833410db-37f2-4dbd-9a84-55c0c6614387 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1697 microversion: 2.1 time: 0.154996 Sep 06 12:09:44.499719 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3698/7355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:44 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:45.521843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8f1848ca-14b9-4b61-8c8d-64b5870065d5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:45.522477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8f1848ca-14b9-4b61-8c8d-64b5870065d5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:45.529035 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f1848ca-14b9-4b61-8c8d-64b5870065d5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:45.529537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f1848ca-14b9-4b61-8c8d-64b5870065d5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:45.529993 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f1848ca-14b9-4b61-8c8d-64b5870065d5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:45.530700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f1848ca-14b9-4b61-8c8d-64b5870065d5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:45.531201 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f1848ca-14b9-4b61-8c8d-64b5870065d5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:45.531640 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8f1848ca-14b9-4b61-8c8d-64b5870065d5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:45.667682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8f1848ca-14b9-4b61-8c8d-64b5870065d5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:45.675658 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8f1848ca-14b9-4b61-8c8d-64b5870065d5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1697 microversion: 2.1 time: 0.157768 Sep 06 12:09:45.676232 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3658/7356] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:45 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:46.700984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-40ad8eb8-efc9-461c-a4ad-c1ff3fa7275b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:46.701613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-40ad8eb8-efc9-461c-a4ad-c1ff3fa7275b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:46.708962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40ad8eb8-efc9-461c-a4ad-c1ff3fa7275b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:46.709492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40ad8eb8-efc9-461c-a4ad-c1ff3fa7275b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:46.709951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40ad8eb8-efc9-461c-a4ad-c1ff3fa7275b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:46.710659 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40ad8eb8-efc9-461c-a4ad-c1ff3fa7275b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:46.711165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40ad8eb8-efc9-461c-a4ad-c1ff3fa7275b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:46.711613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-40ad8eb8-efc9-461c-a4ad-c1ff3fa7275b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:46.853864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-40ad8eb8-efc9-461c-a4ad-c1ff3fa7275b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:46.861830 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-40ad8eb8-efc9-461c-a4ad-c1ff3fa7275b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1697 microversion: 2.1 time: 0.165419 Sep 06 12:09:46.862412 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3699/7357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:46 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:09:47.891948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d6974fae-7adf-46c7-bdd7-9d9418dea0eb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:47.892501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d6974fae-7adf-46c7-bdd7-9d9418dea0eb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:47.899406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6974fae-7adf-46c7-bdd7-9d9418dea0eb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:47.899901 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6974fae-7adf-46c7-bdd7-9d9418dea0eb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:47.900353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6974fae-7adf-46c7-bdd7-9d9418dea0eb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:47.901068 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6974fae-7adf-46c7-bdd7-9d9418dea0eb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:47.901539 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6974fae-7adf-46c7-bdd7-9d9418dea0eb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:47.901978 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d6974fae-7adf-46c7-bdd7-9d9418dea0eb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:48.034929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d6974fae-7adf-46c7-bdd7-9d9418dea0eb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:48.043706 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d6974fae-7adf-46c7-bdd7-9d9418dea0eb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1697 microversion: 2.1 time: 0.155802 Sep 06 12:09:48.044284 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3659/7358] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:47 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:49.068079 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-80072be9-a33a-423d-9bf6-79766e9a29f2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:49.068730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-80072be9-a33a-423d-9bf6-79766e9a29f2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:49.076029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80072be9-a33a-423d-9bf6-79766e9a29f2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:49.076521 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80072be9-a33a-423d-9bf6-79766e9a29f2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:49.076982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80072be9-a33a-423d-9bf6-79766e9a29f2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:49.077691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80072be9-a33a-423d-9bf6-79766e9a29f2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:49.078158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80072be9-a33a-423d-9bf6-79766e9a29f2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:49.078643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-80072be9-a33a-423d-9bf6-79766e9a29f2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:49.213928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-80072be9-a33a-423d-9bf6-79766e9a29f2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:49.221861 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-80072be9-a33a-423d-9bf6-79766e9a29f2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1697 microversion: 2.1 time: 0.157771 Sep 06 12:09:49.222431 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3700/7359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:49 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:50.246360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ba9177d1-8adc-42df-b936-e91a80308897 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:50.247568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ba9177d1-8adc-42df-b936-e91a80308897 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:50.259737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba9177d1-8adc-42df-b936-e91a80308897 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:50.259737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba9177d1-8adc-42df-b936-e91a80308897 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:50.259737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba9177d1-8adc-42df-b936-e91a80308897 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:50.259737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba9177d1-8adc-42df-b936-e91a80308897 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:50.259737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba9177d1-8adc-42df-b936-e91a80308897 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:50.259737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba9177d1-8adc-42df-b936-e91a80308897 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:50.393405 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ba9177d1-8adc-42df-b936-e91a80308897 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:50.402056 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ba9177d1-8adc-42df-b936-e91a80308897 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1696 microversion: 2.1 time: 0.159843 Sep 06 12:09:50.402605 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3660/7360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:50 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:50.630308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-7ede8e6e-7ce9-4e3b-a877-419dc3e60ff3 req-6edbd497-1bef-4695-9828-211b9c0ba894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e700de-c196-4fc6-9792-363dbe3e9b3f", "name": "network-vif-unplugged", "status": "completed", "tag": "ccbd741b-cb87-4f5c-99c2-8639208c9ec1"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:09:50.641398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ede8e6e-7ce9-4e3b-a877-419dc3e60ff3 req-6edbd497-1bef-4695-9828-211b9c0ba894 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:50.641913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ede8e6e-7ce9-4e3b-a877-419dc3e60ff3 req-6edbd497-1bef-4695-9828-211b9c0ba894 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:50.642351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-7ede8e6e-7ce9-4e3b-a877-419dc3e60ff3 req-6edbd497-1bef-4695-9828-211b9c0ba894 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:50.654670 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-7ede8e6e-7ce9-4e3b-a877-419dc3e60ff3 req-6edbd497-1bef-4695-9828-211b9c0ba894 service nova] Creating event network-vif-unplugged:ccbd741b-cb87-4f5c-99c2-8639208c9ec1 for instance 33e700de-c196-4fc6-9792-363dbe3e9b3f on nch2-master-1 Sep 06 12:09:50.660103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [req-7ede8e6e-7ce9-4e3b-a877-419dc3e60ff3 req-6edbd497-1bef-4695-9828-211b9c0ba894 service nova] Instance 33e700de-c196-4fc6-9792-363dbe3e9b3f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140876) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 12:09:50.671888 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-7ede8e6e-7ce9-4e3b-a877-419dc3e60ff3 req-6edbd497-1bef-4695-9828-211b9c0ba894 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045361 Sep 06 12:09:50.672519 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3701/7361] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:51.428263 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c293076b-c1fb-4016-b936-6b92bc52cfe1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:51.428885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c293076b-c1fb-4016-b936-6b92bc52cfe1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:51.436163 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c293076b-c1fb-4016-b936-6b92bc52cfe1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:51.436661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c293076b-c1fb-4016-b936-6b92bc52cfe1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:51.437104 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c293076b-c1fb-4016-b936-6b92bc52cfe1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:51.437817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c293076b-c1fb-4016-b936-6b92bc52cfe1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:51.438283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c293076b-c1fb-4016-b936-6b92bc52cfe1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:51.438740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c293076b-c1fb-4016-b936-6b92bc52cfe1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:51.578917 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c293076b-c1fb-4016-b936-6b92bc52cfe1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:51.588311 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c293076b-c1fb-4016-b936-6b92bc52cfe1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1696 microversion: 2.1 time: 0.163903 Sep 06 12:09:51.591132 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3661/7362] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:51 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:52.614205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5797d285-8cc6-446a-9e87-66995cca2da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:52.614916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5797d285-8cc6-446a-9e87-66995cca2da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:52.621939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5797d285-8cc6-446a-9e87-66995cca2da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:52.622440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5797d285-8cc6-446a-9e87-66995cca2da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:52.622900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5797d285-8cc6-446a-9e87-66995cca2da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:52.623652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5797d285-8cc6-446a-9e87-66995cca2da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:52.624127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5797d285-8cc6-446a-9e87-66995cca2da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:52.624574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5797d285-8cc6-446a-9e87-66995cca2da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:52.687883 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-c5fa90e5-12a9-4ddc-9ffd-df3d0f368213 req-c4ef50f0-ce29-4cad-addd-f4cb4a50e595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e700de-c196-4fc6-9792-363dbe3e9b3f", "tag": "ccbd741b-cb87-4f5c-99c2-8639208c9ec1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:09:52.698968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c5fa90e5-12a9-4ddc-9ffd-df3d0f368213 req-c4ef50f0-ce29-4cad-addd-f4cb4a50e595 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:52.699485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c5fa90e5-12a9-4ddc-9ffd-df3d0f368213 req-c4ef50f0-ce29-4cad-addd-f4cb4a50e595 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:52.699929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-c5fa90e5-12a9-4ddc-9ffd-df3d0f368213 req-c4ef50f0-ce29-4cad-addd-f4cb4a50e595 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:52.712838 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-c5fa90e5-12a9-4ddc-9ffd-df3d0f368213 req-c4ef50f0-ce29-4cad-addd-f4cb4a50e595 service nova] Creating event network-changed:ccbd741b-cb87-4f5c-99c2-8639208c9ec1 for instance 33e700de-c196-4fc6-9792-363dbe3e9b3f on nch2-master-1 Sep 06 12:09:52.718817 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [req-c5fa90e5-12a9-4ddc-9ffd-df3d0f368213 req-c4ef50f0-ce29-4cad-addd-f4cb4a50e595 service nova] Instance 33e700de-c196-4fc6-9792-363dbe3e9b3f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140875) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 06 12:09:52.730014 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-c5fa90e5-12a9-4ddc-9ffd-df3d0f368213 req-c4ef50f0-ce29-4cad-addd-f4cb4a50e595 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045855 Sep 06 12:09:52.730665 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3662/7363] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:52.764510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5797d285-8cc6-446a-9e87-66995cca2da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:52.772647 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5797d285-8cc6-446a-9e87-66995cca2da3 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1694 microversion: 2.1 time: 0.163665 Sep 06 12:09:52.773367 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3702/7364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:52 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:53.799262 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ecce02b0-52ce-444b-a17b-03712dc11892 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:53.800018 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ecce02b0-52ce-444b-a17b-03712dc11892 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:53.807122 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecce02b0-52ce-444b-a17b-03712dc11892 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:53.807635 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecce02b0-52ce-444b-a17b-03712dc11892 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:53.808297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecce02b0-52ce-444b-a17b-03712dc11892 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:53.809038 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecce02b0-52ce-444b-a17b-03712dc11892 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:53.809510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecce02b0-52ce-444b-a17b-03712dc11892 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:53.809953 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ecce02b0-52ce-444b-a17b-03712dc11892 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:53.947302 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ecce02b0-52ce-444b-a17b-03712dc11892 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:53.956976 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ecce02b0-52ce-444b-a17b-03712dc11892 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1694 microversion: 2.1 time: 0.162872 Sep 06 12:09:53.957862 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3663/7365] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:53 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:54.981725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-839d1cdb-58c7-479a-ac9e-c65b1d85d7b8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:54.982345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-839d1cdb-58c7-479a-ac9e-c65b1d85d7b8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:54.989087 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-839d1cdb-58c7-479a-ac9e-c65b1d85d7b8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:54.989586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-839d1cdb-58c7-479a-ac9e-c65b1d85d7b8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:54.990060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-839d1cdb-58c7-479a-ac9e-c65b1d85d7b8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:54.990752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-839d1cdb-58c7-479a-ac9e-c65b1d85d7b8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:54.991255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-839d1cdb-58c7-479a-ac9e-c65b1d85d7b8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:54.991702 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-839d1cdb-58c7-479a-ac9e-c65b1d85d7b8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:55.128425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-839d1cdb-58c7-479a-ac9e-c65b1d85d7b8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:55.136262 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-839d1cdb-58c7-479a-ac9e-c65b1d85d7b8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1691 microversion: 2.1 time: 0.158633 Sep 06 12:09:55.136832 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3703/7366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:54 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:55.160577 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8993f18f-8853-4af9-bfca-dcc9d44390a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:09:55.161174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8993f18f-8853-4af9-bfca-dcc9d44390a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:55.168886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8993f18f-8853-4af9-bfca-dcc9d44390a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:55.169303 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8993f18f-8853-4af9-bfca-dcc9d44390a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:55.169753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8993f18f-8853-4af9-bfca-dcc9d44390a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:55.170460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8993f18f-8853-4af9-bfca-dcc9d44390a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:55.170935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8993f18f-8853-4af9-bfca-dcc9d44390a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:55.171401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8993f18f-8853-4af9-bfca-dcc9d44390a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:55.404038 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8993f18f-8853-4af9-bfca-dcc9d44390a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f/action" status: 204 len: 0 microversion: 2.1 time: 0.247018 Sep 06 12:09:55.405020 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3664/7367] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:09:55 2022] POST /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f/action => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:09:55.413401 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-10b852d8-2cad-4aca-acaa-939444377a70 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:55.413968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-10b852d8-2cad-4aca-acaa-939444377a70 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:55.420862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10b852d8-2cad-4aca-acaa-939444377a70 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:55.421366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10b852d8-2cad-4aca-acaa-939444377a70 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:55.421827 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10b852d8-2cad-4aca-acaa-939444377a70 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:55.422549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10b852d8-2cad-4aca-acaa-939444377a70 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:55.423037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10b852d8-2cad-4aca-acaa-939444377a70 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:55.423530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-10b852d8-2cad-4aca-acaa-939444377a70 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:55.560481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-10b852d8-2cad-4aca-acaa-939444377a70 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:55.568661 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-10b852d8-2cad-4aca-acaa-939444377a70 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1691 microversion: 2.1 time: 0.159343 Sep 06 12:09:55.569820 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3704/7368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:55 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:55.597338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4d203bef-f0fa-4e3c-968e-eff5817f5f1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:55.598090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4d203bef-f0fa-4e3c-968e-eff5817f5f1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:55.604920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d203bef-f0fa-4e3c-968e-eff5817f5f1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:55.605794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d203bef-f0fa-4e3c-968e-eff5817f5f1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:55.606355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d203bef-f0fa-4e3c-968e-eff5817f5f1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:55.607130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d203bef-f0fa-4e3c-968e-eff5817f5f1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:55.607670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d203bef-f0fa-4e3c-968e-eff5817f5f1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:55.608289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4d203bef-f0fa-4e3c-968e-eff5817f5f1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:55.758651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4d203bef-f0fa-4e3c-968e-eff5817f5f1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:55.767837 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4d203bef-f0fa-4e3c-968e-eff5817f5f1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1691 microversion: 2.1 time: 0.174821 Sep 06 12:09:55.768426 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3665/7369] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:55 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:56.792954 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-579ea44b-564e-4ec2-9b30-5bd18f08a2cd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:56.793586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-579ea44b-564e-4ec2-9b30-5bd18f08a2cd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:56.800792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-579ea44b-564e-4ec2-9b30-5bd18f08a2cd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:56.801294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-579ea44b-564e-4ec2-9b30-5bd18f08a2cd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:56.801822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-579ea44b-564e-4ec2-9b30-5bd18f08a2cd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:56.802532 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-579ea44b-564e-4ec2-9b30-5bd18f08a2cd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:56.803031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-579ea44b-564e-4ec2-9b30-5bd18f08a2cd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:56.803474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-579ea44b-564e-4ec2-9b30-5bd18f08a2cd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:56.944877 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-579ea44b-564e-4ec2-9b30-5bd18f08a2cd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:56.953335 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-579ea44b-564e-4ec2-9b30-5bd18f08a2cd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1691 microversion: 2.1 time: 0.165133 Sep 06 12:09:56.953928 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3705/7370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:56 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:57.978375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-573bf4b6-1479-43a4-a280-2219b330db76 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:57.979039 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-573bf4b6-1479-43a4-a280-2219b330db76 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:57.986034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-573bf4b6-1479-43a4-a280-2219b330db76 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:57.986531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-573bf4b6-1479-43a4-a280-2219b330db76 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:57.986986 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-573bf4b6-1479-43a4-a280-2219b330db76 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:57.987722 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-573bf4b6-1479-43a4-a280-2219b330db76 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:57.988191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-573bf4b6-1479-43a4-a280-2219b330db76 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:57.988631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-573bf4b6-1479-43a4-a280-2219b330db76 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:58.123145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-573bf4b6-1479-43a4-a280-2219b330db76 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:58.131111 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-573bf4b6-1479-43a4-a280-2219b330db76 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1683 microversion: 2.1 time: 0.156958 Sep 06 12:09:58.131695 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3666/7371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:57 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:58.554744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-04f067f4-8f36-4aa4-9438-a88dd4b458b7 req-0129cefb-1790-4db4-a873-eb0d6a0a0130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e700de-c196-4fc6-9792-363dbe3e9b3f", "name": "network-vif-plugged", "status": "completed", "tag": "ccbd741b-cb87-4f5c-99c2-8639208c9ec1"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:09:58.565400 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-04f067f4-8f36-4aa4-9438-a88dd4b458b7 req-0129cefb-1790-4db4-a873-eb0d6a0a0130 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:58.565899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-04f067f4-8f36-4aa4-9438-a88dd4b458b7 req-0129cefb-1790-4db4-a873-eb0d6a0a0130 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:58.566351 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-04f067f4-8f36-4aa4-9438-a88dd4b458b7 req-0129cefb-1790-4db4-a873-eb0d6a0a0130 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:58.570439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=75 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:58.578711 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-04f067f4-8f36-4aa4-9438-a88dd4b458b7 req-0129cefb-1790-4db4-a873-eb0d6a0a0130 service nova] Creating event network-vif-plugged:ccbd741b-cb87-4f5c-99c2-8639208c9ec1 for instance 33e700de-c196-4fc6-9792-363dbe3e9b3f on nch2-master-1 Sep 06 12:09:58.583912 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-04f067f4-8f36-4aa4-9438-a88dd4b458b7 req-0129cefb-1790-4db4-a873-eb0d6a0a0130 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032998 Sep 06 12:09:58.584599 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3706/7372] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:18.306914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-28443ed0-4ec2-4629-97ca-e45b9b947250 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:10:18.309259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-28443ed0-4ec2-4629-97ca-e45b9b947250 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:18.311812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=32 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:18.312490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:18.317710 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28443ed0-4ec2-4629-97ca-e45b9b947250 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:18.323267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28443ed0-4ec2-4629-97ca-e45b9b947250 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:18.323267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28443ed0-4ec2-4629-97ca-e45b9b947250 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:18.323267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28443ed0-4ec2-4629-97ca-e45b9b947250 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:18.323267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28443ed0-4ec2-4629-97ca-e45b9b947250 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:18.323267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-28443ed0-4ec2-4629-97ca-e45b9b947250 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:18.389082 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-28443ed0-4ec2-4629-97ca-e45b9b947250 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f/action" status: 200 len: 24576 microversion: 2.1 time: 0.085811 Sep 06 12:10:18.389782 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3667/7373] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:10:18 2022] POST /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f/action => generated 24576 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:10:25.503650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4200cb15-728d-47de-bb89-1e783f411a1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:25.504273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4200cb15-728d-47de-bb89-1e783f411a1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:25.507508 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=29 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:25.514537 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4200cb15-728d-47de-bb89-1e783f411a1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:25.515080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4200cb15-728d-47de-bb89-1e783f411a1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:25.515545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4200cb15-728d-47de-bb89-1e783f411a1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:25.516622 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4200cb15-728d-47de-bb89-1e783f411a1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:25.517726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4200cb15-728d-47de-bb89-1e783f411a1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:25.518212 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4200cb15-728d-47de-bb89-1e783f411a1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:25.557360 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4200cb15-728d-47de-bb89-1e783f411a1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:10:25.571460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-52345079-976d-4a51-a8e6-8dad845605c5 req-e2119201-9470-4064-989c-e67cf5c0a6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e700de-c196-4fc6-9792-363dbe3e9b3f", "tag": "ccbd741b-cb87-4f5c-99c2-8639208c9ec1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:10:25.583973 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-52345079-976d-4a51-a8e6-8dad845605c5 req-e2119201-9470-4064-989c-e67cf5c0a6d3 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:25.584465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-52345079-976d-4a51-a8e6-8dad845605c5 req-e2119201-9470-4064-989c-e67cf5c0a6d3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:25.584904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-52345079-976d-4a51-a8e6-8dad845605c5 req-e2119201-9470-4064-989c-e67cf5c0a6d3 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:25.596904 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-52345079-976d-4a51-a8e6-8dad845605c5 req-e2119201-9470-4064-989c-e67cf5c0a6d3 service nova] Creating event network-changed:ccbd741b-cb87-4f5c-99c2-8639208c9ec1 for instance 33e700de-c196-4fc6-9792-363dbe3e9b3f on nch2-master-1 Sep 06 12:10:25.602559 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-52345079-976d-4a51-a8e6-8dad845605c5 req-e2119201-9470-4064-989c-e67cf5c0a6d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100168 Sep 06 12:10:25.603193 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3668/7374] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:25.822055 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4200cb15-728d-47de-bb89-1e783f411a1f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "DELETE /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 204 len: 0 microversion: 2.1 time: 0.322369 Sep 06 12:10:25.826052 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3707/7375] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 12:10:25 2022] DELETE /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:10:25.837012 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-34ade80e-06f3-41ce-8c80-6fd001955367 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:25.837824 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-34ade80e-06f3-41ce-8c80-6fd001955367 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:25.845748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34ade80e-06f3-41ce-8c80-6fd001955367 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:25.846166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34ade80e-06f3-41ce-8c80-6fd001955367 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:25.846611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34ade80e-06f3-41ce-8c80-6fd001955367 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:25.847748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34ade80e-06f3-41ce-8c80-6fd001955367 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:25.848518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34ade80e-06f3-41ce-8c80-6fd001955367 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:25.848956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-34ade80e-06f3-41ce-8c80-6fd001955367 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:25.987075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-34ade80e-06f3-41ce-8c80-6fd001955367 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:25.995130 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-34ade80e-06f3-41ce-8c80-6fd001955367 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1689 microversion: 2.1 time: 0.166923 Sep 06 12:10:25.995806 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3669/7376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:25 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:27.020938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-bf954cf7-461b-4c21-80cb-b0b3e030d0c0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:27.021664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-bf954cf7-461b-4c21-80cb-b0b3e030d0c0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:27.028638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf954cf7-461b-4c21-80cb-b0b3e030d0c0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:27.029143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf954cf7-461b-4c21-80cb-b0b3e030d0c0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:27.029610 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf954cf7-461b-4c21-80cb-b0b3e030d0c0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:27.030337 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf954cf7-461b-4c21-80cb-b0b3e030d0c0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:27.030823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf954cf7-461b-4c21-80cb-b0b3e030d0c0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:27.031293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-bf954cf7-461b-4c21-80cb-b0b3e030d0c0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:27.487096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-bf954cf7-461b-4c21-80cb-b0b3e030d0c0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:27.495519 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-bf954cf7-461b-4c21-80cb-b0b3e030d0c0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1689 microversion: 2.1 time: 0.478885 Sep 06 12:10:27.496418 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3708/7377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:27 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1689 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:27.896010 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-927f2d21-84c7-473e-a29d-138722630ce2 req-ba58361d-96e8-4e86-ba16-e9a6c7e24d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e700de-c196-4fc6-9792-363dbe3e9b3f", "name": "network-vif-deleted", "tag": "ccbd741b-cb87-4f5c-99c2-8639208c9ec1"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:10:27.907659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-927f2d21-84c7-473e-a29d-138722630ce2 req-ba58361d-96e8-4e86-ba16-e9a6c7e24d97 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:27.909099 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-927f2d21-84c7-473e-a29d-138722630ce2 req-ba58361d-96e8-4e86-ba16-e9a6c7e24d97 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:27.909691 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-927f2d21-84c7-473e-a29d-138722630ce2 req-ba58361d-96e8-4e86-ba16-e9a6c7e24d97 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:27.922117 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-927f2d21-84c7-473e-a29d-138722630ce2 req-ba58361d-96e8-4e86-ba16-e9a6c7e24d97 service nova] Creating event network-vif-deleted:ccbd741b-cb87-4f5c-99c2-8639208c9ec1 for instance 33e700de-c196-4fc6-9792-363dbe3e9b3f on nch2-master-1 Sep 06 12:10:27.927096 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-927f2d21-84c7-473e-a29d-138722630ce2 req-ba58361d-96e8-4e86-ba16-e9a6c7e24d97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034694 Sep 06 12:10:27.927706 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3670/7378] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:28.521939 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:28.522586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:28.529727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:28.530260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:28.530728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:28.531486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:28.531971 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:28.532427 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:28.565641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:28.566148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:28.566613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:28.567112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lazy-loading 'fault' on Instance uuid 33e700de-c196-4fc6-9792-363dbe3e9b3f {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:10:28.608230 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:28.616121 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d9512bef-092d-4d37-b287-012b1905a558 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 200 len: 1357 microversion: 2.1 time: 0.098216 Sep 06 12:10:28.616709 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3709/7379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:28 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 1357 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:29.641730 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-59602c6c-ee1f-481a-be8b-164e67c648d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:29.642435 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-59602c6c-ee1f-481a-be8b-164e67c648d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 33e700de-c196-4fc6-9792-363dbe3e9b3f] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:29.648614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59602c6c-ee1f-481a-be8b-164e67c648d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:29.649100 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59602c6c-ee1f-481a-be8b-164e67c648d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:29.649542 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59602c6c-ee1f-481a-be8b-164e67c648d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:29.650234 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59602c6c-ee1f-481a-be8b-164e67c648d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:29.650699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59602c6c-ee1f-481a-be8b-164e67c648d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:29.651164 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-59602c6c-ee1f-481a-be8b-164e67c648d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:29.664821 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-59602c6c-ee1f-481a-be8b-164e67c648d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] HTTP exception thrown: Instance 33e700de-c196-4fc6-9792-363dbe3e9b3f could not be found. Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-59602c6c-ee1f-481a-be8b-164e67c648d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Request method failure captured: Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f HTTP/1.1 Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzeYVfZJz-bvpRJpbNxoClgmmS38luZVJYnn1c4uHPDNGT6x9mu_OAgJT7SDXZyhhmmM8HWW0WfRoxBDThE9ODnuq3d1gSBx5-I2qdQNYW8FnNVfSLu7r3kZhvwwaUR1Z_VNwXCKdV70KfkyQVz432u5zXg1J26TiMa6aej16G2Ghw4 Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 36e1c59f75934cc38e904fa0dae0d587 Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36e1c59f75934cc38e904fa0dae0d587"}]}] Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 36e1c59f75934cc38e904fa0dae0d587 Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestNetworkAdvancedServerOps-2051570988-project Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 38e0c4e314274ad0bbdc4125638b0916 Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2051570988-project Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 33e700de-c196-4fc6-9792-363dbe3e9b3f could not be found. Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '33e700de-c196-4fc6-9792-363dbe3e9b3f'} Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e700de-c196-4fc6-9792-363dbe3e9b3f could not be found. Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e700de-c196-4fc6-9792-363dbe3e9b3f could not be found. Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:10:29.666483 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:10:29.671289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:10:29.671289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:10:29.671289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:10:29.671289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:10:29.671289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:10:29.671289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:10:29.671289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e700de-c196-4fc6-9792-363dbe3e9b3f could not be found. Sep 06 12:10:29.671289 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:10:29.671289 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-59602c6c-ee1f-481a-be8b-164e67c648d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Returning 404 to user: Instance 33e700de-c196-4fc6-9792-363dbe3e9b3f could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:10:29.671289 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-59602c6c-ee1f-481a-be8b-164e67c648d0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f" status: 404 len: 111 microversion: 2.1 time: 0.031498 Sep 06 12:10:29.671289 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3671/7380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:29 2022] GET /compute/v2.1/servers/33e700de-c196-4fc6-9792-363dbe3e9b3f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:10:33.421875 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d123ee66-5d19-4795-bd93-3648fc9b6840 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '.version_select at 0x7f90f8e171f0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:33.492822 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d123ee66-5d19-4795-bd93-3648fc9b6840 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1992967068" status: 202 len: 0 microversion: 2.1 time: 0.076272 Sep 06 12:10:33.493425 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3710/7381] 10.222.0.20 () {58 vars in 1284 bytes} [Tue Sep 6 12:10:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1992967068 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:10:33.522609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-19b6274b-f65e-41c1-8e14-6adb90230c33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'create', calling method: .version_select at 0x7f90f3338430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1287376732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWBc1Ch+2ei2yIkRP0KWnhRpxiF9Qiv9cKvRUW4t6X+vGJ7rDuv9AYYh34BQ+kcq9cqF0qB9hTV1P9I4NI/OHH0xhS+SISxwxmq+xk8XzSm/Yc5po0dzmhnzuwmaZuCzA=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:10:33.540675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-19b6274b-f65e-41c1-8e14-6adb90230c33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:10:33.546740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-19b6274b-f65e-41c1-8e14-6adb90230c33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for user 38e0c4e314274ad0bbdc4125638b0916 and project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:10:33.628098 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-19b6274b-f65e-41c1-8e14-6adb90230c33 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.109388 Sep 06 12:10:33.628680 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3672/7382] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 12:10:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:41.374064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1923023229", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "cf897388-c608-4dd6-acbc-b95770fd34d1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1287376732", "security_groups": [{"name": "tempest-secgroup-smoke-1525769112"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:10:41.388835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:41.498918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] validate_networks() for [('cf897388-c608-4dd6-acbc-b95770fd34d1', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:10:41.938844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:10:41.939321 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:10:41.939823 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:10:41.940265 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:10:41.940701 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:10:41.950486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:41.950997 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:41.951509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:41.952269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:41.952749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:41.953203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:41.971484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:10:41.977002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for user 38e0c4e314274ad0bbdc4125638b0916 and project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:10:41.990506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:10:41.992913 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:10:42.116138 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8c0073f4-f2e4-46c2-80ae-8a6a556f479f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.746532 Sep 06 12:10:42.117410 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3711/7383] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 12:10:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:10:42.127538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=16 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:42.132217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-179b06f3-1f38-400f-9871-607f20776e9c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:42.132977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-179b06f3-1f38-400f-9871-607f20776e9c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:42.199370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-179b06f3-1f38-400f-9871-607f20776e9c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:42.207686 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-179b06f3-1f38-400f-9871-607f20776e9c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1267 microversion: 2.1 time: 0.081359 Sep 06 12:10:42.219646 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3673/7384] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:42 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:43.233454 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d4a86837-dbda-447d-99b7-16923326e7d4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:43.234196 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d4a86837-dbda-447d-99b7-16923326e7d4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:43.243367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4a86837-dbda-447d-99b7-16923326e7d4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:43.243882 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4a86837-dbda-447d-99b7-16923326e7d4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:43.244348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4a86837-dbda-447d-99b7-16923326e7d4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:43.245075 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4a86837-dbda-447d-99b7-16923326e7d4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:43.245580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4a86837-dbda-447d-99b7-16923326e7d4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:43.246025 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4a86837-dbda-447d-99b7-16923326e7d4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:43.315460 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d4a86837-dbda-447d-99b7-16923326e7d4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:43.319871 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d4a86837-dbda-447d-99b7-16923326e7d4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1271 microversion: 2.1 time: 0.092910 Sep 06 12:10:43.320976 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3712/7385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:43 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:44.346264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-40ed2ba9-5aff-4795-8ee9-cec7a89c4ef5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:44.346990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-40ed2ba9-5aff-4795-8ee9-cec7a89c4ef5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:44.358111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40ed2ba9-5aff-4795-8ee9-cec7a89c4ef5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:44.358797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40ed2ba9-5aff-4795-8ee9-cec7a89c4ef5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:44.359476 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40ed2ba9-5aff-4795-8ee9-cec7a89c4ef5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:44.360410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40ed2ba9-5aff-4795-8ee9-cec7a89c4ef5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:44.361052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40ed2ba9-5aff-4795-8ee9-cec7a89c4ef5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:44.361670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40ed2ba9-5aff-4795-8ee9-cec7a89c4ef5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:44.454918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-40ed2ba9-5aff-4795-8ee9-cec7a89c4ef5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:44.463633 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-40ed2ba9-5aff-4795-8ee9-cec7a89c4ef5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1337 microversion: 2.1 time: 0.123127 Sep 06 12:10:44.468188 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3674/7386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:44 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1337 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:45.491208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3fd1d37f-48f6-4cd8-845e-854b35785dfb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:45.491845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3fd1d37f-48f6-4cd8-845e-854b35785dfb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:45.498916 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fd1d37f-48f6-4cd8-845e-854b35785dfb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:45.499469 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fd1d37f-48f6-4cd8-845e-854b35785dfb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:45.499932 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fd1d37f-48f6-4cd8-845e-854b35785dfb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:45.500663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fd1d37f-48f6-4cd8-845e-854b35785dfb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:45.501163 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fd1d37f-48f6-4cd8-845e-854b35785dfb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:45.501602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3fd1d37f-48f6-4cd8-845e-854b35785dfb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:45.645960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3fd1d37f-48f6-4cd8-845e-854b35785dfb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:45.654557 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3fd1d37f-48f6-4cd8-845e-854b35785dfb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1393 microversion: 2.1 time: 0.167218 Sep 06 12:10:45.659044 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3713/7387] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:45 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:45.997741 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-969233af-3203-405b-aeac-de90ba65f300 req-37f9e31a-b717-442a-aea7-ed01e0981f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a024d0e5-1e89-483f-9d38-865b0e1bd4eb", "tag": "b1563456-8f8a-4a4a-b22a-3986fccc6527"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:10:46.007636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-969233af-3203-405b-aeac-de90ba65f300 req-37f9e31a-b717-442a-aea7-ed01e0981f84 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:46.008129 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-969233af-3203-405b-aeac-de90ba65f300 req-37f9e31a-b717-442a-aea7-ed01e0981f84 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:46.008744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-969233af-3203-405b-aeac-de90ba65f300 req-37f9e31a-b717-442a-aea7-ed01e0981f84 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:46.020836 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-969233af-3203-405b-aeac-de90ba65f300 req-37f9e31a-b717-442a-aea7-ed01e0981f84 service nova] Creating event network-changed:b1563456-8f8a-4a4a-b22a-3986fccc6527 for instance a024d0e5-1e89-483f-9d38-865b0e1bd4eb on nch1-master-1 Sep 06 12:10:46.025806 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-969233af-3203-405b-aeac-de90ba65f300 req-37f9e31a-b717-442a-aea7-ed01e0981f84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089592 Sep 06 12:10:46.026598 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3675/7388] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:46.732670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-629c99f2-7f32-4f8a-8a93-7c6bb593db4d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:46.733956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-629c99f2-7f32-4f8a-8a93-7c6bb593db4d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:46.740096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-629c99f2-7f32-4f8a-8a93-7c6bb593db4d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:46.740599 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-629c99f2-7f32-4f8a-8a93-7c6bb593db4d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:46.741080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-629c99f2-7f32-4f8a-8a93-7c6bb593db4d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:46.741789 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-629c99f2-7f32-4f8a-8a93-7c6bb593db4d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:46.742263 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-629c99f2-7f32-4f8a-8a93-7c6bb593db4d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:46.742707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-629c99f2-7f32-4f8a-8a93-7c6bb593db4d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:46.877679 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-629c99f2-7f32-4f8a-8a93-7c6bb593db4d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:46.885718 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-629c99f2-7f32-4f8a-8a93-7c6bb593db4d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1393 microversion: 2.1 time: 0.211639 Sep 06 12:10:46.886308 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3714/7389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:46 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1393 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:47.911657 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-77ff24e4-cba9-4c25-96ab-c2a55d0e19de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:47.912365 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-77ff24e4-cba9-4c25-96ab-c2a55d0e19de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:47.918625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77ff24e4-cba9-4c25-96ab-c2a55d0e19de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:47.919162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77ff24e4-cba9-4c25-96ab-c2a55d0e19de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:47.919618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77ff24e4-cba9-4c25-96ab-c2a55d0e19de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:47.920356 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77ff24e4-cba9-4c25-96ab-c2a55d0e19de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:47.921484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77ff24e4-cba9-4c25-96ab-c2a55d0e19de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:47.921929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-77ff24e4-cba9-4c25-96ab-c2a55d0e19de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:48.062260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-77ff24e4-cba9-4c25-96ab-c2a55d0e19de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:48.070119 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-77ff24e4-cba9-4c25-96ab-c2a55d0e19de tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1393 microversion: 2.1 time: 0.163672 Sep 06 12:10:48.070708 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3676/7390] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:47 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:49.094112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-20a0cc9a-2a6d-4a35-b09a-1ec92fa4f545 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:49.094864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-20a0cc9a-2a6d-4a35-b09a-1ec92fa4f545 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:49.104194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a0cc9a-2a6d-4a35-b09a-1ec92fa4f545 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:49.104830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a0cc9a-2a6d-4a35-b09a-1ec92fa4f545 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:49.105280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a0cc9a-2a6d-4a35-b09a-1ec92fa4f545 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:49.106014 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a0cc9a-2a6d-4a35-b09a-1ec92fa4f545 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:49.106495 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a0cc9a-2a6d-4a35-b09a-1ec92fa4f545 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:49.106945 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-20a0cc9a-2a6d-4a35-b09a-1ec92fa4f545 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:49.241511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-20a0cc9a-2a6d-4a35-b09a-1ec92fa4f545 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:49.250250 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-20a0cc9a-2a6d-4a35-b09a-1ec92fa4f545 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1393 microversion: 2.1 time: 0.160058 Sep 06 12:10:49.250852 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3715/7391] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:49 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:50.273844 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5043dd1e-cfa5-4337-a91a-7489943beac7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:50.274470 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5043dd1e-cfa5-4337-a91a-7489943beac7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:50.277353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:50.282926 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5043dd1e-cfa5-4337-a91a-7489943beac7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:50.283490 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5043dd1e-cfa5-4337-a91a-7489943beac7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:50.283916 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5043dd1e-cfa5-4337-a91a-7489943beac7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:50.284618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5043dd1e-cfa5-4337-a91a-7489943beac7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:50.285085 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5043dd1e-cfa5-4337-a91a-7489943beac7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:50.285518 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5043dd1e-cfa5-4337-a91a-7489943beac7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:50.419019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5043dd1e-cfa5-4337-a91a-7489943beac7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:50.426822 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5043dd1e-cfa5-4337-a91a-7489943beac7 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1393 microversion: 2.1 time: 0.156911 Sep 06 12:10:50.427424 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3677/7392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:50 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:51.347626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-ca7246f9-b562-4d0a-8648-8db6963e4560 req-45de7ae0-4a2a-42d9-9a6a-b8cc69b9a159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a024d0e5-1e89-483f-9d38-865b0e1bd4eb", "name": "network-vif-plugged", "status": "completed", "tag": "b1563456-8f8a-4a4a-b22a-3986fccc6527"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:10:51.358607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ca7246f9-b562-4d0a-8648-8db6963e4560 req-45de7ae0-4a2a-42d9-9a6a-b8cc69b9a159 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:51.359148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ca7246f9-b562-4d0a-8648-8db6963e4560 req-45de7ae0-4a2a-42d9-9a6a-b8cc69b9a159 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:51.359628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-ca7246f9-b562-4d0a-8648-8db6963e4560 req-45de7ae0-4a2a-42d9-9a6a-b8cc69b9a159 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:51.371226 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-ca7246f9-b562-4d0a-8648-8db6963e4560 req-45de7ae0-4a2a-42d9-9a6a-b8cc69b9a159 service nova] Creating event network-vif-plugged:b1563456-8f8a-4a4a-b22a-3986fccc6527 for instance a024d0e5-1e89-483f-9d38-865b0e1bd4eb on nch1-master-1 Sep 06 12:10:51.376859 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-ca7246f9-b562-4d0a-8648-8db6963e4560 req-45de7ae0-4a2a-42d9-9a6a-b8cc69b9a159 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032506 Sep 06 12:10:51.380847 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3716/7393] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:51.450113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-889ae3eb-3268-4bf6-bcc7-e79e525f7159 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:51.450737 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-889ae3eb-3268-4bf6-bcc7-e79e525f7159 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:51.458536 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-889ae3eb-3268-4bf6-bcc7-e79e525f7159 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:51.459306 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-889ae3eb-3268-4bf6-bcc7-e79e525f7159 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:51.459920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-889ae3eb-3268-4bf6-bcc7-e79e525f7159 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:51.460792 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-889ae3eb-3268-4bf6-bcc7-e79e525f7159 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:51.461406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-889ae3eb-3268-4bf6-bcc7-e79e525f7159 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:51.462019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-889ae3eb-3268-4bf6-bcc7-e79e525f7159 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:51.603275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-889ae3eb-3268-4bf6-bcc7-e79e525f7159 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:51.611786 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-889ae3eb-3268-4bf6-bcc7-e79e525f7159 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1393 microversion: 2.1 time: 0.165931 Sep 06 12:10:51.612356 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3678/7394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:51 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:52.633520 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:52.634235 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:52.639181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e443b06f-40d0-447c-9714-4bd95c3a50b5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:52.639902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e443b06f-40d0-447c-9714-4bd95c3a50b5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:52.646618 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e443b06f-40d0-447c-9714-4bd95c3a50b5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:52.647154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e443b06f-40d0-447c-9714-4bd95c3a50b5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:52.647626 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e443b06f-40d0-447c-9714-4bd95c3a50b5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:52.648349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e443b06f-40d0-447c-9714-4bd95c3a50b5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:52.648831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e443b06f-40d0-447c-9714-4bd95c3a50b5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:52.649280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e443b06f-40d0-447c-9714-4bd95c3a50b5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:52.785194 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e443b06f-40d0-447c-9714-4bd95c3a50b5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:52.793332 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e443b06f-40d0-447c-9714-4bd95c3a50b5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1393 microversion: 2.1 time: 0.160911 Sep 06 12:10:52.793914 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3717/7395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:52 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:53.816656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9e3e3abd-0e5a-4fa1-a8ef-2becdcd93606 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:53.817281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9e3e3abd-0e5a-4fa1-a8ef-2becdcd93606 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:53.819245 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:53.830618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e3e3abd-0e5a-4fa1-a8ef-2becdcd93606 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:53.830618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e3e3abd-0e5a-4fa1-a8ef-2becdcd93606 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:53.830618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e3e3abd-0e5a-4fa1-a8ef-2becdcd93606 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:53.830618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e3e3abd-0e5a-4fa1-a8ef-2becdcd93606 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:53.830618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e3e3abd-0e5a-4fa1-a8ef-2becdcd93606 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:53.830618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9e3e3abd-0e5a-4fa1-a8ef-2becdcd93606 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:53.965789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9e3e3abd-0e5a-4fa1-a8ef-2becdcd93606 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:53.974249 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9e3e3abd-0e5a-4fa1-a8ef-2becdcd93606 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1566 microversion: 2.1 time: 0.161619 Sep 06 12:10:53.974818 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3679/7396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:53 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:53.999257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dadf83b5-005a-40b3-8947-65f01364e118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:53.999899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dadf83b5-005a-40b3-8947-65f01364e118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:54.007241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dadf83b5-005a-40b3-8947-65f01364e118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:54.007744 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dadf83b5-005a-40b3-8947-65f01364e118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:54.008205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dadf83b5-005a-40b3-8947-65f01364e118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:54.008924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dadf83b5-005a-40b3-8947-65f01364e118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:54.009403 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dadf83b5-005a-40b3-8947-65f01364e118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:54.009850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dadf83b5-005a-40b3-8947-65f01364e118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:54.140783 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dadf83b5-005a-40b3-8947-65f01364e118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:54.149309 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dadf83b5-005a-40b3-8947-65f01364e118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1566 microversion: 2.1 time: 0.154142 Sep 06 12:10:54.151056 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3718/7397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:53 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:10:56.487308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a94a84a6-40db-4205-a464-2ff925966500 req-eddfeb14-6aa4-4087-9051-7dfe77230a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a024d0e5-1e89-483f-9d38-865b0e1bd4eb", "tag": "b1563456-8f8a-4a4a-b22a-3986fccc6527"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:10:56.489508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e74ffd0c-5421-473e-8e29-656c6ad51c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:56.490763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e74ffd0c-5421-473e-8e29-656c6ad51c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:56.497481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:56.500463 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a94a84a6-40db-4205-a464-2ff925966500 req-eddfeb14-6aa4-4087-9051-7dfe77230a7d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:56.500968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a94a84a6-40db-4205-a464-2ff925966500 req-eddfeb14-6aa4-4087-9051-7dfe77230a7d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:56.501433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a94a84a6-40db-4205-a464-2ff925966500 req-eddfeb14-6aa4-4087-9051-7dfe77230a7d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:56.504811 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e74ffd0c-5421-473e-8e29-656c6ad51c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:56.509695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e74ffd0c-5421-473e-8e29-656c6ad51c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:56.509695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e74ffd0c-5421-473e-8e29-656c6ad51c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:56.509695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e74ffd0c-5421-473e-8e29-656c6ad51c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:56.509695 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e74ffd0c-5421-473e-8e29-656c6ad51c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:56.510752 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e74ffd0c-5421-473e-8e29-656c6ad51c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:56.514650 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a94a84a6-40db-4205-a464-2ff925966500 req-eddfeb14-6aa4-4087-9051-7dfe77230a7d service nova] Creating event network-changed:b1563456-8f8a-4a4a-b22a-3986fccc6527 for instance a024d0e5-1e89-483f-9d38-865b0e1bd4eb on nch1-master-1 Sep 06 12:10:56.520988 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a94a84a6-40db-4205-a464-2ff925966500 req-eddfeb14-6aa4-4087-9051-7dfe77230a7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037230 Sep 06 12:10:56.523358 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3719/7398] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:10:56.681199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e74ffd0c-5421-473e-8e29-656c6ad51c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:56.690952 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e74ffd0c-5421-473e-8e29-656c6ad51c2d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1566 microversion: 2.1 time: 0.208737 Sep 06 12:10:56.698174 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3680/7399] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:56 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:17.949888 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=42 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:17.955148 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1208f02c-8e84-4a70-96ce-1bac250cd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:11:17.958031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1208f02c-8e84-4a70-96ce-1bac250cd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:17.965475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1208f02c-8e84-4a70-96ce-1bac250cd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:17.966608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1208f02c-8e84-4a70-96ce-1bac250cd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:17.966608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1208f02c-8e84-4a70-96ce-1bac250cd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:17.967188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1208f02c-8e84-4a70-96ce-1bac250cd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:17.967672 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1208f02c-8e84-4a70-96ce-1bac250cd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:17.968128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1208f02c-8e84-4a70-96ce-1bac250cd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:18.021717 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1208f02c-8e84-4a70-96ce-1bac250cd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb/action" status: 200 len: 24573 microversion: 2.1 time: 0.073898 Sep 06 12:11:18.022382 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3720/7400] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:11:17 2022] POST /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:11:29.040227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4a9574d3-c7ab-43aa-b37f-3a0d7521039d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:11:29.042352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=7 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:29.043199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=38 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:29.048501 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a9574d3-c7ab-43aa-b37f-3a0d7521039d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:29.048991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a9574d3-c7ab-43aa-b37f-3a0d7521039d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:29.049439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4a9574d3-c7ab-43aa-b37f-3a0d7521039d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:29.073056 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4a9574d3-c7ab-43aa-b37f-3a0d7521039d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Going to try to stop instance {{(pid=140875) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 12:11:29.269393 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4a9574d3-c7ab-43aa-b37f-3a0d7521039d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb/action" status: 202 len: 0 microversion: 2.1 time: 0.233148 Sep 06 12:11:29.270253 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3681/7401] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:11:29 2022] POST /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:11:29.279808 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a75e66bc-6ca8-4aee-a3f6-b33cc6153e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:29.280580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a75e66bc-6ca8-4aee-a3f6-b33cc6153e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:29.283883 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:29.290344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a75e66bc-6ca8-4aee-a3f6-b33cc6153e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:29.291002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a75e66bc-6ca8-4aee-a3f6-b33cc6153e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:29.291350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a75e66bc-6ca8-4aee-a3f6-b33cc6153e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:29.292091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a75e66bc-6ca8-4aee-a3f6-b33cc6153e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:29.292700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a75e66bc-6ca8-4aee-a3f6-b33cc6153e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:29.293153 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a75e66bc-6ca8-4aee-a3f6-b33cc6153e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:29.438346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a75e66bc-6ca8-4aee-a3f6-b33cc6153e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:29.447836 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a75e66bc-6ca8-4aee-a3f6-b33cc6153e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1695 microversion: 2.1 time: 0.171682 Sep 06 12:11:29.448546 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3721/7402] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:29 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:30.480848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3c1ac244-3915-408d-8026-572634f7a58c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:30.481584 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3c1ac244-3915-408d-8026-572634f7a58c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:30.489939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c1ac244-3915-408d-8026-572634f7a58c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:30.490439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c1ac244-3915-408d-8026-572634f7a58c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:30.490885 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c1ac244-3915-408d-8026-572634f7a58c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:30.491639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c1ac244-3915-408d-8026-572634f7a58c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:30.492105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c1ac244-3915-408d-8026-572634f7a58c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:30.492735 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3c1ac244-3915-408d-8026-572634f7a58c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:30.627960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3c1ac244-3915-408d-8026-572634f7a58c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:30.635865 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3c1ac244-3915-408d-8026-572634f7a58c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1695 microversion: 2.1 time: 0.164045 Sep 06 12:11:30.636453 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3682/7403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:30 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:31.660807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-64bf3de9-b76c-4f70-80c4-0edef29e4e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:31.661439 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-64bf3de9-b76c-4f70-80c4-0edef29e4e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:31.668666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64bf3de9-b76c-4f70-80c4-0edef29e4e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:31.669172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64bf3de9-b76c-4f70-80c4-0edef29e4e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:31.669634 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64bf3de9-b76c-4f70-80c4-0edef29e4e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:31.670357 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64bf3de9-b76c-4f70-80c4-0edef29e4e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:31.670833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64bf3de9-b76c-4f70-80c4-0edef29e4e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:31.671315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-64bf3de9-b76c-4f70-80c4-0edef29e4e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:31.805937 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-64bf3de9-b76c-4f70-80c4-0edef29e4e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:31.813992 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-64bf3de9-b76c-4f70-80c4-0edef29e4e44 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1695 microversion: 2.1 time: 0.157631 Sep 06 12:11:31.814470 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3722/7404] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:31 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:32.838131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-0c8a8c66-60f7-41a8-97d4-39550c7077bb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:32.838748 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-0c8a8c66-60f7-41a8-97d4-39550c7077bb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:32.845566 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c8a8c66-60f7-41a8-97d4-39550c7077bb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:32.846053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c8a8c66-60f7-41a8-97d4-39550c7077bb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:32.846496 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c8a8c66-60f7-41a8-97d4-39550c7077bb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:32.847249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c8a8c66-60f7-41a8-97d4-39550c7077bb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:32.847714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c8a8c66-60f7-41a8-97d4-39550c7077bb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:32.848173 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-0c8a8c66-60f7-41a8-97d4-39550c7077bb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:32.979892 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-0c8a8c66-60f7-41a8-97d4-39550c7077bb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:32.987700 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-0c8a8c66-60f7-41a8-97d4-39550c7077bb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1695 microversion: 2.1 time: 0.153567 Sep 06 12:11:32.988269 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3683/7405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:32 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:34.012170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1fbe28a6-365c-4ded-bb5a-769b3b833489 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:34.012800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1fbe28a6-365c-4ded-bb5a-769b3b833489 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:34.019798 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbe28a6-365c-4ded-bb5a-769b3b833489 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:34.020302 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbe28a6-365c-4ded-bb5a-769b3b833489 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:34.021474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbe28a6-365c-4ded-bb5a-769b3b833489 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:34.022197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbe28a6-365c-4ded-bb5a-769b3b833489 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:34.022686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbe28a6-365c-4ded-bb5a-769b3b833489 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:34.023170 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1fbe28a6-365c-4ded-bb5a-769b3b833489 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:34.160812 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1fbe28a6-365c-4ded-bb5a-769b3b833489 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:34.169048 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1fbe28a6-365c-4ded-bb5a-769b3b833489 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1695 microversion: 2.1 time: 0.160895 Sep 06 12:11:34.169973 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3723/7406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:34 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:35.193556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5ebfeee5-cb1d-4a85-a0bc-3e84bba032ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:35.194167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5ebfeee5-cb1d-4a85-a0bc-3e84bba032ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:35.201315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ebfeee5-cb1d-4a85-a0bc-3e84bba032ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:35.201781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ebfeee5-cb1d-4a85-a0bc-3e84bba032ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:35.202232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ebfeee5-cb1d-4a85-a0bc-3e84bba032ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:35.203090 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ebfeee5-cb1d-4a85-a0bc-3e84bba032ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:35.203485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ebfeee5-cb1d-4a85-a0bc-3e84bba032ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:35.203918 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5ebfeee5-cb1d-4a85-a0bc-3e84bba032ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:35.336215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5ebfeee5-cb1d-4a85-a0bc-3e84bba032ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:35.343961 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5ebfeee5-cb1d-4a85-a0bc-3e84bba032ac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1695 microversion: 2.1 time: 0.154576 Sep 06 12:11:35.344536 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3684/7407] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:35 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:36.367586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4c78296f-14ec-4616-8040-57760f0a2c7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:36.368828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4c78296f-14ec-4616-8040-57760f0a2c7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:36.375956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c78296f-14ec-4616-8040-57760f0a2c7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:36.376462 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c78296f-14ec-4616-8040-57760f0a2c7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:36.376923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c78296f-14ec-4616-8040-57760f0a2c7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:36.377643 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c78296f-14ec-4616-8040-57760f0a2c7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:36.378126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c78296f-14ec-4616-8040-57760f0a2c7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:36.378571 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4c78296f-14ec-4616-8040-57760f0a2c7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:36.509586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4c78296f-14ec-4616-8040-57760f0a2c7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:36.517489 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4c78296f-14ec-4616-8040-57760f0a2c7e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1695 microversion: 2.1 time: 0.153858 Sep 06 12:11:36.518066 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3724/7408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:36 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:37.542050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-79814d8e-075a-416f-badf-32e65d6f8329 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:37.542711 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-79814d8e-075a-416f-badf-32e65d6f8329 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:37.549614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79814d8e-075a-416f-badf-32e65d6f8329 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:37.550109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79814d8e-075a-416f-badf-32e65d6f8329 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:37.550568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79814d8e-075a-416f-badf-32e65d6f8329 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:37.551307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79814d8e-075a-416f-badf-32e65d6f8329 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:37.551771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79814d8e-075a-416f-badf-32e65d6f8329 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:37.552210 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-79814d8e-075a-416f-badf-32e65d6f8329 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:37.993613 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-79814d8e-075a-416f-badf-32e65d6f8329 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:38.001437 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-79814d8e-075a-416f-badf-32e65d6f8329 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1695 microversion: 2.1 time: 0.463934 Sep 06 12:11:38.002015 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3685/7409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:37 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1695 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:39.025577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-852d6960-848b-4c30-a0f4-82ffc8fd7674 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:39.026203 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-852d6960-848b-4c30-a0f4-82ffc8fd7674 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:39.033157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-852d6960-848b-4c30-a0f4-82ffc8fd7674 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:39.033655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-852d6960-848b-4c30-a0f4-82ffc8fd7674 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:39.034113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-852d6960-848b-4c30-a0f4-82ffc8fd7674 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:39.034848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-852d6960-848b-4c30-a0f4-82ffc8fd7674 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:39.035348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-852d6960-848b-4c30-a0f4-82ffc8fd7674 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:39.035793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-852d6960-848b-4c30-a0f4-82ffc8fd7674 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:39.167592 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-852d6960-848b-4c30-a0f4-82ffc8fd7674 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:39.175405 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-852d6960-848b-4c30-a0f4-82ffc8fd7674 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1695 microversion: 2.1 time: 0.154375 Sep 06 12:11:39.175986 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3725/7410] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:39 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:40.200406 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-592f8181-f9f9-4015-8dcd-349bb61c7e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:40.201049 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-592f8181-f9f9-4015-8dcd-349bb61c7e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:40.208072 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-592f8181-f9f9-4015-8dcd-349bb61c7e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:40.208565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-592f8181-f9f9-4015-8dcd-349bb61c7e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:40.209009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-592f8181-f9f9-4015-8dcd-349bb61c7e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:40.209708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-592f8181-f9f9-4015-8dcd-349bb61c7e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:40.210167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-592f8181-f9f9-4015-8dcd-349bb61c7e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:40.210605 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-592f8181-f9f9-4015-8dcd-349bb61c7e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:40.347277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-592f8181-f9f9-4015-8dcd-349bb61c7e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:40.355823 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-592f8181-f9f9-4015-8dcd-349bb61c7e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1695 microversion: 2.1 time: 0.159856 Sep 06 12:11:40.356402 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3686/7411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:40 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:41.379295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-baa1ef93-c75f-4093-8bb0-9ae6d5950ee2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:41.379933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-baa1ef93-c75f-4093-8bb0-9ae6d5950ee2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:41.387072 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-baa1ef93-c75f-4093-8bb0-9ae6d5950ee2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:41.387606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-baa1ef93-c75f-4093-8bb0-9ae6d5950ee2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:41.388070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-baa1ef93-c75f-4093-8bb0-9ae6d5950ee2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:41.388788 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-baa1ef93-c75f-4093-8bb0-9ae6d5950ee2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:41.389274 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-baa1ef93-c75f-4093-8bb0-9ae6d5950ee2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:41.389727 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-baa1ef93-c75f-4093-8bb0-9ae6d5950ee2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:41.525314 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-baa1ef93-c75f-4093-8bb0-9ae6d5950ee2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:41.533225 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-baa1ef93-c75f-4093-8bb0-9ae6d5950ee2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1695 microversion: 2.1 time: 0.157931 Sep 06 12:11:41.542565 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3726/7412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:41 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:42.558175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-51816405-2b29-4e98-b3ab-a3019160b676 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:42.558796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-51816405-2b29-4e98-b3ab-a3019160b676 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:42.565920 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51816405-2b29-4e98-b3ab-a3019160b676 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:42.566358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51816405-2b29-4e98-b3ab-a3019160b676 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:42.566812 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51816405-2b29-4e98-b3ab-a3019160b676 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:42.567543 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51816405-2b29-4e98-b3ab-a3019160b676 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:42.568015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51816405-2b29-4e98-b3ab-a3019160b676 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:42.568459 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-51816405-2b29-4e98-b3ab-a3019160b676 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:42.735388 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-51816405-2b29-4e98-b3ab-a3019160b676 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:42.735388 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-51816405-2b29-4e98-b3ab-a3019160b676 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1695 microversion: 2.1 time: 0.166035 Sep 06 12:11:42.735388 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3687/7413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:42 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:43.751985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ded330aa-485e-4437-a1a4-dfba71906565 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:43.752654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ded330aa-485e-4437-a1a4-dfba71906565 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:43.760090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ded330aa-485e-4437-a1a4-dfba71906565 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:43.760597 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ded330aa-485e-4437-a1a4-dfba71906565 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:43.761068 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ded330aa-485e-4437-a1a4-dfba71906565 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:43.761792 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ded330aa-485e-4437-a1a4-dfba71906565 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:43.762273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ded330aa-485e-4437-a1a4-dfba71906565 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:43.762728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ded330aa-485e-4437-a1a4-dfba71906565 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:43.907083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ded330aa-485e-4437-a1a4-dfba71906565 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:43.915346 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ded330aa-485e-4437-a1a4-dfba71906565 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1695 microversion: 2.1 time: 0.167326 Sep 06 12:11:43.915944 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3727/7414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:43 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:44.939499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ba6f66d9-6ca2-4192-b6e6-7b5d3efd1bf8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:44.940127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ba6f66d9-6ca2-4192-b6e6-7b5d3efd1bf8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:44.946559 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba6f66d9-6ca2-4192-b6e6-7b5d3efd1bf8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:44.947115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba6f66d9-6ca2-4192-b6e6-7b5d3efd1bf8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:44.947533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba6f66d9-6ca2-4192-b6e6-7b5d3efd1bf8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:44.948510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba6f66d9-6ca2-4192-b6e6-7b5d3efd1bf8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:44.949019 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba6f66d9-6ca2-4192-b6e6-7b5d3efd1bf8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:44.949419 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ba6f66d9-6ca2-4192-b6e6-7b5d3efd1bf8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:45.088180 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ba6f66d9-6ca2-4192-b6e6-7b5d3efd1bf8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:45.096230 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ba6f66d9-6ca2-4192-b6e6-7b5d3efd1bf8 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1672 microversion: 2.1 time: 0.160676 Sep 06 12:11:45.096819 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3688/7415] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:44 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:46.193810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b15676c0-d370-4ec1-b499-6fce29633118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:11:46.196638 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b15676c0-d370-4ec1-b499-6fce29633118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:46.205155 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b15676c0-d370-4ec1-b499-6fce29633118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:46.205671 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b15676c0-d370-4ec1-b499-6fce29633118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:46.206830 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b15676c0-d370-4ec1-b499-6fce29633118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:46.206985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b15676c0-d370-4ec1-b499-6fce29633118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:46.207459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b15676c0-d370-4ec1-b499-6fce29633118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:46.207914 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b15676c0-d370-4ec1-b499-6fce29633118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:46.263479 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b15676c0-d370-4ec1-b499-6fce29633118 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb/action" status: 200 len: 38486 microversion: 2.1 time: 0.073546 Sep 06 12:11:46.264156 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3728/7416] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:11:46 2022] POST /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb/action => generated 38486 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:11:46.276364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6b35e190-0927-417d-8c13-9503e4ca82cb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:11:46.283386 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b35e190-0927-417d-8c13-9503e4ca82cb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:46.283877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b35e190-0927-417d-8c13-9503e4ca82cb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:46.284320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6b35e190-0927-417d-8c13-9503e4ca82cb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:46.307789 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6b35e190-0927-417d-8c13-9503e4ca82cb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Going to try to start instance {{(pid=140875) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 12:11:46.486889 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6b35e190-0927-417d-8c13-9503e4ca82cb tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb/action" status: 202 len: 0 microversion: 2.1 time: 0.214026 Sep 06 12:11:46.487461 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3689/7417] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:11:46 2022] POST /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:11:46.497352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b4b38eee-243e-4aff-aab0-224c84c9da04 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:46.498090 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b4b38eee-243e-4aff-aab0-224c84c9da04 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:46.505389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b38eee-243e-4aff-aab0-224c84c9da04 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:46.505902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b38eee-243e-4aff-aab0-224c84c9da04 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:46.506373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b38eee-243e-4aff-aab0-224c84c9da04 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:46.507250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b38eee-243e-4aff-aab0-224c84c9da04 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:46.507737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b38eee-243e-4aff-aab0-224c84c9da04 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:46.508245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b4b38eee-243e-4aff-aab0-224c84c9da04 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:46.646999 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b4b38eee-243e-4aff-aab0-224c84c9da04 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:46.655092 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b4b38eee-243e-4aff-aab0-224c84c9da04 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1681 microversion: 2.1 time: 0.162793 Sep 06 12:11:46.655990 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3729/7418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:46 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:47.681120 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2859b33c-1d71-414f-a8fd-69d54dd2d331 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:47.681891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2859b33c-1d71-414f-a8fd-69d54dd2d331 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:47.689256 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2859b33c-1d71-414f-a8fd-69d54dd2d331 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:47.689802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2859b33c-1d71-414f-a8fd-69d54dd2d331 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:47.690253 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2859b33c-1d71-414f-a8fd-69d54dd2d331 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:47.690971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2859b33c-1d71-414f-a8fd-69d54dd2d331 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:47.691479 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2859b33c-1d71-414f-a8fd-69d54dd2d331 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:47.691894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2859b33c-1d71-414f-a8fd-69d54dd2d331 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:47.833103 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2859b33c-1d71-414f-a8fd-69d54dd2d331 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:47.841889 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2859b33c-1d71-414f-a8fd-69d54dd2d331 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1685 microversion: 2.1 time: 0.165693 Sep 06 12:11:47.842470 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3690/7419] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:47 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:12.032236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e66993db-96da-4ae5-9918-dbe656e0a301 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:12:12.034455 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e66993db-96da-4ae5-9918-dbe656e0a301 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:12.037481 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=21 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:12.038164 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=52 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:12.044658 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e66993db-96da-4ae5-9918-dbe656e0a301 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:12.045161 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e66993db-96da-4ae5-9918-dbe656e0a301 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:12.045649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e66993db-96da-4ae5-9918-dbe656e0a301 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:12.046370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e66993db-96da-4ae5-9918-dbe656e0a301 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:12.046869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e66993db-96da-4ae5-9918-dbe656e0a301 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:12.047353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e66993db-96da-4ae5-9918-dbe656e0a301 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:12.101480 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e66993db-96da-4ae5-9918-dbe656e0a301 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb/action" status: 200 len: 63047 microversion: 2.1 time: 0.072923 Sep 06 12:12:12.102085 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3730/7420] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:12:12 2022] POST /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb/action => generated 63047 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:12:19.282138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3e812775-258f-4743-b12e-821b7a1bbfcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:19.287594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3e812775-258f-4743-b12e-821b7a1bbfcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:19.287713 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-33d03e40-4463-431e-96be-19fa019a7bb5 req-bada512a-f2ba-4392-a35b-02342e1ca8bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a024d0e5-1e89-483f-9d38-865b0e1bd4eb", "tag": "b1563456-8f8a-4a4a-b22a-3986fccc6527"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:12:19.288138 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=20 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:19.289444 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:19.298225 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e812775-258f-4743-b12e-821b7a1bbfcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:19.299284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e812775-258f-4743-b12e-821b7a1bbfcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:19.299813 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e812775-258f-4743-b12e-821b7a1bbfcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:19.301111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e812775-258f-4743-b12e-821b7a1bbfcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:19.301919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e812775-258f-4743-b12e-821b7a1bbfcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:19.302667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3e812775-258f-4743-b12e-821b7a1bbfcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:19.305088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-33d03e40-4463-431e-96be-19fa019a7bb5 req-bada512a-f2ba-4392-a35b-02342e1ca8bc service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:19.306348 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-33d03e40-4463-431e-96be-19fa019a7bb5 req-bada512a-f2ba-4392-a35b-02342e1ca8bc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:19.306907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-33d03e40-4463-431e-96be-19fa019a7bb5 req-bada512a-f2ba-4392-a35b-02342e1ca8bc service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:19.329184 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-33d03e40-4463-431e-96be-19fa019a7bb5 req-bada512a-f2ba-4392-a35b-02342e1ca8bc service nova] Creating event network-changed:b1563456-8f8a-4a4a-b22a-3986fccc6527 for instance a024d0e5-1e89-483f-9d38-865b0e1bd4eb on nch1-master-1 Sep 06 12:12:19.337423 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-33d03e40-4463-431e-96be-19fa019a7bb5 req-bada512a-f2ba-4392-a35b-02342e1ca8bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059226 Sep 06 12:12:19.338410 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3731/7421] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:12:19.363555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3e812775-258f-4743-b12e-821b7a1bbfcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:12:19.580411 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3e812775-258f-4743-b12e-821b7a1bbfcc tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 204 len: 0 microversion: 2.1 time: 0.305651 Sep 06 12:12:19.587108 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3691/7422] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 12:12:19 2022] DELETE /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 12:12:19.590923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-97695fb0-726c-4d8f-8f0e-9740e2625712 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:19.591797 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-97695fb0-726c-4d8f-8f0e-9740e2625712 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:19.598494 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97695fb0-726c-4d8f-8f0e-9740e2625712 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:19.599105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97695fb0-726c-4d8f-8f0e-9740e2625712 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:19.599810 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97695fb0-726c-4d8f-8f0e-9740e2625712 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:19.600936 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97695fb0-726c-4d8f-8f0e-9740e2625712 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:19.601646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97695fb0-726c-4d8f-8f0e-9740e2625712 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:19.602294 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-97695fb0-726c-4d8f-8f0e-9740e2625712 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:19.760049 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-97695fb0-726c-4d8f-8f0e-9740e2625712 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:19.768636 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-97695fb0-726c-4d8f-8f0e-9740e2625712 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1691 microversion: 2.1 time: 0.182578 Sep 06 12:12:19.769420 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3732/7423] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:19 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:20.794569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-91462236-0e9f-4d51-b060-4d88a3864e05 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:20.795307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-91462236-0e9f-4d51-b060-4d88a3864e05 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:20.802130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91462236-0e9f-4d51-b060-4d88a3864e05 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:20.802624 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91462236-0e9f-4d51-b060-4d88a3864e05 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:20.803092 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91462236-0e9f-4d51-b060-4d88a3864e05 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:20.803796 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91462236-0e9f-4d51-b060-4d88a3864e05 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:20.804265 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91462236-0e9f-4d51-b060-4d88a3864e05 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:20.804703 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-91462236-0e9f-4d51-b060-4d88a3864e05 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:20.943528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-91462236-0e9f-4d51-b060-4d88a3864e05 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:20.952250 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-91462236-0e9f-4d51-b060-4d88a3864e05 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1691 microversion: 2.1 time: 0.162660 Sep 06 12:12:20.952848 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3692/7424] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:20 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:21.631201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-5c74fbd3-aae6-43d4-9213-b812bbed62a2 req-d7c7eeeb-c04f-416d-b03f-c9fff31a3740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a024d0e5-1e89-483f-9d38-865b0e1bd4eb", "name": "network-vif-deleted", "tag": "b1563456-8f8a-4a4a-b22a-3986fccc6527"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:12:21.641632 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5c74fbd3-aae6-43d4-9213-b812bbed62a2 req-d7c7eeeb-c04f-416d-b03f-c9fff31a3740 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:21.642128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5c74fbd3-aae6-43d4-9213-b812bbed62a2 req-d7c7eeeb-c04f-416d-b03f-c9fff31a3740 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:21.642573 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5c74fbd3-aae6-43d4-9213-b812bbed62a2 req-d7c7eeeb-c04f-416d-b03f-c9fff31a3740 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:21.655337 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-5c74fbd3-aae6-43d4-9213-b812bbed62a2 req-d7c7eeeb-c04f-416d-b03f-c9fff31a3740 service nova] Creating event network-vif-deleted:b1563456-8f8a-4a4a-b22a-3986fccc6527 for instance a024d0e5-1e89-483f-9d38-865b0e1bd4eb on nch1-master-1 Sep 06 12:12:21.660471 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-5c74fbd3-aae6-43d4-9213-b812bbed62a2 req-d7c7eeeb-c04f-416d-b03f-c9fff31a3740 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033032 Sep 06 12:12:21.661061 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3733/7425] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:12:21.976619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:21.977249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:21.984643 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:21.988836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:21.988836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:21.988836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:21.988836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:21.988836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:22.022615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:22.023136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:22.023654 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:22.024283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lazy-loading 'fault' on Instance uuid a024d0e5-1e89-483f-9d38-865b0e1bd4eb {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:12:22.071077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:22.080918 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-351baf07-2323-4adf-81b9-52810970f589 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 200 len: 1357 microversion: 2.1 time: 0.108640 Sep 06 12:12:22.095061 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3693/7426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:21 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 1357 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:23.114149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7626c57d-6115-472d-942d-a22c2175f00b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:23.114876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7626c57d-6115-472d-942d-a22c2175f00b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: a024d0e5-1e89-483f-9d38-865b0e1bd4eb] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:23.121965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7626c57d-6115-472d-942d-a22c2175f00b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:23.127718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7626c57d-6115-472d-942d-a22c2175f00b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:23.127718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7626c57d-6115-472d-942d-a22c2175f00b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:23.127718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7626c57d-6115-472d-942d-a22c2175f00b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:23.127718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7626c57d-6115-472d-942d-a22c2175f00b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:23.127718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7626c57d-6115-472d-942d-a22c2175f00b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:23.138742 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-7626c57d-6115-472d-942d-a22c2175f00b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] HTTP exception thrown: Instance a024d0e5-1e89-483f-9d38-865b0e1bd4eb could not be found. Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7626c57d-6115-472d-942d-a22c2175f00b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Request method failure captured: Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb HTTP/1.1 Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzeYVfZJz-bvpRJpbNxoClgmmS38luZVJYnn1c4uHPDNGT6x9mu_OAgJT7SDXZyhhmmM8HWW0WfRoxBDThE9ODnuq3d1gSBx5-I2qdQNYW8FnNVfSLu7r3kZhvwwaUR1Z_VNwXCKdV70KfkyQVz432u5zXg1J26TiMa6aej16G2Ghw4 Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 36e1c59f75934cc38e904fa0dae0d587 Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36e1c59f75934cc38e904fa0dae0d587"}]}] Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 36e1c59f75934cc38e904fa0dae0d587 Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TestNetworkAdvancedServerOps-2051570988-project Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 38e0c4e314274ad0bbdc4125638b0916 Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2051570988-project Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance a024d0e5-1e89-483f-9d38-865b0e1bd4eb could not be found. Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'a024d0e5-1e89-483f-9d38-865b0e1bd4eb'} Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a024d0e5-1e89-483f-9d38-865b0e1bd4eb could not be found. Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a024d0e5-1e89-483f-9d38-865b0e1bd4eb could not be found. Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:12:23.140440 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:12:23.146264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:12:23.146264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:12:23.146264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:12:23.146264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:12:23.146264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:12:23.146264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:12:23.146264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a024d0e5-1e89-483f-9d38-865b0e1bd4eb could not be found. Sep 06 12:12:23.146264 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:12:23.146264 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7626c57d-6115-472d-942d-a22c2175f00b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Returning 404 to user: Instance a024d0e5-1e89-483f-9d38-865b0e1bd4eb could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:12:23.146264 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7626c57d-6115-472d-942d-a22c2175f00b tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb" status: 404 len: 111 microversion: 2.1 time: 0.033020 Sep 06 12:12:23.146264 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3734/7427] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:23 2022] GET /compute/v2.1/servers/a024d0e5-1e89-483f-9d38-865b0e1bd4eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:12:27.071192 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b00cd648-7d69-4491-931a-89a148ddede5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '.version_select at 0x7f90f8d94a60>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:27.157551 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b00cd648-7d69-4491-931a-89a148ddede5 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1287376732" status: 202 len: 0 microversion: 2.1 time: 0.090732 Sep 06 12:12:27.158057 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3694/7428] 10.222.0.20 () {58 vars in 1284 bytes} [Tue Sep 6 12:12:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1287376732 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:12:27.192879 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2bb0567e-73ff-458c-ba35-99d2a4cbaaa2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'create', calling method: .version_select at 0x7f90f8a85e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-197138023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgIbLGjs2QXMIQa79VnyCWRgEIMCa4suBhkLU+8RPyuDr1Q2lfVB/sy0sUY0KuT9CIBc+akAtL1o8uT4YEeUYtU0+Iji+Ly4O+zO7xwmWD2ioCaboqcbxNGlOwBd41XPQ=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:12:27.210941 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-2bb0567e-73ff-458c-ba35-99d2a4cbaaa2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:12:27.216288 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-2bb0567e-73ff-458c-ba35-99d2a4cbaaa2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for user 38e0c4e314274ad0bbdc4125638b0916 and project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:12:27.324373 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2bb0567e-73ff-458c-ba35-99d2a4cbaaa2 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.135405 Sep 06 12:12:27.324990 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3735/7429] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 12:12:27 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:12:35.194312 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:35.198948 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-342401165", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "networks": [{"uuid": "1a1a84a9-3f53-4079-ac69-781040fe73db"}], "key_name": "tempest-TestNetworkAdvancedServerOps-197138023", "security_groups": [{"name": "tempest-secgroup-smoke-944437579"}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:12:35.318619 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] validate_networks() for [('1a1a84a9-3f53-4079-ac69-781040fe73db', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:12:35.806431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:12:35.806867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:12:35.807373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:12:35.807791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:12:35.808271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:12:35.818767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:35.819364 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:35.819924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:35.820869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:35.821563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:35.822065 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:35.845443 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:12:35.851373 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Getting quotas for user 38e0c4e314274ad0bbdc4125638b0916 and project 36e1c59f75934cc38e904fa0dae0d587. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:12:35.866794 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:12:35.869671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:12:36.042096 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [428d1555-7861-45d9-8351-2804dbcf1ad1] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 12:12:37.052546 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [428d1555-7861-45d9-8351-2804dbcf1ad1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35590. Sep 06 12:12:37.059462 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9f6fb333-5bec-4159-be53-d6180bf817cf tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.866798 Sep 06 12:12:37.066989 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3695/7430] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 12:12:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:12:37.072408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=16 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:37.080874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-da75595a-75e1-4346-a91d-eac45ca54bac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:37.083113 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-da75595a-75e1-4346-a91d-eac45ca54bac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:37.153246 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-da75595a-75e1-4346-a91d-eac45ca54bac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:37.162027 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-da75595a-75e1-4346-a91d-eac45ca54bac tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1265 microversion: 2.1 time: 0.092921 Sep 06 12:12:37.162695 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3736/7431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:37 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:38.187820 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2512ac49-baa5-4585-b1a1-9bd96d37e242 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:38.189166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2512ac49-baa5-4585-b1a1-9bd96d37e242 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:38.197482 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2512ac49-baa5-4585-b1a1-9bd96d37e242 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:38.199528 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2512ac49-baa5-4585-b1a1-9bd96d37e242 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:38.200377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2512ac49-baa5-4585-b1a1-9bd96d37e242 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:38.201774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2512ac49-baa5-4585-b1a1-9bd96d37e242 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:38.202527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2512ac49-baa5-4585-b1a1-9bd96d37e242 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:38.203139 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2512ac49-baa5-4585-b1a1-9bd96d37e242 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:38.280345 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2512ac49-baa5-4585-b1a1-9bd96d37e242 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:38.289151 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2512ac49-baa5-4585-b1a1-9bd96d37e242 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1269 microversion: 2.1 time: 0.107141 Sep 06 12:12:38.290125 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3696/7432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:38 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1269 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:39.312664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-b5e4fa36-12b7-458e-a852-583378dde941 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:39.313346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-b5e4fa36-12b7-458e-a852-583378dde941 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:39.324509 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5e4fa36-12b7-458e-a852-583378dde941 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:39.325021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5e4fa36-12b7-458e-a852-583378dde941 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:39.325482 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5e4fa36-12b7-458e-a852-583378dde941 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:39.326215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5e4fa36-12b7-458e-a852-583378dde941 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:39.326705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5e4fa36-12b7-458e-a852-583378dde941 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:39.327183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-b5e4fa36-12b7-458e-a852-583378dde941 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:39.391293 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-b5e4fa36-12b7-458e-a852-583378dde941 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:39.399335 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-b5e4fa36-12b7-458e-a852-583378dde941 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1335 microversion: 2.1 time: 0.090755 Sep 06 12:12:39.399926 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3737/7433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:39 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1335 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:40.426181 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b7ce10a9-dc20-40af-a13a-96d11e0bc6aa tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:40.433898 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b7ce10a9-dc20-40af-a13a-96d11e0bc6aa tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:40.441586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ce10a9-dc20-40af-a13a-96d11e0bc6aa tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:40.442086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ce10a9-dc20-40af-a13a-96d11e0bc6aa tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:40.445873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ce10a9-dc20-40af-a13a-96d11e0bc6aa tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:40.445873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ce10a9-dc20-40af-a13a-96d11e0bc6aa tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:40.445873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ce10a9-dc20-40af-a13a-96d11e0bc6aa tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:40.445873 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b7ce10a9-dc20-40af-a13a-96d11e0bc6aa tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:40.578434 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b7ce10a9-dc20-40af-a13a-96d11e0bc6aa tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:40.586644 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b7ce10a9-dc20-40af-a13a-96d11e0bc6aa tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1390 microversion: 2.1 time: 0.166078 Sep 06 12:12:40.587276 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3697/7434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:40 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:40.778223 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-4074479d-b126-41a3-845d-e0f87f2fe8e9 req-0e00cac1-4469-4e48-8f64-85b902cc8ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122f685e-782e-4aeb-bfc2-92308542f353", "tag": "cfaa3ea3-b440-472f-abcd-1fcae8857162"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:12:40.789726 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4074479d-b126-41a3-845d-e0f87f2fe8e9 req-0e00cac1-4469-4e48-8f64-85b902cc8ea9 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:40.790279 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4074479d-b126-41a3-845d-e0f87f2fe8e9 req-0e00cac1-4469-4e48-8f64-85b902cc8ea9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:40.790772 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-4074479d-b126-41a3-845d-e0f87f2fe8e9 req-0e00cac1-4469-4e48-8f64-85b902cc8ea9 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:40.804473 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-4074479d-b126-41a3-845d-e0f87f2fe8e9 req-0e00cac1-4469-4e48-8f64-85b902cc8ea9 service nova] Creating event network-changed:cfaa3ea3-b440-472f-abcd-1fcae8857162 for instance 122f685e-782e-4aeb-bfc2-92308542f353 on nch1-master-1 Sep 06 12:12:40.809912 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-4074479d-b126-41a3-845d-e0f87f2fe8e9 req-0e00cac1-4469-4e48-8f64-85b902cc8ea9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036545 Sep 06 12:12:40.810536 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3738/7435] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:12:41.610267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a1d2eaec-30af-46bc-a9d9-7f003fe5505d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:41.610909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a1d2eaec-30af-46bc-a9d9-7f003fe5505d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:41.617765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d2eaec-30af-46bc-a9d9-7f003fe5505d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:41.618249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d2eaec-30af-46bc-a9d9-7f003fe5505d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:41.618696 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d2eaec-30af-46bc-a9d9-7f003fe5505d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:41.619452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d2eaec-30af-46bc-a9d9-7f003fe5505d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:41.619919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d2eaec-30af-46bc-a9d9-7f003fe5505d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:41.620358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a1d2eaec-30af-46bc-a9d9-7f003fe5505d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:41.754701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a1d2eaec-30af-46bc-a9d9-7f003fe5505d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:41.762482 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a1d2eaec-30af-46bc-a9d9-7f003fe5505d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1390 microversion: 2.1 time: 0.156141 Sep 06 12:12:41.763073 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3698/7436] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:41 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:42.786204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7974c163-3acd-43b9-95c1-6dcdfa8fe361 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:42.786928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7974c163-3acd-43b9-95c1-6dcdfa8fe361 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:42.789852 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:42.795242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7974c163-3acd-43b9-95c1-6dcdfa8fe361 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:42.795785 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7974c163-3acd-43b9-95c1-6dcdfa8fe361 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:42.796250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7974c163-3acd-43b9-95c1-6dcdfa8fe361 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:42.796987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7974c163-3acd-43b9-95c1-6dcdfa8fe361 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:42.797477 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7974c163-3acd-43b9-95c1-6dcdfa8fe361 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:42.798034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7974c163-3acd-43b9-95c1-6dcdfa8fe361 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:42.940282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7974c163-3acd-43b9-95c1-6dcdfa8fe361 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:42.949890 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7974c163-3acd-43b9-95c1-6dcdfa8fe361 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1390 microversion: 2.1 time: 0.167510 Sep 06 12:12:42.950467 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3739/7437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:42 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:43.973478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e393ddd3-0644-4f90-80b1-4bad6dcfd632 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:43.974608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e393ddd3-0644-4f90-80b1-4bad6dcfd632 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:43.981651 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e393ddd3-0644-4f90-80b1-4bad6dcfd632 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:43.982140 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e393ddd3-0644-4f90-80b1-4bad6dcfd632 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:43.982587 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e393ddd3-0644-4f90-80b1-4bad6dcfd632 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:43.983330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e393ddd3-0644-4f90-80b1-4bad6dcfd632 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:43.983779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e393ddd3-0644-4f90-80b1-4bad6dcfd632 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:43.984216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e393ddd3-0644-4f90-80b1-4bad6dcfd632 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:44.116765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e393ddd3-0644-4f90-80b1-4bad6dcfd632 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:44.127591 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e393ddd3-0644-4f90-80b1-4bad6dcfd632 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1390 microversion: 2.1 time: 0.158017 Sep 06 12:12:44.128226 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3699/7438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:43 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:45.156503 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-93a56dde-af25-4178-8b97-ba2931d034a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:45.157134 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-93a56dde-af25-4178-8b97-ba2931d034a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:45.163782 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93a56dde-af25-4178-8b97-ba2931d034a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:45.164234 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93a56dde-af25-4178-8b97-ba2931d034a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:45.164725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93a56dde-af25-4178-8b97-ba2931d034a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:45.165441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93a56dde-af25-4178-8b97-ba2931d034a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:45.165953 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93a56dde-af25-4178-8b97-ba2931d034a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:45.166835 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-93a56dde-af25-4178-8b97-ba2931d034a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:45.302944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-93a56dde-af25-4178-8b97-ba2931d034a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:45.311448 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-93a56dde-af25-4178-8b97-ba2931d034a4 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1390 microversion: 2.1 time: 0.159391 Sep 06 12:12:45.312030 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3740/7439] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:45 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:46.334034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d8cafb5b-f997-4f92-a96a-013d31fa9e45 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:46.334655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d8cafb5b-f997-4f92-a96a-013d31fa9e45 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:46.336782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:46.337508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:46.342979 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8cafb5b-f997-4f92-a96a-013d31fa9e45 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:46.347933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8cafb5b-f997-4f92-a96a-013d31fa9e45 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:46.347933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8cafb5b-f997-4f92-a96a-013d31fa9e45 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:46.347933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8cafb5b-f997-4f92-a96a-013d31fa9e45 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:46.347933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8cafb5b-f997-4f92-a96a-013d31fa9e45 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:46.347933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d8cafb5b-f997-4f92-a96a-013d31fa9e45 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:46.478117 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d8cafb5b-f997-4f92-a96a-013d31fa9e45 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:46.488124 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d8cafb5b-f997-4f92-a96a-013d31fa9e45 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1390 microversion: 2.1 time: 0.158211 Sep 06 12:12:46.488710 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3700/7440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:46 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:47.516342 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c4657ade-8ead-4d5b-8c76-e57c2186440e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:47.516968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c4657ade-8ead-4d5b-8c76-e57c2186440e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:47.519564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:47.524437 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4657ade-8ead-4d5b-8c76-e57c2186440e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:47.524938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4657ade-8ead-4d5b-8c76-e57c2186440e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:47.525396 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4657ade-8ead-4d5b-8c76-e57c2186440e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:47.526426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4657ade-8ead-4d5b-8c76-e57c2186440e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:47.528444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4657ade-8ead-4d5b-8c76-e57c2186440e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:47.531955 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c4657ade-8ead-4d5b-8c76-e57c2186440e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:47.667666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c4657ade-8ead-4d5b-8c76-e57c2186440e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:47.675884 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c4657ade-8ead-4d5b-8c76-e57c2186440e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1390 microversion: 2.1 time: 0.163499 Sep 06 12:12:47.676481 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3741/7441] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:47 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:47.919353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ff35effc-fef1-4b23-a4d0-f7725b8ddc9b req-d162b26c-d0ad-4358-8941-212fab83a821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122f685e-782e-4aeb-bfc2-92308542f353", "name": "network-vif-plugged", "status": "completed", "tag": "cfaa3ea3-b440-472f-abcd-1fcae8857162"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:12:47.929259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ff35effc-fef1-4b23-a4d0-f7725b8ddc9b req-d162b26c-d0ad-4358-8941-212fab83a821 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:47.929744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ff35effc-fef1-4b23-a4d0-f7725b8ddc9b req-d162b26c-d0ad-4358-8941-212fab83a821 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:47.930182 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ff35effc-fef1-4b23-a4d0-f7725b8ddc9b req-d162b26c-d0ad-4358-8941-212fab83a821 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:47.944328 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ff35effc-fef1-4b23-a4d0-f7725b8ddc9b req-d162b26c-d0ad-4358-8941-212fab83a821 service nova] Creating event network-vif-plugged:cfaa3ea3-b440-472f-abcd-1fcae8857162 for instance 122f685e-782e-4aeb-bfc2-92308542f353 on nch1-master-1 Sep 06 12:12:47.950800 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ff35effc-fef1-4b23-a4d0-f7725b8ddc9b req-d162b26c-d0ad-4358-8941-212fab83a821 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103173 Sep 06 12:12:47.951464 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3701/7442] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:12:48.700008 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5edefbf4-c1fb-4103-bdd4-c430307992a1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:48.700561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5edefbf4-c1fb-4103-bdd4-c430307992a1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:48.707749 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5edefbf4-c1fb-4103-bdd4-c430307992a1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.708243 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5edefbf4-c1fb-4103-bdd4-c430307992a1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.708709 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5edefbf4-c1fb-4103-bdd4-c430307992a1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.709423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5edefbf4-c1fb-4103-bdd4-c430307992a1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.709900 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5edefbf4-c1fb-4103-bdd4-c430307992a1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.710344 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5edefbf4-c1fb-4103-bdd4-c430307992a1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.845295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5edefbf4-c1fb-4103-bdd4-c430307992a1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:48.853361 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5edefbf4-c1fb-4103-bdd4-c430307992a1 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1390 microversion: 2.1 time: 0.157795 Sep 06 12:12:48.853955 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3742/7443] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:48 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:49.877998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-47fc8c06-4576-4bd7-81f0-22264bf21470 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:49.878723 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-47fc8c06-4576-4bd7-81f0-22264bf21470 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:49.880761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:49.886451 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47fc8c06-4576-4bd7-81f0-22264bf21470 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:49.906859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47fc8c06-4576-4bd7-81f0-22264bf21470 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:49.906859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47fc8c06-4576-4bd7-81f0-22264bf21470 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:49.906859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47fc8c06-4576-4bd7-81f0-22264bf21470 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:49.906859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47fc8c06-4576-4bd7-81f0-22264bf21470 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:49.906859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-47fc8c06-4576-4bd7-81f0-22264bf21470 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:50.027721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-47fc8c06-4576-4bd7-81f0-22264bf21470 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:50.035468 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-47fc8c06-4576-4bd7-81f0-22264bf21470 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1562 microversion: 2.1 time: 0.162665 Sep 06 12:12:50.036063 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3702/7444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:49 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:50.059129 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-102c48f3-9177-41bb-9990-94134a60462e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:50.059775 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-102c48f3-9177-41bb-9990-94134a60462e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:50.066910 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-102c48f3-9177-41bb-9990-94134a60462e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:50.070105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-102c48f3-9177-41bb-9990-94134a60462e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:50.070105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-102c48f3-9177-41bb-9990-94134a60462e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:50.070105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-102c48f3-9177-41bb-9990-94134a60462e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:50.070105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-102c48f3-9177-41bb-9990-94134a60462e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:50.070105 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-102c48f3-9177-41bb-9990-94134a60462e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:50.205519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-102c48f3-9177-41bb-9990-94134a60462e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:50.213608 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-102c48f3-9177-41bb-9990-94134a60462e tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1562 microversion: 2.1 time: 0.158499 Sep 06 12:12:50.214214 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3743/7445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:50 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:52.408805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-88baa2e5-d57e-4b7e-9ad4-d414e2020f48 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:52.409455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-88baa2e5-d57e-4b7e-9ad4-d414e2020f48 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:52.416081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-de5a68b5-4732-49c5-82f4-b57fb1086050 req-2c1fd915-6b10-4f59-9f29-e80a2a7f8d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122f685e-782e-4aeb-bfc2-92308542f353", "tag": "cfaa3ea3-b440-472f-abcd-1fcae8857162"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:12:52.424526 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88baa2e5-d57e-4b7e-9ad4-d414e2020f48 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:52.425024 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88baa2e5-d57e-4b7e-9ad4-d414e2020f48 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:52.425471 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88baa2e5-d57e-4b7e-9ad4-d414e2020f48 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:52.426187 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88baa2e5-d57e-4b7e-9ad4-d414e2020f48 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:52.426658 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88baa2e5-d57e-4b7e-9ad4-d414e2020f48 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:52.432527 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-88baa2e5-d57e-4b7e-9ad4-d414e2020f48 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:52.437040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-de5a68b5-4732-49c5-82f4-b57fb1086050 req-2c1fd915-6b10-4f59-9f29-e80a2a7f8d7a service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:52.437796 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-de5a68b5-4732-49c5-82f4-b57fb1086050 req-2c1fd915-6b10-4f59-9f29-e80a2a7f8d7a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:52.438364 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-de5a68b5-4732-49c5-82f4-b57fb1086050 req-2c1fd915-6b10-4f59-9f29-e80a2a7f8d7a service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:52.451146 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-de5a68b5-4732-49c5-82f4-b57fb1086050 req-2c1fd915-6b10-4f59-9f29-e80a2a7f8d7a service nova] Creating event network-changed:cfaa3ea3-b440-472f-abcd-1fcae8857162 for instance 122f685e-782e-4aeb-bfc2-92308542f353 on nch1-master-1 Sep 06 12:12:52.458475 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-de5a68b5-4732-49c5-82f4-b57fb1086050 req-2c1fd915-6b10-4f59-9f29-e80a2a7f8d7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046090 Sep 06 12:12:52.459308 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3744/7446] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:12:52.905717 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-88baa2e5-d57e-4b7e-9ad4-d414e2020f48 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:52.915609 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-88baa2e5-d57e-4b7e-9ad4-d414e2020f48 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1562 microversion: 2.1 time: 0.510840 Sep 06 12:12:52.916386 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3703/7447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:52 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1562 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:14.166298 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:13:14.166776 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 12:13:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353/action (ip 10.222.0.20) !!! Sep 06 12:13:14.168324 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=11 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:14.169085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=40 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:14.174767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e368f5ac-736a-4265-a656-6ef41fe40e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:13:14.177073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e368f5ac-736a-4265-a656-6ef41fe40e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:14.185240 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e368f5ac-736a-4265-a656-6ef41fe40e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:14.188489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e368f5ac-736a-4265-a656-6ef41fe40e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:14.188489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e368f5ac-736a-4265-a656-6ef41fe40e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:14.188489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e368f5ac-736a-4265-a656-6ef41fe40e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:14.188489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e368f5ac-736a-4265-a656-6ef41fe40e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:14.188489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e368f5ac-736a-4265-a656-6ef41fe40e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:14.238614 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e368f5ac-736a-4265-a656-6ef41fe40e0a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353/action" status: 200 len: 24572 microversion: 2.1 time: 0.074727 Sep 06 12:13:14.239310 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3745/7448] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:13:14 2022] POST /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353/action => generated 24572 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:13:25.242370 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1133261a-cdea-4c7c-ba55-a302215f0fbd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:13:25.242919 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1133261a-cdea-4c7c-ba55-a302215f0fbd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:25.245195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:25.245858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=46 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:25.251935 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1133261a-cdea-4c7c-ba55-a302215f0fbd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:25.253009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1133261a-cdea-4c7c-ba55-a302215f0fbd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:25.253009 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1133261a-cdea-4c7c-ba55-a302215f0fbd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:25.253594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1133261a-cdea-4c7c-ba55-a302215f0fbd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:25.254052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1133261a-cdea-4c7c-ba55-a302215f0fbd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:25.254484 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1133261a-cdea-4c7c-ba55-a302215f0fbd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:25.277721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-1133261a-cdea-4c7c-ba55-a302215f0fbd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lazy-loading 'flavor' on Instance uuid 122f685e-782e-4aeb-bfc2-92308542f353 {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:13:25.560685 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1133261a-cdea-4c7c-ba55-a302215f0fbd tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353/action" status: 202 len: 0 microversion: 2.1 time: 0.322112 Sep 06 12:13:25.561452 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3704/7449] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:13:25 2022] POST /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:13:25.570486 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a5a53327-7b8c-486c-93b0-d66c68b87a8d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:25.571300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a5a53327-7b8c-486c-93b0-d66c68b87a8d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:25.574029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:25.574959 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=4 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:25.580001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5a53327-7b8c-486c-93b0-d66c68b87a8d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:25.580506 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5a53327-7b8c-486c-93b0-d66c68b87a8d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:25.580969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5a53327-7b8c-486c-93b0-d66c68b87a8d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:25.581691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5a53327-7b8c-486c-93b0-d66c68b87a8d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:25.582201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5a53327-7b8c-486c-93b0-d66c68b87a8d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:25.582655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a5a53327-7b8c-486c-93b0-d66c68b87a8d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:25.722703 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a5a53327-7b8c-486c-93b0-d66c68b87a8d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:25.730666 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a5a53327-7b8c-486c-93b0-d66c68b87a8d tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1689 microversion: 2.1 time: 0.164664 Sep 06 12:13:25.733950 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3746/7450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:25 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:26.754847 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f0f73713-0f89-4734-a52c-11d8690c2029 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:26.755608 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f0f73713-0f89-4734-a52c-11d8690c2029 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:26.762709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0f73713-0f89-4734-a52c-11d8690c2029 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:26.763243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0f73713-0f89-4734-a52c-11d8690c2029 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:26.763702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0f73713-0f89-4734-a52c-11d8690c2029 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:26.765013 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0f73713-0f89-4734-a52c-11d8690c2029 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:26.765398 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0f73713-0f89-4734-a52c-11d8690c2029 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:26.765840 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f0f73713-0f89-4734-a52c-11d8690c2029 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:26.906439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f0f73713-0f89-4734-a52c-11d8690c2029 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:26.914610 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f0f73713-0f89-4734-a52c-11d8690c2029 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1672 microversion: 2.1 time: 0.164150 Sep 06 12:13:26.915219 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3705/7451] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:26 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:28.010972 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aed87f4b-f612-49f4-bb42-74dd6b5b9cef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:13:28.013210 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aed87f4b-f612-49f4-bb42-74dd6b5b9cef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:28.021660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aed87f4b-f612-49f4-bb42-74dd6b5b9cef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.022158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aed87f4b-f612-49f4-bb42-74dd6b5b9cef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.022641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aed87f4b-f612-49f4-bb42-74dd6b5b9cef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.023601 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aed87f4b-f612-49f4-bb42-74dd6b5b9cef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.024097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aed87f4b-f612-49f4-bb42-74dd6b5b9cef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.024530 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aed87f4b-f612-49f4-bb42-74dd6b5b9cef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.074771 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aed87f4b-f612-49f4-bb42-74dd6b5b9cef tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353/action" status: 200 len: 38449 microversion: 2.1 time: 0.067738 Sep 06 12:13:28.075664 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3747/7452] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:13:28 2022] POST /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353/action => generated 38449 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:13:28.087909 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-87f1bf93-1d51-409d-902f-d95703d3f670 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:13:28.088467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-87f1bf93-1d51-409d-902f-d95703d3f670 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:28.095956 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87f1bf93-1d51-409d-902f-d95703d3f670 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.096455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87f1bf93-1d51-409d-902f-d95703d3f670 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.096904 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87f1bf93-1d51-409d-902f-d95703d3f670 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.097612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87f1bf93-1d51-409d-902f-d95703d3f670 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.098078 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87f1bf93-1d51-409d-902f-d95703d3f670 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.098515 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-87f1bf93-1d51-409d-902f-d95703d3f670 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.325855 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-87f1bf93-1d51-409d-902f-d95703d3f670 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353/action" status: 202 len: 0 microversion: 2.1 time: 0.241686 Sep 06 12:13:28.326516 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3706/7453] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:13:28 2022] POST /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 12:13:28.337166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fa2eb2c8-ea99-42fe-b100-403f63460a8a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:28.337976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fa2eb2c8-ea99-42fe-b100-403f63460a8a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:28.345644 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa2eb2c8-ea99-42fe-b100-403f63460a8a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.346144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa2eb2c8-ea99-42fe-b100-403f63460a8a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.346605 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa2eb2c8-ea99-42fe-b100-403f63460a8a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.347376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa2eb2c8-ea99-42fe-b100-403f63460a8a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.347880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa2eb2c8-ea99-42fe-b100-403f63460a8a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.348331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fa2eb2c8-ea99-42fe-b100-403f63460a8a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.494615 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fa2eb2c8-ea99-42fe-b100-403f63460a8a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:28.503233 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fa2eb2c8-ea99-42fe-b100-403f63460a8a tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1678 microversion: 2.1 time: 0.170505 Sep 06 12:13:28.504134 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3748/7454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:28 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:29.528544 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e989d1fa-3c71-4d97-8fe6-3932a8ffd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:29.529292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e989d1fa-3c71-4d97-8fe6-3932a8ffd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:29.537069 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e989d1fa-3c71-4d97-8fe6-3932a8ffd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:29.537563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e989d1fa-3c71-4d97-8fe6-3932a8ffd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:29.538014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e989d1fa-3c71-4d97-8fe6-3932a8ffd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:29.538731 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e989d1fa-3c71-4d97-8fe6-3932a8ffd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:29.539227 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e989d1fa-3c71-4d97-8fe6-3932a8ffd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:29.539672 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e989d1fa-3c71-4d97-8fe6-3932a8ffd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:29.675414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e989d1fa-3c71-4d97-8fe6-3932a8ffd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:29.683651 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e989d1fa-3c71-4d97-8fe6-3932a8ffd9b9 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1678 microversion: 2.1 time: 0.159390 Sep 06 12:13:29.684452 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3707/7455] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:29 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:30.707554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-aa3d2fcf-adfd-4ba1-b8ba-5ac4fb769063 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:30.708185 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-aa3d2fcf-adfd-4ba1-b8ba-5ac4fb769063 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:30.715873 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa3d2fcf-adfd-4ba1-b8ba-5ac4fb769063 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:30.716389 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa3d2fcf-adfd-4ba1-b8ba-5ac4fb769063 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:30.716850 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa3d2fcf-adfd-4ba1-b8ba-5ac4fb769063 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:30.718074 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa3d2fcf-adfd-4ba1-b8ba-5ac4fb769063 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:30.718556 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa3d2fcf-adfd-4ba1-b8ba-5ac4fb769063 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:30.719031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-aa3d2fcf-adfd-4ba1-b8ba-5ac4fb769063 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:30.852969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-aa3d2fcf-adfd-4ba1-b8ba-5ac4fb769063 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:30.861456 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-aa3d2fcf-adfd-4ba1-b8ba-5ac4fb769063 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1681 microversion: 2.1 time: 0.157919 Sep 06 12:13:30.862056 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3749/7456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:30 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:30.956205 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-17a45192-fedd-4993-a2e0-38cfff504cc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:13:30.958572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-17a45192-fedd-4993-a2e0-38cfff504cc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:30.965338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17a45192-fedd-4993-a2e0-38cfff504cc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:30.965822 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17a45192-fedd-4993-a2e0-38cfff504cc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:30.966270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17a45192-fedd-4993-a2e0-38cfff504cc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:30.966967 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17a45192-fedd-4993-a2e0-38cfff504cc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:30.968113 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17a45192-fedd-4993-a2e0-38cfff504cc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:30.968545 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-17a45192-fedd-4993-a2e0-38cfff504cc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:31.010850 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-17a45192-fedd-4993-a2e0-38cfff504cc0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "POST /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353/action" status: 200 len: 38449 microversion: 2.1 time: 0.059171 Sep 06 12:13:31.011507 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3708/7457] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:13:30 2022] POST /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353/action => generated 38449 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:13:32.071654 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3211bbab-9ed3-44b3-995d-1545bca56c4f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:32.072201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3211bbab-9ed3-44b3-995d-1545bca56c4f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:32.074914 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-e2ed449a-bf05-4dcf-a9c4-af2a06ca6d4e req-adbfe007-f9ff-4965-aa02-47efb9b28b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122f685e-782e-4aeb-bfc2-92308542f353", "tag": "cfaa3ea3-b440-472f-abcd-1fcae8857162"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:13:32.080179 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3211bbab-9ed3-44b3-995d-1545bca56c4f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:32.080697 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3211bbab-9ed3-44b3-995d-1545bca56c4f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:32.081166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3211bbab-9ed3-44b3-995d-1545bca56c4f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.081902 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3211bbab-9ed3-44b3-995d-1545bca56c4f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:32.082459 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3211bbab-9ed3-44b3-995d-1545bca56c4f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:32.082918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3211bbab-9ed3-44b3-995d-1545bca56c4f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.087439 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e2ed449a-bf05-4dcf-a9c4-af2a06ca6d4e req-adbfe007-f9ff-4965-aa02-47efb9b28b8c service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:32.088002 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e2ed449a-bf05-4dcf-a9c4-af2a06ca6d4e req-adbfe007-f9ff-4965-aa02-47efb9b28b8c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:32.088664 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-e2ed449a-bf05-4dcf-a9c4-af2a06ca6d4e req-adbfe007-f9ff-4965-aa02-47efb9b28b8c service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.100776 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-e2ed449a-bf05-4dcf-a9c4-af2a06ca6d4e req-adbfe007-f9ff-4965-aa02-47efb9b28b8c service nova] Creating event network-changed:cfaa3ea3-b440-472f-abcd-1fcae8857162 for instance 122f685e-782e-4aeb-bfc2-92308542f353 on nch1-master-1 Sep 06 12:13:32.106387 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-e2ed449a-bf05-4dcf-a9c4-af2a06ca6d4e req-adbfe007-f9ff-4965-aa02-47efb9b28b8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035889 Sep 06 12:13:32.107222 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3709/7458] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:13:32.115227 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3211bbab-9ed3-44b3-995d-1545bca56c4f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:13:32.425690 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3211bbab-9ed3-44b3-995d-1545bca56c4f tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "DELETE /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 204 len: 0 microversion: 2.1 time: 0.357571 Sep 06 12:13:32.426537 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3750/7459] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 12:13:32 2022] DELETE /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:13:32.435610 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8439f49c-3c77-47ce-8e85-c47e040e4171 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:32.436686 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8439f49c-3c77-47ce-8e85-c47e040e4171 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:32.443569 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8439f49c-3c77-47ce-8e85-c47e040e4171 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:32.444076 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8439f49c-3c77-47ce-8e85-c47e040e4171 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:32.444535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8439f49c-3c77-47ce-8e85-c47e040e4171 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.445257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8439f49c-3c77-47ce-8e85-c47e040e4171 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:32.445905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8439f49c-3c77-47ce-8e85-c47e040e4171 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:32.446353 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8439f49c-3c77-47ce-8e85-c47e040e4171 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.595593 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8439f49c-3c77-47ce-8e85-c47e040e4171 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:32.603800 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8439f49c-3c77-47ce-8e85-c47e040e4171 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1687 microversion: 2.1 time: 0.172565 Sep 06 12:13:32.604392 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3710/7460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:32 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:33.629734 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ce246da2-a917-404e-8780-5780836ca8c6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:33.630395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ce246da2-a917-404e-8780-5780836ca8c6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:33.637283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce246da2-a917-404e-8780-5780836ca8c6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:33.637780 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce246da2-a917-404e-8780-5780836ca8c6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:33.638237 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce246da2-a917-404e-8780-5780836ca8c6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:33.638957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce246da2-a917-404e-8780-5780836ca8c6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:33.639450 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce246da2-a917-404e-8780-5780836ca8c6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:33.639891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ce246da2-a917-404e-8780-5780836ca8c6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:33.781048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ce246da2-a917-404e-8780-5780836ca8c6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:33.789138 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ce246da2-a917-404e-8780-5780836ca8c6 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1687 microversion: 2.1 time: 0.163894 Sep 06 12:13:33.789728 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3751/7461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:33 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:34.546466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-609ca8db-c41f-4616-a5f6-1f5d9d11d7ee req-a290882b-956e-4877-9b7f-c846d680fd07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122f685e-782e-4aeb-bfc2-92308542f353", "name": "network-vif-deleted", "tag": "cfaa3ea3-b440-472f-abcd-1fcae8857162"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:13:34.556907 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-609ca8db-c41f-4616-a5f6-1f5d9d11d7ee req-a290882b-956e-4877-9b7f-c846d680fd07 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.557399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-609ca8db-c41f-4616-a5f6-1f5d9d11d7ee req-a290882b-956e-4877-9b7f-c846d680fd07 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.557848 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-609ca8db-c41f-4616-a5f6-1f5d9d11d7ee req-a290882b-956e-4877-9b7f-c846d680fd07 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.569808 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-609ca8db-c41f-4616-a5f6-1f5d9d11d7ee req-a290882b-956e-4877-9b7f-c846d680fd07 service nova] Creating event network-vif-deleted:cfaa3ea3-b440-472f-abcd-1fcae8857162 for instance 122f685e-782e-4aeb-bfc2-92308542f353 on nch1-master-1 Sep 06 12:13:34.575078 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-609ca8db-c41f-4616-a5f6-1f5d9d11d7ee req-a290882b-956e-4877-9b7f-c846d680fd07 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032579 Sep 06 12:13:34.575738 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3711/7462] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:13:34.820831 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:34.825628 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:34.830077 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.830600 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.831261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.832013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.832528 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.833010 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.871968 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.872487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.872984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.874217 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lazy-loading 'fault' on Instance uuid 122f685e-782e-4aeb-bfc2-92308542f353 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:13:34.921434 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e0c4e314274ad0bbdc4125638b0916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1c59f75934cc38e904fa0dae0d587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:34.927372 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-416a4eb0-b6b1-4195-bc84-a4003c5ebfd0 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 200 len: 1355 microversion: 2.1 time: 0.110517 Sep 06 12:13:34.928730 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3752/7463] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:34 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 1355 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:35.956170 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ed6a64d9-6801-4fd2-af0e-1658ad61588c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:35.956886 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ed6a64d9-6801-4fd2-af0e-1658ad61588c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] [instance: 122f685e-782e-4aeb-bfc2-92308542f353] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:35.963308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed6a64d9-6801-4fd2-af0e-1658ad61588c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:35.963807 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed6a64d9-6801-4fd2-af0e-1658ad61588c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:35.964257 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed6a64d9-6801-4fd2-af0e-1658ad61588c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:35.964964 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed6a64d9-6801-4fd2-af0e-1658ad61588c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:35.965431 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed6a64d9-6801-4fd2-af0e-1658ad61588c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:35.965872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed6a64d9-6801-4fd2-af0e-1658ad61588c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:35.979769 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-ed6a64d9-6801-4fd2-af0e-1658ad61588c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] HTTP exception thrown: Instance 122f685e-782e-4aeb-bfc2-92308542f353 could not be found. Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ed6a64d9-6801-4fd2-af0e-1658ad61588c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Request method failure captured: Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 HTTP/1.1 Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzeYVfZJz-bvpRJpbNxoClgmmS38luZVJYnn1c4uHPDNGT6x9mu_OAgJT7SDXZyhhmmM8HWW0WfRoxBDThE9ODnuq3d1gSBx5-I2qdQNYW8FnNVfSLu7r3kZhvwwaUR1Z_VNwXCKdV70KfkyQVz432u5zXg1J26TiMa6aej16G2Ghw4 Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 36e1c59f75934cc38e904fa0dae0d587 Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36e1c59f75934cc38e904fa0dae0d587"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36e1c59f75934cc38e904fa0dae0d587"}]}] Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 36e1c59f75934cc38e904fa0dae0d587 Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2051570988 Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestNetworkAdvancedServerOps-2051570988-project Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 38e0c4e314274ad0bbdc4125638b0916 Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2051570988-project Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 122f685e-782e-4aeb-bfc2-92308542f353 could not be found. Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '122f685e-782e-4aeb-bfc2-92308542f353'} Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122f685e-782e-4aeb-bfc2-92308542f353 could not be found. Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122f685e-782e-4aeb-bfc2-92308542f353 could not be found. Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:13:35.981410 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:13:35.985582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:13:35.985582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:13:35.985582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:13:35.985582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:13:35.985582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:13:35.985582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:13:35.985582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122f685e-782e-4aeb-bfc2-92308542f353 could not be found. Sep 06 12:13:35.985582 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:13:35.985582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ed6a64d9-6801-4fd2-af0e-1658ad61588c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Returning 404 to user: Instance 122f685e-782e-4aeb-bfc2-92308542f353 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:13:35.985582 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ed6a64d9-6801-4fd2-af0e-1658ad61588c tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353" status: 404 len: 111 microversion: 2.1 time: 0.032061 Sep 06 12:13:35.985582 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3712/7464] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:35 2022] GET /compute/v2.1/servers/122f685e-782e-4aeb-bfc2-92308542f353 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:13:39.756752 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ccc489fe-44ed-4dec-b82d-b7ce6cecd277 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] Calling method '.version_select at 0x7f90f8a854c0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:39.815531 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ccc489fe-44ed-4dec-b82d-b7ce6cecd277 tempest-TestNetworkAdvancedServerOps-2051570988 tempest-TestNetworkAdvancedServerOps-2051570988-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-197138023" status: 202 len: 0 microversion: 2.1 time: 0.062716 Sep 06 12:13:39.816134 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3753/7465] 10.222.0.20 () {58 vars in 1281 bytes} [Tue Sep 6 12:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-197138023 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:13:54.730132 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=18 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:54.731349 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:54.920029 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6692bf8f-75f7-4bbe-af43-9d68b67ec8b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Action: 'create', calling method: .version_select at 0x7f90f3177820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1781289236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1kkWSo/LjSrqTio18lTCFo0JOe/rj7BRLR8V9gQR75vQfhusVH8ab1snlTyb35ltub2a9K8YMYeCZQvZgqOkcBIIQUwqHpYbKavZFDt9Azyam7I9mXFXqIl/bj8tFA/Q=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:13:54.937863 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6692bf8f-75f7-4bbe-af43-9d68b67ec8b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Getting quotas for project 7e98949fac3f403faa6fa0e0c2e86c44. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:13:54.945199 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-6692bf8f-75f7-4bbe-af43-9d68b67ec8b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Getting quotas for user 6394701f1951428995065bf1007c34fa and project 7e98949fac3f403faa6fa0e0c2e86c44. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:13:55.059281 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6692bf8f-75f7-4bbe-af43-9d68b67ec8b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.334642 Sep 06 12:13:55.060270 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3713/7466] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 12:13:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:13:57.472047 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:57.472915 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:57.477103 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-724913429", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1781289236", "security_groups": [{"name": "tempest-secgroup-smoke-254964136"}], "networks": [{"uuid": "ef4a5ba5-aacf-4b00-aa21-51c2a4653fd1"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:13:57.599781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] validate_networks() for [('ef4a5ba5-aacf-4b00-aa21-51c2a4653fd1', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:13:58.092447 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:13:58.092919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:13:58.093416 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:13:58.093848 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:13:58.094282 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:13:58.103313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:58.103817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:58.104275 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:58.105028 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:58.105504 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:58.105951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:58.122836 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Getting quotas for project 7e98949fac3f403faa6fa0e0c2e86c44. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:13:58.128489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Getting quotas for user 6394701f1951428995065bf1007c34fa and project 7e98949fac3f403faa6fa0e0c2e86c44. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:13:58.141957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:13:58.144609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:13:58.299561 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-38cc6506-67da-416e-9212-91701c260f84 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.828706 Sep 06 12:13:58.305611 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3754/7467] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 12:13:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:13:58.315770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9f76a66d-0692-4f6e-a2e4-f05796af1ede tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:58.316557 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9f76a66d-0692-4f6e-a2e4-f05796af1ede tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:58.392960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9f76a66d-0692-4f6e-a2e4-f05796af1ede tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:58.401598 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9f76a66d-0692-4f6e-a2e4-f05796af1ede tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1246 microversion: 2.1 time: 0.090989 Sep 06 12:13:58.421878 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3714/7468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:58 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1246 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:59.430804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6bfe356f-e7ae-4f8b-b77b-8ae69941e8d4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:59.432218 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6bfe356f-e7ae-4f8b-b77b-8ae69941e8d4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:59.486333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6bfe356f-e7ae-4f8b-b77b-8ae69941e8d4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:59.493588 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6bfe356f-e7ae-4f8b-b77b-8ae69941e8d4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1246 microversion: 2.1 time: 0.067720 Sep 06 12:13:59.494103 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3755/7469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:59 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1246 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:00.516335 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-f923447b-074a-46a0-9792-840e47bdaae4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:00.517081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-f923447b-074a-46a0-9792-840e47bdaae4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:00.524662 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f923447b-074a-46a0-9792-840e47bdaae4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:00.525162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f923447b-074a-46a0-9792-840e47bdaae4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:00.525615 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f923447b-074a-46a0-9792-840e47bdaae4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:00.526336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f923447b-074a-46a0-9792-840e47bdaae4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:00.526803 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f923447b-074a-46a0-9792-840e47bdaae4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:00.527278 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-f923447b-074a-46a0-9792-840e47bdaae4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:00.593091 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-f923447b-074a-46a0-9792-840e47bdaae4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:00.602694 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-f923447b-074a-46a0-9792-840e47bdaae4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1298 microversion: 2.1 time: 0.090848 Sep 06 12:14:00.603322 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3715/7470] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:00 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:01.626205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d8a5d292-5ace-400d-a2c3-d0378138e768 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:01.626969 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d8a5d292-5ace-400d-a2c3-d0378138e768 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:01.634502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8a5d292-5ace-400d-a2c3-d0378138e768 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:01.634942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8a5d292-5ace-400d-a2c3-d0378138e768 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:01.635432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8a5d292-5ace-400d-a2c3-d0378138e768 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:01.636165 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8a5d292-5ace-400d-a2c3-d0378138e768 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:01.636650 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8a5d292-5ace-400d-a2c3-d0378138e768 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:01.637102 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d8a5d292-5ace-400d-a2c3-d0378138e768 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:01.774944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d8a5d292-5ace-400d-a2c3-d0378138e768 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:01.783474 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d8a5d292-5ace-400d-a2c3-d0378138e768 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1371 microversion: 2.1 time: 0.161286 Sep 06 12:14:01.784210 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3756/7471] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:01 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:02.338214 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-be2aef25-6098-47a8-8d31-9791cc1c21c7 req-50b450f4-bc8a-4cdd-8ce2-6002a3af8219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adbad374-35ca-433a-a086-7434dbff660b", "tag": "b2da4f25-e74b-481c-9564-66c75ac92b47"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:14:02.348713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-be2aef25-6098-47a8-8d31-9791cc1c21c7 req-50b450f4-bc8a-4cdd-8ce2-6002a3af8219 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:02.349307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-be2aef25-6098-47a8-8d31-9791cc1c21c7 req-50b450f4-bc8a-4cdd-8ce2-6002a3af8219 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:02.349763 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-be2aef25-6098-47a8-8d31-9791cc1c21c7 req-50b450f4-bc8a-4cdd-8ce2-6002a3af8219 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:02.361524 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-be2aef25-6098-47a8-8d31-9791cc1c21c7 req-50b450f4-bc8a-4cdd-8ce2-6002a3af8219 service nova] Creating event network-changed:b2da4f25-e74b-481c-9564-66c75ac92b47 for instance adbad374-35ca-433a-a086-7434dbff660b on nch1-master-1 Sep 06 12:14:02.366288 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-be2aef25-6098-47a8-8d31-9791cc1c21c7 req-50b450f4-bc8a-4cdd-8ce2-6002a3af8219 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031885 Sep 06 12:14:02.366901 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3716/7472] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:14:02.806451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-94242a8e-b5c7-4838-9549-992fd191daf5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:02.807157 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-94242a8e-b5c7-4838-9549-992fd191daf5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:02.815579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94242a8e-b5c7-4838-9549-992fd191daf5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:02.816088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94242a8e-b5c7-4838-9549-992fd191daf5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:02.816729 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94242a8e-b5c7-4838-9549-992fd191daf5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:02.817464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94242a8e-b5c7-4838-9549-992fd191daf5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:02.818021 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94242a8e-b5c7-4838-9549-992fd191daf5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:02.818464 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-94242a8e-b5c7-4838-9549-992fd191daf5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:02.976149 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-94242a8e-b5c7-4838-9549-992fd191daf5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:02.985151 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-94242a8e-b5c7-4838-9549-992fd191daf5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1371 microversion: 2.1 time: 0.182680 Sep 06 12:14:02.985752 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3757/7473] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:02 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:04.011061 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-404e2131-b75d-4afe-a87c-27ec8558f5b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:04.011887 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-404e2131-b75d-4afe-a87c-27ec8558f5b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:04.018709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-404e2131-b75d-4afe-a87c-27ec8558f5b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:04.019232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-404e2131-b75d-4afe-a87c-27ec8558f5b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:04.019681 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-404e2131-b75d-4afe-a87c-27ec8558f5b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:04.020385 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-404e2131-b75d-4afe-a87c-27ec8558f5b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:04.020851 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-404e2131-b75d-4afe-a87c-27ec8558f5b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:04.021286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-404e2131-b75d-4afe-a87c-27ec8558f5b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:04.160460 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-404e2131-b75d-4afe-a87c-27ec8558f5b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:04.167105 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-404e2131-b75d-4afe-a87c-27ec8558f5b0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1371 microversion: 2.1 time: 0.162178 Sep 06 12:14:04.167706 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3717/7474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:04 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:05.190718 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ced3e974-f915-4424-a9b4-fc9ea5152d5b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:05.191300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ced3e974-f915-4424-a9b4-fc9ea5152d5b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:05.198273 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ced3e974-f915-4424-a9b4-fc9ea5152d5b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:05.198774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ced3e974-f915-4424-a9b4-fc9ea5152d5b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:05.199266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ced3e974-f915-4424-a9b4-fc9ea5152d5b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:05.200247 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ced3e974-f915-4424-a9b4-fc9ea5152d5b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:05.200722 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ced3e974-f915-4424-a9b4-fc9ea5152d5b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:05.201166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ced3e974-f915-4424-a9b4-fc9ea5152d5b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:05.335057 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ced3e974-f915-4424-a9b4-fc9ea5152d5b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:05.343412 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ced3e974-f915-4424-a9b4-fc9ea5152d5b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1371 microversion: 2.1 time: 0.156938 Sep 06 12:14:05.343996 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3758/7475] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:05 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:06.368077 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c54e4d36-a1c5-421a-af8c-a32c903318e4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:06.368707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c54e4d36-a1c5-421a-af8c-a32c903318e4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:06.375101 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54e4d36-a1c5-421a-af8c-a32c903318e4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:06.375600 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54e4d36-a1c5-421a-af8c-a32c903318e4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:06.376053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54e4d36-a1c5-421a-af8c-a32c903318e4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:06.376766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54e4d36-a1c5-421a-af8c-a32c903318e4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:06.377235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54e4d36-a1c5-421a-af8c-a32c903318e4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:06.377674 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c54e4d36-a1c5-421a-af8c-a32c903318e4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:06.520111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c54e4d36-a1c5-421a-af8c-a32c903318e4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:06.528253 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c54e4d36-a1c5-421a-af8c-a32c903318e4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1371 microversion: 2.1 time: 0.165155 Sep 06 12:14:06.529520 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3718/7476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:06 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:07.552197 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6299545f-2ffb-45b1-a59a-27fd6bdd8951 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:07.552833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6299545f-2ffb-45b1-a59a-27fd6bdd8951 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:07.559778 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6299545f-2ffb-45b1-a59a-27fd6bdd8951 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:07.560283 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6299545f-2ffb-45b1-a59a-27fd6bdd8951 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:07.560741 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6299545f-2ffb-45b1-a59a-27fd6bdd8951 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:07.561451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6299545f-2ffb-45b1-a59a-27fd6bdd8951 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:07.561924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6299545f-2ffb-45b1-a59a-27fd6bdd8951 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:07.562370 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6299545f-2ffb-45b1-a59a-27fd6bdd8951 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:07.696803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6299545f-2ffb-45b1-a59a-27fd6bdd8951 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:07.705591 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6299545f-2ffb-45b1-a59a-27fd6bdd8951 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1371 microversion: 2.1 time: 0.157343 Sep 06 12:14:07.706191 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3759/7477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:07 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:08.271473 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-7d78a41e-af48-447d-b6cf-b37e05f85b02 req-72820648-e6c4-4ed1-b034-8013d75c0c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbad374-35ca-433a-a086-7434dbff660b", "name": "network-vif-plugged", "status": "completed", "tag": "b2da4f25-e74b-481c-9564-66c75ac92b47"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:14:08.281779 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7d78a41e-af48-447d-b6cf-b37e05f85b02 req-72820648-e6c4-4ed1-b034-8013d75c0c51 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:08.282270 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7d78a41e-af48-447d-b6cf-b37e05f85b02 req-72820648-e6c4-4ed1-b034-8013d75c0c51 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:08.282714 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7d78a41e-af48-447d-b6cf-b37e05f85b02 req-72820648-e6c4-4ed1-b034-8013d75c0c51 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:08.293679 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7d78a41e-af48-447d-b6cf-b37e05f85b02 req-72820648-e6c4-4ed1-b034-8013d75c0c51 service nova] Creating event network-vif-plugged:b2da4f25-e74b-481c-9564-66c75ac92b47 for instance adbad374-35ca-433a-a086-7434dbff660b on nch1-master-1 Sep 06 12:14:08.298734 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-7d78a41e-af48-447d-b6cf-b37e05f85b02 req-72820648-e6c4-4ed1-b034-8013d75c0c51 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031140 Sep 06 12:14:08.299367 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3719/7478] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:14:08.730834 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5e0b2e2d-84d5-4949-8c30-a1f3f744f96e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:08.731391 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5e0b2e2d-84d5-4949-8c30-a1f3f744f96e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:08.733805 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:08.741150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0b2e2d-84d5-4949-8c30-a1f3f744f96e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:08.741656 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0b2e2d-84d5-4949-8c30-a1f3f744f96e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:08.742115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0b2e2d-84d5-4949-8c30-a1f3f744f96e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:08.742832 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0b2e2d-84d5-4949-8c30-a1f3f744f96e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:08.743339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0b2e2d-84d5-4949-8c30-a1f3f744f96e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:08.744172 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5e0b2e2d-84d5-4949-8c30-a1f3f744f96e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:08.880048 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5e0b2e2d-84d5-4949-8c30-a1f3f744f96e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:08.887946 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5e0b2e2d-84d5-4949-8c30-a1f3f744f96e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1371 microversion: 2.1 time: 0.161146 Sep 06 12:14:08.888527 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3760/7479] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:08 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:09.908780 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:09.914052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-785a164c-4158-4416-9582-48361ee25cfc tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:09.914767 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-785a164c-4158-4416-9582-48361ee25cfc tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:09.921595 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-785a164c-4158-4416-9582-48361ee25cfc tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:09.922088 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-785a164c-4158-4416-9582-48361ee25cfc tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:09.922537 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-785a164c-4158-4416-9582-48361ee25cfc tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:09.923430 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-785a164c-4158-4416-9582-48361ee25cfc tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:09.923905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-785a164c-4158-4416-9582-48361ee25cfc tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:09.924352 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-785a164c-4158-4416-9582-48361ee25cfc tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:10.060631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-785a164c-4158-4416-9582-48361ee25cfc tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:10.068590 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-785a164c-4158-4416-9582-48361ee25cfc tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1555 microversion: 2.1 time: 0.160847 Sep 06 12:14:10.069169 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3720/7480] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:09 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:10.091663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5f474861-220c-42ee-9c82-66a5e8a543a4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:10.093000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5f474861-220c-42ee-9c82-66a5e8a543a4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:10.094950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:10.101088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f474861-220c-42ee-9c82-66a5e8a543a4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:10.101602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f474861-220c-42ee-9c82-66a5e8a543a4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:10.102083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f474861-220c-42ee-9c82-66a5e8a543a4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:10.102815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f474861-220c-42ee-9c82-66a5e8a543a4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:10.103333 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f474861-220c-42ee-9c82-66a5e8a543a4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:10.103816 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5f474861-220c-42ee-9c82-66a5e8a543a4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:10.241216 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-5f474861-220c-42ee-9c82-66a5e8a543a4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:10.249039 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5f474861-220c-42ee-9c82-66a5e8a543a4 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1555 microversion: 2.1 time: 0.161354 Sep 06 12:14:10.249621 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3761/7481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:10 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:12.196782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-7e3e8f8c-1ee7-4a3c-a776-7a66563e2ba2 req-87bbe568-e11a-4123-9c66-4feaffc0eb8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adbad374-35ca-433a-a086-7434dbff660b", "tag": "b2da4f25-e74b-481c-9564-66c75ac92b47"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:14:12.208529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7e3e8f8c-1ee7-4a3c-a776-7a66563e2ba2 req-87bbe568-e11a-4123-9c66-4feaffc0eb8d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:12.209023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7e3e8f8c-1ee7-4a3c-a776-7a66563e2ba2 req-87bbe568-e11a-4123-9c66-4feaffc0eb8d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:12.209464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-7e3e8f8c-1ee7-4a3c-a776-7a66563e2ba2 req-87bbe568-e11a-4123-9c66-4feaffc0eb8d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:12.221276 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-7e3e8f8c-1ee7-4a3c-a776-7a66563e2ba2 req-87bbe568-e11a-4123-9c66-4feaffc0eb8d service nova] Creating event network-changed:b2da4f25-e74b-481c-9564-66c75ac92b47 for instance adbad374-35ca-433a-a086-7434dbff660b on nch1-master-1 Sep 06 12:14:12.226401 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-7e3e8f8c-1ee7-4a3c-a776-7a66563e2ba2 req-87bbe568-e11a-4123-9c66-4feaffc0eb8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033568 Sep 06 12:14:12.227034 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3721/7482] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:16:07.575864 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e366ae3e-f715-4bfe-a538-76a63bf43111] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 12:16:07.577020 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 12:16:07.577568 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:07.578554 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=38 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:07.583531 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-63f3afe0-2828-41cd-b9d6-1ced0452257a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:16:07.584080 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-63f3afe0-2828-41cd-b9d6-1ced0452257a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:07.590874 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63f3afe0-2828-41cd-b9d6-1ced0452257a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:07.598381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63f3afe0-2828-41cd-b9d6-1ced0452257a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:07.598381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63f3afe0-2828-41cd-b9d6-1ced0452257a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:07.598381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63f3afe0-2828-41cd-b9d6-1ced0452257a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:07.598381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63f3afe0-2828-41cd-b9d6-1ced0452257a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:07.598381 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-63f3afe0-2828-41cd-b9d6-1ced0452257a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:07.616716 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-63f3afe0-2828-41cd-b9d6-1ced0452257a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lazy-loading 'flavor' on Instance uuid adbad374-35ca-433a-a086-7434dbff660b {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:16:08.248919 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-63f3afe0-2828-41cd-b9d6-1ced0452257a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "POST /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b/action" status: 202 len: 0 microversion: 2.1 time: 0.674477 Sep 06 12:16:08.249522 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3762/7483] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:16:07 2022] POST /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b/action => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:16:08.256493 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f437706c-3085-4043-9dae-91c01118faaa] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 12:16:08.257651 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f57fb853-595b-4ef1-91ec-6bf7ec660ec1] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 12:16:08.258133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:08.258957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=30 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:08.260343 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:16:08.260476 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 12:16:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b (ip 10.222.0.20) !!! Sep 06 12:16:08.265992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bf6deb70-128a-48d7-a71c-59030505e325 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:08.266688 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bf6deb70-128a-48d7-a71c-59030505e325 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:08.273358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf6deb70-128a-48d7-a71c-59030505e325 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:08.273850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf6deb70-128a-48d7-a71c-59030505e325 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:08.274301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf6deb70-128a-48d7-a71c-59030505e325 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:08.275026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf6deb70-128a-48d7-a71c-59030505e325 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:08.275499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf6deb70-128a-48d7-a71c-59030505e325 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:08.275943 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-bf6deb70-128a-48d7-a71c-59030505e325 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:08.484856 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bf6deb70-128a-48d7-a71c-59030505e325 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:08.492937 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bf6deb70-128a-48d7-a71c-59030505e325 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1679 microversion: 2.1 time: 0.238679 Sep 06 12:16:08.493528 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3722/7484] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:08 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1679 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:09.522120 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-390db9d0-3b90-4497-9bf8-2d3d0e4af975 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:09.522843 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-390db9d0-3b90-4497-9bf8-2d3d0e4af975 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:09.533097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-390db9d0-3b90-4497-9bf8-2d3d0e4af975 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:09.533630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-390db9d0-3b90-4497-9bf8-2d3d0e4af975 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:09.534088 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-390db9d0-3b90-4497-9bf8-2d3d0e4af975 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:09.534804 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-390db9d0-3b90-4497-9bf8-2d3d0e4af975 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:09.535300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-390db9d0-3b90-4497-9bf8-2d3d0e4af975 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:09.535748 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-390db9d0-3b90-4497-9bf8-2d3d0e4af975 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:09.539868 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] [e366ae3e-f715-4bfe-a538-76a63bf43111] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36000. Sep 06 12:16:09.540595 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36002. Sep 06 12:16:09.676666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-390db9d0-3b90-4497-9bf8-2d3d0e4af975 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:09.685214 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-390db9d0-3b90-4497-9bf8-2d3d0e4af975 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1679 microversion: 2.1 time: 0.168620 Sep 06 12:16:09.685799 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3763/7485] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:09 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:10.709965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7a7113c2-a905-49e0-867f-95c3170b9470 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:10.717626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7a7113c2-a905-49e0-867f-95c3170b9470 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:10.722747 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a7113c2-a905-49e0-867f-95c3170b9470 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:10.723497 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a7113c2-a905-49e0-867f-95c3170b9470 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:10.723868 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a7113c2-a905-49e0-867f-95c3170b9470 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:10.724594 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a7113c2-a905-49e0-867f-95c3170b9470 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:10.725119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a7113c2-a905-49e0-867f-95c3170b9470 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:10.725560 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7a7113c2-a905-49e0-867f-95c3170b9470 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:10.734422 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] [f437706c-3085-4043-9dae-91c01118faaa] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36006. Sep 06 12:16:10.747167 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] [f57fb853-595b-4ef1-91ec-6bf7ec660ec1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36008. Sep 06 12:16:10.882945 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7a7113c2-a905-49e0-867f-95c3170b9470 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:10.891803 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7a7113c2-a905-49e0-867f-95c3170b9470 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1679 microversion: 2.1 time: 0.185846 Sep 06 12:16:10.894258 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3723/7486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:10 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:11.918682 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6eb76e48-829f-4d47-871b-a6fac47cae9b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:11.919353 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6eb76e48-829f-4d47-871b-a6fac47cae9b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:11.926402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6eb76e48-829f-4d47-871b-a6fac47cae9b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:11.926907 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6eb76e48-829f-4d47-871b-a6fac47cae9b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:11.927390 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6eb76e48-829f-4d47-871b-a6fac47cae9b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:11.928104 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6eb76e48-829f-4d47-871b-a6fac47cae9b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:11.928581 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6eb76e48-829f-4d47-871b-a6fac47cae9b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:11.929029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6eb76e48-829f-4d47-871b-a6fac47cae9b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:12.062305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6eb76e48-829f-4d47-871b-a6fac47cae9b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:12.070352 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6eb76e48-829f-4d47-871b-a6fac47cae9b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1679 microversion: 2.1 time: 0.155777 Sep 06 12:16:12.070932 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3764/7487] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:11 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:13.094965 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9bfc8b6a-5f13-4e60-98fa-aebd15043956 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:13.095649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9bfc8b6a-5f13-4e60-98fa-aebd15043956 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:13.102508 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bfc8b6a-5f13-4e60-98fa-aebd15043956 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:13.103001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bfc8b6a-5f13-4e60-98fa-aebd15043956 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:13.104168 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bfc8b6a-5f13-4e60-98fa-aebd15043956 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:13.104866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bfc8b6a-5f13-4e60-98fa-aebd15043956 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:13.105331 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bfc8b6a-5f13-4e60-98fa-aebd15043956 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:13.105764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9bfc8b6a-5f13-4e60-98fa-aebd15043956 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:13.239902 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9bfc8b6a-5f13-4e60-98fa-aebd15043956 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:13.247733 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9bfc8b6a-5f13-4e60-98fa-aebd15043956 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1679 microversion: 2.1 time: 0.156744 Sep 06 12:16:13.248317 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3724/7488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:13 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:14.271738 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-dfa2307e-bb71-4576-b41b-9351b48db2b2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:14.272363 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-dfa2307e-bb71-4576-b41b-9351b48db2b2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:14.279296 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dfa2307e-bb71-4576-b41b-9351b48db2b2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:14.279795 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dfa2307e-bb71-4576-b41b-9351b48db2b2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:14.280269 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dfa2307e-bb71-4576-b41b-9351b48db2b2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:14.280970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dfa2307e-bb71-4576-b41b-9351b48db2b2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:14.281602 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dfa2307e-bb71-4576-b41b-9351b48db2b2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:14.282046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-dfa2307e-bb71-4576-b41b-9351b48db2b2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:14.413059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-dfa2307e-bb71-4576-b41b-9351b48db2b2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:14.421423 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-dfa2307e-bb71-4576-b41b-9351b48db2b2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1679 microversion: 2.1 time: 0.153739 Sep 06 12:16:14.422003 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3765/7489] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:14 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:15.445777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8e7fe5bd-c35c-4354-8e85-a83061cc078b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:15.446402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8e7fe5bd-c35c-4354-8e85-a83061cc078b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:15.454358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e7fe5bd-c35c-4354-8e85-a83061cc078b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:15.454858 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e7fe5bd-c35c-4354-8e85-a83061cc078b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:15.455340 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e7fe5bd-c35c-4354-8e85-a83061cc078b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:15.456050 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e7fe5bd-c35c-4354-8e85-a83061cc078b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:15.456521 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e7fe5bd-c35c-4354-8e85-a83061cc078b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:15.456963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8e7fe5bd-c35c-4354-8e85-a83061cc078b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:15.597376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8e7fe5bd-c35c-4354-8e85-a83061cc078b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:15.606098 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8e7fe5bd-c35c-4354-8e85-a83061cc078b tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1679 microversion: 2.1 time: 0.164301 Sep 06 12:16:15.606674 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3725/7490] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:15 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:16.631036 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a05ae992-57e8-458f-9802-b219f04d069c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:16.631664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a05ae992-57e8-458f-9802-b219f04d069c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:16.638667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a05ae992-57e8-458f-9802-b219f04d069c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:16.639207 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a05ae992-57e8-458f-9802-b219f04d069c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:16.639664 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a05ae992-57e8-458f-9802-b219f04d069c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:16.640373 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a05ae992-57e8-458f-9802-b219f04d069c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:16.640847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a05ae992-57e8-458f-9802-b219f04d069c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:16.641292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a05ae992-57e8-458f-9802-b219f04d069c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:17.074305 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a05ae992-57e8-458f-9802-b219f04d069c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:17.082846 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a05ae992-57e8-458f-9802-b219f04d069c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1679 microversion: 2.1 time: 0.455976 Sep 06 12:16:17.083451 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3766/7491] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:16 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1679 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:18.107579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ec253722-3c52-4cbd-af03-4cd9c86a309e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:18.108194 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ec253722-3c52-4cbd-af03-4cd9c86a309e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:18.115239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec253722-3c52-4cbd-af03-4cd9c86a309e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:18.117119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec253722-3c52-4cbd-af03-4cd9c86a309e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:18.117119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec253722-3c52-4cbd-af03-4cd9c86a309e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:18.117119 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec253722-3c52-4cbd-af03-4cd9c86a309e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:18.117380 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec253722-3c52-4cbd-af03-4cd9c86a309e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:18.117829 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ec253722-3c52-4cbd-af03-4cd9c86a309e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:18.249806 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ec253722-3c52-4cbd-af03-4cd9c86a309e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:18.257767 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ec253722-3c52-4cbd-af03-4cd9c86a309e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1679 microversion: 2.1 time: 0.154809 Sep 06 12:16:18.258360 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3726/7492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:18 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:19.283719 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-79b2748d-aa32-4997-83cc-d4a5bebb3a4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:19.284345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-79b2748d-aa32-4997-83cc-d4a5bebb3a4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:19.291591 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79b2748d-aa32-4997-83cc-d4a5bebb3a4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:19.292091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79b2748d-aa32-4997-83cc-d4a5bebb3a4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:19.292544 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79b2748d-aa32-4997-83cc-d4a5bebb3a4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:19.293260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79b2748d-aa32-4997-83cc-d4a5bebb3a4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:19.293733 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79b2748d-aa32-4997-83cc-d4a5bebb3a4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:19.294181 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-79b2748d-aa32-4997-83cc-d4a5bebb3a4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:19.427891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-79b2748d-aa32-4997-83cc-d4a5bebb3a4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:19.436279 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-79b2748d-aa32-4997-83cc-d4a5bebb3a4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1700 microversion: 2.1 time: 0.157313 Sep 06 12:16:19.436853 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3767/7493] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:19 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1700 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:20.460498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d20b59ba-31b0-449f-9021-5d3424d4bc1e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:20.461093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d20b59ba-31b0-449f-9021-5d3424d4bc1e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:20.468160 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d20b59ba-31b0-449f-9021-5d3424d4bc1e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:20.468659 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d20b59ba-31b0-449f-9021-5d3424d4bc1e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:20.469112 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d20b59ba-31b0-449f-9021-5d3424d4bc1e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:20.469818 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d20b59ba-31b0-449f-9021-5d3424d4bc1e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:20.470307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d20b59ba-31b0-449f-9021-5d3424d4bc1e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:20.470751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d20b59ba-31b0-449f-9021-5d3424d4bc1e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:20.602713 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d20b59ba-31b0-449f-9021-5d3424d4bc1e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:20.610571 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d20b59ba-31b0-449f-9021-5d3424d4bc1e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1700 microversion: 2.1 time: 0.154125 Sep 06 12:16:20.611164 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3727/7494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:20 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1700 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:21.633950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a3133f47-3c7c-4546-9a68-0494083d8e88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:21.634580 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a3133f47-3c7c-4546-9a68-0494083d8e88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:21.642399 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3133f47-3c7c-4546-9a68-0494083d8e88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:21.642876 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3133f47-3c7c-4546-9a68-0494083d8e88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:21.643366 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3133f47-3c7c-4546-9a68-0494083d8e88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:21.644085 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3133f47-3c7c-4546-9a68-0494083d8e88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:21.644562 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3133f47-3c7c-4546-9a68-0494083d8e88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:21.645013 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a3133f47-3c7c-4546-9a68-0494083d8e88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:21.784846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a3133f47-3c7c-4546-9a68-0494083d8e88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:21.793144 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a3133f47-3c7c-4546-9a68-0494083d8e88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1695 microversion: 2.1 time: 0.163198 Sep 06 12:16:21.794043 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3768/7495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:21 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:22.819314 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-11904558-94da-4ecf-be23-74cc13661878 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:22.821481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-11904558-94da-4ecf-be23-74cc13661878 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:22.829260 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11904558-94da-4ecf-be23-74cc13661878 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:22.830023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11904558-94da-4ecf-be23-74cc13661878 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:22.830639 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11904558-94da-4ecf-be23-74cc13661878 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:22.831572 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11904558-94da-4ecf-be23-74cc13661878 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:22.832195 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11904558-94da-4ecf-be23-74cc13661878 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:22.832874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-11904558-94da-4ecf-be23-74cc13661878 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:22.872708 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-792e69dc-fea4-4e8a-b8e3-329f9e1caf1b req-82286bda-d2bf-44ca-b9dc-84e1e993ddaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbad374-35ca-433a-a086-7434dbff660b", "name": "network-vif-plugged", "status": "completed", "tag": "b2da4f25-e74b-481c-9564-66c75ac92b47"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:16:22.888862 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-792e69dc-fea4-4e8a-b8e3-329f9e1caf1b req-82286bda-d2bf-44ca-b9dc-84e1e993ddaf service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:22.893466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-792e69dc-fea4-4e8a-b8e3-329f9e1caf1b req-82286bda-d2bf-44ca-b9dc-84e1e993ddaf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:22.894349 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-792e69dc-fea4-4e8a-b8e3-329f9e1caf1b req-82286bda-d2bf-44ca-b9dc-84e1e993ddaf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:22.910965 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-792e69dc-fea4-4e8a-b8e3-329f9e1caf1b req-82286bda-d2bf-44ca-b9dc-84e1e993ddaf service nova] Creating event network-vif-plugged:b2da4f25-e74b-481c-9564-66c75ac92b47 for instance adbad374-35ca-433a-a086-7434dbff660b on nch1-master-1 Sep 06 12:16:22.922628 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-792e69dc-fea4-4e8a-b8e3-329f9e1caf1b req-82286bda-d2bf-44ca-b9dc-84e1e993ddaf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054043 Sep 06 12:16:22.924087 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3769/7496] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:16:22.990546 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-11904558-94da-4ecf-be23-74cc13661878 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:23.000117 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-11904558-94da-4ecf-be23-74cc13661878 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1695 microversion: 2.1 time: 0.186092 Sep 06 12:16:23.001050 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3728/7497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:22 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:24.030017 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-7a8a7345-a184-46b6-b958-00c21d9f7172 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:24.030765 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-7a8a7345-a184-46b6-b958-00c21d9f7172 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:24.039691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a8a7345-a184-46b6-b958-00c21d9f7172 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:24.040561 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a8a7345-a184-46b6-b958-00c21d9f7172 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:24.041473 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a8a7345-a184-46b6-b958-00c21d9f7172 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:24.042442 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a8a7345-a184-46b6-b958-00c21d9f7172 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:24.043198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a8a7345-a184-46b6-b958-00c21d9f7172 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:24.043863 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-7a8a7345-a184-46b6-b958-00c21d9f7172 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:24.215908 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-7a8a7345-a184-46b6-b958-00c21d9f7172 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:24.225866 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-7a8a7345-a184-46b6-b958-00c21d9f7172 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1695 microversion: 2.1 time: 0.200594 Sep 06 12:16:24.227316 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3770/7498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:24 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1695 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:25.252845 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2ae30138-19c2-46c4-936a-ef23dccf8a2e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:25.254014 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2ae30138-19c2-46c4-936a-ef23dccf8a2e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:25.261011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae30138-19c2-46c4-936a-ef23dccf8a2e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:25.261414 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae30138-19c2-46c4-936a-ef23dccf8a2e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:25.261855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae30138-19c2-46c4-936a-ef23dccf8a2e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:25.262744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae30138-19c2-46c4-936a-ef23dccf8a2e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:25.263241 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae30138-19c2-46c4-936a-ef23dccf8a2e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:25.263692 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2ae30138-19c2-46c4-936a-ef23dccf8a2e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:25.451825 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2ae30138-19c2-46c4-936a-ef23dccf8a2e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:25.469813 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2ae30138-19c2-46c4-936a-ef23dccf8a2e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1695 microversion: 2.1 time: 0.222291 Sep 06 12:16:25.470512 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3729/7499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:25 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1695 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:26.495589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ea58ffe5-89d3-4c5b-a951-f0acb162e235 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:26.496140 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ea58ffe5-89d3-4c5b-a951-f0acb162e235 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:26.504731 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea58ffe5-89d3-4c5b-a951-f0acb162e235 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:26.505214 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea58ffe5-89d3-4c5b-a951-f0acb162e235 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:26.505696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea58ffe5-89d3-4c5b-a951-f0acb162e235 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:26.506435 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea58ffe5-89d3-4c5b-a951-f0acb162e235 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:26.506920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea58ffe5-89d3-4c5b-a951-f0acb162e235 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:26.507471 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ea58ffe5-89d3-4c5b-a951-f0acb162e235 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:26.659388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ea58ffe5-89d3-4c5b-a951-f0acb162e235 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:26.674976 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ea58ffe5-89d3-4c5b-a951-f0acb162e235 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1695 microversion: 2.1 time: 0.183324 Sep 06 12:16:26.677793 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3771/7500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:26 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:27.702573 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d1592ff7-366c-4aad-b321-8a73ea66da6c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:27.716232 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d1592ff7-366c-4aad-b321-8a73ea66da6c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:27.729721 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1592ff7-366c-4aad-b321-8a73ea66da6c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:27.730343 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1592ff7-366c-4aad-b321-8a73ea66da6c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:27.731330 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1592ff7-366c-4aad-b321-8a73ea66da6c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:27.732372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1592ff7-366c-4aad-b321-8a73ea66da6c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:27.735148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1592ff7-366c-4aad-b321-8a73ea66da6c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:27.735891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d1592ff7-366c-4aad-b321-8a73ea66da6c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:27.901311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d1592ff7-366c-4aad-b321-8a73ea66da6c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:27.912683 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d1592ff7-366c-4aad-b321-8a73ea66da6c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1695 microversion: 2.1 time: 0.213852 Sep 06 12:16:27.913736 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3730/7501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:27 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1695 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:28.938553 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-85eae069-b863-4328-bab8-57a2608f02dd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:28.940051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-85eae069-b863-4328-bab8-57a2608f02dd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:28.947919 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85eae069-b863-4328-bab8-57a2608f02dd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:28.948431 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85eae069-b863-4328-bab8-57a2608f02dd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:28.948970 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85eae069-b863-4328-bab8-57a2608f02dd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:28.949711 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85eae069-b863-4328-bab8-57a2608f02dd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:28.950192 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85eae069-b863-4328-bab8-57a2608f02dd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:28.950641 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-85eae069-b863-4328-bab8-57a2608f02dd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:29.108821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-85eae069-b863-4328-bab8-57a2608f02dd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:29.118339 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-85eae069-b863-4328-bab8-57a2608f02dd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1695 microversion: 2.1 time: 0.184466 Sep 06 12:16:29.119836 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3772/7502] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:28 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:30.145347 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-3d9698c2-544d-4045-b890-b0cbe3fe21f5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:30.147131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-3d9698c2-544d-4045-b890-b0cbe3fe21f5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:30.154191 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d9698c2-544d-4045-b890-b0cbe3fe21f5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:30.154700 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d9698c2-544d-4045-b890-b0cbe3fe21f5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:30.155266 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d9698c2-544d-4045-b890-b0cbe3fe21f5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:30.155994 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d9698c2-544d-4045-b890-b0cbe3fe21f5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:30.156480 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d9698c2-544d-4045-b890-b0cbe3fe21f5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:30.156913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-3d9698c2-544d-4045-b890-b0cbe3fe21f5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:30.319151 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-3d9698c2-544d-4045-b890-b0cbe3fe21f5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:30.330727 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-3d9698c2-544d-4045-b890-b0cbe3fe21f5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1695 microversion: 2.1 time: 0.189331 Sep 06 12:16:30.331792 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3731/7503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:30 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:31.355432 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c31563b3-3b3c-4b34-a866-3565e396ffc3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:31.356800 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c31563b3-3b3c-4b34-a866-3565e396ffc3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:31.366586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c31563b3-3b3c-4b34-a866-3565e396ffc3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:31.367131 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c31563b3-3b3c-4b34-a866-3565e396ffc3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:31.367604 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c31563b3-3b3c-4b34-a866-3565e396ffc3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:31.368515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c31563b3-3b3c-4b34-a866-3565e396ffc3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:31.369410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c31563b3-3b3c-4b34-a866-3565e396ffc3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:31.370488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c31563b3-3b3c-4b34-a866-3565e396ffc3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:31.531201 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c31563b3-3b3c-4b34-a866-3565e396ffc3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:31.540381 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c31563b3-3b3c-4b34-a866-3565e396ffc3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1695 microversion: 2.1 time: 0.188938 Sep 06 12:16:31.541152 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3773/7504] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:31 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:32.564568 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1e4a667a-29bc-4351-b5be-c8b32836e5bd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:32.565183 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1e4a667a-29bc-4351-b5be-c8b32836e5bd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:32.572311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e4a667a-29bc-4351-b5be-c8b32836e5bd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:32.577787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e4a667a-29bc-4351-b5be-c8b32836e5bd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:32.577787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e4a667a-29bc-4351-b5be-c8b32836e5bd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:32.577787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e4a667a-29bc-4351-b5be-c8b32836e5bd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:32.577787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e4a667a-29bc-4351-b5be-c8b32836e5bd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:32.577787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e4a667a-29bc-4351-b5be-c8b32836e5bd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:32.711859 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1e4a667a-29bc-4351-b5be-c8b32836e5bd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:32.720715 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1e4a667a-29bc-4351-b5be-c8b32836e5bd tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1677 microversion: 2.1 time: 0.160187 Sep 06 12:16:32.722479 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3732/7505] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:32 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:33.745267 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-37014d10-b18b-43f7-acea-33b9f1b6630e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:33.745899 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-37014d10-b18b-43f7-acea-33b9f1b6630e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:33.753688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37014d10-b18b-43f7-acea-33b9f1b6630e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:33.756035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37014d10-b18b-43f7-acea-33b9f1b6630e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:33.756035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37014d10-b18b-43f7-acea-33b9f1b6630e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:33.756035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37014d10-b18b-43f7-acea-33b9f1b6630e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:33.756035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37014d10-b18b-43f7-acea-33b9f1b6630e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:33.756501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-37014d10-b18b-43f7-acea-33b9f1b6630e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:33.891440 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-37014d10-b18b-43f7-acea-33b9f1b6630e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:33.899516 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-37014d10-b18b-43f7-acea-33b9f1b6630e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1677 microversion: 2.1 time: 0.158213 Sep 06 12:16:33.900158 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3774/7506] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:33 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:34.807764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-2c73f60e-669f-4567-886f-230c5797ff9c req-402c85d1-ef0e-4ad9-93de-354a3d0a3e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbad374-35ca-433a-a086-7434dbff660b", "name": "network-vif-unplugged", "status": "completed", "tag": "b2da4f25-e74b-481c-9564-66c75ac92b47"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:16:34.818928 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2c73f60e-669f-4567-886f-230c5797ff9c req-402c85d1-ef0e-4ad9-93de-354a3d0a3e3b service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:34.819504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2c73f60e-669f-4567-886f-230c5797ff9c req-402c85d1-ef0e-4ad9-93de-354a3d0a3e3b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:34.819954 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2c73f60e-669f-4567-886f-230c5797ff9c req-402c85d1-ef0e-4ad9-93de-354a3d0a3e3b service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:34.832577 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-2c73f60e-669f-4567-886f-230c5797ff9c req-402c85d1-ef0e-4ad9-93de-354a3d0a3e3b service nova] Creating event network-vif-unplugged:b2da4f25-e74b-481c-9564-66c75ac92b47 for instance adbad374-35ca-433a-a086-7434dbff660b on nch1-master-1 Sep 06 12:16:34.838070 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-2c73f60e-669f-4567-886f-230c5797ff9c req-402c85d1-ef0e-4ad9-93de-354a3d0a3e3b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034158 Sep 06 12:16:34.838708 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3733/7507] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:16:34.924466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a0793fa3-5b8e-4403-9cbc-3814df55a76a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:34.925721 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a0793fa3-5b8e-4403-9cbc-3814df55a76a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:34.933052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0793fa3-5b8e-4403-9cbc-3814df55a76a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:34.933565 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0793fa3-5b8e-4403-9cbc-3814df55a76a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:34.934029 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0793fa3-5b8e-4403-9cbc-3814df55a76a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:34.934764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0793fa3-5b8e-4403-9cbc-3814df55a76a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:34.935414 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0793fa3-5b8e-4403-9cbc-3814df55a76a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:34.935803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a0793fa3-5b8e-4403-9cbc-3814df55a76a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:35.078096 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a0793fa3-5b8e-4403-9cbc-3814df55a76a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:35.085977 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a0793fa3-5b8e-4403-9cbc-3814df55a76a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1680 microversion: 2.1 time: 0.166335 Sep 06 12:16:35.086562 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3775/7508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:34 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:35.109769 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7e6c3c3d-afd3-4752-8eed-934d7fba7aa5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:16:35.111084 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e6c3c3d-afd3-4752-8eed-934d7fba7aa5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:35.117450 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e6c3c3d-afd3-4752-8eed-934d7fba7aa5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:35.117939 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e6c3c3d-afd3-4752-8eed-934d7fba7aa5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:35.118393 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e6c3c3d-afd3-4752-8eed-934d7fba7aa5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:35.119143 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e6c3c3d-afd3-4752-8eed-934d7fba7aa5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:35.119645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e6c3c3d-afd3-4752-8eed-934d7fba7aa5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:35.120086 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7e6c3c3d-afd3-4752-8eed-934d7fba7aa5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:35.162332 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7e6c3c3d-afd3-4752-8eed-934d7fba7aa5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140875) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 12:16:35.426148 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7e6c3c3d-afd3-4752-8eed-934d7fba7aa5 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "POST /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b/action" status: 202 len: 0 microversion: 2.1 time: 0.320729 Sep 06 12:16:35.426965 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3734/7509] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:16:35 2022] POST /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:16:35.435249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c176ab13-aac1-4f58-88d0-7e3550be4440 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:35.435889 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c176ab13-aac1-4f58-88d0-7e3550be4440 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:35.442410 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c176ab13-aac1-4f58-88d0-7e3550be4440 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:35.442929 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c176ab13-aac1-4f58-88d0-7e3550be4440 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:35.443517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c176ab13-aac1-4f58-88d0-7e3550be4440 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:35.444238 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c176ab13-aac1-4f58-88d0-7e3550be4440 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:35.444839 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c176ab13-aac1-4f58-88d0-7e3550be4440 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:35.445292 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c176ab13-aac1-4f58-88d0-7e3550be4440 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:35.589983 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c176ab13-aac1-4f58-88d0-7e3550be4440 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:35.598720 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c176ab13-aac1-4f58-88d0-7e3550be4440 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1688 microversion: 2.1 time: 0.167571 Sep 06 12:16:35.599334 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3776/7510] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:35 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:36.623022 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5f47840d-4532-4c0e-ad56-cf2c2d2fd5ee tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:36.623665 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-5f47840d-4532-4c0e-ad56-cf2c2d2fd5ee tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:36.630854 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f47840d-4532-4c0e-ad56-cf2c2d2fd5ee tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:36.631389 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f47840d-4532-4c0e-ad56-cf2c2d2fd5ee tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:36.631821 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f47840d-4532-4c0e-ad56-cf2c2d2fd5ee tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:36.632538 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f47840d-4532-4c0e-ad56-cf2c2d2fd5ee tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:36.633028 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f47840d-4532-4c0e-ad56-cf2c2d2fd5ee tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:36.633472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-5f47840d-4532-4c0e-ad56-cf2c2d2fd5ee tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:36.769736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-5f47840d-4532-4c0e-ad56-cf2c2d2fd5ee tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:36.777759 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5f47840d-4532-4c0e-ad56-cf2c2d2fd5ee tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1628 microversion: 2.1 time: 0.159807 Sep 06 12:16:36.778434 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3735/7511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:36 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1628 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:37.802035 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-2197df5b-c2c9-46f7-8621-ecdb2b13666f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:37.802781 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-2197df5b-c2c9-46f7-8621-ecdb2b13666f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:37.805950 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=31 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:37.810838 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2197df5b-c2c9-46f7-8621-ecdb2b13666f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:37.811386 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2197df5b-c2c9-46f7-8621-ecdb2b13666f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:37.811845 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2197df5b-c2c9-46f7-8621-ecdb2b13666f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:37.812566 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2197df5b-c2c9-46f7-8621-ecdb2b13666f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:37.813046 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2197df5b-c2c9-46f7-8621-ecdb2b13666f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:37.813497 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-2197df5b-c2c9-46f7-8621-ecdb2b13666f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:37.818347 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:37.955998 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-2197df5b-c2c9-46f7-8621-ecdb2b13666f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:37.964072 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-2197df5b-c2c9-46f7-8621-ecdb2b13666f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.166120 Sep 06 12:16:37.964657 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3777/7512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:37 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:38.988391 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-546c4493-00ee-416c-a330-fdca274a6d4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:38.989363 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-546c4493-00ee-416c-a330-fdca274a6d4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:38.992367 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:38.997292 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-546c4493-00ee-416c-a330-fdca274a6d4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:38.998032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-546c4493-00ee-416c-a330-fdca274a6d4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:38.998481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-546c4493-00ee-416c-a330-fdca274a6d4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:38.999284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-546c4493-00ee-416c-a330-fdca274a6d4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:38.999758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-546c4493-00ee-416c-a330-fdca274a6d4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:39.000198 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-546c4493-00ee-416c-a330-fdca274a6d4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:39.003586 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:39.166135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-546c4493-00ee-416c-a330-fdca274a6d4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:39.175408 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-546c4493-00ee-416c-a330-fdca274a6d4c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.190954 Sep 06 12:16:39.185786 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3736/7513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:38 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:40.200818 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-62d9e592-353e-40cd-b93f-2a07c3ec7034 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:40.201717 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-62d9e592-353e-40cd-b93f-2a07c3ec7034 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:40.208456 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62d9e592-353e-40cd-b93f-2a07c3ec7034 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:40.208973 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62d9e592-353e-40cd-b93f-2a07c3ec7034 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:40.209436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62d9e592-353e-40cd-b93f-2a07c3ec7034 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:40.210178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62d9e592-353e-40cd-b93f-2a07c3ec7034 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:40.210666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62d9e592-353e-40cd-b93f-2a07c3ec7034 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:40.211183 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62d9e592-353e-40cd-b93f-2a07c3ec7034 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:40.386082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-62d9e592-353e-40cd-b93f-2a07c3ec7034 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:40.391738 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-62d9e592-353e-40cd-b93f-2a07c3ec7034 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.195127 Sep 06 12:16:40.395705 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3778/7514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:40 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:41.417667 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-01953d72-1744-4e0c-9578-95ce4a51c944 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:41.418375 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-01953d72-1744-4e0c-9578-95ce4a51c944 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:41.426308 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01953d72-1744-4e0c-9578-95ce4a51c944 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:41.427749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01953d72-1744-4e0c-9578-95ce4a51c944 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:41.427749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01953d72-1744-4e0c-9578-95ce4a51c944 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:41.427997 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01953d72-1744-4e0c-9578-95ce4a51c944 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:41.428466 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01953d72-1744-4e0c-9578-95ce4a51c944 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:41.428931 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-01953d72-1744-4e0c-9578-95ce4a51c944 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:41.577338 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-01953d72-1744-4e0c-9578-95ce4a51c944 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:41.586071 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-01953d72-1744-4e0c-9578-95ce4a51c944 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.172632 Sep 06 12:16:41.586858 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3737/7515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:41 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:42.612670 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-27cf0a7e-7527-4e47-84c9-479d61acc0a6 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:42.613461 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-27cf0a7e-7527-4e47-84c9-479d61acc0a6 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:42.620630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27cf0a7e-7527-4e47-84c9-479d61acc0a6 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:42.621146 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27cf0a7e-7527-4e47-84c9-479d61acc0a6 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:42.621587 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27cf0a7e-7527-4e47-84c9-479d61acc0a6 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:42.622467 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27cf0a7e-7527-4e47-84c9-479d61acc0a6 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:42.623295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27cf0a7e-7527-4e47-84c9-479d61acc0a6 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:42.623951 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-27cf0a7e-7527-4e47-84c9-479d61acc0a6 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:42.777847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-27cf0a7e-7527-4e47-84c9-479d61acc0a6 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:42.787457 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-27cf0a7e-7527-4e47-84c9-479d61acc0a6 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.179425 Sep 06 12:16:42.788057 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3779/7516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:42 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:43.815301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b15eac79-0dda-4a82-89aa-1d114860e5ea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:43.816977 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b15eac79-0dda-4a82-89aa-1d114860e5ea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:43.829249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b15eac79-0dda-4a82-89aa-1d114860e5ea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:43.833098 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b15eac79-0dda-4a82-89aa-1d114860e5ea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:43.833791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b15eac79-0dda-4a82-89aa-1d114860e5ea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:43.834941 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b15eac79-0dda-4a82-89aa-1d114860e5ea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:43.835699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b15eac79-0dda-4a82-89aa-1d114860e5ea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:43.836382 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b15eac79-0dda-4a82-89aa-1d114860e5ea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:44.032682 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b15eac79-0dda-4a82-89aa-1d114860e5ea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:44.045452 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b15eac79-0dda-4a82-89aa-1d114860e5ea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.236336 Sep 06 12:16:44.046654 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3738/7517] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:43 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:45.079519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-9e90e6e9-36a7-4060-9bd7-923e079f6771 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:45.079519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-9e90e6e9-36a7-4060-9bd7-923e079f6771 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:45.085720 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e90e6e9-36a7-4060-9bd7-923e079f6771 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:45.086241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e90e6e9-36a7-4060-9bd7-923e079f6771 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:45.086707 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e90e6e9-36a7-4060-9bd7-923e079f6771 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:45.087475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e90e6e9-36a7-4060-9bd7-923e079f6771 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:45.087956 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e90e6e9-36a7-4060-9bd7-923e079f6771 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:45.088411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-9e90e6e9-36a7-4060-9bd7-923e079f6771 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:45.235426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-9e90e6e9-36a7-4060-9bd7-923e079f6771 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:45.243999 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-9e90e6e9-36a7-4060-9bd7-923e079f6771 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.171588 Sep 06 12:16:45.244589 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3780/7518] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:45 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:46.270093 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-2216bce6-ee5c-4f1d-b310-4b471e830fad tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:46.270729 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-2216bce6-ee5c-4f1d-b310-4b471e830fad tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:46.279238 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2216bce6-ee5c-4f1d-b310-4b471e830fad tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:46.279866 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2216bce6-ee5c-4f1d-b310-4b471e830fad tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:46.280395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2216bce6-ee5c-4f1d-b310-4b471e830fad tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:46.281222 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2216bce6-ee5c-4f1d-b310-4b471e830fad tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:46.281764 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2216bce6-ee5c-4f1d-b310-4b471e830fad tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:46.282310 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-2216bce6-ee5c-4f1d-b310-4b471e830fad tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:46.431791 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-2216bce6-ee5c-4f1d-b310-4b471e830fad tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:46.440790 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-2216bce6-ee5c-4f1d-b310-4b471e830fad tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.174788 Sep 06 12:16:46.441564 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3739/7519] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:46 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:47.465878 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-389efbe1-02c8-4084-bdb9-cf0d0d13a233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:47.466666 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-389efbe1-02c8-4084-bdb9-cf0d0d13a233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:47.473492 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-389efbe1-02c8-4084-bdb9-cf0d0d13a233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:47.473995 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-389efbe1-02c8-4084-bdb9-cf0d0d13a233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:47.474453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-389efbe1-02c8-4084-bdb9-cf0d0d13a233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:47.475205 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-389efbe1-02c8-4084-bdb9-cf0d0d13a233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:47.475681 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-389efbe1-02c8-4084-bdb9-cf0d0d13a233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:47.476126 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-389efbe1-02c8-4084-bdb9-cf0d0d13a233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:47.608239 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-389efbe1-02c8-4084-bdb9-cf0d0d13a233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:47.616689 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-389efbe1-02c8-4084-bdb9-cf0d0d13a233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.154802 Sep 06 12:16:47.617264 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3781/7520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:47 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:48.640075 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7067458e-fc10-4988-8137-cd51d375031a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:48.640690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7067458e-fc10-4988-8137-cd51d375031a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:48.648059 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7067458e-fc10-4988-8137-cd51d375031a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:48.648547 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7067458e-fc10-4988-8137-cd51d375031a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:48.648990 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7067458e-fc10-4988-8137-cd51d375031a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:48.649689 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7067458e-fc10-4988-8137-cd51d375031a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:48.650158 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7067458e-fc10-4988-8137-cd51d375031a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:48.650592 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7067458e-fc10-4988-8137-cd51d375031a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:48.788045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7067458e-fc10-4988-8137-cd51d375031a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:48.796188 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7067458e-fc10-4988-8137-cd51d375031a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.160030 Sep 06 12:16:48.796777 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3740/7521] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:48 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:49.820558 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c22c6fa0-ff5f-4c0f-a0ca-517517ac062c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:49.821180 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c22c6fa0-ff5f-4c0f-a0ca-517517ac062c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:49.828540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c22c6fa0-ff5f-4c0f-a0ca-517517ac062c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:49.829091 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c22c6fa0-ff5f-4c0f-a0ca-517517ac062c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:49.829542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c22c6fa0-ff5f-4c0f-a0ca-517517ac062c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:49.830251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c22c6fa0-ff5f-4c0f-a0ca-517517ac062c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:49.831487 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c22c6fa0-ff5f-4c0f-a0ca-517517ac062c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:49.831933 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c22c6fa0-ff5f-4c0f-a0ca-517517ac062c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:49.964250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c22c6fa0-ff5f-4c0f-a0ca-517517ac062c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:49.972120 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c22c6fa0-ff5f-4c0f-a0ca-517517ac062c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.155549 Sep 06 12:16:49.972700 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3782/7522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:49 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:50.996000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ed2fea29-89a1-4205-90bc-fd3fa65890d3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:50.996529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ed2fea29-89a1-4205-90bc-fd3fa65890d3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:51.004000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed2fea29-89a1-4205-90bc-fd3fa65890d3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:51.004495 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed2fea29-89a1-4205-90bc-fd3fa65890d3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:51.004950 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed2fea29-89a1-4205-90bc-fd3fa65890d3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:51.005661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed2fea29-89a1-4205-90bc-fd3fa65890d3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:51.006133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed2fea29-89a1-4205-90bc-fd3fa65890d3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:51.006576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-ed2fea29-89a1-4205-90bc-fd3fa65890d3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:51.140913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ed2fea29-89a1-4205-90bc-fd3fa65890d3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:51.149420 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ed2fea29-89a1-4205-90bc-fd3fa65890d3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.157490 Sep 06 12:16:51.150014 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3741/7523] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:50 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:52.172993 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-58c14b1d-fe40-4424-a86d-ff81645af48e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:52.173545 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-58c14b1d-fe40-4424-a86d-ff81645af48e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:52.181108 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58c14b1d-fe40-4424-a86d-ff81645af48e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:52.181606 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58c14b1d-fe40-4424-a86d-ff81645af48e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:52.182058 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58c14b1d-fe40-4424-a86d-ff81645af48e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:52.182770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58c14b1d-fe40-4424-a86d-ff81645af48e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:52.183262 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58c14b1d-fe40-4424-a86d-ff81645af48e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:52.183704 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-58c14b1d-fe40-4424-a86d-ff81645af48e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:52.320637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-58c14b1d-fe40-4424-a86d-ff81645af48e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:52.328846 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-58c14b1d-fe40-4424-a86d-ff81645af48e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.160223 Sep 06 12:16:52.329420 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3783/7524] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:52 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:52.901565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9e53e08d-9537-4762-89ca-76f28392c7ff req-b3d91e42-5032-44f3-828e-5bdf57eaf387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbad374-35ca-433a-a086-7434dbff660b", "name": "network-vif-plugged", "status": "completed", "tag": "b2da4f25-e74b-481c-9564-66c75ac92b47"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:16:52.913358 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9e53e08d-9537-4762-89ca-76f28392c7ff req-b3d91e42-5032-44f3-828e-5bdf57eaf387 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:52.913846 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9e53e08d-9537-4762-89ca-76f28392c7ff req-b3d91e42-5032-44f3-828e-5bdf57eaf387 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:52.914282 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9e53e08d-9537-4762-89ca-76f28392c7ff req-b3d91e42-5032-44f3-828e-5bdf57eaf387 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:52.925582 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9e53e08d-9537-4762-89ca-76f28392c7ff req-b3d91e42-5032-44f3-828e-5bdf57eaf387 service nova] Creating event network-vif-plugged:b2da4f25-e74b-481c-9564-66c75ac92b47 for instance adbad374-35ca-433a-a086-7434dbff660b on nch1-master-1 Sep 06 12:16:52.930518 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9e53e08d-9537-4762-89ca-76f28392c7ff req-b3d91e42-5032-44f3-828e-5bdf57eaf387 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032742 Sep 06 12:16:52.931161 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3742/7525] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:16:53.352423 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8f9f5fe0-f737-42b0-976c-5bf8f46315d0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:53.353051 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8f9f5fe0-f737-42b0-976c-5bf8f46315d0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:53.360093 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f9f5fe0-f737-42b0-976c-5bf8f46315d0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:53.360593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f9f5fe0-f737-42b0-976c-5bf8f46315d0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:53.361059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f9f5fe0-f737-42b0-976c-5bf8f46315d0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:53.361906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f9f5fe0-f737-42b0-976c-5bf8f46315d0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:53.362383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f9f5fe0-f737-42b0-976c-5bf8f46315d0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:53.362821 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8f9f5fe0-f737-42b0-976c-5bf8f46315d0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:53.493728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-8f9f5fe0-f737-42b0-976c-5bf8f46315d0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:53.501620 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8f9f5fe0-f737-42b0-976c-5bf8f46315d0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.153171 Sep 06 12:16:53.502700 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3784/7526] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:53 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:54.527509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b05be452-dc3b-4af2-a8f6-d326e1982c7a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:54.528355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b05be452-dc3b-4af2-a8f6-d326e1982c7a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:54.535634 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b05be452-dc3b-4af2-a8f6-d326e1982c7a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:54.536131 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b05be452-dc3b-4af2-a8f6-d326e1982c7a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:54.536588 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b05be452-dc3b-4af2-a8f6-d326e1982c7a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:54.537305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b05be452-dc3b-4af2-a8f6-d326e1982c7a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:54.537774 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b05be452-dc3b-4af2-a8f6-d326e1982c7a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:54.538217 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b05be452-dc3b-4af2-a8f6-d326e1982c7a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:54.677894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-b05be452-dc3b-4af2-a8f6-d326e1982c7a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:54.685994 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b05be452-dc3b-4af2-a8f6-d326e1982c7a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1686 microversion: 2.1 time: 0.163915 Sep 06 12:16:54.686582 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3743/7527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:54 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:55.709811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-866b8712-d468-4dd8-a1b3-90111462632c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:55.710491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-866b8712-d468-4dd8-a1b3-90111462632c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:55.717923 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-866b8712-d468-4dd8-a1b3-90111462632c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:55.721376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-866b8712-d468-4dd8-a1b3-90111462632c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:55.721376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-866b8712-d468-4dd8-a1b3-90111462632c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:55.721376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-866b8712-d468-4dd8-a1b3-90111462632c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:55.721376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-866b8712-d468-4dd8-a1b3-90111462632c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:55.721376 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-866b8712-d468-4dd8-a1b3-90111462632c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:55.860097 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-866b8712-d468-4dd8-a1b3-90111462632c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:55.867999 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-866b8712-d468-4dd8-a1b3-90111462632c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1673 microversion: 2.1 time: 0.162066 Sep 06 12:16:55.868580 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3785/7528] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:55 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:07.567644 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=15 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:07.568661 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=43 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:07.569831 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:18:07.569980 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 12:18:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b (ip 10.222.0.20) !!! Sep 06 12:18:07.570354 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=17 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:07.571187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=53 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:07.572982 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:18:07.573124 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 12:18:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 06 12:18:07.574614 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:18:07.575508 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 12:18:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 06 12:18:07.576785 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-fb695d0a-a575-4610-8b47-aacba93282f0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:07.578432 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb695d0a-a575-4610-8b47-aacba93282f0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:07.586975 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb695d0a-a575-4610-8b47-aacba93282f0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:07.587512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb695d0a-a575-4610-8b47-aacba93282f0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:07.588320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb695d0a-a575-4610-8b47-aacba93282f0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:07.588699 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb695d0a-a575-4610-8b47-aacba93282f0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:07.589178 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb695d0a-a575-4610-8b47-aacba93282f0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:07.589625 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-fb695d0a-a575-4610-8b47-aacba93282f0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:07.624759 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-fb695d0a-a575-4610-8b47-aacba93282f0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:18:07.652295 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-b1821564-1eaa-4e43-a79a-ad2aab6971e4 req-af83d8d6-3116-4b56-becf-98f3422b6b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adbad374-35ca-433a-a086-7434dbff660b", "tag": "b2da4f25-e74b-481c-9564-66c75ac92b47"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:18:07.663985 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b1821564-1eaa-4e43-a79a-ad2aab6971e4 req-af83d8d6-3116-4b56-becf-98f3422b6b47 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:07.664515 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b1821564-1eaa-4e43-a79a-ad2aab6971e4 req-af83d8d6-3116-4b56-becf-98f3422b6b47 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:07.664965 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b1821564-1eaa-4e43-a79a-ad2aab6971e4 req-af83d8d6-3116-4b56-becf-98f3422b6b47 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:07.677911 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-b1821564-1eaa-4e43-a79a-ad2aab6971e4 req-af83d8d6-3116-4b56-becf-98f3422b6b47 service nova] Creating event network-changed:b2da4f25-e74b-481c-9564-66c75ac92b47 for instance adbad374-35ca-433a-a086-7434dbff660b on nch1-master-1 Sep 06 12:18:07.683906 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-b1821564-1eaa-4e43-a79a-ad2aab6971e4 req-af83d8d6-3116-4b56-becf-98f3422b6b47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115585 Sep 06 12:18:07.685696 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3786/7529] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:18:07.965186 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-fb695d0a-a575-4610-8b47-aacba93282f0 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "DELETE /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 204 len: 0 microversion: 2.1 time: 0.399882 Sep 06 12:18:07.966823 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3744/7530] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 12:18:07 2022] DELETE /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:18:07.975918 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0b593173-1c27-4d7c-a8f4-d1cb024d9891 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:07.976645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0b593173-1c27-4d7c-a8f4-d1cb024d9891 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:07.984259 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b593173-1c27-4d7c-a8f4-d1cb024d9891 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:07.984771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b593173-1c27-4d7c-a8f4-d1cb024d9891 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:07.985278 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b593173-1c27-4d7c-a8f4-d1cb024d9891 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:07.986098 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b593173-1c27-4d7c-a8f4-d1cb024d9891 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:07.986637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b593173-1c27-4d7c-a8f4-d1cb024d9891 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:07.987115 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0b593173-1c27-4d7c-a8f4-d1cb024d9891 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:08.134315 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0b593173-1c27-4d7c-a8f4-d1cb024d9891 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:08.143252 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0b593173-1c27-4d7c-a8f4-d1cb024d9891 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1679 microversion: 2.1 time: 0.172609 Sep 06 12:18:08.143847 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3787/7531] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:07 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:09.171623 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-36416064-89e8-49d7-9ef2-b51a2ee50eea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:09.172283 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-36416064-89e8-49d7-9ef2-b51a2ee50eea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:09.179874 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36416064-89e8-49d7-9ef2-b51a2ee50eea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:09.180377 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36416064-89e8-49d7-9ef2-b51a2ee50eea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:09.180828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36416064-89e8-49d7-9ef2-b51a2ee50eea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:09.181555 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36416064-89e8-49d7-9ef2-b51a2ee50eea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:09.182023 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36416064-89e8-49d7-9ef2-b51a2ee50eea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:09.182454 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-36416064-89e8-49d7-9ef2-b51a2ee50eea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:09.325229 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-36416064-89e8-49d7-9ef2-b51a2ee50eea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:09.334017 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-36416064-89e8-49d7-9ef2-b51a2ee50eea tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1679 microversion: 2.1 time: 0.167417 Sep 06 12:18:09.334705 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3745/7532] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:09 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:09.947480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-83c592be-8d77-4fbf-a520-6353b68c3de8 req-a646c63c-cfdf-4a71-8d7f-3752b9f4ebf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbad374-35ca-433a-a086-7434dbff660b", "name": "network-vif-deleted", "tag": "b2da4f25-e74b-481c-9564-66c75ac92b47"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:18:09.958276 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-83c592be-8d77-4fbf-a520-6353b68c3de8 req-a646c63c-cfdf-4a71-8d7f-3752b9f4ebf4 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:09.958803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-83c592be-8d77-4fbf-a520-6353b68c3de8 req-a646c63c-cfdf-4a71-8d7f-3752b9f4ebf4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:09.959280 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-83c592be-8d77-4fbf-a520-6353b68c3de8 req-a646c63c-cfdf-4a71-8d7f-3752b9f4ebf4 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:09.973613 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-83c592be-8d77-4fbf-a520-6353b68c3de8 req-a646c63c-cfdf-4a71-8d7f-3752b9f4ebf4 service nova] Creating event network-vif-deleted:b2da4f25-e74b-481c-9564-66c75ac92b47 for instance adbad374-35ca-433a-a086-7434dbff660b on nch1-master-1 Sep 06 12:18:09.979207 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-83c592be-8d77-4fbf-a520-6353b68c3de8 req-a646c63c-cfdf-4a71-8d7f-3752b9f4ebf4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092022 Sep 06 12:18:09.979858 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3788/7533] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:18:10.362005 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:10.363284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:10.374670 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:10.375504 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:10.376094 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:10.376647 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:10.377162 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:10.377649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:10.418053 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:10.419249 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:10.419702 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:10.420174 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.objects.instance [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lazy-loading 'fault' on Instance uuid adbad374-35ca-433a-a086-7434dbff660b {{(pid=140875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:18:10.464464 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:10.472862 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-9938f3c4-1205-4467-b447-28ab930c8c88 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 200 len: 1336 microversion: 2.1 time: 0.118304 Sep 06 12:18:10.473473 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3746/7534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:10 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 1336 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:11.500686 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-521407be-3492-482f-a639-c9cc3c2ca2de tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:11.501433 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-521407be-3492-482f-a639-c9cc3c2ca2de tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: adbad374-35ca-433a-a086-7434dbff660b] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:11.508250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-521407be-3492-482f-a639-c9cc3c2ca2de tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:11.508527 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-521407be-3492-482f-a639-c9cc3c2ca2de tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:11.508984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-521407be-3492-482f-a639-c9cc3c2ca2de tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:11.509730 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-521407be-3492-482f-a639-c9cc3c2ca2de tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:11.510258 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-521407be-3492-482f-a639-c9cc3c2ca2de tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:11.510648 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-521407be-3492-482f-a639-c9cc3c2ca2de tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:11.525407 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.wsgi [None req-521407be-3492-482f-a639-c9cc3c2ca2de tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] HTTP exception thrown: Instance adbad374-35ca-433a-a086-7434dbff660b could not be found. Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-521407be-3492-482f-a639-c9cc3c2ca2de tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Request method failure captured: Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: request: GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b HTTP/1.1 Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: Accept: application/json Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: Accept-Encoding: identity Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: Connection: close Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: Content-Length: 0 Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: Content-Type: application/json Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: Host: 10.222.0.20 Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: Openstack-System-Scope: None Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: User-Agent: python-urllib3/1.26.12 Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Auth-Token: gAAAAABjFzl8I6MWl8uvzGAnfVsJpD6XeyE3quPBquWVw_f8qvdkQzTWjK75tweWmL6vroWNf3DQg4mxahsWmKq8ibhjraCz4v4SErlTmWUUK7UreMvqzGY3yKeUwfUfds-seRctguVH7Iwe1ZYKPifGZdVWLIqXnlreOnw_7mDfMyuM4Vqk-5k Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Id: None Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Domain-Name: None Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Identity-Status: Confirmed Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Is-Admin-Project: True Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Id: default Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Domain-Name: Default Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Id: 7e98949fac3f403faa6fa0e0c2e86c44 Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Project-Name: tempest-TestShelveInstance-276062557 Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Role: member,reader Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Roles: member,reader Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e98949fac3f403faa6fa0e0c2e86c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e98949fac3f403faa6fa0e0c2e86c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e98949fac3f403faa6fa0e0c2e86c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e98949fac3f403faa6fa0e0c2e86c44"}]}] Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant: tempest-TestShelveInstance-276062557 Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Id: 7e98949fac3f403faa6fa0e0c2e86c44 Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-Tenant-Name: tempest-TestShelveInstance-276062557 Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-User: tempest-TestShelveInstance-276062557-project Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Id: default Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-User-Domain-Name: Default Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-User-Id: 6394701f1951428995065bf1007c34fa Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: X-User-Name: tempest-TestShelveInstance-276062557-project Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: method: > Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: exception: Instance adbad374-35ca-433a-a086-7434dbff660b could not be found. Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: action_args: {'id': 'adbad374-35ca-433a-a086-7434dbff660b'} Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adbad374-35ca-433a-a086-7434dbff660b could not be found. Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adbad374-35ca-433a-a086-7434dbff660b could not be found. Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:18:11.527204 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:18:11.531593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:18:11.531593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:18:11.531593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:18:11.531593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:18:11.531593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:18:11.531593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adbad374-35ca-433a-a086-7434dbff660b could not be found. Sep 06 12:18:11.531593 ncdv-master-1 devstack@n-api.service[140876]: ERROR nova.api.openstack.wsgi Sep 06 12:18:11.531593 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-521407be-3492-482f-a639-c9cc3c2ca2de tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Returning 404 to user: Instance adbad374-35ca-433a-a086-7434dbff660b could not be found. {{(pid=140876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:18:11.531593 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-521407be-3492-482f-a639-c9cc3c2ca2de tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b" status: 404 len: 111 microversion: 2.1 time: 0.034483 Sep 06 12:18:11.531593 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3789/7535] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:11 2022] GET /compute/v2.1/servers/adbad374-35ca-433a-a086-7434dbff660b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:18:11.772457 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-5c30a5cc-96d6-4791-9449-aca23949abd7 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '.version_select at 0x7f90f37330d0>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:11.869537 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-5c30a5cc-96d6-4791-9449-aca23949abd7 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1781289236" status: 202 len: 0 microversion: 2.1 time: 0.100856 Sep 06 12:18:11.870220 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3747/7536] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Sep 6 12:18:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1781289236 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:18:11.895501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-04ee63f0-47dd-4252-afee-dcd2f80fd92a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Action: 'create', calling method: .version_select at 0x7f90f334e670>, body: {"keypair": {"name": "tempest-TestShelveInstance-802963313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuq7KRpgXscRz0tSDswZvP4ZJ6ay0ruhCGu3mebsaRD8tEc3K0GO8nJx6HC7gipjMHIaMQfKtzZKcBygdDLoK0Ikswv/Pqp0uJt268Z5Se2t20jHUUl69Ty5AT9a1xJkA=="}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:18:11.911343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-04ee63f0-47dd-4252-afee-dcd2f80fd92a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Getting quotas for project 7e98949fac3f403faa6fa0e0c2e86c44. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:18:11.916706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-04ee63f0-47dd-4252-afee-dcd2f80fd92a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Getting quotas for user 6394701f1951428995065bf1007c34fa and project 7e98949fac3f403faa6fa0e0c2e86c44. Resources: {'key_pairs'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:18:12.012594 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-04ee63f0-47dd-4252-afee-dcd2f80fd92a tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.120879 Sep 06 12:18:12.013230 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3790/7537] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 12:18:11 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:18:19.996322 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1524210612", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-802963313", "security_groups": [{"name": "tempest-secgroup-smoke-1318874568"}], "networks": [{"uuid": "ef4a5ba5-aacf-4b00-aa21-51c2a4653fd1"}], "block_device_mapping_v2": [{"uuid": "f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:18:20.117172 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.network.neutron [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] validate_networks() for [('ef4a5ba5-aacf-4b00-aa21-51c2a4653fd1', None, None, None, None, None)] {{(pid=140875) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:18:20.469402 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:20.552320 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Flavor limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:18:20.552750 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Image limits 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:18:20.553336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Flavor pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:18:20.553675 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Image pref 0:0:0 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:18:20.554152 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.virt.hardware [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:18:20.564259 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:20.574111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:20.574111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:20.574111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:20.574111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:20.574111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:20.585894 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Getting quotas for project 7e98949fac3f403faa6fa0e0c2e86c44. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:18:20.591472 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Getting quotas for user 6394701f1951428995065bf1007c34fa and project 7e98949fac3f403faa6fa0e0c2e86c44. Resources: {'ram', 'instances', 'cores'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:18:20.650933 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Going to run 1 instances... {{(pid=140875) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:18:20.653142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a',volume_size=None,volume_type=None)] {{(pid=140875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:18:21.127215 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-05c18ef4-4149-4bd6-b082-a56dd0c3639c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.134735 Sep 06 12:18:21.133952 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3748/7538] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 12:18:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:18:21.141330 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e3587797-480e-4d43-aa73-864b71f1a985 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:21.144144 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e3587797-480e-4d43-aa73-864b71f1a985 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:21.205960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e3587797-480e-4d43-aa73-864b71f1a985 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:21.213066 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e3587797-480e-4d43-aa73-864b71f1a985 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1088 microversion: 2.1 time: 0.077462 Sep 06 12:18:21.213657 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3791/7539] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:21 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:22.237524 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-54f15e1f-6702-40c4-a085-661fae59e233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:22.238209 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-54f15e1f-6702-40c4-a085-661fae59e233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:22.244606 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54f15e1f-6702-40c4-a085-661fae59e233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:22.245108 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54f15e1f-6702-40c4-a085-661fae59e233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:22.245562 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54f15e1f-6702-40c4-a085-661fae59e233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:22.246280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54f15e1f-6702-40c4-a085-661fae59e233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:22.246749 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54f15e1f-6702-40c4-a085-661fae59e233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:22.247224 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-54f15e1f-6702-40c4-a085-661fae59e233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:22.310255 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-54f15e1f-6702-40c4-a085-661fae59e233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:22.318472 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-54f15e1f-6702-40c4-a085-661fae59e233 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1138 microversion: 2.1 time: 0.085811 Sep 06 12:18:22.319137 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3749/7540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:22 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:23.346037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-62c04b4d-262c-430e-a645-be1aced5a8bf tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:23.346885 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-62c04b4d-262c-430e-a645-be1aced5a8bf tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:23.349226 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=12 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:23.355359 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62c04b4d-262c-430e-a645-be1aced5a8bf tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:23.355866 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62c04b4d-262c-430e-a645-be1aced5a8bf tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:23.356318 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62c04b4d-262c-430e-a645-be1aced5a8bf tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:23.357040 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62c04b4d-262c-430e-a645-be1aced5a8bf tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:23.357519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62c04b4d-262c-430e-a645-be1aced5a8bf tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:23.357957 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-62c04b4d-262c-430e-a645-be1aced5a8bf tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:23.434268 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-62c04b4d-262c-430e-a645-be1aced5a8bf tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:23.443825 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-62c04b4d-262c-430e-a645-be1aced5a8bf tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1194 microversion: 2.1 time: 0.101704 Sep 06 12:18:23.444579 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3792/7541] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:23 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:24.470611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-c59f5380-5c89-44c7-b0eb-049136acf5ae tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:24.472421 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-c59f5380-5c89-44c7-b0eb-049136acf5ae tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:24.479827 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c59f5380-5c89-44c7-b0eb-049136acf5ae tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:24.480563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c59f5380-5c89-44c7-b0eb-049136acf5ae tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:24.481167 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c59f5380-5c89-44c7-b0eb-049136acf5ae tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:24.482136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c59f5380-5c89-44c7-b0eb-049136acf5ae tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:24.482607 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c59f5380-5c89-44c7-b0eb-049136acf5ae tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:24.483081 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-c59f5380-5c89-44c7-b0eb-049136acf5ae tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:24.649216 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-c59f5380-5c89-44c7-b0eb-049136acf5ae tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:24.659903 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-c59f5380-5c89-44c7-b0eb-049136acf5ae tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1272 microversion: 2.1 time: 0.191364 Sep 06 12:18:24.659903 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3750/7542] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:24 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:25.512754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-29b6103d-5c55-48fd-ad46-20479150e7c7 req-464b9b30-7b8f-43fd-839d-c42b8d443950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b43b3e0-9f14-4180-9a51-97aed92b0f16", "tag": "b6584c1c-920a-4883-8f56-a44e1b563393"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:18:25.523064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-29b6103d-5c55-48fd-ad46-20479150e7c7 req-464b9b30-7b8f-43fd-839d-c42b8d443950 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:25.523690 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-29b6103d-5c55-48fd-ad46-20479150e7c7 req-464b9b30-7b8f-43fd-839d-c42b8d443950 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:25.524143 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-29b6103d-5c55-48fd-ad46-20479150e7c7 req-464b9b30-7b8f-43fd-839d-c42b8d443950 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:25.538450 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-29b6103d-5c55-48fd-ad46-20479150e7c7 req-464b9b30-7b8f-43fd-839d-c42b8d443950 service nova] Creating event network-changed:b6584c1c-920a-4883-8f56-a44e1b563393 for instance 9b43b3e0-9f14-4180-9a51-97aed92b0f16 on nch1-master-1 Sep 06 12:18:25.543863 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-29b6103d-5c55-48fd-ad46-20479150e7c7 req-464b9b30-7b8f-43fd-839d-c42b8d443950 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035419 Sep 06 12:18:25.544644 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3793/7543] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:18:25.682348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-7935239e-ce4d-4857-b4b4-5f7abab18fa2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:25.682871 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-7935239e-ce4d-4857-b4b4-5f7abab18fa2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:25.690007 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7935239e-ce4d-4857-b4b4-5f7abab18fa2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:25.690513 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7935239e-ce4d-4857-b4b4-5f7abab18fa2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:25.690991 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7935239e-ce4d-4857-b4b4-5f7abab18fa2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:25.691744 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7935239e-ce4d-4857-b4b4-5f7abab18fa2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:25.692223 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7935239e-ce4d-4857-b4b4-5f7abab18fa2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:25.692673 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-7935239e-ce4d-4857-b4b4-5f7abab18fa2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:25.859423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-7935239e-ce4d-4857-b4b4-5f7abab18fa2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:25.868790 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-7935239e-ce4d-4857-b4b4-5f7abab18fa2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1272 microversion: 2.1 time: 0.190558 Sep 06 12:18:25.869400 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3751/7544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:25 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:26.894309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a90f4d54-cef0-420e-a17a-f2dd26766682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:26.895050 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a90f4d54-cef0-420e-a17a-f2dd26766682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:26.902195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a90f4d54-cef0-420e-a17a-f2dd26766682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:26.902692 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a90f4d54-cef0-420e-a17a-f2dd26766682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:26.903470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a90f4d54-cef0-420e-a17a-f2dd26766682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:26.904187 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a90f4d54-cef0-420e-a17a-f2dd26766682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:26.904663 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a90f4d54-cef0-420e-a17a-f2dd26766682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:26.905579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a90f4d54-cef0-420e-a17a-f2dd26766682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:27.044484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a90f4d54-cef0-420e-a17a-f2dd26766682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:27.053100 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a90f4d54-cef0-420e-a17a-f2dd26766682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1260 microversion: 2.1 time: 0.163177 Sep 06 12:18:27.053676 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3794/7545] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:26 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:28.082124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-231d17d1-0062-4e44-997b-b90b2aac6682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:28.082801 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-231d17d1-0062-4e44-997b-b90b2aac6682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:28.090612 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-231d17d1-0062-4e44-997b-b90b2aac6682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:28.091116 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-231d17d1-0062-4e44-997b-b90b2aac6682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:28.091563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-231d17d1-0062-4e44-997b-b90b2aac6682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:28.092275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-231d17d1-0062-4e44-997b-b90b2aac6682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:28.092739 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-231d17d1-0062-4e44-997b-b90b2aac6682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:28.093171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-231d17d1-0062-4e44-997b-b90b2aac6682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:28.225836 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-231d17d1-0062-4e44-997b-b90b2aac6682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:28.233920 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-231d17d1-0062-4e44-997b-b90b2aac6682 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1260 microversion: 2.1 time: 0.156665 Sep 06 12:18:28.234508 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3752/7546] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:28 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:29.258833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-92e2e8fa-8398-4b37-991a-6a439af20005 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:29.259415 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-92e2e8fa-8398-4b37-991a-6a439af20005 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:29.266896 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92e2e8fa-8398-4b37-991a-6a439af20005 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:29.267429 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92e2e8fa-8398-4b37-991a-6a439af20005 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:29.267884 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92e2e8fa-8398-4b37-991a-6a439af20005 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:29.269213 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92e2e8fa-8398-4b37-991a-6a439af20005 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:29.269688 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92e2e8fa-8398-4b37-991a-6a439af20005 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:29.270132 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-92e2e8fa-8398-4b37-991a-6a439af20005 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:29.403689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-92e2e8fa-8398-4b37-991a-6a439af20005 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:29.411734 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-92e2e8fa-8398-4b37-991a-6a439af20005 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1260 microversion: 2.1 time: 0.157252 Sep 06 12:18:29.412316 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3795/7547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:29 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:18:30.434645 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-6814be2d-e60c-4360-b84a-cdc6d3ab6c8e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:30.435323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-6814be2d-e60c-4360-b84a-cdc6d3ab6c8e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:30.442957 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6814be2d-e60c-4360-b84a-cdc6d3ab6c8e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:30.443698 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6814be2d-e60c-4360-b84a-cdc6d3ab6c8e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:30.444145 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6814be2d-e60c-4360-b84a-cdc6d3ab6c8e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:30.444860 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6814be2d-e60c-4360-b84a-cdc6d3ab6c8e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:30.445324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6814be2d-e60c-4360-b84a-cdc6d3ab6c8e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:30.445761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-6814be2d-e60c-4360-b84a-cdc6d3ab6c8e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:30.575336 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:30.593321 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-6814be2d-e60c-4360-b84a-cdc6d3ab6c8e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:30.599530 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:30.605528 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-6814be2d-e60c-4360-b84a-cdc6d3ab6c8e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1260 microversion: 2.1 time: 0.175445 Sep 06 12:18:30.609271 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3753/7548] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:30 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:31.628784 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-525b7f83-9800-4a3e-9868-4fbb25919a80 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:31.629388 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-525b7f83-9800-4a3e-9868-4fbb25919a80 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:31.632523 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:31.637791 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-525b7f83-9800-4a3e-9868-4fbb25919a80 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:31.638301 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-525b7f83-9800-4a3e-9868-4fbb25919a80 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:31.638753 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-525b7f83-9800-4a3e-9868-4fbb25919a80 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:31.639493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-525b7f83-9800-4a3e-9868-4fbb25919a80 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:31.639962 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-525b7f83-9800-4a3e-9868-4fbb25919a80 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:31.640406 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-525b7f83-9800-4a3e-9868-4fbb25919a80 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:31.776807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-525b7f83-9800-4a3e-9868-4fbb25919a80 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:31.785687 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-525b7f83-9800-4a3e-9868-4fbb25919a80 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1260 microversion: 2.1 time: 0.160713 Sep 06 12:18:31.786281 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3796/7549] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:31 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:32.809215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-15c9bc77-f47e-4259-b171-3f4b03da7f3c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:32.809867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-15c9bc77-f47e-4259-b171-3f4b03da7f3c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:32.818934 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c9bc77-f47e-4259-b171-3f4b03da7f3c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:32.819487 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c9bc77-f47e-4259-b171-3f4b03da7f3c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:32.819968 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c9bc77-f47e-4259-b171-3f4b03da7f3c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:32.820690 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c9bc77-f47e-4259-b171-3f4b03da7f3c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:32.821250 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c9bc77-f47e-4259-b171-3f4b03da7f3c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:32.821693 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-15c9bc77-f47e-4259-b171-3f4b03da7f3c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:32.959958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-15c9bc77-f47e-4259-b171-3f4b03da7f3c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:32.968016 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-15c9bc77-f47e-4259-b171-3f4b03da7f3c tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1260 microversion: 2.1 time: 0.162915 Sep 06 12:18:32.968600 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3754/7550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:32 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:33.489045 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-b70284bf-584c-49d1-ac8d-bc91aed739eb req-9021b762-3fb8-41e1-8f62-0dda03d8fc19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b43b3e0-9f14-4180-9a51-97aed92b0f16", "name": "network-vif-plugged", "status": "completed", "tag": "b6584c1c-920a-4883-8f56-a44e1b563393"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:18:33.498732 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b70284bf-584c-49d1-ac8d-bc91aed739eb req-9021b762-3fb8-41e1-8f62-0dda03d8fc19 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:33.499257 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b70284bf-584c-49d1-ac8d-bc91aed739eb req-9021b762-3fb8-41e1-8f62-0dda03d8fc19 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:33.499712 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-b70284bf-584c-49d1-ac8d-bc91aed739eb req-9021b762-3fb8-41e1-8f62-0dda03d8fc19 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:33.511434 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-b70284bf-584c-49d1-ac8d-bc91aed739eb req-9021b762-3fb8-41e1-8f62-0dda03d8fc19 service nova] Creating event network-vif-plugged:b6584c1c-920a-4883-8f56-a44e1b563393 for instance 9b43b3e0-9f14-4180-9a51-97aed92b0f16 on nch1-master-1 Sep 06 12:18:33.516820 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-b70284bf-584c-49d1-ac8d-bc91aed739eb req-9021b762-3fb8-41e1-8f62-0dda03d8fc19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088716 Sep 06 12:18:33.517468 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3797/7551] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:18:33.992384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8abd13bd-ac31-47c2-86c3-b5422c90cd0f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:33.993015 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8abd13bd-ac31-47c2-86c3-b5422c90cd0f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:34.000215 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8abd13bd-ac31-47c2-86c3-b5422c90cd0f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:34.000728 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8abd13bd-ac31-47c2-86c3-b5422c90cd0f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:34.001200 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8abd13bd-ac31-47c2-86c3-b5422c90cd0f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:34.001910 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8abd13bd-ac31-47c2-86c3-b5422c90cd0f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:34.002384 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8abd13bd-ac31-47c2-86c3-b5422c90cd0f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:34.002828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8abd13bd-ac31-47c2-86c3-b5422c90cd0f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:34.139243 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8abd13bd-ac31-47c2-86c3-b5422c90cd0f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:34.147304 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8abd13bd-ac31-47c2-86c3-b5422c90cd0f tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1260 microversion: 2.1 time: 0.159467 Sep 06 12:18:34.147897 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3755/7552] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:33 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:35.173000 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-4f217860-b257-4ed9-baad-24c83a65e9b3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:35.173705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-4f217860-b257-4ed9-baad-24c83a65e9b3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:35.181764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f217860-b257-4ed9-baad-24c83a65e9b3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:35.182266 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f217860-b257-4ed9-baad-24c83a65e9b3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:35.182725 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f217860-b257-4ed9-baad-24c83a65e9b3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:35.183779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f217860-b257-4ed9-baad-24c83a65e9b3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:35.184260 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f217860-b257-4ed9-baad-24c83a65e9b3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:35.184793 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-4f217860-b257-4ed9-baad-24c83a65e9b3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:35.321942 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-4f217860-b257-4ed9-baad-24c83a65e9b3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:35.330582 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-4f217860-b257-4ed9-baad-24c83a65e9b3 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1444 microversion: 2.1 time: 0.162834 Sep 06 12:18:35.331194 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3798/7553] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:35 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:35.359371 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d5324882-da55-448c-80bd-72fed25f2eb2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:35.359992 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d5324882-da55-448c-80bd-72fed25f2eb2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:35.368348 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5324882-da55-448c-80bd-72fed25f2eb2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:35.368837 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5324882-da55-448c-80bd-72fed25f2eb2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:35.369277 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5324882-da55-448c-80bd-72fed25f2eb2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:35.369981 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5324882-da55-448c-80bd-72fed25f2eb2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:35.370452 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5324882-da55-448c-80bd-72fed25f2eb2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:35.370884 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d5324882-da55-448c-80bd-72fed25f2eb2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:35.506433 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-d5324882-da55-448c-80bd-72fed25f2eb2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:35.514745 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d5324882-da55-448c-80bd-72fed25f2eb2 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1444 microversion: 2.1 time: 0.159386 Sep 06 12:18:35.515373 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3756/7554] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:35 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:37.828934 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-a556c81c-a77e-410e-9b7d-86e9402537c4 req-677bc6e0-c7f7-4727-b5cf-7aa532e05005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b43b3e0-9f14-4180-9a51-97aed92b0f16", "tag": "b6584c1c-920a-4883-8f56-a44e1b563393"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:18:37.844691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a556c81c-a77e-410e-9b7d-86e9402537c4 req-677bc6e0-c7f7-4727-b5cf-7aa532e05005 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:37.845195 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a556c81c-a77e-410e-9b7d-86e9402537c4 req-677bc6e0-c7f7-4727-b5cf-7aa532e05005 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:37.845652 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-a556c81c-a77e-410e-9b7d-86e9402537c4 req-677bc6e0-c7f7-4727-b5cf-7aa532e05005 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:37.858768 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-a556c81c-a77e-410e-9b7d-86e9402537c4 req-677bc6e0-c7f7-4727-b5cf-7aa532e05005 service nova] Creating event network-changed:b6584c1c-920a-4883-8f56-a44e1b563393 for instance 9b43b3e0-9f14-4180-9a51-97aed92b0f16 on nch1-master-1 Sep 06 12:18:37.865883 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-a556c81c-a77e-410e-9b7d-86e9402537c4 req-677bc6e0-c7f7-4727-b5cf-7aa532e05005 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040703 Sep 06 12:18:37.866522 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3799/7555] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:22:11.214465 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f437706c-3085-4043-9dae-91c01118faaa] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 12:22:11.215475 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f57fb853-595b-4ef1-91ec-6bf7ec660ec1] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 12:22:11.216355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:11.217115 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=50 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:11.218054 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:22:11.218203 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 12:22:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16/action (ip 10.222.0.20) !!! Sep 06 12:22:11.220328 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:22:11.220452 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 12:22:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16/action (ip 10.222.0.20) !!! Sep 06 12:22:11.222308 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:22:11.222441 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 12:22:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16/action (ip 10.222.0.20) !!! Sep 06 12:22:11.305271 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-56d47441-de92-4542-bf33-b3938cb49135 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:22:11.307642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-56d47441-de92-4542-bf33-b3938cb49135 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:11.318579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56d47441-de92-4542-bf33-b3938cb49135 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:11.319127 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56d47441-de92-4542-bf33-b3938cb49135 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:11.319582 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56d47441-de92-4542-bf33-b3938cb49135 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:11.320307 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56d47441-de92-4542-bf33-b3938cb49135 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:11.321297 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56d47441-de92-4542-bf33-b3938cb49135 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:11.321742 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-56d47441-de92-4542-bf33-b3938cb49135 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:12.225849 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] [f437706c-3085-4043-9dae-91c01118faaa] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36636. Sep 06 12:22:12.229726 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] [f57fb853-595b-4ef1-91ec-6bf7ec660ec1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36638. Sep 06 12:22:12.233882 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-56d47441-de92-4542-bf33-b3938cb49135 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "POST /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16/action" status: 200 len: 24568 microversion: 2.1 time: 1.021780 Sep 06 12:22:12.234544 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3757/7556] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:22:11 2022] POST /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16/action => generated 24568 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:22:13.178478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-b811f101-c9c1-45fe-a13c-f847af94aeac tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:13.179124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b811f101-c9c1-45fe-a13c-f847af94aeac tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:13.183858 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 12:22:13.184850 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e366ae3e-f715-4bfe-a538-76a63bf43111] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 12:22:13.185764 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:13.186524 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=36 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:13.186642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b811f101-c9c1-45fe-a13c-f847af94aeac tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:13.187350 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b811f101-c9c1-45fe-a13c-f847af94aeac tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:13.187540 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:22:13.187636 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 12:22:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 06 12:22:13.187805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b811f101-c9c1-45fe-a13c-f847af94aeac tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:13.188533 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b811f101-c9c1-45fe-a13c-f847af94aeac tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:13.189026 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b811f101-c9c1-45fe-a13c-f847af94aeac tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:13.190129 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:22:13.190239 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 12:22:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 06 12:22:13.190890 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-b811f101-c9c1-45fe-a13c-f847af94aeac tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:13.192437 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:22:13.192437 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 12:22:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 06 12:22:13.202584 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-81d4c50b-a716-4114-8793-9032fe9528a6 req-be932110-aa38-47ec-9316-8db8251e63b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b43b3e0-9f14-4180-9a51-97aed92b0f16", "tag": "b6584c1c-920a-4883-8f56-a44e1b563393"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:22:13.225856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-81d4c50b-a716-4114-8793-9032fe9528a6 req-be932110-aa38-47ec-9316-8db8251e63b8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:13.226436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-81d4c50b-a716-4114-8793-9032fe9528a6 req-be932110-aa38-47ec-9316-8db8251e63b8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:13.227585 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-81d4c50b-a716-4114-8793-9032fe9528a6 req-be932110-aa38-47ec-9316-8db8251e63b8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:13.228797 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-b811f101-c9c1-45fe-a13c-f847af94aeac tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Going to try to terminate instance {{(pid=140875) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:22:13.240359 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-81d4c50b-a716-4114-8793-9032fe9528a6 req-be932110-aa38-47ec-9316-8db8251e63b8 service nova] Creating event network-changed:b6584c1c-920a-4883-8f56-a44e1b563393 for instance 9b43b3e0-9f14-4180-9a51-97aed92b0f16 on nch1-master-1 Sep 06 12:22:13.247294 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-81d4c50b-a716-4114-8793-9032fe9528a6 req-be932110-aa38-47ec-9316-8db8251e63b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074998 Sep 06 12:22:13.247937 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3800/7557] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:22:13.547122 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-b811f101-c9c1-45fe-a13c-f847af94aeac tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 204 len: 0 microversion: 2.1 time: 0.372711 Sep 06 12:22:13.547866 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3758/7558] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 12:22:13 2022] DELETE /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:22:13.559590 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c8fb2a44-4072-49ad-b344-03a808d4e77d tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:13.560466 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c8fb2a44-4072-49ad-b344-03a808d4e77d tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:13.568066 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8fb2a44-4072-49ad-b344-03a808d4e77d tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:13.568912 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8fb2a44-4072-49ad-b344-03a808d4e77d tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:13.569241 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8fb2a44-4072-49ad-b344-03a808d4e77d tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:13.569987 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8fb2a44-4072-49ad-b344-03a808d4e77d tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:13.570479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8fb2a44-4072-49ad-b344-03a808d4e77d tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:13.570946 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c8fb2a44-4072-49ad-b344-03a808d4e77d tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:13.777309 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c8fb2a44-4072-49ad-b344-03a808d4e77d tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:13.785810 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c8fb2a44-4072-49ad-b344-03a808d4e77d tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1568 microversion: 2.1 time: 0.232739 Sep 06 12:22:13.786420 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3801/7559] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:13 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:14.811870 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-8cc8ef14-ab78-4542-a3a3-26b231eb2424 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:14.812579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-8cc8ef14-ab78-4542-a3a3-26b231eb2424 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:14.820534 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cc8ef14-ab78-4542-a3a3-26b231eb2424 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:14.821054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cc8ef14-ab78-4542-a3a3-26b231eb2424 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:14.821465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cc8ef14-ab78-4542-a3a3-26b231eb2424 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:14.822828 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cc8ef14-ab78-4542-a3a3-26b231eb2424 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:14.823701 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cc8ef14-ab78-4542-a3a3-26b231eb2424 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:14.824171 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-8cc8ef14-ab78-4542-a3a3-26b231eb2424 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:15.006509 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-8cc8ef14-ab78-4542-a3a3-26b231eb2424 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:15.014410 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-8cc8ef14-ab78-4542-a3a3-26b231eb2424 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1450 microversion: 2.1 time: 0.206951 Sep 06 12:22:15.014990 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3759/7560] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:14 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1450 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:16.037299 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d024ccc2-62e2-416f-88b2-3ff48d6516ff tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:16.037924 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d024ccc2-62e2-416f-88b2-3ff48d6516ff tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:16.057032 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36666. Sep 06 12:22:16.062753 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] [e366ae3e-f715-4bfe-a538-76a63bf43111] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36668. Sep 06 12:22:16.065367 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d024ccc2-62e2-416f-88b2-3ff48d6516ff tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:16.065475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d024ccc2-62e2-416f-88b2-3ff48d6516ff tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:16.065928 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d024ccc2-62e2-416f-88b2-3ff48d6516ff tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:16.066667 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d024ccc2-62e2-416f-88b2-3ff48d6516ff tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:16.067426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d024ccc2-62e2-416f-88b2-3ff48d6516ff tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:16.067639 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d024ccc2-62e2-416f-88b2-3ff48d6516ff tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:16.138929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-0bd52b70-a113-42a1-8bf0-b15417b24b86 req-62260747-08f0-41e3-8a98-cda1efa00055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b43b3e0-9f14-4180-9a51-97aed92b0f16", "name": "network-vif-deleted", "tag": "b6584c1c-920a-4883-8f56-a44e1b563393"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:22:16.144536 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d024ccc2-62e2-416f-88b2-3ff48d6516ff tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:16.152838 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d024ccc2-62e2-416f-88b2-3ff48d6516ff tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1382 microversion: 2.1 time: 0.119565 Sep 06 12:22:16.153687 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3802/7561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:16 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1382 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:16.154707 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0bd52b70-a113-42a1-8bf0-b15417b24b86 req-62260747-08f0-41e3-8a98-cda1efa00055 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:16.155237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0bd52b70-a113-42a1-8bf0-b15417b24b86 req-62260747-08f0-41e3-8a98-cda1efa00055 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:16.155685 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-0bd52b70-a113-42a1-8bf0-b15417b24b86 req-62260747-08f0-41e3-8a98-cda1efa00055 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:16.168698 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-0bd52b70-a113-42a1-8bf0-b15417b24b86 req-62260747-08f0-41e3-8a98-cda1efa00055 service nova] Creating event network-vif-deleted:b6584c1c-920a-4883-8f56-a44e1b563393 for instance 9b43b3e0-9f14-4180-9a51-97aed92b0f16 on nch1-master-1 Sep 06 12:22:16.177104 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-0bd52b70-a113-42a1-8bf0-b15417b24b86 req-62260747-08f0-41e3-8a98-cda1efa00055 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042535 Sep 06 12:22:16.177751 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3760/7562] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:22:17.178002 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:17.178574 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:17.185705 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:17.186542 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:17.187033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:17.187737 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:17.188251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:17.192502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:17.224166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:17.225059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:17.225540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:17.226012 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lazy-loading 'fault' on Instance uuid 9b43b3e0-9f14-4180-9a51-97aed92b0f16 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:22:17.267445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6394701f1951428995065bf1007c34fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e98949fac3f403faa6fa0e0c2e86c44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:17.276744 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fb89e7d4-de86-42bb-988e-5b26a27a5549 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 200 len: 1224 microversion: 2.1 time: 0.102726 Sep 06 12:22:17.277441 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3803/7563] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:17 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:18.303781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e6c16b90-296b-47a5-bdc8-9ca26075d05e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:18.304498 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e6c16b90-296b-47a5-bdc8-9ca26075d05e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] [instance: 9b43b3e0-9f14-4180-9a51-97aed92b0f16] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:18.311293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6c16b90-296b-47a5-bdc8-9ca26075d05e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:18.311781 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6c16b90-296b-47a5-bdc8-9ca26075d05e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:18.312281 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6c16b90-296b-47a5-bdc8-9ca26075d05e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:18.312998 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6c16b90-296b-47a5-bdc8-9ca26075d05e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:18.313512 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6c16b90-296b-47a5-bdc8-9ca26075d05e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:18.314034 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e6c16b90-296b-47a5-bdc8-9ca26075d05e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:18.328581 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-e6c16b90-296b-47a5-bdc8-9ca26075d05e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] HTTP exception thrown: Instance 9b43b3e0-9f14-4180-9a51-97aed92b0f16 could not be found. Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e6c16b90-296b-47a5-bdc8-9ca26075d05e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Request method failure captured: Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 HTTP/1.1 Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzl8I6MWl8uvzGAnfVsJpD6XeyE3quPBquWVw_f8qvdkQzTWjK75tweWmL6vroWNf3DQg4mxahsWmKq8ibhjraCz4v4SErlTmWUUK7UreMvqzGY3yKeUwfUfds-seRctguVH7Iwe1ZYKPifGZdVWLIqXnlreOnw_7mDfMyuM4Vqk-5k Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: 7e98949fac3f403faa6fa0e0c2e86c44 Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestShelveInstance-276062557 Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e98949fac3f403faa6fa0e0c2e86c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e98949fac3f403faa6fa0e0c2e86c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e98949fac3f403faa6fa0e0c2e86c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e98949fac3f403faa6fa0e0c2e86c44"}]}] Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestShelveInstance-276062557 Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: 7e98949fac3f403faa6fa0e0c2e86c44 Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestShelveInstance-276062557 Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestShelveInstance-276062557-project Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 6394701f1951428995065bf1007c34fa Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestShelveInstance-276062557-project Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 9b43b3e0-9f14-4180-9a51-97aed92b0f16 could not be found. Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '9b43b3e0-9f14-4180-9a51-97aed92b0f16'} Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b43b3e0-9f14-4180-9a51-97aed92b0f16 could not be found. Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b43b3e0-9f14-4180-9a51-97aed92b0f16 could not be found. Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:22:18.330520 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:22:18.334958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:22:18.334958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:22:18.334958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:22:18.334958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:22:18.334958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:22:18.334958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b43b3e0-9f14-4180-9a51-97aed92b0f16 could not be found. Sep 06 12:22:18.334958 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:22:18.334958 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e6c16b90-296b-47a5-bdc8-9ca26075d05e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Returning 404 to user: Instance 9b43b3e0-9f14-4180-9a51-97aed92b0f16 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:22:18.334958 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e6c16b90-296b-47a5-bdc8-9ca26075d05e tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16" status: 404 len: 111 microversion: 2.1 time: 0.033549 Sep 06 12:22:18.334958 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3761/7564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:18 2022] GET /compute/v2.1/servers/9b43b3e0-9f14-4180-9a51-97aed92b0f16 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:22:18.565198 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a3458808-d46e-43cb-9e6a-695427f0d167 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] Calling method '.version_select at 0x7f90f3312ca0>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:18.684762 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a3458808-d46e-43cb-9e6a-695427f0d167 tempest-TestShelveInstance-276062557 tempest-TestShelveInstance-276062557-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-802963313" status: 202 len: 0 microversion: 2.1 time: 0.123525 Sep 06 12:22:18.685364 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3804/7565] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 12:22:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-802963313 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:22:40.949611 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:40.950395 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:41.155599 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-69d53d5a-b808-488d-aaed-797a048f126f tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Action: 'create', calling method: .version_select at 0x7f90f376b790>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1597321056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAu2P+zGilV/Gp3lti9+AUMVen9eWnfqETPaS4wKeUvY2qtRK5mWh1WkKAWJh3dy42aFQyzPjesTSgfc5oHhuECfzNNekKfoT+ZzAN6DSOWhkRAoQ/X0joR3vui61ntRLQ=="}} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:22:41.173360 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-69d53d5a-b808-488d-aaed-797a048f126f tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Getting quotas for project b9854a67f3494f36b5ff21ef252b0f54. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:22:41.179275 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.quota [None req-69d53d5a-b808-488d-aaed-797a048f126f tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Getting quotas for user 0839807df0844e76bff94839b3bc0949 and project b9854a67f3494f36b5ff21ef252b0f54. Resources: {'key_pairs'} {{(pid=140875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:22:41.313062 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-69d53d5a-b808-488d-aaed-797a048f126f tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.369520 Sep 06 12:22:41.313681 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3762/7566] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 12:22:40 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:22:43.807326 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=22 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:43.808255 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:43.812660 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1460325203", "imageRef": "b67f1cec-6cc8-4a81-963d-d6988be4b72f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1597321056", "security_groups": [{"name": "tempest-secgroup-smoke-1342030562"}], "networks": [{"uuid": "23ab5e15-ad9e-45be-bf48-2d200b4e75ba"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:22:43.930037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] validate_networks() for [('23ab5e15-ad9e-45be-bf48-2d200b4e75ba', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:22:44.412944 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:22:44.413458 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:22:44.414027 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:22:44.414696 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:22:44.415124 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:22:44.431706 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:44.432572 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:44.433059 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:44.433790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:44.434271 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:44.434819 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:44.462799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Getting quotas for project b9854a67f3494f36b5ff21ef252b0f54. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:22:44.462799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Getting quotas for user 0839807df0844e76bff94839b3bc0949 and project b9854a67f3494f36b5ff21ef252b0f54. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:22:44.475307 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:22:44.478352 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b67f1cec-6cc8-4a81-963d-d6988be4b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:22:44.607338 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-baf62d2a-3450-4320-aaa5-ffc84b095060 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.801614 Sep 06 12:22:44.608355 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3805/7567] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 12:22:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:22:44.625642 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-ea28ea75-9089-44ba-a04f-be193f63ac7f tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:44.627541 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-ea28ea75-9089-44ba-a04f-be193f63ac7f tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:44.706905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-ea28ea75-9089-44ba-a04f-be193f63ac7f tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:44.714802 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-ea28ea75-9089-44ba-a04f-be193f63ac7f tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1249 microversion: 2.1 time: 0.098345 Sep 06 12:22:44.715427 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3763/7568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:44 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1249 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:45.738980 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-90e5cae8-9133-4fd4-8be1-8261189518a8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:45.739661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-90e5cae8-9133-4fd4-8be1-8261189518a8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:45.793519 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-90e5cae8-9133-4fd4-8be1-8261189518a8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:45.800747 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-90e5cae8-9133-4fd4-8be1-8261189518a8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1249 microversion: 2.1 time: 0.066648 Sep 06 12:22:45.801329 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3806/7569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:45 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:46.824285 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-63e013d0-38c8-4c3e-9b34-f89e3d61f09e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:46.824826 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-63e013d0-38c8-4c3e-9b34-f89e3d61f09e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:46.832736 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63e013d0-38c8-4c3e-9b34-f89e3d61f09e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:46.833226 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63e013d0-38c8-4c3e-9b34-f89e3d61f09e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:46.833668 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63e013d0-38c8-4c3e-9b34-f89e3d61f09e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:46.834372 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63e013d0-38c8-4c3e-9b34-f89e3d61f09e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:46.834930 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63e013d0-38c8-4c3e-9b34-f89e3d61f09e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:46.835403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-63e013d0-38c8-4c3e-9b34-f89e3d61f09e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:46.897529 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-63e013d0-38c8-4c3e-9b34-f89e3d61f09e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:46.906720 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-63e013d0-38c8-4c3e-9b34-f89e3d61f09e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1301 microversion: 2.1 time: 0.086609 Sep 06 12:22:46.907346 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3764/7570] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:46 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:22:47.931470 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-e69e9c49-8fb2-4fb7-8741-e50f3a7754f4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:47.933081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-e69e9c49-8fb2-4fb7-8741-e50f3a7754f4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:47.940422 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e69e9c49-8fb2-4fb7-8741-e50f3a7754f4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:47.940645 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e69e9c49-8fb2-4fb7-8741-e50f3a7754f4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:47.941052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e69e9c49-8fb2-4fb7-8741-e50f3a7754f4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:47.941820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e69e9c49-8fb2-4fb7-8741-e50f3a7754f4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:47.942613 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e69e9c49-8fb2-4fb7-8741-e50f3a7754f4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:47.943100 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-e69e9c49-8fb2-4fb7-8741-e50f3a7754f4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:48.114586 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-e69e9c49-8fb2-4fb7-8741-e50f3a7754f4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:48.124060 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-e69e9c49-8fb2-4fb7-8741-e50f3a7754f4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1375 microversion: 2.1 time: 0.196915 Sep 06 12:22:48.124676 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3807/7571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:47 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1375 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:49.112770 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-fe90480e-3d68-4be9-aee4-06bc8ca8eea8 req-c9d8c344-206f-4694-b4ae-9892b47fd7ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa235c58-39e0-4010-b2d7-f8f42922ae82", "tag": "372b447b-8082-4bf4-808d-6f3f59c30432"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:22:49.125417 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fe90480e-3d68-4be9-aee4-06bc8ca8eea8 req-c9d8c344-206f-4694-b4ae-9892b47fd7ad service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:49.126135 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fe90480e-3d68-4be9-aee4-06bc8ca8eea8 req-c9d8c344-206f-4694-b4ae-9892b47fd7ad service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:49.126579 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-fe90480e-3d68-4be9-aee4-06bc8ca8eea8 req-c9d8c344-206f-4694-b4ae-9892b47fd7ad service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:49.141690 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-fe90480e-3d68-4be9-aee4-06bc8ca8eea8 req-c9d8c344-206f-4694-b4ae-9892b47fd7ad service nova] Creating event network-changed:372b447b-8082-4bf4-808d-6f3f59c30432 for instance fa235c58-39e0-4010-b2d7-f8f42922ae82 on nch1-master-1 Sep 06 12:22:49.147490 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-fe90480e-3d68-4be9-aee4-06bc8ca8eea8 req-c9d8c344-206f-4694-b4ae-9892b47fd7ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040140 Sep 06 12:22:49.148083 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-291a3099-46db-4301-bfda-d0e5c931421b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:49.148534 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3765/7572] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:22:49.148920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-291a3099-46db-4301-bfda-d0e5c931421b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:49.156031 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-291a3099-46db-4301-bfda-d0e5c931421b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:49.156541 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-291a3099-46db-4301-bfda-d0e5c931421b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:49.166425 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-291a3099-46db-4301-bfda-d0e5c931421b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:49.167345 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-291a3099-46db-4301-bfda-d0e5c931421b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:49.167855 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-291a3099-46db-4301-bfda-d0e5c931421b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:49.168323 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-291a3099-46db-4301-bfda-d0e5c931421b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:49.303938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-291a3099-46db-4301-bfda-d0e5c931421b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:49.312360 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-291a3099-46db-4301-bfda-d0e5c931421b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1375 microversion: 2.1 time: 0.168123 Sep 06 12:22:49.312950 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3808/7573] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:49 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:22:50.338142 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-40eae15a-6e07-46ed-a94b-a4ef40d90026 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:50.338838 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-40eae15a-6e07-46ed-a94b-a4ef40d90026 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:50.345908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40eae15a-6e07-46ed-a94b-a4ef40d90026 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:50.346401 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40eae15a-6e07-46ed-a94b-a4ef40d90026 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:50.346843 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40eae15a-6e07-46ed-a94b-a4ef40d90026 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:50.347671 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40eae15a-6e07-46ed-a94b-a4ef40d90026 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:50.348130 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40eae15a-6e07-46ed-a94b-a4ef40d90026 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:50.348563 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-40eae15a-6e07-46ed-a94b-a4ef40d90026 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:50.485924 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-40eae15a-6e07-46ed-a94b-a4ef40d90026 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:50.493833 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-40eae15a-6e07-46ed-a94b-a4ef40d90026 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1375 microversion: 2.1 time: 0.160932 Sep 06 12:22:50.494922 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3766/7574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:50 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:51.517167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0ae382e5-096c-4169-afff-8526ca970caa tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:51.517822 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-0ae382e5-096c-4169-afff-8526ca970caa tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:51.525251 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ae382e5-096c-4169-afff-8526ca970caa tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:51.525746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ae382e5-096c-4169-afff-8526ca970caa tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:51.526208 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ae382e5-096c-4169-afff-8526ca970caa tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:51.531215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ae382e5-096c-4169-afff-8526ca970caa tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:51.531215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ae382e5-096c-4169-afff-8526ca970caa tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:51.531215 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-0ae382e5-096c-4169-afff-8526ca970caa tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:51.675502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-0ae382e5-096c-4169-afff-8526ca970caa tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:51.688329 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0ae382e5-096c-4169-afff-8526ca970caa tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1375 microversion: 2.1 time: 0.172621 Sep 06 12:22:51.688329 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3809/7575] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:51 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:52.709329 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a0ac262b-dfe1-4c93-b96b-a2b2a921ff72 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:52.709952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a0ac262b-dfe1-4c93-b96b-a2b2a921ff72 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:52.717802 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0ac262b-dfe1-4c93-b96b-a2b2a921ff72 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:52.718301 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0ac262b-dfe1-4c93-b96b-a2b2a921ff72 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:52.718754 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0ac262b-dfe1-4c93-b96b-a2b2a921ff72 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:52.719486 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0ac262b-dfe1-4c93-b96b-a2b2a921ff72 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:52.720045 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0ac262b-dfe1-4c93-b96b-a2b2a921ff72 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:52.720465 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a0ac262b-dfe1-4c93-b96b-a2b2a921ff72 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:52.859478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a0ac262b-dfe1-4c93-b96b-a2b2a921ff72 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:52.867633 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a0ac262b-dfe1-4c93-b96b-a2b2a921ff72 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1375 microversion: 2.1 time: 0.162569 Sep 06 12:22:52.868236 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3767/7576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:52 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:53.891678 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6ad395c0-35ce-47da-96b4-c9ce7c54a55e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:53.892313 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6ad395c0-35ce-47da-96b4-c9ce7c54a55e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:53.899489 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ad395c0-35ce-47da-96b4-c9ce7c54a55e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:53.899992 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ad395c0-35ce-47da-96b4-c9ce7c54a55e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:53.900451 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ad395c0-35ce-47da-96b4-c9ce7c54a55e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:53.901453 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ad395c0-35ce-47da-96b4-c9ce7c54a55e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:53.901930 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ad395c0-35ce-47da-96b4-c9ce7c54a55e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:53.902371 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6ad395c0-35ce-47da-96b4-c9ce7c54a55e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:54.039236 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6ad395c0-35ce-47da-96b4-c9ce7c54a55e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:54.048091 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6ad395c0-35ce-47da-96b4-c9ce7c54a55e tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1375 microversion: 2.1 time: 0.160374 Sep 06 12:22:54.048688 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3810/7577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:53 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:54.792467 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f5beeffc-66b5-46c7-87f3-2195cd3e66d4 req-577ba006-a784-471f-985f-a0367806510e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa235c58-39e0-4010-b2d7-f8f42922ae82", "name": "network-vif-plugged", "status": "completed", "tag": "372b447b-8082-4bf4-808d-6f3f59c30432"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:22:54.799362 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=6 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:54.804867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f5beeffc-66b5-46c7-87f3-2195cd3e66d4 req-577ba006-a784-471f-985f-a0367806510e service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:54.805361 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f5beeffc-66b5-46c7-87f3-2195cd3e66d4 req-577ba006-a784-471f-985f-a0367806510e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:54.805805 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f5beeffc-66b5-46c7-87f3-2195cd3e66d4 req-577ba006-a784-471f-985f-a0367806510e service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:54.817630 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f5beeffc-66b5-46c7-87f3-2195cd3e66d4 req-577ba006-a784-471f-985f-a0367806510e service nova] Creating event network-vif-plugged:372b447b-8082-4bf4-808d-6f3f59c30432 for instance fa235c58-39e0-4010-b2d7-f8f42922ae82 on nch1-master-1 Sep 06 12:22:54.823065 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f5beeffc-66b5-46c7-87f3-2195cd3e66d4 req-577ba006-a784-471f-985f-a0367806510e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037131 Sep 06 12:22:54.823704 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3768/7578] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:22:55.073385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-a070513e-8288-4f8a-aa5a-7d2b5a94693b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:55.078019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-a070513e-8288-4f8a-aa5a-7d2b5a94693b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:55.078019 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:55.083746 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a070513e-8288-4f8a-aa5a-7d2b5a94693b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:55.084496 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a070513e-8288-4f8a-aa5a-7d2b5a94693b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:55.085033 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a070513e-8288-4f8a-aa5a-7d2b5a94693b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:55.085815 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a070513e-8288-4f8a-aa5a-7d2b5a94693b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:55.086242 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a070513e-8288-4f8a-aa5a-7d2b5a94693b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:55.086691 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-a070513e-8288-4f8a-aa5a-7d2b5a94693b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:55.229231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-a070513e-8288-4f8a-aa5a-7d2b5a94693b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:55.237532 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-a070513e-8288-4f8a-aa5a-7d2b5a94693b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1375 microversion: 2.1 time: 0.168901 Sep 06 12:22:55.238120 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3811/7579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:55 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:56.262105 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-a733bb3e-8c6d-4495-a9a0-9bc5e6623c46 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:56.262768 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-a733bb3e-8c6d-4495-a9a0-9bc5e6623c46 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:56.269287 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a733bb3e-8c6d-4495-a9a0-9bc5e6623c46 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:56.269787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a733bb3e-8c6d-4495-a9a0-9bc5e6623c46 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:56.270240 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a733bb3e-8c6d-4495-a9a0-9bc5e6623c46 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:56.270949 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a733bb3e-8c6d-4495-a9a0-9bc5e6623c46 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:56.271481 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a733bb3e-8c6d-4495-a9a0-9bc5e6623c46 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:56.271925 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-a733bb3e-8c6d-4495-a9a0-9bc5e6623c46 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:56.742726 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-a733bb3e-8c6d-4495-a9a0-9bc5e6623c46 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:56.750777 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-a733bb3e-8c6d-4495-a9a0-9bc5e6623c46 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1561 microversion: 2.1 time: 0.494338 Sep 06 12:22:56.751403 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3769/7580] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:56 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1561 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:56.773751 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ae94576a-985a-4158-ba11-6e4b98f2d4be tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:56.774387 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ae94576a-985a-4158-ba11-6e4b98f2d4be tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:56.776339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=8 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:56.783441 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae94576a-985a-4158-ba11-6e4b98f2d4be tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:56.783869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae94576a-985a-4158-ba11-6e4b98f2d4be tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:56.784331 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae94576a-985a-4158-ba11-6e4b98f2d4be tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:56.785060 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae94576a-985a-4158-ba11-6e4b98f2d4be tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:56.785543 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae94576a-985a-4158-ba11-6e4b98f2d4be tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:56.785994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ae94576a-985a-4158-ba11-6e4b98f2d4be tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:56.923277 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ae94576a-985a-4158-ba11-6e4b98f2d4be tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:56.932431 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ae94576a-985a-4158-ba11-6e4b98f2d4be tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1561 microversion: 2.1 time: 0.161514 Sep 06 12:22:56.932431 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3812/7581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:56 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:58.965637 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ce084c18-db2c-45f2-924c-7b15d2a7bc3e req-01fda76e-d4ae-48ff-9894-70362f2db2bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa235c58-39e0-4010-b2d7-f8f42922ae82", "tag": "372b447b-8082-4bf4-808d-6f3f59c30432"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:22:58.976522 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ce084c18-db2c-45f2-924c-7b15d2a7bc3e req-01fda76e-d4ae-48ff-9894-70362f2db2bf service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:58.977001 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ce084c18-db2c-45f2-924c-7b15d2a7bc3e req-01fda76e-d4ae-48ff-9894-70362f2db2bf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:58.977655 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ce084c18-db2c-45f2-924c-7b15d2a7bc3e req-01fda76e-d4ae-48ff-9894-70362f2db2bf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:58.991070 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ce084c18-db2c-45f2-924c-7b15d2a7bc3e req-01fda76e-d4ae-48ff-9894-70362f2db2bf service nova] Creating event network-changed:372b447b-8082-4bf4-808d-6f3f59c30432 for instance fa235c58-39e0-4010-b2d7-f8f42922ae82 on nch1-master-1 Sep 06 12:22:58.997027 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ce084c18-db2c-45f2-924c-7b15d2a7bc3e req-01fda76e-d4ae-48ff-9894-70362f2db2bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034539 Sep 06 12:22:58.997656 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3770/7582] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:24:54.619510 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:24:54.620336 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=38 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:24:54.625891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-8a6a80d6-5e55-467f-88db-52608f0b35b6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1209708352"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:24:54.629484 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-8a6a80d6-5e55-467f-88db-52608f0b35b6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:24:54.635623 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a6a80d6-5e55-467f-88db-52608f0b35b6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:24:54.636154 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a6a80d6-5e55-467f-88db-52608f0b35b6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:24:54.636630 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a6a80d6-5e55-467f-88db-52608f0b35b6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:24:54.637335 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a6a80d6-5e55-467f-88db-52608f0b35b6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:24:54.637806 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a6a80d6-5e55-467f-88db-52608f0b35b6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:24:54.638249 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-8a6a80d6-5e55-467f-88db-52608f0b35b6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:24:55.047713 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-8a6a80d6-5e55-467f-88db-52608f0b35b6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "POST /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82/action" status: 202 len: 0 microversion: 2.1 time: 0.430119 Sep 06 12:24:55.048371 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3813/7583] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:24:54 2022] POST /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 06 12:25:01.258289 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f57fb853-595b-4ef1-91ec-6bf7ec660ec1] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 12:25:01.260071 ncdv-master-1 devstack@n-api.service[140875]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f437706c-3085-4043-9dae-91c01118faaa] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 12:25:01.260900 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:01.261891 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=30 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:01.337893 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-4ef8f865-f979-4b60-8bdf-47d13f5bdb83 req-93549a86-ea9a-49ce-907f-2ce926b112ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa235c58-39e0-4010-b2d7-f8f42922ae82", "name": "network-vif-plugged", "status": "completed", "tag": "372b447b-8082-4bf4-808d-6f3f59c30432"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:25:01.351819 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4ef8f865-f979-4b60-8bdf-47d13f5bdb83 req-93549a86-ea9a-49ce-907f-2ce926b112ac service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:01.352311 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4ef8f865-f979-4b60-8bdf-47d13f5bdb83 req-93549a86-ea9a-49ce-907f-2ce926b112ac service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:01.352761 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-4ef8f865-f979-4b60-8bdf-47d13f5bdb83 req-93549a86-ea9a-49ce-907f-2ce926b112ac service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:01.369886 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-4ef8f865-f979-4b60-8bdf-47d13f5bdb83 req-93549a86-ea9a-49ce-907f-2ce926b112ac service nova] Creating event network-vif-plugged:372b447b-8082-4bf4-808d-6f3f59c30432 for instance fa235c58-39e0-4010-b2d7-f8f42922ae82 on nch1-master-1 Sep 06 12:25:01.375364 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-4ef8f865-f979-4b60-8bdf-47d13f5bdb83 req-93549a86-ea9a-49ce-907f-2ce926b112ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118956 Sep 06 12:25:01.376048 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3771/7584] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:25:10.765383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-975121697", "imageRef": "17126450-0ab2-44ac-944d-292a644475a3", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1597321056", "security_groups": [{"name": "tempest-secgroup-smoke-1342030562"}], "networks": [{"uuid": "23ab5e15-ad9e-45be-bf48-2d200b4e75ba"}]}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:25:10.775579 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:10.776272 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:10.883136 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.network.neutron [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] validate_networks() for [('23ab5e15-ad9e-45be-bf48-2d200b4e75ba', None, None, None, None, None)] {{(pid=140876) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:25:11.266383 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Flavor limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:25:11.266828 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Image limits 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:25:11.267380 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Flavor pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:25:11.268408 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Image pref 0:0:0 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:25:11.268837 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.virt.hardware [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:25:11.277864 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:11.278361 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:11.278809 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:11.279589 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:11.280061 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:11.280501 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:11.297419 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Getting quotas for project b9854a67f3494f36b5ff21ef252b0f54. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:25:11.302799 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.quota [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Getting quotas for user 0839807df0844e76bff94839b3bc0949 and project b9854a67f3494f36b5ff21ef252b0f54. Resources: {'ram', 'instances', 'cores'} {{(pid=140876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:25:11.316030 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Going to run 1 instances... {{(pid=140876) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:25:11.318637 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17126450-0ab2-44ac-944d-292a644475a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:25:11.413234 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c627178a-82f9-4742-9f89-98c2b7be6d7a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.652269 Sep 06 12:25:11.413908 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3814/7585] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 12:25:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:25:11.424156 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:11.430042 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-bba88c72-a282-4606-8b95-e7948313e21c tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:11.433758 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-bba88c72-a282-4606-8b95-e7948313e21c tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:11.439072 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] [f57fb853-595b-4ef1-91ec-6bf7ec660ec1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 37132. Sep 06 12:25:11.442772 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] [f437706c-3085-4043-9dae-91c01118faaa] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 37134. Sep 06 12:25:11.492399 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-bba88c72-a282-4606-8b95-e7948313e21c tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:11.500025 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-bba88c72-a282-4606-8b95-e7948313e21c tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1248 microversion: 2.1 time: 0.078028 Sep 06 12:25:11.500602 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3772/7586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:11 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1248 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:12.525231 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-1cf25927-83da-4b4f-9a69-1551ecf18a80 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:12.529647 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-1cf25927-83da-4b4f-9a69-1551ecf18a80 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:12.537156 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1cf25927-83da-4b4f-9a69-1551ecf18a80 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:12.537689 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1cf25927-83da-4b4f-9a69-1551ecf18a80 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:12.538150 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1cf25927-83da-4b4f-9a69-1551ecf18a80 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:12.538880 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1cf25927-83da-4b4f-9a69-1551ecf18a80 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:12.539395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1cf25927-83da-4b4f-9a69-1551ecf18a80 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:12.539846 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-1cf25927-83da-4b4f-9a69-1551ecf18a80 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:12.602978 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-1cf25927-83da-4b4f-9a69-1551ecf18a80 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:12.610937 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-1cf25927-83da-4b4f-9a69-1551ecf18a80 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1252 microversion: 2.1 time: 0.090535 Sep 06 12:25:12.611563 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3815/7587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:12 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1252 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:13.633908 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-4ea4c18e-7eb6-4e97-88dc-6688899a3131 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:13.634535 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-4ea4c18e-7eb6-4e97-88dc-6688899a3131 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:13.641905 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ea4c18e-7eb6-4e97-88dc-6688899a3131 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:13.642411 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ea4c18e-7eb6-4e97-88dc-6688899a3131 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:13.643089 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ea4c18e-7eb6-4e97-88dc-6688899a3131 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:13.643815 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ea4c18e-7eb6-4e97-88dc-6688899a3131 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:13.644449 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ea4c18e-7eb6-4e97-88dc-6688899a3131 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:13.644923 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-4ea4c18e-7eb6-4e97-88dc-6688899a3131 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:13.722052 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-4ea4c18e-7eb6-4e97-88dc-6688899a3131 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:13.732079 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-4ea4c18e-7eb6-4e97-88dc-6688899a3131 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1308 microversion: 2.1 time: 0.102152 Sep 06 12:25:13.733139 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3773/7588] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:13 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:14.759162 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d19f0c9e-b60d-44fb-bd3e-07bba3e28812 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:14.759817 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d19f0c9e-b60d-44fb-bd3e-07bba3e28812 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:14.774325 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d19f0c9e-b60d-44fb-bd3e-07bba3e28812 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:14.775803 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d19f0c9e-b60d-44fb-bd3e-07bba3e28812 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:14.777121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d19f0c9e-b60d-44fb-bd3e-07bba3e28812 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:14.778906 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d19f0c9e-b60d-44fb-bd3e-07bba3e28812 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:14.779774 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d19f0c9e-b60d-44fb-bd3e-07bba3e28812 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:14.780511 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d19f0c9e-b60d-44fb-bd3e-07bba3e28812 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:15.034339 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d19f0c9e-b60d-44fb-bd3e-07bba3e28812 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:15.048205 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d19f0c9e-b60d-44fb-bd3e-07bba3e28812 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1374 microversion: 2.1 time: 0.294002 Sep 06 12:25:15.055769 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3816/7589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:14 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1374 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:15.291032 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-ff63ae3d-ed0a-4462-b0c4-4c845e1e46e0 req-2cd1be32-eb46-46ab-b5ea-7eca0d77de6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa235c58-39e0-4010-b2d7-f8f42922ae82", "name": "network-vif-unplugged", "status": "completed", "tag": "372b447b-8082-4bf4-808d-6f3f59c30432"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:25:15.320004 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ff63ae3d-ed0a-4462-b0c4-4c845e1e46e0 req-2cd1be32-eb46-46ab-b5ea-7eca0d77de6d service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:15.320680 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ff63ae3d-ed0a-4462-b0c4-4c845e1e46e0 req-2cd1be32-eb46-46ab-b5ea-7eca0d77de6d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:15.321136 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-ff63ae3d-ed0a-4462-b0c4-4c845e1e46e0 req-2cd1be32-eb46-46ab-b5ea-7eca0d77de6d service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:15.334536 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-ff63ae3d-ed0a-4462-b0c4-4c845e1e46e0 req-2cd1be32-eb46-46ab-b5ea-7eca0d77de6d service nova] Creating event network-vif-unplugged:372b447b-8082-4bf4-808d-6f3f59c30432 for instance fa235c58-39e0-4010-b2d7-f8f42922ae82 on nch1-master-1 Sep 06 12:25:15.340851 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-ff63ae3d-ed0a-4462-b0c4-4c845e1e46e0 req-2cd1be32-eb46-46ab-b5ea-7eca0d77de6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056948 Sep 06 12:25:15.342288 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3774/7590] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:25:16.081081 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-258b955f-de85-4be7-b360-76781d939994 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:16.081984 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-258b955f-de85-4be7-b360-76781d939994 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:16.088869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-258b955f-de85-4be7-b360-76781d939994 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:16.089385 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-258b955f-de85-4be7-b360-76781d939994 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:16.089844 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-258b955f-de85-4be7-b360-76781d939994 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:16.090577 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-258b955f-de85-4be7-b360-76781d939994 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:16.091078 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-258b955f-de85-4be7-b360-76781d939994 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:16.091694 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-258b955f-de85-4be7-b360-76781d939994 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:16.246245 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-258b955f-de85-4be7-b360-76781d939994 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:16.260332 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-258b955f-de85-4be7-b360-76781d939994 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1374 microversion: 2.1 time: 0.183533 Sep 06 12:25:16.271382 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3817/7591] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:16 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:25:17.286304 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-41527a33-ff71-46cf-996b-011bd09a20c4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:17.287969 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-41527a33-ff71-46cf-996b-011bd09a20c4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:17.298166 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41527a33-ff71-46cf-996b-011bd09a20c4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:17.298727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41527a33-ff71-46cf-996b-011bd09a20c4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:17.300485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41527a33-ff71-46cf-996b-011bd09a20c4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:17.300485 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41527a33-ff71-46cf-996b-011bd09a20c4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:17.301175 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41527a33-ff71-46cf-996b-011bd09a20c4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:17.301618 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-41527a33-ff71-46cf-996b-011bd09a20c4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:17.457913 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-41527a33-ff71-46cf-996b-011bd09a20c4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:17.476344 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-41527a33-ff71-46cf-996b-011bd09a20c4 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1374 microversion: 2.1 time: 0.195674 Sep 06 12:25:17.478132 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3775/7592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:17 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1374 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:18.507121 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-c1ad50d2-8c9e-49aa-b6b6-aa6e6d45875a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:18.507776 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-c1ad50d2-8c9e-49aa-b6b6-aa6e6d45875a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:18.516127 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1ad50d2-8c9e-49aa-b6b6-aa6e6d45875a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:18.516649 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1ad50d2-8c9e-49aa-b6b6-aa6e6d45875a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:18.517112 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1ad50d2-8c9e-49aa-b6b6-aa6e6d45875a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:18.518346 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1ad50d2-8c9e-49aa-b6b6-aa6e6d45875a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:18.518824 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1ad50d2-8c9e-49aa-b6b6-aa6e6d45875a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:18.519300 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-c1ad50d2-8c9e-49aa-b6b6-aa6e6d45875a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:18.671833 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-c1ad50d2-8c9e-49aa-b6b6-aa6e6d45875a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:18.680773 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-c1ad50d2-8c9e-49aa-b6b6-aa6e6d45875a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1374 microversion: 2.1 time: 0.181421 Sep 06 12:25:18.681833 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3818/7593] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:18 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:19.706355 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e879e158-9eda-4df0-a704-678d80717bf8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:19.707280 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e879e158-9eda-4df0-a704-678d80717bf8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:19.714732 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e879e158-9eda-4df0-a704-678d80717bf8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:19.715324 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e879e158-9eda-4df0-a704-678d80717bf8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:19.715782 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e879e158-9eda-4df0-a704-678d80717bf8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:19.716636 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e879e158-9eda-4df0-a704-678d80717bf8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:19.717111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e879e158-9eda-4df0-a704-678d80717bf8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:19.717556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e879e158-9eda-4df0-a704-678d80717bf8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:19.881455 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e879e158-9eda-4df0-a704-678d80717bf8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:19.887202 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e879e158-9eda-4df0-a704-678d80717bf8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1374 microversion: 2.1 time: 0.184800 Sep 06 12:25:19.888053 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3776/7594] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:19 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:25:20.913233 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ddacc933-6a4c-431a-a34b-33df05b48f3a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:20.914034 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ddacc933-6a4c-431a-a34b-33df05b48f3a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:20.921516 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddacc933-6a4c-431a-a34b-33df05b48f3a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:20.922020 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddacc933-6a4c-431a-a34b-33df05b48f3a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:20.922475 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddacc933-6a4c-431a-a34b-33df05b48f3a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:20.923244 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddacc933-6a4c-431a-a34b-33df05b48f3a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:20.924319 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddacc933-6a4c-431a-a34b-33df05b48f3a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:20.924807 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ddacc933-6a4c-431a-a34b-33df05b48f3a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:21.096448 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ddacc933-6a4c-431a-a34b-33df05b48f3a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:21.105088 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ddacc933-6a4c-431a-a34b-33df05b48f3a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1374 microversion: 2.1 time: 0.195912 Sep 06 12:25:21.105683 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3819/7595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:20 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:22.129284 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-767ca82a-c402-4abc-8a85-4f247220f691 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:22.129867 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-767ca82a-c402-4abc-8a85-4f247220f691 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:22.133046 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell0:SELECT=2 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:22.138293 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-767ca82a-c402-4abc-8a85-4f247220f691 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:22.138787 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-767ca82a-c402-4abc-8a85-4f247220f691 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:22.139264 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-767ca82a-c402-4abc-8a85-4f247220f691 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:22.139971 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-767ca82a-c402-4abc-8a85-4f247220f691 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:22.140436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-767ca82a-c402-4abc-8a85-4f247220f691 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:22.140877 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-767ca82a-c402-4abc-8a85-4f247220f691 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:22.277499 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-767ca82a-c402-4abc-8a85-4f247220f691 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:22.286304 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-767ca82a-c402-4abc-8a85-4f247220f691 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1374 microversion: 2.1 time: 0.161051 Sep 06 12:25:22.286896 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3777/7596] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:22 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:23.312123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-76da0233-18f9-44fe-a16b-7dd4d54c7216 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:23.312123 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-76da0233-18f9-44fe-a16b-7dd4d54c7216 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:23.313037 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:23.313728 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell0:SELECT=6 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:23.320001 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76da0233-18f9-44fe-a16b-7dd4d54c7216 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:23.320514 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76da0233-18f9-44fe-a16b-7dd4d54c7216 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:23.320974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76da0233-18f9-44fe-a16b-7dd4d54c7216 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:23.321693 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76da0233-18f9-44fe-a16b-7dd4d54c7216 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:23.322166 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76da0233-18f9-44fe-a16b-7dd4d54c7216 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:23.322608 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-76da0233-18f9-44fe-a16b-7dd4d54c7216 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:23.470128 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-76da0233-18f9-44fe-a16b-7dd4d54c7216 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:23.478821 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-76da0233-18f9-44fe-a16b-7dd4d54c7216 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1374 microversion: 2.1 time: 0.173018 Sep 06 12:25:23.479463 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3820/7597] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:23 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:23.604305 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-2e7a51a2-ed25-403e-ad48-499ac4818b75 req-b682093b-2920-4dac-a32a-ff8407e62eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522719a4-5f1c-4f52-a0ff-5db9a60556b0", "tag": "0dab001f-84c3-439e-91a0-d8eb4be9426b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:25:23.612337 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2e7a51a2-ed25-403e-ad48-499ac4818b75 req-b682093b-2920-4dac-a32a-ff8407e62eb8 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:23.612835 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2e7a51a2-ed25-403e-ad48-499ac4818b75 req-b682093b-2920-4dac-a32a-ff8407e62eb8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:23.613286 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-2e7a51a2-ed25-403e-ad48-499ac4818b75 req-b682093b-2920-4dac-a32a-ff8407e62eb8 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:23.625146 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-2e7a51a2-ed25-403e-ad48-499ac4818b75 req-b682093b-2920-4dac-a32a-ff8407e62eb8 service nova] Creating event network-changed:0dab001f-84c3-439e-91a0-d8eb4be9426b for instance 522719a4-5f1c-4f52-a0ff-5db9a60556b0 on nch2-master-1 Sep 06 12:25:23.630212 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-2e7a51a2-ed25-403e-ad48-499ac4818b75 req-b682093b-2920-4dac-a32a-ff8407e62eb8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094930 Sep 06 12:25:23.630827 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3778/7598] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:25:24.503982 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3a91b62f-a172-493d-8feb-531c8227fd74 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:24.504631 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3a91b62f-a172-493d-8feb-531c8227fd74 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:24.511894 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a91b62f-a172-493d-8feb-531c8227fd74 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:24.514771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a91b62f-a172-493d-8feb-531c8227fd74 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:24.514771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a91b62f-a172-493d-8feb-531c8227fd74 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:24.514771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a91b62f-a172-493d-8feb-531c8227fd74 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:24.514771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a91b62f-a172-493d-8feb-531c8227fd74 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:24.514771 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3a91b62f-a172-493d-8feb-531c8227fd74 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:24.659502 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-3a91b62f-a172-493d-8feb-531c8227fd74 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:24.667762 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3a91b62f-a172-493d-8feb-531c8227fd74 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1374 microversion: 2.1 time: 0.168026 Sep 06 12:25:24.668360 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3821/7599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:24 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:25.692422 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-e8bd72a2-5a01-4b03-a82a-e2d06a1d4642 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:25.693133 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-e8bd72a2-5a01-4b03-a82a-e2d06a1d4642 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:25.699403 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8bd72a2-5a01-4b03-a82a-e2d06a1d4642 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:25.699895 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8bd72a2-5a01-4b03-a82a-e2d06a1d4642 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:25.704477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8bd72a2-5a01-4b03-a82a-e2d06a1d4642 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:25.704477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8bd72a2-5a01-4b03-a82a-e2d06a1d4642 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:25.704477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8bd72a2-5a01-4b03-a82a-e2d06a1d4642 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:25.704477 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-e8bd72a2-5a01-4b03-a82a-e2d06a1d4642 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:25.846753 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-e8bd72a2-5a01-4b03-a82a-e2d06a1d4642 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:25.855280 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-e8bd72a2-5a01-4b03-a82a-e2d06a1d4642 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1374 microversion: 2.1 time: 0.167985 Sep 06 12:25:25.855878 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3779/7600] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:25 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:25:26.878685 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-fdca5b78-90bd-4832-a379-88369b8e6ec6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:26.879480 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-fdca5b78-90bd-4832-a379-88369b8e6ec6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:26.886633 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fdca5b78-90bd-4832-a379-88369b8e6ec6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:26.887158 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fdca5b78-90bd-4832-a379-88369b8e6ec6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:26.887617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fdca5b78-90bd-4832-a379-88369b8e6ec6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:26.888343 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fdca5b78-90bd-4832-a379-88369b8e6ec6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:26.888820 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fdca5b78-90bd-4832-a379-88369b8e6ec6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:26.889270 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-fdca5b78-90bd-4832-a379-88369b8e6ec6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:27.025488 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-fdca5b78-90bd-4832-a379-88369b8e6ec6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:27.033812 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-fdca5b78-90bd-4832-a379-88369b8e6ec6 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1374 microversion: 2.1 time: 0.159280 Sep 06 12:25:27.034386 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3822/7601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:26 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:27.447109 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-f8d34131-6b6a-4b0a-9ba8-5d77f896edbb req-65ece014-d4df-4c8f-a136-3ab8e911a9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522719a4-5f1c-4f52-a0ff-5db9a60556b0", "name": "network-vif-plugged", "status": "completed", "tag": "0dab001f-84c3-439e-91a0-d8eb4be9426b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:25:27.459897 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f8d34131-6b6a-4b0a-9ba8-5d77f896edbb req-65ece014-d4df-4c8f-a136-3ab8e911a9fa service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:27.462751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f8d34131-6b6a-4b0a-9ba8-5d77f896edbb req-65ece014-d4df-4c8f-a136-3ab8e911a9fa service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:27.462751 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-f8d34131-6b6a-4b0a-9ba8-5d77f896edbb req-65ece014-d4df-4c8f-a136-3ab8e911a9fa service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:27.472905 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-f8d34131-6b6a-4b0a-9ba8-5d77f896edbb req-65ece014-d4df-4c8f-a136-3ab8e911a9fa service nova] Creating event network-vif-plugged:0dab001f-84c3-439e-91a0-d8eb4be9426b for instance 522719a4-5f1c-4f52-a0ff-5db9a60556b0 on nch2-master-1 Sep 06 12:25:27.478124 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-f8d34131-6b6a-4b0a-9ba8-5d77f896edbb req-65ece014-d4df-4c8f-a136-3ab8e911a9fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035326 Sep 06 12:25:27.478815 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3780/7602] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:25:28.059612 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-6d648a5d-40ae-4651-ad7d-da2dc9e9e70b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:28.060491 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-6d648a5d-40ae-4651-ad7d-da2dc9e9e70b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:28.070790 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d648a5d-40ae-4651-ad7d-da2dc9e9e70b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:28.071320 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d648a5d-40ae-4651-ad7d-da2dc9e9e70b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:28.071779 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d648a5d-40ae-4651-ad7d-da2dc9e9e70b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:28.072505 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d648a5d-40ae-4651-ad7d-da2dc9e9e70b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:28.072974 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d648a5d-40ae-4651-ad7d-da2dc9e9e70b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:28.073421 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-6d648a5d-40ae-4651-ad7d-da2dc9e9e70b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:28.231219 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-6d648a5d-40ae-4651-ad7d-da2dc9e9e70b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:28.240128 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-6d648a5d-40ae-4651-ad7d-da2dc9e9e70b tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1374 microversion: 2.1 time: 0.185469 Sep 06 12:25:28.240706 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3823/7603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:28 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:29.265017 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-33cd8a24-9cf4-4002-92cb-6fa1e81931cf tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:29.265660 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-33cd8a24-9cf4-4002-92cb-6fa1e81931cf tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:29.272626 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33cd8a24-9cf4-4002-92cb-6fa1e81931cf tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:29.273124 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33cd8a24-9cf4-4002-92cb-6fa1e81931cf tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:29.273580 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33cd8a24-9cf4-4002-92cb-6fa1e81931cf tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:29.274295 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33cd8a24-9cf4-4002-92cb-6fa1e81931cf tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:29.274765 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33cd8a24-9cf4-4002-92cb-6fa1e81931cf tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:29.275237 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-33cd8a24-9cf4-4002-92cb-6fa1e81931cf tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:29.419427 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-33cd8a24-9cf4-4002-92cb-6fa1e81931cf tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:29.427329 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-33cd8a24-9cf4-4002-92cb-6fa1e81931cf tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1559 microversion: 2.1 time: 0.167601 Sep 06 12:25:29.427923 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3781/7604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:29 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:29.450398 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-473a4aed-8afc-4322-9bd5-a8f85d44f323 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:29.451076 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-473a4aed-8afc-4322-9bd5-a8f85d44f323 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:29.458869 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-473a4aed-8afc-4322-9bd5-a8f85d44f323 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:29.459395 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-473a4aed-8afc-4322-9bd5-a8f85d44f323 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:29.459853 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-473a4aed-8afc-4322-9bd5-a8f85d44f323 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:29.460564 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-473a4aed-8afc-4322-9bd5-a8f85d44f323 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:29.461312 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-473a4aed-8afc-4322-9bd5-a8f85d44f323 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:29.461960 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-473a4aed-8afc-4322-9bd5-a8f85d44f323 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:29.599444 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-473a4aed-8afc-4322-9bd5-a8f85d44f323 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:29.607933 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-473a4aed-8afc-4322-9bd5-a8f85d44f323 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1559 microversion: 2.1 time: 0.161441 Sep 06 12:25:29.608456 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3824/7605] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:29 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:25:31.578850 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-8a0b1b03-9a1f-44c9-acbe-bf31287617cf req-a1f2c450-0be9-42c8-b556-0a5875269b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522719a4-5f1c-4f52-a0ff-5db9a60556b0", "tag": "0dab001f-84c3-439e-91a0-d8eb4be9426b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:25:31.589516 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8a0b1b03-9a1f-44c9-acbe-bf31287617cf req-a1f2c450-0be9-42c8-b556-0a5875269b73 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:31.590000 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8a0b1b03-9a1f-44c9-acbe-bf31287617cf req-a1f2c450-0be9-42c8-b556-0a5875269b73 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:31.590510 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-8a0b1b03-9a1f-44c9-acbe-bf31287617cf req-a1f2c450-0be9-42c8-b556-0a5875269b73 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:31.603413 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-8a0b1b03-9a1f-44c9-acbe-bf31287617cf req-a1f2c450-0be9-42c8-b556-0a5875269b73 service nova] Creating event network-changed:0dab001f-84c3-439e-91a0-d8eb4be9426b for instance 522719a4-5f1c-4f52-a0ff-5db9a60556b0 on nch2-master-1 Sep 06 12:25:31.608599 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-8a0b1b03-9a1f-44c9-acbe-bf31287617cf req-a1f2c450-0be9-42c8-b556-0a5875269b73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033595 Sep 06 12:25:31.609209 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3782/7606] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:27:02.470786 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:27:02.471607 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=62 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:27:02.472960 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:27:02.473117 ncdv-master-1 devstack@n-api.service[140876]: Tue Sep 6 12:27:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0/action (ip 10.222.0.20) !!! Sep 06 12:27:02.477849 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-3515c1de-ae82-492d-96e5-13161a148bed tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-279781613"}} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:27:02.480297 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-3515c1de-ae82-492d-96e5-13161a148bed tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:27:02.487617 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3515c1de-ae82-492d-96e5-13161a148bed tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:02.490609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3515c1de-ae82-492d-96e5-13161a148bed tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:02.490609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3515c1de-ae82-492d-96e5-13161a148bed tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:02.490609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3515c1de-ae82-492d-96e5-13161a148bed tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:02.490609 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3515c1de-ae82-492d-96e5-13161a148bed tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:02.490991 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-3515c1de-ae82-492d-96e5-13161a148bed tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:02.893724 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-3515c1de-ae82-492d-96e5-13161a148bed tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "POST /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0/action" status: 202 len: 0 microversion: 2.1 time: 0.424649 Sep 06 12:27:02.894401 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3825/7607] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 12:27:02 2022] POST /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 06 12:27:09.975869 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_api:SELECT=28 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:27:09.976963 ncdv-master-1 devstack@n-api.service[140875]: DEBUG dbcounter [-] [140875] Writing DB stats nova_cell1:SELECT=44 {{(pid=140875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:27:09.978002 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:27:09.978135 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 12:27:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 06 12:27:09.979589 ncdv-master-1 devstack@n-api.service[140875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:27:09.979705 ncdv-master-1 devstack@n-api.service[140875]: Tue Sep 6 12:27:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 06 12:27:09.986649 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-bbaa9ba7-d26f-4041-adf0-b3377c7bf912 req-a8b80536-3fc1-45ea-a4d1-ccf18289c4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522719a4-5f1c-4f52-a0ff-5db9a60556b0", "name": "network-vif-plugged", "status": "completed", "tag": "0dab001f-84c3-439e-91a0-d8eb4be9426b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:27:10.003960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bbaa9ba7-d26f-4041-adf0-b3377c7bf912 req-a8b80536-3fc1-45ea-a4d1-ccf18289c4ef service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:10.005952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bbaa9ba7-d26f-4041-adf0-b3377c7bf912 req-a8b80536-3fc1-45ea-a4d1-ccf18289c4ef service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:10.005952 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-bbaa9ba7-d26f-4041-adf0-b3377c7bf912 req-a8b80536-3fc1-45ea-a4d1-ccf18289c4ef service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:10.015983 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-bbaa9ba7-d26f-4041-adf0-b3377c7bf912 req-a8b80536-3fc1-45ea-a4d1-ccf18289c4ef service nova] Creating event network-vif-plugged:0dab001f-84c3-439e-91a0-d8eb4be9426b for instance 522719a4-5f1c-4f52-a0ff-5db9a60556b0 on nch2-master-1 Sep 06 12:27:10.021232 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-bbaa9ba7-d26f-4041-adf0-b3377c7bf912 req-a8b80536-3fc1-45ea-a4d1-ccf18289c4ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050829 Sep 06 12:27:10.021858 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3783/7608] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:27:19.287919 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e366ae3e-f715-4bfe-a538-76a63bf43111] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 12:27:19.288737 ncdv-master-1 devstack@n-api.service[140876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 12:27:19.289289 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_api:SELECT=2 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:27:19.290070 ncdv-master-1 devstack@n-api.service[140876]: DEBUG dbcounter [-] [140876] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:27:19.294202 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-250d3d12-344c-4804-b622-0e070853d523 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:27:19.294811 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-250d3d12-344c-4804-b622-0e070853d523 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:27:19.295315 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-9b788634-8f3d-4a6e-8047-a5a35a122a90 req-c67b0ee3-5ee1-46d3-8e62-6ca6405dda06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522719a4-5f1c-4f52-a0ff-5db9a60556b0", "tag": "0dab001f-84c3-439e-91a0-d8eb4be9426b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:27:19.301847 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-250d3d12-344c-4804-b622-0e070853d523 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:19.303178 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-250d3d12-344c-4804-b622-0e070853d523 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:19.303635 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-250d3d12-344c-4804-b622-0e070853d523 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:19.304350 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-250d3d12-344c-4804-b622-0e070853d523 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:19.304976 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-250d3d12-344c-4804-b622-0e070853d523 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:19.305426 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-250d3d12-344c-4804-b622-0e070853d523 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:19.306656 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9b788634-8f3d-4a6e-8047-a5a35a122a90 req-c67b0ee3-5ee1-46d3-8e62-6ca6405dda06 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:19.307235 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9b788634-8f3d-4a6e-8047-a5a35a122a90 req-c67b0ee3-5ee1-46d3-8e62-6ca6405dda06 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:19.307679 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-9b788634-8f3d-4a6e-8047-a5a35a122a90 req-c67b0ee3-5ee1-46d3-8e62-6ca6405dda06 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:19.320187 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-9b788634-8f3d-4a6e-8047-a5a35a122a90 req-c67b0ee3-5ee1-46d3-8e62-6ca6405dda06 service nova] Creating event network-changed:0dab001f-84c3-439e-91a0-d8eb4be9426b for instance 522719a4-5f1c-4f52-a0ff-5db9a60556b0 on nch2-master-1 Sep 06 12:27:19.326553 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-9b788634-8f3d-4a6e-8047-a5a35a122a90 req-c67b0ee3-5ee1-46d3-8e62-6ca6405dda06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036897 Sep 06 12:27:19.327197 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3784/7609] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:27:19.337479 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-250d3d12-344c-4804-b622-0e070853d523 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:27:19.574796 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-250d3d12-344c-4804-b622-0e070853d523 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "DELETE /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 204 len: 0 microversion: 2.1 time: 0.288099 Sep 06 12:27:19.575716 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3826/7610] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 12:27:19 2022] DELETE /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:27:19.584814 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1e1803ea-d9c9-4660-a4b9-4d4d173ef9d8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:27:19.587128 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1e1803ea-d9c9-4660-a4b9-4d4d173ef9d8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:27:19.593148 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1803ea-d9c9-4660-a4b9-4d4d173ef9d8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:19.593766 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1803ea-d9c9-4660-a4b9-4d4d173ef9d8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:19.594316 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1803ea-d9c9-4660-a4b9-4d4d173ef9d8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:19.595196 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1803ea-d9c9-4660-a4b9-4d4d173ef9d8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:19.595762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1803ea-d9c9-4660-a4b9-4d4d173ef9d8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:19.596300 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1e1803ea-d9c9-4660-a4b9-4d4d173ef9d8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:19.791763 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [req-5a4c1ded-e581-4ee6-b572-0402cdb591e1 req-c2765103-869b-4a69-98b1-078f70ef68cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522719a4-5f1c-4f52-a0ff-5db9a60556b0", "name": "network-vif-unplugged", "status": "completed", "tag": "0dab001f-84c3-439e-91a0-d8eb4be9426b"}]} {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:27:19.802767 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5a4c1ded-e581-4ee6-b572-0402cdb591e1 req-c2765103-869b-4a69-98b1-078f70ef68cf service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:19.809188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5a4c1ded-e581-4ee6-b572-0402cdb591e1 req-c2765103-869b-4a69-98b1-078f70ef68cf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:19.809188 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [req-5a4c1ded-e581-4ee6-b572-0402cdb591e1 req-c2765103-869b-4a69-98b1-078f70ef68cf service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:19.816875 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.compute.server_external_events [req-5a4c1ded-e581-4ee6-b572-0402cdb591e1 req-c2765103-869b-4a69-98b1-078f70ef68cf service nova] Creating event network-vif-unplugged:0dab001f-84c3-439e-91a0-d8eb4be9426b for instance 522719a4-5f1c-4f52-a0ff-5db9a60556b0 on nch2-master-1 Sep 06 12:27:19.822028 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [req-5a4c1ded-e581-4ee6-b572-0402cdb591e1 req-c2765103-869b-4a69-98b1-078f70ef68cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035483 Sep 06 12:27:19.822638 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3827/7611] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:27:19.824565 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1e1803ea-d9c9-4660-a4b9-4d4d173ef9d8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:27:19.834185 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1e1803ea-d9c9-4660-a4b9-4d4d173ef9d8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1684 microversion: 2.1 time: 0.253856 Sep 06 12:27:19.834776 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3785/7612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:27:19 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1684 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:27:20.861052 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-d4589030-5276-4bd0-91da-e588dde1c62a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:27:20.861683 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-d4589030-5276-4bd0-91da-e588dde1c62a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:27:20.874411 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4589030-5276-4bd0-91da-e588dde1c62a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:20.875032 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4589030-5276-4bd0-91da-e588dde1c62a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:20.875540 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4589030-5276-4bd0-91da-e588dde1c62a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:20.876723 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4589030-5276-4bd0-91da-e588dde1c62a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:20.877646 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4589030-5276-4bd0-91da-e588dde1c62a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:20.878445 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-d4589030-5276-4bd0-91da-e588dde1c62a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:20.884733 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d2adbf7-affb-4b5d-879e-1e2aea1f78ce] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 37474. Sep 06 12:27:20.885771 ncdv-master-1 devstack@n-api.service[140876]: INFO oslo.messaging._drivers.impl_rabbit [-] [e366ae3e-f715-4bfe-a538-76a63bf43111] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 37472. Sep 06 12:27:21.079920 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-d4589030-5276-4bd0-91da-e588dde1c62a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:27:21.088800 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-d4589030-5276-4bd0-91da-e588dde1c62a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1684 microversion: 2.1 time: 0.233638 Sep 06 12:27:21.089400 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3828/7613] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:27:20 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1684 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:27:21.888576 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-926d8dfe-b48a-4470-813c-26dfb2a22e74 req-f20d896e-5b07-4c6c-9a22-cbf4966f84ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522719a4-5f1c-4f52-a0ff-5db9a60556b0", "name": "network-vif-deleted", "tag": "0dab001f-84c3-439e-91a0-d8eb4be9426b"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:27:21.898960 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-926d8dfe-b48a-4470-813c-26dfb2a22e74 req-f20d896e-5b07-4c6c-9a22-cbf4966f84ea service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:21.899478 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-926d8dfe-b48a-4470-813c-26dfb2a22e74 req-f20d896e-5b07-4c6c-9a22-cbf4966f84ea service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:21.899929 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-926d8dfe-b48a-4470-813c-26dfb2a22e74 req-f20d896e-5b07-4c6c-9a22-cbf4966f84ea service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:21.914895 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-926d8dfe-b48a-4470-813c-26dfb2a22e74 req-f20d896e-5b07-4c6c-9a22-cbf4966f84ea service nova] Creating event network-vif-deleted:0dab001f-84c3-439e-91a0-d8eb4be9426b for instance 522719a4-5f1c-4f52-a0ff-5db9a60556b0 on nch2-master-1 Sep 06 12:27:21.920363 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-926d8dfe-b48a-4470-813c-26dfb2a22e74 req-f20d896e-5b07-4c6c-9a22-cbf4966f84ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091255 Sep 06 12:27:21.925585 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3786/7614] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:27:22.113994 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-ab29da60-848c-416a-9b56-22b27d68fe40 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:27:22.114655 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-ab29da60-848c-416a-9b56-22b27d68fe40 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:27:22.121402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab29da60-848c-416a-9b56-22b27d68fe40 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:22.125754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab29da60-848c-416a-9b56-22b27d68fe40 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:22.125754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab29da60-848c-416a-9b56-22b27d68fe40 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:22.125754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab29da60-848c-416a-9b56-22b27d68fe40 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:22.125754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab29da60-848c-416a-9b56-22b27d68fe40 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:22.125754 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-ab29da60-848c-416a-9b56-22b27d68fe40 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:22.194684 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-ab29da60-848c-416a-9b56-22b27d68fe40 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:27:22.203301 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-ab29da60-848c-416a-9b56-22b27d68fe40 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 200 len: 1333 microversion: 2.1 time: 0.094915 Sep 06 12:27:22.203915 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3829/7615] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:27:22 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:27:23.230709 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d2b3b647-2a29-4619-8717-44cf0e8875c9 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:27:23.231376 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-d2b3b647-2a29-4619-8717-44cf0e8875c9 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: 522719a4-5f1c-4f52-a0ff-5db9a60556b0] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:27:23.237614 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2b3b647-2a29-4619-8717-44cf0e8875c9 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:23.238106 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2b3b647-2a29-4619-8717-44cf0e8875c9 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:23.238556 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2b3b647-2a29-4619-8717-44cf0e8875c9 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:23.239291 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2b3b647-2a29-4619-8717-44cf0e8875c9 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:23.239762 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2b3b647-2a29-4619-8717-44cf0e8875c9 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:23.240272 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-d2b3b647-2a29-4619-8717-44cf0e8875c9 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:23.253567 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-d2b3b647-2a29-4619-8717-44cf0e8875c9 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] HTTP exception thrown: Instance 522719a4-5f1c-4f52-a0ff-5db9a60556b0 could not be found. Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d2b3b647-2a29-4619-8717-44cf0e8875c9 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Request method failure captured: Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 HTTP/1.1 Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzuKVXNfovSn1oeFsG8RJPKHiPeaJl-4IBU5jNtReAbdWP_hJ7CFzIk-9ulsPv2aH1dqSK3wARWMj8gTIshuExbD_XxBgCOUz-rI5ssoMNrkEobMAxqj71rojsrCbAGxw70Bb0CEoSkc0dE5idA5w3GOCuOaRu9QUWeYvo5Gd94et7I Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: b9854a67f3494f36b5ff21ef252b0f54 Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestSnapshotPattern-1498193749 Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b9854a67f3494f36b5ff21ef252b0f54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b9854a67f3494f36b5ff21ef252b0f54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b9854a67f3494f36b5ff21ef252b0f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b9854a67f3494f36b5ff21ef252b0f54"}]}] Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestSnapshotPattern-1498193749 Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: b9854a67f3494f36b5ff21ef252b0f54 Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestSnapshotPattern-1498193749 Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestSnapshotPattern-1498193749-project Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 0839807df0844e76bff94839b3bc0949 Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestSnapshotPattern-1498193749-project Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance 522719a4-5f1c-4f52-a0ff-5db9a60556b0 could not be found. Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': '522719a4-5f1c-4f52-a0ff-5db9a60556b0'} Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522719a4-5f1c-4f52-a0ff-5db9a60556b0 could not be found. Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522719a4-5f1c-4f52-a0ff-5db9a60556b0 could not be found. Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:27:23.255254 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:27:23.259609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:27:23.259609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:27:23.259609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:27:23.259609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:27:23.259609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:27:23.259609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522719a4-5f1c-4f52-a0ff-5db9a60556b0 could not be found. Sep 06 12:27:23.259609 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:27:23.259609 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-d2b3b647-2a29-4619-8717-44cf0e8875c9 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Returning 404 to user: Instance 522719a4-5f1c-4f52-a0ff-5db9a60556b0 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:27:23.259609 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-d2b3b647-2a29-4619-8717-44cf0e8875c9 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0" status: 404 len: 111 microversion: 2.1 time: 0.031348 Sep 06 12:27:23.259609 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3787/7616] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:27:23 2022] GET /compute/v2.1/servers/522719a4-5f1c-4f52-a0ff-5db9a60556b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:27:25.458735 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-5b94b0f8-8915-4ff5-9e43-a393f2fdf166 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:27:25.459661 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5b94b0f8-8915-4ff5-9e43-a393f2fdf166 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:27:25.461267 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-befbd0df-8c0e-4dc2-8035-5eac5d184aed req-ce6f8c49-11a5-4fe9-b2cf-607bcea5f027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa235c58-39e0-4010-b2d7-f8f42922ae82", "tag": "372b447b-8082-4bf4-808d-6f3f59c30432"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:27:25.466891 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b94b0f8-8915-4ff5-9e43-a393f2fdf166 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:25.467549 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b94b0f8-8915-4ff5-9e43-a393f2fdf166 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:25.468111 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b94b0f8-8915-4ff5-9e43-a393f2fdf166 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:25.468938 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b94b0f8-8915-4ff5-9e43-a393f2fdf166 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:25.469840 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b94b0f8-8915-4ff5-9e43-a393f2fdf166 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:25.470298 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-5b94b0f8-8915-4ff5-9e43-a393f2fdf166 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:25.474777 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-befbd0df-8c0e-4dc2-8035-5eac5d184aed req-ce6f8c49-11a5-4fe9-b2cf-607bcea5f027 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:25.475423 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-befbd0df-8c0e-4dc2-8035-5eac5d184aed req-ce6f8c49-11a5-4fe9-b2cf-607bcea5f027 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:25.475974 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-befbd0df-8c0e-4dc2-8035-5eac5d184aed req-ce6f8c49-11a5-4fe9-b2cf-607bcea5f027 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:25.489131 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-befbd0df-8c0e-4dc2-8035-5eac5d184aed req-ce6f8c49-11a5-4fe9-b2cf-607bcea5f027 service nova] Creating event network-changed:372b447b-8082-4bf4-808d-6f3f59c30432 for instance fa235c58-39e0-4010-b2d7-f8f42922ae82 on nch1-master-1 Sep 06 12:27:25.495341 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-befbd0df-8c0e-4dc2-8035-5eac5d184aed req-ce6f8c49-11a5-4fe9-b2cf-607bcea5f027 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038863 Sep 06 12:27:25.496615 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3788/7617] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:27:25.499064 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-5b94b0f8-8915-4ff5-9e43-a393f2fdf166 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Going to try to terminate instance {{(pid=140876) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:27:25.781516 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-5b94b0f8-8915-4ff5-9e43-a393f2fdf166 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 204 len: 0 microversion: 2.1 time: 0.327217 Sep 06 12:27:25.785216 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3830/7618] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 12:27:25 2022] DELETE /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:27:25.792207 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-1299ecc5-50da-465c-a77c-25bc95d2fd6a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:27:25.793011 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-1299ecc5-50da-465c-a77c-25bc95d2fd6a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:27:25.800111 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1299ecc5-50da-465c-a77c-25bc95d2fd6a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:25.800718 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1299ecc5-50da-465c-a77c-25bc95d2fd6a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:25.801239 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1299ecc5-50da-465c-a77c-25bc95d2fd6a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:25.802074 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1299ecc5-50da-465c-a77c-25bc95d2fd6a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:25.802760 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1299ecc5-50da-465c-a77c-25bc95d2fd6a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:25.803531 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-1299ecc5-50da-465c-a77c-25bc95d2fd6a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:25.956708 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.policy [None req-1299ecc5-50da-465c-a77c-25bc95d2fd6a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140875) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:27:25.965668 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-1299ecc5-50da-465c-a77c-25bc95d2fd6a tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1686 microversion: 2.1 time: 0.178027 Sep 06 12:27:25.966258 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3789/7619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:27:25 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:27:26.990493 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-af0588cc-11f1-4317-a1b7-ddf8bbca404d tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:27:26.991250 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-af0588cc-11f1-4317-a1b7-ddf8bbca404d tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:27:26.999378 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af0588cc-11f1-4317-a1b7-ddf8bbca404d tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:27.000317 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af0588cc-11f1-4317-a1b7-ddf8bbca404d tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:27.001152 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af0588cc-11f1-4317-a1b7-ddf8bbca404d tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:27.002474 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af0588cc-11f1-4317-a1b7-ddf8bbca404d tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:27.003409 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af0588cc-11f1-4317-a1b7-ddf8bbca404d tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:27.004308 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-af0588cc-11f1-4317-a1b7-ddf8bbca404d tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:27.141517 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-af0588cc-11f1-4317-a1b7-ddf8bbca404d tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:27:27.150293 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-af0588cc-11f1-4317-a1b7-ddf8bbca404d tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1686 microversion: 2.1 time: 0.164171 Sep 06 12:27:27.150893 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3831/7620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:27:26 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:27:27.805054 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [req-68ca16cd-5126-4dce-874e-63a5174b1c66 req-73d7fe94-fb03-4958-8a6e-f28ab191e8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa235c58-39e0-4010-b2d7-f8f42922ae82", "name": "network-vif-deleted", "tag": "372b447b-8082-4bf4-808d-6f3f59c30432"}]} {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:27:27.816020 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-68ca16cd-5126-4dce-874e-63a5174b1c66 req-73d7fe94-fb03-4958-8a6e-f28ab191e8d5 service nova] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:27.816436 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-68ca16cd-5126-4dce-874e-63a5174b1c66 req-73d7fe94-fb03-4958-8a6e-f28ab191e8d5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:27.816872 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [req-68ca16cd-5126-4dce-874e-63a5174b1c66 req-73d7fe94-fb03-4958-8a6e-f28ab191e8d5 service nova] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:27.829466 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.compute.server_external_events [req-68ca16cd-5126-4dce-874e-63a5174b1c66 req-73d7fe94-fb03-4958-8a6e-f28ab191e8d5 service nova] Creating event network-vif-deleted:372b447b-8082-4bf4-808d-6f3f59c30432 for instance fa235c58-39e0-4010-b2d7-f8f42922ae82 on nch1-master-1 Sep 06 12:27:27.835150 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [req-68ca16cd-5126-4dce-874e-63a5174b1c66 req-73d7fe94-fb03-4958-8a6e-f28ab191e8d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034402 Sep 06 12:27:27.837475 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3790/7621] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 12:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:27:28.174430 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:27:28.175402 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.compute.api [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140876) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:27:28.183261 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:28.183770 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:28.184436 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:28.185167 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:28.185640 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:28.186082 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:28.225073 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:28.225669 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:28.226221 ncdv-master-1 devstack@n-api.service[140876]: DEBUG oslo_concurrency.lockutils [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:28.226768 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.objects.instance [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lazy-loading 'fault' on Instance uuid fa235c58-39e0-4010-b2d7-f8f42922ae82 {{(pid=140876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:27:28.276856 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.policy [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0839807df0844e76bff94839b3bc0949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9854a67f3494f36b5ff21ef252b0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140876) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:27:28.284779 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-cabcb558-0c46-4949-ae16-04551e1b0750 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 200 len: 1339 microversion: 2.1 time: 0.114723 Sep 06 12:27:28.285356 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3832/7622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:27:28 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 1339 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:27:29.309631 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-393467ed-3ccc-467f-88ee-7e15838e3f35 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '>' {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:27:29.310346 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.compute.api [None req-393467ed-3ccc-467f-88ee-7e15838e3f35 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] [instance: fa235c58-39e0-4010-b2d7-f8f42922ae82] Fetching instance by UUID {{(pid=140875) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:27:29.318334 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-393467ed-3ccc-467f-88ee-7e15838e3f35 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:29.318740 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-393467ed-3ccc-467f-88ee-7e15838e3f35 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:29.319146 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-393467ed-3ccc-467f-88ee-7e15838e3f35 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:29.319855 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-393467ed-3ccc-467f-88ee-7e15838e3f35 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Acquiring lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:27:29.320323 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-393467ed-3ccc-467f-88ee-7e15838e3f35 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:27:29.320771 ncdv-master-1 devstack@n-api.service[140875]: DEBUG oslo_concurrency.lockutils [None req-393467ed-3ccc-467f-88ee-7e15838e3f35 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Lock "a5a6b47c-7522-4a84-9be6-8ca7130ab6d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:27:29.337076 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.wsgi [None req-393467ed-3ccc-467f-88ee-7e15838e3f35 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] HTTP exception thrown: Instance fa235c58-39e0-4010-b2d7-f8f42922ae82 could not be found. Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-393467ed-3ccc-467f-88ee-7e15838e3f35 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Request method failure captured: Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: request: GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 HTTP/1.1 Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: Accept: application/json Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: Accept-Encoding: identity Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: Connection: close Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: Content-Length: 0 Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: Content-Type: application/json Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: Host: 10.222.0.20 Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: Openstack-System-Scope: None Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: User-Agent: python-urllib3/1.26.12 Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Auth-Token: gAAAAABjFzuKVXNfovSn1oeFsG8RJPKHiPeaJl-4IBU5jNtReAbdWP_hJ7CFzIk-9ulsPv2aH1dqSK3wARWMj8gTIshuExbD_XxBgCOUz-rI5ssoMNrkEobMAxqj71rojsrCbAGxw70Bb0CEoSkc0dE5idA5w3GOCuOaRu9QUWeYvo5Gd94et7I Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Id: None Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Domain-Name: None Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Identity-Status: Confirmed Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Is-Admin-Project: True Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Id: default Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Domain-Name: Default Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Id: b9854a67f3494f36b5ff21ef252b0f54 Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Project-Name: tempest-TestSnapshotPattern-1498193749 Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Role: member,reader Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Roles: member,reader Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b9854a67f3494f36b5ff21ef252b0f54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b9854a67f3494f36b5ff21ef252b0f54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b9854a67f3494f36b5ff21ef252b0f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b9854a67f3494f36b5ff21ef252b0f54"}]}] Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant: tempest-TestSnapshotPattern-1498193749 Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Id: b9854a67f3494f36b5ff21ef252b0f54 Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-Tenant-Name: tempest-TestSnapshotPattern-1498193749 Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-User: tempest-TestSnapshotPattern-1498193749-project Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Id: default Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-User-Domain-Name: Default Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-User-Id: 0839807df0844e76bff94839b3bc0949 Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: X-User-Name: tempest-TestSnapshotPattern-1498193749-project Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: method: > Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: exception: Instance fa235c58-39e0-4010-b2d7-f8f42922ae82 could not be found. Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: action_args: {'id': 'fa235c58-39e0-4010-b2d7-f8f42922ae82'} Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: {{(pid=140875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa235c58-39e0-4010-b2d7-f8f42922ae82 could not be found. Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa235c58-39e0-4010-b2d7-f8f42922ae82 could not be found. Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:27:29.338727 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:27:29.342653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:27:29.342653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:27:29.342653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:27:29.342653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:27:29.342653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:27:29.342653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa235c58-39e0-4010-b2d7-f8f42922ae82 could not be found. Sep 06 12:27:29.342653 ncdv-master-1 devstack@n-api.service[140875]: ERROR nova.api.openstack.wsgi Sep 06 12:27:29.342653 ncdv-master-1 devstack@n-api.service[140875]: DEBUG nova.api.openstack.wsgi [None req-393467ed-3ccc-467f-88ee-7e15838e3f35 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Returning 404 to user: Instance fa235c58-39e0-4010-b2d7-f8f42922ae82 could not be found. {{(pid=140875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:27:29.342653 ncdv-master-1 devstack@n-api.service[140875]: INFO nova.api.openstack.requestlog [None req-393467ed-3ccc-467f-88ee-7e15838e3f35 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82" status: 404 len: 111 microversion: 2.1 time: 0.035154 Sep 06 12:27:29.342653 ncdv-master-1 devstack@n-api.service[140875]: [pid: 140875|app: 0|req: 3791/7623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 12:27:29 2022] GET /compute/v2.1/servers/fa235c58-39e0-4010-b2d7-f8f42922ae82 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:27:29.584700 ncdv-master-1 devstack@n-api.service[140876]: DEBUG nova.api.openstack.wsgi [None req-0f4e2677-c7a3-4526-ae7b-ccfba89bc4e8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] Calling method '.version_select at 0x7f90f870d430>' {{(pid=140876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:27:29.660807 ncdv-master-1 devstack@n-api.service[140876]: INFO nova.api.openstack.requestlog [None req-0f4e2677-c7a3-4526-ae7b-ccfba89bc4e8 tempest-TestSnapshotPattern-1498193749 tempest-TestSnapshotPattern-1498193749-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1597321056" status: 202 len: 0 microversion: 2.1 time: 0.080392 Sep 06 12:27:29.661910 ncdv-master-1 devstack@n-api.service[140876]: [pid: 140876|app: 0|req: 3833/7624] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Sep 6 12:27:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1597321056 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)